2023-12-19T13:29:34.621 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:29:34.621 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --owner scheduled_rishabh@teuthology --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765 --verbose -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/orig.config.yaml 2023-12-19T13:29:34.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:29:34.758 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765 branch: rishabh-mdscap-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7496765' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mdscap-reef ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-reef sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9974 sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c sleep_before_teardown: 0 subset: 301/512 suite: fs suite_branch: rishabh-mdscap-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi113.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCC6TrBF2XUP+csy3HGsU5ZcX6IhgF+WQz/CDZ3rq/FUSMA1eSdbJQm8cc8co/+GZEAX03xqwkaHinBuMLSbb6k= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdKVkjQGz1BKe0fpMFIl7/J2T5IuU7eVQH6u8gHcBuOp8ZZ9fZnodxtRv2XJNWpb6zF0Jv7EryCwGhNo9gsEwQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_11:42:11 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T13:29:34.759 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa; will attempt to use it 2023-12-19T13:29:34.759 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks 2023-12-19T13:29:34.760 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T13:29:34.762 INFO:teuthology.task.internal:Checking packages... 2023-12-19T13:29:34.795 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '24e2e32ab893c11f7e31ee84381b2f961d1b317c' 2023-12-19T13:29:34.795 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T13:29:34.795 INFO:teuthology.packaging:ref: None 2023-12-19T13:29:34.795 INFO:teuthology.packaging:tag: None 2023-12-19T13:29:34.795 INFO:teuthology.packaging:branch: rishabh-mdscap-reef 2023-12-19T13:29:34.796 INFO:teuthology.packaging:sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:29:34.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mdscap-reef 2023-12-19T13:29:34.938 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1377.g24e2e32a 2023-12-19T13:29:34.939 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T13:29:34.945 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T13:29:34.945 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T13:29:34.952 INFO:teuthology.task.internal:Saving configuration 2023-12-19T13:29:34.970 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T13:29:34.975 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:29:34.997 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:24:21.302689', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCC6TrBF2XUP+csy3HGsU5ZcX6IhgF+WQz/CDZ3rq/FUSMA1eSdbJQm8cc8co/+GZEAX03xqwkaHinBuMLSbb6k='} 2023-12-19T13:29:35.020 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:24:21.301481', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdKVkjQGz1BKe0fpMFIl7/J2T5IuU7eVQH6u8gHcBuOp8ZZ9fZnodxtRv2XJNWpb6zF0Jv7EryCwGhNo9gsEwQ='} 2023-12-19T13:29:35.020 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T13:29:35.026 INFO:teuthology.task.internal:roles: ubuntu@smithi113.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-19T13:29:35.026 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-19T13:29:35.026 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T13:29:35.098 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a1ec00dc0>, signals=[15]) 2023-12-19T13:29:35.099 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T13:29:35.104 INFO:teuthology.task.internal:Opening connections... 2023-12-19T13:29:35.104 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:29:35.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:29:35.189 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:29:35.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:29:35.278 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T13:29:35.284 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2023-12-19T13:29:35.302 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2023-12-19T13:29:35.302 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-19T13:29:35.359 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2023-12-19T13:29:35.359 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2023-12-19T13:29:35.359 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2023-12-19T13:29:35.359 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2023-12-19T13:29:35.359 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2023-12-19T13:29:35.359 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T13:29:35.360 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T13:29:35.361 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-19T13:29:35.385 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-12-19T13:29:35.402 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-12-19T13:29:35.403 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T13:29:35.463 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-12-19T13:29:35.464 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-12-19T13:29:35.464 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T13:29:35.464 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-12-19T13:29:35.464 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:29:35.464 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T13:29:35.464 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T13:29:35.464 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-12-19T13:29:35.485 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T13:29:35.493 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T13:29:35.498 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T13:29:35.498 DEBUG:teuthology.orchestra.run.smithi113:> test '!' -e /home/ubuntu/cephtest 2023-12-19T13:29:35.501 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-12-19T13:29:35.522 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T13:29:35.527 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T13:29:35.528 DEBUG:teuthology.orchestra.run.smithi113:> test -z $(ls -A /var/lib/ceph) 2023-12-19T13:29:35.557 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-12-19T13:29:35.685 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T13:29:35.744 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T13:29:35.758 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T13:29:35.758 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-19T13:29:35.759 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-19T13:29:35.759 DEBUG:teuthology.orchestra.run.smithi113:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T13:29:35.759 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T13:29:35.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:29:35.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-19T13:29:35.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:29:35.780 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-19T13:29:35.942 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:29:35.942 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T13:29:35.942 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-12-19T13:29:35.959 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-361.el9.x86_64 2023-12-19T13:29:35.959 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:29:35.959 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T13:29:35.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2023-12-19T13:29:36.221 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:29:36.221 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T13:29:36.221 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2023-12-19T13:29:36.240 INFO:teuthology.orchestra.run.smithi113.stdout:5.14.0-361.el9.x86_64 2023-12-19T13:29:36.240 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:29:36.241 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T13:29:36.241 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum upgrade -y linux-firmware 2023-12-19T13:29:38.720 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 6.4 MB/s | 6.4 MB 00:00 2023-12-19T13:29:38.728 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - AppStream 7.6 MB/s | 6.4 MB 00:00 2023-12-19T13:29:40.513 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 2.7 MB/s | 2.0 MB 00:00 2023-12-19T13:29:40.636 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2023-12-19T13:29:42.643 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 7.9 MB 00:01 2023-12-19T13:29:42.802 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 7.9 MB 00:01 2023-12-19T13:29:44.745 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 20 MB/s | 18 MB 00:00 2023-12-19T13:29:49.681 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.8 MB 00:01 2023-12-19T13:29:51.096 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 15 kB 00:00 2023-12-19T13:29:52.159 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2023-12-19T13:29:56.848 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-12-19T13:29:59.120 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-12-19T13:29:59.128 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T13:29:59.128 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-12-19T13:29:59.128 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T13:29:59.128 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-12-19T13:29:59.128 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-19T13:29:59.128 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:29:59.128 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-12-19T13:29:59.129 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T13:29:59.129 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 1 Package 2023-12-19T13:29:59.129 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:29:59.129 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 328 M 2023-12-19T13:29:59.129 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-12-19T13:29:59.683 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 18 MB 00:15 2023-12-19T13:30:04.833 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 5.8 MB 00:01 2023-12-19T13:30:06.400 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2023-12-19T13:30:08.262 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-19T13:30:10.590 INFO:teuthology.orchestra.run.smithi151.stdout:linux-firmware-20231030-141.el9.noarch.rpm 29 MB/s | 328 MB 00:11 2023-12-19T13:30:10.591 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:30:10.591 INFO:teuthology.orchestra.run.smithi151.stdout:Total 29 MB/s | 328 MB 00:11 2023-12-19T13:30:10.591 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-12-19T13:30:10.680 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-12-19T13:30:10.681 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-12-19T13:30:12.804 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-12-19T13:30:12.804 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-12-19T13:30:12.918 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-12-19T13:30:15.171 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout: Package Arch Version Repository Size 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrading: 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2023-12-19T13:30:15.185 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrade 1 Package 2023-12-19T13:30:15.186 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:30:15.186 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 328 M 2023-12-19T13:30:15.186 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2023-12-19T13:30:18.759 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-12-19T13:30:19.192 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T13:30:19.295 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:30:20.294 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:30:20.295 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T13:30:20.635 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:30:20.635 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:30:20.635 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-12-19T13:30:20.635 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-19T13:30:20.636 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:30:20.636 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-12-19T13:30:20.915 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T13:30:20.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:30:21.213 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-19T13:30:21.213 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-19T13:30:21.215 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2023-12-19T13:30:22.693 INFO:teuthology.orchestra.run.smithi113.stdout:linux-firmware-20231030-141.el9.noarch.rpm 44 MB/s | 328 MB 00:07 2023-12-19T13:30:22.694 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:30:22.694 INFO:teuthology.orchestra.run.smithi113.stdout:Total 44 MB/s | 328 MB 00:07 2023-12-19T13:30:22.695 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2023-12-19T13:30:22.788 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2023-12-19T13:30:22.788 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2023-12-19T13:30:25.004 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2023-12-19T13:30:25.005 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2023-12-19T13:30:30.815 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2023-12-19T13:30:31.226 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T13:30:31.307 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:30:32.315 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:30:32.315 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T13:30:32.724 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:30:32.724 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:30:32.725 INFO:teuthology.orchestra.run.smithi113.stdout:Upgraded: 2023-12-19T13:30:32.725 INFO:teuthology.orchestra.run.smithi113.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-19T13:30:32.725 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:30:32.725 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2023-12-19T13:30:33.022 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T13:30:33.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:30:33.164 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-19T13:30:33.165 DEBUG:teuthology.orchestra.run.smithi113:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-19T13:30:33.167 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi113.front.sepia.ceph.com to complete... 2023-12-19T13:30:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19 13:30:34 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-19T13:30:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2023-12-19 13:30:34-- 2023-12-19T13:30:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 13s 2023-12-19T13:30:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 306M in 13s (24.5 MB/s) 2023-12-19T13:30:34.010 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T13:30:34.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-19T13:30:35.857 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2023-12-19T13:30:35.946 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2023-12-19T13:30:36.026 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2023-12-19T13:30:43.145 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-19T13:30:59.102 INFO:teuthology.orchestra.run.smithi151.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-19T13:31:02.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19 13:31:02 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-19T13:31:02.846 INFO:teuthology.orchestra.run.smithi113.stderr:FINISHED --2023-12-19 13:31:02-- 2023-12-19T13:31:02.846 INFO:teuthology.orchestra.run.smithi113.stderr:Total wall clock time: 30s 2023-12-19T13:31:02.846 INFO:teuthology.orchestra.run.smithi113.stderr:Downloaded: 1 files, 306M in 29s (10.5 MB/s) 2023-12-19T13:31:02.849 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T13:31:02.850 DEBUG:teuthology.orchestra.run.smithi113:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-19T13:31:04.703 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying... ######################################## 2023-12-19T13:31:04.824 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing... ######################################## 2023-12-19T13:31:04.904 INFO:teuthology.orchestra.run.smithi113.stdout:Updating / installing... 2023-12-19T13:31:12.112 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-19T13:31:20.209 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-19T13:31:20.209 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-19T13:31:20.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T13:31:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T13:31:20.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T13:31:20.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T13:31:20.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T13:31:20.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T13:31:20.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T13:31:20.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T13:31:20.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-19T13:31:20.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T13:31:20.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-19T13:31:20.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-19T13:31:20.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T13:31:20.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-19T13:31:20.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-19T13:31:20.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T13:31:20.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T13:31:20.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T13:31:20.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T13:31:20.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T13:31:20.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T13:31:20.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-19T13:31:20.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T13:31:20.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T13:31:20.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T13:31:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T13:31:20.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T13:31:20.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T13:31:20.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T13:31:20.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T13:31:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T13:31:20.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T13:31:20.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T13:31:20.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T13:31:20.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-19T13:31:20.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-19T13:31:20.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T13:31:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T13:31:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T13:31:20.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T13:31:20.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-19T13:31:20.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T13:31:20.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-19T13:31:20.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T13:31:20.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T13:31:20.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-19T13:31:20.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-19T13:31:20.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T13:31:20.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T13:31:20.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T13:31:20.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T13:31:20.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T13:31:20.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-19T13:31:20.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T13:31:20.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-19T13:31:20.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T13:31:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-19T13:31:20.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T13:31:20.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T13:31:20.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-19T13:31:20.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-19T13:31:20.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-19T13:31:20.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T13:31:20.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T13:31:20.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T13:31:20.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T13:31:20.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-19T13:31:20.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T13:31:20.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-19T13:31:20.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-19T13:31:20.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-19T13:31:20.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T13:31:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T13:31:20.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-19T13:31:20.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-19T13:31:20.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T13:31:20.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-19T13:31:20.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T13:31:20.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T13:31:20.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T13:31:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T13:31:20.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T13:31:20.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T13:31:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-19T13:31:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-19T13:31:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T13:31:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T13:31:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T13:31:20.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T13:31:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-19T13:31:20.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-19T13:31:20.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-19T13:31:20.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T13:31:20.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-19T13:31:20.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T13:31:20.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-19T13:31:20.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T13:31:20.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-19T13:31:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T13:31:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-19T13:31:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T13:31:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-19T13:31:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T13:31:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-19T13:31:20.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T13:31:20.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T13:31:20.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T13:31:20.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-19T13:31:20.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T13:31:20.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-19T13:31:20.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-19T13:31:20.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T13:31:20.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T13:31:20.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T13:31:20.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T13:31:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T13:31:20.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-19T13:31:20.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T13:31:20.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T13:31:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T13:31:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T13:31:20.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T13:31:20.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T13:31:20.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T13:31:20.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T13:31:20.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T13:31:20.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T13:31:20.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T13:31:20.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T13:31:20.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-19T13:31:20.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T13:31:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T13:31:20.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T13:31:20.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T13:31:20.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T13:31:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-19T13:31:20.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T13:31:20.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T13:31:20.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T13:31:20.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-19T13:31:20.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-19T13:31:20.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T13:31:20.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T13:31:20.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T13:31:20.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T13:31:20.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T13:31:20.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T13:31:20.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T13:31:20.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T13:31:20.413 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.413 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-19T13:31:20.435 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.436 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-19T13:31:20.437 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-19T13:31:20.437 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-19T13:31:20.437 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.437 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-19T13:31:20.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 68.el9 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2023-12-19T13:31:20.512 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8264254 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T13:31:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T13:31:20.514 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-12-19T13:31:20.514 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:31:20.514 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T13:31:20.515 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T13:31:20.515 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.6.0-gcd68252d7b4d 2023-12-19T13:31:20.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T13:31:21.127 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-12-19T13:31:22.504 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T13:31:22.542 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-12-19T13:31:22.545 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-12-19T13:31:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.ErFy0jV4C8 2023-12-19T13:31:22.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ErFy0jV4C8 2023-12-19T13:31:22.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.ErFy0jV4C8 2023-12-19T13:31:22.769 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.ErFy0jV4C8 is 6KB 2023-12-19T13:31:22.818 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.ErFy0jV4C8 2023-12-19T13:31:22.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T13:31:22.897 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T13:31:22.898 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T13:31:22.898 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T13:31:22.898 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-19T13:31:22.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-19T13:31:23.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-12-19T13:31:25.760 INFO:teuthology.orchestra.run.smithi113.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-19T13:31:47.099 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi113.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-19T13:31:47.100 DEBUG:teuthology.orchestra.run.smithi113:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T13:31:47.168 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T13:31:47.169 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-19T13:31:47.170 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T13:31:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T13:31:47.172 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T13:31:47.173 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T13:31:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T13:31:47.175 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T13:31:47.176 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T13:31:47.177 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T13:31:47.178 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T13:31:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-19T13:31:47.180 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T13:31:47.181 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-19T13:31:47.182 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T13:31:47.183 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-19T13:31:47.184 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-19T13:31:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T13:31:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T13:31:47.187 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T13:31:47.188 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T13:31:47.189 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T13:31:47.190 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T13:31:47.191 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T13:31:47.192 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T13:31:47.193 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T13:31:47.194 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T13:31:47.195 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T13:31:47.196 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T13:31:47.197 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T13:31:47.198 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T13:31:47.199 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T13:31:47.200 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-19T13:31:47.201 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-19T13:31:47.202 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T13:31:47.203 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T13:31:47.204 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-19T13:31:47.205 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T13:31:47.206 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T13:31:47.207 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T13:31:47.208 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T13:31:47.209 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T13:31:47.210 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T13:31:47.211 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-19T13:31:47.212 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-19T13:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T13:31:47.214 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T13:31:47.215 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T13:31:47.216 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-19T13:31:47.217 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T13:31:47.218 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-19T13:31:47.219 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-19T13:31:47.220 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T13:31:47.221 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T13:31:47.222 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-19T13:31:47.223 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T13:31:47.224 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-19T13:31:47.225 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T13:31:47.226 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-19T13:31:47.227 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T13:31:47.228 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T13:31:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T13:31:47.230 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-19T13:31:47.231 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T13:31:47.231 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T13:31:47.231 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-19T13:31:47.231 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-19T13:31:47.231 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T13:31:47.231 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T13:31:47.232 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T13:31:47.233 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T13:31:47.234 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T13:31:47.235 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-19T13:31:47.236 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-19T13:31:47.237 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T13:31:47.238 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T13:31:47.239 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-19T13:31:47.240 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T13:31:47.241 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-19T13:31:47.242 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-19T13:31:47.243 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-19T13:31:47.244 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T13:31:47.245 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T13:31:47.246 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T13:31:47.247 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T13:31:47.248 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T13:31:47.249 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T13:31:47.250 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-19T13:31:47.251 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-19T13:31:47.252 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T13:31:47.253 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T13:31:47.254 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-19T13:31:47.255 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T13:31:47.256 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T13:31:47.257 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T13:31:47.258 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-19T13:31:47.259 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T13:31:47.260 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-19T13:31:47.261 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T13:31:47.262 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T13:31:47.263 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T13:31:47.264 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T13:31:47.265 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T13:31:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-19T13:31:47.267 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-19T13:31:47.268 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-19T13:31:47.269 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T13:31:47.270 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T13:31:47.271 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T13:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T13:31:47.273 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-19T13:31:47.274 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T13:31:47.275 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T13:31:47.276 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T13:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T13:31:47.278 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T13:31:47.279 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T13:31:47.280 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T13:31:47.281 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T13:31:47.282 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T13:31:47.283 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T13:31:47.284 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T13:31:47.285 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T13:31:47.286 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T13:31:47.287 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T13:31:47.288 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T13:31:47.289 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T13:31:47.290 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T13:31:47.291 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T13:31:47.292 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T13:31:47.293 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T13:31:47.294 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T13:31:47.295 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T13:31:47.296 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T13:31:47.297 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T13:31:47.298 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T13:31:47.299 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T13:31:47.300 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T13:31:47.300 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T13:31:47.300 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T13:31:47.300 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T13:31:47.300 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T13:31:47.300 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T13:31:47.300 INFO:teuthology.orchestra.run.smithi113.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T13:31:47.300 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.300 DEBUG:teuthology.orchestra.run.smithi113:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-19T13:31:47.322 INFO:teuthology.orchestra.run.smithi113.stdout:postinstall scriptlet (using /bin/sh): 2023-12-19T13:31:47.322 INFO:teuthology.orchestra.run.smithi113.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-19T13:31:47.322 INFO:teuthology.orchestra.run.smithi113.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:47.322 INFO:teuthology.orchestra.run.smithi113.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:47.322 INFO:teuthology.orchestra.run.smithi113.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:fi 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:fi 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.323 INFO:teuthology.orchestra.run.smithi113.stdout:fi 2023-12-19T13:31:47.324 DEBUG:teuthology.orchestra.run.smithi113:> sudo rpm -qi grub2-tools 2023-12-19T13:31:47.398 INFO:teuthology.orchestra.run.smithi113.stdout:Name : grub2-tools 2023-12-19T13:31:47.398 INFO:teuthology.orchestra.run.smithi113.stdout:Epoch : 1 2023-12-19T13:31:47.398 INFO:teuthology.orchestra.run.smithi113.stdout:Version : 2.06 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Release : 68.el9 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Architecture: x86_64 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Group : Unspecified 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Size : 8264254 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:License : GPLv3+ 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Packager : builder@centos.org 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Vendor : CentOS 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Summary : Support tools for GRUB. 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout:Description : 2023-12-19T13:31:47.399 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:31:47.400 INFO:teuthology.orchestra.run.smithi113.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T13:31:47.400 INFO:teuthology.orchestra.run.smithi113.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T13:31:47.400 INFO:teuthology.orchestra.run.smithi113.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T13:31:47.400 INFO:teuthology.orchestra.run.smithi113.stdout:hardware devices. 2023-12-19T13:31:47.400 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:31:47.400 INFO:teuthology.orchestra.run.smithi113.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T13:31:47.401 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T13:31:47.401 INFO:teuthology.task.kernel:Updating grub on smithi113 to boot 6.6.0-gcd68252d7b4d 2023-12-19T13:31:47.401 DEBUG:teuthology.orchestra.run.smithi113:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T13:31:47.985 INFO:teuthology.orchestra.run.smithi113.stderr:Generating grub configuration file ... 2023-12-19T13:31:49.251 INFO:teuthology.orchestra.run.smithi113.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T13:31:49.291 INFO:teuthology.orchestra.run.smithi113.stderr:done 2023-12-19T13:31:49.294 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2023-12-19T13:31:49.308 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.0eUL1z359S 2023-12-19T13:31:49.309 DEBUG:teuthology.orchestra.run.smithi113:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0eUL1z359S 2023-12-19T13:31:49.377 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.0eUL1z359S 2023-12-19T13:31:49.516 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.0eUL1z359S is 6KB 2023-12-19T13:31:49.564 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.0eUL1z359S 2023-12-19T13:31:49.578 DEBUG:teuthology.orchestra.run.smithi113:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T13:31:49.642 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T13:31:49.642 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T13:31:49.642 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T13:31:49.642 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-19T13:31:49.644 DEBUG:teuthology.orchestra.run.smithi113:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-19T13:31:49.815 DEBUG:teuthology.orchestra.run.smithi113:> sudo shutdown -r now 2023-12-19T13:31:53.074 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-19T13:31:53.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T13:31:53.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:32:19.845 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-19T13:32:19.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-19T13:32:19.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:32:27.537 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-19T13:32:36.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T13:32:36.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:32:54.418 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-19T13:32:54.929 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-19T13:33:03.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-19T13:33:03.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:33:06.481 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-19T13:33:06.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T13:33:06.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:33:10.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-19T13:33:18.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-19T13:33:18.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:33:25.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T13:33:25.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:33:25.414 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-12-19T13:33:26.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T13:33:26.090 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-19T13:33:26.091 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-12-19T13:33:26.134 INFO:teuthology.orchestra.run.smithi151.stdout:6.6.0-gcd68252d7b4d 2023-12-19T13:33:26.134 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T13:33:26.134 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T13:33:26.134 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T13:33:27.136 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:50.391 DEBUG:teuthology.orchestra.run.smithi113:> true 2023-12-19T13:33:50.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-19T13:33:50.953 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-19T13:33:50.954 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2023-12-19T13:33:50.994 INFO:teuthology.orchestra.run.smithi113.stdout:6.6.0-gcd68252d7b4d 2023-12-19T13:33:50.994 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T13:33:50.994 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T13:33:50.994 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T13:33:51.996 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:51.996 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T13:33:52.007 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T13:33:52.008 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T13:33:52.018 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T13:33:52.077 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T13:33:52.086 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T13:33:52.097 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T13:33:52.097 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T13:33:52.104 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T13:33:52.175 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T13:33:52.182 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T13:33:52.182 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T13:33:52.190 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T13:33:52.321 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:33:52.380 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:33:52.388 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:33:52.452 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:33:52.457 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T13:33:52.464 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T13:33:52.464 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T13:33:52.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T13:33:52.573 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T13:33:52.584 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T13:33:52.584 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T13:33:52.591 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T13:33:52.645 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:33:52.749 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:33:52.834 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:33:52.906 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:33:52.997 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:33:52.997 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T13:33:53.069 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:33:53.158 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:33:53.269 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:33:53.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:33:53.455 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:33:53.455 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T13:33:53.552 DEBUG:teuthology.orchestra.run.smithi113:> sudo service rsyslog restart 2023-12-19T13:33:53.564 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-12-19T13:33:53.678 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T13:33:53.732 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T13:33:54.047 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T13:33:54.056 INFO:teuthology.task.internal:Starting timer... 2023-12-19T13:33:54.056 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T13:33:54.069 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T13:33:54.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo service auditd rotate 2023-12-19T13:33:54.236 INFO:teuthology.orchestra.run.smithi113.stdout:Rotating logs: 2023-12-19T13:33:54.240 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-12-19T13:33:54.375 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-12-19T13:33:54.380 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T13:33:54.380 DEBUG:teuthology.orchestra.run.smithi113:> /usr/sbin/getenforce 2023-12-19T13:33:54.437 INFO:teuthology.orchestra.run.smithi113.stdout:Permissive 2023-12-19T13:33:54.437 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-12-19T13:33:54.501 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-12-19T13:33:54.501 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi113.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-12-19T13:33:54.502 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T13:33:54.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:33:54.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T13:33:54.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:33:54.670 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T13:33:54.671 DEBUG:teuthology.orchestra.run.smithi113:> sudo /usr/sbin/setenforce permissive 2023-12-19T13:33:54.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-12-19T13:33:54.888 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T13:33:54.898 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-19T13:33:54.898 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T13:33:54.915 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T13:33:54.917 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi113.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T13:43:51.670 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi113.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-12-19T13:43:51.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-19T13:43:51.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:51.817 DEBUG:teuthology.orchestra.run.smithi113:> true 2023-12-19T13:43:51.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-19T13:43:51.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T13:43:51.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:52.110 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-12-19T13:43:52.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T13:43:52.256 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T13:43:52.267 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T13:43:52.267 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T13:43:52.268 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T13:43:52.277 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T13:43:52.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T13:43:52.375 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T13:43:52.384 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T13:43:52.430 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T13:43:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T13:43:52.526 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: ntpd: command not found 2023-12-19T13:43:52.539 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-12-19T13:43:52.568 INFO:teuthology.orchestra.run.smithi113.stdout:506 Cannot talk to daemon 2023-12-19T13:43:52.582 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-12-19T13:43:52.617 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T13:43:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T13:43:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T13:43:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T13:43:52.791 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2023-12-19T13:43:52.798 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T13:43:52.798 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2023-12-19T13:43:52.798 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.798 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.798 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.798 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.812 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-12-19T13:43:52.823 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T13:43:52.823 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-12-19T13:43:52.823 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.823 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.823 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.823 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:43:52.825 INFO:teuthology.run_tasks:Running task install... 2023-12-19T13:43:52.834 DEBUG:teuthology.task.install:project ceph 2023-12-19T13:43:52.834 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}} 2023-12-19T13:43:52.834 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'} 2023-12-19T13:43:52.835 INFO:teuthology.task.install:Using flavor: default 2023-12-19T13:43:52.841 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T13:43:52.841 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T13:43:52.841 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T13:43:52.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:43:52.844 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T13:43:52.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:43:52.983 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T13:43:52.984 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T13:43:53.068 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T13:43:53.069 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T13:43:53.154 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T13:43:53.154 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:43:53.154 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T13:43:53.236 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T13:43:53.237 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:43:53.237 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T13:43:53.258 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T13:43:53.258 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T13:43:53.340 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T13:43:53.340 DEBUG:teuthology.orchestra.run.smithi113:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T13:43:53.403 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T13:43:53.489 DEBUG:teuthology.orchestra.run.smithi113:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T13:43:53.539 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T13:43:53.622 DEBUG:teuthology.orchestra.run.smithi113:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T13:43:53.630 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-12-19T13:43:53.634 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-12-19T13:43:53.709 INFO:teuthology.orchestra.run.smithi113.stdout:check_obsoletes = 1 2023-12-19T13:43:53.713 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum clean all 2023-12-19T13:43:54.003 INFO:teuthology.orchestra.run.smithi151.stdout:73 files removed 2023-12-19T13:43:54.042 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T13:43:54.065 INFO:teuthology.orchestra.run.smithi113.stdout:73 files removed 2023-12-19T13:43:54.106 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T13:43:55.061 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 151 kB/s | 77 kB 00:00 2023-12-19T13:43:55.183 INFO:teuthology.orchestra.run.smithi113.stdout:ceph packages for x86_64 135 kB/s | 77 kB 00:00 2023-12-19T13:43:55.511 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 27 kB/s | 9.5 kB 00:00 2023-12-19T13:43:55.758 INFO:teuthology.orchestra.run.smithi113.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-19T13:43:55.954 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2023-12-19T13:43:56.300 INFO:teuthology.orchestra.run.smithi113.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2023-12-19T13:43:56.626 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-19T13:43:56.929 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-19T13:43:58.260 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-12-19T13:43:58.638 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2023-12-19T13:43:59.328 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-12-19T13:43:59.725 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-12-19T13:44:02.509 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-12-19T13:44:03.039 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 7.3 MB/s | 18 MB 00:02 2023-12-19T13:44:06.918 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 5.8 MB 00:00 2023-12-19T13:44:07.564 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 5.8 MB 00:00 2023-12-19T13:44:08.702 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2023-12-19T13:44:09.491 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 15 kB 00:00 2023-12-19T13:44:10.562 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-19T13:44:10.709 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-12-19T13:44:16.070 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-12-19T13:44:16.226 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-19T13:44:18.706 INFO:teuthology.orchestra.run.smithi113.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:44:18.708 INFO:teuthology.orchestra.run.smithi113.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:44:18.728 INFO:teuthology.orchestra.run.smithi113.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T13:44:18.730 INFO:teuthology.orchestra.run.smithi113.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T13:44:18.731 INFO:teuthology.orchestra.run.smithi113.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T13:44:18.732 INFO:teuthology.orchestra.run.smithi113.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T13:44:18.735 INFO:teuthology.orchestra.run.smithi113.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T13:44:18.739 INFO:teuthology.orchestra.run.smithi113.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T13:44:18.740 INFO:teuthology.orchestra.run.smithi113.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:44:18.818 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2023-12-19T13:44:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:44:18.828 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:44:18.832 INFO:teuthology.orchestra.run.smithi113.stdout:============================================================================================ 2023-12-19T13:44:18.832 INFO:teuthology.orchestra.run.smithi113.stdout: Package Arch Version Repository Size 2023-12-19T13:44:18.832 INFO:teuthology.orchestra.run.smithi113.stdout:============================================================================================ 2023-12-19T13:44:18.832 INFO:teuthology.orchestra.run.smithi113.stdout:Installing: 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T13:44:18.833 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T13:44:18.834 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T13:44:18.835 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrading: 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T13:44:18.836 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T13:44:18.837 INFO:teuthology.orchestra.run.smithi113.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout:Installing dependencies: 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T13:44:18.838 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T13:44:18.839 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T13:44:18.840 INFO:teuthology.orchestra.run.smithi113.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T13:44:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T13:44:18.842 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T13:44:18.843 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T13:44:18.844 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T13:44:18.845 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T13:44:18.846 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout:Installing weak dependencies: 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout:============================================================================================ 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout:Install 139 Packages 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrade 15 Packages 2023-12-19T13:44:18.847 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:44:18.848 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T13:44:18.848 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 200 M 2023-12-19T13:44:18.848 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2023-12-19T13:44:18.849 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T13:44:18.849 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T13:44:18.851 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T13:44:18.853 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T13:44:18.856 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T13:44:18.858 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:44:18.936 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-12-19T13:44:18.972 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-12-19T13:44:18.972 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-12-19T13:44:18.972 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T13:44:18.973 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T13:44:18.974 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T13:44:18.975 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T13:44:18.976 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T13:44:18.977 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T13:44:18.978 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T13:44:18.979 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T13:44:18.980 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T13:44:18.981 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T13:44:18.982 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T13:44:18.983 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T13:44:18.984 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-12-19T13:44:18.985 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-12-19T13:44:18.986 INFO:teuthology.orchestra.run.smithi151.stdout:Install 139 Packages 2023-12-19T13:44:18.986 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 15 Packages 2023-12-19T13:44:18.986 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:44:18.986 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 200 M 2023-12-19T13:44:18.986 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-12-19T13:44:19.729 INFO:teuthology.orchestra.run.smithi113.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2023-12-19T13:44:20.062 INFO:teuthology.orchestra.run.smithi151.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-12-19T13:44:20.312 INFO:teuthology.orchestra.run.smithi113.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.4 MB/s | 839 kB 00:00 2023-12-19T13:44:20.446 INFO:teuthology.orchestra.run.smithi113.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 1.1 MB/s | 142 kB 00:00 2023-12-19T13:44:20.788 INFO:teuthology.orchestra.run.smithi113.stdout:(4/154): ceph-common-18.2.0-1377.g24e2e32a.el9. 14 MB/s | 18 MB 00:01 2023-12-19T13:44:20.820 INFO:teuthology.orchestra.run.smithi151.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.1 MB/s | 839 kB 00:00 2023-12-19T13:44:20.905 INFO:teuthology.orchestra.run.smithi113.stdout:(5/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 13 MB/s | 1.4 MB 00:00 2023-12-19T13:44:20.937 INFO:teuthology.orchestra.run.smithi151.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 1.2 MB/s | 142 kB 00:00 2023-12-19T13:44:21.197 INFO:teuthology.orchestra.run.smithi113.stdout:(6/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 15 MB/s | 4.4 MB 00:00 2023-12-19T13:44:21.364 INFO:teuthology.orchestra.run.smithi113.stdout:(7/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 2.3 MB/s | 2.1 MB 00:00 2023-12-19T13:44:21.846 INFO:teuthology.orchestra.run.smithi151.stdout:(4/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 2.5 MB/s | 5.2 MB 00:02 2023-12-19T13:44:22.221 INFO:teuthology.orchestra.run.smithi151.stdout:(5/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 3.9 MB/s | 1.4 MB 00:00 2023-12-19T13:44:22.247 INFO:teuthology.orchestra.run.smithi113.stdout:(8/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x86 17 MB/s | 18 MB 00:01 2023-12-19T13:44:22.298 INFO:teuthology.orchestra.run.smithi113.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 494 kB/s | 24 kB 00:00 2023-12-19T13:44:23.064 INFO:teuthology.orchestra.run.smithi113.stdout:(10/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el 4.5 MB/s | 7.7 MB 00:01 2023-12-19T13:44:23.146 INFO:teuthology.orchestra.run.smithi151.stdout:(6/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 977 kB/s | 2.1 MB 00:02 2023-12-19T13:44:23.148 INFO:teuthology.orchestra.run.smithi113.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 2.6 MB/s | 219 kB 00:00 2023-12-19T13:44:23.257 INFO:teuthology.orchestra.run.smithi113.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 250 kB/s | 27 kB 00:00 2023-12-19T13:44:23.340 INFO:teuthology.orchestra.run.smithi113.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 378 kB/s | 31 kB 00:00 2023-12-19T13:44:23.524 INFO:teuthology.orchestra.run.smithi113.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 3.5 MB/s | 658 kB 00:00 2023-12-19T13:44:23.690 INFO:teuthology.orchestra.run.smithi113.stdout:(15/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x 1.2 MB/s | 5.2 MB 00:04 2023-12-19T13:44:23.724 INFO:teuthology.orchestra.run.smithi113.stdout:(16/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 832 kB/s | 166 kB 00:00 2023-12-19T13:44:23.858 INFO:teuthology.orchestra.run.smithi113.stdout:(17/154): librados-devel-18.2.0-1377.g24e2e32a. 763 kB/s | 127 kB 00:00 2023-12-19T13:44:23.891 INFO:teuthology.orchestra.run.smithi113.stdout:(18/154): libradosstriper1-18.2.0-1377.g24e2e32 2.8 MB/s | 474 kB 00:00 2023-12-19T13:44:23.905 INFO:teuthology.orchestra.run.smithi151.stdout:(7/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 2.6 MB/s | 4.4 MB 00:01 2023-12-19T13:44:23.984 INFO:teuthology.orchestra.run.smithi113.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 494 kB/s | 45 kB 00:00 2023-12-19T13:44:24.084 INFO:teuthology.orchestra.run.smithi113.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 1.2 MB/s | 124 kB 00:00 2023-12-19T13:44:24.184 INFO:teuthology.orchestra.run.smithi113.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 1.6 MB/s | 162 kB 00:00 2023-12-19T13:44:24.626 INFO:teuthology.orchestra.run.smithi113.stdout:(22/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 17 MB/s | 40 MB 00:02 2023-12-19T13:44:24.685 INFO:teuthology.orchestra.run.smithi113.stdout:(23/154): python3-rados-18.2.0-1377.g24e2e32a.e 639 kB/s | 319 kB 00:00 2023-12-19T13:44:24.718 INFO:teuthology.orchestra.run.smithi113.stdout:(24/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 3.2 MB/s | 297 kB 00:00 2023-12-19T13:44:24.752 INFO:teuthology.orchestra.run.smithi113.stdout:(25/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.5 MB/s | 99 kB 00:00 2023-12-19T13:44:24.778 INFO:teuthology.orchestra.run.smithi113.stdout:(26/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.5 MB/s | 87 kB 00:00 2023-12-19T13:44:24.828 INFO:teuthology.orchestra.run.smithi113.stdout:(27/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 3.4 MB/s | 171 kB 00:00 2023-12-19T13:44:24.878 INFO:teuthology.orchestra.run.smithi113.stdout:(28/154): ceph-grafana-dashboards-18.2.0-1377.g 475 kB/s | 23 kB 00:00 2023-12-19T13:44:24.928 INFO:teuthology.orchestra.run.smithi113.stdout:(29/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 2.6 MB/s | 132 kB 00:00 2023-12-19T13:44:25.109 INFO:teuthology.orchestra.run.smithi113.stdout:(30/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 9.8 MB/s | 1.8 MB 00:00 2023-12-19T13:44:25.226 INFO:teuthology.orchestra.run.smithi113.stdout:(31/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 6.3 MB/s | 3.0 MB 00:00 2023-12-19T13:44:25.334 INFO:teuthology.orchestra.run.smithi113.stdout:(32/154): ceph-mgr-modules-core-18.2.0-1377.g24 2.2 MB/s | 242 kB 00:00 2023-12-19T13:44:25.435 INFO:teuthology.orchestra.run.smithi113.stdout:(33/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 506 kB/s | 50 kB 00:00 2023-12-19T13:44:25.580 INFO:teuthology.orchestra.run.smithi151.stdout:(8/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 4.6 MB/s | 7.7 MB 00:01 2023-12-19T13:44:25.593 INFO:teuthology.orchestra.run.smithi113.stdout:(34/154): ceph-mgr-diskprediction-local-18.2.0- 15 MB/s | 7.4 MB 00:00 2023-12-19T13:44:25.619 INFO:teuthology.orchestra.run.smithi113.stdout:(35/154): ceph-prometheus-alerts-18.2.0-1377.g2 80 kB/s | 15 kB 00:00 2023-12-19T13:44:25.622 INFO:teuthology.orchestra.run.smithi151.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 591 kB/s | 24 kB 00:00 2023-12-19T13:44:25.660 INFO:teuthology.orchestra.run.smithi113.stdout:(36/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 3.9 MB/s | 262 kB 00:00 2023-12-19T13:44:25.694 INFO:teuthology.orchestra.run.smithi113.stdout:(37/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 2.9 MB/s | 221 kB 00:00 2023-12-19T13:44:25.720 INFO:teuthology.orchestra.run.smithi113.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 314 kB/s | 18 kB 00:00 2023-12-19T13:44:25.945 INFO:teuthology.orchestra.run.smithi113.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2023-12-19T13:44:25.995 INFO:teuthology.orchestra.run.smithi113.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 920 kB 00:00 2023-12-19T13:44:26.020 INFO:teuthology.orchestra.run.smithi113.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2023-12-19T13:44:26.037 INFO:teuthology.orchestra.run.smithi113.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 537 kB/s | 21 kB 00:00 2023-12-19T13:44:26.079 INFO:teuthology.orchestra.run.smithi113.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-19T13:44:26.096 INFO:teuthology.orchestra.run.smithi113.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 573 kB/s | 32 kB 00:00 2023-12-19T13:44:26.196 INFO:teuthology.orchestra.run.smithi113.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2023-12-19T13:44:26.222 INFO:teuthology.orchestra.run.smithi113.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 164 kB/s | 17 kB 00:00 2023-12-19T13:44:26.263 INFO:teuthology.orchestra.run.smithi113.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 4.5 MB/s | 186 kB 00:00 2023-12-19T13:44:26.289 INFO:teuthology.orchestra.run.smithi113.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 154 kB/s | 10 kB 00:00 2023-12-19T13:44:26.331 INFO:teuthology.orchestra.run.smithi113.stdout:(49/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2023-12-19T13:44:26.356 INFO:teuthology.orchestra.run.smithi113.stdout:(50/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2023-12-19T13:44:26.398 INFO:teuthology.orchestra.run.smithi113.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 10 MB/s | 661 kB 00:00 2023-12-19T13:44:26.440 INFO:teuthology.orchestra.run.smithi113.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2023-12-19T13:44:26.465 INFO:teuthology.orchestra.run.smithi113.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 394 kB/s | 24 kB 00:00 2023-12-19T13:44:26.491 INFO:teuthology.orchestra.run.smithi113.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 937 kB/s | 46 kB 00:00 2023-12-19T13:44:26.524 INFO:teuthology.orchestra.run.smithi113.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-19T13:44:26.558 INFO:teuthology.orchestra.run.smithi113.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-12-19T13:44:26.583 INFO:teuthology.orchestra.run.smithi113.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 615 kB/s | 34 kB 00:00 2023-12-19T13:44:26.742 INFO:teuthology.orchestra.run.smithi113.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-12-19T13:44:26.792 INFO:teuthology.orchestra.run.smithi113.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 8.0 MB/s | 1.5 MB 00:00 2023-12-19T13:44:26.842 INFO:teuthology.orchestra.run.smithi113.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 8.0 MB/s | 811 kB 00:00 2023-12-19T13:44:26.868 INFO:teuthology.orchestra.run.smithi113.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2023-12-19T13:44:27.026 INFO:teuthology.orchestra.run.smithi113.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2023-12-19T13:44:27.051 INFO:teuthology.orchestra.run.smithi113.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 487 kB/s | 78 kB 00:00 2023-12-19T13:44:27.168 INFO:teuthology.orchestra.run.smithi113.stdout:(64/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 1.3 MB/s | 4.5 MB 00:03 2023-12-19T13:44:27.202 INFO:teuthology.orchestra.run.smithi113.stdout:(65/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.5 MB/s | 228 kB 00:00 2023-12-19T13:44:27.344 INFO:teuthology.orchestra.run.smithi113.stdout:(66/154): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-12-19T13:44:27.369 INFO:teuthology.orchestra.run.smithi113.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 122 kB/s | 24 kB 00:00 2023-12-19T13:44:27.397 INFO:teuthology.orchestra.run.smithi113.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 102 kB/s | 18 kB 00:00 2023-12-19T13:44:27.436 INFO:teuthology.orchestra.run.smithi113.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 783 kB/s | 32 kB 00:00 2023-12-19T13:44:27.486 INFO:teuthology.orchestra.run.smithi113.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2023-12-19T13:44:27.620 INFO:teuthology.orchestra.run.smithi113.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2023-12-19T13:44:27.645 INFO:teuthology.orchestra.run.smithi113.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-12-19T13:44:27.679 INFO:teuthology.orchestra.run.smithi113.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2023-12-19T13:44:27.704 INFO:teuthology.orchestra.run.smithi113.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 738 kB/s | 41 kB 00:00 2023-12-19T13:44:27.729 INFO:teuthology.orchestra.run.smithi113.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2023-12-19T13:44:27.755 INFO:teuthology.orchestra.run.smithi113.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2023-12-19T13:44:27.780 INFO:teuthology.orchestra.run.smithi113.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 998 kB/s | 47 kB 00:00 2023-12-19T13:44:27.805 INFO:teuthology.orchestra.run.smithi113.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 592 kB/s | 43 kB 00:00 2023-12-19T13:44:27.931 INFO:teuthology.orchestra.run.smithi151.stdout:(10/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 3.7 MB/s | 18 MB 00:04 2023-12-19T13:44:28.006 INFO:teuthology.orchestra.run.smithi151.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 2.9 MB/s | 219 kB 00:00 2023-12-19T13:44:28.056 INFO:teuthology.orchestra.run.smithi151.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 551 kB/s | 27 kB 00:00 2023-12-19T13:44:28.115 INFO:teuthology.orchestra.run.smithi151.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 540 kB/s | 31 kB 00:00 2023-12-19T13:44:28.147 INFO:teuthology.orchestra.run.smithi113.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2023-12-19T13:44:28.172 INFO:teuthology.orchestra.run.smithi113.stdout:(80/154): python3-toml-0.10.2-6.el9.noarch.rpm 111 kB/s | 39 kB 00:00 2023-12-19T13:44:28.197 INFO:teuthology.orchestra.run.smithi113.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 110 kB/s | 41 kB 00:00 2023-12-19T13:44:28.231 INFO:teuthology.orchestra.run.smithi113.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 300 kB 00:00 2023-12-19T13:44:28.256 INFO:teuthology.orchestra.run.smithi113.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-12-19T13:44:28.257 INFO:teuthology.orchestra.run.smithi151.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 4.6 MB/s | 658 kB 00:00 2023-12-19T13:44:28.281 INFO:teuthology.orchestra.run.smithi113.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.0 MB/s | 85 kB 00:00 2023-12-19T13:44:28.298 INFO:teuthology.orchestra.run.smithi113.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 63 kB 00:00 2023-12-19T13:44:28.315 INFO:teuthology.orchestra.run.smithi151.stdout:(15/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 2.8 MB/s | 166 kB 00:00 2023-12-19T13:44:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:(86/154): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2023-12-19T13:44:28.349 INFO:teuthology.orchestra.run.smithi113.stdout:(87/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 667 kB/s | 44 kB 00:00 2023-12-19T13:44:28.366 INFO:teuthology.orchestra.run.smithi151.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 2.5 MB/s | 127 kB 00:00 2023-12-19T13:44:28.382 INFO:teuthology.orchestra.run.smithi113.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.5 MB/s | 803 kB 00:00 2023-12-19T13:44:28.437 INFO:teuthology.orchestra.run.smithi113.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2023-12-19T13:44:28.466 INFO:teuthology.orchestra.run.smithi151.stdout:(17/154): libradosstriper1-18.2.0-1377.g24e2e32 4.7 MB/s | 474 kB 00:00 2023-12-19T13:44:28.483 INFO:teuthology.orchestra.run.smithi113.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2023-12-19T13:44:28.517 INFO:teuthology.orchestra.run.smithi113.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.1 MB 00:00 2023-12-19T13:44:28.542 INFO:teuthology.orchestra.run.smithi113.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 993 kB/s | 103 kB 00:00 2023-12-19T13:44:28.567 INFO:teuthology.orchestra.run.smithi113.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-12-19T13:44:28.617 INFO:teuthology.orchestra.run.smithi113.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-12-19T13:44:28.651 INFO:teuthology.orchestra.run.smithi113.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 1.7 MB/s | 187 kB 00:00 2023-12-19T13:44:28.718 INFO:teuthology.orchestra.run.smithi113.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2023-12-19T13:44:28.768 INFO:teuthology.orchestra.run.smithi113.stdout:(97/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 6.1 MB/s | 309 kB 00:00 2023-12-19T13:44:28.860 INFO:teuthology.orchestra.run.smithi113.stdout:(98/154): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2023-12-19T13:44:28.952 INFO:teuthology.orchestra.run.smithi113.stdout:(99/154): libarrow-9.0.0-10.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2023-12-19T13:44:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:(100/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2023-12-19T13:44:29.002 INFO:teuthology.orchestra.run.smithi113.stdout:(101/154): liboath-2.6.7-2.el9.x86_64.rpm 987 kB/s | 49 kB 00:00 2023-12-19T13:44:29.028 INFO:teuthology.orchestra.run.smithi113.stdout:(102/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-12-19T13:44:29.078 INFO:teuthology.orchestra.run.smithi113.stdout:(103/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2023-12-19T13:44:29.100 INFO:teuthology.orchestra.run.smithi151.stdout:(18/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 7.0 MB/s | 4.5 MB 00:00 2023-12-19T13:44:29.112 INFO:teuthology.orchestra.run.smithi113.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2023-12-19T13:44:29.145 INFO:teuthology.orchestra.run.smithi113.stdout:(105/154): python3-asyncssh-2.13.2-3.el9.noarch 4.6 MB/s | 548 kB 00:00 2023-12-19T13:44:29.150 INFO:teuthology.orchestra.run.smithi151.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 919 kB/s | 45 kB 00:00 2023-12-19T13:44:29.171 INFO:teuthology.orchestra.run.smithi113.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 557 kB/s | 32 kB 00:00 2023-12-19T13:44:29.196 INFO:teuthology.orchestra.run.smithi113.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 303 kB/s | 15 kB 00:00 2023-12-19T13:44:29.209 INFO:teuthology.orchestra.run.smithi151.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 2.1 MB/s | 124 kB 00:00 2023-12-19T13:44:29.221 INFO:teuthology.orchestra.run.smithi113.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2023-12-19T13:44:29.260 INFO:teuthology.orchestra.run.smithi151.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 3.2 MB/s | 162 kB 00:00 2023-12-19T13:44:29.357 INFO:teuthology.orchestra.run.smithi113.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2023-12-19T13:44:29.389 INFO:teuthology.orchestra.run.smithi113.stdout:(110/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2023-12-19T13:44:29.414 INFO:teuthology.orchestra.run.smithi113.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 632 kB/s | 35 kB 00:00 2023-12-19T13:44:29.449 INFO:teuthology.orchestra.run.smithi113.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 3.3 MB/s | 197 kB 00:00 2023-12-19T13:44:29.473 INFO:teuthology.orchestra.run.smithi113.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2023-12-19T13:44:29.485 INFO:teuthology.orchestra.run.smithi151.stdout:(22/154): ceph-common-18.2.0-1377.g24e2e32a.el9 1.9 MB/s | 18 MB 00:09 2023-12-19T13:44:29.498 INFO:teuthology.orchestra.run.smithi113.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 357 kB/s | 18 kB 00:00 2023-12-19T13:44:29.524 INFO:teuthology.orchestra.run.smithi113.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 466 kB/s | 23 kB 00:00 2023-12-19T13:44:29.549 INFO:teuthology.orchestra.run.smithi113.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2023-12-19T13:44:29.574 INFO:teuthology.orchestra.run.smithi113.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 398 kB/s | 20 kB 00:00 2023-12-19T13:44:29.600 INFO:teuthology.orchestra.run.smithi113.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 183 kB/s | 9.0 kB 00:00 2023-12-19T13:44:29.625 INFO:teuthology.orchestra.run.smithi113.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 828 kB/s | 41 kB 00:00 2023-12-19T13:44:29.659 INFO:teuthology.orchestra.run.smithi113.stdout:(120/154): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2023-12-19T13:44:29.715 INFO:teuthology.orchestra.run.smithi113.stdout:(121/154): python3-more-itertools-8.12.0-2.el9. 1.4 MB/s | 79 kB 00:00 2023-12-19T13:44:29.763 INFO:teuthology.orchestra.run.smithi151.stdout:(23/154): python3-rados-18.2.0-1377.g24e2e32a.e 636 kB/s | 319 kB 00:00 2023-12-19T13:44:29.803 INFO:teuthology.orchestra.run.smithi151.stdout:(24/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 941 kB/s | 297 kB 00:00 2023-12-19T13:44:29.836 INFO:teuthology.orchestra.run.smithi151.stdout:(25/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.3 MB/s | 99 kB 00:00 2023-12-19T13:44:29.870 INFO:teuthology.orchestra.run.smithi151.stdout:(26/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.3 MB/s | 87 kB 00:00 2023-12-19T13:44:29.893 INFO:teuthology.orchestra.run.smithi113.stdout:(122/154): openssl-devel-3.0.7-25.el9.x86_64.rp 3.2 MB/s | 4.1 MB 00:01 2023-12-19T13:44:29.934 INFO:teuthology.orchestra.run.smithi113.stdout:(123/154): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2023-12-19T13:44:29.951 INFO:teuthology.orchestra.run.smithi113.stdout:(124/154): python3-natsort-7.1.1-5.el9.noarch.r 245 kB/s | 58 kB 00:00 2023-12-19T13:44:29.968 INFO:teuthology.orchestra.run.smithi113.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 501 kB/s | 16 kB 00:00 2023-12-19T13:44:29.979 INFO:teuthology.orchestra.run.smithi151.stdout:(27/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.5 MB/s | 171 kB 00:00 2023-12-19T13:44:29.994 INFO:teuthology.orchestra.run.smithi113.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2023-12-19T13:44:30.019 INFO:teuthology.orchestra.run.smithi113.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 572 kB/s | 28 kB 00:00 2023-12-19T13:44:30.044 INFO:teuthology.orchestra.run.smithi113.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 623 kB/s | 31 kB 00:00 2023-12-19T13:44:30.078 INFO:teuthology.orchestra.run.smithi113.stdout:(129/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2023-12-19T13:44:30.103 INFO:teuthology.orchestra.run.smithi113.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-12-19T13:44:30.128 INFO:teuthology.orchestra.run.smithi113.stdout:(131/154): python3-rsa-4.9-2.el9.noarch.rpm 714 kB/s | 59 kB 00:00 2023-12-19T13:44:30.153 INFO:teuthology.orchestra.run.smithi113.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 479 kB/s | 36 kB 00:00 2023-12-19T13:44:30.179 INFO:teuthology.orchestra.run.smithi113.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-19T13:44:30.196 INFO:teuthology.orchestra.run.smithi113.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2023-12-19T13:44:30.229 INFO:teuthology.orchestra.run.smithi113.stdout:(135/154): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-12-19T13:44:30.254 INFO:teuthology.orchestra.run.smithi113.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2023-12-19T13:44:30.288 INFO:teuthology.orchestra.run.smithi113.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-12-19T13:44:30.322 INFO:teuthology.orchestra.run.smithi113.stdout:(138/154): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2023-12-19T13:44:30.397 INFO:teuthology.orchestra.run.smithi113.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-19T13:44:30.446 INFO:teuthology.orchestra.run.smithi151.stdout:(28/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 8.2 MB/s | 40 MB 00:04 2023-12-19T13:44:30.456 INFO:teuthology.orchestra.run.smithi113.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 68 kB 00:00 2023-12-19T13:44:30.488 INFO:teuthology.orchestra.run.smithi151.stdout:(29/154): ceph-grafana-dashboards-18.2.0-1377.g 46 kB/s | 23 kB 00:00 2023-12-19T13:44:30.522 INFO:teuthology.orchestra.run.smithi151.stdout:(30/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.7 MB/s | 132 kB 00:00 2023-12-19T13:44:30.522 INFO:teuthology.orchestra.run.smithi113.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2023-12-19T13:44:30.573 INFO:teuthology.orchestra.run.smithi113.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 744 kB/s | 36 kB 00:00 2023-12-19T13:44:30.622 INFO:teuthology.orchestra.run.smithi151.stdout:(31/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 3.8 MB/s | 3.0 MB 00:00 2023-12-19T13:44:30.640 INFO:teuthology.orchestra.run.smithi113.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2023-12-19T13:44:30.699 INFO:teuthology.orchestra.run.smithi113.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 4.3 MB/s | 255 kB 00:00 2023-12-19T13:44:30.706 INFO:teuthology.orchestra.run.smithi151.stdout:(32/154): ceph-mgr-modules-core-18.2.0-1377.g24 2.9 MB/s | 242 kB 00:00 2023-12-19T13:44:30.732 INFO:teuthology.orchestra.run.smithi113.stdout:(145/154): libacl-2.3.1-4.el9.x86_64.rpm 677 kB/s | 22 kB 00:00 2023-12-19T13:44:30.765 INFO:teuthology.orchestra.run.smithi151.stdout:(33/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 873 kB/s | 50 kB 00:00 2023-12-19T13:44:30.783 INFO:teuthology.orchestra.run.smithi113.stdout:(146/154): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2023-12-19T13:44:30.815 INFO:teuthology.orchestra.run.smithi151.stdout:(34/154): ceph-prometheus-alerts-18.2.0-1377.g2 299 kB/s | 15 kB 00:00 2023-12-19T13:44:30.907 INFO:teuthology.orchestra.run.smithi151.stdout:(35/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 2.8 MB/s | 262 kB 00:00 2023-12-19T13:44:30.991 INFO:teuthology.orchestra.run.smithi151.stdout:(36/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 2.6 MB/s | 221 kB 00:00 2023-12-19T13:44:31.008 INFO:teuthology.orchestra.run.smithi113.stdout:(147/154): librados2-18.2.0-1377.g24e2e32a.el9. 4.5 MB/s | 3.3 MB 00:00 2023-12-19T13:44:31.041 INFO:teuthology.orchestra.run.smithi151.stdout:(37/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 369 kB/s | 18 kB 00:00 2023-12-19T13:44:31.100 INFO:teuthology.orchestra.run.smithi151.stdout:(38/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 2.9 MB/s | 1.8 MB 00:00 2023-12-19T13:44:31.500 INFO:teuthology.orchestra.run.smithi151.stdout:(39/154): ceph-mgr-diskprediction-local-18.2.0- 7.5 MB/s | 7.4 MB 00:00 2023-12-19T13:44:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:(40/154): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 662 kB 00:00 2023-12-19T13:44:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 106 kB 00:00 2023-12-19T13:44:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 433 kB/s | 21 kB 00:00 2023-12-19T13:44:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2023-12-19T13:44:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 496 kB/s | 32 kB 00:00 2023-12-19T13:44:31.783 INFO:teuthology.orchestra.run.smithi113.stdout:(148/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:00 2023-12-19T13:44:31.844 INFO:teuthology.orchestra.run.smithi151.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2023-12-19T13:44:31.861 INFO:teuthology.orchestra.run.smithi151.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 97 kB/s | 17 kB 00:00 2023-12-19T13:44:31.895 INFO:teuthology.orchestra.run.smithi151.stdout:(47/154): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 10 kB 00:00 2023-12-19T13:44:31.900 INFO:teuthology.orchestra.run.smithi113.stdout:(149/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 1.9 MB/s | 3.0 MB 00:01 2023-12-19T13:44:31.925 INFO:teuthology.orchestra.run.smithi113.stdout:(150/154): NetworkManager-team-1.45.7-1.el9.x86 307 kB/s | 43 kB 00:00 2023-12-19T13:44:31.928 INFO:teuthology.orchestra.run.smithi151.stdout:(48/154): jq-1.6-16.el9.x86_64.rpm 2.8 MB/s | 186 kB 00:00 2023-12-19T13:44:31.962 INFO:teuthology.orchestra.run.smithi151.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2023-12-19T13:44:32.013 INFO:teuthology.orchestra.run.smithi151.stdout:(50/154): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 920 kB 00:00 2023-12-19T13:44:32.030 INFO:teuthology.orchestra.run.smithi151.stdout:(51/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 44 kB 00:00 2023-12-19T13:44:32.042 INFO:teuthology.orchestra.run.smithi113.stdout:(151/154): NetworkManager-libnm-1.45.7-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2023-12-19T13:44:32.072 INFO:teuthology.orchestra.run.smithi151.stdout:(52/154): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2023-12-19T13:44:32.105 INFO:teuthology.orchestra.run.smithi151.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 356 kB/s | 24 kB 00:00 2023-12-19T13:44:32.139 INFO:teuthology.orchestra.run.smithi151.stdout:(54/154): libtool-2.4.6-45.el9.x86_64.rpm 5.5 MB/s | 578 kB 00:00 2023-12-19T13:44:32.164 INFO:teuthology.orchestra.run.smithi151.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 508 kB/s | 46 kB 00:00 2023-12-19T13:44:32.167 INFO:teuthology.orchestra.run.smithi113.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 5.0 MB/s | 1.2 MB 00:00 2023-12-19T13:44:32.198 INFO:teuthology.orchestra.run.smithi151.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2023-12-19T13:44:32.223 INFO:teuthology.orchestra.run.smithi151.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 620 kB/s | 34 kB 00:00 2023-12-19T13:44:32.265 INFO:teuthology.orchestra.run.smithi151.stdout:(58/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 217 kB 00:00 2023-12-19T13:44:32.326 INFO:teuthology.orchestra.run.smithi113.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 7.6 MB/s | 2.2 MB 00:00 2023-12-19T13:44:32.424 INFO:teuthology.orchestra.run.smithi151.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2023-12-19T13:44:32.426 INFO:teuthology.orchestra.run.smithi113.stdout:(154/154): NetworkManager-tui-1.45.7-1.el9.x86_ 469 kB/s | 246 kB 00:00 2023-12-19T13:44:32.434 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:44:32.435 INFO:teuthology.orchestra.run.smithi113.stdout:Total 15 MB/s | 200 MB 00:13 2023-12-19T13:44:32.483 INFO:teuthology.orchestra.run.smithi151.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 6.3 MB/s | 1.5 MB 00:00 2023-12-19T13:44:32.516 INFO:teuthology.orchestra.run.smithi151.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 3.4 MB/s | 811 kB 00:00 2023-12-19T13:44:32.542 INFO:teuthology.orchestra.run.smithi151.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.2 MB/s | 134 kB 00:00 2023-12-19T13:44:32.567 INFO:teuthology.orchestra.run.smithi151.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.6 MB/s | 78 kB 00:00 2023-12-19T13:44:32.726 INFO:teuthology.orchestra.run.smithi151.stdout:(64/154): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2023-12-19T13:44:32.841 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2023-12-19T13:44:32.860 INFO:teuthology.orchestra.run.smithi151.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-12-19T13:44:32.885 INFO:teuthology.orchestra.run.smithi151.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 756 kB/s | 228 kB 00:00 2023-12-19T13:44:32.910 INFO:teuthology.orchestra.run.smithi151.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 144 kB/s | 24 kB 00:00 2023-12-19T13:44:32.952 INFO:teuthology.orchestra.run.smithi151.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 448 kB/s | 18 kB 00:00 2023-12-19T13:44:32.978 INFO:teuthology.orchestra.run.smithi151.stdout:(69/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 144 kB 00:00 2023-12-19T13:44:32.994 INFO:teuthology.orchestra.run.smithi151.stdout:(70/154): python3-markupsafe-1.1.1-12.el9.x86_6 384 kB/s | 32 kB 00:00 2023-12-19T13:44:33.036 INFO:teuthology.orchestra.run.smithi151.stdout:(71/154): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 174 kB 00:00 2023-12-19T13:44:33.070 INFO:teuthology.orchestra.run.smithi151.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 217 kB 00:00 2023-12-19T13:44:33.123 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2023-12-19T13:44:33.123 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2023-12-19T13:44:33.195 INFO:teuthology.orchestra.run.smithi151.stdout:(73/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-12-19T13:44:33.212 INFO:teuthology.orchestra.run.smithi151.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 245 kB/s | 41 kB 00:00 2023-12-19T13:44:33.237 INFO:teuthology.orchestra.run.smithi151.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 865 kB/s | 132 kB 00:00 2023-12-19T13:44:33.271 INFO:teuthology.orchestra.run.smithi151.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 47 kB 00:00 2023-12-19T13:44:33.305 INFO:teuthology.orchestra.run.smithi151.stdout:(77/154): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-12-19T13:44:33.322 INFO:teuthology.orchestra.run.smithi151.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 521 kB/s | 43 kB 00:00 2023-12-19T13:44:33.656 INFO:teuthology.orchestra.run.smithi151.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2023-12-19T13:44:33.672 INFO:teuthology.orchestra.run.smithi151.stdout:(80/154): python3-toml-0.10.2-6.el9.noarch.rpm 115 kB/s | 39 kB 00:00 2023-12-19T13:44:33.689 INFO:teuthology.orchestra.run.smithi151.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 116 kB/s | 41 kB 00:00 2023-12-19T13:44:33.723 INFO:teuthology.orchestra.run.smithi151.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2023-12-19T13:44:33.748 INFO:teuthology.orchestra.run.smithi151.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-12-19T13:44:33.774 INFO:teuthology.orchestra.run.smithi151.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.0 MB/s | 85 kB 00:00 2023-12-19T13:44:33.799 INFO:teuthology.orchestra.run.smithi151.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 838 kB/s | 63 kB 00:00 2023-12-19T13:44:33.824 INFO:teuthology.orchestra.run.smithi151.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 902 kB/s | 44 kB 00:00 2023-12-19T13:44:33.850 INFO:teuthology.orchestra.run.smithi151.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-19T13:44:33.892 INFO:teuthology.orchestra.run.smithi151.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.7 MB/s | 803 kB 00:00 2023-12-19T13:44:33.926 INFO:teuthology.orchestra.run.smithi151.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-12-19T13:44:33.951 INFO:teuthology.orchestra.run.smithi151.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 241 kB 00:00 2023-12-19T13:44:34.010 INFO:teuthology.orchestra.run.smithi151.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.1 MB 00:00 2023-12-19T13:44:34.035 INFO:teuthology.orchestra.run.smithi151.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-19T13:44:34.052 INFO:teuthology.orchestra.run.smithi151.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2023-12-19T13:44:34.078 INFO:teuthology.orchestra.run.smithi151.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.7 MB/s | 113 kB 00:00 2023-12-19T13:44:34.128 INFO:teuthology.orchestra.run.smithi151.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 2.5 MB/s | 187 kB 00:00 2023-12-19T13:44:34.332 INFO:teuthology.orchestra.run.smithi151.stdout:(96/154): python3-devel-3.9.17-2.el9.x86_64.rpm 972 kB/s | 245 kB 00:00 2023-12-19T13:44:34.437 INFO:teuthology.orchestra.run.smithi151.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 359 kB/s | 111 kB 00:00 2023-12-19T13:44:34.520 INFO:teuthology.orchestra.run.smithi151.stdout:(98/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 8.9 MB/s | 4.1 MB 00:00 2023-12-19T13:44:34.729 INFO:teuthology.orchestra.run.smithi151.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 125 kB/s | 26 kB 00:00 2023-12-19T13:44:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:(100/154): gperftools-libs-2.9.1-2.el9.x86_64.r 705 kB/s | 309 kB 00:00 2023-12-19T13:44:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:(101/154): liboath-2.6.7-2.el9.x86_64.rpm 735 kB/s | 49 kB 00:00 2023-12-19T13:44:34.847 INFO:teuthology.orchestra.run.smithi151.stdout:(102/154): libunwind-1.6.2-1.el9.x86_64.rpm 902 kB/s | 67 kB 00:00 2023-12-19T13:44:35.039 INFO:teuthology.orchestra.run.smithi151.stdout:(103/154): python3-asyncssh-2.13.2-3.el9.noarch 2.8 MB/s | 548 kB 00:00 2023-12-19T13:44:35.089 INFO:teuthology.orchestra.run.smithi151.stdout:(104/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2023-12-19T13:44:35.106 INFO:teuthology.orchestra.run.smithi151.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 656 kB/s | 43 kB 00:00 2023-12-19T13:44:35.123 INFO:teuthology.orchestra.run.smithi151.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 977 kB/s | 32 kB 00:00 2023-12-19T13:44:35.140 INFO:teuthology.orchestra.run.smithi151.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 455 kB/s | 15 kB 00:00 2023-12-19T13:44:35.216 INFO:teuthology.orchestra.run.smithi151.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2023-12-19T13:44:35.308 INFO:teuthology.orchestra.run.smithi151.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2023-12-19T13:44:35.355 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2023-12-19T13:44:35.355 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2023-12-19T13:44:35.358 INFO:teuthology.orchestra.run.smithi151.stdout:(110/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2023-12-19T13:44:35.384 INFO:teuthology.orchestra.run.smithi151.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 471 kB/s | 35 kB 00:00 2023-12-19T13:44:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:(112/154): python3-jaraco-8.2.1-3.el9.noarch.rp 261 kB/s | 11 kB 00:00 2023-12-19T13:44:35.451 INFO:teuthology.orchestra.run.smithi151.stdout:(113/154): python3-google-auth-2.23.4-1.el9.noa 2.1 MB/s | 197 kB 00:00 2023-12-19T13:44:35.477 INFO:teuthology.orchestra.run.smithi151.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 356 kB/s | 18 kB 00:00 2023-12-19T13:44:35.502 INFO:teuthology.orchestra.run.smithi151.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 467 kB/s | 23 kB 00:00 2023-12-19T13:44:35.527 INFO:teuthology.orchestra.run.smithi151.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 391 kB/s | 19 kB 00:00 2023-12-19T13:44:35.553 INFO:teuthology.orchestra.run.smithi151.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 396 kB/s | 20 kB 00:00 2023-12-19T13:44:35.578 INFO:teuthology.orchestra.run.smithi151.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 182 kB/s | 9.0 kB 00:00 2023-12-19T13:44:35.604 INFO:teuthology.orchestra.run.smithi151.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 823 kB/s | 41 kB 00:00 2023-12-19T13:44:35.646 INFO:teuthology.orchestra.run.smithi151.stdout:(120/154): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2023-12-19T13:44:35.696 INFO:teuthology.orchestra.run.smithi151.stdout:(121/154): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2023-12-19T13:44:35.780 INFO:teuthology.orchestra.run.smithi151.stdout:(122/154): libarrow-9.0.0-10.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2023-12-19T13:44:35.805 INFO:teuthology.orchestra.run.smithi151.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 534 kB/s | 58 kB 00:00 2023-12-19T13:44:35.855 INFO:teuthology.orchestra.run.smithi151.stdout:(124/154): python3-portend-3.1.0-2.el9.noarch.r 333 kB/s | 16 kB 00:00 2023-12-19T13:44:35.906 INFO:teuthology.orchestra.run.smithi151.stdout:(125/154): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2023-12-19T13:44:35.931 INFO:teuthology.orchestra.run.smithi151.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-12-19T13:44:35.956 INFO:teuthology.orchestra.run.smithi151.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 570 kB/s | 28 kB 00:00 2023-12-19T13:44:35.982 INFO:teuthology.orchestra.run.smithi151.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 619 kB/s | 31 kB 00:00 2023-12-19T13:44:36.024 INFO:teuthology.orchestra.run.smithi151.stdout:(129/154): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2023-12-19T13:44:36.049 INFO:teuthology.orchestra.run.smithi151.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 893 kB/s | 59 kB 00:00 2023-12-19T13:44:36.074 INFO:teuthology.orchestra.run.smithi151.stdout:(131/154): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-12-19T13:44:36.108 INFO:teuthology.orchestra.run.smithi151.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2023-12-19T13:44:36.133 INFO:teuthology.orchestra.run.smithi151.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 609 kB/s | 51 kB 00:00 2023-12-19T13:44:36.175 INFO:teuthology.orchestra.run.smithi151.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2023-12-19T13:44:36.240 INFO:teuthology.orchestra.run.smithi151.stdout:(135/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2023-12-19T13:44:36.260 INFO:teuthology.orchestra.run.smithi151.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 241 kB/s | 20 kB 00:00 2023-12-19T13:44:36.327 INFO:teuthology.orchestra.run.smithi151.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2023-12-19T13:44:36.369 INFO:teuthology.orchestra.run.smithi151.stdout:(138/154): python3-werkzeug-2.0.3-3.el9.1.noarc 1.8 MB/s | 427 kB 00:00 2023-12-19T13:44:36.744 INFO:teuthology.orchestra.run.smithi151.stdout:(139/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 8.0 MB/s | 3.0 MB 00:00 2023-12-19T13:44:36.795 INFO:teuthology.orchestra.run.smithi151.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-12-19T13:44:36.886 INFO:teuthology.orchestra.run.smithi151.stdout:(141/154): librados2-18.2.0-1377.g24e2e32a.el9. 5.9 MB/s | 3.3 MB 00:00 2023-12-19T13:44:36.912 INFO:teuthology.orchestra.run.smithi151.stdout:(142/154): acl-2.3.1-4.el9.x86_64.rpm 592 kB/s | 69 kB 00:00 2023-12-19T13:44:36.962 INFO:teuthology.orchestra.run.smithi151.stdout:(143/154): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2023-12-19T13:44:36.988 INFO:teuthology.orchestra.run.smithi151.stdout:(144/154): elfutils-debuginfod-client-0.190-1.e 363 kB/s | 36 kB 00:00 2023-12-19T13:44:37.021 INFO:teuthology.orchestra.run.smithi151.stdout:(145/154): elfutils-libelf-0.190-1.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2023-12-19T13:44:37.080 INFO:teuthology.orchestra.run.smithi151.stdout:(146/154): elfutils-libs-0.190-1.el9.x86_64.rpm 2.8 MB/s | 255 kB 00:00 2023-12-19T13:44:37.097 INFO:teuthology.orchestra.run.smithi151.stdout:(147/154): libacl-2.3.1-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2023-12-19T13:44:37.148 INFO:teuthology.orchestra.run.smithi151.stdout:(148/154): xfsdump-3.1.12-4.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2023-12-19T13:44:37.489 INFO:teuthology.orchestra.run.smithi151.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 127 kB/s | 43 kB 00:00 2023-12-19T13:44:37.848 INFO:teuthology.orchestra.run.smithi151.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 689 kB/s | 246 kB 00:00 2023-12-19T13:44:37.923 INFO:teuthology.orchestra.run.smithi151.stdout:(151/154): NetworkManager-libnm-1.45.7-1.el9.x8 2.2 MB/s | 1.8 MB 00:00 2023-12-19T13:44:37.990 INFO:teuthology.orchestra.run.smithi151.stdout:(152/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2023-12-19T13:44:38.182 INFO:teuthology.orchestra.run.smithi151.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 8.3 MB/s | 2.2 MB 00:00 2023-12-19T13:44:38.232 INFO:teuthology.orchestra.run.smithi151.stdout:(154/154): openssl-3.0.7-25.el9.x86_64.rpm 3.2 MB/s | 1.2 MB 00:00 2023-12-19T13:44:38.248 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:44:38.248 INFO:teuthology.orchestra.run.smithi151.stdout:Total 10 MB/s | 200 MB 00:19 2023-12-19T13:44:38.663 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-12-19T13:44:38.945 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-12-19T13:44:38.946 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-12-19T13:44:41.075 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-12-19T13:44:41.075 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-12-19T13:44:41.586 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2023-12-19T13:44:41.732 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T13:44:41.810 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T13:44:42.025 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T13:44:42.116 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T13:44:42.151 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T13:44:42.250 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T13:44:42.648 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T13:44:42.681 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:44:42.832 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:44:42.858 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:44:42.960 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:44:42.999 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:44:43.067 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T13:44:43.352 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T13:44:43.421 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T13:44:43.446 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:44:43.603 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:44:43.639 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:44:43.987 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:44:44.151 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:44:44.223 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:44:44.418 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:44:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:44:44.801 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:44:44.961 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T13:44:45.010 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T13:44:45.111 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T13:44:45.181 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T13:44:45.214 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T13:44:45.266 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T13:44:45.326 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T13:44:45.424 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T13:44:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T13:44:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T13:44:45.607 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T13:44:45.649 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T13:44:45.697 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T13:44:45.798 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T13:44:45.973 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T13:44:46.039 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T13:44:46.729 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T13:44:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T13:44:46.863 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T13:44:46.913 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T13:44:46.952 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T13:44:47.012 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T13:44:47.209 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T13:44:47.412 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T13:44:47.413 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-12-19T13:44:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T13:44:47.594 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T13:44:47.660 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T13:44:47.732 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T13:44:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T13:44:47.852 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T13:44:47.903 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T13:44:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T13:44:47.943 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T13:44:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T13:44:48.012 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T13:44:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T13:44:48.076 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T13:44:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T13:44:48.141 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T13:44:48.207 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T13:44:48.402 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T13:44:48.448 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T13:44:48.485 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T13:44:48.537 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T13:44:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T13:44:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:44:48.665 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T13:44:48.717 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T13:44:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:44:48.765 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T13:44:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:44:48.804 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T13:44:48.835 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T13:44:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:44:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:44:48.998 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T13:44:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T13:44:49.051 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T13:44:49.118 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T13:44:49.202 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T13:44:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T13:44:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T13:44:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:44:49.459 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T13:44:49.522 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T13:44:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:44:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:44:49.695 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T13:44:49.784 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T13:44:49.816 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T13:44:49.863 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T13:44:49.910 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T13:44:49.953 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T13:44:50.013 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:44:50.013 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T13:44:50.057 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T13:44:50.126 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T13:44:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:44:50.180 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T13:44:50.228 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T13:44:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:44:50.356 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T13:44:50.407 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T13:44:50.437 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:44:50.450 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T13:44:50.514 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:44:50.522 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T13:44:50.587 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T13:44:50.735 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T13:44:50.775 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T13:44:50.863 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:44:50.917 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T13:44:50.981 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T13:44:51.029 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T13:44:51.080 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T13:44:51.195 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T13:44:51.284 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T13:44:51.322 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T13:44:51.380 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T13:44:51.441 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T13:44:51.544 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T13:44:51.591 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T13:44:51.625 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T13:44:51.752 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T13:44:51.788 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T13:44:51.824 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T13:44:51.902 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T13:44:51.948 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T13:44:51.998 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T13:44:52.031 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T13:44:52.073 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T13:44:52.087 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T13:44:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T13:44:52.199 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T13:44:52.249 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T13:44:52.483 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T13:44:52.512 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T13:44:52.605 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T13:44:52.823 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T13:44:52.915 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T13:44:52.971 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T13:44:53.026 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T13:44:53.075 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T13:44:53.128 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T13:44:53.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T13:44:53.378 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T13:44:53.395 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T13:44:53.520 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T13:44:53.531 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T13:44:53.556 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T13:44:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T13:44:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T13:44:53.774 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T13:44:53.813 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T13:44:53.871 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T13:44:53.914 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T13:44:53.975 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T13:44:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T13:44:54.224 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T13:44:54.288 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T13:44:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T13:44:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T13:44:54.516 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T13:44:54.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T13:44:54.622 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T13:44:54.660 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T13:44:54.691 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T13:44:54.846 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T13:44:54.898 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T13:44:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T13:44:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T13:44:55.057 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T13:44:55.234 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T13:44:55.277 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T13:44:55.291 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T13:44:55.328 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T13:44:55.345 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T13:44:55.376 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T13:44:55.425 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T13:44:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T13:44:55.574 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T13:44:55.598 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T13:44:55.645 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T13:44:55.688 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T13:44:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T13:44:55.769 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T13:44:55.803 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T13:44:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T13:44:55.833 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:44:55.902 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T13:44:55.936 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:44:55.955 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T13:44:55.972 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T13:44:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T13:44:56.019 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T13:44:56.121 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T13:44:56.165 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T13:44:56.200 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T13:44:56.254 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T13:44:56.295 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T13:44:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T13:44:56.471 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T13:44:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T13:44:56.511 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:44:56.628 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T13:44:56.635 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:44:56.663 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T13:44:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T13:44:57.673 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T13:44:57.735 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T13:44:57.760 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T13:44:57.819 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T13:44:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T13:44:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T13:44:58.203 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T13:44:58.235 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T13:44:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T13:44:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:44:59.165 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:44:59.168 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T13:44:59.291 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T13:44:59.786 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:44:59.830 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:44:59.983 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:44:59.983 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T13:44:59.983 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T13:44:59.983 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:00.030 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:45:00.858 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T13:45:01.229 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T13:45:01.300 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T13:45:01.336 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T13:45:01.382 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T13:45:01.430 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T13:45:01.824 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T13:45:01.854 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:45:01.968 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:45:02.003 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T13:45:02.059 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T13:45:02.544 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T13:45:02.575 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:45:02.666 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:45:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T13:45:05.158 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:45:05.200 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:45:05.818 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:45:05.863 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:45:06.048 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:45:06.049 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T13:45:06.049 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T13:45:06.049 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:06.098 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:45:12.494 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:45:12.494 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /sys 2023-12-19T13:45:12.494 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /proc 2023-12-19T13:45:12.494 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /mnt 2023-12-19T13:45:12.494 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /var/tmp 2023-12-19T13:45:12.494 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /home 2023-12-19T13:45:12.495 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /root 2023-12-19T13:45:12.495 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /tmp 2023-12-19T13:45:12.495 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:12.704 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:45:12.748 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:45:12.748 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:12.748 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T13:45:12.748 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:14.433 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:45:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:45:14.535 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:14.535 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T13:45:14.535 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:45:14.535 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:45:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:14.792 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:45:14.879 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:45:14.879 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:14.879 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T13:45:14.879 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:45:14.880 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:45:14.880 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:15.417 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:45:15.518 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:45:15.518 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:15.518 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T13:45:15.518 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:45:15.518 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:45:15.519 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:15.635 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T13:45:16.237 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:45:16.278 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:45:16.324 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T13:45:16.427 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T13:45:16.457 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:45:16.776 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:45:16.816 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:45:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:45:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:45:18.122 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:45:18.289 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T13:45:18.318 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:45:18.388 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:45:18.389 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:18.389 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T13:45:18.389 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:45:18.389 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:45:18.389 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:45:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:45:18.572 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T13:45:18.880 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:45:18.880 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-12-19T13:45:18.880 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-12-19T13:45:18.880 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-12-19T13:45:18.880 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-12-19T13:45:18.881 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-12-19T13:45:18.881 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2023-12-19T13:45:18.881 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-12-19T13:45:18.881 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:19.089 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:45:19.139 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:45:19.139 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:19.139 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T13:45:19.139 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:19.429 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T13:45:19.463 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:45:19.542 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:45:19.543 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:19.543 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T13:45:19.543 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:45:19.543 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:45:19.543 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:19.597 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:45:19.661 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:45:19.661 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:19.661 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T13:45:19.661 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:19.710 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:45:19.814 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:45:19.814 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:19.814 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T13:45:19.815 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:45:19.815 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:45:19.815 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:20.156 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:45:20.256 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:45:20.256 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:20.257 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T13:45:20.257 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:45:20.257 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:45:20.257 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:20.792 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:45:20.879 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:45:20.879 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:20.880 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T13:45:20.880 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:45:20.880 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:45:20.880 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:21.118 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:45:21.187 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:45:21.187 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:21.187 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T13:45:21.187 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:45:21.187 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:45:21.187 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:21.685 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:45:21.758 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:45:21.758 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:21.758 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T13:45:21.758 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:45:21.758 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:45:21.758 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:21.888 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T13:45:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:45:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:45:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T13:45:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T13:45:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:45:23.014 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:45:23.054 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:45:24.183 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:45:24.213 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:45:24.238 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T13:45:24.297 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T13:45:24.356 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:45:24.358 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T13:45:24.394 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T13:45:24.434 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T13:45:24.520 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T13:45:24.548 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:45:24.625 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:45:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T13:45:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:45:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:45:24.625 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:24.675 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:45:24.714 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:45:24.755 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T13:45:24.774 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T13:45:24.882 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T13:45:24.916 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T13:45:24.950 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T13:45:25.077 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T13:45:25.147 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:45:25.185 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T13:45:25.237 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T13:45:25.293 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T13:45:25.552 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T13:45:25.585 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:45:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:45:25.670 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:25.670 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T13:45:25.670 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:45:25.670 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:45:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:45:25.792 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:45:25.793 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:25.793 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T13:45:25.793 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:25.910 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:45:25.998 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:45:25.998 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:25.999 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T13:45:25.999 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:45:25.999 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:45:25.999 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:26.125 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:45:26.174 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:45:26.242 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:45:26.380 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:45:26.454 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:45:26.454 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:45:26.454 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T13:45:26.454 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:45:26.455 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:45:26.455 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:27.594 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T13:45:27.893 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T13:45:27.946 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T13:45:28.026 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T13:45:28.188 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T13:45:28.225 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T13:45:28.250 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T13:45:28.284 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T13:45:28.325 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T13:45:28.325 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:45:28.442 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:45:28.492 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T13:45:28.539 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T13:45:28.571 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T13:45:28.571 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:45:28.731 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:45:28.756 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:45:28.797 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:45:28.797 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:45:29.130 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:45:29.130 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:45:29.272 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:45:29.309 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T13:45:29.344 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T13:45:29.377 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T13:45:29.504 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:45:29.757 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:45:29.757 INFO:teuthology.orchestra.run.smithi113.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-19T13:45:29.757 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T13:45:30.543 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T13:45:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T13:45:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T13:45:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T13:45:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T13:45:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T13:45:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T13:45:31.168 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T13:45:31.270 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T13:45:31.333 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:45:31.371 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T13:45:31.422 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T13:45:31.471 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T13:45:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:45:32.480 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:45:32.538 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:45:33.854 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T13:45:33.982 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T13:45:34.049 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T13:45:34.126 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T13:45:34.286 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T13:45:34.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T13:45:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T13:45:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T13:45:34.427 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T13:45:34.427 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:45:34.470 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T13:45:34.470 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T13:45:34.470 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T13:45:34.470 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T13:45:34.470 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T13:45:34.470 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T13:45:34.470 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T13:45:34.471 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T13:45:34.472 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T13:45:34.485 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T13:45:34.485 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T13:45:34.485 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T13:45:34.485 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T13:45:34.486 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T13:45:34.487 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T13:45:34.488 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T13:45:34.489 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T13:45:34.490 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T13:45:34.491 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T13:45:34.492 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T13:45:34.493 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T13:45:34.494 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:45:34.495 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T13:45:34.496 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:45:34.496 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T13:45:34.496 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T13:45:34.496 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T13:45:34.585 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:45:34.628 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T13:45:34.675 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T13:45:34.707 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T13:45:34.707 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:45:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:45:34.884 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:45:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:45:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:45:35.241 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:45:35.242 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:45:35.384 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:45:35.421 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T13:45:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T13:45:35.481 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T13:45:35.626 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:45:35.890 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:45:35.890 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-19T13:45:35.890 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T13:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:Upgraded: 2023-12-19T13:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T13:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout:Installed: 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.705 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: jq-1.6-16.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T13:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T13:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T13:45:36.710 INFO:teuthology.orchestra.run.smithi113.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T13:45:36.711 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T13:45:36.712 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T13:45:36.713 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T13:45:36.714 INFO:teuthology.orchestra.run.smithi113.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T13:45:36.715 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T13:45:36.715 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T13:45:36.715 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T13:45:36.715 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:36.715 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2023-12-19T13:45:37.351 DEBUG:teuthology.parallel:result is None 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T13:45:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T13:45:40.838 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T13:45:40.839 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T13:45:40.840 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T13:45:40.841 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T13:45:40.842 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T13:45:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T13:45:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T13:45:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T13:45:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T13:45:40.847 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T13:45:40.848 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T13:45:40.849 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T13:45:43.043 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T13:45:43.044 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T13:45:43.046 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-16.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.047 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.049 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T13:45:43.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T13:45:43.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T13:45:43.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T13:45:43.053 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T13:45:43.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T13:45:43.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T13:45:43.056 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T13:45:43.057 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T13:45:43.057 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:43.057 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-12-19T13:45:43.634 DEBUG:teuthology.parallel:result is None 2023-12-19T13:45:43.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:45:43.779 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T13:45:43.853 INFO:teuthology.orchestra.run.smithi113.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T13:45:43.854 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T13:45:43.854 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T13:45:43.856 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:45:44.076 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T13:45:44.137 INFO:teuthology.orchestra.run.smithi151.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T13:45:44.137 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T13:45:44.137 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T13:45:44.139 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T13:45:44.139 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:44.139 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T13:45:44.244 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:44.244 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T13:45:44.325 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T13:45:44.325 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:44.325 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T13:45:44.456 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T13:45:44.550 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:44.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T13:45:44.634 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T13:45:44.747 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T13:45:44.748 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:44.748 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T13:45:44.834 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T13:45:44.965 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:44.965 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T13:45:45.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T13:45:45.157 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T13:45:45.157 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:45.157 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T13:45:45.238 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T13:45:45.361 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:45.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T13:45:45.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T13:45:45.592 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T13:45:45.658 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T13:45:45.659 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 777 /var/log/ceph 2023-12-19T13:45:45.669 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-12-19T13:45:45.756 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T13:45:45.756 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T13:45:45.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T13:45:45.840 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T13:45:45.840 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T13:45:45.845 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T13:45:45.930 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T13:45:45.930 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T13:45:45.931 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T13:45:45.931 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:45.931 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T13:45:45.976 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:46.245 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:46.346 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:46.346 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T13:45:46.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:46.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:46.704 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T13:45:46.704 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T13:45:46.705 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765', 'branch': 'rishabh-mdscap-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7496765', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-reef'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-reef', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9974, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'sleep_before_teardown': 0, 'subset': '301/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi113.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCC6TrBF2XUP+csy3HGsU5ZcX6IhgF+WQz/CDZ3rq/FUSMA1eSdbJQm8cc8co/+GZEAX03xqwkaHinBuMLSbb6k=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdKVkjQGz1BKe0fpMFIl7/J2T5IuU7eVQH6u8gHcBuOp8ZZ9fZnodxtRv2XJNWpb6zF0Jv7EryCwGhNo9gsEwQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_11:42:11', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T13:45:46.707 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T13:45:46.716 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T13:45:46.767 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T13:45:46.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T13:45:46.872 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:46.872 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T13:45:46.930 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T13:45:46.930 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_1 2023-12-19T13:45:46.981 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T13:45:46.981 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:46.981 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-12-19T13:45:46.981 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:46.982 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:46.982 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-19 13:45:30.210159746 +0000 2023-12-19T13:45:46.982 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-19 13:43:03.987934807 +0000 2023-12-19T13:45:46.982 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-19 13:43:03.987934807 +0000 2023-12-19T13:45:46.982 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2023-12-19 13:43:03.987934807 +0000 2023-12-19T13:45:46.982 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T13:45:47.073 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-19T13:45:47.073 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-19T13:45:47.073 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000499781 s, 1.0 MB/s 2023-12-19T13:45:47.076 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T13:45:47.135 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_2 2023-12-19T13:45:47.185 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T13:45:47.185 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:47.185 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-12-19T13:45:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-19 13:45:30.211159725 +0000 2023-12-19T13:45:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-19 13:43:05.002914047 +0000 2023-12-19T13:45:47.186 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-19 13:43:05.002914047 +0000 2023-12-19T13:45:47.186 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2023-12-19 13:43:05.002914047 +0000 2023-12-19T13:45:47.186 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T13:45:47.274 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-19T13:45:47.275 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-19T13:45:47.275 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000326633 s, 1.6 MB/s 2023-12-19T13:45:47.278 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T13:45:47.335 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_3 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-19 13:45:30.211159725 +0000 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-19 13:43:06.005893534 +0000 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-19 13:43:06.005893534 +0000 2023-12-19T13:45:47.388 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2023-12-19 13:43:06.005893534 +0000 2023-12-19T13:45:47.389 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T13:45:47.480 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-19T13:45:47.480 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-19T13:45:47.480 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000494027 s, 1.0 MB/s 2023-12-19T13:45:47.484 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T13:45:47.540 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_4 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-19 13:45:30.212159705 +0000 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-19 13:43:07.012872938 +0000 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-19 13:43:07.012872938 +0000 2023-12-19T13:45:47.592 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2023-12-19 13:43:07.012872938 +0000 2023-12-19T13:45:47.593 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T13:45:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-19T13:45:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-19T13:45:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000369085 s, 1.4 MB/s 2023-12-19T13:45:47.684 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T13:45:47.740 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:47.740 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:47.740 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T13:45:47.793 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T13:45:47.793 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-19 13:45:36.353217183 +0000 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-19 13:43:04.273127252 +0000 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-19 13:43:04.273127252 +0000 2023-12-19T13:45:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-19 13:43:04.273127252 +0000 2023-12-19T13:45:47.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T13:45:47.949 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-19T13:45:47.949 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-19T13:45:47.949 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000337262 s, 1.5 MB/s 2023-12-19T13:45:47.952 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T13:45:47.997 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-12-19T13:45:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T13:45:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:48.093 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-12-19T13:45:48.093 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:48.093 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:48.093 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-19 13:45:36.354217171 +0000 2023-12-19T13:45:48.093 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-19 13:43:05.300114997 +0000 2023-12-19T13:45:48.093 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-19 13:43:05.300114997 +0000 2023-12-19T13:45:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-19 13:43:05.300114997 +0000 2023-12-19T13:45:48.094 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T13:45:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-19T13:45:48.165 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-19T13:45:48.165 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000309425 s, 1.7 MB/s 2023-12-19T13:45:48.168 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T13:45:48.210 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-12-19T13:45:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T13:45:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:48.296 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-19T13:45:48.296 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:48.296 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:48.296 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-19 13:45:36.355217159 +0000 2023-12-19T13:45:48.296 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-19 13:43:06.308102968 +0000 2023-12-19T13:45:48.296 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-19 13:43:06.308102968 +0000 2023-12-19T13:45:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-19 13:43:06.308102968 +0000 2023-12-19T13:45:48.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T13:45:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-19T13:45:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-19T13:45:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000385379 s, 1.3 MB/s 2023-12-19T13:45:48.418 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T13:45:48.461 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-12-19T13:45:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T13:45:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:45:48.545 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-12-19T13:45:48.545 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:45:48.545 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:45:48.545 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-19 13:45:36.355217159 +0000 2023-12-19T13:45:48.545 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-19 13:43:07.322090868 +0000 2023-12-19T13:45:48.545 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-19 13:43:07.322090868 +0000 2023-12-19T13:45:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-19 13:43:07.322090868 +0000 2023-12-19T13:45:48.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T13:45:48.674 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-19T13:45:48.674 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-19T13:45:48.674 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000344405 s, 1.5 MB/s 2023-12-19T13:45:48.678 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T13:45:48.738 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:48.738 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T13:45:48.738 INFO:tasks.ceph:Generating config... 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client] pid file = 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client.0] debug client = 20 2023-12-19T13:45:48.739 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-12-19T13:45:48.740 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-12-19T13:45:48.740 INFO:tasks.ceph:[client.1] debug client = 20 2023-12-19T13:45:48.740 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-12-19T13:45:48.740 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-12-19T13:45:48.740 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-19T13:45:48.740 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T13:45:48.740 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T13:45:48.740 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T13:45:48.741 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T13:45:48.741 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T13:45:48.741 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T13:45:48.741 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T13:45:48.741 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T13:45:48.742 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-12-19T13:45:48.743 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-12-19T13:45:48.743 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T13:45:48.743 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T13:45:48.744 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T13:45:48.744 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-12-19T13:45:48.744 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-12-19T13:45:48.744 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-12-19T13:45:48.744 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T13:45:48.744 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T13:45:48.744 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T13:45:48.902 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T13:45:48.911 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T13:45:49.049 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T13:45:49.138 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.113'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2023-12-19T13:45:49.138 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.113,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T13:45:49.139 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:49.139 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T13:45:49.191 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.113 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:49.346 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:49.346 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: generated fsid b8121e09-ebc1-4371-9bac-afd10a2a5b83 2023-12-19T13:45:49.346 INFO:teuthology.orchestra.run.smithi113.stdout:setting min_mon_release = pacific 2023-12-19T13:45:49.346 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 0 2023-12-19T13:45:49.346 INFO:teuthology.orchestra.run.smithi113.stdout:fsid b8121e09-ebc1-4371-9bac-afd10a2a5b83 2023-12-19T13:45:49.346 INFO:teuthology.orchestra.run.smithi113.stdout:last_changed 2023-12-19T13:45:49.347200+0000 2023-12-19T13:45:49.346 INFO:teuthology.orchestra.run.smithi113.stdout:created 2023-12-19T13:45:49.347200+0000 2023-12-19T13:45:49.347 INFO:teuthology.orchestra.run.smithi113.stdout:min_mon_release 16 (pacific) 2023-12-19T13:45:49.347 INFO:teuthology.orchestra.run.smithi113.stdout:election_strategy: 1 2023-12-19T13:45:49.347 INFO:teuthology.orchestra.run.smithi113.stdout:0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2023-12-19T13:45:49.347 INFO:teuthology.orchestra.run.smithi113.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2023-12-19T13:45:49.347 INFO:teuthology.orchestra.run.smithi113.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2023-12-19T13:45:49.347 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T13:45:49.350 DEBUG:teuthology.orchestra.run.smithi113:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T13:45:49.400 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b8121e09-ebc1-4371-9bac-afd10a2a5b83... 2023-12-19T13:45:49.402 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T13:45:49.408 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T13:45:49.569 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2023-12-19T13:45:49.569 INFO:teuthology.orchestra.run.smithi113.stdout: chdir = "" 2023-12-19T13:45:49.569 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: auth supported = cephx 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: filestore xattr use omap = true 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: mon clock drift allowed = 1.000 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: osd crush chooseleaf type = 0 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: auth debug = true 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on old message = true 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on bug = true 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.570 INFO:teuthology.orchestra.run.smithi113.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon pg warn max object skew = 0 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default size = 2 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow primary affinity = true 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow pg remap = true 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on legacy crush tunables = false 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on crush straw calc version zero = false 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on no sortbitwise = false 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on osd down out interval zero = false 2023-12-19T13:45:49.571 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on too few osds = false 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: mon_allow_pool_size_one = true 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: osd default data pool replay window = 5 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: mon allow pool delete = true 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.572 INFO:teuthology.orchestra.run.smithi113.stdout: mon cluster log file level = debug 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: debug asserts on shutdown = true 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: mon health detail to clog = false 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: mon host = "172.21.15.113,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on skipped message = False 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = b8121e09-ebc1-4371-9bac-afd10a2a5b83 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:[osd] 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: osd journal size = 100 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.573 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub load threshold = 5.0 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub max interval = 600 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd mclock profile = high_recovery_ops 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd recover clone overlap = true 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd recovery max chunk = 1048576 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug shutdown = true 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug op order = true 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug verify stray on activate = true 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd open classes on start = true 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug pg log writeout = true 2023-12-19T13:45:49.574 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: osd deep scrub update digest min age = 30 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: osd map max advance = 10 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: journal zero on create = true 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: filestore ondisk finisher threads = 3 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: filestore apply finisher threads = 3 2023-12-19T13:45:49.575 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: bdev debug aio = true 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug misdirected ops = true 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: bdev async discard = True 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: bdev enable discard = True 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore allocator = bitmap 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore block size = 96636764160 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore fsck on mount = True 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluefs = 1/20 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluestore = 1/20 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: debug osd = 20 2023-12-19T13:45:49.576 INFO:teuthology.orchestra.run.smithi113.stdout: debug rocksdb = 4/10 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: memstore device bytes = 200000000 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.9 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.8 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: osd failsafe full ratio = 1.0 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: osd mon report interval = 5 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: osd objectstore = memstore 2023-12-19T13:45:49.577 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-19T13:45:49.578 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.578 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr] 2023-12-19T13:45:49.578 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-19T13:45:49.578 INFO:teuthology.orchestra.run.smithi113.stdout: debug mgr = 20 2023-12-19T13:45:49.578 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: mgr/telemetry/nag = false 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout:[mon] 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: debug paxos = 20 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-19T13:45:49.579 INFO:teuthology.orchestra.run.smithi113.stdout: mon data avail warn = 5 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: mon mgr mkfs grace = 240 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd reporter subtree level = osd 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd prime pg temp = true 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T13:45:49.580 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: # 1m isn't quite enough 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: mon_down_mkfs_grace = 2m 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_filestore_osds = false 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: mon op complaint time = 120 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull ratio = 0.6 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.7 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.6 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:45:49.581 INFO:teuthology.orchestra.run.smithi113.stdout:[client] 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: rgw cache enabled = true 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable ops log = true 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable usage log = true 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: client mount timeout = 600 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = "" 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-19T13:45:49.582 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-19T13:45:49.583 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.a] 2023-12-19T13:45:49.583 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.b] 2023-12-19T13:45:49.583 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.c] 2023-12-19T13:45:49.583 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2023-12-19T13:45:49.583 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2023-12-19T13:45:49.583 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2023-12-19T13:45:49.583 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2023-12-19T13:45:49.584 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2023-12-19T13:45:49.584 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2023-12-19T13:45:49.584 INFO:teuthology.orchestra.run.smithi113.stdout: debug objectcacher = 20 2023-12-19T13:45:49.584 INFO:teuthology.orchestra.run.smithi113.stdout: debug objecter = 20 2023-12-19T13:45:49.584 INFO:teuthology.orchestra.run.smithi113.stdout:[client.1] 2023-12-19T13:45:49.584 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2023-12-19T13:45:49.584 INFO:teuthology.orchestra.run.smithi113.stdout: debug objectcacher = 20 2023-12-19T13:45:49.585 INFO:teuthology.orchestra.run.smithi113.stdout: debug objecter = 20 2023-12-19T13:45:49.585 INFO:teuthology.orchestra.run.smithi113.stdout:[mds] 2023-12-19T13:45:49.585 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds = 20 2023-12-19T13:45:49.585 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds balancer = 20 2023-12-19T13:45:49.585 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-19T13:45:49.585 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug frag = True 2023-12-19T13:45:49.586 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug scatterstat = True 2023-12-19T13:45:49.586 INFO:teuthology.orchestra.run.smithi113.stdout: mds op complaint time = 180 2023-12-19T13:45:49.586 INFO:teuthology.orchestra.run.smithi113.stdout: mds verify scatter = True 2023-12-19T13:45:49.586 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-19T13:45:49.586 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-19T13:45:49.586 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-19T13:45:49.587 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-12-19T13:45:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-12-19T13:45:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T13:45:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-12-19T13:45:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-12-19T13:45:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-12-19T13:45:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-12-19T13:45:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-12-19T13:45:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-12-19T13:45:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.113,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on skipped message = False 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = b8121e09-ebc1-4371-9bac-afd10a2a5b83 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-12-19T13:45:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: memstore device bytes = 200000000 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 1.0 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: osd mon report interval = 5 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = memstore 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-12-19T13:45:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:45:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-12-19T13:45:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull ratio = 0.6 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.7 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.6 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-12-19T13:45:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: debug objectcacher = 20 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: debug objecter = 20 2023-12-19T13:45:49.599 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: debug objectcacher = 20 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: debug objecter = 20 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-12-19T13:45:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-12-19T13:45:49.625 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T13:45:49.626 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T13:45:49.774 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T13:45:49.775 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:49.775 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T13:45:49.825 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:49.825 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T13:45:49.925 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:45:49.926 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:49.926 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T13:45:49.926 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T13:45:50.078 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:45:50.079 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:50.177 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:45:50.177 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:50.177 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T13:45:50.177 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T13:45:50.341 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:45:50.341 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:50.441 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T13:45:50.442 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T13:45:50.442 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T13:45:50.631 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T13:45:50.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T13:45:50.828 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T13:45:50.836 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T13:45:50.836 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T13:45:51.030 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T13:45:51.039 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T13:45:51.131 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T13:45:51.302 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T13:45:51.311 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T13:45:51.400 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T13:45:51.569 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T13:45:51.575 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T13:45:51.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T13:45:51.823 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T13:45:51.833 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-19T13:45:51.914 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T13:45:51.915 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T13:45:52.045 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T13:45:52.102 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-19T13:45:52.230 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-19T13:45:52.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-19T13:45:52.406 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-19T13:45:52.465 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-19T13:45:52.591 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-19T13:45:52.646 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T13:45:52.646 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T13:45:52.646 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T13:45:52.748 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:52.749 INFO:tasks.ceph:role: osd.0 2023-12-19T13:45:52.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:45:52.749 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T13:45:52.845 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:45:52.845 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:45:52.845 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:45:52.845 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:45:52.845 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:45:52.845 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:45:52.845 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:45:52.846 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:45:52.846 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:45:52.846 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:45:53.400 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2023-12-19T13:45:53.407 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-19T13:45:53.407 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T13:45:53.569 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T13:45:53.671 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T13:45:53.755 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:53.756 INFO:tasks.ceph:role: osd.1 2023-12-19T13:45:53.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:45:53.756 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:45:53.857 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:45:54.370 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2023-12-19T13:45:54.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-19T13:45:54.377 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T13:45:54.522 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T13:45:54.621 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T13:45:54.716 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:54.716 INFO:tasks.ceph:role: osd.2 2023-12-19T13:45:54.716 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:45:54.716 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T13:45:54.819 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:45:54.819 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:45:54.819 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:45:54.819 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:45:54.819 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:45:54.819 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:45:54.820 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:45:54.820 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:45:54.820 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:45:54.820 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:45:55.353 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2023-12-19T13:45:55.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-19T13:45:55.359 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T13:45:55.513 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T13:45:55.615 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T13:45:55.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:55.704 INFO:tasks.ceph:role: osd.3 2023-12-19T13:45:55.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:45:55.704 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T13:45:55.801 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:45:55.801 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:45:55.801 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:45:55.801 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:45:55.801 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:45:55.801 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:45:55.801 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:45:55.802 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:45:55.802 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:45:55.802 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:45:56.328 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2023-12-19T13:45:56.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-19T13:45:56.334 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T13:45:56.505 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T13:45:56.679 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:56.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:56.825+0000 7feebf8c3500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T13:45:56.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:56.826+0000 7feebf8c3500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T13:45:56.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:56.833+0000 7feebf8c3500 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-12-19T13:45:56.855 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T13:45:56.945 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:57.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.079+0000 7fcdd8422500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T13:45:57.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.080+0000 7fcdd8422500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T13:45:57.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.082+0000 7fcdd8422500 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-12-19T13:45:57.108 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T13:45:57.195 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:57.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.337+0000 7fa6d5e8c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T13:45:57.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.337+0000 7fa6d5e8c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T13:45:57.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.339+0000 7fa6d5e8c500 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-12-19T13:45:57.360 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T13:45:57.450 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:45:57.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.590+0000 7f873680d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T13:45:57.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.590+0000 7f873680d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T13:45:57.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:45:57.592+0000 7f873680d500 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-12-19T13:45:57.610 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T13:45:57.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T13:45:57.795 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:57.795 INFO:tasks.ceph:role: osd.4 2023-12-19T13:45:57.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:45:57.795 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T13:45:57.894 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:45:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:45:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:45:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:45:57.895 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:45:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:45:57.895 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:45:57.895 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:45:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:45:57.895 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:45:58.427 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-19T13:45:58.435 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-19T13:45:58.436 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T13:45:58.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T13:45:58.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T13:45:58.823 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:58.823 INFO:tasks.ceph:role: osd.5 2023-12-19T13:45:58.823 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:45:58.823 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:45:58.919 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:45:59.411 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-19T13:45:59.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-19T13:45:59.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T13:45:59.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T13:45:59.635 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T13:45:59.730 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:45:59.730 INFO:tasks.ceph:role: osd.6 2023-12-19T13:45:59.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:45:59.730 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:45:59.828 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:46:00.350 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-19T13:46:00.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-19T13:46:00.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T13:46:00.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T13:46:00.661 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T13:46:00.758 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:46:00.758 INFO:tasks.ceph:role: osd.7 2023-12-19T13:46:00.758 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:46:00.759 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T13:46:00.855 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:46:00.856 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:46:01.317 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-19T13:46:01.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-19T13:46:01.324 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T13:46:01.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T13:46:01.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:46:01.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:01.738+0000 7f860cd07500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T13:46:01.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:01.742+0000 7f860cd07500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T13:46:01.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:01.745+0000 7f860cd07500 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-12-19T13:46:01.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T13:46:01.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:46:02.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.011+0000 7f7bd9625500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T13:46:02.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.015+0000 7f7bd9625500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T13:46:02.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.024+0000 7f7bd9625500 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-12-19T13:46:02.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T13:46:02.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:46:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.281+0000 7f104461e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T13:46:02.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.284+0000 7f104461e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T13:46:02.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.292+0000 7f104461e500 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-12-19T13:46:02.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T13:46:02.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:46:02.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.542+0000 7f6600019500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T13:46:02.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.543+0000 7f6600019500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T13:46:02.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:02.545+0000 7f6600019500 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-12-19T13:46:02.562 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T13:46:02.642 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T13:46:02.642 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:02.642 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T13:46:02.745 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:02.746 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T13:46:02.838 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:02.838 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T13:46:02.931 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:02.931 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T13:46:03.021 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:03.021 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T13:46:03.115 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:03.115 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T13:46:03.256 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:03.256 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T13:46:03.353 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:03.353 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T13:46:03.455 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:03.455 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T13:46:03.550 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:03.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-19T13:46:03.645 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:03.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T13:46:03.741 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:03.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T13:46:03.835 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:03.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T13:46:03.930 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:03.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T13:46:04.023 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:04.023 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T13:46:04.084 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:04.084 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-19T13:46:04.136 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:04.136 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-19T13:46:04.195 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:04.195 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-19T13:46:04.244 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T13:46:04.244 DEBUG:teuthology.orchestra.run.smithi113:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T13:46:04.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T13:46:04.341 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.y] 2023-12-19T13:46:04.341 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw== 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ== 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw== 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.0] 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw== 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.1] 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg== 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.2] 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ== 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.3] 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA== 2023-12-19T13:46:04.342 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.x] 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg== 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw== 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ== 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.4] 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ== 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.5] 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g== 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.6] 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw== 2023-12-19T13:46:04.343 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.7] 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg== 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA== 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout:[client.2] 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw== 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout:[client.1] 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw== 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout:[client.3] 2023-12-19T13:46:04.344 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw== 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw== 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ== 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw== 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2023-12-19T13:46:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw== 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg== 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ== 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA== 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg== 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw== 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ== 2023-12-19T13:46:04.386 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ== 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g== 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw== 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg== 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA== 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout:[client.2] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw== 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw== 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout:[client.3] 2023-12-19T13:46:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw== 2023-12-19T13:46:04.389 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:46:04.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:46:04.541 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:04.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:04.687 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:04.695 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:04.839 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:04.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:04.990 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:04.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:05.147 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:05.155 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:05.297 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:05.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:05.453 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:46:05.462 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:46:05.604 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:05.611 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:05.756 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:05.765 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:46:05.910 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:05.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:06.057 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:06.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:06.209 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:06.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:06.366 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:06.372 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:46:06.513 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:06.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:06.660 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:06.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:06.818 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:06.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:06.971 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:06.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:46:07.128 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T13:46:07.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T13:46:07.222 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T13:46:07.382 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T13:46:07.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T13:46:07.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T13:46:07.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T13:46:07.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T13:46:07.923 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T13:46:08.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T13:46:08.157 DEBUG:teuthology.orchestra.run.smithi113:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:46:08.166 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:46:08.218 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T13:46:08.219 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T13:46:08.219 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T13:46:08.225 INFO:tasks.ceph.mon.a:Started 2023-12-19T13:46:08.225 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T13:46:08.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T13:46:08.230 INFO:tasks.ceph.mon.b:Started 2023-12-19T13:46:08.230 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T13:46:08.231 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T13:46:08.236 INFO:tasks.ceph.mon.c:Started 2023-12-19T13:46:08.236 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T13:46:08.236 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T13:46:08.236 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T13:46:08.241 INFO:tasks.ceph.mgr.y:Started 2023-12-19T13:46:08.241 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T13:46:08.241 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T13:46:08.247 INFO:tasks.ceph.mgr.x:Started 2023-12-19T13:46:08.247 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T13:46:08.247 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T13:46:08.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.430+0000 7f6a5ad47640 1 Processor -- start 2023-12-19T13:46:08.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.430+0000 7f6a5ad47640 1 -- start start 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a5ad47640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a5ad47640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a5ad47640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5415d980 con 0x7f6a540cf9a0 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a5ad47640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a540cf4b0 con 0x7f6a540b1b30 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a5ad47640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a540d1530 con 0x7f6a5415d5a0 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a592e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a592e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45448/0 (socket says 172.21.15.113:45448) 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 learned_addr learned my addr 172.21.15.113:0/1605147200 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T13:46:08.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:08.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:08.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.432+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T13:46:08.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.433+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:08.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.433+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:08.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.433+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:08.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.433+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T13:46:08.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.633+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.634+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.634+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.634+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.634+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-19T13:46:08.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.634+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:08.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.635+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T13:46:08.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.635+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:08.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.635+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:08.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:08.635+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-19T13:46:09.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.035+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:09.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.036+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:09.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.036+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:09.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.036+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:09.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.036+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-19T13:46:09.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.036+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:09.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.037+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T13:46:09.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.037+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:09.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.037+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:09.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.037+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-19T13:46:09.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.837+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.838+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.838+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.838+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.838+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-19T13:46:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.838+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.839+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T13:46:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.839+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.839+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:09.839+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-19T13:46:11.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 msgr2=0x7f6a54070a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:46:11.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.151:3300/0 conn(0x7f6a5415d5a0 0x7f6a54070a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:11.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 -- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 msgr2=0x7f6a54070f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:46:11.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 --2- 172.21.15.113:0/1605147200 >> v2:172.21.15.113:3300/0 conn(0x7f6a540b1b30 0x7f6a54070f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:11.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 -- 172.21.15.113:0/1605147200 >> v1:172.21.15.151:6789/0 conn(0x7f6a540cf9a0 legacy=0x7f6a54161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:11.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:11.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 -- 172.21.15.113:0/1605147200 --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a54071d90 con 0x7f6a38006150 2023-12-19T13:46:11.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.432+0000 7f6a527fc640 1 -- 172.21.15.113:0/1605147200 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540d1530 con 0x7f6a38003690 2023-12-19T13:46:11.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.433+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:11.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.433+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:11.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.433+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:11.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.433+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:11.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.433+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T13:46:11.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.635+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:11.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.635+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:11.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.635+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:11.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.635+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:11.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:11.635+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-19T13:46:12.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.036+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:12.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.037+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:12.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.037+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:12.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.037+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:12.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.037+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-19T13:46:12.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.839+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:12.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.839+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:46:12.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.839+0000 7f6a58ae3640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:46:12.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.839+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:46:12.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:12.839+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-19T13:46:13.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.689+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843406063 0 0) 0x7f6a54071d90 con 0x7f6a38006150 2023-12-19T13:46:13.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.690+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a44003520 con 0x7f6a38006150 2023-12-19T13:46:13.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 729107943 0 0) 0x7f6a44003520 con 0x7f6a38006150 2023-12-19T13:46:13.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a38005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:46:13.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a38005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3800af30 con 0x7f6a38006150 2023-12-19T13:46:13.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6a400016f0 con 0x7f6a38006150 2023-12-19T13:46:13.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 >> v1:172.21.15.113:6789/0 conn(0x7f6a38006150 legacy=0x7f6a380085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:13.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a44004d70 0x7f6a440051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540d1530 con 0x7f6a44003ff0 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4400bc80 con 0x7f6a44004d70 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4400be40 con 0x7f6a38003690 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.691+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 reap_dead start 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.692+0000 7f6a53fff640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:13.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.692+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a44004d70 0x7f6a440051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:13.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.693+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:13.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.693+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 msgr2=0x7f6a440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:13.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.693+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.693+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 msgr2=0x7f6a440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:13.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.693+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.693+0000 7f6a592e4640 1 -- 172.21.15.113:0/1605147200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44003520 con 0x7f6a44004d70 2023-12-19T13:46:13.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.693+0000 7f6a53fff640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:13.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.695+0000 7f6a592e4640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a44004d70 0x7f6a440051f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a54067260 tx=0x7f6a440057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6cfcf130f22a2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:13.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.696+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c035410 con 0x7f6a44004d70 2023-12-19T13:46:13.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.696+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c02f030 con 0x7f6a44004d70 2023-12-19T13:46:13.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.696+0000 7f6a537fe640 1 -- 172.21.15.113:0/1605147200 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0355b0 con 0x7f6a44004d70 2023-12-19T13:46:13.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.697+0000 7f6a5ad47640 1 -- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a44004d70 msgr2=0x7f6a440051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:13.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.697+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a44004d70 0x7f6a440051f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a54067260 tx=0x7f6a440057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.697+0000 7f6a5ad47640 1 -- 172.21.15.113:0/1605147200 shutdown_connections 2023-12-19T13:46:13.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.697+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.697+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a38003690 0x7f6a440039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.697+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/1605147200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a44004d70 0x7f6a440051f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.697+0000 7f6a5ad47640 1 -- 172.21.15.113:0/1605147200 >> 172.21.15.113:0/1605147200 conn(0x7f6a540cfd80 msgr2=0x7f6a540d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:13.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.698+0000 7f6a5ad47640 1 -- 172.21.15.113:0/1605147200 shutdown_connections 2023-12-19T13:46:13.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.698+0000 7f6a5ad47640 1 -- 172.21.15.113:0/1605147200 wait complete. 2023-12-19T13:46:13.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.701+0000 7f6a5ad47640 1 Processor -- start 2023-12-19T13:46:13.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.701+0000 7f6a5ad47640 1 -- start start 2023-12-19T13:46:13.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.702+0000 7f6a5ad47640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a38003690 0x7f6a540ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:13.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.702+0000 7f6a5ad47640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a5413f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:13.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a5ad47640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a44004d70 0x7f6a5413f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:13.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a5ad47640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54158570 con 0x7f6a44003ff0 2023-12-19T13:46:13.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a5ad47640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54145e50 con 0x7f6a38003690 2023-12-19T13:46:13.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a5ad47640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540cae30 con 0x7f6a44004d70 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a5413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a5413f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45542/0 (socket says 172.21.15.113:45542) 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 -- 172.21.15.113:0/3587161454 learned_addr learned my addr 172.21.15.113:0/3587161454 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a592e4640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a44004d70 0x7f6a5413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a58ae3640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a38003690 0x7f6a540ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 -- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a44004d70 msgr2=0x7f6a5413f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a44004d70 0x7f6a5413f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 -- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a38003690 msgr2=0x7f6a540ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a38003690 0x7f6a540ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.703+0000 7f6a53fff640 1 -- 172.21.15.113:0/3587161454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54157bd0 con 0x7f6a44003ff0 2023-12-19T13:46:13.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.704+0000 7f6a53fff640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a5413f400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a40001820 tx=0x7f6a4000fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:13.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.704+0000 7f6a517fa640 1 -- 172.21.15.113:0/3587161454 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000fec0 con 0x7f6a44003ff0 2023-12-19T13:46:13.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.704+0000 7f6a517fa640 1 -- 172.21.15.113:0/3587161454 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a400052e0 con 0x7f6a44003ff0 2023-12-19T13:46:13.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.704+0000 7f6a517fa640 1 -- 172.21.15.113:0/3587161454 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000d930 con 0x7f6a44003ff0 2023-12-19T13:46:13.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.704+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a54157eb0 con 0x7f6a44003ff0 2023-12-19T13:46:13.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.705+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a541578a0 con 0x7f6a44003ff0 2023-12-19T13:46:13.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.705+0000 7f6a517fa640 1 -- 172.21.15.113:0/3587161454 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a400035f0 con 0x7f6a44003ff0 2023-12-19T13:46:13.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.705+0000 7f6a517fa640 1 -- 172.21.15.113:0/3587161454 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6a4001d460 con 0x7f6a44003ff0 2023-12-19T13:46:13.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.706+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5415d980 con 0x7f6a44003ff0 2023-12-19T13:46:13.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.710+0000 7f6a517fa640 1 -- 172.21.15.113:0/3587161454 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f6a5415d980 con 0x7f6a44003ff0 2023-12-19T13:46:13.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.783+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6a540d1200 con 0x7f6a44003ff0 2023-12-19T13:46:13.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.788+0000 7f6a517fa640 1 -- 172.21.15.113:0/3587161454 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6a40003a80 con 0x7f6a44003ff0 2023-12-19T13:46:13.788 INFO:teuthology.orchestra.run.smithi113.stderr:adjusted tunables profile to default 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 msgr2=0x7f6a5413f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a5413f400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a40001820 tx=0x7f6a4000fc70 comp rx=0 tx=0).stop 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 shutdown_connections 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a44004d70 0x7f6a5413f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44003ff0 0x7f6a5413f400 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 --2- 172.21.15.113:0/3587161454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a38003690 0x7f6a540ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 >> 172.21.15.113:0/3587161454 conn(0x7f6a540cfd80 msgr2=0x7f6a5415c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 shutdown_connections 2023-12-19T13:46:13.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:13.790+0000 7f6a5ad47640 1 -- 172.21.15.113:0/3587161454 wait complete. 2023-12-19T13:46:13.807 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T13:46:13.807 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T13:46:13.807 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:13.807 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T13:46:13.888 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:13.888 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T13:46:14.020 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:14.020 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T13:46:14.100 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:14.100 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T13:46:14.228 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:14.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T13:46:14.235 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:14.235+0000 7fc4d6611040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T13:46:14.241 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:14.235+0000 7fa7f066f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T13:46:14.295 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:14.295+0000 7fc4d6611040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T13:46:14.299 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:14.298+0000 7fa7f066f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T13:46:14.321 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:14.321 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T13:46:14.405 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:14.405 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T13:46:14.535 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:46:14.535 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T13:46:14.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-12-19T13:46:14.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.843+0000 7fe27a262640 1 Processor -- start 2023-12-19T13:46:14.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.844+0000 7fe27a262640 1 -- start start 2023-12-19T13:46:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.845+0000 7fe27a262640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe2740b43e0 0x7fe27415b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.845+0000 7fe27a262640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27406e8a0 con 0x7fe27415b180 2023-12-19T13:46:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.845+0000 7fe27a262640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27415c7e0 con 0x7fe2740d0f30 2023-12-19T13:46:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.845+0000 7fe27a262640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2740ceb80 con 0x7fe2740b43e0 2023-12-19T13:46:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.846+0000 7fe279a61640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe2740d0f30 0x7fe2740d1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:44516/0 (socket says 172.21.15.151:44516) 2023-12-19T13:46:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.846+0000 7fe279a61640 1 -- 172.21.15.151:0/84082066 learned_addr learned my addr 172.21.15.151:0/84082066 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-19T13:46:14.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.846+0000 7fe278a5f640 1 --2- 172.21.15.151:0/84082066 >> v2:172.21.15.113:3300/0 conn(0x7fe2740b43e0 0x7fe27415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:14.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.846+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83441537 0 0) 0x7fe27415c7e0 con 0x7fe2740d0f30 2023-12-19T13:46:14.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.846+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe260003520 con 0x7fe2740d0f30 2023-12-19T13:46:14.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.846+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896334476 0 0) 0x7fe27406e8a0 con 0x7fe27415b180 2023-12-19T13:46:14.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe27415c7e0 con 0x7fe27415b180 2023-12-19T13:46:14.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090509069 0 0) 0x7fe260003520 con 0x7fe2740d0f30 2023-12-19T13:46:14.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 >> v2:172.21.15.113:3300/0 conn(0x7fe2740b43e0 msgr2=0x7fe27415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 --2- 172.21.15.151:0/84082066 >> v2:172.21.15.113:3300/0 conn(0x7fe2740b43e0 0x7fe27415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 >> v1:172.21.15.113:6789/0 conn(0x7fe27415b180 legacy=0x7fe2740ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27415bc60 con 0x7fe2740d0f30 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe26c0019f0 con 0x7fe2740d0f30 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 >> v1:172.21.15.151:6789/0 conn(0x7fe2740d0f30 legacy=0x7fe2740d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003bc0 0x7fe260003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2600047c0 0x7fe260004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe260005180 0x7fe26000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740ceb80 con 0x7fe260003bc0 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26000c120 con 0x7fe260005180 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26000c2e0 con 0x7fe2600047c0 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe278a5f640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2600047c0 0x7fe260004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe279260640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003bc0 0x7fe260003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:14.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe279a61640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe260005180 0x7fe26000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe278a5f640 1 -- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe260005180 msgr2=0x7fe26000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe278a5f640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe260005180 0x7fe26000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe278a5f640 1 -- 172.21.15.151:0/84082066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003bc0 msgr2=0x7fe260003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe278a5f640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003bc0 0x7fe260003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.847+0000 7fe278a5f640 1 -- 172.21.15.151:0/84082066 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260003520 con 0x7fe2600047c0 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.848+0000 7fe279a61640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe260005180 0x7fe26000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.848+0000 7fe279a61640 1 -- 172.21.15.151:0/84082066 reap_dead start 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.849+0000 7fe278a5f640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2600047c0 0x7fe260004c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe264009a90 tx=0x7fe2600057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96430fbe40736e3e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.849+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26402c680 con 0x7fe2600047c0 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.849+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26402c7e0 con 0x7fe2600047c0 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.849+0000 7fe26bfff640 1 -- 172.21.15.151:0/84082066 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26402cb90 con 0x7fe2600047c0 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.850+0000 7fe27a262640 1 -- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2600047c0 msgr2=0x7fe260004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.850+0000 7fe27a262640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2600047c0 0x7fe260004c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe264009a90 tx=0x7fe2600057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.850+0000 7fe27a262640 1 -- 172.21.15.151:0/84082066 shutdown_connections 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.850+0000 7fe27a262640 1 --2- 172.21.15.151:0/84082066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2600047c0 0x7fe260004c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.850+0000 7fe27a262640 1 -- 172.21.15.151:0/84082066 >> 172.21.15.151:0/84082066 conn(0x7fe27406f160 msgr2=0x7fe27406f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.850+0000 7fe27a262640 1 -- 172.21.15.151:0/84082066 shutdown_connections 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.850+0000 7fe27a262640 1 -- 172.21.15.151:0/84082066 wait complete. 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.852+0000 7fe27a262640 1 Processor -- start 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.852+0000 7fe27a262640 1 -- start start 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe27a262640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2600047c0 0x7fe2741533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe27a262640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe274154740 0x7fe274070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe27a262640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe274153ae0 0x7fe274070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe27a262640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741576d0 con 0x7fe274154740 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe27a262640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274153910 con 0x7fe2600047c0 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe27a262640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe274156de0 con 0x7fe274153ae0 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe279260640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2600047c0 0x7fe2741533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe279260640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2600047c0 0x7fe2741533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46944/0 (socket says 172.21.15.151:46944) 2023-12-19T13:46:14.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe279260640 1 -- 172.21.15.151:0/3898002222 learned_addr learned my addr 172.21.15.151:0/3898002222 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe279a61640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe274153ae0 0x7fe274070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe278a5f640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe274154740 0x7fe274070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe279260640 1 -- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe274153ae0 msgr2=0x7fe274070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.853+0000 7fe279260640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe274153ae0 0x7fe274070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe279260640 1 -- 172.21.15.151:0/3898002222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe274154740 msgr2=0x7fe274070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe279260640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe274154740 0x7fe274070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe279260640 1 -- 172.21.15.151:0/3898002222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274157080 con 0x7fe2600047c0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe279260640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2600047c0 0x7fe2741533d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e780 tx=0x7fe27000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe269ffb640 1 -- 172.21.15.151:0/3898002222 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700050d0 con 0x7fe2600047c0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe269ffb640 1 -- 172.21.15.151:0/3898002222 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270005230 con 0x7fe2600047c0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe269ffb640 1 -- 172.21.15.151:0/3898002222 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27000c6c0 con 0x7fe2600047c0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe274157360 con 0x7fe2600047c0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.854+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2741541f0 con 0x7fe2600047c0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.855+0000 7fe269ffb640 1 -- 172.21.15.151:0/3898002222 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe27000cb20 con 0x7fe2600047c0 2023-12-19T13:46:14.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.855+0000 7fe269ffb640 1 -- 172.21.15.151:0/3898002222 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe270003cb0 con 0x7fe2600047c0 2023-12-19T13:46:14.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.855+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe274066a60 con 0x7fe2600047c0 2023-12-19T13:46:14.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.858+0000 7fe269ffb640 1 -- 172.21.15.151:0/3898002222 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fe2700035f0 con 0x7fe2600047c0 2023-12-19T13:46:14.900 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:14.900+0000 7fc4d6611040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T13:46:14.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.936+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7fe2741574f0 con 0x7fe2600047c0 2023-12-19T13:46:14.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.943+0000 7fe269ffb640 1 -- 172.21.15.151:0/3898002222 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe270003790 con 0x7fe2600047c0 2023-12-19T13:46:14.944 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-12-19T13:46:14.945 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:14.944+0000 7fa7f066f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T13:46:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.945+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2600047c0 msgr2=0x7fe2741533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.945+0000 7fe27a262640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2600047c0 0x7fe2741533d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e780 tx=0x7fe27000eb80 comp rx=0 tx=0).stop 2023-12-19T13:46:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.945+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 shutdown_connections 2023-12-19T13:46:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.945+0000 7fe27a262640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe274153ae0 0x7fe274070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.945+0000 7fe27a262640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe274154740 0x7fe274070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.945+0000 7fe27a262640 1 --2- 172.21.15.151:0/3898002222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2600047c0 0x7fe2741533d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.945+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 >> 172.21.15.151:0/3898002222 conn(0x7fe27406f160 msgr2=0x7fe2740ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.946+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 shutdown_connections 2023-12-19T13:46:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:14.946+0000 7fe27a262640 1 -- 172.21.15.151:0/3898002222 wait complete. 2023-12-19T13:46:14.961 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:14.961+0000 7fc4d6611040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T13:46:14.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-12-19T13:46:15.012 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.012+0000 7fc4d6611040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T13:46:15.016 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.016+0000 7fa7f066f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T13:46:15.073 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.073+0000 7fc4d6611040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T13:46:15.074 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.073+0000 7fa7f066f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T13:46:15.122 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.122+0000 7fc4d6611040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T13:46:15.143 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.143+0000 7fa7f066f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T13:46:15.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.152+0000 7f141438b640 1 Processor -- start 2023-12-19T13:46:15.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.153+0000 7f141438b640 1 -- start start 2023-12-19T13:46:15.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.154+0000 7f141438b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f140c15a190 0x7f140c0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.154+0000 7f141438b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f140c0aef40 0x7f140c0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.154+0000 7f141438b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0b0c40 con 0x7f140c0b07f0 2023-12-19T13:46:15.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.154+0000 7f141438b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0ad960 con 0x7f140c15a190 2023-12-19T13:46:15.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.154+0000 7f141438b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0adc40 con 0x7f140c0aef40 2023-12-19T13:46:15.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1411926640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f140c0aef40 0x7f140c0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1411926640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f140c0aef40 0x7f140c0b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42388/0 (socket says 172.21.15.151:42388) 2023-12-19T13:46:15.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1411926640 1 -- 172.21.15.151:0/3134441224 learned_addr learned my addr 172.21.15.151:0/3134441224 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:15.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1412127640 1 --2- 172.21.15.151:0/3134441224 >> v2:172.21.15.113:3300/0 conn(0x7f140c15a190 0x7f140c0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1411926640 1 -- 172.21.15.151:0/3134441224 >> v2:172.21.15.113:3300/0 conn(0x7f140c15a190 msgr2=0x7f140c0aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:15.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1411926640 1 --2- 172.21.15.151:0/3134441224 >> v2:172.21.15.113:3300/0 conn(0x7f140c15a190 0x7f140c0aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1411926640 1 -- 172.21.15.151:0/3134441224 >> v1:172.21.15.113:6789/0 conn(0x7f140c0b07f0 legacy=0x7f140c0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:15.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.155+0000 7f1411926640 1 -- 172.21.15.151:0/3134441224 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0adf20 con 0x7f140c0aef40 2023-12-19T13:46:15.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.156+0000 7f1411926640 1 --2- 172.21.15.151:0/3134441224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c0aef40 0x7f140c0b02b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f140c0cbaa0 tx=0x7f140002da90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e300dca68f2cb69d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:15.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.156+0000 7f1411125640 1 -- 172.21.15.151:0/3134441224 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140002f850 con 0x7f140c0aef40 2023-12-19T13:46:15.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.156+0000 7f1411125640 1 -- 172.21.15.151:0/3134441224 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140002f9b0 con 0x7f140c0aef40 2023-12-19T13:46:15.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.156+0000 7f1411125640 1 -- 172.21.15.151:0/3134441224 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140002fd40 con 0x7f140c0aef40 2023-12-19T13:46:15.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 -- 172.21.15.151:0/3134441224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c0aef40 msgr2=0x7f140c0b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 --2- 172.21.15.151:0/3134441224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c0aef40 0x7f140c0b02b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f140c0cbaa0 tx=0x7f140002da90 comp rx=0 tx=0).stop 2023-12-19T13:46:15.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 -- 172.21.15.151:0/3134441224 shutdown_connections 2023-12-19T13:46:15.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 --2- 172.21.15.151:0/3134441224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c0aef40 0x7f140c0b02b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 --2- 172.21.15.151:0/3134441224 >> v2:172.21.15.113:3300/0 conn(0x7f140c15a190 0x7f140c0aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 -- 172.21.15.151:0/3134441224 >> 172.21.15.151:0/3134441224 conn(0x7f140c066160 msgr2=0x7f140c0cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:15.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 -- 172.21.15.151:0/3134441224 shutdown_connections 2023-12-19T13:46:15.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.157+0000 7f141438b640 1 -- 172.21.15.151:0/3134441224 wait complete. 2023-12-19T13:46:15.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.159+0000 7f141438b640 1 Processor -- start 2023-12-19T13:46:15.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.159+0000 7f141438b640 1 -- start start 2023-12-19T13:46:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f141438b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f140c0b07f0 0x7f140c148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f141438b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f140c15a190 0x7f140c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f141438b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c15aab0 0x7f140c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f141438b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15c0d0 con 0x7f140c15a190 2023-12-19T13:46:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f141438b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15b030 con 0x7f140c15aab0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f141438b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15b310 con 0x7f140c0b07f0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f1412127640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f140c0b07f0 0x7f140c148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f1412928640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c15aab0 0x7f140c15c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f1412127640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f140c0b07f0 0x7f140c148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:45458/0 (socket says 172.21.15.151:45458) 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.160+0000 7f1412127640 1 -- 172.21.15.151:0/4165029568 learned_addr learned my addr 172.21.15.151:0/4165029568 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f1411926640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f140c15a190 0x7f140c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f1412928640 1 -- 172.21.15.151:0/4165029568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f140c0b07f0 msgr2=0x7f140c148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f1412928640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f140c0b07f0 0x7f140c148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f1412928640 1 -- 172.21.15.151:0/4165029568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f140c15a190 msgr2=0x7f140c15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f1412928640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f140c15a190 0x7f140c15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f1412928640 1 -- 172.21.15.151:0/4165029568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14000094d0 con 0x7f140c15aab0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f1412928640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c15aab0 0x7f140c15c9f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f140400c410 tx=0x7f140400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f140affd640 1 -- 172.21.15.151:0/4165029568 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040035f0 con 0x7f140c15aab0 2023-12-19T13:46:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f140affd640 1 -- 172.21.15.151:0/4165029568 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404003750 con 0x7f140c15aab0 2023-12-19T13:46:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c15b5f0 con 0x7f140c15aab0 2023-12-19T13:46:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.161+0000 7f140affd640 1 -- 172.21.15.151:0/4165029568 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404003b00 con 0x7f140c15aab0 2023-12-19T13:46:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.162+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c15bbb0 con 0x7f140c15aab0 2023-12-19T13:46:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.162+0000 7f140affd640 1 -- 172.21.15.151:0/4165029568 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1404007020 con 0x7f140c15aab0 2023-12-19T13:46:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.162+0000 7f140affd640 1 -- 172.21.15.151:0/4165029568 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1404012400 con 0x7f140c15aab0 2023-12-19T13:46:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.163+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c061910 con 0x7f140c15aab0 2023-12-19T13:46:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.165+0000 7f140affd640 1 -- 172.21.15.151:0/4165029568 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f1404017070 con 0x7f140c15aab0 2023-12-19T13:46:15.200 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.200+0000 7fa7f066f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T13:46:15.234 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.234+0000 7fc4d6611040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T13:46:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.244+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f140c0ad480 con 0x7f140c15aab0 2023-12-19T13:46:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.252+0000 7f140affd640 1 -- 172.21.15.151:0/4165029568 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1404007500 con 0x7f140c15aab0 2023-12-19T13:46:15.252 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c15aab0 msgr2=0x7f140c15c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c15aab0 0x7f140c15c9f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f140400c410 tx=0x7f140400c8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 shutdown_connections 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f140c15aab0 0x7f140c15c9f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f140c15a190 0x7f140c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 --2- 172.21.15.151:0/4165029568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f140c0b07f0 0x7f140c148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 >> 172.21.15.151:0/4165029568 conn(0x7f140c066160 msgr2=0x7f140c156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 shutdown_connections 2023-12-19T13:46:15.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.253+0000 7f141438b640 1 -- 172.21.15.151:0/4165029568 wait complete. 2023-12-19T13:46:15.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-12-19T13:46:15.315 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.315+0000 7fc4d6611040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T13:46:15.325 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.324+0000 7fa7f066f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T13:46:15.367 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.367+0000 7fc4d6611040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T13:46:15.409 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.409+0000 7fa7f066f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T13:46:15.425 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.426+0000 7fc4d6611040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T13:46:15.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.459+0000 7f59d687d640 1 Processor -- start 2023-12-19T13:46:15.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.460+0000 7f59d687d640 1 -- start start 2023-12-19T13:46:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.461+0000 7f59d687d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f59d006f160 0x7f59d00d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.461+0000 7f59d687d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f59d00d1c60 0x7f59d015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.461+0000 7f59d687d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00d2d20 con 0x7f59d0146d60 2023-12-19T13:46:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.461+0000 7f59d687d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d00d2110 con 0x7f59d00d1c60 2023-12-19T13:46:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.461+0000 7f59d687d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d00d3000 con 0x7f59d006f160 2023-12-19T13:46:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.461+0000 7f59cf7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f59d006f160 0x7f59d00d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59cf7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f59d006f160 0x7f59d00d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42404/0 (socket says 172.21.15.151:42404) 2023-12-19T13:46:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59cf7fe640 1 -- 172.21.15.151:0/820030739 learned_addr learned my addr 172.21.15.151:0/820030739 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59d4e1a640 1 --2- 172.21.15.151:0/820030739 >> v2:172.21.15.113:3300/0 conn(0x7f59d00d1c60 0x7f59d015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59cf7fe640 1 -- 172.21.15.151:0/820030739 >> v2:172.21.15.113:3300/0 conn(0x7f59d00d1c60 msgr2=0x7f59d015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59cf7fe640 1 --2- 172.21.15.151:0/820030739 >> v2:172.21.15.113:3300/0 conn(0x7f59d00d1c60 0x7f59d015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59cf7fe640 1 -- 172.21.15.151:0/820030739 >> v1:172.21.15.151:6789/0 conn(0x7f59d0146d60 legacy=0x7f59d00b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59cf7fe640 1 -- 172.21.15.151:0/820030739 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00b8c70 con 0x7f59d006f160 2023-12-19T13:46:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.462+0000 7f59d4e1a640 1 --2- 172.21.15.151:0/820030739 >> v2:172.21.15.113:3300/0 conn(0x7f59d00d1c60 0x7f59d015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.464+0000 7f59cf7fe640 1 --2- 172.21.15.151:0/820030739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d006f160 0x7f59d00d1720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59d0161070 tx=0x7f59c402b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a25569b8a1ccac89 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.464+0000 7f59ceffd640 1 -- 172.21.15.151:0/820030739 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4030870 con 0x7f59d006f160 2023-12-19T13:46:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.464+0000 7f59ceffd640 1 -- 172.21.15.151:0/820030739 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c40309d0 con 0x7f59d006f160 2023-12-19T13:46:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.464+0000 7f59ceffd640 1 -- 172.21.15.151:0/820030739 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4030d60 con 0x7f59d006f160 2023-12-19T13:46:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 -- 172.21.15.151:0/820030739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d006f160 msgr2=0x7f59d00d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 --2- 172.21.15.151:0/820030739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d006f160 0x7f59d00d1720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59d0161070 tx=0x7f59c402b9b0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 -- 172.21.15.151:0/820030739 shutdown_connections 2023-12-19T13:46:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 --2- 172.21.15.151:0/820030739 >> v2:172.21.15.113:3300/0 conn(0x7f59d00d1c60 0x7f59d015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 --2- 172.21.15.151:0/820030739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d006f160 0x7f59d00d1720 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 -- 172.21.15.151:0/820030739 >> 172.21.15.151:0/820030739 conn(0x7f59d00cfe10 msgr2=0x7f59d00d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 -- 172.21.15.151:0/820030739 shutdown_connections 2023-12-19T13:46:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.465+0000 7f59d687d640 1 -- 172.21.15.151:0/820030739 wait complete. 2023-12-19T13:46:15.466 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.466+0000 7fa7f066f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T13:46:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.467+0000 7f59d687d640 1 Processor -- start 2023-12-19T13:46:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.467+0000 7f59d687d640 1 -- start start 2023-12-19T13:46:15.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59d687d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f59d006f160 0x7f59d01f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59d687d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d00d1c60 0x7f59d01f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59d687d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59d0146d60 0x7f59d0141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59d687d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d01f6f00 con 0x7f59d006f160 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59d687d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d015a890 con 0x7f59d00d1c60 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59d687d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d01f30e0 con 0x7f59d0146d60 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d00d1c60 0x7f59d01f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d00d1c60 0x7f59d01f69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42414/0 (socket says 172.21.15.151:42414) 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59cf7fe640 1 -- 172.21.15.151:0/4142618397 learned_addr learned my addr 172.21.15.151:0/4142618397 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59d4e1a640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59d0146d60 0x7f59d0141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.468+0000 7f59cffff640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f59d006f160 0x7f59d01f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59cf7fe640 1 -- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59d0146d60 msgr2=0x7f59d0141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59cf7fe640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59d0146d60 0x7f59d0141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59cf7fe640 1 -- 172.21.15.151:0/4142618397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f59d006f160 msgr2=0x7f59d01f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59cf7fe640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f59d006f160 0x7f59d01f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59cf7fe640 1 -- 172.21.15.151:0/4142618397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40094d0 con 0x7f59d00d1c60 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59cffff640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f59d006f160 0x7f59d01f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59cf7fe640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d00d1c60 0x7f59d01f69c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f59c402b9f0 tx=0x7f59c4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59ccff9640 1 -- 172.21.15.151:0/4142618397 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4030860 con 0x7f59d00d1c60 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59ccff9640 1 -- 172.21.15.151:0/4142618397 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4043400 con 0x7f59d00d1c60 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59ccff9640 1 -- 172.21.15.151:0/4142618397 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40437b0 con 0x7f59d00d1c60 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.469+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d01f33c0 con 0x7f59d00d1c60 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.470+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d01f3980 con 0x7f59d00d1c60 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.470+0000 7f59ccff9640 1 -- 172.21.15.151:0/4142618397 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f59c4043c10 con 0x7f59d00d1c60 2023-12-19T13:46:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.470+0000 7f59ccff9640 1 -- 172.21.15.151:0/4142618397 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f59c403e070 con 0x7f59d00d1c60 2023-12-19T13:46:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.471+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d0061910 con 0x7f59d00d1c60 2023-12-19T13:46:15.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.473+0000 7f59ccff9640 1 -- 172.21.15.151:0/4142618397 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f59c4034070 con 0x7f59d00d1c60 2023-12-19T13:46:15.480 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.480+0000 7fc4d6611040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T13:46:15.532 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.531+0000 7fa7f066f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T13:46:15.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.556+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f59d00b8160 con 0x7f59d00d1c60 2023-12-19T13:46:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.564+0000 7f59ccff9640 1 -- 172.21.15.151:0/4142618397 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f59c404d530 con 0x7f59d00d1c60 2023-12-19T13:46:15.565 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-12-19T13:46:15.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d00d1c60 msgr2=0x7f59d01f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d00d1c60 0x7f59d01f69c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f59c402b9f0 tx=0x7f59c4004730 comp rx=0 tx=0).stop 2023-12-19T13:46:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 shutdown_connections 2023-12-19T13:46:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59d0146d60 0x7f59d0141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59d00d1c60 0x7f59d01f69c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 --2- 172.21.15.151:0/4142618397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f59d006f160 0x7f59d01f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 >> 172.21.15.151:0/4142618397 conn(0x7f59d00cfe10 msgr2=0x7f59d01450f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 shutdown_connections 2023-12-19T13:46:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.565+0000 7f59d687d640 1 -- 172.21.15.151:0/4142618397 wait complete. 2023-12-19T13:46:15.583 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-12-19T13:46:15.591 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:15.590+0000 7fa7f066f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T13:46:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.765+0000 7fcdabfff640 1 Processor -- start 2023-12-19T13:46:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.765+0000 7fcdabfff640 1 -- start start 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.766+0000 7fcdabfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcdac0cc1e0 0x7fcdac071630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cec70 0x7fcdac070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdabfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0ce7e0 con 0x7fcdac15db10 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdabfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0711c0 con 0x7fcdac0cc1e0 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdabfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0cdeb0 con 0x7fcdac0cec70 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdaa7fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cec70 0x7fcdac070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdab7fe640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fcdac15db10 0x7fcdac15a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:46478/0 (socket says 172.21.15.151:46478) 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdab7fe640 1 -- 172.21.15.151:0/1363141698 learned_addr learned my addr 172.21.15.151:0/1363141698 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-19T13:46:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdaa7fc640 1 --2- 172.21.15.151:0/1363141698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cec70 0x7fcdac070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:45490/0 (socket says 172.21.15.151:45490) 2023-12-19T13:46:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdaaffd640 1 --2- 172.21.15.151:0/1363141698 >> v2:172.21.15.113:3300/0 conn(0x7fcdac0cc1e0 0x7fcdac071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdaa7fc640 1 -- 172.21.15.151:0/1363141698 >> v2:172.21.15.113:3300/0 conn(0x7fcdac0cc1e0 msgr2=0x7fcdac071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdaa7fc640 1 --2- 172.21.15.151:0/1363141698 >> v2:172.21.15.113:3300/0 conn(0x7fcdac0cc1e0 0x7fcdac071630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdaa7fc640 1 -- 172.21.15.151:0/1363141698 >> v1:172.21.15.151:6789/0 conn(0x7fcdac15db10 legacy=0x7fcdac15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcda9ffb640 1 -- 172.21.15.151:0/1363141698 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138559585 0 0) 0x7fcdac0ce7e0 con 0x7fcdac15db10 2023-12-19T13:46:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.767+0000 7fcdaa7fc640 1 -- 172.21.15.151:0/1363141698 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0ce190 con 0x7fcdac0cec70 2023-12-19T13:46:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcdaa7fc640 1 --2- 172.21.15.151:0/1363141698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cec70 0x7fcdac070c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcda00097a0 tx=0x7fcda002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=291788aeebbfbd09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcda9ffb640 1 -- 172.21.15.151:0/1363141698 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda002e070 con 0x7fcdac0cec70 2023-12-19T13:46:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcda9ffb640 1 -- 172.21.15.151:0/1363141698 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00315a0 con 0x7fcdac0cec70 2023-12-19T13:46:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcda9ffb640 1 -- 172.21.15.151:0/1363141698 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0031930 con 0x7fcdac0cec70 2023-12-19T13:46:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcdabfff640 1 -- 172.21.15.151:0/1363141698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cec70 msgr2=0x7fcdac070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcdabfff640 1 --2- 172.21.15.151:0/1363141698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cec70 0x7fcdac070c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcda00097a0 tx=0x7fcda002b840 comp rx=0 tx=0).stop 2023-12-19T13:46:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcdabfff640 1 -- 172.21.15.151:0/1363141698 shutdown_connections 2023-12-19T13:46:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcdabfff640 1 --2- 172.21.15.151:0/1363141698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cec70 0x7fcdac070c80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcdabfff640 1 --2- 172.21.15.151:0/1363141698 >> v2:172.21.15.113:3300/0 conn(0x7fcdac0cc1e0 0x7fcdac071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.769+0000 7fcdabfff640 1 -- 172.21.15.151:0/1363141698 >> 172.21.15.151:0/1363141698 conn(0x7fcdac0cfca0 msgr2=0x7fcdac0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.770+0000 7fcdabfff640 1 -- 172.21.15.151:0/1363141698 shutdown_connections 2023-12-19T13:46:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.770+0000 7fcdabfff640 1 -- 172.21.15.151:0/1363141698 wait complete. 2023-12-19T13:46:15.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.771+0000 7fcdabfff640 1 Processor -- start 2023-12-19T13:46:15.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.771+0000 7fcdabfff640 1 -- start start 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cc1e0 0x7fcdac1f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0cec70 0x7fcdac13e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac15db10 0x7fcdac137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdabfff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac152f50 con 0x7fcdac15db10 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdabfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac13d660 con 0x7fcdac0cec70 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdabfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac13d940 con 0x7fcdac0cc1e0 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cc1e0 0x7fcdac1f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdaa7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0cec70 0x7fcdac13e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cc1e0 0x7fcdac1f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:45498/0 (socket says 172.21.15.151:45498) 2023-12-19T13:46:15.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.772+0000 7fcdaaffd640 1 -- 172.21.15.151:0/1295182050 learned_addr learned my addr 172.21.15.151:0/1295182050 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdaa7fc640 1 -- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cc1e0 msgr2=0x7fcdac1f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdab7fe640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac15db10 0x7fcdac137d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdaa7fc640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cc1e0 0x7fcdac1f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdaa7fc640 1 -- 172.21.15.151:0/1295182050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac15db10 msgr2=0x7fcdac137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdaa7fc640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac15db10 0x7fcdac137d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdaa7fc640 1 -- 172.21.15.151:0/1295182050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009400 con 0x7fcdac0cec70 2023-12-19T13:46:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdaaffd640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cc1e0 0x7fcdac1f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcdaa7fc640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0cec70 0x7fcdac13e700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcda0033000 tx=0x7fcda00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcd937fe640 1 -- 172.21.15.151:0/1295182050 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0004230 con 0x7fcdac0cec70 2023-12-19T13:46:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.773+0000 7fcd937fe640 1 -- 172.21.15.151:0/1295182050 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00043b0 con 0x7fcdac0cec70 2023-12-19T13:46:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.774+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac13dc20 con 0x7fcdac0cec70 2023-12-19T13:46:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.774+0000 7fcd937fe640 1 -- 172.21.15.151:0/1295182050 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0004520 con 0x7fcdac0cec70 2023-12-19T13:46:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.774+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac13e1e0 con 0x7fcdac0cec70 2023-12-19T13:46:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.774+0000 7fcd937fe640 1 -- 172.21.15.151:0/1295182050 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcda0032b80 con 0x7fcdac0cec70 2023-12-19T13:46:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.774+0000 7fcd937fe640 1 -- 172.21.15.151:0/1295182050 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcda0032e30 con 0x7fcdac0cec70 2023-12-19T13:46:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.775+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac061910 con 0x7fcdac0cec70 2023-12-19T13:46:15.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.777+0000 7fcd937fe640 1 -- 172.21.15.151:0/1295182050 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fcda0003cf0 con 0x7fcdac0cec70 2023-12-19T13:46:15.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.854+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7fcdac1f29e0 con 0x7fcdac0cec70 2023-12-19T13:46:15.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.862+0000 7fcd937fe640 1 -- 172.21.15.151:0/1295182050 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcda0003610 con 0x7fcdac0cec70 2023-12-19T13:46:15.863 INFO:teuthology.orchestra.run.smithi151.stdout:3 2023-12-19T13:46:15.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0cec70 msgr2=0x7fcdac13e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0cec70 0x7fcdac13e700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcda0033000 tx=0x7fcda00046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 shutdown_connections 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac15db10 0x7fcdac137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0cec70 0x7fcdac13e700 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 --2- 172.21.15.151:0/1295182050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac0cc1e0 0x7fcdac1f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 >> 172.21.15.151:0/1295182050 conn(0x7fcdac0cfca0 msgr2=0x7fcdac154420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 shutdown_connections 2023-12-19T13:46:15.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:15.864+0000 7fcdabfff640 1 -- 172.21.15.151:0/1295182050 wait complete. 2023-12-19T13:46:15.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-12-19T13:46:15.928 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:15.928+0000 7fc4d6611040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T13:46:16.070 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.069+0000 7fa7f066f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T13:46:16.085 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.086+0000 7fc4d6611040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T13:46:16.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.118+0000 7fc785de7640 1 Processor -- start 2023-12-19T13:46:16.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.118+0000 7fc785de7640 1 -- start start 2023-12-19T13:46:16.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.120+0000 7fc785de7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc78006f160 0x7fc7800d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.120+0000 7fc785de7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7800d2d20 con 0x7fc780146d60 2023-12-19T13:46:16.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.120+0000 7fc785de7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7800d3000 con 0x7fc7800d1c60 2023-12-19T13:46:16.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.120+0000 7fc785de7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800d2110 con 0x7fc78006f160 2023-12-19T13:46:16.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.120+0000 7fc77ffff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fc7800d1c60 0x7fc78015dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:46480/0 (socket says 172.21.15.151:46480) 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.120+0000 7fc77ffff640 1 -- 172.21.15.151:0/3492727469 learned_addr learned my addr 172.21.15.151:0/3492727469 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc777fff640 1 --2- 172.21.15.151:0/3492727469 >> v2:172.21.15.113:3300/0 conn(0x7fc78006f160 0x7fc7800d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158440205 0 0) 0x7fc7800d3000 con 0x7fc7800d1c60 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc76c003520 con 0x7fc7800d1c60 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818729507 0 0) 0x7fc76c003520 con 0x7fc7800d1c60 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 >> v2:172.21.15.113:3300/0 conn(0x7fc78006f160 msgr2=0x7fc7800d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 --2- 172.21.15.151:0/3492727469 >> v2:172.21.15.113:3300/0 conn(0x7fc78006f160 0x7fc7800d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 >> v1:172.21.15.113:6789/0 conn(0x7fc780146d60 legacy=0x7fc7800b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7800b8c70 con 0x7fc7800d1c60 2023-12-19T13:46:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc7780019f0 con 0x7fc7800d1c60 2023-12-19T13:46:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 >> v1:172.21.15.151:6789/0 conn(0x7fc7800d1c60 legacy=0x7fc78015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc76c0039e0 0x7fc76c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc76c0047c0 0x7fc76c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c005180 0x7fc76c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800d2110 con 0x7fc76c0047c0 2023-12-19T13:46:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c00c0b0 con 0x7fc76c005180 2023-12-19T13:46:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.121+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c00c270 con 0x7fc76c0039e0 2023-12-19T13:46:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77f7fe640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc76c0039e0 0x7fc76c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77ffff640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c005180 0x7fc76c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc777fff640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc76c0047c0 0x7fc76c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77f7fe640 1 -- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c005180 msgr2=0x7fc76c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77f7fe640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c005180 0x7fc76c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77f7fe640 1 -- 172.21.15.151:0/3492727469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc76c0047c0 msgr2=0x7fc76c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77f7fe640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc76c0047c0 0x7fc76c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77f7fe640 1 -- 172.21.15.151:0/3492727469 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c003520 con 0x7fc76c0039e0 2023-12-19T13:46:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.122+0000 7fc77ffff640 1 -- 172.21.15.151:0/3492727469 reap_dead start 2023-12-19T13:46:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.123+0000 7fc77f7fe640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc76c0039e0 0x7fc76c003e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc770001750 tx=0x7fc76c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a889b12b2d9005e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.123+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700052d0 con 0x7fc76c0039e0 2023-12-19T13:46:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.123+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77002e050 con 0x7fc76c0039e0 2023-12-19T13:46:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.123+0000 7fc77effd640 1 -- 172.21.15.151:0/3492727469 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770003830 con 0x7fc76c0039e0 2023-12-19T13:46:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.124+0000 7fc785de7640 1 -- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc76c0039e0 msgr2=0x7fc76c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.124+0000 7fc785de7640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc76c0039e0 0x7fc76c003e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc770001750 tx=0x7fc76c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.124+0000 7fc785de7640 1 -- 172.21.15.151:0/3492727469 shutdown_connections 2023-12-19T13:46:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.124+0000 7fc785de7640 1 --2- 172.21.15.151:0/3492727469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc76c0039e0 0x7fc76c003e00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.124+0000 7fc785de7640 1 -- 172.21.15.151:0/3492727469 >> 172.21.15.151:0/3492727469 conn(0x7fc7800cfe10 msgr2=0x7fc7800d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.124+0000 7fc785de7640 1 -- 172.21.15.151:0/3492727469 shutdown_connections 2023-12-19T13:46:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.124+0000 7fc785de7640 1 -- 172.21.15.151:0/3492727469 wait complete. 2023-12-19T13:46:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.126+0000 7fc785de7640 1 Processor -- start 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.126+0000 7fc785de7640 1 -- start start 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc785de7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c0039e0 0x7fc780159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc785de7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc78015dba0 0x7fc78013df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc785de7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7801444f0 0x7fc780144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc785de7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013e490 con 0x7fc7801444f0 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc785de7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013c190 con 0x7fc76c0039e0 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc785de7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc780144eb0 con 0x7fc78015dba0 2023-12-19T13:46:16.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc77f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c0039e0 0x7fc780159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc777fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc78015dba0 0x7fc78013df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc77f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c0039e0 0x7fc780159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42448/0 (socket says 172.21.15.151:42448) 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.127+0000 7fc77f7fe640 1 -- 172.21.15.151:0/470531054 learned_addr learned my addr 172.21.15.151:0/470531054 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77ffff640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7801444f0 0x7fc780144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77f7fe640 1 -- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc78015dba0 msgr2=0x7fc78013df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77f7fe640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc78015dba0 0x7fc78013df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77f7fe640 1 -- 172.21.15.151:0/470531054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7801444f0 msgr2=0x7fc780144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77f7fe640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7801444f0 0x7fc780144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77f7fe640 1 -- 172.21.15.151:0/470531054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780141d70 con 0x7fc76c0039e0 2023-12-19T13:46:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc777fff640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc78015dba0 0x7fc78013df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77f7fe640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c0039e0 0x7fc780159c50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc77002bc30 tx=0x7fc770001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77cff9640 1 -- 172.21.15.151:0/470531054 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700076c0 con 0x7fc76c0039e0 2023-12-19T13:46:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77cff9640 1 -- 172.21.15.151:0/470531054 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770007a30 con 0x7fc76c0039e0 2023-12-19T13:46:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc77cff9640 1 -- 172.21.15.151:0/470531054 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770006c00 con 0x7fc76c0039e0 2023-12-19T13:46:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78015eb10 con 0x7fc76c0039e0 2023-12-19T13:46:16.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.128+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78015e550 con 0x7fc76c0039e0 2023-12-19T13:46:16.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.129+0000 7fc77cff9640 1 -- 172.21.15.151:0/470531054 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc7700038f0 con 0x7fc76c0039e0 2023-12-19T13:46:16.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.129+0000 7fc77cff9640 1 -- 172.21.15.151:0/470531054 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc770006d60 con 0x7fc76c0039e0 2023-12-19T13:46:16.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.130+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc780061910 con 0x7fc76c0039e0 2023-12-19T13:46:16.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.132+0000 7fc77cff9640 1 -- 172.21.15.151:0/470531054 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc770064b10 con 0x7fc76c0039e0 2023-12-19T13:46:16.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.211+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fc7800d39a0 con 0x7fc76c0039e0 2023-12-19T13:46:16.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.218+0000 7fc77cff9640 1 -- 172.21.15.151:0/470531054 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc770053030 con 0x7fc76c0039e0 2023-12-19T13:46:16.219 INFO:teuthology.orchestra.run.smithi151.stdout:4 2023-12-19T13:46:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c0039e0 msgr2=0x7fc780159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c0039e0 0x7fc780159c50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc77002bc30 tx=0x7fc770001120 comp rx=0 tx=0).stop 2023-12-19T13:46:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 shutdown_connections 2023-12-19T13:46:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7801444f0 0x7fc780144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc78015dba0 0x7fc78013df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 --2- 172.21.15.151:0/470531054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc76c0039e0 0x7fc780159c50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 >> 172.21.15.151:0/470531054 conn(0x7fc7800cfe10 msgr2=0x7fc7800b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 shutdown_connections 2023-12-19T13:46:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.219+0000 7fc785de7640 1 -- 172.21.15.151:0/470531054 wait complete. 2023-12-19T13:46:16.237 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.236+0000 7fc4d6611040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T13:46:16.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-12-19T13:46:16.243 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.239+0000 7fa7f066f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T13:46:16.288 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.289+0000 7fc4d6611040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T13:46:16.381 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.380+0000 7fa7f066f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T13:46:16.395 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.395+0000 7fc4d6611040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:46:16.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.423+0000 7fd81d7ae640 1 Processor -- start 2023-12-19T13:46:16.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.423+0000 7fd81d7ae640 1 -- start start 2023-12-19T13:46:16.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd81d7ae640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd81806f160 0x7fd8180d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd81d7ae640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd8180d1c60 0x7fd81815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd81d7ae640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8180d2d20 con 0x7fd818146d60 2023-12-19T13:46:16.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd81d7ae640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8180d2110 con 0x7fd8180d1c60 2023-12-19T13:46:16.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd81d7ae640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8180d3000 con 0x7fd81806f160 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd816ffd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd818146d60 0x7fd8180b6ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:46492/0 (socket says 172.21.15.151:46492) 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd816ffd640 1 -- 172.21.15.151:0/1590504103 learned_addr learned my addr 172.21.15.151:0/1590504103 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.425+0000 7fd80ffff640 1 --2- 172.21.15.151:0/1590504103 >> v2:172.21.15.151:3300/0 conn(0x7fd81806f160 0x7fd8180d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.426+0000 7fd8177fe640 1 --2- 172.21.15.151:0/1590504103 >> v2:172.21.15.113:3300/0 conn(0x7fd8180d1c60 0x7fd81815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.426+0000 7fd80ffff640 1 -- 172.21.15.151:0/1590504103 >> v2:172.21.15.113:3300/0 conn(0x7fd8180d1c60 msgr2=0x7fd81815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.426+0000 7fd80ffff640 1 --2- 172.21.15.151:0/1590504103 >> v2:172.21.15.113:3300/0 conn(0x7fd8180d1c60 0x7fd81815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.426+0000 7fd80ffff640 1 -- 172.21.15.151:0/1590504103 >> v1:172.21.15.151:6789/0 conn(0x7fd818146d60 legacy=0x7fd8180b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.426+0000 7fd80ffff640 1 -- 172.21.15.151:0/1590504103 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8180b8c70 con 0x7fd81806f160 2023-12-19T13:46:16.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.427+0000 7fd80ffff640 1 --2- 172.21.15.151:0/1590504103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd8180d1720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd818161070 tx=0x7fd80002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c917ec51dedba477 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:16.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd8167fc640 1 -- 172.21.15.151:0/1590504103 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800031830 con 0x7fd81806f160 2023-12-19T13:46:16.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd8167fc640 1 -- 172.21.15.151:0/1590504103 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800031990 con 0x7fd81806f160 2023-12-19T13:46:16.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd8167fc640 1 -- 172.21.15.151:0/1590504103 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800031d20 con 0x7fd81806f160 2023-12-19T13:46:16.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1590504103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 msgr2=0x7fd8180d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd81d7ae640 1 --2- 172.21.15.151:0/1590504103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd8180d1720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd818161070 tx=0x7fd80002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1590504103 shutdown_connections 2023-12-19T13:46:16.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd81d7ae640 1 --2- 172.21.15.151:0/1590504103 >> v2:172.21.15.113:3300/0 conn(0x7fd8180d1c60 0x7fd81815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd81d7ae640 1 --2- 172.21.15.151:0/1590504103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd8180d1720 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1590504103 >> 172.21.15.151:0/1590504103 conn(0x7fd8180cfe10 msgr2=0x7fd8180d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:16.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.428+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1590504103 shutdown_connections 2023-12-19T13:46:16.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.429+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1590504103 wait complete. 2023-12-19T13:46:16.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.430+0000 7fd81d7ae640 1 Processor -- start 2023-12-19T13:46:16.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.430+0000 7fd81d7ae640 1 -- start start 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd81d7ae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd818156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd81d7ae640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8180d1c60 0x7fd818145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd81d7ae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd818146d60 0x7fd818145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd81d7ae640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd818157480 con 0x7fd8180d1c60 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd81d7ae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81815ecb0 con 0x7fd81806f160 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd81d7ae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81815ef90 con 0x7fd818146d60 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd816ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd818156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd816ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd818156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42476/0 (socket says 172.21.15.151:42476) 2023-12-19T13:46:16.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.431+0000 7fd816ffd640 1 -- 172.21.15.151:0/1955498749 learned_addr learned my addr 172.21.15.151:0/1955498749 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:16.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd8177fe640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd818146d60 0x7fd818145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd80ffff640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8180d1c60 0x7fd818145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd816ffd640 1 -- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd818146d60 msgr2=0x7fd818145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd816ffd640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd818146d60 0x7fd818145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd816ffd640 1 -- 172.21.15.151:0/1955498749 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8180d1c60 msgr2=0x7fd818145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd816ffd640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8180d1c60 0x7fd818145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd816ffd640 1 -- 172.21.15.151:0/1955498749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009400 con 0x7fd81806f160 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd8177fe640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd818146d60 0x7fd818145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd816ffd640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd818156f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd80800c480 tx=0x7fd80800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.432+0000 7fd80f7fe640 1 -- 172.21.15.151:0/1955498749 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808005ce0 con 0x7fd81806f160 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.433+0000 7fd80f7fe640 1 -- 172.21.15.151:0/1955498749 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd808005e40 con 0x7fd81806f160 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.433+0000 7fd80f7fe640 1 -- 172.21.15.151:0/1955498749 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080072f0 con 0x7fd81806f160 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.433+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81815f270 con 0x7fd81806f160 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.433+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd818159e50 con 0x7fd81806f160 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.433+0000 7fd80f7fe640 1 -- 172.21.15.151:0/1955498749 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd80801c440 con 0x7fd81806f160 2023-12-19T13:46:16.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.433+0000 7fd80f7fe640 1 -- 172.21.15.151:0/1955498749 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd808012980 con 0x7fd81806f160 2023-12-19T13:46:16.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.434+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81815f790 con 0x7fd81806f160 2023-12-19T13:46:16.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.436+0000 7fd80f7fe640 1 -- 172.21.15.151:0/1955498749 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd808021060 con 0x7fd81806f160 2023-12-19T13:46:16.438 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.437+0000 7fa7f066f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T13:46:16.505 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.505+0000 7fc4d6611040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T13:46:16.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.515+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fd818061910 con 0x7fd81806f160 2023-12-19T13:46:16.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.523+0000 7fd80f7fe640 1 -- 172.21.15.151:0/1955498749 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd808017070 con 0x7fd81806f160 2023-12-19T13:46:16.524 INFO:teuthology.orchestra.run.smithi151.stdout:5 2023-12-19T13:46:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.524+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 msgr2=0x7fd818156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.524+0000 7fd81d7ae640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd818156f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd80800c480 tx=0x7fd80800c940 comp rx=0 tx=0).stop 2023-12-19T13:46:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.524+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 shutdown_connections 2023-12-19T13:46:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.524+0000 7fd81d7ae640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd818146d60 0x7fd818145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.524+0000 7fd81d7ae640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8180d1c60 0x7fd818145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.524+0000 7fd81d7ae640 1 --2- 172.21.15.151:0/1955498749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd81806f160 0x7fd818156f40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.524+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 >> 172.21.15.151:0/1955498749 conn(0x7fd8180cfe10 msgr2=0x7fd81806f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.525+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 shutdown_connections 2023-12-19T13:46:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.525+0000 7fd81d7ae640 1 -- 172.21.15.151:0/1955498749 wait complete. 2023-12-19T13:46:16.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-12-19T13:46:16.554 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.554+0000 7fa7f066f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:46:16.663 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.662+0000 7fc4d6611040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:46:16.672 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.671+0000 7fa7f066f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T13:46:16.708 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:16.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:16.718 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.713+0000 7fc4d6611040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T13:46:16.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.736+0000 7fdde2817640 1 Processor -- start 2023-12-19T13:46:16.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.737+0000 7fdde2817640 1 -- start start 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdde2817640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15d800 0x7fdddc0c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdde2817640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdddc070160 0x7fdddc0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdde2817640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0c3db0 con 0x7fdddc06fc20 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdde2817640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc070e90 con 0x7fdddc070160 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdde2817640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0c4090 con 0x7fdddc15d800 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15d800 0x7fdddc0c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdddb7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdddc070160 0x7fdddc0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdddb7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdddc070160 0x7fdddc0cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42484/0 (socket says 172.21.15.151:42484) 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15d800 0x7fdddc0c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:45520/0 (socket says 172.21.15.151:45520) 2023-12-19T13:46:16.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.738+0000 7fdddb7fe640 1 -- 172.21.15.151:0/3105183315 learned_addr learned my addr 172.21.15.151:0/3105183315 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:16.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.739+0000 7fdddb7fe640 1 -- 172.21.15.151:0/3105183315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15d800 msgr2=0x7fdddc0c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:16.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.739+0000 7fdddb7fe640 1 --2- 172.21.15.151:0/3105183315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15d800 0x7fdddc0c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.739+0000 7fdddb7fe640 1 -- 172.21.15.151:0/3105183315 >> v1:172.21.15.113:6789/0 conn(0x7fdddc06fc20 legacy=0x7fdddc161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.739+0000 7fdddb7fe640 1 -- 172.21.15.151:0/3105183315 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0705f0 con 0x7fdddc070160 2023-12-19T13:46:16.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.740+0000 7fdddb7fe640 1 --2- 172.21.15.151:0/3105183315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc070160 0x7fdddc0cbef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009870 tx=0x7fddd002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab32715fcc9b60e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:16.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.740+0000 7fdddaffd640 1 -- 172.21.15.151:0/3105183315 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0030840 con 0x7fdddc070160 2023-12-19T13:46:16.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdddaffd640 1 -- 172.21.15.151:0/3105183315 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd00309a0 con 0x7fdddc070160 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdddaffd640 1 -- 172.21.15.151:0/3105183315 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0030d30 con 0x7fdddc070160 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdde2817640 1 -- 172.21.15.151:0/3105183315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc070160 msgr2=0x7fdddc0cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdde2817640 1 --2- 172.21.15.151:0/3105183315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc070160 0x7fdddc0cbef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009870 tx=0x7fddd002b980 comp rx=0 tx=0).stop 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdde2817640 1 -- 172.21.15.151:0/3105183315 shutdown_connections 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdde2817640 1 --2- 172.21.15.151:0/3105183315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc070160 0x7fdddc0cbef0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdde2817640 1 --2- 172.21.15.151:0/3105183315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15d800 0x7fdddc0c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdde2817640 1 -- 172.21.15.151:0/3105183315 >> 172.21.15.151:0/3105183315 conn(0x7fdddc0d0190 msgr2=0x7fdddc0d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.741+0000 7fdde2817640 1 -- 172.21.15.151:0/3105183315 shutdown_connections 2023-12-19T13:46:16.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.742+0000 7fdde2817640 1 -- 172.21.15.151:0/3105183315 wait complete. 2023-12-19T13:46:16.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.743+0000 7fdde2817640 1 Processor -- start 2023-12-19T13:46:16.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.743+0000 7fdde2817640 1 -- start start 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.744+0000 7fdde2817640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdddc06fc20 0x7fdddc15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.744+0000 7fdde2817640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc15d800 0x7fdddc15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.744+0000 7fdde2817640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15aed0 0x7fdddc15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.744+0000 7fdde2817640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc15b880 con 0x7fdddc06fc20 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.744+0000 7fdde2817640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc158570 con 0x7fdddc15d800 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.744+0000 7fdde2817640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc15d090 con 0x7fdddc15aed0 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.745+0000 7fdddb7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc15d800 0x7fdddc15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.745+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdddc06fc20 0x7fdddc15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.745+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdddc06fc20 0x7fdddc15cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.151:54076/0 (socket says 172.21.15.151:54076) 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.745+0000 7fdddbfff640 1 -- 172.21.15.151:0/4162683135 learned_addr learned my addr 172.21.15.151:0/4162683135 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.745+0000 7fdddb7fe640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc15d800 0x7fdddc15ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42492/0 (socket says 172.21.15.151:42492) 2023-12-19T13:46:16.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.745+0000 7fdde0db4640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15aed0 0x7fdddc15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:16.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.745+0000 7fdddb7fe640 1 -- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15aed0 msgr2=0x7fdddc15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdddb7fe640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15aed0 0x7fdddc15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdddb7fe640 1 -- 172.21.15.151:0/4162683135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdddc06fc20 msgr2=0x7fdddc15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdddb7fe640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdddc06fc20 0x7fdddc15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdddb7fe640 1 -- 172.21.15.151:0/4162683135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00094d0 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdddbfff640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdddc06fc20 0x7fdddc15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdde0db4640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15aed0 0x7fdddc15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdddb7fe640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc15d800 0x7fdddc15ed40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fddd0033000 tx=0x7fddd0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fddd8ff9640 1 -- 172.21.15.151:0/4162683135 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0039c10 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fddd8ff9640 1 -- 172.21.15.151:0/4162683135 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0039d70 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fddd8ff9640 1 -- 172.21.15.151:0/4162683135 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0043640 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc15bab0 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.746+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc15c070 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.747+0000 7fddd8ff9640 1 -- 172.21.15.151:0/4162683135 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fddd0043aa0 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.747+0000 7fddd8ff9640 1 -- 172.21.15.151:0/4162683135 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fddd003e070 con 0x7fdddc15d800 2023-12-19T13:46:16.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.748+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc061910 con 0x7fdddc15d800 2023-12-19T13:46:16.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.750+0000 7fddd8ff9640 1 -- 172.21.15.151:0/4162683135 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fddd0034070 con 0x7fdddc15d800 2023-12-19T13:46:16.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.828+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fdddc160580 con 0x7fdddc15d800 2023-12-19T13:46:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.834+0000 7fddd8ff9640 1 -- 172.21.15.151:0/4162683135 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fddd004d460 con 0x7fdddc15d800 2023-12-19T13:46:16.835 INFO:teuthology.orchestra.run.smithi151.stdout:6 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc15d800 msgr2=0x7fdddc15ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc15d800 0x7fdddc15ed40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fddd0033000 tx=0x7fddd0004730 comp rx=0 tx=0).stop 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 shutdown_connections 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdddc15aed0 0x7fdddc15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdddc15d800 0x7fdddc15ed40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 --2- 172.21.15.151:0/4162683135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdddc06fc20 0x7fdddc15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 >> 172.21.15.151:0/4162683135 conn(0x7fdddc0d0190 msgr2=0x7fdddc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 shutdown_connections 2023-12-19T13:46:16.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:16.835+0000 7fdde2817640 1 -- 172.21.15.151:0/4162683135 wait complete. 2023-12-19T13:46:16.844 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.843+0000 7fa7f066f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:46:16.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-12-19T13:46:16.879 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:16.878+0000 7fc4d6611040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T13:46:16.897 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:16.895+0000 7fa7f066f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T13:46:17.062 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:17.060+0000 7fa7f066f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T13:46:17.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.091+0000 7f814898e640 1 Processor -- start 2023-12-19T13:46:17.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.091+0000 7f814898e640 1 -- start start 2023-12-19T13:46:17.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f814898e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81441606f0 0x7f814415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f814898e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8144160d50 0x7f81441611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f814898e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814406c2d0 con 0x7f814406bb30 2023-12-19T13:46:17.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f814898e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8144143870 con 0x7f81441606f0 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f814898e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81441616e0 con 0x7f8144160d50 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f81437fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81441606f0 0x7f814415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f81437fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81441606f0 0x7f814415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42496/0 (socket says 172.21.15.151:42496) 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f8143fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8144160d50 0x7f81441611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.093+0000 7f81437fe640 1 -- 172.21.15.151:0/2726237724 learned_addr learned my addr 172.21.15.151:0/2726237724 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.094+0000 7f81437fe640 1 -- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8144160d50 msgr2=0x7f81441611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.094+0000 7f81437fe640 1 --2- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8144160d50 0x7f81441611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.094+0000 7f81437fe640 1 -- 172.21.15.151:0/2726237724 >> v1:172.21.15.113:6789/0 conn(0x7f814406bb30 legacy=0x7f814406e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.094+0000 7f81437fe640 1 -- 172.21.15.151:0/2726237724 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81440ad0a0 con 0x7f81441606f0 2023-12-19T13:46:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.094+0000 7f8143fff640 1 --2- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8144160d50 0x7f81441611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.095+0000 7f81437fe640 1 --2- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81441606f0 0x7f814415e920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8134009870 tx=0x7f813402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc38f3ffcd55fa62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.095+0000 7f81427fc640 1 -- 172.21.15.151:0/2726237724 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340317c0 con 0x7f81441606f0 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.095+0000 7f81427fc640 1 -- 172.21.15.151:0/2726237724 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8134031920 con 0x7f81441606f0 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.095+0000 7f81427fc640 1 -- 172.21.15.151:0/2726237724 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134031cb0 con 0x7f81441606f0 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.095+0000 7f814898e640 1 -- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81441606f0 msgr2=0x7f814415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.095+0000 7f814898e640 1 --2- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81441606f0 0x7f814415e920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8134009870 tx=0x7f813402b860 comp rx=0 tx=0).stop 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.096+0000 7f814898e640 1 -- 172.21.15.151:0/2726237724 shutdown_connections 2023-12-19T13:46:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.096+0000 7f814898e640 1 --2- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8144160d50 0x7f81441611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.096+0000 7f814898e640 1 --2- 172.21.15.151:0/2726237724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81441606f0 0x7f814415e920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.096+0000 7f814898e640 1 -- 172.21.15.151:0/2726237724 >> 172.21.15.151:0/2726237724 conn(0x7f81440cfca0 msgr2=0x7f81440b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.096+0000 7f814898e640 1 -- 172.21.15.151:0/2726237724 shutdown_connections 2023-12-19T13:46:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.096+0000 7f814898e640 1 -- 172.21.15.151:0/2726237724 wait complete. 2023-12-19T13:46:17.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.097+0000 7f814898e640 1 Processor -- start 2023-12-19T13:46:17.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.097+0000 7f814898e640 1 -- start start 2023-12-19T13:46:17.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.098+0000 7f814898e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f814406bb30 0x7f81440cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.098+0000 7f814898e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81441606f0 0x7f81441f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.098+0000 7f814898e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8144160d50 0x7f8144155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.098+0000 7f814898e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8144156c80 con 0x7f8144160d50 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.098+0000 7f814898e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8144155dd0 con 0x7f814406bb30 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.098+0000 7f814898e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8144156070 con 0x7f81441606f0 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f814406bb30 0x7f81440cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81441606f0 0x7f81441f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f814406bb30 0x7f81440cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42510/0 (socket says 172.21.15.151:42510) 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81441606f0 0x7f81441f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:45556/0 (socket says 172.21.15.151:45556) 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f81437fe640 1 -- 172.21.15.151:0/32103176 learned_addr learned my addr 172.21.15.151:0/32103176 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8143fff640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8144160d50 0x7f8144155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 -- 172.21.15.151:0/32103176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f814406bb30 msgr2=0x7f81440cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f814406bb30 0x7f81440cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 -- 172.21.15.151:0/32103176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8144160d50 msgr2=0x7f8144155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8144160d50 0x7f8144155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 -- 172.21.15.151:0/32103176 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c009a70 con 0x7f81441606f0 2023-12-19T13:46:17.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.099+0000 7f8142ffd640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81441606f0 0x7f81441f38a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f813800c410 tx=0x7f813800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.100+0000 7f812bfff640 1 -- 172.21.15.151:0/32103176 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138005230 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.100+0000 7f812bfff640 1 -- 172.21.15.151:0/32103176 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138005390 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.100+0000 7f812bfff640 1 -- 172.21.15.151:0/32103176 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138004820 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.100+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81340094d0 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.100+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8144156630 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.100+0000 7f812bfff640 1 -- 172.21.15.151:0/32103176 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8138004c80 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.100+0000 7f812bfff640 1 -- 172.21.15.151:0/32103176 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f81380069b0 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.101+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144061910 con 0x7f81441606f0 2023-12-19T13:46:17.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.106+0000 7f812bfff640 1 -- 172.21.15.151:0/32103176 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f8138017070 con 0x7f81441606f0 2023-12-19T13:46:17.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.184+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f81440acd20 con 0x7f81441606f0 2023-12-19T13:46:17.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.191+0000 7f812bfff640 1 -- 172.21.15.151:0/32103176 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8138011590 con 0x7f81441606f0 2023-12-19T13:46:17.192 INFO:teuthology.orchestra.run.smithi151.stdout:7 2023-12-19T13:46:17.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81441606f0 msgr2=0x7f81441f38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81441606f0 0x7f81441f38a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f813800c410 tx=0x7f813800c8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 shutdown_connections 2023-12-19T13:46:17.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8144160d50 0x7f8144155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81441606f0 0x7f81441f38a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 --2- 172.21.15.151:0/32103176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f814406bb30 0x7f81440cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 >> 172.21.15.151:0/32103176 conn(0x7f81440cfca0 msgr2=0x7f81440b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:17.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 shutdown_connections 2023-12-19T13:46:17.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19T13:46:17.193+0000 7f814898e640 1 -- 172.21.15.151:0/32103176 wait complete. 2023-12-19T13:46:17.209 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T13:46:17.210 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T13:46:17.219 INFO:tasks.ceph.osd.0:Started 2023-12-19T13:46:17.219 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T13:46:17.219 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T13:46:17.227 INFO:tasks.ceph.osd.1:Started 2023-12-19T13:46:17.227 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T13:46:17.227 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T13:46:17.232 INFO:tasks.ceph.osd.2:Started 2023-12-19T13:46:17.232 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T13:46:17.232 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T13:46:17.240 INFO:tasks.ceph.osd.3:Started 2023-12-19T13:46:17.241 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T13:46:17.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T13:46:17.248 INFO:tasks.ceph.osd.4:Started 2023-12-19T13:46:17.249 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T13:46:17.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T13:46:17.255 INFO:tasks.ceph.osd.5:Started 2023-12-19T13:46:17.255 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T13:46:17.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T13:46:17.261 INFO:tasks.ceph.osd.6:Started 2023-12-19T13:46:17.261 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T13:46:17.261 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T13:46:17.267 INFO:tasks.ceph.osd.7:Started 2023-12-19T13:46:17.267 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:17.419 INFO:tasks.ceph.osd.1.smithi113.stderr:2023-12-19T13:46:17.419+0000 7fe002de2500 -1 Falling back to public interface 2023-12-19T13:46:17.421 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-19T13:46:17.420+0000 7fc2dc20e500 -1 Falling back to public interface 2023-12-19T13:46:17.431 INFO:tasks.ceph.osd.3.smithi113.stderr:2023-12-19T13:46:17.430+0000 7f3d73607500 -1 Falling back to public interface 2023-12-19T13:46:17.431 INFO:tasks.ceph.osd.2.smithi113.stderr:2023-12-19T13:46:17.431+0000 7ffbd9a05500 -1 Falling back to public interface 2023-12-19T13:46:17.431 INFO:tasks.ceph.osd.0.smithi113.stderr:2023-12-19T13:46:17.431+0000 7f2b1049a500 -1 Falling back to public interface 2023-12-19T13:46:17.432 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-19T13:46:17.431+0000 7fd03541b500 -1 Falling back to public interface 2023-12-19T13:46:17.435 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-19T13:46:17.434+0000 7f7c9d939500 -1 Falling back to public interface 2023-12-19T13:46:17.438 INFO:tasks.ceph.osd.0.smithi113.stderr:2023-12-19T13:46:17.438+0000 7f2b0f441640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2023-12-19T13:46:17.440 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-19T13:46:17.439+0000 7fc2dc20e500 -1 osd.4 0 log_to_monitors true 2023-12-19T13:46:17.445 INFO:tasks.ceph.osd.1.smithi113.stderr:2023-12-19T13:46:17.446+0000 7fe002de2500 -1 osd.1 0 log_to_monitors true 2023-12-19T13:46:17.452 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-19T13:46:17.451+0000 7fd03541b500 -1 osd.5 0 log_to_monitors true 2023-12-19T13:46:17.455 INFO:tasks.ceph.osd.2.smithi113.stderr:2023-12-19T13:46:17.455+0000 7ffbd9a05500 -1 osd.2 0 log_to_monitors true 2023-12-19T13:46:17.461 INFO:tasks.ceph.osd.3.smithi113.stderr:2023-12-19T13:46:17.462+0000 7f3d73607500 -1 osd.3 0 log_to_monitors true 2023-12-19T13:46:17.462 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-19T13:46:17.461+0000 7ff24d717500 -1 Falling back to public interface 2023-12-19T13:46:17.468 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-19T13:46:17.467+0000 7f7c9d939500 -1 osd.7 0 log_to_monitors true 2023-12-19T13:46:17.469 INFO:tasks.ceph.osd.0.smithi113.stderr:2023-12-19T13:46:17.470+0000 7f2b1049a500 -1 osd.0 0 log_to_monitors true 2023-12-19T13:46:17.488 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-19T13:46:17.487+0000 7ff24d717500 -1 osd.6 0 log_to_monitors true 2023-12-19T13:46:17.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.505+0000 7ff6e759e640 1 Processor -- start 2023-12-19T13:46:17.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.505+0000 7ff6e759e640 1 -- start start 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e8146e30 0x7ff6e80b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e759e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff6e80d0c60 0x7ff6e815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e759e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e80b8300 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e759e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e8147210 con 0x7ff6e80d0c60 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80d10d0 con 0x7ff6e8146e30 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e5d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff6e80b7ea0 0x7ff6e80d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59208/0 (socket says 172.21.15.113:59208) 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e5d9b640 1 -- 172.21.15.113:0/3331081056 learned_addr learned my addr 172.21.15.113:0/3331081056 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e6d9d640 1 --2- 172.21.15.113:0/3331081056 >> v2:172.21.15.113:3300/0 conn(0x7ff6e80d0c60 0x7ff6e815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.506+0000 7ff6e659c640 1 --2- 172.21.15.113:0/3331081056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e8146e30 0x7ff6e80b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.507+0000 7ff6e559a640 1 -- 172.21.15.113:0/3331081056 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425741151 0 0) 0x7ff6e80b8300 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.507+0000 7ff6e559a640 1 -- 172.21.15.113:0/3331081056 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d0003520 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.507+0000 7ff6e6d9d640 1 -- 172.21.15.113:0/3331081056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e8146e30 msgr2=0x7ff6e80b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.507+0000 7ff6e6d9d640 1 --2- 172.21.15.113:0/3331081056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e8146e30 0x7ff6e80b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.507+0000 7ff6e6d9d640 1 -- 172.21.15.113:0/3331081056 >> v1:172.21.15.113:6789/0 conn(0x7ff6e80b7ea0 legacy=0x7ff6e80d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.507+0000 7ff6e6d9d640 1 -- 172.21.15.113:0/3331081056 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80d12d0 con 0x7ff6e80d0c60 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.508+0000 7ff6e6d9d640 1 --2- 172.21.15.113:0/3331081056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80d0c60 0x7ff6e815d870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d90 tx=0x7ff6e002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b9972bc8034de3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.508+0000 7ff6e559a640 1 -- 172.21.15.113:0/3331081056 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e002cbc0 con 0x7ff6e80d0c60 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.508+0000 7ff6e559a640 1 -- 172.21.15.113:0/3331081056 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e002cd20 con 0x7ff6e80d0c60 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.508+0000 7ff6e559a640 1 -- 172.21.15.113:0/3331081056 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0034640 con 0x7ff6e80d0c60 2023-12-19T13:46:17.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.508+0000 7ff6e759e640 1 -- 172.21.15.113:0/3331081056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80d0c60 msgr2=0x7ff6e815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.508+0000 7ff6e759e640 1 --2- 172.21.15.113:0/3331081056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80d0c60 0x7ff6e815d870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d90 tx=0x7ff6e002be10 comp rx=0 tx=0).stop 2023-12-19T13:46:17.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.509+0000 7ff6e759e640 1 -- 172.21.15.113:0/3331081056 shutdown_connections 2023-12-19T13:46:17.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.509+0000 7ff6e759e640 1 --2- 172.21.15.113:0/3331081056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80d0c60 0x7ff6e815d870 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.509+0000 7ff6e759e640 1 --2- 172.21.15.113:0/3331081056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e8146e30 0x7ff6e80b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.509+0000 7ff6e759e640 1 -- 172.21.15.113:0/3331081056 >> 172.21.15.113:0/3331081056 conn(0x7ff6e80b2990 msgr2=0x7ff6e80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:17.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.509+0000 7ff6e759e640 1 -- 172.21.15.113:0/3331081056 shutdown_connections 2023-12-19T13:46:17.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.509+0000 7ff6e759e640 1 -- 172.21.15.113:0/3331081056 wait complete. 2023-12-19T13:46:17.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.510+0000 7ff6e759e640 1 Processor -- start 2023-12-19T13:46:17.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.510+0000 7ff6e759e640 1 -- start start 2023-12-19T13:46:17.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.511+0000 7ff6e759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80b7ea0 0x7ff6e813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.511+0000 7ff6e759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e80d0c60 0x7ff6e813b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.511+0000 7ff6e759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e8146e30 0x7ff6e813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:17.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.511+0000 7ff6e759e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e813c880 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.511+0000 7ff6e759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e813bc70 con 0x7ff6e8146e30 2023-12-19T13:46:17.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.511+0000 7ff6e759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e813bf50 con 0x7ff6e80d0c60 2023-12-19T13:46:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.511+0000 7ff6e659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80b7ea0 0x7ff6e813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80b7ea0 0x7ff6e813da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45652/0 (socket says 172.21.15.113:45652) 2023-12-19T13:46:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 -- 172.21.15.113:0/154104916 learned_addr learned my addr 172.21.15.113:0/154104916 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e5d9b640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e80d0c60 0x7ff6e813b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e6d9d640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e8146e30 0x7ff6e813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 -- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e80d0c60 msgr2=0x7ff6e813b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e80d0c60 0x7ff6e813b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 -- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e8146e30 msgr2=0x7ff6e813ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e8146e30 0x7ff6e813ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 -- 172.21.15.113:0/154104916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009a70 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e659c640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80b7ea0 0x7ff6e813da80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800e9b0 tx=0x7ff6d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6d6ffd640 1 -- 172.21.15.113:0/154104916 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8009670 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6d6ffd640 1 -- 172.21.15.113:0/154104916 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d800c9a0 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6d6ffd640 1 -- 172.21.15.113:0/154104916 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800cd50 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.512+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e813c230 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.513+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e813b8f0 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.513+0000 7ff6d6ffd640 1 -- 172.21.15.113:0/154104916 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff6d8013770 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.513+0000 7ff6d6ffd640 1 -- 172.21.15.113:0/154104916 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff6d801c450 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.514+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e8061910 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.516+0000 7ff6d6ffd640 1 -- 172.21.15.113:0/154104916 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff6d8021060 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.580+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e813f250 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.581+0000 7ff6d6ffd640 1 -- 172.21.15.113:0/154104916 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff6d8017070 con 0x7ff6e80b7ea0 2023-12-19T13:46:17.581 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:17.581 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":10,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:17.187145+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80b7ea0 msgr2=0x7ff6e813da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80b7ea0 0x7ff6e813da80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800e9b0 tx=0x7ff6d800ee70 comp rx=0 tx=0).stop 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 shutdown_connections 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e8146e30 0x7ff6e813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e80d0c60 0x7ff6e813b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 --2- 172.21.15.113:0/154104916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6e80b7ea0 0x7ff6e813da80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 >> 172.21.15.113:0/154104916 conn(0x7ff6e80b2990 msgr2=0x7ff6e80b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 shutdown_connections 2023-12-19T13:46:17.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:17.582+0000 7ff6e759e640 1 -- 172.21.15.113:0/154104916 wait complete. 2023-12-19T13:46:17.597 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T13:46:17.597 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T13:46:17.909 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:17.909+0000 7fc4d6611040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T13:46:18.215 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:18.215+0000 7fc4d6611040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T13:46:18.241 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:18.240+0000 7fa7f066f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T13:46:18.273 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:18.273+0000 7fc4d6611040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T13:46:18.385 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:18.385+0000 7fc4d6611040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T13:46:18.403 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:18.548 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.549+0000 7ff26e895640 1 Processor -- start 2023-12-19T13:46:18.549 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.549+0000 7ff26e895640 1 -- start start 2023-12-19T13:46:18.550 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.550+0000 7ff26e895640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b8b30 0x7ff2680b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:18.550 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.550+0000 7ff26e895640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2680b55c0 0x7ff268143460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:18.550 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.550+0000 7ff26e895640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268161dd0 con 0x7ff2680b64a0 2023-12-19T13:46:18.550 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.550+0000 7ff26e895640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff268140a10 con 0x7ff2680b55c0 2023-12-19T13:46:18.550 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.550+0000 7ff26e895640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680b9450 con 0x7ff2680b8b30 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d893640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b8b30 0x7ff2680b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d893640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b8b30 0x7ff2680b8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:37000/0 (socket says 172.21.15.113:37000) 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d893640 1 -- 172.21.15.113:0/1945275099 learned_addr learned my addr 172.21.15.113:0/1945275099 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d092640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff2680b64a0 0x7ff268142d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:57728/0 (socket says 172.21.15.113:57728) 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26e094640 1 --2- 172.21.15.113:0/1945275099 >> v2:172.21.15.151:3300/0 conn(0x7ff2680b55c0 0x7ff268143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26c891640 1 -- 172.21.15.113:0/1945275099 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183733384 0 0) 0x7ff268161dd0 con 0x7ff2680b64a0 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26c891640 1 -- 172.21.15.113:0/1945275099 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff254003520 con 0x7ff2680b64a0 2023-12-19T13:46:18.551 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d893640 1 -- 172.21.15.113:0/1945275099 >> v2:172.21.15.151:3300/0 conn(0x7ff2680b55c0 msgr2=0x7ff268143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:18.552 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d893640 1 --2- 172.21.15.113:0/1945275099 >> v2:172.21.15.151:3300/0 conn(0x7ff2680b55c0 0x7ff268143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.552 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d893640 1 -- 172.21.15.113:0/1945275099 >> v1:172.21.15.151:6789/0 conn(0x7ff2680b64a0 legacy=0x7ff268142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:18.552 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.551+0000 7ff26d893640 1 -- 172.21.15.113:0/1945275099 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2681611c0 con 0x7ff2680b8b30 2023-12-19T13:46:18.552 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.553+0000 7ff26d893640 1 --2- 172.21.15.113:0/1945275099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b8b30 0x7ff2680b8f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8673c8629d04a96e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:18.552 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.553+0000 7ff26c891640 1 -- 172.21.15.113:0/1945275099 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264030840 con 0x7ff2680b8b30 2023-12-19T13:46:18.552 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.553+0000 7ff26c891640 1 -- 172.21.15.113:0/1945275099 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2640309a0 con 0x7ff2680b8b30 2023-12-19T13:46:18.553 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.553+0000 7ff26c891640 1 -- 172.21.15.113:0/1945275099 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264030d30 con 0x7ff2680b8b30 2023-12-19T13:46:18.553 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.553+0000 7ff26e895640 1 -- 172.21.15.113:0/1945275099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b8b30 msgr2=0x7ff2680b8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:18.553 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.553+0000 7ff26e895640 1 --2- 172.21.15.113:0/1945275099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b8b30 0x7ff2680b8f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402b980 comp rx=0 tx=0).stop 2023-12-19T13:46:18.553 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.554+0000 7ff26e895640 1 -- 172.21.15.113:0/1945275099 shutdown_connections 2023-12-19T13:46:18.554 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.554+0000 7ff26e895640 1 --2- 172.21.15.113:0/1945275099 >> v2:172.21.15.151:3300/0 conn(0x7ff2680b55c0 0x7ff268143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.554 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.554+0000 7ff26e895640 1 --2- 172.21.15.113:0/1945275099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b8b30 0x7ff2680b8f10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.554 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.554+0000 7ff26e895640 1 -- 172.21.15.113:0/1945275099 >> 172.21.15.113:0/1945275099 conn(0x7ff2680d3330 msgr2=0x7ff2680d3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:18.554 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.554+0000 7ff26e895640 1 -- 172.21.15.113:0/1945275099 shutdown_connections 2023-12-19T13:46:18.554 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.554+0000 7ff26e895640 1 -- 172.21.15.113:0/1945275099 wait complete. 2023-12-19T13:46:18.555 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.555+0000 7ff26e895640 1 Processor -- start 2023-12-19T13:46:18.555 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.555+0000 7ff26e895640 1 -- start start 2023-12-19T13:46:18.556 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.556+0000 7ff26e895640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2680b55c0 0x7ff26813f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:18.556 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.556+0000 7ff26e895640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b64a0 0x7ff26806f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.556+0000 7ff26e895640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2680b8b30 0x7ff26806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.556+0000 7ff26e895640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26815a380 con 0x7ff2680b8b30 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.556+0000 7ff26e895640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26815a810 con 0x7ff2680b55c0 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.556+0000 7ff26e895640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff268159770 con 0x7ff2680b64a0 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2680b8b30 0x7ff26806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2680b8b30 0x7ff26806fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43126/0 (socket says 172.21.15.113:43126) 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 -- 172.21.15.113:0/3776097165 learned_addr learned my addr 172.21.15.113:0/3776097165 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26d092640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b64a0 0x7ff26806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26d893640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2680b55c0 0x7ff26813f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 -- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b64a0 msgr2=0x7ff26806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b64a0 0x7ff26806f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 -- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2680b55c0 msgr2=0x7ff26813f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:18.557 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2680b55c0 0x7ff26813f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.558 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 -- 172.21.15.113:0/3776097165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640094d0 con 0x7ff2680b8b30 2023-12-19T13:46:18.558 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26d893640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2680b55c0 0x7ff26813f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:18.558 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:18.557+0000 7fa7f066f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T13:46:18.559 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff26e094640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2680b8b30 0x7ff26806fdc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff26000ec10 tx=0x7ff26000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:18.559 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.557+0000 7ff25e7fc640 1 -- 172.21.15.113:0/3776097165 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260009a70 con 0x7ff2680b8b30 2023-12-19T13:46:18.559 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.558+0000 7ff25e7fc640 1 -- 172.21.15.113:0/3776097165 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26000f040 con 0x7ff2680b8b30 2023-12-19T13:46:18.559 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.558+0000 7ff25e7fc640 1 -- 172.21.15.113:0/3776097165 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260014480 con 0x7ff2680b8b30 2023-12-19T13:46:18.559 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.558+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff268159a50 con 0x7ff2680b8b30 2023-12-19T13:46:18.559 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.558+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26815a010 con 0x7ff2680b8b30 2023-12-19T13:46:18.559 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.559+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26815a4f0 con 0x7ff2680b8b30 2023-12-19T13:46:18.560 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.559+0000 7ff25e7fc640 1 -- 172.21.15.113:0/3776097165 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 2) v1 ==== 44255+0+0 (secure 0 0 0) 0x7ff2600147f0 con 0x7ff2680b8b30 2023-12-19T13:46:18.560 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.559+0000 7ff25e7fc640 1 -- 172.21.15.113:0/3776097165 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7ff260049ff0 con 0x7ff2680b8b30 2023-12-19T13:46:18.561 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.561+0000 7ff25e7fc640 1 -- 172.21.15.113:0/3776097165 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff260007d90 con 0x7ff2680b8b30 2023-12-19T13:46:18.617 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:18.616+0000 7fa7f066f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T13:46:18.620 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.621+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff268161a10 con 0x7ff2680b8b30 2023-12-19T13:46:18.622 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.622+0000 7ff25e7fc640 1 -- 172.21.15.113:0/3776097165 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff260018030 con 0x7ff2680b8b30 2023-12-19T13:46:18.622 INFO:teuthology.misc.health.smithi113.stdout: 2023-12-19T13:46:18.622 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":11,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:18.189878+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:18.623 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.623+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2680b8b30 msgr2=0x7ff26806fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:18.623 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.623+0000 7ff26e895640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2680b8b30 0x7ff26806fdc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff26000ec10 tx=0x7ff26000c490 comp rx=0 tx=0).stop 2023-12-19T13:46:18.623 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.623+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 shutdown_connections 2023-12-19T13:46:18.623 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.623+0000 7ff26e895640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2680b8b30 0x7ff26806fdc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.624 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.623+0000 7ff26e895640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2680b64a0 0x7ff26806f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.624 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.623+0000 7ff26e895640 1 --2- 172.21.15.113:0/3776097165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2680b55c0 0x7ff26813f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:18.624 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.623+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 >> 172.21.15.113:0/3776097165 conn(0x7ff2680d3330 msgr2=0x7ff26815ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:18.624 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.624+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 shutdown_connections 2023-12-19T13:46:18.624 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:18.624+0000 7ff26e895640 1 -- 172.21.15.113:0/3776097165 wait complete. 2023-12-19T13:46:18.636 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T13:46:18.730 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-19T13:46:18.730+0000 7fa7f066f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T13:46:19.234 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-19T13:46:19.234+0000 7fc2d7b31640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T13:46:19.235 INFO:tasks.ceph.osd.0.smithi113.stderr:2023-12-19T13:46:19.236+0000 7f2b0c425640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T13:46:19.238 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-19T13:46:19.237+0000 7fd030d57640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T13:46:19.238 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-19T13:46:19.237+0000 7ff2496a2640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T13:46:19.238 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-19T13:46:19.237+0000 7fc2d1164640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.238 INFO:tasks.ceph.osd.0.smithi113.stderr:2023-12-19T13:46:19.239+0000 7f2b05a58640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.239 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-19T13:46:19.239+0000 7f7c998c4640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T13:46:19.240 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-19T13:46:19.240+0000 7fd02a38a640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.240 INFO:tasks.ceph.osd.1.smithi113.stderr:2023-12-19T13:46:19.241+0000 7fdffed6d640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T13:46:19.241 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-19T13:46:19.240+0000 7ff242cd5640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.242 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-19T13:46:19.242+0000 7f7c92ef7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.243 INFO:tasks.ceph.osd.1.smithi113.stderr:2023-12-19T13:46:19.243+0000 7fdff83a0640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.253 INFO:tasks.ceph.osd.3.smithi113.stderr:2023-12-19T13:46:19.254+0000 7f3d6f592640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T13:46:19.256 INFO:tasks.ceph.osd.3.smithi113.stderr:2023-12-19T13:46:19.257+0000 7f3d68bc5640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.257 INFO:tasks.ceph.osd.2.smithi113.stderr:2023-12-19T13:46:19.258+0000 7ffbd5990640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T13:46:19.261 INFO:tasks.ceph.osd.2.smithi113.stderr:2023-12-19T13:46:19.261+0000 7ffbcefc3640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:46:19.445 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:19.446+0000 7fc477715640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T13:46:19.450 INFO:tasks.ceph.mgr.y.smithi113.stderr:2023-12-19T13:46:19.451+0000 7fc477715640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T13:46:25.443 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:25.628 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.629+0000 7f5c471f6640 1 Processor -- start 2023-12-19T13:46:25.629 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.629+0000 7f5c471f6640 1 -- start start 2023-12-19T13:46:25.630 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.630+0000 7f5c471f6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5c4015b420 0x7f5c400b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.630+0000 7f5c471f6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c400b0540 0x7f5c400b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.630+0000 7f5c471f6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c400b0950 con 0x7f5c4015b040 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.630+0000 7f5c471f6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4015ee50 con 0x7f5c400b0540 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.630+0000 7f5c471f6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4015f0f0 con 0x7f5c4015b420 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c469f5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c400b0540 0x7f5c400b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c461f4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5c4015b040 0x7f5c4006dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51012/0 (socket says 172.21.15.113:51012) 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c461f4640 1 -- 172.21.15.113:0/940288501 learned_addr learned my addr 172.21.15.113:0/940288501 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:25.631 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c459f3640 1 --2- 172.21.15.113:0/940288501 >> v2:172.21.15.151:3300/0 conn(0x7f5c4015b420 0x7f5c400b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:25.632 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c469f5640 1 -- 172.21.15.113:0/940288501 >> v2:172.21.15.151:3300/0 conn(0x7f5c4015b420 msgr2=0x7f5c400b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:25.632 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c469f5640 1 --2- 172.21.15.113:0/940288501 >> v2:172.21.15.151:3300/0 conn(0x7f5c4015b420 0x7f5c400b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.632 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c469f5640 1 -- 172.21.15.113:0/940288501 >> v1:172.21.15.113:6789/0 conn(0x7f5c4015b040 legacy=0x7f5c4006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:25.632 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.631+0000 7f5c469f5640 1 -- 172.21.15.113:0/940288501 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4015f3d0 con 0x7f5c400b0540 2023-12-19T13:46:25.633 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.632+0000 7f5c469f5640 1 --2- 172.21.15.113:0/940288501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c400b13d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5c400c94c0 tx=0x7f5c3802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc474edeea0eb1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:25.634 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c451f2640 1 -- 172.21.15.113:0/940288501 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3802cc70 con 0x7f5c400b0540 2023-12-19T13:46:25.634 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c451f2640 1 -- 172.21.15.113:0/940288501 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3802cdd0 con 0x7f5c400b0540 2023-12-19T13:46:25.634 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c451f2640 1 -- 172.21.15.113:0/940288501 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38034660 con 0x7f5c400b0540 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c471f6640 1 -- 172.21.15.113:0/940288501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 msgr2=0x7f5c400b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c471f6640 1 --2- 172.21.15.113:0/940288501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c400b13d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5c400c94c0 tx=0x7f5c3802bec0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c471f6640 1 -- 172.21.15.113:0/940288501 shutdown_connections 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c471f6640 1 --2- 172.21.15.113:0/940288501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c400b13d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c471f6640 1 --2- 172.21.15.113:0/940288501 >> v2:172.21.15.151:3300/0 conn(0x7f5c4015b420 0x7f5c400b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c471f6640 1 -- 172.21.15.113:0/940288501 >> 172.21.15.113:0/940288501 conn(0x7f5c400cb940 msgr2=0x7f5c400cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.633+0000 7f5c471f6640 1 -- 172.21.15.113:0/940288501 shutdown_connections 2023-12-19T13:46:25.635 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.634+0000 7f5c471f6640 1 -- 172.21.15.113:0/940288501 wait complete. 2023-12-19T13:46:25.637 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.635+0000 7f5c471f6640 1 Processor -- start 2023-12-19T13:46:25.637 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.635+0000 7f5c471f6640 1 -- start start 2023-12-19T13:46:25.637 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c471f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c40149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:25.637 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c471f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4015b040 0x7f5c4014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c471f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c4015b420 0x7f5c4014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c471f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4014b0d0 con 0x7f5c400b0540 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c471f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015c8c0 con 0x7f5c4015b420 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c471f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015bf90 con 0x7f5c4015b040 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c461f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c40149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.636+0000 7f5c461f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c40149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43160/0 (socket says 172.21.15.113:43160) 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c461f4640 1 -- 172.21.15.113:0/3194540540 learned_addr learned my addr 172.21.15.113:0/3194540540 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c459f3640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4015b040 0x7f5c4014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c469f5640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c4015b420 0x7f5c4014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c461f4640 1 -- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4015b040 msgr2=0x7f5c4014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c461f4640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4015b040 0x7f5c4014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c461f4640 1 -- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c4015b420 msgr2=0x7f5c4014a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c461f4640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c4015b420 0x7f5c4014a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c461f4640 1 -- 172.21.15.113:0/3194540540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009a70 con 0x7f5c400b0540 2023-12-19T13:46:25.638 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c459f3640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4015b040 0x7f5c4014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c461f4640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c40149c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c4a0 tx=0x7f5c3c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.637+0000 7f5c36ffd640 1 -- 172.21.15.113:0/3194540540 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c005ce0 con 0x7f5c400b0540 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.638+0000 7f5c36ffd640 1 -- 172.21.15.113:0/3194540540 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c005e40 con 0x7f5c400b0540 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.638+0000 7f5c36ffd640 1 -- 172.21.15.113:0/3194540540 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007270 con 0x7f5c400b0540 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.638+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4015c270 con 0x7f5c400b0540 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.638+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4014abe0 con 0x7f5c400b0540 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.639+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4014ae30 con 0x7f5c400b0540 2023-12-19T13:46:25.639 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.640+0000 7f5c36ffd640 1 -- 172.21.15.113:0/3194540540 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c3c007490 con 0x7f5c400b0540 2023-12-19T13:46:25.640 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.640+0000 7f5c36ffd640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a430 0x7f5c2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:25.641 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.641+0000 7f5c36ffd640 1 -- 172.21.15.113:0/3194540540 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c3c087a30 con 0x7f5c400b0540 2023-12-19T13:46:25.641 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.641+0000 7f5c459f3640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a430 0x7f5c2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:25.641 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.641+0000 7f5c459f3640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a430 0x7f5c2406c8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c30006fd0 tx=0x7f5c30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:25.646 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.646+0000 7f5c36ffd640 1 -- 172.21.15.113:0/3194540540 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c3c053420 con 0x7f5c400b0540 2023-12-19T13:46:25.837 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.837+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c40061910 con 0x7f5c400b0540 2023-12-19T13:46:25.838 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.838+0000 7f5c36ffd640 1 -- 172.21.15.113:0/3194540540 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f5c3c017090 con 0x7f5c400b0540 2023-12-19T13:46:25.838 INFO:teuthology.misc.health.smithi113.stdout: 2023-12-19T13:46:25.838 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":16,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:23.250705+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:25.840 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a430 msgr2=0x7f5c2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:25.840 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a430 0x7f5c2406c8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c30006fd0 tx=0x7f5c30008040 comp rx=0 tx=0).stop 2023-12-19T13:46:25.840 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 msgr2=0x7f5c40149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:25.840 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c40149c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c4a0 tx=0x7f5c3c00c960 comp rx=0 tx=0).stop 2023-12-19T13:46:25.840 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 shutdown_connections 2023-12-19T13:46:25.841 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a430 0x7f5c2406c8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.841 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c4015b420 0x7f5c4014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.841 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4015b040 0x7f5c4014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.841 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 --2- 172.21.15.113:0/3194540540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c400b0540 0x7f5c40149c20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:25.841 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.840+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 >> 172.21.15.113:0/3194540540 conn(0x7f5c400cb940 msgr2=0x7f5c400ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:25.841 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.841+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 shutdown_connections 2023-12-19T13:46:25.841 INFO:teuthology.misc.health.smithi113.stderr:2023-12-19T13:46:25.841+0000 7f5c471f6640 1 -- 172.21.15.113:0/3194540540 wait complete. 2023-12-19T13:46:25.854 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T13:46:25.855 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T13:46:25.855 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:46:25.855 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:46:25.863 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:46:25.863 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:46:25.864 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:46:25.871 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:46:25.871 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:46:25.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:46:25.881 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:46:25.881 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:46:25.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:46:25.890 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:46:25.890 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T13:46:25.890 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:26.019 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:46:26.023 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:46:26.047 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:46:26.049 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:46:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.077+0000 7fdcb8947640 1 Processor -- start 2023-12-19T13:46:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.077+0000 7fdcb8947640 1 -- start start 2023-12-19T13:46:26.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb8947640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb8947640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdcb40cfcd0 0x7fdcb40d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb8947640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb4161f10 con 0x7fdcb40b2930 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb8947640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb415e9d0 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb8947640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40d0680 con 0x7fdcb415e0b0 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb2d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdcb40cfcd0 0x7fdcb40d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcabfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdcb40b2930 0x7fdcb4160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51030/0 (socket says 172.21.15.113:51030) 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcabfff640 1 -- 172.21.15.113:0/1812381479 learned_addr learned my addr 172.21.15.113:0/1812381479 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb259c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb2d9d640 1 -- 172.21.15.113:0/1812381479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 msgr2=0x7fdcb415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:26.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb2d9d640 1 --2- 172.21.15.113:0/1812381479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb2d9d640 1 -- 172.21.15.113:0/1812381479 >> v1:172.21.15.113:6789/0 conn(0x7fdcb40b2930 legacy=0x7fdcb4160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb2d9d640 1 -- 172.21.15.113:0/1812381479 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb41616f0 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.079+0000 7fdcb1d9b640 1 -- 172.21.15.113:0/1812381479 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574266278 0 0) 0x7fdcb4161f10 con 0x7fdcb40b2930 2023-12-19T13:46:26.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.080+0000 7fdcb2d9d640 1 --2- 172.21.15.113:0/1812381479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb40d0140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009dc0 tx=0x7fdcac02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3d95ba796e10c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb1d9b640 1 -- 172.21.15.113:0/1812381479 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac02cc40 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb1d9b640 1 -- 172.21.15.113:0/1812381479 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac02cda0 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb1d9b640 1 -- 172.21.15.113:0/1812381479 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac034660 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 -- 172.21.15.113:0/1812381479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 msgr2=0x7fdcb40d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1812381479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb40d0140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009dc0 tx=0x7fdcac02be90 comp rx=0 tx=0).stop 2023-12-19T13:46:26.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 -- 172.21.15.113:0/1812381479 shutdown_connections 2023-12-19T13:46:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1812381479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb40d0140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1812381479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb415e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 -- 172.21.15.113:0/1812381479 >> 172.21.15.113:0/1812381479 conn(0x7fdcb40cc770 msgr2=0x7fdcb40ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 -- 172.21.15.113:0/1812381479 shutdown_connections 2023-12-19T13:46:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.081+0000 7fdcb8947640 1 -- 172.21.15.113:0/1812381479 wait complete. 2023-12-19T13:46:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.083+0000 7fdcb8947640 1 Processor -- start 2023-12-19T13:46:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.083+0000 7fdcb8947640 1 -- start start 2023-12-19T13:46:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcb8947640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcb40b2930 0x7fdcb41478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcb8947640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb4160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcb8947640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb40702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcb8947640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40b0600 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcb8947640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40b0850 con 0x7fdcb40b2930 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcb8947640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40b0b30 con 0x7fdcb415e0b0 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcabfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb4160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcabfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb4160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43196/0 (socket says 172.21.15.113:43196) 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.084+0000 7fdcabfff640 1 -- 172.21.15.113:0/1292955315 learned_addr learned my addr 172.21.15.113:0/1292955315 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcb259c640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcb40b2930 0x7fdcb41478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcb2d9d640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb40702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcabfff640 1 -- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 msgr2=0x7fdcb40702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcabfff640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb40702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcabfff640 1 -- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcb40b2930 msgr2=0x7fdcb41478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcabfff640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcb40b2930 0x7fdcb41478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcabfff640 1 -- 172.21.15.113:0/1292955315 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac009a70 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcabfff640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb4160010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c4d0 tx=0x7fdc9c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.085+0000 7fdcaaffd640 1 -- 172.21.15.113:0/1292955315 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0074e0 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.086+0000 7fdcaaffd640 1 -- 172.21.15.113:0/1292955315 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c007660 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.086+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb40b0e10 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.086+0000 7fdcaaffd640 1 -- 172.21.15.113:0/1292955315 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c004a20 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.086+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb40b13d0 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.087+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb40b15f0 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.088+0000 7fdcaaffd640 1 -- 172.21.15.113:0/1292955315 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc9c004b80 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.088+0000 7fdcaaffd640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc9406a430 0x7fdc9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.089+0000 7fdcaaffd640 1 -- 172.21.15.113:0/1292955315 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc9c087740 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.089+0000 7fdcb259c640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc9406a430 0x7fdc9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.089+0000 7fdcb259c640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc9406a430 0x7fdc9406c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009aa0 tx=0x7fdca4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.093+0000 7fdcaaffd640 1 -- 172.21.15.113:0/1292955315 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc9c053130 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.278+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcb4061910 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.279+0000 7fdcaaffd640 1 -- 172.21.15.113:0/1292955315 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fdc9c018090 con 0x7fdcb40cfcd0 2023-12-19T13:46:26.279 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:26.280 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:23.250705+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc9406a430 msgr2=0x7fdc9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc9406a430 0x7fdc9406c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009aa0 tx=0x7fdca4009190 comp rx=0 tx=0).stop 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 msgr2=0x7fdcb4160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb4160010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c4d0 tx=0x7fdc9c00c990 comp rx=0 tx=0).stop 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 shutdown_connections 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc9406a430 0x7fdc9406c8f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcb415e0b0 0x7fdcb40702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb40cfcd0 0x7fdcb4160010 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 --2- 172.21.15.113:0/1292955315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcb40b2930 0x7fdcb41478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 >> 172.21.15.113:0/1292955315 conn(0x7fdcb40cc770 msgr2=0x7fdcb4155670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:26.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 shutdown_connections 2023-12-19T13:46:26.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.282+0000 7fdcb8947640 1 -- 172.21.15.113:0/1292955315 wait complete. 2023-12-19T13:46:26.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:46:26.299 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:46:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.508+0000 7fa16ce65640 1 Processor -- start 2023-12-19T13:46:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.508+0000 7fa16ce65640 1 -- start start 2023-12-19T13:46:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.509+0000 7fa16ce65640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa168141900 0x7fa1680afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.509+0000 7fa16ce65640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa1680b02a0 0x7fa16806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa16ce65640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa1680ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa16ce65640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1680b0730 con 0x7fa168141900 2023-12-19T13:46:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa16ce65640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16806e220 con 0x7fa1680b02a0 2023-12-19T13:46:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa16ce65640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680cbea0 con 0x7fa16806da30 2023-12-19T13:46:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa168141900 0x7fa1680afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa168141900 0x7fa1680afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43200/0 (socket says 172.21.15.113:43200) 2023-12-19T13:46:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 -- 172.21.15.113:0/4070223811 learned_addr learned my addr 172.21.15.113:0/4070223811 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 -- 172.21.15.113:0/4070223811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 msgr2=0x7fa1680ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa167fff640 1 --2- 172.21.15.113:0/4070223811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa1680ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa166ffd640 1 --2- 172.21.15.113:0/4070223811 >> v2:172.21.15.151:3300/0 conn(0x7fa1680b02a0 0x7fa16806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 --2- 172.21.15.113:0/4070223811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa1680ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 -- 172.21.15.113:0/4070223811 >> v2:172.21.15.151:3300/0 conn(0x7fa1680b02a0 msgr2=0x7fa16806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 --2- 172.21.15.113:0/4070223811 >> v2:172.21.15.151:3300/0 conn(0x7fa1680b02a0 0x7fa16806d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa1677fe640 1 -- 172.21.15.113:0/4070223811 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680cc180 con 0x7fa168141900 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.510+0000 7fa167fff640 1 --2- 172.21.15.113:0/4070223811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa1680ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.511+0000 7fa1677fe640 1 --2- 172.21.15.113:0/4070223811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa168141900 0x7fa1680afd60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa16804eaa0 tx=0x7fa15802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6105cafa02bf4e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa1667fc640 1 -- 172.21.15.113:0/4070223811 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158031870 con 0x7fa168141900 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa1667fc640 1 -- 172.21.15.113:0/4070223811 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1580319d0 con 0x7fa168141900 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa1667fc640 1 -- 172.21.15.113:0/4070223811 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158031d60 con 0x7fa168141900 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 -- 172.21.15.113:0/4070223811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa168141900 msgr2=0x7fa1680afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 --2- 172.21.15.113:0/4070223811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa168141900 0x7fa1680afd60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa16804eaa0 tx=0x7fa15802b910 comp rx=0 tx=0).stop 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 -- 172.21.15.113:0/4070223811 shutdown_connections 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 --2- 172.21.15.113:0/4070223811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa1680ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 --2- 172.21.15.113:0/4070223811 >> v2:172.21.15.151:3300/0 conn(0x7fa1680b02a0 0x7fa16806d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 --2- 172.21.15.113:0/4070223811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa168141900 0x7fa1680afd60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 -- 172.21.15.113:0/4070223811 >> 172.21.15.113:0/4070223811 conn(0x7fa16806f630 msgr2=0x7fa16806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.512+0000 7fa16ce65640 1 -- 172.21.15.113:0/4070223811 shutdown_connections 2023-12-19T13:46:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.513+0000 7fa16ce65640 1 -- 172.21.15.113:0/4070223811 wait complete. 2023-12-19T13:46:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.514+0000 7fa16ce65640 1 Processor -- start 2023-12-19T13:46:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.514+0000 7fa16ce65640 1 -- start start 2023-12-19T13:46:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.515+0000 7fa16ce65640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa168153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.515+0000 7fa16ce65640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1680b02a0 0x7fa1680b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.515+0000 7fa16ce65640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa168141900 0x7fa1680b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.515+0000 7fa16ce65640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa168155ed0 con 0x7fa1680b02a0 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.515+0000 7fa16ce65640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680b2f40 con 0x7fa168141900 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.515+0000 7fa16ce65640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680b1d80 con 0x7fa16806da30 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.515+0000 7fa166ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1680b02a0 0x7fa1680b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1680b02a0 0x7fa1680b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43212/0 (socket says 172.21.15.113:43212) 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 -- 172.21.15.113:0/2349625723 learned_addr learned my addr 172.21.15.113:0/2349625723 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa167fff640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa168141900 0x7fa1680b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa1677fe640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa168153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 -- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 msgr2=0x7fa168153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa168153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 -- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa168141900 msgr2=0x7fa1680b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa168141900 0x7fa1680b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 -- 172.21.15.113:0/2349625723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580094d0 con 0x7fa1680b02a0 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa167fff640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa168141900 0x7fa1680b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:26.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa1677fe640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa168153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:26.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa166ffd640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1680b02a0 0x7fa1680b1230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00c7f0 tx=0x7fa15c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.516+0000 7fa14ffff640 1 -- 172.21.15.113:0/2349625723 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c004220 con 0x7fa1680b02a0 2023-12-19T13:46:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.517+0000 7fa14ffff640 1 -- 172.21.15.113:0/2349625723 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c0043a0 con 0x7fa1680b02a0 2023-12-19T13:46:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.517+0000 7fa14ffff640 1 -- 172.21.15.113:0/2349625723 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c007860 con 0x7fa1680b02a0 2023-12-19T13:46:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.517+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa168155810 con 0x7fa1680b02a0 2023-12-19T13:46:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.517+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa168154270 con 0x7fa1680b02a0 2023-12-19T13:46:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.518+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa168061910 con 0x7fa1680b02a0 2023-12-19T13:46:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.519+0000 7fa14ffff640 1 -- 172.21.15.113:0/2349625723 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa15c007bd0 con 0x7fa1680b02a0 2023-12-19T13:46:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.520+0000 7fa14ffff640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15406a460 0x7fa15406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.520+0000 7fa14ffff640 1 -- 172.21.15.113:0/2349625723 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa15c088520 con 0x7fa1680b02a0 2023-12-19T13:46:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.520+0000 7fa1677fe640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15406a460 0x7fa15406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.520+0000 7fa1677fe640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15406a460 0x7fa15406c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa158036000 tx=0x7fa15803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.524+0000 7fa14ffff640 1 -- 172.21.15.113:0/2349625723 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa15c053ef0 con 0x7fa1680b02a0 2023-12-19T13:46:26.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.716+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1680cf700 con 0x7fa1680b02a0 2023-12-19T13:46:26.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.717+0000 7fa14ffff640 1 -- 172.21.15.113:0/2349625723 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa15c01e0a0 con 0x7fa1680b02a0 2023-12-19T13:46:26.717 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.719+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15406a460 msgr2=0x7fa15406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.719+0000 7fa16ce65640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15406a460 0x7fa15406c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa158036000 tx=0x7fa15803c040 comp rx=0 tx=0).stop 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1680b02a0 msgr2=0x7fa1680b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1680b02a0 0x7fa1680b1230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00c7f0 tx=0x7fa15c00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 shutdown_connections 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15406a460 0x7fa15406c920 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa168141900 0x7fa1680b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1680b02a0 0x7fa1680b1230 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 --2- 172.21.15.113:0/2349625723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa16806da30 0x7fa168153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 >> 172.21.15.113:0/2349625723 conn(0x7fa16806f630 msgr2=0x7fa16813f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 shutdown_connections 2023-12-19T13:46:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.720+0000 7fa16ce65640 1 -- 172.21.15.113:0/2349625723 wait complete. 2023-12-19T13:46:26.739 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:46:26.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.945+0000 7fa17cfc4640 1 Processor -- start 2023-12-19T13:46:26.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.946+0000 7fa17cfc4640 1 -- start start 2023-12-19T13:46:26.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.947+0000 7fa17cfc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1781449e0 0x7fa1780af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.947+0000 7fa17cfc4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa17806c6b0 0x7fa1780b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.947+0000 7fa17cfc4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1780afb10 con 0x7fa1780b0b50 2023-12-19T13:46:26.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.947+0000 7fa17cfc4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17806bb30 con 0x7fa17806c6b0 2023-12-19T13:46:26.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.947+0000 7fa17cfc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780b0070 con 0x7fa1781449e0 2023-12-19T13:46:26.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa176d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa17806c6b0 0x7fa1780b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa176d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa17806c6b0 0x7fa1780b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43226/0 (socket says 172.21.15.113:43226) 2023-12-19T13:46:26.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa176d9d640 1 -- 172.21.15.113:0/2738097205 learned_addr learned my addr 172.21.15.113:0/2738097205 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:26.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa17659c640 1 --2- 172.21.15.113:0/2738097205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1781449e0 0x7fa1780af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa176d9d640 1 -- 172.21.15.113:0/2738097205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1781449e0 msgr2=0x7fa1780af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:26.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa176d9d640 1 --2- 172.21.15.113:0/2738097205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1781449e0 0x7fa1780af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa176d9d640 1 -- 172.21.15.113:0/2738097205 >> v1:172.21.15.113:6789/0 conn(0x7fa1780b0b50 legacy=0x7fa17806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa176d9d640 1 -- 172.21.15.113:0/2738097205 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1780b0350 con 0x7fa17806c6b0 2023-12-19T13:46:26.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa17559a640 1 -- 172.21.15.113:0/2738097205 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056095782 0 0) 0x7fa1780afb10 con 0x7fa1780b0b50 2023-12-19T13:46:26.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.948+0000 7fa17659c640 1 --2- 172.21.15.113:0/2738097205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1781449e0 0x7fa1780af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:26.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.949+0000 7fa176d9d640 1 --2- 172.21.15.113:0/2738097205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa17806c6b0 0x7fa1780b1710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa170009870 tx=0x7fa17002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347da191f5ff2358 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.949+0000 7fa17559a640 1 -- 172.21.15.113:0/2738097205 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170030840 con 0x7fa17806c6b0 2023-12-19T13:46:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.949+0000 7fa17559a640 1 -- 172.21.15.113:0/2738097205 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1700309a0 con 0x7fa17806c6b0 2023-12-19T13:46:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17559a640 1 -- 172.21.15.113:0/2738097205 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170030d30 con 0x7fa17806c6b0 2023-12-19T13:46:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2738097205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa17806c6b0 msgr2=0x7fa1780b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2738097205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa17806c6b0 0x7fa1780b1710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa170009870 tx=0x7fa17002b980 comp rx=0 tx=0).stop 2023-12-19T13:46:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2738097205 shutdown_connections 2023-12-19T13:46:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2738097205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa17806c6b0 0x7fa1780b1710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2738097205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1781449e0 0x7fa1780af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2738097205 >> 172.21.15.113:0/2738097205 conn(0x7fa1780cbb70 msgr2=0x7fa1780cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2738097205 shutdown_connections 2023-12-19T13:46:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.950+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2738097205 wait complete. 2023-12-19T13:46:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.952+0000 7fa17cfc4640 1 Processor -- start 2023-12-19T13:46:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.952+0000 7fa17cfc4640 1 -- start start 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa17cfc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa17806c6b0 0x7fa17813ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa17cfc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1780b0b50 0x7fa17815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa17cfc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1781449e0 0x7fa1781f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa17cfc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17813c950 con 0x7fa1780b0b50 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa17cfc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17815cbf0 con 0x7fa1781449e0 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa17cfc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17815ced0 con 0x7fa17806c6b0 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa175d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1780b0b50 0x7fa17815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa175d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1780b0b50 0x7fa17815c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43232/0 (socket says 172.21.15.113:43232) 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.953+0000 7fa175d9b640 1 -- 172.21.15.113:0/2736182584 learned_addr learned my addr 172.21.15.113:0/2736182584 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa175d9b640 1 -- 172.21.15.113:0/2736182584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa17806c6b0 msgr2=0x7fa17813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa175d9b640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa17806c6b0 0x7fa17813ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa175d9b640 1 -- 172.21.15.113:0/2736182584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1781449e0 msgr2=0x7fa1781f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa175d9b640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1781449e0 0x7fa1781f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa175d9b640 1 -- 172.21.15.113:0/2736182584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700094d0 con 0x7fa1780b0b50 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa175d9b640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1780b0b50 0x7fa17815c350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa16800c890 tx=0x7fa16800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa16effd640 1 -- 172.21.15.113:0/2736182584 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168003da0 con 0x7fa1780b0b50 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa16effd640 1 -- 172.21.15.113:0/2736182584 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa168005070 con 0x7fa1780b0b50 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa16effd640 1 -- 172.21.15.113:0/2736182584 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168005420 con 0x7fa1780b0b50 2023-12-19T13:46:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17815d1b0 con 0x7fa1780b0b50 2023-12-19T13:46:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.954+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17813c4d0 con 0x7fa1780b0b50 2023-12-19T13:46:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.955+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa178061910 con 0x7fa1780b0b50 2023-12-19T13:46:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.956+0000 7fa16effd640 1 -- 172.21.15.113:0/2736182584 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa168005580 con 0x7fa1780b0b50 2023-12-19T13:46:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.957+0000 7fa16effd640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15806a430 0x7fa15806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.957+0000 7fa16effd640 1 -- 172.21.15.113:0/2736182584 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa168087e80 con 0x7fa1780b0b50 2023-12-19T13:46:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.957+0000 7fa17659c640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15806a430 0x7fa15806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.958+0000 7fa17659c640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15806a430 0x7fa15806c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa160006fd0 tx=0x7fa160008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:26.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:26.961+0000 7fa16effd640 1 -- 172.21.15.113:0/2736182584 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa168053850 con 0x7fa1780b0b50 2023-12-19T13:46:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.189+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1780ae560 con 0x7fa1780b0b50 2023-12-19T13:46:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.190+0000 7fa16effd640 1 -- 172.21.15.113:0/2736182584 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fa168017070 con 0x7fa1780b0b50 2023-12-19T13:46:27.191 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:27.191 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-19T13:46:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 3 2023-12-19T13:46:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.192+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15806a430 msgr2=0x7fa15806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.192+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15806a430 0x7fa15806c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa160006fd0 tx=0x7fa160008040 comp rx=0 tx=0).stop 2023-12-19T13:46:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.192+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1780b0b50 msgr2=0x7fa17815c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.192+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1780b0b50 0x7fa17815c350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa16800c890 tx=0x7fa16800cd50 comp rx=0 tx=0).stop 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 shutdown_connections 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa15806a430 0x7fa15806c8f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1781449e0 0x7fa1781f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1780b0b50 0x7fa17815c350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 --2- 172.21.15.113:0/2736182584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa17806c6b0 0x7fa17813ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 >> 172.21.15.113:0/2736182584 conn(0x7fa1780cbb70 msgr2=0x7fa1780ad2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 shutdown_connections 2023-12-19T13:46:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.193+0000 7fa17cfc4640 1 -- 172.21.15.113:0/2736182584 wait complete. 2023-12-19T13:46:27.212 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.416+0000 7fc962162640 1 Processor -- start 2023-12-19T13:46:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.417+0000 7fc962162640 1 -- start start 2023-12-19T13:46:27.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.418+0000 7fc962162640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc95c144c20 0x7fc95c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.418+0000 7fc962162640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c0b58c0 0x7fc95c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.418+0000 7fc962162640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c0b6640 con 0x7fc95c0b2a80 2023-12-19T13:46:27.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.418+0000 7fc962162640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c0b5da0 con 0x7fc95c144c20 2023-12-19T13:46:27.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.418+0000 7fc962162640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0b6080 con 0x7fc95c0b58c0 2023-12-19T13:46:27.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.418+0000 7fc96095f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc95c0b2a80 0x7fc95c0cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51060/0 (socket says 172.21.15.113:51060) 2023-12-19T13:46:27.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.418+0000 7fc96095f640 1 -- 172.21.15.113:0/4209046278 learned_addr learned my addr 172.21.15.113:0/4209046278 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc961961640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c0b58c0 0x7fc95c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550674408 0 0) 0x7fc95c0b6640 con 0x7fc95c0b2a80 2023-12-19T13:46:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc948003520 con 0x7fc95c0b2a80 2023-12-19T13:46:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc961160640 1 --2- 172.21.15.113:0/4209046278 >> v2:172.21.15.151:3300/0 conn(0x7fc95c144c20 0x7fc95c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2170168968 0 0) 0x7fc948003520 con 0x7fc95c0b2a80 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c0b58c0 msgr2=0x7fc95c15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c0b58c0 0x7fc95c15bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 >> v2:172.21.15.151:3300/0 conn(0x7fc95c144c20 msgr2=0x7fc95c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 --2- 172.21.15.113:0/4209046278 >> v2:172.21.15.151:3300/0 conn(0x7fc95c144c20 0x7fc95c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c0b6360 con 0x7fc95c0b2a80 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc94c001670 con 0x7fc95c0b2a80 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 >> v1:172.21.15.113:6789/0 conn(0x7fc95c0b2a80 legacy=0x7fc95c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc948003970 0x7fc948003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc948004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc948005180 0x7fc94800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0b5da0 con 0x7fc9480047c0 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0b6080 con 0x7fc948003970 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94800bfc0 con 0x7fc948005180 2023-12-19T13:46:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.419+0000 7fc961961640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c0b58c0 0x7fc95c15bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:27.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.420+0000 7fc96095f640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc948004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.420+0000 7fc961160640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc948003970 0x7fc948003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.420+0000 7fc96095f640 1 -- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc948005180 msgr2=0x7fc94800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:27.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.420+0000 7fc96095f640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc948005180 0x7fc94800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.420+0000 7fc96095f640 1 -- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc948003970 msgr2=0x7fc948003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:27.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.420+0000 7fc96095f640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc948003970 0x7fc948003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.420+0000 7fc96095f640 1 -- 172.21.15.113:0/4209046278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948003520 con 0x7fc9480047c0 2023-12-19T13:46:27.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.421+0000 7fc96095f640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc948004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c270 tx=0x7fc9480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768372178565d6f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:27.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.421+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c02cae0 con 0x7fc9480047c0 2023-12-19T13:46:27.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.421+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c02cc40 con 0x7fc9480047c0 2023-12-19T13:46:27.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.421+0000 7fc953fff640 1 -- 172.21.15.113:0/4209046278 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0058d0 con 0x7fc9480047c0 2023-12-19T13:46:27.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.422+0000 7fc962162640 1 -- 172.21.15.113:0/4209046278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 msgr2=0x7fc948004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.422+0000 7fc962162640 1 --2- 172.21.15.113:0/4209046278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc948004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c270 tx=0x7fc9480057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.422+0000 7fc961961640 1 -- 172.21.15.113:0/4209046278 reap_dead start 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.422+0000 7fc962162640 1 -- 172.21.15.113:0/4209046278 shutdown_connections 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.422+0000 7fc962162640 1 -- 172.21.15.113:0/4209046278 >> 172.21.15.113:0/4209046278 conn(0x7fc95c06b8f0 msgr2=0x7fc95c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.422+0000 7fc962162640 1 -- 172.21.15.113:0/4209046278 shutdown_connections 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.422+0000 7fc962162640 1 -- 172.21.15.113:0/4209046278 wait complete. 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.424+0000 7fc962162640 1 Processor -- start 2023-12-19T13:46:27.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.424+0000 7fc962162640 1 -- start start 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc962162640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc95c15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc962162640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc95c0ca4a0 0x7fc95c143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc962162640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c06ddc0 0x7fc95c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc962162640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c06e780 con 0x7fc9480047c0 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc962162640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c1f3840 con 0x7fc95c0ca4a0 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc962162640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c1f2810 con 0x7fc95c06ddc0 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc95c15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc95c15ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43256/0 (socket says 172.21.15.113:43256) 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 -- 172.21.15.113:0/1738589026 learned_addr learned my addr 172.21.15.113:0/1738589026 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 -- 172.21.15.113:0/1738589026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c06ddc0 msgr2=0x7fc95c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c06ddc0 0x7fc95c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 -- 172.21.15.113:0/1738589026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc95c0ca4a0 msgr2=0x7fc95c143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc95c0ca4a0 0x7fc95c143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.425+0000 7fc961160640 1 -- 172.21.15.113:0/1738589026 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c0ce200 con 0x7fc9480047c0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.426+0000 7fc961160640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc95c15ac80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc95800f660 tx=0x7fc95800fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.426+0000 7fc951ffb640 1 -- 172.21.15.113:0/1738589026 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800d8c0 con 0x7fc9480047c0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.426+0000 7fc951ffb640 1 -- 172.21.15.113:0/1738589026 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800da20 con 0x7fc9480047c0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.426+0000 7fc951ffb640 1 -- 172.21.15.113:0/1738589026 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800dd90 con 0x7fc9480047c0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.426+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c1f2a80 con 0x7fc9480047c0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.426+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c1f3040 con 0x7fc9480047c0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.427+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c061910 con 0x7fc9480047c0 2023-12-19T13:46:27.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.428+0000 7fc951ffb640 1 -- 172.21.15.113:0/1738589026 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc958014460 con 0x7fc9480047c0 2023-12-19T13:46:27.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.429+0000 7fc951ffb640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc94006a460 0x7fc94006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.429+0000 7fc951ffb640 1 -- 172.21.15.113:0/1738589026 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc958088f90 con 0x7fc9480047c0 2023-12-19T13:46:27.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.429+0000 7fc96095f640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc94006a460 0x7fc94006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.430+0000 7fc96095f640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc94006a460 0x7fc94006c920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc94c034000 tx=0x7fc94c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:27.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.433+0000 7fc951ffb640 1 -- 172.21.15.113:0/1738589026 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc9580bbc80 con 0x7fc9480047c0 2023-12-19T13:46:27.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.624+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc95c0cdd20 con 0x7fc9480047c0 2023-12-19T13:46:27.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.625+0000 7fc951ffb640 1 -- 172.21.15.113:0/1738589026 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fc9580548d0 con 0x7fc9480047c0 2023-12-19T13:46:27.626 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:27.626 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:23.250705+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc94006a460 msgr2=0x7fc94006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc94006a460 0x7fc94006c920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc94c034000 tx=0x7fc94c02e000 comp rx=0 tx=0).stop 2023-12-19T13:46:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 msgr2=0x7fc95c15ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc95c15ac80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc95800f660 tx=0x7fc95800fb20 comp rx=0 tx=0).stop 2023-12-19T13:46:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 shutdown_connections 2023-12-19T13:46:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc94006a460 0x7fc94006c920 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc95c06ddc0 0x7fc95c06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc95c0ca4a0 0x7fc95c143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 --2- 172.21.15.113:0/1738589026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9480047c0 0x7fc95c15ac80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 >> 172.21.15.113:0/1738589026 conn(0x7fc95c06b8f0 msgr2=0x7fc95c0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 shutdown_connections 2023-12-19T13:46:27.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.628+0000 7fc962162640 1 -- 172.21.15.113:0/1738589026 wait complete. 2023-12-19T13:46:27.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:46:27.647 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:46:27.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.858+0000 7fc6b5edb640 1 Processor -- start 2023-12-19T13:46:27.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.858+0000 7fc6b5edb640 1 -- start start 2023-12-19T13:46:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.859+0000 7fc6b5edb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6b015b1d0 0x7fc6b00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.859+0000 7fc6b5edb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b015fde0 con 0x7fc6b00ceea0 2023-12-19T13:46:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.859+0000 7fc6b5edb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b015ef10 con 0x7fc6b00b1ec0 2023-12-19T13:46:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.859+0000 7fc6b5edb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b00b2320 con 0x7fc6b015b1d0 2023-12-19T13:46:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.860+0000 7fc6af7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6b015b1d0 0x7fc6b00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.860+0000 7fc6affff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc6b00ceea0 0x7fc6b006c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51066/0 (socket says 172.21.15.113:51066) 2023-12-19T13:46:27.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.860+0000 7fc6affff640 1 -- 172.21.15.113:0/511977205 learned_addr learned my addr 172.21.15.113:0/511977205 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:27.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.860+0000 7fc6af7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6b015b1d0 0x7fc6b00b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43268/0 (socket says 172.21.15.113:43268) 2023-12-19T13:46:27.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.860+0000 7fc6af7fe640 1 -- 172.21.15.113:0/511977205 >> v1:172.21.15.151:6789/0 conn(0x7fc6b00b1ec0 legacy=0x7fc6b015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:27.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.860+0000 7fc6af7fe640 1 -- 172.21.15.113:0/511977205 >> v1:172.21.15.113:6789/0 conn(0x7fc6b00ceea0 legacy=0x7fc6b006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.860+0000 7fc6af7fe640 1 -- 172.21.15.113:0/511977205 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00b2e40 con 0x7fc6b015b1d0 2023-12-19T13:46:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.861+0000 7fc6af7fe640 1 --2- 172.21.15.113:0/511977205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b015b1d0 0x7fc6b00b2760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00097a0 tx=0x7fc6a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1942d54c8259c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.861+0000 7fc6aeffd640 1 -- 172.21.15.113:0/511977205 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0031830 con 0x7fc6b015b1d0 2023-12-19T13:46:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.861+0000 7fc6aeffd640 1 -- 172.21.15.113:0/511977205 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0031990 con 0x7fc6b015b1d0 2023-12-19T13:46:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.861+0000 7fc6aeffd640 1 -- 172.21.15.113:0/511977205 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0031d20 con 0x7fc6b015b1d0 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.862+0000 7fc6b5edb640 1 -- 172.21.15.113:0/511977205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b015b1d0 msgr2=0x7fc6b00b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.862+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/511977205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b015b1d0 0x7fc6b00b2760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00097a0 tx=0x7fc6a002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.862+0000 7fc6b5edb640 1 -- 172.21.15.113:0/511977205 shutdown_connections 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.862+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/511977205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b015b1d0 0x7fc6b00b2760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.862+0000 7fc6b5edb640 1 -- 172.21.15.113:0/511977205 >> 172.21.15.113:0/511977205 conn(0x7fc6b0073150 msgr2=0x7fc6b00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.862+0000 7fc6b5edb640 1 -- 172.21.15.113:0/511977205 shutdown_connections 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.862+0000 7fc6b5edb640 1 -- 172.21.15.113:0/511977205 wait complete. 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.864+0000 7fc6b5edb640 1 Processor -- start 2023-12-19T13:46:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.864+0000 7fc6b5edb640 1 -- start start 2023-12-19T13:46:27.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6b5edb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b00b1ec0 0x7fc6b015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6b5edb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b00ceea0 0x7fc6b0143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6b5edb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b015b1d0 0x7fc6b0146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6b5edb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0146b80 con 0x7fc6b00ceea0 2023-12-19T13:46:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6b5edb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0146e60 con 0x7fc6b015b1d0 2023-12-19T13:46:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6b5edb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00ca590 con 0x7fc6b00b1ec0 2023-12-19T13:46:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6a6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b00ceea0 0x7fc6b0143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6a6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b00ceea0 0x7fc6b0143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43284/0 (socket says 172.21.15.113:43284) 2023-12-19T13:46:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.865+0000 7fc6a6ffd640 1 -- 172.21.15.113:0/3861565280 learned_addr learned my addr 172.21.15.113:0/3861565280 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6a6ffd640 1 -- 172.21.15.113:0/3861565280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b00b1ec0 msgr2=0x7fc6b015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6a6ffd640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b00b1ec0 0x7fc6b015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6a6ffd640 1 -- 172.21.15.113:0/3861565280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b015b1d0 msgr2=0x7fc6b0146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6a6ffd640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b015b1d0 0x7fc6b0146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6a6ffd640 1 -- 172.21.15.113:0/3861565280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0009400 con 0x7fc6b00ceea0 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6a6ffd640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b00ceea0 0x7fc6b0143f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c430 tx=0x7fc69800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6acff9640 1 -- 172.21.15.113:0/3861565280 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698011790 con 0x7fc6b00ceea0 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6acff9640 1 -- 172.21.15.113:0/3861565280 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6980118f0 con 0x7fc6b00ceea0 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b00ca870 con 0x7fc6b00ceea0 2023-12-19T13:46:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6acff9640 1 -- 172.21.15.113:0/3861565280 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698011ce0 con 0x7fc6b00ceea0 2023-12-19T13:46:27.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.866+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b00ca1b0 con 0x7fc6b00ceea0 2023-12-19T13:46:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.867+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b00caab0 con 0x7fc6b00ceea0 2023-12-19T13:46:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.868+0000 7fc6acff9640 1 -- 172.21.15.113:0/3861565280 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc69801c460 con 0x7fc6b00ceea0 2023-12-19T13:46:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.869+0000 7fc6acff9640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc69006a430 0x7fc69006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:27.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.869+0000 7fc6acff9640 1 -- 172.21.15.113:0/3861565280 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6980885e0 con 0x7fc6b00ceea0 2023-12-19T13:46:27.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.869+0000 7fc6af7fe640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc69006a430 0x7fc69006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:27.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.870+0000 7fc6af7fe640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc69006a430 0x7fc69006c8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0036000 tx=0x7fc6a0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:27.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:27.873+0000 7fc6acff9640 1 -- 172.21.15.113:0/3861565280 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc6b00caab0 con 0x7fc6b00ceea0 2023-12-19T13:46:28.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.051+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6b00caab0 con 0x7fc6b00ceea0 2023-12-19T13:46:28.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.051+0000 7fc6acff9640 1 -- 172.21.15.113:0/3861565280 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6b00caab0 con 0x7fc6b00ceea0 2023-12-19T13:46:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:46:28.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc69006a430 msgr2=0x7fc69006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc69006a430 0x7fc69006c8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0036000 tx=0x7fc6a0030000 comp rx=0 tx=0).stop 2023-12-19T13:46:28.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b00ceea0 msgr2=0x7fc6b0143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b00ceea0 0x7fc6b0143f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c430 tx=0x7fc69800c8f0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 shutdown_connections 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc69006a430 0x7fc69006c8f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b015b1d0 0x7fc6b0146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b00ceea0 0x7fc6b0143f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 --2- 172.21.15.113:0/3861565280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b00b1ec0 0x7fc6b015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 >> 172.21.15.113:0/3861565280 conn(0x7fc6b0073150 msgr2=0x7fc6b0159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:28.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 shutdown_connections 2023-12-19T13:46:28.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.054+0000 7fc6b5edb640 1 -- 172.21.15.113:0/3861565280 wait complete. 2023-12-19T13:46:28.072 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:46:28.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.275+0000 7f9ca8841640 1 Processor -- start 2023-12-19T13:46:28.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.275+0000 7f9ca8841640 1 -- start start 2023-12-19T13:46:28.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.277+0000 7f9ca8841640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca415d490 0x7f9ca40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.277+0000 7f9ca8841640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ca40705c0 0x7f9ca40acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.277+0000 7f9ca8841640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca406b850 con 0x7f9ca415d870 2023-12-19T13:46:28.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.277+0000 7f9ca8841640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca406c6b0 con 0x7f9ca40705c0 2023-12-19T13:46:28.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.277+0000 7f9ca8841640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca406f160 con 0x7f9ca415d490 2023-12-19T13:46:28.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca2d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ca40705c0 0x7f9ca40acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca259c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca415d490 0x7f9ca40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca2d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ca40705c0 0x7f9ca40acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:53622/0 (socket says 172.21.15.113:53622) 2023-12-19T13:46:28.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca2d9d640 1 -- 172.21.15.113:0/182203361 learned_addr learned my addr 172.21.15.113:0/182203361 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:28.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca2d9d640 1 -- 172.21.15.113:0/182203361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca415d490 msgr2=0x7f9ca40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:28.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca2d9d640 1 --2- 172.21.15.113:0/182203361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca415d490 0x7f9ca40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca2d9d640 1 -- 172.21.15.113:0/182203361 >> v1:172.21.15.151:6789/0 conn(0x7f9ca415d870 legacy=0x7f9ca4161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.278+0000 7f9ca2d9d640 1 -- 172.21.15.113:0/182203361 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca406bb30 con 0x7f9ca40705c0 2023-12-19T13:46:28.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.280+0000 7f9ca2d9d640 1 --2- 172.21.15.113:0/182203361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca40705c0 0x7f9ca40acdf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009e50 tx=0x7f9c9c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8bfb1e3df74d8c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:28.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.280+0000 7f9ca1d9b640 1 -- 172.21.15.113:0/182203361 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c02cb00 con 0x7f9ca40705c0 2023-12-19T13:46:28.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca1d9b640 1 -- 172.21.15.113:0/182203361 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c02cc60 con 0x7f9ca40705c0 2023-12-19T13:46:28.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca1d9b640 1 -- 172.21.15.113:0/182203361 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0343f0 con 0x7f9ca40705c0 2023-12-19T13:46:28.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 -- 172.21.15.113:0/182203361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca40705c0 msgr2=0x7f9ca40acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 --2- 172.21.15.113:0/182203361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca40705c0 0x7f9ca40acdf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009e50 tx=0x7f9c9c02bf60 comp rx=0 tx=0).stop 2023-12-19T13:46:28.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 -- 172.21.15.113:0/182203361 shutdown_connections 2023-12-19T13:46:28.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 --2- 172.21.15.113:0/182203361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca40705c0 0x7f9ca40acdf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 --2- 172.21.15.113:0/182203361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca415d490 0x7f9ca40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 -- 172.21.15.113:0/182203361 >> 172.21.15.113:0/182203361 conn(0x7f9ca40cf0b0 msgr2=0x7f9ca40cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:28.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 -- 172.21.15.113:0/182203361 shutdown_connections 2023-12-19T13:46:28.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.281+0000 7f9ca8841640 1 -- 172.21.15.113:0/182203361 wait complete. 2023-12-19T13:46:28.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.283+0000 7f9ca8841640 1 Processor -- start 2023-12-19T13:46:28.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.283+0000 7f9ca8841640 1 -- start start 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.284+0000 7f9ca8841640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca40705c0 0x7f9ca414bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.284+0000 7f9ca8841640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ca415d490 0x7f9ca4153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.284+0000 7f9ca8841640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca415d870 0x7f9ca415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.284+0000 7f9ca8841640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca414c0e0 con 0x7f9ca415d490 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.284+0000 7f9ca8841640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca41595c0 con 0x7f9ca415d870 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.284+0000 7f9ca8841640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4159000 con 0x7f9ca40705c0 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.284+0000 7f9c9bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ca415d490 0x7f9ca4153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ca415d490 0x7f9ca4153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35426/0 (socket says 172.21.15.113:35426) 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 -- 172.21.15.113:0/2457129008 learned_addr learned my addr 172.21.15.113:0/2457129008 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9ca2d9d640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca415d870 0x7f9ca415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9ca259c640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca40705c0 0x7f9ca414bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 -- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca40705c0 msgr2=0x7f9ca414bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca40705c0 0x7f9ca414bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 -- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca415d870 msgr2=0x7f9ca415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca415d870 0x7f9ca415c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 -- 172.21.15.113:0/2457129008 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c009b30 con 0x7f9ca415d490 2023-12-19T13:46:28.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9bfff640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ca415d490 0x7f9ca4153980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c3c0 tx=0x7f9c8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:28.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.285+0000 7f9c9affd640 1 -- 172.21.15.113:0/2457129008 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0052d0 con 0x7f9ca415d490 2023-12-19T13:46:28.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.286+0000 7f9c9affd640 1 -- 172.21.15.113:0/2457129008 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c005450 con 0x7f9ca415d490 2023-12-19T13:46:28.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.286+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca41592e0 con 0x7f9ca415d490 2023-12-19T13:46:28.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.286+0000 7f9c9affd640 1 -- 172.21.15.113:0/2457129008 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c007260 con 0x7f9ca415d490 2023-12-19T13:46:28.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.286+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca4153460 con 0x7f9ca415d490 2023-12-19T13:46:28.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.287+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca4074770 con 0x7f9ca415d490 2023-12-19T13:46:28.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.288+0000 7f9c9affd640 1 -- 172.21.15.113:0/2457129008 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c8c0073c0 con 0x7f9ca415d490 2023-12-19T13:46:28.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.288+0000 7f9c9affd640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8406a430 0x7f9c8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.289+0000 7f9c9affd640 1 -- 172.21.15.113:0/2457129008 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c8c0878d0 con 0x7f9ca415d490 2023-12-19T13:46:28.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.289+0000 7f9ca259c640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8406a430 0x7f9c8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.289+0000 7f9ca259c640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8406a430 0x7f9c8406c8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009ad0 tx=0x7f9c94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:28.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.293+0000 7f9c9affd640 1 -- 172.21.15.113:0/2457129008 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c8c0532a0 con 0x7f9ca415d490 2023-12-19T13:46:28.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.487+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9ca4061910 con 0x7f9ca415d490 2023-12-19T13:46:28.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.488+0000 7f9c9affd640 1 -- 172.21.15.113:0/2457129008 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9c8c0568c0 con 0x7f9ca415d490 2023-12-19T13:46:28.488 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:28.489 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:46:28.489 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:46:28.489 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:46:28.489 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:46:28.489 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:46:28.489 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:46:28.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8406a430 msgr2=0x7f9c8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8406a430 0x7f9c8406c8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009ad0 tx=0x7f9c94008040 comp rx=0 tx=0).stop 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ca415d490 msgr2=0x7f9ca4153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ca415d490 0x7f9ca4153980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c3c0 tx=0x7f9c8c00c880 comp rx=0 tx=0).stop 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 shutdown_connections 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8406a430 0x7f9c8406c8f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca415d870 0x7f9ca415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ca415d490 0x7f9ca4153980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 --2- 172.21.15.113:0/2457129008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ca40705c0 0x7f9ca414bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.490+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 >> 172.21.15.113:0/2457129008 conn(0x7f9ca40cf0b0 msgr2=0x7f9ca40b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.491+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 shutdown_connections 2023-12-19T13:46:28.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.491+0000 7f9ca8841640 1 -- 172.21.15.113:0/2457129008 wait complete. 2023-12-19T13:46:28.510 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:46:28.511 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:46:28.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.718+0000 7fd8fb88f640 1 Processor -- start 2023-12-19T13:46:28.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.718+0000 7fd8fb88f640 1 -- start start 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8fb88f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f415a000 0x7fd8f415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8fb88f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd8f40cbca0 0x7fd8f40b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8fb88f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd8f40b1dc0 0x7fd8f406b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8fb88f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f4071c60 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8fb88f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40b2230 con 0x7fd8f40cbca0 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8fb88f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f415ec00 con 0x7fd8f415a000 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8f9e2c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd8f40b1dc0 0x7fd8f406b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8f9e2c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd8f40b1dc0 0x7fd8f406b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35440/0 (socket says 172.21.15.113:35440) 2023-12-19T13:46:28.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.720+0000 7fd8f9e2c640 1 -- 172.21.15.113:0/1043710654 learned_addr learned my addr 172.21.15.113:0/1043710654 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:28.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.721+0000 7fd8f962b640 1 --2- 172.21.15.113:0/1043710654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f415a000 0x7fd8f415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.721+0000 7fd8f8e2a640 1 --2- 172.21.15.113:0/1043710654 >> v2:172.21.15.151:3300/0 conn(0x7fd8f40cbca0 0x7fd8f40b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.721+0000 7fd8f9e2c640 1 -- 172.21.15.113:0/1043710654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f415a000 msgr2=0x7fd8f415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:28.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.721+0000 7fd8f9e2c640 1 --2- 172.21.15.113:0/1043710654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f415a000 0x7fd8f415e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.721+0000 7fd8f9e2c640 1 -- 172.21.15.113:0/1043710654 >> v2:172.21.15.151:3300/0 conn(0x7fd8f40cbca0 msgr2=0x7fd8f40b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:28.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.721+0000 7fd8f9e2c640 1 --2- 172.21.15.113:0/1043710654 >> v2:172.21.15.151:3300/0 conn(0x7fd8f40cbca0 0x7fd8f40b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.721+0000 7fd8f9e2c640 1 -- 172.21.15.113:0/1043710654 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4070bc0 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.722+0000 7fd8f9e2c640 1 --2- 172.21.15.113:0/1043710654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f406b790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8f415edd0 tx=0x7fd8ec02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56ed010668401b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.722+0000 7fd8ebfff640 1 -- 172.21.15.113:0/1043710654 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec02ec60 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.722+0000 7fd8ebfff640 1 -- 172.21.15.113:0/1043710654 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec02edc0 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.722+0000 7fd8ebfff640 1 -- 172.21.15.113:0/1043710654 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec036610 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 -- 172.21.15.113:0/1043710654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 msgr2=0x7fd8f406b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/1043710654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f406b790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8f415edd0 tx=0x7fd8ec02e0c0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 -- 172.21.15.113:0/1043710654 shutdown_connections 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/1043710654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f406b790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/1043710654 >> v2:172.21.15.151:3300/0 conn(0x7fd8f40cbca0 0x7fd8f40b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/1043710654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f415a000 0x7fd8f415e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 -- 172.21.15.113:0/1043710654 >> 172.21.15.113:0/1043710654 conn(0x7fd8f40cf230 msgr2=0x7fd8f40cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 -- 172.21.15.113:0/1043710654 shutdown_connections 2023-12-19T13:46:28.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.723+0000 7fd8fb88f640 1 -- 172.21.15.113:0/1043710654 wait complete. 2023-12-19T13:46:28.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.725+0000 7fd8fb88f640 1 Processor -- start 2023-12-19T13:46:28.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.726+0000 7fd8fb88f640 1 -- start start 2023-12-19T13:46:28.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8fb88f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f4158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8fb88f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f40cbca0 0x7fd8f40acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8fb88f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8f415a000 0x7fd8f4149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8fb88f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41f6440 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8fb88f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41f6720 con 0x7fd8f415a000 2023-12-19T13:46:28.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8fb88f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41f6a00 con 0x7fd8f40cbca0 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f4158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f4158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35454/0 (socket says 172.21.15.113:35454) 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 -- 172.21.15.113:0/2563259997 learned_addr learned my addr 172.21.15.113:0/2563259997 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f8e2a640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f40cbca0 0x7fd8f40acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f9e2c640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8f415a000 0x7fd8f4149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 -- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f40cbca0 msgr2=0x7fd8f40acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f40cbca0 0x7fd8f40acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 -- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8f415a000 msgr2=0x7fd8f4149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8f415a000 0x7fd8f4149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.727+0000 7fd8f962b640 1 -- 172.21.15.113:0/2563259997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009b30 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.728+0000 7fd8f962b640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f4158960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000d5f0 tx=0x7fd8f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:28.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.728+0000 7fd8e9ffb640 1 -- 172.21.15.113:0/2563259997 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00125f0 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.728+0000 7fd8e9ffb640 1 -- 172.21.15.113:0/2563259997 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0012750 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.728+0000 7fd8e9ffb640 1 -- 172.21.15.113:0/2563259997 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0012b00 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.728+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f41f6ce0 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.728+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f4158ea0 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.729+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4061910 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.730+0000 7fd8e9ffb640 1 -- 172.21.15.113:0/2563259997 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8f0012c60 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.732+0000 7fd8e9ffb640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d806a430 0x7fd8d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:28.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.732+0000 7fd8e9ffb640 1 -- 172.21.15.113:0/2563259997 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8f0088a00 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.732+0000 7fd8f8e2a640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d806a430 0x7fd8d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:28.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.733+0000 7fd8f8e2a640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d806a430 0x7fd8d806c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8f414c6a0 tx=0x7fd8e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:28.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.737+0000 7fd8e9ffb640 1 -- 172.21.15.113:0/2563259997 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd8f00543d0 con 0x7fd8f40b1dc0 2023-12-19T13:46:28.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:28.930+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd8f40cfff0 con 0x7fd8f40b1dc0 2023-12-19T13:46:29.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.428+0000 7fd8e9ffb640 1 -- 172.21.15.113:0/2563259997 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd8f00579f0 con 0x7fd8f40b1dc0 2023-12-19T13:46:29.430 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:46:29.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.435+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d806a430 msgr2=0x7fd8d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:29.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.435+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d806a430 0x7fd8d806c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8f414c6a0 tx=0x7fd8e4008040 comp rx=0 tx=0).stop 2023-12-19T13:46:29.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.435+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 msgr2=0x7fd8f4158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:29.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.435+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f4158960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000d5f0 tx=0x7fd8f000dab0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 shutdown_connections 2023-12-19T13:46:29.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d806a430 0x7fd8d806c8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8f415a000 0x7fd8f4149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8f40cbca0 0x7fd8f40acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 --2- 172.21.15.113:0/2563259997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8f40b1dc0 0x7fd8f4158960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 >> 172.21.15.113:0/2563259997 conn(0x7fd8f40cf230 msgr2=0x7fd8f414a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:29.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 shutdown_connections 2023-12-19T13:46:29.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.436+0000 7fd8fb88f640 1 -- 172.21.15.113:0/2563259997 wait complete. 2023-12-19T13:46:29.459 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:46:29.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.662+0000 7ff8b303e640 1 Processor -- start 2023-12-19T13:46:29.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.662+0000 7ff8b303e640 1 -- start start 2023-12-19T13:46:29.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b303e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff8ac158df0 0x7ff8ac15c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:29.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b303e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:29.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b303e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8ac06d850 0x7ff8ac06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b303e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac070130 con 0x7ff8ac158df0 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b303e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac06e1c0 con 0x7ff8ac06d850 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b303e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac06f610 con 0x7ff8ac06f160 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b0dda640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff8ac158df0 0x7ff8ac15c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b0dda640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff8ac158df0 0x7ff8ac15c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35470/0 (socket says 172.21.15.113:35470) 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.664+0000 7ff8b0dda640 1 -- 172.21.15.113:0/1868206267 learned_addr learned my addr 172.21.15.113:0/1868206267 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8abfff640 1 --2- 172.21.15.113:0/1868206267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8b0dda640 1 -- 172.21.15.113:0/1868206267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 msgr2=0x7ff8ac0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8b0dda640 1 --2- 172.21.15.113:0/1868206267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8b15db640 1 --2- 172.21.15.113:0/1868206267 >> v2:172.21.15.151:3300/0 conn(0x7ff8ac06d850 0x7ff8ac06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8b0dda640 1 -- 172.21.15.113:0/1868206267 >> v2:172.21.15.151:3300/0 conn(0x7ff8ac06d850 msgr2=0x7ff8ac06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8b0dda640 1 --2- 172.21.15.113:0/1868206267 >> v2:172.21.15.151:3300/0 conn(0x7ff8ac06d850 0x7ff8ac06dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8b0dda640 1 -- 172.21.15.113:0/1868206267 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac06f890 con 0x7ff8ac158df0 2023-12-19T13:46:29.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.665+0000 7ff8b15db640 1 --2- 172.21.15.113:0/1868206267 >> v2:172.21.15.151:3300/0 conn(0x7ff8ac06d850 0x7ff8ac06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:29.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.666+0000 7ff8b0dda640 1 --2- 172.21.15.113:0/1868206267 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac15c460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac15ffc0 tx=0x7ff8a002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3038635eccec6e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:29.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.666+0000 7ff8ab7fe640 1 -- 172.21.15.113:0/1868206267 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00317d0 con 0x7ff8ac158df0 2023-12-19T13:46:29.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.666+0000 7ff8ab7fe640 1 -- 172.21.15.113:0/1868206267 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0031930 con 0x7ff8ac158df0 2023-12-19T13:46:29.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.666+0000 7ff8ab7fe640 1 -- 172.21.15.113:0/1868206267 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0031cc0 con 0x7ff8ac158df0 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 -- 172.21.15.113:0/1868206267 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 msgr2=0x7ff8ac15c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 --2- 172.21.15.113:0/1868206267 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac15c460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac15ffc0 tx=0x7ff8a002b870 comp rx=0 tx=0).stop 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 -- 172.21.15.113:0/1868206267 shutdown_connections 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 --2- 172.21.15.113:0/1868206267 >> v2:172.21.15.151:3300/0 conn(0x7ff8ac06d850 0x7ff8ac06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 --2- 172.21.15.113:0/1868206267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 --2- 172.21.15.113:0/1868206267 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac15c460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 -- 172.21.15.113:0/1868206267 >> 172.21.15.113:0/1868206267 conn(0x7ff8ac0cf0b0 msgr2=0x7ff8ac0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:29.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 -- 172.21.15.113:0/1868206267 shutdown_connections 2023-12-19T13:46:29.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.667+0000 7ff8b303e640 1 -- 172.21.15.113:0/1868206267 wait complete. 2023-12-19T13:46:29.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.669+0000 7ff8b303e640 1 Processor -- start 2023-12-19T13:46:29.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.669+0000 7ff8b303e640 1 -- start start 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b303e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8ac06d850 0x7ff8ac149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b303e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b303e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b303e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac15a2a0 con 0x7ff8ac158df0 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b303e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac1f31f0 con 0x7ff8ac06d850 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b303e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac149770 con 0x7ff8ac06f160 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b15db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.670+0000 7ff8b15db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac06ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35486/0 (socket says 172.21.15.113:35486) 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b15db640 1 -- 172.21.15.113:0/2841168155 learned_addr learned my addr 172.21.15.113:0/2841168155 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8abfff640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b0dda640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8ac06d850 0x7ff8ac149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b15db640 1 -- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 msgr2=0x7ff8ac0acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:29.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b15db640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b15db640 1 -- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8ac06d850 msgr2=0x7ff8ac149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:29.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b15db640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8ac06d850 0x7ff8ac149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:29.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b15db640 1 -- 172.21.15.113:0/2841168155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00094d0 con 0x7ff8ac158df0 2023-12-19T13:46:29.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b0dda640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8ac06d850 0x7ff8ac149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:29.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8b15db640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac06ca10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400cd10 tx=0x7ff8a400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:29.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8a97fa640 1 -- 172.21.15.113:0/2841168155 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400f680 con 0x7ff8ac158df0 2023-12-19T13:46:29.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.671+0000 7ff8a97fa640 1 -- 172.21.15.113:0/2841168155 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400f800 con 0x7ff8ac158df0 2023-12-19T13:46:29.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.672+0000 7ff8a97fa640 1 -- 172.21.15.113:0/2841168155 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400fbb0 con 0x7ff8ac158df0 2023-12-19T13:46:29.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.672+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac159620 con 0x7ff8ac158df0 2023-12-19T13:46:29.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.672+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac159be0 con 0x7ff8ac158df0 2023-12-19T13:46:29.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.673+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac074770 con 0x7ff8ac158df0 2023-12-19T13:46:29.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.674+0000 7ff8a97fa640 1 -- 172.21.15.113:0/2841168155 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff8a400b040 con 0x7ff8ac158df0 2023-12-19T13:46:29.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.675+0000 7ff8a97fa640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff89006a430 0x7ff89006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:29.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.676+0000 7ff8a97fa640 1 -- 172.21.15.113:0/2841168155 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff8a4089120 con 0x7ff8ac158df0 2023-12-19T13:46:29.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.676+0000 7ff8b0dda640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff89006a430 0x7ff89006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:29.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.676+0000 7ff8b0dda640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff89006a430 0x7ff89006c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0036000 tx=0x7ff8a003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:29.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.681+0000 7ff8a97fa640 1 -- 172.21.15.113:0/2841168155 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff8a40548e0 con 0x7ff8ac158df0 2023-12-19T13:46:29.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:29.873+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff8ac061910 con 0x7ff8ac158df0 2023-12-19T13:46:30.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.442+0000 7ff8a97fa640 1 -- 172.21.15.113:0/2841168155 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff8a4057f00 con 0x7ff8ac158df0 2023-12-19T13:46:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:46:30.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.449+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff89006a430 msgr2=0x7ff89006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:30.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.449+0000 7ff8b303e640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff89006a430 0x7ff89006c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0036000 tx=0x7ff8a003d040 comp rx=0 tx=0).stop 2023-12-19T13:46:30.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.449+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 msgr2=0x7ff8ac06ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:30.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.449+0000 7ff8b303e640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac06ca10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400cd10 tx=0x7ff8a400a650 comp rx=0 tx=0).stop 2023-12-19T13:46:30.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.449+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 shutdown_connections 2023-12-19T13:46:30.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.450+0000 7ff8b303e640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff89006a430 0x7ff89006c8f0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0036000 tx=0x7ff8a003d040 comp rx=0 tx=0).stop 2023-12-19T13:46:30.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.450+0000 7ff8b303e640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff8ac158df0 0x7ff8ac06ca10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.450+0000 7ff8b303e640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8ac06f160 0x7ff8ac0acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.450+0000 7ff8b303e640 1 --2- 172.21.15.113:0/2841168155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8ac06d850 0x7ff8ac149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.450+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 >> 172.21.15.113:0/2841168155 conn(0x7ff8ac0cf0b0 msgr2=0x7ff8ac155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:30.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.452+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 shutdown_connections 2023-12-19T13:46:30.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.452+0000 7ff8b303e640 1 -- 172.21.15.113:0/2841168155 wait complete. 2023-12-19T13:46:30.481 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:46:30.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.668+0000 7f25b8217640 1 Processor -- start 2023-12-19T13:46:30.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.669+0000 7f25b8217640 1 -- start start 2023-12-19T13:46:30.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.670+0000 7f25b8217640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f25b015b1d0 0x7f25b00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:30.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.670+0000 7f25b8217640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25b00b1ec0 0x7f25b015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:30.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.670+0000 7f25b8217640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b015ef10 con 0x7f25b00ceea0 2023-12-19T13:46:30.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.670+0000 7f25b8217640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00b2320 con 0x7f25b00b1ec0 2023-12-19T13:46:30.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.670+0000 7f25b8217640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00b2e40 con 0x7f25b015b1d0 2023-12-19T13:46:30.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b57b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25b00b1ec0 0x7f25b015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:30.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b57b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25b00b1ec0 0x7f25b015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35500/0 (socket says 172.21.15.113:35500) 2023-12-19T13:46:30.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b57b2640 1 -- 172.21.15.113:0/1875439776 learned_addr learned my addr 172.21.15.113:0/1875439776 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:30.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b5fb3640 1 --2- 172.21.15.113:0/1875439776 >> v2:172.21.15.151:3300/0 conn(0x7f25b015b1d0 0x7f25b00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:30.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b57b2640 1 -- 172.21.15.113:0/1875439776 >> v2:172.21.15.151:3300/0 conn(0x7f25b015b1d0 msgr2=0x7f25b00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:30.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b57b2640 1 --2- 172.21.15.113:0/1875439776 >> v2:172.21.15.151:3300/0 conn(0x7f25b015b1d0 0x7f25b00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b57b2640 1 -- 172.21.15.113:0/1875439776 >> v1:172.21.15.151:6789/0 conn(0x7f25b00ceea0 legacy=0x7f25b006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:30.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b57b2640 1 -- 172.21.15.113:0/1875439776 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00b3120 con 0x7f25b00b1ec0 2023-12-19T13:46:30.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.671+0000 7f25b5fb3640 1 --2- 172.21.15.113:0/1875439776 >> v2:172.21.15.151:3300/0 conn(0x7f25b015b1d0 0x7f25b00b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:30.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.672+0000 7f25b57b2640 1 --2- 172.21.15.113:0/1875439776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00b1ec0 0x7f25b015f6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25b00ae020 tx=0x7f25a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e3e59f2a641455 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:30.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.672+0000 7f25b4fb1640 1 -- 172.21.15.113:0/1875439776 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0031870 con 0x7f25b00b1ec0 2023-12-19T13:46:30.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.672+0000 7f25b4fb1640 1 -- 172.21.15.113:0/1875439776 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a00319d0 con 0x7f25b00b1ec0 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b4fb1640 1 -- 172.21.15.113:0/1875439776 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0031d60 con 0x7f25b00b1ec0 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 -- 172.21.15.113:0/1875439776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00b1ec0 msgr2=0x7f25b015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 --2- 172.21.15.113:0/1875439776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00b1ec0 0x7f25b015f6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25b00ae020 tx=0x7f25a002b910 comp rx=0 tx=0).stop 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 -- 172.21.15.113:0/1875439776 shutdown_connections 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 --2- 172.21.15.113:0/1875439776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00b1ec0 0x7f25b015f6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 --2- 172.21.15.113:0/1875439776 >> v2:172.21.15.151:3300/0 conn(0x7f25b015b1d0 0x7f25b00b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 -- 172.21.15.113:0/1875439776 >> 172.21.15.113:0/1875439776 conn(0x7f25b0073150 msgr2=0x7f25b00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 -- 172.21.15.113:0/1875439776 shutdown_connections 2023-12-19T13:46:30.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.673+0000 7f25b8217640 1 -- 172.21.15.113:0/1875439776 wait complete. 2023-12-19T13:46:30.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.675+0000 7f25b8217640 1 Processor -- start 2023-12-19T13:46:30.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.675+0000 7f25b8217640 1 -- start start 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b8217640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b00b1ec0 0x7f25b0153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b8217640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00ceea0 0x7f25b0155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b8217640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b015b1d0 0x7f25b01517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b8217640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b014e100 con 0x7f25b00ceea0 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b8217640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b0155780 con 0x7f25b015b1d0 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b8217640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b01565c0 con 0x7f25b00b1ec0 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b57b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00ceea0 0x7f25b0155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.676+0000 7f25b57b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00ceea0 0x7f25b0155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35516/0 (socket says 172.21.15.113:35516) 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b57b2640 1 -- 172.21.15.113:0/4011029395 learned_addr learned my addr 172.21.15.113:0/4011029395 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:30.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b5fb3640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b00b1ec0 0x7f25b0153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b57b2640 1 -- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b00b1ec0 msgr2=0x7f25b0153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b57b2640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b00b1ec0 0x7f25b0153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b57b2640 1 -- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b015b1d0 msgr2=0x7f25b01517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b67b4640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b015b1d0 0x7f25b01517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b57b2640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b015b1d0 0x7f25b01517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b57b2640 1 -- 172.21.15.113:0/4011029395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00094d0 con 0x7f25b00ceea0 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b5fb3640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b00b1ec0 0x7f25b0153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:30.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.677+0000 7f25b57b2640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00ceea0 0x7f25b0155240 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25a002b950 tx=0x7f25a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:30.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.678+0000 7f25a67fc640 1 -- 172.21.15.113:0/4011029395 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0031840 con 0x7f25b00ceea0 2023-12-19T13:46:30.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.678+0000 7f25a67fc640 1 -- 172.21.15.113:0/4011029395 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a00443f0 con 0x7f25b00ceea0 2023-12-19T13:46:30.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.678+0000 7f25a67fc640 1 -- 172.21.15.113:0/4011029395 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00447a0 con 0x7f25b00ceea0 2023-12-19T13:46:30.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.678+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b01559b0 con 0x7f25b00ceea0 2023-12-19T13:46:30.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.678+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b0155f70 con 0x7f25b00ceea0 2023-12-19T13:46:30.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.679+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b00cb7b0 con 0x7f25b00ceea0 2023-12-19T13:46:30.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.680+0000 7f25a67fc640 1 -- 172.21.15.113:0/4011029395 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25a0044900 con 0x7f25b00ceea0 2023-12-19T13:46:30.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.681+0000 7f25a67fc640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f259406a430 0x7f259406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:30.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.681+0000 7f25a67fc640 1 -- 172.21.15.113:0/4011029395 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f25a002d040 con 0x7f25b00ceea0 2023-12-19T13:46:30.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.681+0000 7f25b5fb3640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f259406a430 0x7f259406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:30.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.682+0000 7f25b5fb3640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f259406a430 0x7f259406c8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25ac006fd0 tx=0x7f25ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:30.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.686+0000 7f25a67fc640 1 -- 172.21.15.113:0/4011029395 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25a0076880 con 0x7f25b00ceea0 2023-12-19T13:46:30.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.916+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f25b0061910 con 0x7f25b00ceea0 2023-12-19T13:46:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.931+0000 7f25a67fc640 1 -- 172.21.15.113:0/4011029395 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f25a00350c0 con 0x7f25b00ceea0 2023-12-19T13:46:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T13:46:30.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.938+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f259406a430 msgr2=0x7f259406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.938+0000 7f25b8217640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f259406a430 0x7f259406c8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25ac006fd0 tx=0x7f25ac008040 comp rx=0 tx=0).stop 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.938+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00ceea0 msgr2=0x7f25b0155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.938+0000 7f25b8217640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00ceea0 0x7f25b0155240 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25a002b950 tx=0x7f25a00046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.939+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 shutdown_connections 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.939+0000 7f25b8217640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f259406a430 0x7f259406c8f0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25ac006fd0 tx=0x7f25ac008040 comp rx=0 tx=0).stop 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.939+0000 7f25b8217640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b015b1d0 0x7f25b01517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.939+0000 7f25b8217640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25b00ceea0 0x7f25b0155240 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.939+0000 7f25b8217640 1 --2- 172.21.15.113:0/4011029395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b00b1ec0 0x7f25b0153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:30.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.939+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 >> 172.21.15.113:0/4011029395 conn(0x7f25b0073150 msgr2=0x7f25b00b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:30.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.943+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 shutdown_connections 2023-12-19T13:46:30.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:30.944+0000 7f25b8217640 1 -- 172.21.15.113:0/4011029395 wait complete. 2023-12-19T13:46:30.968 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.146+0000 7f0cceb27640 1 Processor -- start 2023-12-19T13:46:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.147+0000 7f0cceb27640 1 -- start start 2023-12-19T13:46:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.148+0000 7f0cceb27640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 0x7f0cc806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.148+0000 7f0cceb27640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0cc815e040 0x7f0cc815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.148+0000 7f0cceb27640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc815e9c0 con 0x7f0cc8157aa0 2023-12-19T13:46:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.148+0000 7f0cceb27640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2600 con 0x7f0cc815e040 2023-12-19T13:46:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.148+0000 7f0cceb27640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80b1d60 con 0x7f0cc80b1710 2023-12-19T13:46:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0ccc8c3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0cc8157aa0 0x7f0cc8161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37452/0 (socket says 172.21.15.113:37452) 2023-12-19T13:46:31.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0ccc8c3640 1 -- 172.21.15.113:0/4142469289 learned_addr learned my addr 172.21.15.113:0/4142469289 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:31.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 0x7f0cc806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0ccd0c4640 1 --2- 172.21.15.113:0/4142469289 >> v2:172.21.15.151:3300/0 conn(0x7f0cc815e040 0x7f0cc815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315946038 0 0) 0x7f0cc815e9c0 con 0x7f0cc8157aa0 2023-12-19T13:46:31.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb8003520 con 0x7f0cc8157aa0 2023-12-19T13:46:31.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741658211 0 0) 0x7f0cb8003520 con 0x7f0cc8157aa0 2023-12-19T13:46:31.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 msgr2=0x7f0cc806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 0x7f0cc806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 >> v2:172.21.15.151:3300/0 conn(0x7f0cc815e040 msgr2=0x7f0cc815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 --2- 172.21.15.113:0/4142469289 >> v2:172.21.15.151:3300/0 conn(0x7f0cc815e040 0x7f0cc815e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80b2040 con 0x7f0cc8157aa0 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0cbc001670 con 0x7f0cc8157aa0 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 0x7f0cc806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.149+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 >> v1:172.21.15.113:6789/0 conn(0x7f0cc8157aa0 legacy=0x7f0cc8161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc77fe640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 0x7f0cb80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc77fe640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb8003fd0 0x7f0cb80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc77fe640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8004d00 0x7f0cb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2600 con 0x7f0cb8003fd0 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80b1d60 con 0x7f0cb8004d00 2023-12-19T13:46:31.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb800bab0 con 0x7f0cc80b1710 2023-12-19T13:46:31.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0ccd0c4640 1 --2- 172.21.15.113:0/4142469289 >> v2:172.21.15.151:3300/0 conn(0x7f0cc815e040 0x7f0cc815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:31.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb8003fd0 0x7f0cb80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0ccc8c3640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 0x7f0cb80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc7fff640 1 -- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 msgr2=0x7f0cb80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:31.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc80b1710 0x7f0cb80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc7fff640 1 -- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8004d00 msgr2=0x7f0cb8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:31.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8004d00 0x7f0cb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.150+0000 7f0cc7fff640 1 -- 172.21.15.113:0/4142469289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8003520 con 0x7f0cb8003fd0 2023-12-19T13:46:31.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.151+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb8003fd0 0x7f0cb80047c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098a0 tx=0x7f0cb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4610819ab3ac49 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:31.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4004230 con 0x7f0cb8003fd0 2023-12-19T13:46:31.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb4004390 con 0x7f0cb8003fd0 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cc77fe640 1 -- 172.21.15.113:0/4142469289 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4003830 con 0x7f0cb8003fd0 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cceb27640 1 -- 172.21.15.113:0/4142469289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb8003fd0 msgr2=0x7f0cb80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cceb27640 1 --2- 172.21.15.113:0/4142469289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb8003fd0 0x7f0cb80047c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098a0 tx=0x7f0cb80057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0ccd0c4640 1 -- 172.21.15.113:0/4142469289 reap_dead start 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cceb27640 1 -- 172.21.15.113:0/4142469289 shutdown_connections 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cceb27640 1 -- 172.21.15.113:0/4142469289 >> 172.21.15.113:0/4142469289 conn(0x7f0cc80cbb70 msgr2=0x7f0cc80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cceb27640 1 -- 172.21.15.113:0/4142469289 shutdown_connections 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.152+0000 7f0cceb27640 1 -- 172.21.15.113:0/4142469289 wait complete. 2023-12-19T13:46:31.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.154+0000 7f0cceb27640 1 Processor -- start 2023-12-19T13:46:31.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.154+0000 7f0cceb27640 1 -- start start 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.155+0000 7f0cceb27640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8003fd0 0x7f0cc8143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.155+0000 7f0cceb27640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cc8140650 0x7f0cc8141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.155+0000 7f0cceb27640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc813fd00 0x7f0cc8158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.155+0000 7f0cceb27640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8140e30 con 0x7f0cc8140650 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.155+0000 7f0cceb27640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8141110 con 0x7f0cb8003fd0 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.155+0000 7f0cceb27640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81413f0 con 0x7f0cc813fd00 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cc8140650 0x7f0cc8141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cc8140650 0x7f0cc8141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35522/0 (socket says 172.21.15.113:35522) 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 -- 172.21.15.113:0/3764608931 learned_addr learned my addr 172.21.15.113:0/3764608931 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0ccd0c4640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc813fd00 0x7f0cc8158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 -- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc813fd00 msgr2=0x7f0cc8158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0ccc8c3640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8003fd0 0x7f0cc8143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc813fd00 0x7f0cc8158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 -- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8003fd0 msgr2=0x7f0cc8143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8003fd0 0x7f0cc8143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 -- 172.21.15.113:0/3764608931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc81416d0 con 0x7f0cc8140650 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.156+0000 7f0cc7fff640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cc8140650 0x7f0cc8141ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098a0 tx=0x7f0cb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.157+0000 7f0cc57fa640 1 -- 172.21.15.113:0/3764608931 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4030630 con 0x7f0cc8140650 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.157+0000 7f0cc57fa640 1 -- 172.21.15.113:0/3764608931 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb4030790 con 0x7f0cc8140650 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.157+0000 7f0cc57fa640 1 -- 172.21.15.113:0/3764608931 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4030b00 con 0x7f0cc8140650 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.157+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc81419b0 con 0x7f0cc8140650 2023-12-19T13:46:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.157+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc8140ad0 con 0x7f0cc8140650 2023-12-19T13:46:31.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.158+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc8141b40 con 0x7f0cc8140650 2023-12-19T13:46:31.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.159+0000 7f0cc57fa640 1 -- 172.21.15.113:0/3764608931 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0cb4030c60 con 0x7f0cc8140650 2023-12-19T13:46:31.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.160+0000 7f0cc57fa640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a400 0x7f0cac06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.160+0000 7f0cc57fa640 1 -- 172.21.15.113:0/3764608931 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cb40aa6f0 con 0x7f0cc8140650 2023-12-19T13:46:31.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.160+0000 7f0ccc8c3640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a400 0x7f0cac06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.161+0000 7f0ccc8c3640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a400 0x7f0cac06c8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001eb0 tx=0x7f0cbc001d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.164+0000 7f0cc57fa640 1 -- 172.21.15.113:0/3764608931 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0cb4075cf0 con 0x7f0cc8140650 2023-12-19T13:46:31.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.353+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc8061910 con 0x7f0cc8140650 2023-12-19T13:46:31.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.355+0000 7f0cc57fa640 1 -- 172.21.15.113:0/3764608931 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f0cb400f040 con 0x7f0cc8140650 2023-12-19T13:46:31.356 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:31.357 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":19,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:30.918364+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.357+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a400 msgr2=0x7f0cac06c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.357+0000 7f0cceb27640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a400 0x7f0cac06c8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001eb0 tx=0x7f0cbc001d80 comp rx=0 tx=0).stop 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.357+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cc8140650 msgr2=0x7f0cc8141ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.357+0000 7f0cceb27640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cc8140650 0x7f0cc8141ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098a0 tx=0x7f0cb4004730 comp rx=0 tx=0).stop 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 shutdown_connections 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a400 0x7f0cac06c8c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc813fd00 0x7f0cc8158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cc8140650 0x7f0cc8141ed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 --2- 172.21.15.113:0/3764608931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb8003fd0 0x7f0cc8143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 >> 172.21.15.113:0/3764608931 conn(0x7f0cc80cbb70 msgr2=0x7f0cc806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 shutdown_connections 2023-12-19T13:46:31.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.358+0000 7f0cceb27640 1 -- 172.21.15.113:0/3764608931 wait complete. 2023-12-19T13:46:31.377 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:31.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.583+0000 7f53be00b640 1 Processor -- start 2023-12-19T13:46:31.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.583+0000 7f53be00b640 1 -- start start 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53be00b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f53b80ae110 0x7f53b80b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53be00b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f53b80b0640 0x7f53b806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53be00b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b80b0a60 con 0x7f53b8157bf0 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53be00b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b806b8c0 con 0x7f53b80b0640 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53be00b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b80ae640 con 0x7f53b80ae110 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53b7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f53b80b0640 0x7f53b806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53b7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f53b80b0640 0x7f53b806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35526/0 (socket says 172.21.15.113:35526) 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53b7fff640 1 -- 172.21.15.113:0/3497345718 learned_addr learned my addr 172.21.15.113:0/3497345718 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53affff640 1 --2- 172.21.15.113:0/3497345718 >> v2:172.21.15.151:3300/0 conn(0x7f53b80ae110 0x7f53b80b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53b7fff640 1 -- 172.21.15.113:0/3497345718 >> v2:172.21.15.151:3300/0 conn(0x7f53b80ae110 msgr2=0x7f53b80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53b7fff640 1 --2- 172.21.15.113:0/3497345718 >> v2:172.21.15.151:3300/0 conn(0x7f53b80ae110 0x7f53b80b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53b7fff640 1 -- 172.21.15.113:0/3497345718 >> v1:172.21.15.151:6789/0 conn(0x7f53b8157bf0 legacy=0x7f53b815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.585+0000 7f53b7fff640 1 -- 172.21.15.113:0/3497345718 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80ae920 con 0x7f53b80b0640 2023-12-19T13:46:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.587+0000 7f53b7fff640 1 --2- 172.21.15.113:0/3497345718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80b0640 0x7f53b806d230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53b80af4b0 tx=0x7f53b002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7110f2345ad9204 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.587+0000 7f53b6ffd640 1 -- 172.21.15.113:0/3497345718 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b002ca80 con 0x7f53b80b0640 2023-12-19T13:46:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.587+0000 7f53b6ffd640 1 -- 172.21.15.113:0/3497345718 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b002cbe0 con 0x7f53b80b0640 2023-12-19T13:46:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.587+0000 7f53b6ffd640 1 -- 172.21.15.113:0/3497345718 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b00343f0 con 0x7f53b80b0640 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 -- 172.21.15.113:0/3497345718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80b0640 msgr2=0x7f53b806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 --2- 172.21.15.113:0/3497345718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80b0640 0x7f53b806d230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53b80af4b0 tx=0x7f53b002bee0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 -- 172.21.15.113:0/3497345718 shutdown_connections 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 --2- 172.21.15.113:0/3497345718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80b0640 0x7f53b806d230 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 --2- 172.21.15.113:0/3497345718 >> v2:172.21.15.151:3300/0 conn(0x7f53b80ae110 0x7f53b80b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 -- 172.21.15.113:0/3497345718 >> 172.21.15.113:0/3497345718 conn(0x7f53b80cbb70 msgr2=0x7f53b80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 -- 172.21.15.113:0/3497345718 shutdown_connections 2023-12-19T13:46:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.588+0000 7f53be00b640 1 -- 172.21.15.113:0/3497345718 wait complete. 2023-12-19T13:46:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.590+0000 7f53be00b640 1 Processor -- start 2023-12-19T13:46:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.590+0000 7f53be00b640 1 -- start start 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53be00b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80ae110 0x7f53b8146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53be00b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b0640 0x7f53b81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53be00b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b8157bf0 0x7f53b806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53be00b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8147440 con 0x7f53b80ae110 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53be00b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8158820 con 0x7f53b8157bf0 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53be00b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8147860 con 0x7f53b80b0640 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53b77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80ae110 0x7f53b8146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53b77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80ae110 0x7f53b8146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35528/0 (socket says 172.21.15.113:35528) 2023-12-19T13:46:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.591+0000 7f53b77fe640 1 -- 172.21.15.113:0/2216132783 learned_addr learned my addr 172.21.15.113:0/2216132783 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:31.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b7fff640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b8157bf0 0x7f53b806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b77fe640 1 -- 172.21.15.113:0/2216132783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b0640 msgr2=0x7f53b81582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b77fe640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b0640 0x7f53b81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b77fe640 1 -- 172.21.15.113:0/2216132783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b8157bf0 msgr2=0x7f53b806ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b77fe640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b8157bf0 0x7f53b806ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b77fe640 1 -- 172.21.15.113:0/2216132783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b0009b30 con 0x7f53b80ae110 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b77fe640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80ae110 0x7f53b8146f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53a800b3f0 tx=0x7f53a800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b4ff9640 1 -- 172.21.15.113:0/2216132783 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8011830 con 0x7f53b80ae110 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b4ff9640 1 -- 172.21.15.113:0/2216132783 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8011990 con 0x7f53b80ae110 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53b4ff9640 1 -- 172.21.15.113:0/2216132783 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8011d40 con 0x7f53b80ae110 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b8147b40 con 0x7f53b80ae110 2023-12-19T13:46:31.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.592+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b8148100 con 0x7f53b80ae110 2023-12-19T13:46:31.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.593+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b8061910 con 0x7f53b80ae110 2023-12-19T13:46:31.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.594+0000 7f53b4ff9640 1 -- 172.21.15.113:0/2216132783 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f53a801a400 con 0x7f53b80ae110 2023-12-19T13:46:31.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.595+0000 7f53b4ff9640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f539806a460 0x7f539806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:31.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.595+0000 7f53b4ff9640 1 -- 172.21.15.113:0/2216132783 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53a80886f0 con 0x7f53b80ae110 2023-12-19T13:46:31.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.595+0000 7f53affff640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f539806a460 0x7f539806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:31.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.596+0000 7f53affff640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f539806a460 0x7f539806c920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53b81567b0 tx=0x7f53a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:31.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.600+0000 7f53b4ff9640 1 -- 172.21.15.113:0/2216132783 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f53a8053ce0 con 0x7f53b80ae110 2023-12-19T13:46:31.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.791+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53b8070f40 con 0x7f53b80ae110 2023-12-19T13:46:31.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.793+0000 7f53b4ff9640 1 -- 172.21.15.113:0/2216132783 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f53a8057300 con 0x7f53b80ae110 2023-12-19T13:46:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:31.794 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":19,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:30.918364+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f539806a460 msgr2=0x7f539806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f539806a460 0x7f539806c920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53b81567b0 tx=0x7f53a0008040 comp rx=0 tx=0).stop 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80ae110 msgr2=0x7f53b8146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80ae110 0x7f53b8146f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53a800b3f0 tx=0x7f53a800b8b0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 shutdown_connections 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f539806a460 0x7f539806c920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b8157bf0 0x7f53b806ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b0640 0x7f53b81582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 --2- 172.21.15.113:0/2216132783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80ae110 0x7f53b8146f00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:31.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 >> 172.21.15.113:0/2216132783 conn(0x7f53b80cbb70 msgr2=0x7f53b80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:31.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 shutdown_connections 2023-12-19T13:46:31.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:31.796+0000 7f53be00b640 1 -- 172.21.15.113:0/2216132783 wait complete. 2023-12-19T13:46:31.815 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:46:32.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.032+0000 7fad42617640 1 Processor -- start 2023-12-19T13:46:32.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.033+0000 7fad42617640 1 -- start start 2023-12-19T13:46:32.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad42617640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad3c15b7a0 0x7fad3c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad42617640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fad3c0af7b0 0x7fad3c06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad42617640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c0afe90 con 0x7fad3c06e300 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad42617640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0b2cc0 con 0x7fad3c15b7a0 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad42617640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0b00e0 con 0x7fad3c0af7b0 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad3bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad3c15b7a0 0x7fad3c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad40bb4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fad3c06e300 0x7fad3c15f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37454/0 (socket says 172.21.15.113:37454) 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad3bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad3c15b7a0 0x7fad3c06d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35534/0 (socket says 172.21.15.113:35534) 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.034+0000 7fad40bb4640 1 -- 172.21.15.113:0/778094215 learned_addr learned my addr 172.21.15.113:0/778094215 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.035+0000 7fad3b7fe640 1 --2- 172.21.15.113:0/778094215 >> v2:172.21.15.151:3300/0 conn(0x7fad3c0af7b0 0x7fad3c06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.035+0000 7fad3bfff640 1 -- 172.21.15.113:0/778094215 >> v2:172.21.15.151:3300/0 conn(0x7fad3c0af7b0 msgr2=0x7fad3c06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.035+0000 7fad3bfff640 1 --2- 172.21.15.113:0/778094215 >> v2:172.21.15.151:3300/0 conn(0x7fad3c0af7b0 0x7fad3c06ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.035+0000 7fad3bfff640 1 -- 172.21.15.113:0/778094215 >> v1:172.21.15.113:6789/0 conn(0x7fad3c06e300 legacy=0x7fad3c15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:32.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.035+0000 7fad3bfff640 1 -- 172.21.15.113:0/778094215 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0cf480 con 0x7fad3c15b7a0 2023-12-19T13:46:32.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.035+0000 7fad3affd640 1 -- 172.21.15.113:0/778094215 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765055929 0 0) 0x7fad3c0afe90 con 0x7fad3c06e300 2023-12-19T13:46:32.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.035+0000 7fad3b7fe640 1 --2- 172.21.15.113:0/778094215 >> v2:172.21.15.151:3300/0 conn(0x7fad3c0af7b0 0x7fad3c06ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.036+0000 7fad3bfff640 1 --2- 172.21.15.113:0/778094215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c06d880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad3c15f240 tx=0x7fad2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47156e290392225d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.036+0000 7fad3affd640 1 -- 172.21.15.113:0/778094215 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c031830 con 0x7fad3c15b7a0 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.036+0000 7fad3affd640 1 -- 172.21.15.113:0/778094215 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c031990 con 0x7fad3c15b7a0 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.036+0000 7fad3affd640 1 -- 172.21.15.113:0/778094215 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c031d20 con 0x7fad3c15b7a0 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 -- 172.21.15.113:0/778094215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 msgr2=0x7fad3c06d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 --2- 172.21.15.113:0/778094215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c06d880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad3c15f240 tx=0x7fad2c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 -- 172.21.15.113:0/778094215 shutdown_connections 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 --2- 172.21.15.113:0/778094215 >> v2:172.21.15.151:3300/0 conn(0x7fad3c0af7b0 0x7fad3c06ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 --2- 172.21.15.113:0/778094215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c06d880 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 -- 172.21.15.113:0/778094215 >> 172.21.15.113:0/778094215 conn(0x7fad3c0659d0 msgr2=0x7fad3c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:32.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 -- 172.21.15.113:0/778094215 shutdown_connections 2023-12-19T13:46:32.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.037+0000 7fad42617640 1 -- 172.21.15.113:0/778094215 wait complete. 2023-12-19T13:46:32.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.039+0000 7fad42617640 1 Processor -- start 2023-12-19T13:46:32.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.039+0000 7fad42617640 1 -- start start 2023-12-19T13:46:32.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad42617640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3c06e300 0x7fad3c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:32.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad42617640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3c0af7b0 0x7fad3c0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:32.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad42617640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad42617640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0b51a0 con 0x7fad3c15b7a0 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad42617640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0d0b30 con 0x7fad3c0af7b0 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad42617640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0cbe10 con 0x7fad3c06e300 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad40bb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad40bb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c0cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35538/0 (socket says 172.21.15.113:35538) 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.040+0000 7fad40bb4640 1 -- 172.21.15.113:0/1003118034 learned_addr learned my addr 172.21.15.113:0/1003118034 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad3b7fe640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3c0af7b0 0x7fad3c0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad3bfff640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3c06e300 0x7fad3c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad40bb4640 1 -- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3c06e300 msgr2=0x7fad3c1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad40bb4640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3c06e300 0x7fad3c1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad40bb4640 1 -- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3c0af7b0 msgr2=0x7fad3c0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad40bb4640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3c0af7b0 0x7fad3c0d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad40bb4640 1 -- 172.21.15.113:0/1003118034 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c009400 con 0x7fad3c15b7a0 2023-12-19T13:46:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad3bfff640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3c06e300 0x7fad3c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad40bb4640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c0cb8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c450 tx=0x7fad3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.041+0000 7fad38ff9640 1 -- 172.21.15.113:0/1003118034 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad340074e0 con 0x7fad3c15b7a0 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.042+0000 7fad38ff9640 1 -- 172.21.15.113:0/1003118034 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad34007660 con 0x7fad3c15b7a0 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.042+0000 7fad38ff9640 1 -- 172.21.15.113:0/1003118034 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34004a20 con 0x7fad3c15b7a0 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.042+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c0b5440 con 0x7fad3c15b7a0 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.042+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c0b5a00 con 0x7fad3c15b7a0 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.043+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3c061910 con 0x7fad3c15b7a0 2023-12-19T13:46:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.044+0000 7fad38ff9640 1 -- 172.21.15.113:0/1003118034 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad34004b80 con 0x7fad3c15b7a0 2023-12-19T13:46:32.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.045+0000 7fad38ff9640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad1c06a430 0x7fad1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:32.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.045+0000 7fad38ff9640 1 -- 172.21.15.113:0/1003118034 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad34087a40 con 0x7fad3c15b7a0 2023-12-19T13:46:32.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.045+0000 7fad3bfff640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad1c06a430 0x7fad1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:32.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.046+0000 7fad3bfff640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad1c06a430 0x7fad1c06c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad2c036000 tx=0x7fad2c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:32.046 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-12-19T13:46:32.046+0000 7f0e0e2ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:46:32.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.049+0000 7fad38ff9640 1 -- 172.21.15.113:0/1003118034 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad34089e60 con 0x7fad3c15b7a0 2023-12-19T13:46:32.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.259+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fad3c070680 con 0x7fad3c15b7a0 2023-12-19T13:46:32.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.959+0000 7fad38ff9640 1 -- 172.21.15.113:0/1003118034 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fad34018020 con 0x7fad3c15b7a0 2023-12-19T13:46:32.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad1c06a430 msgr2=0x7fad1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:32.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad1c06a430 0x7fad1c06c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad2c036000 tx=0x7fad2c008030 comp rx=0 tx=0).stop 2023-12-19T13:46:32.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 msgr2=0x7fad3c0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:32.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c0cb8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c450 tx=0x7fad3400c910 comp rx=0 tx=0).stop 2023-12-19T13:46:32.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 shutdown_connections 2023-12-19T13:46:32.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad1c06a430 0x7fad1c06c8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad3c15b7a0 0x7fad3c0cb8d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3c0af7b0 0x7fad3c0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 --2- 172.21.15.113:0/1003118034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3c06e300 0x7fad3c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:32.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.963+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 >> 172.21.15.113:0/1003118034 conn(0x7fad3c0659d0 msgr2=0x7fad3c0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:32.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.964+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 shutdown_connections 2023-12-19T13:46:32.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:32.964+0000 7fad42617640 1 -- 172.21.15.113:0/1003118034 wait complete. 2023-12-19T13:46:32.983 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2023-12-19T13:46:32.983 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:46:33.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.192+0000 7f839b40e640 1 Processor -- start 2023-12-19T13:46:33.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.192+0000 7f839b40e640 1 -- start start 2023-12-19T13:46:33.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.193+0000 7f839b40e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:33.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.193+0000 7f839b40e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f83940addf0 0x7f83940cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:33.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.193+0000 7f839b40e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839415f910 con 0x7f83940cc360 2023-12-19T13:46:33.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.193+0000 7f839b40e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940cc790 con 0x7f83940addf0 2023-12-19T13:46:33.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.193+0000 7f839b40e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839415fda0 con 0x7f839415b130 2023-12-19T13:46:33.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f8399c0b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f83940addf0 0x7f83940cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f8399c0b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f83940addf0 0x7f83940cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35544/0 (socket says 172.21.15.113:35544) 2023-12-19T13:46:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f8399c0b640 1 -- 172.21.15.113:0/601842680 learned_addr learned my addr 172.21.15.113:0/601842680 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f839a40c640 1 --2- 172.21.15.113:0/601842680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f8399c0b640 1 -- 172.21.15.113:0/601842680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 msgr2=0x7f839406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f8399c0b640 1 --2- 172.21.15.113:0/601842680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f8399c0b640 1 -- 172.21.15.113:0/601842680 >> v1:172.21.15.151:6789/0 conn(0x7f83940cc360 legacy=0x7f83940b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.194+0000 7f8399c0b640 1 -- 172.21.15.113:0/601842680 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839415efe0 con 0x7f83940addf0 2023-12-19T13:46:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.195+0000 7f8399c0b640 1 --2- 172.21.15.113:0/601842680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940addf0 0x7f83940cbe20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8384009870 tx=0x7f838402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef32c99e21f1a82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839940a640 1 -- 172.21.15.113:0/601842680 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838402f830 con 0x7f83940addf0 2023-12-19T13:46:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839940a640 1 -- 172.21.15.113:0/601842680 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838402f990 con 0x7f83940addf0 2023-12-19T13:46:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839940a640 1 -- 172.21.15.113:0/601842680 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838402fd20 con 0x7f83940addf0 2023-12-19T13:46:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 -- 172.21.15.113:0/601842680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940addf0 msgr2=0x7f83940cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 --2- 172.21.15.113:0/601842680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940addf0 0x7f83940cbe20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8384009870 tx=0x7f838402ba10 comp rx=0 tx=0).stop 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 -- 172.21.15.113:0/601842680 shutdown_connections 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 --2- 172.21.15.113:0/601842680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940addf0 0x7f83940cbe20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 --2- 172.21.15.113:0/601842680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 -- 172.21.15.113:0/601842680 >> 172.21.15.113:0/601842680 conn(0x7f83940659a0 msgr2=0x7f8394065d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 -- 172.21.15.113:0/601842680 shutdown_connections 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.196+0000 7f839b40e640 1 -- 172.21.15.113:0/601842680 wait complete. 2023-12-19T13:46:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.198+0000 7f839b40e640 1 Processor -- start 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.198+0000 7f839b40e640 1 -- start start 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.199+0000 7f839b40e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83940addf0 0x7f83940cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.199+0000 7f839b40e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940cc360 0x7f839415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.199+0000 7f839b40e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.199+0000 7f839b40e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c5550 con 0x7f83940cc360 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.199+0000 7f839b40e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839415ba50 con 0x7f83940addf0 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.199+0000 7f839b40e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839414d040 con 0x7f839415b130 2023-12-19T13:46:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940cc360 0x7f839415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940cc360 0x7f839415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35546/0 (socket says 172.21.15.113:35546) 2023-12-19T13:46:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 -- 172.21.15.113:0/1237098885 learned_addr learned my addr 172.21.15.113:0/1237098885 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f839ac0d640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f839a40c640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83940addf0 0x7f83940cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 -- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 msgr2=0x7f839414cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839414cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 -- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83940addf0 msgr2=0x7f83940cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83940addf0 0x7f83940cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 -- 172.21.15.113:0/1237098885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83840094d0 con 0x7f83940cc360 2023-12-19T13:46:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.200+0000 7f8399c0b640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940cc360 0x7f839415b510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8384000c00 tx=0x7f8384004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.201+0000 7f838affd640 1 -- 172.21.15.113:0/1237098885 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384037c40 con 0x7f83940cc360 2023-12-19T13:46:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.201+0000 7f838affd640 1 -- 172.21.15.113:0/1237098885 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8384037da0 con 0x7f83940cc360 2023-12-19T13:46:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.201+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83940c57a0 con 0x7f83940cc360 2023-12-19T13:46:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.201+0000 7f838affd640 1 -- 172.21.15.113:0/1237098885 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384041640 con 0x7f83940cc360 2023-12-19T13:46:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.201+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8394154cb0 con 0x7f83940cc360 2023-12-19T13:46:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.202+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83940cb100 con 0x7f83940cc360 2023-12-19T13:46:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.203+0000 7f838affd640 1 -- 172.21.15.113:0/1237098885 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f83840417a0 con 0x7f83940cc360 2023-12-19T13:46:33.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.204+0000 7f838affd640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f837806a430 0x7f837806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:33.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.204+0000 7f838affd640 1 -- 172.21.15.113:0/1237098885 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f838403c070 con 0x7f83940cc360 2023-12-19T13:46:33.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.205+0000 7f839a40c640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f837806a430 0x7f837806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:33.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.205+0000 7f839a40c640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f837806a430 0x7f837806c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8390006fd0 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:33.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.209+0000 7f838affd640 1 -- 172.21.15.113:0/1237098885 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f83940cb100 con 0x7f83940cc360 2023-12-19T13:46:33.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:33.436+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f83940cb7c0 con 0x7f83940cc360 2023-12-19T13:46:34.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.417+0000 7f838affd640 1 -- 172.21.15.113:0/1237098885 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f83940cb7c0 con 0x7f83940cc360 2023-12-19T13:46:34.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f837806a430 msgr2=0x7f837806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f837806a430 0x7f837806c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8390006fd0 tx=0x7f8390008040 comp rx=0 tx=0).stop 2023-12-19T13:46:34.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940cc360 msgr2=0x7f839415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940cc360 0x7f839415b510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8384000c00 tx=0x7f8384004730 comp rx=0 tx=0).stop 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 shutdown_connections 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f837806a430 0x7f837806c8f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f839415b130 0x7f839414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83940cc360 0x7f839415b510 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 --2- 172.21.15.113:0/1237098885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83940addf0 0x7f83940cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.420+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 >> 172.21.15.113:0/1237098885 conn(0x7f83940659a0 msgr2=0x7f83940b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.421+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 shutdown_connections 2023-12-19T13:46:34.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.421+0000 7f839b40e640 1 -- 172.21.15.113:0/1237098885 wait complete. 2023-12-19T13:46:34.445 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:46:34.445 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:46:34.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.655+0000 7f7cc7e31640 1 Processor -- start 2023-12-19T13:46:34.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.655+0000 7f7cc7e31640 1 -- start start 2023-12-19T13:46:34.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.657+0000 7f7cc7e31640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7cc01449e0 0x7f7cc00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:34.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.657+0000 7f7cc7e31640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc00afb10 con 0x7f7cc006c6b0 2023-12-19T13:46:34.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.657+0000 7f7cc7e31640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc006bb30 con 0x7f7cc00b0b50 2023-12-19T13:46:34.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.657+0000 7f7cc7e31640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00b0070 con 0x7f7cc01449e0 2023-12-19T13:46:34.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.657+0000 7f7cc5bcd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7cc01449e0 0x7f7cc00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:34.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.657+0000 7f7cc63ce640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7cc006c6b0 0x7f7cc00b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37456/0 (socket says 172.21.15.113:37456) 2023-12-19T13:46:34.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.657+0000 7f7cc63ce640 1 -- 172.21.15.113:0/2378433145 learned_addr learned my addr 172.21.15.113:0/2378433145 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:34.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.658+0000 7f7cc5bcd640 1 -- 172.21.15.113:0/2378433145 >> v1:172.21.15.151:6789/0 conn(0x7f7cc00b0b50 legacy=0x7f7cc006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:34.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.658+0000 7f7cc5bcd640 1 -- 172.21.15.113:0/2378433145 >> v1:172.21.15.113:6789/0 conn(0x7f7cc006c6b0 legacy=0x7f7cc00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.658+0000 7f7cc5bcd640 1 -- 172.21.15.113:0/2378433145 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00b0350 con 0x7f7cc01449e0 2023-12-19T13:46:34.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.658+0000 7f7cc4bcb640 1 -- 172.21.15.113:0/2378433145 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552518122 0 0) 0x7f7cc00afb10 con 0x7f7cc006c6b0 2023-12-19T13:46:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.659+0000 7f7cc5bcd640 1 --2- 172.21.15.113:0/2378433145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc01449e0 0x7f7cc00af5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097a0 tx=0x7f7cbc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85181c294f6372ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.659+0000 7f7cc4bcb640 1 -- 172.21.15.113:0/2378433145 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc031830 con 0x7f7cc01449e0 2023-12-19T13:46:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.659+0000 7f7cc4bcb640 1 -- 172.21.15.113:0/2378433145 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc031990 con 0x7f7cc01449e0 2023-12-19T13:46:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.659+0000 7f7cc4bcb640 1 -- 172.21.15.113:0/2378433145 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc031d20 con 0x7f7cc01449e0 2023-12-19T13:46:34.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.660+0000 7f7cc7e31640 1 -- 172.21.15.113:0/2378433145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc01449e0 msgr2=0x7f7cc00af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.660+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/2378433145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc01449e0 0x7f7cc00af5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097a0 tx=0x7f7cbc02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.660+0000 7f7cc7e31640 1 -- 172.21.15.113:0/2378433145 shutdown_connections 2023-12-19T13:46:34.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.660+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/2378433145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc01449e0 0x7f7cc00af5d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.660+0000 7f7cc7e31640 1 -- 172.21.15.113:0/2378433145 >> 172.21.15.113:0/2378433145 conn(0x7f7cc00cbb70 msgr2=0x7f7cc00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:34.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.660+0000 7f7cc7e31640 1 -- 172.21.15.113:0/2378433145 shutdown_connections 2023-12-19T13:46:34.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.660+0000 7f7cc7e31640 1 -- 172.21.15.113:0/2378433145 wait complete. 2023-12-19T13:46:34.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.662+0000 7f7cc7e31640 1 Processor -- start 2023-12-19T13:46:34.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.662+0000 7f7cc7e31640 1 -- start start 2023-12-19T13:46:34.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc7e31640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc006c6b0 0x7f7cc013c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:34.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc7e31640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc00b0b50 0x7f7cc014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc7e31640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cc01449e0 0x7f7cc014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc7e31640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc014b290 con 0x7f7cc006c6b0 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc7e31640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc014b570 con 0x7f7cc00b0b50 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc7e31640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc014b850 con 0x7f7cc01449e0 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc5bcd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc006c6b0 0x7f7cc013c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc5bcd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc006c6b0 0x7f7cc013c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35558/0 (socket says 172.21.15.113:35558) 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc5bcd640 1 -- 172.21.15.113:0/3376802037 learned_addr learned my addr 172.21.15.113:0/3376802037 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc63ce640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cc01449e0 0x7f7cc014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc5bcd640 1 -- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cc01449e0 msgr2=0x7f7cc014c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc5bcd640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cc01449e0 0x7f7cc014c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc53cc640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc00b0b50 0x7f7cc014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.663+0000 7f7cc5bcd640 1 -- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc00b0b50 msgr2=0x7f7cc014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cc5bcd640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc00b0b50 0x7f7cc014a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cc5bcd640 1 -- 172.21.15.113:0/3376802037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc009400 con 0x7f7cc006c6b0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cc5bcd640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc006c6b0 0x7f7cc013c980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097a0 tx=0x7f7cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cb67fc640 1 -- 172.21.15.113:0/3376802037 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc03aa60 con 0x7f7cc006c6b0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cb67fc640 1 -- 172.21.15.113:0/3376802037 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc03abc0 con 0x7f7cc006c6b0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc014bb30 con 0x7f7cc006c6b0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cb67fc640 1 -- 172.21.15.113:0/3376802037 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0443f0 con 0x7f7cc006c6b0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.664+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc013cec0 con 0x7f7cc006c6b0 2023-12-19T13:46:34.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.665+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc014c050 con 0x7f7cc006c6b0 2023-12-19T13:46:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.666+0000 7f7cb67fc640 1 -- 172.21.15.113:0/3376802037 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7cbc04d450 con 0x7f7cc006c6b0 2023-12-19T13:46:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.667+0000 7f7cb67fc640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ca406a430 0x7f7ca406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.667+0000 7f7cb67fc640 1 -- 172.21.15.113:0/3376802037 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cbc0aabe0 con 0x7f7cc006c6b0 2023-12-19T13:46:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.668+0000 7f7cc53cc640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ca406a430 0x7f7ca406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.668+0000 7f7cc53cc640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ca406a430 0x7f7ca406c8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cc01f3c60 tx=0x7f7cb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.672+0000 7f7cb67fc640 1 -- 172.21.15.113:0/3376802037 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7cc014c050 con 0x7f7cc006c6b0 2023-12-19T13:46:34.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.899+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cc014c050 con 0x7f7cc006c6b0 2023-12-19T13:46:34.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.901+0000 7f7cb67fc640 1 -- 172.21.15.113:0/3376802037 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f7cc014c050 con 0x7f7cc006c6b0 2023-12-19T13:46:34.902 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:34.902 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:46:34.902 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.903+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ca406a430 msgr2=0x7f7ca406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.903+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ca406a430 0x7f7ca406c8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cc01f3c60 tx=0x7f7cb0009040 comp rx=0 tx=0).stop 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.903+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc006c6b0 msgr2=0x7f7cc013c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.903+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc006c6b0 0x7f7cc013c980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097a0 tx=0x7f7cbc0046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 shutdown_connections 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ca406a430 0x7f7ca406c8f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cc01449e0 0x7f7cc014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc00b0b50 0x7f7cc014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 --2- 172.21.15.113:0/3376802037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cc006c6b0 0x7f7cc013c980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 >> 172.21.15.113:0/3376802037 conn(0x7f7cc00cbb70 msgr2=0x7f7cc00cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 shutdown_connections 2023-12-19T13:46:34.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:34.904+0000 7f7cc7e31640 1 -- 172.21.15.113:0/3376802037 wait complete. 2023-12-19T13:46:34.922 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:35.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.119+0000 7fc4990a1640 1 Processor -- start 2023-12-19T13:46:35.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.119+0000 7fc4990a1640 1 -- start start 2023-12-19T13:46:35.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.120+0000 7fc4990a1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 0x7fc49415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc4990a1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49415b740 con 0x7fc4940ae110 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc4990a1640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4940ae640 con 0x7fc4940b0810 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc4990a1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49406b8c0 con 0x7fc494157bf0 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc48bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc4940ae110 0x7fc4940b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37462/0 (socket says 172.21.15.113:37462) 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc48bfff640 1 -- 172.21.15.113:0/4259527825 learned_addr learned my addr 172.21.15.113:0/4259527825 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc492d9d640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 0x7fc49415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012557308 0 0) 0x7fc49415b740 con 0x7fc4940ae110 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.121+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc480003520 con 0x7fc4940ae110 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 630669635 0 0) 0x7fc480003520 con 0x7fc4940ae110 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 msgr2=0x7fc49415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 0x7fc49415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 >> v1:172.21.15.151:6789/0 conn(0x7fc4940b0810 legacy=0x7fc49406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940ae920 con 0x7fc4940ae110 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc47c001670 con 0x7fc4940ae110 2023-12-19T13:46:35.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 >> v1:172.21.15.113:6789/0 conn(0x7fc4940ae110 legacy=0x7fc4940b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480003a10 0x7fc480003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 0x7fc4800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004d00 0x7fc480005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49406b8c0 con 0x7fc480004d00 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48000bb10 con 0x7fc480003a10 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48000deb0 con 0x7fc494157bf0 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49359e640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004d00 0x7fc480005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc492d9d640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480003a10 0x7fc480003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc48bfff640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 0x7fc4800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49359e640 1 -- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 msgr2=0x7fc4800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:35.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49359e640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc494157bf0 0x7fc4800047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49359e640 1 -- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480003a10 msgr2=0x7fc480003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:35.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.122+0000 7fc49359e640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480003a10 0x7fc480003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.123+0000 7fc49359e640 1 -- 172.21.15.113:0/4259527825 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480003520 con 0x7fc480004d00 2023-12-19T13:46:35.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc49359e640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004d00 0x7fc480005180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc48c001e20 tx=0x7fc4800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879c6ad1bde26bb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:35.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c003b70 con 0x7fc480004d00 2023-12-19T13:46:35.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c003cd0 con 0x7fc480004d00 2023-12-19T13:46:35.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc49259c640 1 -- 172.21.15.113:0/4259527825 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c005310 con 0x7fc480004d00 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc4990a1640 1 -- 172.21.15.113:0/4259527825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004d00 msgr2=0x7fc480005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc4990a1640 1 --2- 172.21.15.113:0/4259527825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004d00 0x7fc480005180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc48c001e20 tx=0x7fc4800057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc49359e640 1 -- 172.21.15.113:0/4259527825 reap_dead start 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc4990a1640 1 -- 172.21.15.113:0/4259527825 shutdown_connections 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc4990a1640 1 -- 172.21.15.113:0/4259527825 >> 172.21.15.113:0/4259527825 conn(0x7fc4940cbb70 msgr2=0x7fc4940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc4990a1640 1 -- 172.21.15.113:0/4259527825 shutdown_connections 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.124+0000 7fc4990a1640 1 -- 172.21.15.113:0/4259527825 wait complete. 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.126+0000 7fc4990a1640 1 Processor -- start 2023-12-19T13:46:35.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.126+0000 7fc4990a1640 1 -- start start 2023-12-19T13:46:35.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc4990a1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480004d00 0x7fc494153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc4990a1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4941f6bf0 0x7fc49415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc4990a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49415e240 0x7fc494159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc4990a1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941541b0 con 0x7fc49415e240 2023-12-19T13:46:35.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc4990a1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49415e6c0 con 0x7fc480004d00 2023-12-19T13:46:35.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc4990a1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49415bfe0 con 0x7fc4941f6bf0 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc49359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49415e240 0x7fc494159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc49359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49415e240 0x7fc494159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35584/0 (socket says 172.21.15.113:35584) 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.127+0000 7fc49359e640 1 -- 172.21.15.113:0/30080302 learned_addr learned my addr 172.21.15.113:0/30080302 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc492d9d640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480004d00 0x7fc494153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc48bfff640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4941f6bf0 0x7fc49415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc49359e640 1 -- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4941f6bf0 msgr2=0x7fc49415dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc49359e640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4941f6bf0 0x7fc49415dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc49359e640 1 -- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480004d00 msgr2=0x7fc494153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc49359e640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480004d00 0x7fc494153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc49359e640 1 -- 172.21.15.113:0/30080302 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940cb080 con 0x7fc49415e240 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc492d9d640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480004d00 0x7fc494153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc49359e640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49415e240 0x7fc494159380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc48c005040 tx=0x7fc48c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc48b7fe640 1 -- 172.21.15.113:0/30080302 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c03e070 con 0x7fc49415e240 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc48b7fe640 1 -- 172.21.15.113:0/30080302 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c003e40 con 0x7fc49415e240 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc48b7fe640 1 -- 172.21.15.113:0/30080302 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c006d50 con 0x7fc49415e240 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.128+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49415b990 con 0x7fc49415e240 2023-12-19T13:46:35.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.129+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4941f7070 con 0x7fc49415e240 2023-12-19T13:46:35.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.130+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc494061910 con 0x7fc49415e240 2023-12-19T13:46:35.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.131+0000 7fc48b7fe640 1 -- 172.21.15.113:0/30080302 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc48c041070 con 0x7fc49415e240 2023-12-19T13:46:35.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.131+0000 7fc48b7fe640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc47406a460 0x7fc47406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.131+0000 7fc48b7fe640 1 -- 172.21.15.113:0/30080302 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc48c0a95c0 con 0x7fc49415e240 2023-12-19T13:46:35.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.132+0000 7fc492d9d640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc47406a460 0x7fc47406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.132+0000 7fc492d9d640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc47406a460 0x7fc47406c920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc49415d7e0 tx=0x7fc484008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:35.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.136+0000 7fc48b7fe640 1 -- 172.21.15.113:0/30080302 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc48c074d20 con 0x7fc49415e240 2023-12-19T13:46:35.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.327+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc49415c120 con 0x7fc49415e240 2023-12-19T13:46:35.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.328+0000 7fc48b7fe640 1 -- 172.21.15.113:0/30080302 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fc48c078340 con 0x7fc49415e240 2023-12-19T13:46:35.329 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:35.329 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:35.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.331+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc47406a460 msgr2=0x7fc47406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.331+0000 7fc4990a1640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc47406a460 0x7fc47406c920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc49415d7e0 tx=0x7fc484008040 comp rx=0 tx=0).stop 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.331+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49415e240 msgr2=0x7fc494159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.331+0000 7fc4990a1640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49415e240 0x7fc494159380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc48c005040 tx=0x7fc48c0014a0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.331+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 shutdown_connections 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.331+0000 7fc4990a1640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc47406a460 0x7fc47406c920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.331+0000 7fc4990a1640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49415e240 0x7fc494159380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.332+0000 7fc4990a1640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4941f6bf0 0x7fc49415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.332+0000 7fc4990a1640 1 --2- 172.21.15.113:0/30080302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc480004d00 0x7fc494153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.332+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 >> 172.21.15.113:0/30080302 conn(0x7fc4940cbb70 msgr2=0x7fc4940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.332+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 shutdown_connections 2023-12-19T13:46:35.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.332+0000 7fc4990a1640 1 -- 172.21.15.113:0/30080302 wait complete. 2023-12-19T13:46:35.350 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:46:35.350 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:46:35.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.555+0000 7ff18bfff640 1 Processor -- start 2023-12-19T13:46:35.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.556+0000 7ff18bfff640 1 -- start start 2023-12-19T13:46:35.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.557+0000 7ff18bfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff18c15d620 0x7ff18c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.557+0000 7ff18bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0b6ca0 con 0x7ff18c0b6870 2023-12-19T13:46:35.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.557+0000 7ff18bfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0b4120 con 0x7ff18c15da00 2023-12-19T13:46:35.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.557+0000 7ff18bfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0b6ee0 con 0x7ff18c15d620 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.557+0000 7ff18b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff18c0b6870 0x7ff18c0b4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37476/0 (socket says 172.21.15.113:37476) 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.557+0000 7ff18b7fe640 1 -- 172.21.15.113:0/1497584850 learned_addr learned my addr 172.21.15.113:0/1497584850 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18affd640 1 --2- 172.21.15.113:0/1497584850 >> v2:172.21.15.151:3300/0 conn(0x7ff18c15d620 0x7ff18c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088083225 0 0) 0x7ff184001110 con 0x7ff18c0b6870 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff178003520 con 0x7ff18c0b6870 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332375098 0 0) 0x7ff178003520 con 0x7ff18c0b6870 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 >> v2:172.21.15.151:3300/0 conn(0x7ff18c15d620 msgr2=0x7ff18c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 --2- 172.21.15.113:0/1497584850 >> v2:172.21.15.151:3300/0 conn(0x7ff18c15d620 0x7ff18c0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 >> v1:172.21.15.151:6789/0 conn(0x7ff18c15da00 legacy=0x7ff18c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0b71c0 con 0x7ff18c0b6870 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff184001800 con 0x7ff18c0b6870 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 >> v1:172.21.15.113:6789/0 conn(0x7ff18c0b6870 legacy=0x7ff18c0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.558+0000 7ff18a7fc640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff178003970 0x7ff178003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18a7fc640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1780047c0 0x7ff178004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18a7fc640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff178005180 0x7ff17800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b6ee0 con 0x7ff1780047c0 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17800c030 con 0x7ff178003970 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17800c1f0 con 0x7ff178005180 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff1827fc640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1780047c0 0x7ff178004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18affd640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff178003970 0x7ff178003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18b7fe640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff178005180 0x7ff17800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff1827fc640 1 -- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff178005180 msgr2=0x7ff17800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:35.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff1827fc640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff178005180 0x7ff17800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff1827fc640 1 -- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff178003970 msgr2=0x7ff178003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:35.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff1827fc640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff178003970 0x7ff178003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff1827fc640 1 -- 172.21.15.113:0/1497584850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178003520 con 0x7ff1780047c0 2023-12-19T13:46:35.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.559+0000 7ff18b7fe640 1 -- 172.21.15.113:0/1497584850 reap_dead start 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.560+0000 7ff1827fc640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1780047c0 0x7ff178004c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff174001e50 tx=0x7ff1780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607b1458defed64a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174003b70 con 0x7ff1780047c0 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff174003cd0 con 0x7ff1780047c0 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18a7fc640 1 -- 172.21.15.113:0/1497584850 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174005310 con 0x7ff1780047c0 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18bfff640 1 -- 172.21.15.113:0/1497584850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1780047c0 msgr2=0x7ff178004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18bfff640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1780047c0 0x7ff178004c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff174001e50 tx=0x7ff1780057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18bfff640 1 -- 172.21.15.113:0/1497584850 shutdown_connections 2023-12-19T13:46:35.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18bfff640 1 --2- 172.21.15.113:0/1497584850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1780047c0 0x7ff178004c40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.561+0000 7ff18bfff640 1 -- 172.21.15.113:0/1497584850 >> 172.21.15.113:0/1497584850 conn(0x7ff18c0cfb90 msgr2=0x7ff18c0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:35.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.562+0000 7ff18bfff640 1 -- 172.21.15.113:0/1497584850 shutdown_connections 2023-12-19T13:46:35.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.562+0000 7ff18bfff640 1 -- 172.21.15.113:0/1497584850 wait complete. 2023-12-19T13:46:35.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.563+0000 7ff18bfff640 1 Processor -- start 2023-12-19T13:46:35.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.563+0000 7ff18bfff640 1 -- start start 2023-12-19T13:46:35.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.564+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1780047c0 0x7ff18c145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.564+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff18c1f63d0 0x7ff18c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.564+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff18c070420 0x7ff18c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.564+0000 7ff18bfff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c070de0 con 0x7ff18c070420 2023-12-19T13:46:35.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.564+0000 7ff18bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c15dde0 con 0x7ff18c1f63d0 2023-12-19T13:46:35.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.564+0000 7ff18bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c146060 con 0x7ff1780047c0 2023-12-19T13:46:35.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff18c070420 0x7ff18c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff18c070420 0x7ff18c0708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35602/0 (socket says 172.21.15.113:35602) 2023-12-19T13:46:35.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 -- 172.21.15.113:0/3312702458 learned_addr learned my addr 172.21.15.113:0/3312702458 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18affd640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1780047c0 0x7ff18c145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff1827fc640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff18c1f63d0 0x7ff18c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 -- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1780047c0 msgr2=0x7ff18c145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1780047c0 0x7ff18c145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 -- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff18c1f63d0 msgr2=0x7ff18c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff18c1f63d0 0x7ff18c15bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 -- 172.21.15.113:0/3312702458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c1f6900 con 0x7ff18c070420 2023-12-19T13:46:35.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.565+0000 7ff18b7fe640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff18c070420 0x7ff18c0708a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0b82e0 tx=0x7ff18400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:35.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.566+0000 7ff188ff9640 1 -- 172.21.15.113:0/3312702458 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18400eed0 con 0x7ff18c070420 2023-12-19T13:46:35.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.566+0000 7ff188ff9640 1 -- 172.21.15.113:0/3312702458 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18400c610 con 0x7ff18c070420 2023-12-19T13:46:35.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.566+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c1f6be0 con 0x7ff18c070420 2023-12-19T13:46:35.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.566+0000 7ff188ff9640 1 -- 172.21.15.113:0/3312702458 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18400c9a0 con 0x7ff18c070420 2023-12-19T13:46:35.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.566+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c1f71a0 con 0x7ff18c070420 2023-12-19T13:46:35.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.567+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c061910 con 0x7ff18c070420 2023-12-19T13:46:35.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.568+0000 7ff188ff9640 1 -- 172.21.15.113:0/3312702458 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff18400cb00 con 0x7ff18c070420 2023-12-19T13:46:35.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.569+0000 7ff188ff9640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16c06a430 0x7ff16c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:35.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.569+0000 7ff188ff9640 1 -- 172.21.15.113:0/3312702458 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1840884b0 con 0x7ff18c070420 2023-12-19T13:46:35.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.569+0000 7ff18affd640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16c06a430 0x7ff16c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:35.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.570+0000 7ff18affd640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16c06a430 0x7ff16c06c8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff18c04f860 tx=0x7ff17c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.574+0000 7ff188ff9640 1 -- 172.21.15.113:0/3312702458 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff184053a00 con 0x7ff18c070420 2023-12-19T13:46:35.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.758+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff18c0b4650 con 0x7ff16c06a430 2023-12-19T13:46:35.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.772+0000 7ff188ff9640 1 -- 172.21.15.113:0/3312702458 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252427 (secure 0 0 0) 0x7ff17c0138b0 con 0x7ff16c06a430 2023-12-19T13:46:35.775 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:35.778 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16c06a430 msgr2=0x7ff16c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16c06a430 0x7ff16c06c8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff18c04f860 tx=0x7ff17c008040 comp rx=0 tx=0).stop 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff18c070420 msgr2=0x7ff18c0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff18c070420 0x7ff18c0708a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0b82e0 tx=0x7ff18400eb90 comp rx=0 tx=0).stop 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 shutdown_connections 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16c06a430 0x7ff16c06c8f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff18c070420 0x7ff18c0708a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff18c1f63d0 0x7ff18c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 --2- 172.21.15.113:0/3312702458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1780047c0 0x7ff18c145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:35.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 >> 172.21.15.113:0/3312702458 conn(0x7ff18c0cfb90 msgr2=0x7ff18c1599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:35.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 shutdown_connections 2023-12-19T13:46:35.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:35.778+0000 7ff18bfff640 1 -- 172.21.15.113:0/3312702458 wait complete. 2023-12-19T13:46:35.797 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-19T13:46:34.410724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":96,"acting":96,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560945,"statfs":{"total":1600000000,"available":1598408160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.451377+0000","last_change":"2023-12-19T13:46:30.451377+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.451377+0000","last_undegraded":"2023-12-19T13:46:30.451377+0000","last_fullsized":"2023-12-19T13:46:30.451377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.460368+0000","last_change":"2023-12-19T13:46:30.460368+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.460368+0000","last_undegraded":"2023-12-19T13:46:30.460368+0000","last_fullsized":"2023-12-19T13:46:30.460368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455454+0000","last_change":"2023-12-19T13:46:30.455454+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455454+0000","last_undegraded":"2023-12-19T13:46:30.455454+0000","last_fullsized":"2023-12-19T13:46:30.455454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455685+0000","last_change":"2023-12-19T13:46:30.455685+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455685+0000","last_undegraded":"2023-12-19T13:46:30.455685+0000","last_fullsized":"2023-12-19T13:46:30.455685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:08.682812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.447059+0000","last_change":"2023-12-19T13:46:30.447059+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.447059+0000","last_undegraded":"2023-12-19T13:46:30.447059+0000","last_fullsized":"2023-12-19T13:46:30.447059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.453576+0000","last_change":"2023-12-19T13:46:30.453576+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.453576+0000","last_undegraded":"2023-12-19T13:46:30.453576+0000","last_fullsized":"2023-12-19T13:46:30.453576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455138+0000","last_change":"2023-12-19T13:46:30.455138+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455138+0000","last_undegraded":"2023-12-19T13:46:30.455138+0000","last_fullsized":"2023-12-19T13:46:30.455138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:02.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.458565+0000","last_change":"2023-12-19T13:46:30.458565+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.458565+0000","last_undegraded":"2023-12-19T13:46:30.458565+0000","last_fullsized":"2023-12-19T13:46:30.458565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.442362+0000","last_change":"2023-12-19T13:46:30.442362+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.442362+0000","last_undegraded":"2023-12-19T13:46:30.442362+0000","last_fullsized":"2023-12-19T13:46:30.442362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.441628+0000","last_change":"2023-12-19T13:46:30.441628+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.441628+0000","last_undegraded":"2023-12-19T13:46:30.441628+0000","last_fullsized":"2023-12-19T13:46:30.441628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437131+0000","last_change":"2023-12-19T13:46:29.437131+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437131+0000","last_undegraded":"2023-12-19T13:46:29.437131+0000","last_fullsized":"2023-12-19T13:46:29.437131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:33.124713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432839+0000","last_change":"2023-12-19T13:46:29.432839+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432839+0000","last_undegraded":"2023-12-19T13:46:29.432839+0000","last_fullsized":"2023-12-19T13:46:29.432839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.454272+0000","last_change":"2023-12-19T13:46:30.454272+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.454272+0000","last_undegraded":"2023-12-19T13:46:30.454272+0000","last_fullsized":"2023-12-19T13:46:30.454272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437172+0000","last_change":"2023-12-19T13:46:29.437172+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437172+0000","last_undegraded":"2023-12-19T13:46:29.437172+0000","last_fullsized":"2023-12-19T13:46:29.437172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:03.646304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.439129+0000","last_change":"2023-12-19T13:46:30.439129+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.439129+0000","last_undegraded":"2023-12-19T13:46:30.439129+0000","last_fullsized":"2023-12-19T13:46:30.439129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:09.441431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432860+0000","last_change":"2023-12-19T13:46:29.432860+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432860+0000","last_undegraded":"2023-12-19T13:46:29.432860+0000","last_fullsized":"2023-12-19T13:46:29.432860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.452942+0000","last_change":"2023-12-19T13:46:30.452942+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.452942+0000","last_undegraded":"2023-12-19T13:46:30.452942+0000","last_fullsized":"2023-12-19T13:46:30.452942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.440730+0000","last_change":"2023-12-19T13:46:30.440730+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.440730+0000","last_undegraded":"2023-12-19T13:46:30.440730+0000","last_fullsized":"2023-12-19T13:46:30.440730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433974+0000","last_change":"2023-12-19T13:46:29.433974+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433974+0000","last_undegraded":"2023-12-19T13:46:29.433974+0000","last_fullsized":"2023-12-19T13:46:29.433974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:40.827653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.441733+0000","last_change":"2023-12-19T13:46:30.441733+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.441733+0000","last_undegraded":"2023-12-19T13:46:30.441733+0000","last_fullsized":"2023-12-19T13:46:30.441733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437789+0000","last_change":"2023-12-19T13:46:29.437789+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437789+0000","last_undegraded":"2023-12-19T13:46:29.437789+0000","last_fullsized":"2023-12-19T13:46:29.437789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:01.555601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432041+0000","last_change":"2023-12-19T13:46:29.432041+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432041+0000","last_undegraded":"2023-12-19T13:46:29.432041+0000","last_fullsized":"2023-12-19T13:46:29.432041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.435998+0000","last_change":"2023-12-19T13:46:29.435998+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.435998+0000","last_undegraded":"2023-12-19T13:46:29.435998+0000","last_fullsized":"2023-12-19T13:46:29.435998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.430700+0000","last_change":"2023-12-19T13:46:29.430700+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.430700+0000","last_undegraded":"2023-12-19T13:46:29.430700+0000","last_fullsized":"2023-12-19T13:46:29.430700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433348+0000","last_change":"2023-12-19T13:46:29.433348+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433348+0000","last_undegraded":"2023-12-19T13:46:29.433348+0000","last_fullsized":"2023-12-19T13:46:29.433348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.456150+0000","last_change":"2023-12-19T13:46:30.456074+0000","last_active":"2023-12-19T13:46:30.456150+0000","last_peered":"2023-12-19T13:46:30.456150+0000","last_clean":"2023-12-19T13:46:30.456150+0000","last_became_active":"2023-12-19T13:46:30.455381+0000","last_became_peered":"2023-12-19T13:46:30.455381+0000","last_unstale":"2023-12-19T13:46:30.456150+0000","last_undegraded":"2023-12-19T13:46:30.456150+0000","last_fullsized":"2023-12-19T13:46:30.456150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.431686+0000","last_change":"2023-12-19T13:46:29.431686+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.431686+0000","last_undegraded":"2023-12-19T13:46:29.431686+0000","last_fullsized":"2023-12-19T13:46:29.431686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-19T13:46:29.424850+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:46:29.424850+0000","last_peered":"2023-12-19T13:46:29.424850+0000","last_clean":"2023-12-19T13:46:29.424850+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:46:29.424850+0000","last_undegraded":"2023-12-19T13:46:29.424850+0000","last_fullsized":"2023-12-19T13:46:29.424850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433622+0000","last_change":"2023-12-19T13:46:29.433622+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433622+0000","last_undegraded":"2023-12-19T13:46:29.433622+0000","last_fullsized":"2023-12-19T13:46:29.433622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:54.770943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433610+0000","last_change":"2023-12-19T13:46:29.433610+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433610+0000","last_undegraded":"2023-12-19T13:46:29.433610+0000","last_fullsized":"2023-12-19T13:46:29.433610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:39.901573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.442061+0000","last_change":"2023-12-19T13:46:30.442061+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.442061+0000","last_undegraded":"2023-12-19T13:46:30.442061+0000","last_fullsized":"2023-12-19T13:46:30.442061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455079+0000","last_change":"2023-12-19T13:46:30.455079+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455079+0000","last_undegraded":"2023-12-19T13:46:30.455079+0000","last_fullsized":"2023-12-19T13:46:30.455079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:34.137836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433610+0000","last_change":"2023-12-19T13:46:29.433610+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433610+0000","last_undegraded":"2023-12-19T13:46:29.433610+0000","last_fullsized":"2023-12-19T13:46:29.433610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.442274+0000","last_change":"2023-12-19T13:46:30.442274+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.442274+0000","last_undegraded":"2023-12-19T13:46:30.442274+0000","last_fullsized":"2023-12-19T13:46:30.442274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437204+0000","last_change":"2023-12-19T13:46:29.437204+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437204+0000","last_undegraded":"2023-12-19T13:46:29.437204+0000","last_fullsized":"2023-12-19T13:46:29.437204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:58.990876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.435071+0000","last_change":"2023-12-19T13:46:29.435071+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.435071+0000","last_undegraded":"2023-12-19T13:46:29.435071+0000","last_fullsized":"2023-12-19T13:46:29.435071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.435646+0000","last_change":"2023-12-19T13:46:29.435646+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.435646+0000","last_undegraded":"2023-12-19T13:46:29.435646+0000","last_fullsized":"2023-12-19T13:46:29.435646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.430727+0000","last_change":"2023-12-19T13:46:29.430727+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.430727+0000","last_undegraded":"2023-12-19T13:46:29.430727+0000","last_fullsized":"2023-12-19T13:46:29.430727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:25.754683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432523+0000","last_change":"2023-12-19T13:46:29.432523+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432523+0000","last_undegraded":"2023-12-19T13:46:29.432523+0000","last_fullsized":"2023-12-19T13:46:29.432523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432040+0000","last_change":"2023-12-19T13:46:29.432040+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432040+0000","last_undegraded":"2023-12-19T13:46:29.432040+0000","last_fullsized":"2023-12-19T13:46:29.432040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.444143+0000","last_change":"2023-12-19T13:46:30.444143+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.444143+0000","last_undegraded":"2023-12-19T13:46:30.444143+0000","last_fullsized":"2023-12-19T13:46:30.444143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433979+0000","last_change":"2023-12-19T13:46:29.433979+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433979+0000","last_undegraded":"2023-12-19T13:46:29.433979+0000","last_fullsized":"2023-12-19T13:46:29.433979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432259+0000","last_change":"2023-12-19T13:46:29.432259+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432259+0000","last_undegraded":"2023-12-19T13:46:29.432259+0000","last_fullsized":"2023-12-19T13:46:29.432259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.431463+0000","last_change":"2023-12-19T13:46:29.431463+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.431463+0000","last_undegraded":"2023-12-19T13:46:29.431463+0000","last_fullsized":"2023-12-19T13:46:29.431463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.452617+0000","last_change":"2023-12-19T13:46:30.452617+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.452617+0000","last_undegraded":"2023-12-19T13:46:30.452617+0000","last_fullsized":"2023-12-19T13:46:30.452617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.454508+0000","last_change":"2023-12-19T13:46:30.449386+0000","last_active":"2023-12-19T13:46:30.454508+0000","last_peered":"2023-12-19T13:46:30.454508+0000","last_clean":"2023-12-19T13:46:30.454508+0000","last_became_active":"2023-12-19T13:46:30.448900+0000","last_became_peered":"2023-12-19T13:46:30.448900+0000","last_unstale":"2023-12-19T13:46:30.454508+0000","last_undegraded":"2023-12-19T13:46:30.454508+0000","last_fullsized":"2023-12-19T13:46:30.454508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.457737+0000","last_change":"2023-12-19T13:46:30.457737+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.457737+0000","last_undegraded":"2023-12-19T13:46:30.457737+0000","last_fullsized":"2023-12-19T13:46:30.457737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.436838+0000","last_change":"2023-12-19T13:46:29.436838+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.436838+0000","last_undegraded":"2023-12-19T13:46:29.436838+0000","last_fullsized":"2023-12-19T13:46:29.436838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]}]}],"pool_statfs":[]}} 2023-12-19T13:46:35.801 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:46:36.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.055+0000 7fa6766da640 1 Processor -- start 2023-12-19T13:46:36.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.056+0000 7fa6766da640 1 -- start start 2023-12-19T13:46:36.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.057+0000 7fa6766da640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa67015e5a0 0x7fa6700b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.057+0000 7fa6766da640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 0x7fa6700ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.057+0000 7fa6766da640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67015ec30 con 0x7fa67015f680 2023-12-19T13:46:36.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.057+0000 7fa6766da640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6700ce5a0 con 0x7fa67015e5a0 2023-12-19T13:46:36.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.057+0000 7fa6766da640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015e980 con 0x7fa6700cdbf0 2023-12-19T13:46:36.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.058+0000 7fa674ed7640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa67015f680 0x7fa6700b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37488/0 (socket says 172.21.15.113:37488) 2023-12-19T13:46:36.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.058+0000 7fa674ed7640 1 -- 172.21.15.113:0/2848231061 learned_addr learned my addr 172.21.15.113:0/2848231061 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:36.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.058+0000 7fa675ed9640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 0x7fa6700ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.058+0000 7fa6756d8640 1 --2- 172.21.15.113:0/2848231061 >> v2:172.21.15.151:3300/0 conn(0x7fa67015e5a0 0x7fa6700b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.058+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308136209 0 0) 0x7fa67015ec30 con 0x7fa67015f680 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.058+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c003520 con 0x7fa67015f680 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1762081631 0 0) 0x7fa65c003520 con 0x7fa67015f680 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 msgr2=0x7fa6700ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 0x7fa6700ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 >> v2:172.21.15.151:3300/0 conn(0x7fa67015e5a0 msgr2=0x7fa6700b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 --2- 172.21.15.113:0/2848231061 >> v2:172.21.15.151:3300/0 conn(0x7fa67015e5a0 0x7fa6700b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700b2f90 con 0x7fa67015f680 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fa660001670 con 0x7fa67015f680 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 >> v1:172.21.15.113:6789/0 conn(0x7fa67015f680 legacy=0x7fa6700b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c003970 0x7fa65c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 0x7fa65c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa65c004d00 0x7fa65c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700ce5a0 con 0x7fa65c004d00 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015e980 con 0x7fa65c003970 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c00b980 con 0x7fa6700cdbf0 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa675ed9640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa65c004d00 0x7fa65c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa674ed7640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 0x7fa65c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa6756d8640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c003970 0x7fa65c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa675ed9640 1 -- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 msgr2=0x7fa65c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa675ed9640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 0x7fa65c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.059+0000 7fa675ed9640 1 -- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c003970 msgr2=0x7fa65c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.060+0000 7fa675ed9640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c003970 0x7fa65c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.060+0000 7fa675ed9640 1 -- 172.21.15.113:0/2848231061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c003520 con 0x7fa65c004d00 2023-12-19T13:46:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.060+0000 7fa674ed7640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6700cdbf0 0x7fa65c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa675ed9640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa65c004d00 0x7fa65c005180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa668009fc0 tx=0x7fa65c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bec8ba37dff640 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66802cc20 con 0x7fa65c004d00 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66800f040 con 0x7fa65c004d00 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa667fff640 1 -- 172.21.15.113:0/2848231061 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668034440 con 0x7fa65c004d00 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa6766da640 1 -- 172.21.15.113:0/2848231061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa65c004d00 msgr2=0x7fa65c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa6766da640 1 --2- 172.21.15.113:0/2848231061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa65c004d00 0x7fa65c005180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa668009fc0 tx=0x7fa65c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa675ed9640 1 -- 172.21.15.113:0/2848231061 reap_dead start 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa6766da640 1 -- 172.21.15.113:0/2848231061 shutdown_connections 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.061+0000 7fa6766da640 1 -- 172.21.15.113:0/2848231061 >> 172.21.15.113:0/2848231061 conn(0x7fa6700b0100 msgr2=0x7fa6700b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:36.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.062+0000 7fa6766da640 1 -- 172.21.15.113:0/2848231061 shutdown_connections 2023-12-19T13:46:36.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.062+0000 7fa6766da640 1 -- 172.21.15.113:0/2848231061 wait complete. 2023-12-19T13:46:36.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.063+0000 7fa6766da640 1 Processor -- start 2023-12-19T13:46:36.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.063+0000 7fa6766da640 1 -- start start 2023-12-19T13:46:36.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.064+0000 7fa6766da640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c004d00 0x7fa670155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.064+0000 7fa6766da640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa670154590 0x7fa67015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.064+0000 7fa6766da640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa67015ce50 0x7fa6700c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.064+0000 7fa6766da640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6701558e0 con 0x7fa67015ce50 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.064+0000 7fa6766da640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700cd3d0 con 0x7fa65c004d00 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.064+0000 7fa6766da640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015d2d0 con 0x7fa670154590 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa67015ce50 0x7fa6700c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa67015ce50 0x7fa6700c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35632/0 (socket says 172.21.15.113:35632) 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 -- 172.21.15.113:0/474911275 learned_addr learned my addr 172.21.15.113:0/474911275 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa674ed7640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa670154590 0x7fa67015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 -- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa670154590 msgr2=0x7fa67015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa6756d8640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c004d00 0x7fa670155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa670154590 0x7fa67015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 -- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c004d00 msgr2=0x7fa670155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c004d00 0x7fa670155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 -- 172.21.15.113:0/474911275 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700c9dc0 con 0x7fa67015ce50 2023-12-19T13:46:36.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.065+0000 7fa675ed9640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa67015ce50 0x7fa6700c9170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa66800e230 tx=0x7fa668009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:36.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.066+0000 7fa665ffb640 1 -- 172.21.15.113:0/474911275 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668043070 con 0x7fa67015ce50 2023-12-19T13:46:36.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.066+0000 7fa665ffb640 1 -- 172.21.15.113:0/474911275 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa668034ad0 con 0x7fa67015ce50 2023-12-19T13:46:36.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.066+0000 7fa665ffb640 1 -- 172.21.15.113:0/474911275 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66802cea0 con 0x7fa67015ce50 2023-12-19T13:46:36.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.066+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa670154f40 con 0x7fa67015ce50 2023-12-19T13:46:36.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.066+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa670155500 con 0x7fa67015ce50 2023-12-19T13:46:36.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.067+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6701556c0 con 0x7fa67015ce50 2023-12-19T13:46:36.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.068+0000 7fa665ffb640 1 -- 172.21.15.113:0/474911275 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa66803e440 con 0x7fa67015ce50 2023-12-19T13:46:36.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.068+0000 7fa665ffb640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa65406a430 0x7fa65406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.069+0000 7fa665ffb640 1 -- 172.21.15.113:0/474911275 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6680aa3b0 con 0x7fa67015ce50 2023-12-19T13:46:36.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.069+0000 7fa6756d8640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa65406a430 0x7fa65406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.069+0000 7fa6756d8640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa65406a430 0x7fa65406c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009990 tx=0x7fa66c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:36.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.073+0000 7fa665ffb640 1 -- 172.21.15.113:0/474911275 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa668075900 con 0x7fa67015ce50 2023-12-19T13:46:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.257+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa67015ee80 con 0x7fa65406a430 2023-12-19T13:46:36.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.278+0000 7fa665ffb640 1 -- 172.21.15.113:0/474911275 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252427 (secure 0 0 0) 0x7fa66c0118e0 con 0x7fa65406a430 2023-12-19T13:46:36.282 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:36.283 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa65406a430 msgr2=0x7fa65406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa65406a430 0x7fa65406c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009990 tx=0x7fa66c008040 comp rx=0 tx=0).stop 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa67015ce50 msgr2=0x7fa6700c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa67015ce50 0x7fa6700c9170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa66800e230 tx=0x7fa668009750 comp rx=0 tx=0).stop 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 shutdown_connections 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa65406a430 0x7fa65406c8f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa67015ce50 0x7fa6700c9170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa670154590 0x7fa67015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 --2- 172.21.15.113:0/474911275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa65c004d00 0x7fa670155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 >> 172.21.15.113:0/474911275 conn(0x7fa6700b0100 msgr2=0x7fa670158610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 shutdown_connections 2023-12-19T13:46:36.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.283+0000 7fa6766da640 1 -- 172.21.15.113:0/474911275 wait complete. 2023-12-19T13:46:36.303 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-19T13:46:34.410724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":96,"acting":96,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560945,"statfs":{"total":1600000000,"available":1598408160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.451377+0000","last_change":"2023-12-19T13:46:30.451377+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.451377+0000","last_undegraded":"2023-12-19T13:46:30.451377+0000","last_fullsized":"2023-12-19T13:46:30.451377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.460368+0000","last_change":"2023-12-19T13:46:30.460368+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.460368+0000","last_undegraded":"2023-12-19T13:46:30.460368+0000","last_fullsized":"2023-12-19T13:46:30.460368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455454+0000","last_change":"2023-12-19T13:46:30.455454+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455454+0000","last_undegraded":"2023-12-19T13:46:30.455454+0000","last_fullsized":"2023-12-19T13:46:30.455454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455685+0000","last_change":"2023-12-19T13:46:30.455685+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455685+0000","last_undegraded":"2023-12-19T13:46:30.455685+0000","last_fullsized":"2023-12-19T13:46:30.455685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:08.682812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.447059+0000","last_change":"2023-12-19T13:46:30.447059+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.447059+0000","last_undegraded":"2023-12-19T13:46:30.447059+0000","last_fullsized":"2023-12-19T13:46:30.447059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.453576+0000","last_change":"2023-12-19T13:46:30.453576+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.453576+0000","last_undegraded":"2023-12-19T13:46:30.453576+0000","last_fullsized":"2023-12-19T13:46:30.453576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455138+0000","last_change":"2023-12-19T13:46:30.455138+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455138+0000","last_undegraded":"2023-12-19T13:46:30.455138+0000","last_fullsized":"2023-12-19T13:46:30.455138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:02.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.458565+0000","last_change":"2023-12-19T13:46:30.458565+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.458565+0000","last_undegraded":"2023-12-19T13:46:30.458565+0000","last_fullsized":"2023-12-19T13:46:30.458565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.442362+0000","last_change":"2023-12-19T13:46:30.442362+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.442362+0000","last_undegraded":"2023-12-19T13:46:30.442362+0000","last_fullsized":"2023-12-19T13:46:30.442362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.441628+0000","last_change":"2023-12-19T13:46:30.441628+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.441628+0000","last_undegraded":"2023-12-19T13:46:30.441628+0000","last_fullsized":"2023-12-19T13:46:30.441628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437131+0000","last_change":"2023-12-19T13:46:29.437131+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437131+0000","last_undegraded":"2023-12-19T13:46:29.437131+0000","last_fullsized":"2023-12-19T13:46:29.437131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:33.124713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432839+0000","last_change":"2023-12-19T13:46:29.432839+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432839+0000","last_undegraded":"2023-12-19T13:46:29.432839+0000","last_fullsized":"2023-12-19T13:46:29.432839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.454272+0000","last_change":"2023-12-19T13:46:30.454272+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.454272+0000","last_undegraded":"2023-12-19T13:46:30.454272+0000","last_fullsized":"2023-12-19T13:46:30.454272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437172+0000","last_change":"2023-12-19T13:46:29.437172+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437172+0000","last_undegraded":"2023-12-19T13:46:29.437172+0000","last_fullsized":"2023-12-19T13:46:29.437172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:03.646304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.439129+0000","last_change":"2023-12-19T13:46:30.439129+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.439129+0000","last_undegraded":"2023-12-19T13:46:30.439129+0000","last_fullsized":"2023-12-19T13:46:30.439129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:09.441431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432860+0000","last_change":"2023-12-19T13:46:29.432860+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432860+0000","last_undegraded":"2023-12-19T13:46:29.432860+0000","last_fullsized":"2023-12-19T13:46:29.432860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.452942+0000","last_change":"2023-12-19T13:46:30.452942+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.452942+0000","last_undegraded":"2023-12-19T13:46:30.452942+0000","last_fullsized":"2023-12-19T13:46:30.452942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.440730+0000","last_change":"2023-12-19T13:46:30.440730+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.440730+0000","last_undegraded":"2023-12-19T13:46:30.440730+0000","last_fullsized":"2023-12-19T13:46:30.440730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433974+0000","last_change":"2023-12-19T13:46:29.433974+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433974+0000","last_undegraded":"2023-12-19T13:46:29.433974+0000","last_fullsized":"2023-12-19T13:46:29.433974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:40.827653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.441733+0000","last_change":"2023-12-19T13:46:30.441733+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.441733+0000","last_undegraded":"2023-12-19T13:46:30.441733+0000","last_fullsized":"2023-12-19T13:46:30.441733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437789+0000","last_change":"2023-12-19T13:46:29.437789+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437789+0000","last_undegraded":"2023-12-19T13:46:29.437789+0000","last_fullsized":"2023-12-19T13:46:29.437789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:01.555601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432041+0000","last_change":"2023-12-19T13:46:29.432041+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432041+0000","last_undegraded":"2023-12-19T13:46:29.432041+0000","last_fullsized":"2023-12-19T13:46:29.432041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.435998+0000","last_change":"2023-12-19T13:46:29.435998+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.435998+0000","last_undegraded":"2023-12-19T13:46:29.435998+0000","last_fullsized":"2023-12-19T13:46:29.435998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.430700+0000","last_change":"2023-12-19T13:46:29.430700+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.430700+0000","last_undegraded":"2023-12-19T13:46:29.430700+0000","last_fullsized":"2023-12-19T13:46:29.430700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433348+0000","last_change":"2023-12-19T13:46:29.433348+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433348+0000","last_undegraded":"2023-12-19T13:46:29.433348+0000","last_fullsized":"2023-12-19T13:46:29.433348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.456150+0000","last_change":"2023-12-19T13:46:30.456074+0000","last_active":"2023-12-19T13:46:30.456150+0000","last_peered":"2023-12-19T13:46:30.456150+0000","last_clean":"2023-12-19T13:46:30.456150+0000","last_became_active":"2023-12-19T13:46:30.455381+0000","last_became_peered":"2023-12-19T13:46:30.455381+0000","last_unstale":"2023-12-19T13:46:30.456150+0000","last_undegraded":"2023-12-19T13:46:30.456150+0000","last_fullsized":"2023-12-19T13:46:30.456150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.431686+0000","last_change":"2023-12-19T13:46:29.431686+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.431686+0000","last_undegraded":"2023-12-19T13:46:29.431686+0000","last_fullsized":"2023-12-19T13:46:29.431686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-19T13:46:29.424850+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:46:29.424850+0000","last_peered":"2023-12-19T13:46:29.424850+0000","last_clean":"2023-12-19T13:46:29.424850+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:46:29.424850+0000","last_undegraded":"2023-12-19T13:46:29.424850+0000","last_fullsized":"2023-12-19T13:46:29.424850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433622+0000","last_change":"2023-12-19T13:46:29.433622+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433622+0000","last_undegraded":"2023-12-19T13:46:29.433622+0000","last_fullsized":"2023-12-19T13:46:29.433622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:54.770943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433610+0000","last_change":"2023-12-19T13:46:29.433610+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433610+0000","last_undegraded":"2023-12-19T13:46:29.433610+0000","last_fullsized":"2023-12-19T13:46:29.433610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:39.901573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.442061+0000","last_change":"2023-12-19T13:46:30.442061+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.442061+0000","last_undegraded":"2023-12-19T13:46:30.442061+0000","last_fullsized":"2023-12-19T13:46:30.442061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.455079+0000","last_change":"2023-12-19T13:46:30.455079+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.455079+0000","last_undegraded":"2023-12-19T13:46:30.455079+0000","last_fullsized":"2023-12-19T13:46:30.455079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:34.137836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433610+0000","last_change":"2023-12-19T13:46:29.433610+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433610+0000","last_undegraded":"2023-12-19T13:46:29.433610+0000","last_fullsized":"2023-12-19T13:46:29.433610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-12-19T13:46:30.442274+0000","last_change":"2023-12-19T13:46:30.442274+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.442274+0000","last_undegraded":"2023-12-19T13:46:30.442274+0000","last_fullsized":"2023-12-19T13:46:30.442274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.437204+0000","last_change":"2023-12-19T13:46:29.437204+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.437204+0000","last_undegraded":"2023-12-19T13:46:29.437204+0000","last_fullsized":"2023-12-19T13:46:29.437204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:58.990876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.435071+0000","last_change":"2023-12-19T13:46:29.435071+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.435071+0000","last_undegraded":"2023-12-19T13:46:29.435071+0000","last_fullsized":"2023-12-19T13:46:29.435071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.435646+0000","last_change":"2023-12-19T13:46:29.435646+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.435646+0000","last_undegraded":"2023-12-19T13:46:29.435646+0000","last_fullsized":"2023-12-19T13:46:29.435646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.430727+0000","last_change":"2023-12-19T13:46:29.430727+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.430727+0000","last_undegraded":"2023-12-19T13:46:29.430727+0000","last_fullsized":"2023-12-19T13:46:29.430727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:25.754683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432523+0000","last_change":"2023-12-19T13:46:29.432523+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432523+0000","last_undegraded":"2023-12-19T13:46:29.432523+0000","last_fullsized":"2023-12-19T13:46:29.432523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432040+0000","last_change":"2023-12-19T13:46:29.432040+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432040+0000","last_undegraded":"2023-12-19T13:46:29.432040+0000","last_fullsized":"2023-12-19T13:46:29.432040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.444143+0000","last_change":"2023-12-19T13:46:30.444143+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.444143+0000","last_undegraded":"2023-12-19T13:46:30.444143+0000","last_fullsized":"2023-12-19T13:46:30.444143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.433979+0000","last_change":"2023-12-19T13:46:29.433979+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.433979+0000","last_undegraded":"2023-12-19T13:46:29.433979+0000","last_fullsized":"2023-12-19T13:46:29.433979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.432259+0000","last_change":"2023-12-19T13:46:29.432259+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.432259+0000","last_undegraded":"2023-12-19T13:46:29.432259+0000","last_fullsized":"2023-12-19T13:46:29.432259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:46:30.423972+0000","last_change":"2023-12-19T13:46:30.423972+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.423972+0000","last_undegraded":"2023-12-19T13:46:30.423972+0000","last_fullsized":"2023-12-19T13:46:30.423972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.431463+0000","last_change":"2023-12-19T13:46:29.431463+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.431463+0000","last_undegraded":"2023-12-19T13:46:29.431463+0000","last_fullsized":"2023-12-19T13:46:29.431463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.452617+0000","last_change":"2023-12-19T13:46:30.452617+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.452617+0000","last_undegraded":"2023-12-19T13:46:30.452617+0000","last_fullsized":"2023-12-19T13:46:30.452617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.454508+0000","last_change":"2023-12-19T13:46:30.449386+0000","last_active":"2023-12-19T13:46:30.454508+0000","last_peered":"2023-12-19T13:46:30.454508+0000","last_clean":"2023-12-19T13:46:30.454508+0000","last_became_active":"2023-12-19T13:46:30.448900+0000","last_became_peered":"2023-12-19T13:46:30.448900+0000","last_unstale":"2023-12-19T13:46:30.454508+0000","last_undegraded":"2023-12-19T13:46:30.454508+0000","last_fullsized":"2023-12-19T13:46:30.454508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T13:46:30.457737+0000","last_change":"2023-12-19T13:46:30.457737+0000","last_active":"2023-12-19T13:46:30.423972+0000","last_peered":"2023-12-19T13:46:30.423972+0000","last_clean":"2023-12-19T13:46:30.423972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:30.457737+0000","last_undegraded":"2023-12-19T13:46:30.457737+0000","last_fullsized":"2023-12-19T13:46:30.457737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-19T13:46:29.436838+0000","last_change":"2023-12-19T13:46:29.436838+0000","last_active":"2023-12-19T13:46:29.410850+0000","last_peered":"2023-12-19T13:46:29.410850+0000","last_clean":"2023-12-19T13:46:29.410850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:46:29.436838+0000","last_undegraded":"2023-12-19T13:46:29.436838+0000","last_fullsized":"2023-12-19T13:46:29.436838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]}]}],"pool_statfs":[]}} 2023-12-19T13:46:36.309 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:46:36.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.566+0000 7f5882c17640 1 Processor -- start 2023-12-19T13:46:36.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.566+0000 7f5882c17640 1 -- start start 2023-12-19T13:46:36.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f5882c17640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f587c1449e0 0x7f587c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f5882c17640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f587c0b0b50 0x7f587c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f5882c17640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0afb10 con 0x7f587c06b590 2023-12-19T13:46:36.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f5882c17640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c06bb30 con 0x7f587c0b0b50 2023-12-19T13:46:36.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f5882c17640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0b0070 con 0x7f587c1449e0 2023-12-19T13:46:36.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f587bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f587c0b0b50 0x7f587c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f587bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f587c0b0b50 0x7f587c06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35642/0 (socket says 172.21.15.113:35642) 2023-12-19T13:46:36.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f587bfff640 1 -- 172.21.15.113:0/4009941223 learned_addr learned my addr 172.21.15.113:0/4009941223 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:36.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f58809b3640 1 --2- 172.21.15.113:0/4009941223 >> v2:172.21.15.151:3300/0 conn(0x7f587c1449e0 0x7f587c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f587bfff640 1 -- 172.21.15.113:0/4009941223 >> v2:172.21.15.151:3300/0 conn(0x7f587c1449e0 msgr2=0x7f587c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:36.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f587bfff640 1 --2- 172.21.15.113:0/4009941223 >> v2:172.21.15.151:3300/0 conn(0x7f587c1449e0 0x7f587c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f587bfff640 1 -- 172.21.15.113:0/4009941223 >> v1:172.21.15.151:6789/0 conn(0x7f587c06b590 legacy=0x7f587c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:36.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f587bfff640 1 -- 172.21.15.113:0/4009941223 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0b0350 con 0x7f587c0b0b50 2023-12-19T13:46:36.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.568+0000 7f58809b3640 1 --2- 172.21.15.113:0/4009941223 >> v2:172.21.15.151:3300/0 conn(0x7f587c1449e0 0x7f587c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:36.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.569+0000 7f587bfff640 1 --2- 172.21.15.113:0/4009941223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c0b0b50 0x7f587c06bfa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f587c071cd0 tx=0x7f586802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e2647e4cdf372c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:36.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.570+0000 7f587b7fe640 1 -- 172.21.15.113:0/4009941223 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868031870 con 0x7f587c0b0b50 2023-12-19T13:46:36.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.570+0000 7f587b7fe640 1 -- 172.21.15.113:0/4009941223 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58680319d0 con 0x7f587c0b0b50 2023-12-19T13:46:36.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.570+0000 7f587b7fe640 1 -- 172.21.15.113:0/4009941223 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868031d60 con 0x7f587c0b0b50 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.570+0000 7f5882c17640 1 -- 172.21.15.113:0/4009941223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c0b0b50 msgr2=0x7f587c06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.570+0000 7f5882c17640 1 --2- 172.21.15.113:0/4009941223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c0b0b50 0x7f587c06bfa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f587c071cd0 tx=0x7f586802b910 comp rx=0 tx=0).stop 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.571+0000 7f5882c17640 1 -- 172.21.15.113:0/4009941223 shutdown_connections 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.571+0000 7f5882c17640 1 --2- 172.21.15.113:0/4009941223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c0b0b50 0x7f587c06bfa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.571+0000 7f5882c17640 1 --2- 172.21.15.113:0/4009941223 >> v2:172.21.15.151:3300/0 conn(0x7f587c1449e0 0x7f587c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.571+0000 7f5882c17640 1 -- 172.21.15.113:0/4009941223 >> 172.21.15.113:0/4009941223 conn(0x7f587c0cbb70 msgr2=0x7f587c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.571+0000 7f5882c17640 1 -- 172.21.15.113:0/4009941223 shutdown_connections 2023-12-19T13:46:36.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.571+0000 7f5882c17640 1 -- 172.21.15.113:0/4009941223 wait complete. 2023-12-19T13:46:36.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.573+0000 7f5882c17640 1 Processor -- start 2023-12-19T13:46:36.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.573+0000 7f5882c17640 1 -- start start 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.574+0000 7f5882c17640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c06b590 0x7f587c1f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.574+0000 7f5882c17640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c0b0b50 0x7f587c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.574+0000 7f5882c17640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c1449e0 0x7f587c0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.574+0000 7f5882c17640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cdd00 con 0x7f587c1449e0 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.574+0000 7f5882c17640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c15e610 con 0x7f587c06b590 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.574+0000 7f5882c17640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c15c9c0 con 0x7f587c0b0b50 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c1449e0 0x7f587c0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c1449e0 0x7f587c0ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35654/0 (socket says 172.21.15.113:35654) 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 -- 172.21.15.113:0/1023065592 learned_addr learned my addr 172.21.15.113:0/1023065592 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f587bfff640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c0b0b50 0x7f587c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58809b3640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c06b590 0x7f587c1f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 -- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c0b0b50 msgr2=0x7f587c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c0b0b50 0x7f587c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 -- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c06b590 msgr2=0x7f587c1f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c06b590 0x7f587c1f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 -- 172.21.15.113:0/1023065592 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680094d0 con 0x7f587c1449e0 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f587bfff640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c0b0b50 0x7f587c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58809b3640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c06b590 0x7f587c1f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:36.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.575+0000 7f58811b4640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c1449e0 0x7f587c0ce3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f587400c7b0 tx=0x7f587400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:36.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.576+0000 7f58797fa640 1 -- 172.21.15.113:0/1023065592 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874003d80 con 0x7f587c1449e0 2023-12-19T13:46:36.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.576+0000 7f58797fa640 1 -- 172.21.15.113:0/1023065592 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5874005070 con 0x7f587c1449e0 2023-12-19T13:46:36.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.576+0000 7f58797fa640 1 -- 172.21.15.113:0/1023065592 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874005420 con 0x7f587c1449e0 2023-12-19T13:46:36.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.576+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0cd180 con 0x7f587c1449e0 2023-12-19T13:46:36.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.576+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0cd740 con 0x7f587c1449e0 2023-12-19T13:46:36.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.577+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c15cb00 con 0x7f587c1449e0 2023-12-19T13:46:36.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.578+0000 7f58797fa640 1 -- 172.21.15.113:0/1023065592 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5874005580 con 0x7f587c1449e0 2023-12-19T13:46:36.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.579+0000 7f58797fa640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:36.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.579+0000 7f58797fa640 1 -- 172.21.15.113:0/1023065592 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5874087ec0 con 0x7f587c1449e0 2023-12-19T13:46:36.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.579+0000 7f58809b3640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:36.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.580+0000 7f58809b3640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.583+0000 7f58797fa640 1 -- 172.21.15.113:0/1023065592 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5874053410 con 0x7f587c1449e0 2023-12-19T13:46:36.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.768+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f587c0ae2e0 con 0x7f586006a430 2023-12-19T13:46:36.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.787+0000 7f58797fa640 1 -- 172.21.15.113:0/1023065592 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259993 (secure 0 0 0) 0x7f587c0ae2e0 con 0x7f586006a430 2023-12-19T13:46:36.791 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:36.792 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:46:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.791+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 msgr2=0x7f586006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.791+0000 7f5882c17640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870008040 comp rx=0 tx=0).stop 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c1449e0 msgr2=0x7f587c0ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c1449e0 0x7f587c0ce3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f587400c7b0 tx=0x7f587400cc70 comp rx=0 tx=0).stop 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 shutdown_connections 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f587c1449e0 0x7f587c0ce3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c0b0b50 0x7f587c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 --2- 172.21.15.113:0/1023065592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c06b590 0x7f587c1f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 >> 172.21.15.113:0/1023065592 conn(0x7f587c0cbb70 msgr2=0x7f587c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 shutdown_connections 2023-12-19T13:46:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:36.792+0000 7f5882c17640 1 -- 172.21.15.113:0/1023065592 wait complete. 2023-12-19T13:46:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T13:46:36.411358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001804"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479619+0000","last_change":"2023-12-19T13:46:30.947466+0000","last_active":"2023-12-19T13:46:32.479619+0000","last_peered":"2023-12-19T13:46:32.479619+0000","last_clean":"2023-12-19T13:46:32.479619+0000","last_became_active":"2023-12-19T13:46:30.944804+0000","last_became_peered":"2023-12-19T13:46:30.944804+0000","last_unstale":"2023-12-19T13:46:32.479619+0000","last_undegraded":"2023-12-19T13:46:32.479619+0000","last_fullsized":"2023-12-19T13:46:32.479619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949108+0000","last_change":"2023-12-19T13:46:30.947759+0000","last_active":"2023-12-19T13:46:30.949108+0000","last_peered":"2023-12-19T13:46:30.949108+0000","last_clean":"2023-12-19T13:46:30.949108+0000","last_became_active":"2023-12-19T13:46:30.947539+0000","last_became_peered":"2023-12-19T13:46:30.947539+0000","last_unstale":"2023-12-19T13:46:30.949108+0000","last_undegraded":"2023-12-19T13:46:30.949108+0000","last_fullsized":"2023-12-19T13:46:30.949108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949060+0000","last_change":"2023-12-19T13:46:30.947127+0000","last_active":"2023-12-19T13:46:30.949060+0000","last_peered":"2023-12-19T13:46:30.949060+0000","last_clean":"2023-12-19T13:46:30.949060+0000","last_became_active":"2023-12-19T13:46:30.946112+0000","last_became_peered":"2023-12-19T13:46:30.946112+0000","last_unstale":"2023-12-19T13:46:30.949060+0000","last_undegraded":"2023-12-19T13:46:30.949060+0000","last_fullsized":"2023-12-19T13:46:30.949060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:31.692673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932443+0000","last_change":"2023-12-19T13:46:30.944335+0000","last_active":"2023-12-19T13:46:31.932443+0000","last_peered":"2023-12-19T13:46:31.932443+0000","last_clean":"2023-12-19T13:46:31.932443+0000","last_became_active":"2023-12-19T13:46:30.943978+0000","last_became_peered":"2023-12-19T13:46:30.943978+0000","last_unstale":"2023-12-19T13:46:31.932443+0000","last_undegraded":"2023-12-19T13:46:31.932443+0000","last_fullsized":"2023-12-19T13:46:31.932443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480797+0000","last_change":"2023-12-19T13:46:30.958489+0000","last_active":"2023-12-19T13:46:32.480797+0000","last_peered":"2023-12-19T13:46:32.480797+0000","last_clean":"2023-12-19T13:46:32.480797+0000","last_became_active":"2023-12-19T13:46:30.957947+0000","last_became_peered":"2023-12-19T13:46:30.957947+0000","last_unstale":"2023-12-19T13:46:32.480797+0000","last_undegraded":"2023-12-19T13:46:32.480797+0000","last_fullsized":"2023-12-19T13:46:32.480797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932704+0000","last_change":"2023-12-19T13:46:30.941012+0000","last_active":"2023-12-19T13:46:31.932704+0000","last_peered":"2023-12-19T13:46:31.932704+0000","last_clean":"2023-12-19T13:46:31.932704+0000","last_became_active":"2023-12-19T13:46:30.940674+0000","last_became_peered":"2023-12-19T13:46:30.940674+0000","last_unstale":"2023-12-19T13:46:31.932704+0000","last_undegraded":"2023-12-19T13:46:31.932704+0000","last_fullsized":"2023-12-19T13:46:31.932704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480352+0000","last_change":"2023-12-19T13:46:30.956208+0000","last_active":"2023-12-19T13:46:32.480352+0000","last_peered":"2023-12-19T13:46:32.480352+0000","last_clean":"2023-12-19T13:46:32.480352+0000","last_became_active":"2023-12-19T13:46:30.954562+0000","last_became_peered":"2023-12-19T13:46:30.954562+0000","last_unstale":"2023-12-19T13:46:32.480352+0000","last_undegraded":"2023-12-19T13:46:32.480352+0000","last_fullsized":"2023-12-19T13:46:32.480352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951004+0000","last_change":"2023-12-19T13:46:30.949875+0000","last_active":"2023-12-19T13:46:30.951004+0000","last_peered":"2023-12-19T13:46:30.951004+0000","last_clean":"2023-12-19T13:46:30.951004+0000","last_became_active":"2023-12-19T13:46:30.949625+0000","last_became_peered":"2023-12-19T13:46:30.949625+0000","last_unstale":"2023-12-19T13:46:30.951004+0000","last_undegraded":"2023-12-19T13:46:30.951004+0000","last_fullsized":"2023-12-19T13:46:30.951004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:18.684952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478175+0000","last_change":"2023-12-19T13:46:30.940157+0000","last_active":"2023-12-19T13:46:32.478175+0000","last_peered":"2023-12-19T13:46:32.478175+0000","last_clean":"2023-12-19T13:46:32.478175+0000","last_became_active":"2023-12-19T13:46:30.939947+0000","last_became_peered":"2023-12-19T13:46:30.939947+0000","last_unstale":"2023-12-19T13:46:32.478175+0000","last_undegraded":"2023-12-19T13:46:32.478175+0000","last_fullsized":"2023-12-19T13:46:32.478175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480049+0000","last_change":"2023-12-19T13:46:30.958360+0000","last_active":"2023-12-19T13:46:32.480049+0000","last_peered":"2023-12-19T13:46:32.480049+0000","last_clean":"2023-12-19T13:46:32.480049+0000","last_became_active":"2023-12-19T13:46:30.957433+0000","last_became_peered":"2023-12-19T13:46:30.957433+0000","last_unstale":"2023-12-19T13:46:32.480049+0000","last_undegraded":"2023-12-19T13:46:32.480049+0000","last_fullsized":"2023-12-19T13:46:32.480049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479889+0000","last_change":"2023-12-19T13:46:30.946461+0000","last_active":"2023-12-19T13:46:32.479889+0000","last_peered":"2023-12-19T13:46:32.479889+0000","last_clean":"2023-12-19T13:46:32.479889+0000","last_became_active":"2023-12-19T13:46:30.944536+0000","last_became_peered":"2023-12-19T13:46:30.944536+0000","last_unstale":"2023-12-19T13:46:32.479889+0000","last_undegraded":"2023-12-19T13:46:32.479889+0000","last_fullsized":"2023-12-19T13:46:32.479889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479093+0000","last_change":"2023-12-19T13:46:30.955116+0000","last_active":"2023-12-19T13:46:32.479093+0000","last_peered":"2023-12-19T13:46:32.479093+0000","last_clean":"2023-12-19T13:46:32.479093+0000","last_became_active":"2023-12-19T13:46:30.954208+0000","last_became_peered":"2023-12-19T13:46:30.954208+0000","last_unstale":"2023-12-19T13:46:32.479093+0000","last_undegraded":"2023-12-19T13:46:32.479093+0000","last_fullsized":"2023-12-19T13:46:32.479093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477789+0000","last_change":"2023-12-19T13:46:30.951097+0000","last_active":"2023-12-19T13:46:32.477789+0000","last_peered":"2023-12-19T13:46:32.477789+0000","last_clean":"2023-12-19T13:46:32.477789+0000","last_became_active":"2023-12-19T13:46:30.950596+0000","last_became_peered":"2023-12-19T13:46:30.950596+0000","last_unstale":"2023-12-19T13:46:32.477789+0000","last_undegraded":"2023-12-19T13:46:32.477789+0000","last_fullsized":"2023-12-19T13:46:32.477789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477725+0000","last_change":"2023-12-19T13:46:30.951645+0000","last_active":"2023-12-19T13:46:32.477725+0000","last_peered":"2023-12-19T13:46:32.477725+0000","last_clean":"2023-12-19T13:46:32.477725+0000","last_became_active":"2023-12-19T13:46:30.951372+0000","last_became_peered":"2023-12-19T13:46:30.951372+0000","last_unstale":"2023-12-19T13:46:32.477725+0000","last_undegraded":"2023-12-19T13:46:32.477725+0000","last_fullsized":"2023-12-19T13:46:32.477725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960243+0000","last_change":"2023-12-19T13:46:30.960188+0000","last_active":"2023-12-19T13:46:30.960243+0000","last_peered":"2023-12-19T13:46:30.960243+0000","last_clean":"2023-12-19T13:46:30.960243+0000","last_became_active":"2023-12-19T13:46:30.959885+0000","last_became_peered":"2023-12-19T13:46:30.959885+0000","last_unstale":"2023-12-19T13:46:30.960243+0000","last_undegraded":"2023-12-19T13:46:30.960243+0000","last_fullsized":"2023-12-19T13:46:30.960243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481033+0000","last_change":"2023-12-19T13:46:30.932726+0000","last_active":"2023-12-19T13:46:32.481033+0000","last_peered":"2023-12-19T13:46:32.481033+0000","last_clean":"2023-12-19T13:46:32.481033+0000","last_became_active":"2023-12-19T13:46:30.931668+0000","last_became_peered":"2023-12-19T13:46:30.931668+0000","last_unstale":"2023-12-19T13:46:32.481033+0000","last_undegraded":"2023-12-19T13:46:32.481033+0000","last_fullsized":"2023-12-19T13:46:32.481033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478349+0000","last_change":"2023-12-19T13:46:30.957418+0000","last_active":"2023-12-19T13:46:32.478349+0000","last_peered":"2023-12-19T13:46:32.478349+0000","last_clean":"2023-12-19T13:46:32.478349+0000","last_became_active":"2023-12-19T13:46:30.957187+0000","last_became_peered":"2023-12-19T13:46:30.957187+0000","last_unstale":"2023-12-19T13:46:32.478349+0000","last_undegraded":"2023-12-19T13:46:32.478349+0000","last_fullsized":"2023-12-19T13:46:32.478349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:03.460723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.934059+0000","last_change":"2023-12-19T13:46:30.933939+0000","last_active":"2023-12-19T13:46:30.934059+0000","last_peered":"2023-12-19T13:46:30.934059+0000","last_clean":"2023-12-19T13:46:30.934059+0000","last_became_active":"2023-12-19T13:46:30.933698+0000","last_became_peered":"2023-12-19T13:46:30.933698+0000","last_unstale":"2023-12-19T13:46:30.934059+0000","last_undegraded":"2023-12-19T13:46:30.934059+0000","last_fullsized":"2023-12-19T13:46:30.934059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478667+0000","last_change":"2023-12-19T13:46:30.954479+0000","last_active":"2023-12-19T13:46:32.478667+0000","last_peered":"2023-12-19T13:46:32.478667+0000","last_clean":"2023-12-19T13:46:32.478667+0000","last_became_active":"2023-12-19T13:46:30.953640+0000","last_became_peered":"2023-12-19T13:46:30.953640+0000","last_unstale":"2023-12-19T13:46:32.478667+0000","last_undegraded":"2023-12-19T13:46:32.478667+0000","last_fullsized":"2023-12-19T13:46:32.478667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:14.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480286+0000","last_change":"2023-12-19T13:46:30.957735+0000","last_active":"2023-12-19T13:46:32.480286+0000","last_peered":"2023-12-19T13:46:32.480286+0000","last_clean":"2023-12-19T13:46:32.480286+0000","last_became_active":"2023-12-19T13:46:30.954757+0000","last_became_peered":"2023-12-19T13:46:30.954757+0000","last_unstale":"2023-12-19T13:46:32.480286+0000","last_undegraded":"2023-12-19T13:46:32.480286+0000","last_fullsized":"2023-12-19T13:46:32.480286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928022+0000","last_change":"2023-12-19T13:46:30.935192+0000","last_active":"2023-12-19T13:46:31.928022+0000","last_peered":"2023-12-19T13:46:31.928022+0000","last_clean":"2023-12-19T13:46:31.928022+0000","last_became_active":"2023-12-19T13:46:30.934966+0000","last_became_peered":"2023-12-19T13:46:30.934966+0000","last_unstale":"2023-12-19T13:46:31.928022+0000","last_undegraded":"2023-12-19T13:46:31.928022+0000","last_fullsized":"2023-12-19T13:46:31.928022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479248+0000","last_change":"2023-12-19T13:46:30.957999+0000","last_active":"2023-12-19T13:46:32.479248+0000","last_peered":"2023-12-19T13:46:32.479248+0000","last_clean":"2023-12-19T13:46:32.479248+0000","last_became_active":"2023-12-19T13:46:30.957775+0000","last_became_peered":"2023-12-19T13:46:30.957775+0000","last_unstale":"2023-12-19T13:46:32.479248+0000","last_undegraded":"2023-12-19T13:46:32.479248+0000","last_fullsized":"2023-12-19T13:46:32.479248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950982+0000","last_change":"2023-12-19T13:46:30.949299+0000","last_active":"2023-12-19T13:46:30.950982+0000","last_peered":"2023-12-19T13:46:30.950982+0000","last_clean":"2023-12-19T13:46:30.950982+0000","last_became_active":"2023-12-19T13:46:30.946882+0000","last_became_peered":"2023-12-19T13:46:30.946882+0000","last_unstale":"2023-12-19T13:46:30.950982+0000","last_undegraded":"2023-12-19T13:46:30.950982+0000","last_fullsized":"2023-12-19T13:46:30.950982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477911+0000","last_change":"2023-12-19T13:46:30.954278+0000","last_active":"2023-12-19T13:46:32.477911+0000","last_peered":"2023-12-19T13:46:32.477911+0000","last_clean":"2023-12-19T13:46:32.477911+0000","last_became_active":"2023-12-19T13:46:30.952450+0000","last_became_peered":"2023-12-19T13:46:30.952450+0000","last_unstale":"2023-12-19T13:46:32.477911+0000","last_undegraded":"2023-12-19T13:46:32.477911+0000","last_fullsized":"2023-12-19T13:46:32.477911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955765+0000","last_change":"2023-12-19T13:46:30.954346+0000","last_active":"2023-12-19T13:46:30.955765+0000","last_peered":"2023-12-19T13:46:30.955765+0000","last_clean":"2023-12-19T13:46:30.955765+0000","last_became_active":"2023-12-19T13:46:30.952500+0000","last_became_peered":"2023-12-19T13:46:30.952500+0000","last_unstale":"2023-12-19T13:46:30.955765+0000","last_undegraded":"2023-12-19T13:46:30.955765+0000","last_fullsized":"2023-12-19T13:46:30.955765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932905+0000","last_change":"2023-12-19T13:46:30.931389+0000","last_active":"2023-12-19T13:46:31.932905+0000","last_peered":"2023-12-19T13:46:31.932905+0000","last_clean":"2023-12-19T13:46:31.932905+0000","last_became_active":"2023-12-19T13:46:30.931071+0000","last_became_peered":"2023-12-19T13:46:30.931071+0000","last_unstale":"2023-12-19T13:46:31.932905+0000","last_undegraded":"2023-12-19T13:46:31.932905+0000","last_fullsized":"2023-12-19T13:46:31.932905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478415+0000","last_change":"2023-12-19T13:46:30.952230+0000","last_active":"2023-12-19T13:46:32.478415+0000","last_peered":"2023-12-19T13:46:32.478415+0000","last_clean":"2023-12-19T13:46:32.478415+0000","last_became_active":"2023-12-19T13:46:30.952001+0000","last_became_peered":"2023-12-19T13:46:30.952001+0000","last_unstale":"2023-12-19T13:46:32.478415+0000","last_undegraded":"2023-12-19T13:46:32.478415+0000","last_fullsized":"2023-12-19T13:46:32.478415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:02.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479226+0000","last_change":"2023-12-19T13:46:30.950882+0000","last_active":"2023-12-19T13:46:32.479226+0000","last_peered":"2023-12-19T13:46:32.479226+0000","last_clean":"2023-12-19T13:46:32.479226+0000","last_became_active":"2023-12-19T13:46:30.950214+0000","last_became_peered":"2023-12-19T13:46:30.950214+0000","last_unstale":"2023-12-19T13:46:32.479226+0000","last_undegraded":"2023-12-19T13:46:32.479226+0000","last_fullsized":"2023-12-19T13:46:32.479226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952004+0000","last_change":"2023-12-19T13:46:30.948716+0000","last_active":"2023-12-19T13:46:30.952004+0000","last_peered":"2023-12-19T13:46:30.952004+0000","last_clean":"2023-12-19T13:46:30.952004+0000","last_became_active":"2023-12-19T13:46:30.948483+0000","last_became_peered":"2023-12-19T13:46:30.948483+0000","last_unstale":"2023-12-19T13:46:30.952004+0000","last_undegraded":"2023-12-19T13:46:30.952004+0000","last_fullsized":"2023-12-19T13:46:30.952004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480930+0000","last_change":"2023-12-19T13:46:30.950655+0000","last_active":"2023-12-19T13:46:32.480930+0000","last_peered":"2023-12-19T13:46:32.480930+0000","last_clean":"2023-12-19T13:46:32.480930+0000","last_became_active":"2023-12-19T13:46:30.950446+0000","last_became_peered":"2023-12-19T13:46:30.950446+0000","last_unstale":"2023-12-19T13:46:32.480930+0000","last_undegraded":"2023-12-19T13:46:32.480930+0000","last_fullsized":"2023-12-19T13:46:32.480930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:05.776092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939565+0000","last_change":"2023-12-19T13:46:30.938955+0000","last_active":"2023-12-19T13:46:30.939565+0000","last_peered":"2023-12-19T13:46:30.939565+0000","last_clean":"2023-12-19T13:46:30.939565+0000","last_became_active":"2023-12-19T13:46:30.938382+0000","last_became_peered":"2023-12-19T13:46:30.938382+0000","last_unstale":"2023-12-19T13:46:30.939565+0000","last_undegraded":"2023-12-19T13:46:30.939565+0000","last_fullsized":"2023-12-19T13:46:30.939565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932221+0000","last_change":"2023-12-19T13:46:30.949294+0000","last_active":"2023-12-19T13:46:31.932221+0000","last_peered":"2023-12-19T13:46:31.932221+0000","last_clean":"2023-12-19T13:46:31.932221+0000","last_became_active":"2023-12-19T13:46:30.949073+0000","last_became_peered":"2023-12-19T13:46:30.949073+0000","last_unstale":"2023-12-19T13:46:31.932221+0000","last_undegraded":"2023-12-19T13:46:31.932221+0000","last_fullsized":"2023-12-19T13:46:31.932221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478387+0000","last_change":"2023-12-19T13:46:30.950387+0000","last_active":"2023-12-19T13:46:32.478387+0000","last_peered":"2023-12-19T13:46:32.478387+0000","last_clean":"2023-12-19T13:46:32.478387+0000","last_became_active":"2023-12-19T13:46:30.947508+0000","last_became_peered":"2023-12-19T13:46:30.947508+0000","last_unstale":"2023-12-19T13:46:32.478387+0000","last_undegraded":"2023-12-19T13:46:32.478387+0000","last_fullsized":"2023-12-19T13:46:32.478387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955028+0000","last_change":"2023-12-19T13:46:30.463700+0000","last_active":"2023-12-19T13:46:30.955028+0000","last_peered":"2023-12-19T13:46:30.955028+0000","last_clean":"2023-12-19T13:46:30.955028+0000","last_became_active":"2023-12-19T13:46:30.463230+0000","last_became_peered":"2023-12-19T13:46:30.463230+0000","last_unstale":"2023-12-19T13:46:30.955028+0000","last_undegraded":"2023-12-19T13:46:30.955028+0000","last_fullsized":"2023-12-19T13:46:30.955028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927907+0000","last_change":"2023-12-19T13:46:30.956149+0000","last_active":"2023-12-19T13:46:31.927907+0000","last_peered":"2023-12-19T13:46:31.927907+0000","last_clean":"2023-12-19T13:46:31.927907+0000","last_became_active":"2023-12-19T13:46:30.955830+0000","last_became_peered":"2023-12-19T13:46:30.955830+0000","last_unstale":"2023-12-19T13:46:31.927907+0000","last_undegraded":"2023-12-19T13:46:31.927907+0000","last_fullsized":"2023-12-19T13:46:31.927907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960209+0000","last_change":"2023-12-19T13:46:30.467903+0000","last_active":"2023-12-19T13:46:30.960209+0000","last_peered":"2023-12-19T13:46:30.960209+0000","last_clean":"2023-12-19T13:46:30.960209+0000","last_became_active":"2023-12-19T13:46:30.467653+0000","last_became_peered":"2023-12-19T13:46:30.467653+0000","last_unstale":"2023-12-19T13:46:30.960209+0000","last_undegraded":"2023-12-19T13:46:30.960209+0000","last_fullsized":"2023-12-19T13:46:30.960209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:33.124713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938449+0000","last_change":"2023-12-19T13:46:30.470689+0000","last_active":"2023-12-19T13:46:30.938449+0000","last_peered":"2023-12-19T13:46:30.938449+0000","last_clean":"2023-12-19T13:46:30.938449+0000","last_became_active":"2023-12-19T13:46:30.470436+0000","last_became_peered":"2023-12-19T13:46:30.470436+0000","last_unstale":"2023-12-19T13:46:30.938449+0000","last_undegraded":"2023-12-19T13:46:30.938449+0000","last_fullsized":"2023-12-19T13:46:30.938449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955782+0000","last_change":"2023-12-19T13:46:30.954917+0000","last_active":"2023-12-19T13:46:30.955782+0000","last_peered":"2023-12-19T13:46:30.955782+0000","last_clean":"2023-12-19T13:46:30.955782+0000","last_became_active":"2023-12-19T13:46:30.954590+0000","last_became_peered":"2023-12-19T13:46:30.954590+0000","last_unstale":"2023-12-19T13:46:30.955782+0000","last_undegraded":"2023-12-19T13:46:30.955782+0000","last_fullsized":"2023-12-19T13:46:30.955782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926484+0000","last_change":"2023-12-19T13:46:30.450013+0000","last_active":"2023-12-19T13:46:30.926484+0000","last_peered":"2023-12-19T13:46:30.926484+0000","last_clean":"2023-12-19T13:46:30.926484+0000","last_became_active":"2023-12-19T13:46:30.449760+0000","last_became_peered":"2023-12-19T13:46:30.449760+0000","last_unstale":"2023-12-19T13:46:30.926484+0000","last_undegraded":"2023-12-19T13:46:30.926484+0000","last_fullsized":"2023-12-19T13:46:30.926484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:03.646304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927969+0000","last_change":"2023-12-19T13:46:30.943118+0000","last_active":"2023-12-19T13:46:31.927969+0000","last_peered":"2023-12-19T13:46:31.927969+0000","last_clean":"2023-12-19T13:46:31.927969+0000","last_became_active":"2023-12-19T13:46:30.942893+0000","last_became_peered":"2023-12-19T13:46:30.942893+0000","last_unstale":"2023-12-19T13:46:31.927969+0000","last_undegraded":"2023-12-19T13:46:31.927969+0000","last_fullsized":"2023-12-19T13:46:31.927969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937097+0000","last_change":"2023-12-19T13:46:30.465649+0000","last_active":"2023-12-19T13:46:30.937097+0000","last_peered":"2023-12-19T13:46:30.937097+0000","last_clean":"2023-12-19T13:46:30.937097+0000","last_became_active":"2023-12-19T13:46:30.457418+0000","last_became_peered":"2023-12-19T13:46:30.457418+0000","last_unstale":"2023-12-19T13:46:30.937097+0000","last_undegraded":"2023-12-19T13:46:30.937097+0000","last_fullsized":"2023-12-19T13:46:30.937097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:09.441431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932357+0000","last_change":"2023-12-19T13:46:30.940866+0000","last_active":"2023-12-19T13:46:31.932357+0000","last_peered":"2023-12-19T13:46:31.932357+0000","last_clean":"2023-12-19T13:46:31.932357+0000","last_became_active":"2023-12-19T13:46:30.940000+0000","last_became_peered":"2023-12-19T13:46:30.940000+0000","last_unstale":"2023-12-19T13:46:31.932357+0000","last_undegraded":"2023-12-19T13:46:31.932357+0000","last_fullsized":"2023-12-19T13:46:31.932357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:54.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.948940+0000","last_change":"2023-12-19T13:46:30.471859+0000","last_active":"2023-12-19T13:46:30.948940+0000","last_peered":"2023-12-19T13:46:30.948940+0000","last_clean":"2023-12-19T13:46:30.948940+0000","last_became_active":"2023-12-19T13:46:30.471277+0000","last_became_peered":"2023-12-19T13:46:30.471277+0000","last_unstale":"2023-12-19T13:46:30.948940+0000","last_undegraded":"2023-12-19T13:46:30.948940+0000","last_fullsized":"2023-12-19T13:46:30.948940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952022+0000","last_change":"2023-12-19T13:46:30.951516+0000","last_active":"2023-12-19T13:46:30.952022+0000","last_peered":"2023-12-19T13:46:30.952022+0000","last_clean":"2023-12-19T13:46:30.952022+0000","last_became_active":"2023-12-19T13:46:30.951275+0000","last_became_peered":"2023-12-19T13:46:30.951275+0000","last_unstale":"2023-12-19T13:46:30.952022+0000","last_undegraded":"2023-12-19T13:46:30.952022+0000","last_fullsized":"2023-12-19T13:46:30.952022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951214+0000","last_change":"2023-12-19T13:46:30.464446+0000","last_active":"2023-12-19T13:46:30.951214+0000","last_peered":"2023-12-19T13:46:30.951214+0000","last_clean":"2023-12-19T13:46:30.951214+0000","last_became_active":"2023-12-19T13:46:30.463227+0000","last_became_peered":"2023-12-19T13:46:30.463227+0000","last_unstale":"2023-12-19T13:46:30.951214+0000","last_undegraded":"2023-12-19T13:46:30.951214+0000","last_fullsized":"2023-12-19T13:46:30.951214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478163+0000","last_change":"2023-12-19T13:46:30.937059+0000","last_active":"2023-12-19T13:46:32.478163+0000","last_peered":"2023-12-19T13:46:32.478163+0000","last_clean":"2023-12-19T13:46:32.478163+0000","last_became_active":"2023-12-19T13:46:30.936498+0000","last_became_peered":"2023-12-19T13:46:30.936498+0000","last_unstale":"2023-12-19T13:46:32.478163+0000","last_undegraded":"2023-12-19T13:46:32.478163+0000","last_fullsized":"2023-12-19T13:46:32.478163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958001+0000","last_change":"2023-12-19T13:46:30.465379+0000","last_active":"2023-12-19T13:46:30.958001+0000","last_peered":"2023-12-19T13:46:30.958001+0000","last_clean":"2023-12-19T13:46:30.958001+0000","last_became_active":"2023-12-19T13:46:30.464638+0000","last_became_peered":"2023-12-19T13:46:30.464638+0000","last_unstale":"2023-12-19T13:46:30.958001+0000","last_undegraded":"2023-12-19T13:46:30.958001+0000","last_fullsized":"2023-12-19T13:46:30.958001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:40.827653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479035+0000","last_change":"2023-12-19T13:46:30.954585+0000","last_active":"2023-12-19T13:46:32.479035+0000","last_peered":"2023-12-19T13:46:32.479035+0000","last_clean":"2023-12-19T13:46:32.479035+0000","last_became_active":"2023-12-19T13:46:30.954225+0000","last_became_peered":"2023-12-19T13:46:30.954225+0000","last_unstale":"2023-12-19T13:46:32.479035+0000","last_undegraded":"2023-12-19T13:46:32.479035+0000","last_fullsized":"2023-12-19T13:46:32.479035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959430+0000","last_change":"2023-12-19T13:46:30.467738+0000","last_active":"2023-12-19T13:46:30.959430+0000","last_peered":"2023-12-19T13:46:30.959430+0000","last_clean":"2023-12-19T13:46:30.959430+0000","last_became_active":"2023-12-19T13:46:30.467458+0000","last_became_peered":"2023-12-19T13:46:30.467458+0000","last_unstale":"2023-12-19T13:46:30.959430+0000","last_undegraded":"2023-12-19T13:46:30.959430+0000","last_fullsized":"2023-12-19T13:46:30.959430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477744+0000","last_change":"2023-12-19T13:46:30.945420+0000","last_active":"2023-12-19T13:46:32.477744+0000","last_peered":"2023-12-19T13:46:32.477744+0000","last_clean":"2023-12-19T13:46:32.477744+0000","last_became_active":"2023-12-19T13:46:30.945196+0000","last_became_peered":"2023-12-19T13:46:30.945196+0000","last_unstale":"2023-12-19T13:46:32.477744+0000","last_undegraded":"2023-12-19T13:46:32.477744+0000","last_fullsized":"2023-12-19T13:46:32.477744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925451+0000","last_change":"2023-12-19T13:46:30.460639+0000","last_active":"2023-12-19T13:46:30.925451+0000","last_peered":"2023-12-19T13:46:30.925451+0000","last_clean":"2023-12-19T13:46:30.925451+0000","last_became_active":"2023-12-19T13:46:30.460292+0000","last_became_peered":"2023-12-19T13:46:30.460292+0000","last_unstale":"2023-12-19T13:46:30.925451+0000","last_undegraded":"2023-12-19T13:46:30.925451+0000","last_fullsized":"2023-12-19T13:46:30.925451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:01.555601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481397+0000","last_change":"2023-12-19T13:46:30.959817+0000","last_active":"2023-12-19T13:46:32.481397+0000","last_peered":"2023-12-19T13:46:32.481397+0000","last_clean":"2023-12-19T13:46:32.481397+0000","last_became_active":"2023-12-19T13:46:30.959575+0000","last_became_peered":"2023-12-19T13:46:30.959575+0000","last_unstale":"2023-12-19T13:46:32.481397+0000","last_undegraded":"2023-12-19T13:46:32.481397+0000","last_fullsized":"2023-12-19T13:46:32.481397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:10.080876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949079+0000","last_change":"2023-12-19T13:46:30.471710+0000","last_active":"2023-12-19T13:46:30.949079+0000","last_peered":"2023-12-19T13:46:30.949079+0000","last_clean":"2023-12-19T13:46:30.949079+0000","last_became_active":"2023-12-19T13:46:30.470939+0000","last_became_peered":"2023-12-19T13:46:30.470939+0000","last_unstale":"2023-12-19T13:46:30.949079+0000","last_undegraded":"2023-12-19T13:46:30.949079+0000","last_fullsized":"2023-12-19T13:46:30.949079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478648+0000","last_change":"2023-12-19T13:46:30.947790+0000","last_active":"2023-12-19T13:46:32.478648+0000","last_peered":"2023-12-19T13:46:32.478648+0000","last_clean":"2023-12-19T13:46:32.478648+0000","last_became_active":"2023-12-19T13:46:30.947145+0000","last_became_peered":"2023-12-19T13:46:30.947145+0000","last_unstale":"2023-12-19T13:46:32.478648+0000","last_undegraded":"2023-12-19T13:46:32.478648+0000","last_fullsized":"2023-12-19T13:46:32.478648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.957777+0000","last_change":"2023-12-19T13:46:30.465840+0000","last_active":"2023-12-19T13:46:30.957777+0000","last_peered":"2023-12-19T13:46:30.957777+0000","last_clean":"2023-12-19T13:46:30.957777+0000","last_became_active":"2023-12-19T13:46:30.465539+0000","last_became_peered":"2023-12-19T13:46:30.465539+0000","last_unstale":"2023-12-19T13:46:30.957777+0000","last_undegraded":"2023-12-19T13:46:30.957777+0000","last_fullsized":"2023-12-19T13:46:30.957777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478618+0000","last_change":"2023-12-19T13:46:30.935669+0000","last_active":"2023-12-19T13:46:32.478618+0000","last_peered":"2023-12-19T13:46:32.478618+0000","last_clean":"2023-12-19T13:46:32.478618+0000","last_became_active":"2023-12-19T13:46:30.931664+0000","last_became_peered":"2023-12-19T13:46:30.931664+0000","last_unstale":"2023-12-19T13:46:32.478618+0000","last_undegraded":"2023-12-19T13:46:32.478618+0000","last_fullsized":"2023-12-19T13:46:32.478618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956431+0000","last_change":"2023-12-19T13:46:30.469934+0000","last_active":"2023-12-19T13:46:30.956431+0000","last_peered":"2023-12-19T13:46:30.956431+0000","last_clean":"2023-12-19T13:46:30.956431+0000","last_became_active":"2023-12-19T13:46:30.469677+0000","last_became_peered":"2023-12-19T13:46:30.469677+0000","last_unstale":"2023-12-19T13:46:30.956431+0000","last_undegraded":"2023-12-19T13:46:30.956431+0000","last_fullsized":"2023-12-19T13:46:30.956431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932472+0000","last_change":"2023-12-19T13:46:30.955967+0000","last_active":"2023-12-19T13:46:31.932472+0000","last_peered":"2023-12-19T13:46:31.932472+0000","last_clean":"2023-12-19T13:46:31.932472+0000","last_became_active":"2023-12-19T13:46:30.955703+0000","last_became_peered":"2023-12-19T13:46:30.955703+0000","last_unstale":"2023-12-19T13:46:31.932472+0000","last_undegraded":"2023-12-19T13:46:31.932472+0000","last_fullsized":"2023-12-19T13:46:31.932472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:34.137836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956418+0000","last_change":"2023-12-19T13:46:30.463235+0000","last_active":"2023-12-19T13:46:30.956418+0000","last_peered":"2023-12-19T13:46:30.956418+0000","last_clean":"2023-12-19T13:46:30.956418+0000","last_became_active":"2023-12-19T13:46:30.462908+0000","last_became_peered":"2023-12-19T13:46:30.462908+0000","last_unstale":"2023-12-19T13:46:30.956418+0000","last_undegraded":"2023-12-19T13:46:30.956418+0000","last_fullsized":"2023-12-19T13:46:30.956418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477974+0000","last_change":"2023-12-19T13:46:30.947024+0000","last_active":"2023-12-19T13:46:32.477974+0000","last_peered":"2023-12-19T13:46:32.477974+0000","last_clean":"2023-12-19T13:46:32.477974+0000","last_became_active":"2023-12-19T13:46:30.946825+0000","last_became_peered":"2023-12-19T13:46:30.946825+0000","last_unstale":"2023-12-19T13:46:32.477974+0000","last_undegraded":"2023-12-19T13:46:32.477974+0000","last_fullsized":"2023-12-19T13:46:32.477974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953122+0000","last_change":"2023-12-19T13:46:30.456074+0000","last_active":"2023-12-19T13:46:30.953122+0000","last_peered":"2023-12-19T13:46:30.953122+0000","last_clean":"2023-12-19T13:46:30.953122+0000","last_became_active":"2023-12-19T13:46:30.455381+0000","last_became_peered":"2023-12-19T13:46:30.455381+0000","last_unstale":"2023-12-19T13:46:30.953122+0000","last_undegraded":"2023-12-19T13:46:30.953122+0000","last_fullsized":"2023-12-19T13:46:30.953122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479507+0000","last_change":"2023-12-19T13:46:30.956360+0000","last_active":"2023-12-19T13:46:32.479507+0000","last_peered":"2023-12-19T13:46:32.479507+0000","last_clean":"2023-12-19T13:46:32.479507+0000","last_became_active":"2023-12-19T13:46:30.954873+0000","last_became_peered":"2023-12-19T13:46:30.954873+0000","last_unstale":"2023-12-19T13:46:32.479507+0000","last_undegraded":"2023-12-19T13:46:32.479507+0000","last_fullsized":"2023-12-19T13:46:32.479507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939117+0000","last_change":"2023-12-19T13:46:30.471994+0000","last_active":"2023-12-19T13:46:30.939117+0000","last_peered":"2023-12-19T13:46:30.939117+0000","last_clean":"2023-12-19T13:46:30.939117+0000","last_became_active":"2023-12-19T13:46:30.471851+0000","last_became_peered":"2023-12-19T13:46:30.471851+0000","last_unstale":"2023-12-19T13:46:30.939117+0000","last_undegraded":"2023-12-19T13:46:30.939117+0000","last_fullsized":"2023-12-19T13:46:30.939117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481270+0000","last_change":"2023-12-19T13:46:30.939193+0000","last_active":"2023-12-19T13:46:32.481270+0000","last_peered":"2023-12-19T13:46:32.481270+0000","last_clean":"2023-12-19T13:46:32.481270+0000","last_became_active":"2023-12-19T13:46:30.938853+0000","last_became_peered":"2023-12-19T13:46:30.938853+0000","last_unstale":"2023-12-19T13:46:32.481270+0000","last_undegraded":"2023-12-19T13:46:32.481270+0000","last_fullsized":"2023-12-19T13:46:32.481270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:31.136164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937637+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:46:30.937637+0000","last_peered":"2023-12-19T13:46:30.937637+0000","last_clean":"2023-12-19T13:46:30.937637+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:46:30.937637+0000","last_undegraded":"2023-12-19T13:46:30.937637+0000","last_fullsized":"2023-12-19T13:46:30.937637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925861+0000","last_change":"2023-12-19T13:46:30.466620+0000","last_active":"2023-12-19T13:46:30.925861+0000","last_peered":"2023-12-19T13:46:30.925861+0000","last_clean":"2023-12-19T13:46:30.925861+0000","last_became_active":"2023-12-19T13:46:30.466140+0000","last_became_peered":"2023-12-19T13:46:30.466140+0000","last_unstale":"2023-12-19T13:46:30.925861+0000","last_undegraded":"2023-12-19T13:46:30.925861+0000","last_fullsized":"2023-12-19T13:46:30.925861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:54.770943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928217+0000","last_change":"2023-12-19T13:46:30.935325+0000","last_active":"2023-12-19T13:46:31.928217+0000","last_peered":"2023-12-19T13:46:31.928217+0000","last_clean":"2023-12-19T13:46:31.928217+0000","last_became_active":"2023-12-19T13:46:30.934910+0000","last_became_peered":"2023-12-19T13:46:30.934910+0000","last_unstale":"2023-12-19T13:46:31.928217+0000","last_undegraded":"2023-12-19T13:46:31.928217+0000","last_fullsized":"2023-12-19T13:46:31.928217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928316+0000","last_change":"2023-12-19T13:46:30.468537+0000","last_active":"2023-12-19T13:46:30.928316+0000","last_peered":"2023-12-19T13:46:30.928316+0000","last_clean":"2023-12-19T13:46:30.928316+0000","last_became_active":"2023-12-19T13:46:30.468301+0000","last_became_peered":"2023-12-19T13:46:30.468301+0000","last_unstale":"2023-12-19T13:46:30.928316+0000","last_undegraded":"2023-12-19T13:46:30.928316+0000","last_fullsized":"2023-12-19T13:46:30.928316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:39.901573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479355+0000","last_change":"2023-12-19T13:46:30.947051+0000","last_active":"2023-12-19T13:46:32.479355+0000","last_peered":"2023-12-19T13:46:32.479355+0000","last_clean":"2023-12-19T13:46:32.479355+0000","last_became_active":"2023-12-19T13:46:30.946837+0000","last_became_peered":"2023-12-19T13:46:30.946837+0000","last_unstale":"2023-12-19T13:46:32.479355+0000","last_undegraded":"2023-12-19T13:46:32.479355+0000","last_fullsized":"2023-12-19T13:46:32.479355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.929140+0000","last_change":"2023-12-19T13:46:30.456665+0000","last_active":"2023-12-19T13:46:30.929140+0000","last_peered":"2023-12-19T13:46:30.929140+0000","last_clean":"2023-12-19T13:46:30.929140+0000","last_became_active":"2023-12-19T13:46:30.456068+0000","last_became_peered":"2023-12-19T13:46:30.456068+0000","last_unstale":"2023-12-19T13:46:30.929140+0000","last_undegraded":"2023-12-19T13:46:30.929140+0000","last_fullsized":"2023-12-19T13:46:30.929140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.944823+0000","last_change":"2023-12-19T13:46:30.944565+0000","last_active":"2023-12-19T13:46:30.944823+0000","last_peered":"2023-12-19T13:46:30.944823+0000","last_clean":"2023-12-19T13:46:30.944823+0000","last_became_active":"2023-12-19T13:46:30.944091+0000","last_became_peered":"2023-12-19T13:46:30.944091+0000","last_unstale":"2023-12-19T13:46:30.944823+0000","last_undegraded":"2023-12-19T13:46:30.944823+0000","last_fullsized":"2023-12-19T13:46:30.944823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926212+0000","last_change":"2023-12-19T13:46:30.463352+0000","last_active":"2023-12-19T13:46:30.926212+0000","last_peered":"2023-12-19T13:46:30.926212+0000","last_clean":"2023-12-19T13:46:30.926212+0000","last_became_active":"2023-12-19T13:46:30.463056+0000","last_became_peered":"2023-12-19T13:46:30.463056+0000","last_unstale":"2023-12-19T13:46:30.926212+0000","last_undegraded":"2023-12-19T13:46:30.926212+0000","last_fullsized":"2023-12-19T13:46:30.926212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480115+0000","last_change":"2023-12-19T13:46:30.948432+0000","last_active":"2023-12-19T13:46:32.480115+0000","last_peered":"2023-12-19T13:46:32.480115+0000","last_clean":"2023-12-19T13:46:32.480115+0000","last_became_active":"2023-12-19T13:46:30.948068+0000","last_became_peered":"2023-12-19T13:46:30.948068+0000","last_unstale":"2023-12-19T13:46:32.480115+0000","last_undegraded":"2023-12-19T13:46:32.480115+0000","last_fullsized":"2023-12-19T13:46:32.480115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.941985+0000","last_change":"2023-12-19T13:46:30.463018+0000","last_active":"2023-12-19T13:46:30.941985+0000","last_peered":"2023-12-19T13:46:30.941985+0000","last_clean":"2023-12-19T13:46:30.941985+0000","last_became_active":"2023-12-19T13:46:30.462528+0000","last_became_peered":"2023-12-19T13:46:30.462528+0000","last_unstale":"2023-12-19T13:46:30.941985+0000","last_undegraded":"2023-12-19T13:46:30.941985+0000","last_fullsized":"2023-12-19T13:46:30.941985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932691+0000","last_change":"2023-12-19T13:46:30.949775+0000","last_active":"2023-12-19T13:46:31.932691+0000","last_peered":"2023-12-19T13:46:31.932691+0000","last_clean":"2023-12-19T13:46:31.932691+0000","last_became_active":"2023-12-19T13:46:30.949527+0000","last_became_peered":"2023-12-19T13:46:30.949527+0000","last_unstale":"2023-12-19T13:46:31.932691+0000","last_undegraded":"2023-12-19T13:46:31.932691+0000","last_fullsized":"2023-12-19T13:46:31.932691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928099+0000","last_change":"2023-12-19T13:46:30.463359+0000","last_active":"2023-12-19T13:46:30.928099+0000","last_peered":"2023-12-19T13:46:30.928099+0000","last_clean":"2023-12-19T13:46:30.928099+0000","last_became_active":"2023-12-19T13:46:30.463093+0000","last_became_peered":"2023-12-19T13:46:30.463093+0000","last_unstale":"2023-12-19T13:46:30.928099+0000","last_undegraded":"2023-12-19T13:46:30.928099+0000","last_fullsized":"2023-12-19T13:46:30.928099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:58.990876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478303+0000","last_change":"2023-12-19T13:46:30.954730+0000","last_active":"2023-12-19T13:46:32.478303+0000","last_peered":"2023-12-19T13:46:32.478303+0000","last_clean":"2023-12-19T13:46:32.478303+0000","last_became_active":"2023-12-19T13:46:30.954495+0000","last_became_peered":"2023-12-19T13:46:30.954495+0000","last_unstale":"2023-12-19T13:46:32.478303+0000","last_undegraded":"2023-12-19T13:46:32.478303+0000","last_fullsized":"2023-12-19T13:46:32.478303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:08.682812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932324+0000","last_change":"2023-12-19T13:46:30.470099+0000","last_active":"2023-12-19T13:46:30.932324+0000","last_peered":"2023-12-19T13:46:30.932324+0000","last_clean":"2023-12-19T13:46:30.932324+0000","last_became_active":"2023-12-19T13:46:30.469960+0000","last_became_peered":"2023-12-19T13:46:30.469960+0000","last_unstale":"2023-12-19T13:46:30.932324+0000","last_undegraded":"2023-12-19T13:46:30.932324+0000","last_fullsized":"2023-12-19T13:46:30.932324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928069+0000","last_change":"2023-12-19T13:46:30.944631+0000","last_active":"2023-12-19T13:46:31.928069+0000","last_peered":"2023-12-19T13:46:31.928069+0000","last_clean":"2023-12-19T13:46:31.928069+0000","last_became_active":"2023-12-19T13:46:30.943922+0000","last_became_peered":"2023-12-19T13:46:30.943922+0000","last_unstale":"2023-12-19T13:46:31.928069+0000","last_undegraded":"2023-12-19T13:46:31.928069+0000","last_fullsized":"2023-12-19T13:46:31.928069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959854+0000","last_change":"2023-12-19T13:46:30.472244+0000","last_active":"2023-12-19T13:46:30.959854+0000","last_peered":"2023-12-19T13:46:30.959854+0000","last_clean":"2023-12-19T13:46:30.959854+0000","last_became_active":"2023-12-19T13:46:30.471954+0000","last_became_peered":"2023-12-19T13:46:30.471954+0000","last_unstale":"2023-12-19T13:46:30.959854+0000","last_undegraded":"2023-12-19T13:46:30.959854+0000","last_fullsized":"2023-12-19T13:46:30.959854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927854+0000","last_change":"2023-12-19T13:46:30.939034+0000","last_active":"2023-12-19T13:46:31.927854+0000","last_peered":"2023-12-19T13:46:31.927854+0000","last_clean":"2023-12-19T13:46:31.927854+0000","last_became_active":"2023-12-19T13:46:30.938407+0000","last_became_peered":"2023-12-19T13:46:30.938407+0000","last_unstale":"2023-12-19T13:46:31.927854+0000","last_undegraded":"2023-12-19T13:46:31.927854+0000","last_fullsized":"2023-12-19T13:46:31.927854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.936764+0000","last_change":"2023-12-19T13:46:30.469524+0000","last_active":"2023-12-19T13:46:30.936764+0000","last_peered":"2023-12-19T13:46:30.936764+0000","last_clean":"2023-12-19T13:46:30.936764+0000","last_became_active":"2023-12-19T13:46:30.467130+0000","last_became_peered":"2023-12-19T13:46:30.467130+0000","last_unstale":"2023-12-19T13:46:30.936764+0000","last_undegraded":"2023-12-19T13:46:30.936764+0000","last_fullsized":"2023-12-19T13:46:30.936764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:25.754683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481642+0000","last_change":"2023-12-19T13:46:30.948464+0000","last_active":"2023-12-19T13:46:32.481642+0000","last_peered":"2023-12-19T13:46:32.481642+0000","last_clean":"2023-12-19T13:46:32.481642+0000","last_became_active":"2023-12-19T13:46:30.941429+0000","last_became_peered":"2023-12-19T13:46:30.941429+0000","last_unstale":"2023-12-19T13:46:32.481642+0000","last_undegraded":"2023-12-19T13:46:32.481642+0000","last_fullsized":"2023-12-19T13:46:32.481642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:14.644536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932435+0000","last_change":"2023-12-19T13:46:30.467632+0000","last_active":"2023-12-19T13:46:30.932435+0000","last_peered":"2023-12-19T13:46:30.932435+0000","last_clean":"2023-12-19T13:46:30.932435+0000","last_became_active":"2023-12-19T13:46:30.467326+0000","last_became_peered":"2023-12-19T13:46:30.467326+0000","last_unstale":"2023-12-19T13:46:30.932435+0000","last_undegraded":"2023-12-19T13:46:30.932435+0000","last_fullsized":"2023-12-19T13:46:30.932435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928264+0000","last_change":"2023-12-19T13:46:30.945501+0000","last_active":"2023-12-19T13:46:31.928264+0000","last_peered":"2023-12-19T13:46:31.928264+0000","last_clean":"2023-12-19T13:46:31.928264+0000","last_became_active":"2023-12-19T13:46:30.945070+0000","last_became_peered":"2023-12-19T13:46:30.945070+0000","last_unstale":"2023-12-19T13:46:31.928264+0000","last_undegraded":"2023-12-19T13:46:31.928264+0000","last_fullsized":"2023-12-19T13:46:31.928264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938563+0000","last_change":"2023-12-19T13:46:30.468143+0000","last_active":"2023-12-19T13:46:30.938563+0000","last_peered":"2023-12-19T13:46:30.938563+0000","last_clean":"2023-12-19T13:46:30.938563+0000","last_became_active":"2023-12-19T13:46:30.467699+0000","last_became_peered":"2023-12-19T13:46:30.467699+0000","last_unstale":"2023-12-19T13:46:30.938563+0000","last_undegraded":"2023-12-19T13:46:30.938563+0000","last_fullsized":"2023-12-19T13:46:30.938563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.947589+0000","last_change":"2023-12-19T13:46:30.947222+0000","last_active":"2023-12-19T13:46:30.947589+0000","last_peered":"2023-12-19T13:46:30.947589+0000","last_clean":"2023-12-19T13:46:30.947589+0000","last_became_active":"2023-12-19T13:46:30.947006+0000","last_became_peered":"2023-12-19T13:46:30.947006+0000","last_unstale":"2023-12-19T13:46:30.947589+0000","last_undegraded":"2023-12-19T13:46:30.947589+0000","last_fullsized":"2023-12-19T13:46:30.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958497+0000","last_change":"2023-12-19T13:46:30.465441+0000","last_active":"2023-12-19T13:46:30.958497+0000","last_peered":"2023-12-19T13:46:30.958497+0000","last_clean":"2023-12-19T13:46:30.958497+0000","last_became_active":"2023-12-19T13:46:30.465103+0000","last_became_peered":"2023-12-19T13:46:30.465103+0000","last_unstale":"2023-12-19T13:46:30.958497+0000","last_undegraded":"2023-12-19T13:46:30.958497+0000","last_fullsized":"2023-12-19T13:46:30.958497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478407+0000","last_change":"2023-12-19T13:46:30.952729+0000","last_active":"2023-12-19T13:46:32.478407+0000","last_peered":"2023-12-19T13:46:32.478407+0000","last_clean":"2023-12-19T13:46:32.478407+0000","last_became_active":"2023-12-19T13:46:30.950922+0000","last_became_peered":"2023-12-19T13:46:30.950922+0000","last_unstale":"2023-12-19T13:46:32.478407+0000","last_undegraded":"2023-12-19T13:46:32.478407+0000","last_fullsized":"2023-12-19T13:46:32.478407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:13.580642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481163+0000","last_change":"2023-12-19T13:46:30.957451+0000","last_active":"2023-12-19T13:46:32.481163+0000","last_peered":"2023-12-19T13:46:32.481163+0000","last_clean":"2023-12-19T13:46:32.481163+0000","last_became_active":"2023-12-19T13:46:30.955947+0000","last_became_peered":"2023-12-19T13:46:30.955947+0000","last_unstale":"2023-12-19T13:46:32.481163+0000","last_undegraded":"2023-12-19T13:46:32.481163+0000","last_fullsized":"2023-12-19T13:46:32.481163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:07.116909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959781+0000","last_change":"2023-12-19T13:46:30.470680+0000","last_active":"2023-12-19T13:46:30.959781+0000","last_peered":"2023-12-19T13:46:30.959781+0000","last_clean":"2023-12-19T13:46:30.959781+0000","last_became_active":"2023-12-19T13:46:30.470409+0000","last_became_peered":"2023-12-19T13:46:30.470409+0000","last_unstale":"2023-12-19T13:46:30.959781+0000","last_undegraded":"2023-12-19T13:46:30.959781+0000","last_fullsized":"2023-12-19T13:46:30.959781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479758+0000","last_change":"2023-12-19T13:46:30.946912+0000","last_active":"2023-12-19T13:46:32.479758+0000","last_peered":"2023-12-19T13:46:32.479758+0000","last_clean":"2023-12-19T13:46:32.479758+0000","last_became_active":"2023-12-19T13:46:30.946689+0000","last_became_peered":"2023-12-19T13:46:30.946689+0000","last_unstale":"2023-12-19T13:46:32.479758+0000","last_undegraded":"2023-12-19T13:46:32.479758+0000","last_fullsized":"2023-12-19T13:46:32.479758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960456+0000","last_change":"2023-12-19T13:46:30.470862+0000","last_active":"2023-12-19T13:46:30.960456+0000","last_peered":"2023-12-19T13:46:30.960456+0000","last_clean":"2023-12-19T13:46:30.960456+0000","last_became_active":"2023-12-19T13:46:30.470428+0000","last_became_peered":"2023-12-19T13:46:30.470428+0000","last_unstale":"2023-12-19T13:46:30.960456+0000","last_undegraded":"2023-12-19T13:46:30.960456+0000","last_fullsized":"2023-12-19T13:46:30.960456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950966+0000","last_change":"2023-12-19T13:46:30.949145+0000","last_active":"2023-12-19T13:46:30.950966+0000","last_peered":"2023-12-19T13:46:30.950966+0000","last_clean":"2023-12-19T13:46:30.950966+0000","last_became_active":"2023-12-19T13:46:30.946515+0000","last_became_peered":"2023-12-19T13:46:30.946515+0000","last_unstale":"2023-12-19T13:46:30.950966+0000","last_undegraded":"2023-12-19T13:46:30.950966+0000","last_fullsized":"2023-12-19T13:46:30.950966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953453+0000","last_change":"2023-12-19T13:46:30.449386+0000","last_active":"2023-12-19T13:46:30.953453+0000","last_peered":"2023-12-19T13:46:30.953453+0000","last_clean":"2023-12-19T13:46:30.953453+0000","last_became_active":"2023-12-19T13:46:30.448900+0000","last_became_peered":"2023-12-19T13:46:30.448900+0000","last_unstale":"2023-12-19T13:46:30.953453+0000","last_undegraded":"2023-12-19T13:46:30.953453+0000","last_fullsized":"2023-12-19T13:46:30.953453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952114+0000","last_change":"2023-12-19T13:46:30.952009+0000","last_active":"2023-12-19T13:46:30.952114+0000","last_peered":"2023-12-19T13:46:30.952114+0000","last_clean":"2023-12-19T13:46:30.952114+0000","last_became_active":"2023-12-19T13:46:30.951734+0000","last_became_peered":"2023-12-19T13:46:30.951734+0000","last_unstale":"2023-12-19T13:46:30.952114+0000","last_undegraded":"2023-12-19T13:46:30.952114+0000","last_fullsized":"2023-12-19T13:46:30.952114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959118+0000","last_change":"2023-12-19T13:46:30.458973+0000","last_active":"2023-12-19T13:46:30.959118+0000","last_peered":"2023-12-19T13:46:30.959118+0000","last_clean":"2023-12-19T13:46:30.959118+0000","last_became_active":"2023-12-19T13:46:30.458267+0000","last_became_peered":"2023-12-19T13:46:30.458267+0000","last_unstale":"2023-12-19T13:46:30.959118+0000","last_undegraded":"2023-12-19T13:46:30.959118+0000","last_fullsized":"2023-12-19T13:46:30.959118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]}],"pool_statfs":[]}} 2023-12-19T13:46:36.819 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T13:46:37.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.068+0000 7ff92de34640 1 Processor -- start 2023-12-19T13:46:37.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.068+0000 7ff92de34640 1 -- start start 2023-12-19T13:46:37.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff92de34640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff92815b1e0 0x7ff92815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff92de34640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff92815a8a0 0x7ff92815b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff92de34640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92806b520 con 0x7ff928159f80 2023-12-19T13:46:37.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff92de34640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9280b2b20 con 0x7ff92815b1e0 2023-12-19T13:46:37.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff92de34640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9280b2fb0 con 0x7ff92815a8a0 2023-12-19T13:46:37.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff91ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff92815b1e0 0x7ff92815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff92ce32640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff928159f80 0x7ff92806f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37490/0 (socket says 172.21.15.113:37490) 2023-12-19T13:46:37.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.070+0000 7ff92ce32640 1 -- 172.21.15.113:0/1879652765 learned_addr learned my addr 172.21.15.113:0/1879652765 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:37.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff91f7fe640 1 -- 172.21.15.113:0/1879652765 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959389185 0 0) 0x7ff92806b520 con 0x7ff928159f80 2023-12-19T13:46:37.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff91f7fe640 1 -- 172.21.15.113:0/1879652765 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff910005730 con 0x7ff928159f80 2023-12-19T13:46:37.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff92d633640 1 --2- 172.21.15.113:0/1879652765 >> v2:172.21.15.151:3300/0 conn(0x7ff92815a8a0 0x7ff92815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff91ffff640 1 -- 172.21.15.113:0/1879652765 >> v2:172.21.15.151:3300/0 conn(0x7ff92815a8a0 msgr2=0x7ff92815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:37.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff91ffff640 1 --2- 172.21.15.113:0/1879652765 >> v2:172.21.15.151:3300/0 conn(0x7ff92815a8a0 0x7ff92815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff91ffff640 1 -- 172.21.15.113:0/1879652765 >> v1:172.21.15.113:6789/0 conn(0x7ff928159f80 legacy=0x7ff92806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff91ffff640 1 -- 172.21.15.113:0/1879652765 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280b1f10 con 0x7ff92815b1e0 2023-12-19T13:46:37.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.071+0000 7ff92d633640 1 --2- 172.21.15.113:0/1879652765 >> v2:172.21.15.151:3300/0 conn(0x7ff92815a8a0 0x7ff92815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.072+0000 7ff91ffff640 1 --2- 172.21.15.113:0/1879652765 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff92815a360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff9280ae020 tx=0x7ff91802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ff6d1b52ae15c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.072+0000 7ff91f7fe640 1 -- 172.21.15.113:0/1879652765 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918030610 con 0x7ff92815b1e0 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.072+0000 7ff91f7fe640 1 -- 172.21.15.113:0/1879652765 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918030770 con 0x7ff92815b1e0 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.072+0000 7ff91f7fe640 1 -- 172.21.15.113:0/1879652765 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918030b00 con 0x7ff92815b1e0 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 -- 172.21.15.113:0/1879652765 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 msgr2=0x7ff92815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 --2- 172.21.15.113:0/1879652765 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff92815a360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff9280ae020 tx=0x7ff91802b960 comp rx=0 tx=0).stop 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 -- 172.21.15.113:0/1879652765 shutdown_connections 2023-12-19T13:46:37.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 --2- 172.21.15.113:0/1879652765 >> v2:172.21.15.151:3300/0 conn(0x7ff92815a8a0 0x7ff92815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 --2- 172.21.15.113:0/1879652765 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff92815a360 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 -- 172.21.15.113:0/1879652765 >> 172.21.15.113:0/1879652765 conn(0x7ff9280b0100 msgr2=0x7ff9280b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:37.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 -- 172.21.15.113:0/1879652765 shutdown_connections 2023-12-19T13:46:37.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.073+0000 7ff92de34640 1 -- 172.21.15.113:0/1879652765 wait complete. 2023-12-19T13:46:37.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.075+0000 7ff92de34640 1 Processor -- start 2023-12-19T13:46:37.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.075+0000 7ff92de34640 1 -- start start 2023-12-19T13:46:37.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92de34640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff928159f80 0x7ff92806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92de34640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff92815a8a0 0x7ff928146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92de34640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff928151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92de34640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92806e300 con 0x7ff92815b1e0 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92de34640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281470e0 con 0x7ff92815a8a0 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92de34640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281503d0 con 0x7ff928159f80 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff928151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff928151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35674/0 (socket says 172.21.15.113:35674) 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 -- 172.21.15.113:0/3572671883 learned_addr learned my addr 172.21.15.113:0/3572671883 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff91ffff640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff92815a8a0 0x7ff928146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92ce32640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff928159f80 0x7ff92806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 -- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff928159f80 msgr2=0x7ff92806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff928159f80 0x7ff92806ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 -- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff92815a8a0 msgr2=0x7ff928146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff92815a8a0 0x7ff928146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.076+0000 7ff92d633640 1 -- 172.21.15.113:0/3572671883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918009400 con 0x7ff92815b1e0 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.077+0000 7ff92d633640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff928151470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c7f0 tx=0x7ff92000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.077+0000 7ff91d7fa640 1 -- 172.21.15.113:0/3572671883 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920007820 con 0x7ff92815b1e0 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.077+0000 7ff91d7fa640 1 -- 172.21.15.113:0/3572671883 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920007980 con 0x7ff92815b1e0 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.077+0000 7ff91d7fa640 1 -- 172.21.15.113:0/3572671883 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920007d70 con 0x7ff92815b1e0 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.077+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9281506b0 con 0x7ff92815b1e0 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.077+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff928150c70 con 0x7ff92815b1e0 2023-12-19T13:46:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.078+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff928061910 con 0x7ff92815b1e0 2023-12-19T13:46:37.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.079+0000 7ff91d7fa640 1 -- 172.21.15.113:0/3572671883 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9200113f0 con 0x7ff92815b1e0 2023-12-19T13:46:37.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.080+0000 7ff91d7fa640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff91406a460 0x7ff91406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.080+0000 7ff91d7fa640 1 -- 172.21.15.113:0/3572671883 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff920088bc0 con 0x7ff92815b1e0 2023-12-19T13:46:37.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.080+0000 7ff92ce32640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff91406a460 0x7ff91406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.081+0000 7ff92ce32640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff91406a460 0x7ff91406c920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff924001560 tx=0x7ff924009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.084+0000 7ff91d7fa640 1 -- 172.21.15.113:0/3572671883 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff920054240 con 0x7ff92815b1e0 2023-12-19T13:46:37.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.331+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff9280b0f70 con 0x7ff92815b1e0 2023-12-19T13:46:37.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.332+0000 7ff91d7fa640 1 -- 172.21.15.113:0/3572671883 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1004 (secure 0 0 0) 0x7ff92001f400 con 0x7ff92815b1e0 2023-12-19T13:46:37.333 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:37.333 INFO:teuthology.orchestra.run.smithi113.stdout:{"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1702993580,"num_in_osds":8,"osd_in_since":1702993577,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":1751364,"bytes_avail":1598248636,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4264}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-12-19T13:46:13.659977+0000","services":{}},"progress_events":{}} 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.334+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff91406a460 msgr2=0x7ff91406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.334+0000 7ff92de34640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff91406a460 0x7ff91406c920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff924001560 tx=0x7ff924009040 comp rx=0 tx=0).stop 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 msgr2=0x7ff928151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff928151470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c7f0 tx=0x7ff92000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 shutdown_connections 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff91406a460 0x7ff91406c920 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff92815b1e0 0x7ff928151470 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff92815a8a0 0x7ff928146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 --2- 172.21.15.113:0/3572671883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff928159f80 0x7ff92806ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 >> 172.21.15.113:0/3572671883 conn(0x7ff9280b0100 msgr2=0x7ff9280b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:37.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 shutdown_connections 2023-12-19T13:46:37.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.335+0000 7ff92de34640 1 -- 172.21.15.113:0/3572671883 wait complete. 2023-12-19T13:46:37.352 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T13:46:37.352 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:46:37.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.556+0000 7fe8206b9640 1 Processor -- start 2023-12-19T13:46:37.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.556+0000 7fe8206b9640 1 -- start start 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe8206b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe818146e10 0x7fe8180d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe8206b9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe8180ce110 0x7fe8180ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe8206b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8180cd840 con 0x7fe8180d2b00 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe8206b9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8180d2430 con 0x7fe8180ce110 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe8206b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8180ceac0 con 0x7fe818146e10 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe81dc54640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe8180d2b00 0x7fe8180b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37494/0 (socket says 172.21.15.113:37494) 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe81dc54640 1 -- 172.21.15.113:0/3612595265 learned_addr learned my addr 172.21.15.113:0/3612595265 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:37.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.558+0000 7fe81ec56640 1 --2- 172.21.15.113:0/3612595265 >> v2:172.21.15.113:3300/0 conn(0x7fe8180ce110 0x7fe8180ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.559+0000 7fe81e455640 1 --2- 172.21.15.113:0/3612595265 >> v2:172.21.15.151:3300/0 conn(0x7fe818146e10 0x7fe8180d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.559+0000 7fe81ec56640 1 -- 172.21.15.113:0/3612595265 >> v2:172.21.15.151:3300/0 conn(0x7fe818146e10 msgr2=0x7fe8180d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:37.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.559+0000 7fe81ec56640 1 --2- 172.21.15.113:0/3612595265 >> v2:172.21.15.151:3300/0 conn(0x7fe818146e10 0x7fe8180d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.559+0000 7fe81ec56640 1 -- 172.21.15.113:0/3612595265 >> v1:172.21.15.113:6789/0 conn(0x7fe8180d2b00 legacy=0x7fe8180b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.559+0000 7fe81ec56640 1 -- 172.21.15.113:0/3612595265 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180b6e90 con 0x7fe8180ce110 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.560+0000 7fe81ec56640 1 --2- 172.21.15.113:0/3612595265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8180ce110 0x7fe8180ce580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8180d0720 tx=0x7fe81002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d7e40c401b0a9e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.560+0000 7fe81d453640 1 -- 172.21.15.113:0/3612595265 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81002cbd0 con 0x7fe8180ce110 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.560+0000 7fe81d453640 1 -- 172.21.15.113:0/3612595265 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81002cd30 con 0x7fe8180ce110 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.560+0000 7fe81d453640 1 -- 172.21.15.113:0/3612595265 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81002cea0 con 0x7fe8180ce110 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 -- 172.21.15.113:0/3612595265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8180ce110 msgr2=0x7fe8180ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 --2- 172.21.15.113:0/3612595265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8180ce110 0x7fe8180ce580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8180d0720 tx=0x7fe81002be20 comp rx=0 tx=0).stop 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 -- 172.21.15.113:0/3612595265 shutdown_connections 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 --2- 172.21.15.113:0/3612595265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8180ce110 0x7fe8180ce580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 --2- 172.21.15.113:0/3612595265 >> v2:172.21.15.151:3300/0 conn(0x7fe818146e10 0x7fe8180d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 -- 172.21.15.113:0/3612595265 >> 172.21.15.113:0/3612595265 conn(0x7fe8180b29c0 msgr2=0x7fe8180b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 -- 172.21.15.113:0/3612595265 shutdown_connections 2023-12-19T13:46:37.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.561+0000 7fe8206b9640 1 -- 172.21.15.113:0/3612595265 wait complete. 2023-12-19T13:46:37.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.563+0000 7fe8206b9640 1 Processor -- start 2023-12-19T13:46:37.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.563+0000 7fe8206b9640 1 -- start start 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe8206b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8180ce110 0x7fe818159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe8206b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8180d2b00 0x7fe81815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe8206b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe818146e10 0x7fe81815e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe8206b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81815c3c0 con 0x7fe818146e10 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe8206b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818141400 con 0x7fe8180d2b00 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe8206b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81815be00 con 0x7fe8180ce110 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe81ec56640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe818146e10 0x7fe81815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe81ec56640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe818146e10 0x7fe81815e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35686/0 (socket says 172.21.15.113:35686) 2023-12-19T13:46:37.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.564+0000 7fe81ec56640 1 -- 172.21.15.113:0/173712732 learned_addr learned my addr 172.21.15.113:0/173712732 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81dc54640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8180d2b00 0x7fe81815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81e455640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8180ce110 0x7fe818159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81ec56640 1 -- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8180ce110 msgr2=0x7fe818159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81ec56640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8180ce110 0x7fe818159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81ec56640 1 -- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8180d2b00 msgr2=0x7fe81815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81ec56640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8180d2b00 0x7fe81815db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81ec56640 1 -- 172.21.15.113:0/173712732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810009a70 con 0x7fe818146e10 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe81ec56640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe818146e10 0x7fe81815e040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe810009d90 tx=0x7fe810004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe80effd640 1 -- 172.21.15.113:0/173712732 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81002cea0 con 0x7fe818146e10 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe80effd640 1 -- 172.21.15.113:0/173712732 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe810040670 con 0x7fe818146e10 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe80effd640 1 -- 172.21.15.113:0/173712732 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810040a20 con 0x7fe818146e10 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81815c0e0 con 0x7fe818146e10 2023-12-19T13:46:37.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.565+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81815b0d0 con 0x7fe818146e10 2023-12-19T13:46:37.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.566+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe818140e80 con 0x7fe818146e10 2023-12-19T13:46:37.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.567+0000 7fe80effd640 1 -- 172.21.15.113:0/173712732 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe810040b80 con 0x7fe818146e10 2023-12-19T13:46:37.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.568+0000 7fe80effd640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7fc06a430 0x7fe7fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:37.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.568+0000 7fe80effd640 1 -- 172.21.15.113:0/173712732 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8100ab620 con 0x7fe818146e10 2023-12-19T13:46:37.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.568+0000 7fe81e455640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7fc06a430 0x7fe7fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:37.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.569+0000 7fe81e455640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7fc06a430 0x7fe7fc06c8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe814006fd0 tx=0x7fe814008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:37.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.572+0000 7fe80effd640 1 -- 172.21.15.113:0/173712732 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe818140e80 con 0x7fe818146e10 2023-12-19T13:46:37.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.757+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8180b41c0 con 0x7fe7fc06a430 2023-12-19T13:46:37.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.765+0000 7fe80effd640 1 -- 172.21.15.113:0/173712732 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259993 (secure 0 0 0) 0x7fe814009d60 con 0x7fe7fc06a430 2023-12-19T13:46:37.769 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:37.771 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7fc06a430 msgr2=0x7fe7fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7fc06a430 0x7fe7fc06c8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe814006fd0 tx=0x7fe814008040 comp rx=0 tx=0).stop 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe818146e10 msgr2=0x7fe81815e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe818146e10 0x7fe81815e040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe810009d90 tx=0x7fe810004a40 comp rx=0 tx=0).stop 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 shutdown_connections 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7fc06a430 0x7fe7fc06c8f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe818146e10 0x7fe81815e040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8180d2b00 0x7fe81815db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 --2- 172.21.15.113:0/173712732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8180ce110 0x7fe818159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.770+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 >> 172.21.15.113:0/173712732 conn(0x7fe8180b29c0 msgr2=0x7fe8180b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.771+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 shutdown_connections 2023-12-19T13:46:37.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:37.771+0000 7fe8206b9640 1 -- 172.21.15.113:0/173712732 wait complete. 2023-12-19T13:46:37.790 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T13:46:36.411358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001804"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479619+0000","last_change":"2023-12-19T13:46:30.947466+0000","last_active":"2023-12-19T13:46:32.479619+0000","last_peered":"2023-12-19T13:46:32.479619+0000","last_clean":"2023-12-19T13:46:32.479619+0000","last_became_active":"2023-12-19T13:46:30.944804+0000","last_became_peered":"2023-12-19T13:46:30.944804+0000","last_unstale":"2023-12-19T13:46:32.479619+0000","last_undegraded":"2023-12-19T13:46:32.479619+0000","last_fullsized":"2023-12-19T13:46:32.479619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949108+0000","last_change":"2023-12-19T13:46:30.947759+0000","last_active":"2023-12-19T13:46:30.949108+0000","last_peered":"2023-12-19T13:46:30.949108+0000","last_clean":"2023-12-19T13:46:30.949108+0000","last_became_active":"2023-12-19T13:46:30.947539+0000","last_became_peered":"2023-12-19T13:46:30.947539+0000","last_unstale":"2023-12-19T13:46:30.949108+0000","last_undegraded":"2023-12-19T13:46:30.949108+0000","last_fullsized":"2023-12-19T13:46:30.949108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949060+0000","last_change":"2023-12-19T13:46:30.947127+0000","last_active":"2023-12-19T13:46:30.949060+0000","last_peered":"2023-12-19T13:46:30.949060+0000","last_clean":"2023-12-19T13:46:30.949060+0000","last_became_active":"2023-12-19T13:46:30.946112+0000","last_became_peered":"2023-12-19T13:46:30.946112+0000","last_unstale":"2023-12-19T13:46:30.949060+0000","last_undegraded":"2023-12-19T13:46:30.949060+0000","last_fullsized":"2023-12-19T13:46:30.949060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:31.692673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932443+0000","last_change":"2023-12-19T13:46:30.944335+0000","last_active":"2023-12-19T13:46:31.932443+0000","last_peered":"2023-12-19T13:46:31.932443+0000","last_clean":"2023-12-19T13:46:31.932443+0000","last_became_active":"2023-12-19T13:46:30.943978+0000","last_became_peered":"2023-12-19T13:46:30.943978+0000","last_unstale":"2023-12-19T13:46:31.932443+0000","last_undegraded":"2023-12-19T13:46:31.932443+0000","last_fullsized":"2023-12-19T13:46:31.932443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480797+0000","last_change":"2023-12-19T13:46:30.958489+0000","last_active":"2023-12-19T13:46:32.480797+0000","last_peered":"2023-12-19T13:46:32.480797+0000","last_clean":"2023-12-19T13:46:32.480797+0000","last_became_active":"2023-12-19T13:46:30.957947+0000","last_became_peered":"2023-12-19T13:46:30.957947+0000","last_unstale":"2023-12-19T13:46:32.480797+0000","last_undegraded":"2023-12-19T13:46:32.480797+0000","last_fullsized":"2023-12-19T13:46:32.480797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932704+0000","last_change":"2023-12-19T13:46:30.941012+0000","last_active":"2023-12-19T13:46:31.932704+0000","last_peered":"2023-12-19T13:46:31.932704+0000","last_clean":"2023-12-19T13:46:31.932704+0000","last_became_active":"2023-12-19T13:46:30.940674+0000","last_became_peered":"2023-12-19T13:46:30.940674+0000","last_unstale":"2023-12-19T13:46:31.932704+0000","last_undegraded":"2023-12-19T13:46:31.932704+0000","last_fullsized":"2023-12-19T13:46:31.932704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480352+0000","last_change":"2023-12-19T13:46:30.956208+0000","last_active":"2023-12-19T13:46:32.480352+0000","last_peered":"2023-12-19T13:46:32.480352+0000","last_clean":"2023-12-19T13:46:32.480352+0000","last_became_active":"2023-12-19T13:46:30.954562+0000","last_became_peered":"2023-12-19T13:46:30.954562+0000","last_unstale":"2023-12-19T13:46:32.480352+0000","last_undegraded":"2023-12-19T13:46:32.480352+0000","last_fullsized":"2023-12-19T13:46:32.480352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951004+0000","last_change":"2023-12-19T13:46:30.949875+0000","last_active":"2023-12-19T13:46:30.951004+0000","last_peered":"2023-12-19T13:46:30.951004+0000","last_clean":"2023-12-19T13:46:30.951004+0000","last_became_active":"2023-12-19T13:46:30.949625+0000","last_became_peered":"2023-12-19T13:46:30.949625+0000","last_unstale":"2023-12-19T13:46:30.951004+0000","last_undegraded":"2023-12-19T13:46:30.951004+0000","last_fullsized":"2023-12-19T13:46:30.951004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:18.684952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478175+0000","last_change":"2023-12-19T13:46:30.940157+0000","last_active":"2023-12-19T13:46:32.478175+0000","last_peered":"2023-12-19T13:46:32.478175+0000","last_clean":"2023-12-19T13:46:32.478175+0000","last_became_active":"2023-12-19T13:46:30.939947+0000","last_became_peered":"2023-12-19T13:46:30.939947+0000","last_unstale":"2023-12-19T13:46:32.478175+0000","last_undegraded":"2023-12-19T13:46:32.478175+0000","last_fullsized":"2023-12-19T13:46:32.478175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480049+0000","last_change":"2023-12-19T13:46:30.958360+0000","last_active":"2023-12-19T13:46:32.480049+0000","last_peered":"2023-12-19T13:46:32.480049+0000","last_clean":"2023-12-19T13:46:32.480049+0000","last_became_active":"2023-12-19T13:46:30.957433+0000","last_became_peered":"2023-12-19T13:46:30.957433+0000","last_unstale":"2023-12-19T13:46:32.480049+0000","last_undegraded":"2023-12-19T13:46:32.480049+0000","last_fullsized":"2023-12-19T13:46:32.480049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479889+0000","last_change":"2023-12-19T13:46:30.946461+0000","last_active":"2023-12-19T13:46:32.479889+0000","last_peered":"2023-12-19T13:46:32.479889+0000","last_clean":"2023-12-19T13:46:32.479889+0000","last_became_active":"2023-12-19T13:46:30.944536+0000","last_became_peered":"2023-12-19T13:46:30.944536+0000","last_unstale":"2023-12-19T13:46:32.479889+0000","last_undegraded":"2023-12-19T13:46:32.479889+0000","last_fullsized":"2023-12-19T13:46:32.479889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479093+0000","last_change":"2023-12-19T13:46:30.955116+0000","last_active":"2023-12-19T13:46:32.479093+0000","last_peered":"2023-12-19T13:46:32.479093+0000","last_clean":"2023-12-19T13:46:32.479093+0000","last_became_active":"2023-12-19T13:46:30.954208+0000","last_became_peered":"2023-12-19T13:46:30.954208+0000","last_unstale":"2023-12-19T13:46:32.479093+0000","last_undegraded":"2023-12-19T13:46:32.479093+0000","last_fullsized":"2023-12-19T13:46:32.479093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477789+0000","last_change":"2023-12-19T13:46:30.951097+0000","last_active":"2023-12-19T13:46:32.477789+0000","last_peered":"2023-12-19T13:46:32.477789+0000","last_clean":"2023-12-19T13:46:32.477789+0000","last_became_active":"2023-12-19T13:46:30.950596+0000","last_became_peered":"2023-12-19T13:46:30.950596+0000","last_unstale":"2023-12-19T13:46:32.477789+0000","last_undegraded":"2023-12-19T13:46:32.477789+0000","last_fullsized":"2023-12-19T13:46:32.477789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477725+0000","last_change":"2023-12-19T13:46:30.951645+0000","last_active":"2023-12-19T13:46:32.477725+0000","last_peered":"2023-12-19T13:46:32.477725+0000","last_clean":"2023-12-19T13:46:32.477725+0000","last_became_active":"2023-12-19T13:46:30.951372+0000","last_became_peered":"2023-12-19T13:46:30.951372+0000","last_unstale":"2023-12-19T13:46:32.477725+0000","last_undegraded":"2023-12-19T13:46:32.477725+0000","last_fullsized":"2023-12-19T13:46:32.477725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960243+0000","last_change":"2023-12-19T13:46:30.960188+0000","last_active":"2023-12-19T13:46:30.960243+0000","last_peered":"2023-12-19T13:46:30.960243+0000","last_clean":"2023-12-19T13:46:30.960243+0000","last_became_active":"2023-12-19T13:46:30.959885+0000","last_became_peered":"2023-12-19T13:46:30.959885+0000","last_unstale":"2023-12-19T13:46:30.960243+0000","last_undegraded":"2023-12-19T13:46:30.960243+0000","last_fullsized":"2023-12-19T13:46:30.960243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481033+0000","last_change":"2023-12-19T13:46:30.932726+0000","last_active":"2023-12-19T13:46:32.481033+0000","last_peered":"2023-12-19T13:46:32.481033+0000","last_clean":"2023-12-19T13:46:32.481033+0000","last_became_active":"2023-12-19T13:46:30.931668+0000","last_became_peered":"2023-12-19T13:46:30.931668+0000","last_unstale":"2023-12-19T13:46:32.481033+0000","last_undegraded":"2023-12-19T13:46:32.481033+0000","last_fullsized":"2023-12-19T13:46:32.481033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478349+0000","last_change":"2023-12-19T13:46:30.957418+0000","last_active":"2023-12-19T13:46:32.478349+0000","last_peered":"2023-12-19T13:46:32.478349+0000","last_clean":"2023-12-19T13:46:32.478349+0000","last_became_active":"2023-12-19T13:46:30.957187+0000","last_became_peered":"2023-12-19T13:46:30.957187+0000","last_unstale":"2023-12-19T13:46:32.478349+0000","last_undegraded":"2023-12-19T13:46:32.478349+0000","last_fullsized":"2023-12-19T13:46:32.478349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:03.460723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.934059+0000","last_change":"2023-12-19T13:46:30.933939+0000","last_active":"2023-12-19T13:46:30.934059+0000","last_peered":"2023-12-19T13:46:30.934059+0000","last_clean":"2023-12-19T13:46:30.934059+0000","last_became_active":"2023-12-19T13:46:30.933698+0000","last_became_peered":"2023-12-19T13:46:30.933698+0000","last_unstale":"2023-12-19T13:46:30.934059+0000","last_undegraded":"2023-12-19T13:46:30.934059+0000","last_fullsized":"2023-12-19T13:46:30.934059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478667+0000","last_change":"2023-12-19T13:46:30.954479+0000","last_active":"2023-12-19T13:46:32.478667+0000","last_peered":"2023-12-19T13:46:32.478667+0000","last_clean":"2023-12-19T13:46:32.478667+0000","last_became_active":"2023-12-19T13:46:30.953640+0000","last_became_peered":"2023-12-19T13:46:30.953640+0000","last_unstale":"2023-12-19T13:46:32.478667+0000","last_undegraded":"2023-12-19T13:46:32.478667+0000","last_fullsized":"2023-12-19T13:46:32.478667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:14.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480286+0000","last_change":"2023-12-19T13:46:30.957735+0000","last_active":"2023-12-19T13:46:32.480286+0000","last_peered":"2023-12-19T13:46:32.480286+0000","last_clean":"2023-12-19T13:46:32.480286+0000","last_became_active":"2023-12-19T13:46:30.954757+0000","last_became_peered":"2023-12-19T13:46:30.954757+0000","last_unstale":"2023-12-19T13:46:32.480286+0000","last_undegraded":"2023-12-19T13:46:32.480286+0000","last_fullsized":"2023-12-19T13:46:32.480286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928022+0000","last_change":"2023-12-19T13:46:30.935192+0000","last_active":"2023-12-19T13:46:31.928022+0000","last_peered":"2023-12-19T13:46:31.928022+0000","last_clean":"2023-12-19T13:46:31.928022+0000","last_became_active":"2023-12-19T13:46:30.934966+0000","last_became_peered":"2023-12-19T13:46:30.934966+0000","last_unstale":"2023-12-19T13:46:31.928022+0000","last_undegraded":"2023-12-19T13:46:31.928022+0000","last_fullsized":"2023-12-19T13:46:31.928022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479248+0000","last_change":"2023-12-19T13:46:30.957999+0000","last_active":"2023-12-19T13:46:32.479248+0000","last_peered":"2023-12-19T13:46:32.479248+0000","last_clean":"2023-12-19T13:46:32.479248+0000","last_became_active":"2023-12-19T13:46:30.957775+0000","last_became_peered":"2023-12-19T13:46:30.957775+0000","last_unstale":"2023-12-19T13:46:32.479248+0000","last_undegraded":"2023-12-19T13:46:32.479248+0000","last_fullsized":"2023-12-19T13:46:32.479248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950982+0000","last_change":"2023-12-19T13:46:30.949299+0000","last_active":"2023-12-19T13:46:30.950982+0000","last_peered":"2023-12-19T13:46:30.950982+0000","last_clean":"2023-12-19T13:46:30.950982+0000","last_became_active":"2023-12-19T13:46:30.946882+0000","last_became_peered":"2023-12-19T13:46:30.946882+0000","last_unstale":"2023-12-19T13:46:30.950982+0000","last_undegraded":"2023-12-19T13:46:30.950982+0000","last_fullsized":"2023-12-19T13:46:30.950982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477911+0000","last_change":"2023-12-19T13:46:30.954278+0000","last_active":"2023-12-19T13:46:32.477911+0000","last_peered":"2023-12-19T13:46:32.477911+0000","last_clean":"2023-12-19T13:46:32.477911+0000","last_became_active":"2023-12-19T13:46:30.952450+0000","last_became_peered":"2023-12-19T13:46:30.952450+0000","last_unstale":"2023-12-19T13:46:32.477911+0000","last_undegraded":"2023-12-19T13:46:32.477911+0000","last_fullsized":"2023-12-19T13:46:32.477911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955765+0000","last_change":"2023-12-19T13:46:30.954346+0000","last_active":"2023-12-19T13:46:30.955765+0000","last_peered":"2023-12-19T13:46:30.955765+0000","last_clean":"2023-12-19T13:46:30.955765+0000","last_became_active":"2023-12-19T13:46:30.952500+0000","last_became_peered":"2023-12-19T13:46:30.952500+0000","last_unstale":"2023-12-19T13:46:30.955765+0000","last_undegraded":"2023-12-19T13:46:30.955765+0000","last_fullsized":"2023-12-19T13:46:30.955765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932905+0000","last_change":"2023-12-19T13:46:30.931389+0000","last_active":"2023-12-19T13:46:31.932905+0000","last_peered":"2023-12-19T13:46:31.932905+0000","last_clean":"2023-12-19T13:46:31.932905+0000","last_became_active":"2023-12-19T13:46:30.931071+0000","last_became_peered":"2023-12-19T13:46:30.931071+0000","last_unstale":"2023-12-19T13:46:31.932905+0000","last_undegraded":"2023-12-19T13:46:31.932905+0000","last_fullsized":"2023-12-19T13:46:31.932905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478415+0000","last_change":"2023-12-19T13:46:30.952230+0000","last_active":"2023-12-19T13:46:32.478415+0000","last_peered":"2023-12-19T13:46:32.478415+0000","last_clean":"2023-12-19T13:46:32.478415+0000","last_became_active":"2023-12-19T13:46:30.952001+0000","last_became_peered":"2023-12-19T13:46:30.952001+0000","last_unstale":"2023-12-19T13:46:32.478415+0000","last_undegraded":"2023-12-19T13:46:32.478415+0000","last_fullsized":"2023-12-19T13:46:32.478415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:02.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479226+0000","last_change":"2023-12-19T13:46:30.950882+0000","last_active":"2023-12-19T13:46:32.479226+0000","last_peered":"2023-12-19T13:46:32.479226+0000","last_clean":"2023-12-19T13:46:32.479226+0000","last_became_active":"2023-12-19T13:46:30.950214+0000","last_became_peered":"2023-12-19T13:46:30.950214+0000","last_unstale":"2023-12-19T13:46:32.479226+0000","last_undegraded":"2023-12-19T13:46:32.479226+0000","last_fullsized":"2023-12-19T13:46:32.479226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952004+0000","last_change":"2023-12-19T13:46:30.948716+0000","last_active":"2023-12-19T13:46:30.952004+0000","last_peered":"2023-12-19T13:46:30.952004+0000","last_clean":"2023-12-19T13:46:30.952004+0000","last_became_active":"2023-12-19T13:46:30.948483+0000","last_became_peered":"2023-12-19T13:46:30.948483+0000","last_unstale":"2023-12-19T13:46:30.952004+0000","last_undegraded":"2023-12-19T13:46:30.952004+0000","last_fullsized":"2023-12-19T13:46:30.952004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480930+0000","last_change":"2023-12-19T13:46:30.950655+0000","last_active":"2023-12-19T13:46:32.480930+0000","last_peered":"2023-12-19T13:46:32.480930+0000","last_clean":"2023-12-19T13:46:32.480930+0000","last_became_active":"2023-12-19T13:46:30.950446+0000","last_became_peered":"2023-12-19T13:46:30.950446+0000","last_unstale":"2023-12-19T13:46:32.480930+0000","last_undegraded":"2023-12-19T13:46:32.480930+0000","last_fullsized":"2023-12-19T13:46:32.480930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:05.776092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939565+0000","last_change":"2023-12-19T13:46:30.938955+0000","last_active":"2023-12-19T13:46:30.939565+0000","last_peered":"2023-12-19T13:46:30.939565+0000","last_clean":"2023-12-19T13:46:30.939565+0000","last_became_active":"2023-12-19T13:46:30.938382+0000","last_became_peered":"2023-12-19T13:46:30.938382+0000","last_unstale":"2023-12-19T13:46:30.939565+0000","last_undegraded":"2023-12-19T13:46:30.939565+0000","last_fullsized":"2023-12-19T13:46:30.939565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932221+0000","last_change":"2023-12-19T13:46:30.949294+0000","last_active":"2023-12-19T13:46:31.932221+0000","last_peered":"2023-12-19T13:46:31.932221+0000","last_clean":"2023-12-19T13:46:31.932221+0000","last_became_active":"2023-12-19T13:46:30.949073+0000","last_became_peered":"2023-12-19T13:46:30.949073+0000","last_unstale":"2023-12-19T13:46:31.932221+0000","last_undegraded":"2023-12-19T13:46:31.932221+0000","last_fullsized":"2023-12-19T13:46:31.932221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478387+0000","last_change":"2023-12-19T13:46:30.950387+0000","last_active":"2023-12-19T13:46:32.478387+0000","last_peered":"2023-12-19T13:46:32.478387+0000","last_clean":"2023-12-19T13:46:32.478387+0000","last_became_active":"2023-12-19T13:46:30.947508+0000","last_became_peered":"2023-12-19T13:46:30.947508+0000","last_unstale":"2023-12-19T13:46:32.478387+0000","last_undegraded":"2023-12-19T13:46:32.478387+0000","last_fullsized":"2023-12-19T13:46:32.478387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955028+0000","last_change":"2023-12-19T13:46:30.463700+0000","last_active":"2023-12-19T13:46:30.955028+0000","last_peered":"2023-12-19T13:46:30.955028+0000","last_clean":"2023-12-19T13:46:30.955028+0000","last_became_active":"2023-12-19T13:46:30.463230+0000","last_became_peered":"2023-12-19T13:46:30.463230+0000","last_unstale":"2023-12-19T13:46:30.955028+0000","last_undegraded":"2023-12-19T13:46:30.955028+0000","last_fullsized":"2023-12-19T13:46:30.955028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927907+0000","last_change":"2023-12-19T13:46:30.956149+0000","last_active":"2023-12-19T13:46:31.927907+0000","last_peered":"2023-12-19T13:46:31.927907+0000","last_clean":"2023-12-19T13:46:31.927907+0000","last_became_active":"2023-12-19T13:46:30.955830+0000","last_became_peered":"2023-12-19T13:46:30.955830+0000","last_unstale":"2023-12-19T13:46:31.927907+0000","last_undegraded":"2023-12-19T13:46:31.927907+0000","last_fullsized":"2023-12-19T13:46:31.927907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960209+0000","last_change":"2023-12-19T13:46:30.467903+0000","last_active":"2023-12-19T13:46:30.960209+0000","last_peered":"2023-12-19T13:46:30.960209+0000","last_clean":"2023-12-19T13:46:30.960209+0000","last_became_active":"2023-12-19T13:46:30.467653+0000","last_became_peered":"2023-12-19T13:46:30.467653+0000","last_unstale":"2023-12-19T13:46:30.960209+0000","last_undegraded":"2023-12-19T13:46:30.960209+0000","last_fullsized":"2023-12-19T13:46:30.960209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:33.124713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938449+0000","last_change":"2023-12-19T13:46:30.470689+0000","last_active":"2023-12-19T13:46:30.938449+0000","last_peered":"2023-12-19T13:46:30.938449+0000","last_clean":"2023-12-19T13:46:30.938449+0000","last_became_active":"2023-12-19T13:46:30.470436+0000","last_became_peered":"2023-12-19T13:46:30.470436+0000","last_unstale":"2023-12-19T13:46:30.938449+0000","last_undegraded":"2023-12-19T13:46:30.938449+0000","last_fullsized":"2023-12-19T13:46:30.938449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955782+0000","last_change":"2023-12-19T13:46:30.954917+0000","last_active":"2023-12-19T13:46:30.955782+0000","last_peered":"2023-12-19T13:46:30.955782+0000","last_clean":"2023-12-19T13:46:30.955782+0000","last_became_active":"2023-12-19T13:46:30.954590+0000","last_became_peered":"2023-12-19T13:46:30.954590+0000","last_unstale":"2023-12-19T13:46:30.955782+0000","last_undegraded":"2023-12-19T13:46:30.955782+0000","last_fullsized":"2023-12-19T13:46:30.955782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926484+0000","last_change":"2023-12-19T13:46:30.450013+0000","last_active":"2023-12-19T13:46:30.926484+0000","last_peered":"2023-12-19T13:46:30.926484+0000","last_clean":"2023-12-19T13:46:30.926484+0000","last_became_active":"2023-12-19T13:46:30.449760+0000","last_became_peered":"2023-12-19T13:46:30.449760+0000","last_unstale":"2023-12-19T13:46:30.926484+0000","last_undegraded":"2023-12-19T13:46:30.926484+0000","last_fullsized":"2023-12-19T13:46:30.926484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:03.646304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927969+0000","last_change":"2023-12-19T13:46:30.943118+0000","last_active":"2023-12-19T13:46:31.927969+0000","last_peered":"2023-12-19T13:46:31.927969+0000","last_clean":"2023-12-19T13:46:31.927969+0000","last_became_active":"2023-12-19T13:46:30.942893+0000","last_became_peered":"2023-12-19T13:46:30.942893+0000","last_unstale":"2023-12-19T13:46:31.927969+0000","last_undegraded":"2023-12-19T13:46:31.927969+0000","last_fullsized":"2023-12-19T13:46:31.927969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937097+0000","last_change":"2023-12-19T13:46:30.465649+0000","last_active":"2023-12-19T13:46:30.937097+0000","last_peered":"2023-12-19T13:46:30.937097+0000","last_clean":"2023-12-19T13:46:30.937097+0000","last_became_active":"2023-12-19T13:46:30.457418+0000","last_became_peered":"2023-12-19T13:46:30.457418+0000","last_unstale":"2023-12-19T13:46:30.937097+0000","last_undegraded":"2023-12-19T13:46:30.937097+0000","last_fullsized":"2023-12-19T13:46:30.937097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:09.441431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932357+0000","last_change":"2023-12-19T13:46:30.940866+0000","last_active":"2023-12-19T13:46:31.932357+0000","last_peered":"2023-12-19T13:46:31.932357+0000","last_clean":"2023-12-19T13:46:31.932357+0000","last_became_active":"2023-12-19T13:46:30.940000+0000","last_became_peered":"2023-12-19T13:46:30.940000+0000","last_unstale":"2023-12-19T13:46:31.932357+0000","last_undegraded":"2023-12-19T13:46:31.932357+0000","last_fullsized":"2023-12-19T13:46:31.932357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:54.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.948940+0000","last_change":"2023-12-19T13:46:30.471859+0000","last_active":"2023-12-19T13:46:30.948940+0000","last_peered":"2023-12-19T13:46:30.948940+0000","last_clean":"2023-12-19T13:46:30.948940+0000","last_became_active":"2023-12-19T13:46:30.471277+0000","last_became_peered":"2023-12-19T13:46:30.471277+0000","last_unstale":"2023-12-19T13:46:30.948940+0000","last_undegraded":"2023-12-19T13:46:30.948940+0000","last_fullsized":"2023-12-19T13:46:30.948940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952022+0000","last_change":"2023-12-19T13:46:30.951516+0000","last_active":"2023-12-19T13:46:30.952022+0000","last_peered":"2023-12-19T13:46:30.952022+0000","last_clean":"2023-12-19T13:46:30.952022+0000","last_became_active":"2023-12-19T13:46:30.951275+0000","last_became_peered":"2023-12-19T13:46:30.951275+0000","last_unstale":"2023-12-19T13:46:30.952022+0000","last_undegraded":"2023-12-19T13:46:30.952022+0000","last_fullsized":"2023-12-19T13:46:30.952022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951214+0000","last_change":"2023-12-19T13:46:30.464446+0000","last_active":"2023-12-19T13:46:30.951214+0000","last_peered":"2023-12-19T13:46:30.951214+0000","last_clean":"2023-12-19T13:46:30.951214+0000","last_became_active":"2023-12-19T13:46:30.463227+0000","last_became_peered":"2023-12-19T13:46:30.463227+0000","last_unstale":"2023-12-19T13:46:30.951214+0000","last_undegraded":"2023-12-19T13:46:30.951214+0000","last_fullsized":"2023-12-19T13:46:30.951214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478163+0000","last_change":"2023-12-19T13:46:30.937059+0000","last_active":"2023-12-19T13:46:32.478163+0000","last_peered":"2023-12-19T13:46:32.478163+0000","last_clean":"2023-12-19T13:46:32.478163+0000","last_became_active":"2023-12-19T13:46:30.936498+0000","last_became_peered":"2023-12-19T13:46:30.936498+0000","last_unstale":"2023-12-19T13:46:32.478163+0000","last_undegraded":"2023-12-19T13:46:32.478163+0000","last_fullsized":"2023-12-19T13:46:32.478163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958001+0000","last_change":"2023-12-19T13:46:30.465379+0000","last_active":"2023-12-19T13:46:30.958001+0000","last_peered":"2023-12-19T13:46:30.958001+0000","last_clean":"2023-12-19T13:46:30.958001+0000","last_became_active":"2023-12-19T13:46:30.464638+0000","last_became_peered":"2023-12-19T13:46:30.464638+0000","last_unstale":"2023-12-19T13:46:30.958001+0000","last_undegraded":"2023-12-19T13:46:30.958001+0000","last_fullsized":"2023-12-19T13:46:30.958001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:40.827653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479035+0000","last_change":"2023-12-19T13:46:30.954585+0000","last_active":"2023-12-19T13:46:32.479035+0000","last_peered":"2023-12-19T13:46:32.479035+0000","last_clean":"2023-12-19T13:46:32.479035+0000","last_became_active":"2023-12-19T13:46:30.954225+0000","last_became_peered":"2023-12-19T13:46:30.954225+0000","last_unstale":"2023-12-19T13:46:32.479035+0000","last_undegraded":"2023-12-19T13:46:32.479035+0000","last_fullsized":"2023-12-19T13:46:32.479035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959430+0000","last_change":"2023-12-19T13:46:30.467738+0000","last_active":"2023-12-19T13:46:30.959430+0000","last_peered":"2023-12-19T13:46:30.959430+0000","last_clean":"2023-12-19T13:46:30.959430+0000","last_became_active":"2023-12-19T13:46:30.467458+0000","last_became_peered":"2023-12-19T13:46:30.467458+0000","last_unstale":"2023-12-19T13:46:30.959430+0000","last_undegraded":"2023-12-19T13:46:30.959430+0000","last_fullsized":"2023-12-19T13:46:30.959430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477744+0000","last_change":"2023-12-19T13:46:30.945420+0000","last_active":"2023-12-19T13:46:32.477744+0000","last_peered":"2023-12-19T13:46:32.477744+0000","last_clean":"2023-12-19T13:46:32.477744+0000","last_became_active":"2023-12-19T13:46:30.945196+0000","last_became_peered":"2023-12-19T13:46:30.945196+0000","last_unstale":"2023-12-19T13:46:32.477744+0000","last_undegraded":"2023-12-19T13:46:32.477744+0000","last_fullsized":"2023-12-19T13:46:32.477744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925451+0000","last_change":"2023-12-19T13:46:30.460639+0000","last_active":"2023-12-19T13:46:30.925451+0000","last_peered":"2023-12-19T13:46:30.925451+0000","last_clean":"2023-12-19T13:46:30.925451+0000","last_became_active":"2023-12-19T13:46:30.460292+0000","last_became_peered":"2023-12-19T13:46:30.460292+0000","last_unstale":"2023-12-19T13:46:30.925451+0000","last_undegraded":"2023-12-19T13:46:30.925451+0000","last_fullsized":"2023-12-19T13:46:30.925451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:01.555601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481397+0000","last_change":"2023-12-19T13:46:30.959817+0000","last_active":"2023-12-19T13:46:32.481397+0000","last_peered":"2023-12-19T13:46:32.481397+0000","last_clean":"2023-12-19T13:46:32.481397+0000","last_became_active":"2023-12-19T13:46:30.959575+0000","last_became_peered":"2023-12-19T13:46:30.959575+0000","last_unstale":"2023-12-19T13:46:32.481397+0000","last_undegraded":"2023-12-19T13:46:32.481397+0000","last_fullsized":"2023-12-19T13:46:32.481397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:10.080876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949079+0000","last_change":"2023-12-19T13:46:30.471710+0000","last_active":"2023-12-19T13:46:30.949079+0000","last_peered":"2023-12-19T13:46:30.949079+0000","last_clean":"2023-12-19T13:46:30.949079+0000","last_became_active":"2023-12-19T13:46:30.470939+0000","last_became_peered":"2023-12-19T13:46:30.470939+0000","last_unstale":"2023-12-19T13:46:30.949079+0000","last_undegraded":"2023-12-19T13:46:30.949079+0000","last_fullsized":"2023-12-19T13:46:30.949079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478648+0000","last_change":"2023-12-19T13:46:30.947790+0000","last_active":"2023-12-19T13:46:32.478648+0000","last_peered":"2023-12-19T13:46:32.478648+0000","last_clean":"2023-12-19T13:46:32.478648+0000","last_became_active":"2023-12-19T13:46:30.947145+0000","last_became_peered":"2023-12-19T13:46:30.947145+0000","last_unstale":"2023-12-19T13:46:32.478648+0000","last_undegraded":"2023-12-19T13:46:32.478648+0000","last_fullsized":"2023-12-19T13:46:32.478648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.957777+0000","last_change":"2023-12-19T13:46:30.465840+0000","last_active":"2023-12-19T13:46:30.957777+0000","last_peered":"2023-12-19T13:46:30.957777+0000","last_clean":"2023-12-19T13:46:30.957777+0000","last_became_active":"2023-12-19T13:46:30.465539+0000","last_became_peered":"2023-12-19T13:46:30.465539+0000","last_unstale":"2023-12-19T13:46:30.957777+0000","last_undegraded":"2023-12-19T13:46:30.957777+0000","last_fullsized":"2023-12-19T13:46:30.957777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478618+0000","last_change":"2023-12-19T13:46:30.935669+0000","last_active":"2023-12-19T13:46:32.478618+0000","last_peered":"2023-12-19T13:46:32.478618+0000","last_clean":"2023-12-19T13:46:32.478618+0000","last_became_active":"2023-12-19T13:46:30.931664+0000","last_became_peered":"2023-12-19T13:46:30.931664+0000","last_unstale":"2023-12-19T13:46:32.478618+0000","last_undegraded":"2023-12-19T13:46:32.478618+0000","last_fullsized":"2023-12-19T13:46:32.478618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956431+0000","last_change":"2023-12-19T13:46:30.469934+0000","last_active":"2023-12-19T13:46:30.956431+0000","last_peered":"2023-12-19T13:46:30.956431+0000","last_clean":"2023-12-19T13:46:30.956431+0000","last_became_active":"2023-12-19T13:46:30.469677+0000","last_became_peered":"2023-12-19T13:46:30.469677+0000","last_unstale":"2023-12-19T13:46:30.956431+0000","last_undegraded":"2023-12-19T13:46:30.956431+0000","last_fullsized":"2023-12-19T13:46:30.956431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932472+0000","last_change":"2023-12-19T13:46:30.955967+0000","last_active":"2023-12-19T13:46:31.932472+0000","last_peered":"2023-12-19T13:46:31.932472+0000","last_clean":"2023-12-19T13:46:31.932472+0000","last_became_active":"2023-12-19T13:46:30.955703+0000","last_became_peered":"2023-12-19T13:46:30.955703+0000","last_unstale":"2023-12-19T13:46:31.932472+0000","last_undegraded":"2023-12-19T13:46:31.932472+0000","last_fullsized":"2023-12-19T13:46:31.932472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:34.137836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956418+0000","last_change":"2023-12-19T13:46:30.463235+0000","last_active":"2023-12-19T13:46:30.956418+0000","last_peered":"2023-12-19T13:46:30.956418+0000","last_clean":"2023-12-19T13:46:30.956418+0000","last_became_active":"2023-12-19T13:46:30.462908+0000","last_became_peered":"2023-12-19T13:46:30.462908+0000","last_unstale":"2023-12-19T13:46:30.956418+0000","last_undegraded":"2023-12-19T13:46:30.956418+0000","last_fullsized":"2023-12-19T13:46:30.956418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477974+0000","last_change":"2023-12-19T13:46:30.947024+0000","last_active":"2023-12-19T13:46:32.477974+0000","last_peered":"2023-12-19T13:46:32.477974+0000","last_clean":"2023-12-19T13:46:32.477974+0000","last_became_active":"2023-12-19T13:46:30.946825+0000","last_became_peered":"2023-12-19T13:46:30.946825+0000","last_unstale":"2023-12-19T13:46:32.477974+0000","last_undegraded":"2023-12-19T13:46:32.477974+0000","last_fullsized":"2023-12-19T13:46:32.477974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953122+0000","last_change":"2023-12-19T13:46:30.456074+0000","last_active":"2023-12-19T13:46:30.953122+0000","last_peered":"2023-12-19T13:46:30.953122+0000","last_clean":"2023-12-19T13:46:30.953122+0000","last_became_active":"2023-12-19T13:46:30.455381+0000","last_became_peered":"2023-12-19T13:46:30.455381+0000","last_unstale":"2023-12-19T13:46:30.953122+0000","last_undegraded":"2023-12-19T13:46:30.953122+0000","last_fullsized":"2023-12-19T13:46:30.953122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479507+0000","last_change":"2023-12-19T13:46:30.956360+0000","last_active":"2023-12-19T13:46:32.479507+0000","last_peered":"2023-12-19T13:46:32.479507+0000","last_clean":"2023-12-19T13:46:32.479507+0000","last_became_active":"2023-12-19T13:46:30.954873+0000","last_became_peered":"2023-12-19T13:46:30.954873+0000","last_unstale":"2023-12-19T13:46:32.479507+0000","last_undegraded":"2023-12-19T13:46:32.479507+0000","last_fullsized":"2023-12-19T13:46:32.479507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939117+0000","last_change":"2023-12-19T13:46:30.471994+0000","last_active":"2023-12-19T13:46:30.939117+0000","last_peered":"2023-12-19T13:46:30.939117+0000","last_clean":"2023-12-19T13:46:30.939117+0000","last_became_active":"2023-12-19T13:46:30.471851+0000","last_became_peered":"2023-12-19T13:46:30.471851+0000","last_unstale":"2023-12-19T13:46:30.939117+0000","last_undegraded":"2023-12-19T13:46:30.939117+0000","last_fullsized":"2023-12-19T13:46:30.939117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481270+0000","last_change":"2023-12-19T13:46:30.939193+0000","last_active":"2023-12-19T13:46:32.481270+0000","last_peered":"2023-12-19T13:46:32.481270+0000","last_clean":"2023-12-19T13:46:32.481270+0000","last_became_active":"2023-12-19T13:46:30.938853+0000","last_became_peered":"2023-12-19T13:46:30.938853+0000","last_unstale":"2023-12-19T13:46:32.481270+0000","last_undegraded":"2023-12-19T13:46:32.481270+0000","last_fullsized":"2023-12-19T13:46:32.481270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:31.136164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937637+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:46:30.937637+0000","last_peered":"2023-12-19T13:46:30.937637+0000","last_clean":"2023-12-19T13:46:30.937637+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:46:30.937637+0000","last_undegraded":"2023-12-19T13:46:30.937637+0000","last_fullsized":"2023-12-19T13:46:30.937637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925861+0000","last_change":"2023-12-19T13:46:30.466620+0000","last_active":"2023-12-19T13:46:30.925861+0000","last_peered":"2023-12-19T13:46:30.925861+0000","last_clean":"2023-12-19T13:46:30.925861+0000","last_became_active":"2023-12-19T13:46:30.466140+0000","last_became_peered":"2023-12-19T13:46:30.466140+0000","last_unstale":"2023-12-19T13:46:30.925861+0000","last_undegraded":"2023-12-19T13:46:30.925861+0000","last_fullsized":"2023-12-19T13:46:30.925861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:54.770943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928217+0000","last_change":"2023-12-19T13:46:30.935325+0000","last_active":"2023-12-19T13:46:31.928217+0000","last_peered":"2023-12-19T13:46:31.928217+0000","last_clean":"2023-12-19T13:46:31.928217+0000","last_became_active":"2023-12-19T13:46:30.934910+0000","last_became_peered":"2023-12-19T13:46:30.934910+0000","last_unstale":"2023-12-19T13:46:31.928217+0000","last_undegraded":"2023-12-19T13:46:31.928217+0000","last_fullsized":"2023-12-19T13:46:31.928217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928316+0000","last_change":"2023-12-19T13:46:30.468537+0000","last_active":"2023-12-19T13:46:30.928316+0000","last_peered":"2023-12-19T13:46:30.928316+0000","last_clean":"2023-12-19T13:46:30.928316+0000","last_became_active":"2023-12-19T13:46:30.468301+0000","last_became_peered":"2023-12-19T13:46:30.468301+0000","last_unstale":"2023-12-19T13:46:30.928316+0000","last_undegraded":"2023-12-19T13:46:30.928316+0000","last_fullsized":"2023-12-19T13:46:30.928316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:39.901573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479355+0000","last_change":"2023-12-19T13:46:30.947051+0000","last_active":"2023-12-19T13:46:32.479355+0000","last_peered":"2023-12-19T13:46:32.479355+0000","last_clean":"2023-12-19T13:46:32.479355+0000","last_became_active":"2023-12-19T13:46:30.946837+0000","last_became_peered":"2023-12-19T13:46:30.946837+0000","last_unstale":"2023-12-19T13:46:32.479355+0000","last_undegraded":"2023-12-19T13:46:32.479355+0000","last_fullsized":"2023-12-19T13:46:32.479355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.929140+0000","last_change":"2023-12-19T13:46:30.456665+0000","last_active":"2023-12-19T13:46:30.929140+0000","last_peered":"2023-12-19T13:46:30.929140+0000","last_clean":"2023-12-19T13:46:30.929140+0000","last_became_active":"2023-12-19T13:46:30.456068+0000","last_became_peered":"2023-12-19T13:46:30.456068+0000","last_unstale":"2023-12-19T13:46:30.929140+0000","last_undegraded":"2023-12-19T13:46:30.929140+0000","last_fullsized":"2023-12-19T13:46:30.929140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.944823+0000","last_change":"2023-12-19T13:46:30.944565+0000","last_active":"2023-12-19T13:46:30.944823+0000","last_peered":"2023-12-19T13:46:30.944823+0000","last_clean":"2023-12-19T13:46:30.944823+0000","last_became_active":"2023-12-19T13:46:30.944091+0000","last_became_peered":"2023-12-19T13:46:30.944091+0000","last_unstale":"2023-12-19T13:46:30.944823+0000","last_undegraded":"2023-12-19T13:46:30.944823+0000","last_fullsized":"2023-12-19T13:46:30.944823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926212+0000","last_change":"2023-12-19T13:46:30.463352+0000","last_active":"2023-12-19T13:46:30.926212+0000","last_peered":"2023-12-19T13:46:30.926212+0000","last_clean":"2023-12-19T13:46:30.926212+0000","last_became_active":"2023-12-19T13:46:30.463056+0000","last_became_peered":"2023-12-19T13:46:30.463056+0000","last_unstale":"2023-12-19T13:46:30.926212+0000","last_undegraded":"2023-12-19T13:46:30.926212+0000","last_fullsized":"2023-12-19T13:46:30.926212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480115+0000","last_change":"2023-12-19T13:46:30.948432+0000","last_active":"2023-12-19T13:46:32.480115+0000","last_peered":"2023-12-19T13:46:32.480115+0000","last_clean":"2023-12-19T13:46:32.480115+0000","last_became_active":"2023-12-19T13:46:30.948068+0000","last_became_peered":"2023-12-19T13:46:30.948068+0000","last_unstale":"2023-12-19T13:46:32.480115+0000","last_undegraded":"2023-12-19T13:46:32.480115+0000","last_fullsized":"2023-12-19T13:46:32.480115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.941985+0000","last_change":"2023-12-19T13:46:30.463018+0000","last_active":"2023-12-19T13:46:30.941985+0000","last_peered":"2023-12-19T13:46:30.941985+0000","last_clean":"2023-12-19T13:46:30.941985+0000","last_became_active":"2023-12-19T13:46:30.462528+0000","last_became_peered":"2023-12-19T13:46:30.462528+0000","last_unstale":"2023-12-19T13:46:30.941985+0000","last_undegraded":"2023-12-19T13:46:30.941985+0000","last_fullsized":"2023-12-19T13:46:30.941985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932691+0000","last_change":"2023-12-19T13:46:30.949775+0000","last_active":"2023-12-19T13:46:31.932691+0000","last_peered":"2023-12-19T13:46:31.932691+0000","last_clean":"2023-12-19T13:46:31.932691+0000","last_became_active":"2023-12-19T13:46:30.949527+0000","last_became_peered":"2023-12-19T13:46:30.949527+0000","last_unstale":"2023-12-19T13:46:31.932691+0000","last_undegraded":"2023-12-19T13:46:31.932691+0000","last_fullsized":"2023-12-19T13:46:31.932691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928099+0000","last_change":"2023-12-19T13:46:30.463359+0000","last_active":"2023-12-19T13:46:30.928099+0000","last_peered":"2023-12-19T13:46:30.928099+0000","last_clean":"2023-12-19T13:46:30.928099+0000","last_became_active":"2023-12-19T13:46:30.463093+0000","last_became_peered":"2023-12-19T13:46:30.463093+0000","last_unstale":"2023-12-19T13:46:30.928099+0000","last_undegraded":"2023-12-19T13:46:30.928099+0000","last_fullsized":"2023-12-19T13:46:30.928099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:58.990876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478303+0000","last_change":"2023-12-19T13:46:30.954730+0000","last_active":"2023-12-19T13:46:32.478303+0000","last_peered":"2023-12-19T13:46:32.478303+0000","last_clean":"2023-12-19T13:46:32.478303+0000","last_became_active":"2023-12-19T13:46:30.954495+0000","last_became_peered":"2023-12-19T13:46:30.954495+0000","last_unstale":"2023-12-19T13:46:32.478303+0000","last_undegraded":"2023-12-19T13:46:32.478303+0000","last_fullsized":"2023-12-19T13:46:32.478303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:08.682812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932324+0000","last_change":"2023-12-19T13:46:30.470099+0000","last_active":"2023-12-19T13:46:30.932324+0000","last_peered":"2023-12-19T13:46:30.932324+0000","last_clean":"2023-12-19T13:46:30.932324+0000","last_became_active":"2023-12-19T13:46:30.469960+0000","last_became_peered":"2023-12-19T13:46:30.469960+0000","last_unstale":"2023-12-19T13:46:30.932324+0000","last_undegraded":"2023-12-19T13:46:30.932324+0000","last_fullsized":"2023-12-19T13:46:30.932324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928069+0000","last_change":"2023-12-19T13:46:30.944631+0000","last_active":"2023-12-19T13:46:31.928069+0000","last_peered":"2023-12-19T13:46:31.928069+0000","last_clean":"2023-12-19T13:46:31.928069+0000","last_became_active":"2023-12-19T13:46:30.943922+0000","last_became_peered":"2023-12-19T13:46:30.943922+0000","last_unstale":"2023-12-19T13:46:31.928069+0000","last_undegraded":"2023-12-19T13:46:31.928069+0000","last_fullsized":"2023-12-19T13:46:31.928069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959854+0000","last_change":"2023-12-19T13:46:30.472244+0000","last_active":"2023-12-19T13:46:30.959854+0000","last_peered":"2023-12-19T13:46:30.959854+0000","last_clean":"2023-12-19T13:46:30.959854+0000","last_became_active":"2023-12-19T13:46:30.471954+0000","last_became_peered":"2023-12-19T13:46:30.471954+0000","last_unstale":"2023-12-19T13:46:30.959854+0000","last_undegraded":"2023-12-19T13:46:30.959854+0000","last_fullsized":"2023-12-19T13:46:30.959854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927854+0000","last_change":"2023-12-19T13:46:30.939034+0000","last_active":"2023-12-19T13:46:31.927854+0000","last_peered":"2023-12-19T13:46:31.927854+0000","last_clean":"2023-12-19T13:46:31.927854+0000","last_became_active":"2023-12-19T13:46:30.938407+0000","last_became_peered":"2023-12-19T13:46:30.938407+0000","last_unstale":"2023-12-19T13:46:31.927854+0000","last_undegraded":"2023-12-19T13:46:31.927854+0000","last_fullsized":"2023-12-19T13:46:31.927854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.936764+0000","last_change":"2023-12-19T13:46:30.469524+0000","last_active":"2023-12-19T13:46:30.936764+0000","last_peered":"2023-12-19T13:46:30.936764+0000","last_clean":"2023-12-19T13:46:30.936764+0000","last_became_active":"2023-12-19T13:46:30.467130+0000","last_became_peered":"2023-12-19T13:46:30.467130+0000","last_unstale":"2023-12-19T13:46:30.936764+0000","last_undegraded":"2023-12-19T13:46:30.936764+0000","last_fullsized":"2023-12-19T13:46:30.936764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:25.754683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481642+0000","last_change":"2023-12-19T13:46:30.948464+0000","last_active":"2023-12-19T13:46:32.481642+0000","last_peered":"2023-12-19T13:46:32.481642+0000","last_clean":"2023-12-19T13:46:32.481642+0000","last_became_active":"2023-12-19T13:46:30.941429+0000","last_became_peered":"2023-12-19T13:46:30.941429+0000","last_unstale":"2023-12-19T13:46:32.481642+0000","last_undegraded":"2023-12-19T13:46:32.481642+0000","last_fullsized":"2023-12-19T13:46:32.481642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:14.644536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932435+0000","last_change":"2023-12-19T13:46:30.467632+0000","last_active":"2023-12-19T13:46:30.932435+0000","last_peered":"2023-12-19T13:46:30.932435+0000","last_clean":"2023-12-19T13:46:30.932435+0000","last_became_active":"2023-12-19T13:46:30.467326+0000","last_became_peered":"2023-12-19T13:46:30.467326+0000","last_unstale":"2023-12-19T13:46:30.932435+0000","last_undegraded":"2023-12-19T13:46:30.932435+0000","last_fullsized":"2023-12-19T13:46:30.932435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928264+0000","last_change":"2023-12-19T13:46:30.945501+0000","last_active":"2023-12-19T13:46:31.928264+0000","last_peered":"2023-12-19T13:46:31.928264+0000","last_clean":"2023-12-19T13:46:31.928264+0000","last_became_active":"2023-12-19T13:46:30.945070+0000","last_became_peered":"2023-12-19T13:46:30.945070+0000","last_unstale":"2023-12-19T13:46:31.928264+0000","last_undegraded":"2023-12-19T13:46:31.928264+0000","last_fullsized":"2023-12-19T13:46:31.928264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938563+0000","last_change":"2023-12-19T13:46:30.468143+0000","last_active":"2023-12-19T13:46:30.938563+0000","last_peered":"2023-12-19T13:46:30.938563+0000","last_clean":"2023-12-19T13:46:30.938563+0000","last_became_active":"2023-12-19T13:46:30.467699+0000","last_became_peered":"2023-12-19T13:46:30.467699+0000","last_unstale":"2023-12-19T13:46:30.938563+0000","last_undegraded":"2023-12-19T13:46:30.938563+0000","last_fullsized":"2023-12-19T13:46:30.938563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.947589+0000","last_change":"2023-12-19T13:46:30.947222+0000","last_active":"2023-12-19T13:46:30.947589+0000","last_peered":"2023-12-19T13:46:30.947589+0000","last_clean":"2023-12-19T13:46:30.947589+0000","last_became_active":"2023-12-19T13:46:30.947006+0000","last_became_peered":"2023-12-19T13:46:30.947006+0000","last_unstale":"2023-12-19T13:46:30.947589+0000","last_undegraded":"2023-12-19T13:46:30.947589+0000","last_fullsized":"2023-12-19T13:46:30.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958497+0000","last_change":"2023-12-19T13:46:30.465441+0000","last_active":"2023-12-19T13:46:30.958497+0000","last_peered":"2023-12-19T13:46:30.958497+0000","last_clean":"2023-12-19T13:46:30.958497+0000","last_became_active":"2023-12-19T13:46:30.465103+0000","last_became_peered":"2023-12-19T13:46:30.465103+0000","last_unstale":"2023-12-19T13:46:30.958497+0000","last_undegraded":"2023-12-19T13:46:30.958497+0000","last_fullsized":"2023-12-19T13:46:30.958497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478407+0000","last_change":"2023-12-19T13:46:30.952729+0000","last_active":"2023-12-19T13:46:32.478407+0000","last_peered":"2023-12-19T13:46:32.478407+0000","last_clean":"2023-12-19T13:46:32.478407+0000","last_became_active":"2023-12-19T13:46:30.950922+0000","last_became_peered":"2023-12-19T13:46:30.950922+0000","last_unstale":"2023-12-19T13:46:32.478407+0000","last_undegraded":"2023-12-19T13:46:32.478407+0000","last_fullsized":"2023-12-19T13:46:32.478407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:13.580642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481163+0000","last_change":"2023-12-19T13:46:30.957451+0000","last_active":"2023-12-19T13:46:32.481163+0000","last_peered":"2023-12-19T13:46:32.481163+0000","last_clean":"2023-12-19T13:46:32.481163+0000","last_became_active":"2023-12-19T13:46:30.955947+0000","last_became_peered":"2023-12-19T13:46:30.955947+0000","last_unstale":"2023-12-19T13:46:32.481163+0000","last_undegraded":"2023-12-19T13:46:32.481163+0000","last_fullsized":"2023-12-19T13:46:32.481163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:07.116909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959781+0000","last_change":"2023-12-19T13:46:30.470680+0000","last_active":"2023-12-19T13:46:30.959781+0000","last_peered":"2023-12-19T13:46:30.959781+0000","last_clean":"2023-12-19T13:46:30.959781+0000","last_became_active":"2023-12-19T13:46:30.470409+0000","last_became_peered":"2023-12-19T13:46:30.470409+0000","last_unstale":"2023-12-19T13:46:30.959781+0000","last_undegraded":"2023-12-19T13:46:30.959781+0000","last_fullsized":"2023-12-19T13:46:30.959781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479758+0000","last_change":"2023-12-19T13:46:30.946912+0000","last_active":"2023-12-19T13:46:32.479758+0000","last_peered":"2023-12-19T13:46:32.479758+0000","last_clean":"2023-12-19T13:46:32.479758+0000","last_became_active":"2023-12-19T13:46:30.946689+0000","last_became_peered":"2023-12-19T13:46:30.946689+0000","last_unstale":"2023-12-19T13:46:32.479758+0000","last_undegraded":"2023-12-19T13:46:32.479758+0000","last_fullsized":"2023-12-19T13:46:32.479758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960456+0000","last_change":"2023-12-19T13:46:30.470862+0000","last_active":"2023-12-19T13:46:30.960456+0000","last_peered":"2023-12-19T13:46:30.960456+0000","last_clean":"2023-12-19T13:46:30.960456+0000","last_became_active":"2023-12-19T13:46:30.470428+0000","last_became_peered":"2023-12-19T13:46:30.470428+0000","last_unstale":"2023-12-19T13:46:30.960456+0000","last_undegraded":"2023-12-19T13:46:30.960456+0000","last_fullsized":"2023-12-19T13:46:30.960456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950966+0000","last_change":"2023-12-19T13:46:30.949145+0000","last_active":"2023-12-19T13:46:30.950966+0000","last_peered":"2023-12-19T13:46:30.950966+0000","last_clean":"2023-12-19T13:46:30.950966+0000","last_became_active":"2023-12-19T13:46:30.946515+0000","last_became_peered":"2023-12-19T13:46:30.946515+0000","last_unstale":"2023-12-19T13:46:30.950966+0000","last_undegraded":"2023-12-19T13:46:30.950966+0000","last_fullsized":"2023-12-19T13:46:30.950966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953453+0000","last_change":"2023-12-19T13:46:30.449386+0000","last_active":"2023-12-19T13:46:30.953453+0000","last_peered":"2023-12-19T13:46:30.953453+0000","last_clean":"2023-12-19T13:46:30.953453+0000","last_became_active":"2023-12-19T13:46:30.448900+0000","last_became_peered":"2023-12-19T13:46:30.448900+0000","last_unstale":"2023-12-19T13:46:30.953453+0000","last_undegraded":"2023-12-19T13:46:30.953453+0000","last_fullsized":"2023-12-19T13:46:30.953453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952114+0000","last_change":"2023-12-19T13:46:30.952009+0000","last_active":"2023-12-19T13:46:30.952114+0000","last_peered":"2023-12-19T13:46:30.952114+0000","last_clean":"2023-12-19T13:46:30.952114+0000","last_became_active":"2023-12-19T13:46:30.951734+0000","last_became_peered":"2023-12-19T13:46:30.951734+0000","last_unstale":"2023-12-19T13:46:30.952114+0000","last_undegraded":"2023-12-19T13:46:30.952114+0000","last_fullsized":"2023-12-19T13:46:30.952114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959118+0000","last_change":"2023-12-19T13:46:30.458973+0000","last_active":"2023-12-19T13:46:30.959118+0000","last_peered":"2023-12-19T13:46:30.959118+0000","last_clean":"2023-12-19T13:46:30.959118+0000","last_became_active":"2023-12-19T13:46:30.458267+0000","last_became_peered":"2023-12-19T13:46:30.458267+0000","last_unstale":"2023-12-19T13:46:30.959118+0000","last_undegraded":"2023-12-19T13:46:30.959118+0000","last_fullsized":"2023-12-19T13:46:30.959118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]}],"pool_statfs":[]}} 2023-12-19T13:46:40.795 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:46:41.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.016+0000 7f92ab6a1640 1 Processor -- start 2023-12-19T13:46:41.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.016+0000 7f92ab6a1640 1 -- start start 2023-12-19T13:46:41.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.017+0000 7f92ab6a1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a415b3c0 0x7f92a415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.017+0000 7f92ab6a1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f92a40cc540 0x7f92a406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.018+0000 7f92ab6a1640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a4161510 con 0x7f92a406f6a0 2023-12-19T13:46:41.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.018+0000 7f92ab6a1640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a415ed70 con 0x7f92a40cc540 2023-12-19T13:46:41.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.018+0000 7f92ab6a1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a415e4d0 con 0x7f92a415b3c0 2023-12-19T13:46:41.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.018+0000 7f92a943d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a415b3c0 0x7f92a415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.018+0000 7f92a8c3c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f92a40cc540 0x7f92a406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.018+0000 7f92a943d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a415b3c0 0x7f92a415ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51592/0 (socket says 172.21.15.113:51592) 2023-12-19T13:46:41.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.018+0000 7f92a943d640 1 -- 172.21.15.113:0/2598712200 learned_addr learned my addr 172.21.15.113:0/2598712200 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:41.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.019+0000 7f92a943d640 1 -- 172.21.15.113:0/2598712200 >> v2:172.21.15.151:3300/0 conn(0x7f92a40cc540 msgr2=0x7f92a406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:41.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.019+0000 7f92a943d640 1 --2- 172.21.15.113:0/2598712200 >> v2:172.21.15.151:3300/0 conn(0x7f92a40cc540 0x7f92a406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.019+0000 7f92a943d640 1 -- 172.21.15.113:0/2598712200 >> v1:172.21.15.151:6789/0 conn(0x7f92a406f6a0 legacy=0x7f92a406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.019+0000 7f92a943d640 1 -- 172.21.15.113:0/2598712200 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a415e7b0 con 0x7f92a415b3c0 2023-12-19T13:46:41.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.019+0000 7f92a8c3c640 1 --2- 172.21.15.113:0/2598712200 >> v2:172.21.15.151:3300/0 conn(0x7f92a40cc540 0x7f92a406f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:41.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.020+0000 7f92a943d640 1 --2- 172.21.15.113:0/2598712200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a415b3c0 0x7f92a415ddf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009870 tx=0x7f92a002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624bc0eaad9f705b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.021+0000 7f929bfff640 1 -- 172.21.15.113:0/2598712200 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0030840 con 0x7f92a415b3c0 2023-12-19T13:46:41.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.021+0000 7f929bfff640 1 -- 172.21.15.113:0/2598712200 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a00309a0 con 0x7f92a415b3c0 2023-12-19T13:46:41.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.021+0000 7f929bfff640 1 -- 172.21.15.113:0/2598712200 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0030d30 con 0x7f92a415b3c0 2023-12-19T13:46:41.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 -- 172.21.15.113:0/2598712200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a415b3c0 msgr2=0x7f92a415ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/2598712200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a415b3c0 0x7f92a415ddf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009870 tx=0x7f92a002b980 comp rx=0 tx=0).stop 2023-12-19T13:46:41.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 -- 172.21.15.113:0/2598712200 shutdown_connections 2023-12-19T13:46:41.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/2598712200 >> v2:172.21.15.151:3300/0 conn(0x7f92a40cc540 0x7f92a406f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/2598712200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a415b3c0 0x7f92a415ddf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 -- 172.21.15.113:0/2598712200 >> 172.21.15.113:0/2598712200 conn(0x7f92a40d01a0 msgr2=0x7f92a40d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:41.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 -- 172.21.15.113:0/2598712200 shutdown_connections 2023-12-19T13:46:41.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.022+0000 7f92ab6a1640 1 -- 172.21.15.113:0/2598712200 wait complete. 2023-12-19T13:46:41.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.024+0000 7f92ab6a1640 1 Processor -- start 2023-12-19T13:46:41.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.024+0000 7f92ab6a1640 1 -- start start 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92ab6a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a406f6a0 0x7f92a40cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92ab6a1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a40cc540 0x7f92a40cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92ab6a1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92a415b3c0 0x7f92a4146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92ab6a1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a41569f0 con 0x7f92a406f6a0 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92ab6a1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4156cb0 con 0x7f92a415b3c0 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92ab6a1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4156f90 con 0x7f92a40cc540 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a406f6a0 0x7f92a40cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a406f6a0 0x7f92a40cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43406/0 (socket says 172.21.15.113:43406) 2023-12-19T13:46:41.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 -- 172.21.15.113:0/1373383860 learned_addr learned my addr 172.21.15.113:0/1373383860 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:41.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a8c3c640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a40cc540 0x7f92a40cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 -- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a40cc540 msgr2=0x7f92a40cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a9c3e640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92a415b3c0 0x7f92a4146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a40cc540 0x7f92a40cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 -- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92a415b3c0 msgr2=0x7f92a4146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92a415b3c0 0x7f92a4146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.025+0000 7f92a943d640 1 -- 172.21.15.113:0/1373383860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009400 con 0x7f92a406f6a0 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.026+0000 7f92a943d640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a406f6a0 0x7f92a40cce60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f92a002b9c0 tx=0x7f92a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.026+0000 7f9299ffb640 1 -- 172.21.15.113:0/1373383860 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a003e070 con 0x7f92a406f6a0 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.026+0000 7f9299ffb640 1 -- 172.21.15.113:0/1373383860 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a0039a10 con 0x7f92a406f6a0 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.026+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a00094d0 con 0x7f92a406f6a0 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.026+0000 7f9299ffb640 1 -- 172.21.15.113:0/1373383860 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0039de0 con 0x7f92a406f6a0 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.026+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a40cf870 con 0x7f92a406f6a0 2023-12-19T13:46:41.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.028+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a4061910 con 0x7f92a406f6a0 2023-12-19T13:46:41.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.029+0000 7f9299ffb640 1 -- 172.21.15.113:0/1373383860 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f92a00423f0 con 0x7f92a406f6a0 2023-12-19T13:46:41.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.030+0000 7f9299ffb640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f928806a430 0x7f928806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.030+0000 7f9299ffb640 1 -- 172.21.15.113:0/1373383860 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92a00aa740 con 0x7f92a406f6a0 2023-12-19T13:46:41.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.030+0000 7f92a8c3c640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f928806a430 0x7f928806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.031+0000 7f92a8c3c640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f928806a430 0x7f928806c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92a415d9a0 tx=0x7f9294008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.035+0000 7f9299ffb640 1 -- 172.21.15.113:0/1373383860 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f92a0075dc0 con 0x7f92a406f6a0 2023-12-19T13:46:41.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.209+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92a415b7a0 con 0x7f928806a430 2023-12-19T13:46:41.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.220+0000 7f9299ffb640 1 -- 172.21.15.113:0/1373383860 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259993 (secure 0 0 0) 0x7f92940109f0 con 0x7f928806a430 2023-12-19T13:46:41.224 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:41.225 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.224+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f928806a430 msgr2=0x7f928806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.224+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f928806a430 0x7f928806c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92a415d9a0 tx=0x7f9294008040 comp rx=0 tx=0).stop 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.224+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a406f6a0 msgr2=0x7f92a40cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.224+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a406f6a0 0x7f92a40cce60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f92a002b9c0 tx=0x7f92a00046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 shutdown_connections 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f928806a430 0x7f928806c8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92a415b3c0 0x7f92a4146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92a40cc540 0x7f92a40cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 --2- 172.21.15.113:0/1373383860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a406f6a0 0x7f92a40cce60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 >> 172.21.15.113:0/1373383860 conn(0x7f92a40d01a0 msgr2=0x7f92a415a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:41.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 shutdown_connections 2023-12-19T13:46:41.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.225+0000 7f92ab6a1640 1 -- 172.21.15.113:0/1373383860 wait complete. 2023-12-19T13:46:41.242 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-19T13:46:40.412869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.486184"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479619+0000","last_change":"2023-12-19T13:46:30.947466+0000","last_active":"2023-12-19T13:46:32.479619+0000","last_peered":"2023-12-19T13:46:32.479619+0000","last_clean":"2023-12-19T13:46:32.479619+0000","last_became_active":"2023-12-19T13:46:30.944804+0000","last_became_peered":"2023-12-19T13:46:30.944804+0000","last_unstale":"2023-12-19T13:46:32.479619+0000","last_undegraded":"2023-12-19T13:46:32.479619+0000","last_fullsized":"2023-12-19T13:46:32.479619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949108+0000","last_change":"2023-12-19T13:46:30.947759+0000","last_active":"2023-12-19T13:46:30.949108+0000","last_peered":"2023-12-19T13:46:30.949108+0000","last_clean":"2023-12-19T13:46:30.949108+0000","last_became_active":"2023-12-19T13:46:30.947539+0000","last_became_peered":"2023-12-19T13:46:30.947539+0000","last_unstale":"2023-12-19T13:46:30.949108+0000","last_undegraded":"2023-12-19T13:46:30.949108+0000","last_fullsized":"2023-12-19T13:46:30.949108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949060+0000","last_change":"2023-12-19T13:46:30.947127+0000","last_active":"2023-12-19T13:46:30.949060+0000","last_peered":"2023-12-19T13:46:30.949060+0000","last_clean":"2023-12-19T13:46:30.949060+0000","last_became_active":"2023-12-19T13:46:30.946112+0000","last_became_peered":"2023-12-19T13:46:30.946112+0000","last_unstale":"2023-12-19T13:46:30.949060+0000","last_undegraded":"2023-12-19T13:46:30.949060+0000","last_fullsized":"2023-12-19T13:46:30.949060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:31.692673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932443+0000","last_change":"2023-12-19T13:46:30.944335+0000","last_active":"2023-12-19T13:46:31.932443+0000","last_peered":"2023-12-19T13:46:31.932443+0000","last_clean":"2023-12-19T13:46:31.932443+0000","last_became_active":"2023-12-19T13:46:30.943978+0000","last_became_peered":"2023-12-19T13:46:30.943978+0000","last_unstale":"2023-12-19T13:46:31.932443+0000","last_undegraded":"2023-12-19T13:46:31.932443+0000","last_fullsized":"2023-12-19T13:46:31.932443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480797+0000","last_change":"2023-12-19T13:46:30.958489+0000","last_active":"2023-12-19T13:46:32.480797+0000","last_peered":"2023-12-19T13:46:32.480797+0000","last_clean":"2023-12-19T13:46:32.480797+0000","last_became_active":"2023-12-19T13:46:30.957947+0000","last_became_peered":"2023-12-19T13:46:30.957947+0000","last_unstale":"2023-12-19T13:46:32.480797+0000","last_undegraded":"2023-12-19T13:46:32.480797+0000","last_fullsized":"2023-12-19T13:46:32.480797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932704+0000","last_change":"2023-12-19T13:46:30.941012+0000","last_active":"2023-12-19T13:46:31.932704+0000","last_peered":"2023-12-19T13:46:31.932704+0000","last_clean":"2023-12-19T13:46:31.932704+0000","last_became_active":"2023-12-19T13:46:30.940674+0000","last_became_peered":"2023-12-19T13:46:30.940674+0000","last_unstale":"2023-12-19T13:46:31.932704+0000","last_undegraded":"2023-12-19T13:46:31.932704+0000","last_fullsized":"2023-12-19T13:46:31.932704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480352+0000","last_change":"2023-12-19T13:46:30.956208+0000","last_active":"2023-12-19T13:46:32.480352+0000","last_peered":"2023-12-19T13:46:32.480352+0000","last_clean":"2023-12-19T13:46:32.480352+0000","last_became_active":"2023-12-19T13:46:30.954562+0000","last_became_peered":"2023-12-19T13:46:30.954562+0000","last_unstale":"2023-12-19T13:46:32.480352+0000","last_undegraded":"2023-12-19T13:46:32.480352+0000","last_fullsized":"2023-12-19T13:46:32.480352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951004+0000","last_change":"2023-12-19T13:46:30.949875+0000","last_active":"2023-12-19T13:46:30.951004+0000","last_peered":"2023-12-19T13:46:30.951004+0000","last_clean":"2023-12-19T13:46:30.951004+0000","last_became_active":"2023-12-19T13:46:30.949625+0000","last_became_peered":"2023-12-19T13:46:30.949625+0000","last_unstale":"2023-12-19T13:46:30.951004+0000","last_undegraded":"2023-12-19T13:46:30.951004+0000","last_fullsized":"2023-12-19T13:46:30.951004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:18.684952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478175+0000","last_change":"2023-12-19T13:46:30.940157+0000","last_active":"2023-12-19T13:46:32.478175+0000","last_peered":"2023-12-19T13:46:32.478175+0000","last_clean":"2023-12-19T13:46:32.478175+0000","last_became_active":"2023-12-19T13:46:30.939947+0000","last_became_peered":"2023-12-19T13:46:30.939947+0000","last_unstale":"2023-12-19T13:46:32.478175+0000","last_undegraded":"2023-12-19T13:46:32.478175+0000","last_fullsized":"2023-12-19T13:46:32.478175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480049+0000","last_change":"2023-12-19T13:46:30.958360+0000","last_active":"2023-12-19T13:46:32.480049+0000","last_peered":"2023-12-19T13:46:32.480049+0000","last_clean":"2023-12-19T13:46:32.480049+0000","last_became_active":"2023-12-19T13:46:30.957433+0000","last_became_peered":"2023-12-19T13:46:30.957433+0000","last_unstale":"2023-12-19T13:46:32.480049+0000","last_undegraded":"2023-12-19T13:46:32.480049+0000","last_fullsized":"2023-12-19T13:46:32.480049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479889+0000","last_change":"2023-12-19T13:46:30.946461+0000","last_active":"2023-12-19T13:46:32.479889+0000","last_peered":"2023-12-19T13:46:32.479889+0000","last_clean":"2023-12-19T13:46:32.479889+0000","last_became_active":"2023-12-19T13:46:30.944536+0000","last_became_peered":"2023-12-19T13:46:30.944536+0000","last_unstale":"2023-12-19T13:46:32.479889+0000","last_undegraded":"2023-12-19T13:46:32.479889+0000","last_fullsized":"2023-12-19T13:46:32.479889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479093+0000","last_change":"2023-12-19T13:46:30.955116+0000","last_active":"2023-12-19T13:46:32.479093+0000","last_peered":"2023-12-19T13:46:32.479093+0000","last_clean":"2023-12-19T13:46:32.479093+0000","last_became_active":"2023-12-19T13:46:30.954208+0000","last_became_peered":"2023-12-19T13:46:30.954208+0000","last_unstale":"2023-12-19T13:46:32.479093+0000","last_undegraded":"2023-12-19T13:46:32.479093+0000","last_fullsized":"2023-12-19T13:46:32.479093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477789+0000","last_change":"2023-12-19T13:46:30.951097+0000","last_active":"2023-12-19T13:46:32.477789+0000","last_peered":"2023-12-19T13:46:32.477789+0000","last_clean":"2023-12-19T13:46:32.477789+0000","last_became_active":"2023-12-19T13:46:30.950596+0000","last_became_peered":"2023-12-19T13:46:30.950596+0000","last_unstale":"2023-12-19T13:46:32.477789+0000","last_undegraded":"2023-12-19T13:46:32.477789+0000","last_fullsized":"2023-12-19T13:46:32.477789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477725+0000","last_change":"2023-12-19T13:46:30.951645+0000","last_active":"2023-12-19T13:46:32.477725+0000","last_peered":"2023-12-19T13:46:32.477725+0000","last_clean":"2023-12-19T13:46:32.477725+0000","last_became_active":"2023-12-19T13:46:30.951372+0000","last_became_peered":"2023-12-19T13:46:30.951372+0000","last_unstale":"2023-12-19T13:46:32.477725+0000","last_undegraded":"2023-12-19T13:46:32.477725+0000","last_fullsized":"2023-12-19T13:46:32.477725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960243+0000","last_change":"2023-12-19T13:46:30.960188+0000","last_active":"2023-12-19T13:46:30.960243+0000","last_peered":"2023-12-19T13:46:30.960243+0000","last_clean":"2023-12-19T13:46:30.960243+0000","last_became_active":"2023-12-19T13:46:30.959885+0000","last_became_peered":"2023-12-19T13:46:30.959885+0000","last_unstale":"2023-12-19T13:46:30.960243+0000","last_undegraded":"2023-12-19T13:46:30.960243+0000","last_fullsized":"2023-12-19T13:46:30.960243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481033+0000","last_change":"2023-12-19T13:46:30.932726+0000","last_active":"2023-12-19T13:46:32.481033+0000","last_peered":"2023-12-19T13:46:32.481033+0000","last_clean":"2023-12-19T13:46:32.481033+0000","last_became_active":"2023-12-19T13:46:30.931668+0000","last_became_peered":"2023-12-19T13:46:30.931668+0000","last_unstale":"2023-12-19T13:46:32.481033+0000","last_undegraded":"2023-12-19T13:46:32.481033+0000","last_fullsized":"2023-12-19T13:46:32.481033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478349+0000","last_change":"2023-12-19T13:46:30.957418+0000","last_active":"2023-12-19T13:46:32.478349+0000","last_peered":"2023-12-19T13:46:32.478349+0000","last_clean":"2023-12-19T13:46:32.478349+0000","last_became_active":"2023-12-19T13:46:30.957187+0000","last_became_peered":"2023-12-19T13:46:30.957187+0000","last_unstale":"2023-12-19T13:46:32.478349+0000","last_undegraded":"2023-12-19T13:46:32.478349+0000","last_fullsized":"2023-12-19T13:46:32.478349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:03.460723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.934059+0000","last_change":"2023-12-19T13:46:30.933939+0000","last_active":"2023-12-19T13:46:30.934059+0000","last_peered":"2023-12-19T13:46:30.934059+0000","last_clean":"2023-12-19T13:46:30.934059+0000","last_became_active":"2023-12-19T13:46:30.933698+0000","last_became_peered":"2023-12-19T13:46:30.933698+0000","last_unstale":"2023-12-19T13:46:30.934059+0000","last_undegraded":"2023-12-19T13:46:30.934059+0000","last_fullsized":"2023-12-19T13:46:30.934059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478667+0000","last_change":"2023-12-19T13:46:30.954479+0000","last_active":"2023-12-19T13:46:32.478667+0000","last_peered":"2023-12-19T13:46:32.478667+0000","last_clean":"2023-12-19T13:46:32.478667+0000","last_became_active":"2023-12-19T13:46:30.953640+0000","last_became_peered":"2023-12-19T13:46:30.953640+0000","last_unstale":"2023-12-19T13:46:32.478667+0000","last_undegraded":"2023-12-19T13:46:32.478667+0000","last_fullsized":"2023-12-19T13:46:32.478667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:14.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480286+0000","last_change":"2023-12-19T13:46:30.957735+0000","last_active":"2023-12-19T13:46:32.480286+0000","last_peered":"2023-12-19T13:46:32.480286+0000","last_clean":"2023-12-19T13:46:32.480286+0000","last_became_active":"2023-12-19T13:46:30.954757+0000","last_became_peered":"2023-12-19T13:46:30.954757+0000","last_unstale":"2023-12-19T13:46:32.480286+0000","last_undegraded":"2023-12-19T13:46:32.480286+0000","last_fullsized":"2023-12-19T13:46:32.480286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928022+0000","last_change":"2023-12-19T13:46:30.935192+0000","last_active":"2023-12-19T13:46:31.928022+0000","last_peered":"2023-12-19T13:46:31.928022+0000","last_clean":"2023-12-19T13:46:31.928022+0000","last_became_active":"2023-12-19T13:46:30.934966+0000","last_became_peered":"2023-12-19T13:46:30.934966+0000","last_unstale":"2023-12-19T13:46:31.928022+0000","last_undegraded":"2023-12-19T13:46:31.928022+0000","last_fullsized":"2023-12-19T13:46:31.928022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479248+0000","last_change":"2023-12-19T13:46:30.957999+0000","last_active":"2023-12-19T13:46:32.479248+0000","last_peered":"2023-12-19T13:46:32.479248+0000","last_clean":"2023-12-19T13:46:32.479248+0000","last_became_active":"2023-12-19T13:46:30.957775+0000","last_became_peered":"2023-12-19T13:46:30.957775+0000","last_unstale":"2023-12-19T13:46:32.479248+0000","last_undegraded":"2023-12-19T13:46:32.479248+0000","last_fullsized":"2023-12-19T13:46:32.479248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950982+0000","last_change":"2023-12-19T13:46:30.949299+0000","last_active":"2023-12-19T13:46:30.950982+0000","last_peered":"2023-12-19T13:46:30.950982+0000","last_clean":"2023-12-19T13:46:30.950982+0000","last_became_active":"2023-12-19T13:46:30.946882+0000","last_became_peered":"2023-12-19T13:46:30.946882+0000","last_unstale":"2023-12-19T13:46:30.950982+0000","last_undegraded":"2023-12-19T13:46:30.950982+0000","last_fullsized":"2023-12-19T13:46:30.950982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477911+0000","last_change":"2023-12-19T13:46:30.954278+0000","last_active":"2023-12-19T13:46:32.477911+0000","last_peered":"2023-12-19T13:46:32.477911+0000","last_clean":"2023-12-19T13:46:32.477911+0000","last_became_active":"2023-12-19T13:46:30.952450+0000","last_became_peered":"2023-12-19T13:46:30.952450+0000","last_unstale":"2023-12-19T13:46:32.477911+0000","last_undegraded":"2023-12-19T13:46:32.477911+0000","last_fullsized":"2023-12-19T13:46:32.477911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955765+0000","last_change":"2023-12-19T13:46:30.954346+0000","last_active":"2023-12-19T13:46:30.955765+0000","last_peered":"2023-12-19T13:46:30.955765+0000","last_clean":"2023-12-19T13:46:30.955765+0000","last_became_active":"2023-12-19T13:46:30.952500+0000","last_became_peered":"2023-12-19T13:46:30.952500+0000","last_unstale":"2023-12-19T13:46:30.955765+0000","last_undegraded":"2023-12-19T13:46:30.955765+0000","last_fullsized":"2023-12-19T13:46:30.955765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932905+0000","last_change":"2023-12-19T13:46:30.931389+0000","last_active":"2023-12-19T13:46:31.932905+0000","last_peered":"2023-12-19T13:46:31.932905+0000","last_clean":"2023-12-19T13:46:31.932905+0000","last_became_active":"2023-12-19T13:46:30.931071+0000","last_became_peered":"2023-12-19T13:46:30.931071+0000","last_unstale":"2023-12-19T13:46:31.932905+0000","last_undegraded":"2023-12-19T13:46:31.932905+0000","last_fullsized":"2023-12-19T13:46:31.932905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478415+0000","last_change":"2023-12-19T13:46:30.952230+0000","last_active":"2023-12-19T13:46:32.478415+0000","last_peered":"2023-12-19T13:46:32.478415+0000","last_clean":"2023-12-19T13:46:32.478415+0000","last_became_active":"2023-12-19T13:46:30.952001+0000","last_became_peered":"2023-12-19T13:46:30.952001+0000","last_unstale":"2023-12-19T13:46:32.478415+0000","last_undegraded":"2023-12-19T13:46:32.478415+0000","last_fullsized":"2023-12-19T13:46:32.478415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:02.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479226+0000","last_change":"2023-12-19T13:46:30.950882+0000","last_active":"2023-12-19T13:46:32.479226+0000","last_peered":"2023-12-19T13:46:32.479226+0000","last_clean":"2023-12-19T13:46:32.479226+0000","last_became_active":"2023-12-19T13:46:30.950214+0000","last_became_peered":"2023-12-19T13:46:30.950214+0000","last_unstale":"2023-12-19T13:46:32.479226+0000","last_undegraded":"2023-12-19T13:46:32.479226+0000","last_fullsized":"2023-12-19T13:46:32.479226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952004+0000","last_change":"2023-12-19T13:46:30.948716+0000","last_active":"2023-12-19T13:46:30.952004+0000","last_peered":"2023-12-19T13:46:30.952004+0000","last_clean":"2023-12-19T13:46:30.952004+0000","last_became_active":"2023-12-19T13:46:30.948483+0000","last_became_peered":"2023-12-19T13:46:30.948483+0000","last_unstale":"2023-12-19T13:46:30.952004+0000","last_undegraded":"2023-12-19T13:46:30.952004+0000","last_fullsized":"2023-12-19T13:46:30.952004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480930+0000","last_change":"2023-12-19T13:46:30.950655+0000","last_active":"2023-12-19T13:46:32.480930+0000","last_peered":"2023-12-19T13:46:32.480930+0000","last_clean":"2023-12-19T13:46:32.480930+0000","last_became_active":"2023-12-19T13:46:30.950446+0000","last_became_peered":"2023-12-19T13:46:30.950446+0000","last_unstale":"2023-12-19T13:46:32.480930+0000","last_undegraded":"2023-12-19T13:46:32.480930+0000","last_fullsized":"2023-12-19T13:46:32.480930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:05.776092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939565+0000","last_change":"2023-12-19T13:46:30.938955+0000","last_active":"2023-12-19T13:46:30.939565+0000","last_peered":"2023-12-19T13:46:30.939565+0000","last_clean":"2023-12-19T13:46:30.939565+0000","last_became_active":"2023-12-19T13:46:30.938382+0000","last_became_peered":"2023-12-19T13:46:30.938382+0000","last_unstale":"2023-12-19T13:46:30.939565+0000","last_undegraded":"2023-12-19T13:46:30.939565+0000","last_fullsized":"2023-12-19T13:46:30.939565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932221+0000","last_change":"2023-12-19T13:46:30.949294+0000","last_active":"2023-12-19T13:46:31.932221+0000","last_peered":"2023-12-19T13:46:31.932221+0000","last_clean":"2023-12-19T13:46:31.932221+0000","last_became_active":"2023-12-19T13:46:30.949073+0000","last_became_peered":"2023-12-19T13:46:30.949073+0000","last_unstale":"2023-12-19T13:46:31.932221+0000","last_undegraded":"2023-12-19T13:46:31.932221+0000","last_fullsized":"2023-12-19T13:46:31.932221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478387+0000","last_change":"2023-12-19T13:46:30.950387+0000","last_active":"2023-12-19T13:46:32.478387+0000","last_peered":"2023-12-19T13:46:32.478387+0000","last_clean":"2023-12-19T13:46:32.478387+0000","last_became_active":"2023-12-19T13:46:30.947508+0000","last_became_peered":"2023-12-19T13:46:30.947508+0000","last_unstale":"2023-12-19T13:46:32.478387+0000","last_undegraded":"2023-12-19T13:46:32.478387+0000","last_fullsized":"2023-12-19T13:46:32.478387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955028+0000","last_change":"2023-12-19T13:46:30.463700+0000","last_active":"2023-12-19T13:46:30.955028+0000","last_peered":"2023-12-19T13:46:30.955028+0000","last_clean":"2023-12-19T13:46:30.955028+0000","last_became_active":"2023-12-19T13:46:30.463230+0000","last_became_peered":"2023-12-19T13:46:30.463230+0000","last_unstale":"2023-12-19T13:46:30.955028+0000","last_undegraded":"2023-12-19T13:46:30.955028+0000","last_fullsized":"2023-12-19T13:46:30.955028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927907+0000","last_change":"2023-12-19T13:46:30.956149+0000","last_active":"2023-12-19T13:46:31.927907+0000","last_peered":"2023-12-19T13:46:31.927907+0000","last_clean":"2023-12-19T13:46:31.927907+0000","last_became_active":"2023-12-19T13:46:30.955830+0000","last_became_peered":"2023-12-19T13:46:30.955830+0000","last_unstale":"2023-12-19T13:46:31.927907+0000","last_undegraded":"2023-12-19T13:46:31.927907+0000","last_fullsized":"2023-12-19T13:46:31.927907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960209+0000","last_change":"2023-12-19T13:46:30.467903+0000","last_active":"2023-12-19T13:46:30.960209+0000","last_peered":"2023-12-19T13:46:30.960209+0000","last_clean":"2023-12-19T13:46:30.960209+0000","last_became_active":"2023-12-19T13:46:30.467653+0000","last_became_peered":"2023-12-19T13:46:30.467653+0000","last_unstale":"2023-12-19T13:46:30.960209+0000","last_undegraded":"2023-12-19T13:46:30.960209+0000","last_fullsized":"2023-12-19T13:46:30.960209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:33.124713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938449+0000","last_change":"2023-12-19T13:46:30.470689+0000","last_active":"2023-12-19T13:46:30.938449+0000","last_peered":"2023-12-19T13:46:30.938449+0000","last_clean":"2023-12-19T13:46:30.938449+0000","last_became_active":"2023-12-19T13:46:30.470436+0000","last_became_peered":"2023-12-19T13:46:30.470436+0000","last_unstale":"2023-12-19T13:46:30.938449+0000","last_undegraded":"2023-12-19T13:46:30.938449+0000","last_fullsized":"2023-12-19T13:46:30.938449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955782+0000","last_change":"2023-12-19T13:46:30.954917+0000","last_active":"2023-12-19T13:46:30.955782+0000","last_peered":"2023-12-19T13:46:30.955782+0000","last_clean":"2023-12-19T13:46:30.955782+0000","last_became_active":"2023-12-19T13:46:30.954590+0000","last_became_peered":"2023-12-19T13:46:30.954590+0000","last_unstale":"2023-12-19T13:46:30.955782+0000","last_undegraded":"2023-12-19T13:46:30.955782+0000","last_fullsized":"2023-12-19T13:46:30.955782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926484+0000","last_change":"2023-12-19T13:46:30.450013+0000","last_active":"2023-12-19T13:46:30.926484+0000","last_peered":"2023-12-19T13:46:30.926484+0000","last_clean":"2023-12-19T13:46:30.926484+0000","last_became_active":"2023-12-19T13:46:30.449760+0000","last_became_peered":"2023-12-19T13:46:30.449760+0000","last_unstale":"2023-12-19T13:46:30.926484+0000","last_undegraded":"2023-12-19T13:46:30.926484+0000","last_fullsized":"2023-12-19T13:46:30.926484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:03.646304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927969+0000","last_change":"2023-12-19T13:46:30.943118+0000","last_active":"2023-12-19T13:46:31.927969+0000","last_peered":"2023-12-19T13:46:31.927969+0000","last_clean":"2023-12-19T13:46:31.927969+0000","last_became_active":"2023-12-19T13:46:30.942893+0000","last_became_peered":"2023-12-19T13:46:30.942893+0000","last_unstale":"2023-12-19T13:46:31.927969+0000","last_undegraded":"2023-12-19T13:46:31.927969+0000","last_fullsized":"2023-12-19T13:46:31.927969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937097+0000","last_change":"2023-12-19T13:46:30.465649+0000","last_active":"2023-12-19T13:46:30.937097+0000","last_peered":"2023-12-19T13:46:30.937097+0000","last_clean":"2023-12-19T13:46:30.937097+0000","last_became_active":"2023-12-19T13:46:30.457418+0000","last_became_peered":"2023-12-19T13:46:30.457418+0000","last_unstale":"2023-12-19T13:46:30.937097+0000","last_undegraded":"2023-12-19T13:46:30.937097+0000","last_fullsized":"2023-12-19T13:46:30.937097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:09.441431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932357+0000","last_change":"2023-12-19T13:46:30.940866+0000","last_active":"2023-12-19T13:46:31.932357+0000","last_peered":"2023-12-19T13:46:31.932357+0000","last_clean":"2023-12-19T13:46:31.932357+0000","last_became_active":"2023-12-19T13:46:30.940000+0000","last_became_peered":"2023-12-19T13:46:30.940000+0000","last_unstale":"2023-12-19T13:46:31.932357+0000","last_undegraded":"2023-12-19T13:46:31.932357+0000","last_fullsized":"2023-12-19T13:46:31.932357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:54.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.948940+0000","last_change":"2023-12-19T13:46:30.471859+0000","last_active":"2023-12-19T13:46:30.948940+0000","last_peered":"2023-12-19T13:46:30.948940+0000","last_clean":"2023-12-19T13:46:30.948940+0000","last_became_active":"2023-12-19T13:46:30.471277+0000","last_became_peered":"2023-12-19T13:46:30.471277+0000","last_unstale":"2023-12-19T13:46:30.948940+0000","last_undegraded":"2023-12-19T13:46:30.948940+0000","last_fullsized":"2023-12-19T13:46:30.948940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952022+0000","last_change":"2023-12-19T13:46:30.951516+0000","last_active":"2023-12-19T13:46:30.952022+0000","last_peered":"2023-12-19T13:46:30.952022+0000","last_clean":"2023-12-19T13:46:30.952022+0000","last_became_active":"2023-12-19T13:46:30.951275+0000","last_became_peered":"2023-12-19T13:46:30.951275+0000","last_unstale":"2023-12-19T13:46:30.952022+0000","last_undegraded":"2023-12-19T13:46:30.952022+0000","last_fullsized":"2023-12-19T13:46:30.952022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951214+0000","last_change":"2023-12-19T13:46:30.464446+0000","last_active":"2023-12-19T13:46:30.951214+0000","last_peered":"2023-12-19T13:46:30.951214+0000","last_clean":"2023-12-19T13:46:30.951214+0000","last_became_active":"2023-12-19T13:46:30.463227+0000","last_became_peered":"2023-12-19T13:46:30.463227+0000","last_unstale":"2023-12-19T13:46:30.951214+0000","last_undegraded":"2023-12-19T13:46:30.951214+0000","last_fullsized":"2023-12-19T13:46:30.951214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478163+0000","last_change":"2023-12-19T13:46:30.937059+0000","last_active":"2023-12-19T13:46:32.478163+0000","last_peered":"2023-12-19T13:46:32.478163+0000","last_clean":"2023-12-19T13:46:32.478163+0000","last_became_active":"2023-12-19T13:46:30.936498+0000","last_became_peered":"2023-12-19T13:46:30.936498+0000","last_unstale":"2023-12-19T13:46:32.478163+0000","last_undegraded":"2023-12-19T13:46:32.478163+0000","last_fullsized":"2023-12-19T13:46:32.478163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958001+0000","last_change":"2023-12-19T13:46:30.465379+0000","last_active":"2023-12-19T13:46:30.958001+0000","last_peered":"2023-12-19T13:46:30.958001+0000","last_clean":"2023-12-19T13:46:30.958001+0000","last_became_active":"2023-12-19T13:46:30.464638+0000","last_became_peered":"2023-12-19T13:46:30.464638+0000","last_unstale":"2023-12-19T13:46:30.958001+0000","last_undegraded":"2023-12-19T13:46:30.958001+0000","last_fullsized":"2023-12-19T13:46:30.958001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:40.827653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479035+0000","last_change":"2023-12-19T13:46:30.954585+0000","last_active":"2023-12-19T13:46:32.479035+0000","last_peered":"2023-12-19T13:46:32.479035+0000","last_clean":"2023-12-19T13:46:32.479035+0000","last_became_active":"2023-12-19T13:46:30.954225+0000","last_became_peered":"2023-12-19T13:46:30.954225+0000","last_unstale":"2023-12-19T13:46:32.479035+0000","last_undegraded":"2023-12-19T13:46:32.479035+0000","last_fullsized":"2023-12-19T13:46:32.479035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959430+0000","last_change":"2023-12-19T13:46:30.467738+0000","last_active":"2023-12-19T13:46:30.959430+0000","last_peered":"2023-12-19T13:46:30.959430+0000","last_clean":"2023-12-19T13:46:30.959430+0000","last_became_active":"2023-12-19T13:46:30.467458+0000","last_became_peered":"2023-12-19T13:46:30.467458+0000","last_unstale":"2023-12-19T13:46:30.959430+0000","last_undegraded":"2023-12-19T13:46:30.959430+0000","last_fullsized":"2023-12-19T13:46:30.959430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477744+0000","last_change":"2023-12-19T13:46:30.945420+0000","last_active":"2023-12-19T13:46:32.477744+0000","last_peered":"2023-12-19T13:46:32.477744+0000","last_clean":"2023-12-19T13:46:32.477744+0000","last_became_active":"2023-12-19T13:46:30.945196+0000","last_became_peered":"2023-12-19T13:46:30.945196+0000","last_unstale":"2023-12-19T13:46:32.477744+0000","last_undegraded":"2023-12-19T13:46:32.477744+0000","last_fullsized":"2023-12-19T13:46:32.477744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925451+0000","last_change":"2023-12-19T13:46:30.460639+0000","last_active":"2023-12-19T13:46:30.925451+0000","last_peered":"2023-12-19T13:46:30.925451+0000","last_clean":"2023-12-19T13:46:30.925451+0000","last_became_active":"2023-12-19T13:46:30.460292+0000","last_became_peered":"2023-12-19T13:46:30.460292+0000","last_unstale":"2023-12-19T13:46:30.925451+0000","last_undegraded":"2023-12-19T13:46:30.925451+0000","last_fullsized":"2023-12-19T13:46:30.925451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:01.555601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481397+0000","last_change":"2023-12-19T13:46:30.959817+0000","last_active":"2023-12-19T13:46:32.481397+0000","last_peered":"2023-12-19T13:46:32.481397+0000","last_clean":"2023-12-19T13:46:32.481397+0000","last_became_active":"2023-12-19T13:46:30.959575+0000","last_became_peered":"2023-12-19T13:46:30.959575+0000","last_unstale":"2023-12-19T13:46:32.481397+0000","last_undegraded":"2023-12-19T13:46:32.481397+0000","last_fullsized":"2023-12-19T13:46:32.481397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:10.080876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949079+0000","last_change":"2023-12-19T13:46:30.471710+0000","last_active":"2023-12-19T13:46:30.949079+0000","last_peered":"2023-12-19T13:46:30.949079+0000","last_clean":"2023-12-19T13:46:30.949079+0000","last_became_active":"2023-12-19T13:46:30.470939+0000","last_became_peered":"2023-12-19T13:46:30.470939+0000","last_unstale":"2023-12-19T13:46:30.949079+0000","last_undegraded":"2023-12-19T13:46:30.949079+0000","last_fullsized":"2023-12-19T13:46:30.949079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478648+0000","last_change":"2023-12-19T13:46:30.947790+0000","last_active":"2023-12-19T13:46:32.478648+0000","last_peered":"2023-12-19T13:46:32.478648+0000","last_clean":"2023-12-19T13:46:32.478648+0000","last_became_active":"2023-12-19T13:46:30.947145+0000","last_became_peered":"2023-12-19T13:46:30.947145+0000","last_unstale":"2023-12-19T13:46:32.478648+0000","last_undegraded":"2023-12-19T13:46:32.478648+0000","last_fullsized":"2023-12-19T13:46:32.478648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.957777+0000","last_change":"2023-12-19T13:46:30.465840+0000","last_active":"2023-12-19T13:46:30.957777+0000","last_peered":"2023-12-19T13:46:30.957777+0000","last_clean":"2023-12-19T13:46:30.957777+0000","last_became_active":"2023-12-19T13:46:30.465539+0000","last_became_peered":"2023-12-19T13:46:30.465539+0000","last_unstale":"2023-12-19T13:46:30.957777+0000","last_undegraded":"2023-12-19T13:46:30.957777+0000","last_fullsized":"2023-12-19T13:46:30.957777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478618+0000","last_change":"2023-12-19T13:46:30.935669+0000","last_active":"2023-12-19T13:46:32.478618+0000","last_peered":"2023-12-19T13:46:32.478618+0000","last_clean":"2023-12-19T13:46:32.478618+0000","last_became_active":"2023-12-19T13:46:30.931664+0000","last_became_peered":"2023-12-19T13:46:30.931664+0000","last_unstale":"2023-12-19T13:46:32.478618+0000","last_undegraded":"2023-12-19T13:46:32.478618+0000","last_fullsized":"2023-12-19T13:46:32.478618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956431+0000","last_change":"2023-12-19T13:46:30.469934+0000","last_active":"2023-12-19T13:46:30.956431+0000","last_peered":"2023-12-19T13:46:30.956431+0000","last_clean":"2023-12-19T13:46:30.956431+0000","last_became_active":"2023-12-19T13:46:30.469677+0000","last_became_peered":"2023-12-19T13:46:30.469677+0000","last_unstale":"2023-12-19T13:46:30.956431+0000","last_undegraded":"2023-12-19T13:46:30.956431+0000","last_fullsized":"2023-12-19T13:46:30.956431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932472+0000","last_change":"2023-12-19T13:46:30.955967+0000","last_active":"2023-12-19T13:46:31.932472+0000","last_peered":"2023-12-19T13:46:31.932472+0000","last_clean":"2023-12-19T13:46:31.932472+0000","last_became_active":"2023-12-19T13:46:30.955703+0000","last_became_peered":"2023-12-19T13:46:30.955703+0000","last_unstale":"2023-12-19T13:46:31.932472+0000","last_undegraded":"2023-12-19T13:46:31.932472+0000","last_fullsized":"2023-12-19T13:46:31.932472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:34.137836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956418+0000","last_change":"2023-12-19T13:46:30.463235+0000","last_active":"2023-12-19T13:46:30.956418+0000","last_peered":"2023-12-19T13:46:30.956418+0000","last_clean":"2023-12-19T13:46:30.956418+0000","last_became_active":"2023-12-19T13:46:30.462908+0000","last_became_peered":"2023-12-19T13:46:30.462908+0000","last_unstale":"2023-12-19T13:46:30.956418+0000","last_undegraded":"2023-12-19T13:46:30.956418+0000","last_fullsized":"2023-12-19T13:46:30.956418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477974+0000","last_change":"2023-12-19T13:46:30.947024+0000","last_active":"2023-12-19T13:46:32.477974+0000","last_peered":"2023-12-19T13:46:32.477974+0000","last_clean":"2023-12-19T13:46:32.477974+0000","last_became_active":"2023-12-19T13:46:30.946825+0000","last_became_peered":"2023-12-19T13:46:30.946825+0000","last_unstale":"2023-12-19T13:46:32.477974+0000","last_undegraded":"2023-12-19T13:46:32.477974+0000","last_fullsized":"2023-12-19T13:46:32.477974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953122+0000","last_change":"2023-12-19T13:46:30.456074+0000","last_active":"2023-12-19T13:46:30.953122+0000","last_peered":"2023-12-19T13:46:30.953122+0000","last_clean":"2023-12-19T13:46:30.953122+0000","last_became_active":"2023-12-19T13:46:30.455381+0000","last_became_peered":"2023-12-19T13:46:30.455381+0000","last_unstale":"2023-12-19T13:46:30.953122+0000","last_undegraded":"2023-12-19T13:46:30.953122+0000","last_fullsized":"2023-12-19T13:46:30.953122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479507+0000","last_change":"2023-12-19T13:46:30.956360+0000","last_active":"2023-12-19T13:46:32.479507+0000","last_peered":"2023-12-19T13:46:32.479507+0000","last_clean":"2023-12-19T13:46:32.479507+0000","last_became_active":"2023-12-19T13:46:30.954873+0000","last_became_peered":"2023-12-19T13:46:30.954873+0000","last_unstale":"2023-12-19T13:46:32.479507+0000","last_undegraded":"2023-12-19T13:46:32.479507+0000","last_fullsized":"2023-12-19T13:46:32.479507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939117+0000","last_change":"2023-12-19T13:46:30.471994+0000","last_active":"2023-12-19T13:46:30.939117+0000","last_peered":"2023-12-19T13:46:30.939117+0000","last_clean":"2023-12-19T13:46:30.939117+0000","last_became_active":"2023-12-19T13:46:30.471851+0000","last_became_peered":"2023-12-19T13:46:30.471851+0000","last_unstale":"2023-12-19T13:46:30.939117+0000","last_undegraded":"2023-12-19T13:46:30.939117+0000","last_fullsized":"2023-12-19T13:46:30.939117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481270+0000","last_change":"2023-12-19T13:46:30.939193+0000","last_active":"2023-12-19T13:46:32.481270+0000","last_peered":"2023-12-19T13:46:32.481270+0000","last_clean":"2023-12-19T13:46:32.481270+0000","last_became_active":"2023-12-19T13:46:30.938853+0000","last_became_peered":"2023-12-19T13:46:30.938853+0000","last_unstale":"2023-12-19T13:46:32.481270+0000","last_undegraded":"2023-12-19T13:46:32.481270+0000","last_fullsized":"2023-12-19T13:46:32.481270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:31.136164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937637+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:46:30.937637+0000","last_peered":"2023-12-19T13:46:30.937637+0000","last_clean":"2023-12-19T13:46:30.937637+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:46:30.937637+0000","last_undegraded":"2023-12-19T13:46:30.937637+0000","last_fullsized":"2023-12-19T13:46:30.937637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925861+0000","last_change":"2023-12-19T13:46:30.466620+0000","last_active":"2023-12-19T13:46:30.925861+0000","last_peered":"2023-12-19T13:46:30.925861+0000","last_clean":"2023-12-19T13:46:30.925861+0000","last_became_active":"2023-12-19T13:46:30.466140+0000","last_became_peered":"2023-12-19T13:46:30.466140+0000","last_unstale":"2023-12-19T13:46:30.925861+0000","last_undegraded":"2023-12-19T13:46:30.925861+0000","last_fullsized":"2023-12-19T13:46:30.925861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:54.770943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928217+0000","last_change":"2023-12-19T13:46:30.935325+0000","last_active":"2023-12-19T13:46:31.928217+0000","last_peered":"2023-12-19T13:46:31.928217+0000","last_clean":"2023-12-19T13:46:31.928217+0000","last_became_active":"2023-12-19T13:46:30.934910+0000","last_became_peered":"2023-12-19T13:46:30.934910+0000","last_unstale":"2023-12-19T13:46:31.928217+0000","last_undegraded":"2023-12-19T13:46:31.928217+0000","last_fullsized":"2023-12-19T13:46:31.928217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928316+0000","last_change":"2023-12-19T13:46:30.468537+0000","last_active":"2023-12-19T13:46:30.928316+0000","last_peered":"2023-12-19T13:46:30.928316+0000","last_clean":"2023-12-19T13:46:30.928316+0000","last_became_active":"2023-12-19T13:46:30.468301+0000","last_became_peered":"2023-12-19T13:46:30.468301+0000","last_unstale":"2023-12-19T13:46:30.928316+0000","last_undegraded":"2023-12-19T13:46:30.928316+0000","last_fullsized":"2023-12-19T13:46:30.928316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:39.901573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479355+0000","last_change":"2023-12-19T13:46:30.947051+0000","last_active":"2023-12-19T13:46:32.479355+0000","last_peered":"2023-12-19T13:46:32.479355+0000","last_clean":"2023-12-19T13:46:32.479355+0000","last_became_active":"2023-12-19T13:46:30.946837+0000","last_became_peered":"2023-12-19T13:46:30.946837+0000","last_unstale":"2023-12-19T13:46:32.479355+0000","last_undegraded":"2023-12-19T13:46:32.479355+0000","last_fullsized":"2023-12-19T13:46:32.479355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.929140+0000","last_change":"2023-12-19T13:46:30.456665+0000","last_active":"2023-12-19T13:46:30.929140+0000","last_peered":"2023-12-19T13:46:30.929140+0000","last_clean":"2023-12-19T13:46:30.929140+0000","last_became_active":"2023-12-19T13:46:30.456068+0000","last_became_peered":"2023-12-19T13:46:30.456068+0000","last_unstale":"2023-12-19T13:46:30.929140+0000","last_undegraded":"2023-12-19T13:46:30.929140+0000","last_fullsized":"2023-12-19T13:46:30.929140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.944823+0000","last_change":"2023-12-19T13:46:30.944565+0000","last_active":"2023-12-19T13:46:30.944823+0000","last_peered":"2023-12-19T13:46:30.944823+0000","last_clean":"2023-12-19T13:46:30.944823+0000","last_became_active":"2023-12-19T13:46:30.944091+0000","last_became_peered":"2023-12-19T13:46:30.944091+0000","last_unstale":"2023-12-19T13:46:30.944823+0000","last_undegraded":"2023-12-19T13:46:30.944823+0000","last_fullsized":"2023-12-19T13:46:30.944823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926212+0000","last_change":"2023-12-19T13:46:30.463352+0000","last_active":"2023-12-19T13:46:30.926212+0000","last_peered":"2023-12-19T13:46:30.926212+0000","last_clean":"2023-12-19T13:46:30.926212+0000","last_became_active":"2023-12-19T13:46:30.463056+0000","last_became_peered":"2023-12-19T13:46:30.463056+0000","last_unstale":"2023-12-19T13:46:30.926212+0000","last_undegraded":"2023-12-19T13:46:30.926212+0000","last_fullsized":"2023-12-19T13:46:30.926212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480115+0000","last_change":"2023-12-19T13:46:30.948432+0000","last_active":"2023-12-19T13:46:32.480115+0000","last_peered":"2023-12-19T13:46:32.480115+0000","last_clean":"2023-12-19T13:46:32.480115+0000","last_became_active":"2023-12-19T13:46:30.948068+0000","last_became_peered":"2023-12-19T13:46:30.948068+0000","last_unstale":"2023-12-19T13:46:32.480115+0000","last_undegraded":"2023-12-19T13:46:32.480115+0000","last_fullsized":"2023-12-19T13:46:32.480115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.941985+0000","last_change":"2023-12-19T13:46:30.463018+0000","last_active":"2023-12-19T13:46:30.941985+0000","last_peered":"2023-12-19T13:46:30.941985+0000","last_clean":"2023-12-19T13:46:30.941985+0000","last_became_active":"2023-12-19T13:46:30.462528+0000","last_became_peered":"2023-12-19T13:46:30.462528+0000","last_unstale":"2023-12-19T13:46:30.941985+0000","last_undegraded":"2023-12-19T13:46:30.941985+0000","last_fullsized":"2023-12-19T13:46:30.941985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932691+0000","last_change":"2023-12-19T13:46:30.949775+0000","last_active":"2023-12-19T13:46:31.932691+0000","last_peered":"2023-12-19T13:46:31.932691+0000","last_clean":"2023-12-19T13:46:31.932691+0000","last_became_active":"2023-12-19T13:46:30.949527+0000","last_became_peered":"2023-12-19T13:46:30.949527+0000","last_unstale":"2023-12-19T13:46:31.932691+0000","last_undegraded":"2023-12-19T13:46:31.932691+0000","last_fullsized":"2023-12-19T13:46:31.932691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928099+0000","last_change":"2023-12-19T13:46:30.463359+0000","last_active":"2023-12-19T13:46:30.928099+0000","last_peered":"2023-12-19T13:46:30.928099+0000","last_clean":"2023-12-19T13:46:30.928099+0000","last_became_active":"2023-12-19T13:46:30.463093+0000","last_became_peered":"2023-12-19T13:46:30.463093+0000","last_unstale":"2023-12-19T13:46:30.928099+0000","last_undegraded":"2023-12-19T13:46:30.928099+0000","last_fullsized":"2023-12-19T13:46:30.928099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:58.990876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478303+0000","last_change":"2023-12-19T13:46:30.954730+0000","last_active":"2023-12-19T13:46:32.478303+0000","last_peered":"2023-12-19T13:46:32.478303+0000","last_clean":"2023-12-19T13:46:32.478303+0000","last_became_active":"2023-12-19T13:46:30.954495+0000","last_became_peered":"2023-12-19T13:46:30.954495+0000","last_unstale":"2023-12-19T13:46:32.478303+0000","last_undegraded":"2023-12-19T13:46:32.478303+0000","last_fullsized":"2023-12-19T13:46:32.478303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:08.682812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932324+0000","last_change":"2023-12-19T13:46:30.470099+0000","last_active":"2023-12-19T13:46:30.932324+0000","last_peered":"2023-12-19T13:46:30.932324+0000","last_clean":"2023-12-19T13:46:30.932324+0000","last_became_active":"2023-12-19T13:46:30.469960+0000","last_became_peered":"2023-12-19T13:46:30.469960+0000","last_unstale":"2023-12-19T13:46:30.932324+0000","last_undegraded":"2023-12-19T13:46:30.932324+0000","last_fullsized":"2023-12-19T13:46:30.932324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928069+0000","last_change":"2023-12-19T13:46:30.944631+0000","last_active":"2023-12-19T13:46:31.928069+0000","last_peered":"2023-12-19T13:46:31.928069+0000","last_clean":"2023-12-19T13:46:31.928069+0000","last_became_active":"2023-12-19T13:46:30.943922+0000","last_became_peered":"2023-12-19T13:46:30.943922+0000","last_unstale":"2023-12-19T13:46:31.928069+0000","last_undegraded":"2023-12-19T13:46:31.928069+0000","last_fullsized":"2023-12-19T13:46:31.928069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959854+0000","last_change":"2023-12-19T13:46:30.472244+0000","last_active":"2023-12-19T13:46:30.959854+0000","last_peered":"2023-12-19T13:46:30.959854+0000","last_clean":"2023-12-19T13:46:30.959854+0000","last_became_active":"2023-12-19T13:46:30.471954+0000","last_became_peered":"2023-12-19T13:46:30.471954+0000","last_unstale":"2023-12-19T13:46:30.959854+0000","last_undegraded":"2023-12-19T13:46:30.959854+0000","last_fullsized":"2023-12-19T13:46:30.959854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927854+0000","last_change":"2023-12-19T13:46:30.939034+0000","last_active":"2023-12-19T13:46:31.927854+0000","last_peered":"2023-12-19T13:46:31.927854+0000","last_clean":"2023-12-19T13:46:31.927854+0000","last_became_active":"2023-12-19T13:46:30.938407+0000","last_became_peered":"2023-12-19T13:46:30.938407+0000","last_unstale":"2023-12-19T13:46:31.927854+0000","last_undegraded":"2023-12-19T13:46:31.927854+0000","last_fullsized":"2023-12-19T13:46:31.927854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.936764+0000","last_change":"2023-12-19T13:46:30.469524+0000","last_active":"2023-12-19T13:46:30.936764+0000","last_peered":"2023-12-19T13:46:30.936764+0000","last_clean":"2023-12-19T13:46:30.936764+0000","last_became_active":"2023-12-19T13:46:30.467130+0000","last_became_peered":"2023-12-19T13:46:30.467130+0000","last_unstale":"2023-12-19T13:46:30.936764+0000","last_undegraded":"2023-12-19T13:46:30.936764+0000","last_fullsized":"2023-12-19T13:46:30.936764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:25.754683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481642+0000","last_change":"2023-12-19T13:46:30.948464+0000","last_active":"2023-12-19T13:46:32.481642+0000","last_peered":"2023-12-19T13:46:32.481642+0000","last_clean":"2023-12-19T13:46:32.481642+0000","last_became_active":"2023-12-19T13:46:30.941429+0000","last_became_peered":"2023-12-19T13:46:30.941429+0000","last_unstale":"2023-12-19T13:46:32.481642+0000","last_undegraded":"2023-12-19T13:46:32.481642+0000","last_fullsized":"2023-12-19T13:46:32.481642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:14.644536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932435+0000","last_change":"2023-12-19T13:46:30.467632+0000","last_active":"2023-12-19T13:46:30.932435+0000","last_peered":"2023-12-19T13:46:30.932435+0000","last_clean":"2023-12-19T13:46:30.932435+0000","last_became_active":"2023-12-19T13:46:30.467326+0000","last_became_peered":"2023-12-19T13:46:30.467326+0000","last_unstale":"2023-12-19T13:46:30.932435+0000","last_undegraded":"2023-12-19T13:46:30.932435+0000","last_fullsized":"2023-12-19T13:46:30.932435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928264+0000","last_change":"2023-12-19T13:46:30.945501+0000","last_active":"2023-12-19T13:46:31.928264+0000","last_peered":"2023-12-19T13:46:31.928264+0000","last_clean":"2023-12-19T13:46:31.928264+0000","last_became_active":"2023-12-19T13:46:30.945070+0000","last_became_peered":"2023-12-19T13:46:30.945070+0000","last_unstale":"2023-12-19T13:46:31.928264+0000","last_undegraded":"2023-12-19T13:46:31.928264+0000","last_fullsized":"2023-12-19T13:46:31.928264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938563+0000","last_change":"2023-12-19T13:46:30.468143+0000","last_active":"2023-12-19T13:46:30.938563+0000","last_peered":"2023-12-19T13:46:30.938563+0000","last_clean":"2023-12-19T13:46:30.938563+0000","last_became_active":"2023-12-19T13:46:30.467699+0000","last_became_peered":"2023-12-19T13:46:30.467699+0000","last_unstale":"2023-12-19T13:46:30.938563+0000","last_undegraded":"2023-12-19T13:46:30.938563+0000","last_fullsized":"2023-12-19T13:46:30.938563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.947589+0000","last_change":"2023-12-19T13:46:30.947222+0000","last_active":"2023-12-19T13:46:30.947589+0000","last_peered":"2023-12-19T13:46:30.947589+0000","last_clean":"2023-12-19T13:46:30.947589+0000","last_became_active":"2023-12-19T13:46:30.947006+0000","last_became_peered":"2023-12-19T13:46:30.947006+0000","last_unstale":"2023-12-19T13:46:30.947589+0000","last_undegraded":"2023-12-19T13:46:30.947589+0000","last_fullsized":"2023-12-19T13:46:30.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958497+0000","last_change":"2023-12-19T13:46:30.465441+0000","last_active":"2023-12-19T13:46:30.958497+0000","last_peered":"2023-12-19T13:46:30.958497+0000","last_clean":"2023-12-19T13:46:30.958497+0000","last_became_active":"2023-12-19T13:46:30.465103+0000","last_became_peered":"2023-12-19T13:46:30.465103+0000","last_unstale":"2023-12-19T13:46:30.958497+0000","last_undegraded":"2023-12-19T13:46:30.958497+0000","last_fullsized":"2023-12-19T13:46:30.958497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478407+0000","last_change":"2023-12-19T13:46:30.952729+0000","last_active":"2023-12-19T13:46:32.478407+0000","last_peered":"2023-12-19T13:46:32.478407+0000","last_clean":"2023-12-19T13:46:32.478407+0000","last_became_active":"2023-12-19T13:46:30.950922+0000","last_became_peered":"2023-12-19T13:46:30.950922+0000","last_unstale":"2023-12-19T13:46:32.478407+0000","last_undegraded":"2023-12-19T13:46:32.478407+0000","last_fullsized":"2023-12-19T13:46:32.478407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:13.580642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481163+0000","last_change":"2023-12-19T13:46:30.957451+0000","last_active":"2023-12-19T13:46:32.481163+0000","last_peered":"2023-12-19T13:46:32.481163+0000","last_clean":"2023-12-19T13:46:32.481163+0000","last_became_active":"2023-12-19T13:46:30.955947+0000","last_became_peered":"2023-12-19T13:46:30.955947+0000","last_unstale":"2023-12-19T13:46:32.481163+0000","last_undegraded":"2023-12-19T13:46:32.481163+0000","last_fullsized":"2023-12-19T13:46:32.481163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:07.116909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959781+0000","last_change":"2023-12-19T13:46:30.470680+0000","last_active":"2023-12-19T13:46:30.959781+0000","last_peered":"2023-12-19T13:46:30.959781+0000","last_clean":"2023-12-19T13:46:30.959781+0000","last_became_active":"2023-12-19T13:46:30.470409+0000","last_became_peered":"2023-12-19T13:46:30.470409+0000","last_unstale":"2023-12-19T13:46:30.959781+0000","last_undegraded":"2023-12-19T13:46:30.959781+0000","last_fullsized":"2023-12-19T13:46:30.959781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479758+0000","last_change":"2023-12-19T13:46:30.946912+0000","last_active":"2023-12-19T13:46:32.479758+0000","last_peered":"2023-12-19T13:46:32.479758+0000","last_clean":"2023-12-19T13:46:32.479758+0000","last_became_active":"2023-12-19T13:46:30.946689+0000","last_became_peered":"2023-12-19T13:46:30.946689+0000","last_unstale":"2023-12-19T13:46:32.479758+0000","last_undegraded":"2023-12-19T13:46:32.479758+0000","last_fullsized":"2023-12-19T13:46:32.479758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960456+0000","last_change":"2023-12-19T13:46:30.470862+0000","last_active":"2023-12-19T13:46:30.960456+0000","last_peered":"2023-12-19T13:46:30.960456+0000","last_clean":"2023-12-19T13:46:30.960456+0000","last_became_active":"2023-12-19T13:46:30.470428+0000","last_became_peered":"2023-12-19T13:46:30.470428+0000","last_unstale":"2023-12-19T13:46:30.960456+0000","last_undegraded":"2023-12-19T13:46:30.960456+0000","last_fullsized":"2023-12-19T13:46:30.960456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950966+0000","last_change":"2023-12-19T13:46:30.949145+0000","last_active":"2023-12-19T13:46:30.950966+0000","last_peered":"2023-12-19T13:46:30.950966+0000","last_clean":"2023-12-19T13:46:30.950966+0000","last_became_active":"2023-12-19T13:46:30.946515+0000","last_became_peered":"2023-12-19T13:46:30.946515+0000","last_unstale":"2023-12-19T13:46:30.950966+0000","last_undegraded":"2023-12-19T13:46:30.950966+0000","last_fullsized":"2023-12-19T13:46:30.950966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953453+0000","last_change":"2023-12-19T13:46:30.449386+0000","last_active":"2023-12-19T13:46:30.953453+0000","last_peered":"2023-12-19T13:46:30.953453+0000","last_clean":"2023-12-19T13:46:30.953453+0000","last_became_active":"2023-12-19T13:46:30.448900+0000","last_became_peered":"2023-12-19T13:46:30.448900+0000","last_unstale":"2023-12-19T13:46:30.953453+0000","last_undegraded":"2023-12-19T13:46:30.953453+0000","last_fullsized":"2023-12-19T13:46:30.953453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952114+0000","last_change":"2023-12-19T13:46:30.952009+0000","last_active":"2023-12-19T13:46:30.952114+0000","last_peered":"2023-12-19T13:46:30.952114+0000","last_clean":"2023-12-19T13:46:30.952114+0000","last_became_active":"2023-12-19T13:46:30.951734+0000","last_became_peered":"2023-12-19T13:46:30.951734+0000","last_unstale":"2023-12-19T13:46:30.952114+0000","last_undegraded":"2023-12-19T13:46:30.952114+0000","last_fullsized":"2023-12-19T13:46:30.952114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959118+0000","last_change":"2023-12-19T13:46:30.458973+0000","last_active":"2023-12-19T13:46:30.959118+0000","last_peered":"2023-12-19T13:46:30.959118+0000","last_clean":"2023-12-19T13:46:30.959118+0000","last_became_active":"2023-12-19T13:46:30.458267+0000","last_became_peered":"2023-12-19T13:46:30.458267+0000","last_unstale":"2023-12-19T13:46:30.959118+0000","last_undegraded":"2023-12-19T13:46:30.959118+0000","last_fullsized":"2023-12-19T13:46:30.959118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]}],"pool_statfs":[]}} 2023-12-19T13:46:41.246 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:46:41.246 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T13:46:41.246 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T13:46:41.247 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T13:46:41.247 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T13:46:41.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.494+0000 7f8915577640 1 Processor -- start 2023-12-19T13:46:41.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.494+0000 7f8915577640 1 -- start start 2023-12-19T13:46:41.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f8915577640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101449e0 0x7f89100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f8915577640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89100b0b50 0x7f891006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f8915577640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89100afb10 con 0x7f891006b590 2023-12-19T13:46:41.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f8915577640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891006bb30 con 0x7f89100b0b50 2023-12-19T13:46:41.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f8915577640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89100b0070 con 0x7f89101449e0 2023-12-19T13:46:41.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f890f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f891006b590 0x7f891015eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59354/0 (socket says 172.21.15.113:59354) 2023-12-19T13:46:41.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f890f7fe640 1 -- 172.21.15.113:0/2243900059 learned_addr learned my addr 172.21.15.113:0/2243900059 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f890effd640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101449e0 0x7f89100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.496+0000 7f8907fff640 1 --2- 172.21.15.113:0/2243900059 >> v2:172.21.15.151:3300/0 conn(0x7f89100b0b50 0x7f891006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935446613 0 0) 0x7f89100afb10 con 0x7f891006b590 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88fc003520 con 0x7f891006b590 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3492463024 0 0) 0x7f88fc003520 con 0x7f891006b590 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101449e0 msgr2=0x7f89100af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101449e0 0x7f89100af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 >> v2:172.21.15.151:3300/0 conn(0x7f89100b0b50 msgr2=0x7f891006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 --2- 172.21.15.113:0/2243900059 >> v2:172.21.15.151:3300/0 conn(0x7f89100b0b50 0x7f891006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89100b0350 con 0x7f891006b590 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f89080019f0 con 0x7f891006b590 2023-12-19T13:46:41.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 >> v1:172.21.15.113:6789/0 conn(0x7f891006b590 legacy=0x7f891015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0039e0 0x7f88fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88fc0047c0 0x7f88fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101449e0 0x7f88fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891006bb30 con 0x7f88fc0047c0 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89100b0070 con 0x7f88fc0039e0 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc00ba00 con 0x7f89101449e0 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f8907fff640 1 --2- 172.21.15.113:0/2243900059 >> v2:172.21.15.151:3300/0 conn(0x7f89100b0b50 0x7f891006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.497+0000 7f8907fff640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88fc0047c0 0x7f88fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.498+0000 7f890effd640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0039e0 0x7f88fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.498+0000 7f8907fff640 1 -- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101449e0 msgr2=0x7f88fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.498+0000 7f8907fff640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101449e0 0x7f88fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.498+0000 7f8907fff640 1 -- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0039e0 msgr2=0x7f88fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.498+0000 7f8907fff640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0039e0 0x7f88fc003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.498+0000 7f8907fff640 1 -- 172.21.15.113:0/2243900059 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc003520 con 0x7f88fc0047c0 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.499+0000 7f8907fff640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88fc0047c0 0x7f88fc004c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009600 tx=0x7f88fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fc81d53370ef7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.499+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8030990 con 0x7f88fc0047c0 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.499+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f8030af0 con 0x7f88fc0047c0 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.499+0000 7f890e7fc640 1 -- 172.21.15.113:0/2243900059 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8030e60 con 0x7f88fc0047c0 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.500+0000 7f8915577640 1 -- 172.21.15.113:0/2243900059 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88fc0047c0 msgr2=0x7f88fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.500+0000 7f8915577640 1 --2- 172.21.15.113:0/2243900059 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88fc0047c0 0x7f88fc004c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009600 tx=0x7f88fc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.500+0000 7f890f7fe640 1 -- 172.21.15.113:0/2243900059 reap_dead start 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.500+0000 7f8915577640 1 -- 172.21.15.113:0/2243900059 shutdown_connections 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.500+0000 7f8915577640 1 -- 172.21.15.113:0/2243900059 >> 172.21.15.113:0/2243900059 conn(0x7f89100cbb70 msgr2=0x7f89100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.500+0000 7f8915577640 1 -- 172.21.15.113:0/2243900059 shutdown_connections 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.500+0000 7f8915577640 1 -- 172.21.15.113:0/2243900059 wait complete. 2023-12-19T13:46:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.501+0000 7f8915577640 1 Processor -- start 2023-12-19T13:46:41.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.502+0000 7f8915577640 1 -- start start 2023-12-19T13:46:41.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.502+0000 7f8915577640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0047c0 0x7f89101426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.502+0000 7f8915577640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f891015dd50 0x7f891015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.502+0000 7f8915577640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101ee340 0x7f89101405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.502+0000 7f8915577640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891015a900 con 0x7f891015dd50 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.502+0000 7f8915577640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8910142d00 con 0x7f88fc0047c0 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.502+0000 7f8915577640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89101413a0 con 0x7f89101ee340 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f891015dd50 0x7f891015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f891015dd50 0x7f891015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43424/0 (socket says 172.21.15.113:43424) 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 -- 172.21.15.113:0/3741969908 learned_addr learned my addr 172.21.15.113:0/3741969908 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f890f7fe640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101ee340 0x7f89101405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f890effd640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0047c0 0x7f89101426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 -- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101ee340 msgr2=0x7f89101405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101ee340 0x7f89101405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 -- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0047c0 msgr2=0x7f89101426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0047c0 0x7f89101426b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 -- 172.21.15.113:0/3741969908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910159fd0 con 0x7f891015dd50 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.503+0000 7f8907fff640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f891015dd50 0x7f891015ad90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88f8030400 tx=0x7f88f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.504+0000 7f89077fe640 1 -- 172.21.15.113:0/3741969908 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8030e60 con 0x7f891015dd50 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.504+0000 7f89077fe640 1 -- 172.21.15.113:0/3741969908 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f8042410 con 0x7f891015dd50 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.504+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891015a2b0 con 0x7f891015dd50 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.504+0000 7f89077fe640 1 -- 172.21.15.113:0/3741969908 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80427a0 con 0x7f891015dd50 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.504+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89101ee7c0 con 0x7f891015dd50 2023-12-19T13:46:41.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.505+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891015e550 con 0x7f891015dd50 2023-12-19T13:46:41.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.506+0000 7f89077fe640 1 -- 172.21.15.113:0/3741969908 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88f803f050 con 0x7f891015dd50 2023-12-19T13:46:41.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.506+0000 7f89077fe640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88f006a460 0x7f88f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.507+0000 7f89077fe640 1 -- 172.21.15.113:0/3741969908 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88f80aeaa0 con 0x7f891015dd50 2023-12-19T13:46:41.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.507+0000 7f890effd640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88f006a460 0x7f88f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.507+0000 7f890effd640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88f006a460 0x7f88f006c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8900009830 tx=0x7f8900008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.511+0000 7f89077fe640 1 -- 172.21.15.113:0/3741969908 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f88f807a0a0 con 0x7f891015dd50 2023-12-19T13:46:41.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.743+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8910061910 con 0x7f891015dd50 2023-12-19T13:46:41.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.751+0000 7f89077fe640 1 -- 172.21.15.113:0/3741969908 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169969 (secure 0 0 0) 0x7f88f8052090 con 0x7f891015dd50 2023-12-19T13:46:41.754 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88f006a460 msgr2=0x7f88f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88f006a460 0x7f88f006c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8900009830 tx=0x7f8900008040 comp rx=0 tx=0).stop 2023-12-19T13:46:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f891015dd50 msgr2=0x7f891015ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f891015dd50 0x7f891015ad90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88f8030400 tx=0x7f88f8004730 comp rx=0 tx=0).stop 2023-12-19T13:46:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 shutdown_connections 2023-12-19T13:46:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88f006a460 0x7f88f006c920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89101ee340 0x7f89101405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f891015dd50 0x7f891015ad90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 --2- 172.21.15.113:0/3741969908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc0047c0 0x7f89101426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.755+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 >> 172.21.15.113:0/3741969908 conn(0x7f89100cbb70 msgr2=0x7f891013f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.756+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 shutdown_connections 2023-12-19T13:46:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.756+0000 7f8915577640 1 -- 172.21.15.113:0/3741969908 wait complete. 2023-12-19T13:46:41.773 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":83819},{"type":"v1","addr":"172.21.15.113:6833","nonce":83819}]},"active_addr":"172.21.15.113:6833/83819","active_change":"2023-12-19T13:46:18.388708+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":1039257551}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":1027229139}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":1223051871}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":487093804}]}]} 2023-12-19T13:46:41.777 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T13:46:41.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T13:46:41.778 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:41.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.972+0000 7ff4cc72e640 1 Processor -- start 2023-12-19T13:46:41.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.972+0000 7ff4cc72e640 1 -- start start 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4cc72e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff4c41449e0 0x7ff4c40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4cc72e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff4c406c6b0 0x7ff4c40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4cc72e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40afb10 con 0x7ff4c40b0b50 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4cc72e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c406bb30 con 0x7ff4c406c6b0 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4cc72e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40b0070 con 0x7ff4c41449e0 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4caccb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff4c406c6b0 0x7ff4c40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4c9cc9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff4c40b0b50 0x7ff4c406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59360/0 (socket says 172.21.15.113:59360) 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4caccb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff4c406c6b0 0x7ff4c40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43436/0 (socket says 172.21.15.113:43436) 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4c9cc9640 1 -- 172.21.15.113:0/3844967873 learned_addr learned my addr 172.21.15.113:0/3844967873 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:41.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.974+0000 7ff4ca4ca640 1 --2- 172.21.15.113:0/3844967873 >> v2:172.21.15.151:3300/0 conn(0x7ff4c41449e0 0x7ff4c40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.975+0000 7ff4caccb640 1 -- 172.21.15.113:0/3844967873 >> v2:172.21.15.151:3300/0 conn(0x7ff4c41449e0 msgr2=0x7ff4c40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:41.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.975+0000 7ff4caccb640 1 --2- 172.21.15.113:0/3844967873 >> v2:172.21.15.151:3300/0 conn(0x7ff4c41449e0 0x7ff4c40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.975+0000 7ff4caccb640 1 -- 172.21.15.113:0/3844967873 >> v1:172.21.15.113:6789/0 conn(0x7ff4c40b0b50 legacy=0x7ff4c406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.975+0000 7ff4caccb640 1 -- 172.21.15.113:0/3844967873 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40b0350 con 0x7ff4c406c6b0 2023-12-19T13:46:41.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.975+0000 7ff4ca4ca640 1 --2- 172.21.15.113:0/3844967873 >> v2:172.21.15.151:3300/0 conn(0x7ff4c41449e0 0x7ff4c40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:41.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.976+0000 7ff4caccb640 1 --2- 172.21.15.113:0/3844967873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c406c6b0 0x7ff4c40b1710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4071cd0 tx=0x7ff4bc02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c0c99ab2e70a4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.976+0000 7ff4c94c8640 1 -- 172.21.15.113:0/3844967873 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc02cc70 con 0x7ff4c406c6b0 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.976+0000 7ff4c94c8640 1 -- 172.21.15.113:0/3844967873 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc02cdd0 con 0x7ff4c406c6b0 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.976+0000 7ff4c94c8640 1 -- 172.21.15.113:0/3844967873 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc034660 con 0x7ff4c406c6b0 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.976+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3844967873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c406c6b0 msgr2=0x7ff4c40b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.976+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3844967873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c406c6b0 0x7ff4c40b1710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4071cd0 tx=0x7ff4bc02bec0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.977+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3844967873 shutdown_connections 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.977+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3844967873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c406c6b0 0x7ff4c40b1710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.977+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3844967873 >> v2:172.21.15.151:3300/0 conn(0x7ff4c41449e0 0x7ff4c40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.977+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3844967873 >> 172.21.15.113:0/3844967873 conn(0x7ff4c40cbb70 msgr2=0x7ff4c40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.977+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3844967873 shutdown_connections 2023-12-19T13:46:41.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.977+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3844967873 wait complete. 2023-12-19T13:46:41.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.978+0000 7ff4cc72e640 1 Processor -- start 2023-12-19T13:46:41.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.978+0000 7ff4cc72e640 1 -- start start 2023-12-19T13:46:41.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.979+0000 7ff4cc72e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c406c6b0 0x7ff4c415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.979+0000 7ff4cc72e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c40b0b50 0x7ff4c40ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.979+0000 7ff4cc72e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c41449e0 0x7ff4c40ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.979+0000 7ff4cc72e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41f2d20 con 0x7ff4c40b0b50 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.979+0000 7ff4cc72e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c415e060 con 0x7ff4c406c6b0 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.979+0000 7ff4cc72e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c415e340 con 0x7ff4c41449e0 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c40b0b50 0x7ff4c40ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c40b0b50 0x7ff4c40ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43452/0 (socket says 172.21.15.113:43452) 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 -- 172.21.15.113:0/3141498041 learned_addr learned my addr 172.21.15.113:0/3141498041 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4ca4ca640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c406c6b0 0x7ff4c415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4caccb640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c41449e0 0x7ff4c40ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 -- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c41449e0 msgr2=0x7ff4c40ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c41449e0 0x7ff4c40ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 -- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c406c6b0 msgr2=0x7ff4c415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c406c6b0 0x7ff4c415c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 -- 172.21.15.113:0/3141498041 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc009a70 con 0x7ff4c40b0b50 2023-12-19T13:46:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4ca4ca640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c406c6b0 0x7ff4c415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:41.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.980+0000 7ff4c9cc9640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c40b0b50 0x7ff4c40ad140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c4a0 tx=0x7ff4b400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.981+0000 7ff4baffd640 1 -- 172.21.15.113:0/3141498041 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4005ce0 con 0x7ff4c40b0b50 2023-12-19T13:46:41.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.981+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c415e620 con 0x7ff4c40b0b50 2023-12-19T13:46:41.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.981+0000 7ff4baffd640 1 -- 172.21.15.113:0/3141498041 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4005e40 con 0x7ff4c40b0b50 2023-12-19T13:46:41.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.981+0000 7ff4baffd640 1 -- 172.21.15.113:0/3141498041 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4007270 con 0x7ff4c40b0b50 2023-12-19T13:46:41.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.981+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c415dd30 con 0x7ff4c40b0b50 2023-12-19T13:46:41.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.982+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c41f3220 con 0x7ff4c40b0b50 2023-12-19T13:46:41.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.983+0000 7ff4baffd640 1 -- 172.21.15.113:0/3141498041 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4b4007490 con 0x7ff4c40b0b50 2023-12-19T13:46:41.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.983+0000 7ff4baffd640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff4a806a430 0x7ff4a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:41.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.984+0000 7ff4baffd640 1 -- 172.21.15.113:0/3141498041 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4b4087dc0 con 0x7ff4c40b0b50 2023-12-19T13:46:41.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.984+0000 7ff4ca4ca640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff4a806a430 0x7ff4a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:41.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.984+0000 7ff4ca4ca640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff4a806a430 0x7ff4a806c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0006fd0 tx=0x7ff4c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:41.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:41.988+0000 7ff4baffd640 1 -- 172.21.15.113:0/3141498041 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4c41f3220 con 0x7ff4c40b0b50 2023-12-19T13:46:42.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.176+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c41f3220 con 0x7ff4c40b0b50 2023-12-19T13:46:42.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.178+0000 7ff4baffd640 1 -- 172.21.15.113:0/3141498041 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7ff4c41f3220 con 0x7ff4c40b0b50 2023-12-19T13:46:42.179 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:42.179 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:42.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff4a806a430 msgr2=0x7ff4a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff4a806a430 0x7ff4a806c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0006fd0 tx=0x7ff4c0008040 comp rx=0 tx=0).stop 2023-12-19T13:46:42.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c40b0b50 msgr2=0x7ff4c40ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c40b0b50 0x7ff4c40ad140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c4a0 tx=0x7ff4b400c960 comp rx=0 tx=0).stop 2023-12-19T13:46:42.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 shutdown_connections 2023-12-19T13:46:42.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff4a806a430 0x7ff4a806c8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c41449e0 0x7ff4c40ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4c40b0b50 0x7ff4c40ad140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 --2- 172.21.15.113:0/3141498041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c406c6b0 0x7ff4c415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 >> 172.21.15.113:0/3141498041 conn(0x7ff4c40cbb70 msgr2=0x7ff4c40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.180+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 shutdown_connections 2023-12-19T13:46:42.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.181+0000 7ff4cc72e640 1 -- 172.21.15.113:0/3141498041 wait complete. 2023-12-19T13:46:42.199 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T13:46:42.199 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:42.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.409+0000 7ff6bffff640 1 Processor -- start 2023-12-19T13:46:42.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.409+0000 7ff6bffff640 1 -- start start 2023-12-19T13:46:42.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.410+0000 7ff6bffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6c015d510 0x7ff6c0161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.410+0000 7ff6bffff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c015e890 con 0x7ff6c015d8f0 2023-12-19T13:46:42.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.410+0000 7ff6bffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c015e2d0 con 0x7ff6c00ce530 2023-12-19T13:46:42.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.410+0000 7ff6bffff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c015e5b0 con 0x7ff6c015d510 2023-12-19T13:46:42.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6be7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff6c015d8f0 0x7ff6c00cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59362/0 (socket says 172.21.15.113:59362) 2023-12-19T13:46:42.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6be7fc640 1 -- 172.21.15.113:0/3446184545 learned_addr learned my addr 172.21.15.113:0/3446184545 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:42.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6beffd640 1 --2- 172.21.15.113:0/3446184545 >> v2:172.21.15.151:3300/0 conn(0x7ff6c015d510 0x7ff6c0161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315445778 0 0) 0x7ff6c015e890 con 0x7ff6c015d8f0 2023-12-19T13:46:42.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a8003520 con 0x7ff6c015d8f0 2023-12-19T13:46:42.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2302930306 0 0) 0x7ff6a8003520 con 0x7ff6c015d8f0 2023-12-19T13:46:42.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 >> v2:172.21.15.151:3300/0 conn(0x7ff6c015d510 msgr2=0x7ff6c0161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 --2- 172.21.15.113:0/3446184545 >> v2:172.21.15.151:3300/0 conn(0x7ff6c015d510 0x7ff6c0161810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 >> v1:172.21.15.151:6789/0 conn(0x7ff6c00ce530 legacy=0x7ff6c00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0161010 con 0x7ff6c015d8f0 2023-12-19T13:46:42.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff6b4001670 con 0x7ff6c015d8f0 2023-12-19T13:46:42.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 >> v1:172.21.15.113:6789/0 conn(0x7ff6c015d8f0 legacy=0x7ff6c00cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a8003970 0x7ff6a8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6a80047c0 0x7ff6a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6a8005180 0x7ff6a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015e5b0 con 0x7ff6a80047c0 2023-12-19T13:46:42.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a800c000 con 0x7ff6a8003970 2023-12-19T13:46:42.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.411+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a800c1c0 con 0x7ff6a8005180 2023-12-19T13:46:42.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6be7fc640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6a80047c0 0x7ff6a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6beffd640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a8003970 0x7ff6a8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6be7fc640 1 -- 172.21.15.113:0/3446184545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6a8005180 msgr2=0x7ff6a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6be7fc640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6a8005180 0x7ff6a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6be7fc640 1 -- 172.21.15.113:0/3446184545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a8003970 msgr2=0x7ff6a8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6be7fc640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a8003970 0x7ff6a8003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6be7fc640 1 -- 172.21.15.113:0/3446184545 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0161010 con 0x7ff6a80047c0 2023-12-19T13:46:42.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.412+0000 7ff6bf7fe640 1 -- 172.21.15.113:0/3446184545 reap_dead start 2023-12-19T13:46:42.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.413+0000 7ff6be7fc640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6a80047c0 0x7ff6a8004c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c290 tx=0x7ff6a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9e85e63058b99f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b402cb20 con 0x7ff6a80047c0 2023-12-19T13:46:42.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b402cc80 con 0x7ff6a80047c0 2023-12-19T13:46:42.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bdffb640 1 -- 172.21.15.113:0/3446184545 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40058d0 con 0x7ff6a80047c0 2023-12-19T13:46:42.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bffff640 1 -- 172.21.15.113:0/3446184545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6a80047c0 msgr2=0x7ff6a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bffff640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6a80047c0 0x7ff6a8004c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c290 tx=0x7ff6a80057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bffff640 1 -- 172.21.15.113:0/3446184545 shutdown_connections 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bffff640 1 --2- 172.21.15.113:0/3446184545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6a80047c0 0x7ff6a8004c40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bffff640 1 -- 172.21.15.113:0/3446184545 >> 172.21.15.113:0/3446184545 conn(0x7ff6c00d30e0 msgr2=0x7ff6c00d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bffff640 1 -- 172.21.15.113:0/3446184545 shutdown_connections 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.414+0000 7ff6bffff640 1 -- 172.21.15.113:0/3446184545 wait complete. 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.416+0000 7ff6bffff640 1 Processor -- start 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.416+0000 7ff6bffff640 1 -- start start 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a80047c0 0x7ff6c01449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6c01e8e10 0x7ff6c01e9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6c015b330 0x7ff6c015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bffff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015c300 con 0x7ff6c015b330 2023-12-19T13:46:42.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015c5e0 con 0x7ff6a80047c0 2023-12-19T13:46:42.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015c8c0 con 0x7ff6c01e8e10 2023-12-19T13:46:42.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6c015b330 0x7ff6c015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6c015b330 0x7ff6c015b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43484/0 (socket says 172.21.15.113:43484) 2023-12-19T13:46:42.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.417+0000 7ff6bf7fe640 1 -- 172.21.15.113:0/432617068 learned_addr learned my addr 172.21.15.113:0/432617068 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6beffd640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a80047c0 0x7ff6c01449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bf7fe640 1 -- 172.21.15.113:0/432617068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6c01e8e10 msgr2=0x7ff6c01e9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bf7fe640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6c01e8e10 0x7ff6c01e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bf7fe640 1 -- 172.21.15.113:0/432617068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a80047c0 msgr2=0x7ff6c01449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bf7fe640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a80047c0 0x7ff6c01449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bf7fe640 1 -- 172.21.15.113:0/432617068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c015cba0 con 0x7ff6c015b330 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bf7fe640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6c015b330 0x7ff6c015b7e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8007fd0 tx=0x7ff6b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6a7fff640 1 -- 172.21.15.113:0/432617068 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80070d0 con 0x7ff6c015b330 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6a7fff640 1 -- 172.21.15.113:0/432617068 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8007230 con 0x7ff6c015b330 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6a7fff640 1 -- 172.21.15.113:0/432617068 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80075e0 con 0x7ff6c015b330 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c01e67d0 con 0x7ff6c015b330 2023-12-19T13:46:42.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.418+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c015bd20 con 0x7ff6c015b330 2023-12-19T13:46:42.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.420+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c01e69c0 con 0x7ff6c015b330 2023-12-19T13:46:42.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.420+0000 7ff6a7fff640 1 -- 172.21.15.113:0/432617068 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6b8007740 con 0x7ff6c015b330 2023-12-19T13:46:42.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.421+0000 7ff6a7fff640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff6ac06a460 0x7ff6ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.421+0000 7ff6a7fff640 1 -- 172.21.15.113:0/432617068 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6b8087d90 con 0x7ff6c015b330 2023-12-19T13:46:42.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.421+0000 7ff6beffd640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff6ac06a460 0x7ff6ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.422+0000 7ff6beffd640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff6ac06a460 0x7ff6ac06c920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00099d0 tx=0x7ff6b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.425+0000 7ff6a7fff640 1 -- 172.21.15.113:0/432617068 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff6b8053380 con 0x7ff6c015b330 2023-12-19T13:46:42.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.605+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6c0061910 con 0x7ff6c015b330 2023-12-19T13:46:42.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.607+0000 7ff6a7fff640 1 -- 172.21.15.113:0/432617068 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7ff6b80569a0 con 0x7ff6c015b330 2023-12-19T13:46:42.608 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:42.608 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff6ac06a460 msgr2=0x7ff6ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff6ac06a460 0x7ff6ac06c920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00099d0 tx=0x7ff6b0008040 comp rx=0 tx=0).stop 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6c015b330 msgr2=0x7ff6c015b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6c015b330 0x7ff6c015b7e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8007fd0 tx=0x7ff6b800c890 comp rx=0 tx=0).stop 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 shutdown_connections 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff6ac06a460 0x7ff6ac06c920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6c015b330 0x7ff6c015b7e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6c01e8e10 0x7ff6c01e9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 --2- 172.21.15.113:0/432617068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6a80047c0 0x7ff6c01449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 >> 172.21.15.113:0/432617068 conn(0x7ff6c00d30e0 msgr2=0x7ff6c0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 shutdown_connections 2023-12-19T13:46:42.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.610+0000 7ff6bffff640 1 -- 172.21.15.113:0/432617068 wait complete. 2023-12-19T13:46:42.628 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T13:46:42.629 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T13:46:42.629 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T13:46:42.630 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T13:46:42.630 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T13:46:42.630 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T13:46:42.631 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T13:46:42.631 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T13:46:42.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.928+0000 7f9ced729640 1 Processor -- start 2023-12-19T13:46:42.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.929+0000 7f52f2084640 1 Processor -- start 2023-12-19T13:46:42.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.929+0000 7f52f2084640 1 -- start start 2023-12-19T13:46:42.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.929+0000 7f9ced729640 1 -- start start 2023-12-19T13:46:42.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.931+0000 7f9ced729640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ce00e4740 0x7f9ce00543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f9ced729640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0035cc0 0x7f9ce00388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f52f2084640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52ec0cb890 0x7f52ec15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f52f2084640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec15dde0 con 0x7f52ec0cb180 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f52f2084640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec0b32c0 con 0x7f52ec159320 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f52f2084640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec070380 con 0x7f52ec0cb890 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f9ced729640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce0056b90 con 0x7f9ce0038de0 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f9cecf28640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9ce0038de0 0x7f9ce00e4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59370/0 (socket says 172.21.15.113:59370) 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f9cecf28640 1 -- 172.21.15.113:0/484414509 learned_addr learned my addr 172.21.15.113:0/484414509 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:42.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.932+0000 7f9ce7fff640 1 --2- 172.21.15.113:0/484414509 >> v2:172.21.15.151:3300/0 conn(0x7f9ce00e4740 0x7f9ce00543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f9ced729640 1 -- 172.21.15.113:0/484414509 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce0039230 con 0x7f9ce00e4740 2023-12-19T13:46:42.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f30f359e640 1 Processor -- start 2023-12-19T13:46:42.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f9ced729640 1 -- 172.21.15.113:0/484414509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce00549f0 con 0x7f9ce0035cc0 2023-12-19T13:46:42.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f52e3fff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f52ec159320 0x7f52ec15d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:59032/0 (socket says 172.21.15.113:59032) 2023-12-19T13:46:42.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f52e3fff640 1 -- 172.21.15.113:0/992354104 learned_addr learned my addr 172.21.15.113:0/992354104 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:42.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f9ce77fe640 1 --2- 172.21.15.113:0/484414509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0035cc0 0x7f9ce00388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f52ebfff640 1 --2- 172.21.15.113:0/992354104 >> v2:172.21.15.113:3300/0 conn(0x7f52ec0cb890 0x7f52ec15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f9ce6ffd640 1 -- 172.21.15.113:0/484414509 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234766200 0 0) 0x7f9ce806ed80 con 0x7f9ce0038de0 2023-12-19T13:46:42.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f9ce6ffd640 1 -- 172.21.15.113:0/484414509 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd8007930 con 0x7f9ce0038de0 2023-12-19T13:46:42.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f9ce77fe640 1 -- 172.21.15.113:0/484414509 >> v2:172.21.15.151:3300/0 conn(0x7f9ce00e4740 msgr2=0x7f9ce00543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f9ce77fe640 1 --2- 172.21.15.113:0/484414509 >> v2:172.21.15.151:3300/0 conn(0x7f9ce00e4740 0x7f9ce00543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f9ce77fe640 1 -- 172.21.15.113:0/484414509 >> v1:172.21.15.113:6789/0 conn(0x7f9ce0038de0 legacy=0x7f9ce00e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f52ebfff640 1 -- 172.21.15.113:0/992354104 >> v1:172.21.15.151:6789/0 conn(0x7f52ec159320 legacy=0x7f52ec15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f52ebfff640 1 -- 172.21.15.113:0/992354104 >> v1:172.21.15.113:6789/0 conn(0x7f52ec0cb180 legacy=0x7f52ec0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f52ebfff640 1 -- 172.21.15.113:0/992354104 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec070660 con 0x7f52ec0cb890 2023-12-19T13:46:42.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.933+0000 7f30f359e640 1 -- start start 2023-12-19T13:46:42.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.934+0000 7f52eaffd640 1 -- 172.21.15.113:0/992354104 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444778478 0 0) 0x7f52ec0b32c0 con 0x7f52ec159320 2023-12-19T13:46:42.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.935+0000 7f9ce77fe640 1 -- 172.21.15.113:0/484414509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0036340 con 0x7f9ce0035cc0 2023-12-19T13:46:42.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.935+0000 7f9ce7fff640 1 --2- 172.21.15.113:0/484414509 >> v2:172.21.15.151:3300/0 conn(0x7f9ce00e4740 0x7f9ce00543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:42.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f30f359e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30ec0eb700 0x7f30ec007020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f30f359e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec050340 con 0x7f30ec0eb2c0 2023-12-19T13:46:42.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f30f359e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec006480 con 0x7f30ec0e78b0 2023-12-19T13:46:42.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f30f359e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec04fd80 con 0x7f30ec0eb700 2023-12-19T13:46:42.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f30f1d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f30ec0eb2c0 0x7f30ec006910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59384/0 (socket says 172.21.15.113:59384) 2023-12-19T13:46:42.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f30f1d9b640 1 -- 172.21.15.113:0/3165595079 learned_addr learned my addr 172.21.15.113:0/3165595079 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:42.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f52ebfff640 1 --2- 172.21.15.113:0/992354104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec0cb890 0x7f52ec15d8a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009d90 tx=0x7f52e402e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7198fc759f6ad73b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f30f2d9d640 1 --2- 172.21.15.113:0/3165595079 >> v2:172.21.15.151:3300/0 conn(0x7f30ec0eb700 0x7f30ec007020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.936+0000 7f52eaffd640 1 -- 172.21.15.113:0/992354104 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4036440 con 0x7f52ec0cb890 2023-12-19T13:46:42.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.937+0000 7f52eaffd640 1 -- 172.21.15.113:0/992354104 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e40365a0 con 0x7f52ec0cb890 2023-12-19T13:46:42.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.937+0000 7f52eaffd640 1 -- 172.21.15.113:0/992354104 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4036440 con 0x7f52ec0cb890 2023-12-19T13:46:42.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.937+0000 7f30f2d9d640 1 -- 172.21.15.113:0/3165595079 >> v1:172.21.15.151:6789/0 conn(0x7f30ec0e78b0 legacy=0x7f30ec04f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f30f2d9d640 1 -- 172.21.15.113:0/3165595079 >> v1:172.21.15.113:6789/0 conn(0x7f30ec0eb2c0 legacy=0x7f30ec006910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f52f2084640 1 -- 172.21.15.113:0/992354104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec0cb890 msgr2=0x7f52ec15d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f52f2084640 1 --2- 172.21.15.113:0/992354104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec0cb890 0x7f52ec15d8a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009d90 tx=0x7f52e402e150 comp rx=0 tx=0).stop 2023-12-19T13:46:42.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f30f2d9d640 1 -- 172.21.15.113:0/3165595079 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec050060 con 0x7f30ec0eb700 2023-12-19T13:46:42.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f52f2084640 1 -- 172.21.15.113:0/992354104 shutdown_connections 2023-12-19T13:46:42.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f52f2084640 1 --2- 172.21.15.113:0/992354104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec0cb890 0x7f52ec15d8a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f52f2084640 1 -- 172.21.15.113:0/992354104 >> 172.21.15.113:0/992354104 conn(0x7f52ec0b4300 msgr2=0x7f52ec0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.937+0000 7f30f159a640 1 -- 172.21.15.113:0/3165595079 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634375612 0 0) 0x7f30ec050340 con 0x7f30ec0eb2c0 2023-12-19T13:46:42.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f52f2084640 1 -- 172.21.15.113:0/992354104 shutdown_connections 2023-12-19T13:46:42.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.938+0000 7f52f2084640 1 -- 172.21.15.113:0/992354104 wait complete. 2023-12-19T13:46:42.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.939+0000 7f9ce77fe640 1 --2- 172.21.15.113:0/484414509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0035cc0 0x7f9ce00388a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097a0 tx=0x7f9cdc02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9345c9a9c860abc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.939+0000 7f30f2d9d640 1 --2- 172.21.15.113:0/3165595079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb700 0x7f30ec007020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c596611f115e82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.940+0000 7f9ce6ffd640 1 -- 172.21.15.113:0/484414509 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0316f0 con 0x7f9ce0035cc0 2023-12-19T13:46:42.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f6e36cb6640 1 Processor -- start 2023-12-19T13:46:42.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.940+0000 7f30f159a640 1 -- 172.21.15.113:0/3165595079 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8031830 con 0x7f30ec0eb700 2023-12-19T13:46:42.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f52f2084640 1 Processor -- start 2023-12-19T13:46:42.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.940+0000 7f9ce6ffd640 1 -- 172.21.15.113:0/484414509 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc031850 con 0x7f9ce0035cc0 2023-12-19T13:46:42.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.940+0000 7f9ce6ffd640 1 -- 172.21.15.113:0/484414509 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc031bc0 con 0x7f9ce0035cc0 2023-12-19T13:46:42.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f9ced729640 1 -- 172.21.15.113:0/484414509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0035cc0 msgr2=0x7f9ce00388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f9ced729640 1 --2- 172.21.15.113:0/484414509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0035cc0 0x7f9ce00388a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097a0 tx=0x7f9cdc02b790 comp rx=0 tx=0).stop 2023-12-19T13:46:42.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.940+0000 7f30f159a640 1 -- 172.21.15.113:0/3165595079 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8031990 con 0x7f30ec0eb700 2023-12-19T13:46:42.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.940+0000 7f30f159a640 1 -- 172.21.15.113:0/3165595079 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8031d20 con 0x7f30ec0eb700 2023-12-19T13:46:42.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f52f2084640 1 -- start start 2023-12-19T13:46:42.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f30f359e640 1 -- 172.21.15.113:0/3165595079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb700 msgr2=0x7f30ec007020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f30f359e640 1 --2- 172.21.15.113:0/3165595079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb700 0x7f30ec007020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f30f359e640 1 -- 172.21.15.113:0/3165595079 shutdown_connections 2023-12-19T13:46:42.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f30f359e640 1 --2- 172.21.15.113:0/3165595079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb700 0x7f30ec007020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f30f359e640 1 -- 172.21.15.113:0/3165595079 >> 172.21.15.113:0/3165595079 conn(0x7f30ec054c10 msgr2=0x7f30ec054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f30f359e640 1 -- 172.21.15.113:0/3165595079 shutdown_connections 2023-12-19T13:46:42.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f30f359e640 1 -- 172.21.15.113:0/3165595079 wait complete. 2023-12-19T13:46:42.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.942+0000 7f9ced729640 1 -- 172.21.15.113:0/484414509 shutdown_connections 2023-12-19T13:46:42.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.942+0000 7f9ced729640 1 --2- 172.21.15.113:0/484414509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0035cc0 0x7f9ce00388a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.942+0000 7f9ced729640 1 --2- 172.21.15.113:0/484414509 >> v2:172.21.15.151:3300/0 conn(0x7f9ce00e4740 0x7f9ce00543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.942+0000 7f9ced729640 1 -- 172.21.15.113:0/484414509 >> 172.21.15.113:0/484414509 conn(0x7f9ce00538a0 msgr2=0x7f9ce0053cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.942+0000 7f9ced729640 1 -- 172.21.15.113:0/484414509 shutdown_connections 2023-12-19T13:46:42.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.942+0000 7f9ced729640 1 -- 172.21.15.113:0/484414509 wait complete. 2023-12-19T13:46:42.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.941+0000 7f6e36cb6640 1 -- start start 2023-12-19T13:46:42.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.943+0000 7f52f2084640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec0cb180 0x7f52ec141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.943+0000 7f6e36cb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300d01b0 0x7f6e3015e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.943+0000 7f6e36cb6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6e300d0590 0x7f6e300cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.943+0000 7f6e36cb6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6e300ce1e0 0x7f6e3015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.943+0000 7f6e36cb6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3015ece0 con 0x7f6e300ce1e0 2023-12-19T13:46:42.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.943+0000 7f6e36cb6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300ce9d0 con 0x7f6e300d0590 2023-12-19T13:46:42.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.943+0000 7f6e36cb6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300ce6f0 con 0x7f6e300d01b0 2023-12-19T13:46:42.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.944+0000 7f30f359e640 1 Processor -- start 2023-12-19T13:46:42.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.944+0000 7f6e35253640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6e300ce1e0 0x7f6e3015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.944+0000 7f30f359e640 1 -- start start 2023-12-19T13:46:42.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.944+0000 7f9ced729640 1 Processor -- start 2023-12-19T13:46:42.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.944+0000 7f6e2ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6e300d0590 0x7f6e300cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f9ced729640 1 -- start start 2023-12-19T13:46:42.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f6e2ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6e300d0590 0x7f6e300cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49716/0 (socket says 172.21.15.113:49716) 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f6e2ffff640 1 -- 172.21.15.113:0/2072374075 learned_addr learned my addr 172.21.15.113:0/2072374075 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f6e2ffff640 1 -- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300d01b0 msgr2=0x7f6e3015e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f30f359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30ec0e78b0 0x7f30ec17c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f30f359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb2c0 0x7f30ec0e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f30f359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30ec0eb700 0x7f30ec0e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f30f359e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec0eabc0 con 0x7f30ec0eb700 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f30f359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec048740 con 0x7f30ec0eb2c0 2023-12-19T13:46:42.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f30f359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec048990 con 0x7f30ec0e78b0 2023-12-19T13:46:42.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f6e34a52640 1 --2- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300d01b0 0x7f6e3015e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f30f2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30ec0eb700 0x7f30ec0e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f30f2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30ec0eb700 0x7f30ec0e9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43512/0 (socket says 172.21.15.113:43512) 2023-12-19T13:46:42.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f30f2d9d640 1 -- 172.21.15.113:0/27657494 learned_addr learned my addr 172.21.15.113:0/27657494 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.944+0000 7f52f2084640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52ec0cb890 0x7f52ec156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.944+0000 7f52f2084640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec159320 0x7f52ec156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f52eb7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec0cb180 0x7f52ec141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f52f2084640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec152410 con 0x7f52ec159320 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f52f2084640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec142040 con 0x7f52ec0cb180 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f52f2084640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec152660 con 0x7f52ec0cb890 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.945+0000 7f6e2ffff640 1 --2- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300d01b0 0x7f6e3015e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f30f259c640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30ec0e78b0 0x7f30ec17c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f30f1d9b640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb2c0 0x7f30ec0e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f6e2ffff640 1 -- 172.21.15.113:0/2072374075 >> v2:172.21.15.113:3300/0 conn(0x7f6e300ce1e0 msgr2=0x7f6e3015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f6e2ffff640 1 --2- 172.21.15.113:0/2072374075 >> v2:172.21.15.113:3300/0 conn(0x7f6e300ce1e0 0x7f6e3015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f6e2ffff640 1 -- 172.21.15.113:0/2072374075 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3015dcc0 con 0x7f6e300d0590 2023-12-19T13:46:42.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f9ced729640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ce0035cc0 0x7f9ce00dbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7fd6d5657640 1 Processor -- start 2023-12-19T13:46:42.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec159320 0x7f52ec156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f6e35253640 1 --2- 172.21.15.113:0/2072374075 >> v2:172.21.15.113:3300/0 conn(0x7f6e300ce1e0 0x7f6e3015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:42.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f9ced729640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0038de0 0x7f9ce00e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec159320 0x7f52ec156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43516/0 (socket says 172.21.15.113:43516) 2023-12-19T13:46:42.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7fd6d5657640 1 -- start start 2023-12-19T13:46:42.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.946+0000 7f52ebfff640 1 -- 172.21.15.113:0/2920513860 learned_addr learned my addr 172.21.15.113:0/2920513860 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f9ced729640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ce00e4740 0x7f9ce00e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f52ebfff640 1 -- 172.21.15.113:0/2920513860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52ec0cb890 msgr2=0x7f52ec156760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:46:42.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f30f259c640 1 -- 172.21.15.113:0/27657494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb2c0 msgr2=0x7f30ec0e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f30f259c640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30ec0eb2c0 0x7f30ec0e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f30f259c640 1 -- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30ec0eb700 msgr2=0x7f30ec0e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f30f259c640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30ec0eb700 0x7f30ec0e9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f9ce7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ce0035cc0 0x7f9ce00dbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f30f259c640 1 -- 172.21.15.113:0/27657494 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8009400 con 0x7f30ec0e78b0 2023-12-19T13:46:42.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f9ce7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ce0035cc0 0x7f9ce00dbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49732/0 (socket says 172.21.15.113:49732) 2023-12-19T13:46:42.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.947+0000 7f9ce7fff640 1 -- 172.21.15.113:0/2943914935 learned_addr learned my addr 172.21.15.113:0/2943914935 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f9ced729640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce004c300 con 0x7f9ce00e4740 2023-12-19T13:46:42.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f9ce77fe640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0038de0 0x7f9ce00e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f9ced729640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce004e100 con 0x7f9ce0035cc0 2023-12-19T13:46:42.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f9ced729640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce004b680 con 0x7f9ce0038de0 2023-12-19T13:46:42.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f9cecf28640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ce00e4740 0x7f9ce00e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f30f259c640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30ec0e78b0 0x7f30ec17c630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f30f404ee30 tx=0x7f30f4072850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f6e2ffff640 1 --2- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d0590 0x7f6e300cdca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e300d44d0 tx=0x7f6e2002b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=690604f2f0477b37 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f52ebfff640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52ec0cb890 0x7f52ec156760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f52ebfff640 1 -- 172.21.15.113:0/2920513860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec0cb180 msgr2=0x7f52ec141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f52ebfff640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec0cb180 0x7f52ec141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.948+0000 7f52ebfff640 1 -- 172.21.15.113:0/2920513860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4009a70 con 0x7f52ec159320 2023-12-19T13:46:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4072260 con 0x7f30ec0e78b0 2023-12-19T13:46:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f40b7070 con 0x7f30ec0e78b0 2023-12-19T13:46:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40723c0 con 0x7f30ec0e78b0 2023-12-19T13:46:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f30f359e640 1 -- 172.21.15.113:0/27657494 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec048c70 con 0x7f30ec0e78b0 2023-12-19T13:46:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f6e2f7fe640 1 -- 172.21.15.113:0/2072374075 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20031880 con 0x7f6e300d0590 2023-12-19T13:46:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f6e2f7fe640 1 -- 172.21.15.113:0/2072374075 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e200319e0 con 0x7f6e300d0590 2023-12-19T13:46:42.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f6e2f7fe640 1 -- 172.21.15.113:0/2072374075 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20031d70 con 0x7f6e300d0590 2023-12-19T13:46:42.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f52ebfff640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec159320 0x7f52ec156ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52e402e760 tx=0x7f52e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f9ce77fe640 1 -- 172.21.15.113:0/2943914935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ce0035cc0 msgr2=0x7f9ce00dbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.949+0000 7f30f359e640 1 -- 172.21.15.113:0/27657494 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec049230 con 0x7f30ec0e78b0 2023-12-19T13:46:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4036be0 con 0x7f52ec159320 2023-12-19T13:46:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4036d40 con 0x7f52ec159320 2023-12-19T13:46:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4004240 con 0x7f52ec159320 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f9ce77fe640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ce0035cc0 0x7f9ce00dbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f9ce77fe640 1 -- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ce00e4740 msgr2=0x7f9ce00e5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f9ce77fe640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ce00e4740 0x7f9ce00e5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f9ce77fe640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd4009400 con 0x7f9ce0038de0 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f9ce7fff640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ce0035cc0 0x7f9ce00dbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f9ce77fe640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0038de0 0x7f9ce00e4b20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc033000 tx=0x7f9cdc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.950+0000 7f52f2084640 1 -- 172.21.15.113:0/2920513860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec152940 con 0x7f52ec159320 2023-12-19T13:46:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.951+0000 7f52f2084640 1 -- 172.21.15.113:0/2920513860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec152f00 con 0x7f52ec159320 2023-12-19T13:46:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.951+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc004510 con 0x7f9ce0038de0 2023-12-19T13:46:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.951+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc031bd0 con 0x7f9ce0038de0 2023-12-19T13:46:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.951+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc003610 con 0x7f9ce0038de0 2023-12-19T13:46:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7f9ced729640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc009400 con 0x7f9ce0038de0 2023-12-19T13:46:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7f9ced729640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce004bc40 con 0x7f9ce0038de0 2023-12-19T13:46:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.951+0000 7fd6d5657640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6c8053150 0x7fd6c8033d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.951+0000 7fd6d5657640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c8006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7fd6d5657640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c80543f0 con 0x7fd6c800c1f0 2023-12-19T13:46:42.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7fd6d5657640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80535d0 con 0x7fd6c8053150 2023-12-19T13:46:42.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7fd6d5657640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8053ac0 con 0x7fd6c8006190 2023-12-19T13:46:42.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7f6e36cb6640 1 -- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d0590 msgr2=0x7f6e300cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7f6e36cb6640 1 --2- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d0590 0x7f6e300cdca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e300d44d0 tx=0x7f6e2002b920 comp rx=0 tx=0).stop 2023-12-19T13:46:42.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7fd6d4e56640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c8006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7f6e36cb6640 1 -- 172.21.15.113:0/2072374075 shutdown_connections 2023-12-19T13:46:42.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7f6e36cb6640 1 --2- 172.21.15.113:0/2072374075 >> v2:172.21.15.113:3300/0 conn(0x7f6e300ce1e0 0x7f6e3015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7f6e36cb6640 1 --2- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d0590 0x7f6e300cdca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7f6e36cb6640 1 --2- 172.21.15.113:0/2072374075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300d01b0 0x7f6e3015e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7f6e36cb6640 1 -- 172.21.15.113:0/2072374075 >> 172.21.15.113:0/2072374075 conn(0x7f6e300b27a0 msgr2=0x7f6e300b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7fd6d4e56640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c8006620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51690/0 (socket says 172.21.15.113:51690) 2023-12-19T13:46:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.952+0000 7f30f359e640 1 -- 172.21.15.113:0/27657494 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30ec0ebb90 con 0x7f30ec0e78b0 2023-12-19T13:46:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f30f406a2e0 con 0x7f30ec0e78b0 2023-12-19T13:46:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7fd6d4e56640 1 -- 172.21.15.113:0/4000334349 learned_addr learned my addr 172.21.15.113:0/4000334349 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7f9ced729640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ce0051a00 con 0x7f9ce0038de0 2023-12-19T13:46:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.953+0000 7fd6cf7fe640 1 --2- 172.21.15.113:0/4000334349 >> v2:172.21.15.151:3300/0 conn(0x7fd6c8053150 0x7fd6c8033d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52c4000fc0 con 0x7f52ec159320 2023-12-19T13:46:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7f6e36cb6640 1 -- 172.21.15.113:0/2072374075 shutdown_connections 2023-12-19T13:46:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7f6e36cb6640 1 -- 172.21.15.113:0/2072374075 wait complete. 2023-12-19T13:46:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7f30e2ffd640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30d406a430 0x7f30d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7fd6cf7fe640 1 -- 172.21.15.113:0/4000334349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 msgr2=0x7fd6c8006620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7fd6cf7fe640 1 --2- 172.21.15.113:0/4000334349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c8006620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7fd6cf7fe640 1 -- 172.21.15.113:0/4000334349 >> v1:172.21.15.113:6789/0 conn(0x7fd6c800c1f0 legacy=0x7fd6c8050230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7fd6cf7fe640 1 -- 172.21.15.113:0/4000334349 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8053da0 con 0x7fd6c8053150 2023-12-19T13:46:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.955+0000 7f8bef28b640 1 Processor -- start 2023-12-19T13:46:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30f4101ee0 con 0x7f30ec0e78b0 2023-12-19T13:46:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.955+0000 7f30e2ffd640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f30d40725d0 0x7f30d40749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7f0f8a37d640 1 Processor -- start 2023-12-19T13:46:42.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.955+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 --> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30d40750a0 con 0x7f30d40725d0 2023-12-19T13:46:42.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.954+0000 7fd6ceffd640 1 -- 172.21.15.113:0/4000334349 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857688165 0 0) 0x7fd6c80543f0 con 0x7fd6c800c1f0 2023-12-19T13:46:42.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.955+0000 7f0f8a37d640 1 -- start start 2023-12-19T13:46:42.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.955+0000 7f8bef28b640 1 -- start start 2023-12-19T13:46:42.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.956+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52e403d070 con 0x7f52ec159320 2023-12-19T13:46:42.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.956+0000 7fd6cf7fe640 1 --2- 172.21.15.113:0/4000334349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 0x7fd6c8033d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40097a0 tx=0x7fd6c402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498b013163cbfed8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.956+0000 7f30f1d9b640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30d406a430 0x7f30d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.956+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30f40b25d0 con 0x7f30ec0e78b0 2023-12-19T13:46:42.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.956+0000 7f30f2d9d640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f30d40725d0 0x7f30d40749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.956+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9cdc03b040 con 0x7f9ce0038de0 2023-12-19T13:46:42.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7fd6ceffd640 1 -- 172.21.15.113:0/4000334349 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4030800 con 0x7fd6c8053150 2023-12-19T13:46:42.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7fd6ceffd640 1 -- 172.21.15.113:0/4000334349 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4030960 con 0x7fd6c8053150 2023-12-19T13:46:42.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7fd6ceffd640 1 -- 172.21.15.113:0/4000334349 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4030cf0 con 0x7fd6c8053150 2023-12-19T13:46:42.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7f8bef28b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be815efa0 0x7f8be815f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7f8bef28b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80ce9d0 con 0x7f8be815e7a0 2023-12-19T13:46:42.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7f8bef28b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80ce6f0 con 0x7f8be80d01b0 2023-12-19T13:46:42.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7f8bef28b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be815dcc0 con 0x7f8be815efa0 2023-12-19T13:46:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.957+0000 7f0f8a37d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f84146e10 0x7f0f840d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f0f8a37d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840d2b00 0x7f0f840b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f0f8a37d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840cd840 con 0x7f0f840ce110 2023-12-19T13:46:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f0f8a37d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840d2430 con 0x7f0f84146e10 2023-12-19T13:46:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f0f8a37d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840d2620 con 0x7f0f840d2b00 2023-12-19T13:46:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f8bec826640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8be815e7a0 0x7f8be80cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59398/0 (socket says 172.21.15.113:59398) 2023-12-19T13:46:42.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f8bec826640 1 -- 172.21.15.113:0/3215430885 learned_addr learned my addr 172.21.15.113:0/3215430885 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:42.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f8bed828640 1 --2- 172.21.15.113:0/3215430885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be815efa0 0x7f8be815f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7fd6d5657640 1 -- 172.21.15.113:0/4000334349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 msgr2=0x7fd6c8033d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7fd6d5657640 1 --2- 172.21.15.113:0/4000334349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 0x7fd6c8033d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40097a0 tx=0x7fd6c402b940 comp rx=0 tx=0).stop 2023-12-19T13:46:42.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f6e36cb6640 1 Processor -- start 2023-12-19T13:46:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f0f837fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840d2b00 0x7f0f840b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f0f837fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840d2b00 0x7f0f840b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51706/0 (socket says 172.21.15.113:51706) 2023-12-19T13:46:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f0f837fe640 1 -- 172.21.15.113:0/2204437559 learned_addr learned my addr 172.21.15.113:0/2204437559 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f52e8ff9640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f52cc06a500 0x7f52cc06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52e40ab250 con 0x7f52ec159320 2023-12-19T13:46:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7fd6d5657640 1 -- 172.21.15.113:0/4000334349 shutdown_connections 2023-12-19T13:46:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7fd6d5657640 1 --2- 172.21.15.113:0/4000334349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c8006620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7fd6d5657640 1 --2- 172.21.15.113:0/4000334349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 0x7fd6c8033d50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7fd6d5657640 1 -- 172.21.15.113:0/4000334349 >> 172.21.15.113:0/4000334349 conn(0x7fd6c8054c10 msgr2=0x7fd6c8054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f30f1d9b640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30d406a430 0x7f30d406c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30e4007f70 tx=0x7f30e4007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f0f83fff640 1 --2- 172.21.15.113:0/2204437559 >> v2:172.21.15.151:3300/0 conn(0x7f0f84146e10 0x7f0f840d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f52eb7fe640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f52cc06a500 0x7f52cc06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f30f2d9d640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f30d40725d0 0x7f30d40749f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f52e8ff9640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7f52cc072720 0x7f52cc074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 --> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52cc0751f0 con 0x7f52cc072720 2023-12-19T13:46:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52e40ad870 con 0x7f52ec159320 2023-12-19T13:46:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f9ce4ff9640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ccc06a480 0x7f9ccc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.958+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cdc0aa990 con 0x7f9ce0038de0 2023-12-19T13:46:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f9ce4ff9640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f9ccc072530 0x7f9ccc074950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ccc075000 con 0x7f9ccc072530 2023-12-19T13:46:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cdc0aae30 con 0x7f9ce0038de0 2023-12-19T13:46:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7f8bed828640 1 -- 172.21.15.113:0/3215430885 >> v1:172.21.15.151:6789/0 conn(0x7f8be80d01b0 legacy=0x7f8be80d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7f8bed828640 1 -- 172.21.15.113:0/3215430885 >> v1:172.21.15.113:6789/0 conn(0x7f8be815e7a0 legacy=0x7f8be80cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7f52e3fff640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7f52cc072720 0x7f52cc074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f6e36cb6640 1 -- start start 2023-12-19T13:46:42.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== osd.0 v2:172.21.15.113:6811/84090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f30d40750a0 con 0x7f30d40725d0 2023-12-19T13:46:42.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7f9ce7fff640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ccc06a480 0x7f9ccc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7f8bed828640 1 -- 172.21.15.113:0/3215430885 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be815dfa0 con 0x7f8be815efa0 2023-12-19T13:46:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7f8bdffff640 1 -- 172.21.15.113:0/3215430885 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532654436 0 0) 0x7f8be80ce9d0 con 0x7f8be815e7a0 2023-12-19T13:46:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f52eb7fe640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f52cc06a500 0x7f52cc06c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f52dc000f60 tx=0x7f52dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f52e3fff640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7f52cc072720 0x7f52cc074b40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f0f837fe640 1 -- 172.21.15.113:0/2204437559 >> v2:172.21.15.151:3300/0 conn(0x7f0f84146e10 msgr2=0x7f0f840d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f0f837fe640 1 --2- 172.21.15.113:0/2204437559 >> v2:172.21.15.151:3300/0 conn(0x7f0f84146e10 0x7f0f840d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f0f837fe640 1 -- 172.21.15.113:0/2204437559 >> v1:172.21.15.151:6789/0 conn(0x7f0f840ce110 legacy=0x7f0f840b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.959+0000 7f0f837fe640 1 -- 172.21.15.113:0/2204437559 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840b41c0 con 0x7f0f840d2b00 2023-12-19T13:46:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f6e36cb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300ce1e0 0x7f6e3006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f6e36cb6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d01b0 0x7f6e30157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f6e36cb6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e300d0590 0x7f6e300b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f6e36cb6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3006cd30 con 0x7f6e300d0590 2023-12-19T13:46:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f6e36cb6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3006a2e0 con 0x7f6e300d01b0 2023-12-19T13:46:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.961+0000 7f6e36cb6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3006b7f0 con 0x7f6e300ce1e0 2023-12-19T13:46:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f8bed828640 1 --2- 172.21.15.113:0/3215430885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be815efa0 0x7f8be815f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8be00097d0 tx=0x7f8be002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc85d96d7d006f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f6e34a52640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300ce1e0 0x7f6e3006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f6e35253640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e300d0590 0x7f6e300b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f6e34a52640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300ce1e0 0x7f6e3006b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51710/0 (socket says 172.21.15.113:51710) 2023-12-19T13:46:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f9cecf28640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f9ccc072530 0x7f9ccc074950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f6e34a52640 1 -- 172.21.15.113:0/4213169591 learned_addr learned my addr 172.21.15.113:0/4213169591 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f8bdffff640 1 -- 172.21.15.113:0/3215430885 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0030800 con 0x7f8be815efa0 2023-12-19T13:46:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f8bdffff640 1 -- 172.21.15.113:0/3215430885 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0030960 con 0x7f8be815efa0 2023-12-19T13:46:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f8bdffff640 1 -- 172.21.15.113:0/3215430885 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0030cf0 con 0x7f8be815efa0 2023-12-19T13:46:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7f6e2ffff640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d01b0 0x7f6e30157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7fd6d5657640 1 -- 172.21.15.113:0/4000334349 shutdown_connections 2023-12-19T13:46:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.960+0000 7fd6d5657640 1 -- 172.21.15.113:0/4000334349 wait complete. 2023-12-19T13:46:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.962+0000 7fd6d5657640 1 Processor -- start 2023-12-19T13:46:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== osd.1 v2:172.21.15.113:6800/84088 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f52cc0751f0 con 0x7f52cc072720 2023-12-19T13:46:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f9cecf28640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f9ccc072530 0x7f9ccc074950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f9ce7fff640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ccc06a480 0x7f9ccc06c940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40114b0 tx=0x7f9cd4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7fd6d5657640 1 -- start start 2023-12-19T13:46:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f6e34a52640 1 -- 172.21.15.113:0/4213169591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d01b0 msgr2=0x7f6e30157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f6e34a52640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e300d01b0 0x7f6e30157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f6e34a52640 1 -- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e300d0590 msgr2=0x7f6e300b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f6e34a52640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e300d0590 0x7f6e300b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f6e34a52640 1 -- 172.21.15.113:0/4213169591 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200094d0 con 0x7f6e300ce1e0 2023-12-19T13:46:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.963+0000 7f0f837fe640 1 --2- 172.21.15.113:0/2204437559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840d2b00 0x7f0f840b6780 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009e50 tx=0x7f0f7402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a042ce5182e609a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f6e34a52640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300ce1e0 0x7f6e3006b2b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c7f0 tx=0x7f6e2800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== osd.2 v2:172.21.15.113:6809/84093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9ccc075000 con 0x7f9ccc072530 2023-12-19T13:46:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f8bef28b640 1 -- 172.21.15.113:0/3215430885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be815efa0 msgr2=0x7f8be815f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f8bef28b640 1 --2- 172.21.15.113:0/3215430885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be815efa0 0x7f8be815f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8be00097d0 tx=0x7f8be002b940 comp rx=0 tx=0).stop 2023-12-19T13:46:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28004220 con 0x7f6e300ce1e0 2023-12-19T13:46:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f0f82ffd640 1 -- 172.21.15.113:0/2204437559 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7402cb00 con 0x7f0f840d2b00 2023-12-19T13:46:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f8bef28b640 1 -- 172.21.15.113:0/3215430885 shutdown_connections 2023-12-19T13:46:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f8bef28b640 1 --2- 172.21.15.113:0/3215430885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be815efa0 0x7f8be815f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f0f82ffd640 1 -- 172.21.15.113:0/2204437559 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7402cc60 con 0x7f0f840d2b00 2023-12-19T13:46:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7f0f82ffd640 1 -- 172.21.15.113:0/2204437559 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740343f0 con 0x7f0f840d2b00 2023-12-19T13:46:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.964+0000 7f8bef28b640 1 -- 172.21.15.113:0/3215430885 >> 172.21.15.113:0/3215430885 conn(0x7f8be80b27a0 msgr2=0x7f8be80b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6d5657640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c80d4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28004380 con 0x7f6e300ce1e0 2023-12-19T13:46:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28007860 con 0x7f6e300ce1e0 2023-12-19T13:46:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6d5657640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6c800c1f0 0x7fd6c80efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6d5657640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 0x7fd6c80cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6d5657640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c804a520 con 0x7fd6c800c1f0 2023-12-19T13:46:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6d5657640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c804a800 con 0x7fd6c8053150 2023-12-19T13:46:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6d5657640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c804aae0 con 0x7fd6c8006190 2023-12-19T13:46:42.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3006a4f0 con 0x7f6e300ce1e0 2023-12-19T13:46:42.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7f8bef28b640 1 -- 172.21.15.113:0/3215430885 shutdown_connections 2023-12-19T13:46:42.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3006aab0 con 0x7f6e300ce1e0 2023-12-19T13:46:42.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6d4e56640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 0x7fd6c80cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6cffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c80d4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6cffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c80d4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51722/0 (socket says 172.21.15.113:51722) 2023-12-19T13:46:43.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7fd6cffff640 1 -- 172.21.15.113:0/852953727 learned_addr learned my addr 172.21.15.113:0/852953727 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.965+0000 7f8bef28b640 1 -- 172.21.15.113:0/3215430885 wait complete. 2023-12-19T13:46:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7fd6cf7fe640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6c800c1f0 0x7fd6c80efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7fd6d4e56640 1 -- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 msgr2=0x7fd6c80d4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7f0f8a37d640 1 -- 172.21.15.113:0/2204437559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840d2b00 msgr2=0x7f0f840b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7f0f8a37d640 1 --2- 172.21.15.113:0/2204437559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840d2b00 0x7f0f840b6780 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009e50 tx=0x7f0f7402bf60 comp rx=0 tx=0).stop 2023-12-19T13:46:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7fd6d4e56640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6c8006190 0x7fd6c80d4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7fd6d4e56640 1 -- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6c800c1f0 msgr2=0x7fd6c80efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7fd6d4e56640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6c800c1f0 0x7fd6c80efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7fd6d4e56640 1 -- 172.21.15.113:0/852953727 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4009400 con 0x7fd6c8053150 2023-12-19T13:46:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7fd6cf7fe640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6c800c1f0 0x7fd6c80efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.966+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e3015e280 con 0x7f6e300ce1e0 2023-12-19T13:46:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.967+0000 7f0f8a37d640 1 -- 172.21.15.113:0/2204437559 shutdown_connections 2023-12-19T13:46:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.967+0000 7f0f8a37d640 1 --2- 172.21.15.113:0/2204437559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840d2b00 0x7f0f840b6780 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.967+0000 7f0f8a37d640 1 --2- 172.21.15.113:0/2204437559 >> v2:172.21.15.151:3300/0 conn(0x7f0f84146e10 0x7f0f840d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.967+0000 7f0f8a37d640 1 -- 172.21.15.113:0/2204437559 >> 172.21.15.113:0/2204437559 conn(0x7f0f840b29c0 msgr2=0x7f0f840b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.967+0000 7f0f8a37d640 1 -- 172.21.15.113:0/2204437559 shutdown_connections 2023-12-19T13:46:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.967+0000 7fd6d4e56640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 0x7fd6c80cedb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0068fd0 tx=0x7fd6d004f030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.968+0000 7f8bef28b640 1 Processor -- start 2023-12-19T13:46:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.968+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00b8070 con 0x7fd6c8053150 2023-12-19T13:46:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.968+0000 7f8bef28b640 1 -- start start 2023-12-19T13:46:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.968+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d004e8d0 con 0x7fd6c8053150 2023-12-19T13:46:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.968+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c80eef50 con 0x7fd6c8053150 2023-12-19T13:46:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.968+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00b8070 con 0x7fd6c8053150 2023-12-19T13:46:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.968+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c80ef510 con 0x7fd6c8053150 2023-12-19T13:46:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.967+0000 7f0f8a37d640 1 -- 172.21.15.113:0/2204437559 wait complete. 2023-12-19T13:46:43.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.969+0000 7f8bef28b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be80d01b0 0x7f8be81fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.969+0000 7f8bef28b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8be815e7a0 0x7f8be80cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.969+0000 7f8bef28b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be815efa0 0x7f8be81f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bef28b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81f8890 con 0x7f8be815e7a0 2023-12-19T13:46:43.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bef28b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81fb3f0 con 0x7f8be815efa0 2023-12-19T13:46:43.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bef28b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81f82d0 con 0x7f8be80d01b0 2023-12-19T13:46:43.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f0f8a37d640 1 Processor -- start 2023-12-19T13:46:43.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7fd7fdd92640 1 Processor -- start 2023-12-19T13:46:43.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bec826640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8be815e7a0 0x7f8be80cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bed027640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be80d01b0 0x7f8be81fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bed027640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be80d01b0 0x7f8be81fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51738/0 (socket says 172.21.15.113:51738) 2023-12-19T13:46:43.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bed027640 1 -- 172.21.15.113:0/2888526977 learned_addr learned my addr 172.21.15.113:0/2888526977 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f8bed828640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be815efa0 0x7f8be81f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e28007bd0 con 0x7f6e300ce1e0 2023-12-19T13:46:43.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7fd7fdd92640 1 -- start start 2023-12-19T13:46:43.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6c8034290 con 0x7fd6c8053150 2023-12-19T13:46:43.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.970+0000 7f0f8a37d640 1 -- start start 2023-12-19T13:46:43.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.971+0000 7f8bed027640 1 -- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be815efa0 msgr2=0x7f8be81f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.971+0000 7f8bed027640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be815efa0 0x7f8be81f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.971+0000 7f8bed027640 1 -- 172.21.15.113:0/2888526977 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8be815e7a0 msgr2=0x7f8be80cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.971+0000 7f8bed027640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8be815e7a0 0x7f8be80cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.971+0000 7f8bed027640 1 -- 172.21.15.113:0/2888526977 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be0009400 con 0x7f8be80d01b0 2023-12-19T13:46:43.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.971+0000 7f8bed027640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be80d01b0 0x7f8be81fb880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c7c0 tx=0x7f8be400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7f6e2d7fa640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e1006a460 0x7f6e1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e28088e50 con 0x7f6e300ce1e0 2023-12-19T13:46:43.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7f6e2d7fa640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7f6e10072680 0x7f6e10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 --> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e10075150 con 0x7f6e10072680 2023-12-19T13:46:43.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e28089200 con 0x7f6e300ce1e0 2023-12-19T13:46:43.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7f0f8a37d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840ce110 0x7f0f841407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7fd7fdd92640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7fd7fdd92640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd7f80ce110 0x7fd7f80ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7fd7fdd92640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80cd840 con 0x7fd7f80d2b00 2023-12-19T13:46:43.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7fd7fdd92640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80d2430 con 0x7fd7f80ce110 2023-12-19T13:46:43.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7fd7fdd92640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80ceae0 con 0x7fd7f8146e10 2023-12-19T13:46:43.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f8a37d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f840d2b00 0x7f0f84158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4006d50 con 0x7f8be80d01b0 2023-12-19T13:46:43.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4003970 con 0x7f8be80d01b0 2023-12-19T13:46:43.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4003d20 con 0x7f8be80d01b0 2023-12-19T13:46:43.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be81f85b0 con 0x7f8be80d01b0 2023-12-19T13:46:43.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f8a37d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f84146e10 0x7f0f8415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.972+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f80d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51740/0 (socket says 172.21.15.113:51740) 2023-12-19T13:46:43.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f6e2ffff640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e1006a460 0x7f6e1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f6e35253640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7f6e10072680 0x7f6e10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f8a37d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841fa3b0 con 0x7f0f84146e10 2023-12-19T13:46:43.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f8a37d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84140d00 con 0x7f0f840d2b00 2023-12-19T13:46:43.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f8a37d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8415b3f0 con 0x7f0f840ce110 2023-12-19T13:46:43.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f837fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f840d2b00 0x7f0f84158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f837fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f840d2b00 0x7f0f84158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49780/0 (socket says 172.21.15.113:49780) 2023-12-19T13:46:43.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f0f837fe640 1 -- 172.21.15.113:0/963260364 learned_addr learned my addr 172.21.15.113:0/963260364 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be81fbdc0 con 0x7f8be80d01b0 2023-12-19T13:46:43.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7f0f83fff640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840ce110 0x7f0f841407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7f0f8891a640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f84146e10 0x7f0f8415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7fd7f6ffd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd7f80d2b00 0x7fd7f80b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:59072/0 (socket says 172.21.15.113:59072) 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7fd7f6ffd640 1 -- 172.21.15.113:0/1680540324 learned_addr learned my addr 172.21.15.113:0/1680540324 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.973+0000 7fd7f7fff640 1 --2- 172.21.15.113:0/1680540324 >> v2:172.21.15.113:3300/0 conn(0x7fd7f80ce110 0x7fd7f80ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7fd7f67fc640 1 -- 172.21.15.113:0/1680540324 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388662613 0 0) 0x7fd7f80cd840 con 0x7fd7f80d2b00 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7fd7f67fc640 1 -- 172.21.15.113:0/1680540324 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e0003520 con 0x7fd7f80d2b00 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7f0f83fff640 1 -- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f840d2b00 msgr2=0x7f0f84158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7f0f83fff640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f840d2b00 0x7f0f84158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7f0f83fff640 1 -- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f84146e10 msgr2=0x7f0f8415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.974+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6d00008d0 con 0x7fd6c8053150 2023-12-19T13:46:43.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7f0f83fff640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f84146e10 0x7f0f8415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7f0f83fff640 1 -- 172.21.15.113:0/963260364 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74009b30 con 0x7f0f840ce110 2023-12-19T13:46:43.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7f0f8891a640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f84146e10 0x7f0f8415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:43.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7f6e35253640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7f6e10072680 0x7f6e10074aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7f6e2ffff640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e1006a460 0x7f6e1006c920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e20036000 tx=0x7f6e2003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7fd7f7fff640 1 -- 172.21.15.113:0/1680540324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 msgr2=0x7fd7f80d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7fd7f7fff640 1 --2- 172.21.15.113:0/1680540324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f80d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7fd7f7fff640 1 -- 172.21.15.113:0/1680540324 >> v1:172.21.15.151:6789/0 conn(0x7fd7f80d2b00 legacy=0x7fd7f80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.975+0000 7fd7f7fff640 1 -- 172.21.15.113:0/1680540324 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80b6e90 con 0x7fd7f80ce110 2023-12-19T13:46:43.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.976+0000 7f0f83fff640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840ce110 0x7f0f841407c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e8a0 tx=0x7f0f7c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.976+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== osd.3 v2:172.21.15.113:6808/84094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f6e10075150 con 0x7f6e10072680 2023-12-19T13:46:43.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7fd6ccff9640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6b406a490 0x7fd6b406c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.976+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c009e60 con 0x7f0f840ce110 2023-12-19T13:46:43.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6d0102320 con 0x7fd6c8053150 2023-12-19T13:46:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bc8000fc0 con 0x7f8be80d01b0 2023-12-19T13:46:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7fd6ccff9640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7fd6b40726b0 0x7fd6b4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8415b6d0 con 0x7f0f840ce110 2023-12-19T13:46:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c00c940 con 0x7f0f840ce110 2023-12-19T13:46:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00ccd0 con 0x7f0f840ce110 2023-12-19T13:46:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 --> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6b4075180 con 0x7fd6b40726b0 2023-12-19T13:46:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.977+0000 7fd7f7fff640 1 --2- 172.21.15.113:0/1680540324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80ce110 0x7fd7f80ce5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009dc0 tx=0x7fd7f002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4030c903886783 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7fd7f67fc640 1 -- 172.21.15.113:0/1680540324 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f002cc40 con 0x7fd7f80ce110 2023-12-19T13:46:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7fd7f67fc640 1 -- 172.21.15.113:0/1680540324 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f002cda0 con 0x7fd7f80ce110 2023-12-19T13:46:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7fd7f67fc640 1 -- 172.21.15.113:0/1680540324 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0034660 con 0x7fd7f80ce110 2023-12-19T13:46:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8be400a850 con 0x7f8be80d01b0 2023-12-19T13:46:43.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6d0104940 con 0x7fd6c8053150 2023-12-19T13:46:43.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7fd6cf7fe640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7fd6b40726b0 0x7fd6b4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.978+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8415bc90 con 0x7f0f840ce110 2023-12-19T13:46:43.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd6cffff640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6b406a490 0x7fd6b406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 -- 172.21.15.113:0/1680540324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80ce110 msgr2=0x7fd7f80ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 --2- 172.21.15.113:0/1680540324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80ce110 0x7fd7f80ce5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009dc0 tx=0x7fd7f002be90 comp rx=0 tx=0).stop 2023-12-19T13:46:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 -- 172.21.15.113:0/1680540324 shutdown_connections 2023-12-19T13:46:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 --2- 172.21.15.113:0/1680540324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80ce110 0x7fd7f80ce5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 --2- 172.21.15.113:0/1680540324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f80d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 -- 172.21.15.113:0/1680540324 >> 172.21.15.113:0/1680540324 conn(0x7fd7f80b29c0 msgr2=0x7fd7f80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7f8bddffb640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8bcc06a480 0x7f8bcc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8be4088350 con 0x7f8be80d01b0 2023-12-19T13:46:43.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 -- 172.21.15.113:0/1680540324 shutdown_connections 2023-12-19T13:46:43.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.979+0000 7fd7fdd92640 1 -- 172.21.15.113:0/1680540324 wait complete. 2023-12-19T13:46:43.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.980+0000 7f8bddffb640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f8bcc0726a0 0x7f8bcc074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.980+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 --> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bcc075170 con 0x7f8bcc0726a0 2023-12-19T13:46:43.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.980+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8be408a930 con 0x7f8be80d01b0 2023-12-19T13:46:43.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.980+0000 7f8bec826640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8bcc06a480 0x7f8bcc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.980+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f840b4780 con 0x7f0f840ce110 2023-12-19T13:46:43.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.980+0000 7f8bed828640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f8bcc0726a0 0x7f8bcc074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.980+0000 7fd6cf7fe640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7fd6b40726b0 0x7fd6b4074ad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.981+0000 7fd6cffff640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6b406a490 0x7fd6b406c950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc007fd0 tx=0x7fd6bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.981+0000 7f8bec826640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8bcc06a480 0x7f8bcc06c940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8007f70 tx=0x7f8bd8007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.981+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f7c013470 con 0x7f0f840ce110 2023-12-19T13:46:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.982+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== osd.4 v2:172.21.15.151:6800/84063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fd6b4075180 con 0x7fd6b40726b0 2023-12-19T13:46:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.982+0000 7f8bed828640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f8bcc0726a0 0x7f8bcc074ac0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.982+0000 7fd7fdd92640 1 Processor -- start 2023-12-19T13:46:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.982+0000 7fd7fdd92640 1 -- start start 2023-12-19T13:46:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.983+0000 7f0f80ff9640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f6406a430 0x7f0f6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.983+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f7c088880 con 0x7f0f840ce110 2023-12-19T13:46:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.983+0000 7f0f837fe640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f6406a430 0x7f0f6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.984+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== osd.6 v2:172.21.15.151:6824/84065 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f8bcc075170 con 0x7f8bcc0726a0 2023-12-19T13:46:43.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.984+0000 7f0f80ff9640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f0f64072650 0x7f0f64074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.984+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 --> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f64075120 con 0x7f0f64072650 2023-12-19T13:46:43.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.984+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f7c08d2a0 con 0x7f0f840ce110 2023-12-19T13:46:43.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.984+0000 7fd7fdd92640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7f80ce110 0x7fd7f814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.984+0000 7fd7fdd92640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80d2b00 0x7fd7f815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.984+0000 7fd7fdd92640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f8070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7fdd92640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8160ec0 con 0x7fd7f80d2b00 2023-12-19T13:46:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7fdd92640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f81602b0 con 0x7fd7f80ce110 2023-12-19T13:46:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7f0f8891a640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f0f64072650 0x7f0f64074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7f0f837fe640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f6406a430 0x7f0f6406c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009e50 tx=0x7f0f74030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7f80ce110 0x7fd7f814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7f7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f8070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7f80ce110 0x7fd7f814fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49794/0 (socket says 172.21.15.113:49794) 2023-12-19T13:46:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7fdd92640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8160590 con 0x7fd7f8146e10 2023-12-19T13:46:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7f77fe640 1 -- 172.21.15.113:0/3529788172 learned_addr learned my addr 172.21.15.113:0/3529788172 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.985+0000 7fd7f6ffd640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80d2b00 0x7fd7f815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.986+0000 7fd7f6ffd640 1 -- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 msgr2=0x7fd7f8070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.986+0000 7fd7f6ffd640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7f8146e10 0x7fd7f8070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.986+0000 7fd7f6ffd640 1 -- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7f80ce110 msgr2=0x7fd7f814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.986+0000 7fd7f6ffd640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7f80ce110 0x7fd7f814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.986+0000 7fd7f6ffd640 1 -- 172.21.15.113:0/3529788172 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0009a70 con 0x7fd7f80d2b00 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7fd7f6ffd640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80d2b00 0x7fd7f815db00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800c430 tx=0x7fd7e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7fd7f77fe640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7f80ce110 0x7fd7f814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8005ce0 con 0x7fd7f80d2b00 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8005e40 con 0x7fd7f80d2b00 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80072d0 con 0x7fd7f80d2b00 2023-12-19T13:46:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8160870 con 0x7fd7f80d2b00 2023-12-19T13:46:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7f0f8891a640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f0f64072650 0x7f0f64074a70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.987+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f814ff60 con 0x7fd7f80d2b00 2023-12-19T13:46:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.988+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7f80b41c0 con 0x7fd7f80d2b00 2023-12-19T13:46:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.989+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== osd.5 v2:172.21.15.151:6808/84062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0f64075120 con 0x7f0f64072650 2023-12-19T13:46:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.991+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 --> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f52c4002cb0 con 0x7f52cc072720 2023-12-19T13:46:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.992+0000 7f52e8ff9640 1 -- 172.21.15.113:0/2920513860 <== osd.1 v2:172.21.15.113:6800/84088 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f52c4002cb0 con 0x7f52cc072720 2023-12-19T13:46:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.991+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd7e8007430 con 0x7fd7f80d2b00 2023-12-19T13:46:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.992+0000 7fd7dffff640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd7e406a460 0x7fd7e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.992+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7f52cc072720 msgr2=0x7f52cc074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.992+0000 7f52e1ffb640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7f52cc072720 0x7f52cc074b40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7e80889e0 con 0x7fd7f80d2b00 2023-12-19T13:46:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7fd7dffff640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7fd7e4072680 0x7fd7e4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 --> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7e4075150 con 0x7fd7e4072680 2023-12-19T13:46:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e8088d90 con 0x7fd7f80d2b00 2023-12-19T13:46:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f52cc06a500 msgr2=0x7f52cc06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7f52e1ffb640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f52cc06a500 0x7f52cc06c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f52dc000f60 tx=0x7f52dc009040 comp rx=0 tx=0).stop 2023-12-19T13:46:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7fd7f77fe640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd7e406a460 0x7fd7e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec159320 msgr2=0x7f52ec156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7f52e1ffb640 1 --2- 172.21.15.113:0/2920513860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52ec159320 0x7f52ec156ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52e402e760 tx=0x7f52e4004a40 comp rx=0 tx=0).stop 2023-12-19T13:46:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.993+0000 7f52ebfff640 1 -- 172.21.15.113:0/2920513860 reap_dead start 2023-12-19T13:46:43.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.994+0000 7fd7f7fff640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7fd7e4072680 0x7fd7e4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.994+0000 7f30f359e640 1 -- 172.21.15.113:0/27657494 --> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30ec006110 con 0x7f30d40725d0 2023-12-19T13:46:43.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.995+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 shutdown_connections 2023-12-19T13:46:43.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.995+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 >> 172.21.15.113:0/2920513860 conn(0x7f52ec0b4300 msgr2=0x7f52ec157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.995+0000 7fd7f77fe640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd7e406a460 0x7fd7e406c920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009b80 tx=0x7fd7ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.995+0000 7fd7f7fff640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7fd7e4072680 0x7fd7e4074aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.995+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 shutdown_connections 2023-12-19T13:46:43.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.995+0000 7f52e1ffb640 1 -- 172.21.15.113:0/2920513860 wait complete. 2023-12-19T13:46:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.996+0000 7f30e2ffd640 1 -- 172.21.15.113:0/27657494 <== osd.0 v2:172.21.15.113:6811/84090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f30e8031b80 con 0x7f30d40725d0 2023-12-19T13:46:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.996+0000 7f9ced729640 1 -- 172.21.15.113:0/2943914935 --> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ce0051720 con 0x7f9ccc072530 2023-12-19T13:46:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== osd.7 v2:172.21.15.151:6814/84064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fd7e4075150 con 0x7fd7e4072680 2023-12-19T13:46:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.996+0000 7f30e0ff9640 1 -- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f30d40725d0 msgr2=0x7f30d40749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.996+0000 7f30e0ff9640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f30d40725d0 0x7f30d40749f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f9ce4ff9640 1 -- 172.21.15.113:0/2943914935 <== osd.2 v2:172.21.15.113:6809/84093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9ce8072960 con 0x7f9ccc072530 2023-12-19T13:46:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f30e0ff9640 1 -- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30d406a430 msgr2=0x7f30d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f30e0ff9640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30d406a430 0x7f30d406c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30e4007f70 tx=0x7f30e4007f00 comp rx=0 tx=0).stop 2023-12-19T13:46:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f30e0ff9640 1 -- 172.21.15.113:0/27657494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30ec0e78b0 msgr2=0x7f30ec17c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f30e0ff9640 1 --2- 172.21.15.113:0/27657494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30ec0e78b0 0x7f30ec17c630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f30f404ee30 tx=0x7f30f4072850 comp rx=0 tx=0).stop 2023-12-19T13:46:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f30f2d9d640 1 -- 172.21.15.113:0/27657494 reap_dead start 2023-12-19T13:46:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f9cd27fc640 1 -- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f9ccc072530 msgr2=0x7f9ccc074950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.997+0000 7f9cd27fc640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f9ccc072530 0x7f9ccc074950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f9cd27fc640 1 -- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ccc06a480 msgr2=0x7f9ccc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f9cd27fc640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ccc06a480 0x7f9ccc06c940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40114b0 tx=0x7f9cd4009190 comp rx=0 tx=0).stop 2023-12-19T13:46:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f9cd27fc640 1 -- 172.21.15.113:0/2943914935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0038de0 msgr2=0x7f9ce00e4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f9cd27fc640 1 --2- 172.21.15.113:0/2943914935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ce0038de0 0x7f9ce00e4b20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc033000 tx=0x7f9cdc0046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f9cecf28640 1 -- 172.21.15.113:0/2943914935 reap_dead start 2023-12-19T13:46:43.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f30e0ff9640 1 -- 172.21.15.113:0/27657494 shutdown_connections 2023-12-19T13:46:43.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f30e0ff9640 1 -- 172.21.15.113:0/27657494 >> 172.21.15.113:0/27657494 conn(0x7f30ec054c10 msgr2=0x7f30ec04d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f9cd27fc640 1 -- 172.21.15.113:0/2943914935 shutdown_connections 2023-12-19T13:46:43.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.998+0000 7f9cd27fc640 1 -- 172.21.15.113:0/2943914935 >> 172.21.15.113:0/2943914935 conn(0x7f9ce00538a0 msgr2=0x7f9ce0007c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.999+0000 7f9cd27fc640 1 -- 172.21.15.113:0/2943914935 shutdown_connections 2023-12-19T13:46:43.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.999+0000 7f30e0ff9640 1 -- 172.21.15.113:0/27657494 shutdown_connections 2023-12-19T13:46:43.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.999+0000 7f30e0ff9640 1 -- 172.21.15.113:0/27657494 wait complete. 2023-12-19T13:46:43.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:42.999+0000 7f9cd27fc640 1 -- 172.21.15.113:0/2943914935 wait complete. 2023-12-19T13:46:43.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.009+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 --> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6c8054080 con 0x7fd6b40726b0 2023-12-19T13:46:43.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.010+0000 7fd6ccff9640 1 -- 172.21.15.113:0/852953727 <== osd.4 v2:172.21.15.151:6800/84063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6c4030b50 con 0x7fd6b40726b0 2023-12-19T13:46:43.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.011+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 --> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e3015dfa0 con 0x7f6e10072680 2023-12-19T13:46:43.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7f6e2d7fa640 1 -- 172.21.15.113:0/4213169591 <== osd.3 v2:172.21.15.113:6808/84094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e1800f040 con 0x7f6e10072680 2023-12-19T13:46:43.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7fd6b40726b0 msgr2=0x7fd6b4074ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 --> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8bc8002cb0 con 0x7f8bcc0726a0 2023-12-19T13:46:43.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7fd6b40726b0 0x7fd6b4074ad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6b406a490 msgr2=0x7fd6b406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6b406a490 0x7fd6b406c950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc007fd0 tx=0x7fd6bc009040 comp rx=0 tx=0).stop 2023-12-19T13:46:43.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 msgr2=0x7fd6c80cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 --2- 172.21.15.113:0/852953727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6c8053150 0x7fd6c80cedb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0068fd0 tx=0x7fd6d004f030 comp rx=0 tx=0).stop 2023-12-19T13:46:43.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d4e56640 1 -- 172.21.15.113:0/852953727 reap_dead start 2023-12-19T13:46:43.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 shutdown_connections 2023-12-19T13:46:43.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.012+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 >> 172.21.15.113:0/852953727 conn(0x7fd6c8054c10 msgr2=0x7fd6c80d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.013+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 shutdown_connections 2023-12-19T13:46:43.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.013+0000 7fd6d5657640 1 -- 172.21.15.113:0/852953727 wait complete. 2023-12-19T13:46:43.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.013+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7f6e10072680 msgr2=0x7f6e10074aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.013+0000 7f6e36cb6640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7f6e10072680 0x7f6e10074aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f8bddffb640 1 -- 172.21.15.113:0/2888526977 <== osd.6 v2:172.21.15.151:6824/84065 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8bc8002cb0 con 0x7f8bcc0726a0 2023-12-19T13:46:43.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e1006a460 msgr2=0x7f6e1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e1006a460 0x7f6e1006c920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e20036000 tx=0x7f6e2003c040 comp rx=0 tx=0).stop 2023-12-19T13:46:43.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300ce1e0 msgr2=0x7f6e3006b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 --2- 172.21.15.113:0/4213169591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e300ce1e0 0x7f6e3006b2b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c7f0 tx=0x7f6e2800ccb0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e35253640 1 -- 172.21.15.113:0/4213169591 reap_dead start 2023-12-19T13:46:43.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 shutdown_connections 2023-12-19T13:46:43.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 >> 172.21.15.113:0/4213169591 conn(0x7f6e300b27a0 msgr2=0x7f6e3015f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 shutdown_connections 2023-12-19T13:46:43.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f6e36cb6640 1 -- 172.21.15.113:0/4213169591 wait complete. 2023-12-19T13:46:43.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f8bcc0726a0 msgr2=0x7f8bcc074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.014+0000 7f8bef28b640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f8bcc0726a0 0x7f8bcc074ac0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8bcc06a480 msgr2=0x7f8bcc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8bcc06a480 0x7f8bcc06c940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8007f70 tx=0x7f8bd8007f00 comp rx=0 tx=0).stop 2023-12-19T13:46:43.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be80d01b0 msgr2=0x7f8be81fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 --2- 172.21.15.113:0/2888526977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8be80d01b0 0x7f8be81fb880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c7c0 tx=0x7f8be400cc80 comp rx=0 tx=0).stop 2023-12-19T13:46:43.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bed828640 1 -- 172.21.15.113:0/2888526977 reap_dead start 2023-12-19T13:46:43.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 shutdown_connections 2023-12-19T13:46:43.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 >> 172.21.15.113:0/2888526977 conn(0x7f8be80b27a0 msgr2=0x7f8be80b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 shutdown_connections 2023-12-19T13:46:43.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.015+0000 7f8bef28b640 1 -- 172.21.15.113:0/2888526977 wait complete. 2023-12-19T13:46:43.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.018+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 --> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f840b44a0 con 0x7f0f64072650 2023-12-19T13:46:43.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.019+0000 7f0f80ff9640 1 -- 172.21.15.113:0/963260364 <== osd.5 v2:172.21.15.151:6808/84062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f6c001810 con 0x7f0f64072650 2023-12-19T13:46:43.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.020+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f0f64072650 msgr2=0x7f0f64074a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.020+0000 7f0f8a37d640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f0f64072650 0x7f0f64074a70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.050 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.051 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T13:46:43.051 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.023+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f6406a430 msgr2=0x7f0f6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.023+0000 7f0f8a37d640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f6406a430 0x7f0f6406c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009e50 tx=0x7f0f74030000 comp rx=0 tx=0).stop 2023-12-19T13:46:43.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.023+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840ce110 msgr2=0x7f0f841407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.023+0000 7f0f8a37d640 1 --2- 172.21.15.113:0/963260364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f840ce110 0x7f0f841407c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e8a0 tx=0x7f0f7c00ed60 comp rx=0 tx=0).stop 2023-12-19T13:46:43.052 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T13:46:43.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.023+0000 7f0f8891a640 1 -- 172.21.15.113:0/963260364 reap_dead start 2023-12-19T13:46:43.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.023+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 shutdown_connections 2023-12-19T13:46:43.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.023+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 >> 172.21.15.113:0/963260364 conn(0x7f0f840b29c0 msgr2=0x7f0f84145e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.024+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 shutdown_connections 2023-12-19T13:46:43.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.024+0000 7f0f8a37d640 1 -- 172.21.15.113:0/963260364 wait complete. 2023-12-19T13:46:43.054 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2023-12-19T13:46:43.055 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T13:46:43.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.024+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 --> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7f80d2620 con 0x7fd7e4072680 2023-12-19T13:46:43.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.025+0000 7fd7dffff640 1 -- 172.21.15.113:0/3529788172 <== osd.7 v2:172.21.15.151:6814/84064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7e4075150 con 0x7fd7e4072680 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7fd7e4072680 msgr2=0x7fd7e4074aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7fd7e4072680 0x7fd7e4074aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd7e406a460 msgr2=0x7fd7e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd7e406a460 0x7fd7e406c920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009b80 tx=0x7fd7ec008040 comp rx=0 tx=0).stop 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80d2b00 msgr2=0x7fd7f815db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 --2- 172.21.15.113:0/3529788172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7f80d2b00 0x7fd7f815db00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800c430 tx=0x7fd7e800c8f0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7f7fff640 1 -- 172.21.15.113:0/3529788172 reap_dead start 2023-12-19T13:46:43.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 shutdown_connections 2023-12-19T13:46:43.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.026+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 >> 172.21.15.113:0/3529788172 conn(0x7fd7f80b29c0 msgr2=0x7fd7f80b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.027+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 shutdown_connections 2023-12-19T13:46:43.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.027+0000 7fd7fdd92640 1 -- 172.21.15.113:0/3529788172 wait complete. 2023-12-19T13:46:43.057 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.058 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T13:46:43.058 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.059 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T13:46:43.059 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.060 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T13:46:43.060 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.060 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T13:46:43.061 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.062 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T13:46:43.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.382+0000 7fc058b4c640 1 Processor -- start 2023-12-19T13:46:43.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.382+0000 7fc058b4c640 1 -- start start 2023-12-19T13:46:43.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.383+0000 7fc058b4c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc04c0e34a0 0x7fc04c0543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.383+0000 7fc058b4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c0582c0 0x7fc04c056cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.383+0000 7fc058b4c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc04c057230 0x7fc04c03c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.383+0000 7fc058b4c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c058dd0 con 0x7fc04c057230 2023-12-19T13:46:43.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.383+0000 7fc058b4c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c057b90 con 0x7fc04c0e34a0 2023-12-19T13:46:43.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.383+0000 7fc058b4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c057e70 con 0x7fc04c0582c0 2023-12-19T13:46:43.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.384+0000 7fc052ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c0582c0 0x7fc04c056cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.384+0000 7fc052ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c0582c0 0x7fc04c056cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51752/0 (socket says 172.21.15.113:51752) 2023-12-19T13:46:43.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.384+0000 7fc052ffd640 1 -- 172.21.15.113:0/2392850766 learned_addr learned my addr 172.21.15.113:0/2392850766 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.385+0000 7fc052ffd640 1 -- 172.21.15.113:0/2392850766 >> v2:172.21.15.151:3300/0 conn(0x7fc04c0e34a0 msgr2=0x7fc04c0543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.385+0000 7fc052ffd640 1 --2- 172.21.15.113:0/2392850766 >> v2:172.21.15.151:3300/0 conn(0x7fc04c0e34a0 0x7fc04c0543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.385+0000 7fc052ffd640 1 -- 172.21.15.113:0/2392850766 >> v2:172.21.15.113:3300/0 conn(0x7fc04c057230 msgr2=0x7fc04c03c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.385+0000 7fc052ffd640 1 --2- 172.21.15.113:0/2392850766 >> v2:172.21.15.113:3300/0 conn(0x7fc04c057230 0x7fc04c03c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.385+0000 7fc052ffd640 1 -- 172.21.15.113:0/2392850766 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c053810 con 0x7fc04c0582c0 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.387+0000 7fc052ffd640 1 --2- 172.21.15.113:0/2392850766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c0582c0 0x7fc04c056cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc04c059000 tx=0x7fc04802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738e039712e50d6c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.388+0000 7fc0527fc640 1 -- 172.21.15.113:0/2392850766 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048030610 con 0x7fc04c0582c0 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.388+0000 7fc0527fc640 1 -- 172.21.15.113:0/2392850766 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048030770 con 0x7fc04c0582c0 2023-12-19T13:46:43.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.388+0000 7fc0527fc640 1 -- 172.21.15.113:0/2392850766 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048030b20 con 0x7fc04c0582c0 2023-12-19T13:46:43.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 -- 172.21.15.113:0/2392850766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c0582c0 msgr2=0x7fc04c056cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2392850766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c0582c0 0x7fc04c056cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc04c059000 tx=0x7fc04802b960 comp rx=0 tx=0).stop 2023-12-19T13:46:43.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 -- 172.21.15.113:0/2392850766 shutdown_connections 2023-12-19T13:46:43.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2392850766 >> v2:172.21.15.113:3300/0 conn(0x7fc04c057230 0x7fc04c03c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2392850766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c0582c0 0x7fc04c056cf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2392850766 >> v2:172.21.15.151:3300/0 conn(0x7fc04c0e34a0 0x7fc04c0543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 -- 172.21.15.113:0/2392850766 >> 172.21.15.113:0/2392850766 conn(0x7fc04c059120 msgr2=0x7fc04c059530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 -- 172.21.15.113:0/2392850766 shutdown_connections 2023-12-19T13:46:43.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.390+0000 7fc058b4c640 1 -- 172.21.15.113:0/2392850766 wait complete. 2023-12-19T13:46:43.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.393+0000 7fc058b4c640 1 Processor -- start 2023-12-19T13:46:43.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.394+0000 7fc058b4c640 1 -- start start 2023-12-19T13:46:43.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.397+0000 7fc058b4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c057230 0x7fc04c052630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.397+0000 7fc058b4c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc04c0582c0 0x7fc04c0e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.397+0000 7fc058b4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc04c0e34a0 0x7fc04c0e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.397+0000 7fc058b4c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c0e67e0 con 0x7fc04c0582c0 2023-12-19T13:46:43.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.397+0000 7fc058b4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c04f1d0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.397+0000 7fc058b4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c0e5f40 con 0x7fc04c057230 2023-12-19T13:46:43.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.398+0000 7fc053fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc04c0e34a0 0x7fc04c0e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.398+0000 7fc052ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc04c0582c0 0x7fc04c0e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.398+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c057230 0x7fc04c052630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.398+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c057230 0x7fc04c052630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51762/0 (socket says 172.21.15.113:51762) 2023-12-19T13:46:43.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.398+0000 7fc0537fe640 1 -- 172.21.15.113:0/2469400940 learned_addr learned my addr 172.21.15.113:0/2469400940 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.399+0000 7fc053fff640 1 -- 172.21.15.113:0/2469400940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c057230 msgr2=0x7fc04c052630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.399+0000 7fc053fff640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c057230 0x7fc04c052630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.399+0000 7fc053fff640 1 -- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc04c0582c0 msgr2=0x7fc04c0e53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.399+0000 7fc053fff640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc04c0582c0 0x7fc04c0e53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.399+0000 7fc053fff640 1 -- 172.21.15.113:0/2469400940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480094d0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.399+0000 7fc052ffd640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc04c0582c0 0x7fc04c0e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:43.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.399+0000 7f5ee6a26640 1 Processor -- start 2023-12-19T13:46:43.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.400+0000 7f5ee6a26640 1 -- start start 2023-12-19T13:46:43.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.400+0000 7fc053fff640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc04c0e34a0 0x7fc04c0e5910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc054063d60 tx=0x7fc05406be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.400+0000 7fc03bfff640 1 -- 172.21.15.113:0/2469400940 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054072960 con 0x7fc04c0e34a0 2023-12-19T13:46:43.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.401+0000 7fc03bfff640 1 -- 172.21.15.113:0/2469400940 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054069ec0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.401+0000 7fc03bfff640 1 -- 172.21.15.113:0/2469400940 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05404e8d0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.401+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c0e6220 con 0x7fc04c0e34a0 2023-12-19T13:46:43.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.401+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c03f460 con 0x7fc04c0e34a0 2023-12-19T13:46:43.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.402+0000 7f1143433640 1 Processor -- start 2023-12-19T13:46:43.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.402+0000 7f1143433640 1 -- start start 2023-12-19T13:46:43.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f1143433640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f11340ddce0 0x7f1134054050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c0058e0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f1143433640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f11340e1060 0x7f1134050c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f1143433640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11340de0c0 con 0x7f11340511b0 2023-12-19T13:46:43.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f1143433640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113403bbe0 con 0x7f11340ddce0 2023-12-19T13:46:43.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f1143433640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11340515c0 con 0x7f11340e1060 2023-12-19T13:46:43.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.405+0000 7f1142c32640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f11340511b0 0x7f1134034690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59406/0 (socket says 172.21.15.113:59406) 2023-12-19T13:46:43.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.405+0000 7f1142c32640 1 -- 172.21.15.113:0/1103666259 learned_addr learned my addr 172.21.15.113:0/1103666259 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:43.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.405+0000 7fc03bfff640 1 -- 172.21.15.113:0/2469400940 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0540008d0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.403+0000 7f5ee6a26640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ee015efa0 0x7f5ee015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.403+0000 7f5ee6a26640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00ce9d0 con 0x7f5ee00d01b0 2023-12-19T13:46:43.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.403+0000 7f5ee6a26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00ce6f0 con 0x7f5ee015e7a0 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.403+0000 7f5ee6a26640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee015dcc0 con 0x7f5ee015efa0 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.403+0000 7f5ee4fc3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ee015efa0 0x7f5ee015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f5ee4fc3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ee015efa0 0x7f5ee015f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43592/0 (socket says 172.21.15.113:43592) 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f5ee4fc3640 1 -- 172.21.15.113:0/1718576054 learned_addr learned my addr 172.21.15.113:0/1718576054 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f5ee4fc3640 1 -- 172.21.15.113:0/1718576054 >> v1:172.21.15.151:6789/0 conn(0x7f5ee015e7a0 legacy=0x7f5ee00cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f5ee4fc3640 1 -- 172.21.15.113:0/1718576054 >> v1:172.21.15.113:6789/0 conn(0x7f5ee00d01b0 legacy=0x7f5ee00d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.404+0000 7f5ee4fc3640 1 -- 172.21.15.113:0/1718576054 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee015dfa0 con 0x7f5ee015efa0 2023-12-19T13:46:43.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7f5ee4fc3640 1 --2- 172.21.15.113:0/1718576054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015f3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009e50 tx=0x7f5ed802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc090bb03bbe400 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7f3ac398e640 1 Processor -- start 2023-12-19T13:46:43.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.405+0000 7f1142431640 1 --2- 172.21.15.113:0/1103666259 >> v2:172.21.15.113:3300/0 conn(0x7f11340ddce0 0x7f1134054050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7f114142f640 1 -- 172.21.15.113:0/1103666259 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166847975 0 0) 0x7f11340de0c0 con 0x7f11340511b0 2023-12-19T13:46:43.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7f114142f640 1 -- 172.21.15.113:0/1103666259 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1128005730 con 0x7f11340511b0 2023-12-19T13:46:43.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7f1141c30640 1 --2- 172.21.15.113:0/1103666259 >> v2:172.21.15.151:3300/0 conn(0x7f11340e1060 0x7f1134050c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7f3ac398e640 1 -- start start 2023-12-19T13:46:43.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7fc03bfff640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04006a430 0x7fc04006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7fc03bfff640 1 -- 172.21.15.113:0/2469400940 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0540b6070 con 0x7fc04c0e34a0 2023-12-19T13:46:43.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7fc0537fe640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04006a430 0x7fc04006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.406+0000 7f5edeffd640 1 -- 172.21.15.113:0/1718576054 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed802ca80 con 0x7f5ee015efa0 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7f5edeffd640 1 -- 172.21.15.113:0/1718576054 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed802cbe0 con 0x7f5ee015efa0 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f5edeffd640 1 -- 172.21.15.113:0/1718576054 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed802ca80 con 0x7f5ee015efa0 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f5ee6a26640 1 -- 172.21.15.113:0/1718576054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 msgr2=0x7f5ee015f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f5ee6a26640 1 --2- 172.21.15.113:0/1718576054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015f3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009e50 tx=0x7f5ed802bee0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f5ee6a26640 1 -- 172.21.15.113:0/1718576054 shutdown_connections 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f5ee6a26640 1 --2- 172.21.15.113:0/1718576054 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015f3f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f5ee6a26640 1 -- 172.21.15.113:0/1718576054 >> 172.21.15.113:0/1718576054 conn(0x7f5ee00b27a0 msgr2=0x7f5ee00b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7f1141c30640 1 -- 172.21.15.113:0/1103666259 >> v2:172.21.15.113:3300/0 conn(0x7f11340ddce0 msgr2=0x7f1134054050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7f1141c30640 1 --2- 172.21.15.113:0/1103666259 >> v2:172.21.15.113:3300/0 conn(0x7f11340ddce0 0x7f1134054050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7f114142f640 1 -- 172.21.15.113:0/1103666259 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624323746 0 0) 0x7f1128005730 con 0x7f11340511b0 2023-12-19T13:46:43.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7f1141c30640 1 -- 172.21.15.113:0/1103666259 >> v1:172.21.15.113:6789/0 conn(0x7f11340511b0 legacy=0x7f1134034690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.407+0000 7f1141c30640 1 -- 172.21.15.113:0/1103666259 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134054630 con 0x7f11340e1060 2023-12-19T13:46:43.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f3ac398e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d01b0 0x7f3abc15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f3ac398e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3abc0d0590 0x7f3abc0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7f5ee6a26640 1 -- 172.21.15.113:0/1718576054 shutdown_connections 2023-12-19T13:46:43.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f3ac398e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3abc0ce1e0 0x7f3abc15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f3ac398e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc15ece0 con 0x7f3abc0ce1e0 2023-12-19T13:46:43.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f3ac398e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0ce9d0 con 0x7f3abc0d0590 2023-12-19T13:46:43.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.408+0000 7f3ac398e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0ce6f0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7f3ac172a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d01b0 0x7f3abc15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7f3ac172a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d01b0 0x7f3abc15e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51776/0 (socket says 172.21.15.113:51776) 2023-12-19T13:46:43.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7f3ac172a640 1 -- 172.21.15.113:0/2217009819 learned_addr learned my addr 172.21.15.113:0/2217009819 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7f3ac0f29640 1 --2- 172.21.15.113:0/2217009819 >> v2:172.21.15.151:3300/0 conn(0x7f3abc0d0590 0x7f3abc0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7f5ee6a26640 1 -- 172.21.15.113:0/1718576054 wait complete. 2023-12-19T13:46:43.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7f1141c30640 1 --2- 172.21.15.113:0/1103666259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340e1060 0x7f1134050c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1134056cb0 tx=0x7f112c02b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6088a40fd3a01b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.409+0000 7fc0537fe640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04006a430 0x7fc04006c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc044009a40 tx=0x7fc0440091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.410+0000 7f3ac172a640 1 -- 172.21.15.113:0/2217009819 >> v2:172.21.15.151:3300/0 conn(0x7f3abc0d0590 msgr2=0x7f3abc0cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.410+0000 7f3ac172a640 1 --2- 172.21.15.113:0/2217009819 >> v2:172.21.15.151:3300/0 conn(0x7f3abc0d0590 0x7f3abc0cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.410+0000 7f3ac172a640 1 -- 172.21.15.113:0/2217009819 >> v2:172.21.15.113:3300/0 conn(0x7f3abc0ce1e0 msgr2=0x7f3abc15efa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:46:43.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.410+0000 7f3ac172a640 1 --2- 172.21.15.113:0/2217009819 >> v2:172.21.15.113:3300/0 conn(0x7f3abc0ce1e0 0x7f3abc15efa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.410+0000 7f3ac172a640 1 -- 172.21.15.113:0/2217009819 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc15dcc0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.411+0000 7f5ee6a26640 1 Processor -- start 2023-12-19T13:46:43.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.412+0000 7f5ee6a26640 1 -- start start 2023-12-19T13:46:43.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.412+0000 7f3ac172a640 1 --2- 172.21.15.113:0/2217009819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d01b0 0x7f3abc15e7a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0d44d0 tx=0x7f3ab402bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fbd3f6bc42a647e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f3ab3fff640 1 -- 172.21.15.113:0/2217009819 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab402caa0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7fc10d330640 1 Processor -- start 2023-12-19T13:46:43.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f3ab3fff640 1 -- 172.21.15.113:0/2217009819 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab402cc00 con 0x7f3abc0d01b0 2023-12-19T13:46:43.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f3ab3fff640 1 -- 172.21.15.113:0/2217009819 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40343f0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f5ee6a26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ee00d01b0 0x7f5ee00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f5ee6a26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ee015e7a0 0x7f5ee0146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f5ee6a26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f5ee6a26640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee01506b0 con 0x7f5ee015efa0 2023-12-19T13:46:43.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7fc10d330640 1 -- start start 2023-12-19T13:46:43.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f5ee6a26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee01474c0 con 0x7f5ee00d01b0 2023-12-19T13:46:43.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.413+0000 7f5ee6a26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00b6890 con 0x7f5ee015e7a0 2023-12-19T13:46:43.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f5edf7fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ee015e7a0 0x7f5ee0146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f5edffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ee00d01b0 0x7f5ee00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f3ac398e640 1 -- 172.21.15.113:0/2217009819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d01b0 msgr2=0x7f3abc15e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f5edffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ee00d01b0 0x7f5ee00b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49834/0 (socket says 172.21.15.113:49834) 2023-12-19T13:46:43.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f5edffff640 1 -- 172.21.15.113:0/3147581583 learned_addr learned my addr 172.21.15.113:0/3147581583 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f5ee4fc3640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f3ac398e640 1 --2- 172.21.15.113:0/2217009819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d01b0 0x7f3abc15e7a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0d44d0 tx=0x7f3ab402bf00 comp rx=0 tx=0).stop 2023-12-19T13:46:43.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f3ac398e640 1 -- 172.21.15.113:0/2217009819 shutdown_connections 2023-12-19T13:46:43.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f3ac398e640 1 --2- 172.21.15.113:0/2217009819 >> v2:172.21.15.113:3300/0 conn(0x7f3abc0ce1e0 0x7f3abc15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f3ac398e640 1 --2- 172.21.15.113:0/2217009819 >> v2:172.21.15.151:3300/0 conn(0x7f3abc0d0590 0x7f3abc0cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f3ac398e640 1 --2- 172.21.15.113:0/2217009819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d01b0 0x7f3abc15e7a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f0497fff640 1 Processor -- start 2023-12-19T13:46:43.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.414+0000 7f3ac398e640 1 -- 172.21.15.113:0/2217009819 >> 172.21.15.113:0/2217009819 conn(0x7f3abc0b27a0 msgr2=0x7f3abc0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5ee4fc3640 1 -- 172.21.15.113:0/3147581583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ee015e7a0 msgr2=0x7f5ee0146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5ee4fc3640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ee015e7a0 0x7f5ee0146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5ee4fc3640 1 -- 172.21.15.113:0/3147581583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ee00d01b0 msgr2=0x7f5ee00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5ee4fc3640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ee00d01b0 0x7f5ee00b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5ee4fc3640 1 -- 172.21.15.113:0/3147581583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8009b30 con 0x7f5ee015efa0 2023-12-19T13:46:43.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5edffff640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ee00d01b0 0x7f5ee00b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:43.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f0497fff640 1 -- start start 2023-12-19T13:46:43.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f3ac398e640 1 -- 172.21.15.113:0/2217009819 shutdown_connections 2023-12-19T13:46:43.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5ee4fc3640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015a6c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8032000 tx=0x7f5ed8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f3ac398e640 1 -- 172.21.15.113:0/2217009819 wait complete. 2023-12-19T13:46:43.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7fc10d330640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7fc10d330640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080d12d0 con 0x7fc108146e30 2023-12-19T13:46:43.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7fc10d330640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080d15b0 con 0x7fc1080b8070 2023-12-19T13:46:43.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7fc10d330640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108147210 con 0x7fc10815e880 2023-12-19T13:46:43.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.415+0000 7f5edcff9640 1 -- 172.21.15.113:0/3147581583 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8009510 con 0x7f5ee015efa0 2023-12-19T13:46:43.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7f5edcff9640 1 -- 172.21.15.113:0/3147581583 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8004440 con 0x7f5ee015efa0 2023-12-19T13:46:43.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7fc107fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc108146e30 0x7fc1080b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59422/0 (socket says 172.21.15.113:59422) 2023-12-19T13:46:43.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7fc107fff640 1 -- 172.21.15.113:0/590922981 learned_addr learned my addr 172.21.15.113:0/590922981 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:43.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7f5edcff9640 1 -- 172.21.15.113:0/3147581583 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80047f0 con 0x7f5ee015efa0 2023-12-19T13:46:43.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7f5ee6a26640 1 -- 172.21.15.113:0/3147581583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee00b6b70 con 0x7f5ee015efa0 2023-12-19T13:46:43.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7f5ee6a26640 1 -- 172.21.15.113:0/3147581583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee00b7130 con 0x7f5ee015efa0 2023-12-19T13:46:43.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7fc10cb2f640 1 --2- 172.21.15.113:0/590922981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7f6a79010640 1 Processor -- start 2023-12-19T13:46:43.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.417+0000 7f6a79010640 1 -- start start 2023-12-19T13:46:43.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.416+0000 7fc106ffd640 1 -- 172.21.15.113:0/590922981 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164406185 0 0) 0x7fc1080d12d0 con 0x7fc108146e30 2023-12-19T13:46:43.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.417+0000 7fc10cb2f640 1 -- 172.21.15.113:0/590922981 >> v1:172.21.15.151:6789/0 conn(0x7fc1080b8070 legacy=0x7fc1080d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.417+0000 7fc10cb2f640 1 -- 172.21.15.113:0/590922981 >> v1:172.21.15.113:6789/0 conn(0x7fc108146e30 legacy=0x7fc1080b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.417+0000 7fc10cb2f640 1 -- 172.21.15.113:0/590922981 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080d1890 con 0x7fc10815e880 2023-12-19T13:46:43.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.417+0000 7f5ee6a26640 1 -- 172.21.15.113:0/3147581583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee0061910 con 0x7f5ee015efa0 2023-12-19T13:46:43.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f3ac398e640 1 Processor -- start 2023-12-19T13:46:43.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f3ac398e640 1 -- start start 2023-12-19T13:46:43.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f0497fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04980cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f0497fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980b4120 con 0x7f049815da00 2023-12-19T13:46:43.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f0497fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980b6ee0 con 0x7f04980b6870 2023-12-19T13:46:43.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f0497fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b71c0 con 0x7f049815d620 2023-12-19T13:46:43.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f04967fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f049815da00 0x7f04980b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59430/0 (socket says 172.21.15.113:59430) 2023-12-19T13:46:43.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.418+0000 7f04967fc640 1 -- 172.21.15.113:0/841998508 learned_addr learned my addr 172.21.15.113:0/841998508 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:43.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7fc10cb2f640 1 --2- 172.21.15.113:0/590922981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080d0c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc100009dc0 tx=0x7fc10002be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a2c26e968c6de3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f6a79010640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d01b0 0x7f6a7415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f3ac398e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc0ce1e0 0x7f3abc151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f6a79010640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7415ece0 con 0x7f6a7415efa0 2023-12-19T13:46:43.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f6a79010640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740ce9d0 con 0x7f6a740d0590 2023-12-19T13:46:43.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f6a79010640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740ce6f0 con 0x7f6a740d01b0 2023-12-19T13:46:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f3ac398e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3abc0d01b0 0x7f3abc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f3ac398e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d0590 0x7f3abc15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f3ac398e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc148ea0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f3ac398e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc148290 con 0x7f3abc0ce1e0 2023-12-19T13:46:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f3ac398e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc148570 con 0x7f3abc0d0590 2023-12-19T13:46:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f0496ffd640 1 --2- 172.21.15.113:0/841998508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04980cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f0495ffb640 1 -- 172.21.15.113:0/841998508 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905410364 0 0) 0x7f04980b4120 con 0x7f049815da00 2023-12-19T13:46:43.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7f0495ffb640 1 -- 172.21.15.113:0/841998508 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0480003520 con 0x7f049815da00 2023-12-19T13:46:43.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.419+0000 7fc106ffd640 1 -- 172.21.15.113:0/590922981 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10002cbb0 con 0x7fc10815e880 2023-12-19T13:46:43.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f3ac0f29640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3abc0d01b0 0x7f3abc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f6a7359e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6a7415efa0 0x7f6a7415f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59436/0 (socket says 172.21.15.113:59436) 2023-12-19T13:46:43.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f6a7359e640 1 -- 172.21.15.113:0/3020232673 learned_addr learned my addr 172.21.15.113:0/3020232673 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f3ac0f29640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3abc0d01b0 0x7f3abc15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43620/0 (socket says 172.21.15.113:43620) 2023-12-19T13:46:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f3ac0f29640 1 -- 172.21.15.113:0/131888504 learned_addr learned my addr 172.21.15.113:0/131888504 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f3ac172a640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc0ce1e0 0x7f3abc151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f5edcff9640 1 -- 172.21.15.113:0/3147581583 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ed803e450 con 0x7f5ee015efa0 2023-12-19T13:46:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f3ac1f2b640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d0590 0x7f3abc15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7fc106ffd640 1 -- 172.21.15.113:0/590922981 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10002cd10 con 0x7fc10815e880 2023-12-19T13:46:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f0496ffd640 1 -- 172.21.15.113:0/841998508 >> v1:172.21.15.151:6789/0 conn(0x7f04980b6870 legacy=0x7f04980b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f0496ffd640 1 -- 172.21.15.113:0/841998508 >> v1:172.21.15.113:6789/0 conn(0x7f049815da00 legacy=0x7f04980b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f6a72d9d640 1 --2- 172.21.15.113:0/3020232673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d01b0 0x7f6a7415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f6a71d9b640 1 -- 172.21.15.113:0/3020232673 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157450658 0 0) 0x7f6a7415ece0 con 0x7f6a7415efa0 2023-12-19T13:46:43.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7f3ac0f29640 1 -- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d0590 msgr2=0x7f3abc15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7f3ac0f29640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d0590 0x7f3abc15a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f6a71d9b640 1 -- 172.21.15.113:0/3020232673 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c003520 con 0x7f6a7415efa0 2023-12-19T13:46:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7f3ac0f29640 1 -- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc0ce1e0 msgr2=0x7f3abc151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7f3ac0f29640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc0ce1e0 0x7f3abc151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7f3ac0f29640 1 -- 172.21.15.113:0/131888504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab4009b30 con 0x7f3abc0d01b0 2023-12-19T13:46:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7f3ac0f29640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3abc0d01b0 0x7f3abc15a400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e9b0 tx=0x7f3ab800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7fc10d330640 1 -- 172.21.15.113:0/590922981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 msgr2=0x7fc1080d0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.420+0000 7f0496ffd640 1 -- 172.21.15.113:0/841998508 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980b4370 con 0x7f049815d620 2023-12-19T13:46:43.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7f5edcff9640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ecc06a500 0x7f5ecc06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7f5edcff9640 1 -- 172.21.15.113:0/3147581583 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ed80ab5b0 con 0x7f5ee015efa0 2023-12-19T13:46:43.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7fc106ffd640 1 -- 172.21.15.113:0/590922981 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100034660 con 0x7fc10815e880 2023-12-19T13:46:43.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.421+0000 7fc10d330640 1 --2- 172.21.15.113:0/590922981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080d0c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc100009dc0 tx=0x7fc10002be00 comp rx=0 tx=0).stop 2023-12-19T13:46:43.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7fc10d330640 1 -- 172.21.15.113:0/590922981 shutdown_connections 2023-12-19T13:46:43.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7fc10d330640 1 --2- 172.21.15.113:0/590922981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080d0c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7fc10d330640 1 -- 172.21.15.113:0/590922981 >> 172.21.15.113:0/590922981 conn(0x7fc1080b2990 msgr2=0x7fc1080b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7f6a72d9d640 1 -- 172.21.15.113:0/3020232673 >> v1:172.21.15.151:6789/0 conn(0x7f6a740d0590 legacy=0x7f6a740cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7f6a72d9d640 1 -- 172.21.15.113:0/3020232673 >> v1:172.21.15.113:6789/0 conn(0x7f6a7415efa0 legacy=0x7f6a7415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7f6a72d9d640 1 -- 172.21.15.113:0/3020232673 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7415dcc0 con 0x7f6a740d01b0 2023-12-19T13:46:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7f5edffff640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ecc06a500 0x7f5ecc06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7fc10d330640 1 -- 172.21.15.113:0/590922981 shutdown_connections 2023-12-19T13:46:43.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.422+0000 7fc10d330640 1 -- 172.21.15.113:0/590922981 wait complete. 2023-12-19T13:46:43.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.423+0000 7f0496ffd640 1 --2- 172.21.15.113:0/841998508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04980cef60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04880097d0 tx=0x7f048802b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7a7183517b2e7e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.423+0000 7f5edffff640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ecc06a500 0x7f5ecc06c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0006fd0 tx=0x7f5ed0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.423+0000 7f0495ffb640 1 -- 172.21.15.113:0/841998508 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c001670 con 0x7f049815d620 2023-12-19T13:46:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.423+0000 7f0495ffb640 1 -- 172.21.15.113:0/841998508 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048802e050 con 0x7f049815d620 2023-12-19T13:46:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.423+0000 7f0495ffb640 1 -- 172.21.15.113:0/841998508 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488030730 con 0x7f049815d620 2023-12-19T13:46:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f6a72d9d640 1 --2- 172.21.15.113:0/3020232673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d01b0 0x7f6a7415e7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009dc0 tx=0x7f6a6c02bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46e21bba31c0cad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f6a71d9b640 1 -- 172.21.15.113:0/3020232673 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c02ccc0 con 0x7f6a740d01b0 2023-12-19T13:46:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f0497fff640 1 -- 172.21.15.113:0/841998508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 msgr2=0x7f04980cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f0497fff640 1 --2- 172.21.15.113:0/841998508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04980cef60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04880097d0 tx=0x7f048802b7b0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f6a71d9b640 1 -- 172.21.15.113:0/3020232673 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c02ce20 con 0x7f6a740d01b0 2023-12-19T13:46:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f6a71d9b640 1 -- 172.21.15.113:0/3020232673 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c034640 con 0x7f6a740d01b0 2023-12-19T13:46:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f0497fff640 1 -- 172.21.15.113:0/841998508 shutdown_connections 2023-12-19T13:46:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f0497fff640 1 --2- 172.21.15.113:0/841998508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04980cef60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.424+0000 7f0497fff640 1 -- 172.21.15.113:0/841998508 >> 172.21.15.113:0/841998508 conn(0x7f04980cfb90 msgr2=0x7f04980cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.425+0000 7f0497fff640 1 -- 172.21.15.113:0/841998508 shutdown_connections 2023-12-19T13:46:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.425+0000 7f0497fff640 1 -- 172.21.15.113:0/841998508 wait complete. 2023-12-19T13:46:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.425+0000 7fc10d330640 1 Processor -- start 2023-12-19T13:46:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.425+0000 7fc10d330640 1 -- start start 2023-12-19T13:46:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.425+0000 7f6a79010640 1 -- 172.21.15.113:0/3020232673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d01b0 msgr2=0x7f6a7415e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.425+0000 7f6a79010640 1 --2- 172.21.15.113:0/3020232673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d01b0 0x7f6a7415e7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009dc0 tx=0x7f6a6c02bf10 comp rx=0 tx=0).stop 2023-12-19T13:46:43.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7fc03bfff640 1 -- 172.21.15.113:0/2469400940 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc0540b2ec0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7f6a79010640 1 -- 172.21.15.113:0/3020232673 shutdown_connections 2023-12-19T13:46:43.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7f6a79010640 1 --2- 172.21.15.113:0/3020232673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d01b0 0x7f6a7415e7a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7f6a79010640 1 -- 172.21.15.113:0/3020232673 >> 172.21.15.113:0/3020232673 conn(0x7f6a740b27a0 msgr2=0x7f6a740b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7fe756edb640 1 Processor -- start 2023-12-19T13:46:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7f6a79010640 1 -- 172.21.15.113:0/3020232673 shutdown_connections 2023-12-19T13:46:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7fe756edb640 1 -- start start 2023-12-19T13:46:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7f6a79010640 1 -- 172.21.15.113:0/3020232673 wait complete. 2023-12-19T13:46:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.426+0000 7fc10d330640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1080b8070 0x7fc10813aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7f114142f640 1 -- 172.21.15.113:0/1103666259 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c030510 con 0x7f11340e1060 2023-12-19T13:46:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7f114142f640 1 -- 172.21.15.113:0/1103666259 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c02e050 con 0x7f11340e1060 2023-12-19T13:46:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7f114142f640 1 -- 172.21.15.113:0/1103666259 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c030890 con 0x7f11340e1060 2023-12-19T13:46:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7fc10d330640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc108146e30 0x7fc1081e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7fc10d330640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7fc10d330640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10813b020 con 0x7fc108146e30 2023-12-19T13:46:43.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7f0497fff640 1 Processor -- start 2023-12-19T13:46:43.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7fc10d330640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081e46e0 con 0x7fc1080b8070 2023-12-19T13:46:43.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.427+0000 7fc10d330640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081e49c0 con 0x7fc10815e880 2023-12-19T13:46:43.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fc10cb2f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fc10cb2f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51834/0 (socket says 172.21.15.113:51834) 2023-12-19T13:46:43.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fc10cb2f640 1 -- 172.21.15.113:0/1396952296 learned_addr learned my addr 172.21.15.113:0/1396952296 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7f1143433640 1 -- 172.21.15.113:0/1103666259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340e1060 msgr2=0x7f1134050c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fc107fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1080b8070 0x7fc10813aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7f1143433640 1 --2- 172.21.15.113:0/1103666259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340e1060 0x7f1134050c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1134056cb0 tx=0x7f112c02b770 comp rx=0 tx=0).stop 2023-12-19T13:46:43.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fe756edb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d01b0 0x7fe75015e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fc1077fe640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc108146e30 0x7fc1081e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fe756edb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe7500d0590 0x7fe7500cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fe756edb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75015ece0 con 0x7fe7500ce1e0 2023-12-19T13:46:43.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7f1143433640 1 -- 172.21.15.113:0/1103666259 shutdown_connections 2023-12-19T13:46:43.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fe756edb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7500ce9d0 con 0x7fe7500d0590 2023-12-19T13:46:43.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7fe756edb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500ce6f0 con 0x7fe7500d01b0 2023-12-19T13:46:43.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7f1143433640 1 --2- 172.21.15.113:0/1103666259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340e1060 0x7f1134050c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7f1143433640 1 --2- 172.21.15.113:0/1103666259 >> v2:172.21.15.113:3300/0 conn(0x7f11340ddce0 0x7f1134054050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7f1143433640 1 -- 172.21.15.113:0/1103666259 >> 172.21.15.113:0/1103666259 conn(0x7f1134055c10 msgr2=0x7f1134055ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.428+0000 7f0497fff640 1 -- start start 2023-12-19T13:46:43.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7f6a79010640 1 Processor -- start 2023-12-19T13:46:43.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7f1143433640 1 -- 172.21.15.113:0/1103666259 shutdown_connections 2023-12-19T13:46:43.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fe754c77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d01b0 0x7fe75015e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7f6a79010640 1 -- start start 2023-12-19T13:46:43.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fe754c77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d01b0 0x7fe75015e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51844/0 (socket says 172.21.15.113:51844) 2023-12-19T13:46:43.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fe754c77640 1 -- 172.21.15.113:0/2996339768 learned_addr learned my addr 172.21.15.113:0/2996339768 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7f1143433640 1 -- 172.21.15.113:0/1103666259 wait complete. 2023-12-19T13:46:43.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fc10cb2f640 1 -- 172.21.15.113:0/1396952296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1080b8070 msgr2=0x7fc10813aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fc10cb2f640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1080b8070 0x7fc10813aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fc10cb2f640 1 -- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc108146e30 msgr2=0x7fc1081e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fc10cb2f640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc108146e30 0x7fc1081e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fc10cb2f640 1 -- 172.21.15.113:0/1396952296 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc100009a70 con 0x7fc10815e880 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.429+0000 7fe74ffff640 1 --2- 172.21.15.113:0/2996339768 >> v2:172.21.15.151:3300/0 conn(0x7fe7500d0590 0x7fe7500cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f3ab1ffb640 1 -- 172.21.15.113:0/131888504 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8009670 con 0x7f3abc0d01b0 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f3ab1ffb640 1 -- 172.21.15.113:0/131888504 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab800c9a0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f3ab1ffb640 1 -- 172.21.15.113:0/131888504 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800cd50 con 0x7f3abc0d01b0 2023-12-19T13:46:43.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f0497fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04980b6870 0x7f0498147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f0497fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04981e7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f0497fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049815da00 0x7f04981f8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f0497fff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04981f8110 con 0x7f049815da00 2023-12-19T13:46:43.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f0497fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980d1ef0 con 0x7f04980b6870 2023-12-19T13:46:43.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f0497fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04981f7b50 con 0x7f049815d620 2023-12-19T13:46:43.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7fc1077fe640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc108146e30 0x7fc1081e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:43.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f5edcff9640 1 -- 172.21.15.113:0/3147581583 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5ed8076ca0 con 0x7f5ee015efa0 2023-12-19T13:46:43.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7f04977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049815da00 0x7f04981f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7f04977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049815da00 0x7f04981f8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43634/0 (socket says 172.21.15.113:43634) 2023-12-19T13:46:43.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7f04977fe640 1 -- 172.21.15.113:0/840622448 learned_addr learned my addr 172.21.15.113:0/840622448 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7fc10cb2f640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080b4170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc100009ee0 tx=0x7fc100004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc148850 con 0x7f3abc0d01b0 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.430+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc145fd0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7f0496ffd640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04980b6870 0x7f0498147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7fe754c77640 1 -- 172.21.15.113:0/2996339768 >> v2:172.21.15.151:3300/0 conn(0x7fe7500d0590 msgr2=0x7fe7500cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7fe754c77640 1 --2- 172.21.15.113:0/2996339768 >> v2:172.21.15.151:3300/0 conn(0x7fe7500d0590 0x7fe7500cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7fe754c77640 1 -- 172.21.15.113:0/2996339768 >> v1:172.21.15.151:6789/0 conn(0x7fe7500ce1e0 legacy=0x7fe75015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7fe754c77640 1 -- 172.21.15.113:0/2996339768 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75015dcc0 con 0x7fe7500d01b0 2023-12-19T13:46:43.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7fe74ffff640 1 --2- 172.21.15.113:0/2996339768 >> v2:172.21.15.151:3300/0 conn(0x7fe7500d0590 0x7fe7500cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:43.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7f04977fe640 1 -- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 msgr2=0x7f04981e7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7f04967fc640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04981e7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.432+0000 7f1143433640 1 Processor -- start 2023-12-19T13:46:43.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.431+0000 7f04977fe640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04981e7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.432+0000 7f04977fe640 1 -- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04980b6870 msgr2=0x7f0498147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.432+0000 7f04977fe640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04980b6870 0x7f0498147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.432+0000 7f04977fe640 1 -- 172.21.15.113:0/840622448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488009400 con 0x7f049815da00 2023-12-19T13:46:43.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.432+0000 7f04967fc640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04981e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:43.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.432+0000 7f1143433640 1 -- start start 2023-12-19T13:46:43.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.432+0000 7f04977fe640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049815da00 0x7f04981f8380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f049000c7a0 tx=0x7f049000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc0cfa40 con 0x7f3abc0d01b0 2023-12-19T13:46:43.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f6a79010640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a740d01b0 0x7f6a741f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f6a79010640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d0590 0x7f6a7415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f6a79010640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a7415efa0 0x7f6a7415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f6a79010640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741f61e0 con 0x7f6a7415efa0 2023-12-19T13:46:43.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f6a79010640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741f6430 con 0x7f6a740d01b0 2023-12-19T13:46:43.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f6a79010640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741f6710 con 0x7f6a740d0590 2023-12-19T13:46:43.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7fe754c77640 1 --2- 172.21.15.113:0/2996339768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d01b0 0x7fe75015e7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe744009870 tx=0x7fe74402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5612331c316c7fa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f047ffff640 1 -- 172.21.15.113:0/840622448 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490003b70 con 0x7f049815da00 2023-12-19T13:46:43.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f047ffff640 1 -- 172.21.15.113:0/840622448 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490003cf0 con 0x7f049815da00 2023-12-19T13:46:43.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f047ffff640 1 -- 172.21.15.113:0/840622448 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490003ea0 con 0x7f049815da00 2023-12-19T13:46:43.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.433+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04981f7e30 con 0x7f049815da00 2023-12-19T13:46:43.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1143433640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340511b0 0x7f11341755d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1143433640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11340ddce0 0x7f1134171df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1143433640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11340e1060 0x7f113404e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1143433640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1134175d20 con 0x7f11340ddce0 2023-12-19T13:46:43.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1143433640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113404f2d0 con 0x7f11340511b0 2023-12-19T13:46:43.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1143433640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113404f5b0 con 0x7f11340e1060 2023-12-19T13:46:43.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f6a72d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a740d01b0 0x7f6a741f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f6a72d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a740d01b0 0x7f6a741f24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49882/0 (socket says 172.21.15.113:49882) 2023-12-19T13:46:43.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f6a72d9d640 1 -- 172.21.15.113:0/1451144554 learned_addr learned my addr 172.21.15.113:0/1451144554 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f6a7259c640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d0590 0x7f6a7415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1142c32640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11340e1060 0x7f113404e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1142c32640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11340e1060 0x7f113404e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51874/0 (socket says 172.21.15.113:51874) 2023-12-19T13:46:43.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f1142c32640 1 -- 172.21.15.113:0/3637515305 learned_addr learned my addr 172.21.15.113:0/3637515305 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f1142431640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340511b0 0x7f11341755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f6a7259c640 1 -- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a740d01b0 msgr2=0x7f6a741f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f6a7259c640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a740d01b0 0x7f6a741f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.434+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04981e6b00 con 0x7f049815da00 2023-12-19T13:46:43.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f6a7259c640 1 -- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a7415efa0 msgr2=0x7f6a7415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f6a7259c640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a7415efa0 0x7f6a7415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f6a7259c640 1 -- 172.21.15.113:0/1451144554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009a70 con 0x7f6a740d0590 2023-12-19T13:46:43.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f1142c32640 1 -- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340511b0 msgr2=0x7f11341755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f1142c32640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340511b0 0x7f11341755d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.435+0000 7f1142c32640 1 -- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11340ddce0 msgr2=0x7f1134171df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.436+0000 7f6a7259c640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d0590 0x7f6a7415c810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c390 tx=0x7f6a6800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.436+0000 7f1142c32640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11340ddce0 0x7f1134171df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.436+0000 7f1142c32640 1 -- 172.21.15.113:0/3637515305 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c009400 con 0x7f11340e1060 2023-12-19T13:46:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.436+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04981e6d20 con 0x7f049815da00 2023-12-19T13:46:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.436+0000 7fc104ff9640 1 -- 172.21.15.113:0/1396952296 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100003b90 con 0x7fc10815e880 2023-12-19T13:46:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.436+0000 7f1142c32640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11340e1060 0x7f113404e9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f113c04f860 tx=0x7f113c0721f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7f6a5b7fe640 1 -- 172.21.15.113:0/1451144554 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a680052d0 con 0x7f6a740d0590 2023-12-19T13:46:43.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a741f69f0 con 0x7f6a740d0590 2023-12-19T13:46:43.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1081e4ca0 con 0x7fc10815e880 2023-12-19T13:46:43.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1081e6360 con 0x7fc10815e880 2023-12-19T13:46:43.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7fc104ff9640 1 -- 172.21.15.113:0/1396952296 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100003cf0 con 0x7fc10815e880 2023-12-19T13:46:43.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7fc104ff9640 1 -- 172.21.15.113:0/1396952296 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100004270 con 0x7fc10815e880 2023-12-19T13:46:43.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a741f2a00 con 0x7f6a740d0590 2023-12-19T13:46:43.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7fe74f7fe640 1 -- 172.21.15.113:0/2996339768 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744030840 con 0x7fe7500d01b0 2023-12-19T13:46:43.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7fe74f7fe640 1 -- 172.21.15.113:0/2996339768 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7440309a0 con 0x7fe7500d01b0 2023-12-19T13:46:43.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7fe74f7fe640 1 -- 172.21.15.113:0/2996339768 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744030d30 con 0x7fe7500d01b0 2023-12-19T13:46:43.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7f047ffff640 1 -- 172.21.15.113:0/840622448 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f049000aa90 con 0x7f049815da00 2023-12-19T13:46:43.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7f1132ffd640 1 -- 172.21.15.113:0/3637515305 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0670a0 con 0x7f11340e1060 2023-12-19T13:46:43.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7f1132ffd640 1 -- 172.21.15.113:0/3637515305 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c067220 con 0x7f11340e1060 2023-12-19T13:46:43.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7f1132ffd640 1 -- 172.21.15.113:0/3637515305 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c06e620 con 0x7f11340e1060 2023-12-19T13:46:43.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.437+0000 7f3ab1ffb640 1 -- 172.21.15.113:0/131888504 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ab8013470 con 0x7f3abc0d01b0 2023-12-19T13:46:43.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7fe756edb640 1 -- 172.21.15.113:0/2996339768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d01b0 msgr2=0x7fe75015e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7fe756edb640 1 --2- 172.21.15.113:0/2996339768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d01b0 0x7fe75015e7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe744009870 tx=0x7fe74402b980 comp rx=0 tx=0).stop 2023-12-19T13:46:43.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113404f890 con 0x7f11340e1060 2023-12-19T13:46:43.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1134172330 con 0x7f11340e1060 2023-12-19T13:46:43.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.439+0000 7f6a5b7fe640 1 -- 172.21.15.113:0/1451144554 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a68005430 con 0x7f6a740d0590 2023-12-19T13:46:43.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.439+0000 7f6a5b7fe640 1 -- 172.21.15.113:0/1451144554 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68003830 con 0x7f6a740d0590 2023-12-19T13:46:43.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7fe756edb640 1 -- 172.21.15.113:0/2996339768 shutdown_connections 2023-12-19T13:46:43.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7fe756edb640 1 --2- 172.21.15.113:0/2996339768 >> v2:172.21.15.151:3300/0 conn(0x7fe7500d0590 0x7fe7500cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7fe756edb640 1 --2- 172.21.15.113:0/2996339768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d01b0 0x7fe75015e7a0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe744009870 tx=0x7fe74402b980 comp rx=0 tx=0).stop 2023-12-19T13:46:43.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.438+0000 7fe756edb640 1 -- 172.21.15.113:0/2996339768 >> 172.21.15.113:0/2996339768 conn(0x7fe7500b27a0 msgr2=0x7fe7500b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.439+0000 7f3ab1ffb640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3aa006a480 0x7f3aa006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.440+0000 7f3ab1ffb640 1 -- 172.21.15.113:0/131888504 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ab8089220 con 0x7f3abc0d01b0 2023-12-19T13:46:43.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.440+0000 7fe756edb640 1 -- 172.21.15.113:0/2996339768 shutdown_connections 2023-12-19T13:46:43.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.439+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1134175e90 con 0x7f11340e1060 2023-12-19T13:46:43.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.439+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1081e68f0 con 0x7fc10815e880 2023-12-19T13:46:43.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.440+0000 7f047ffff640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f048406a480 0x7f048406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.440+0000 7fe756edb640 1 -- 172.21.15.113:0/2996339768 wait complete. 2023-12-19T13:46:43.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.440+0000 7f3ac172a640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3aa006a480 0x7f3aa006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.442+0000 7f3ac172a640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3aa006a480 0x7f3aa006c940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4035000 tx=0x7f3ab4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.442+0000 7f0496ffd640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f048406a480 0x7f048406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.442+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a54005250 con 0x7f6a740d0590 2023-12-19T13:46:43.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.442+0000 7fc104ff9640 1 -- 172.21.15.113:0/1396952296 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc1000045e0 con 0x7fc10815e880 2023-12-19T13:46:43.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.443+0000 7fe756edb640 1 Processor -- start 2023-12-19T13:46:43.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.442+0000 7f1132ffd640 1 -- 172.21.15.113:0/3637515305 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f113c090070 con 0x7f11340e1060 2023-12-19T13:46:43.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.443+0000 7fe756edb640 1 -- start start 2023-12-19T13:46:43.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.443+0000 7f0496ffd640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f048406a480 0x7f048406c940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0488034000 tx=0x7f0488008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.443+0000 7f6a5b7fe640 1 -- 172.21.15.113:0/1451144554 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6a68003990 con 0x7f6a740d0590 2023-12-19T13:46:43.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fc104ff9640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f406a430 0x7fc0f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fc104ff9640 1 -- 172.21.15.113:0/1396952296 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1000ab8b0 con 0x7fc10815e880 2023-12-19T13:46:43.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fe756edb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7500ce1e0 0x7fe750148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fe756edb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d0590 0x7fe7501487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fe756edb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe750145c50 0x7fe7500b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fe756edb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750146a20 con 0x7fe750145c50 2023-12-19T13:46:43.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fe756edb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b7c00 con 0x7fe7500ce1e0 2023-12-19T13:46:43.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7fe756edb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe750155650 con 0x7fe7500d0590 2023-12-19T13:46:43.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.444+0000 7f3ab1ffb640 1 -- 172.21.15.113:0/131888504 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ab80549a0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7fc107fff640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f406a430 0x7fc0f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7f047ffff640 1 -- 172.21.15.113:0/840622448 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0490058050 con 0x7f049815da00 2023-12-19T13:46:43.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7f6a5b7fe640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6a6006a430 0x7f6a6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7fe754c77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7500ce1e0 0x7fe750148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7fe755478640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe750145c50 0x7fe7500b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7fe754c77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7500ce1e0 0x7fe750148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49902/0 (socket says 172.21.15.113:49902) 2023-12-19T13:46:43.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7fe754c77640 1 -- 172.21.15.113:0/3159702822 learned_addr learned my addr 172.21.15.113:0/3159702822 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:43.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7fe74ffff640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d0590 0x7fe7501487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7f6a5b7fe640 1 -- 172.21.15.113:0/1451144554 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a68087e30 con 0x7f6a740d0590 2023-12-19T13:46:43.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7f6a72d9d640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6a6006a430 0x7f6a6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7f1132ffd640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f112006a530 0x7f112006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.445+0000 7f1132ffd640 1 -- 172.21.15.113:0/3637515305 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f113c1037d0 con 0x7f11340e1060 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7fe755478640 1 -- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d0590 msgr2=0x7fe7501487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7fe755478640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d0590 0x7fe7501487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7fe755478640 1 -- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7500ce1e0 msgr2=0x7fe750148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7fe755478640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7500ce1e0 0x7fe750148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7fe755478640 1 -- 172.21.15.113:0/3159702822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440094d0 con 0x7fe750145c50 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7fe754c77640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7500ce1e0 0x7fe750148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.446+0000 7fe74ffff640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d0590 0x7fe7501487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.447+0000 7fe755478640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe750145c50 0x7fe7500b6c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c690 tx=0x7fe74800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.447+0000 7f1142431640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f112006a530 0x7f112006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.447+0000 7f6a72d9d640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6a6006a430 0x7f6a6006c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c02bf50 tx=0x7f6a6c02cf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.447+0000 7fc107fff640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f406a430 0x7fc0f406c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007f70 tx=0x7fc0f8007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.448+0000 7f1142431640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f112006a530 0x7f112006c9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11340499f0 tx=0x7f113800f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.451+0000 7f047ffff640 1 -- 172.21.15.113:0/840622448 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0490053c90 con 0x7f049815da00 2023-12-19T13:46:43.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.451+0000 7fe74d7fa640 1 -- 172.21.15.113:0/3159702822 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748003b70 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.451+0000 7fe74d7fa640 1 -- 172.21.15.113:0/3159702822 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748003cd0 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.451+0000 7fe74d7fa640 1 -- 172.21.15.113:0/3159702822 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748005310 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.451+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7501f7980 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.451+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750146360 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.453+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe750146b60 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.453+0000 7fe74d7fa640 1 -- 172.21.15.113:0/3159702822 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe748005470 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.455+0000 7fe74d7fa640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe73406a4b0 0x7fe73406c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.455+0000 7fe74d7fa640 1 -- 172.21.15.113:0/3159702822 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe748088500 con 0x7fe750145c50 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.456+0000 7fe754c77640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe73406a4b0 0x7fe73406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.457+0000 7fe754c77640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe73406a4b0 0x7fe73406c970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe744009870 tx=0x7fe744008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:43.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.459+0000 7fc104ff9640 1 -- 172.21.15.113:0/1396952296 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc1000770e0 con 0x7fc10815e880 2023-12-19T13:46:43.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.461+0000 7fe74d7fa640 1 -- 172.21.15.113:0/3159702822 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe750146b60 con 0x7fe750145c50 2023-12-19T13:46:43.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.473+0000 7f1132ffd640 1 -- 172.21.15.113:0/3637515305 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f113c0ceda0 con 0x7f11340e1060 2023-12-19T13:46:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.493+0000 7f6a5b7fe640 1 -- 172.21.15.113:0/1451144554 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6a68053430 con 0x7f6a740d0590 2023-12-19T13:46:43.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.827+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc04c0380b0 con 0x7fc04c0e34a0 2023-12-19T13:46:43.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.828+0000 7fc03bfff640 1 -- 172.21.15.113:0/2469400940 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0540be020 con 0x7fc04c0e34a0 2023-12-19T13:46:43.832 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2023-12-19T13:46:43.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04006a430 msgr2=0x7fc04006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04006a430 0x7fc04006c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc044009a40 tx=0x7fc0440091c0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc04c0e34a0 msgr2=0x7fc04c0e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc04c0e34a0 0x7fc04c0e5910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc054063d60 tx=0x7fc05406be90 comp rx=0 tx=0).stop 2023-12-19T13:46:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 shutdown_connections 2023-12-19T13:46:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04006a430 0x7fc04006c8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc04c0e34a0 0x7fc04c0e5910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc04c0582c0 0x7fc04c0e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.834+0000 7fc058b4c640 1 --2- 172.21.15.113:0/2469400940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc04c057230 0x7fc04c052630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.835+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 >> 172.21.15.113:0/2469400940 conn(0x7fc04c059120 msgr2=0x7fc04c0542f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.835+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 shutdown_connections 2023-12-19T13:46:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.836+0000 7fc058b4c640 1 -- 172.21.15.113:0/2469400940 wait complete. 2023-12-19T13:46:43.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.838+0000 7f5ee6a26640 1 -- 172.21.15.113:0/3147581583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ee0061910 con 0x7f5ee015efa0 2023-12-19T13:46:43.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.839+0000 7f5edcff9640 1 -- 172.21.15.113:0/3147581583 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ed807a2c0 con 0x7f5ee015efa0 2023-12-19T13:46:43.843 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:43.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.843+0000 7f5ec67fc640 1 -- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ecc06a500 msgr2=0x7f5ecc06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.843+0000 7f5ec67fc640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ecc06a500 0x7f5ecc06c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0006fd0 tx=0x7f5ed0008040 comp rx=0 tx=0).stop 2023-12-19T13:46:43.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.843+0000 7f5ec67fc640 1 -- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 msgr2=0x7f5ee015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.843+0000 7f5ec67fc640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015a6c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8032000 tx=0x7f5ed8004a40 comp rx=0 tx=0).stop 2023-12-19T13:46:43.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.844+0000 7f5ec67fc640 1 -- 172.21.15.113:0/3147581583 shutdown_connections 2023-12-19T13:46:43.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.844+0000 7f5ec67fc640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ecc06a500 0x7f5ecc06c9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.844+0000 7f5ec67fc640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ee015efa0 0x7f5ee015a6c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.844+0000 7f5ec67fc640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ee015e7a0 0x7f5ee0146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.844+0000 7f5ec67fc640 1 --2- 172.21.15.113:0/3147581583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ee00d01b0 0x7f5ee00b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.844+0000 7f5ec67fc640 1 -- 172.21.15.113:0/3147581583 >> 172.21.15.113:0/3147581583 conn(0x7f5ee00b27a0 msgr2=0x7f5ee015f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.845+0000 7f5ec67fc640 1 -- 172.21.15.113:0/3147581583 shutdown_connections 2023-12-19T13:46:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.845+0000 7f5ec67fc640 1 -- 172.21.15.113:0/3147581583 wait complete. 2023-12-19T13:46:43.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.849+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe750146b60 con 0x7fe750145c50 2023-12-19T13:46:43.852 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2023-12-19T13:46:43.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.850+0000 7fe74d7fa640 1 -- 172.21.15.113:0/3159702822 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe750146b60 con 0x7fe750145c50 2023-12-19T13:46:43.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.852+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3abc061910 con 0x7f3abc0d01b0 2023-12-19T13:46:43.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.853+0000 7f3ab1ffb640 1 -- 172.21.15.113:0/131888504 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ab8057fc0 con 0x7f3abc0d01b0 2023-12-19T13:46:43.854 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2023-12-19T13:46:43.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.854+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe73406a4b0 msgr2=0x7fe73406c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.854+0000 7fe756edb640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe73406a4b0 0x7fe73406c970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe744009870 tx=0x7fe744008030 comp rx=0 tx=0).stop 2023-12-19T13:46:43.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.854+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe750145c50 msgr2=0x7fe7500b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.854+0000 7fe756edb640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe750145c50 0x7fe7500b6c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c690 tx=0x7fe74800cb50 comp rx=0 tx=0).stop 2023-12-19T13:46:43.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.855+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 shutdown_connections 2023-12-19T13:46:43.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.855+0000 7fe756edb640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe73406a4b0 0x7fe73406c970 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.855+0000 7fe756edb640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe750145c50 0x7fe7500b6c30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.855+0000 7fe756edb640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7500d0590 0x7fe7501487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.855+0000 7fe756edb640 1 --2- 172.21.15.113:0/3159702822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7500ce1e0 0x7fe750148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.855+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 >> 172.21.15.113:0/3159702822 conn(0x7fe7500b27a0 msgr2=0x7fe750160590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.856+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 shutdown_connections 2023-12-19T13:46:43.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.856+0000 7fe756edb640 1 -- 172.21.15.113:0/3159702822 wait complete. 2023-12-19T13:46:43.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.857+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0498061910 con 0x7f049815da00 2023-12-19T13:46:43.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.858+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3aa006a480 msgr2=0x7f3aa006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.858+0000 7f3ac398e640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3aa006a480 0x7f3aa006c940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4035000 tx=0x7f3ab4030000 comp rx=0 tx=0).stop 2023-12-19T13:46:43.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.858+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3abc0d01b0 msgr2=0x7f3abc15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.858+0000 7f3ac398e640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3abc0d01b0 0x7f3abc15a400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e9b0 tx=0x7f3ab800ee70 comp rx=0 tx=0).stop 2023-12-19T13:46:43.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 shutdown_connections 2023-12-19T13:46:43.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3aa006a480 0x7f3aa006c940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc0d0590 0x7f3abc15a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3abc0d01b0 0x7f3abc15a400 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 --2- 172.21.15.113:0/131888504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc0ce1e0 0x7f3abc151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 >> 172.21.15.113:0/131888504 conn(0x7f3abc0b27a0 msgr2=0x7f3abc14f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f047ffff640 1 -- 172.21.15.113:0/840622448 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04900572b0 con 0x7f049815da00 2023-12-19T13:46:43.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 shutdown_connections 2023-12-19T13:46:43.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.859+0000 7f3ac398e640 1 -- 172.21.15.113:0/131888504 wait complete. 2023-12-19T13:46:43.860 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2023-12-19T13:46:43.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f048406a480 msgr2=0x7f048406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f048406a480 0x7f048406c940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0488034000 tx=0x7f0488008030 comp rx=0 tx=0).stop 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049815da00 msgr2=0x7f04981f8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049815da00 0x7f04981f8380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f049000c7a0 tx=0x7f049000cc60 comp rx=0 tx=0).stop 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 shutdown_connections 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f048406a480 0x7f048406c940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049815da00 0x7f04981f8380 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f049815d620 0x7f04981e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 --2- 172.21.15.113:0/840622448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04980b6870 0x7f0498147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.864+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 >> 172.21.15.113:0/840622448 conn(0x7f04980cfb90 msgr2=0x7f049806fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.865+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 shutdown_connections 2023-12-19T13:46:43.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.865+0000 7f0497fff640 1 -- 172.21.15.113:0/840622448 wait complete. 2023-12-19T13:46:43.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-12-19T13:46:43.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.871+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1081e68f0 con 0x7fc10815e880 2023-12-19T13:46:43.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.872+0000 7fc104ff9640 1 -- 172.21.15.113:0/1396952296 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1081e68f0 con 0x7fc10815e880 2023-12-19T13:46:43.874 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2023-12-19T13:46:43.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f406a430 msgr2=0x7fc0f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f406a430 0x7fc0f406c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007f70 tx=0x7fc0f8007f00 comp rx=0 tx=0).stop 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 msgr2=0x7fc1080b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080b4170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc100009ee0 tx=0x7fc100004a40 comp rx=0 tx=0).stop 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 shutdown_connections 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f406a430 0x7fc0f406c8f0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007f70 tx=0x7fc0f8007f00 comp rx=0 tx=0).stop 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc10815e880 0x7fc1080b4170 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc108146e30 0x7fc1081e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 --2- 172.21.15.113:0/1396952296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1080b8070 0x7fc10813aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.875+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 >> 172.21.15.113:0/1396952296 conn(0x7fc1080b2990 msgr2=0x7fc1080b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.877+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 shutdown_connections 2023-12-19T13:46:43.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.877+0000 7fc10d330640 1 -- 172.21.15.113:0/1396952296 wait complete. 2023-12-19T13:46:43.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-19T13:46:43.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.881+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f113404f6f0 con 0x7f11340e1060 2023-12-19T13:46:43.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.882+0000 7f1132ffd640 1 -- 172.21.15.113:0/3637515305 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f113404f6f0 con 0x7f11340e1060 2023-12-19T13:46:43.883 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2023-12-19T13:46:43.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-19T13:46:43.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f112006a530 msgr2=0x7f112006c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f112006a530 0x7f112006c9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11340499f0 tx=0x7f113800f040 comp rx=0 tx=0).stop 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11340e1060 msgr2=0x7f113404e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11340e1060 0x7f113404e9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f113c04f860 tx=0x7f113c0721f0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 shutdown_connections 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f112006a530 0x7f112006c9f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11340e1060 0x7f113404e9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11340ddce0 0x7f1134171df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 --2- 172.21.15.113:0/3637515305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11340511b0 0x7f11341755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 >> 172.21.15.113:0/3637515305 conn(0x7f1134055c10 msgr2=0x7f11340554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.885+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 shutdown_connections 2023-12-19T13:46:43.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.886+0000 7f1143433640 1 -- 172.21.15.113:0/3637515305 wait complete. 2023-12-19T13:46:43.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-12-19T13:46:43.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.893+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6a54005500 con 0x7f6a740d0590 2023-12-19T13:46:43.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.894+0000 7f6a5b7fe640 1 -- 172.21.15.113:0/1451144554 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a68056a50 con 0x7f6a740d0590 2023-12-19T13:46:43.895 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2023-12-19T13:46:43.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-12-19T13:46:43.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6a6006a430 msgr2=0x7f6a6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6a6006a430 0x7f6a6006c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c02bf50 tx=0x7f6a6c02cf90 comp rx=0 tx=0).stop 2023-12-19T13:46:43.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d0590 msgr2=0x7f6a7415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:43.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d0590 0x7f6a7415c810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c390 tx=0x7f6a6800c850 comp rx=0 tx=0).stop 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 shutdown_connections 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6a6006a430 0x7f6a6006c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a7415efa0 0x7f6a7415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a740d0590 0x7f6a7415c810 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 --2- 172.21.15.113:0/1451144554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a740d01b0 0x7f6a741f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 >> 172.21.15.113:0/1451144554 conn(0x7f6a740b27a0 msgr2=0x7f6a7406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 shutdown_connections 2023-12-19T13:46:43.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:43.897+0000 7f6a79010640 1 -- 172.21.15.113:0/1451144554 wait complete. 2023-12-19T13:46:43.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-19T13:46:43.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-19T13:46:44.868 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T13:46:44.875 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T13:46:44.883 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T13:46:44.887 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T13:46:44.891 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T13:46:44.900 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T13:46:44.903 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T13:46:44.915 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T13:46:45.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.163+0000 7f50efc8f640 1 Processor -- start 2023-12-19T13:46:45.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.163+0000 7f50efc8f640 1 -- start start 2023-12-19T13:46:45.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.165+0000 7f50efc8f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f50e80b0bf0 0x7f50e80cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.165+0000 7f50efc8f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80cbdd0 con 0x7f50e8159320 2023-12-19T13:46:45.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.165+0000 7f50efc8f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80b32c0 con 0x7f50e80cb180 2023-12-19T13:46:45.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.165+0000 7f50efc8f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e8070380 con 0x7f50e80b0bf0 2023-12-19T13:46:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.167+0000 7f50ee22c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f50e80b0bf0 0x7f50e80cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.167+0000 7f50ed22a640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f50e80cb180 0x7f50e80b04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:59138/0 (socket says 172.21.15.113:59138) 2023-12-19T13:46:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.167+0000 7f50ed22a640 1 -- 172.21.15.113:0/781825484 learned_addr learned my addr 172.21.15.113:0/781825484 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.168+0000 7f50eca29640 1 -- 172.21.15.113:0/781825484 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613189373 0 0) 0x7f50e80b32c0 con 0x7f50e80cb180 2023-12-19T13:46:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.168+0000 7f50eca29640 1 -- 172.21.15.113:0/781825484 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d4003520 con 0x7f50e80cb180 2023-12-19T13:46:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.169+0000 7f50eca29640 1 -- 172.21.15.113:0/781825484 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3182797210 0 0) 0x7f50d4003520 con 0x7f50e80cb180 2023-12-19T13:46:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.169+0000 7f50ee22c640 1 -- 172.21.15.113:0/781825484 >> v1:172.21.15.151:6789/0 conn(0x7f50e80cb180 legacy=0x7f50e80b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.169+0000 7f50ee22c640 1 -- 172.21.15.113:0/781825484 >> v1:172.21.15.113:6789/0 conn(0x7f50e8159320 legacy=0x7f50e80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.171+0000 7f50ee22c640 1 -- 172.21.15.113:0/781825484 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8070660 con 0x7f50e80b0bf0 2023-12-19T13:46:45.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.173+0000 7f50ee22c640 1 --2- 172.21.15.113:0/781825484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 0x7f50e80cb890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50e40097a0 tx=0x7f50e402b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b45780b2e82992eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.173+0000 7f50eca29640 1 -- 172.21.15.113:0/781825484 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8001670 con 0x7f50e80b0bf0 2023-12-19T13:46:45.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.174+0000 7f50eca29640 1 -- 172.21.15.113:0/781825484 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e402e050 con 0x7f50e80b0bf0 2023-12-19T13:46:45.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.174+0000 7f50eca29640 1 -- 172.21.15.113:0/781825484 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4030730 con 0x7f50e80b0bf0 2023-12-19T13:46:45.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.175+0000 7f50efc8f640 1 -- 172.21.15.113:0/781825484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 msgr2=0x7f50e80cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.175+0000 7f50efc8f640 1 --2- 172.21.15.113:0/781825484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 0x7f50e80cb890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50e40097a0 tx=0x7f50e402b680 comp rx=0 tx=0).stop 2023-12-19T13:46:45.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.175+0000 7f50efc8f640 1 -- 172.21.15.113:0/781825484 shutdown_connections 2023-12-19T13:46:45.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.176+0000 7f50efc8f640 1 --2- 172.21.15.113:0/781825484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 0x7f50e80cb890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.176+0000 7f50efc8f640 1 -- 172.21.15.113:0/781825484 >> 172.21.15.113:0/781825484 conn(0x7f50e80b4300 msgr2=0x7f50e80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.176+0000 7f50efc8f640 1 -- 172.21.15.113:0/781825484 shutdown_connections 2023-12-19T13:46:45.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.176+0000 7f50efc8f640 1 -- 172.21.15.113:0/781825484 wait complete. 2023-12-19T13:46:45.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.180+0000 7f50efc8f640 1 Processor -- start 2023-12-19T13:46:45.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.180+0000 7f50efc8f640 1 -- start start 2023-12-19T13:46:45.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.182+0000 7f50efc8f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 0x7f50e814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.182+0000 7f50efc8f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50e80cb180 0x7f50e806c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.183+0000 7f50efc8f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50e8159320 0x7f50e81512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.183+0000 7f50efc8f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8150a80 con 0x7f50e80cb180 2023-12-19T13:46:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.183+0000 7f50efc8f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8151020 con 0x7f50e80b0bf0 2023-12-19T13:46:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.183+0000 7f50efc8f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8150d40 con 0x7f50e8159320 2023-12-19T13:46:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.183+0000 7f50eda2b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 0x7f50e814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.184+0000 7f50ee22c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50e8159320 0x7f50e81512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.184+0000 7f50ee22c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50e8159320 0x7f50e81512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51900/0 (socket says 172.21.15.113:51900) 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.184+0000 7f50ee22c640 1 -- 172.21.15.113:0/2634741579 learned_addr learned my addr 172.21.15.113:0/2634741579 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.184+0000 7f50ee22c640 1 -- 172.21.15.113:0/2634741579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 msgr2=0x7f50e814cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.184+0000 7f50ee22c640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 0x7f50e814cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.185+0000 7f50ee22c640 1 -- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50e80cb180 msgr2=0x7f50e806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.185+0000 7f50ed22a640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50e80cb180 0x7f50e806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.185+0000 7f50ee22c640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50e80cb180 0x7f50e806c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.185+0000 7f50ee22c640 1 -- 172.21.15.113:0/2634741579 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4009400 con 0x7f50e8159320 2023-12-19T13:46:45.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.185+0000 7f50ed22a640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50e80cb180 0x7f50e806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:45.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.186+0000 7f50ee22c640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50e8159320 0x7f50e81512c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50e40098c0 tx=0x7f50e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.187+0000 7f50de7fc640 1 -- 172.21.15.113:0/2634741579 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e403d950 con 0x7f50e8159320 2023-12-19T13:46:45.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.187+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e806bd30 con 0x7f50e8159320 2023-12-19T13:46:45.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.187+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e814d080 con 0x7f50e8159320 2023-12-19T13:46:45.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.187+0000 7f50de7fc640 1 -- 172.21.15.113:0/2634741579 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e403dab0 con 0x7f50e8159320 2023-12-19T13:46:45.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.189+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e806c250 con 0x7f50e8159320 2023-12-19T13:46:45.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.191+0000 7f50de7fc640 1 -- 172.21.15.113:0/2634741579 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e403de40 con 0x7f50e8159320 2023-12-19T13:46:45.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.192+0000 7f50de7fc640 1 -- 172.21.15.113:0/2634741579 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f50e4039040 con 0x7f50e8159320 2023-12-19T13:46:45.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.194+0000 7f50de7fc640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f50cc06a460 0x7f50cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.194+0000 7f50de7fc640 1 -- 172.21.15.113:0/2634741579 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50e40aaad0 con 0x7f50e8159320 2023-12-19T13:46:45.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.195+0000 7f50eda2b640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f50cc06a460 0x7f50cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.196+0000 7f50eda2b640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f50cc06a460 0x7f50cc06c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50e00012e0 tx=0x7f50e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.206+0000 7f50de7fc640 1 -- 172.21.15.113:0/2634741579 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f50e4076160 con 0x7f50e8159320 2023-12-19T13:46:45.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.208+0000 7f1738d81640 1 Processor -- start 2023-12-19T13:46:45.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.208+0000 7f1738d81640 1 -- start start 2023-12-19T13:46:45.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.210+0000 7f1738d81640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f17340d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.210+0000 7f1738d81640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17340ce110 0x7f17340ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.210+0000 7f1738d81640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340cd840 con 0x7f1734146e10 2023-12-19T13:46:45.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.210+0000 7f1738d81640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340d2430 con 0x7f17340ce110 2023-12-19T13:46:45.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.210+0000 7f1738d81640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340ceae0 con 0x7f17340d2b00 2023-12-19T13:46:45.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.211+0000 7f1731d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f17340d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.211+0000 7f1731d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f17340d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:51914/0 (socket says 172.21.15.113:51914) 2023-12-19T13:46:45.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.211+0000 7f1731d9b640 1 -- 172.21.15.113:0/2349328910 learned_addr learned my addr 172.21.15.113:0/2349328910 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.212+0000 7f1731d9b640 1 -- 172.21.15.113:0/2349328910 >> v2:172.21.15.113:3300/0 conn(0x7f17340ce110 msgr2=0x7f17340ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.212+0000 7f1731d9b640 1 --2- 172.21.15.113:0/2349328910 >> v2:172.21.15.113:3300/0 conn(0x7f17340ce110 0x7f17340ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.212+0000 7f1731d9b640 1 -- 172.21.15.113:0/2349328910 >> v1:172.21.15.113:6789/0 conn(0x7f1734146e10 legacy=0x7f17340b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.212+0000 7f1731d9b640 1 -- 172.21.15.113:0/2349328910 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340b6e90 con 0x7f17340d2b00 2023-12-19T13:46:45.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.214+0000 7f1731d9b640 1 --2- 172.21.15.113:0/2349328910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f17340d1ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1724009e50 tx=0x7f172402bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1f2718860326b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.215+0000 7f173159a640 1 -- 172.21.15.113:0/2349328910 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172402caa0 con 0x7f17340d2b00 2023-12-19T13:46:45.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.215+0000 7f173159a640 1 -- 172.21.15.113:0/2349328910 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172402cc00 con 0x7f17340d2b00 2023-12-19T13:46:45.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.215+0000 7f173159a640 1 -- 172.21.15.113:0/2349328910 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240343f0 con 0x7f17340d2b00 2023-12-19T13:46:45.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.216+0000 7f1738d81640 1 -- 172.21.15.113:0/2349328910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 msgr2=0x7f17340d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.216+0000 7f1738d81640 1 --2- 172.21.15.113:0/2349328910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f17340d1ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1724009e50 tx=0x7f172402bf00 comp rx=0 tx=0).stop 2023-12-19T13:46:45.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.217+0000 7f1738d81640 1 -- 172.21.15.113:0/2349328910 shutdown_connections 2023-12-19T13:46:45.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.217+0000 7f1738d81640 1 --2- 172.21.15.113:0/2349328910 >> v2:172.21.15.113:3300/0 conn(0x7f17340ce110 0x7f17340ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.217+0000 7f1738d81640 1 --2- 172.21.15.113:0/2349328910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f17340d1ef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.217+0000 7f1738d81640 1 -- 172.21.15.113:0/2349328910 >> 172.21.15.113:0/2349328910 conn(0x7f17340b29c0 msgr2=0x7f17340b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.217+0000 7f1738d81640 1 -- 172.21.15.113:0/2349328910 shutdown_connections 2023-12-19T13:46:45.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.217+0000 7f1738d81640 1 -- 172.21.15.113:0/2349328910 wait complete. 2023-12-19T13:46:45.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.219+0000 7fc1b6069640 1 Processor -- start 2023-12-19T13:46:45.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.220+0000 7f1738d81640 1 Processor -- start 2023-12-19T13:46:45.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.219+0000 7fc1b6069640 1 -- start start 2023-12-19T13:46:45.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.220+0000 7f1738d81640 1 -- start start 2023-12-19T13:46:45.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.222+0000 7fc1b6069640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1b0161660 0x7fc1b0166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.222+0000 7fc1b6069640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.222+0000 7f1738d81640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17340ce110 0x7f173413e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7f1738d81640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f173413cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7f1738d81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1734146e10 0x7f1734143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7f173259c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17340ce110 0x7f173413e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7fc1b6069640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b0165bc0 con 0x7fc1b00afa50 2023-12-19T13:46:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7fc1af7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1b0161660 0x7fc1b0166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7fc1af7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1b0161660 0x7fc1b0166050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43688/0 (socket says 172.21.15.113:43688) 2023-12-19T13:46:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7fc1aeffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc1b00afa50 0x7fc1b00b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59458/0 (socket says 172.21.15.113:59458) 2023-12-19T13:46:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7fc1aeffd640 1 -- 172.21.15.113:0/3117123860 learned_addr learned my addr 172.21.15.113:0/3117123860 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7f173259c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17340ce110 0x7f173413e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49936/0 (socket says 172.21.15.113:49936) 2023-12-19T13:46:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7f1738d81640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173413e9c0 con 0x7f1734146e10 2023-12-19T13:46:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7f1738d81640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734143dc0 con 0x7f17340ce110 2023-12-19T13:46:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7fc1affff640 1 --2- 172.21.15.113:0/3117123860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.223+0000 7f1738d81640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17341440a0 con 0x7f17340d2b00 2023-12-19T13:46:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f173259c640 1 -- 172.21.15.113:0/3540290846 learned_addr learned my addr 172.21.15.113:0/3540290846 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f1732d9d640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1734146e10 0x7f1734143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f1731d9b640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f173413cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7fc1b6069640 1 -- 172.21.15.113:0/3117123860 --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b006e520 con 0x7fc1b0161660 2023-12-19T13:46:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7fc1b6069640 1 -- 172.21.15.113:0/3117123860 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00afef0 con 0x7fc1b0161a40 2023-12-19T13:46:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f173259c640 1 -- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 msgr2=0x7f173413cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f173259c640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f173413cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f173259c640 1 -- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1734146e10 msgr2=0x7f1734143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f173259c640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1734146e10 0x7f1734143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.224+0000 7f173259c640 1 -- 172.21.15.113:0/3540290846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1724009b30 con 0x7f17340ce110 2023-12-19T13:46:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7fc1af7fe640 1 -- 172.21.15.113:0/3117123860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 msgr2=0x7fc1b00b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7f136aa96640 1 Processor -- start 2023-12-19T13:46:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7f173259c640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17340ce110 0x7f173413e480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c460 tx=0x7f171c00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7fc1ae7fc640 1 -- 172.21.15.113:0/3117123860 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801867887 0 0) 0x7fc1b0165bc0 con 0x7fc1b00afa50 2023-12-19T13:46:45.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7fc1af7fe640 1 --2- 172.21.15.113:0/3117123860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b00b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7fc1af7fe640 1 -- 172.21.15.113:0/3117123860 >> v1:172.21.15.113:6789/0 conn(0x7fc1b00afa50 legacy=0x7fc1b00b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7fc1af7fe640 1 -- 172.21.15.113:0/3117123860 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0165570 con 0x7fc1b0161660 2023-12-19T13:46:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7f172affd640 1 -- 172.21.15.113:0/3540290846 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c012830 con 0x7f17340ce110 2023-12-19T13:46:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.226+0000 7f172affd640 1 -- 172.21.15.113:0/3540290846 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0129d0 con 0x7f17340ce110 2023-12-19T13:46:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.226+0000 7f172affd640 1 -- 172.21.15.113:0/3540290846 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c012d80 con 0x7f17340ce110 2023-12-19T13:46:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.226+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173413d9a0 con 0x7f17340ce110 2023-12-19T13:46:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.227+0000 7fc1affff640 1 --2- 172.21.15.113:0/3117123860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:45.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.227+0000 7fc1af7fe640 1 --2- 172.21.15.113:0/3117123860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b0161660 0x7fc1b0166050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009a00 tx=0x7fc1a002bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a6efdc230246e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.226+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173413df60 con 0x7f17340ce110 2023-12-19T13:46:45.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.225+0000 7f136aa96640 1 -- start start 2023-12-19T13:46:45.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.227+0000 7f136aa96640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f136415e7a0 0x7f13640cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.227+0000 7f136aa96640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640ce9d0 con 0x7f13640d01b0 2023-12-19T13:46:45.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.227+0000 7f136aa96640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640ce6f0 con 0x7f13640ce1e0 2023-12-19T13:46:45.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.227+0000 7f136aa96640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136415dcc0 con 0x7f136415e7a0 2023-12-19T13:46:45.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7fc1ae7fc640 1 -- 172.21.15.113:0/3117123860 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a002d700 con 0x7fc1b0161660 2023-12-19T13:46:45.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7fc1ae7fc640 1 -- 172.21.15.113:0/3117123860 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a002d860 con 0x7fc1b0161660 2023-12-19T13:46:45.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7fc1ae7fc640 1 -- 172.21.15.113:0/3117123860 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a002dc30 con 0x7fc1b0161660 2023-12-19T13:46:45.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7f1363fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f136415e7a0 0x7f13640cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7f1363fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f136415e7a0 0x7f13640cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43714/0 (socket says 172.21.15.113:43714) 2023-12-19T13:46:45.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7f1363fff640 1 -- 172.21.15.113:0/2319056365 learned_addr learned my addr 172.21.15.113:0/2319056365 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7f1369033640 1 --1- 172.21.15.113:0/2319056365 >> v1:172.21.15.151:6789/0 conn(0x7f13640ce1e0 0x7f136415efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:59142/0 (socket says 172.21.15.113:59142) 2023-12-19T13:46:45.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.228+0000 7f1368832640 1 --1- 172.21.15.113:0/2319056365 >> v1:172.21.15.113:6789/0 conn(0x7f13640d01b0 0x7f13640d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59468/0 (socket says 172.21.15.113:59468) 2023-12-19T13:46:45.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.229+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1718005250 con 0x7f17340ce110 2023-12-19T13:46:45.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.229+0000 7fc1b6069640 1 -- 172.21.15.113:0/3117123860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b0161660 msgr2=0x7fc1b0166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.229+0000 7fc1b6069640 1 --2- 172.21.15.113:0/3117123860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b0161660 0x7fc1b0166050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009a00 tx=0x7fc1a002bb50 comp rx=0 tx=0).stop 2023-12-19T13:46:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.230+0000 7fc1b6069640 1 -- 172.21.15.113:0/3117123860 shutdown_connections 2023-12-19T13:46:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.230+0000 7fc1b6069640 1 --2- 172.21.15.113:0/3117123860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.230+0000 7fc1b6069640 1 --2- 172.21.15.113:0/3117123860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b0161660 0x7fc1b0166050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.230+0000 7fc1b6069640 1 -- 172.21.15.113:0/3117123860 >> 172.21.15.113:0/3117123860 conn(0x7fc1b00cbb70 msgr2=0x7fc1b00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.230+0000 7fc1b6069640 1 -- 172.21.15.113:0/3117123860 shutdown_connections 2023-12-19T13:46:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.230+0000 7fc1b6069640 1 -- 172.21.15.113:0/3117123860 wait complete. 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.229+0000 7f1363fff640 1 -- 172.21.15.113:0/2319056365 >> v1:172.21.15.151:6789/0 conn(0x7f13640ce1e0 legacy=0x7f136415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.229+0000 7f1363fff640 1 -- 172.21.15.113:0/2319056365 >> v1:172.21.15.113:6789/0 conn(0x7f13640d01b0 legacy=0x7f13640d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.229+0000 7f1363fff640 1 -- 172.21.15.113:0/2319056365 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136415dfa0 con 0x7f136415e7a0 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.231+0000 7f1363fff640 1 --2- 172.21.15.113:0/2319056365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f13640cdca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f13540097f0 tx=0x7f135402b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613f68a38ee195c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.232+0000 7f13637fe640 1 -- 172.21.15.113:0/2319056365 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354031760 con 0x7f136415e7a0 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.232+0000 7f13637fe640 1 -- 172.21.15.113:0/2319056365 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540318c0 con 0x7f136415e7a0 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.232+0000 7f13637fe640 1 -- 172.21.15.113:0/2319056365 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354031c50 con 0x7f136415e7a0 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.232+0000 7f172affd640 1 -- 172.21.15.113:0/3540290846 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f171c024420 con 0x7f17340ce110 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.233+0000 7f172affd640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f171406a500 0x7f171406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.233+0000 7f172affd640 1 -- 172.21.15.113:0/3540290846 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f171c088bf0 con 0x7f17340ce110 2023-12-19T13:46:45.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.233+0000 7f136aa96640 1 -- 172.21.15.113:0/2319056365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 msgr2=0x7f13640cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.233+0000 7f136aa96640 1 --2- 172.21.15.113:0/2319056365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f13640cdca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f13540097f0 tx=0x7f135402b800 comp rx=0 tx=0).stop 2023-12-19T13:46:45.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.234+0000 7f136aa96640 1 -- 172.21.15.113:0/2319056365 shutdown_connections 2023-12-19T13:46:45.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.234+0000 7f136aa96640 1 --2- 172.21.15.113:0/2319056365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f13640cdca0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.234+0000 7f136aa96640 1 -- 172.21.15.113:0/2319056365 >> 172.21.15.113:0/2319056365 conn(0x7f13640b27a0 msgr2=0x7f13640b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.234+0000 7f1731d9b640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f171406a500 0x7f171406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.234+0000 7f136aa96640 1 -- 172.21.15.113:0/2319056365 shutdown_connections 2023-12-19T13:46:45.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.234+0000 7fc1b6069640 1 Processor -- start 2023-12-19T13:46:45.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.235+0000 7fc1b6069640 1 -- start start 2023-12-19T13:46:45.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.235+0000 7f2876eca640 1 Processor -- start 2023-12-19T13:46:45.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.235+0000 7f1731d9b640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f171406a500 0x7f171406c9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1724009e50 tx=0x7f1724030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.235+0000 7f2876eca640 1 -- start start 2023-12-19T13:46:45.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.234+0000 7f136aa96640 1 -- 172.21.15.113:0/2319056365 wait complete. 2023-12-19T13:46:45.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f136aa96640 1 Processor -- start 2023-12-19T13:46:45.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7fc1b6069640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b00afa50 0x7fc1b006c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f136aa96640 1 -- start start 2023-12-19T13:46:45.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7fc1b6069640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b0161660 0x7fc1b0155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f2876eca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2870161660 0x7f2870166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f2876eca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28700afa50 0x7f2870162910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f2876eca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2870161a40 0x7f28700b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f2876eca640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2870165bc0 con 0x7f2870161a40 2023-12-19T13:46:45.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f2876eca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2870162e50 con 0x7f2870161660 2023-12-19T13:46:45.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7f2876eca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287006e520 con 0x7f28700afa50 2023-12-19T13:46:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7fc1b6069640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b01fa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.237+0000 7fc1af7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b00afa50 0x7fc1b006c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7fc1b6069640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b006b730 con 0x7fc1b00afa50 2023-12-19T13:46:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7fc1b6069640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01fb080 con 0x7fc1b0161660 2023-12-19T13:46:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7fc1b6069640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01fb360 con 0x7fc1b0161a40 2023-12-19T13:46:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7f2875467640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2870161a40 0x7f28700b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7f2875467640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2870161a40 0x7f28700b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43734/0 (socket says 172.21.15.113:43734) 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7f2875467640 1 -- 172.21.15.113:0/3681420907 learned_addr learned my addr 172.21.15.113:0/3681420907 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7f2874c66640 1 --2- 172.21.15.113:0/3681420907 >> v2:172.21.15.151:3300/0 conn(0x7f2870161660 0x7f2870166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7f286ffff640 1 --2- 172.21.15.113:0/3681420907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28700afa50 0x7f2870162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7fc1af7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b00afa50 0x7fc1b006c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43722/0 (socket says 172.21.15.113:43722) 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7fc1af7fe640 1 -- 172.21.15.113:0/2246085368 learned_addr learned my addr 172.21.15.113:0/2246085368 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7fc1aeffd640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b0161660 0x7fc1b0155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.238+0000 7fc1affff640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b01fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f136aa96640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640ce1e0 0x7f13641570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7fc1aeffd640 1 -- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 msgr2=0x7fc1b01fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7fc1aeffd640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b01fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7fc1aeffd640 1 -- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b00afa50 msgr2=0x7fc1b006c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7fc1aeffd640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b00afa50 0x7fc1b006c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7fc1aeffd640 1 -- 172.21.15.113:0/2246085368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0009400 con 0x7fc1b0161660 2023-12-19T13:46:45.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f136aa96640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640d01b0 0x7f136415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f136aa96640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f136415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f136aa96640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1364200080 con 0x7f136415e7a0 2023-12-19T13:46:45.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f136aa96640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13641f64f0 con 0x7f13640ce1e0 2023-12-19T13:46:45.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f136aa96640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136415a730 con 0x7f13640d01b0 2023-12-19T13:46:45.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f1369033640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f136415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f1369033640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f136415b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43740/0 (socket says 172.21.15.113:43740) 2023-12-19T13:46:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f1369033640 1 -- 172.21.15.113:0/2809368945 learned_addr learned my addr 172.21.15.113:0/2809368945 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f1368832640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640ce1e0 0x7f13641570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f1363fff640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640d01b0 0x7f136415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7fc1aeffd640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b0161660 0x7fc1b0155bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c450 tx=0x7fc1a400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f1369033640 1 -- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640d01b0 msgr2=0x7f136415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f1369033640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640d01b0 0x7f136415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f1369033640 1 -- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640ce1e0 msgr2=0x7f13641570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f1369033640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640ce1e0 0x7f13641570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f1369033640 1 -- 172.21.15.113:0/2809368945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540094d0 con 0x7f136415e7a0 2023-12-19T13:46:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f2875467640 1 -- 172.21.15.113:0/3681420907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28700afa50 msgr2=0x7f2870162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f2875467640 1 --2- 172.21.15.113:0/3681420907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28700afa50 0x7f2870162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f2875467640 1 -- 172.21.15.113:0/3681420907 >> v2:172.21.15.151:3300/0 conn(0x7f2870161660 msgr2=0x7f2870166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f2875467640 1 --2- 172.21.15.113:0/3681420907 >> v2:172.21.15.151:3300/0 conn(0x7f2870161660 0x7f2870166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.239+0000 7f2875467640 1 -- 172.21.15.113:0/3681420907 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700afef0 con 0x7f2870161a40 2023-12-19T13:46:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.240+0000 7f855a0df640 1 Processor -- start 2023-12-19T13:46:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.241+0000 7f855a0df640 1 -- start start 2023-12-19T13:46:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.241+0000 7f2875467640 1 --2- 172.21.15.113:0/3681420907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2870161a40 0x7f28700b01b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28700cf010 tx=0x7f286802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79384221541c06c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.241+0000 7f286f7fe640 1 -- 172.21.15.113:0/3681420907 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286802ca80 con 0x7f2870161a40 2023-12-19T13:46:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.241+0000 7f286f7fe640 1 -- 172.21.15.113:0/3681420907 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286802cbe0 con 0x7f2870161a40 2023-12-19T13:46:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.241+0000 7f286f7fe640 1 -- 172.21.15.113:0/3681420907 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680343f0 con 0x7f2870161a40 2023-12-19T13:46:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.241+0000 7f1369033640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f136415b220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f135800c750 tx=0x7f135800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.241+0000 7f13617fa640 1 -- 172.21.15.113:0/2809368945 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13580072d0 con 0x7f136415e7a0 2023-12-19T13:46:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.242+0000 7f13617fa640 1 -- 172.21.15.113:0/2809368945 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358007430 con 0x7f136415e7a0 2023-12-19T13:46:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.242+0000 7f13617fa640 1 -- 172.21.15.113:0/2809368945 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13580047e0 con 0x7f136415e7a0 2023-12-19T13:46:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.242+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136415a450 con 0x7f136415e7a0 2023-12-19T13:46:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.242+0000 7f2876eca640 1 -- 172.21.15.113:0/3681420907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2870161a40 msgr2=0x7f28700b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.242+0000 7f2876eca640 1 --2- 172.21.15.113:0/3681420907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2870161a40 0x7f28700b01b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28700cf010 tx=0x7f286802bee0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.242+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136406bf60 con 0x7f136415e7a0 2023-12-19T13:46:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.242+0000 7f2876eca640 1 -- 172.21.15.113:0/3681420907 shutdown_connections 2023-12-19T13:46:45.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f855a0df640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f85540d01b0 0x7f855415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f855a0df640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415efa0 0x7f855415f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f855a0df640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855415ece0 con 0x7f85540d0590 2023-12-19T13:46:45.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f855a0df640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540ce9d0 con 0x7f85540d01b0 2023-12-19T13:46:45.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f855a0df640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540ce6f0 con 0x7f855415efa0 2023-12-19T13:46:45.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f2876eca640 1 --2- 172.21.15.113:0/3681420907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2870161a40 0x7f28700b01b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f2876eca640 1 --2- 172.21.15.113:0/3681420907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28700afa50 0x7f2870162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f2876eca640 1 --2- 172.21.15.113:0/3681420907 >> v2:172.21.15.151:3300/0 conn(0x7f2870161660 0x7f2870166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f2876eca640 1 -- 172.21.15.113:0/3681420907 >> 172.21.15.113:0/3681420907 conn(0x7f28700cbb70 msgr2=0x7f28700cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f2876eca640 1 -- 172.21.15.113:0/3681420907 shutdown_connections 2023-12-19T13:46:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f854affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f85540d0590 0x7f85540cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59474/0 (socket says 172.21.15.113:59474) 2023-12-19T13:46:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f854affd640 1 -- 172.21.15.113:0/1846365154 learned_addr learned my addr 172.21.15.113:0/1846365154 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7fa97c4f7640 1 Processor -- start 2023-12-19T13:46:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7fa97c4f7640 1 -- start start 2023-12-19T13:46:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.243+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1364061910 con 0x7f136415e7a0 2023-12-19T13:46:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f85537fe640 1 --2- 172.21.15.113:0/1846365154 >> v2:172.21.15.151:3300/0 conn(0x7f85540d01b0 0x7f855415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8553fff640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415efa0 0x7f855415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f2876eca640 1 -- 172.21.15.113:0/3681420907 wait complete. 2023-12-19T13:46:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294149698 0 0) 0x7f855415ece0 con 0x7f85540d0590 2023-12-19T13:46:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540003520 con 0x7f85540d0590 2023-12-19T13:46:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f3a05c54640 1 Processor -- start 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629238863 0 0) 0x7f8540003520 con 0x7f85540d0590 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415efa0 msgr2=0x7f855415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415efa0 0x7f855415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 >> v2:172.21.15.151:3300/0 conn(0x7f85540d01b0 msgr2=0x7f855415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 --2- 172.21.15.113:0/1846365154 >> v2:172.21.15.151:3300/0 conn(0x7f85540d01b0 0x7f855415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855415dcc0 con 0x7f85540d0590 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f853c001670 con 0x7f85540d0590 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 >> v1:172.21.15.113:6789/0 conn(0x7f85540d0590 legacy=0x7f85540cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85400039e0 0x7f8540003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85400047c0 0x7f8540004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f8552ffd640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540005180 0x7f854000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.245+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540ce9d0 con 0x7f85400039e0 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.245+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540ce6f0 con 0x7f8540005180 2023-12-19T13:46:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.245+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854000bec0 con 0x7f85400047c0 2023-12-19T13:46:45.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.244+0000 7f3a05c54640 1 -- start start 2023-12-19T13:46:45.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.245+0000 7f85537fe640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85400039e0 0x7f8540003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7f85537fe640 1 -- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85400047c0 msgr2=0x7f8540004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7f85537fe640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85400047c0 0x7f8540004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7f85537fe640 1 -- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540005180 msgr2=0x7f854000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7fa97c4f7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa9740d03d0 0x7fa9740b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7fa97c4f7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa9740d07b0 0x7fa97414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7fa97c4f7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9740d3150 con 0x7fa9740b59a0 2023-12-19T13:46:45.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7fa97c4f7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9740cf4a0 con 0x7fa9740d03d0 2023-12-19T13:46:45.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7fa97c4f7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9740d2bd0 con 0x7fa9740d07b0 2023-12-19T13:46:45.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7f13617fa640 1 -- 172.21.15.113:0/2809368945 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f135800a640 con 0x7f136415e7a0 2023-12-19T13:46:45.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7f2876eca640 1 Processor -- start 2023-12-19T13:46:45.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7f2876eca640 1 -- start start 2023-12-19T13:46:45.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7f85537fe640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540005180 0x7f854000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7f85537fe640 1 -- 172.21.15.113:0/1846365154 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855415dcc0 con 0x7f85400039e0 2023-12-19T13:46:45.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7fa97aa94640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa9740b59a0 0x7fa974165550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59482/0 (socket says 172.21.15.113:59482) 2023-12-19T13:46:45.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.246+0000 7fa97a293640 1 --2- 172.21.15.113:0/1809863581 >> v2:172.21.15.113:3300/0 conn(0x7fa9740d03d0 0x7fa9740b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7fa97aa94640 1 -- 172.21.15.113:0/1809863581 learned_addr learned my addr 172.21.15.113:0/1809863581 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:45.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7f3a05c54640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8038fb0 0x7f39f80543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7f3a05c54640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f39f8035cc0 0x7f39f8054e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7f3a05c54640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f8056b90 con 0x7f39f80e4740 2023-12-19T13:46:45.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7f3a05c54640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f80549f0 con 0x7f39f8035cc0 2023-12-19T13:46:45.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7f3a05c54640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f8036340 con 0x7f39f8038fb0 2023-12-19T13:46:45.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7fc197fff640 1 -- 172.21.15.113:0/2246085368 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40074e0 con 0x7fc1b0161660 2023-12-19T13:46:45.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f13617fa640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f135006a430 0x7f135006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f172affd640 1 -- 172.21.15.113:0/3540290846 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f171c054270 con 0x7f17340ce110 2023-12-19T13:46:45.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f85537fe640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85400039e0 0x7f8540003e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8544009fd0 tx=0x7f85400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e6cb503ac2015f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7fc197fff640 1 -- 172.21.15.113:0/2246085368 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4007640 con 0x7fc1b0161660 2023-12-19T13:46:45.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7fc197fff640 1 -- 172.21.15.113:0/2246085368 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4004a20 con 0x7fc1b0161660 2023-12-19T13:46:45.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b006b940 con 0x7fc1b0161660 2023-12-19T13:46:45.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.247+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b006c680 con 0x7fc1b0161660 2023-12-19T13:46:45.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7fa979a92640 1 --2- 172.21.15.113:0/1809863581 >> v2:172.21.15.151:3300/0 conn(0x7fa9740d07b0 0x7fa97414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7fa97a293640 1 -- 172.21.15.113:0/1809863581 >> v2:172.21.15.151:3300/0 conn(0x7fa9740d07b0 msgr2=0x7fa97414ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7fa97a293640 1 --2- 172.21.15.113:0/1809863581 >> v2:172.21.15.151:3300/0 conn(0x7fa9740d07b0 0x7fa97414ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f13617fa640 1 -- 172.21.15.113:0/2809368945 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13580880a0 con 0x7f136415e7a0 2023-12-19T13:46:45.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7fa97a293640 1 -- 172.21.15.113:0/1809863581 >> v1:172.21.15.113:6789/0 conn(0x7fa9740b59a0 legacy=0x7fa974165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f3a04c52640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f39f80e4740 0x7f39f80388a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:59148/0 (socket says 172.21.15.113:59148) 2023-12-19T13:46:45.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f39fffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8038fb0 0x7f39f80543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f3a04c52640 1 -- 172.21.15.113:0/964353337 learned_addr learned my addr 172.21.15.113:0/964353337 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:45.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.248+0000 7f3a05453640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f39f8035cc0 0x7f39f8054e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7f1368832640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f135006a430 0x7f135006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7fa97a293640 1 -- 172.21.15.113:0/1809863581 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9740cfbd0 con 0x7fa9740d03d0 2023-12-19T13:46:45.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7fa979a92640 1 --2- 172.21.15.113:0/1809863581 >> v2:172.21.15.151:3300/0 conn(0x7fa9740d07b0 0x7fa97414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:45.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc190005250 con 0x7fc1b0161660 2023-12-19T13:46:45.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7f39fffff640 1 -- 172.21.15.113:0/964353337 >> v2:172.21.15.113:3300/0 conn(0x7f39f8035cc0 msgr2=0x7f39f8054e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.250+0000 7f1368832640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f135006a430 0x7f135006c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f135c0012e0 tx=0x7f135c005b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7f39fffff640 1 --2- 172.21.15.113:0/964353337 >> v2:172.21.15.113:3300/0 conn(0x7f39f8035cc0 0x7f39f8054e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7f39fffff640 1 -- 172.21.15.113:0/964353337 >> v1:172.21.15.151:6789/0 conn(0x7f39f80e4740 legacy=0x7f39f80388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.249+0000 7f39fffff640 1 -- 172.21.15.113:0/964353337 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f8051720 con 0x7f39f8038fb0 2023-12-19T13:46:45.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.250+0000 7f2876eca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28700afa50 0x7f28700aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7f2876eca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2870161660 0x7f28700a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7f2876eca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2870161a40 0x7f2870160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7fc197fff640 1 -- 172.21.15.113:0/2246085368 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc1a4034b80 con 0x7fc1b0161660 2023-12-19T13:46:45.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7fa97a293640 1 --2- 172.21.15.113:0/1809863581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d03d0 0x7fa9740b4b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9700097d0 tx=0x7fa97002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7d599c37187198 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7f2876eca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287015a6f0 con 0x7f28700afa50 2023-12-19T13:46:45.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7f39fffff640 1 --2- 172.21.15.113:0/964353337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8038fb0 0x7f39f80543c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0097a0 tx=0x7f39ec02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8528216586b2ebf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7f2876eca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700a8cd0 con 0x7f2870161660 2023-12-19T13:46:45.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7f2874c66640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28700afa50 0x7f28700aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.251+0000 7f2876eca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700a8fb0 con 0x7f2870161a40 2023-12-19T13:46:45.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f2875467640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2870161a40 0x7f2870160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f2875467640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2870161a40 0x7f2870160490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:52006/0 (socket says 172.21.15.113:52006) 2023-12-19T13:46:45.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f2875467640 1 -- 172.21.15.113:0/2387259750 learned_addr learned my addr 172.21.15.113:0/2387259750 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f39ff7fe640 1 -- 172.21.15.113:0/964353337 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec02f050 con 0x7f39f8038fb0 2023-12-19T13:46:45.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f286ffff640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2870161660 0x7f28700a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f39ff7fe640 1 -- 172.21.15.113:0/964353337 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec031700 con 0x7f39f8038fb0 2023-12-19T13:46:45.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f39ff7fe640 1 -- 172.21.15.113:0/964353337 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec031a90 con 0x7f39f8038fb0 2023-12-19T13:46:45.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f2875467640 1 -- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2870161660 msgr2=0x7f28700a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f2875467640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2870161660 0x7f28700a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7fc197fff640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc19c06a430 0x7fc19c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.252+0000 7f2875467640 1 -- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28700afa50 msgr2=0x7f28700aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f2875467640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28700afa50 0x7f28700aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f2875467640 1 -- 172.21.15.113:0/2387259750 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009b30 con 0x7f2870161a40 2023-12-19T13:46:45.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f2874c66640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28700afa50 0x7f28700aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:46:45.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f3a05c54640 1 -- 172.21.15.113:0/964353337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8038fb0 msgr2=0x7f39f80543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f3a05c54640 1 --2- 172.21.15.113:0/964353337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8038fb0 0x7f39f80543c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0097a0 tx=0x7f39ec02b7a0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854402ccb0 con 0x7f85400039e0 2023-12-19T13:46:45.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7fa979291640 1 -- 172.21.15.113:0/1809863581 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970031830 con 0x7fa9740d03d0 2023-12-19T13:46:45.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400f040 con 0x7f85400039e0 2023-12-19T13:46:45.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f8552ffd640 1 -- 172.21.15.113:0/1846365154 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544034660 con 0x7f85400039e0 2023-12-19T13:46:45.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7fa979291640 1 -- 172.21.15.113:0/1809863581 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970031990 con 0x7fa9740d03d0 2023-12-19T13:46:45.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7fa979291640 1 -- 172.21.15.113:0/1809863581 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970031d20 con 0x7fa9740d03d0 2023-12-19T13:46:45.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f3a05c54640 1 -- 172.21.15.113:0/964353337 shutdown_connections 2023-12-19T13:46:45.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f3a05c54640 1 --2- 172.21.15.113:0/964353337 >> v2:172.21.15.113:3300/0 conn(0x7f39f8035cc0 0x7f39f8054e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f3a05c54640 1 --2- 172.21.15.113:0/964353337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8038fb0 0x7f39f80543c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f3a05c54640 1 -- 172.21.15.113:0/964353337 >> 172.21.15.113:0/964353337 conn(0x7f39f80538a0 msgr2=0x7f39f8053cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7f13617fa640 1 -- 172.21.15.113:0/2809368945 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1358053720 con 0x7f136415e7a0 2023-12-19T13:46:45.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f3a05c54640 1 -- 172.21.15.113:0/964353337 shutdown_connections 2023-12-19T13:46:45.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f2875467640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2870161a40 0x7f2870160490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2868036040 tx=0x7f2868004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f855a0df640 1 -- 172.21.15.113:0/1846365154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85400039e0 msgr2=0x7f8540003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.253+0000 7fc197fff640 1 -- 172.21.15.113:0/2246085368 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a4087980 con 0x7fc1b0161660 2023-12-19T13:46:45.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1809863581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d03d0 msgr2=0x7fa9740b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1809863581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d03d0 0x7fa9740b4b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9700097d0 tx=0x7fa97002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f855a0df640 1 --2- 172.21.15.113:0/1846365154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85400039e0 0x7f8540003e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8544009fd0 tx=0x7f85400057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f8553fff640 1 -- 172.21.15.113:0/1846365154 reap_dead start 2023-12-19T13:46:45.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f855a0df640 1 -- 172.21.15.113:0/1846365154 shutdown_connections 2023-12-19T13:46:45.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f855a0df640 1 -- 172.21.15.113:0/1846365154 >> 172.21.15.113:0/1846365154 conn(0x7f85540b27a0 msgr2=0x7f85540b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7f3a05c54640 1 -- 172.21.15.113:0/964353337 wait complete. 2023-12-19T13:46:45.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.254+0000 7fc1af7fe640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc19c06a430 0x7fc19c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1809863581 shutdown_connections 2023-12-19T13:46:45.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1809863581 >> v2:172.21.15.151:3300/0 conn(0x7fa9740d07b0 0x7fa97414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1809863581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d03d0 0x7fa9740b4b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1809863581 >> 172.21.15.113:0/1809863581 conn(0x7fa9740b27a0 msgr2=0x7fa9740b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7f855a0df640 1 -- 172.21.15.113:0/1846365154 shutdown_connections 2023-12-19T13:46:45.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7f855a0df640 1 -- 172.21.15.113:0/1846365154 wait complete. 2023-12-19T13:46:45.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7fc1af7fe640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc19c06a430 0x7fc19c06c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1a002bb90 tx=0x7fc1a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.255+0000 7f286d7fa640 1 -- 172.21.15.113:0/2387259750 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868007ea0 con 0x7f2870161a40 2023-12-19T13:46:45.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.256+0000 7f286d7fa640 1 -- 172.21.15.113:0/2387259750 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286803e450 con 0x7f2870161a40 2023-12-19T13:46:45.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.256+0000 7f286d7fa640 1 -- 172.21.15.113:0/2387259750 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286803e800 con 0x7f2870161a40 2023-12-19T13:46:45.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.256+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1809863581 shutdown_connections 2023-12-19T13:46:45.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.256+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28700a9290 con 0x7f2870161a40 2023-12-19T13:46:45.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.257+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700a9850 con 0x7f2870161a40 2023-12-19T13:46:45.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.256+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1809863581 wait complete. 2023-12-19T13:46:45.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.257+0000 7f3a05c54640 1 Processor -- start 2023-12-19T13:46:45.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.257+0000 7f3a05c54640 1 -- start start 2023-12-19T13:46:45.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.258+0000 7fa97c4f7640 1 Processor -- start 2023-12-19T13:46:45.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.258+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870061910 con 0x7f2870161a40 2023-12-19T13:46:45.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.258+0000 7fa97c4f7640 1 -- start start 2023-12-19T13:46:45.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.259+0000 7f855a0df640 1 Processor -- start 2023-12-19T13:46:45.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.259+0000 7fa97c4f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9740b59a0 0x7fa9741f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.259+0000 7fa97c4f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9740d03d0 0x7fa974163a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7f3a05c54640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8035cc0 0x7f39f80dde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.259+0000 7fa97c4f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d07b0 0x7fa9741f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.259+0000 7fa97c4f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97413fae0 con 0x7fa9740d07b0 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.259+0000 7fa97c4f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9741f8a30 con 0x7fa9740d03d0 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.259+0000 7fa97c4f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97413fd30 con 0x7fa9740b59a0 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d07b0 0x7fa9741f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97a293640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9740b59a0 0x7fa9741f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d07b0 0x7fa9741f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43790/0 (socket says 172.21.15.113:43790) 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 -- 172.21.15.113:0/1587744137 learned_addr learned my addr 172.21.15.113:0/1587744137 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa979a92640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9740d03d0 0x7fa974163a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7f855a0df640 1 -- start start 2023-12-19T13:46:45.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7f3a05c54640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39f8038fb0 0x7f39f80dae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 -- 172.21.15.113:0/1587744137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9740b59a0 msgr2=0x7fa9741f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9740b59a0 0x7fa9741f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 -- 172.21.15.113:0/1587744137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9740d03d0 msgr2=0x7fa974163a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9740d03d0 0x7fa974163a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7fa97aa94640 1 -- 172.21.15.113:0/1587744137 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009400 con 0x7fa9740d07b0 2023-12-19T13:46:45.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7f3a05c54640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f80e4740 0x7f39f80d9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7f3a04c52640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8035cc0 0x7f39f80dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7f3a04c52640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8035cc0 0x7f39f80dde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:52016/0 (socket says 172.21.15.113:52016) 2023-12-19T13:46:45.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7fa97aa94640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d07b0 0x7fa9741f79d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa96400c3c0 tx=0x7fa96400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7fa96affd640 1 -- 172.21.15.113:0/1587744137 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964005ce0 con 0x7fa9740d07b0 2023-12-19T13:46:45.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7fa96affd640 1 -- 172.21.15.113:0/1587744137 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964005e40 con 0x7fa9740d07b0 2023-12-19T13:46:45.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7fa96affd640 1 -- 172.21.15.113:0/1587744137 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9640072f0 con 0x7fa9740d07b0 2023-12-19T13:46:45.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7f3a04c52640 1 -- 172.21.15.113:0/768127504 learned_addr learned my addr 172.21.15.113:0/768127504 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f8049dc0 con 0x7f39f8038fb0 2023-12-19T13:46:45.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80deda0 con 0x7f39f80e4740 2023-12-19T13:46:45.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.260+0000 7f286d7fa640 1 -- 172.21.15.113:0/2387259750 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f286802cd50 con 0x7f2870161a40 2023-12-19T13:46:45.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.261+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa974140010 con 0x7fa9740d07b0 2023-12-19T13:46:45.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9741405d0 con 0x7fa9740d07b0 2023-12-19T13:46:45.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f855a0df640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855415b4f0 0x7f855414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f855a0df640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415b8d0 0x7f8554150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f803bda0 con 0x7f39f8035cc0 2023-12-19T13:46:45.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f3a05453640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f80e4740 0x7f39f80d9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f286d7fa640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285406a430 0x7f285406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f39fffff640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39f8038fb0 0x7f39f80dae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f855a0df640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85541515f0 0x7f8554159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f286d7fa640 1 -- 172.21.15.113:0/2387259750 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28680ab6a0 con 0x7f2870161a40 2023-12-19T13:46:45.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f2874c66640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285406a430 0x7f285406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f855a0df640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85541509a0 con 0x7f85541515f0 2023-12-19T13:46:45.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.262+0000 7f855a0df640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540b79c0 con 0x7f855415b4f0 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f855a0df640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554158aa0 con 0x7f855415b8d0 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f854affd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415b8d0 0x7f8554150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f8553fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85541515f0 0x7f8554159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f8553fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85541515f0 0x7f8554159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43808/0 (socket says 172.21.15.113:43808) 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f8553fff640 1 -- 172.21.15.113:0/4062895312 learned_addr learned my addr 172.21.15.113:0/4062895312 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f85537fe640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855415b4f0 0x7f855414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f39fffff640 1 -- 172.21.15.113:0/768127504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8035cc0 msgr2=0x7f39f80dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f39fffff640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8035cc0 0x7f39f80dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f39fffff640 1 -- 172.21.15.113:0/768127504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f80e4740 msgr2=0x7f39f80d9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f39fffff640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f80e4740 0x7f39f80d9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.263+0000 7f39fffff640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec009400 con 0x7f39f8038fb0 2023-12-19T13:46:45.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9741407f0 con 0x7fa9740d07b0 2023-12-19T13:46:45.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f39fffff640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39f8038fb0 0x7f39f80dae60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39ec033000 tx=0x7f39ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f8553fff640 1 -- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415b8d0 msgr2=0x7f8554150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f8553fff640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415b8d0 0x7f8554150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f8553fff640 1 -- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855415b4f0 msgr2=0x7f855414ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f8553fff640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855415b4f0 0x7f855414ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f8553fff640 1 -- 172.21.15.113:0/4062895312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554158d80 con 0x7f85541515f0 2023-12-19T13:46:45.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f85537fe640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855415b4f0 0x7f855414ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:45.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.264+0000 7f39fd7fa640 1 -- 172.21.15.113:0/768127504 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec033bb0 con 0x7f39f8038fb0 2023-12-19T13:46:45.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.265+0000 7f8553fff640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85541515f0 0x7f8554159860 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f854c000c00 tx=0x7f854c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.265+0000 7f39fd7fa640 1 -- 172.21.15.113:0/768127504 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec033d10 con 0x7f39f8038fb0 2023-12-19T13:46:45.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.265+0000 7f39fd7fa640 1 -- 172.21.15.113:0/768127504 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec033bb0 con 0x7f39f8038fb0 2023-12-19T13:46:45.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.265+0000 7f2874c66640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285406a430 0x7f285406c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2864009f80 tx=0x7f2864009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.265+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f803bac0 con 0x7f39f8038fb0 2023-12-19T13:46:45.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.265+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f80daae0 con 0x7f39f8038fb0 2023-12-19T13:46:45.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.266+0000 7f8550ff9640 1 -- 172.21.15.113:0/4062895312 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c004030 con 0x7f85541515f0 2023-12-19T13:46:45.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.266+0000 7f8550ff9640 1 -- 172.21.15.113:0/4062895312 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c004190 con 0x7f85541515f0 2023-12-19T13:46:45.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.266+0000 7f8550ff9640 1 -- 172.21.15.113:0/4062895312 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00c680 con 0x7f85541515f0 2023-12-19T13:46:45.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.266+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8554159060 con 0x7f85541515f0 2023-12-19T13:46:45.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.266+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8554159da0 con 0x7f85541515f0 2023-12-19T13:46:45.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.267+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8554159580 con 0x7f85541515f0 2023-12-19T13:46:45.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.268+0000 7fa96affd640 1 -- 172.21.15.113:0/1587744137 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa964007450 con 0x7fa9740d07b0 2023-12-19T13:46:45.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.267+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f80def60 con 0x7f39f8038fb0 2023-12-19T13:46:45.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.269+0000 7f39fd7fa640 1 -- 172.21.15.113:0/768127504 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39ec03a040 con 0x7f39f8038fb0 2023-12-19T13:46:45.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.269+0000 7f8550ff9640 1 -- 172.21.15.113:0/4062895312 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f854c00c7e0 con 0x7f85541515f0 2023-12-19T13:46:45.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.269+0000 7fc197fff640 1 -- 172.21.15.113:0/2246085368 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc1a4053000 con 0x7fc1b0161660 2023-12-19T13:46:45.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.270+0000 7fa96affd640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa96006a4b0 0x7fa96006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.270+0000 7fa96affd640 1 -- 172.21.15.113:0/1587744137 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa964087cc0 con 0x7fa9740d07b0 2023-12-19T13:46:45.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.270+0000 7f8550ff9640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f853406a480 0x7f853406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.271+0000 7f8550ff9640 1 -- 172.21.15.113:0/4062895312 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f854c087c00 con 0x7f85541515f0 2023-12-19T13:46:45.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.270+0000 7f39fd7fa640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f39e406a490 0x7f39e406c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.270+0000 7f39fd7fa640 1 -- 172.21.15.113:0/768127504 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39ec0a9990 con 0x7f39f8038fb0 2023-12-19T13:46:45.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.271+0000 7fa97a293640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa96006a4b0 0x7fa96006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.271+0000 7f3a04c52640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f39e406a490 0x7f39e406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.272+0000 7f85537fe640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f853406a480 0x7f853406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.272+0000 7fa97a293640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa96006a4b0 0x7fa96006c970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa970036000 tx=0x7fa97003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.273+0000 7f286d7fa640 1 -- 172.21.15.113:0/2387259750 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2868076d80 con 0x7f2870161a40 2023-12-19T13:46:45.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.273+0000 7f3a04c52640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f39e406a490 0x7f39e406c950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005880 tx=0x7f39f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.273+0000 7f85537fe640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f853406a480 0x7f853406c940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8544036000 tx=0x7f854402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.276+0000 7fa96affd640 1 -- 172.21.15.113:0/1587744137 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa9640534d0 con 0x7fa9740d07b0 2023-12-19T13:46:45.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.285+0000 7f8550ff9640 1 -- 172.21.15.113:0/4062895312 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8554159580 con 0x7f85541515f0 2023-12-19T13:46:45.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.294+0000 7f39fd7fa640 1 -- 172.21.15.113:0/768127504 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f39ec074ee0 con 0x7f39f8038fb0 2023-12-19T13:46:45.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.610+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f50e806c250 con 0x7f50e8159320 2023-12-19T13:46:45.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.611+0000 7f50de7fc640 1 -- 172.21.15.113:0/2634741579 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50e806c250 con 0x7f50e8159320 2023-12-19T13:46:45.612 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:45.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.614+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f50cc06a460 msgr2=0x7f50cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.614+0000 7f50efc8f640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f50cc06a460 0x7f50cc06c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50e00012e0 tx=0x7f50e0009040 comp rx=0 tx=0).stop 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50e8159320 msgr2=0x7f50e81512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50e8159320 0x7f50e81512c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50e40098c0 tx=0x7f50e40046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 shutdown_connections 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f50cc06a460 0x7f50cc06c920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50e8159320 0x7f50e81512c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50e80cb180 0x7f50e806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 --2- 172.21.15.113:0/2634741579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50e80b0bf0 0x7f50e814cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.615+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 >> 172.21.15.113:0/2634741579 conn(0x7f50e80b4300 msgr2=0x7f50e8157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.616+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 shutdown_connections 2023-12-19T13:46:45.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.616+0000 7f50efc8f640 1 -- 172.21.15.113:0/2634741579 wait complete. 2023-12-19T13:46:45.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-12-19T13:46:45.646 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.666+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17180057d0 con 0x7f17340ce110 2023-12-19T13:46:45.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.667+0000 7f172affd640 1 -- 172.21.15.113:0/3540290846 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f171c016070 con 0x7f17340ce110 2023-12-19T13:46:45.668 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2023-12-19T13:46:45.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.668+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f13640d31b0 con 0x7f136415e7a0 2023-12-19T13:46:45.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.669+0000 7f13617fa640 1 -- 172.21.15.113:0/2809368945 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1358021090 con 0x7f136415e7a0 2023-12-19T13:46:45.670 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:45.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.670+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f171406a500 msgr2=0x7f171406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.670+0000 7f1738d81640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f171406a500 0x7f171406c9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1724009e50 tx=0x7f1724030000 comp rx=0 tx=0).stop 2023-12-19T13:46:45.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.670+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17340ce110 msgr2=0x7f173413e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.670+0000 7f1738d81640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17340ce110 0x7f173413e480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c460 tx=0x7f171c00c920 comp rx=0 tx=0).stop 2023-12-19T13:46:45.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.671+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 shutdown_connections 2023-12-19T13:46:45.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.671+0000 7f1738d81640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f171406a500 0x7f171406c9c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.671+0000 7f1738d81640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1734146e10 0x7f1734143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.671+0000 7f1738d81640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17340d2b00 0x7f173413cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.671+0000 7f1738d81640 1 --2- 172.21.15.113:0/3540290846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17340ce110 0x7f173413e480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.671+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 >> 172.21.15.113:0/3540290846 conn(0x7f17340b29c0 msgr2=0x7f17340b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.671+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 shutdown_connections 2023-12-19T13:46:45.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.672+0000 7f1738d81640 1 -- 172.21.15.113:0/3540290846 wait complete. 2023-12-19T13:46:45.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f135006a430 msgr2=0x7f135006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f135006a430 0x7f135006c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f135c0012e0 tx=0x7f135c005b90 comp rx=0 tx=0).stop 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 msgr2=0x7f136415b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f136415b220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f135800c750 tx=0x7f135800cc10 comp rx=0 tx=0).stop 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 shutdown_connections 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f135006a430 0x7f135006c8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f136415e7a0 0x7f136415b220 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640d01b0 0x7f136415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 --2- 172.21.15.113:0/2809368945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640ce1e0 0x7f13641570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 >> 172.21.15.113:0/2809368945 conn(0x7f13640b27a0 msgr2=0x7f136415f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 shutdown_connections 2023-12-19T13:46:45.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.673+0000 7f136aa96640 1 -- 172.21.15.113:0/2809368945 wait complete. 2023-12-19T13:46:45.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.675+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f39f80058e0 con 0x7f39f8038fb0 2023-12-19T13:46:45.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.676+0000 7f39fd7fa640 1 -- 172.21.15.113:0/768127504 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39ec038090 con 0x7f39f8038fb0 2023-12-19T13:46:45.677 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:45.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.678+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f39e406a490 msgr2=0x7f39e406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.678+0000 7f3a05c54640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f39e406a490 0x7f39e406c950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005880 tx=0x7f39f4009040 comp rx=0 tx=0).stop 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.678+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39f8038fb0 msgr2=0x7f39f80dae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.678+0000 7f3a05c54640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39f8038fb0 0x7f39f80dae60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39ec033000 tx=0x7f39ec0046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 shutdown_connections 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f39e406a490 0x7f39e406c950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f80e4740 0x7f39f80d9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39f8038fb0 0x7f39f80dae60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 --2- 172.21.15.113:0/768127504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f8035cc0 0x7f39f80dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 >> 172.21.15.113:0/768127504 conn(0x7f39f80538a0 msgr2=0x7f39f8008920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 shutdown_connections 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.679+0000 7f3a05c54640 1 -- 172.21.15.113:0/768127504 wait complete. 2023-12-19T13:46:45.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.680+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc1900057d0 con 0x7fc1b0161660 2023-12-19T13:46:45.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.681+0000 7fc197fff640 1 -- 172.21.15.113:0/2246085368 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1a4018090 con 0x7fc1b0161660 2023-12-19T13:46:45.682 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:45.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.684+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc19c06a430 msgr2=0x7fc19c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.684+0000 7fc1b6069640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc19c06a430 0x7fc19c06c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1a002bb90 tx=0x7fc1a0008030 comp rx=0 tx=0).stop 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.684+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b0161660 msgr2=0x7fc1b0155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.684+0000 7fc1b6069640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b0161660 0x7fc1b0155bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c450 tx=0x7fc1a400c910 comp rx=0 tx=0).stop 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 shutdown_connections 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc19c06a430 0x7fc19c06c8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0161a40 0x7fc1b01fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b0161660 0x7fc1b0155bb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 --2- 172.21.15.113:0/2246085368 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b00afa50 0x7fc1b006c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 >> 172.21.15.113:0/2246085368 conn(0x7fc1b00cbb70 msgr2=0x7fc1b01620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 shutdown_connections 2023-12-19T13:46:45.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.685+0000 7fc1b6069640 1 -- 172.21.15.113:0/2246085368 wait complete. 2023-12-19T13:46:45.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.692+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f28700a90f0 con 0x7f2870161a40 2023-12-19T13:46:45.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.692+0000 7f286d7fa640 1 -- 172.21.15.113:0/2387259750 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2868043020 con 0x7f2870161a40 2023-12-19T13:46:45.693 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:45.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285406a430 msgr2=0x7f285406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285406a430 0x7f285406c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2864009f80 tx=0x7f2864009190 comp rx=0 tx=0).stop 2023-12-19T13:46:45.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2870161a40 msgr2=0x7f2870160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2870161a40 0x7f2870160490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2868036040 tx=0x7f2868004a40 comp rx=0 tx=0).stop 2023-12-19T13:46:45.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 shutdown_connections 2023-12-19T13:46:45.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285406a430 0x7f285406c8f0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2864009f80 tx=0x7f2864009190 comp rx=0 tx=0).stop 2023-12-19T13:46:45.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2870161a40 0x7f2870160490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2870161660 0x7f28700a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 --2- 172.21.15.113:0/2387259750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28700afa50 0x7f28700aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.696+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 >> 172.21.15.113:0/2387259750 conn(0x7f28700cbb70 msgr2=0x7f2870164790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.697+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 shutdown_connections 2023-12-19T13:46:45.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.697+0000 7f2876eca640 1 -- 172.21.15.113:0/2387259750 wait complete. 2023-12-19T13:46:45.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-12-19T13:46:45.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.700+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8554159580 con 0x7f85541515f0 2023-12-19T13:46:45.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.700+0000 7f8550ff9640 1 -- 172.21.15.113:0/4062895312 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f854c01a020 con 0x7f85541515f0 2023-12-19T13:46:45.702 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.702 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:45.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-19T13:46:45.704 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-12-19T13:46:45.705 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f853406a480 msgr2=0x7f853406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f853406a480 0x7f853406c940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8544036000 tx=0x7f854402e000 comp rx=0 tx=0).stop 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85541515f0 msgr2=0x7f8554159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85541515f0 0x7f8554159860 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f854c000c00 tx=0x7f854c00ec00 comp rx=0 tx=0).stop 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 shutdown_connections 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f853406a480 0x7f853406c940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85541515f0 0x7f8554159860 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f855415b8d0 0x7f8554150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 --2- 172.21.15.113:0/4062895312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855415b4f0 0x7f855414ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.703+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 >> 172.21.15.113:0/4062895312 conn(0x7f85540b27a0 msgr2=0x7f855415f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.704+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 shutdown_connections 2023-12-19T13:46:45.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.704+0000 7f855a0df640 1 -- 172.21.15.113:0/4062895312 wait complete. 2023-12-19T13:46:45.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.706+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa974061910 con 0x7fa9740d07b0 2023-12-19T13:46:45.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.707+0000 7fa96affd640 1 -- 172.21.15.113:0/1587744137 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa964017020 con 0x7fa9740d07b0 2023-12-19T13:46:45.708 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2023-12-19T13:46:45.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-12-19T13:46:45.709 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa96006a4b0 msgr2=0x7fa96006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa96006a4b0 0x7fa96006c970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa970036000 tx=0x7fa97003c040 comp rx=0 tx=0).stop 2023-12-19T13:46:45.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d07b0 msgr2=0x7fa9741f79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d07b0 0x7fa9741f79d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa96400c3c0 tx=0x7fa96400c880 comp rx=0 tx=0).stop 2023-12-19T13:46:45.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 shutdown_connections 2023-12-19T13:46:45.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa96006a4b0 0x7fa96006c970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9740d07b0 0x7fa9741f79d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9740d03d0 0x7fa974163a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 --2- 172.21.15.113:0/1587744137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9740b59a0 0x7fa9741f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 >> 172.21.15.113:0/1587744137 conn(0x7fa9740b27a0 msgr2=0x7fa9740b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 shutdown_connections 2023-12-19T13:46:45.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.710+0000 7fa97c4f7640 1 -- 172.21.15.113:0/1587744137 wait complete. 2023-12-19T13:46:45.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-12-19T13:46:45.719 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-12-19T13:46:45.722 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-12-19T13:46:45.728 DEBUG:teuthology.parallel:result is None 2023-12-19T13:46:45.728 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T13:46:45.728 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:46:45.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.975+0000 7fe40ffff640 1 Processor -- start 2023-12-19T13:46:45.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.975+0000 7fe40ffff640 1 -- start start 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.976+0000 7fe40ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe410159f80 0x7fe41006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 0x7fe41015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41006b520 con 0x7fe41015b1e0 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40ffff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4100b2b20 con 0x7fe410159f80 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100b2fb0 con 0x7fe41015aa70 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe410159f80 0x7fe41006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe410159f80 0x7fe41006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43824/0 (socket says 172.21.15.113:43824) 2023-12-19T13:46:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40effd640 1 -- 172.21.15.113:0/2298814594 learned_addr learned my addr 172.21.15.113:0/2298814594 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40f7fe640 1 --2- 172.21.15.113:0/2298814594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 0x7fe41015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40effd640 1 -- 172.21.15.113:0/2298814594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 msgr2=0x7fe41015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40effd640 1 --2- 172.21.15.113:0/2298814594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 0x7fe41015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40effd640 1 -- 172.21.15.113:0/2298814594 >> v1:172.21.15.151:6789/0 conn(0x7fe41015b1e0 legacy=0x7fe41015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:45.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.977+0000 7fe40effd640 1 -- 172.21.15.113:0/2298814594 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100b1f10 con 0x7fe410159f80 2023-12-19T13:46:45.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.978+0000 7fe40effd640 1 --2- 172.21.15.113:0/2298814594 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe41006f160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe400009e50 tx=0x7fe40002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a01bdc388a9e92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.978+0000 7fe40dffb640 1 -- 172.21.15.113:0/2298814594 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40002cb00 con 0x7fe410159f80 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40dffb640 1 -- 172.21.15.113:0/2298814594 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40002cc60 con 0x7fe410159f80 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40dffb640 1 -- 172.21.15.113:0/2298814594 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000343f0 con 0x7fe410159f80 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 -- 172.21.15.113:0/2298814594 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 msgr2=0x7fe41006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 --2- 172.21.15.113:0/2298814594 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe41006f160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe400009e50 tx=0x7fe40002bf60 comp rx=0 tx=0).stop 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 -- 172.21.15.113:0/2298814594 shutdown_connections 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 --2- 172.21.15.113:0/2298814594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 0x7fe41015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 --2- 172.21.15.113:0/2298814594 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe41006f160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 -- 172.21.15.113:0/2298814594 >> 172.21.15.113:0/2298814594 conn(0x7fe4100b0100 msgr2=0x7fe4100b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 -- 172.21.15.113:0/2298814594 shutdown_connections 2023-12-19T13:46:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.979+0000 7fe40ffff640 1 -- 172.21.15.113:0/2298814594 wait complete. 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.981+0000 7fe40ffff640 1 Processor -- start 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.981+0000 7fe40ffff640 1 -- start start 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe410153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 0x7fe4101f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe41015b1e0 0x7fe41006c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40ffff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101f0cf0 con 0x7fe410159f80 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101f0fd0 con 0x7fe41015b1e0 2023-12-19T13:46:45.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101f12b0 con 0x7fe41015aa70 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe410153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe410153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43828/0 (socket says 172.21.15.113:43828) 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 -- 172.21.15.113:0/1501517420 learned_addr learned my addr 172.21.15.113:0/1501517420 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 -- 172.21.15.113:0/1501517420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 msgr2=0x7fe4101f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 0x7fe4101f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 -- 172.21.15.113:0/1501517420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe41015b1e0 msgr2=0x7fe41006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe41015b1e0 0x7fe41006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.982+0000 7fe40effd640 1 -- 172.21.15.113:0/1501517420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009b30 con 0x7fe410159f80 2023-12-19T13:46:45.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.983+0000 7fe40effd640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe410153e20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe400009e50 tx=0x7fe400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.983+0000 7fe407fff640 1 -- 172.21.15.113:0/1501517420 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40003e450 con 0x7fe410159f80 2023-12-19T13:46:45.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.983+0000 7fe407fff640 1 -- 172.21.15.113:0/1501517420 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40003e5f0 con 0x7fe410159f80 2023-12-19T13:46:45.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.983+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4101f1590 con 0x7fe410159f80 2023-12-19T13:46:45.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.983+0000 7fe407fff640 1 -- 172.21.15.113:0/1501517420 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40003e9a0 con 0x7fe410159f80 2023-12-19T13:46:45.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.983+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4100a8a00 con 0x7fe410159f80 2023-12-19T13:46:45.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.984+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4100a8b90 con 0x7fe410159f80 2023-12-19T13:46:45.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.985+0000 7fe407fff640 1 -- 172.21.15.113:0/1501517420 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe40003eb00 con 0x7fe410159f80 2023-12-19T13:46:45.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.986+0000 7fe407fff640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe3f006a430 0x7fe3f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:45.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.986+0000 7fe407fff640 1 -- 172.21.15.113:0/1501517420 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4000ab8e0 con 0x7fe410159f80 2023-12-19T13:46:45.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.986+0000 7fe40e7fc640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe3f006a430 0x7fe3f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:45.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.987+0000 7fe40e7fc640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe3f006a430 0x7fe3f006c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8006fd0 tx=0x7fe3f8006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:45.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:45.990+0000 7fe407fff640 1 -- 172.21.15.113:0/1501517420 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe400076e30 con 0x7fe410159f80 2023-12-19T13:46:46.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.162+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4100aa8f0 con 0x7fe3f006a430 2023-12-19T13:46:46.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.181+0000 7fe407fff640 1 -- 172.21.15.113:0/1501517420 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260010 (secure 0 0 0) 0x7fe4100aa8f0 con 0x7fe3f006a430 2023-12-19T13:46:46.185 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:46.186 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:46:46.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe3f006a430 msgr2=0x7fe3f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe3f006a430 0x7fe3f006c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8006fd0 tx=0x7fe3f8006bc0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 msgr2=0x7fe410153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe410153e20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe400009e50 tx=0x7fe400004a40 comp rx=0 tx=0).stop 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 shutdown_connections 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe3f006a430 0x7fe3f006c8f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe41015b1e0 0x7fe41006c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe41015aa70 0x7fe4101f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 --2- 172.21.15.113:0/1501517420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe410159f80 0x7fe410153e20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.186+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 >> 172.21.15.113:0/1501517420 conn(0x7fe4100b0100 msgr2=0x7fe4100ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.187+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 shutdown_connections 2023-12-19T13:46:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.187+0000 7fe40ffff640 1 -- 172.21.15.113:0/1501517420 wait complete. 2023-12-19T13:46:46.205 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-19T13:46:44.414002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003841"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479619+0000","last_change":"2023-12-19T13:46:30.947466+0000","last_active":"2023-12-19T13:46:32.479619+0000","last_peered":"2023-12-19T13:46:32.479619+0000","last_clean":"2023-12-19T13:46:32.479619+0000","last_became_active":"2023-12-19T13:46:30.944804+0000","last_became_peered":"2023-12-19T13:46:30.944804+0000","last_unstale":"2023-12-19T13:46:32.479619+0000","last_undegraded":"2023-12-19T13:46:32.479619+0000","last_fullsized":"2023-12-19T13:46:32.479619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949108+0000","last_change":"2023-12-19T13:46:30.947759+0000","last_active":"2023-12-19T13:46:30.949108+0000","last_peered":"2023-12-19T13:46:30.949108+0000","last_clean":"2023-12-19T13:46:30.949108+0000","last_became_active":"2023-12-19T13:46:30.947539+0000","last_became_peered":"2023-12-19T13:46:30.947539+0000","last_unstale":"2023-12-19T13:46:30.949108+0000","last_undegraded":"2023-12-19T13:46:30.949108+0000","last_fullsized":"2023-12-19T13:46:30.949108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949060+0000","last_change":"2023-12-19T13:46:30.947127+0000","last_active":"2023-12-19T13:46:30.949060+0000","last_peered":"2023-12-19T13:46:30.949060+0000","last_clean":"2023-12-19T13:46:30.949060+0000","last_became_active":"2023-12-19T13:46:30.946112+0000","last_became_peered":"2023-12-19T13:46:30.946112+0000","last_unstale":"2023-12-19T13:46:30.949060+0000","last_undegraded":"2023-12-19T13:46:30.949060+0000","last_fullsized":"2023-12-19T13:46:30.949060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:31.692673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932443+0000","last_change":"2023-12-19T13:46:30.944335+0000","last_active":"2023-12-19T13:46:31.932443+0000","last_peered":"2023-12-19T13:46:31.932443+0000","last_clean":"2023-12-19T13:46:31.932443+0000","last_became_active":"2023-12-19T13:46:30.943978+0000","last_became_peered":"2023-12-19T13:46:30.943978+0000","last_unstale":"2023-12-19T13:46:31.932443+0000","last_undegraded":"2023-12-19T13:46:31.932443+0000","last_fullsized":"2023-12-19T13:46:31.932443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480797+0000","last_change":"2023-12-19T13:46:30.958489+0000","last_active":"2023-12-19T13:46:32.480797+0000","last_peered":"2023-12-19T13:46:32.480797+0000","last_clean":"2023-12-19T13:46:32.480797+0000","last_became_active":"2023-12-19T13:46:30.957947+0000","last_became_peered":"2023-12-19T13:46:30.957947+0000","last_unstale":"2023-12-19T13:46:32.480797+0000","last_undegraded":"2023-12-19T13:46:32.480797+0000","last_fullsized":"2023-12-19T13:46:32.480797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932704+0000","last_change":"2023-12-19T13:46:30.941012+0000","last_active":"2023-12-19T13:46:31.932704+0000","last_peered":"2023-12-19T13:46:31.932704+0000","last_clean":"2023-12-19T13:46:31.932704+0000","last_became_active":"2023-12-19T13:46:30.940674+0000","last_became_peered":"2023-12-19T13:46:30.940674+0000","last_unstale":"2023-12-19T13:46:31.932704+0000","last_undegraded":"2023-12-19T13:46:31.932704+0000","last_fullsized":"2023-12-19T13:46:31.932704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480352+0000","last_change":"2023-12-19T13:46:30.956208+0000","last_active":"2023-12-19T13:46:32.480352+0000","last_peered":"2023-12-19T13:46:32.480352+0000","last_clean":"2023-12-19T13:46:32.480352+0000","last_became_active":"2023-12-19T13:46:30.954562+0000","last_became_peered":"2023-12-19T13:46:30.954562+0000","last_unstale":"2023-12-19T13:46:32.480352+0000","last_undegraded":"2023-12-19T13:46:32.480352+0000","last_fullsized":"2023-12-19T13:46:32.480352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951004+0000","last_change":"2023-12-19T13:46:30.949875+0000","last_active":"2023-12-19T13:46:30.951004+0000","last_peered":"2023-12-19T13:46:30.951004+0000","last_clean":"2023-12-19T13:46:30.951004+0000","last_became_active":"2023-12-19T13:46:30.949625+0000","last_became_peered":"2023-12-19T13:46:30.949625+0000","last_unstale":"2023-12-19T13:46:30.951004+0000","last_undegraded":"2023-12-19T13:46:30.951004+0000","last_fullsized":"2023-12-19T13:46:30.951004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:18.684952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478175+0000","last_change":"2023-12-19T13:46:30.940157+0000","last_active":"2023-12-19T13:46:32.478175+0000","last_peered":"2023-12-19T13:46:32.478175+0000","last_clean":"2023-12-19T13:46:32.478175+0000","last_became_active":"2023-12-19T13:46:30.939947+0000","last_became_peered":"2023-12-19T13:46:30.939947+0000","last_unstale":"2023-12-19T13:46:32.478175+0000","last_undegraded":"2023-12-19T13:46:32.478175+0000","last_fullsized":"2023-12-19T13:46:32.478175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480049+0000","last_change":"2023-12-19T13:46:30.958360+0000","last_active":"2023-12-19T13:46:32.480049+0000","last_peered":"2023-12-19T13:46:32.480049+0000","last_clean":"2023-12-19T13:46:32.480049+0000","last_became_active":"2023-12-19T13:46:30.957433+0000","last_became_peered":"2023-12-19T13:46:30.957433+0000","last_unstale":"2023-12-19T13:46:32.480049+0000","last_undegraded":"2023-12-19T13:46:32.480049+0000","last_fullsized":"2023-12-19T13:46:32.480049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479889+0000","last_change":"2023-12-19T13:46:30.946461+0000","last_active":"2023-12-19T13:46:32.479889+0000","last_peered":"2023-12-19T13:46:32.479889+0000","last_clean":"2023-12-19T13:46:32.479889+0000","last_became_active":"2023-12-19T13:46:30.944536+0000","last_became_peered":"2023-12-19T13:46:30.944536+0000","last_unstale":"2023-12-19T13:46:32.479889+0000","last_undegraded":"2023-12-19T13:46:32.479889+0000","last_fullsized":"2023-12-19T13:46:32.479889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479093+0000","last_change":"2023-12-19T13:46:30.955116+0000","last_active":"2023-12-19T13:46:32.479093+0000","last_peered":"2023-12-19T13:46:32.479093+0000","last_clean":"2023-12-19T13:46:32.479093+0000","last_became_active":"2023-12-19T13:46:30.954208+0000","last_became_peered":"2023-12-19T13:46:30.954208+0000","last_unstale":"2023-12-19T13:46:32.479093+0000","last_undegraded":"2023-12-19T13:46:32.479093+0000","last_fullsized":"2023-12-19T13:46:32.479093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477789+0000","last_change":"2023-12-19T13:46:30.951097+0000","last_active":"2023-12-19T13:46:32.477789+0000","last_peered":"2023-12-19T13:46:32.477789+0000","last_clean":"2023-12-19T13:46:32.477789+0000","last_became_active":"2023-12-19T13:46:30.950596+0000","last_became_peered":"2023-12-19T13:46:30.950596+0000","last_unstale":"2023-12-19T13:46:32.477789+0000","last_undegraded":"2023-12-19T13:46:32.477789+0000","last_fullsized":"2023-12-19T13:46:32.477789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477725+0000","last_change":"2023-12-19T13:46:30.951645+0000","last_active":"2023-12-19T13:46:32.477725+0000","last_peered":"2023-12-19T13:46:32.477725+0000","last_clean":"2023-12-19T13:46:32.477725+0000","last_became_active":"2023-12-19T13:46:30.951372+0000","last_became_peered":"2023-12-19T13:46:30.951372+0000","last_unstale":"2023-12-19T13:46:32.477725+0000","last_undegraded":"2023-12-19T13:46:32.477725+0000","last_fullsized":"2023-12-19T13:46:32.477725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960243+0000","last_change":"2023-12-19T13:46:30.960188+0000","last_active":"2023-12-19T13:46:30.960243+0000","last_peered":"2023-12-19T13:46:30.960243+0000","last_clean":"2023-12-19T13:46:30.960243+0000","last_became_active":"2023-12-19T13:46:30.959885+0000","last_became_peered":"2023-12-19T13:46:30.959885+0000","last_unstale":"2023-12-19T13:46:30.960243+0000","last_undegraded":"2023-12-19T13:46:30.960243+0000","last_fullsized":"2023-12-19T13:46:30.960243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481033+0000","last_change":"2023-12-19T13:46:30.932726+0000","last_active":"2023-12-19T13:46:32.481033+0000","last_peered":"2023-12-19T13:46:32.481033+0000","last_clean":"2023-12-19T13:46:32.481033+0000","last_became_active":"2023-12-19T13:46:30.931668+0000","last_became_peered":"2023-12-19T13:46:30.931668+0000","last_unstale":"2023-12-19T13:46:32.481033+0000","last_undegraded":"2023-12-19T13:46:32.481033+0000","last_fullsized":"2023-12-19T13:46:32.481033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478349+0000","last_change":"2023-12-19T13:46:30.957418+0000","last_active":"2023-12-19T13:46:32.478349+0000","last_peered":"2023-12-19T13:46:32.478349+0000","last_clean":"2023-12-19T13:46:32.478349+0000","last_became_active":"2023-12-19T13:46:30.957187+0000","last_became_peered":"2023-12-19T13:46:30.957187+0000","last_unstale":"2023-12-19T13:46:32.478349+0000","last_undegraded":"2023-12-19T13:46:32.478349+0000","last_fullsized":"2023-12-19T13:46:32.478349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:03.460723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.934059+0000","last_change":"2023-12-19T13:46:30.933939+0000","last_active":"2023-12-19T13:46:30.934059+0000","last_peered":"2023-12-19T13:46:30.934059+0000","last_clean":"2023-12-19T13:46:30.934059+0000","last_became_active":"2023-12-19T13:46:30.933698+0000","last_became_peered":"2023-12-19T13:46:30.933698+0000","last_unstale":"2023-12-19T13:46:30.934059+0000","last_undegraded":"2023-12-19T13:46:30.934059+0000","last_fullsized":"2023-12-19T13:46:30.934059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478667+0000","last_change":"2023-12-19T13:46:30.954479+0000","last_active":"2023-12-19T13:46:32.478667+0000","last_peered":"2023-12-19T13:46:32.478667+0000","last_clean":"2023-12-19T13:46:32.478667+0000","last_became_active":"2023-12-19T13:46:30.953640+0000","last_became_peered":"2023-12-19T13:46:30.953640+0000","last_unstale":"2023-12-19T13:46:32.478667+0000","last_undegraded":"2023-12-19T13:46:32.478667+0000","last_fullsized":"2023-12-19T13:46:32.478667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:14.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480286+0000","last_change":"2023-12-19T13:46:30.957735+0000","last_active":"2023-12-19T13:46:32.480286+0000","last_peered":"2023-12-19T13:46:32.480286+0000","last_clean":"2023-12-19T13:46:32.480286+0000","last_became_active":"2023-12-19T13:46:30.954757+0000","last_became_peered":"2023-12-19T13:46:30.954757+0000","last_unstale":"2023-12-19T13:46:32.480286+0000","last_undegraded":"2023-12-19T13:46:32.480286+0000","last_fullsized":"2023-12-19T13:46:32.480286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928022+0000","last_change":"2023-12-19T13:46:30.935192+0000","last_active":"2023-12-19T13:46:31.928022+0000","last_peered":"2023-12-19T13:46:31.928022+0000","last_clean":"2023-12-19T13:46:31.928022+0000","last_became_active":"2023-12-19T13:46:30.934966+0000","last_became_peered":"2023-12-19T13:46:30.934966+0000","last_unstale":"2023-12-19T13:46:31.928022+0000","last_undegraded":"2023-12-19T13:46:31.928022+0000","last_fullsized":"2023-12-19T13:46:31.928022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479248+0000","last_change":"2023-12-19T13:46:30.957999+0000","last_active":"2023-12-19T13:46:32.479248+0000","last_peered":"2023-12-19T13:46:32.479248+0000","last_clean":"2023-12-19T13:46:32.479248+0000","last_became_active":"2023-12-19T13:46:30.957775+0000","last_became_peered":"2023-12-19T13:46:30.957775+0000","last_unstale":"2023-12-19T13:46:32.479248+0000","last_undegraded":"2023-12-19T13:46:32.479248+0000","last_fullsized":"2023-12-19T13:46:32.479248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950982+0000","last_change":"2023-12-19T13:46:30.949299+0000","last_active":"2023-12-19T13:46:30.950982+0000","last_peered":"2023-12-19T13:46:30.950982+0000","last_clean":"2023-12-19T13:46:30.950982+0000","last_became_active":"2023-12-19T13:46:30.946882+0000","last_became_peered":"2023-12-19T13:46:30.946882+0000","last_unstale":"2023-12-19T13:46:30.950982+0000","last_undegraded":"2023-12-19T13:46:30.950982+0000","last_fullsized":"2023-12-19T13:46:30.950982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477911+0000","last_change":"2023-12-19T13:46:30.954278+0000","last_active":"2023-12-19T13:46:32.477911+0000","last_peered":"2023-12-19T13:46:32.477911+0000","last_clean":"2023-12-19T13:46:32.477911+0000","last_became_active":"2023-12-19T13:46:30.952450+0000","last_became_peered":"2023-12-19T13:46:30.952450+0000","last_unstale":"2023-12-19T13:46:32.477911+0000","last_undegraded":"2023-12-19T13:46:32.477911+0000","last_fullsized":"2023-12-19T13:46:32.477911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955765+0000","last_change":"2023-12-19T13:46:30.954346+0000","last_active":"2023-12-19T13:46:30.955765+0000","last_peered":"2023-12-19T13:46:30.955765+0000","last_clean":"2023-12-19T13:46:30.955765+0000","last_became_active":"2023-12-19T13:46:30.952500+0000","last_became_peered":"2023-12-19T13:46:30.952500+0000","last_unstale":"2023-12-19T13:46:30.955765+0000","last_undegraded":"2023-12-19T13:46:30.955765+0000","last_fullsized":"2023-12-19T13:46:30.955765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932905+0000","last_change":"2023-12-19T13:46:30.931389+0000","last_active":"2023-12-19T13:46:31.932905+0000","last_peered":"2023-12-19T13:46:31.932905+0000","last_clean":"2023-12-19T13:46:31.932905+0000","last_became_active":"2023-12-19T13:46:30.931071+0000","last_became_peered":"2023-12-19T13:46:30.931071+0000","last_unstale":"2023-12-19T13:46:31.932905+0000","last_undegraded":"2023-12-19T13:46:31.932905+0000","last_fullsized":"2023-12-19T13:46:31.932905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478415+0000","last_change":"2023-12-19T13:46:30.952230+0000","last_active":"2023-12-19T13:46:32.478415+0000","last_peered":"2023-12-19T13:46:32.478415+0000","last_clean":"2023-12-19T13:46:32.478415+0000","last_became_active":"2023-12-19T13:46:30.952001+0000","last_became_peered":"2023-12-19T13:46:30.952001+0000","last_unstale":"2023-12-19T13:46:32.478415+0000","last_undegraded":"2023-12-19T13:46:32.478415+0000","last_fullsized":"2023-12-19T13:46:32.478415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:02.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479226+0000","last_change":"2023-12-19T13:46:30.950882+0000","last_active":"2023-12-19T13:46:32.479226+0000","last_peered":"2023-12-19T13:46:32.479226+0000","last_clean":"2023-12-19T13:46:32.479226+0000","last_became_active":"2023-12-19T13:46:30.950214+0000","last_became_peered":"2023-12-19T13:46:30.950214+0000","last_unstale":"2023-12-19T13:46:32.479226+0000","last_undegraded":"2023-12-19T13:46:32.479226+0000","last_fullsized":"2023-12-19T13:46:32.479226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952004+0000","last_change":"2023-12-19T13:46:30.948716+0000","last_active":"2023-12-19T13:46:30.952004+0000","last_peered":"2023-12-19T13:46:30.952004+0000","last_clean":"2023-12-19T13:46:30.952004+0000","last_became_active":"2023-12-19T13:46:30.948483+0000","last_became_peered":"2023-12-19T13:46:30.948483+0000","last_unstale":"2023-12-19T13:46:30.952004+0000","last_undegraded":"2023-12-19T13:46:30.952004+0000","last_fullsized":"2023-12-19T13:46:30.952004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480930+0000","last_change":"2023-12-19T13:46:30.950655+0000","last_active":"2023-12-19T13:46:32.480930+0000","last_peered":"2023-12-19T13:46:32.480930+0000","last_clean":"2023-12-19T13:46:32.480930+0000","last_became_active":"2023-12-19T13:46:30.950446+0000","last_became_peered":"2023-12-19T13:46:30.950446+0000","last_unstale":"2023-12-19T13:46:32.480930+0000","last_undegraded":"2023-12-19T13:46:32.480930+0000","last_fullsized":"2023-12-19T13:46:32.480930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:05.776092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939565+0000","last_change":"2023-12-19T13:46:30.938955+0000","last_active":"2023-12-19T13:46:30.939565+0000","last_peered":"2023-12-19T13:46:30.939565+0000","last_clean":"2023-12-19T13:46:30.939565+0000","last_became_active":"2023-12-19T13:46:30.938382+0000","last_became_peered":"2023-12-19T13:46:30.938382+0000","last_unstale":"2023-12-19T13:46:30.939565+0000","last_undegraded":"2023-12-19T13:46:30.939565+0000","last_fullsized":"2023-12-19T13:46:30.939565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932221+0000","last_change":"2023-12-19T13:46:30.949294+0000","last_active":"2023-12-19T13:46:31.932221+0000","last_peered":"2023-12-19T13:46:31.932221+0000","last_clean":"2023-12-19T13:46:31.932221+0000","last_became_active":"2023-12-19T13:46:30.949073+0000","last_became_peered":"2023-12-19T13:46:30.949073+0000","last_unstale":"2023-12-19T13:46:31.932221+0000","last_undegraded":"2023-12-19T13:46:31.932221+0000","last_fullsized":"2023-12-19T13:46:31.932221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478387+0000","last_change":"2023-12-19T13:46:30.950387+0000","last_active":"2023-12-19T13:46:32.478387+0000","last_peered":"2023-12-19T13:46:32.478387+0000","last_clean":"2023-12-19T13:46:32.478387+0000","last_became_active":"2023-12-19T13:46:30.947508+0000","last_became_peered":"2023-12-19T13:46:30.947508+0000","last_unstale":"2023-12-19T13:46:32.478387+0000","last_undegraded":"2023-12-19T13:46:32.478387+0000","last_fullsized":"2023-12-19T13:46:32.478387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955028+0000","last_change":"2023-12-19T13:46:30.463700+0000","last_active":"2023-12-19T13:46:30.955028+0000","last_peered":"2023-12-19T13:46:30.955028+0000","last_clean":"2023-12-19T13:46:30.955028+0000","last_became_active":"2023-12-19T13:46:30.463230+0000","last_became_peered":"2023-12-19T13:46:30.463230+0000","last_unstale":"2023-12-19T13:46:30.955028+0000","last_undegraded":"2023-12-19T13:46:30.955028+0000","last_fullsized":"2023-12-19T13:46:30.955028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927907+0000","last_change":"2023-12-19T13:46:30.956149+0000","last_active":"2023-12-19T13:46:31.927907+0000","last_peered":"2023-12-19T13:46:31.927907+0000","last_clean":"2023-12-19T13:46:31.927907+0000","last_became_active":"2023-12-19T13:46:30.955830+0000","last_became_peered":"2023-12-19T13:46:30.955830+0000","last_unstale":"2023-12-19T13:46:31.927907+0000","last_undegraded":"2023-12-19T13:46:31.927907+0000","last_fullsized":"2023-12-19T13:46:31.927907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960209+0000","last_change":"2023-12-19T13:46:30.467903+0000","last_active":"2023-12-19T13:46:30.960209+0000","last_peered":"2023-12-19T13:46:30.960209+0000","last_clean":"2023-12-19T13:46:30.960209+0000","last_became_active":"2023-12-19T13:46:30.467653+0000","last_became_peered":"2023-12-19T13:46:30.467653+0000","last_unstale":"2023-12-19T13:46:30.960209+0000","last_undegraded":"2023-12-19T13:46:30.960209+0000","last_fullsized":"2023-12-19T13:46:30.960209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:33.124713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938449+0000","last_change":"2023-12-19T13:46:30.470689+0000","last_active":"2023-12-19T13:46:30.938449+0000","last_peered":"2023-12-19T13:46:30.938449+0000","last_clean":"2023-12-19T13:46:30.938449+0000","last_became_active":"2023-12-19T13:46:30.470436+0000","last_became_peered":"2023-12-19T13:46:30.470436+0000","last_unstale":"2023-12-19T13:46:30.938449+0000","last_undegraded":"2023-12-19T13:46:30.938449+0000","last_fullsized":"2023-12-19T13:46:30.938449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955782+0000","last_change":"2023-12-19T13:46:30.954917+0000","last_active":"2023-12-19T13:46:30.955782+0000","last_peered":"2023-12-19T13:46:30.955782+0000","last_clean":"2023-12-19T13:46:30.955782+0000","last_became_active":"2023-12-19T13:46:30.954590+0000","last_became_peered":"2023-12-19T13:46:30.954590+0000","last_unstale":"2023-12-19T13:46:30.955782+0000","last_undegraded":"2023-12-19T13:46:30.955782+0000","last_fullsized":"2023-12-19T13:46:30.955782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926484+0000","last_change":"2023-12-19T13:46:30.450013+0000","last_active":"2023-12-19T13:46:30.926484+0000","last_peered":"2023-12-19T13:46:30.926484+0000","last_clean":"2023-12-19T13:46:30.926484+0000","last_became_active":"2023-12-19T13:46:30.449760+0000","last_became_peered":"2023-12-19T13:46:30.449760+0000","last_unstale":"2023-12-19T13:46:30.926484+0000","last_undegraded":"2023-12-19T13:46:30.926484+0000","last_fullsized":"2023-12-19T13:46:30.926484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:03.646304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927969+0000","last_change":"2023-12-19T13:46:30.943118+0000","last_active":"2023-12-19T13:46:31.927969+0000","last_peered":"2023-12-19T13:46:31.927969+0000","last_clean":"2023-12-19T13:46:31.927969+0000","last_became_active":"2023-12-19T13:46:30.942893+0000","last_became_peered":"2023-12-19T13:46:30.942893+0000","last_unstale":"2023-12-19T13:46:31.927969+0000","last_undegraded":"2023-12-19T13:46:31.927969+0000","last_fullsized":"2023-12-19T13:46:31.927969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937097+0000","last_change":"2023-12-19T13:46:30.465649+0000","last_active":"2023-12-19T13:46:30.937097+0000","last_peered":"2023-12-19T13:46:30.937097+0000","last_clean":"2023-12-19T13:46:30.937097+0000","last_became_active":"2023-12-19T13:46:30.457418+0000","last_became_peered":"2023-12-19T13:46:30.457418+0000","last_unstale":"2023-12-19T13:46:30.937097+0000","last_undegraded":"2023-12-19T13:46:30.937097+0000","last_fullsized":"2023-12-19T13:46:30.937097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:09.441431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932357+0000","last_change":"2023-12-19T13:46:30.940866+0000","last_active":"2023-12-19T13:46:31.932357+0000","last_peered":"2023-12-19T13:46:31.932357+0000","last_clean":"2023-12-19T13:46:31.932357+0000","last_became_active":"2023-12-19T13:46:30.940000+0000","last_became_peered":"2023-12-19T13:46:30.940000+0000","last_unstale":"2023-12-19T13:46:31.932357+0000","last_undegraded":"2023-12-19T13:46:31.932357+0000","last_fullsized":"2023-12-19T13:46:31.932357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:54.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.948940+0000","last_change":"2023-12-19T13:46:30.471859+0000","last_active":"2023-12-19T13:46:30.948940+0000","last_peered":"2023-12-19T13:46:30.948940+0000","last_clean":"2023-12-19T13:46:30.948940+0000","last_became_active":"2023-12-19T13:46:30.471277+0000","last_became_peered":"2023-12-19T13:46:30.471277+0000","last_unstale":"2023-12-19T13:46:30.948940+0000","last_undegraded":"2023-12-19T13:46:30.948940+0000","last_fullsized":"2023-12-19T13:46:30.948940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952022+0000","last_change":"2023-12-19T13:46:30.951516+0000","last_active":"2023-12-19T13:46:30.952022+0000","last_peered":"2023-12-19T13:46:30.952022+0000","last_clean":"2023-12-19T13:46:30.952022+0000","last_became_active":"2023-12-19T13:46:30.951275+0000","last_became_peered":"2023-12-19T13:46:30.951275+0000","last_unstale":"2023-12-19T13:46:30.952022+0000","last_undegraded":"2023-12-19T13:46:30.952022+0000","last_fullsized":"2023-12-19T13:46:30.952022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951214+0000","last_change":"2023-12-19T13:46:30.464446+0000","last_active":"2023-12-19T13:46:30.951214+0000","last_peered":"2023-12-19T13:46:30.951214+0000","last_clean":"2023-12-19T13:46:30.951214+0000","last_became_active":"2023-12-19T13:46:30.463227+0000","last_became_peered":"2023-12-19T13:46:30.463227+0000","last_unstale":"2023-12-19T13:46:30.951214+0000","last_undegraded":"2023-12-19T13:46:30.951214+0000","last_fullsized":"2023-12-19T13:46:30.951214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478163+0000","last_change":"2023-12-19T13:46:30.937059+0000","last_active":"2023-12-19T13:46:32.478163+0000","last_peered":"2023-12-19T13:46:32.478163+0000","last_clean":"2023-12-19T13:46:32.478163+0000","last_became_active":"2023-12-19T13:46:30.936498+0000","last_became_peered":"2023-12-19T13:46:30.936498+0000","last_unstale":"2023-12-19T13:46:32.478163+0000","last_undegraded":"2023-12-19T13:46:32.478163+0000","last_fullsized":"2023-12-19T13:46:32.478163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958001+0000","last_change":"2023-12-19T13:46:30.465379+0000","last_active":"2023-12-19T13:46:30.958001+0000","last_peered":"2023-12-19T13:46:30.958001+0000","last_clean":"2023-12-19T13:46:30.958001+0000","last_became_active":"2023-12-19T13:46:30.464638+0000","last_became_peered":"2023-12-19T13:46:30.464638+0000","last_unstale":"2023-12-19T13:46:30.958001+0000","last_undegraded":"2023-12-19T13:46:30.958001+0000","last_fullsized":"2023-12-19T13:46:30.958001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:40.827653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479035+0000","last_change":"2023-12-19T13:46:30.954585+0000","last_active":"2023-12-19T13:46:32.479035+0000","last_peered":"2023-12-19T13:46:32.479035+0000","last_clean":"2023-12-19T13:46:32.479035+0000","last_became_active":"2023-12-19T13:46:30.954225+0000","last_became_peered":"2023-12-19T13:46:30.954225+0000","last_unstale":"2023-12-19T13:46:32.479035+0000","last_undegraded":"2023-12-19T13:46:32.479035+0000","last_fullsized":"2023-12-19T13:46:32.479035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959430+0000","last_change":"2023-12-19T13:46:30.467738+0000","last_active":"2023-12-19T13:46:30.959430+0000","last_peered":"2023-12-19T13:46:30.959430+0000","last_clean":"2023-12-19T13:46:30.959430+0000","last_became_active":"2023-12-19T13:46:30.467458+0000","last_became_peered":"2023-12-19T13:46:30.467458+0000","last_unstale":"2023-12-19T13:46:30.959430+0000","last_undegraded":"2023-12-19T13:46:30.959430+0000","last_fullsized":"2023-12-19T13:46:30.959430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477744+0000","last_change":"2023-12-19T13:46:30.945420+0000","last_active":"2023-12-19T13:46:32.477744+0000","last_peered":"2023-12-19T13:46:32.477744+0000","last_clean":"2023-12-19T13:46:32.477744+0000","last_became_active":"2023-12-19T13:46:30.945196+0000","last_became_peered":"2023-12-19T13:46:30.945196+0000","last_unstale":"2023-12-19T13:46:32.477744+0000","last_undegraded":"2023-12-19T13:46:32.477744+0000","last_fullsized":"2023-12-19T13:46:32.477744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925451+0000","last_change":"2023-12-19T13:46:30.460639+0000","last_active":"2023-12-19T13:46:30.925451+0000","last_peered":"2023-12-19T13:46:30.925451+0000","last_clean":"2023-12-19T13:46:30.925451+0000","last_became_active":"2023-12-19T13:46:30.460292+0000","last_became_peered":"2023-12-19T13:46:30.460292+0000","last_unstale":"2023-12-19T13:46:30.925451+0000","last_undegraded":"2023-12-19T13:46:30.925451+0000","last_fullsized":"2023-12-19T13:46:30.925451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:01.555601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481397+0000","last_change":"2023-12-19T13:46:30.959817+0000","last_active":"2023-12-19T13:46:32.481397+0000","last_peered":"2023-12-19T13:46:32.481397+0000","last_clean":"2023-12-19T13:46:32.481397+0000","last_became_active":"2023-12-19T13:46:30.959575+0000","last_became_peered":"2023-12-19T13:46:30.959575+0000","last_unstale":"2023-12-19T13:46:32.481397+0000","last_undegraded":"2023-12-19T13:46:32.481397+0000","last_fullsized":"2023-12-19T13:46:32.481397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:10.080876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949079+0000","last_change":"2023-12-19T13:46:30.471710+0000","last_active":"2023-12-19T13:46:30.949079+0000","last_peered":"2023-12-19T13:46:30.949079+0000","last_clean":"2023-12-19T13:46:30.949079+0000","last_became_active":"2023-12-19T13:46:30.470939+0000","last_became_peered":"2023-12-19T13:46:30.470939+0000","last_unstale":"2023-12-19T13:46:30.949079+0000","last_undegraded":"2023-12-19T13:46:30.949079+0000","last_fullsized":"2023-12-19T13:46:30.949079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478648+0000","last_change":"2023-12-19T13:46:30.947790+0000","last_active":"2023-12-19T13:46:32.478648+0000","last_peered":"2023-12-19T13:46:32.478648+0000","last_clean":"2023-12-19T13:46:32.478648+0000","last_became_active":"2023-12-19T13:46:30.947145+0000","last_became_peered":"2023-12-19T13:46:30.947145+0000","last_unstale":"2023-12-19T13:46:32.478648+0000","last_undegraded":"2023-12-19T13:46:32.478648+0000","last_fullsized":"2023-12-19T13:46:32.478648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.957777+0000","last_change":"2023-12-19T13:46:30.465840+0000","last_active":"2023-12-19T13:46:30.957777+0000","last_peered":"2023-12-19T13:46:30.957777+0000","last_clean":"2023-12-19T13:46:30.957777+0000","last_became_active":"2023-12-19T13:46:30.465539+0000","last_became_peered":"2023-12-19T13:46:30.465539+0000","last_unstale":"2023-12-19T13:46:30.957777+0000","last_undegraded":"2023-12-19T13:46:30.957777+0000","last_fullsized":"2023-12-19T13:46:30.957777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478618+0000","last_change":"2023-12-19T13:46:30.935669+0000","last_active":"2023-12-19T13:46:32.478618+0000","last_peered":"2023-12-19T13:46:32.478618+0000","last_clean":"2023-12-19T13:46:32.478618+0000","last_became_active":"2023-12-19T13:46:30.931664+0000","last_became_peered":"2023-12-19T13:46:30.931664+0000","last_unstale":"2023-12-19T13:46:32.478618+0000","last_undegraded":"2023-12-19T13:46:32.478618+0000","last_fullsized":"2023-12-19T13:46:32.478618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956431+0000","last_change":"2023-12-19T13:46:30.469934+0000","last_active":"2023-12-19T13:46:30.956431+0000","last_peered":"2023-12-19T13:46:30.956431+0000","last_clean":"2023-12-19T13:46:30.956431+0000","last_became_active":"2023-12-19T13:46:30.469677+0000","last_became_peered":"2023-12-19T13:46:30.469677+0000","last_unstale":"2023-12-19T13:46:30.956431+0000","last_undegraded":"2023-12-19T13:46:30.956431+0000","last_fullsized":"2023-12-19T13:46:30.956431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932472+0000","last_change":"2023-12-19T13:46:30.955967+0000","last_active":"2023-12-19T13:46:31.932472+0000","last_peered":"2023-12-19T13:46:31.932472+0000","last_clean":"2023-12-19T13:46:31.932472+0000","last_became_active":"2023-12-19T13:46:30.955703+0000","last_became_peered":"2023-12-19T13:46:30.955703+0000","last_unstale":"2023-12-19T13:46:31.932472+0000","last_undegraded":"2023-12-19T13:46:31.932472+0000","last_fullsized":"2023-12-19T13:46:31.932472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:34.137836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956418+0000","last_change":"2023-12-19T13:46:30.463235+0000","last_active":"2023-12-19T13:46:30.956418+0000","last_peered":"2023-12-19T13:46:30.956418+0000","last_clean":"2023-12-19T13:46:30.956418+0000","last_became_active":"2023-12-19T13:46:30.462908+0000","last_became_peered":"2023-12-19T13:46:30.462908+0000","last_unstale":"2023-12-19T13:46:30.956418+0000","last_undegraded":"2023-12-19T13:46:30.956418+0000","last_fullsized":"2023-12-19T13:46:30.956418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477974+0000","last_change":"2023-12-19T13:46:30.947024+0000","last_active":"2023-12-19T13:46:32.477974+0000","last_peered":"2023-12-19T13:46:32.477974+0000","last_clean":"2023-12-19T13:46:32.477974+0000","last_became_active":"2023-12-19T13:46:30.946825+0000","last_became_peered":"2023-12-19T13:46:30.946825+0000","last_unstale":"2023-12-19T13:46:32.477974+0000","last_undegraded":"2023-12-19T13:46:32.477974+0000","last_fullsized":"2023-12-19T13:46:32.477974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953122+0000","last_change":"2023-12-19T13:46:30.456074+0000","last_active":"2023-12-19T13:46:30.953122+0000","last_peered":"2023-12-19T13:46:30.953122+0000","last_clean":"2023-12-19T13:46:30.953122+0000","last_became_active":"2023-12-19T13:46:30.455381+0000","last_became_peered":"2023-12-19T13:46:30.455381+0000","last_unstale":"2023-12-19T13:46:30.953122+0000","last_undegraded":"2023-12-19T13:46:30.953122+0000","last_fullsized":"2023-12-19T13:46:30.953122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479507+0000","last_change":"2023-12-19T13:46:30.956360+0000","last_active":"2023-12-19T13:46:32.479507+0000","last_peered":"2023-12-19T13:46:32.479507+0000","last_clean":"2023-12-19T13:46:32.479507+0000","last_became_active":"2023-12-19T13:46:30.954873+0000","last_became_peered":"2023-12-19T13:46:30.954873+0000","last_unstale":"2023-12-19T13:46:32.479507+0000","last_undegraded":"2023-12-19T13:46:32.479507+0000","last_fullsized":"2023-12-19T13:46:32.479507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939117+0000","last_change":"2023-12-19T13:46:30.471994+0000","last_active":"2023-12-19T13:46:30.939117+0000","last_peered":"2023-12-19T13:46:30.939117+0000","last_clean":"2023-12-19T13:46:30.939117+0000","last_became_active":"2023-12-19T13:46:30.471851+0000","last_became_peered":"2023-12-19T13:46:30.471851+0000","last_unstale":"2023-12-19T13:46:30.939117+0000","last_undegraded":"2023-12-19T13:46:30.939117+0000","last_fullsized":"2023-12-19T13:46:30.939117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481270+0000","last_change":"2023-12-19T13:46:30.939193+0000","last_active":"2023-12-19T13:46:32.481270+0000","last_peered":"2023-12-19T13:46:32.481270+0000","last_clean":"2023-12-19T13:46:32.481270+0000","last_became_active":"2023-12-19T13:46:30.938853+0000","last_became_peered":"2023-12-19T13:46:30.938853+0000","last_unstale":"2023-12-19T13:46:32.481270+0000","last_undegraded":"2023-12-19T13:46:32.481270+0000","last_fullsized":"2023-12-19T13:46:32.481270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:31.136164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937637+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:46:30.937637+0000","last_peered":"2023-12-19T13:46:30.937637+0000","last_clean":"2023-12-19T13:46:30.937637+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:46:30.937637+0000","last_undegraded":"2023-12-19T13:46:30.937637+0000","last_fullsized":"2023-12-19T13:46:30.937637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925861+0000","last_change":"2023-12-19T13:46:30.466620+0000","last_active":"2023-12-19T13:46:30.925861+0000","last_peered":"2023-12-19T13:46:30.925861+0000","last_clean":"2023-12-19T13:46:30.925861+0000","last_became_active":"2023-12-19T13:46:30.466140+0000","last_became_peered":"2023-12-19T13:46:30.466140+0000","last_unstale":"2023-12-19T13:46:30.925861+0000","last_undegraded":"2023-12-19T13:46:30.925861+0000","last_fullsized":"2023-12-19T13:46:30.925861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:54.770943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928217+0000","last_change":"2023-12-19T13:46:30.935325+0000","last_active":"2023-12-19T13:46:31.928217+0000","last_peered":"2023-12-19T13:46:31.928217+0000","last_clean":"2023-12-19T13:46:31.928217+0000","last_became_active":"2023-12-19T13:46:30.934910+0000","last_became_peered":"2023-12-19T13:46:30.934910+0000","last_unstale":"2023-12-19T13:46:31.928217+0000","last_undegraded":"2023-12-19T13:46:31.928217+0000","last_fullsized":"2023-12-19T13:46:31.928217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928316+0000","last_change":"2023-12-19T13:46:30.468537+0000","last_active":"2023-12-19T13:46:30.928316+0000","last_peered":"2023-12-19T13:46:30.928316+0000","last_clean":"2023-12-19T13:46:30.928316+0000","last_became_active":"2023-12-19T13:46:30.468301+0000","last_became_peered":"2023-12-19T13:46:30.468301+0000","last_unstale":"2023-12-19T13:46:30.928316+0000","last_undegraded":"2023-12-19T13:46:30.928316+0000","last_fullsized":"2023-12-19T13:46:30.928316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:39.901573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479355+0000","last_change":"2023-12-19T13:46:30.947051+0000","last_active":"2023-12-19T13:46:32.479355+0000","last_peered":"2023-12-19T13:46:32.479355+0000","last_clean":"2023-12-19T13:46:32.479355+0000","last_became_active":"2023-12-19T13:46:30.946837+0000","last_became_peered":"2023-12-19T13:46:30.946837+0000","last_unstale":"2023-12-19T13:46:32.479355+0000","last_undegraded":"2023-12-19T13:46:32.479355+0000","last_fullsized":"2023-12-19T13:46:32.479355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.929140+0000","last_change":"2023-12-19T13:46:30.456665+0000","last_active":"2023-12-19T13:46:30.929140+0000","last_peered":"2023-12-19T13:46:30.929140+0000","last_clean":"2023-12-19T13:46:30.929140+0000","last_became_active":"2023-12-19T13:46:30.456068+0000","last_became_peered":"2023-12-19T13:46:30.456068+0000","last_unstale":"2023-12-19T13:46:30.929140+0000","last_undegraded":"2023-12-19T13:46:30.929140+0000","last_fullsized":"2023-12-19T13:46:30.929140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.944823+0000","last_change":"2023-12-19T13:46:30.944565+0000","last_active":"2023-12-19T13:46:30.944823+0000","last_peered":"2023-12-19T13:46:30.944823+0000","last_clean":"2023-12-19T13:46:30.944823+0000","last_became_active":"2023-12-19T13:46:30.944091+0000","last_became_peered":"2023-12-19T13:46:30.944091+0000","last_unstale":"2023-12-19T13:46:30.944823+0000","last_undegraded":"2023-12-19T13:46:30.944823+0000","last_fullsized":"2023-12-19T13:46:30.944823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926212+0000","last_change":"2023-12-19T13:46:30.463352+0000","last_active":"2023-12-19T13:46:30.926212+0000","last_peered":"2023-12-19T13:46:30.926212+0000","last_clean":"2023-12-19T13:46:30.926212+0000","last_became_active":"2023-12-19T13:46:30.463056+0000","last_became_peered":"2023-12-19T13:46:30.463056+0000","last_unstale":"2023-12-19T13:46:30.926212+0000","last_undegraded":"2023-12-19T13:46:30.926212+0000","last_fullsized":"2023-12-19T13:46:30.926212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480115+0000","last_change":"2023-12-19T13:46:30.948432+0000","last_active":"2023-12-19T13:46:32.480115+0000","last_peered":"2023-12-19T13:46:32.480115+0000","last_clean":"2023-12-19T13:46:32.480115+0000","last_became_active":"2023-12-19T13:46:30.948068+0000","last_became_peered":"2023-12-19T13:46:30.948068+0000","last_unstale":"2023-12-19T13:46:32.480115+0000","last_undegraded":"2023-12-19T13:46:32.480115+0000","last_fullsized":"2023-12-19T13:46:32.480115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.941985+0000","last_change":"2023-12-19T13:46:30.463018+0000","last_active":"2023-12-19T13:46:30.941985+0000","last_peered":"2023-12-19T13:46:30.941985+0000","last_clean":"2023-12-19T13:46:30.941985+0000","last_became_active":"2023-12-19T13:46:30.462528+0000","last_became_peered":"2023-12-19T13:46:30.462528+0000","last_unstale":"2023-12-19T13:46:30.941985+0000","last_undegraded":"2023-12-19T13:46:30.941985+0000","last_fullsized":"2023-12-19T13:46:30.941985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932691+0000","last_change":"2023-12-19T13:46:30.949775+0000","last_active":"2023-12-19T13:46:31.932691+0000","last_peered":"2023-12-19T13:46:31.932691+0000","last_clean":"2023-12-19T13:46:31.932691+0000","last_became_active":"2023-12-19T13:46:30.949527+0000","last_became_peered":"2023-12-19T13:46:30.949527+0000","last_unstale":"2023-12-19T13:46:31.932691+0000","last_undegraded":"2023-12-19T13:46:31.932691+0000","last_fullsized":"2023-12-19T13:46:31.932691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928099+0000","last_change":"2023-12-19T13:46:30.463359+0000","last_active":"2023-12-19T13:46:30.928099+0000","last_peered":"2023-12-19T13:46:30.928099+0000","last_clean":"2023-12-19T13:46:30.928099+0000","last_became_active":"2023-12-19T13:46:30.463093+0000","last_became_peered":"2023-12-19T13:46:30.463093+0000","last_unstale":"2023-12-19T13:46:30.928099+0000","last_undegraded":"2023-12-19T13:46:30.928099+0000","last_fullsized":"2023-12-19T13:46:30.928099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:58.990876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478303+0000","last_change":"2023-12-19T13:46:30.954730+0000","last_active":"2023-12-19T13:46:32.478303+0000","last_peered":"2023-12-19T13:46:32.478303+0000","last_clean":"2023-12-19T13:46:32.478303+0000","last_became_active":"2023-12-19T13:46:30.954495+0000","last_became_peered":"2023-12-19T13:46:30.954495+0000","last_unstale":"2023-12-19T13:46:32.478303+0000","last_undegraded":"2023-12-19T13:46:32.478303+0000","last_fullsized":"2023-12-19T13:46:32.478303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:08.682812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928427+0000","last_change":"2023-12-19T13:46:30.470099+0000","last_active":"2023-12-19T13:46:31.928427+0000","last_peered":"2023-12-19T13:46:31.928427+0000","last_clean":"2023-12-19T13:46:31.928427+0000","last_became_active":"2023-12-19T13:46:30.469960+0000","last_became_peered":"2023-12-19T13:46:30.469960+0000","last_unstale":"2023-12-19T13:46:31.928427+0000","last_undegraded":"2023-12-19T13:46:31.928427+0000","last_fullsized":"2023-12-19T13:46:31.928427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928069+0000","last_change":"2023-12-19T13:46:30.944631+0000","last_active":"2023-12-19T13:46:31.928069+0000","last_peered":"2023-12-19T13:46:31.928069+0000","last_clean":"2023-12-19T13:46:31.928069+0000","last_became_active":"2023-12-19T13:46:30.943922+0000","last_became_peered":"2023-12-19T13:46:30.943922+0000","last_unstale":"2023-12-19T13:46:31.928069+0000","last_undegraded":"2023-12-19T13:46:31.928069+0000","last_fullsized":"2023-12-19T13:46:31.928069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959854+0000","last_change":"2023-12-19T13:46:30.472244+0000","last_active":"2023-12-19T13:46:30.959854+0000","last_peered":"2023-12-19T13:46:30.959854+0000","last_clean":"2023-12-19T13:46:30.959854+0000","last_became_active":"2023-12-19T13:46:30.471954+0000","last_became_peered":"2023-12-19T13:46:30.471954+0000","last_unstale":"2023-12-19T13:46:30.959854+0000","last_undegraded":"2023-12-19T13:46:30.959854+0000","last_fullsized":"2023-12-19T13:46:30.959854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927854+0000","last_change":"2023-12-19T13:46:30.939034+0000","last_active":"2023-12-19T13:46:31.927854+0000","last_peered":"2023-12-19T13:46:31.927854+0000","last_clean":"2023-12-19T13:46:31.927854+0000","last_became_active":"2023-12-19T13:46:30.938407+0000","last_became_peered":"2023-12-19T13:46:30.938407+0000","last_unstale":"2023-12-19T13:46:31.927854+0000","last_undegraded":"2023-12-19T13:46:31.927854+0000","last_fullsized":"2023-12-19T13:46:31.927854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.936764+0000","last_change":"2023-12-19T13:46:30.469524+0000","last_active":"2023-12-19T13:46:30.936764+0000","last_peered":"2023-12-19T13:46:30.936764+0000","last_clean":"2023-12-19T13:46:30.936764+0000","last_became_active":"2023-12-19T13:46:30.467130+0000","last_became_peered":"2023-12-19T13:46:30.467130+0000","last_unstale":"2023-12-19T13:46:30.936764+0000","last_undegraded":"2023-12-19T13:46:30.936764+0000","last_fullsized":"2023-12-19T13:46:30.936764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:25.754683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481642+0000","last_change":"2023-12-19T13:46:30.948464+0000","last_active":"2023-12-19T13:46:32.481642+0000","last_peered":"2023-12-19T13:46:32.481642+0000","last_clean":"2023-12-19T13:46:32.481642+0000","last_became_active":"2023-12-19T13:46:30.941429+0000","last_became_peered":"2023-12-19T13:46:30.941429+0000","last_unstale":"2023-12-19T13:46:32.481642+0000","last_undegraded":"2023-12-19T13:46:32.481642+0000","last_fullsized":"2023-12-19T13:46:32.481642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:14.644536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932435+0000","last_change":"2023-12-19T13:46:30.467632+0000","last_active":"2023-12-19T13:46:30.932435+0000","last_peered":"2023-12-19T13:46:30.932435+0000","last_clean":"2023-12-19T13:46:30.932435+0000","last_became_active":"2023-12-19T13:46:30.467326+0000","last_became_peered":"2023-12-19T13:46:30.467326+0000","last_unstale":"2023-12-19T13:46:30.932435+0000","last_undegraded":"2023-12-19T13:46:30.932435+0000","last_fullsized":"2023-12-19T13:46:30.932435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928264+0000","last_change":"2023-12-19T13:46:30.945501+0000","last_active":"2023-12-19T13:46:31.928264+0000","last_peered":"2023-12-19T13:46:31.928264+0000","last_clean":"2023-12-19T13:46:31.928264+0000","last_became_active":"2023-12-19T13:46:30.945070+0000","last_became_peered":"2023-12-19T13:46:30.945070+0000","last_unstale":"2023-12-19T13:46:31.928264+0000","last_undegraded":"2023-12-19T13:46:31.928264+0000","last_fullsized":"2023-12-19T13:46:31.928264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938563+0000","last_change":"2023-12-19T13:46:30.468143+0000","last_active":"2023-12-19T13:46:30.938563+0000","last_peered":"2023-12-19T13:46:30.938563+0000","last_clean":"2023-12-19T13:46:30.938563+0000","last_became_active":"2023-12-19T13:46:30.467699+0000","last_became_peered":"2023-12-19T13:46:30.467699+0000","last_unstale":"2023-12-19T13:46:30.938563+0000","last_undegraded":"2023-12-19T13:46:30.938563+0000","last_fullsized":"2023-12-19T13:46:30.938563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.947589+0000","last_change":"2023-12-19T13:46:30.947222+0000","last_active":"2023-12-19T13:46:30.947589+0000","last_peered":"2023-12-19T13:46:30.947589+0000","last_clean":"2023-12-19T13:46:30.947589+0000","last_became_active":"2023-12-19T13:46:30.947006+0000","last_became_peered":"2023-12-19T13:46:30.947006+0000","last_unstale":"2023-12-19T13:46:30.947589+0000","last_undegraded":"2023-12-19T13:46:30.947589+0000","last_fullsized":"2023-12-19T13:46:30.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958497+0000","last_change":"2023-12-19T13:46:30.465441+0000","last_active":"2023-12-19T13:46:30.958497+0000","last_peered":"2023-12-19T13:46:30.958497+0000","last_clean":"2023-12-19T13:46:30.958497+0000","last_became_active":"2023-12-19T13:46:30.465103+0000","last_became_peered":"2023-12-19T13:46:30.465103+0000","last_unstale":"2023-12-19T13:46:30.958497+0000","last_undegraded":"2023-12-19T13:46:30.958497+0000","last_fullsized":"2023-12-19T13:46:30.958497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478407+0000","last_change":"2023-12-19T13:46:30.952729+0000","last_active":"2023-12-19T13:46:32.478407+0000","last_peered":"2023-12-19T13:46:32.478407+0000","last_clean":"2023-12-19T13:46:32.478407+0000","last_became_active":"2023-12-19T13:46:30.950922+0000","last_became_peered":"2023-12-19T13:46:30.950922+0000","last_unstale":"2023-12-19T13:46:32.478407+0000","last_undegraded":"2023-12-19T13:46:32.478407+0000","last_fullsized":"2023-12-19T13:46:32.478407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:13.580642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481163+0000","last_change":"2023-12-19T13:46:30.957451+0000","last_active":"2023-12-19T13:46:32.481163+0000","last_peered":"2023-12-19T13:46:32.481163+0000","last_clean":"2023-12-19T13:46:32.481163+0000","last_became_active":"2023-12-19T13:46:30.955947+0000","last_became_peered":"2023-12-19T13:46:30.955947+0000","last_unstale":"2023-12-19T13:46:32.481163+0000","last_undegraded":"2023-12-19T13:46:32.481163+0000","last_fullsized":"2023-12-19T13:46:32.481163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:07.116909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959781+0000","last_change":"2023-12-19T13:46:30.470680+0000","last_active":"2023-12-19T13:46:30.959781+0000","last_peered":"2023-12-19T13:46:30.959781+0000","last_clean":"2023-12-19T13:46:30.959781+0000","last_became_active":"2023-12-19T13:46:30.470409+0000","last_became_peered":"2023-12-19T13:46:30.470409+0000","last_unstale":"2023-12-19T13:46:30.959781+0000","last_undegraded":"2023-12-19T13:46:30.959781+0000","last_fullsized":"2023-12-19T13:46:30.959781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479758+0000","last_change":"2023-12-19T13:46:30.946912+0000","last_active":"2023-12-19T13:46:32.479758+0000","last_peered":"2023-12-19T13:46:32.479758+0000","last_clean":"2023-12-19T13:46:32.479758+0000","last_became_active":"2023-12-19T13:46:30.946689+0000","last_became_peered":"2023-12-19T13:46:30.946689+0000","last_unstale":"2023-12-19T13:46:32.479758+0000","last_undegraded":"2023-12-19T13:46:32.479758+0000","last_fullsized":"2023-12-19T13:46:32.479758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960456+0000","last_change":"2023-12-19T13:46:30.470862+0000","last_active":"2023-12-19T13:46:30.960456+0000","last_peered":"2023-12-19T13:46:30.960456+0000","last_clean":"2023-12-19T13:46:30.960456+0000","last_became_active":"2023-12-19T13:46:30.470428+0000","last_became_peered":"2023-12-19T13:46:30.470428+0000","last_unstale":"2023-12-19T13:46:30.960456+0000","last_undegraded":"2023-12-19T13:46:30.960456+0000","last_fullsized":"2023-12-19T13:46:30.960456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950966+0000","last_change":"2023-12-19T13:46:30.949145+0000","last_active":"2023-12-19T13:46:30.950966+0000","last_peered":"2023-12-19T13:46:30.950966+0000","last_clean":"2023-12-19T13:46:30.950966+0000","last_became_active":"2023-12-19T13:46:30.946515+0000","last_became_peered":"2023-12-19T13:46:30.946515+0000","last_unstale":"2023-12-19T13:46:30.950966+0000","last_undegraded":"2023-12-19T13:46:30.950966+0000","last_fullsized":"2023-12-19T13:46:30.950966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953453+0000","last_change":"2023-12-19T13:46:30.449386+0000","last_active":"2023-12-19T13:46:30.953453+0000","last_peered":"2023-12-19T13:46:30.953453+0000","last_clean":"2023-12-19T13:46:30.953453+0000","last_became_active":"2023-12-19T13:46:30.448900+0000","last_became_peered":"2023-12-19T13:46:30.448900+0000","last_unstale":"2023-12-19T13:46:30.953453+0000","last_undegraded":"2023-12-19T13:46:30.953453+0000","last_fullsized":"2023-12-19T13:46:30.953453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952114+0000","last_change":"2023-12-19T13:46:30.952009+0000","last_active":"2023-12-19T13:46:30.952114+0000","last_peered":"2023-12-19T13:46:30.952114+0000","last_clean":"2023-12-19T13:46:30.952114+0000","last_became_active":"2023-12-19T13:46:30.951734+0000","last_became_peered":"2023-12-19T13:46:30.951734+0000","last_unstale":"2023-12-19T13:46:30.952114+0000","last_undegraded":"2023-12-19T13:46:30.952114+0000","last_fullsized":"2023-12-19T13:46:30.952114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959118+0000","last_change":"2023-12-19T13:46:30.458973+0000","last_active":"2023-12-19T13:46:30.959118+0000","last_peered":"2023-12-19T13:46:30.959118+0000","last_clean":"2023-12-19T13:46:30.959118+0000","last_became_active":"2023-12-19T13:46:30.458267+0000","last_became_peered":"2023-12-19T13:46:30.458267+0000","last_unstale":"2023-12-19T13:46:30.959118+0000","last_undegraded":"2023-12-19T13:46:30.959118+0000","last_fullsized":"2023-12-19T13:46:30.959118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]}],"pool_statfs":[]}} 2023-12-19T13:46:46.209 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:46:46.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.458+0000 7f5884b4e640 1 Processor -- start 2023-12-19T13:46:46.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.458+0000 7f5884b4e640 1 -- start start 2023-12-19T13:46:46.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f5884b4e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58801449e0 0x7f58800af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f5884b4e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800afb10 con 0x7f588006c6b0 2023-12-19T13:46:46.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f5884b4e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588006bb30 con 0x7f58800b0b50 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f5884b4e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800b0070 con 0x7f58801449e0 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f587e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58801449e0 0x7f58800af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f587e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58801449e0 0x7f58800af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43838/0 (socket says 172.21.15.113:43838) 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f587ed9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f588006c6b0 0x7f58800b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59488/0 (socket says 172.21.15.113:59488) 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.460+0000 7f587e59c640 1 -- 172.21.15.113:0/2904038286 learned_addr learned my addr 172.21.15.113:0/2904038286 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.461+0000 7f587e59c640 1 -- 172.21.15.113:0/2904038286 >> v1:172.21.15.151:6789/0 conn(0x7f58800b0b50 legacy=0x7f588006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.461+0000 7f587e59c640 1 -- 172.21.15.113:0/2904038286 >> v1:172.21.15.113:6789/0 conn(0x7f588006c6b0 legacy=0x7f58800b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.461+0000 7f587dd9b640 1 -- 172.21.15.113:0/2904038286 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938925636 0 0) 0x7f58800afb10 con 0x7f588006c6b0 2023-12-19T13:46:46.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.461+0000 7f587e59c640 1 -- 172.21.15.113:0/2904038286 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800b0350 con 0x7f58801449e0 2023-12-19T13:46:46.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.462+0000 7f587e59c640 1 --2- 172.21.15.113:0/2904038286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f58800af5d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5870009870 tx=0x7f587002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab05727539272e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.462+0000 7f587dd9b640 1 -- 172.21.15.113:0/2904038286 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870030860 con 0x7f58801449e0 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.462+0000 7f587dd9b640 1 -- 172.21.15.113:0/2904038286 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58700309c0 con 0x7f58801449e0 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.462+0000 7f587dd9b640 1 -- 172.21.15.113:0/2904038286 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870030d50 con 0x7f58801449e0 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.463+0000 7f5884b4e640 1 -- 172.21.15.113:0/2904038286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 msgr2=0x7f58800af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.463+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2904038286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f58800af5d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5870009870 tx=0x7f587002b9a0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.463+0000 7f5884b4e640 1 -- 172.21.15.113:0/2904038286 shutdown_connections 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.463+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2904038286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f58800af5d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.463+0000 7f5884b4e640 1 -- 172.21.15.113:0/2904038286 >> 172.21.15.113:0/2904038286 conn(0x7f58800cbb70 msgr2=0x7f58800cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.463+0000 7f5884b4e640 1 -- 172.21.15.113:0/2904038286 shutdown_connections 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.463+0000 7f5884b4e640 1 -- 172.21.15.113:0/2904038286 wait complete. 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.465+0000 7f5884b4e640 1 Processor -- start 2023-12-19T13:46:46.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.465+0000 7f5884b4e640 1 -- start start 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f5884b4e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f588006c6b0 0x7f588013c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f5884b4e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58800b0b50 0x7f588014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f5884b4e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f588014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f5884b4e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588014b290 con 0x7f58801449e0 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f5884b4e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588014b570 con 0x7f58800b0b50 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f5884b4e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588014b850 con 0x7f588006c6b0 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f588014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f588014c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43840/0 (socket says 172.21.15.113:43840) 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 -- 172.21.15.113:0/2633051442 learned_addr learned my addr 172.21.15.113:0/2633051442 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587e59c640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f588006c6b0 0x7f588013c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f5877fff640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58800b0b50 0x7f588014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 -- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f588006c6b0 msgr2=0x7f588013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f588006c6b0 0x7f588013c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 -- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58800b0b50 msgr2=0x7f588014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58800b0b50 0x7f588014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.466+0000 7f587ed9d640 1 -- 172.21.15.113:0/2633051442 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700094d0 con 0x7f58801449e0 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.467+0000 7f5877fff640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58800b0b50 0x7f588014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.467+0000 7f587ed9d640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f588014c8a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f587800c7e0 tx=0x7f587800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.467+0000 7f5876ffd640 1 -- 172.21.15.113:0/2633051442 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800a640 con 0x7f58801449e0 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.467+0000 7f5876ffd640 1 -- 172.21.15.113:0/2633051442 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587800a7c0 con 0x7f58801449e0 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.467+0000 7f5876ffd640 1 -- 172.21.15.113:0/2633051442 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800ab70 con 0x7f58801449e0 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.467+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588014bb30 con 0x7f58801449e0 2023-12-19T13:46:46.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.467+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588013cec0 con 0x7f58801449e0 2023-12-19T13:46:46.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.468+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588014c050 con 0x7f58801449e0 2023-12-19T13:46:46.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.469+0000 7f5876ffd640 1 -- 172.21.15.113:0/2633051442 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f587800acd0 con 0x7f58801449e0 2023-12-19T13:46:46.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.470+0000 7f5876ffd640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.470+0000 7f5876ffd640 1 -- 172.21.15.113:0/2633051442 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5878087eb0 con 0x7f58801449e0 2023-12-19T13:46:46.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.471+0000 7f587e59c640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.471+0000 7f587e59c640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5870036000 tx=0x7f587003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:46.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.474+0000 7f5876ffd640 1 -- 172.21.15.113:0/2633051442 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f588014c050 con 0x7f58801449e0 2023-12-19T13:46:46.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.645+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f588014b6e0 con 0x7f586006a430 2023-12-19T13:46:46.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.656+0000 7f5876ffd640 1 -- 172.21.15.113:0/2633051442 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260093 (secure 0 0 0) 0x7f588014b6e0 con 0x7f586006a430 2023-12-19T13:46:46.661 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:46.662 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:46:46.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 msgr2=0x7f586006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5870036000 tx=0x7f587003b040 comp rx=0 tx=0).stop 2023-12-19T13:46:46.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 msgr2=0x7f588014c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f588014c8a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f587800c7e0 tx=0x7f587800cca0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 shutdown_connections 2023-12-19T13:46:46.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f586006a430 0x7f586006c8f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58801449e0 0x7f588014c8a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58800b0b50 0x7f588014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 --2- 172.21.15.113:0/2633051442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f588006c6b0 0x7f588013c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 >> 172.21.15.113:0/2633051442 conn(0x7f58800cbb70 msgr2=0x7f58800cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:46.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 shutdown_connections 2023-12-19T13:46:46.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.662+0000 7f5884b4e640 1 -- 172.21.15.113:0/2633051442 wait complete. 2023-12-19T13:46:46.680 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-19T13:46:46.414912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004187"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479619+0000","last_change":"2023-12-19T13:46:30.947466+0000","last_active":"2023-12-19T13:46:32.479619+0000","last_peered":"2023-12-19T13:46:32.479619+0000","last_clean":"2023-12-19T13:46:32.479619+0000","last_became_active":"2023-12-19T13:46:30.944804+0000","last_became_peered":"2023-12-19T13:46:30.944804+0000","last_unstale":"2023-12-19T13:46:32.479619+0000","last_undegraded":"2023-12-19T13:46:32.479619+0000","last_fullsized":"2023-12-19T13:46:32.479619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949108+0000","last_change":"2023-12-19T13:46:30.947759+0000","last_active":"2023-12-19T13:46:30.949108+0000","last_peered":"2023-12-19T13:46:30.949108+0000","last_clean":"2023-12-19T13:46:30.949108+0000","last_became_active":"2023-12-19T13:46:30.947539+0000","last_became_peered":"2023-12-19T13:46:30.947539+0000","last_unstale":"2023-12-19T13:46:30.949108+0000","last_undegraded":"2023-12-19T13:46:30.949108+0000","last_fullsized":"2023-12-19T13:46:30.949108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949060+0000","last_change":"2023-12-19T13:46:30.947127+0000","last_active":"2023-12-19T13:46:30.949060+0000","last_peered":"2023-12-19T13:46:30.949060+0000","last_clean":"2023-12-19T13:46:30.949060+0000","last_became_active":"2023-12-19T13:46:30.946112+0000","last_became_peered":"2023-12-19T13:46:30.946112+0000","last_unstale":"2023-12-19T13:46:30.949060+0000","last_undegraded":"2023-12-19T13:46:30.949060+0000","last_fullsized":"2023-12-19T13:46:30.949060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:31.692673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932443+0000","last_change":"2023-12-19T13:46:30.944335+0000","last_active":"2023-12-19T13:46:31.932443+0000","last_peered":"2023-12-19T13:46:31.932443+0000","last_clean":"2023-12-19T13:46:31.932443+0000","last_became_active":"2023-12-19T13:46:30.943978+0000","last_became_peered":"2023-12-19T13:46:30.943978+0000","last_unstale":"2023-12-19T13:46:31.932443+0000","last_undegraded":"2023-12-19T13:46:31.932443+0000","last_fullsized":"2023-12-19T13:46:31.932443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480797+0000","last_change":"2023-12-19T13:46:30.958489+0000","last_active":"2023-12-19T13:46:32.480797+0000","last_peered":"2023-12-19T13:46:32.480797+0000","last_clean":"2023-12-19T13:46:32.480797+0000","last_became_active":"2023-12-19T13:46:30.957947+0000","last_became_peered":"2023-12-19T13:46:30.957947+0000","last_unstale":"2023-12-19T13:46:32.480797+0000","last_undegraded":"2023-12-19T13:46:32.480797+0000","last_fullsized":"2023-12-19T13:46:32.480797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932704+0000","last_change":"2023-12-19T13:46:30.941012+0000","last_active":"2023-12-19T13:46:31.932704+0000","last_peered":"2023-12-19T13:46:31.932704+0000","last_clean":"2023-12-19T13:46:31.932704+0000","last_became_active":"2023-12-19T13:46:30.940674+0000","last_became_peered":"2023-12-19T13:46:30.940674+0000","last_unstale":"2023-12-19T13:46:31.932704+0000","last_undegraded":"2023-12-19T13:46:31.932704+0000","last_fullsized":"2023-12-19T13:46:31.932704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480352+0000","last_change":"2023-12-19T13:46:30.956208+0000","last_active":"2023-12-19T13:46:32.480352+0000","last_peered":"2023-12-19T13:46:32.480352+0000","last_clean":"2023-12-19T13:46:32.480352+0000","last_became_active":"2023-12-19T13:46:30.954562+0000","last_became_peered":"2023-12-19T13:46:30.954562+0000","last_unstale":"2023-12-19T13:46:32.480352+0000","last_undegraded":"2023-12-19T13:46:32.480352+0000","last_fullsized":"2023-12-19T13:46:32.480352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951004+0000","last_change":"2023-12-19T13:46:30.949875+0000","last_active":"2023-12-19T13:46:30.951004+0000","last_peered":"2023-12-19T13:46:30.951004+0000","last_clean":"2023-12-19T13:46:30.951004+0000","last_became_active":"2023-12-19T13:46:30.949625+0000","last_became_peered":"2023-12-19T13:46:30.949625+0000","last_unstale":"2023-12-19T13:46:30.951004+0000","last_undegraded":"2023-12-19T13:46:30.951004+0000","last_fullsized":"2023-12-19T13:46:30.951004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:18.684952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478175+0000","last_change":"2023-12-19T13:46:30.940157+0000","last_active":"2023-12-19T13:46:32.478175+0000","last_peered":"2023-12-19T13:46:32.478175+0000","last_clean":"2023-12-19T13:46:32.478175+0000","last_became_active":"2023-12-19T13:46:30.939947+0000","last_became_peered":"2023-12-19T13:46:30.939947+0000","last_unstale":"2023-12-19T13:46:32.478175+0000","last_undegraded":"2023-12-19T13:46:32.478175+0000","last_fullsized":"2023-12-19T13:46:32.478175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480049+0000","last_change":"2023-12-19T13:46:30.958360+0000","last_active":"2023-12-19T13:46:32.480049+0000","last_peered":"2023-12-19T13:46:32.480049+0000","last_clean":"2023-12-19T13:46:32.480049+0000","last_became_active":"2023-12-19T13:46:30.957433+0000","last_became_peered":"2023-12-19T13:46:30.957433+0000","last_unstale":"2023-12-19T13:46:32.480049+0000","last_undegraded":"2023-12-19T13:46:32.480049+0000","last_fullsized":"2023-12-19T13:46:32.480049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479889+0000","last_change":"2023-12-19T13:46:30.946461+0000","last_active":"2023-12-19T13:46:32.479889+0000","last_peered":"2023-12-19T13:46:32.479889+0000","last_clean":"2023-12-19T13:46:32.479889+0000","last_became_active":"2023-12-19T13:46:30.944536+0000","last_became_peered":"2023-12-19T13:46:30.944536+0000","last_unstale":"2023-12-19T13:46:32.479889+0000","last_undegraded":"2023-12-19T13:46:32.479889+0000","last_fullsized":"2023-12-19T13:46:32.479889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479093+0000","last_change":"2023-12-19T13:46:30.955116+0000","last_active":"2023-12-19T13:46:32.479093+0000","last_peered":"2023-12-19T13:46:32.479093+0000","last_clean":"2023-12-19T13:46:32.479093+0000","last_became_active":"2023-12-19T13:46:30.954208+0000","last_became_peered":"2023-12-19T13:46:30.954208+0000","last_unstale":"2023-12-19T13:46:32.479093+0000","last_undegraded":"2023-12-19T13:46:32.479093+0000","last_fullsized":"2023-12-19T13:46:32.479093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477789+0000","last_change":"2023-12-19T13:46:30.951097+0000","last_active":"2023-12-19T13:46:32.477789+0000","last_peered":"2023-12-19T13:46:32.477789+0000","last_clean":"2023-12-19T13:46:32.477789+0000","last_became_active":"2023-12-19T13:46:30.950596+0000","last_became_peered":"2023-12-19T13:46:30.950596+0000","last_unstale":"2023-12-19T13:46:32.477789+0000","last_undegraded":"2023-12-19T13:46:32.477789+0000","last_fullsized":"2023-12-19T13:46:32.477789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477725+0000","last_change":"2023-12-19T13:46:30.951645+0000","last_active":"2023-12-19T13:46:32.477725+0000","last_peered":"2023-12-19T13:46:32.477725+0000","last_clean":"2023-12-19T13:46:32.477725+0000","last_became_active":"2023-12-19T13:46:30.951372+0000","last_became_peered":"2023-12-19T13:46:30.951372+0000","last_unstale":"2023-12-19T13:46:32.477725+0000","last_undegraded":"2023-12-19T13:46:32.477725+0000","last_fullsized":"2023-12-19T13:46:32.477725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960243+0000","last_change":"2023-12-19T13:46:30.960188+0000","last_active":"2023-12-19T13:46:30.960243+0000","last_peered":"2023-12-19T13:46:30.960243+0000","last_clean":"2023-12-19T13:46:30.960243+0000","last_became_active":"2023-12-19T13:46:30.959885+0000","last_became_peered":"2023-12-19T13:46:30.959885+0000","last_unstale":"2023-12-19T13:46:30.960243+0000","last_undegraded":"2023-12-19T13:46:30.960243+0000","last_fullsized":"2023-12-19T13:46:30.960243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:59.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481033+0000","last_change":"2023-12-19T13:46:30.932726+0000","last_active":"2023-12-19T13:46:32.481033+0000","last_peered":"2023-12-19T13:46:32.481033+0000","last_clean":"2023-12-19T13:46:32.481033+0000","last_became_active":"2023-12-19T13:46:30.931668+0000","last_became_peered":"2023-12-19T13:46:30.931668+0000","last_unstale":"2023-12-19T13:46:32.481033+0000","last_undegraded":"2023-12-19T13:46:32.481033+0000","last_fullsized":"2023-12-19T13:46:32.481033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478349+0000","last_change":"2023-12-19T13:46:30.957418+0000","last_active":"2023-12-19T13:46:32.478349+0000","last_peered":"2023-12-19T13:46:32.478349+0000","last_clean":"2023-12-19T13:46:32.478349+0000","last_became_active":"2023-12-19T13:46:30.957187+0000","last_became_peered":"2023-12-19T13:46:30.957187+0000","last_unstale":"2023-12-19T13:46:32.478349+0000","last_undegraded":"2023-12-19T13:46:32.478349+0000","last_fullsized":"2023-12-19T13:46:32.478349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:03.460723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.934059+0000","last_change":"2023-12-19T13:46:30.933939+0000","last_active":"2023-12-19T13:46:30.934059+0000","last_peered":"2023-12-19T13:46:30.934059+0000","last_clean":"2023-12-19T13:46:30.934059+0000","last_became_active":"2023-12-19T13:46:30.933698+0000","last_became_peered":"2023-12-19T13:46:30.933698+0000","last_unstale":"2023-12-19T13:46:30.934059+0000","last_undegraded":"2023-12-19T13:46:30.934059+0000","last_fullsized":"2023-12-19T13:46:30.934059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478667+0000","last_change":"2023-12-19T13:46:30.954479+0000","last_active":"2023-12-19T13:46:32.478667+0000","last_peered":"2023-12-19T13:46:32.478667+0000","last_clean":"2023-12-19T13:46:32.478667+0000","last_became_active":"2023-12-19T13:46:30.953640+0000","last_became_peered":"2023-12-19T13:46:30.953640+0000","last_unstale":"2023-12-19T13:46:32.478667+0000","last_undegraded":"2023-12-19T13:46:32.478667+0000","last_fullsized":"2023-12-19T13:46:32.478667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:14.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480286+0000","last_change":"2023-12-19T13:46:30.957735+0000","last_active":"2023-12-19T13:46:32.480286+0000","last_peered":"2023-12-19T13:46:32.480286+0000","last_clean":"2023-12-19T13:46:32.480286+0000","last_became_active":"2023-12-19T13:46:30.954757+0000","last_became_peered":"2023-12-19T13:46:30.954757+0000","last_unstale":"2023-12-19T13:46:32.480286+0000","last_undegraded":"2023-12-19T13:46:32.480286+0000","last_fullsized":"2023-12-19T13:46:32.480286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:10.156563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928022+0000","last_change":"2023-12-19T13:46:30.935192+0000","last_active":"2023-12-19T13:46:31.928022+0000","last_peered":"2023-12-19T13:46:31.928022+0000","last_clean":"2023-12-19T13:46:31.928022+0000","last_became_active":"2023-12-19T13:46:30.934966+0000","last_became_peered":"2023-12-19T13:46:30.934966+0000","last_unstale":"2023-12-19T13:46:31.928022+0000","last_undegraded":"2023-12-19T13:46:31.928022+0000","last_fullsized":"2023-12-19T13:46:31.928022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479248+0000","last_change":"2023-12-19T13:46:30.957999+0000","last_active":"2023-12-19T13:46:32.479248+0000","last_peered":"2023-12-19T13:46:32.479248+0000","last_clean":"2023-12-19T13:46:32.479248+0000","last_became_active":"2023-12-19T13:46:30.957775+0000","last_became_peered":"2023-12-19T13:46:30.957775+0000","last_unstale":"2023-12-19T13:46:32.479248+0000","last_undegraded":"2023-12-19T13:46:32.479248+0000","last_fullsized":"2023-12-19T13:46:32.479248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:33.923739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950982+0000","last_change":"2023-12-19T13:46:30.949299+0000","last_active":"2023-12-19T13:46:30.950982+0000","last_peered":"2023-12-19T13:46:30.950982+0000","last_clean":"2023-12-19T13:46:30.950982+0000","last_became_active":"2023-12-19T13:46:30.946882+0000","last_became_peered":"2023-12-19T13:46:30.946882+0000","last_unstale":"2023-12-19T13:46:30.950982+0000","last_undegraded":"2023-12-19T13:46:30.950982+0000","last_fullsized":"2023-12-19T13:46:30.950982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477911+0000","last_change":"2023-12-19T13:46:30.954278+0000","last_active":"2023-12-19T13:46:32.477911+0000","last_peered":"2023-12-19T13:46:32.477911+0000","last_clean":"2023-12-19T13:46:32.477911+0000","last_became_active":"2023-12-19T13:46:30.952450+0000","last_became_peered":"2023-12-19T13:46:30.952450+0000","last_unstale":"2023-12-19T13:46:32.477911+0000","last_undegraded":"2023-12-19T13:46:32.477911+0000","last_fullsized":"2023-12-19T13:46:32.477911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:50.573113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955765+0000","last_change":"2023-12-19T13:46:30.954346+0000","last_active":"2023-12-19T13:46:30.955765+0000","last_peered":"2023-12-19T13:46:30.955765+0000","last_clean":"2023-12-19T13:46:30.955765+0000","last_became_active":"2023-12-19T13:46:30.952500+0000","last_became_peered":"2023-12-19T13:46:30.952500+0000","last_unstale":"2023-12-19T13:46:30.955765+0000","last_undegraded":"2023-12-19T13:46:30.955765+0000","last_fullsized":"2023-12-19T13:46:30.955765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932905+0000","last_change":"2023-12-19T13:46:30.931389+0000","last_active":"2023-12-19T13:46:31.932905+0000","last_peered":"2023-12-19T13:46:31.932905+0000","last_clean":"2023-12-19T13:46:31.932905+0000","last_became_active":"2023-12-19T13:46:30.931071+0000","last_became_peered":"2023-12-19T13:46:30.931071+0000","last_unstale":"2023-12-19T13:46:31.932905+0000","last_undegraded":"2023-12-19T13:46:31.932905+0000","last_fullsized":"2023-12-19T13:46:31.932905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478415+0000","last_change":"2023-12-19T13:46:30.952230+0000","last_active":"2023-12-19T13:46:32.478415+0000","last_peered":"2023-12-19T13:46:32.478415+0000","last_clean":"2023-12-19T13:46:32.478415+0000","last_became_active":"2023-12-19T13:46:30.952001+0000","last_became_peered":"2023-12-19T13:46:30.952001+0000","last_unstale":"2023-12-19T13:46:32.478415+0000","last_undegraded":"2023-12-19T13:46:32.478415+0000","last_fullsized":"2023-12-19T13:46:32.478415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:02.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479226+0000","last_change":"2023-12-19T13:46:30.950882+0000","last_active":"2023-12-19T13:46:32.479226+0000","last_peered":"2023-12-19T13:46:32.479226+0000","last_clean":"2023-12-19T13:46:32.479226+0000","last_became_active":"2023-12-19T13:46:30.950214+0000","last_became_peered":"2023-12-19T13:46:30.950214+0000","last_unstale":"2023-12-19T13:46:32.479226+0000","last_undegraded":"2023-12-19T13:46:32.479226+0000","last_fullsized":"2023-12-19T13:46:32.479226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952004+0000","last_change":"2023-12-19T13:46:30.948716+0000","last_active":"2023-12-19T13:46:30.952004+0000","last_peered":"2023-12-19T13:46:30.952004+0000","last_clean":"2023-12-19T13:46:30.952004+0000","last_became_active":"2023-12-19T13:46:30.948483+0000","last_became_peered":"2023-12-19T13:46:30.948483+0000","last_unstale":"2023-12-19T13:46:30.952004+0000","last_undegraded":"2023-12-19T13:46:30.952004+0000","last_fullsized":"2023-12-19T13:46:30.952004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480930+0000","last_change":"2023-12-19T13:46:30.950655+0000","last_active":"2023-12-19T13:46:32.480930+0000","last_peered":"2023-12-19T13:46:32.480930+0000","last_clean":"2023-12-19T13:46:32.480930+0000","last_became_active":"2023-12-19T13:46:30.950446+0000","last_became_peered":"2023-12-19T13:46:30.950446+0000","last_unstale":"2023-12-19T13:46:32.480930+0000","last_undegraded":"2023-12-19T13:46:32.480930+0000","last_fullsized":"2023-12-19T13:46:32.480930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:05.776092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939565+0000","last_change":"2023-12-19T13:46:30.938955+0000","last_active":"2023-12-19T13:46:30.939565+0000","last_peered":"2023-12-19T13:46:30.939565+0000","last_clean":"2023-12-19T13:46:30.939565+0000","last_became_active":"2023-12-19T13:46:30.938382+0000","last_became_peered":"2023-12-19T13:46:30.938382+0000","last_unstale":"2023-12-19T13:46:30.939565+0000","last_undegraded":"2023-12-19T13:46:30.939565+0000","last_fullsized":"2023-12-19T13:46:30.939565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932221+0000","last_change":"2023-12-19T13:46:30.949294+0000","last_active":"2023-12-19T13:46:31.932221+0000","last_peered":"2023-12-19T13:46:31.932221+0000","last_clean":"2023-12-19T13:46:31.932221+0000","last_became_active":"2023-12-19T13:46:30.949073+0000","last_became_peered":"2023-12-19T13:46:30.949073+0000","last_unstale":"2023-12-19T13:46:31.932221+0000","last_undegraded":"2023-12-19T13:46:31.932221+0000","last_fullsized":"2023-12-19T13:46:31.932221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478387+0000","last_change":"2023-12-19T13:46:30.950387+0000","last_active":"2023-12-19T13:46:32.478387+0000","last_peered":"2023-12-19T13:46:32.478387+0000","last_clean":"2023-12-19T13:46:32.478387+0000","last_became_active":"2023-12-19T13:46:30.947508+0000","last_became_peered":"2023-12-19T13:46:30.947508+0000","last_unstale":"2023-12-19T13:46:32.478387+0000","last_undegraded":"2023-12-19T13:46:32.478387+0000","last_fullsized":"2023-12-19T13:46:32.478387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:04.659427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955028+0000","last_change":"2023-12-19T13:46:30.463700+0000","last_active":"2023-12-19T13:46:30.955028+0000","last_peered":"2023-12-19T13:46:30.955028+0000","last_clean":"2023-12-19T13:46:30.955028+0000","last_became_active":"2023-12-19T13:46:30.463230+0000","last_became_peered":"2023-12-19T13:46:30.463230+0000","last_unstale":"2023-12-19T13:46:30.955028+0000","last_undegraded":"2023-12-19T13:46:30.955028+0000","last_fullsized":"2023-12-19T13:46:30.955028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927907+0000","last_change":"2023-12-19T13:46:30.956149+0000","last_active":"2023-12-19T13:46:31.927907+0000","last_peered":"2023-12-19T13:46:31.927907+0000","last_clean":"2023-12-19T13:46:31.927907+0000","last_became_active":"2023-12-19T13:46:30.955830+0000","last_became_peered":"2023-12-19T13:46:30.955830+0000","last_unstale":"2023-12-19T13:46:31.927907+0000","last_undegraded":"2023-12-19T13:46:31.927907+0000","last_fullsized":"2023-12-19T13:46:31.927907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960209+0000","last_change":"2023-12-19T13:46:30.467903+0000","last_active":"2023-12-19T13:46:30.960209+0000","last_peered":"2023-12-19T13:46:30.960209+0000","last_clean":"2023-12-19T13:46:30.960209+0000","last_became_active":"2023-12-19T13:46:30.467653+0000","last_became_peered":"2023-12-19T13:46:30.467653+0000","last_unstale":"2023-12-19T13:46:30.960209+0000","last_undegraded":"2023-12-19T13:46:30.960209+0000","last_fullsized":"2023-12-19T13:46:30.960209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:33.124713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938449+0000","last_change":"2023-12-19T13:46:30.470689+0000","last_active":"2023-12-19T13:46:30.938449+0000","last_peered":"2023-12-19T13:46:30.938449+0000","last_clean":"2023-12-19T13:46:30.938449+0000","last_became_active":"2023-12-19T13:46:30.470436+0000","last_became_peered":"2023-12-19T13:46:30.470436+0000","last_unstale":"2023-12-19T13:46:30.938449+0000","last_undegraded":"2023-12-19T13:46:30.938449+0000","last_fullsized":"2023-12-19T13:46:30.938449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.955782+0000","last_change":"2023-12-19T13:46:30.954917+0000","last_active":"2023-12-19T13:46:30.955782+0000","last_peered":"2023-12-19T13:46:30.955782+0000","last_clean":"2023-12-19T13:46:30.955782+0000","last_became_active":"2023-12-19T13:46:30.954590+0000","last_became_peered":"2023-12-19T13:46:30.954590+0000","last_unstale":"2023-12-19T13:46:30.955782+0000","last_undegraded":"2023-12-19T13:46:30.955782+0000","last_fullsized":"2023-12-19T13:46:30.955782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926484+0000","last_change":"2023-12-19T13:46:30.450013+0000","last_active":"2023-12-19T13:46:30.926484+0000","last_peered":"2023-12-19T13:46:30.926484+0000","last_clean":"2023-12-19T13:46:30.926484+0000","last_became_active":"2023-12-19T13:46:30.449760+0000","last_became_peered":"2023-12-19T13:46:30.449760+0000","last_unstale":"2023-12-19T13:46:30.926484+0000","last_undegraded":"2023-12-19T13:46:30.926484+0000","last_fullsized":"2023-12-19T13:46:30.926484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:03.646304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927969+0000","last_change":"2023-12-19T13:46:30.943118+0000","last_active":"2023-12-19T13:46:31.927969+0000","last_peered":"2023-12-19T13:46:31.927969+0000","last_clean":"2023-12-19T13:46:31.927969+0000","last_became_active":"2023-12-19T13:46:30.942893+0000","last_became_peered":"2023-12-19T13:46:30.942893+0000","last_unstale":"2023-12-19T13:46:31.927969+0000","last_undegraded":"2023-12-19T13:46:31.927969+0000","last_fullsized":"2023-12-19T13:46:31.927969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:07.285214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937097+0000","last_change":"2023-12-19T13:46:30.465649+0000","last_active":"2023-12-19T13:46:30.937097+0000","last_peered":"2023-12-19T13:46:30.937097+0000","last_clean":"2023-12-19T13:46:30.937097+0000","last_became_active":"2023-12-19T13:46:30.457418+0000","last_became_peered":"2023-12-19T13:46:30.457418+0000","last_unstale":"2023-12-19T13:46:30.937097+0000","last_undegraded":"2023-12-19T13:46:30.937097+0000","last_fullsized":"2023-12-19T13:46:30.937097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:09.441431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932357+0000","last_change":"2023-12-19T13:46:30.940866+0000","last_active":"2023-12-19T13:46:31.932357+0000","last_peered":"2023-12-19T13:46:31.932357+0000","last_clean":"2023-12-19T13:46:31.932357+0000","last_became_active":"2023-12-19T13:46:30.940000+0000","last_became_peered":"2023-12-19T13:46:30.940000+0000","last_unstale":"2023-12-19T13:46:31.932357+0000","last_undegraded":"2023-12-19T13:46:31.932357+0000","last_fullsized":"2023-12-19T13:46:31.932357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:54.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.948940+0000","last_change":"2023-12-19T13:46:30.471859+0000","last_active":"2023-12-19T13:46:30.948940+0000","last_peered":"2023-12-19T13:46:30.948940+0000","last_clean":"2023-12-19T13:46:30.948940+0000","last_became_active":"2023-12-19T13:46:30.471277+0000","last_became_peered":"2023-12-19T13:46:30.471277+0000","last_unstale":"2023-12-19T13:46:30.948940+0000","last_undegraded":"2023-12-19T13:46:30.948940+0000","last_fullsized":"2023-12-19T13:46:30.948940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952022+0000","last_change":"2023-12-19T13:46:30.951516+0000","last_active":"2023-12-19T13:46:30.952022+0000","last_peered":"2023-12-19T13:46:30.952022+0000","last_clean":"2023-12-19T13:46:30.952022+0000","last_became_active":"2023-12-19T13:46:30.951275+0000","last_became_peered":"2023-12-19T13:46:30.951275+0000","last_unstale":"2023-12-19T13:46:30.952022+0000","last_undegraded":"2023-12-19T13:46:30.952022+0000","last_fullsized":"2023-12-19T13:46:30.952022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.951214+0000","last_change":"2023-12-19T13:46:30.464446+0000","last_active":"2023-12-19T13:46:30.951214+0000","last_peered":"2023-12-19T13:46:30.951214+0000","last_clean":"2023-12-19T13:46:30.951214+0000","last_became_active":"2023-12-19T13:46:30.463227+0000","last_became_peered":"2023-12-19T13:46:30.463227+0000","last_unstale":"2023-12-19T13:46:30.951214+0000","last_undegraded":"2023-12-19T13:46:30.951214+0000","last_fullsized":"2023-12-19T13:46:30.951214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478163+0000","last_change":"2023-12-19T13:46:30.937059+0000","last_active":"2023-12-19T13:46:32.478163+0000","last_peered":"2023-12-19T13:46:32.478163+0000","last_clean":"2023-12-19T13:46:32.478163+0000","last_became_active":"2023-12-19T13:46:30.936498+0000","last_became_peered":"2023-12-19T13:46:30.936498+0000","last_unstale":"2023-12-19T13:46:32.478163+0000","last_undegraded":"2023-12-19T13:46:32.478163+0000","last_fullsized":"2023-12-19T13:46:32.478163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958001+0000","last_change":"2023-12-19T13:46:30.465379+0000","last_active":"2023-12-19T13:46:30.958001+0000","last_peered":"2023-12-19T13:46:30.958001+0000","last_clean":"2023-12-19T13:46:30.958001+0000","last_became_active":"2023-12-19T13:46:30.464638+0000","last_became_peered":"2023-12-19T13:46:30.464638+0000","last_unstale":"2023-12-19T13:46:30.958001+0000","last_undegraded":"2023-12-19T13:46:30.958001+0000","last_fullsized":"2023-12-19T13:46:30.958001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:40.827653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479035+0000","last_change":"2023-12-19T13:46:30.954585+0000","last_active":"2023-12-19T13:46:32.479035+0000","last_peered":"2023-12-19T13:46:32.479035+0000","last_clean":"2023-12-19T13:46:32.479035+0000","last_became_active":"2023-12-19T13:46:30.954225+0000","last_became_peered":"2023-12-19T13:46:30.954225+0000","last_unstale":"2023-12-19T13:46:32.479035+0000","last_undegraded":"2023-12-19T13:46:32.479035+0000","last_fullsized":"2023-12-19T13:46:32.479035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:40.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959430+0000","last_change":"2023-12-19T13:46:30.467738+0000","last_active":"2023-12-19T13:46:30.959430+0000","last_peered":"2023-12-19T13:46:30.959430+0000","last_clean":"2023-12-19T13:46:30.959430+0000","last_became_active":"2023-12-19T13:46:30.467458+0000","last_became_peered":"2023-12-19T13:46:30.467458+0000","last_unstale":"2023-12-19T13:46:30.959430+0000","last_undegraded":"2023-12-19T13:46:30.959430+0000","last_fullsized":"2023-12-19T13:46:30.959430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477744+0000","last_change":"2023-12-19T13:46:30.945420+0000","last_active":"2023-12-19T13:46:32.477744+0000","last_peered":"2023-12-19T13:46:32.477744+0000","last_clean":"2023-12-19T13:46:32.477744+0000","last_became_active":"2023-12-19T13:46:30.945196+0000","last_became_peered":"2023-12-19T13:46:30.945196+0000","last_unstale":"2023-12-19T13:46:32.477744+0000","last_undegraded":"2023-12-19T13:46:32.477744+0000","last_fullsized":"2023-12-19T13:46:32.477744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925451+0000","last_change":"2023-12-19T13:46:30.460639+0000","last_active":"2023-12-19T13:46:30.925451+0000","last_peered":"2023-12-19T13:46:30.925451+0000","last_clean":"2023-12-19T13:46:30.925451+0000","last_became_active":"2023-12-19T13:46:30.460292+0000","last_became_peered":"2023-12-19T13:46:30.460292+0000","last_unstale":"2023-12-19T13:46:30.925451+0000","last_undegraded":"2023-12-19T13:46:30.925451+0000","last_fullsized":"2023-12-19T13:46:30.925451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:01.555601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481397+0000","last_change":"2023-12-19T13:46:30.959817+0000","last_active":"2023-12-19T13:46:32.481397+0000","last_peered":"2023-12-19T13:46:32.481397+0000","last_clean":"2023-12-19T13:46:32.481397+0000","last_became_active":"2023-12-19T13:46:30.959575+0000","last_became_peered":"2023-12-19T13:46:30.959575+0000","last_unstale":"2023-12-19T13:46:32.481397+0000","last_undegraded":"2023-12-19T13:46:32.481397+0000","last_fullsized":"2023-12-19T13:46:32.481397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:10.080876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.949079+0000","last_change":"2023-12-19T13:46:30.471710+0000","last_active":"2023-12-19T13:46:30.949079+0000","last_peered":"2023-12-19T13:46:30.949079+0000","last_clean":"2023-12-19T13:46:30.949079+0000","last_became_active":"2023-12-19T13:46:30.470939+0000","last_became_peered":"2023-12-19T13:46:30.470939+0000","last_unstale":"2023-12-19T13:46:30.949079+0000","last_undegraded":"2023-12-19T13:46:30.949079+0000","last_fullsized":"2023-12-19T13:46:30.949079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478648+0000","last_change":"2023-12-19T13:46:30.947790+0000","last_active":"2023-12-19T13:46:32.478648+0000","last_peered":"2023-12-19T13:46:32.478648+0000","last_clean":"2023-12-19T13:46:32.478648+0000","last_became_active":"2023-12-19T13:46:30.947145+0000","last_became_peered":"2023-12-19T13:46:30.947145+0000","last_unstale":"2023-12-19T13:46:32.478648+0000","last_undegraded":"2023-12-19T13:46:32.478648+0000","last_fullsized":"2023-12-19T13:46:32.478648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:55.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.957777+0000","last_change":"2023-12-19T13:46:30.465840+0000","last_active":"2023-12-19T13:46:30.957777+0000","last_peered":"2023-12-19T13:46:30.957777+0000","last_clean":"2023-12-19T13:46:30.957777+0000","last_became_active":"2023-12-19T13:46:30.465539+0000","last_became_peered":"2023-12-19T13:46:30.465539+0000","last_unstale":"2023-12-19T13:46:30.957777+0000","last_undegraded":"2023-12-19T13:46:30.957777+0000","last_fullsized":"2023-12-19T13:46:30.957777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478618+0000","last_change":"2023-12-19T13:46:30.935669+0000","last_active":"2023-12-19T13:46:32.478618+0000","last_peered":"2023-12-19T13:46:32.478618+0000","last_clean":"2023-12-19T13:46:32.478618+0000","last_became_active":"2023-12-19T13:46:30.931664+0000","last_became_peered":"2023-12-19T13:46:30.931664+0000","last_unstale":"2023-12-19T13:46:32.478618+0000","last_undegraded":"2023-12-19T13:46:32.478618+0000","last_fullsized":"2023-12-19T13:46:32.478618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:10.542512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956431+0000","last_change":"2023-12-19T13:46:30.469934+0000","last_active":"2023-12-19T13:46:30.956431+0000","last_peered":"2023-12-19T13:46:30.956431+0000","last_clean":"2023-12-19T13:46:30.956431+0000","last_became_active":"2023-12-19T13:46:30.469677+0000","last_became_peered":"2023-12-19T13:46:30.469677+0000","last_unstale":"2023-12-19T13:46:30.956431+0000","last_undegraded":"2023-12-19T13:46:30.956431+0000","last_fullsized":"2023-12-19T13:46:30.956431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932472+0000","last_change":"2023-12-19T13:46:30.955967+0000","last_active":"2023-12-19T13:46:31.932472+0000","last_peered":"2023-12-19T13:46:31.932472+0000","last_clean":"2023-12-19T13:46:31.932472+0000","last_became_active":"2023-12-19T13:46:30.955703+0000","last_became_peered":"2023-12-19T13:46:30.955703+0000","last_unstale":"2023-12-19T13:46:31.932472+0000","last_undegraded":"2023-12-19T13:46:31.932472+0000","last_fullsized":"2023-12-19T13:46:31.932472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:34.137836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.956418+0000","last_change":"2023-12-19T13:46:30.463235+0000","last_active":"2023-12-19T13:46:30.956418+0000","last_peered":"2023-12-19T13:46:30.956418+0000","last_clean":"2023-12-19T13:46:30.956418+0000","last_became_active":"2023-12-19T13:46:30.462908+0000","last_became_peered":"2023-12-19T13:46:30.462908+0000","last_unstale":"2023-12-19T13:46:30.956418+0000","last_undegraded":"2023-12-19T13:46:30.956418+0000","last_fullsized":"2023-12-19T13:46:30.956418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.477974+0000","last_change":"2023-12-19T13:46:30.947024+0000","last_active":"2023-12-19T13:46:32.477974+0000","last_peered":"2023-12-19T13:46:32.477974+0000","last_clean":"2023-12-19T13:46:32.477974+0000","last_became_active":"2023-12-19T13:46:30.946825+0000","last_became_peered":"2023-12-19T13:46:30.946825+0000","last_unstale":"2023-12-19T13:46:32.477974+0000","last_undegraded":"2023-12-19T13:46:32.477974+0000","last_fullsized":"2023-12-19T13:46:32.477974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:22.659327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953122+0000","last_change":"2023-12-19T13:46:30.456074+0000","last_active":"2023-12-19T13:46:30.953122+0000","last_peered":"2023-12-19T13:46:30.953122+0000","last_clean":"2023-12-19T13:46:30.953122+0000","last_became_active":"2023-12-19T13:46:30.455381+0000","last_became_peered":"2023-12-19T13:46:30.455381+0000","last_unstale":"2023-12-19T13:46:30.953122+0000","last_undegraded":"2023-12-19T13:46:30.953122+0000","last_fullsized":"2023-12-19T13:46:30.953122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479507+0000","last_change":"2023-12-19T13:46:30.956360+0000","last_active":"2023-12-19T13:46:32.479507+0000","last_peered":"2023-12-19T13:46:32.479507+0000","last_clean":"2023-12-19T13:46:32.479507+0000","last_became_active":"2023-12-19T13:46:30.954873+0000","last_became_peered":"2023-12-19T13:46:30.954873+0000","last_unstale":"2023-12-19T13:46:32.479507+0000","last_undegraded":"2023-12-19T13:46:32.479507+0000","last_fullsized":"2023-12-19T13:46:32.479507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.939117+0000","last_change":"2023-12-19T13:46:30.471994+0000","last_active":"2023-12-19T13:46:30.939117+0000","last_peered":"2023-12-19T13:46:30.939117+0000","last_clean":"2023-12-19T13:46:30.939117+0000","last_became_active":"2023-12-19T13:46:30.471851+0000","last_became_peered":"2023-12-19T13:46:30.471851+0000","last_unstale":"2023-12-19T13:46:30.939117+0000","last_undegraded":"2023-12-19T13:46:30.939117+0000","last_fullsized":"2023-12-19T13:46:30.939117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481270+0000","last_change":"2023-12-19T13:46:30.939193+0000","last_active":"2023-12-19T13:46:32.481270+0000","last_peered":"2023-12-19T13:46:32.481270+0000","last_clean":"2023-12-19T13:46:32.481270+0000","last_became_active":"2023-12-19T13:46:30.938853+0000","last_became_peered":"2023-12-19T13:46:30.938853+0000","last_unstale":"2023-12-19T13:46:32.481270+0000","last_undegraded":"2023-12-19T13:46:32.481270+0000","last_fullsized":"2023-12-19T13:46:32.481270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:31.136164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.937637+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:46:30.937637+0000","last_peered":"2023-12-19T13:46:30.937637+0000","last_clean":"2023-12-19T13:46:30.937637+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:46:30.937637+0000","last_undegraded":"2023-12-19T13:46:30.937637+0000","last_fullsized":"2023-12-19T13:46:30.937637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.925861+0000","last_change":"2023-12-19T13:46:30.466620+0000","last_active":"2023-12-19T13:46:30.925861+0000","last_peered":"2023-12-19T13:46:30.925861+0000","last_clean":"2023-12-19T13:46:30.925861+0000","last_became_active":"2023-12-19T13:46:30.466140+0000","last_became_peered":"2023-12-19T13:46:30.466140+0000","last_unstale":"2023-12-19T13:46:30.925861+0000","last_undegraded":"2023-12-19T13:46:30.925861+0000","last_fullsized":"2023-12-19T13:46:30.925861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:54.770943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928217+0000","last_change":"2023-12-19T13:46:30.935325+0000","last_active":"2023-12-19T13:46:31.928217+0000","last_peered":"2023-12-19T13:46:31.928217+0000","last_clean":"2023-12-19T13:46:31.928217+0000","last_became_active":"2023-12-19T13:46:30.934910+0000","last_became_peered":"2023-12-19T13:46:30.934910+0000","last_unstale":"2023-12-19T13:46:31.928217+0000","last_undegraded":"2023-12-19T13:46:31.928217+0000","last_fullsized":"2023-12-19T13:46:31.928217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:59.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928316+0000","last_change":"2023-12-19T13:46:30.468537+0000","last_active":"2023-12-19T13:46:30.928316+0000","last_peered":"2023-12-19T13:46:30.928316+0000","last_clean":"2023-12-19T13:46:30.928316+0000","last_became_active":"2023-12-19T13:46:30.468301+0000","last_became_peered":"2023-12-19T13:46:30.468301+0000","last_unstale":"2023-12-19T13:46:30.928316+0000","last_undegraded":"2023-12-19T13:46:30.928316+0000","last_fullsized":"2023-12-19T13:46:30.928316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:39.901573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479355+0000","last_change":"2023-12-19T13:46:30.947051+0000","last_active":"2023-12-19T13:46:32.479355+0000","last_peered":"2023-12-19T13:46:32.479355+0000","last_clean":"2023-12-19T13:46:32.479355+0000","last_became_active":"2023-12-19T13:46:30.946837+0000","last_became_peered":"2023-12-19T13:46:30.946837+0000","last_unstale":"2023-12-19T13:46:32.479355+0000","last_undegraded":"2023-12-19T13:46:32.479355+0000","last_fullsized":"2023-12-19T13:46:32.479355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.003998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.929140+0000","last_change":"2023-12-19T13:46:30.456665+0000","last_active":"2023-12-19T13:46:30.929140+0000","last_peered":"2023-12-19T13:46:30.929140+0000","last_clean":"2023-12-19T13:46:30.929140+0000","last_became_active":"2023-12-19T13:46:30.456068+0000","last_became_peered":"2023-12-19T13:46:30.456068+0000","last_unstale":"2023-12-19T13:46:30.929140+0000","last_undegraded":"2023-12-19T13:46:30.929140+0000","last_fullsized":"2023-12-19T13:46:30.929140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.944823+0000","last_change":"2023-12-19T13:46:30.944565+0000","last_active":"2023-12-19T13:46:30.944823+0000","last_peered":"2023-12-19T13:46:30.944823+0000","last_clean":"2023-12-19T13:46:30.944823+0000","last_became_active":"2023-12-19T13:46:30.944091+0000","last_became_peered":"2023-12-19T13:46:30.944091+0000","last_unstale":"2023-12-19T13:46:30.944823+0000","last_undegraded":"2023-12-19T13:46:30.944823+0000","last_fullsized":"2023-12-19T13:46:30.944823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.093870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.926212+0000","last_change":"2023-12-19T13:46:30.463352+0000","last_active":"2023-12-19T13:46:30.926212+0000","last_peered":"2023-12-19T13:46:30.926212+0000","last_clean":"2023-12-19T13:46:30.926212+0000","last_became_active":"2023-12-19T13:46:30.463056+0000","last_became_peered":"2023-12-19T13:46:30.463056+0000","last_unstale":"2023-12-19T13:46:30.926212+0000","last_undegraded":"2023-12-19T13:46:30.926212+0000","last_fullsized":"2023-12-19T13:46:30.926212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.480115+0000","last_change":"2023-12-19T13:46:30.948432+0000","last_active":"2023-12-19T13:46:32.480115+0000","last_peered":"2023-12-19T13:46:32.480115+0000","last_clean":"2023-12-19T13:46:32.480115+0000","last_became_active":"2023-12-19T13:46:30.948068+0000","last_became_peered":"2023-12-19T13:46:30.948068+0000","last_unstale":"2023-12-19T13:46:32.480115+0000","last_undegraded":"2023-12-19T13:46:32.480115+0000","last_fullsized":"2023-12-19T13:46:32.480115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:12:51.789717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.941985+0000","last_change":"2023-12-19T13:46:30.463018+0000","last_active":"2023-12-19T13:46:30.941985+0000","last_peered":"2023-12-19T13:46:30.941985+0000","last_clean":"2023-12-19T13:46:30.941985+0000","last_became_active":"2023-12-19T13:46:30.462528+0000","last_became_peered":"2023-12-19T13:46:30.462528+0000","last_unstale":"2023-12-19T13:46:30.941985+0000","last_undegraded":"2023-12-19T13:46:30.941985+0000","last_fullsized":"2023-12-19T13:46:30.941985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.932691+0000","last_change":"2023-12-19T13:46:30.949775+0000","last_active":"2023-12-19T13:46:31.932691+0000","last_peered":"2023-12-19T13:46:31.932691+0000","last_clean":"2023-12-19T13:46:31.932691+0000","last_became_active":"2023-12-19T13:46:30.949527+0000","last_became_peered":"2023-12-19T13:46:30.949527+0000","last_unstale":"2023-12-19T13:46:31.932691+0000","last_undegraded":"2023-12-19T13:46:31.932691+0000","last_fullsized":"2023-12-19T13:46:31.932691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:26.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.928099+0000","last_change":"2023-12-19T13:46:30.463359+0000","last_active":"2023-12-19T13:46:30.928099+0000","last_peered":"2023-12-19T13:46:30.928099+0000","last_clean":"2023-12-19T13:46:30.928099+0000","last_became_active":"2023-12-19T13:46:30.463093+0000","last_became_peered":"2023-12-19T13:46:30.463093+0000","last_unstale":"2023-12-19T13:46:30.928099+0000","last_undegraded":"2023-12-19T13:46:30.928099+0000","last_fullsized":"2023-12-19T13:46:30.928099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:58.990876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478303+0000","last_change":"2023-12-19T13:46:30.954730+0000","last_active":"2023-12-19T13:46:32.478303+0000","last_peered":"2023-12-19T13:46:32.478303+0000","last_clean":"2023-12-19T13:46:32.478303+0000","last_became_active":"2023-12-19T13:46:30.954495+0000","last_became_peered":"2023-12-19T13:46:30.954495+0000","last_unstale":"2023-12-19T13:46:32.478303+0000","last_undegraded":"2023-12-19T13:46:32.478303+0000","last_fullsized":"2023-12-19T13:46:32.478303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:08.682812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928427+0000","last_change":"2023-12-19T13:46:30.470099+0000","last_active":"2023-12-19T13:46:31.928427+0000","last_peered":"2023-12-19T13:46:31.928427+0000","last_clean":"2023-12-19T13:46:31.928427+0000","last_became_active":"2023-12-19T13:46:30.469960+0000","last_became_peered":"2023-12-19T13:46:30.469960+0000","last_unstale":"2023-12-19T13:46:31.928427+0000","last_undegraded":"2023-12-19T13:46:31.928427+0000","last_fullsized":"2023-12-19T13:46:31.928427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928069+0000","last_change":"2023-12-19T13:46:30.944631+0000","last_active":"2023-12-19T13:46:31.928069+0000","last_peered":"2023-12-19T13:46:31.928069+0000","last_clean":"2023-12-19T13:46:31.928069+0000","last_became_active":"2023-12-19T13:46:30.943922+0000","last_became_peered":"2023-12-19T13:46:30.943922+0000","last_unstale":"2023-12-19T13:46:31.928069+0000","last_undegraded":"2023-12-19T13:46:31.928069+0000","last_fullsized":"2023-12-19T13:46:31.928069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:07.182207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959854+0000","last_change":"2023-12-19T13:46:30.472244+0000","last_active":"2023-12-19T13:46:30.959854+0000","last_peered":"2023-12-19T13:46:30.959854+0000","last_clean":"2023-12-19T13:46:30.959854+0000","last_became_active":"2023-12-19T13:46:30.471954+0000","last_became_peered":"2023-12-19T13:46:30.471954+0000","last_unstale":"2023-12-19T13:46:30.959854+0000","last_undegraded":"2023-12-19T13:46:30.959854+0000","last_fullsized":"2023-12-19T13:46:30.959854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.927854+0000","last_change":"2023-12-19T13:46:30.939034+0000","last_active":"2023-12-19T13:46:31.927854+0000","last_peered":"2023-12-19T13:46:31.927854+0000","last_clean":"2023-12-19T13:46:31.927854+0000","last_became_active":"2023-12-19T13:46:30.938407+0000","last_became_peered":"2023-12-19T13:46:30.938407+0000","last_unstale":"2023-12-19T13:46:31.927854+0000","last_undegraded":"2023-12-19T13:46:31.927854+0000","last_fullsized":"2023-12-19T13:46:31.927854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:46.294535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.936764+0000","last_change":"2023-12-19T13:46:30.469524+0000","last_active":"2023-12-19T13:46:30.936764+0000","last_peered":"2023-12-19T13:46:30.936764+0000","last_clean":"2023-12-19T13:46:30.936764+0000","last_became_active":"2023-12-19T13:46:30.467130+0000","last_became_peered":"2023-12-19T13:46:30.467130+0000","last_unstale":"2023-12-19T13:46:30.936764+0000","last_undegraded":"2023-12-19T13:46:30.936764+0000","last_fullsized":"2023-12-19T13:46:30.936764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:25.754683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481642+0000","last_change":"2023-12-19T13:46:30.948464+0000","last_active":"2023-12-19T13:46:32.481642+0000","last_peered":"2023-12-19T13:46:32.481642+0000","last_clean":"2023-12-19T13:46:32.481642+0000","last_became_active":"2023-12-19T13:46:30.941429+0000","last_became_peered":"2023-12-19T13:46:30.941429+0000","last_unstale":"2023-12-19T13:46:32.481642+0000","last_undegraded":"2023-12-19T13:46:32.481642+0000","last_fullsized":"2023-12-19T13:46:32.481642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:14.644536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.932435+0000","last_change":"2023-12-19T13:46:30.467632+0000","last_active":"2023-12-19T13:46:30.932435+0000","last_peered":"2023-12-19T13:46:30.932435+0000","last_clean":"2023-12-19T13:46:30.932435+0000","last_became_active":"2023-12-19T13:46:30.467326+0000","last_became_peered":"2023-12-19T13:46:30.467326+0000","last_unstale":"2023-12-19T13:46:30.932435+0000","last_undegraded":"2023-12-19T13:46:30.932435+0000","last_fullsized":"2023-12-19T13:46:30.932435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:29.335182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:31.928264+0000","last_change":"2023-12-19T13:46:30.945501+0000","last_active":"2023-12-19T13:46:31.928264+0000","last_peered":"2023-12-19T13:46:31.928264+0000","last_clean":"2023-12-19T13:46:31.928264+0000","last_became_active":"2023-12-19T13:46:30.945070+0000","last_became_peered":"2023-12-19T13:46:30.945070+0000","last_unstale":"2023-12-19T13:46:31.928264+0000","last_undegraded":"2023-12-19T13:46:31.928264+0000","last_fullsized":"2023-12-19T13:46:31.928264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:40.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.938563+0000","last_change":"2023-12-19T13:46:30.468143+0000","last_active":"2023-12-19T13:46:30.938563+0000","last_peered":"2023-12-19T13:46:30.938563+0000","last_clean":"2023-12-19T13:46:30.938563+0000","last_became_active":"2023-12-19T13:46:30.467699+0000","last_became_peered":"2023-12-19T13:46:30.467699+0000","last_unstale":"2023-12-19T13:46:30.938563+0000","last_undegraded":"2023-12-19T13:46:30.938563+0000","last_fullsized":"2023-12-19T13:46:30.938563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:37:45.146012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.947589+0000","last_change":"2023-12-19T13:46:30.947222+0000","last_active":"2023-12-19T13:46:30.947589+0000","last_peered":"2023-12-19T13:46:30.947589+0000","last_clean":"2023-12-19T13:46:30.947589+0000","last_became_active":"2023-12-19T13:46:30.947006+0000","last_became_peered":"2023-12-19T13:46:30.947006+0000","last_unstale":"2023-12-19T13:46:30.947589+0000","last_undegraded":"2023-12-19T13:46:30.947589+0000","last_fullsized":"2023-12-19T13:46:30.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.958497+0000","last_change":"2023-12-19T13:46:30.465441+0000","last_active":"2023-12-19T13:46:30.958497+0000","last_peered":"2023-12-19T13:46:30.958497+0000","last_clean":"2023-12-19T13:46:30.958497+0000","last_became_active":"2023-12-19T13:46:30.465103+0000","last_became_peered":"2023-12-19T13:46:30.465103+0000","last_unstale":"2023-12-19T13:46:30.958497+0000","last_undegraded":"2023-12-19T13:46:30.958497+0000","last_fullsized":"2023-12-19T13:46:30.958497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:32.910616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.478407+0000","last_change":"2023-12-19T13:46:30.952729+0000","last_active":"2023-12-19T13:46:32.478407+0000","last_peered":"2023-12-19T13:46:32.478407+0000","last_clean":"2023-12-19T13:46:32.478407+0000","last_became_active":"2023-12-19T13:46:30.950922+0000","last_became_peered":"2023-12-19T13:46:30.950922+0000","last_unstale":"2023-12-19T13:46:32.478407+0000","last_undegraded":"2023-12-19T13:46:32.478407+0000","last_fullsized":"2023-12-19T13:46:32.478407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:13.580642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.481163+0000","last_change":"2023-12-19T13:46:30.957451+0000","last_active":"2023-12-19T13:46:32.481163+0000","last_peered":"2023-12-19T13:46:32.481163+0000","last_clean":"2023-12-19T13:46:32.481163+0000","last_became_active":"2023-12-19T13:46:30.955947+0000","last_became_peered":"2023-12-19T13:46:30.955947+0000","last_unstale":"2023-12-19T13:46:32.481163+0000","last_undegraded":"2023-12-19T13:46:32.481163+0000","last_fullsized":"2023-12-19T13:46:32.481163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:07.116909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959781+0000","last_change":"2023-12-19T13:46:30.470680+0000","last_active":"2023-12-19T13:46:30.959781+0000","last_peered":"2023-12-19T13:46:30.959781+0000","last_clean":"2023-12-19T13:46:30.959781+0000","last_became_active":"2023-12-19T13:46:30.470409+0000","last_became_peered":"2023-12-19T13:46:30.470409+0000","last_unstale":"2023-12-19T13:46:30.959781+0000","last_undegraded":"2023-12-19T13:46:30.959781+0000","last_fullsized":"2023-12-19T13:46:30.959781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:21.883224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:46:32.479758+0000","last_change":"2023-12-19T13:46:30.946912+0000","last_active":"2023-12-19T13:46:32.479758+0000","last_peered":"2023-12-19T13:46:32.479758+0000","last_clean":"2023-12-19T13:46:32.479758+0000","last_became_active":"2023-12-19T13:46:30.946689+0000","last_became_peered":"2023-12-19T13:46:30.946689+0000","last_unstale":"2023-12-19T13:46:32.479758+0000","last_undegraded":"2023-12-19T13:46:32.479758+0000","last_fullsized":"2023-12-19T13:46:32.479758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:40.914695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.960456+0000","last_change":"2023-12-19T13:46:30.470862+0000","last_active":"2023-12-19T13:46:30.960456+0000","last_peered":"2023-12-19T13:46:30.960456+0000","last_clean":"2023-12-19T13:46:30.960456+0000","last_became_active":"2023-12-19T13:46:30.470428+0000","last_became_peered":"2023-12-19T13:46:30.470428+0000","last_unstale":"2023-12-19T13:46:30.960456+0000","last_undegraded":"2023-12-19T13:46:30.960456+0000","last_fullsized":"2023-12-19T13:46:30.960456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:53.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.950966+0000","last_change":"2023-12-19T13:46:30.949145+0000","last_active":"2023-12-19T13:46:30.950966+0000","last_peered":"2023-12-19T13:46:30.950966+0000","last_clean":"2023-12-19T13:46:30.950966+0000","last_became_active":"2023-12-19T13:46:30.946515+0000","last_became_peered":"2023-12-19T13:46:30.946515+0000","last_unstale":"2023-12-19T13:46:30.950966+0000","last_undegraded":"2023-12-19T13:46:30.950966+0000","last_fullsized":"2023-12-19T13:46:30.950966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:10.851448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.953453+0000","last_change":"2023-12-19T13:46:30.449386+0000","last_active":"2023-12-19T13:46:30.953453+0000","last_peered":"2023-12-19T13:46:30.953453+0000","last_clean":"2023-12-19T13:46:30.953453+0000","last_became_active":"2023-12-19T13:46:30.448900+0000","last_became_peered":"2023-12-19T13:46:30.448900+0000","last_unstale":"2023-12-19T13:46:30.953453+0000","last_undegraded":"2023-12-19T13:46:30.953453+0000","last_fullsized":"2023-12-19T13:46:30.953453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:47.777676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.952114+0000","last_change":"2023-12-19T13:46:30.952009+0000","last_active":"2023-12-19T13:46:30.952114+0000","last_peered":"2023-12-19T13:46:30.952114+0000","last_clean":"2023-12-19T13:46:30.952114+0000","last_became_active":"2023-12-19T13:46:30.951734+0000","last_became_peered":"2023-12-19T13:46:30.951734+0000","last_unstale":"2023-12-19T13:46:30.952114+0000","last_undegraded":"2023-12-19T13:46:30.952114+0000","last_fullsized":"2023-12-19T13:46:30.952114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:30.423972+0000","last_clean_scrub_stamp":"2023-12-19T13:46:30.423972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:58.909373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:46:30.959118+0000","last_change":"2023-12-19T13:46:30.458973+0000","last_active":"2023-12-19T13:46:30.959118+0000","last_peered":"2023-12-19T13:46:30.959118+0000","last_clean":"2023-12-19T13:46:30.959118+0000","last_became_active":"2023-12-19T13:46:30.458267+0000","last_became_peered":"2023-12-19T13:46:30.458267+0000","last_unstale":"2023-12-19T13:46:30.959118+0000","last_undegraded":"2023-12-19T13:46:30.959118+0000","last_fullsized":"2023-12-19T13:46:30.959118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:29.410850+0000","last_clean_scrub_stamp":"2023-12-19T13:46:29.410850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:20.474583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4689999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.3769999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3090000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0179999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8849999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0919999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8159999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4530000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4269999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:46:46.684 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T13:46:46.684 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T13:46:46.684 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T13:46:46.684 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T13:46:46.871 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:46.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:46.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.934+0000 7f7494a7d640 1 Processor -- start 2023-12-19T13:46:46.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.934+0000 7f7494a7d640 1 -- start start 2023-12-19T13:46:46.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f7494a7d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7490146e20 0x7f749006c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f7494a7d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f749006cd50 0x7f749006f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f7494a7d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74900c2ea0 con 0x7f7490146a40 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f7494a7d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749006d1c0 con 0x7f7490146e20 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f7494a7d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74900c3180 con 0x7f749006cd50 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f748dd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7490146e20 0x7f749006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f748dd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7490146e20 0x7f749006c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43842/0 (socket says 172.21.15.113:43842) 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f748dd9b640 1 -- 172.21.15.113:0/2257206174 learned_addr learned my addr 172.21.15.113:0/2257206174 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.936+0000 7f748ed9d640 1 --2- 172.21.15.113:0/2257206174 >> v2:172.21.15.151:3300/0 conn(0x7f749006cd50 0x7f749006f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.937+0000 7f748dd9b640 1 -- 172.21.15.113:0/2257206174 >> v2:172.21.15.151:3300/0 conn(0x7f749006cd50 msgr2=0x7f749006f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.937+0000 7f748dd9b640 1 --2- 172.21.15.113:0/2257206174 >> v2:172.21.15.151:3300/0 conn(0x7f749006cd50 0x7f749006f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.937+0000 7f748dd9b640 1 -- 172.21.15.113:0/2257206174 >> v1:172.21.15.151:6789/0 conn(0x7f7490146a40 legacy=0x7f749015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.937+0000 7f748dd9b640 1 -- 172.21.15.113:0/2257206174 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900c3460 con 0x7f7490146e20 2023-12-19T13:46:46.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.938+0000 7f748dd9b640 1 --2- 172.21.15.113:0/2257206174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146e20 0x7f749006c810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7490154b70 tx=0x7f748402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e74020b2a94dab7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:46.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.938+0000 7f748d59a640 1 -- 172.21.15.113:0/2257206174 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484030860 con 0x7f7490146e20 2023-12-19T13:46:46.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.938+0000 7f748d59a640 1 -- 172.21.15.113:0/2257206174 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74840309c0 con 0x7f7490146e20 2023-12-19T13:46:46.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.938+0000 7f748d59a640 1 -- 172.21.15.113:0/2257206174 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484030d50 con 0x7f7490146e20 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 -- 172.21.15.113:0/2257206174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146e20 msgr2=0x7f749006c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2257206174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146e20 0x7f749006c810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7490154b70 tx=0x7f748402b9a0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 -- 172.21.15.113:0/2257206174 shutdown_connections 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2257206174 >> v2:172.21.15.151:3300/0 conn(0x7f749006cd50 0x7f749006f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2257206174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146e20 0x7f749006c810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 -- 172.21.15.113:0/2257206174 >> 172.21.15.113:0/2257206174 conn(0x7f74900659d0 msgr2=0x7f7490065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 -- 172.21.15.113:0/2257206174 shutdown_connections 2023-12-19T13:46:46.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.939+0000 7f7494a7d640 1 -- 172.21.15.113:0/2257206174 wait complete. 2023-12-19T13:46:46.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.941+0000 7f7494a7d640 1 Processor -- start 2023-12-19T13:46:46.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.941+0000 7f7494a7d640 1 -- start start 2023-12-19T13:46:46.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f7494a7d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006cd50 0x7f74901f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f7494a7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146a40 0x7f749015fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f7494a7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490143040 0x7f74900cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f7494a7d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74901f6700 con 0x7f7490146a40 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f7494a7d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74901f69d0 con 0x7f7490143040 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f7494a7d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74901f6cb0 con 0x7f749006cd50 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146a40 0x7f749015fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146a40 0x7f749015fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43850/0 (socket says 172.21.15.113:43850) 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 -- 172.21.15.113:0/2360239720 learned_addr learned my addr 172.21.15.113:0/2360239720 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748e59c640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006cd50 0x7f74901f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748ed9d640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490143040 0x7f74900cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 -- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006cd50 msgr2=0x7f74901f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006cd50 0x7f74901f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 -- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490143040 msgr2=0x7f74900cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490143040 0x7f74900cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748dd9b640 1 -- 172.21.15.113:0/2360239720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840094d0 con 0x7f7490146a40 2023-12-19T13:46:46.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.942+0000 7f748e59c640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006cd50 0x7f74901f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:46.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.943+0000 7f748dd9b640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146a40 0x7f749015fb50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f748402b9e0 tx=0x7f7484004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:46.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.943+0000 7f747effd640 1 -- 172.21.15.113:0/2360239720 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484039a90 con 0x7f7490146a40 2023-12-19T13:46:46.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.943+0000 7f747effd640 1 -- 172.21.15.113:0/2360239720 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484039c10 con 0x7f7490146a40 2023-12-19T13:46:46.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.943+0000 7f747effd640 1 -- 172.21.15.113:0/2360239720 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484043410 con 0x7f7490146a40 2023-12-19T13:46:46.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.943+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74901f6f90 con 0x7f7490146a40 2023-12-19T13:46:46.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.943+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74901f3ce0 con 0x7f7490146a40 2023-12-19T13:46:46.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.944+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7490074770 con 0x7f7490146a40 2023-12-19T13:46:46.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.946+0000 7f747effd640 1 -- 172.21.15.113:0/2360239720 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f748402f3b0 con 0x7f7490146a40 2023-12-19T13:46:46.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.947+0000 7f747effd640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f747006a430 0x7f747006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:46.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.947+0000 7f747effd640 1 -- 172.21.15.113:0/2360239720 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74840aab30 con 0x7f7490146a40 2023-12-19T13:46:46.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.947+0000 7f748e59c640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f747006a430 0x7f747006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:46.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.948+0000 7f748e59c640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f747006a430 0x7f747006c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7480007fd0 tx=0x7f7480009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:46.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:46.953+0000 7f747effd640 1 -- 172.21.15.113:0/2360239720 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7484076230 con 0x7f7490146a40 2023-12-19T13:46:47.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.178+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7490061910 con 0x7f7490146a40 2023-12-19T13:46:47.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.179+0000 7f747effd640 1 -- 172.21.15.113:0/2360239720 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7484034040 con 0x7f7490146a40 2023-12-19T13:46:47.179 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:47.179 INFO:teuthology.orchestra.run.smithi113.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T13:46:47.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f747006a430 msgr2=0x7f747006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f747006a430 0x7f747006c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7480007fd0 tx=0x7f7480009040 comp rx=0 tx=0).stop 2023-12-19T13:46:47.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146a40 msgr2=0x7f749015fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146a40 0x7f749015fb50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f748402b9e0 tx=0x7f7484004730 comp rx=0 tx=0).stop 2023-12-19T13:46:47.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 shutdown_connections 2023-12-19T13:46:47.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f747006a430 0x7f747006c8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490143040 0x7f74900cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7490146a40 0x7f749015fb50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 --2- 172.21.15.113:0/2360239720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006cd50 0x7f74901f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 >> 172.21.15.113:0/2360239720 conn(0x7f74900659d0 msgr2=0x7f7490070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:47.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 shutdown_connections 2023-12-19T13:46:47.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.181+0000 7f7494a7d640 1 -- 172.21.15.113:0/2360239720 wait complete. 2023-12-19T13:46:47.200 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T13:46:47.201 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.407+0000 7f9017ea1640 1 Processor -- start 2023-12-19T13:46:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.408+0000 7f9017ea1640 1 -- start start 2023-12-19T13:46:47.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f9017ea1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f90100b0b50 0x7f901006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f9017ea1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f901006b590 0x7f901006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f9017ea1640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901006bb30 con 0x7f90101449e0 2023-12-19T13:46:47.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f9017ea1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100b0070 con 0x7f90100b0b50 2023-12-19T13:46:47.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f9017ea1640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100b0350 con 0x7f901006b590 2023-12-19T13:46:47.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901543c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f90100b0b50 0x7f901006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901543c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f90100b0b50 0x7f901006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43862/0 (socket says 172.21.15.113:43862) 2023-12-19T13:46:47.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901543c640 1 -- 172.21.15.113:0/4078397841 learned_addr learned my addr 172.21.15.113:0/4078397841 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:47.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901643e640 1 --2- 172.21.15.113:0/4078397841 >> v2:172.21.15.151:3300/0 conn(0x7f901006b590 0x7f901006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901543c640 1 -- 172.21.15.113:0/4078397841 >> v2:172.21.15.151:3300/0 conn(0x7f901006b590 msgr2=0x7f901006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901543c640 1 --2- 172.21.15.113:0/4078397841 >> v2:172.21.15.151:3300/0 conn(0x7f901006b590 0x7f901006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901543c640 1 -- 172.21.15.113:0/4078397841 >> v1:172.21.15.151:6789/0 conn(0x7f90101449e0 legacy=0x7f90100af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.410+0000 7f901543c640 1 -- 172.21.15.113:0/4078397841 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100b0630 con 0x7f90100b0b50 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.411+0000 7f901543c640 1 --2- 172.21.15.113:0/4078397841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90100b0b50 0x7f901006bfa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f90100b1270 tx=0x7f900002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80c0a6c9cd3f6f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.411+0000 7f9014c3b640 1 -- 172.21.15.113:0/4078397841 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000031870 con 0x7f90100b0b50 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.411+0000 7f9014c3b640 1 -- 172.21.15.113:0/4078397841 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90000319d0 con 0x7f90100b0b50 2023-12-19T13:46:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.411+0000 7f9014c3b640 1 -- 172.21.15.113:0/4078397841 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000031d60 con 0x7f90100b0b50 2023-12-19T13:46:47.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 -- 172.21.15.113:0/4078397841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90100b0b50 msgr2=0x7f901006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 --2- 172.21.15.113:0/4078397841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90100b0b50 0x7f901006bfa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f90100b1270 tx=0x7f900002b910 comp rx=0 tx=0).stop 2023-12-19T13:46:47.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 -- 172.21.15.113:0/4078397841 shutdown_connections 2023-12-19T13:46:47.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 --2- 172.21.15.113:0/4078397841 >> v2:172.21.15.151:3300/0 conn(0x7f901006b590 0x7f901006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 --2- 172.21.15.113:0/4078397841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90100b0b50 0x7f901006bfa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 -- 172.21.15.113:0/4078397841 >> 172.21.15.113:0/4078397841 conn(0x7f90100cbb70 msgr2=0x7f90100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 -- 172.21.15.113:0/4078397841 shutdown_connections 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.412+0000 7f9017ea1640 1 -- 172.21.15.113:0/4078397841 wait complete. 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.414+0000 7f9017ea1640 1 Processor -- start 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.414+0000 7f9017ea1640 1 -- start start 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f9017ea1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f901006b590 0x7f901015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f9017ea1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90100b0b50 0x7f901013ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f9017ea1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90101449e0 0x7f90101411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f9017ea1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901015a710 con 0x7f90101449e0 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f9017ea1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901015e9b0 con 0x7f90100b0b50 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f9017ea1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901015dda0 con 0x7f901006b590 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f901643e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90101449e0 0x7f90101411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f901643e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90101449e0 0x7f90101411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43876/0 (socket says 172.21.15.113:43876) 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.415+0000 7f901643e640 1 -- 172.21.15.113:0/3199005472 learned_addr learned my addr 172.21.15.113:0/3199005472 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f901643e640 1 -- 172.21.15.113:0/3199005472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f901006b590 msgr2=0x7f901015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f901643e640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f901006b590 0x7f901015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f901643e640 1 -- 172.21.15.113:0/3199005472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90100b0b50 msgr2=0x7f901013ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f901643e640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90100b0b50 0x7f901013ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f901643e640 1 -- 172.21.15.113:0/3199005472 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000094d0 con 0x7f90101449e0 2023-12-19T13:46:47.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f901643e640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90101449e0 0x7f90101411c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9008007e40 tx=0x7f900800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:47.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f90067fc640 1 -- 172.21.15.113:0/3199005472 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008014620 con 0x7f90101449e0 2023-12-19T13:46:47.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f90067fc640 1 -- 172.21.15.113:0/3199005472 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800ee90 con 0x7f90101449e0 2023-12-19T13:46:47.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901015e080 con 0x7f90101449e0 2023-12-19T13:46:47.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f90067fc640 1 -- 172.21.15.113:0/3199005472 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080149c0 con 0x7f90101449e0 2023-12-19T13:46:47.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.416+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901015e640 con 0x7f90101449e0 2023-12-19T13:46:47.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.417+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90100afb00 con 0x7f90101449e0 2023-12-19T13:46:47.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.418+0000 7f90067fc640 1 -- 172.21.15.113:0/3199005472 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9008014b20 con 0x7f90101449e0 2023-12-19T13:46:47.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.419+0000 7f90067fc640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ff406a430 0x7f8ff406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.419+0000 7f90067fc640 1 -- 172.21.15.113:0/3199005472 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90080892d0 con 0x7f90101449e0 2023-12-19T13:46:47.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.419+0000 7f9015c3d640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ff406a430 0x7f8ff406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.420+0000 7f9015c3d640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ff406a430 0x7f8ff406c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f900c006fd0 tx=0x7f900c006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:47.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.423+0000 7f90067fc640 1 -- 172.21.15.113:0/3199005472 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f90080548b0 con 0x7f90101449e0 2023-12-19T13:46:47.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.600+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9010061910 con 0x7f90101449e0 2023-12-19T13:46:47.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.603+0000 7f90067fc640 1 -- 172.21.15.113:0/3199005472 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f9008057ed0 con 0x7f90101449e0 2023-12-19T13:46:47.604 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:47.604 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ff406a430 msgr2=0x7f8ff406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ff406a430 0x7f8ff406c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f900c006fd0 tx=0x7f900c006bc0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90101449e0 msgr2=0x7f90101411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90101449e0 0x7f90101411c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9008007e40 tx=0x7f900800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 shutdown_connections 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ff406a430 0x7f8ff406c8f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90101449e0 0x7f90101411c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90100b0b50 0x7f901013ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 --2- 172.21.15.113:0/3199005472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f901006b590 0x7f901015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 >> 172.21.15.113:0/3199005472 conn(0x7f90100cbb70 msgr2=0x7f90100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:47.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 shutdown_connections 2023-12-19T13:46:47.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.605+0000 7f9017ea1640 1 -- 172.21.15.113:0/3199005472 wait complete. 2023-12-19T13:46:47.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:46:47.625 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:46:47.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.832+0000 7f4388096640 1 Processor -- start 2023-12-19T13:46:47.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.832+0000 7f4388096640 1 -- start start 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.833+0000 7f4388096640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f43800b2760 0x7f43800b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4388096640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800ceea0 0x7f43800cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4388096640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438015fde0 con 0x7f438015b1d0 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4388096640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43800b2400 con 0x7f43800b2760 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4388096640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800cf870 con 0x7f43800ceea0 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4385e32640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f438015b1d0 0x7f438015f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59504/0 (socket says 172.21.15.113:59504) 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4385e32640 1 -- 172.21.15.113:0/4040440938 learned_addr learned my addr 172.21.15.113:0/4040440938 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4385631640 1 --2- 172.21.15.113:0/4040440938 >> v2:172.21.15.113:3300/0 conn(0x7f43800b2760 0x7f43800b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4386633640 1 --2- 172.21.15.113:0/4040440938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800ceea0 0x7f43800cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4384e30640 1 -- 172.21.15.113:0/4040440938 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740545131 0 0) 0x7f438015fde0 con 0x7f438015b1d0 2023-12-19T13:46:47.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4384e30640 1 -- 172.21.15.113:0/4040440938 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f436c003520 con 0x7f438015b1d0 2023-12-19T13:46:47.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4385631640 1 -- 172.21.15.113:0/4040440938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800ceea0 msgr2=0x7f43800cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:47.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4385631640 1 --2- 172.21.15.113:0/4040440938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800ceea0 0x7f43800cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4385631640 1 -- 172.21.15.113:0/4040440938 >> v1:172.21.15.113:6789/0 conn(0x7f438015b1d0 legacy=0x7f438015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.834+0000 7f4385631640 1 -- 172.21.15.113:0/4040440938 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800b2bc0 con 0x7f43800b2760 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.835+0000 7f4385631640 1 --2- 172.21.15.113:0/4040440938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43800b2760 0x7f43800b1ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f43700097a0 tx=0x7f437002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0a20a63fa3637d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4384e30640 1 -- 172.21.15.113:0/4040440938 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370031830 con 0x7f43800b2760 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4384e30640 1 -- 172.21.15.113:0/4040440938 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4370031990 con 0x7f43800b2760 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4384e30640 1 -- 172.21.15.113:0/4040440938 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370031d20 con 0x7f43800b2760 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 -- 172.21.15.113:0/4040440938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43800b2760 msgr2=0x7f43800b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 --2- 172.21.15.113:0/4040440938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43800b2760 0x7f43800b1ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f43700097a0 tx=0x7f437002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 -- 172.21.15.113:0/4040440938 shutdown_connections 2023-12-19T13:46:47.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 --2- 172.21.15.113:0/4040440938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800ceea0 0x7f43800cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 --2- 172.21.15.113:0/4040440938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43800b2760 0x7f43800b1ec0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 -- 172.21.15.113:0/4040440938 >> 172.21.15.113:0/4040440938 conn(0x7f4380073150 msgr2=0x7f43800659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:47.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 -- 172.21.15.113:0/4040440938 shutdown_connections 2023-12-19T13:46:47.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.836+0000 7f4388096640 1 -- 172.21.15.113:0/4040440938 wait complete. 2023-12-19T13:46:47.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.838+0000 7f4388096640 1 Processor -- start 2023-12-19T13:46:47.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.838+0000 7f4388096640 1 -- start start 2023-12-19T13:46:47.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.839+0000 7f4388096640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800b2760 0x7f4380153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.839+0000 7f4388096640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43800ceea0 0x7f4380157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.839+0000 7f4388096640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f438015b1d0 0x7f43800ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.839+0000 7f4388096640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015b8e0 con 0x7f438015b1d0 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.839+0000 7f4388096640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015d360 con 0x7f43800ceea0 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.839+0000 7f4388096640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438015d640 con 0x7f43800b2760 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f438015b1d0 0x7f43800ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f438015b1d0 0x7f43800ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43892/0 (socket says 172.21.15.113:43892) 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 -- 172.21.15.113:0/3126379128 learned_addr learned my addr 172.21.15.113:0/3126379128 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4385e32640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800b2760 0x7f4380153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4385631640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43800ceea0 0x7f4380157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 -- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800b2760 msgr2=0x7f4380153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800b2760 0x7f4380153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 -- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43800ceea0 msgr2=0x7f4380157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43800ceea0 0x7f4380157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 -- 172.21.15.113:0/3126379128 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4370009400 con 0x7f438015b1d0 2023-12-19T13:46:47.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f4386633640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f438015b1d0 0x7f43800ac8b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4378007e40 tx=0x7f437800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:47.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.840+0000 7f43767fc640 1 -- 172.21.15.113:0/3126379128 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378014620 con 0x7f438015b1d0 2023-12-19T13:46:47.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.841+0000 7f43767fc640 1 -- 172.21.15.113:0/3126379128 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437800ee90 con 0x7f438015b1d0 2023-12-19T13:46:47.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.841+0000 7f43767fc640 1 -- 172.21.15.113:0/3126379128 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780149e0 con 0x7f438015b1d0 2023-12-19T13:46:47.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.841+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438015d920 con 0x7f438015b1d0 2023-12-19T13:46:47.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.841+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438015dee0 con 0x7f438015b1d0 2023-12-19T13:46:47.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.842+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438015e0d0 con 0x7f438015b1d0 2023-12-19T13:46:47.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.843+0000 7f43767fc640 1 -- 172.21.15.113:0/3126379128 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4378014b40 con 0x7f438015b1d0 2023-12-19T13:46:47.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.843+0000 7f43767fc640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f436406a430 0x7f436406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:47.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.844+0000 7f43767fc640 1 -- 172.21.15.113:0/3126379128 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4378089230 con 0x7f438015b1d0 2023-12-19T13:46:47.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.844+0000 7f4385e32640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f436406a430 0x7f436406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:47.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.845+0000 7f4385e32640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f436406a430 0x7f436406c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f437c0011e0 tx=0x7f437c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:47.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:47.850+0000 7f43767fc640 1 -- 172.21.15.113:0/3126379128 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43780548b0 con 0x7f438015b1d0 2023-12-19T13:46:48.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.037+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4380061910 con 0x7f438015b1d0 2023-12-19T13:46:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.038+0000 7f43767fc640 1 -- 172.21.15.113:0/3126379128 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4378057ed0 con 0x7f438015b1d0 2023-12-19T13:46:48.039 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f436406a430 msgr2=0x7f436406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f436406a430 0x7f436406c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f437c0011e0 tx=0x7f437c009040 comp rx=0 tx=0).stop 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f438015b1d0 msgr2=0x7f43800ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f438015b1d0 0x7f43800ac8b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4378007e40 tx=0x7f437800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 shutdown_connections 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f436406a430 0x7f436406c8f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f438015b1d0 0x7f43800ac8b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43800ceea0 0x7f4380157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 --2- 172.21.15.113:0/3126379128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43800b2760 0x7f4380153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 >> 172.21.15.113:0/3126379128 conn(0x7f4380073150 msgr2=0x7f43800cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:48.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 shutdown_connections 2023-12-19T13:46:48.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.042+0000 7f4388096640 1 -- 172.21.15.113:0/3126379128 wait complete. 2023-12-19T13:46:48.061 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:46:48.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.276+0000 7f4235747640 1 Processor -- start 2023-12-19T13:46:48.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.276+0000 7f4235747640 1 -- start start 2023-12-19T13:46:48.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f4235747640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4230157bf0 0x7f423015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f4235747640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300b0810 0x7f423006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f4235747640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423015b740 con 0x7f42300ae110 2023-12-19T13:46:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f4235747640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423006b8c0 con 0x7f4230157bf0 2023-12-19T13:46:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f4235747640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300ae640 con 0x7f42300b0810 2023-12-19T13:46:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422effd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4230157bf0 0x7f423015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300b0810 0x7f423006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422effd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4230157bf0 0x7f423015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:43822/0 (socket says 172.21.15.113:43822) 2023-12-19T13:46:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422effd640 1 -- 172.21.15.113:0/514513343 learned_addr learned my addr 172.21.15.113:0/514513343 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:48.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422effd640 1 -- 172.21.15.113:0/514513343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300b0810 msgr2=0x7f423006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:48.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422effd640 1 --2- 172.21.15.113:0/514513343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300b0810 0x7f423006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422effd640 1 -- 172.21.15.113:0/514513343 >> v1:172.21.15.151:6789/0 conn(0x7f42300ae110 legacy=0x7f42300b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.278+0000 7f422effd640 1 -- 172.21.15.113:0/514513343 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300ae920 con 0x7f4230157bf0 2023-12-19T13:46:48.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.279+0000 7f422effd640 1 --2- 172.21.15.113:0/514513343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4230157bf0 0x7f423015b200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4220009870 tx=0x7f422002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c63433c0019821d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:48.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.280+0000 7f422dffb640 1 -- 172.21.15.113:0/514513343 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220030840 con 0x7f4230157bf0 2023-12-19T13:46:48.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.280+0000 7f422dffb640 1 -- 172.21.15.113:0/514513343 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42200309a0 con 0x7f4230157bf0 2023-12-19T13:46:48.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.280+0000 7f422dffb640 1 -- 172.21.15.113:0/514513343 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220030d30 con 0x7f4230157bf0 2023-12-19T13:46:48.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.280+0000 7f4235747640 1 -- 172.21.15.113:0/514513343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4230157bf0 msgr2=0x7f423015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.280+0000 7f4235747640 1 --2- 172.21.15.113:0/514513343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4230157bf0 0x7f423015b200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4220009870 tx=0x7f422002b980 comp rx=0 tx=0).stop 2023-12-19T13:46:48.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.281+0000 7f4235747640 1 -- 172.21.15.113:0/514513343 shutdown_connections 2023-12-19T13:46:48.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.281+0000 7f4235747640 1 --2- 172.21.15.113:0/514513343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300b0810 0x7f423006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.281+0000 7f4235747640 1 --2- 172.21.15.113:0/514513343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4230157bf0 0x7f423015b200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.281+0000 7f4235747640 1 -- 172.21.15.113:0/514513343 >> 172.21.15.113:0/514513343 conn(0x7f42300cbb70 msgr2=0x7f42300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:48.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.281+0000 7f4235747640 1 -- 172.21.15.113:0/514513343 shutdown_connections 2023-12-19T13:46:48.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.281+0000 7f4235747640 1 -- 172.21.15.113:0/514513343 wait complete. 2023-12-19T13:46:48.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.282+0000 7f4235747640 1 Processor -- start 2023-12-19T13:46:48.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.282+0000 7f4235747640 1 -- start start 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.283+0000 7f4235747640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300ae110 0x7f423014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.283+0000 7f4235747640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42300b0810 0x7f42300ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.283+0000 7f4235747640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4230157bf0 0x7f423015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.283+0000 7f4235747640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4230155180 con 0x7f4230157bf0 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.283+0000 7f4235747640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4230152410 con 0x7f42300b0810 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.283+0000 7f4235747640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4230154600 con 0x7f42300ae110 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4230157bf0 0x7f423015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4230157bf0 0x7f423015c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52752/0 (socket says 172.21.15.113:52752) 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 -- 172.21.15.113:0/113812388 learned_addr learned my addr 172.21.15.113:0/113812388 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422effd640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300ae110 0x7f423014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422e7fc640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42300b0810 0x7f42300ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 -- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300ae110 msgr2=0x7f423014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300ae110 0x7f423014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 -- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42300b0810 msgr2=0x7f42300ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42300b0810 0x7f42300ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 -- 172.21.15.113:0/113812388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200094d0 con 0x7f4230157bf0 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.284+0000 7f422f7fe640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4230157bf0 0x7f423015c940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f422800efc0 tx=0x7f422800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.285+0000 7f42277fe640 1 -- 172.21.15.113:0/113812388 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228009ca0 con 0x7f4230157bf0 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.285+0000 7f42277fe640 1 -- 172.21.15.113:0/113812388 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422800f040 con 0x7f4230157bf0 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.285+0000 7f42277fe640 1 -- 172.21.15.113:0/113812388 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42280146c0 con 0x7f4230157bf0 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.285+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42301548e0 con 0x7f4230157bf0 2023-12-19T13:46:48.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.285+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230154ea0 con 0x7f4230157bf0 2023-12-19T13:46:48.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.286+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42301525d0 con 0x7f4230157bf0 2023-12-19T13:46:48.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.287+0000 7f42277fe640 1 -- 172.21.15.113:0/113812388 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4228014820 con 0x7f4230157bf0 2023-12-19T13:46:48.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.288+0000 7f42277fe640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f421006a430 0x7f421006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.288+0000 7f42277fe640 1 -- 172.21.15.113:0/113812388 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42280898c0 con 0x7f4230157bf0 2023-12-19T13:46:48.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.288+0000 7f422effd640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f421006a430 0x7f421006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.289+0000 7f422effd640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f421006a430 0x7f421006c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4220036000 tx=0x7f422003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:48.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.293+0000 7f42277fe640 1 -- 172.21.15.113:0/113812388 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4228054e10 con 0x7f4230157bf0 2023-12-19T13:46:48.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.471+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42300af190 con 0x7f4230157bf0 2023-12-19T13:46:48.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.472+0000 7f42277fe640 1 -- 172.21.15.113:0/113812388 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4228018020 con 0x7f4230157bf0 2023-12-19T13:46:48.472 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:46:48.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f421006a430 msgr2=0x7f421006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f421006a430 0x7f421006c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4220036000 tx=0x7f422003b040 comp rx=0 tx=0).stop 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4230157bf0 msgr2=0x7f423015c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4230157bf0 0x7f423015c940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f422800efc0 tx=0x7f422800c490 comp rx=0 tx=0).stop 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 shutdown_connections 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f421006a430 0x7f421006c8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4230157bf0 0x7f423015c940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42300b0810 0x7f42300ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 --2- 172.21.15.113:0/113812388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42300ae110 0x7f423014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 >> 172.21.15.113:0/113812388 conn(0x7f42300cbb70 msgr2=0x7f423006d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 shutdown_connections 2023-12-19T13:46:48.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.475+0000 7f4235747640 1 -- 172.21.15.113:0/113812388 wait complete. 2023-12-19T13:46:48.493 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:46:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.696+0000 7f3ec2062640 1 Processor -- start 2023-12-19T13:46:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.697+0000 7f3ec2062640 1 -- start start 2023-12-19T13:46:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.698+0000 7f3ec2062640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc15ae50 0x7f3ebc15e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.698+0000 7f3ec2062640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3ebc0b2710 0x7f3ebc0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec2062640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc0cd020 con 0x7f3ebc0ce750 2023-12-19T13:46:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec2062640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc0cca30 con 0x7f3ebc15ae50 2023-12-19T13:46:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec2062640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b2f20 con 0x7f3ebc0b2710 2023-12-19T13:46:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec1060640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc15ae50 0x7f3ebc15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec1861640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3ebc0ce750 0x7f3ebc0cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:58996/0 (socket says 172.21.15.113:58996) 2023-12-19T13:46:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec1861640 1 -- 172.21.15.113:0/4219676714 learned_addr learned my addr 172.21.15.113:0/4219676714 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec085f640 1 --2- 172.21.15.113:0/4219676714 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc0b2710 0x7f3ebc0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec1060640 1 -- 172.21.15.113:0/4219676714 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc0b2710 msgr2=0x7f3ebc0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:48.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec1060640 1 --2- 172.21.15.113:0/4219676714 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc0b2710 0x7f3ebc0ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec1060640 1 -- 172.21.15.113:0/4219676714 >> v1:172.21.15.113:6789/0 conn(0x7f3ebc0ce750 legacy=0x7f3ebc0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3ec1060640 1 -- 172.21.15.113:0/4219676714 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0b3200 con 0x7f3ebc15ae50 2023-12-19T13:46:48.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.699+0000 7f3eaffff640 1 -- 172.21.15.113:0/4219676714 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618743426 0 0) 0x7f3ebc0cd020 con 0x7f3ebc0ce750 2023-12-19T13:46:48.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.700+0000 7f3ec1060640 1 --2- 172.21.15.113:0/4219676714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc15e460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0ad000 tx=0x7f3eb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0245d74066ef42 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:48.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3eaffff640 1 -- 172.21.15.113:0/4219676714 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8031830 con 0x7f3ebc15ae50 2023-12-19T13:46:48.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3eaffff640 1 -- 172.21.15.113:0/4219676714 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb8031990 con 0x7f3ebc15ae50 2023-12-19T13:46:48.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3eaffff640 1 -- 172.21.15.113:0/4219676714 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8031d20 con 0x7f3ebc15ae50 2023-12-19T13:46:48.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 -- 172.21.15.113:0/4219676714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc15ae50 msgr2=0x7f3ebc15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 --2- 172.21.15.113:0/4219676714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc15e460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0ad000 tx=0x7f3eb802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 -- 172.21.15.113:0/4219676714 shutdown_connections 2023-12-19T13:46:48.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 --2- 172.21.15.113:0/4219676714 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc0b2710 0x7f3ebc0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 --2- 172.21.15.113:0/4219676714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc15e460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 -- 172.21.15.113:0/4219676714 >> 172.21.15.113:0/4219676714 conn(0x7f3ebc06f630 msgr2=0x7f3ebc06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:48.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 -- 172.21.15.113:0/4219676714 shutdown_connections 2023-12-19T13:46:48.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.701+0000 7f3ec2062640 1 -- 172.21.15.113:0/4219676714 wait complete. 2023-12-19T13:46:48.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.703+0000 7f3ec2062640 1 Processor -- start 2023-12-19T13:46:48.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.703+0000 7f3ec2062640 1 -- start start 2023-12-19T13:46:48.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.704+0000 7f3ec2062640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b2710 0x7f3ebc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.704+0000 7f3ec2062640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0ce750 0x7f3ebc14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.704+0000 7f3ec2062640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.704+0000 7f3ec2062640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc06b590 con 0x7f3ebc0ce750 2023-12-19T13:46:48.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.704+0000 7f3ec2062640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc15e620 con 0x7f3ebc15ae50 2023-12-19T13:46:48.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.704+0000 7f3ec2062640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc15e900 con 0x7f3ebc0b2710 2023-12-19T13:46:48.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.704+0000 7f3ec085f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0ce750 0x7f3ebc14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0ce750 0x7f3ebc14c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52780/0 (socket says 172.21.15.113:52780) 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 -- 172.21.15.113:0/1614074105 learned_addr learned my addr 172.21.15.113:0/1614074105 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec1861640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec1060640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b2710 0x7f3ebc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 -- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b2710 msgr2=0x7f3ebc06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b2710 0x7f3ebc06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 -- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc15ae50 msgr2=0x7f3ebc14c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc14c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 -- 172.21.15.113:0/1614074105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb8009400 con 0x7f3ebc0ce750 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec1861640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc14c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec1060640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b2710 0x7f3ebc06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3ec085f640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0ce750 0x7f3ebc14c280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000d800 tx=0x7f3eb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.705+0000 7f3eadffb640 1 -- 172.21.15.113:0/1614074105 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000b6c0 con 0x7f3ebc0ce750 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.706+0000 7f3eadffb640 1 -- 172.21.15.113:0/1614074105 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb000b840 con 0x7f3ebc0ce750 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.706+0000 7f3eadffb640 1 -- 172.21.15.113:0/1614074105 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000bbf0 con 0x7f3ebc0ce750 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.706+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc15ebe0 con 0x7f3ebc0ce750 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.706+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc06de10 con 0x7f3ebc0ce750 2023-12-19T13:46:48.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.707+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc06dfd0 con 0x7f3ebc0ce750 2023-12-19T13:46:48.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.708+0000 7f3eadffb640 1 -- 172.21.15.113:0/1614074105 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3eb000bd50 con 0x7f3ebc0ce750 2023-12-19T13:46:48.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.708+0000 7f3eadffb640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea006a460 0x7f3ea006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:48.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.709+0000 7f3eadffb640 1 -- 172.21.15.113:0/1614074105 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3eb0088ef0 con 0x7f3ebc0ce750 2023-12-19T13:46:48.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.709+0000 7f3ec1060640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea006a460 0x7f3ea006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:48.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.709+0000 7f3ec1060640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea006a460 0x7f3ea006c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8036000 tx=0x7f3eb803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:48.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.713+0000 7f3eadffb640 1 -- 172.21.15.113:0/1614074105 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3eb0054440 con 0x7f3ebc0ce750 2023-12-19T13:46:48.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.896+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ebc061910 con 0x7f3ebc0ce750 2023-12-19T13:46:48.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.897+0000 7f3eadffb640 1 -- 172.21.15.113:0/1614074105 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3eb0057a60 con 0x7f3ebc0ce750 2023-12-19T13:46:48.897 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:46:48.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea006a460 msgr2=0x7f3ea006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea006a460 0x7f3ea006c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8036000 tx=0x7f3eb803c040 comp rx=0 tx=0).stop 2023-12-19T13:46:48.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0ce750 msgr2=0x7f3ebc14c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:48.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0ce750 0x7f3ebc14c280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000d800 tx=0x7f3eb000dcc0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 shutdown_connections 2023-12-19T13:46:48.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea006a460 0x7f3ea006c920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc15ae50 0x7f3ebc14c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0ce750 0x7f3ebc14c280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 --2- 172.21.15.113:0/1614074105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b2710 0x7f3ebc06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:48.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 >> 172.21.15.113:0/1614074105 conn(0x7f3ebc06f630 msgr2=0x7f3ebc15a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:48.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 shutdown_connections 2023-12-19T13:46:48.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:48.899+0000 7f3ec2062640 1 -- 172.21.15.113:0/1614074105 wait complete. 2023-12-19T13:46:48.917 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:46:49.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.128+0000 7fe8738b2640 1 Processor -- start 2023-12-19T13:46:49.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.128+0000 7fe8738b2640 1 -- start start 2023-12-19T13:46:49.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.130+0000 7fe8738b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c157bf0 0x7fe86c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.130+0000 7fe8738b2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe86c0ae110 0x7fe86c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.130+0000 7fe8738b2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c0b0a90 con 0x7fe86c0b0640 2023-12-19T13:46:49.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.130+0000 7fe8738b2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c06b8c0 con 0x7fe86c0ae110 2023-12-19T13:46:49.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.130+0000 7fe8738b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c15b740 con 0x7fe86c157bf0 2023-12-19T13:46:49.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.130+0000 7fe87164e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c157bf0 0x7fe86c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.130+0000 7fe870e4d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe86c0ae110 0x7fe86c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.131+0000 7fe870e4d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe86c0ae110 0x7fe86c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:43850/0 (socket says 172.21.15.113:43850) 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.131+0000 7fe87164e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c157bf0 0x7fe86c15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:53506/0 (socket says 172.21.15.113:53506) 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.131+0000 7fe870e4d640 1 -- 172.21.15.113:0/3414682764 learned_addr learned my addr 172.21.15.113:0/3414682764 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.131+0000 7fe870e4d640 1 -- 172.21.15.113:0/3414682764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c157bf0 msgr2=0x7fe86c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.131+0000 7fe870e4d640 1 --2- 172.21.15.113:0/3414682764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c157bf0 0x7fe86c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.131+0000 7fe870e4d640 1 -- 172.21.15.113:0/3414682764 >> v1:172.21.15.151:6789/0 conn(0x7fe86c0b0640 legacy=0x7fe86c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.131+0000 7fe870e4d640 1 -- 172.21.15.113:0/3414682764 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c0ae640 con 0x7fe86c0ae110 2023-12-19T13:46:49.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.133+0000 7fe870e4d640 1 --2- 172.21.15.113:0/3414682764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c0b0100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00bb10 tx=0x7fe85c02e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10771d8bb68d3f5d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.133+0000 7fe863fff640 1 -- 172.21.15.113:0/3414682764 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c036440 con 0x7fe86c0ae110 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.133+0000 7fe863fff640 1 -- 172.21.15.113:0/3414682764 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c0365a0 con 0x7fe86c0ae110 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.133+0000 7fe863fff640 1 -- 172.21.15.113:0/3414682764 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c036930 con 0x7fe86c0ae110 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 -- 172.21.15.113:0/3414682764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 msgr2=0x7fe86c0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 --2- 172.21.15.113:0/3414682764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c0b0100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00bb10 tx=0x7fe85c02e150 comp rx=0 tx=0).stop 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 -- 172.21.15.113:0/3414682764 shutdown_connections 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 --2- 172.21.15.113:0/3414682764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c0b0100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 --2- 172.21.15.113:0/3414682764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c157bf0 0x7fe86c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 -- 172.21.15.113:0/3414682764 >> 172.21.15.113:0/3414682764 conn(0x7fe86c0cbb70 msgr2=0x7fe86c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 -- 172.21.15.113:0/3414682764 shutdown_connections 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.134+0000 7fe8738b2640 1 -- 172.21.15.113:0/3414682764 wait complete. 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.136+0000 7fe8738b2640 1 Processor -- start 2023-12-19T13:46:49.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.136+0000 7fe8738b2640 1 -- start start 2023-12-19T13:46:49.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe8738b2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe8738b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c0b0640 0x7fe86c152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe8738b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe86c157bf0 0x7fe86c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe8738b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c1516f0 con 0x7fe86c157bf0 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe8738b2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c157fd0 con 0x7fe86c0ae110 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe8738b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c152140 con 0x7fe86c0b0640 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe871e4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe86c157bf0 0x7fe86c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe871e4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe86c157bf0 0x7fe86c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52782/0 (socket says 172.21.15.113:52782) 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe871e4f640 1 -- 172.21.15.113:0/4287153587 learned_addr learned my addr 172.21.15.113:0/4287153587 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.137+0000 7fe87164e640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe870e4d640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c0b0640 0x7fe86c152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe871e4f640 1 -- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c0b0640 msgr2=0x7fe86c152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe871e4f640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c0b0640 0x7fe86c152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe871e4f640 1 -- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 msgr2=0x7fe86c1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe871e4f640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe871e4f640 1 -- 172.21.15.113:0/4287153587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c00b770 con 0x7fe86c157bf0 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe87164e640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe871e4f640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe86c157bf0 0x7fe86c06d130 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe86400c400 tx=0x7fe86400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe861ffb640 1 -- 172.21.15.113:0/4287153587 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8640052d0 con 0x7fe86c157bf0 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe861ffb640 1 -- 172.21.15.113:0/4287153587 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864005430 con 0x7fe86c157bf0 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c158220 con 0x7fe86c157bf0 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe861ffb640 1 -- 172.21.15.113:0/4287153587 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864003810 con 0x7fe86c157bf0 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.138+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c1587e0 con 0x7fe86c157bf0 2023-12-19T13:46:49.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.140+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c061910 con 0x7fe86c157bf0 2023-12-19T13:46:49.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.140+0000 7fe861ffb640 1 -- 172.21.15.113:0/4287153587 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe864003970 con 0x7fe86c157bf0 2023-12-19T13:46:49.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.141+0000 7fe861ffb640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe85006a430 0x7fe85006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.141+0000 7fe861ffb640 1 -- 172.21.15.113:0/4287153587 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe864087cc0 con 0x7fe86c157bf0 2023-12-19T13:46:49.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.142+0000 7fe87164e640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe85006a430 0x7fe85006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.142+0000 7fe87164e640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe85006a430 0x7fe85006c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe86c153760 tx=0x7fe86800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:49.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.145+0000 7fe861ffb640 1 -- 172.21.15.113:0/4287153587 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe864053340 con 0x7fe86c157bf0 2023-12-19T13:46:49.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.372+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe86c0b0a90 con 0x7fe86c157bf0 2023-12-19T13:46:49.373 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.373+0000 7fe861ffb640 1 -- 172.21.15.113:0/4287153587 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fe86c0b0a90 con 0x7fe86c157bf0 2023-12-19T13:46:49.373 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:49.374 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:46:49.374 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:46:49.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.375+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe85006a430 msgr2=0x7fe85006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.375+0000 7fe8738b2640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe85006a430 0x7fe85006c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe86c153760 tx=0x7fe86800b040 comp rx=0 tx=0).stop 2023-12-19T13:46:49.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.375+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe86c157bf0 msgr2=0x7fe86c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.375+0000 7fe8738b2640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe86c157bf0 0x7fe86c06d130 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe86400c400 tx=0x7fe86400c8c0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.375+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 shutdown_connections 2023-12-19T13:46:49.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.376+0000 7fe8738b2640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe85006a430 0x7fe85006c8f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.376+0000 7fe8738b2640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe86c157bf0 0x7fe86c06d130 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.376+0000 7fe8738b2640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe86c0b0640 0x7fe86c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.376+0000 7fe8738b2640 1 --2- 172.21.15.113:0/4287153587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86c0ae110 0x7fe86c1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.376+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 >> 172.21.15.113:0/4287153587 conn(0x7fe86c0cbb70 msgr2=0x7fe86c15e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:49.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.376+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 shutdown_connections 2023-12-19T13:46:49.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.376+0000 7fe8738b2640 1 -- 172.21.15.113:0/4287153587 wait complete. 2023-12-19T13:46:49.395 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:49.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.596+0000 7f8f4ec4c640 1 Processor -- start 2023-12-19T13:46:49.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.596+0000 7f8f4ec4c640 1 -- start start 2023-12-19T13:46:49.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.598+0000 7f8f4ec4c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8f48157bf0 0x7f8f4815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.598+0000 7f8f4ec4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.598+0000 7f8f4ec4c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f480b0a90 con 0x7f8f480b0640 2023-12-19T13:46:49.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.598+0000 7f8f4ec4c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4806b8c0 con 0x7f8f48157bf0 2023-12-19T13:46:49.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.598+0000 7f8f4ec4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4815b740 con 0x7f8f480ae110 2023-12-19T13:46:49.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f4d1e9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8f480b0640 0x7f8f4815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59004/0 (socket says 172.21.15.113:59004) 2023-12-19T13:46:49.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f4d1e9640 1 -- 172.21.15.113:0/2824127084 learned_addr learned my addr 172.21.15.113:0/2824127084 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:49.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f4c9e8640 1 --2- 172.21.15.113:0/2824127084 >> v2:172.21.15.113:3300/0 conn(0x7f8f48157bf0 0x7f8f4815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f47fff640 1 --2- 172.21.15.113:0/2824127084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f477fe640 1 -- 172.21.15.113:0/2824127084 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621524496 0 0) 0x7f8f40001490 con 0x7f8f480b0640 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f477fe640 1 -- 172.21.15.113:0/2824127084 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f38003520 con 0x7f8f480b0640 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f4c9e8640 1 -- 172.21.15.113:0/2824127084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 msgr2=0x7f8f480b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f4c9e8640 1 --2- 172.21.15.113:0/2824127084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f4c9e8640 1 -- 172.21.15.113:0/2824127084 >> v1:172.21.15.113:6789/0 conn(0x7f8f480b0640 legacy=0x7f8f4815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.599+0000 7f8f4c9e8640 1 -- 172.21.15.113:0/2824127084 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480ae640 con 0x7f8f48157bf0 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.600+0000 7f8f4c9e8640 1 --2- 172.21.15.113:0/2824127084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f4815b200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0097a0 tx=0x7f8f3c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b120cd7cfca52003 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:49.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.600+0000 7f8f477fe640 1 -- 172.21.15.113:0/2824127084 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c02d040 con 0x7f8f48157bf0 2023-12-19T13:46:49.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.600+0000 7f8f477fe640 1 -- 172.21.15.113:0/2824127084 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c031810 con 0x7f8f48157bf0 2023-12-19T13:46:49.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.600+0000 7f8f477fe640 1 -- 172.21.15.113:0/2824127084 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c031ba0 con 0x7f8f48157bf0 2023-12-19T13:46:49.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/2824127084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 msgr2=0x7f8f4815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/2824127084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f4815b200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0097a0 tx=0x7f8f3c02b8b0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/2824127084 shutdown_connections 2023-12-19T13:46:49.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/2824127084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/2824127084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f4815b200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/2824127084 >> 172.21.15.113:0/2824127084 conn(0x7f8f480cbb70 msgr2=0x7f8f480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:49.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/2824127084 shutdown_connections 2023-12-19T13:46:49.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.601+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/2824127084 wait complete. 2023-12-19T13:46:49.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.603+0000 7f8f4ec4c640 1 Processor -- start 2023-12-19T13:46:49.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.603+0000 7f8f4ec4c640 1 -- start start 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.604+0000 7f8f4ec4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.604+0000 7f8f4ec4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f480b0640 0x7f8f480cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.604+0000 7f8f4ec4c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f480ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.604+0000 7f8f4ec4c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48147e60 con 0x7f8f48157bf0 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.604+0000 7f8f4ec4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48148100 con 0x7f8f480b0640 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.604+0000 7f8f4ec4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f481483e0 con 0x7f8f480ae110 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f480ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f480ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52798/0 (socket says 172.21.15.113:52798) 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 -- 172.21.15.113:0/3537045504 learned_addr learned my addr 172.21.15.113:0/3537045504 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4c9e8640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f47fff640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f480b0640 0x7f8f480cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 -- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 msgr2=0x7f8f480abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 -- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f480b0640 msgr2=0x7f8f480cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f480b0640 0x7f8f480cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.605+0000 7f8f4d1e9640 1 -- 172.21.15.113:0/3537045504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009400 con 0x7f8f48157bf0 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.606+0000 7f8f4d1e9640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f480ce2e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000cb40 tx=0x7f8f4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.606+0000 7f8f457fa640 1 -- 172.21.15.113:0/3537045504 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000aca0 con 0x7f8f48157bf0 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.606+0000 7f8f457fa640 1 -- 172.21.15.113:0/3537045504 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4000ae00 con 0x7f8f48157bf0 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.606+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f481486c0 con 0x7f8f48157bf0 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.606+0000 7f8f457fa640 1 -- 172.21.15.113:0/3537045504 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40012620 con 0x7f8f48157bf0 2023-12-19T13:46:49.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.606+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f481458a0 con 0x7f8f48157bf0 2023-12-19T13:46:49.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.607+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f48148be0 con 0x7f8f48157bf0 2023-12-19T13:46:49.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.608+0000 7f8f457fa640 1 -- 172.21.15.113:0/3537045504 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f40007070 con 0x7f8f48157bf0 2023-12-19T13:46:49.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.609+0000 7f8f457fa640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f2c06a460 0x7f8f2c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:49.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.609+0000 7f8f457fa640 1 -- 172.21.15.113:0/3537045504 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f40088790 con 0x7f8f48157bf0 2023-12-19T13:46:49.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.609+0000 7f8f4c9e8640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f2c06a460 0x7f8f2c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:49.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.610+0000 7f8f4c9e8640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f2c06a460 0x7f8f2c06c920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c036000 tx=0x7f8f3c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:49.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.613+0000 7f8f457fa640 1 -- 172.21.15.113:0/3537045504 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f48148be0 con 0x7f8f48157bf0 2023-12-19T13:46:49.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.792+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f480b0a90 con 0x7f8f48157bf0 2023-12-19T13:46:49.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.794+0000 7f8f457fa640 1 -- 172.21.15.113:0/3537045504 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f8f480b0a90 con 0x7f8f48157bf0 2023-12-19T13:46:49.794 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:49.795 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:49.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f2c06a460 msgr2=0x7f8f2c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f2c06a460 0x7f8f2c06c920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c036000 tx=0x7f8f3c03c040 comp rx=0 tx=0).stop 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 msgr2=0x7f8f480ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f480ce2e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000cb40 tx=0x7f8f4000a060 comp rx=0 tx=0).stop 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 shutdown_connections 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f2c06a460 0x7f8f2c06c920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f48157bf0 0x7f8f480ce2e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f480b0640 0x7f8f480cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 --2- 172.21.15.113:0/3537045504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f480ae110 0x7f8f480abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 >> 172.21.15.113:0/3537045504 conn(0x7f8f480cbb70 msgr2=0x7f8f4806d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 shutdown_connections 2023-12-19T13:46:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:49.797+0000 7f8f4ec4c640 1 -- 172.21.15.113:0/3537045504 wait complete. 2023-12-19T13:46:49.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:46:49.816 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:46:50.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.034+0000 7f4213b7e640 1 Processor -- start 2023-12-19T13:46:50.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.034+0000 7f4213b7e640 1 -- start start 2023-12-19T13:46:50.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.035+0000 7f4213b7e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f420c15b1d0 0x7f420c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.035+0000 7f4213b7e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f420c0ceea0 0x7f420c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.035+0000 7f4213b7e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c15fde0 con 0x7f420c0b1ec0 2023-12-19T13:46:50.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.035+0000 7f4213b7e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0cf870 con 0x7f420c0ceea0 2023-12-19T13:46:50.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.035+0000 7f4213b7e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c15ef10 con 0x7f420c15b1d0 2023-12-19T13:46:50.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f4211119640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f420c0b1ec0 0x7f420c15f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59020/0 (socket says 172.21.15.113:59020) 2023-12-19T13:46:50.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f4211119640 1 -- 172.21.15.113:0/2917953372 learned_addr learned my addr 172.21.15.113:0/2917953372 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:50.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f421211b640 1 --2- 172.21.15.113:0/2917953372 >> v2:172.21.15.113:3300/0 conn(0x7f420c0ceea0 0x7f420c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f421191a640 1 --2- 172.21.15.113:0/2917953372 >> v2:172.21.15.151:3300/0 conn(0x7f420c15b1d0 0x7f420c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f4210918640 1 -- 172.21.15.113:0/2917953372 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516092562 0 0) 0x7f420c15fde0 con 0x7f420c0b1ec0 2023-12-19T13:46:50.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f4210918640 1 -- 172.21.15.113:0/2917953372 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f8003520 con 0x7f420c0b1ec0 2023-12-19T13:46:50.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f421211b640 1 -- 172.21.15.113:0/2917953372 >> v2:172.21.15.151:3300/0 conn(0x7f420c15b1d0 msgr2=0x7f420c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:50.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f421211b640 1 --2- 172.21.15.113:0/2917953372 >> v2:172.21.15.151:3300/0 conn(0x7f420c15b1d0 0x7f420c0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f421211b640 1 -- 172.21.15.113:0/2917953372 >> v1:172.21.15.113:6789/0 conn(0x7f420c0b1ec0 legacy=0x7f420c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.036+0000 7f421211b640 1 -- 172.21.15.113:0/2917953372 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0b2320 con 0x7f420c0ceea0 2023-12-19T13:46:50.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f421211b640 1 --2- 172.21.15.113:0/2917953372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0ceea0 0x7f420c0cf330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f420c0ae020 tx=0x7f420402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297c9e56c30cb65b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4210918640 1 -- 172.21.15.113:0/2917953372 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420402cc80 con 0x7f420c0ceea0 2023-12-19T13:46:50.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4210918640 1 -- 172.21.15.113:0/2917953372 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420402cde0 con 0x7f420c0ceea0 2023-12-19T13:46:50.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4210918640 1 -- 172.21.15.113:0/2917953372 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204034660 con 0x7f420c0ceea0 2023-12-19T13:46:50.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4213b7e640 1 -- 172.21.15.113:0/2917953372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0ceea0 msgr2=0x7f420c0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2917953372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0ceea0 0x7f420c0cf330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f420c0ae020 tx=0x7f420402bed0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4213b7e640 1 -- 172.21.15.113:0/2917953372 shutdown_connections 2023-12-19T13:46:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2917953372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0ceea0 0x7f420c0cf330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2917953372 >> v2:172.21.15.151:3300/0 conn(0x7f420c15b1d0 0x7f420c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.038+0000 7f4213b7e640 1 -- 172.21.15.113:0/2917953372 >> 172.21.15.113:0/2917953372 conn(0x7f420c073150 msgr2=0x7f420c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.039+0000 7f4213b7e640 1 -- 172.21.15.113:0/2917953372 shutdown_connections 2023-12-19T13:46:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.039+0000 7f4213b7e640 1 -- 172.21.15.113:0/2917953372 wait complete. 2023-12-19T13:46:50.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.040+0000 7f4213b7e640 1 Processor -- start 2023-12-19T13:46:50.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.040+0000 7f4213b7e640 1 -- start start 2023-12-19T13:46:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.041+0000 7f4213b7e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f420c0b1ec0 0x7f420c152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.041+0000 7f4213b7e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0ceea0 0x7f420c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.041+0000 7f4213b7e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c15b1d0 0x7f420c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.041+0000 7f4213b7e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c153580 con 0x7f420c15b1d0 2023-12-19T13:46:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.041+0000 7f4213b7e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c153860 con 0x7f420c0b1ec0 2023-12-19T13:46:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.041+0000 7f4213b7e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c153b40 con 0x7f420c0ceea0 2023-12-19T13:46:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c15b1d0 0x7f420c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c15b1d0 0x7f420c0cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52802/0 (socket says 172.21.15.113:52802) 2023-12-19T13:46:50.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 -- 172.21.15.113:0/2248543165 learned_addr learned my addr 172.21.15.113:0/2248543165 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421191a640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f420c0b1ec0 0x7f420c152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f4211119640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0ceea0 0x7f420c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 -- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0ceea0 msgr2=0x7f420c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0ceea0 0x7f420c156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 -- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f420c0b1ec0 msgr2=0x7f420c152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f420c0b1ec0 0x7f420c152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 -- 172.21.15.113:0/2248543165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204009a70 con 0x7f420c15b1d0 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.042+0000 7f421211b640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c15b1d0 0x7f420c0cb9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4204009e80 tx=0x7f4204004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.043+0000 7f41fe7fc640 1 -- 172.21.15.113:0/2248543165 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204040650 con 0x7f420c15b1d0 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.043+0000 7f41fe7fc640 1 -- 172.21.15.113:0/2248543165 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42040407b0 con 0x7f420c15b1d0 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.043+0000 7f41fe7fc640 1 -- 172.21.15.113:0/2248543165 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204040b60 con 0x7f420c15b1d0 2023-12-19T13:46:50.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.043+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c0c8440 con 0x7f420c15b1d0 2023-12-19T13:46:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.043+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c157140 con 0x7f420c15b1d0 2023-12-19T13:46:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.044+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c0c82a0 con 0x7f420c15b1d0 2023-12-19T13:46:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.045+0000 7f41fe7fc640 1 -- 172.21.15.113:0/2248543165 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4204040cc0 con 0x7f420c15b1d0 2023-12-19T13:46:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.045+0000 7f41fe7fc640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f41f006a460 0x7f41f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.046+0000 7f41fe7fc640 1 -- 172.21.15.113:0/2248543165 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42040ab380 con 0x7f420c15b1d0 2023-12-19T13:46:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.046+0000 7f421191a640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f41f006a460 0x7f41f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.046+0000 7f421191a640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f41f006a460 0x7f41f006c920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4208009970 tx=0x7f4208008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.050+0000 7f41fe7fc640 1 -- 172.21.15.113:0/2248543165 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f420c0c82a0 con 0x7f420c15b1d0 2023-12-19T13:46:50.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.223+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f420c0c82a0 con 0x7f420c15b1d0 2023-12-19T13:46:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.224+0000 7f41fe7fc640 1 -- 172.21.15.113:0/2248543165 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f420c0c82a0 con 0x7f420c15b1d0 2023-12-19T13:46:50.224 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f41f006a460 msgr2=0x7f41f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f41f006a460 0x7f41f006c920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4208009970 tx=0x7f4208008040 comp rx=0 tx=0).stop 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c15b1d0 msgr2=0x7f420c0cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c15b1d0 0x7f420c0cb9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4204009e80 tx=0x7f4204004a40 comp rx=0 tx=0).stop 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 shutdown_connections 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f41f006a460 0x7f41f006c920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c15b1d0 0x7f420c0cb9b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0ceea0 0x7f420c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 --2- 172.21.15.113:0/2248543165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f420c0b1ec0 0x7f420c152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 >> 172.21.15.113:0/2248543165 conn(0x7f420c073150 msgr2=0x7f420c0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 shutdown_connections 2023-12-19T13:46:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.227+0000 7f4213b7e640 1 -- 172.21.15.113:0/2248543165 wait complete. 2023-12-19T13:46:50.245 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:46:50.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.453+0000 7f5993163640 1 Processor -- start 2023-12-19T13:46:50.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.453+0000 7f5993163640 1 -- start start 2023-12-19T13:46:50.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5993163640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f598c161020 0x7f598c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5993163640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5993163640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f598c0b63c0 0x7f598c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5993163640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c15df70 con 0x7f598c161020 2023-12-19T13:46:50.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5993163640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c15e1a0 con 0x7f598c0b63c0 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5993163640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c15e480 con 0x7f598c143230 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5990eff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f598c161020 0x7f598c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5990eff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f598c161020 0x7f598c15da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52808/0 (socket says 172.21.15.113:52808) 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5990eff640 1 -- 172.21.15.113:0/3707002849 learned_addr learned my addr 172.21.15.113:0/3707002849 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5983fff640 1 --2- 172.21.15.113:0/3707002849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5991700640 1 --2- 172.21.15.113:0/3707002849 >> v2:172.21.15.151:3300/0 conn(0x7f598c0b63c0 0x7f598c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5990eff640 1 -- 172.21.15.113:0/3707002849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 msgr2=0x7f598c143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.455+0000 7f5990eff640 1 --2- 172.21.15.113:0/3707002849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.456+0000 7f5990eff640 1 -- 172.21.15.113:0/3707002849 >> v2:172.21.15.151:3300/0 conn(0x7f598c0b63c0 msgr2=0x7f598c0b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.456+0000 7f5990eff640 1 --2- 172.21.15.113:0/3707002849 >> v2:172.21.15.151:3300/0 conn(0x7f598c0b63c0 0x7f598c0b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.456+0000 7f5990eff640 1 -- 172.21.15.113:0/3707002849 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c15e760 con 0x7f598c161020 2023-12-19T13:46:50.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.456+0000 7f5983fff640 1 --2- 172.21.15.113:0/3707002849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:50.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.457+0000 7f5990eff640 1 --2- 172.21.15.113:0/3707002849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c15da30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f598c0d0ed0 tx=0x7f598802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57418434bf98b66c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.457+0000 7f59837fe640 1 -- 172.21.15.113:0/3707002849 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988031860 con 0x7f598c161020 2023-12-19T13:46:50.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.457+0000 7f59837fe640 1 -- 172.21.15.113:0/3707002849 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59880319c0 con 0x7f598c161020 2023-12-19T13:46:50.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.457+0000 7f59837fe640 1 -- 172.21.15.113:0/3707002849 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988031d50 con 0x7f598c161020 2023-12-19T13:46:50.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 -- 172.21.15.113:0/3707002849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 msgr2=0x7f598c15da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 --2- 172.21.15.113:0/3707002849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c15da30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f598c0d0ed0 tx=0x7f598802b900 comp rx=0 tx=0).stop 2023-12-19T13:46:50.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 -- 172.21.15.113:0/3707002849 shutdown_connections 2023-12-19T13:46:50.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 --2- 172.21.15.113:0/3707002849 >> v2:172.21.15.151:3300/0 conn(0x7f598c0b63c0 0x7f598c0b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 --2- 172.21.15.113:0/3707002849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 --2- 172.21.15.113:0/3707002849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c15da30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 -- 172.21.15.113:0/3707002849 >> 172.21.15.113:0/3707002849 conn(0x7f598c0b26f0 msgr2=0x7f598c0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:50.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 -- 172.21.15.113:0/3707002849 shutdown_connections 2023-12-19T13:46:50.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.458+0000 7f5993163640 1 -- 172.21.15.113:0/3707002849 wait complete. 2023-12-19T13:46:50.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.460+0000 7f5993163640 1 Processor -- start 2023-12-19T13:46:50.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.460+0000 7f5993163640 1 -- start start 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.461+0000 7f5993163640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f598c0b63c0 0x7f598c141560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.461+0000 7f5993163640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.461+0000 7f5993163640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.461+0000 7f5993163640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c15cbb0 con 0x7f598c161020 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.461+0000 7f5993163640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c159140 con 0x7f598c0b63c0 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.461+0000 7f5993163640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c15bf30 con 0x7f598c143230 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52812/0 (socket says 172.21.15.113:52812) 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 -- 172.21.15.113:0/2162228168 learned_addr learned my addr 172.21.15.113:0/2162228168 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5990eff640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f598c0b63c0 0x7f598c141560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 -- 172.21.15.113:0/2162228168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 msgr2=0x7f598c1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 -- 172.21.15.113:0/2162228168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f598c0b63c0 msgr2=0x7f598c141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f598c0b63c0 0x7f598c141560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 -- 172.21.15.113:0/2162228168 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59880094d0 con 0x7f598c161020 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f5991700640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c158c00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f598400ccf0 tx=0x7f598400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.462+0000 7f59817fa640 1 -- 172.21.15.113:0/2162228168 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984003b90 con 0x7f598c161020 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.463+0000 7f59817fa640 1 -- 172.21.15.113:0/2162228168 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984003cf0 con 0x7f598c161020 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.463+0000 7f59817fa640 1 -- 172.21.15.113:0/2162228168 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984004240 con 0x7f598c161020 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.463+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c15c210 con 0x7f598c161020 2023-12-19T13:46:50.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.463+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c15c7d0 con 0x7f598c161020 2023-12-19T13:46:50.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.464+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c15ccf0 con 0x7f598c161020 2023-12-19T13:46:50.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.465+0000 7f59817fa640 1 -- 172.21.15.113:0/2162228168 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f59840043a0 con 0x7f598c161020 2023-12-19T13:46:50.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.466+0000 7f59817fa640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f597806a430 0x7f597806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.466+0000 7f59817fa640 1 -- 172.21.15.113:0/2162228168 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5984012070 con 0x7f598c161020 2023-12-19T13:46:50.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.466+0000 7f5990eff640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f597806a430 0x7f597806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.467+0000 7f5990eff640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f597806a430 0x7f597806c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5988036000 tx=0x7f598803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.470+0000 7f59817fa640 1 -- 172.21.15.113:0/2162228168 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f598c15ccf0 con 0x7f598c161020 2023-12-19T13:46:50.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.661+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f598c15ccf0 con 0x7f598c161020 2023-12-19T13:46:50.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.662+0000 7f59817fa640 1 -- 172.21.15.113:0/2162228168 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f598c15ccf0 con 0x7f598c161020 2023-12-19T13:46:50.662 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:46:50.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.664+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f597806a430 msgr2=0x7f597806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.664+0000 7f5993163640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f597806a430 0x7f597806c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5988036000 tx=0x7f598803c040 comp rx=0 tx=0).stop 2023-12-19T13:46:50.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.664+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 msgr2=0x7f598c158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.664+0000 7f5993163640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c158c00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f598400ccf0 tx=0x7f598400a660 comp rx=0 tx=0).stop 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 shutdown_connections 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f597806a430 0x7f597806c8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f598c161020 0x7f598c158c00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f598c143230 0x7f598c1586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 --2- 172.21.15.113:0/2162228168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f598c0b63c0 0x7f598c141560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 >> 172.21.15.113:0/2162228168 conn(0x7f598c0b26f0 msgr2=0x7f598c140a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 shutdown_connections 2023-12-19T13:46:50.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.665+0000 7f5993163640 1 -- 172.21.15.113:0/2162228168 wait complete. 2023-12-19T13:46:50.681 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:46:50.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.893+0000 7f0abe484640 1 Processor -- start 2023-12-19T13:46:50.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.893+0000 7f0abe484640 1 -- start start 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abe484640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ab815b1d0 0x7f0ab80b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abe484640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abe484640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ab80ceea0 0x7f0ab80cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abe484640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab80cf870 con 0x7f0ab80ceea0 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abe484640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab815ef10 con 0x7f0ab815b1d0 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abe484640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80b2320 con 0x7f0ab80b1ec0 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ab80ceea0 0x7f0ab80cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ab80ceea0 0x7f0ab80cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52818/0 (socket says 172.21.15.113:52818) 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 -- 172.21.15.113:0/1056828971 learned_addr learned my addr 172.21.15.113:0/1056828971 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0ab7fff640 1 --2- 172.21.15.113:0/1056828971 >> v2:172.21.15.151:3300/0 conn(0x7f0ab815b1d0 0x7f0ab80b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0ab77fe640 1 --2- 172.21.15.113:0/1056828971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 -- 172.21.15.113:0/1056828971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 msgr2=0x7f0ab815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 --2- 172.21.15.113:0/1056828971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 -- 172.21.15.113:0/1056828971 >> v2:172.21.15.151:3300/0 conn(0x7f0ab815b1d0 msgr2=0x7f0ab80b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 --2- 172.21.15.113:0/1056828971 >> v2:172.21.15.151:3300/0 conn(0x7f0ab815b1d0 0x7f0ab80b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.895+0000 7f0abca21640 1 -- 172.21.15.113:0/1056828971 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80b2e40 con 0x7f0ab80ceea0 2023-12-19T13:46:50.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.896+0000 7f0abca21640 1 --2- 172.21.15.113:0/1056828971 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab80ceea0 0x7f0ab80cf330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80ae020 tx=0x7f0ab002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a000f50cbdca5cd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0ab6ffd640 1 -- 172.21.15.113:0/1056828971 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0031870 con 0x7f0ab80ceea0 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0ab6ffd640 1 -- 172.21.15.113:0/1056828971 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab00319d0 con 0x7f0ab80ceea0 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0ab6ffd640 1 -- 172.21.15.113:0/1056828971 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0031d60 con 0x7f0ab80ceea0 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0abe484640 1 -- 172.21.15.113:0/1056828971 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab80ceea0 msgr2=0x7f0ab80cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0abe484640 1 --2- 172.21.15.113:0/1056828971 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab80ceea0 0x7f0ab80cf330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80ae020 tx=0x7f0ab002b910 comp rx=0 tx=0).stop 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0abe484640 1 -- 172.21.15.113:0/1056828971 shutdown_connections 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0abe484640 1 --2- 172.21.15.113:0/1056828971 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab80ceea0 0x7f0ab80cf330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0abe484640 1 --2- 172.21.15.113:0/1056828971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0abe484640 1 --2- 172.21.15.113:0/1056828971 >> v2:172.21.15.151:3300/0 conn(0x7f0ab815b1d0 0x7f0ab80b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.897+0000 7f0abe484640 1 -- 172.21.15.113:0/1056828971 >> 172.21.15.113:0/1056828971 conn(0x7f0ab8073150 msgr2=0x7f0ab80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.898+0000 7f0abe484640 1 -- 172.21.15.113:0/1056828971 shutdown_connections 2023-12-19T13:46:50.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.898+0000 7f0abe484640 1 -- 172.21.15.113:0/1056828971 wait complete. 2023-12-19T13:46:50.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.899+0000 7f0abe484640 1 Processor -- start 2023-12-19T13:46:50.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.899+0000 7f0abe484640 1 -- start start 2023-12-19T13:46:50.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abe484640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab80c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abe484640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab80ceea0 0x7f0ab8156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abe484640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab815b1d0 0x7f0ab8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abe484640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8157100 con 0x7f0ab815b1d0 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abe484640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80c7290 con 0x7f0ab80ceea0 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abe484640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81e6010 con 0x7f0ab80b1ec0 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abca21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab815b1d0 0x7f0ab8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abca21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab815b1d0 0x7f0ab8156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52832/0 (socket says 172.21.15.113:52832) 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.900+0000 7f0abca21640 1 -- 172.21.15.113:0/1500046943 learned_addr learned my addr 172.21.15.113:0/1500046943 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0ab77fe640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab80ceea0 0x7f0ab8156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0ab7fff640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab80c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0abca21640 1 -- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 msgr2=0x7f0ab80c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0abca21640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab80c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0abca21640 1 -- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab80ceea0 msgr2=0x7f0ab8156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:50.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0abca21640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab80ceea0 0x7f0ab8156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:50.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0abca21640 1 -- 172.21.15.113:0/1500046943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00094d0 con 0x7f0ab815b1d0 2023-12-19T13:46:50.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0abca21640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab815b1d0 0x7f0ab8156bc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ab002b950 tx=0x7f0ab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0ab4ff9640 1 -- 172.21.15.113:0/1500046943 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab003ac60 con 0x7f0ab815b1d0 2023-12-19T13:46:50.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0ab4ff9640 1 -- 172.21.15.113:0/1500046943 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab003adc0 con 0x7f0ab815b1d0 2023-12-19T13:46:50.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.901+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab81e62f0 con 0x7f0ab815b1d0 2023-12-19T13:46:50.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.902+0000 7f0ab4ff9640 1 -- 172.21.15.113:0/1500046943 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0044630 con 0x7f0ab815b1d0 2023-12-19T13:46:50.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.902+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab81e68b0 con 0x7f0ab815b1d0 2023-12-19T13:46:50.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.903+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab8061910 con 0x7f0ab815b1d0 2023-12-19T13:46:50.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.903+0000 7f0ab4ff9640 1 -- 172.21.15.113:0/1500046943 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ab0044790 con 0x7f0ab815b1d0 2023-12-19T13:46:50.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.904+0000 7f0ab4ff9640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aa406a460 0x7f0aa406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:50.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.904+0000 7f0ab4ff9640 1 -- 172.21.15.113:0/1500046943 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ab002d040 con 0x7f0ab815b1d0 2023-12-19T13:46:50.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.905+0000 7f0ab7fff640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aa406a460 0x7f0aa406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:50.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.905+0000 7f0ab7fff640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aa406a460 0x7f0aa406c920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ab815d790 tx=0x7f0aa800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:50.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:50.909+0000 7f0ab4ff9640 1 -- 172.21.15.113:0/1500046943 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ab0076760 con 0x7f0ab815b1d0 2023-12-19T13:46:51.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.097+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ab80cdc90 con 0x7f0ab815b1d0 2023-12-19T13:46:51.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.098+0000 7f0ab4ff9640 1 -- 172.21.15.113:0/1500046943 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ab0079d80 con 0x7f0ab815b1d0 2023-12-19T13:46:51.098 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:46:51.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.100+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aa406a460 msgr2=0x7f0aa406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.100+0000 7f0abe484640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aa406a460 0x7f0aa406c920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ab815d790 tx=0x7f0aa800b040 comp rx=0 tx=0).stop 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.100+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab815b1d0 msgr2=0x7f0ab8156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.100+0000 7f0abe484640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab815b1d0 0x7f0ab8156bc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ab002b950 tx=0x7f0ab00046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.100+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 shutdown_connections 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.100+0000 7f0abe484640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aa406a460 0x7f0aa406c920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.100+0000 7f0abe484640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab815b1d0 0x7f0ab8156bc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.101+0000 7f0abe484640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab80ceea0 0x7f0ab8156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.101+0000 7f0abe484640 1 --2- 172.21.15.113:0/1500046943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab80b1ec0 0x7f0ab80c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.101+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 >> 172.21.15.113:0/1500046943 conn(0x7f0ab8073150 msgr2=0x7f0ab81574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.101+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 shutdown_connections 2023-12-19T13:46:51.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.101+0000 7f0abe484640 1 -- 172.21.15.113:0/1500046943 wait complete. 2023-12-19T13:46:51.119 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:46:51.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.327+0000 7f4334139640 1 Processor -- start 2023-12-19T13:46:51.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.327+0000 7f4334139640 1 -- start start 2023-12-19T13:46:51.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.329+0000 7f4334139640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f432c0b25f0 0x7f432c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.329+0000 7f4334139640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c06d1a0 con 0x7f432c06cd50 2023-12-19T13:46:51.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.329+0000 7f4334139640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c148030 con 0x7f432c147c50 2023-12-19T13:46:51.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.329+0000 7f4334139640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0b1e80 con 0x7f432c0b25f0 2023-12-19T13:46:51.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f43326d6640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f432c06cd50 0x7f432c06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59032/0 (socket says 172.21.15.113:59032) 2023-12-19T13:46:51.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f43326d6640 1 -- 172.21.15.113:0/2600547722 learned_addr learned my addr 172.21.15.113:0/2600547722 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:51.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f43316d4640 1 --2- 172.21.15.113:0/2600547722 >> v2:172.21.15.151:3300/0 conn(0x7f432c0b25f0 0x7f432c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291571081 0 0) 0x7f4324001110 con 0x7f432c06cd50 2023-12-19T13:46:51.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4314003520 con 0x7f432c06cd50 2023-12-19T13:46:51.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2092812478 0 0) 0x7f4314003520 con 0x7f432c06cd50 2023-12-19T13:46:51.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 >> v2:172.21.15.151:3300/0 conn(0x7f432c0b25f0 msgr2=0x7f432c06c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 --2- 172.21.15.113:0/2600547722 >> v2:172.21.15.151:3300/0 conn(0x7f432c0b25f0 0x7f432c06c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 >> v1:172.21.15.151:6789/0 conn(0x7f432c147c50 legacy=0x7f432c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0b0de0 con 0x7f432c06cd50 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f4324001800 con 0x7f432c06cd50 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 >> v1:172.21.15.113:6789/0 conn(0x7f432c06cd50 legacy=0x7f432c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4314003a30 0x7f4314003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43140047c0 0x7f4314004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43140052a0 0x7f431400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0b1e80 con 0x7f43140047c0 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431400c170 con 0x7f43140052a0 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.330+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431400c330 con 0x7f4314003a30 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43316d4640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43140047c0 0x7f4314004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f4331ed5640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4314003a30 0x7f4314003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43326d6640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43140052a0 0x7f431400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43316d4640 1 -- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4314003a30 msgr2=0x7f4314003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43316d4640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4314003a30 0x7f4314003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43316d4640 1 -- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43140052a0 msgr2=0x7f431400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43316d4640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43140052a0 0x7f431400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43316d4640 1 -- 172.21.15.113:0/2600547722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4314003520 con 0x7f43140047c0 2023-12-19T13:46:51.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.331+0000 7f43326d6640 1 -- 172.21.15.113:0/2600547722 reap_dead start 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.332+0000 7f43316d4640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43140047c0 0x7f4314004c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4320009ac0 tx=0x7f43140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e56ff1e69b7aae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.332+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432002c6b0 con 0x7f43140047c0 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.332+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432002c810 con 0x7f43140047c0 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.332+0000 7f4330ed3640 1 -- 172.21.15.113:0/2600547722 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432002cba0 con 0x7f43140047c0 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.333+0000 7f4334139640 1 -- 172.21.15.113:0/2600547722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43140047c0 msgr2=0x7f4314004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.333+0000 7f4334139640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43140047c0 0x7f4314004c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4320009ac0 tx=0x7f43140057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.333+0000 7f4334139640 1 -- 172.21.15.113:0/2600547722 shutdown_connections 2023-12-19T13:46:51.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.333+0000 7f4334139640 1 --2- 172.21.15.113:0/2600547722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43140047c0 0x7f4314004c40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.333+0000 7f4334139640 1 -- 172.21.15.113:0/2600547722 >> 172.21.15.113:0/2600547722 conn(0x7f432c0659d0 msgr2=0x7f432c065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:51.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.333+0000 7f4334139640 1 -- 172.21.15.113:0/2600547722 shutdown_connections 2023-12-19T13:46:51.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.333+0000 7f4334139640 1 -- 172.21.15.113:0/2600547722 wait complete. 2023-12-19T13:46:51.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.335+0000 7f4334139640 1 Processor -- start 2023-12-19T13:46:51.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.335+0000 7f4334139640 1 -- start start 2023-12-19T13:46:51.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f4334139640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43140047c0 0x7f432c1397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f4334139640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c14a3b0 0x7f432c15cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f4334139640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f432c06f120 0x7f432c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f4334139640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c06fae0 con 0x7f432c06f120 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f4334139640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c15d7c0 con 0x7f432c14a3b0 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f4334139640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c15daa0 con 0x7f43140047c0 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f43326d6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f432c06f120 0x7f432c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f43326d6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f432c06f120 0x7f432c06f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52860/0 (socket says 172.21.15.113:52860) 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.336+0000 7f43326d6640 1 -- 172.21.15.113:0/1834292615 learned_addr learned my addr 172.21.15.113:0/1834292615 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43316d4640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c14a3b0 0x7f432c15cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f4331ed5640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43140047c0 0x7f432c1397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43326d6640 1 -- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43140047c0 msgr2=0x7f432c1397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43326d6640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43140047c0 0x7f432c1397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43326d6640 1 -- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c14a3b0 msgr2=0x7f432c15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43326d6640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c14a3b0 0x7f432c15cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43326d6640 1 -- 172.21.15.113:0/1834292615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c15dd80 con 0x7f432c06f120 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f4331ed5640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43140047c0 0x7f432c1397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43316d4640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c14a3b0 0x7f432c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f43326d6640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f432c06f120 0x7f432c06f5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f432c070930 tx=0x7f432400d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f432a7fc640 1 -- 172.21.15.113:0/1834292615 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324007440 con 0x7f432c06f120 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f432a7fc640 1 -- 172.21.15.113:0/1834292615 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43240075c0 con 0x7f432c06f120 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c15e060 con 0x7f432c06f120 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f432a7fc640 1 -- 172.21.15.113:0/1834292615 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324004a20 con 0x7f432c06f120 2023-12-19T13:46:51.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.337+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c15d400 con 0x7f432c06f120 2023-12-19T13:46:51.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.338+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c074770 con 0x7f432c06f120 2023-12-19T13:46:51.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.339+0000 7f432a7fc640 1 -- 172.21.15.113:0/1834292615 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4324004b80 con 0x7f432c06f120 2023-12-19T13:46:51.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.340+0000 7f432a7fc640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f431806a430 0x7f431806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.340+0000 7f432a7fc640 1 -- 172.21.15.113:0/1834292615 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43240881d0 con 0x7f432c06f120 2023-12-19T13:46:51.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.340+0000 7f4331ed5640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f431806a430 0x7f431806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.341+0000 7f4331ed5640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f431806a430 0x7f431806c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f431c007fd0 tx=0x7f431c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.344+0000 7f432a7fc640 1 -- 172.21.15.113:0/1834292615 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4324053860 con 0x7f432c06f120 2023-12-19T13:46:51.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.570+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f432c06d1a0 con 0x7f432c06f120 2023-12-19T13:46:51.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.570+0000 7f432a7fc640 1 -- 172.21.15.113:0/1834292615 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f432c06d1a0 con 0x7f432c06f120 2023-12-19T13:46:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:51.570 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:46:51.571 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f431806a430 msgr2=0x7f431806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f431806a430 0x7f431806c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f431c007fd0 tx=0x7f431c009040 comp rx=0 tx=0).stop 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f432c06f120 msgr2=0x7f432c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f432c06f120 0x7f432c06f5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f432c070930 tx=0x7f432400d950 comp rx=0 tx=0).stop 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 shutdown_connections 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f431806a430 0x7f431806c8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f432c06f120 0x7f432c06f5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c14a3b0 0x7f432c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 --2- 172.21.15.113:0/1834292615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43140047c0 0x7f432c1397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 >> 172.21.15.113:0/1834292615 conn(0x7f432c0659d0 msgr2=0x7f432c0711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 shutdown_connections 2023-12-19T13:46:51.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.573+0000 7f4334139640 1 -- 172.21.15.113:0/1834292615 wait complete. 2023-12-19T13:46:51.591 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:46:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.799+0000 7f361c927640 1 Processor -- start 2023-12-19T13:46:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.799+0000 7f361c927640 1 -- start start 2023-12-19T13:46:51.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.801+0000 7f361c927640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f36180b0b50 0x7f361806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.801+0000 7f361c927640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 0x7f361806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.801+0000 7f361c927640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361806bb30 con 0x7f36181449e0 2023-12-19T13:46:51.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.801+0000 7f361c927640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180b0070 con 0x7f36180b0b50 2023-12-19T13:46:51.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.801+0000 7f361c927640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36180b0350 con 0x7f361806b590 2023-12-19T13:46:51.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.801+0000 7f361659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f36181449e0 0x7f36180af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59034/0 (socket says 172.21.15.113:59034) 2023-12-19T13:46:51.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.801+0000 7f361659c640 1 -- 172.21.15.113:0/2959845596 learned_addr learned my addr 172.21.15.113:0/2959845596 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3616d9d640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 0x7f361806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f360ffff640 1 --2- 172.21.15.113:0/2959845596 >> v2:172.21.15.151:3300/0 conn(0x7f36180b0b50 0x7f361806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594542928 0 0) 0x7f361806bb30 con 0x7f36181449e0 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3604003520 con 0x7f36181449e0 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2026569424 0 0) 0x7f3604003520 con 0x7f36181449e0 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 msgr2=0x7f361806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 0x7f361806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 >> v2:172.21.15.151:3300/0 conn(0x7f36180b0b50 msgr2=0x7f361806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 --2- 172.21.15.113:0/2959845596 >> v2:172.21.15.151:3300/0 conn(0x7f36180b0b50 0x7f361806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36180b0630 con 0x7f36181449e0 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3608001670 con 0x7f36181449e0 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 >> v1:172.21.15.113:6789/0 conn(0x7f36181449e0 legacy=0x7f36180af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 0x7f36040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604003fb0 0x7f36040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3604005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36180b0070 con 0x7f3604004d00 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36180b0350 con 0x7f3604003fb0 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360400ba00 con 0x7f361806b590 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.802+0000 7f3616d9d640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3604005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.803+0000 7f361659c640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 0x7f36040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.803+0000 7f3616d9d640 1 -- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 msgr2=0x7f36040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.803+0000 7f360ffff640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604003fb0 0x7f36040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.803+0000 7f3616d9d640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f361806b590 0x7f36040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.803+0000 7f3616d9d640 1 -- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604003fb0 msgr2=0x7f36040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:51.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.803+0000 7f3616d9d640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604003fb0 0x7f36040047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.803+0000 7f3616d9d640 1 -- 172.21.15.113:0/2959845596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604003520 con 0x7f3604004d00 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.804+0000 7f3616d9d640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3604005180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3610009fc0 tx=0x7f36040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb302625bf73462f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.804+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361002cc20 con 0x7f3604004d00 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.804+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361000f040 con 0x7f3604004d00 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.804+0000 7f3615d9b640 1 -- 172.21.15.113:0/2959845596 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610034440 con 0x7f3604004d00 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.805+0000 7f361c927640 1 -- 172.21.15.113:0/2959845596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 msgr2=0x7f3604005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.805+0000 7f361c927640 1 --2- 172.21.15.113:0/2959845596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3604005180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3610009fc0 tx=0x7f36040057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.805+0000 7f3616d9d640 1 -- 172.21.15.113:0/2959845596 reap_dead start 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.805+0000 7f361c927640 1 -- 172.21.15.113:0/2959845596 shutdown_connections 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.805+0000 7f361c927640 1 -- 172.21.15.113:0/2959845596 >> 172.21.15.113:0/2959845596 conn(0x7f36180cbb70 msgr2=0x7f36180cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.805+0000 7f361c927640 1 -- 172.21.15.113:0/2959845596 shutdown_connections 2023-12-19T13:46:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.805+0000 7f361c927640 1 -- 172.21.15.113:0/2959845596 wait complete. 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.807+0000 7f361c927640 1 Processor -- start 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.807+0000 7f361c927640 1 -- start start 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361c927640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3618157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361c927640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36180cea60 0x7f3618158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361c927640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3618157090 0x7f3618153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361c927640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618141100 con 0x7f3604004d00 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361c927640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618140db0 con 0x7f3618157090 2023-12-19T13:46:51.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361c927640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618157590 con 0x7f36180cea60 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3618157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3618157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52892/0 (socket says 172.21.15.113:52892) 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 -- 172.21.15.113:0/2508878464 learned_addr learned my addr 172.21.15.113:0/2508878464 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 -- 172.21.15.113:0/2508878464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36180cea60 msgr2=0x7f3618158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36180cea60 0x7f3618158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 -- 172.21.15.113:0/2508878464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3618157090 msgr2=0x7f3618153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3618157090 0x7f3618153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 -- 172.21.15.113:0/2508878464 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618157870 con 0x7f3604004d00 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.808+0000 7f361659c640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3618157f30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f360800e760 tx=0x7f360800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.809+0000 7f360effd640 1 -- 172.21.15.113:0/2508878464 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360800ee70 con 0x7f3604004d00 2023-12-19T13:46:51.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.809+0000 7f360effd640 1 -- 172.21.15.113:0/2508878464 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360800c7f0 con 0x7f3604004d00 2023-12-19T13:46:51.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.809+0000 7f360effd640 1 -- 172.21.15.113:0/2508878464 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360800cba0 con 0x7f3604004d00 2023-12-19T13:46:51.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.809+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3618157b50 con 0x7f3604004d00 2023-12-19T13:46:51.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.809+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361813b2c0 con 0x7f3604004d00 2023-12-19T13:46:51.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.810+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3618157d70 con 0x7f3604004d00 2023-12-19T13:46:51.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.811+0000 7f360effd640 1 -- 172.21.15.113:0/2508878464 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f360800cd00 con 0x7f3604004d00 2023-12-19T13:46:51.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.812+0000 7f360effd640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35f806a460 0x7f35f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:51.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.812+0000 7f360effd640 1 -- 172.21.15.113:0/2508878464 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3608088560 con 0x7f3604004d00 2023-12-19T13:46:51.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.812+0000 7f360ffff640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35f806a460 0x7f35f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:51.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.812+0000 7f360ffff640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35f806a460 0x7f35f806c920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f36180cc1f0 tx=0x7f3600008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:51.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:51.816+0000 7f360effd640 1 -- 172.21.15.113:0/2508878464 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3618157d70 con 0x7f3604004d00 2023-12-19T13:46:52.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.006+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3618157d70 con 0x7f3604004d00 2023-12-19T13:46:52.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.008+0000 7f360effd640 1 -- 172.21.15.113:0/2508878464 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f3618157d70 con 0x7f3604004d00 2023-12-19T13:46:52.008 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:52.009 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35f806a460 msgr2=0x7f35f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35f806a460 0x7f35f806c920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f36180cc1f0 tx=0x7f3600008040 comp rx=0 tx=0).stop 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 msgr2=0x7f3618157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3618157f30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f360800e760 tx=0x7f360800ec20 comp rx=0 tx=0).stop 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 shutdown_connections 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35f806a460 0x7f35f806c920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3618157090 0x7f3618153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36180cea60 0x7f3618158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 --2- 172.21.15.113:0/2508878464 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3604004d00 0x7f3618157f30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 >> 172.21.15.113:0/2508878464 conn(0x7f36180cbb70 msgr2=0x7f361806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:52.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 shutdown_connections 2023-12-19T13:46:52.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.011+0000 7f361c927640 1 -- 172.21.15.113:0/2508878464 wait complete. 2023-12-19T13:46:52.030 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:46:52.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.241+0000 7fdc28238640 1 Processor -- start 2023-12-19T13:46:52.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.241+0000 7fdc28238640 1 -- start start 2023-12-19T13:46:52.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.242+0000 7fdc28238640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 0x7fdc200af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.242+0000 7fdc28238640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdc200b0b50 0x7fdc2006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.242+0000 7fdc28238640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc200afb10 con 0x7fdc2006b590 2023-12-19T13:46:52.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc28238640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2006bb30 con 0x7fdc200b0b50 2023-12-19T13:46:52.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc28238640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200b0070 con 0x7fdc201449e0 2023-12-19T13:46:52.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc267d5640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdc2006b590 0x7fdc2015eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59036/0 (socket says 172.21.15.113:59036) 2023-12-19T13:46:52.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc267d5640 1 -- 172.21.15.113:0/1985324335 learned_addr learned my addr 172.21.15.113:0/1985324335 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc25fd4640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 0x7fdc200af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc257d3640 1 --2- 172.21.15.113:0/1985324335 >> v2:172.21.15.151:3300/0 conn(0x7fdc200b0b50 0x7fdc2006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254177936 0 0) 0x7fdc200afb10 con 0x7fdc2006b590 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.243+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc0c003520 con 0x7fdc2006b590 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3737429522 0 0) 0x7fdc0c003520 con 0x7fdc2006b590 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 msgr2=0x7fdc200af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 0x7fdc200af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 >> v2:172.21.15.151:3300/0 conn(0x7fdc200b0b50 msgr2=0x7fdc2006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:52.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 --2- 172.21.15.113:0/1985324335 >> v2:172.21.15.151:3300/0 conn(0x7fdc200b0b50 0x7fdc2006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200b0350 con 0x7fdc2006b590 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fdc180019f0 con 0x7fdc2006b590 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 >> v1:172.21.15.113:6789/0 conn(0x7fdc2006b590 legacy=0x7fdc2015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc0c0039e0 0x7fdc0c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 0x7fdc0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc0c004d00 0x7fdc0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2006bb30 con 0x7fdc0c004d00 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200b0070 con 0x7fdc0c0039e0 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c00b980 con 0x7fdc201449e0 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc267d5640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc0c004d00 0x7fdc0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc257d3640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 0x7fdc0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc25fd4640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc0c0039e0 0x7fdc0c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc267d5640 1 -- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 msgr2=0x7fdc0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc267d5640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 0x7fdc0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc267d5640 1 -- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc0c0039e0 msgr2=0x7fdc0c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:52.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.244+0000 7fdc267d5640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc0c0039e0 0x7fdc0c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.245+0000 7fdc267d5640 1 -- 172.21.15.113:0/1985324335 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c003520 con 0x7fdc0c004d00 2023-12-19T13:46:52.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.245+0000 7fdc257d3640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc201449e0 0x7fdc0c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:52.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc267d5640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc0c004d00 0x7fdc0c005180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800a860 tx=0x7fdc0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9681da1774257738 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18034630 con 0x7fdc0c004d00 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1802f070 con 0x7fdc0c004d00 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc24fd2640 1 -- 172.21.15.113:0/1985324335 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180349f0 con 0x7fdc0c004d00 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc28238640 1 -- 172.21.15.113:0/1985324335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc0c004d00 msgr2=0x7fdc0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc28238640 1 --2- 172.21.15.113:0/1985324335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc0c004d00 0x7fdc0c005180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800a860 tx=0x7fdc0c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc267d5640 1 -- 172.21.15.113:0/1985324335 reap_dead start 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc28238640 1 -- 172.21.15.113:0/1985324335 shutdown_connections 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.246+0000 7fdc28238640 1 -- 172.21.15.113:0/1985324335 >> 172.21.15.113:0/1985324335 conn(0x7fdc200cbb70 msgr2=0x7fdc200cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.247+0000 7fdc28238640 1 -- 172.21.15.113:0/1985324335 shutdown_connections 2023-12-19T13:46:52.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.247+0000 7fdc28238640 1 -- 172.21.15.113:0/1985324335 wait complete. 2023-12-19T13:46:52.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.248+0000 7fdc28238640 1 Processor -- start 2023-12-19T13:46:52.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.248+0000 7fdc28238640 1 -- start start 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.249+0000 7fdc28238640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0c004d00 0x7fdc20143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.249+0000 7fdc28238640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc200ac400 0x7fdc200ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.249+0000 7fdc28238640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc2013eb10 0x7fdc2013ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.249+0000 7fdc28238640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200c2b90 con 0x7fdc2013eb10 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.249+0000 7fdc28238640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc201f3b60 con 0x7fdc200ac400 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.249+0000 7fdc28238640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2013f4d0 con 0x7fdc0c004d00 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc2013eb10 0x7fdc2013ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc2013eb10 0x7fdc2013ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52902/0 (socket says 172.21.15.113:52902) 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 -- 172.21.15.113:0/4289447428 learned_addr learned my addr 172.21.15.113:0/4289447428 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc257d3640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc200ac400 0x7fdc200ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc25fd4640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0c004d00 0x7fdc20143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 -- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0c004d00 msgr2=0x7fdc20143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0c004d00 0x7fdc20143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 -- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc200ac400 msgr2=0x7fdc200ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc200ac400 0x7fdc200ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 -- 172.21.15.113:0/4289447428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200acf50 con 0x7fdc2013eb10 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.250+0000 7fdc267d5640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc2013eb10 0x7fdc2013ef90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800a860 tx=0x7fdc18001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.251+0000 7fdc167fc640 1 -- 172.21.15.113:0/4289447428 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18044070 con 0x7fdc2013eb10 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.251+0000 7fdc167fc640 1 -- 172.21.15.113:0/4289447428 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18001fd0 con 0x7fdc2013eb10 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.251+0000 7fdc167fc640 1 -- 172.21.15.113:0/4289447428 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18034840 con 0x7fdc2013eb10 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.251+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc201f3db0 con 0x7fdc2013eb10 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.251+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc201f4370 con 0x7fdc2013eb10 2023-12-19T13:46:52.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.252+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc201f4560 con 0x7fdc2013eb10 2023-12-19T13:46:52.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.253+0000 7fdc167fc640 1 -- 172.21.15.113:0/4289447428 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc18031030 con 0x7fdc2013eb10 2023-12-19T13:46:52.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.254+0000 7fdc167fc640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc0406a430 0x7fdc0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:52.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.254+0000 7fdc167fc640 1 -- 172.21.15.113:0/4289447428 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc180aa4c0 con 0x7fdc2013eb10 2023-12-19T13:46:52.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.254+0000 7fdc25fd4640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc0406a430 0x7fdc0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:52.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.255+0000 7fdc25fd4640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc0406a430 0x7fdc0406c8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0098d0 tx=0x7fdc1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:52.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.258+0000 7fdc167fc640 1 -- 172.21.15.113:0/4289447428 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc18079410 con 0x7fdc2013eb10 2023-12-19T13:46:52.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.485+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc201f4560 con 0x7fdc2013eb10 2023-12-19T13:46:52.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.486+0000 7fdc167fc640 1 -- 172.21.15.113:0/4289447428 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fdc18078fa0 con 0x7fdc2013eb10 2023-12-19T13:46:52.486 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:46:52.486 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:46:52.486 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:46:52.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc0406a430 msgr2=0x7fdc0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc0406a430 0x7fdc0406c8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0098d0 tx=0x7fdc1c008040 comp rx=0 tx=0).stop 2023-12-19T13:46:52.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc2013eb10 msgr2=0x7fdc2013ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:52.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc2013eb10 0x7fdc2013ef90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800a860 tx=0x7fdc18001d80 comp rx=0 tx=0).stop 2023-12-19T13:46:52.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 shutdown_connections 2023-12-19T13:46:52.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdc0406a430 0x7fdc0406c8f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc2013eb10 0x7fdc2013ef90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc200ac400 0x7fdc200ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 --2- 172.21.15.113:0/4289447428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0c004d00 0x7fdc20143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:52.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 >> 172.21.15.113:0/4289447428 conn(0x7fdc200cbb70 msgr2=0x7fdc200b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:52.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 shutdown_connections 2023-12-19T13:46:52.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:52.489+0000 7fdc28238640 1 -- 172.21.15.113:0/4289447428 wait complete. 2023-12-19T13:46:52.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:46:30.918938+0000', 'modified': '2023-12-19T13:46:34.411633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/155547423', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 155547423}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 155547423}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:46:52.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:46:52.910 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T13:46:53.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.130+0000 7f3b2ffff640 1 Processor -- start 2023-12-19T13:46:53.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.131+0000 7f3b2ffff640 1 -- start start 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b30157710 0x7f3b300b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b300b2990 0x7f3b300b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300b0c80 con 0x7f3b300b0830 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2ffff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3015d7d0 con 0x7f3b30157710 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300b2ea0 con 0x7f3b300b2990 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b30157710 0x7f3b300b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b30157710 0x7f3b300b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52912/0 (socket says 172.21.15.113:52912) 2023-12-19T13:46:53.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2effd640 1 -- 172.21.15.113:0/2807372489 learned_addr learned my addr 172.21.15.113:0/2807372489 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:53.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2effd640 1 -- 172.21.15.113:0/2807372489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b300b2990 msgr2=0x7f3b300b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b267fc640 1 --2- 172.21.15.113:0/2807372489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b300b2990 0x7f3b300b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2effd640 1 --2- 172.21.15.113:0/2807372489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b300b2990 0x7f3b300b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2effd640 1 -- 172.21.15.113:0/2807372489 >> v1:172.21.15.151:6789/0 conn(0x7f3b300b0830 legacy=0x7f3b300ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.133+0000 7f3b2effd640 1 -- 172.21.15.113:0/2807372489 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3015da90 con 0x7f3b30157710 2023-12-19T13:46:53.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.134+0000 7f3b267fc640 1 --2- 172.21.15.113:0/2807372489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b300b2990 0x7f3b300b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:53.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2effd640 1 --2- 172.21.15.113:0/2807372489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b30157710 0x7f3b300b2450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009870 tx=0x7f3b2002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b582b2e65ab1ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:53.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2e7fc640 1 -- 172.21.15.113:0/2807372489 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20031740 con 0x7f3b30157710 2023-12-19T13:46:53.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2e7fc640 1 -- 172.21.15.113:0/2807372489 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200318a0 con 0x7f3b30157710 2023-12-19T13:46:53.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2e7fc640 1 -- 172.21.15.113:0/2807372489 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20031c30 con 0x7f3b30157710 2023-12-19T13:46:53.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2ffff640 1 -- 172.21.15.113:0/2807372489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b30157710 msgr2=0x7f3b300b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/2807372489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b30157710 0x7f3b300b2450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009870 tx=0x7f3b2002b7e0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2ffff640 1 -- 172.21.15.113:0/2807372489 shutdown_connections 2023-12-19T13:46:53.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/2807372489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b300b2990 0x7f3b300b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/2807372489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b30157710 0x7f3b300b2450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.135+0000 7f3b2ffff640 1 -- 172.21.15.113:0/2807372489 >> 172.21.15.113:0/2807372489 conn(0x7f3b300659a0 msgr2=0x7f3b30065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:53.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.136+0000 7f3b2ffff640 1 -- 172.21.15.113:0/2807372489 shutdown_connections 2023-12-19T13:46:53.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.136+0000 7f3b2ffff640 1 -- 172.21.15.113:0/2807372489 wait complete. 2023-12-19T13:46:53.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.137+0000 7f3b2ffff640 1 Processor -- start 2023-12-19T13:46:53.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.137+0000 7f3b2ffff640 1 -- start start 2023-12-19T13:46:53.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.138+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b300b0830 0x7f3b3006df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.138+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b300b2990 0x7f3b30159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.138+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b30157710 0x7f3b3015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.138+0000 7f3b2ffff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006bcc0 con 0x7f3b300b0830 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.138+0000 7f3b2ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006b390 con 0x7f3b300b2990 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.138+0000 7f3b2ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006b670 con 0x7f3b30157710 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b300b0830 0x7f3b3006df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b300b0830 0x7f3b3006df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52920/0 (socket says 172.21.15.113:52920) 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 -- 172.21.15.113:0/1633502414 learned_addr learned my addr 172.21.15.113:0/1633502414 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b267fc640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b300b2990 0x7f3b30159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2f7fe640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b30157710 0x7f3b3015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 -- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b30157710 msgr2=0x7f3b3015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b30157710 0x7f3b3015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 -- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b300b2990 msgr2=0x7f3b30159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b300b2990 0x7f3b30159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 -- 172.21.15.113:0/1633502414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200094d0 con 0x7f3b300b0830 2023-12-19T13:46:53.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.139+0000 7f3b2effd640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b300b0830 0x7f3b3006df60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009870 tx=0x7f3b200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:53.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.140+0000 7f3b27fff640 1 -- 172.21.15.113:0/1633502414 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20033c70 con 0x7f3b300b0830 2023-12-19T13:46:53.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.140+0000 7f3b27fff640 1 -- 172.21.15.113:0/1633502414 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20033dd0 con 0x7f3b300b0830 2023-12-19T13:46:53.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.140+0000 7f3b27fff640 1 -- 172.21.15.113:0/1633502414 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2003c640 con 0x7f3b300b0830 2023-12-19T13:46:53.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.140+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3006b950 con 0x7f3b300b0830 2023-12-19T13:46:53.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.140+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3006e4a0 con 0x7f3b300b0830 2023-12-19T13:46:53.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.142+0000 7f3b27fff640 1 -- 172.21.15.113:0/1633502414 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b2003a040 con 0x7f3b300b0830 2023-12-19T13:46:53.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.143+0000 7f3b27fff640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3b1006a430 0x7f3b1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.143+0000 7f3b27fff640 1 -- 172.21.15.113:0/1633502414 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b200aa340 con 0x7f3b300b0830 2023-12-19T13:46:53.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.143+0000 7f3b267fc640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3b1006a430 0x7f3b1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.144+0000 7f3b37fc3740 1 Processor -- start 2023-12-19T13:46:53.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.144+0000 7f3b267fc640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3b1006a430 0x7f3b1006c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b301f6340 tx=0x7f3b18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:53.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.144+0000 7f3b37fc3740 1 -- start start 2023-12-19T13:46:53.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f5a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f29e90 0x563535f57180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535e99f80 con 0x563535f29e90 2023-12-19T13:46:53.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535e97710 con 0x563535f59f10 2023-12-19T13:46:53.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563535e93000 con 0x563535f2da90 2023-12-19T13:46:53.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f29e90 0x563535f57180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f29e90 0x563535f57180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52922/0 (socket says 172.21.15.113:52922) 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.145+0000 7f3b267fc640 1 -- 172.21.15.113:0/3708959673 learned_addr learned my addr 172.21.15.113:0/3708959673 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b2f7fe640 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b2effd640 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f5a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b267fc640 1 -- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 msgr2=0x563535f576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b267fc640 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b267fc640 1 -- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 msgr2=0x563535f5a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b267fc640 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f5a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b267fc640 1 -- 172.21.15.113:0/3708959673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563535e5a690 con 0x563535f29e90 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b2effd640 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f5a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b2f7fe640 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b267fc640 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f29e90 0x563535f57180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800f9c0 tx=0x7f3b18012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c197662e730767 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b24ff9640 1 -- 172.21.15.113:0/3708959673 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18014be0 con 0x563535f29e90 2023-12-19T13:46:53.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b24ff9640 1 -- 172.21.15.113:0/3708959673 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18019070 con 0x563535f29e90 2023-12-19T13:46:53.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.146+0000 7f3b24ff9640 1 -- 172.21.15.113:0/3708959673 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800a710 con 0x563535f29e90 2023-12-19T13:46:53.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3708959673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f29e90 msgr2=0x563535f57180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f29e90 0x563535f57180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800f9c0 tx=0x7f3b18012000 comp rx=0 tx=0).stop 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3708959673 shutdown_connections 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f29e90 0x563535f57180 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3708959673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f5a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3708959673 >> 172.21.15.113:0/3708959673 conn(0x563535f2c1a0 msgr2=0x563535f74d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3708959673 shutdown_connections 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.147+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3708959673 wait complete. 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.148+0000 7f3b37fc3740 1 -- start start 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.148+0000 7f3b37fc3740 1 Processor -- start 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.149+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f4fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.149+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f52140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.149+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f52680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.149+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535e347d0 con 0x563535f2da90 2023-12-19T13:46:53.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.149+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535e34470 con 0x563535f59f10 2023-12-19T13:46:53.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.149+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563535bfaf20 con 0x563535f4f600 2023-12-19T13:46:53.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.149+0000 7f3b37fc3740 10 client.0 _ll_register_callbacks cb 0x563535e831b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:46:53.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f4fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f4fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52924/0 (socket says 172.21.15.113:52924) 2023-12-19T13:46:53.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 -- 172.21.15.113:0/3577372665 learned_addr learned my addr 172.21.15.113:0/3577372665 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:53.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2f7fe640 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b267fc640 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f52140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 -- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 msgr2=0x563535f52680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f52680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 -- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 msgr2=0x563535f52140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f52140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 -- 172.21.15.113:0/3577372665 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1800e040 con 0x563535f2da90 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b2effd640 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f4fcb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b200a8800 tx=0x7f3b20079ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb38798804bff7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.150+0000 7f3b0dffb640 1 -- 172.21.15.113:0/3577372665 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20040020 con 0x563535f2da90 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b0dffb640 1 -- 172.21.15.113:0/3577372665 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b200815c0 con 0x563535f2da90 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563535ebd550 con 0x563535f2da90 2023-12-19T13:46:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b0dffb640 1 -- 172.21.15.113:0/3577372665 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b2007d0d0 con 0x563535f2da90 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 10 client.4671 fetch_fsmap learned FSMap version 8 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563535e91680 con 0x563535f2da90 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b0dffb640 1 -- 172.21.15.113:0/3577372665 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20094080 con 0x563535f2da90 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b0dffb640 1 -- 172.21.15.113:0/3577372665 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f3b20078ad0 con 0x563535f2da90 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 10 client.4671 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 20 client.4671 populate_metadata read hostname 'smithi113' 2023-12-19T13:46:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f53800 0x563535f87800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 4 client.4671 mds_command: new command op to 4264 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:46:53.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.151+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 --> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563535e85b50 con 0x563535f53800 2023-12-19T13:46:53.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.152+0000 7f3b267fc640 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f53800 0x563535f87800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.153+0000 7f3b267fc640 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f53800 0x563535f87800 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e3ea172aab99974 server_cookie=f60f28ae6236dc79 in_seq=0 out_seq=0 2023-12-19T13:46:53.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.153+0000 7f3b0dffb640 10 client.4671 ms_handle_connect on v2:172.21.15.151:6834/155547423 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b0dffb640 1 -- 172.21.15.113:0/3577372665 <== mds.0 v2:172.21.15.151:6834/155547423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563535e85b50 con 0x563535f53800 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b0dffb640 10 client.4671 handle_command_reply: tid=0 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 client.4671 shutdown 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 msgr2=0x563535f4fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f4fcb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b200a8800 tx=0x7f3b20079ce0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 shutdown_connections 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f53800 0x563535f87800 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f52680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f52140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b0dffb640 0 client.4671 ms_handle_reset on v2:172.21.15.151:6834/155547423 2023-12-19T13:46:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/3577372665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f4fcb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 >> 172.21.15.113:0/3577372665 conn(0x563535f29e90 msgr2=0x563535f2e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 shutdown_connections 2023-12-19T13:46:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 1 -- 172.21.15.113:0/3577372665 wait complete. 2023-12-19T13:46:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.155+0000 7f3b37fc3740 20 client.4671 trim_cache size 0 max 16384 2023-12-19T13:46:53.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.171+0000 7f3b37fc3740 1 Processor -- start 2023-12-19T13:46:53.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.172+0000 7f3b37fc3740 1 -- start start 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.172+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f29020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.172+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f4f600 0x563535f519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.172+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f51f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.172+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535e33850 con 0x563535f4f600 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.172+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535f56ac0 con 0x563535f59f10 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563535f77c40 con 0x563535f2da90 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f4f600 0x563535f519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f4f600 0x563535f519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52928/0 (socket says 172.21.15.113:52928) 2023-12-19T13:46:53.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 -- 172.21.15.113:0/223740081 learned_addr learned my addr 172.21.15.113:0/223740081 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b2f7fe640 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f51f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b2effd640 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 -- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 msgr2=0x563535f29020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f29020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 -- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 msgr2=0x563535f51f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f51f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.173+0000 7f3b267fc640 1 -- 172.21.15.113:0/223740081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563535e339e0 con 0x563535f4f600 2023-12-19T13:46:53.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b267fc640 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f4f600 0x563535f519c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800a380 tx=0x7f3b18014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e483c0197966d3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:53.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b257fa640 1 -- 172.21.15.113:0/223740081 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18031040 con 0x563535f4f600 2023-12-19T13:46:53.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b257fa640 1 -- 172.21.15.113:0/223740081 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b180332b0 con 0x563535f4f600 2023-12-19T13:46:53.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b257fa640 1 -- 172.21.15.113:0/223740081 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18014e00 con 0x563535f4f600 2023-12-19T13:46:53.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b37fc3740 1 -- 172.21.15.113:0/223740081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f4f600 msgr2=0x563535f519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f4f600 0x563535f519c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800a380 tx=0x7f3b18014000 comp rx=0 tx=0).stop 2023-12-19T13:46:53.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b37fc3740 1 -- 172.21.15.113:0/223740081 shutdown_connections 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f51f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f4f600 0x563535f519c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/223740081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f2da90 0x563535f29020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.174+0000 7f3b37fc3740 1 -- 172.21.15.113:0/223740081 >> 172.21.15.113:0/223740081 conn(0x563535f29e90 msgr2=0x563535f783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.175+0000 7f3b37fc3740 1 -- 172.21.15.113:0/223740081 shutdown_connections 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.175+0000 7f3b37fc3740 1 -- 172.21.15.113:0/223740081 wait complete. 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.175+0000 7f3b37fc3740 1 -- start start 2023-12-19T13:46:53.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.175+0000 7f3b37fc3740 1 Processor -- start 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.176+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f2fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.176+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f8d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.176+0000 7f3b37fc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f56e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.176+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535f8e3d0 con 0x563535f2da90 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.176+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563535f96e40 con 0x563535f59f10 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.176+0000 7f3b37fc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563535f51970 con 0x563535f4f600 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.176+0000 7f3b37fc3740 10 client.0 _ll_register_callbacks cb 0x7f3b1800a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f2fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f2fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52940/0 (socket says 172.21.15.113:52940) 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 -- 172.21.15.113:0/2510577275 learned_addr learned my addr 172.21.15.113:0/2510577275 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2f7fe640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f56e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b267fc640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f8d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 -- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 msgr2=0x563535f8d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f8d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 -- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 msgr2=0x563535f56e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f56e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 -- 172.21.15.113:0/2510577275 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563535e5a690 con 0x563535f2da90 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2f7fe640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f56e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b267fc640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f8d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b2effd640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f2fd10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b20076000 tx=0x7f3b200a8730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0e645bf787ddf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.177+0000 7f3b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b0dffb640 1 -- 172.21.15.113:0/2510577275 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20040040 con 0x563535f2da90 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b0dffb640 1 -- 172.21.15.113:0/2510577275 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b200815c0 con 0x563535f2da90 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b18019070 con 0x563535f2da90 2023-12-19T13:46:53.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b0dffb640 1 -- 172.21.15.113:0/2510577275 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b20075920 con 0x563535f2da90 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 10 client.4677 fetch_fsmap learned FSMap version 8 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563535e58ef0 con 0x563535f2da90 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b0dffb640 1 -- 172.21.15.113:0/2510577275 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18019070 con 0x563535f2da90 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b0dffb640 1 -- 172.21.15.113:0/2510577275 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f3b2007f1c0 con 0x563535f2da90 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 10 client.4677 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 20 client.4677 populate_metadata read hostname 'smithi113' 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f8dd00 0x563535f573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:53.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 4 client.4677 mds_command: new command op to 4264 tid=0[{"prefix": "status"}] 2023-12-19T13:46:53.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.178+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 --> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563535e8c080 con 0x563535f8dd00 2023-12-19T13:46:53.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.179+0000 7f3b267fc640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f8dd00 0x563535f573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.180+0000 7f3b267fc640 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f8dd00 0x563535f573a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93c4e13df62e390a server_cookie=6756f796dfd7473f in_seq=0 out_seq=0 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.180+0000 7f3b0dffb640 10 client.4677 ms_handle_connect on v2:172.21.15.151:6834/155547423 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.180+0000 7f3b0dffb640 1 -- 172.21.15.113:0/2510577275 <== mds.0 v2:172.21.15.151:6834/155547423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563535e8c080 con 0x563535f8dd00 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.180+0000 7f3b0dffb640 10 client.4677 handle_command_reply: tid=0 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.180+0000 7f3b37fc3740 1 client.4677 shutdown 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 msgr2=0x563535f2fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f2fd10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b20076000 tx=0x7f3b200a8730 comp rx=0 tx=0).stop 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 shutdown_connections 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:6834/155547423,v1:172.21.15.151:6835/155547423] conn(0x563535f8dd00 0x563535f573a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563535f59f10 0x563535f56e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563535f4f600 0x563535f8d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 --2- 172.21.15.113:0/2510577275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563535f2da90 0x563535f2fd10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b0dffb640 0 client.4677 ms_handle_reset on v2:172.21.15.151:6834/155547423 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 >> 172.21.15.113:0/2510577275 conn(0x563535f29e90 msgr2=0x563535f4aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 shutdown_connections 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 1 -- 172.21.15.113:0/2510577275 wait complete. 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.181+0000 7f3b37fc3740 20 client.4677 trim_cache size 0 max 16384 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:46:53.184 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4264, 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 22.254615166000001, 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 8, 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 20, 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 20, 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 27.126578954999999 2023-12-19T13:46:53.185 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3b1006a430 msgr2=0x7f3b1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3b1006a430 0x7f3b1006c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b301f6340 tx=0x7f3b18008040 comp rx=0 tx=0).stop 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b300b0830 msgr2=0x7f3b3006df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b300b0830 0x7f3b3006df60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009870 tx=0x7f3b200046c0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 shutdown_connections 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3b1006a430 0x7f3b1006c8f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b30157710 0x7f3b3015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b300b2990 0x7f3b30159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 --2- 172.21.15.113:0/1633502414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b300b0830 0x7f3b3006df60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:53.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 >> 172.21.15.113:0/1633502414 conn(0x7f3b300659a0 msgr2=0x7f3b3006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:53.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 shutdown_connections 2023-12-19T13:46:53.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:53.182+0000 7f3b2ffff640 1 -- 172.21.15.113:0/1633502414 wait complete. 2023-12-19T13:46:53.198 INFO:teuthology.run_tasks:Running task kclient... 2023-12-19T13:46:53.235 INFO:tasks.kclient:Mounting kernel clients... 2023-12-19T13:46:53.235 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-19T13:46:53.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.236 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:46:53.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.290 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2023-12-19T13:46:53.389 INFO:teuthology.orchestra.run.smithi113.stderr:Cannot find device "ceph-brx" 2023-12-19T13:46:53.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:46:53.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.392 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:46:53.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.445 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2023-12-19T13:46:53.544 INFO:teuthology.orchestra.run.smithi113.stderr:Cannot find device "ceph-brx" 2023-12-19T13:46:53.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:46:53.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.548 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:46:53.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-19T13:46:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-12-19T13:46:53.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:46:53.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.717 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:46:53.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:53.770 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-19T13:46:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-12-19T13:46:53.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:46:53.873 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-19T13:46:53.873 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T13:46:53.873 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:46:53.873 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:46:54.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.095+0000 7fe14cf7e640 1 Processor -- start 2023-12-19T13:46:54.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.096+0000 7fe14cf7e640 1 -- start start 2023-12-19T13:46:54.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.097+0000 7fe14cf7e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe148159f80 0x7fe14806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:54.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.097+0000 7fe14cf7e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14806b520 con 0x7fe14815aa70 2023-12-19T13:46:54.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.097+0000 7fe14cf7e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1480b2b20 con 0x7fe14815b1e0 2023-12-19T13:46:54.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.097+0000 7fe14cf7e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1480b2fb0 con 0x7fe148159f80 2023-12-19T13:46:54.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.097+0000 7fe1477fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe148159f80 0x7fe14806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:54.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.098+0000 7fe1477fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe148159f80 0x7fe14806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52948/0 (socket says 172.21.15.113:52948) 2023-12-19T13:46:54.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.098+0000 7fe1477fe640 1 -- 172.21.15.113:0/1547437497 learned_addr learned my addr 172.21.15.113:0/1547437497 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:54.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.098+0000 7fe1477fe640 1 -- 172.21.15.113:0/1547437497 >> v1:172.21.15.151:6789/0 conn(0x7fe14815b1e0 legacy=0x7fe14815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:54.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.098+0000 7fe1477fe640 1 -- 172.21.15.113:0/1547437497 >> v1:172.21.15.113:6789/0 conn(0x7fe14815aa70 legacy=0x7fe14815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:54.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.098+0000 7fe1477fe640 1 -- 172.21.15.113:0/1547437497 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480b1f10 con 0x7fe148159f80 2023-12-19T13:46:54.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.099+0000 7fe1477fe640 1 --2- 172.21.15.113:0/1547437497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe148159f80 0x7fe14806f160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe138009870 tx=0x7fe13802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe663221d56c5a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:54.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.099+0000 7fe146ffd640 1 -- 172.21.15.113:0/1547437497 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13802f840 con 0x7fe148159f80 2023-12-19T13:46:54.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.099+0000 7fe146ffd640 1 -- 172.21.15.113:0/1547437497 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13802f9a0 con 0x7fe148159f80 2023-12-19T13:46:54.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.099+0000 7fe146ffd640 1 -- 172.21.15.113:0/1547437497 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13802fd30 con 0x7fe148159f80 2023-12-19T13:46:54.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.100+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1547437497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe148159f80 msgr2=0x7fe14806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:54.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.100+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1547437497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe148159f80 0x7fe14806f160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe138009870 tx=0x7fe13802ba20 comp rx=0 tx=0).stop 2023-12-19T13:46:54.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.100+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1547437497 shutdown_connections 2023-12-19T13:46:54.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.100+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1547437497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe148159f80 0x7fe14806f160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:54.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.100+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1547437497 >> 172.21.15.113:0/1547437497 conn(0x7fe1480b0100 msgr2=0x7fe1480b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:54.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.100+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1547437497 shutdown_connections 2023-12-19T13:46:54.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.100+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1547437497 wait complete. 2023-12-19T13:46:54.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.102+0000 7fe14cf7e640 1 Processor -- start 2023-12-19T13:46:54.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.103+0000 7fe14cf7e640 1 -- start start 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe14cf7e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe148159f80 0x7fe1481f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe14cf7e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe14815aa70 0x7fe1480cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe14cf7e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe14815b1e0 0x7fe148152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe14cf7e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14815c880 con 0x7fe14815b1e0 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe14cf7e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1481f3340 con 0x7fe14815aa70 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe14cf7e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1481f3620 con 0x7fe148159f80 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe147fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe14815b1e0 0x7fe148152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe147fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe14815b1e0 0x7fe148152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52952/0 (socket says 172.21.15.113:52952) 2023-12-19T13:46:54.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe147fff640 1 -- 172.21.15.113:0/1973293214 learned_addr learned my addr 172.21.15.113:0/1973293214 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.104+0000 7fe1477fe640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe148159f80 0x7fe1481f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe147fff640 1 -- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe148159f80 msgr2=0x7fe1481f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe147fff640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe148159f80 0x7fe1481f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe13ffff640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe14815aa70 0x7fe1480cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe147fff640 1 -- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe14815aa70 msgr2=0x7fe1480cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe147fff640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe14815aa70 0x7fe1480cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe147fff640 1 -- 172.21.15.113:0/1973293214 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1380094d0 con 0x7fe14815b1e0 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe1477fe640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe148159f80 0x7fe1481f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe13ffff640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe14815aa70 0x7fe1480cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe147fff640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe14815b1e0 0x7fe148152110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe14000c7a0 tx=0x7fe14000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe144ff9640 1 -- 172.21.15.113:0/1973293214 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140003b70 con 0x7fe14815b1e0 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe144ff9640 1 -- 172.21.15.113:0/1973293214 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe140003cf0 con 0x7fe14815b1e0 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1481f3900 con 0x7fe14815b1e0 2023-12-19T13:46:54.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe144ff9640 1 -- 172.21.15.113:0/1973293214 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140003ea0 con 0x7fe14815b1e0 2023-12-19T13:46:54.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.105+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148153b20 con 0x7fe14815b1e0 2023-12-19T13:46:54.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.106+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14815c9c0 con 0x7fe14815b1e0 2023-12-19T13:46:54.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.107+0000 7fe144ff9640 1 -- 172.21.15.113:0/1973293214 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe14000aa90 con 0x7fe14815b1e0 2023-12-19T13:46:54.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.109+0000 7fe144ff9640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe12806a430 0x7fe12806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:54.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.109+0000 7fe144ff9640 1 -- 172.21.15.113:0/1973293214 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe140088760 con 0x7fe14815b1e0 2023-12-19T13:46:54.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.109+0000 7fe1477fe640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe12806a430 0x7fe12806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:54.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.110+0000 7fe1477fe640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe12806a430 0x7fe12806c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe138036000 tx=0x7fe138039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:54.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.114+0000 7fe144ff9640 1 -- 172.21.15.113:0/1973293214 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe14815c9c0 con 0x7fe14815b1e0 2023-12-19T13:46:54.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.338+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe14815c9c0 con 0x7fe14815b1e0 2023-12-19T13:46:54.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.338+0000 7fe144ff9640 1 -- 172.21.15.113:0/1973293214 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe14815c9c0 con 0x7fe14815b1e0 2023-12-19T13:46:54.338 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:46:54.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe12806a430 msgr2=0x7fe12806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe12806a430 0x7fe12806c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe138036000 tx=0x7fe138039040 comp rx=0 tx=0).stop 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe14815b1e0 msgr2=0x7fe148152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe14815b1e0 0x7fe148152110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe14000c7a0 tx=0x7fe14000cc60 comp rx=0 tx=0).stop 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 shutdown_connections 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe12806a430 0x7fe12806c8f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe14815b1e0 0x7fe148152110 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe14815aa70 0x7fe1480cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 --2- 172.21.15.113:0/1973293214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe148159f80 0x7fe1481f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 >> 172.21.15.113:0/1973293214 conn(0x7fe1480b0100 msgr2=0x7fe148154ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 shutdown_connections 2023-12-19T13:46:54.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:54.341+0000 7fe14cf7e640 1 -- 172.21.15.113:0/1973293214 wait complete. 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:46:54.361 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:46:54.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:54.361 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:46:54.419 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42406sec preferred_lft 42406sec 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:46:54.420 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:54.421 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T13:46:54.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:54.421 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:54.422 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:54.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add name ceph-brx type bridge 2023-12-19T13:46:54.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr flush dev ceph-brx 2023-12-19T13:46:54.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set ceph-brx up 2023-12-19T13:46:54.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T13:46:54.422 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:54.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:54.886 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:46:54.968 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:46:54.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:54.972 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:46:55.024 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:46:55.024 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:46:55.024 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:46:55.024 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:46:55.025 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:46:55.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:55.025 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:55.025 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:55.025 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:46:55.025 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:46:55.025 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:46:55.026 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:55.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:55.737 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:46:55.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:55.783 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2023-12-19T13:46:55.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:55.871 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:55.871 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:55.871 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:46:55.871 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T13:46:55.871 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:55.990 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T13:46:55.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:55.990 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:55.991 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:55.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T13:46:55.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T13:46:55.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T13:46:55.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T13:46:55.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T13:46:55.991 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:56.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:56.262 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:56.262 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:56.262 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:46:56.262 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T13:46:56.262 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:56.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:46:56.417 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:46:56.462 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:46:56.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:46:56.463 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:46:56.556 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:46:56.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:56.556 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:46:56.687 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:46:56.687 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:46:57.147 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:46:57.147 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:46:57.147 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:46:57.147 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:46:57.147 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:46:57.150 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:46:57.150 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:46:57.150 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:46:57.150 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:46:57.150 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:46:57.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:46:57.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:57.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:46:57.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:57.242 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:46:57.314 INFO:teuthology.orchestra.run.smithi113.stdout:client4689 2023-12-19T13:46:57.315 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:57.315 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:46:57.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:57.368 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:46:57.443 INFO:teuthology.orchestra.run.smithi113.stdout:client4689 2023-12-19T13:46:57.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:57.444 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:46:57.522 INFO:teuthology.orchestra.run.smithi113.stdout:client4689 2023-12-19T13:46:57.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:57.522 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4689/status') 2023-12-19T13:46:57.623 INFO:teuthology.orchestra.run.smithi113.stdout:instance: client.4689 (3)192.168.0.1:0/3620387927 2023-12-19T13:46:57.623 INFO:teuthology.orchestra.run.smithi113.stdout:blocklisted: false 2023-12-19T13:46:57.623 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records in 2023-12-19T13:46:57.623 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records out 2023-12-19T13:46:57.624 INFO:teuthology.orchestra.run.smithi113.stderr:69 bytes copied, 6.6316e-05 s, 1.0 MB/s 2023-12-19T13:46:57.627 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-12-19T13:46:57.628 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T13:46:57.628 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T13:46:57.628 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:46:57.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.838+0000 7f7992623640 1 Processor -- start 2023-12-19T13:46:57.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.838+0000 7f7992623640 1 -- start start 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7992623640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f798c15d490 0x7f798c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7992623640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f798c0afbd0 0x7f798c0ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7992623640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798c1611b0 con 0x7f798c06d760 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7992623640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c0cb6c0 con 0x7f798c0afbd0 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7992623640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c161490 con 0x7f798c15d490 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7990bc0640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f798c06d760 0x7f798c0b2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59068/0 (socket says 172.21.15.113:59068) 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7990bc0640 1 -- 172.21.15.113:0/680852644 learned_addr learned my addr 172.21.15.113:0/680852644 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:46:57.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.840+0000 7f7983fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f798c0afbd0 0x7f798c0ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:57.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.841+0000 7f798bfff640 1 --2- 172.21.15.113:0/680852644 >> v2:172.21.15.151:3300/0 conn(0x7f798c15d490 0x7f798c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:57.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.841+0000 7f7983fff640 1 -- 172.21.15.113:0/680852644 >> v2:172.21.15.151:3300/0 conn(0x7f798c15d490 msgr2=0x7f798c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:46:57.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.841+0000 7f7983fff640 1 --2- 172.21.15.113:0/680852644 >> v2:172.21.15.151:3300/0 conn(0x7f798c15d490 0x7f798c0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:57.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.841+0000 7f7983fff640 1 -- 172.21.15.113:0/680852644 >> v1:172.21.15.113:6789/0 conn(0x7f798c06d760 legacy=0x7f798c0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:57.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.841+0000 7f7983fff640 1 -- 172.21.15.113:0/680852644 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c161770 con 0x7f798c0afbd0 2023-12-19T13:46:57.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.842+0000 7f7983fff640 1 --2- 172.21.15.113:0/680852644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c0afbd0 0x7f798c0ce090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f798c0cb850 tx=0x7f797402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dd154b3bcf3d83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:57.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.842+0000 7f798b7fe640 1 -- 172.21.15.113:0/680852644 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974031830 con 0x7f798c0afbd0 2023-12-19T13:46:57.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f798b7fe640 1 -- 172.21.15.113:0/680852644 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974031990 con 0x7f798c0afbd0 2023-12-19T13:46:57.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f798b7fe640 1 -- 172.21.15.113:0/680852644 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974031d20 con 0x7f798c0afbd0 2023-12-19T13:46:57.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 -- 172.21.15.113:0/680852644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c0afbd0 msgr2=0x7f798c0ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:57.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 --2- 172.21.15.113:0/680852644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c0afbd0 0x7f798c0ce090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f798c0cb850 tx=0x7f797402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:46:57.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 -- 172.21.15.113:0/680852644 shutdown_connections 2023-12-19T13:46:57.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 --2- 172.21.15.113:0/680852644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c0afbd0 0x7f798c0ce090 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:57.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 --2- 172.21.15.113:0/680852644 >> v2:172.21.15.151:3300/0 conn(0x7f798c15d490 0x7f798c0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:57.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 -- 172.21.15.113:0/680852644 >> 172.21.15.113:0/680852644 conn(0x7f798c0659d0 msgr2=0x7f798c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:57.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 -- 172.21.15.113:0/680852644 shutdown_connections 2023-12-19T13:46:57.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.843+0000 7f7992623640 1 -- 172.21.15.113:0/680852644 wait complete. 2023-12-19T13:46:57.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.845+0000 7f7992623640 1 Processor -- start 2023-12-19T13:46:57.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.845+0000 7f7992623640 1 -- start start 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.846+0000 7f7992623640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f798c06d760 0x7f798c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.846+0000 7f7992623640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f798c0afbd0 0x7f798c0b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.846+0000 7f7992623640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c15d490 0x7f798c0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.846+0000 7f7992623640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0b6f90 con 0x7f798c15d490 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.846+0000 7f7992623640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0b31b0 con 0x7f798c0afbd0 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.846+0000 7f7992623640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c15c430 con 0x7f798c06d760 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c15d490 0x7f798c0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c15d490 0x7f798c0b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52968/0 (socket says 172.21.15.113:52968) 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 -- 172.21.15.113:0/2464716390 learned_addr learned my addr 172.21.15.113:0/2464716390 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:46:57.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f798bfff640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f798c06d760 0x7f798c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7983fff640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f798c0afbd0 0x7f798c0b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 -- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f798c06d760 msgr2=0x7f798c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f798c06d760 0x7f798c0b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 -- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f798c0afbd0 msgr2=0x7f798c0b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f798c0afbd0 0x7f798c0b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 -- 172.21.15.113:0/2464716390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740093a0 con 0x7f798c15d490 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7983fff640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f798c0afbd0 0x7f798c0b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:46:57.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.847+0000 7f7990bc0640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c15d490 0x7f798c0b2c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f798400cbc0 tx=0x7f798400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:57.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.848+0000 7f79897fa640 1 -- 172.21.15.113:0/2464716390 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400ad40 con 0x7f798c15d490 2023-12-19T13:46:57.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.848+0000 7f79897fa640 1 -- 172.21.15.113:0/2464716390 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984012400 con 0x7f798c15d490 2023-12-19T13:46:57.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.848+0000 7f79897fa640 1 -- 172.21.15.113:0/2464716390 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400aea0 con 0x7f798c15d490 2023-12-19T13:46:57.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.848+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c15be70 con 0x7f798c15d490 2023-12-19T13:46:57.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.848+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c0b4bc0 con 0x7f798c15d490 2023-12-19T13:46:57.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.849+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c061910 con 0x7f798c15d490 2023-12-19T13:46:57.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.850+0000 7f79897fa640 1 -- 172.21.15.113:0/2464716390 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7984007070 con 0x7f798c15d490 2023-12-19T13:46:57.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.851+0000 7f79897fa640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f796c06a430 0x7f796c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:46:57.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.851+0000 7f79897fa640 1 -- 172.21.15.113:0/2464716390 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79840887a0 con 0x7f798c15d490 2023-12-19T13:46:57.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.851+0000 7f798bfff640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f796c06a430 0x7f796c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:46:57.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.852+0000 7f798bfff640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f796c06a430 0x7f796c06c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f797c006fd0 tx=0x7f797c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:46:57.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:57.856+0000 7f79897fa640 1 -- 172.21.15.113:0/2464716390 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7984053e30 con 0x7f798c15d490 2023-12-19T13:46:58.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.082+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f798c155560 con 0x7f798c15d490 2023-12-19T13:46:58.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.082+0000 7f79897fa640 1 -- 172.21.15.113:0/2464716390 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7984017070 con 0x7f798c15d490 2023-12-19T13:46:58.082 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:46:58.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f796c06a430 msgr2=0x7f796c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:58.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f796c06a430 0x7f796c06c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f797c006fd0 tx=0x7f797c008040 comp rx=0 tx=0).stop 2023-12-19T13:46:58.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c15d490 msgr2=0x7f798c0b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:46:58.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c15d490 0x7f798c0b2c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f798400cbc0 tx=0x7f798400a430 comp rx=0 tx=0).stop 2023-12-19T13:46:58.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 shutdown_connections 2023-12-19T13:46:58.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f796c06a430 0x7f796c06c8f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f798c15d490 0x7f798c0b2c70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f798c0afbd0 0x7f798c0b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 --2- 172.21.15.113:0/2464716390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f798c06d760 0x7f798c0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:46:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 >> 172.21.15.113:0/2464716390 conn(0x7f798c0659d0 msgr2=0x7f798c0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:46:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 shutdown_connections 2023-12-19T13:46:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:46:58.085+0000 7f7992623640 1 -- 172.21.15.113:0/2464716390 wait complete. 2023-12-19T13:46:58.102 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T13:46:58.102 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:46:58.102 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:46:58.102 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-19T13:46:58.102 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T13:46:58.103 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T13:46:58.103 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T13:46:58.103 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:46:58.103 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-19T13:46:58.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.103 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:46:58.150 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:46:58.151 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42402sec preferred_lft 42402sec 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:46:58.152 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.153 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:46:58.153 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.153 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:46:58.153 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:46:58.153 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:46:58.153 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.158 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:46:58.246 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:46:58.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.250 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:46:58.302 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:46:58.302 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:46:58.302 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:46:58.302 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:46:58.303 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:46:58.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.303 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:58.303 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:58.303 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:46:58.303 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:46:58.303 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:46:58.303 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:58.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.483 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:46:58.532 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:46:58.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.533 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2023-12-19T13:46:58.583 INFO:teuthology.orchestra.run.smithi113.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-19T13:46:58.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.584 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:58.584 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:58.585 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:46:58.585 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-19T13:46:58.585 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:58.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.724 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 56:ec:e8:7e:96:24 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.813 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::54ec:e8ff:fe7e:9624/64 scope link 2023-12-19T13:46:58.814 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.817 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T13:46:58.912 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:46:58.912 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:46:58.912 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 56:ec:e8:7e:96:24 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::54ec:e8ff:fe7e:9624/64 scope link 2023-12-19T13:46:58.913 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:46:58.917 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-19T13:46:58.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:58.917 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:58.917 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:58.917 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-19T13:46:58.917 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T13:46:58.917 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-19T13:46:58.918 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-19T13:46:58.918 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-19T13:46:58.918 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:59.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:59.185 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:46:59.185 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:46:59.185 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.1 up 2023-12-19T13:46:59.186 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T13:46:59.186 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:46:59.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:46:59.358 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-19T13:46:59.406 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-19T13:46:59.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:46:59.406 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-19T13:46:59.453 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-12-19T13:46:59.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:59.453 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:46:59.585 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:46:59.585 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:46:59.618 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:46:59.619 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:46:59.619 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:46:59.619 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 2@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:46:59.619 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:46:59.620 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-12-19T13:46:59.620 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:46:59.620 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:46:59.620 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:46:59.620 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:46:59.624 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:46:59.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:59.624 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-19T13:46:59.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:59.704 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:46:59.763 INFO:teuthology.orchestra.run.smithi113.stdout:client4519 2023-12-19T13:46:59.764 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:46:59.764 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:46:59.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:59.812 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:46:59.912 INFO:teuthology.orchestra.run.smithi113.stdout:client4519 2023-12-19T13:46:59.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:59.913 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:46:59.966 INFO:teuthology.orchestra.run.smithi113.stdout:client4519 2023-12-19T13:46:59.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:46:59.966 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4519/status') 2023-12-19T13:47:00.057 INFO:teuthology.orchestra.run.smithi113.stdout:instance: client.4519 (3)172.21.15.113:0/709682553 2023-12-19T13:47:00.058 INFO:teuthology.orchestra.run.smithi113.stdout:blocklisted: false 2023-12-19T13:47:00.058 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records in 2023-12-19T13:47:00.058 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records out 2023-12-19T13:47:00.058 INFO:teuthology.orchestra.run.smithi113.stderr:70 bytes copied, 6.8666e-05 s, 1.0 MB/s 2023-12-19T13:47:00.062 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-19T13:47:00.062 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T13:47:00.062 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:00.062 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:47:00.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.272+0000 7f0cb9db9640 1 Processor -- start 2023-12-19T13:47:00.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.272+0000 7f0cb9db9640 1 -- start start 2023-12-19T13:47:00.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb9db9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0cb415e7a0 0x7f0cb40cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb9db9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 0x7f0cb415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb9db9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb40ce9d0 con 0x7f0cb40d01b0 2023-12-19T13:47:00.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb9db9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb40ce6f0 con 0x7f0cb415e7a0 2023-12-19T13:47:00.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb9db9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb415dcc0 con 0x7f0cb40ce1e0 2023-12-19T13:47:00.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb37fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0cb40d01b0 0x7f0cb40d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36080/0 (socket says 172.21.15.113:36080) 2023-12-19T13:47:00.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb37fe640 1 -- 172.21.15.113:0/2699032178 learned_addr learned my addr 172.21.15.113:0/2699032178 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.274+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737351370 0 0) 0x7f0cb40ce9d0 con 0x7f0cb40d01b0 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca0003520 con 0x7f0cb40d01b0 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb3fff640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 0x7f0cb415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cabfff640 1 --2- 172.21.15.113:0/2699032178 >> v2:172.21.15.151:3300/0 conn(0x7f0cb415e7a0 0x7f0cb40cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 614709659 0 0) 0x7f0ca0003520 con 0x7f0cb40d01b0 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 msgr2=0x7f0cb415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 0x7f0cb415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 >> v2:172.21.15.151:3300/0 conn(0x7f0cb415e7a0 msgr2=0x7f0cb40cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 --2- 172.21.15.113:0/2699032178 >> v2:172.21.15.151:3300/0 conn(0x7f0cb415e7a0 0x7f0cb40cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb415dfa0 con 0x7f0cb40d01b0 2023-12-19T13:47:00.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0ca4001670 con 0x7f0cb40d01b0 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 >> v1:172.21.15.113:6789/0 conn(0x7f0cb40d01b0 legacy=0x7f0cb40d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 0x7f0ca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40ce6f0 con 0x7f0ca00047c0 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb415dcc0 con 0x7f0ca00039e0 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca000bb00 con 0x7f0cb40ce1e0 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.275+0000 7f0cabfff640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cb3fff640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 0x7f0ca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cb37fe640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cabfff640 1 -- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 msgr2=0x7f0ca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cabfff640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40ce1e0 0x7f0ca0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cabfff640 1 -- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00039e0 msgr2=0x7f0ca0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:00.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cabfff640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cabfff640 1 -- 172.21.15.113:0/2699032178 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0003520 con 0x7f0ca00047c0 2023-12-19T13:47:00.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.276+0000 7f0cb37fe640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.277+0000 7f0cabfff640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00ba30 tx=0x7f0ca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475f58c96c00168e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.277+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c032680 con 0x7f0ca00047c0 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.277+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0327e0 con 0x7f0ca00047c0 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.277+0000 7f0cb2ffd640 1 -- 172.21.15.113:0/2699032178 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c032b70 con 0x7f0ca00047c0 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.278+0000 7f0cb9db9640 1 -- 172.21.15.113:0/2699032178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00047c0 msgr2=0x7f0ca0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.278+0000 7f0cb9db9640 1 --2- 172.21.15.113:0/2699032178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00ba30 tx=0x7f0ca00057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.278+0000 7f0cb3fff640 1 -- 172.21.15.113:0/2699032178 reap_dead start 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.278+0000 7f0cb9db9640 1 -- 172.21.15.113:0/2699032178 shutdown_connections 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.278+0000 7f0cb9db9640 1 -- 172.21.15.113:0/2699032178 >> 172.21.15.113:0/2699032178 conn(0x7f0cb40b27a0 msgr2=0x7f0cb40b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.278+0000 7f0cb9db9640 1 -- 172.21.15.113:0/2699032178 shutdown_connections 2023-12-19T13:47:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.278+0000 7f0cb9db9640 1 -- 172.21.15.113:0/2699032178 wait complete. 2023-12-19T13:47:00.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.280+0000 7f0cb9db9640 1 Processor -- start 2023-12-19T13:47:00.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.280+0000 7f0cb9db9640 1 -- start start 2023-12-19T13:47:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb9db9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00047c0 0x7f0cb4140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb9db9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb4143030 0x7f0cb41434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb9db9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb41439f0 0x7f0cb4155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb9db9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41415d0 con 0x7f0cb41439f0 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb9db9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4140fe0 con 0x7f0cb4143030 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb9db9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4156f80 con 0x7f0ca00047c0 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb41439f0 0x7f0cb4155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb41439f0 0x7f0cb4155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48686/0 (socket says 172.21.15.113:48686) 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 -- 172.21.15.113:0/3065768475 learned_addr learned my addr 172.21.15.113:0/3065768475 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cabfff640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb4143030 0x7f0cb41434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb37fe640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00047c0 0x7f0cb4140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 -- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00047c0 msgr2=0x7f0cb4140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00047c0 0x7f0cb4140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 -- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb4143030 msgr2=0x7f0cb41434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb4143030 0x7f0cb41434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb3fff640 1 -- 172.21.15.113:0/3065768475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4157260 con 0x7f0cb41439f0 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.281+0000 7f0cb37fe640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00047c0 0x7f0cb4140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.282+0000 7f0cb3fff640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb41439f0 0x7f0cb4155ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0004740 tx=0x7f0cac00e510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:00.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.282+0000 7f0cb0ff9640 1 -- 172.21.15.113:0/3065768475 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00edf0 con 0x7f0cb41439f0 2023-12-19T13:47:00.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.282+0000 7f0cb0ff9640 1 -- 172.21.15.113:0/3065768475 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac00f040 con 0x7f0cb41439f0 2023-12-19T13:47:00.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.282+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb41411f0 con 0x7f0cb41439f0 2023-12-19T13:47:00.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.282+0000 7f0cb0ff9640 1 -- 172.21.15.113:0/3065768475 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac015650 con 0x7f0cb41439f0 2023-12-19T13:47:00.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.282+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb41502d0 con 0x7f0cb41439f0 2023-12-19T13:47:00.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.283+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb4061910 con 0x7f0cb41439f0 2023-12-19T13:47:00.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.284+0000 7f0cb0ff9640 1 -- 172.21.15.113:0/3065768475 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0cac0157b0 con 0x7f0cb41439f0 2023-12-19T13:47:00.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.285+0000 7f0cb0ff9640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a430 0x7f0c9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:00.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.285+0000 7f0cb0ff9640 1 -- 172.21.15.113:0/3065768475 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cac089050 con 0x7f0cb41439f0 2023-12-19T13:47:00.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.286+0000 7f0cb37fe640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a430 0x7f0c9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:00.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.286+0000 7f0cb37fe640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a430 0x7f0c9406c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4000c00 tx=0x7f0ca4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:00.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.290+0000 7f0cb0ff9640 1 -- 172.21.15.113:0/3065768475 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0cac0546d0 con 0x7f0cb41439f0 2023-12-19T13:47:00.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.518+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0cb40d31b0 con 0x7f0cb41439f0 2023-12-19T13:47:00.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.519+0000 7f0cb0ff9640 1 -- 172.21.15.113:0/3065768475 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0cac057cf0 con 0x7f0cb41439f0 2023-12-19T13:47:00.519 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:47:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a430 msgr2=0x7f0c9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a430 0x7f0c9406c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4000c00 tx=0x7f0ca4009040 comp rx=0 tx=0).stop 2023-12-19T13:47:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb41439f0 msgr2=0x7f0cb4155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb41439f0 0x7f0cb4155ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0004740 tx=0x7f0cac00e510 comp rx=0 tx=0).stop 2023-12-19T13:47:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 shutdown_connections 2023-12-19T13:47:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a430 0x7f0c9406c8f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb41439f0 0x7f0cb4155ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb4143030 0x7f0cb41434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 --2- 172.21.15.113:0/3065768475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00047c0 0x7f0cb4140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:00.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 >> 172.21.15.113:0/3065768475 conn(0x7f0cb40b27a0 msgr2=0x7f0cb40d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:00.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 shutdown_connections 2023-12-19T13:47:00.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:00.522+0000 7f0cb9db9640 1 -- 172.21.15.113:0/3065768475 wait complete. 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:47:00.539 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:47:00.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:00.540 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:47:00.599 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:00.600 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:00.601 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T13:47:00.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:00.602 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:00.602 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:00.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-12-19T13:47:00.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-12-19T13:47:00.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-12-19T13:47:00.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T13:47:00.602 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:01.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:01.058 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:47:01.133 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:47:01.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:01.137 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:47:01.194 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:47:01.194 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:47:01.194 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:47:01.194 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:47:01.194 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:47:01.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:01.195 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:01.195 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:01.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:47:01.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:47:01.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:47:01.195 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:01.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:01.932 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:47:01.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:01.975 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-12-19T13:47:02.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:02.069 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:02.069 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:02.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:47:02.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-19T13:47:02.069 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:02.198 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-19T13:47:02.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-19T13:47:02.198 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:02.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:02.468 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:02.468 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:02.468 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:47:02.468 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T13:47:02.468 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:02.614 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:02.614 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:02.661 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:47:02.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:02.662 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:02.758 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:47:02.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:02.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:02.931 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:02.931 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:03.384 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:03.385 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:03.385 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:47:03.385 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:47:03.385 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:47:03.387 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:47:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:47:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:47:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:47:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:47:03.391 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:47:03.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:03.392 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:03.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:03.483 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:03.540 INFO:teuthology.orchestra.run.smithi151.stdout:client4707 2023-12-19T13:47:03.541 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:03.541 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:03.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:03.595 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:03.650 INFO:teuthology.orchestra.run.smithi151.stdout:client4707 2023-12-19T13:47:03.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:03.650 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:03.703 INFO:teuthology.orchestra.run.smithi151.stdout:client4707 2023-12-19T13:47:03.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:03.703 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4707/status') 2023-12-19T13:47:03.794 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4707 (3)172.21.15.151:0/4231889665 2023-12-19T13:47:03.794 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-12-19T13:47:03.795 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-12-19T13:47:03.795 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-12-19T13:47:03.795 INFO:teuthology.orchestra.run.smithi151.stderr:71 bytes copied, 6.8671e-05 s, 1.0 MB/s 2023-12-19T13:47:03.799 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-12-19T13:47:03.799 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T13:47:03.799 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T13:47:03.799 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:47:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.021+0000 7f7eefa5f640 1 Processor -- start 2023-12-19T13:47:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.021+0000 7f7eefa5f640 1 -- start start 2023-12-19T13:47:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.023+0000 7f7eefa5f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ee80b0b50 0x7f7ee806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.023+0000 7f7eefa5f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee806bb30 con 0x7f7ee806b590 2023-12-19T13:47:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.023+0000 7f7eefa5f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee80b0070 con 0x7f7ee81449e0 2023-12-19T13:47:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.023+0000 7f7eefa5f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80b0350 con 0x7f7ee80b0b50 2023-12-19T13:47:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.023+0000 7f7eedffc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7ee806b590 0x7f7ee80b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36090/0 (socket says 172.21.15.113:36090) 2023-12-19T13:47:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.023+0000 7f7eedffc640 1 -- 172.21.15.113:0/2139318 learned_addr learned my addr 172.21.15.113:0/2139318 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.023+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041571996 0 0) 0x7f7ee806bb30 con 0x7f7ee806b590 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7eecffa640 1 --2- 172.21.15.113:0/2139318 >> v2:172.21.15.151:3300/0 conn(0x7f7ee80b0b50 0x7f7ee806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed4003520 con 0x7f7ee806b590 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216854354 0 0) 0x7f7ed4003520 con 0x7f7ee806b590 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 >> v2:172.21.15.151:3300/0 conn(0x7f7ee80b0b50 msgr2=0x7f7ee806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 --2- 172.21.15.113:0/2139318 >> v2:172.21.15.151:3300/0 conn(0x7f7ee80b0b50 0x7f7ee806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 >> v1:172.21.15.151:6789/0 conn(0x7f7ee81449e0 legacy=0x7f7ee80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80b0630 con 0x7f7ee806b590 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f7ee00019f0 con 0x7f7ee806b590 2023-12-19T13:47:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7eecffa640 1 --2- 172.21.15.113:0/2139318 >> v2:172.21.15.151:3300/0 conn(0x7f7ee80b0b50 0x7f7ee806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 >> v1:172.21.15.113:6789/0 conn(0x7f7ee806b590 legacy=0x7f7ee80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed4003a30 0x7f7ed4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ed40052a0 0x7f7ed400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80b0350 con 0x7f7ed40052a0 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed400c1a0 con 0x7f7ed4003a30 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed400c360 con 0x7f7ed40047c0 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.024+0000 7f7eedffc640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ed40052a0 0x7f7ed400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.025+0000 7f7eed7fb640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed4003a30 0x7f7ed4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.025+0000 7f7eecffa640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.025+0000 7f7eedffc640 1 -- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ed40047c0 msgr2=0x7f7ed4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.025+0000 7f7eedffc640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.025+0000 7f7eedffc640 1 -- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed4003a30 msgr2=0x7f7ed4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.025+0000 7f7eedffc640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed4003a30 0x7f7ed4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.025+0000 7f7eedffc640 1 -- 172.21.15.113:0/2139318 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4003520 con 0x7f7ed40052a0 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.026+0000 7f7eedffc640 1 -- 172.21.15.113:0/2139318 reap_dead start 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.026+0000 7f7eedffc640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ed40052a0 0x7f7ed400b980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0002230 tx=0x7f7ed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2577ceb9291fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.026+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0034630 con 0x7f7ed40052a0 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.026+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee002f070 con 0x7f7ed40052a0 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.026+0000 7f7edffff640 1 -- 172.21.15.113:0/2139318 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00349d0 con 0x7f7ed40052a0 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.027+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2139318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ed40052a0 msgr2=0x7f7ed400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.027+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ed40052a0 0x7f7ed400b980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0002230 tx=0x7f7ed40057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.027+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2139318 shutdown_connections 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.027+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2139318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ed40052a0 0x7f7ed400b980 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.027+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2139318 >> 172.21.15.113:0/2139318 conn(0x7f7ee80cbb70 msgr2=0x7f7ee80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.027+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2139318 shutdown_connections 2023-12-19T13:47:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.027+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2139318 wait complete. 2023-12-19T13:47:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.029+0000 7f7eefa5f640 1 Processor -- start 2023-12-19T13:47:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.029+0000 7f7eefa5f640 1 -- start start 2023-12-19T13:47:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eefa5f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed40052a0 0x7f7ee80a88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eefa5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ee8142890 0x7f7ee81f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eefa5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee8070170 0x7f7ee8070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eefa5f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8070b60 con 0x7f7ee8142890 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eefa5f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8143070 con 0x7f7ed40052a0 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eefa5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8143350 con 0x7f7ee8070170 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eecffa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ee8142890 0x7f7ee81f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eecffa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ee8142890 0x7f7ee81f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48708/0 (socket says 172.21.15.113:48708) 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eecffa640 1 -- 172.21.15.113:0/2605184908 learned_addr learned my addr 172.21.15.113:0/2605184908 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eedffc640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee8070170 0x7f7ee8070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.030+0000 7f7eed7fb640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed40052a0 0x7f7ee80a88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eecffa640 1 -- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee8070170 msgr2=0x7f7ee8070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eecffa640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee8070170 0x7f7ee8070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eecffa640 1 -- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed40052a0 msgr2=0x7f7ee80a88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eecffa640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed40052a0 0x7f7ee80a88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eecffa640 1 -- 172.21.15.113:0/2605184908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8143630 con 0x7f7ee8142890 2023-12-19T13:47:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eedffc640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee8070170 0x7f7ee8070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eecffa640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ee8142890 0x7f7ee81f21c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8010860 tx=0x7f7ed8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eddffb640 1 -- 172.21.15.113:0/2605184908 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800cb40 con 0x7f7ee8142890 2023-12-19T13:47:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eddffb640 1 -- 172.21.15.113:0/2605184908 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800cca0 con 0x7f7ee8142890 2023-12-19T13:47:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eddffb640 1 -- 172.21.15.113:0/2605184908 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80156b0 con 0x7f7ee8142890 2023-12-19T13:47:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.031+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee8143910 con 0x7f7ee8142890 2023-12-19T13:47:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.032+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee81f2700 con 0x7f7ee8142890 2023-12-19T13:47:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.033+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee8061910 con 0x7f7ee8142890 2023-12-19T13:47:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.034+0000 7f7eddffb640 1 -- 172.21.15.113:0/2605184908 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ed8015810 con 0x7f7ee8142890 2023-12-19T13:47:04.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.035+0000 7f7eddffb640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:04.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.035+0000 7f7eddffb640 1 -- 172.21.15.113:0/2605184908 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ed8089100 con 0x7f7ee8142890 2023-12-19T13:47:04.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.035+0000 7f7eed7fb640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:04.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.036+0000 7f7eed7fb640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005490 tx=0x7f7ee4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:04.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.040+0000 7f7eddffb640 1 -- 172.21.15.113:0/2605184908 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7ed80547a0 con 0x7f7ee8142890 2023-12-19T13:47:04.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.267+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ee80cb440 con 0x7f7ee8142890 2023-12-19T13:47:04.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.268+0000 7f7eddffb640 1 -- 172.21.15.113:0/2605184908 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7ed8057dc0 con 0x7f7ee8142890 2023-12-19T13:47:04.267 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:47:04.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ecc06a430 msgr2=0x7f7ecc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:04.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005490 tx=0x7f7ee4009040 comp rx=0 tx=0).stop 2023-12-19T13:47:04.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ee8142890 msgr2=0x7f7ee81f21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:04.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ee8142890 0x7f7ee81f21c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8010860 tx=0x7f7ed8010d20 comp rx=0 tx=0).stop 2023-12-19T13:47:04.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 shutdown_connections 2023-12-19T13:47:04.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee8070170 0x7f7ee8070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ee8142890 0x7f7ee81f21c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 --2- 172.21.15.113:0/2605184908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed40052a0 0x7f7ee80a88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:04.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 >> 172.21.15.113:0/2605184908 conn(0x7f7ee80cbb70 msgr2=0x7f7ee81404a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:04.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 shutdown_connections 2023-12-19T13:47:04.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:04.270+0000 7f7eefa5f640 1 -- 172.21.15.113:0/2605184908 wait complete. 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:47:04.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-19T13:47:04.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.290 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:47:04.352 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:47:04.352 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:47:04.352 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:47:04.352 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:04.352 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:47:04.353 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42370sec preferred_lft 42370sec 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:47:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:04.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.355 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:47:04.446 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:47:04.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.450 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:47:04.506 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:47:04.507 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:47:04.507 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:47:04.507 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:47:04.507 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:47:04.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.507 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:04.507 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:04.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:47:04.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:47:04.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:47:04.507 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:04.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.688 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:47:04.737 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:47:04.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.737 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-12-19T13:47:04.786 INFO:teuthology.orchestra.run.smithi151.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-19T13:47:04.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.787 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:04.787 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:04.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:47:04.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-19T13:47:04.788 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:04.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:04.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T13:47:05.021 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:47:05.021 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 3a:ec:1c:53:3e:2c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::38ec:1cff:fe53:3e2c/64 scope link 2023-12-19T13:47:05.022 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:05.025 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T13:47:05.117 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:47:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:47:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:47:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:47:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.118 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:47:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 3a:ec:1c:53:3e:2c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T13:47:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T13:47:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::38ec:1cff:fe53:3e2c/64 scope link 2023-12-19T13:47:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:05.121 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-19T13:47:05.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-19T13:47:05.122 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:05.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:05.394 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:05.394 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:05.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.1 up 2023-12-19T13:47:05.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T13:47:05.394 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:05.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:05.562 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-19T13:47:05.609 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-19T13:47:05.609 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:05.609 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-19T13:47:05.705 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-12-19T13:47:05.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:05.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:05.847 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:05.847 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:05.881 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:05.881 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:05.882 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:47:05.882 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 3@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:47:05.882 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:47:05.882 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-12-19T13:47:05.883 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:47:05.883 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:47:05.883 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:47:05.883 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:47:05.886 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:47:05.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:05.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-19T13:47:05.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:05.964 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:06.014 INFO:teuthology.orchestra.run.smithi151.stdout:client4442 2023-12-19T13:47:06.014 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:06.014 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:06.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:06.062 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:06.166 INFO:teuthology.orchestra.run.smithi151.stdout:client4442 2023-12-19T13:47:06.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:06.167 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:06.224 INFO:teuthology.orchestra.run.smithi151.stdout:client4442 2023-12-19T13:47:06.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:06.225 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4442/status') 2023-12-19T13:47:06.315 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4442 (3)192.168.0.2:0/556310393 2023-12-19T13:47:06.315 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-12-19T13:47:06.315 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-12-19T13:47:06.316 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-12-19T13:47:06.316 INFO:teuthology.orchestra.run.smithi151.stderr:68 bytes copied, 7.1247e-05 s, 954 kB/s 2023-12-19T13:47:06.319 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T13:47:06.336 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:06.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.557+0000 7f01be9d0640 1 Processor -- start 2023-12-19T13:47:06.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.557+0000 7f01be9d0640 1 -- start start 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.558+0000 7f01be9d0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f01b806c6b0 0x7f01b8166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.558+0000 7f01be9d0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b806bb30 con 0x7f01b81449e0 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.558+0000 7f01be9d0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b80b0070 con 0x7f01b80b0b50 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.558+0000 7f01be9d0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b80b0350 con 0x7f01b806c6b0 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.559+0000 7f01b7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f01b81449e0 0x7f01b80af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36102/0 (socket says 172.21.15.113:36102) 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.559+0000 7f01b7fff640 1 -- 172.21.15.113:0/389745670 learned_addr learned my addr 172.21.15.113:0/389745670 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.559+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222607551 0 0) 0x7f01b806bb30 con 0x7f01b81449e0 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.559+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a4003520 con 0x7f01b81449e0 2023-12-19T13:47:06.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.559+0000 7f01bcf6d640 1 --2- 172.21.15.113:0/389745670 >> v2:172.21.15.151:3300/0 conn(0x7f01b806c6b0 0x7f01b8166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.559+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3215680568 0 0) 0x7f01a4003520 con 0x7f01b81449e0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 >> v2:172.21.15.151:3300/0 conn(0x7f01b806c6b0 msgr2=0x7f01b8166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 --2- 172.21.15.113:0/389745670 >> v2:172.21.15.151:3300/0 conn(0x7f01b806c6b0 0x7f01b8166200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 >> v1:172.21.15.151:6789/0 conn(0x7f01b80b0b50 legacy=0x7f01b806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b80b0630 con 0x7f01b81449e0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f01a8001670 con 0x7f01b81449e0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 >> v1:172.21.15.113:6789/0 conn(0x7f01b81449e0 legacy=0x7f01b80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01a40039e0 0x7f01a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01a40052d0 0x7f01a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80b0350 con 0x7f01a40047c0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a400c210 con 0x7f01a40039e0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a400c3d0 con 0x7f01a40052d0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01affff640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01b7fff640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01a40039e0 0x7f01a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01bcf6d640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01a40052d0 0x7f01a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01affff640 1 -- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01a40052d0 msgr2=0x7f01a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:06.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.560+0000 7f01affff640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01a40052d0 0x7f01a400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.561+0000 7f01affff640 1 -- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01a40039e0 msgr2=0x7f01a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:06.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.561+0000 7f01affff640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01a40039e0 0x7f01a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.561+0000 7f01affff640 1 -- 172.21.15.113:0/389745670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a4003520 con 0x7f01a40047c0 2023-12-19T13:47:06.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.561+0000 7f01bcf6d640 1 -- 172.21.15.113:0/389745670 reap_dead start 2023-12-19T13:47:06.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.562+0000 7f01affff640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01a4004c40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01a0001750 tx=0x7f01a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9de5c8ae3a49c9d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:06.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.562+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00052d0 con 0x7f01a40047c0 2023-12-19T13:47:06.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.562+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a002e050 con 0x7f01a40047c0 2023-12-19T13:47:06.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.562+0000 7f01b77fe640 1 -- 172.21.15.113:0/389745670 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0003830 con 0x7f01a40047c0 2023-12-19T13:47:06.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.562+0000 7f01be9d0640 1 -- 172.21.15.113:0/389745670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 msgr2=0x7f01a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.562+0000 7f01be9d0640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01a4004c40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01a0001750 tx=0x7f01a40057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.563+0000 7f01be9d0640 1 -- 172.21.15.113:0/389745670 shutdown_connections 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.563+0000 7f01be9d0640 1 --2- 172.21.15.113:0/389745670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01a4004c40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.563+0000 7f01be9d0640 1 -- 172.21.15.113:0/389745670 >> 172.21.15.113:0/389745670 conn(0x7f01b80cbb70 msgr2=0x7f01b80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.563+0000 7f01be9d0640 1 -- 172.21.15.113:0/389745670 shutdown_connections 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.563+0000 7f01be9d0640 1 -- 172.21.15.113:0/389745670 wait complete. 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.564+0000 7f01be9d0640 1 Processor -- start 2023-12-19T13:47:06.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.565+0000 7f01be9d0640 1 -- start start 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01be9d0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01b81f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01be9d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01b81f60a0 0x7f01b81f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01be9d0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01b81435e0 0x7f01b8143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01be9d0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80a84a0 con 0x7f01a40047c0 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01be9d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8143fa0 con 0x7f01b81f60a0 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01be9d0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80a8a20 con 0x7f01b81435e0 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01b81f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01b81f2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48720/0 (socket says 172.21.15.113:48720) 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 -- 172.21.15.113:0/3863030552 learned_addr learned my addr 172.21.15.113:0/3863030552 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 -- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01b81435e0 msgr2=0x7f01b8143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01b81435e0 0x7f01b8143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 -- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01b81f60a0 msgr2=0x7f01b81f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:06.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01affff640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01b81f60a0 0x7f01b81f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01b81f60a0 0x7f01b81f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01b7fff640 1 -- 172.21.15.113:0/3863030552 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b81f6b60 con 0x7f01a40047c0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.566+0000 7f01affff640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01b81f60a0 0x7f01b81f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.567+0000 7f01b7fff640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01b81f2230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01a8001200 tx=0x7f01a800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.567+0000 7f01b57fa640 1 -- 172.21.15.113:0/3863030552 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a800ee50 con 0x7f01a40047c0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.567+0000 7f01b57fa640 1 -- 172.21.15.113:0/3863030552 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a800c870 con 0x7f01a40047c0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.567+0000 7f01b57fa640 1 -- 172.21.15.113:0/3863030552 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a800cc20 con 0x7f01a40047c0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.567+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b81f6e40 con 0x7f01a40047c0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.567+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b814d100 con 0x7f01a40047c0 2023-12-19T13:47:06.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.568+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b81f7030 con 0x7f01a40047c0 2023-12-19T13:47:06.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.569+0000 7f01b57fa640 1 -- 172.21.15.113:0/3863030552 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f01a801d460 con 0x7f01a40047c0 2023-12-19T13:47:06.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.571+0000 7f01b57fa640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f019806a460 0x7f019806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.571+0000 7f01b57fa640 1 -- 172.21.15.113:0/3863030552 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01a80887e0 con 0x7f01a40047c0 2023-12-19T13:47:06.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.571+0000 7f01affff640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f019806a460 0x7f019806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.572+0000 7f01affff640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f019806a460 0x7f019806c920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01a0033000 tx=0x7f01a0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:06.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.575+0000 7f01b57fa640 1 -- 172.21.15.113:0/3863030552 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f01b81f7030 con 0x7f01a40047c0 2023-12-19T13:47:06.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.768+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01b81f7030 con 0x7f01a40047c0 2023-12-19T13:47:06.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.770+0000 7f01b57fa640 1 -- 172.21.15.113:0/3863030552 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f01b81f7030 con 0x7f01a40047c0 2023-12-19T13:47:06.770 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:06.770 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:06.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f019806a460 msgr2=0x7f019806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f019806a460 0x7f019806c920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01a0033000 tx=0x7f01a0009030 comp rx=0 tx=0).stop 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 msgr2=0x7f01b81f2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01b81f2230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01a8001200 tx=0x7f01a800ec60 comp rx=0 tx=0).stop 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 shutdown_connections 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f019806a460 0x7f019806c920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01b81435e0 0x7f01b8143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01b81f60a0 0x7f01b81f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 --2- 172.21.15.113:0/3863030552 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01a40047c0 0x7f01b81f2230 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 >> 172.21.15.113:0/3863030552 conn(0x7f01b80cbb70 msgr2=0x7f01b80702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 shutdown_connections 2023-12-19T13:47:06.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.773+0000 7f01be9d0640 1 -- 172.21.15.113:0/3863030552 wait complete. 2023-12-19T13:47:06.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:06.792 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.994+0000 7fbdcfd5c640 1 Processor -- start 2023-12-19T13:47:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.994+0000 7fbdcfd5c640 1 -- start start 2023-12-19T13:47:06.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcfd5c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbdc80b7f20 0x7fbdc815da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcfd5c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbdc80b6430 0x7fbdc80b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcfd5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcfd5c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc8147540 con 0x7fbdc80b7f20 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcfd5c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc815ea80 con 0x7fbdc80b6430 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcfd5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc815ee60 con 0x7fbdc8070c70 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcdaf8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbdc80b7f20 0x7fbdc815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcdaf8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbdc80b7f20 0x7fbdc815da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48730/0 (socket says 172.21.15.113:48730) 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.996+0000 7fbdcdaf8640 1 -- 172.21.15.113:0/3372624274 learned_addr learned my addr 172.21.15.113:0/3372624274 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.997+0000 7fbdce2f9640 1 --2- 172.21.15.113:0/3372624274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.997+0000 7fbdcd2f7640 1 --2- 172.21.15.113:0/3372624274 >> v2:172.21.15.151:3300/0 conn(0x7fbdc80b6430 0x7fbdc80b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.997+0000 7fbdcdaf8640 1 -- 172.21.15.113:0/3372624274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 msgr2=0x7fbdc8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.997+0000 7fbdcdaf8640 1 --2- 172.21.15.113:0/3372624274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.997+0000 7fbdcdaf8640 1 -- 172.21.15.113:0/3372624274 >> v2:172.21.15.151:3300/0 conn(0x7fbdc80b6430 msgr2=0x7fbdc80b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:06.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.997+0000 7fbdcdaf8640 1 --2- 172.21.15.113:0/3372624274 >> v2:172.21.15.151:3300/0 conn(0x7fbdc80b6430 0x7fbdc80b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:06.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.997+0000 7fbdcdaf8640 1 -- 172.21.15.113:0/3372624274 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80b22e0 con 0x7fbdc80b7f20 2023-12-19T13:47:06.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.998+0000 7fbdcdaf8640 1 --2- 172.21.15.113:0/3372624274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc815da10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80cff70 tx=0x7fbdc402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804933230a560040 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:06.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdccaf6640 1 -- 172.21.15.113:0/3372624274 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4031870 con 0x7fbdc80b7f20 2023-12-19T13:47:06.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdccaf6640 1 -- 172.21.15.113:0/3372624274 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40319d0 con 0x7fbdc80b7f20 2023-12-19T13:47:06.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdccaf6640 1 -- 172.21.15.113:0/3372624274 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4031d60 con 0x7fbdc80b7f20 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/3372624274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 msgr2=0x7fbdc815da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/3372624274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc815da10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80cff70 tx=0x7fbdc402b910 comp rx=0 tx=0).stop 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/3372624274 shutdown_connections 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/3372624274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/3372624274 >> v2:172.21.15.151:3300/0 conn(0x7fbdc80b6430 0x7fbdc80b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/3372624274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc815da10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/3372624274 >> 172.21.15.113:0/3372624274 conn(0x7fbdc80d3520 msgr2=0x7fbdc80d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/3372624274 shutdown_connections 2023-12-19T13:47:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:06.999+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/3372624274 wait complete. 2023-12-19T13:47:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.001+0000 7fbdcfd5c640 1 Processor -- start 2023-12-19T13:47:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.001+0000 7fbdcfd5c640 1 -- start start 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdcfd5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdcfd5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc80b6430 0x7fbdc80b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdcfd5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc80b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdcfd5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc81f3490 con 0x7fbdc80b7f20 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdcfd5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8158ab0 con 0x7fbdc80b6430 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdcfd5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc81f38b0 con 0x7fbdc8070c70 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdce2f9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc80b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdce2f9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc80b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48744/0 (socket says 172.21.15.113:48744) 2023-12-19T13:47:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.002+0000 7fbdce2f9640 1 -- 172.21.15.113:0/4100239439 learned_addr learned my addr 172.21.15.113:0/4100239439 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdcdaf8640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdce2f9640 1 -- 172.21.15.113:0/4100239439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 msgr2=0x7fbdc8140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdce2f9640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdce2f9640 1 -- 172.21.15.113:0/4100239439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc80b6430 msgr2=0x7fbdc80b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdce2f9640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc80b6430 0x7fbdc80b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdce2f9640 1 -- 172.21.15.113:0/4100239439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40094d0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdce2f9640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc80b5690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0007d20 tx=0x7fbdc000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdbe7fc640 1 -- 172.21.15.113:0/4100239439 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0014420 con 0x7fbdc80b7f20 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdbe7fc640 1 -- 172.21.15.113:0/4100239439 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc00145a0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdbe7fc640 1 -- 172.21.15.113:0/4100239439 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0014950 con 0x7fbdc80b7f20 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.003+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc81f6de0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.004+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc81f2dd0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.005+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc81f35d0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.006+0000 7fbdbe7fc640 1 -- 172.21.15.113:0/4100239439 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdc0014ab0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.006+0000 7fbdbe7fc640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdac06a430 0x7fbdac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.007+0000 7fbdbe7fc640 1 -- 172.21.15.113:0/4100239439 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdc00891c0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.007+0000 7fbdcdaf8640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdac06a430 0x7fbdac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.008+0000 7fbdcdaf8640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdac06a430 0x7fbdac06c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4036000 tx=0x7fbdc403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.011+0000 7fbdbe7fc640 1 -- 172.21.15.113:0/4100239439 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbdc81f35d0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.201+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdc81f35d0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.202+0000 7fbdbe7fc640 1 -- 172.21.15.113:0/4100239439 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbdc81f35d0 con 0x7fbdc80b7f20 2023-12-19T13:47:07.202 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdac06a430 msgr2=0x7fbdac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdac06a430 0x7fbdac06c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4036000 tx=0x7fbdc403c040 comp rx=0 tx=0).stop 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 msgr2=0x7fbdc80b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc80b5690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0007d20 tx=0x7fbdc000e4b0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 shutdown_connections 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdac06a430 0x7fbdac06c8f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc80b7f20 0x7fbdc80b5690 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc80b6430 0x7fbdc80b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 --2- 172.21.15.113:0/4100239439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8070c70 0x7fbdc8140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 >> 172.21.15.113:0/4100239439 conn(0x7fbdc80d3520 msgr2=0x7fbdc80d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 shutdown_connections 2023-12-19T13:47:07.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.205+0000 7fbdcfd5c640 1 -- 172.21.15.113:0/4100239439 wait complete. 2023-12-19T13:47:07.223 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:07.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.436+0000 7f1caf12e640 1 Processor -- start 2023-12-19T13:47:07.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.436+0000 7f1caf12e640 1 -- start start 2023-12-19T13:47:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.437+0000 7f1caf12e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1ca8146ef0 0x7f1ca80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.437+0000 7f1caf12e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ca81618a0 0x7f1ca80b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.437+0000 7f1caf12e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca80d2a50 con 0x7f1ca80b6710 2023-12-19T13:47:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.437+0000 7f1caf12e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca80cda90 con 0x7f1ca8146ef0 2023-12-19T13:47:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.437+0000 7f1caf12e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca80cdca0 con 0x7f1ca81618a0 2023-12-19T13:47:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.437+0000 7f1caceca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1ca8146ef0 0x7f1ca80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.437+0000 7f1caceca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1ca8146ef0 0x7f1ca80ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48746/0 (socket says 172.21.15.113:48746) 2023-12-19T13:47:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.438+0000 7f1caceca640 1 -- 172.21.15.113:0/3892173060 learned_addr learned my addr 172.21.15.113:0/3892173060 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.438+0000 7f1caceca640 1 -- 172.21.15.113:0/3892173060 >> v2:172.21.15.151:3300/0 conn(0x7f1ca81618a0 msgr2=0x7f1ca80b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.438+0000 7f1caceca640 1 --2- 172.21.15.113:0/3892173060 >> v2:172.21.15.151:3300/0 conn(0x7f1ca81618a0 0x7f1ca80b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.438+0000 7f1caceca640 1 -- 172.21.15.113:0/3892173060 >> v1:172.21.15.151:6789/0 conn(0x7f1ca80b6710 legacy=0x7f1ca8161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.438+0000 7f1caceca640 1 -- 172.21.15.113:0/3892173060 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80cdf80 con 0x7f1ca8146ef0 2023-12-19T13:47:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.439+0000 7f1caceca640 1 --2- 172.21.15.113:0/3892173060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca8146ef0 0x7f1ca80ce4a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ca808bbb0 tx=0x7f1c9802bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e4da833dfa308f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.439+0000 7f1ca77fe640 1 -- 172.21.15.113:0/3892173060 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9802c980 con 0x7f1ca8146ef0 2023-12-19T13:47:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.439+0000 7f1ca77fe640 1 -- 172.21.15.113:0/3892173060 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9802cae0 con 0x7f1ca8146ef0 2023-12-19T13:47:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.439+0000 7f1ca77fe640 1 -- 172.21.15.113:0/3892173060 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9802ce70 con 0x7f1ca8146ef0 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 -- 172.21.15.113:0/3892173060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca8146ef0 msgr2=0x7f1ca80ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 --2- 172.21.15.113:0/3892173060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca8146ef0 0x7f1ca80ce4a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ca808bbb0 tx=0x7f1c9802bde0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 -- 172.21.15.113:0/3892173060 shutdown_connections 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 --2- 172.21.15.113:0/3892173060 >> v2:172.21.15.151:3300/0 conn(0x7f1ca81618a0 0x7f1ca80b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 --2- 172.21.15.113:0/3892173060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca8146ef0 0x7f1ca80ce4a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 -- 172.21.15.113:0/3892173060 >> 172.21.15.113:0/3892173060 conn(0x7f1ca80b29c0 msgr2=0x7f1ca80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 -- 172.21.15.113:0/3892173060 shutdown_connections 2023-12-19T13:47:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.440+0000 7f1caf12e640 1 -- 172.21.15.113:0/3892173060 wait complete. 2023-12-19T13:47:07.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.442+0000 7f1caf12e640 1 Processor -- start 2023-12-19T13:47:07.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.442+0000 7f1caf12e640 1 -- start start 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caf12e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca80b6710 0x7f1ca81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caf12e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca8146ef0 0x7f1ca8156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caf12e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca81618a0 0x7f1ca8157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caf12e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca8157690 con 0x7f1ca80b6710 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caf12e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca81f2e20 con 0x7f1ca81618a0 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caf12e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca81f3090 con 0x7f1ca8146ef0 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caceca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca80b6710 0x7f1ca81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caceca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca80b6710 0x7f1ca81581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48762/0 (socket says 172.21.15.113:48762) 2023-12-19T13:47:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.443+0000 7f1caceca640 1 -- 172.21.15.113:0/1516227751 learned_addr learned my addr 172.21.15.113:0/1516227751 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:07.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1caceca640 1 -- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca8146ef0 msgr2=0x7f1ca8156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1ca7fff640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca8146ef0 0x7f1ca8156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1caceca640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca8146ef0 0x7f1ca8156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1cad6cb640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca81618a0 0x7f1ca8157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1caceca640 1 -- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca81618a0 msgr2=0x7f1ca8157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1caceca640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca81618a0 0x7f1ca8157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1caceca640 1 -- 172.21.15.113:0/1516227751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98009b30 con 0x7f1ca80b6710 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1ca7fff640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca8146ef0 0x7f1ca8156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1caceca640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca80b6710 0x7f1ca81581b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1c980093e0 tx=0x7f1c98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1ca57fa640 1 -- 172.21.15.113:0/1516227751 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9802c900 con 0x7f1ca80b6710 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1ca57fa640 1 -- 172.21.15.113:0/1516227751 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c98007d30 con 0x7f1ca80b6710 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1ca57fa640 1 -- 172.21.15.113:0/1516227751 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98007ea0 con 0x7f1ca80b6710 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.444+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca81f3370 con 0x7f1ca80b6710 2023-12-19T13:47:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.445+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca81f7180 con 0x7f1ca80b6710 2023-12-19T13:47:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.446+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca81f3890 con 0x7f1ca80b6710 2023-12-19T13:47:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.447+0000 7f1ca57fa640 1 -- 172.21.15.113:0/1516227751 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c9803e690 con 0x7f1ca80b6710 2023-12-19T13:47:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.447+0000 7f1ca57fa640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c8806a430 0x7f1c8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.448+0000 7f1ca57fa640 1 -- 172.21.15.113:0/1516227751 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c980ab5e0 con 0x7f1ca80b6710 2023-12-19T13:47:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.448+0000 7f1ca7fff640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c8806a430 0x7f1c8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.448+0000 7f1ca7fff640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c8806a430 0x7f1c8806c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ca815dc90 tx=0x7f1c90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.452+0000 7f1ca57fa640 1 -- 172.21.15.113:0/1516227751 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c98076bd0 con 0x7f1ca80b6710 2023-12-19T13:47:07.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.640+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ca8061910 con 0x7f1ca80b6710 2023-12-19T13:47:07.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.641+0000 7f1ca57fa640 1 -- 172.21.15.113:0/1516227751 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c9807a1f0 con 0x7f1ca80b6710 2023-12-19T13:47:07.642 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:07.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.643+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c8806a430 msgr2=0x7f1c8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.643+0000 7f1caf12e640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c8806a430 0x7f1c8806c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ca815dc90 tx=0x7f1c90008040 comp rx=0 tx=0).stop 2023-12-19T13:47:07.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.643+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca80b6710 msgr2=0x7f1ca81581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.643+0000 7f1caf12e640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca80b6710 0x7f1ca81581b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1c980093e0 tx=0x7f1c98004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:07.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 shutdown_connections 2023-12-19T13:47:07.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c8806a430 0x7f1c8806c8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca81618a0 0x7f1ca8157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca8146ef0 0x7f1ca8156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 --2- 172.21.15.113:0/1516227751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca80b6710 0x7f1ca81581b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 >> 172.21.15.113:0/1516227751 conn(0x7f1ca80b29c0 msgr2=0x7f1ca80ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:07.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 shutdown_connections 2023-12-19T13:47:07.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.644+0000 7f1caf12e640 1 -- 172.21.15.113:0/1516227751 wait complete. 2023-12-19T13:47:07.660 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:07.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.867+0000 7ffbdb329640 1 Processor -- start 2023-12-19T13:47:07.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.867+0000 7ffbdb329640 1 -- start start 2023-12-19T13:47:07.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.869+0000 7ffbdb329640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 0x7ffbd415e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.869+0000 7ffbdb329640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffbd40cd4b0 0x7ffbd40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.869+0000 7ffbdb329640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd40cd020 con 0x7ffbd40b2710 2023-12-19T13:47:07.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.869+0000 7ffbdb329640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40cde80 con 0x7ffbd40cd4b0 2023-12-19T13:47:07.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.869+0000 7ffbdb329640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40cca30 con 0x7ffbd415ae50 2023-12-19T13:47:07.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.869+0000 7ffbd9b26640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffbd40b2710 0x7ffbd40ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36108/0 (socket says 172.21.15.113:36108) 2023-12-19T13:47:07.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.869+0000 7ffbd9b26640 1 -- 172.21.15.113:0/4179983615 learned_addr learned my addr 172.21.15.113:0/4179983615 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:07.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbdab28640 1 --2- 172.21.15.113:0/4179983615 >> v2:172.21.15.151:3300/0 conn(0x7ffbd40cd4b0 0x7ffbd40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbda327640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 0x7ffbd415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110881855 0 0) 0x7ffbd40cd020 con 0x7ffbd40b2710 2023-12-19T13:47:07.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc0003520 con 0x7ffbd40b2710 2023-12-19T13:47:07.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821634403 0 0) 0x7ffbc0003520 con 0x7ffbd40b2710 2023-12-19T13:47:07.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 msgr2=0x7ffbd415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:07.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 0x7ffbd415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 >> v2:172.21.15.151:3300/0 conn(0x7ffbd40cd4b0 msgr2=0x7ffbd40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 --2- 172.21.15.113:0/4179983615 >> v2:172.21.15.151:3300/0 conn(0x7ffbd40cd4b0 0x7ffbd40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40b2f20 con 0x7ffbd40b2710 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ffbc4001670 con 0x7ffbd40b2710 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 >> v1:172.21.15.113:6789/0 conn(0x7ffbd40b2710 legacy=0x7ffbd40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbc0003970 0x7ffbc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 0x7ffbc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40cca30 con 0x7ffbc00047c0 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc000b980 con 0x7ffbc0003970 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.870+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc000bac0 con 0x7ffbd415ae50 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbd9b26640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbda327640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbc0003970 0x7ffbc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbdab28640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 0x7ffbc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbd9b26640 1 -- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 msgr2=0x7ffbc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:07.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbd9b26640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd415ae50 0x7ffbc0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbd9b26640 1 -- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbc0003970 msgr2=0x7ffbc0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:07.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbd9b26640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbc0003970 0x7ffbc0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbd9b26640 1 -- 172.21.15.113:0/4179983615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0003520 con 0x7ffbc00047c0 2023-12-19T13:47:07.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.871+0000 7ffbda327640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbc0003970 0x7ffbc0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:07.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.872+0000 7ffbd9b26640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbc0004c40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c210 tx=0x7ffbc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a920262c56d6477 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.872+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4005ad0 con 0x7ffbc00047c0 2023-12-19T13:47:07.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.872+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4005c30 con 0x7ffbc00047c0 2023-12-19T13:47:07.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.872+0000 7ffbd9325640 1 -- 172.21.15.113:0/4179983615 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc402c8d0 con 0x7ffbc00047c0 2023-12-19T13:47:07.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.873+0000 7ffbdb329640 1 -- 172.21.15.113:0/4179983615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 msgr2=0x7ffbc0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.873+0000 7ffbdb329640 1 --2- 172.21.15.113:0/4179983615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbc0004c40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c210 tx=0x7ffbc00057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.873+0000 7ffbdab28640 1 -- 172.21.15.113:0/4179983615 reap_dead start 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.873+0000 7ffbdb329640 1 -- 172.21.15.113:0/4179983615 shutdown_connections 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.873+0000 7ffbdb329640 1 -- 172.21.15.113:0/4179983615 >> 172.21.15.113:0/4179983615 conn(0x7ffbd406f630 msgr2=0x7ffbd406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.873+0000 7ffbdb329640 1 -- 172.21.15.113:0/4179983615 shutdown_connections 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.873+0000 7ffbdb329640 1 -- 172.21.15.113:0/4179983615 wait complete. 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.875+0000 7ffbdb329640 1 Processor -- start 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.875+0000 7ffbdb329640 1 -- start start 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbdb329640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbd4154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbdb329640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd40b05d0 0x7ffbd414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbdb329640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd41f5e50 0x7ffbd415d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbdb329640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd414f410 con 0x7ffbc00047c0 2023-12-19T13:47:07.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbdb329640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd41f62e0 con 0x7ffbd41f5e50 2023-12-19T13:47:07.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbdb329640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd41f65c0 con 0x7ffbd40b05d0 2023-12-19T13:47:07.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbd4154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbd4154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48782/0 (socket says 172.21.15.113:48782) 2023-12-19T13:47:07.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 -- 172.21.15.113:0/281841635 learned_addr learned my addr 172.21.15.113:0/281841635 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:07.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 -- 172.21.15.113:0/281841635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd40b05d0 msgr2=0x7ffbd414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd40b05d0 0x7ffbd414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 -- 172.21.15.113:0/281841635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd41f5e50 msgr2=0x7ffbd415d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:07.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd41f5e50 0x7ffbd415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:07.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.876+0000 7ffbda327640 1 -- 172.21.15.113:0/281841635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd41f68a0 con 0x7ffbc00047c0 2023-12-19T13:47:07.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.877+0000 7ffbda327640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbd4154f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000e7e0 tx=0x7ffbd000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.877+0000 7ffbcaffd640 1 -- 172.21.15.113:0/281841635 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000c650 con 0x7ffbc00047c0 2023-12-19T13:47:07.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.877+0000 7ffbcaffd640 1 -- 172.21.15.113:0/281841635 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000c7b0 con 0x7ffbc00047c0 2023-12-19T13:47:07.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.877+0000 7ffbcaffd640 1 -- 172.21.15.113:0/281841635 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000cb60 con 0x7ffbc00047c0 2023-12-19T13:47:07.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.877+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd41f6b80 con 0x7ffbc00047c0 2023-12-19T13:47:07.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.877+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd415e050 con 0x7ffbc00047c0 2023-12-19T13:47:07.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.878+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd4158790 con 0x7ffbc00047c0 2023-12-19T13:47:07.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.879+0000 7ffbcaffd640 1 -- 172.21.15.113:0/281841635 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffbd000ccc0 con 0x7ffbc00047c0 2023-12-19T13:47:07.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.880+0000 7ffbcaffd640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffbb806a430 0x7ffbb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:07.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.880+0000 7ffbcaffd640 1 -- 172.21.15.113:0/281841635 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbd0088590 con 0x7ffbc00047c0 2023-12-19T13:47:07.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.880+0000 7ffbd9b26640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffbb806a430 0x7ffbb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:07.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.881+0000 7ffbd9b26640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffbb806a430 0x7ffbb806c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4034000 tx=0x7ffbc402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:07.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:07.884+0000 7ffbcaffd640 1 -- 172.21.15.113:0/281841635 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffbd0053c10 con 0x7ffbc00047c0 2023-12-19T13:47:08.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.072+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbd4061910 con 0x7ffbc00047c0 2023-12-19T13:47:08.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.073+0000 7ffbcaffd640 1 -- 172.21.15.113:0/281841635 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbd0057230 con 0x7ffbc00047c0 2023-12-19T13:47:08.073 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:08.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffbb806a430 msgr2=0x7ffbb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffbb806a430 0x7ffbb806c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4034000 tx=0x7ffbc402e000 comp rx=0 tx=0).stop 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 msgr2=0x7ffbd4154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbd4154f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000e7e0 tx=0x7ffbd000eca0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 shutdown_connections 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffbb806a430 0x7ffbb806c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd41f5e50 0x7ffbd415d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbd40b05d0 0x7ffbd414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 --2- 172.21.15.113:0/281841635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbc00047c0 0x7ffbd4154f90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 >> 172.21.15.113:0/281841635 conn(0x7ffbd406f630 msgr2=0x7ffbd40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.075+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 shutdown_connections 2023-12-19T13:47:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.076+0000 7ffbdb329640 1 -- 172.21.15.113:0/281841635 wait complete. 2023-12-19T13:47:08.094 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:08.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.301+0000 7f7f38b22640 1 Processor -- start 2023-12-19T13:47:08.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.301+0000 7f7f38b22640 1 -- start start 2023-12-19T13:47:08.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f38b22640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7f340b0b50 0x7f7f3406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f38b22640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 0x7f7f3406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f38b22640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3406bb30 con 0x7f7f341449e0 2023-12-19T13:47:08.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f38b22640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f340b0070 con 0x7f7f340b0b50 2023-12-19T13:47:08.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f38b22640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340b0350 con 0x7f7f3406b590 2023-12-19T13:47:08.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f3259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7f341449e0 0x7f7f340af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54940/0 (socket says 172.21.15.113:54940) 2023-12-19T13:47:08.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f3259c640 1 -- 172.21.15.113:0/297419797 learned_addr learned my addr 172.21.15.113:0/297419797 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.303+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684756689 0 0) 0x7f7f3406bb30 con 0x7f7f341449e0 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f20003520 con 0x7f7f341449e0 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f32d9d640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 0x7f7f3406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f2bfff640 1 --2- 172.21.15.113:0/297419797 >> v2:172.21.15.151:3300/0 conn(0x7f7f340b0b50 0x7f7f3406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3266078943 0 0) 0x7f7f20003520 con 0x7f7f341449e0 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 msgr2=0x7f7f3406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 0x7f7f3406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 >> v2:172.21.15.151:3300/0 conn(0x7f7f340b0b50 msgr2=0x7f7f3406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 --2- 172.21.15.113:0/297419797 >> v2:172.21.15.151:3300/0 conn(0x7f7f340b0b50 0x7f7f3406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340b0630 con 0x7f7f341449e0 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f7f24001670 con 0x7f7f341449e0 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 >> v1:172.21.15.113:6789/0 conn(0x7f7f341449e0 legacy=0x7f7f340af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f200039e0 0x7f7f20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 0x7f7f200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340b0070 con 0x7f7f20004d00 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340b0350 con 0x7f7f200039e0 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2000bab0 con 0x7f7f3406b590 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.304+0000 7f7f32d9d640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.305+0000 7f7f2bfff640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 0x7f7f200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.305+0000 7f7f32d9d640 1 -- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 msgr2=0x7f7f200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.305+0000 7f7f32d9d640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3406b590 0x7f7f200047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.305+0000 7f7f3259c640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f200039e0 0x7f7f20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.305+0000 7f7f32d9d640 1 -- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f200039e0 msgr2=0x7f7f20003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.305+0000 7f7f32d9d640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f200039e0 0x7f7f20003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.305+0000 7f7f32d9d640 1 -- 172.21.15.113:0/297419797 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20003520 con 0x7f7f20004d00 2023-12-19T13:47:08.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.306+0000 7f7f32d9d640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f20005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007330 tx=0x7f7f200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dfca6855477b11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.306+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c02cca0 con 0x7f7f20004d00 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.306+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c02ce00 con 0x7f7f20004d00 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.306+0000 7f7f31d9b640 1 -- 172.21.15.113:0/297419797 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c034660 con 0x7f7f20004d00 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.306+0000 7f7f38b22640 1 -- 172.21.15.113:0/297419797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 msgr2=0x7f7f20005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.307+0000 7f7f38b22640 1 --2- 172.21.15.113:0/297419797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f20005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007330 tx=0x7f7f200057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.307+0000 7f7f32d9d640 1 -- 172.21.15.113:0/297419797 reap_dead start 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.307+0000 7f7f38b22640 1 -- 172.21.15.113:0/297419797 shutdown_connections 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.307+0000 7f7f38b22640 1 -- 172.21.15.113:0/297419797 >> 172.21.15.113:0/297419797 conn(0x7f7f340cbb70 msgr2=0x7f7f340cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.307+0000 7f7f38b22640 1 -- 172.21.15.113:0/297419797 shutdown_connections 2023-12-19T13:47:08.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.307+0000 7f7f38b22640 1 -- 172.21.15.113:0/297419797 wait complete. 2023-12-19T13:47:08.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.308+0000 7f7f38b22640 1 Processor -- start 2023-12-19T13:47:08.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.309+0000 7f7f38b22640 1 -- start start 2023-12-19T13:47:08.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.309+0000 7f7f38b22640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f341594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.309+0000 7f7f38b22640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3413b740 0x7f7f341f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f38b22640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3413bba0 0x7f7f341f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f38b22640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340ced00 con 0x7f7f20004d00 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f38b22640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3413d4c0 con 0x7f7f3413bba0 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f38b22640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3413e2c0 con 0x7f7f3413b740 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f341594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f341594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42514/0 (socket says 172.21.15.113:42514) 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 -- 172.21.15.113:0/2063499572 learned_addr learned my addr 172.21.15.113:0/2063499572 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 -- 172.21.15.113:0/2063499572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3413b740 msgr2=0x7f7f341f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3413b740 0x7f7f341f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 -- 172.21.15.113:0/2063499572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3413bba0 msgr2=0x7f7f341f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3413bba0 0x7f7f341f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 -- 172.21.15.113:0/2063499572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3413d740 con 0x7f7f20004d00 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.310+0000 7f7f3259c640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f341594f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7f24000ff0 tx=0x7f7f2400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.311+0000 7f7f2affd640 1 -- 172.21.15.113:0/2063499572 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240074e0 con 0x7f7f20004d00 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.311+0000 7f7f2affd640 1 -- 172.21.15.113:0/2063499572 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24007640 con 0x7f7f20004d00 2023-12-19T13:47:08.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.311+0000 7f7f2affd640 1 -- 172.21.15.113:0/2063499572 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240049e0 con 0x7f7f20004d00 2023-12-19T13:47:08.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.311+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3413da20 con 0x7f7f20004d00 2023-12-19T13:47:08.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.311+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3413dfe0 con 0x7f7f20004d00 2023-12-19T13:47:08.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.312+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f34061910 con 0x7f7f20004d00 2023-12-19T13:47:08.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.313+0000 7f7f2affd640 1 -- 172.21.15.113:0/2063499572 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f24004b40 con 0x7f7f20004d00 2023-12-19T13:47:08.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.313+0000 7f7f2affd640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f1406a460 0x7f7f1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.314+0000 7f7f2affd640 1 -- 172.21.15.113:0/2063499572 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f240881c0 con 0x7f7f20004d00 2023-12-19T13:47:08.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.314+0000 7f7f2bfff640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f1406a460 0x7f7f1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.315+0000 7f7f2bfff640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f1406a460 0x7f7f1406c920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c006e80 tx=0x7f7f1c006e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:08.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.318+0000 7f7f2affd640 1 -- 172.21.15.113:0/2063499572 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f240537b0 con 0x7f7f20004d00 2023-12-19T13:47:08.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.508+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f340ccc80 con 0x7f7f20004d00 2023-12-19T13:47:08.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.511+0000 7f7f2affd640 1 -- 172.21.15.113:0/2063499572 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f7f24056dd0 con 0x7f7f20004d00 2023-12-19T13:47:08.511 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:08.511 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:08.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.513+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f1406a460 msgr2=0x7f7f1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.513+0000 7f7f38b22640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f1406a460 0x7f7f1406c920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c006e80 tx=0x7f7f1c006e10 comp rx=0 tx=0).stop 2023-12-19T13:47:08.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.513+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 msgr2=0x7f7f341594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.513+0000 7f7f38b22640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f341594f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7f24000ff0 tx=0x7f7f2400dc70 comp rx=0 tx=0).stop 2023-12-19T13:47:08.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 shutdown_connections 2023-12-19T13:47:08.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f1406a460 0x7f7f1406c920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3413bba0 0x7f7f341f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3413b740 0x7f7f341f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 --2- 172.21.15.113:0/2063499572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f20004d00 0x7f7f341594f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 >> 172.21.15.113:0/2063499572 conn(0x7f7f340cbb70 msgr2=0x7f7f340ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:08.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 shutdown_connections 2023-12-19T13:47:08.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.514+0000 7f7f38b22640 1 -- 172.21.15.113:0/2063499572 wait complete. 2023-12-19T13:47:08.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:08.533 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:08.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.747+0000 7fd7b8f0a640 1 Processor -- start 2023-12-19T13:47:08.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.747+0000 7fd7b8f0a640 1 -- start start 2023-12-19T13:47:08.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.748+0000 7fd7b8f0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 0x7fd7b40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.748+0000 7fd7b8f0a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b415fde0 con 0x7fd7b40b2760 2023-12-19T13:47:08.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.748+0000 7fd7b8f0a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b40b2bc0 con 0x7fd7b415b1d0 2023-12-19T13:47:08.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.748+0000 7fd7b8f0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40b2400 con 0x7fd7b40cf5b0 2023-12-19T13:47:08.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.749+0000 7fd7abfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd7b40b2760 0x7fd7b40ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54944/0 (socket says 172.21.15.113:54944) 2023-12-19T13:47:08.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.749+0000 7fd7abfff640 1 -- 172.21.15.113:0/3742275671 learned_addr learned my addr 172.21.15.113:0/3742275671 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:08.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.749+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506470710 0 0) 0x7fd7b415fde0 con 0x7fd7b40b2760 2023-12-19T13:47:08.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.749+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a0003520 con 0x7fd7b40b2760 2023-12-19T13:47:08.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.749+0000 7fd7b2d9d640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 0x7fd7b40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107960697 0 0) 0x7fd7a0003520 con 0x7fd7b40b2760 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 msgr2=0x7fd7b40b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 0x7fd7b40b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 >> v1:172.21.15.151:6789/0 conn(0x7fd7b415b1d0 legacy=0x7fd7b415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b415ef10 con 0x7fd7b40b2760 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fd79c001670 con 0x7fd7b40b2760 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b2d9d640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 0x7fd7b40b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 >> v1:172.21.15.113:6789/0 conn(0x7fd7b40b2760 legacy=0x7fd7b40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00047c0 0x7fd7a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 0x7fd7a00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a000bb10 con 0x7fd7a0003a10 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a000bc50 con 0x7fd7a00047c0 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a000be10 con 0x7fd7b40cf5b0 2023-12-19T13:47:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b259c640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7abfff640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00047c0 0x7fd7a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b259c640 1 -- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 msgr2=0x7fd7a00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b259c640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b40cf5b0 0x7fd7a00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b259c640 1 -- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00047c0 msgr2=0x7fd7a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b259c640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00047c0 0x7fd7a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.750+0000 7fd7b259c640 1 -- 172.21.15.113:0/3742275671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0003520 con 0x7fd7a0003a10 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b259c640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7a0003e30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4001750 tx=0x7fd7a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823f8dee2c0221f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40052d0 con 0x7fd7a0003a10 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a402e050 con 0x7fd7a0003a10 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b1d9b640 1 -- 172.21.15.113:0/3742275671 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40035f0 con 0x7fd7a0003a10 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3742275671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 msgr2=0x7fd7a0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b8f0a640 1 --2- 172.21.15.113:0/3742275671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7a0003e30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4001750 tx=0x7fd7a00057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b2d9d640 1 -- 172.21.15.113:0/3742275671 reap_dead start 2023-12-19T13:47:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3742275671 shutdown_connections 2023-12-19T13:47:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.752+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3742275671 >> 172.21.15.113:0/3742275671 conn(0x7fd7b4073150 msgr2=0x7fd7b40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.753+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3742275671 shutdown_connections 2023-12-19T13:47:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.753+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3742275671 wait complete. 2023-12-19T13:47:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.754+0000 7fd7b8f0a640 1 Processor -- start 2023-12-19T13:47:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.754+0000 7fd7b8f0a640 1 -- start start 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.755+0000 7fd7b8f0a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7b4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.755+0000 7fd7b8f0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b41f6b30 0x7fd7b41f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b8f0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7b40c8460 0x7fd7b40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b8f0a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b41560b0 con 0x7fd7a0003a10 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b8f0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40c8e20 con 0x7fd7b40c8460 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b8f0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40ca450 con 0x7fd7b41f6b30 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7b4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7b4155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42534/0 (socket says 172.21.15.113:42534) 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 -- 172.21.15.113:0/3998127502 learned_addr learned my addr 172.21.15.113:0/3998127502 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7abfff640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b41f6b30 0x7fd7b41f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b2d9d640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7b40c8460 0x7fd7b40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 -- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b41f6b30 msgr2=0x7fd7b41f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b41f6b30 0x7fd7b41f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 -- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7b40c8460 msgr2=0x7fd7b40c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7b40c8460 0x7fd7b40c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.756+0000 7fd7b259c640 1 -- 172.21.15.113:0/3998127502 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b414a5b0 con 0x7fd7a0003a10 2023-12-19T13:47:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.757+0000 7fd7b259c640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7b4155b70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4008fd0 tx=0x7fd7a4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.757+0000 7fd7aaffd640 1 -- 172.21.15.113:0/3998127502 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40076c0 con 0x7fd7a0003a10 2023-12-19T13:47:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.757+0000 7fd7aaffd640 1 -- 172.21.15.113:0/3998127502 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4007a30 con 0x7fd7a0003a10 2023-12-19T13:47:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.757+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b41f7060 con 0x7fd7a0003a10 2023-12-19T13:47:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.757+0000 7fd7aaffd640 1 -- 172.21.15.113:0/3998127502 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4006be0 con 0x7fd7a0003a10 2023-12-19T13:47:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.757+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b415c600 con 0x7fd7a0003a10 2023-12-19T13:47:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.758+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b4061910 con 0x7fd7a0003a10 2023-12-19T13:47:08.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.759+0000 7fd7aaffd640 1 -- 172.21.15.113:0/3998127502 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd7a4006d40 con 0x7fd7a0003a10 2023-12-19T13:47:08.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.760+0000 7fd7aaffd640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd79406a430 0x7fd79406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:08.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.760+0000 7fd7aaffd640 1 -- 172.21.15.113:0/3998127502 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7a40aa900 con 0x7fd7a0003a10 2023-12-19T13:47:08.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.761+0000 7fd7abfff640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd79406a430 0x7fd79406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.761+0000 7fd7abfff640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd79406a430 0x7fd79406c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd79c001eb0 tx=0x7fd79c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:08.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.765+0000 7fd7aaffd640 1 -- 172.21.15.113:0/3998127502 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd7a4075e50 con 0x7fd7a0003a10 2023-12-19T13:47:08.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.954+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7b414a5b0 con 0x7fd7a0003a10 2023-12-19T13:47:08.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.955+0000 7fd7aaffd640 1 -- 172.21.15.113:0/3998127502 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7b414a5b0 con 0x7fd7a0003a10 2023-12-19T13:47:08.955 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.957+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd79406a430 msgr2=0x7fd79406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.957+0000 7fd7b8f0a640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd79406a430 0x7fd79406c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd79c001eb0 tx=0x7fd79c009040 comp rx=0 tx=0).stop 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 msgr2=0x7fd7b4155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7b4155b70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4008fd0 tx=0x7fd7a4001120 comp rx=0 tx=0).stop 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 shutdown_connections 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd79406a430 0x7fd79406c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7b40c8460 0x7fd7b40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7b41f6b30 0x7fd7b41f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 --2- 172.21.15.113:0/3998127502 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7a0003a10 0x7fd7b4155b70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 >> 172.21.15.113:0/3998127502 conn(0x7fd7b4073150 msgr2=0x7fd7b40b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 shutdown_connections 2023-12-19T13:47:08.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:08.958+0000 7fd7b8f0a640 1 -- 172.21.15.113:0/3998127502 wait complete. 2023-12-19T13:47:08.977 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:09.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.194+0000 7fcdc4e77640 1 Processor -- start 2023-12-19T13:47:09.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.195+0000 7fcdc4e77640 1 -- start start 2023-12-19T13:47:09.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.196+0000 7fcdc4e77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 0x7fcdc00d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.196+0000 7fcdc4e77640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc00cd840 con 0x7fcdc0146e10 2023-12-19T13:47:09.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.196+0000 7fcdc4e77640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc00b6e90 con 0x7fcdc00ce110 2023-12-19T13:47:09.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.196+0000 7fcdc4e77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00d2430 con 0x7fcdc00d2b00 2023-12-19T13:47:09.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.196+0000 7fcdbe59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcdc0146e10 0x7fcdc00b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54952/0 (socket says 172.21.15.113:54952) 2023-12-19T13:47:09.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.196+0000 7fcdbe59c640 1 -- 172.21.15.113:0/1786361763 learned_addr learned my addr 172.21.15.113:0/1786361763 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:09.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbdd9b640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 0x7fcdc00d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098712582 0 0) 0x7fcdc00cd840 con 0x7fcdc0146e10 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdac003520 con 0x7fcdc0146e10 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921838243 0 0) 0x7fcdac003520 con 0x7fcdc0146e10 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 msgr2=0x7fcdc00d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 0x7fcdc00d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 >> v1:172.21.15.151:6789/0 conn(0x7fcdc00ce110 legacy=0x7fcdc00b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc00d2620 con 0x7fcdc0146e10 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fcda8001670 con 0x7fcdc0146e10 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 >> v1:172.21.15.113:6789/0 conn(0x7fcdc0146e10 legacy=0x7fcdc00b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac003a10 0x7fcdac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.197+0000 7fcdbd59a640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 0x7fcdac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbd59a640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac004d00 0x7fcdac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac00ba90 con 0x7fcdac004d00 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac00bc00 con 0x7fcdac003a10 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac00bdc0 con 0x7fcdc00d2b00 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbed9d640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac004d00 0x7fcdac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbe59c640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac003a10 0x7fcdac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbdd9b640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 0x7fcdac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbed9d640 1 -- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 msgr2=0x7fcdac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbed9d640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc00d2b00 0x7fcdac0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbed9d640 1 -- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac003a10 msgr2=0x7fcdac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:09.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbed9d640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac003a10 0x7fcdac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.198+0000 7fcdbed9d640 1 -- 172.21.15.113:0/1786361763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac003520 con 0x7fcdac004d00 2023-12-19T13:47:09.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.199+0000 7fcdbed9d640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac004d00 0x7fcdac005180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8001720 tx=0x7fcdac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9250908f054557f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:09.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.199+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb80052d0 con 0x7fcdac004d00 2023-12-19T13:47:09.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb802e050 con 0x7fcdac004d00 2023-12-19T13:47:09.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdbd59a640 1 -- 172.21.15.113:0/1786361763 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb80035f0 con 0x7fcdac004d00 2023-12-19T13:47:09.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdc4e77640 1 -- 172.21.15.113:0/1786361763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac004d00 msgr2=0x7fcdac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdc4e77640 1 --2- 172.21.15.113:0/1786361763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdac004d00 0x7fcdac005180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8001720 tx=0x7fcdac0057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdbed9d640 1 -- 172.21.15.113:0/1786361763 reap_dead start 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdc4e77640 1 -- 172.21.15.113:0/1786361763 shutdown_connections 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdc4e77640 1 -- 172.21.15.113:0/1786361763 >> 172.21.15.113:0/1786361763 conn(0x7fcdc00b29c0 msgr2=0x7fcdc00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdc4e77640 1 -- 172.21.15.113:0/1786361763 shutdown_connections 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.200+0000 7fcdc4e77640 1 -- 172.21.15.113:0/1786361763 wait complete. 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.202+0000 7fcdc4e77640 1 Processor -- start 2023-12-19T13:47:09.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.202+0000 7fcdc4e77640 1 -- start start 2023-12-19T13:47:09.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdc4e77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac004d00 0x7fcdc0159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdc4e77640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc0160620 0x7fcdc015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdc4e77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc015f0e0 0x7fcdc00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdc4e77640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc015f580 con 0x7fcdc0160620 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdc4e77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc015f860 con 0x7fcdac004d00 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdc4e77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc015fb40 con 0x7fcdc015f0e0 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdbdd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc0160620 0x7fcdc015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdbdd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc0160620 0x7fcdc015eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42550/0 (socket says 172.21.15.113:42550) 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.203+0000 7fcdbdd9b640 1 -- 172.21.15.113:0/2050569121 learned_addr learned my addr 172.21.15.113:0/2050569121 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbdd9b640 1 -- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc015f0e0 msgr2=0x7fcdc00c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbdd9b640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc015f0e0 0x7fcdc00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbdd9b640 1 -- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac004d00 msgr2=0x7fcdc0159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbe59c640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac004d00 0x7fcdc0159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbdd9b640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac004d00 0x7fcdc0159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbdd9b640 1 -- 172.21.15.113:0/2050569121 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc015fe20 con 0x7fcdc0160620 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbe59c640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac004d00 0x7fcdc0159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdbdd9b640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc0160620 0x7fcdc015eba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000f350 tx=0x7fcdb000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdb6ffd640 1 -- 172.21.15.113:0/2050569121 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000fee0 con 0x7fcdc0160620 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdb6ffd640 1 -- 172.21.15.113:0/2050569121 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0011040 con 0x7fcdc0160620 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdb6ffd640 1 -- 172.21.15.113:0/2050569121 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0017860 con 0x7fcdc0160620 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.204+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc0160100 con 0x7fcdc0160620 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.205+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc015b650 con 0x7fcdc0160620 2023-12-19T13:47:09.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.206+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc0061910 con 0x7fcdc0160620 2023-12-19T13:47:09.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.206+0000 7fcdb6ffd640 1 -- 172.21.15.113:0/2050569121 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcdb00179c0 con 0x7fcdc0160620 2023-12-19T13:47:09.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.207+0000 7fcdb6ffd640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcda006a430 0x7fcda006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.207+0000 7fcdb6ffd640 1 -- 172.21.15.113:0/2050569121 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdb0088f20 con 0x7fcdc0160620 2023-12-19T13:47:09.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.208+0000 7fcdbe59c640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcda006a430 0x7fcda006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.208+0000 7fcdbe59c640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcda006a430 0x7fcda006c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcda8001eb0 tx=0x7fcda8001d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:09.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.212+0000 7fcdb6ffd640 1 -- 172.21.15.113:0/2050569121 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcdb0054660 con 0x7fcdc0160620 2023-12-19T13:47:09.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.398+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdc0146610 con 0x7fcdc0160620 2023-12-19T13:47:09.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.399+0000 7fcdb6ffd640 1 -- 172.21.15.113:0/2050569121 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdb001c020 con 0x7fcdc0160620 2023-12-19T13:47:09.399 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:09.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcda006a430 msgr2=0x7fcda006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcda006a430 0x7fcda006c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcda8001eb0 tx=0x7fcda8001d60 comp rx=0 tx=0).stop 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc0160620 msgr2=0x7fcdc015eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc0160620 0x7fcdc015eba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000f350 tx=0x7fcdb000f810 comp rx=0 tx=0).stop 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 shutdown_connections 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcda006a430 0x7fcda006c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc015f0e0 0x7fcdc00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc0160620 0x7fcdc015eba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 --2- 172.21.15.113:0/2050569121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac004d00 0x7fcdc0159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 >> 172.21.15.113:0/2050569121 conn(0x7fcdc00b29c0 msgr2=0x7fcdc00d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 shutdown_connections 2023-12-19T13:47:09.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.402+0000 7fcdc4e77640 1 -- 172.21.15.113:0/2050569121 wait complete. 2023-12-19T13:47:09.420 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:09.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.636+0000 7f2598718640 1 Processor -- start 2023-12-19T13:47:09.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.637+0000 7f2598718640 1 -- start start 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.638+0000 7f2598718640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2590152510 0x7f25900b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.638+0000 7f2598718640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25900adba0 0x7f259015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.638+0000 7f2598718640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25901528f0 con 0x7f25900b0640 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.638+0000 7f2598718640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25900b0bc0 con 0x7f25900adba0 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.638+0000 7f2598718640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259015ba70 con 0x7f2590152510 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.638+0000 7f2596cb5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25900adba0 0x7f259015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f2595cb3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f25900b0640 0x7f25900ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54968/0 (socket says 172.21.15.113:54968) 2023-12-19T13:47:09.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f2595cb3640 1 -- 172.21.15.113:0/589571720 learned_addr learned my addr 172.21.15.113:0/589571720 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:09.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f25964b4640 1 --2- 172.21.15.113:0/589571720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2590152510 0x7f25900b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f2596cb5640 1 -- 172.21.15.113:0/589571720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2590152510 msgr2=0x7f25900b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:09.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f2596cb5640 1 --2- 172.21.15.113:0/589571720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2590152510 0x7f25900b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f2596cb5640 1 -- 172.21.15.113:0/589571720 >> v1:172.21.15.113:6789/0 conn(0x7f25900b0640 legacy=0x7f25900ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f2596cb5640 1 -- 172.21.15.113:0/589571720 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259015bd50 con 0x7f25900adba0 2023-12-19T13:47:09.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.639+0000 7f25954b2640 1 -- 172.21.15.113:0/589571720 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722425728 0 0) 0x7f25901528f0 con 0x7f25900b0640 2023-12-19T13:47:09.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.640+0000 7f2596cb5640 1 --2- 172.21.15.113:0/589571720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f259015cb00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2588009d90 tx=0x7f258802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea25b5fcfb1e102 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:09.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.640+0000 7f25954b2640 1 -- 172.21.15.113:0/589571720 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258802cc50 con 0x7f25900adba0 2023-12-19T13:47:09.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.640+0000 7f25954b2640 1 -- 172.21.15.113:0/589571720 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258802cdb0 con 0x7f25900adba0 2023-12-19T13:47:09.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f25954b2640 1 -- 172.21.15.113:0/589571720 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588034660 con 0x7f25900adba0 2023-12-19T13:47:09.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 -- 172.21.15.113:0/589571720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 msgr2=0x7f259015cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 --2- 172.21.15.113:0/589571720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f259015cb00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2588009d90 tx=0x7f258802bea0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 -- 172.21.15.113:0/589571720 shutdown_connections 2023-12-19T13:47:09.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 --2- 172.21.15.113:0/589571720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f259015cb00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 --2- 172.21.15.113:0/589571720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2590152510 0x7f25900b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 -- 172.21.15.113:0/589571720 >> 172.21.15.113:0/589571720 conn(0x7f2590073790 msgr2=0x7f25900659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:09.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 -- 172.21.15.113:0/589571720 shutdown_connections 2023-12-19T13:47:09.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.641+0000 7f2598718640 1 -- 172.21.15.113:0/589571720 wait complete. 2023-12-19T13:47:09.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.643+0000 7f2598718640 1 Processor -- start 2023-12-19T13:47:09.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.643+0000 7f2598718640 1 -- start start 2023-12-19T13:47:09.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f2598718640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f2590148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f2598718640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25900b0640 0x7f2590157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f2598718640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2590152510 0x7f25901599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f2598718640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2590153ec0 con 0x7f25900adba0 2023-12-19T13:47:09.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f2598718640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25901541a0 con 0x7f2590152510 2023-12-19T13:47:09.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f2598718640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2590154480 con 0x7f25900b0640 2023-12-19T13:47:09.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f25964b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f2590148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f25964b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f2590148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42572/0 (socket says 172.21.15.113:42572) 2023-12-19T13:47:09.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.644+0000 7f25964b4640 1 -- 172.21.15.113:0/2535886030 learned_addr learned my addr 172.21.15.113:0/2535886030 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:09.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f25964b4640 1 -- 172.21.15.113:0/2535886030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25900b0640 msgr2=0x7f2590157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f25964b4640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25900b0640 0x7f2590157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f25964b4640 1 -- 172.21.15.113:0/2535886030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2590152510 msgr2=0x7f25901599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f25964b4640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2590152510 0x7f25901599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f25964b4640 1 -- 172.21.15.113:0/2535886030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588009a70 con 0x7f25900adba0 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f25964b4640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f2590148700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f258c00d5d0 tx=0x7f258c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f2586ffd640 1 -- 172.21.15.113:0/2535886030 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0125f0 con 0x7f25900adba0 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f2586ffd640 1 -- 172.21.15.113:0/2535886030 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c012770 con 0x7f25900adba0 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f2586ffd640 1 -- 172.21.15.113:0/2535886030 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c012b20 con 0x7f25900adba0 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.645+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2590154760 con 0x7f25900adba0 2023-12-19T13:47:09.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.646+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2590148c40 con 0x7f25900adba0 2023-12-19T13:47:09.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.647+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25901562e0 con 0x7f25900adba0 2023-12-19T13:47:09.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.647+0000 7f2586ffd640 1 -- 172.21.15.113:0/2535886030 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f258c012c80 con 0x7f25900adba0 2023-12-19T13:47:09.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.648+0000 7f2586ffd640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f257406a430 0x7f257406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:09.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.648+0000 7f2586ffd640 1 -- 172.21.15.113:0/2535886030 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f258c088e30 con 0x7f25900adba0 2023-12-19T13:47:09.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.649+0000 7f2595cb3640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f257406a430 0x7f257406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:09.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.649+0000 7f2595cb3640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f257406a430 0x7f257406c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2580007fd0 tx=0x7f2580007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:09.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.653+0000 7f2586ffd640 1 -- 172.21.15.113:0/2535886030 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25901562e0 con 0x7f25900adba0 2023-12-19T13:47:09.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.841+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25901562e0 con 0x7f25900adba0 2023-12-19T13:47:09.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.842+0000 7f2586ffd640 1 -- 172.21.15.113:0/2535886030 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25901562e0 con 0x7f25900adba0 2023-12-19T13:47:09.842 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:09.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.844+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f257406a430 msgr2=0x7f257406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.844+0000 7f2598718640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f257406a430 0x7f257406c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2580007fd0 tx=0x7f2580007920 comp rx=0 tx=0).stop 2023-12-19T13:47:09.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.844+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 msgr2=0x7f2590148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.844+0000 7f2598718640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f2590148700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f258c00d5d0 tx=0x7f258c00da90 comp rx=0 tx=0).stop 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 shutdown_connections 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f257406a430 0x7f257406c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2590152510 0x7f25901599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25900b0640 0x7f2590157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 --2- 172.21.15.113:0/2535886030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25900adba0 0x7f2590148700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 >> 172.21.15.113:0/2535886030 conn(0x7f2590073790 msgr2=0x7f259015db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 shutdown_connections 2023-12-19T13:47:09.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:09.845+0000 7f2598718640 1 -- 172.21.15.113:0/2535886030 wait complete. 2023-12-19T13:47:09.862 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:10.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.065+0000 7f8c7759e640 1 Processor -- start 2023-12-19T13:47:10.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.065+0000 7f8c7759e640 1 -- start start 2023-12-19T13:47:10.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.066+0000 7f8c7759e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8c78159f80 0x7f8c7806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.066+0000 7f8c7759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8c7815aa70 0x7f8c7815b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.066+0000 7f8c7759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7806b520 con 0x7f8c7815b1e0 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7759e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780b2b20 con 0x7f8c78159f80 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780b2fb0 con 0x7f8c7815aa70 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8c78159f80 0x7f8c7806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8c78159f80 0x7f8c7806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42578/0 (socket says 172.21.15.113:42578) 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7659c640 1 -- 172.21.15.113:0/229297673 learned_addr learned my addr 172.21.15.113:0/229297673 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7659c640 1 -- 172.21.15.113:0/229297673 >> v2:172.21.15.151:3300/0 conn(0x7f8c7815aa70 msgr2=0x7f8c7815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7659c640 1 --2- 172.21.15.113:0/229297673 >> v2:172.21.15.151:3300/0 conn(0x7f8c7815aa70 0x7f8c7815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7659c640 1 -- 172.21.15.113:0/229297673 >> v1:172.21.15.151:6789/0 conn(0x7f8c7815b1e0 legacy=0x7f8c7815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.067+0000 7f8c7659c640 1 -- 172.21.15.113:0/229297673 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780b1f10 con 0x7f8c78159f80 2023-12-19T13:47:10.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.068+0000 7f8c7659c640 1 --2- 172.21.15.113:0/229297673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c78159f80 0x7f8c7806f160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c780ae020 tx=0x7f8c6802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69e6f2cbcb2a076 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c75d9b640 1 -- 172.21.15.113:0/229297673 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68030860 con 0x7f8c78159f80 2023-12-19T13:47:10.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c75d9b640 1 -- 172.21.15.113:0/229297673 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c680309c0 con 0x7f8c78159f80 2023-12-19T13:47:10.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c75d9b640 1 -- 172.21.15.113:0/229297673 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68030d50 con 0x7f8c78159f80 2023-12-19T13:47:10.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 -- 172.21.15.113:0/229297673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c78159f80 msgr2=0x7f8c7806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 --2- 172.21.15.113:0/229297673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c78159f80 0x7f8c7806f160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c780ae020 tx=0x7f8c6802b9a0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 -- 172.21.15.113:0/229297673 shutdown_connections 2023-12-19T13:47:10.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 --2- 172.21.15.113:0/229297673 >> v2:172.21.15.151:3300/0 conn(0x7f8c7815aa70 0x7f8c7815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 --2- 172.21.15.113:0/229297673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c78159f80 0x7f8c7806f160 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 -- 172.21.15.113:0/229297673 >> 172.21.15.113:0/229297673 conn(0x7f8c780b0100 msgr2=0x7f8c780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:10.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 -- 172.21.15.113:0/229297673 shutdown_connections 2023-12-19T13:47:10.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.069+0000 7f8c7759e640 1 -- 172.21.15.113:0/229297673 wait complete. 2023-12-19T13:47:10.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.071+0000 7f8c7759e640 1 Processor -- start 2023-12-19T13:47:10.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.071+0000 7f8c7759e640 1 -- start start 2023-12-19T13:47:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.072+0000 7f8c7759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c78159f80 0x7f8c78143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.072+0000 7f8c7759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7815aa70 0x7f8c781661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.072+0000 7f8c7759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c7815b1e0 0x7f8c781f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.072+0000 7f8c7759e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78167d20 con 0x7f8c7815b1e0 2023-12-19T13:47:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.072+0000 7f8c7759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78147c40 con 0x7f8c78159f80 2023-12-19T13:47:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.072+0000 7f8c7759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78147f20 con 0x7f8c7815aa70 2023-12-19T13:47:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c7815b1e0 0x7f8c781f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c7815b1e0 0x7f8c781f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42594/0 (socket says 172.21.15.113:42594) 2023-12-19T13:47:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 -- 172.21.15.113:0/2856434690 learned_addr learned my addr 172.21.15.113:0/2856434690 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 -- 172.21.15.113:0/2856434690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7815aa70 msgr2=0x7f8c781661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7815aa70 0x7f8c781661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 -- 172.21.15.113:0/2856434690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c78159f80 msgr2=0x7f8c78143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c78159f80 0x7f8c78143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 -- 172.21.15.113:0/2856434690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680094d0 con 0x7f8c7815b1e0 2023-12-19T13:47:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c76d9d640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c7815b1e0 0x7f8c781f6170 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000b970 tx=0x7f8c7000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c6effd640 1 -- 172.21.15.113:0/2856434690 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7000cb40 con 0x7f8c7815b1e0 2023-12-19T13:47:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c6effd640 1 -- 172.21.15.113:0/2856434690 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7000ccc0 con 0x7f8c7815b1e0 2023-12-19T13:47:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.073+0000 7f8c6effd640 1 -- 172.21.15.113:0/2856434690 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70014680 con 0x7f8c7815b1e0 2023-12-19T13:47:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.074+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c78148200 con 0x7f8c7815b1e0 2023-12-19T13:47:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.074+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c781668d0 con 0x7f8c7815b1e0 2023-12-19T13:47:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.075+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78061910 con 0x7f8c7815b1e0 2023-12-19T13:47:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.076+0000 7f8c6effd640 1 -- 172.21.15.113:0/2856434690 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8c7001d3b0 con 0x7f8c7815b1e0 2023-12-19T13:47:10.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.077+0000 7f8c6effd640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8c5806a430 0x7f8c5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.077+0000 7f8c6effd640 1 -- 172.21.15.113:0/2856434690 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c70088700 con 0x7f8c7815b1e0 2023-12-19T13:47:10.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.077+0000 7f8c7659c640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8c5806a430 0x7f8c5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.078+0000 7f8c7659c640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8c5806a430 0x7f8c5806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c68036000 tx=0x7f8c6803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.081+0000 7f8c6effd640 1 -- 172.21.15.113:0/2856434690 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8c70053ce0 con 0x7f8c7815b1e0 2023-12-19T13:47:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.271+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c781668d0 con 0x7f8c7815b1e0 2023-12-19T13:47:10.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.273+0000 7f8c6effd640 1 -- 172.21.15.113:0/2856434690 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f8c781668d0 con 0x7f8c7815b1e0 2023-12-19T13:47:10.273 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:10.273 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8c5806a430 msgr2=0x7f8c5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8c5806a430 0x7f8c5806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c68036000 tx=0x7f8c6803b040 comp rx=0 tx=0).stop 2023-12-19T13:47:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c7815b1e0 msgr2=0x7f8c781f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c7815b1e0 0x7f8c781f6170 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000b970 tx=0x7f8c7000be30 comp rx=0 tx=0).stop 2023-12-19T13:47:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 shutdown_connections 2023-12-19T13:47:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8c5806a430 0x7f8c5806c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c7815b1e0 0x7f8c781f6170 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7815aa70 0x7f8c781661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 --2- 172.21.15.113:0/2856434690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c78159f80 0x7f8c78143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 >> 172.21.15.113:0/2856434690 conn(0x7f8c780b0100 msgr2=0x7f8c780cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 shutdown_connections 2023-12-19T13:47:10.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.276+0000 7f8c7759e640 1 -- 172.21.15.113:0/2856434690 wait complete. 2023-12-19T13:47:10.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:10.296 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:10.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.518+0000 7f7646429640 1 Processor -- start 2023-12-19T13:47:10.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.518+0000 7f7646429640 1 -- start start 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7646429640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f764006f490 0x7f764006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7646429640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f76400d1670 0x7f76400d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7646429640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764006fe30 con 0x7f7640146cd0 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7646429640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76401470b0 con 0x7f76400d1670 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7646429640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7640070260 con 0x7f764006f490 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7645c28640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f76400d1670 0x7f76400d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7645c28640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f76400d1670 0x7f76400d1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42606/0 (socket says 172.21.15.113:42606) 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.520+0000 7f7645c28640 1 -- 172.21.15.113:0/2926998326 learned_addr learned my addr 172.21.15.113:0/2926998326 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.521+0000 7f7645c28640 1 -- 172.21.15.113:0/2926998326 >> v2:172.21.15.151:3300/0 conn(0x7f764006f490 msgr2=0x7f764006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.521+0000 7f7645c28640 1 --2- 172.21.15.113:0/2926998326 >> v2:172.21.15.151:3300/0 conn(0x7f764006f490 0x7f764006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.521+0000 7f7645c28640 1 -- 172.21.15.113:0/2926998326 >> v1:172.21.15.151:6789/0 conn(0x7f7640146cd0 legacy=0x7f76400b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.521+0000 7f7645c28640 1 -- 172.21.15.113:0/2926998326 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400b6ea0 con 0x7f76400d1670 2023-12-19T13:47:10.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.522+0000 7f7645c28640 1 --2- 172.21.15.113:0/2926998326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76400d1670 0x7f76400d1b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76400724b0 tx=0x7f763802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e232ceb3627912e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.522+0000 7f763ffff640 1 -- 172.21.15.113:0/2926998326 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380317e0 con 0x7f76400d1670 2023-12-19T13:47:10.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.522+0000 7f763ffff640 1 -- 172.21.15.113:0/2926998326 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7638031940 con 0x7f76400d1670 2023-12-19T13:47:10.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.522+0000 7f763ffff640 1 -- 172.21.15.113:0/2926998326 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638031cd0 con 0x7f76400d1670 2023-12-19T13:47:10.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 -- 172.21.15.113:0/2926998326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76400d1670 msgr2=0x7f76400d1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 --2- 172.21.15.113:0/2926998326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76400d1670 0x7f76400d1b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76400724b0 tx=0x7f763802b880 comp rx=0 tx=0).stop 2023-12-19T13:47:10.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 -- 172.21.15.113:0/2926998326 shutdown_connections 2023-12-19T13:47:10.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 --2- 172.21.15.113:0/2926998326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76400d1670 0x7f76400d1b00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 --2- 172.21.15.113:0/2926998326 >> v2:172.21.15.151:3300/0 conn(0x7f764006f490 0x7f764006f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 -- 172.21.15.113:0/2926998326 >> 172.21.15.113:0/2926998326 conn(0x7f76400d3200 msgr2=0x7f76400d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:10.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 -- 172.21.15.113:0/2926998326 shutdown_connections 2023-12-19T13:47:10.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.523+0000 7f7646429640 1 -- 172.21.15.113:0/2926998326 wait complete. 2023-12-19T13:47:10.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.525+0000 7f7646429640 1 Processor -- start 2023-12-19T13:47:10.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.525+0000 7f7646429640 1 -- start start 2023-12-19T13:47:10.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7646429640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f764006f490 0x7f76401f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7646429640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76400d1670 0x7f76400ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7646429640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7640146cd0 0x7f764015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7646429640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400c9120 con 0x7f7640146cd0 2023-12-19T13:47:10.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7646429640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401f38f0 con 0x7f764006f490 2023-12-19T13:47:10.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7646429640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400c9520 con 0x7f76400d1670 2023-12-19T13:47:10.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7645c28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7640146cd0 0x7f764015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7645c28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7640146cd0 0x7f764015ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42618/0 (socket says 172.21.15.113:42618) 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.526+0000 7f7645c28640 1 -- 172.21.15.113:0/1839234827 learned_addr learned my addr 172.21.15.113:0/1839234827 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f7645c28640 1 -- 172.21.15.113:0/1839234827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76400d1670 msgr2=0x7f76400ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f7645c28640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76400d1670 0x7f76400ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f7645c28640 1 -- 172.21.15.113:0/1839234827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f764006f490 msgr2=0x7f76401f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f7645c28640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f764006f490 0x7f76401f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f7645c28640 1 -- 172.21.15.113:0/1839234827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380094d0 con 0x7f7640146cd0 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f7645c28640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7640146cd0 0x7f764015ba20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76380090b0 tx=0x7f76380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f763dffb640 1 -- 172.21.15.113:0/1839234827 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638032940 con 0x7f7640146cd0 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f763dffb640 1 -- 172.21.15.113:0/1839234827 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7638032ac0 con 0x7f7640146cd0 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f763dffb640 1 -- 172.21.15.113:0/1839234827 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638032e70 con 0x7f7640146cd0 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.527+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76400c81c0 con 0x7f7640146cd0 2023-12-19T13:47:10.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.528+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76400c8780 con 0x7f7640146cd0 2023-12-19T13:47:10.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.529+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7640061910 con 0x7f7640146cd0 2023-12-19T13:47:10.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.530+0000 7f763dffb640 1 -- 172.21.15.113:0/1839234827 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f763804d3f0 con 0x7f7640146cd0 2023-12-19T13:47:10.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.530+0000 7f763dffb640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f762406a430 0x7f762406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.531+0000 7f763dffb640 1 -- 172.21.15.113:0/1839234827 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76380aa740 con 0x7f7640146cd0 2023-12-19T13:47:10.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.531+0000 7f7645427640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f762406a430 0x7f762406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.531+0000 7f7645427640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f762406a430 0x7f762406c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7640142530 tx=0x7f7634009220 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.535+0000 7f763dffb640 1 -- 172.21.15.113:0/1839234827 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7638075dc0 con 0x7f7640146cd0 2023-12-19T13:47:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.724+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76400d2fe0 con 0x7f7640146cd0 2023-12-19T13:47:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.725+0000 7f763dffb640 1 -- 172.21.15.113:0/1839234827 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76380793e0 con 0x7f7640146cd0 2023-12-19T13:47:10.725 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.727+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f762406a430 msgr2=0x7f762406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.727+0000 7f7646429640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f762406a430 0x7f762406c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7640142530 tx=0x7f7634009220 comp rx=0 tx=0).stop 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7640146cd0 msgr2=0x7f764015ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7640146cd0 0x7f764015ba20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76380090b0 tx=0x7f76380046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 shutdown_connections 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f762406a430 0x7f762406c8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7640146cd0 0x7f764015ba20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76400d1670 0x7f76400ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 --2- 172.21.15.113:0/1839234827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f764006f490 0x7f76401f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 >> 172.21.15.113:0/1839234827 conn(0x7f76400d3200 msgr2=0x7f76400b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:10.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 shutdown_connections 2023-12-19T13:47:10.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.728+0000 7f7646429640 1 -- 172.21.15.113:0/1839234827 wait complete. 2023-12-19T13:47:10.746 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.971+0000 7fc17f03f640 1 Processor -- start 2023-12-19T13:47:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.971+0000 7fc17f03f640 1 -- start start 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17f03f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc1780b6130 0x7fc1780b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17f03f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc178140740 con 0x7fc1780b5cd0 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17f03f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc178143990 con 0x7fc178140360 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17f03f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc178142e10 con 0x7fc1780b6130 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17d83c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc1780b5cd0 0x7fc1780b4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54974/0 (socket says 172.21.15.113:54974) 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17d83c640 1 -- 172.21.15.113:0/255207361 learned_addr learned my addr 172.21.15.113:0/255207361 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905080930 0 0) 0x7fc178140740 con 0x7fc1780b5cd0 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.973+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc164003520 con 0x7fc1780b5cd0 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17e83e640 1 --2- 172.21.15.113:0/255207361 >> v2:172.21.15.151:3300/0 conn(0x7fc1780b6130 0x7fc1780b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805947897 0 0) 0x7fc164003520 con 0x7fc1780b5cd0 2023-12-19T13:47:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 >> v2:172.21.15.151:3300/0 conn(0x7fc1780b6130 msgr2=0x7fc1780b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 --2- 172.21.15.113:0/255207361 >> v2:172.21.15.151:3300/0 conn(0x7fc1780b6130 0x7fc1780b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 >> v1:172.21.15.151:6789/0 conn(0x7fc178140360 legacy=0x7fc1780b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1781430f0 con 0x7fc1780b5cd0 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc168001670 con 0x7fc1780b5cd0 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17e83e640 1 --2- 172.21.15.113:0/255207361 >> v2:172.21.15.151:3300/0 conn(0x7fc1780b6130 0x7fc1780b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 >> v1:172.21.15.113:6789/0 conn(0x7fc1780b5cd0 legacy=0x7fc1780b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164003a10 0x7fc164003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1640047c0 0x7fc164004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc164005380 0x7fc16400b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc178142e10 con 0x7fc164005380 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16400c2c0 con 0x7fc1640047c0 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16400c480 con 0x7fc164003a10 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.974+0000 7fc17e83e640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc164005380 0x7fc16400b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17d83c640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1640047c0 0x7fc164004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17e03d640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164003a10 0x7fc164003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17e83e640 1 -- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164003a10 msgr2=0x7fc164003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17e83e640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164003a10 0x7fc164003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17e83e640 1 -- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1640047c0 msgr2=0x7fc164004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17e83e640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1640047c0 0x7fc164004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17e83e640 1 -- 172.21.15.113:0/255207361 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164003520 con 0x7fc164005380 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17d83c640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1640047c0 0x7fc164004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.975+0000 7fc17e03d640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164003a10 0x7fc164003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:10.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.976+0000 7fc17e83e640 1 -- 172.21.15.113:0/255207361 reap_dead start 2023-12-19T13:47:10.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.976+0000 7fc17e83e640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc164005380 0x7fc16400b9e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc17000c490 tx=0x7fc1640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89384ffd7b63c85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.976+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170037070 con 0x7fc164005380 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.976+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc170033460 con 0x7fc164005380 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.976+0000 7fc17d03b640 1 -- 172.21.15.113:0/255207361 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170033830 con 0x7fc164005380 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.977+0000 7fc17f03f640 1 -- 172.21.15.113:0/255207361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc164005380 msgr2=0x7fc16400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.977+0000 7fc17f03f640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc164005380 0x7fc16400b9e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc17000c490 tx=0x7fc1640057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.977+0000 7fc17f03f640 1 -- 172.21.15.113:0/255207361 shutdown_connections 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.977+0000 7fc17f03f640 1 --2- 172.21.15.113:0/255207361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc164005380 0x7fc16400b9e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.977+0000 7fc17f03f640 1 -- 172.21.15.113:0/255207361 >> 172.21.15.113:0/255207361 conn(0x7fc178065dc0 msgr2=0x7fc1780b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.977+0000 7fc17f03f640 1 -- 172.21.15.113:0/255207361 shutdown_connections 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.977+0000 7fc17f03f640 1 -- 172.21.15.113:0/255207361 wait complete. 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.979+0000 7fc17f03f640 1 Processor -- start 2023-12-19T13:47:10.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.979+0000 7fc17f03f640 1 -- start start 2023-12-19T13:47:10.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17f03f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164005380 0x7fc1780d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17f03f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1781438f0 0x7fc1781387e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17f03f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc17813b420 0x7fc17813b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17f03f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17813bde0 con 0x7fc1781438f0 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17f03f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc178138d20 con 0x7fc17813b420 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17f03f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc178143d70 con 0x7fc164005380 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17d83c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1781438f0 0x7fc1781387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17d83c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1781438f0 0x7fc1781387e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42640/0 (socket says 172.21.15.113:42640) 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.980+0000 7fc17d83c640 1 -- 172.21.15.113:0/1029383053 learned_addr learned my addr 172.21.15.113:0/1029383053 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17e83e640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc17813b420 0x7fc17813b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17e03d640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164005380 0x7fc1780d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17d83c640 1 -- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164005380 msgr2=0x7fc1780d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17d83c640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164005380 0x7fc1780d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17d83c640 1 -- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc17813b420 msgr2=0x7fc17813b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17d83c640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc17813b420 0x7fc17813b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17d83c640 1 -- 172.21.15.113:0/1029383053 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1781612f0 con 0x7fc1781438f0 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17e03d640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164005380 0x7fc1780d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17d83c640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1781438f0 0x7fc1781387e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc16800d770 tx=0x7fc16800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc16effd640 1 -- 172.21.15.113:0/1029383053 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680074e0 con 0x7fc1781438f0 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc16effd640 1 -- 172.21.15.113:0/1029383053 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168007640 con 0x7fc1781438f0 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc178161590 con 0x7fc1781438f0 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.981+0000 7fc16effd640 1 -- 172.21.15.113:0/1029383053 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680049e0 con 0x7fc1781438f0 2023-12-19T13:47:10.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.982+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17813e400 con 0x7fc1781438f0 2023-12-19T13:47:10.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.983+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc178061910 con 0x7fc1781438f0 2023-12-19T13:47:10.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.984+0000 7fc16effd640 1 -- 172.21.15.113:0/1029383053 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc168004b40 con 0x7fc1781438f0 2023-12-19T13:47:10.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.985+0000 7fc16effd640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc15c06a430 0x7fc15c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:10.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.985+0000 7fc16effd640 1 -- 172.21.15.113:0/1029383053 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc168088500 con 0x7fc1781438f0 2023-12-19T13:47:10.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.985+0000 7fc17e03d640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc15c06a430 0x7fc15c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:10.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.986+0000 7fc17e03d640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc15c06a430 0x7fc15c06c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc174003dc0 tx=0x7fc174009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:10.989+0000 7fc16effd640 1 -- 172.21.15.113:0/1029383053 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc168053af0 con 0x7fc1781438f0 2023-12-19T13:47:11.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.179+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1780d26a0 con 0x7fc1781438f0 2023-12-19T13:47:11.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.180+0000 7fc16effd640 1 -- 172.21.15.113:0/1029383053 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc168057110 con 0x7fc1781438f0 2023-12-19T13:47:11.179 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc15c06a430 msgr2=0x7fc15c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc15c06a430 0x7fc15c06c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc174003dc0 tx=0x7fc174009040 comp rx=0 tx=0).stop 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1781438f0 msgr2=0x7fc1781387e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1781438f0 0x7fc1781387e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc16800d770 tx=0x7fc16800dc30 comp rx=0 tx=0).stop 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 shutdown_connections 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc15c06a430 0x7fc15c06c8f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc17813b420 0x7fc17813b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1781438f0 0x7fc1781387e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 --2- 172.21.15.113:0/1029383053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc164005380 0x7fc1780d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 >> 172.21.15.113:0/1029383053 conn(0x7fc178065dc0 msgr2=0x7fc1780b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:11.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 shutdown_connections 2023-12-19T13:47:11.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.182+0000 7fc17f03f640 1 -- 172.21.15.113:0/1029383053 wait complete. 2023-12-19T13:47:11.199 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:11.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.402+0000 7f19f9877640 1 Processor -- start 2023-12-19T13:47:11.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.402+0000 7f19f9877640 1 -- start start 2023-12-19T13:47:11.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.404+0000 7f19f9877640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f19f406fc40 0x7f19f40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.404+0000 7f19f9877640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f4161e70 con 0x7f19f40b6430 2023-12-19T13:47:11.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.404+0000 7f19f9877640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f4161260 con 0x7f19f4146ff0 2023-12-19T13:47:11.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.404+0000 7f19f9877640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f4161080 con 0x7f19f406fc40 2023-12-19T13:47:11.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.404+0000 7f19f27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f19f406fc40 0x7f19f40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.404+0000 7f19f37fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f19f40b6430 0x7f19f415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54978/0 (socket says 172.21.15.113:54978) 2023-12-19T13:47:11.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.404+0000 7f19f37fe640 1 -- 172.21.15.113:0/1051636046 learned_addr learned my addr 172.21.15.113:0/1051636046 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:11.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.405+0000 7f19f27fc640 1 -- 172.21.15.113:0/1051636046 >> v1:172.21.15.151:6789/0 conn(0x7f19f4146ff0 legacy=0x7f19f406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.405+0000 7f19f27fc640 1 -- 172.21.15.113:0/1051636046 >> v1:172.21.15.113:6789/0 conn(0x7f19f40b6430 legacy=0x7f19f415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.405+0000 7f19f27fc640 1 -- 172.21.15.113:0/1051636046 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4161540 con 0x7f19f406fc40 2023-12-19T13:47:11.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.405+0000 7f19f1ffb640 1 -- 172.21.15.113:0/1051636046 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138706244 0 0) 0x7f19f4161e70 con 0x7f19f40b6430 2023-12-19T13:47:11.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.406+0000 7f19f27fc640 1 --2- 172.21.15.113:0/1051636046 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f406fc40 0x7f19f40d10f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f19e80097a0 tx=0x7f19e802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b8f310a1dba25 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:11.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.406+0000 7f19f1ffb640 1 -- 172.21.15.113:0/1051636046 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8030610 con 0x7f19f406fc40 2023-12-19T13:47:11.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.406+0000 7f19f1ffb640 1 -- 172.21.15.113:0/1051636046 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8030770 con 0x7f19f406fc40 2023-12-19T13:47:11.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.406+0000 7f19f1ffb640 1 -- 172.21.15.113:0/1051636046 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8030b00 con 0x7f19f406fc40 2023-12-19T13:47:11.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.407+0000 7f19f9877640 1 -- 172.21.15.113:0/1051636046 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f406fc40 msgr2=0x7f19f40d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.407+0000 7f19f9877640 1 --2- 172.21.15.113:0/1051636046 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f406fc40 0x7f19f40d10f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f19e80097a0 tx=0x7f19e802b960 comp rx=0 tx=0).stop 2023-12-19T13:47:11.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.407+0000 7f19f9877640 1 -- 172.21.15.113:0/1051636046 shutdown_connections 2023-12-19T13:47:11.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.407+0000 7f19f9877640 1 --2- 172.21.15.113:0/1051636046 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f406fc40 0x7f19f40d10f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.407+0000 7f19f9877640 1 -- 172.21.15.113:0/1051636046 >> 172.21.15.113:0/1051636046 conn(0x7f19f40d3520 msgr2=0x7f19f40d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:11.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.407+0000 7f19f9877640 1 -- 172.21.15.113:0/1051636046 shutdown_connections 2023-12-19T13:47:11.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.407+0000 7f19f9877640 1 -- 172.21.15.113:0/1051636046 wait complete. 2023-12-19T13:47:11.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.409+0000 7f19f9877640 1 Processor -- start 2023-12-19T13:47:11.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.409+0000 7f19f9877640 1 -- start start 2023-12-19T13:47:11.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f9877640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f406fc40 0x7f19f4152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f9877640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f40b6430 0x7f19f4142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f9877640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19f4146ff0 0x7f19f40c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f9877640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f41417d0 con 0x7f19f40b6430 2023-12-19T13:47:11.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f9877640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4143860 con 0x7f19f406fc40 2023-12-19T13:47:11.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f9877640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4142c50 con 0x7f19f4146ff0 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f27fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f40b6430 0x7f19f4142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f27fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f40b6430 0x7f19f4142340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42656/0 (socket says 172.21.15.113:42656) 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.410+0000 7f19f27fc640 1 -- 172.21.15.113:0/3130407701 learned_addr learned my addr 172.21.15.113:0/3130407701 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f27fc640 1 -- 172.21.15.113:0/3130407701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19f4146ff0 msgr2=0x7f19f40c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f27fc640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19f4146ff0 0x7f19f40c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f27fc640 1 -- 172.21.15.113:0/3130407701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f406fc40 msgr2=0x7f19f4152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f27fc640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f406fc40 0x7f19f4152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f27fc640 1 -- 172.21.15.113:0/3130407701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009400 con 0x7f19f40b6430 2023-12-19T13:47:11.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f27fc640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f40b6430 0x7f19f4142340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098c0 tx=0x7f19e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:11.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19dbfff640 1 -- 172.21.15.113:0/3130407701 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e803e040 con 0x7f19f40b6430 2023-12-19T13:47:11.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19dbfff640 1 -- 172.21.15.113:0/3130407701 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8039cb0 con 0x7f19f40b6430 2023-12-19T13:47:11.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f4142f30 con 0x7f19f40b6430 2023-12-19T13:47:11.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19dbfff640 1 -- 172.21.15.113:0/3130407701 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8044630 con 0x7f19f40b6430 2023-12-19T13:47:11.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.411+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f41434f0 con 0x7f19f40b6430 2023-12-19T13:47:11.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.413+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f41439d0 con 0x7f19f40b6430 2023-12-19T13:47:11.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.413+0000 7f19dbfff640 1 -- 172.21.15.113:0/3130407701 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f19e804d3b0 con 0x7f19f40b6430 2023-12-19T13:47:11.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.414+0000 7f19dbfff640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f19e006a430 0x7f19e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.414+0000 7f19dbfff640 1 -- 172.21.15.113:0/3130407701 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e80aaf00 con 0x7f19f40b6430 2023-12-19T13:47:11.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.415+0000 7f19f2ffd640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f19e006a430 0x7f19e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.415+0000 7f19f2ffd640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f19e006a430 0x7f19e006c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f19e4000f60 tx=0x7f19e40079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:11.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.419+0000 7f19dbfff640 1 -- 172.21.15.113:0/3130407701 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f19e80764f0 con 0x7f19f40b6430 2023-12-19T13:47:11.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.607+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19f4061910 con 0x7f19f40b6430 2023-12-19T13:47:11.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.607+0000 7f19dbfff640 1 -- 172.21.15.113:0/3130407701 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19e8079b10 con 0x7f19f40b6430 2023-12-19T13:47:11.607 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:11.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f19e006a430 msgr2=0x7f19e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f19e006a430 0x7f19e006c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f19e4000f60 tx=0x7f19e40079b0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f40b6430 msgr2=0x7f19f4142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f40b6430 0x7f19f4142340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098c0 tx=0x7f19e8004730 comp rx=0 tx=0).stop 2023-12-19T13:47:11.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 shutdown_connections 2023-12-19T13:47:11.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f19e006a430 0x7f19e006c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19f4146ff0 0x7f19f40c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f40b6430 0x7f19f4142340 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 --2- 172.21.15.113:0/3130407701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f406fc40 0x7f19f4152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 >> 172.21.15.113:0/3130407701 conn(0x7f19f40d3520 msgr2=0x7f19f41600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:11.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 shutdown_connections 2023-12-19T13:47:11.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.610+0000 7f19f9877640 1 -- 172.21.15.113:0/3130407701 wait complete. 2023-12-19T13:47:11.629 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:11.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.837+0000 7f2d8bfff640 1 Processor -- start 2023-12-19T13:47:11.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.837+0000 7f2d8bfff640 1 -- start start 2023-12-19T13:47:11.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.838+0000 7f2d8bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2d8c15b1e0 0x7f2d8c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d8bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c06b520 con 0x7f2d8c15a8a0 2023-12-19T13:47:11.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d8bfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c0b2b20 con 0x7f2d8c159f80 2023-12-19T13:47:11.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d8bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c0b2fb0 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d827fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2d8c15b1e0 0x7f2d8c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d8b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2d8c15a8a0 0x7f2d8c15b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54986/0 (socket says 172.21.15.113:54986) 2023-12-19T13:47:11.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d8b7fe640 1 -- 172.21.15.113:0/751999984 learned_addr learned my addr 172.21.15.113:0/751999984 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:11.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d827fc640 1 -- 172.21.15.113:0/751999984 >> v1:172.21.15.151:6789/0 conn(0x7f2d8c159f80 legacy=0x7f2d8c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:11.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d827fc640 1 -- 172.21.15.113:0/751999984 >> v1:172.21.15.113:6789/0 conn(0x7f2d8c15a8a0 legacy=0x7f2d8c15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d827fc640 1 -- 172.21.15.113:0/751999984 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0b1f10 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.839+0000 7f2d8a7fc640 1 -- 172.21.15.113:0/751999984 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216792303 0 0) 0x7f2d8c06b520 con 0x7f2d8c15a8a0 2023-12-19T13:47:11.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.840+0000 7f2d827fc640 1 --2- 172.21.15.113:0/751999984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c15a360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097a0 tx=0x7f2d7402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4688f1ae7aefd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:11.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8a7fc640 1 -- 172.21.15.113:0/751999984 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74030610 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8a7fc640 1 -- 172.21.15.113:0/751999984 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74030770 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8a7fc640 1 -- 172.21.15.113:0/751999984 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74030b00 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8bfff640 1 -- 172.21.15.113:0/751999984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 msgr2=0x7f2d8c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/751999984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c15a360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097a0 tx=0x7f2d7402b960 comp rx=0 tx=0).stop 2023-12-19T13:47:11.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8bfff640 1 -- 172.21.15.113:0/751999984 shutdown_connections 2023-12-19T13:47:11.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/751999984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c15a360 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8bfff640 1 -- 172.21.15.113:0/751999984 >> 172.21.15.113:0/751999984 conn(0x7f2d8c0b0100 msgr2=0x7f2d8c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:11.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.841+0000 7f2d8bfff640 1 -- 172.21.15.113:0/751999984 shutdown_connections 2023-12-19T13:47:11.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.842+0000 7f2d8bfff640 1 -- 172.21.15.113:0/751999984 wait complete. 2023-12-19T13:47:11.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.843+0000 7f2d8bfff640 1 Processor -- start 2023-12-19T13:47:11.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.843+0000 7f2d8bfff640 1 -- start start 2023-12-19T13:47:11.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.844+0000 7f2d8bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d8c159f80 0x7f2d8c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.844+0000 7f2d8bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d8c15a8a0 0x7f2d8c14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.844+0000 7f2d8bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.844+0000 7f2d8bfff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c156910 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.844+0000 7f2d8bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c1e7920 con 0x7f2d8c15a8a0 2023-12-19T13:47:11.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.844+0000 7f2d8bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c1e7c00 con 0x7f2d8c159f80 2023-12-19T13:47:11.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c06d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42674/0 (socket says 172.21.15.113:42674) 2023-12-19T13:47:11.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 -- 172.21.15.113:0/3055768783 learned_addr learned my addr 172.21.15.113:0/3055768783 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8affd640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d8c159f80 0x7f2d8c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d827fc640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d8c15a8a0 0x7f2d8c14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 -- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d8c159f80 msgr2=0x7f2d8c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d8c159f80 0x7f2d8c1563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 -- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d8c15a8a0 msgr2=0x7f2d8c14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d8c15a8a0 0x7f2d8c14ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 -- 172.21.15.113:0/3055768783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009400 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8affd640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d8c159f80 0x7f2d8c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.845+0000 7f2d8b7fe640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c06d7f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c7e0 tx=0x7f2d8400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.846+0000 7f2d88ff9640 1 -- 172.21.15.113:0/3055768783 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400a640 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.846+0000 7f2d88ff9640 1 -- 172.21.15.113:0/3055768783 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400a7c0 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.846+0000 7f2d88ff9640 1 -- 172.21.15.113:0/3055768783 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400ab70 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.846+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c1e7ee0 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.846+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c1e5040 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.847+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c061910 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.848+0000 7f2d88ff9640 1 -- 172.21.15.113:0/3055768783 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d8400acd0 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.848+0000 7f2d88ff9640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d6c06a430 0x7f2d6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.849+0000 7f2d88ff9640 1 -- 172.21.15.113:0/3055768783 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d84087e20 con 0x7f2d8c15b1e0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.849+0000 7f2d8affd640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d6c06a430 0x7f2d6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.849+0000 7f2d8affd640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d6c06a430 0x7f2d6c06c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c1553e0 tx=0x7f2d7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:11.853+0000 7f2d88ff9640 1 -- 172.21.15.113:0/3055768783 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d84053400 con 0x7f2d8c15b1e0 2023-12-19T13:47:12.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.042+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d8c1e5230 con 0x7f2d8c15b1e0 2023-12-19T13:47:12.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.044+0000 7f2d88ff9640 1 -- 172.21.15.113:0/3055768783 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f2d84018090 con 0x7f2d8c15b1e0 2023-12-19T13:47:12.044 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:12.044 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d6c06a430 msgr2=0x7f2d6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d6c06a430 0x7f2d6c06c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c1553e0 tx=0x7f2d7c009040 comp rx=0 tx=0).stop 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 msgr2=0x7f2d8c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c06d7f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c7e0 tx=0x7f2d8400cca0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 shutdown_connections 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d6c06a430 0x7f2d6c06c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d8c15b1e0 0x7f2d8c06d7f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d8c15a8a0 0x7f2d8c14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 --2- 172.21.15.113:0/3055768783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d8c159f80 0x7f2d8c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 >> 172.21.15.113:0/3055768783 conn(0x7f2d8c0b0100 msgr2=0x7f2d8c155980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:12.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 shutdown_connections 2023-12-19T13:47:12.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.047+0000 7f2d8bfff640 1 -- 172.21.15.113:0/3055768783 wait complete. 2023-12-19T13:47:12.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:12.066 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:12.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.280+0000 7faea1c79640 1 Processor -- start 2023-12-19T13:47:12.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.280+0000 7faea1c79640 1 -- start start 2023-12-19T13:47:12.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea1c79640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fae9c0b0470 0x7fae9c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea1c79640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fae9c14b0b0 0x7fae9c0b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea1c79640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0b21d0 con 0x7fae9c14acd0 2023-12-19T13:47:12.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea1c79640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c0b2410 con 0x7fae9c14b0b0 2023-12-19T13:47:12.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea1c79640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c0b26f0 con 0x7fae9c0b0470 2023-12-19T13:47:12.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea0c77640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fae9c14acd0 0x7fae9c0afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54998/0 (socket says 172.21.15.113:54998) 2023-12-19T13:47:12.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea0c77640 1 -- 172.21.15.113:0/2373170700 learned_addr learned my addr 172.21.15.113:0/2373170700 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:12.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7faea1478640 1 --2- 172.21.15.113:0/2373170700 >> v2:172.21.15.113:3300/0 conn(0x7fae9c14b0b0 0x7fae9c0b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7fae9bfff640 1 --2- 172.21.15.113:0/2373170700 >> v2:172.21.15.151:3300/0 conn(0x7fae9c0b0470 0x7fae9c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7fae9b7fe640 1 -- 172.21.15.113:0/2373170700 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032211803 0 0) 0x7fae90001110 con 0x7fae9c14acd0 2023-12-19T13:47:12.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.282+0000 7fae9b7fe640 1 -- 172.21.15.113:0/2373170700 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae84003520 con 0x7fae9c14acd0 2023-12-19T13:47:12.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.283+0000 7faea1478640 1 -- 172.21.15.113:0/2373170700 >> v2:172.21.15.151:3300/0 conn(0x7fae9c0b0470 msgr2=0x7fae9c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:12.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.283+0000 7faea1478640 1 --2- 172.21.15.113:0/2373170700 >> v2:172.21.15.151:3300/0 conn(0x7fae9c0b0470 0x7fae9c0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.283+0000 7faea1478640 1 -- 172.21.15.113:0/2373170700 >> v1:172.21.15.113:6789/0 conn(0x7fae9c14acd0 legacy=0x7fae9c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.283+0000 7faea1478640 1 -- 172.21.15.113:0/2373170700 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0ce030 con 0x7fae9c14b0b0 2023-12-19T13:47:12.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.284+0000 7faea1478640 1 --2- 172.21.15.113:0/2373170700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c0b1c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae9c067480 tx=0x7fae9402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5881d0dc039a982 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:12.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.284+0000 7fae9b7fe640 1 -- 172.21.15.113:0/2373170700 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9402cc80 con 0x7fae9c14b0b0 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.284+0000 7fae9b7fe640 1 -- 172.21.15.113:0/2373170700 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9402cde0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.284+0000 7fae9b7fe640 1 -- 172.21.15.113:0/2373170700 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94034660 con 0x7fae9c14b0b0 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.284+0000 7faea1c79640 1 -- 172.21.15.113:0/2373170700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 msgr2=0x7fae9c0b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.284+0000 7faea1c79640 1 --2- 172.21.15.113:0/2373170700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c0b1c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae9c067480 tx=0x7fae9402bed0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.285+0000 7faea1c79640 1 -- 172.21.15.113:0/2373170700 shutdown_connections 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.285+0000 7faea1c79640 1 --2- 172.21.15.113:0/2373170700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c0b1c90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.285+0000 7faea1c79640 1 --2- 172.21.15.113:0/2373170700 >> v2:172.21.15.151:3300/0 conn(0x7fae9c0b0470 0x7fae9c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.285+0000 7faea1c79640 1 -- 172.21.15.113:0/2373170700 >> 172.21.15.113:0/2373170700 conn(0x7fae9c06f630 msgr2=0x7fae9c06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.285+0000 7faea1c79640 1 -- 172.21.15.113:0/2373170700 shutdown_connections 2023-12-19T13:47:12.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.285+0000 7faea1c79640 1 -- 172.21.15.113:0/2373170700 wait complete. 2023-12-19T13:47:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.286+0000 7faea1c79640 1 Processor -- start 2023-12-19T13:47:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.287+0000 7faea1c79640 1 -- start start 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.287+0000 7faea1c79640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae9c0b0470 0x7fae9c1488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.287+0000 7faea1c79640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae9c14acd0 0x7fae9c1fa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.287+0000 7faea1c79640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1c79640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c1f8060 con 0x7fae9c14b0b0 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1c79640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c1faf50 con 0x7fae9c14acd0 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1c79640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c1fb230 con 0x7fae9c0b0470 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c142d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42694/0 (socket says 172.21.15.113:42694) 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 -- 172.21.15.113:0/2331424218 learned_addr learned my addr 172.21.15.113:0/2331424218 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7fae9bfff640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae9c14acd0 0x7fae9c1fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea0c77640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae9c0b0470 0x7fae9c1488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 -- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae9c0b0470 msgr2=0x7fae9c1488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae9c0b0470 0x7fae9c1488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 -- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae9c14acd0 msgr2=0x7fae9c1fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae9c14acd0 0x7fae9c1fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea1478640 1 -- 172.21.15.113:0/2331424218 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94009a70 con 0x7fae9c14b0b0 2023-12-19T13:47:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7faea0c77640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae9c0b0470 0x7fae9c1488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.288+0000 7fae9bfff640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae9c14acd0 0x7fae9c1fa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.289+0000 7faea1478640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c142d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fae94009e80 tx=0x7fae94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.289+0000 7fae997fa640 1 -- 172.21.15.113:0/2331424218 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94040650 con 0x7fae9c14b0b0 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.289+0000 7fae997fa640 1 -- 172.21.15.113:0/2331424218 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae940407b0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.289+0000 7fae997fa640 1 -- 172.21.15.113:0/2331424218 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94040b60 con 0x7fae9c14b0b0 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.289+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c1f82d0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.289+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c1613e0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.290+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c161570 con 0x7fae9c14b0b0 2023-12-19T13:47:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.291+0000 7fae997fa640 1 -- 172.21.15.113:0/2331424218 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae94040cc0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.292+0000 7fae997fa640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae8806a460 0x7fae8806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.292+0000 7fae997fa640 1 -- 172.21.15.113:0/2331424218 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae940ab3a0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.292+0000 7faea0c77640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae8806a460 0x7fae8806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.293+0000 7faea0c77640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae8806a460 0x7fae8806c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae90001370 tx=0x7fae90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:12.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.296+0000 7fae997fa640 1 -- 172.21.15.113:0/2331424218 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae94076990 con 0x7fae9c14b0b0 2023-12-19T13:47:12.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.486+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae9c1f87f0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.487+0000 7fae997fa640 1 -- 172.21.15.113:0/2331424218 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae9c1f87f0 con 0x7fae9c14b0b0 2023-12-19T13:47:12.487 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:12.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae8806a460 msgr2=0x7fae8806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae8806a460 0x7fae8806c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae90001370 tx=0x7fae90009040 comp rx=0 tx=0).stop 2023-12-19T13:47:12.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 msgr2=0x7fae9c142d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c142d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fae94009e80 tx=0x7fae94004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 shutdown_connections 2023-12-19T13:47:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae8806a460 0x7fae8806c920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae9c14b0b0 0x7fae9c142d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae9c14acd0 0x7fae9c1fa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 --2- 172.21.15.113:0/2331424218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae9c0b0470 0x7fae9c1488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 >> 172.21.15.113:0/2331424218 conn(0x7fae9c06f630 msgr2=0x7fae9c06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 shutdown_connections 2023-12-19T13:47:12.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.490+0000 7faea1c79640 1 -- 172.21.15.113:0/2331424218 wait complete. 2023-12-19T13:47:12.509 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:12.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.730+0000 7fba61aad640 1 Processor -- start 2023-12-19T13:47:12.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.730+0000 7fba61aad640 1 -- start start 2023-12-19T13:47:12.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba61aad640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba5c0d2b60 0x7fba5c0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba61aad640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c142bf0 0x7fba5c143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba61aad640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c143940 con 0x7fba5c070750 2023-12-19T13:47:12.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba61aad640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c070b30 con 0x7fba5c0d2b60 2023-12-19T13:47:12.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba61aad640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0d1060 con 0x7fba5c142bf0 2023-12-19T13:47:12.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba5affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba5c0d2b60 0x7fba5c0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba5b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fba5c070750 0x7fba5c0d2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55006/0 (socket says 172.21.15.113:55006) 2023-12-19T13:47:12.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba5b7fe640 1 -- 172.21.15.113:0/2447111966 learned_addr learned my addr 172.21.15.113:0/2447111966 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:12.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba5bfff640 1 --2- 172.21.15.113:0/2447111966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c142bf0 0x7fba5c143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba5affd640 1 -- 172.21.15.113:0/2447111966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c142bf0 msgr2=0x7fba5c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:12.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.732+0000 7fba5affd640 1 --2- 172.21.15.113:0/2447111966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c142bf0 0x7fba5c143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.733+0000 7fba5affd640 1 -- 172.21.15.113:0/2447111966 >> v1:172.21.15.113:6789/0 conn(0x7fba5c070750 legacy=0x7fba5c0d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.733+0000 7fba5affd640 1 -- 172.21.15.113:0/2447111966 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0cfd60 con 0x7fba5c0d2b60 2023-12-19T13:47:12.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.734+0000 7fba5affd640 1 --2- 172.21.15.113:0/2447111966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c0d2b60 0x7fba5c0d0b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fba500097a0 tx=0x7fba5002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb52634d4ea42a3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:12.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.734+0000 7fba5a7fc640 1 -- 172.21.15.113:0/2447111966 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5002d040 con 0x7fba5c0d2b60 2023-12-19T13:47:12.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.734+0000 7fba5a7fc640 1 -- 172.21.15.113:0/2447111966 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba50031810 con 0x7fba5c0d2b60 2023-12-19T13:47:12.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.734+0000 7fba5a7fc640 1 -- 172.21.15.113:0/2447111966 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50031ba0 con 0x7fba5c0d2b60 2023-12-19T13:47:12.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.734+0000 7fba61aad640 1 -- 172.21.15.113:0/2447111966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c0d2b60 msgr2=0x7fba5c0d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.734+0000 7fba61aad640 1 --2- 172.21.15.113:0/2447111966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c0d2b60 0x7fba5c0d0b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fba500097a0 tx=0x7fba5002b8b0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.735+0000 7fba61aad640 1 -- 172.21.15.113:0/2447111966 shutdown_connections 2023-12-19T13:47:12.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.735+0000 7fba61aad640 1 --2- 172.21.15.113:0/2447111966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c142bf0 0x7fba5c143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.735+0000 7fba61aad640 1 --2- 172.21.15.113:0/2447111966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c0d2b60 0x7fba5c0d0b20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.735+0000 7fba61aad640 1 -- 172.21.15.113:0/2447111966 >> 172.21.15.113:0/2447111966 conn(0x7fba5c0b2540 msgr2=0x7fba5c0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:12.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.735+0000 7fba61aad640 1 -- 172.21.15.113:0/2447111966 shutdown_connections 2023-12-19T13:47:12.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.735+0000 7fba61aad640 1 -- 172.21.15.113:0/2447111966 wait complete. 2023-12-19T13:47:12.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.736+0000 7fba61aad640 1 Processor -- start 2023-12-19T13:47:12.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.736+0000 7fba61aad640 1 -- start start 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.737+0000 7fba61aad640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c070750 0x7fba5c13e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.737+0000 7fba61aad640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d2b60 0x7fba5c13ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.737+0000 7fba61aad640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c142bf0 0x7fba5c160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.737+0000 7fba61aad640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0ce0c0 con 0x7fba5c142bf0 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.737+0000 7fba61aad640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0ce3a0 con 0x7fba5c070750 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.737+0000 7fba61aad640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0ce680 con 0x7fba5c0d2b60 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c142bf0 0x7fba5c160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c142bf0 0x7fba5c160a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42712/0 (socket says 172.21.15.113:42712) 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 -- 172.21.15.113:0/440433127 learned_addr learned my addr 172.21.15.113:0/440433127 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5affd640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d2b60 0x7fba5c13ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 -- 172.21.15.113:0/440433127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d2b60 msgr2=0x7fba5c13ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d2b60 0x7fba5c13ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 -- 172.21.15.113:0/440433127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c070750 msgr2=0x7fba5c13e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c070750 0x7fba5c13e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 -- 172.21.15.113:0/440433127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009400 con 0x7fba5c142bf0 2023-12-19T13:47:12.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.738+0000 7fba5bfff640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c142bf0 0x7fba5c160a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba5400cc30 tx=0x7fba5400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:12.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.739+0000 7fba43fff640 1 -- 172.21.15.113:0/440433127 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400ce40 con 0x7fba5c142bf0 2023-12-19T13:47:12.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.739+0000 7fba43fff640 1 -- 172.21.15.113:0/440433127 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54003990 con 0x7fba5c142bf0 2023-12-19T13:47:12.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.739+0000 7fba43fff640 1 -- 172.21.15.113:0/440433127 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54003d20 con 0x7fba5c142bf0 2023-12-19T13:47:12.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.739+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c0ce960 con 0x7fba5c142bf0 2023-12-19T13:47:12.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.739+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c160f80 con 0x7fba5c142bf0 2023-12-19T13:47:12.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.740+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c0cee80 con 0x7fba5c142bf0 2023-12-19T13:47:12.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.741+0000 7fba43fff640 1 -- 172.21.15.113:0/440433127 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba54003e80 con 0x7fba5c142bf0 2023-12-19T13:47:12.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.742+0000 7fba43fff640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fba4806a430 0x7fba4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:12.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.742+0000 7fba43fff640 1 -- 172.21.15.113:0/440433127 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba54088e20 con 0x7fba5c142bf0 2023-12-19T13:47:12.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.743+0000 7fba5b7fe640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fba4806a430 0x7fba4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:12.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.743+0000 7fba5b7fe640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fba4806a430 0x7fba4806c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0015f0 tx=0x7fba4c007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:12.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.747+0000 7fba43fff640 1 -- 172.21.15.113:0/440433127 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fba5c0cee80 con 0x7fba5c142bf0 2023-12-19T13:47:12.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.937+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba5c0cee80 con 0x7fba5c142bf0 2023-12-19T13:47:12.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.938+0000 7fba43fff640 1 -- 172.21.15.113:0/440433127 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba5c0cee80 con 0x7fba5c142bf0 2023-12-19T13:47:12.938 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:12.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fba4806a430 msgr2=0x7fba4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fba4806a430 0x7fba4806c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0015f0 tx=0x7fba4c007a40 comp rx=0 tx=0).stop 2023-12-19T13:47:12.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c142bf0 msgr2=0x7fba5c160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:12.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c142bf0 0x7fba5c160a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba5400cc30 tx=0x7fba5400a5c0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 shutdown_connections 2023-12-19T13:47:12.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fba4806a430 0x7fba4806c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba5c142bf0 0x7fba5c160a40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d2b60 0x7fba5c13ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 --2- 172.21.15.113:0/440433127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c070750 0x7fba5c13e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:12.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 >> 172.21.15.113:0/440433127 conn(0x7fba5c0b2540 msgr2=0x7fba5c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:12.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 shutdown_connections 2023-12-19T13:47:12.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:12.941+0000 7fba61aad640 1 -- 172.21.15.113:0/440433127 wait complete. 2023-12-19T13:47:12.959 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:13.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.179+0000 7f9ffe081640 1 Processor -- start 2023-12-19T13:47:13.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.180+0000 7f9ffe081640 1 -- start start 2023-12-19T13:47:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.181+0000 7f9ffe081640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 0x7f9ff80b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.181+0000 7f9ffe081640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff815fde0 con 0x7f9ff815b1d0 2023-12-19T13:47:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.181+0000 7f9ffe081640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80b2bc0 con 0x7f9ff80b2760 2023-12-19T13:47:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.181+0000 7f9ffe081640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80b2400 con 0x7f9ff80cf5b0 2023-12-19T13:47:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff77fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9ff815b1d0 0x7f9ff815f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55014/0 (socket says 172.21.15.113:55014) 2023-12-19T13:47:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff77fe640 1 -- 172.21.15.113:0/2119492014 learned_addr learned my addr 172.21.15.113:0/2119492014 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff7fff640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 0x7f9ff80b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947440626 0 0) 0x7f9ff815fde0 con 0x7f9ff815b1d0 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd8003520 con 0x7f9ff815b1d0 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 534964827 0 0) 0x7f9fd8003520 con 0x7f9ff815b1d0 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 msgr2=0x7f9ff80b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 0x7f9ff80b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 >> v1:172.21.15.151:6789/0 conn(0x7f9ff80b2760 legacy=0x7f9ff80ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff815ef10 con 0x7f9ff815b1d0 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.182+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9fe8001670 con 0x7f9ff815b1d0 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 >> v1:172.21.15.113:6789/0 conn(0x7f9ff815b1d0 legacy=0x7f9ff815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff6ffd640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 0x7f9fd8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff6ffd640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9fd80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff6ffd640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd8004d70 0x7f9fd80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd800bbb0 con 0x7f9fd8004090 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd800bd20 con 0x7f9fd8004d70 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd800bee0 con 0x7f9ff80cf5b0 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9feffff640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9fd80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9ff77fe640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 0x7f9fd8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9feffff640 1 -- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 msgr2=0x7f9fd8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9feffff640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80cf5b0 0x7f9fd8003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9feffff640 1 -- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd8004d70 msgr2=0x7f9fd80051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:13.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9feffff640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd8004d70 0x7f9fd80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.183+0000 7f9feffff640 1 -- 172.21.15.113:0/2119492014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8003520 con 0x7f9fd8004090 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.184+0000 7f9feffff640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9fd80047c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0001750 tx=0x7f9fd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf585b6f06574e32 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00052d0 con 0x7f9fd8004090 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe002e050 con 0x7f9fd8004090 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ff6ffd640 1 -- 172.21.15.113:0/2119492014 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0003830 con 0x7f9fd8004090 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ffe081640 1 -- 172.21.15.113:0/2119492014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 msgr2=0x7f9fd80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ffe081640 1 --2- 172.21.15.113:0/2119492014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9fd80047c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0001750 tx=0x7f9fd80057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ff7fff640 1 -- 172.21.15.113:0/2119492014 reap_dead start 2023-12-19T13:47:13.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ffe081640 1 -- 172.21.15.113:0/2119492014 shutdown_connections 2023-12-19T13:47:13.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ffe081640 1 -- 172.21.15.113:0/2119492014 >> 172.21.15.113:0/2119492014 conn(0x7f9ff8073150 msgr2=0x7f9ff80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:13.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ffe081640 1 -- 172.21.15.113:0/2119492014 shutdown_connections 2023-12-19T13:47:13.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.185+0000 7f9ffe081640 1 -- 172.21.15.113:0/2119492014 wait complete. 2023-12-19T13:47:13.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.187+0000 7f9ffe081640 1 Processor -- start 2023-12-19T13:47:13.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.187+0000 7f9ffe081640 1 -- start start 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ffe081640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9ff8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ffe081640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff80c9950 0x7f9ff80c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ffe081640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80c82a0 0x7f9ff80c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ffe081640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80ca310 con 0x7f9fd8004090 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ffe081640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff815b5b0 con 0x7f9ff80c9950 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ffe081640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80c8fd0 con 0x7f9ff80c82a0 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ff77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9ff8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.188+0000 7f9ff77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9ff8153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42734/0 (socket says 172.21.15.113:42734) 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff77fe640 1 -- 172.21.15.113:0/2040968933 learned_addr learned my addr 172.21.15.113:0/2040968933 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff77fe640 1 -- 172.21.15.113:0/2040968933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80c82a0 msgr2=0x7f9ff80c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff77fe640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80c82a0 0x7f9ff80c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff77fe640 1 -- 172.21.15.113:0/2040968933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff80c9950 msgr2=0x7f9ff80c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff77fe640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff80c9950 0x7f9ff80c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff77fe640 1 -- 172.21.15.113:0/2040968933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80c92b0 con 0x7f9fd8004090 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff77fe640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9ff8153cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800e780 tx=0x7f9fe800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff4ff9640 1 -- 172.21.15.113:0/2040968933 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800ee90 con 0x7f9fd8004090 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff4ff9640 1 -- 172.21.15.113:0/2040968933 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe800c870 con 0x7f9fd8004090 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ff4ff9640 1 -- 172.21.15.113:0/2040968933 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800cc20 con 0x7f9fd8004090 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.189+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff80c9590 con 0x7f9fd8004090 2023-12-19T13:47:13.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.190+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff80c8c60 con 0x7f9fd8004090 2023-12-19T13:47:13.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.191+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff815ba40 con 0x7f9fd8004090 2023-12-19T13:47:13.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.191+0000 7f9ff4ff9640 1 -- 172.21.15.113:0/2040968933 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fe801d460 con 0x7f9fd8004090 2023-12-19T13:47:13.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.192+0000 7f9ff4ff9640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fdc06a460 0x7f9fdc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.193+0000 7f9ff4ff9640 1 -- 172.21.15.113:0/2040968933 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fe8088810 con 0x7f9fd8004090 2023-12-19T13:47:13.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.193+0000 7f9feffff640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fdc06a460 0x7f9fdc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.193+0000 7f9feffff640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fdc06a460 0x7f9fdc06c920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0033000 tx=0x7f9fe002f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:13.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.197+0000 7f9ff4ff9640 1 -- 172.21.15.113:0/2040968933 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ff815ba40 con 0x7f9fd8004090 2023-12-19T13:47:13.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.385+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ff815ba40 con 0x7f9fd8004090 2023-12-19T13:47:13.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.386+0000 7f9ff4ff9640 1 -- 172.21.15.113:0/2040968933 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ff815ba40 con 0x7f9fd8004090 2023-12-19T13:47:13.386 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.388+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fdc06a460 msgr2=0x7f9fdc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.388+0000 7f9ffe081640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fdc06a460 0x7f9fdc06c920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0033000 tx=0x7f9fe002f000 comp rx=0 tx=0).stop 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.388+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 msgr2=0x7f9ff8153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.388+0000 7f9ffe081640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9ff8153cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800e780 tx=0x7f9fe800ec40 comp rx=0 tx=0).stop 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 shutdown_connections 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fdc06a460 0x7f9fdc06c920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff80c82a0 0x7f9ff80c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff80c9950 0x7f9ff80c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 --2- 172.21.15.113:0/2040968933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fd8004090 0x7f9ff8153cf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 >> 172.21.15.113:0/2040968933 conn(0x7f9ff8073150 msgr2=0x7f9ff80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 shutdown_connections 2023-12-19T13:47:13.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.389+0000 7f9ffe081640 1 -- 172.21.15.113:0/2040968933 wait complete. 2023-12-19T13:47:13.416 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-19T13:47:13.416 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T13:47:13.417 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:13.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.630+0000 7f650759e640 1 Processor -- start 2023-12-19T13:47:13.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.630+0000 7f650759e640 1 -- start start 2023-12-19T13:47:13.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650759e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f650815e3f0 0x7f65080b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080b2460 0x7f65080ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650759e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65080b2fa0 con 0x7f65080acdf0 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650759e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65080ad280 con 0x7f650815e3f0 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650806f600 con 0x7f65080b2460 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f650815e3f0 0x7f65080b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f650815e3f0 0x7f65080b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42736/0 (socket says 172.21.15.113:42736) 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650659c640 1 -- 172.21.15.113:0/2063971645 learned_addr learned my addr 172.21.15.113:0/2063971645 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:13.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f6506d9d640 1 --1- 172.21.15.113:0/2063971645 >> v1:172.21.15.113:6789/0 conn(0x7f65080acdf0 0x7f6508160e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55020/0 (socket says 172.21.15.113:55020) 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f64fffff640 1 --2- 172.21.15.113:0/2063971645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080b2460 0x7f65080ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650659c640 1 -- 172.21.15.113:0/2063971645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080b2460 msgr2=0x7f65080ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650659c640 1 --2- 172.21.15.113:0/2063971645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080b2460 0x7f65080ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f6505d9b640 1 -- 172.21.15.113:0/2063971645 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435784918 0 0) 0x7f65080b2fa0 con 0x7f65080acdf0 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650659c640 1 -- 172.21.15.113:0/2063971645 >> v1:172.21.15.113:6789/0 conn(0x7f65080acdf0 legacy=0x7f6508160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f650659c640 1 -- 172.21.15.113:0/2063971645 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650815e7d0 con 0x7f650815e3f0 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.632+0000 7f64fffff640 1 --2- 172.21.15.113:0/2063971645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080b2460 0x7f65080ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:13.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.634+0000 7f650659c640 1 --2- 172.21.15.113:0/2063971645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f650815e3f0 0x7f65080b1f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009870 tx=0x7f64f802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2167d48ec9c90241 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:13.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.634+0000 7f6505d9b640 1 -- 172.21.15.113:0/2063971645 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8031640 con 0x7f650815e3f0 2023-12-19T13:47:13.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.634+0000 7f6505d9b640 1 -- 172.21.15.113:0/2063971645 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f80317a0 con 0x7f650815e3f0 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.634+0000 7f6505d9b640 1 -- 172.21.15.113:0/2063971645 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8031b30 con 0x7f650815e3f0 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.634+0000 7f650759e640 1 -- 172.21.15.113:0/2063971645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f650815e3f0 msgr2=0x7f65080b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.634+0000 7f650759e640 1 --2- 172.21.15.113:0/2063971645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f650815e3f0 0x7f65080b1f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009870 tx=0x7f64f802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.635+0000 7f650759e640 1 -- 172.21.15.113:0/2063971645 shutdown_connections 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.635+0000 7f650759e640 1 --2- 172.21.15.113:0/2063971645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080b2460 0x7f65080ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.635+0000 7f650759e640 1 --2- 172.21.15.113:0/2063971645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f650815e3f0 0x7f65080b1f20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.635+0000 7f650759e640 1 -- 172.21.15.113:0/2063971645 >> 172.21.15.113:0/2063971645 conn(0x7f65080b0100 msgr2=0x7f65080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.635+0000 7f650759e640 1 -- 172.21.15.113:0/2063971645 shutdown_connections 2023-12-19T13:47:13.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.635+0000 7f650759e640 1 -- 172.21.15.113:0/2063971645 wait complete. 2023-12-19T13:47:13.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.636+0000 7f650759e640 1 Processor -- start 2023-12-19T13:47:13.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.637+0000 7f650759e640 1 -- start start 2023-12-19T13:47:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.637+0000 7f650759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080acdf0 0x7f650815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f650759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65080b2460 0x7f65081f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f650759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f650815e3f0 0x7f65081555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f650759e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081460c0 con 0x7f65080b2460 2023-12-19T13:47:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f650759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650815ce00 con 0x7f650815e3f0 2023-12-19T13:47:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f650759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6508145440 con 0x7f65080acdf0 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65080b2460 0x7f65081f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65080b2460 0x7f65081f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42746/0 (socket says 172.21.15.113:42746) 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 -- 172.21.15.113:0/666637123 learned_addr learned my addr 172.21.15.113:0/666637123 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f650659c640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080acdf0 0x7f650815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f6506d9d640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f650815e3f0 0x7f65081555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 -- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080acdf0 msgr2=0x7f650815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080acdf0 0x7f650815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 -- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f650815e3f0 msgr2=0x7f65081555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f650815e3f0 0x7f65081555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f64fffff640 1 -- 172.21.15.113:0/666637123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80094d0 con 0x7f65080b2460 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.638+0000 7f6506d9d640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f650815e3f0 0x7f65081555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:13.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.639+0000 7f64fffff640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65080b2460 0x7f65081f3030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c7f0 tx=0x7f64f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.639+0000 7f64feffd640 1 -- 172.21.15.113:0/666637123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0007820 con 0x7f65080b2460 2023-12-19T13:47:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.639+0000 7f64feffd640 1 -- 172.21.15.113:0/666637123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0007980 con 0x7f65080b2460 2023-12-19T13:47:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.639+0000 7f64feffd640 1 -- 172.21.15.113:0/666637123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0007cf0 con 0x7f65080b2460 2023-12-19T13:47:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.639+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6508145720 con 0x7f65080b2460 2023-12-19T13:47:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.639+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6508145ce0 con 0x7f65080b2460 2023-12-19T13:47:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.640+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508061910 con 0x7f65080b2460 2023-12-19T13:47:13.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.641+0000 7f64feffd640 1 -- 172.21.15.113:0/666637123 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f64f00113f0 con 0x7f65080b2460 2023-12-19T13:47:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.642+0000 7f64feffd640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64e806a430 0x7f64e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.642+0000 7f64feffd640 1 -- 172.21.15.113:0/666637123 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f0088c70 con 0x7f65080b2460 2023-12-19T13:47:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.642+0000 7f650659c640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64e806a430 0x7f64e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.643+0000 7f650659c640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64e806a430 0x7f64e806c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f64f8036000 tx=0x7f64f803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:13.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.647+0000 7f64feffd640 1 -- 172.21.15.113:0/666637123 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f64f0054260 con 0x7f65080b2460 2023-12-19T13:47:13.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.838+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f650806f260 con 0x7f65080b2460 2023-12-19T13:47:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.840+0000 7f64feffd640 1 -- 172.21.15.113:0/666637123 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f64f001f090 con 0x7f65080b2460 2023-12-19T13:47:13.840 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:13.841 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64e806a430 msgr2=0x7f64e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64e806a430 0x7f64e806c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f64f8036000 tx=0x7f64f803c040 comp rx=0 tx=0).stop 2023-12-19T13:47:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65080b2460 msgr2=0x7f65081f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65080b2460 0x7f65081f3030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c7f0 tx=0x7f64f000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 shutdown_connections 2023-12-19T13:47:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64e806a430 0x7f64e806c8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f650815e3f0 0x7f65081555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65080b2460 0x7f65081f3030 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 --2- 172.21.15.113:0/666637123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65080acdf0 0x7f650815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:13.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 >> 172.21.15.113:0/666637123 conn(0x7f65080b0100 msgr2=0x7f6508157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:13.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 shutdown_connections 2023-12-19T13:47:13.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:13.843+0000 7f650759e640 1 -- 172.21.15.113:0/666637123 wait complete. 2023-12-19T13:47:13.862 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:13.863 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:14.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.080+0000 7f60233c4640 1 Processor -- start 2023-12-19T13:47:14.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.081+0000 7f60233c4640 1 -- start start 2023-12-19T13:47:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.082+0000 7f60233c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 0x7f601c0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.082+0000 7f60233c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c0ccbd0 con 0x7f601c154760 2023-12-19T13:47:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.082+0000 7f60233c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c154b40 con 0x7f601c0b0070 2023-12-19T13:47:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.082+0000 7f60233c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0ccf20 con 0x7f601c15b290 2023-12-19T13:47:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.082+0000 7f6021160640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f601c154760 0x7f601c0cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55026/0 (socket says 172.21.15.113:55026) 2023-12-19T13:47:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.082+0000 7f6021160640 1 -- 172.21.15.113:0/1356925976 learned_addr learned my addr 172.21.15.113:0/1356925976 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:14.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f602095f640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 0x7f601c0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895759032 0 0) 0x7f601c0ccbd0 con 0x7f601c154760 2023-12-19T13:47:14.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6008003520 con 0x7f601c154760 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564188330 0 0) 0x7f6008003520 con 0x7f601c154760 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 msgr2=0x7f601c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 0x7f601c0b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 >> v1:172.21.15.151:6789/0 conn(0x7f601c0b0070 legacy=0x7f601c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0cc060 con 0x7f601c154760 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6018001670 con 0x7f601c154760 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.083+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 >> v1:172.21.15.113:6789/0 conn(0x7f601c154760 legacy=0x7f601c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6013fff640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008003a10 0x7f6008003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6013fff640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 0x7f60080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6013fff640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6008004d00 0x7f6008005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0ccf20 con 0x7f6008004d00 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600800bb10 con 0x7f6008003a10 2023-12-19T13:47:14.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600800dee0 con 0x7f601c15b290 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6021961640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6008004d00 0x7f6008005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f602095f640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 0x7f60080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6021160640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008003a10 0x7f6008003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6021961640 1 -- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 msgr2=0x7f60080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6021961640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15b290 0x7f60080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6021961640 1 -- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008003a10 msgr2=0x7f6008003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6021961640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008003a10 0x7f6008003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.084+0000 7f6021961640 1 -- 172.21.15.113:0/1356925976 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008003520 con 0x7f6008004d00 2023-12-19T13:47:14.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.085+0000 7f6021961640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6008004d00 0x7f6008005180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6014001e50 tx=0x7f60080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3be6a81e58e1524 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014003b70 con 0x7f6008004d00 2023-12-19T13:47:14.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014003cd0 con 0x7f6008004d00 2023-12-19T13:47:14.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f6013fff640 1 -- 172.21.15.113:0/1356925976 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014005310 con 0x7f6008004d00 2023-12-19T13:47:14.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f60233c4640 1 -- 172.21.15.113:0/1356925976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6008004d00 msgr2=0x7f6008005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f60233c4640 1 --2- 172.21.15.113:0/1356925976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6008004d00 0x7f6008005180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6014001e50 tx=0x7f60080057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f6021961640 1 -- 172.21.15.113:0/1356925976 reap_dead start 2023-12-19T13:47:14.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f60233c4640 1 -- 172.21.15.113:0/1356925976 shutdown_connections 2023-12-19T13:47:14.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f60233c4640 1 -- 172.21.15.113:0/1356925976 >> 172.21.15.113:0/1356925976 conn(0x7f601c073150 msgr2=0x7f601c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:14.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f60233c4640 1 -- 172.21.15.113:0/1356925976 shutdown_connections 2023-12-19T13:47:14.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.086+0000 7f60233c4640 1 -- 172.21.15.113:0/1356925976 wait complete. 2023-12-19T13:47:14.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.088+0000 7f60233c4640 1 Processor -- start 2023-12-19T13:47:14.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.088+0000 7f60233c4640 1 -- start start 2023-12-19T13:47:14.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.089+0000 7f60233c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008004d00 0x7f601c1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.089+0000 7f60233c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15cae0 0x7f601c14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.089+0000 7f60233c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601c156440 0x7f601c1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.089+0000 7f60233c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c14fdb0 con 0x7f601c156440 2023-12-19T13:47:14.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.089+0000 7f60233c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c14f510 con 0x7f6008004d00 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.089+0000 7f60233c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c14f7f0 con 0x7f601c15cae0 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601c156440 0x7f601c1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601c156440 0x7f601c1568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42758/0 (socket says 172.21.15.113:42758) 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 -- 172.21.15.113:0/1161352627 learned_addr learned my addr 172.21.15.113:0/1161352627 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f602095f640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15cae0 0x7f601c14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 -- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15cae0 msgr2=0x7f601c14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15cae0 0x7f601c14ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021160640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008004d00 0x7f601c1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 -- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008004d00 msgr2=0x7f601c1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008004d00 0x7f601c1575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 -- 172.21.15.113:0/1161352627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c14fad0 con 0x7f601c156440 2023-12-19T13:47:14.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.090+0000 7f6021961640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601c156440 0x7f601c1568f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6014001f70 tx=0x7f60140014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.091+0000 7f6011ffb640 1 -- 172.21.15.113:0/1161352627 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601403e070 con 0x7f601c156440 2023-12-19T13:47:14.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.091+0000 7f6011ffb640 1 -- 172.21.15.113:0/1161352627 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014003e40 con 0x7f601c156440 2023-12-19T13:47:14.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.091+0000 7f6011ffb640 1 -- 172.21.15.113:0/1161352627 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014006d90 con 0x7f601c156440 2023-12-19T13:47:14.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.091+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c15b810 con 0x7f601c156440 2023-12-19T13:47:14.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.091+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c14f220 con 0x7f601c156440 2023-12-19T13:47:14.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.092+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c15b670 con 0x7f601c156440 2023-12-19T13:47:14.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.093+0000 7f6011ffb640 1 -- 172.21.15.113:0/1161352627 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6014007030 con 0x7f601c156440 2023-12-19T13:47:14.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.094+0000 7f6011ffb640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f600006a460 0x7f600006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.094+0000 7f6011ffb640 1 -- 172.21.15.113:0/1161352627 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60140a9bf0 con 0x7f601c156440 2023-12-19T13:47:14.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.094+0000 7f6021160640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f600006a460 0x7f600006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.095+0000 7f6021160640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f600006a460 0x7f600006c920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6018001200 tx=0x7f6018000f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.098+0000 7f6011ffb640 1 -- 172.21.15.113:0/1161352627 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f601c15b670 con 0x7f601c156440 2023-12-19T13:47:14.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.288+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f601c15b670 con 0x7f601c156440 2023-12-19T13:47:14.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.289+0000 7f6011ffb640 1 -- 172.21.15.113:0/1161352627 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f601c15b670 con 0x7f601c156440 2023-12-19T13:47:14.288 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.291+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f600006a460 msgr2=0x7f600006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.291+0000 7f60233c4640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f600006a460 0x7f600006c920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6018001200 tx=0x7f6018000f70 comp rx=0 tx=0).stop 2023-12-19T13:47:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.291+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601c156440 msgr2=0x7f601c1568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.291+0000 7f60233c4640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601c156440 0x7f601c1568f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6014001f70 tx=0x7f60140014a0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 shutdown_connections 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f600006a460 0x7f600006c920 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601c156440 0x7f601c1568f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f601c15cae0 0x7f601c14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 --2- 172.21.15.113:0/1161352627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6008004d00 0x7f601c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 >> 172.21.15.113:0/1161352627 conn(0x7f601c073150 msgr2=0x7f601c1528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 shutdown_connections 2023-12-19T13:47:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.292+0000 7f60233c4640 1 -- 172.21.15.113:0/1161352627 wait complete. 2023-12-19T13:47:14.311 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:14.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.522+0000 7f2f1497e640 1 Processor -- start 2023-12-19T13:47:14.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.522+0000 7f2f1497e640 1 -- start start 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f1497e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f100b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f1497e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2f100b5cd0 0x7f2f100b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f1497e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2f10160f30 0x7f2f101613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f1497e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100b6670 con 0x7f2f10160f30 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f1497e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f10140740 con 0x7f2f100b5cd0 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f1497e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10143990 con 0x7f2f10140360 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f0ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2f10160f30 0x7f2f101613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f0ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2f10160f30 0x7f2f101613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42770/0 (socket says 172.21.15.113:42770) 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.524+0000 7f2f0ffff640 1 -- 172.21.15.113:0/2868188142 learned_addr learned my addr 172.21.15.113:0/2868188142 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.525+0000 7f2f07fff640 1 --2- 172.21.15.113:0/2868188142 >> v2:172.21.15.151:3300/0 conn(0x7f2f100b5cd0 0x7f2f100b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.525+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/2868188142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f100b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.525+0000 7f2f0ffff640 1 -- 172.21.15.113:0/2868188142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 msgr2=0x7f2f100b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:14.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.525+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/2868188142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f100b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.525+0000 7f2f0ffff640 1 -- 172.21.15.113:0/2868188142 >> v2:172.21.15.151:3300/0 conn(0x7f2f100b5cd0 msgr2=0x7f2f100b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:14.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.525+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/2868188142 >> v2:172.21.15.151:3300/0 conn(0x7f2f100b5cd0 0x7f2f100b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.525+0000 7f2f0ffff640 1 -- 172.21.15.113:0/2868188142 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100b8610 con 0x7f2f10160f30 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.526+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/2868188142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f101613c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2f100d07d0 tx=0x7f2f0802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7cd4c028f78229 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.526+0000 7f2f0effd640 1 -- 172.21.15.113:0/2868188142 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0802c9e0 con 0x7f2f10160f30 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.526+0000 7f2f0effd640 1 -- 172.21.15.113:0/2868188142 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0802cb40 con 0x7f2f10160f30 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.526+0000 7f2f0effd640 1 -- 172.21.15.113:0/2868188142 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f080343f0 con 0x7f2f10160f30 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 -- 172.21.15.113:0/2868188142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 msgr2=0x7f2f101613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 --2- 172.21.15.113:0/2868188142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f101613c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2f100d07d0 tx=0x7f2f0802be40 comp rx=0 tx=0).stop 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 -- 172.21.15.113:0/2868188142 shutdown_connections 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 --2- 172.21.15.113:0/2868188142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f101613c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 --2- 172.21.15.113:0/2868188142 >> v2:172.21.15.151:3300/0 conn(0x7f2f100b5cd0 0x7f2f100b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 --2- 172.21.15.113:0/2868188142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f100b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 -- 172.21.15.113:0/2868188142 >> 172.21.15.113:0/2868188142 conn(0x7f2f10065dc0 msgr2=0x7f2f100b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:14.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 -- 172.21.15.113:0/2868188142 shutdown_connections 2023-12-19T13:47:14.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.527+0000 7f2f1497e640 1 -- 172.21.15.113:0/2868188142 wait complete. 2023-12-19T13:47:14.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.529+0000 7f2f1497e640 1 Processor -- start 2023-12-19T13:47:14.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.529+0000 7f2f1497e640 1 -- start start 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.530+0000 7f2f1497e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f100b5cd0 0x7f2f101f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.530+0000 7f2f1497e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f1013f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.530+0000 7f2f1497e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f1015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.530+0000 7f2f1497e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10143b90 con 0x7f2f10160f30 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.530+0000 7f2f1497e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10143e70 con 0x7f2f100b5cd0 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.530+0000 7f2f1497e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f101f5cd0 con 0x7f2f10140360 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f1015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f1015fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42772/0 (socket says 172.21.15.113:42772) 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 -- 172.21.15.113:0/4000002817 learned_addr learned my addr 172.21.15.113:0/4000002817 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:14.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f100b5cd0 0x7f2f101f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f07fff640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f1013f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 -- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 msgr2=0x7f2f1013f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f1013f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 -- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f100b5cd0 msgr2=0x7f2f101f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f100b5cd0 0x7f2f101f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.531+0000 7f2f0ffff640 1 -- 172.21.15.113:0/4000002817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08009b30 con 0x7f2f10160f30 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.532+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f1015fac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009f40 tx=0x7f2f08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.532+0000 7f2f0cff9640 1 -- 172.21.15.113:0/4000002817 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08040670 con 0x7f2f10160f30 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.532+0000 7f2f0cff9640 1 -- 172.21.15.113:0/4000002817 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f080407f0 con 0x7f2f10160f30 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.532+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10160890 con 0x7f2f10160f30 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.532+0000 7f2f0cff9640 1 -- 172.21.15.113:0/4000002817 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08040ba0 con 0x7f2f10160f30 2023-12-19T13:47:14.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.532+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1013fa70 con 0x7f2f10160f30 2023-12-19T13:47:14.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.533+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f10061910 con 0x7f2f10160f30 2023-12-19T13:47:14.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.535+0000 7f2f0cff9640 1 -- 172.21.15.113:0/4000002817 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2f08040d00 con 0x7f2f10160f30 2023-12-19T13:47:14.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.536+0000 7f2f0cff9640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ef006a430 0x7f2ef006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.536+0000 7f2f0cff9640 1 -- 172.21.15.113:0/4000002817 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f080abd00 con 0x7f2f10160f30 2023-12-19T13:47:14.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.537+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ef006a430 0x7f2ef006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.537+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ef006a430 0x7f2ef006c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f00006fd0 tx=0x7f2f00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.545+0000 7f2f0cff9640 1 -- 172.21.15.113:0/4000002817 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2f080772e0 con 0x7f2f10160f30 2023-12-19T13:47:14.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.738+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f10143fb0 con 0x7f2f10160f30 2023-12-19T13:47:14.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.739+0000 7f2f0cff9640 1 -- 172.21.15.113:0/4000002817 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f08009510 con 0x7f2f10160f30 2023-12-19T13:47:14.739 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:14.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ef006a430 msgr2=0x7f2ef006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ef006a430 0x7f2ef006c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f00006fd0 tx=0x7f2f00008040 comp rx=0 tx=0).stop 2023-12-19T13:47:14.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 msgr2=0x7f2f1015fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f1015fac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009f40 tx=0x7f2f08004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 shutdown_connections 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ef006a430 0x7f2ef006c8f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f10160f30 0x7f2f1015fac0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f10140360 0x7f2f1013f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 --2- 172.21.15.113:0/4000002817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f100b5cd0 0x7f2f101f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 >> 172.21.15.113:0/4000002817 conn(0x7f2f10065dc0 msgr2=0x7f2f100b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 shutdown_connections 2023-12-19T13:47:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.742+0000 7f2f1497e640 1 -- 172.21.15.113:0/4000002817 wait complete. 2023-12-19T13:47:14.759 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:14.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.969+0000 7fca60f22640 1 Processor -- start 2023-12-19T13:47:14.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.969+0000 7fca60f22640 1 -- start start 2023-12-19T13:47:14.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca60f22640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fca5c15b1d0 0x7fca5c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca60f22640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fca5c0ceea0 0x7fca5c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca60f22640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c15fde0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca60f22640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c0cf870 con 0x7fca5c15b1d0 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca60f22640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c15ef10 con 0x7fca5c0ceea0 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca5a59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fca5c15b1d0 0x7fca5c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca5a59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fca5c15b1d0 0x7fca5c0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42786/0 (socket says 172.21.15.113:42786) 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.971+0000 7fca5a59c640 1 -- 172.21.15.113:0/2120327291 learned_addr learned my addr 172.21.15.113:0/2120327291 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.972+0000 7fca5a59c640 1 -- 172.21.15.113:0/2120327291 >> v2:172.21.15.151:3300/0 conn(0x7fca5c0ceea0 msgr2=0x7fca5c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.972+0000 7fca5ad9d640 1 --2- 172.21.15.113:0/2120327291 >> v2:172.21.15.151:3300/0 conn(0x7fca5c0ceea0 0x7fca5c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.972+0000 7fca5a59c640 1 --2- 172.21.15.113:0/2120327291 >> v2:172.21.15.151:3300/0 conn(0x7fca5c0ceea0 0x7fca5c0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.972+0000 7fca5a59c640 1 -- 172.21.15.113:0/2120327291 >> v1:172.21.15.113:6789/0 conn(0x7fca5c0b1ec0 legacy=0x7fca5c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.972+0000 7fca5a59c640 1 -- 172.21.15.113:0/2120327291 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0b2320 con 0x7fca5c15b1d0 2023-12-19T13:47:14.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.972+0000 7fca59d9b640 1 -- 172.21.15.113:0/2120327291 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112396226 0 0) 0x7fca5c15fde0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.972+0000 7fca5ad9d640 1 --2- 172.21.15.113:0/2120327291 >> v2:172.21.15.151:3300/0 conn(0x7fca5c0ceea0 0x7fca5c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:14.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.973+0000 7fca5a59c640 1 --2- 172.21.15.113:0/2120327291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c15b1d0 0x7fca5c0b2760 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0663a0 tx=0x7fca4c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f01cc9be26ce5f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.973+0000 7fca59d9b640 1 -- 172.21.15.113:0/2120327291 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c030860 con 0x7fca5c15b1d0 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.973+0000 7fca59d9b640 1 -- 172.21.15.113:0/2120327291 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c0309c0 con 0x7fca5c15b1d0 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.973+0000 7fca59d9b640 1 -- 172.21.15.113:0/2120327291 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c030d50 con 0x7fca5c15b1d0 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 -- 172.21.15.113:0/2120327291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c15b1d0 msgr2=0x7fca5c0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 --2- 172.21.15.113:0/2120327291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c15b1d0 0x7fca5c0b2760 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0663a0 tx=0x7fca4c02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 -- 172.21.15.113:0/2120327291 shutdown_connections 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 --2- 172.21.15.113:0/2120327291 >> v2:172.21.15.151:3300/0 conn(0x7fca5c0ceea0 0x7fca5c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 --2- 172.21.15.113:0/2120327291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c15b1d0 0x7fca5c0b2760 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 -- 172.21.15.113:0/2120327291 >> 172.21.15.113:0/2120327291 conn(0x7fca5c073150 msgr2=0x7fca5c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:14.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 -- 172.21.15.113:0/2120327291 shutdown_connections 2023-12-19T13:47:14.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.974+0000 7fca60f22640 1 -- 172.21.15.113:0/2120327291 wait complete. 2023-12-19T13:47:14.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.976+0000 7fca60f22640 1 Processor -- start 2023-12-19T13:47:14.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.976+0000 7fca60f22640 1 -- start start 2023-12-19T13:47:14.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca60f22640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c0b1ec0 0x7fca5c0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca60f22640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca5c0ceea0 0x7fca5c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca60f22640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca5c15b1d0 0x7fca5c15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca60f22640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0c96a0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca60f22640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0a9830 con 0x7fca5c15b1d0 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca60f22640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0a89e0 con 0x7fca5c0ceea0 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca5a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c0b1ec0 0x7fca5c0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca5a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c0b1ec0 0x7fca5c0a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42800/0 (socket says 172.21.15.113:42800) 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.977+0000 7fca5a59c640 1 -- 172.21.15.113:0/684883560 learned_addr learned my addr 172.21.15.113:0/684883560 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca5a59c640 1 -- 172.21.15.113:0/684883560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca5c0ceea0 msgr2=0x7fca5c155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca5a59c640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca5c0ceea0 0x7fca5c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca5a59c640 1 -- 172.21.15.113:0/684883560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca5c15b1d0 msgr2=0x7fca5c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:14.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca5a59c640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca5c15b1d0 0x7fca5c15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:14.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca5a59c640 1 -- 172.21.15.113:0/684883560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0094d0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca5a59c640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c0b1ec0 0x7fca5c0a84a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca4c000c00 tx=0x7fca4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca52ffd640 1 -- 172.21.15.113:0/684883560 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c030850 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca52ffd640 1 -- 172.21.15.113:0/684883560 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c039d90 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca52ffd640 1 -- 172.21.15.113:0/684883560 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c043650 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c0a8cb0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.978+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c0a9270 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.980+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c0c97e0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.980+0000 7fca52ffd640 1 -- 172.21.15.113:0/684883560 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca4c04c3b0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.981+0000 7fca52ffd640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca3c06a430 0x7fca3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:14.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.981+0000 7fca52ffd640 1 -- 172.21.15.113:0/684883560 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca4c0ab1f0 con 0x7fca5c0b1ec0 2023-12-19T13:47:14.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.982+0000 7fca53fff640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca3c06a430 0x7fca3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:14.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.982+0000 7fca53fff640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca3c06a430 0x7fca3c06c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0cb9d0 tx=0x7fca44007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:14.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:14.986+0000 7fca52ffd640 1 -- 172.21.15.113:0/684883560 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca5c0c97e0 con 0x7fca5c0b1ec0 2023-12-19T13:47:15.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.175+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca5c0c97e0 con 0x7fca5c0b1ec0 2023-12-19T13:47:15.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.176+0000 7fca52ffd640 1 -- 172.21.15.113:0/684883560 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca5c0c97e0 con 0x7fca5c0b1ec0 2023-12-19T13:47:15.176 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:15.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.178+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca3c06a430 msgr2=0x7fca3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.178+0000 7fca60f22640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca3c06a430 0x7fca3c06c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0cb9d0 tx=0x7fca44007910 comp rx=0 tx=0).stop 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.178+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c0b1ec0 msgr2=0x7fca5c0a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.178+0000 7fca60f22640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c0b1ec0 0x7fca5c0a84a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca4c000c00 tx=0x7fca4c004730 comp rx=0 tx=0).stop 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 shutdown_connections 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca3c06a430 0x7fca3c06c8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca5c15b1d0 0x7fca5c15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca5c0ceea0 0x7fca5c155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 --2- 172.21.15.113:0/684883560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca5c0b1ec0 0x7fca5c0a84a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 >> 172.21.15.113:0/684883560 conn(0x7fca5c073150 msgr2=0x7fca5c0ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 shutdown_connections 2023-12-19T13:47:15.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.179+0000 7fca60f22640 1 -- 172.21.15.113:0/684883560 wait complete. 2023-12-19T13:47:15.196 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-19T13:47:15.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.394+0000 7f0d11a83640 1 Processor -- start 2023-12-19T13:47:15.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.394+0000 7f0d11a83640 1 -- start start 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d11a83640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d0c15d620 0x7f0d0c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d11a83640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0d0c0b6870 0x7f0d0c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d11a83640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c0b6ca0 con 0x7f0d0c15da00 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d11a83640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c0b4120 con 0x7f0d0c15d620 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d11a83640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c0b5b80 con 0x7f0d0c0b6870 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d10a81640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d0c15d620 0x7f0d0c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d10a81640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d0c15d620 0x7f0d0c0cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42814/0 (socket says 172.21.15.113:42814) 2023-12-19T13:47:15.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.396+0000 7f0d10a81640 1 -- 172.21.15.113:0/1572089983 learned_addr learned my addr 172.21.15.113:0/1572089983 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:15.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.397+0000 7f0d11282640 1 --2- 172.21.15.113:0/1572089983 >> v2:172.21.15.151:3300/0 conn(0x7f0d0c0b6870 0x7f0d0c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:15.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.397+0000 7f0d10a81640 1 -- 172.21.15.113:0/1572089983 >> v2:172.21.15.151:3300/0 conn(0x7f0d0c0b6870 msgr2=0x7f0d0c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:15.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.397+0000 7f0d10a81640 1 --2- 172.21.15.113:0/1572089983 >> v2:172.21.15.151:3300/0 conn(0x7f0d0c0b6870 0x7f0d0c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.397+0000 7f0d10a81640 1 -- 172.21.15.113:0/1572089983 >> v1:172.21.15.113:6789/0 conn(0x7f0d0c15da00 legacy=0x7f0d0c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:15.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.397+0000 7f0d10a81640 1 -- 172.21.15.113:0/1572089983 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0b6ee0 con 0x7f0d0c15d620 2023-12-19T13:47:15.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.397+0000 7f0d0b7fe640 1 -- 172.21.15.113:0/1572089983 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376274592 0 0) 0x7f0cf8001110 con 0x7f0d0c15da00 2023-12-19T13:47:15.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.397+0000 7f0d11282640 1 --2- 172.21.15.113:0/1572089983 >> v2:172.21.15.151:3300/0 conn(0x7f0d0c0b6870 0x7f0d0c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.398+0000 7f0d10a81640 1 --2- 172.21.15.113:0/1572089983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c15d620 0x7f0d0c0cef60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0d30a0 tx=0x7f0d0002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41e58657807ca8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.398+0000 7f0d0b7fe640 1 -- 172.21.15.113:0/1572089983 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0002f850 con 0x7f0d0c15d620 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.398+0000 7f0d0b7fe640 1 -- 172.21.15.113:0/1572089983 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0002f9b0 con 0x7f0d0c15d620 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.398+0000 7f0d0b7fe640 1 -- 172.21.15.113:0/1572089983 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0002fd40 con 0x7f0d0c15d620 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 -- 172.21.15.113:0/1572089983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c15d620 msgr2=0x7f0d0c0cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1572089983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c15d620 0x7f0d0c0cef60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0d30a0 tx=0x7f0d0002ba30 comp rx=0 tx=0).stop 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 -- 172.21.15.113:0/1572089983 shutdown_connections 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1572089983 >> v2:172.21.15.151:3300/0 conn(0x7f0d0c0b6870 0x7f0d0c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1572089983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c15d620 0x7f0d0c0cef60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 -- 172.21.15.113:0/1572089983 >> 172.21.15.113:0/1572089983 conn(0x7f0d0c0cfb90 msgr2=0x7f0d0c0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 -- 172.21.15.113:0/1572089983 shutdown_connections 2023-12-19T13:47:15.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.399+0000 7f0d11a83640 1 -- 172.21.15.113:0/1572089983 wait complete. 2023-12-19T13:47:15.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.401+0000 7f0d11a83640 1 Processor -- start 2023-12-19T13:47:15.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.401+0000 7f0d11a83640 1 -- start start 2023-12-19T13:47:15.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d11a83640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c0b6870 0x7f0d0c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d11a83640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d0c15d620 0x7f0d0c150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d11a83640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d0c15da00 0x7f0d0c142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d11a83640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c1511b0 con 0x7f0d0c0b6870 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d11a83640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c152e40 con 0x7f0d0c15da00 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d11a83640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c143150 con 0x7f0d0c15d620 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c0b6870 0x7f0d0c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c0b6870 0x7f0d0c155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42826/0 (socket says 172.21.15.113:42826) 2023-12-19T13:47:15.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 -- 172.21.15.113:0/1640117391 learned_addr learned my addr 172.21.15.113:0/1640117391 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:15.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d0bfff640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d0c15d620 0x7f0d0c150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:15.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d11282640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d0c15da00 0x7f0d0c142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:15.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 -- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d0c15d620 msgr2=0x7f0d0c150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:15.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d0c15d620 0x7f0d0c150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 -- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d0c15da00 msgr2=0x7f0d0c142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d0c15da00 0x7f0d0c142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.402+0000 7f0d10a81640 1 -- 172.21.15.113:0/1640117391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000094d0 con 0x7f0d0c0b6870 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.403+0000 7f0d10a81640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c0b6870 0x7f0d0c155170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0d000090b0 tx=0x7f0d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.403+0000 7f0d097fa640 1 -- 172.21.15.113:0/1640117391 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0003b040 con 0x7f0d0c0b6870 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.403+0000 7f0d097fa640 1 -- 172.21.15.113:0/1640117391 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00037df0 con 0x7f0d0c0b6870 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.403+0000 7f0d097fa640 1 -- 172.21.15.113:0/1640117391 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00004270 con 0x7f0d0c0b6870 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.403+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0c156480 con 0x7f0d0c0b6870 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.403+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c155b50 con 0x7f0d0c0b6870 2023-12-19T13:47:15.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.404+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c061910 con 0x7f0d0c0b6870 2023-12-19T13:47:15.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.405+0000 7f0d097fa640 1 -- 172.21.15.113:0/1640117391 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d000043d0 con 0x7f0d0c0b6870 2023-12-19T13:47:15.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.406+0000 7f0d097fa640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cf006a430 0x7f0cf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:15.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.406+0000 7f0d097fa640 1 -- 172.21.15.113:0/1640117391 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d000abaa0 con 0x7f0d0c0b6870 2023-12-19T13:47:15.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.406+0000 7f0d0bfff640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cf006a430 0x7f0cf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:15.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.407+0000 7f0d0bfff640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cf006a430 0x7f0cf006c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c15be20 tx=0x7f0cf8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:15.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.414+0000 7f0d097fa640 1 -- 172.21.15.113:0/1640117391 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d00076ff0 con 0x7f0d0c0b6870 2023-12-19T13:47:15.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:15.670+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f0d0c0d22c0 con 0x7f0d0c0b6870 2023-12-19T13:47:16.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.636+0000 7f0d097fa640 1 -- 172.21.15.113:0/1640117391 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v58) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0d0007a610 con 0x7f0d0c0b6870 2023-12-19T13:47:16.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.639+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cf006a430 msgr2=0x7f0cf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.639+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cf006a430 0x7f0cf006c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c15be20 tx=0x7f0cf8009040 comp rx=0 tx=0).stop 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.639+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c0b6870 msgr2=0x7f0d0c155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.639+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c0b6870 0x7f0d0c155170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0d000090b0 tx=0x7f0d000046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 shutdown_connections 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cf006a430 0x7f0cf006c8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d0c15da00 0x7f0d0c142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d0c15d620 0x7f0d0c150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 --2- 172.21.15.113:0/1640117391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d0c0b6870 0x7f0d0c155170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 >> 172.21.15.113:0/1640117391 conn(0x7f0d0c0cfb90 msgr2=0x7f0d0c150390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 shutdown_connections 2023-12-19T13:47:16.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:16.640+0000 7f0d11a83640 1 -- 172.21.15.113:0/1640117391 wait complete. 2023-12-19T13:47:16.661 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T13:47:16.894 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_objectstore":"memstore"} 2023-12-19T13:47:16.894 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T13:47:16.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:47:17.013 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:17.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:17.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.095+0000 7fe19bfa4640 1 Processor -- start 2023-12-19T13:47:17.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.095+0000 7fe19bfa4640 1 -- start start 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.096+0000 7fe19bfa4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe1941611a0 0x7fe194161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.096+0000 7fe19bfa4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe194168530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.096+0000 7fe19bfa4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1940ce7e0 con 0x7fe194161ac0 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.096+0000 7fe19bfa4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe194072fe0 con 0x7fe1941611a0 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.096+0000 7fe19bfa4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940732c0 con 0x7fe19415e2c0 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe199d40640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe1941611a0 0x7fe194161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe199d40640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe1941611a0 0x7fe194161580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42836/0 (socket says 172.21.15.113:42836) 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe199d40640 1 -- 172.21.15.113:0/1091330202 learned_addr learned my addr 172.21.15.113:0/1091330202 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe19a541640 1 --2- 172.21.15.113:0/1091330202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe194168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe199d40640 1 -- 172.21.15.113:0/1091330202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 msgr2=0x7fe194168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:17.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe199d40640 1 --2- 172.21.15.113:0/1091330202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe194168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe199d40640 1 -- 172.21.15.113:0/1091330202 >> v1:172.21.15.151:6789/0 conn(0x7fe194161ac0 legacy=0x7fe19415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe199d40640 1 -- 172.21.15.113:0/1091330202 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19406d780 con 0x7fe1941611a0 2023-12-19T13:47:17.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.097+0000 7fe19a541640 1 --2- 172.21.15.113:0/1091330202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe194168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:17.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.098+0000 7fe199d40640 1 --2- 172.21.15.113:0/1091330202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe194161580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098a0 tx=0x7fe19002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51261aa6f4a8831c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:17.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.098+0000 7fe198d3e640 1 -- 172.21.15.113:0/1091330202 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190030840 con 0x7fe1941611a0 2023-12-19T13:47:17.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.098+0000 7fe198d3e640 1 -- 172.21.15.113:0/1091330202 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1900309a0 con 0x7fe1941611a0 2023-12-19T13:47:17.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.098+0000 7fe198d3e640 1 -- 172.21.15.113:0/1091330202 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190030d30 con 0x7fe1941611a0 2023-12-19T13:47:17.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 -- 172.21.15.113:0/1091330202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 msgr2=0x7fe194161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/1091330202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe194161580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098a0 tx=0x7fe19002b980 comp rx=0 tx=0).stop 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 -- 172.21.15.113:0/1091330202 shutdown_connections 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/1091330202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe194168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/1091330202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe194161580 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 -- 172.21.15.113:0/1091330202 >> 172.21.15.113:0/1091330202 conn(0x7fe1940b2090 msgr2=0x7fe1940b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 -- 172.21.15.113:0/1091330202 shutdown_connections 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.099+0000 7fe19bfa4640 1 -- 172.21.15.113:0/1091330202 wait complete. 2023-12-19T13:47:17.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.101+0000 7fe19bfa4640 1 Processor -- start 2023-12-19T13:47:17.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.101+0000 7fe19bfa4640 1 -- start start 2023-12-19T13:47:17.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19bfa4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe1940afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19bfa4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe19415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19bfa4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe194161ac0 0x7fe19415c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19bfa4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1941f7450 con 0x7fe1941611a0 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19bfa4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19415caa0 con 0x7fe194161ac0 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19bfa4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1941f2e40 con 0x7fe19415e2c0 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19953f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe19415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19953f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe19415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42850/0 (socket says 172.21.15.113:42850) 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19953f640 1 -- 172.21.15.113:0/2893363722 learned_addr learned my addr 172.21.15.113:0/2893363722 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe19a541640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe194161ac0 0x7fe19415c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.102+0000 7fe199d40640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe1940afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19953f640 1 -- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 msgr2=0x7fe1940afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19953f640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe1940afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19953f640 1 -- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe194161ac0 msgr2=0x7fe19415c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19953f640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe194161ac0 0x7fe19415c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19953f640 1 -- 172.21.15.113:0/2893363722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900094d0 con 0x7fe1941611a0 2023-12-19T13:47:17.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe199d40640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe1940afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:17.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19953f640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe19415be70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c430 tx=0x7fe18400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:17.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe18a7fc640 1 -- 172.21.15.113:0/2893363722 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840052d0 con 0x7fe1941611a0 2023-12-19T13:47:17.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe18a7fc640 1 -- 172.21.15.113:0/2893363722 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184005430 con 0x7fe1941611a0 2023-12-19T13:47:17.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1941f3970 con 0x7fe1941611a0 2023-12-19T13:47:17.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe18a7fc640 1 -- 172.21.15.113:0/2893363722 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184003830 con 0x7fe1941611a0 2023-12-19T13:47:17.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.103+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1941f3e00 con 0x7fe1941611a0 2023-12-19T13:47:17.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.104+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1941f3b00 con 0x7fe1941611a0 2023-12-19T13:47:17.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.106+0000 7fe18a7fc640 1 -- 172.21.15.113:0/2893363722 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe184003990 con 0x7fe1941611a0 2023-12-19T13:47:17.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.106+0000 7fe18a7fc640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe17806a430 0x7fe17806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.107+0000 7fe18a7fc640 1 -- 172.21.15.113:0/2893363722 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe184087d90 con 0x7fe1941611a0 2023-12-19T13:47:17.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.107+0000 7fe199d40640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe17806a430 0x7fe17806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.107+0000 7fe199d40640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe17806a430 0x7fe17806c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe190036000 tx=0x7fe190008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:17.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.112+0000 7fe18a7fc640 1 -- 172.21.15.113:0/2893363722 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe184053420 con 0x7fe1941611a0 2023-12-19T13:47:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.299+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe194061910 con 0x7fe1941611a0 2023-12-19T13:47:17.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.305+0000 7fe18a7fc640 1 -- 172.21.15.113:0/2893363722 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe184056a40 con 0x7fe1941611a0 2023-12-19T13:47:17.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe17806a430 msgr2=0x7fe17806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe17806a430 0x7fe17806c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe190036000 tx=0x7fe190008030 comp rx=0 tx=0).stop 2023-12-19T13:47:17.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 msgr2=0x7fe19415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe19415be70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c430 tx=0x7fe18400c8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 shutdown_connections 2023-12-19T13:47:17.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe17806a430 0x7fe17806c8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe194161ac0 0x7fe19415c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1941611a0 0x7fe19415be70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 --2- 172.21.15.113:0/2893363722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe19415e2c0 0x7fe1940afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 >> 172.21.15.113:0/2893363722 conn(0x7fe1940b2090 msgr2=0x7fe1940b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:17.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 shutdown_connections 2023-12-19T13:47:17.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.308+0000 7fe19bfa4640 1 -- 172.21.15.113:0/2893363722 wait complete. 2023-12-19T13:47:17.328 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:47:17.328 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:47:17.441 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:47:17.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:47:17.573 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:47:17.573 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:17.634 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:47:17.634 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:17.686 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:47:17.686 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:17.741 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:17.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.952+0000 7f8a1c28f640 1 Processor -- start 2023-12-19T13:47:17.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.952+0000 7f8a1c28f640 1 -- start start 2023-12-19T13:47:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.954+0000 7f8a1c28f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a14146da0 0x7f8a140aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.954+0000 7f8a1c28f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a140d1070 con 0x7f8a14147180 2023-12-19T13:47:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.954+0000 7f8a1c28f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14162020 con 0x7f8a14161900 2023-12-19T13:47:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.954+0000 7f8a1c28f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140aabd0 con 0x7f8a14146da0 2023-12-19T13:47:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.954+0000 7f8a1982a640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8a14147180 0x7f8a141611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46006/0 (socket says 172.21.15.113:46006) 2023-12-19T13:47:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.954+0000 7f8a1982a640 1 -- 172.21.15.113:0/3538437621 learned_addr learned my addr 172.21.15.113:0/3538437621 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:17.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/3538437621 >> v2:172.21.15.151:3300/0 conn(0x7f8a14146da0 0x7f8a140aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723096663 0 0) 0x7f8a140d1070 con 0x7f8a14147180 2023-12-19T13:47:17.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a00003520 con 0x7f8a14147180 2023-12-19T13:47:17.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3858016017 0 0) 0x7f8a00003520 con 0x7f8a14147180 2023-12-19T13:47:17.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 >> v2:172.21.15.151:3300/0 conn(0x7f8a14146da0 msgr2=0x7f8a140aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:17.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 --2- 172.21.15.113:0/3538437621 >> v2:172.21.15.151:3300/0 conn(0x7f8a14146da0 0x7f8a140aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 >> v1:172.21.15.151:6789/0 conn(0x7f8a14161900 legacy=0x7f8a140d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140aaeb0 con 0x7f8a14147180 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8a04001670 con 0x7f8a14147180 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 >> v1:172.21.15.113:6789/0 conn(0x7f8a14147180 legacy=0x7f8a141611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.955+0000 7f8a19029640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a19029640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a000047c0 0x7f8a00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a19029640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a000051f0 0x7f8a0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a140aabd0 con 0x7f8a000039e0 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0000c150 con 0x7f8a000051f0 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0000c310 con 0x7f8a000047c0 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a1a02b640 1 -- 172.21.15.113:0/3538437621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a000047c0 msgr2=0x7f8a00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a000047c0 0x7f8a00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a1a02b640 1 -- 172.21.15.113:0/3538437621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a000051f0 msgr2=0x7f8a0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:17.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a000051f0 0x7f8a0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a1a02b640 1 -- 172.21.15.113:0/3538437621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00003520 con 0x7f8a000039e0 2023-12-19T13:47:17.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.956+0000 7f8a1a82c640 1 -- 172.21.15.113:0/3538437621 reap_dead start 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.957+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a00003e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007360 tx=0x7f8a000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6842c6174eacbad6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.957+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1002ccd0 con 0x7f8a000039e0 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1002ce30 con 0x7f8a000039e0 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a19029640 1 -- 172.21.15.113:0/3538437621 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10034660 con 0x7f8a000039e0 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a1c28f640 1 -- 172.21.15.113:0/3538437621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 msgr2=0x7f8a00003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a00003e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007360 tx=0x7f8a000057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a1c28f640 1 -- 172.21.15.113:0/3538437621 shutdown_connections 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/3538437621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a00003e00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a1c28f640 1 -- 172.21.15.113:0/3538437621 >> 172.21.15.113:0/3538437621 conn(0x7f8a14071a50 msgr2=0x7f8a140d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a1c28f640 1 -- 172.21.15.113:0/3538437621 shutdown_connections 2023-12-19T13:47:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.958+0000 7f8a1c28f640 1 -- 172.21.15.113:0/3538437621 wait complete. 2023-12-19T13:47:17.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.960+0000 7f8a1c28f640 1 Processor -- start 2023-12-19T13:47:17.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.960+0000 7f8a1c28f640 1 -- start start 2023-12-19T13:47:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1c28f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a140af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1c28f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1413db60 0x7f8a1413dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1c28f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a141f4450 0x7f8a141f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1c28f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1413e500 con 0x7f8a000039e0 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1c28f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1413d170 con 0x7f8a141f4450 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1c28f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a140af040 con 0x7f8a1413db60 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1a02b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a140af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1a02b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a140af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49440/0 (socket says 172.21.15.113:49440) 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.961+0000 7f8a1a02b640 1 -- 172.21.15.113:0/1369856827 learned_addr learned my addr 172.21.15.113:0/1369856827 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a1982a640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1413db60 0x7f8a1413dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a1a02b640 1 -- 172.21.15.113:0/1369856827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1413db60 msgr2=0x7f8a1413dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1413db60 0x7f8a1413dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a1a02b640 1 -- 172.21.15.113:0/1369856827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a141f4450 msgr2=0x7f8a141f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a141f4450 0x7f8a141f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a1a02b640 1 -- 172.21.15.113:0/1369856827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140ae170 con 0x7f8a000039e0 2023-12-19T13:47:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a1a02b640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a140af4d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a1002c670 tx=0x7f8a10004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.962+0000 7f8a0affd640 1 -- 172.21.15.113:0/1369856827 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10003b90 con 0x7f8a000039e0 2023-12-19T13:47:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.963+0000 7f8a0affd640 1 -- 172.21.15.113:0/1369856827 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10003d30 con 0x7f8a000039e0 2023-12-19T13:47:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.963+0000 7f8a0affd640 1 -- 172.21.15.113:0/1369856827 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10003ea0 con 0x7f8a000039e0 2023-12-19T13:47:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.963+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a140ae430 con 0x7f8a000039e0 2023-12-19T13:47:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.963+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a140ae9f0 con 0x7f8a000039e0 2023-12-19T13:47:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.964+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a14073ec0 con 0x7f8a000039e0 2023-12-19T13:47:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.965+0000 7f8a0affd640 1 -- 172.21.15.113:0/1369856827 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a1003b040 con 0x7f8a000039e0 2023-12-19T13:47:17.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.966+0000 7f8a0affd640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89f806a460 0x7f89f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:17.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.966+0000 7f8a0affd640 1 -- 172.21.15.113:0/1369856827 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a100aa950 con 0x7f8a000039e0 2023-12-19T13:47:17.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.966+0000 7f8a1982a640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89f806a460 0x7f89f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:17.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.966+0000 7f8a1982a640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89f806a460 0x7f89f806c920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a040011e0 tx=0x7f8a04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:17.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:17.970+0000 7f8a0affd640 1 -- 172.21.15.113:0/1369856827 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a10075fc0 con 0x7f8a000039e0 2023-12-19T13:47:18.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.161+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a1415ebd0 con 0x7f8a000039e0 2023-12-19T13:47:18.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.165+0000 7f8a0affd640 1 -- 172.21.15.113:0/1369856827 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f8a100795e0 con 0x7f8a000039e0 2023-12-19T13:47:18.166 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:18.166 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:46:31.922500+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89f806a460 msgr2=0x7f89f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89f806a460 0x7f89f806c920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a040011e0 tx=0x7f8a04009040 comp rx=0 tx=0).stop 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 msgr2=0x7f8a140af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a140af4d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a1002c670 tx=0x7f8a10004ab0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 shutdown_connections 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89f806a460 0x7f89f806c920 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a141f4450 0x7f8a141f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1413db60 0x7f8a1413dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 --2- 172.21.15.113:0/1369856827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a000039e0 0x7f8a140af4d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 >> 172.21.15.113:0/1369856827 conn(0x7f8a14071a50 msgr2=0x7f8a1415df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:18.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.167+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 shutdown_connections 2023-12-19T13:47:18.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.168+0000 7f8a1c28f640 1 -- 172.21.15.113:0/1369856827 wait complete. 2023-12-19T13:47:18.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:18.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:18.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.404+0000 7f8d46ce6640 1 Processor -- start 2023-12-19T13:47:18.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.404+0000 7f8d46ce6640 1 -- start start 2023-12-19T13:47:18.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.406+0000 7f8d46ce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8d400cd4e0 0x7f8d4015e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.406+0000 7f8d46ce6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d4015a4f0 0x7f8d4015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.406+0000 7f8d46ce6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.406+0000 7f8d46ce6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d400b06f0 con 0x7f8d400cd4e0 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.406+0000 7f8d46ce6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4015dae0 con 0x7f8d4015a4f0 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.406+0000 7f8d46ce6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4015b000 con 0x7f8d400afd60 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.406+0000 7f8d45ce4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8d400cd4e0 0x7f8d4015e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d45ce4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8d400cd4e0 0x7f8d4015e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49456/0 (socket says 172.21.15.113:49456) 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d45ce4640 1 -- 172.21.15.113:0/2051329123 learned_addr learned my addr 172.21.15.113:0/2051329123 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d454e3640 1 --2- 172.21.15.113:0/2051329123 >> v2:172.21.15.151:3300/0 conn(0x7f8d4015a4f0 0x7f8d4015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d464e5640 1 --2- 172.21.15.113:0/2051329123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d45ce4640 1 -- 172.21.15.113:0/2051329123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 msgr2=0x7f8d400b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d45ce4640 1 --2- 172.21.15.113:0/2051329123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d45ce4640 1 -- 172.21.15.113:0/2051329123 >> v2:172.21.15.151:3300/0 conn(0x7f8d4015a4f0 msgr2=0x7f8d4015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:18.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d45ce4640 1 --2- 172.21.15.113:0/2051329123 >> v2:172.21.15.151:3300/0 conn(0x7f8d4015a4f0 0x7f8d4015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d45ce4640 1 -- 172.21.15.113:0/2051329123 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4015b2e0 con 0x7f8d400cd4e0 2023-12-19T13:47:18.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d464e5640 1 --2- 172.21.15.113:0/2051329123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:18.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.407+0000 7f8d454e3640 1 --2- 172.21.15.113:0/2051329123 >> v2:172.21.15.151:3300/0 conn(0x7f8d4015a4f0 0x7f8d4015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.408+0000 7f8d45ce4640 1 --2- 172.21.15.113:0/2051329123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d400cd4e0 0x7f8d4015e580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d40071750 tx=0x7f8d3c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3e6e2dba6f2e10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.408+0000 7f8d44ce2640 1 -- 172.21.15.113:0/2051329123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c02ee90 con 0x7f8d400cd4e0 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.408+0000 7f8d44ce2640 1 -- 172.21.15.113:0/2051329123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c036440 con 0x7f8d400cd4e0 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.408+0000 7f8d44ce2640 1 -- 172.21.15.113:0/2051329123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0367d0 con 0x7f8d400cd4e0 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 -- 172.21.15.113:0/2051329123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d400cd4e0 msgr2=0x7f8d4015e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/2051329123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d400cd4e0 0x7f8d4015e580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d40071750 tx=0x7f8d3c02e0e0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 -- 172.21.15.113:0/2051329123 shutdown_connections 2023-12-19T13:47:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/2051329123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/2051329123 >> v2:172.21.15.151:3300/0 conn(0x7f8d4015a4f0 0x7f8d4015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/2051329123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d400cd4e0 0x7f8d4015e580 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 -- 172.21.15.113:0/2051329123 >> 172.21.15.113:0/2051329123 conn(0x7f8d4006f630 msgr2=0x7f8d4006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:18.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 -- 172.21.15.113:0/2051329123 shutdown_connections 2023-12-19T13:47:18.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.409+0000 7f8d46ce6640 1 -- 172.21.15.113:0/2051329123 wait complete. 2023-12-19T13:47:18.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.411+0000 7f8d46ce6640 1 Processor -- start 2023-12-19T13:47:18.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.412+0000 7f8d46ce6640 1 -- start start 2023-12-19T13:47:18.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d46ce6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d46ce6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d400cd4e0 0x7f8d400af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d46ce6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d4015a4f0 0x7f8d400af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d46ce6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d401f3c80 con 0x7f8d4015a4f0 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d46ce6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d401f0660 con 0x7f8d400cd4e0 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d46ce6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d401f3ef0 con 0x7f8d400afd60 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d464e5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d4015a4f0 0x7f8d400af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d464e5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d4015a4f0 0x7f8d400af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49466/0 (socket says 172.21.15.113:49466) 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.413+0000 7f8d464e5640 1 -- 172.21.15.113:0/3437716316 learned_addr learned my addr 172.21.15.113:0/3437716316 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d454e3640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d400cd4e0 0x7f8d400af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d45ce4640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d464e5640 1 -- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 msgr2=0x7f8d400cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d464e5640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d464e5640 1 -- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d400cd4e0 msgr2=0x7f8d400af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d464e5640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d400cd4e0 0x7f8d400af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d464e5640 1 -- 172.21.15.113:0/3437716316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c00b770 con 0x7f8d4015a4f0 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d454e3640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d400cd4e0 0x7f8d400af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d464e5640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d4015a4f0 0x7f8d400af810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800cd40 tx=0x7f8d3800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d367fc640 1 -- 172.21.15.113:0/3437716316 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800f680 con 0x7f8d4015a4f0 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d367fc640 1 -- 172.21.15.113:0/3437716316 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800f800 con 0x7f8d4015a4f0 2023-12-19T13:47:18.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d401f41d0 con 0x7f8d4015a4f0 2023-12-19T13:47:18.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.414+0000 7f8d367fc640 1 -- 172.21.15.113:0/3437716316 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800fbb0 con 0x7f8d4015a4f0 2023-12-19T13:47:18.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.415+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d401f4790 con 0x7f8d4015a4f0 2023-12-19T13:47:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.416+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d401f49b0 con 0x7f8d4015a4f0 2023-12-19T13:47:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.417+0000 7f8d367fc640 1 -- 172.21.15.113:0/3437716316 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d3800b040 con 0x7f8d4015a4f0 2023-12-19T13:47:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.417+0000 7f8d367fc640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d2406a430 0x7f8d2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.418+0000 7f8d367fc640 1 -- 172.21.15.113:0/3437716316 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d38089300 con 0x7f8d4015a4f0 2023-12-19T13:47:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.418+0000 7f8d45ce4640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d2406a430 0x7f8d2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.418+0000 7f8d45ce4640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d2406a430 0x7f8d2406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c038000 tx=0x7f8d3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.422+0000 7f8d367fc640 1 -- 172.21.15.113:0/3437716316 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d38054850 con 0x7f8d4015a4f0 2023-12-19T13:47:18.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.619+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d400ad8f0 con 0x7f8d4015a4f0 2023-12-19T13:47:18.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.620+0000 7f8d367fc640 1 -- 172.21.15.113:0/3437716316 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d38057e70 con 0x7f8d4015a4f0 2023-12-19T13:47:18.621 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d2406a430 msgr2=0x7f8d2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d2406a430 0x7f8d2406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c038000 tx=0x7f8d3c008040 comp rx=0 tx=0).stop 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d4015a4f0 msgr2=0x7f8d400af810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d4015a4f0 0x7f8d400af810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800cd40 tx=0x7f8d3800a650 comp rx=0 tx=0).stop 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 shutdown_connections 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d2406a430 0x7f8d2406c8f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d4015a4f0 0x7f8d400af810 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d400cd4e0 0x7f8d400af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 --2- 172.21.15.113:0/3437716316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d400afd60 0x7f8d400cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 >> 172.21.15.113:0/3437716316 conn(0x7f8d4006f630 msgr2=0x7f8d400cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 shutdown_connections 2023-12-19T13:47:18.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.623+0000 7f8d46ce6640 1 -- 172.21.15.113:0/3437716316 wait complete. 2023-12-19T13:47:18.643 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:18.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.854+0000 7f4d076c4640 1 Processor -- start 2023-12-19T13:47:18.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.854+0000 7f4d076c4640 1 -- start start 2023-12-19T13:47:18.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.856+0000 7f4d076c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d000d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.856+0000 7f4d076c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4d000cf2d0 0x7f4d000b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.856+0000 7f4d076c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000d0fb0 con 0x7f4d00144cc0 2023-12-19T13:47:18.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.856+0000 7f4d076c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d000cf760 con 0x7f4d000cf2d0 2023-12-19T13:47:18.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.856+0000 7f4d076c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000b4a30 con 0x7f4d0006a9f0 2023-12-19T13:47:18.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.857+0000 7f4d04c5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d000d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.857+0000 7f4d05460640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4d00144cc0 0x7f4d0006a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:60134/0 (socket says 172.21.15.113:60134) 2023-12-19T13:47:18.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.857+0000 7f4d05460640 1 -- 172.21.15.113:0/2031886214 learned_addr learned my addr 172.21.15.113:0/2031886214 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:18.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.857+0000 7f4d05c61640 1 --2- 172.21.15.113:0/2031886214 >> v2:172.21.15.151:3300/0 conn(0x7f4d000cf2d0 0x7f4d000b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.858+0000 7f4d05c61640 1 -- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 msgr2=0x7f4d000d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:18.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.858+0000 7f4d05c61640 1 --2- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d000d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.858+0000 7f4d05c61640 1 -- 172.21.15.113:0/2031886214 >> v1:172.21.15.151:6789/0 conn(0x7f4d00144cc0 legacy=0x7f4d0006a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.858+0000 7f4d05c61640 1 -- 172.21.15.113:0/2031886214 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000b4d10 con 0x7f4d000cf2d0 2023-12-19T13:47:18.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.858+0000 7f4cf7fff640 1 -- 172.21.15.113:0/2031886214 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617980759 0 0) 0x7f4d000d0fb0 con 0x7f4d00144cc0 2023-12-19T13:47:18.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.858+0000 7f4d04c5f640 1 --2- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d000d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:47:18.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.859+0000 7f4d05c61640 1 --2- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000b5ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009d90 tx=0x7f4cf802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4512ac4c85924110 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:18.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.860+0000 7f4cf7fff640 1 -- 172.21.15.113:0/2031886214 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf802cbd0 con 0x7f4d000cf2d0 2023-12-19T13:47:18.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.860+0000 7f4cf7fff640 1 -- 172.21.15.113:0/2031886214 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf802cd30 con 0x7f4d000cf2d0 2023-12-19T13:47:18.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.860+0000 7f4cf7fff640 1 -- 172.21.15.113:0/2031886214 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf802cea0 con 0x7f4d000cf2d0 2023-12-19T13:47:18.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 -- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 msgr2=0x7f4d000b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 --2- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000b5ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009d90 tx=0x7f4cf802be20 comp rx=0 tx=0).stop 2023-12-19T13:47:18.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 -- 172.21.15.113:0/2031886214 shutdown_connections 2023-12-19T13:47:18.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 --2- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000b5ad0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 --2- 172.21.15.113:0/2031886214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d000d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 -- 172.21.15.113:0/2031886214 >> 172.21.15.113:0/2031886214 conn(0x7f4d000d1210 msgr2=0x7f4d000d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:18.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 -- 172.21.15.113:0/2031886214 shutdown_connections 2023-12-19T13:47:18.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.861+0000 7f4d076c4640 1 -- 172.21.15.113:0/2031886214 wait complete. 2023-12-19T13:47:18.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.863+0000 7f4d076c4640 1 Processor -- start 2023-12-19T13:47:18.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.863+0000 7f4d076c4640 1 -- start start 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d076c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d00142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d076c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d076c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d00144cc0 0x7f4d000b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d076c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000ae300 con 0x7f4d00144cc0 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d076c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d00143500 con 0x7f4d000cf2d0 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d076c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001eec40 con 0x7f4d0006a9f0 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d00144cc0 0x7f4d000b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d00144cc0 0x7f4d000b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49482/0 (socket says 172.21.15.113:49482) 2023-12-19T13:47:18.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 -- 172.21.15.113:0/174929066 learned_addr learned my addr 172.21.15.113:0/174929066 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d04c5f640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05460640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d00142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 -- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 msgr2=0x7f4d00142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d00142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 -- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 msgr2=0x7f4d000aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d05c61640 1 -- 172.21.15.113:0/174929066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00093a0 con 0x7f4d00144cc0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.864+0000 7f4d04c5f640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.865+0000 7f4d05c61640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d00144cc0 0x7f4d000b1b20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009d90 tx=0x7f4cf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.865+0000 7f4cf5ffb640 1 -- 172.21.15.113:0/174929066 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf802cea0 con 0x7f4d00144cc0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.865+0000 7f4cf5ffb640 1 -- 172.21.15.113:0/174929066 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8040650 con 0x7f4d00144cc0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.865+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf8009a70 con 0x7f4d00144cc0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.865+0000 7f4cf5ffb640 1 -- 172.21.15.113:0/174929066 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8040a00 con 0x7f4d00144cc0 2023-12-19T13:47:18.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.865+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d001ef200 con 0x7f4d00144cc0 2023-12-19T13:47:18.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.866+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d000b4fd0 con 0x7f4d00144cc0 2023-12-19T13:47:18.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.867+0000 7f4cf5ffb640 1 -- 172.21.15.113:0/174929066 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4cf8040b60 con 0x7f4d00144cc0 2023-12-19T13:47:18.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.868+0000 7f4cf5ffb640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ce406a430 0x7f4ce406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:18.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.868+0000 7f4cf5ffb640 1 -- 172.21.15.113:0/174929066 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf80ab550 con 0x7f4d00144cc0 2023-12-19T13:47:18.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.868+0000 7f4d05460640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ce406a430 0x7f4ce406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:18.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.869+0000 7f4d05460640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ce406a430 0x7f4ce406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc000f60 tx=0x7f4cfc007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:18.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:18.873+0000 7f4cf5ffb640 1 -- 172.21.15.113:0/174929066 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d000b4fd0 con 0x7f4d00144cc0 2023-12-19T13:47:19.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.069+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d000b4fd0 con 0x7f4d00144cc0 2023-12-19T13:47:19.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.070+0000 7f4cf5ffb640 1 -- 172.21.15.113:0/174929066 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d000b4fd0 con 0x7f4d00144cc0 2023-12-19T13:47:19.070 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:19.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ce406a430 msgr2=0x7f4ce406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ce406a430 0x7f4ce406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc000f60 tx=0x7f4cfc007c00 comp rx=0 tx=0).stop 2023-12-19T13:47:19.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d00144cc0 msgr2=0x7f4d000b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d00144cc0 0x7f4d000b1b20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009d90 tx=0x7f4cf8004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:19.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 shutdown_connections 2023-12-19T13:47:19.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ce406a430 0x7f4ce406c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d00144cc0 0x7f4d000b1b20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d000cf2d0 0x7f4d000aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 --2- 172.21.15.113:0/174929066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d0006a9f0 0x7f4d00142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 >> 172.21.15.113:0/174929066 conn(0x7f4d000d1210 msgr2=0x7f4d00143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:19.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 shutdown_connections 2023-12-19T13:47:19.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.072+0000 7f4d076c4640 1 -- 172.21.15.113:0/174929066 wait complete. 2023-12-19T13:47:19.091 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:19.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.302+0000 7fa8f8f5c640 1 Processor -- start 2023-12-19T13:47:19.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.303+0000 7fa8f8f5c640 1 -- start start 2023-12-19T13:47:19.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.304+0000 7fa8f8f5c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa8f4154760 0x7fa8f415b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.304+0000 7fa8f8f5c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b0070 0x7fa8f40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.304+0000 7fa8f8f5c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f40ccbd0 con 0x7fa8f40cb810 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.304+0000 7fa8f8f5c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40ccf20 con 0x7fa8f4154760 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.304+0000 7fa8f8f5c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40b0a60 con 0x7fa8f40b0070 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa8f4154760 0x7fa8f415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa8f4154760 0x7fa8f415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49486/0 (socket says 172.21.15.113:49486) 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f259c640 1 -- 172.21.15.113:0/3093762900 learned_addr learned my addr 172.21.15.113:0/3093762900 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f2d9d640 1 --2- 172.21.15.113:0/3093762900 >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b0070 0x7fa8f40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f259c640 1 -- 172.21.15.113:0/3093762900 >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b0070 msgr2=0x7fa8f40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:19.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f259c640 1 --2- 172.21.15.113:0/3093762900 >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b0070 0x7fa8f40b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f259c640 1 -- 172.21.15.113:0/3093762900 >> v1:172.21.15.113:6789/0 conn(0x7fa8f40cb810 legacy=0x7fa8f40b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f259c640 1 -- 172.21.15.113:0/3093762900 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4154b40 con 0x7fa8f4154760 2023-12-19T13:47:19.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.305+0000 7fa8f2d9d640 1 --2- 172.21.15.113:0/3093762900 >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b0070 0x7fa8f40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.306+0000 7fa8f259c640 1 --2- 172.21.15.113:0/3093762900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f4154760 0x7fa8f415b290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40662e0 tx=0x7fa8e402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5073917264d6fbb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f1d9b640 1 -- 172.21.15.113:0/3093762900 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4031880 con 0x7fa8f4154760 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f1d9b640 1 -- 172.21.15.113:0/3093762900 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e40319e0 con 0x7fa8f4154760 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f1d9b640 1 -- 172.21.15.113:0/3093762900 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4031d70 con 0x7fa8f4154760 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3093762900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f4154760 msgr2=0x7fa8f415b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3093762900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f4154760 0x7fa8f415b290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40662e0 tx=0x7fa8e402b920 comp rx=0 tx=0).stop 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3093762900 shutdown_connections 2023-12-19T13:47:19.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3093762900 >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b0070 0x7fa8f40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3093762900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f4154760 0x7fa8f415b290 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3093762900 >> 172.21.15.113:0/3093762900 conn(0x7fa8f4073150 msgr2=0x7fa8f40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:19.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.307+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3093762900 shutdown_connections 2023-12-19T13:47:19.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.308+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3093762900 wait complete. 2023-12-19T13:47:19.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.309+0000 7fa8f8f5c640 1 Processor -- start 2023-12-19T13:47:19.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.309+0000 7fa8f8f5c640 1 -- start start 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f8f5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b0070 0x7fa8f40ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f8f5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40cb810 0x7fa8f41576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f8f5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4154760 0x7fa8f4154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f8f5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4155a30 con 0x7fa8f40b0070 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f8f5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4157c00 con 0x7fa8f40cb810 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f8f5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4148300 con 0x7fa8f4154760 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b0070 0x7fa8f40ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b0070 0x7fa8f40ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49488/0 (socket says 172.21.15.113:49488) 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.310+0000 7fa8f259c640 1 -- 172.21.15.113:0/3302576060 learned_addr learned my addr 172.21.15.113:0/3302576060 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:19.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8f259c640 1 -- 172.21.15.113:0/3302576060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4154760 msgr2=0x7fa8f4154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8f259c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4154760 0x7fa8f4154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8f259c640 1 -- 172.21.15.113:0/3302576060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40cb810 msgr2=0x7fa8f41576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8f259c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40cb810 0x7fa8f41576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8f259c640 1 -- 172.21.15.113:0/3302576060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40094d0 con 0x7fa8f40b0070 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8f259c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b0070 0x7fa8f40ad920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4000c00 tx=0x7fa8e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8eaffd640 1 -- 172.21.15.113:0/3302576060 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e403ad30 con 0x7fa8f40b0070 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8eaffd640 1 -- 172.21.15.113:0/3302576060 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e40443f0 con 0x7fa8f40b0070 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.311+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f4155210 con 0x7fa8f40b0070 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.312+0000 7fa8eaffd640 1 -- 172.21.15.113:0/3302576060 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40447a0 con 0x7fa8f40b0070 2023-12-19T13:47:19.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.312+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f4155750 con 0x7fa8f40b0070 2023-12-19T13:47:19.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.313+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4061910 con 0x7fa8f40b0070 2023-12-19T13:47:19.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.314+0000 7fa8eaffd640 1 -- 172.21.15.113:0/3302576060 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa8e404d450 con 0x7fa8f40b0070 2023-12-19T13:47:19.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.314+0000 7fa8eaffd640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.315+0000 7fa8eaffd640 1 -- 172.21.15.113:0/3302576060 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8e40ab130 con 0x7fa8f40b0070 2023-12-19T13:47:19.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.315+0000 7fa8ebfff640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.315+0000 7fa8ebfff640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc000f60 tx=0x7fa8dc0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:19.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.319+0000 7fa8eaffd640 1 -- 172.21.15.113:0/3302576060 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa8e4076680 con 0x7fa8f40b0070 2023-12-19T13:47:19.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.515+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8f40b25b0 con 0x7fa8f40b0070 2023-12-19T13:47:19.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.516+0000 7fa8eaffd640 1 -- 172.21.15.113:0/3302576060 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8e4079ca0 con 0x7fa8f40b0070 2023-12-19T13:47:19.517 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:19.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 msgr2=0x7fa8d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc000f60 tx=0x7fa8dc0079b0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b0070 msgr2=0x7fa8f40ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b0070 0x7fa8f40ad920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4000c00 tx=0x7fa8e40046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 shutdown_connections 2023-12-19T13:47:19.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4154760 0x7fa8f4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40cb810 0x7fa8f41576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 --2- 172.21.15.113:0/3302576060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b0070 0x7fa8f40ad920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.518+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 >> 172.21.15.113:0/3302576060 conn(0x7fa8f4073150 msgr2=0x7fa8f40cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:19.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.519+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 shutdown_connections 2023-12-19T13:47:19.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.519+0000 7fa8f8f5c640 1 -- 172.21.15.113:0/3302576060 wait complete. 2023-12-19T13:47:19.538 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:47:19.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.755+0000 7f5c48d2e640 1 Processor -- start 2023-12-19T13:47:19.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.756+0000 7f5c48d2e640 1 -- start start 2023-12-19T13:47:19.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.757+0000 7f5c48d2e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5c4406c6b0 0x7f5c44166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.757+0000 7f5c48d2e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4406bb30 con 0x7f5c441449e0 2023-12-19T13:47:19.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.757+0000 7f5c48d2e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c440b0070 con 0x7f5c440b0b50 2023-12-19T13:47:19.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.757+0000 7f5c48d2e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c440b0350 con 0x7f5c4406c6b0 2023-12-19T13:47:19.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.758+0000 7f5c4259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5c441449e0 0x7f5c440af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46022/0 (socket says 172.21.15.113:46022) 2023-12-19T13:47:19.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.758+0000 7f5c4259c640 1 -- 172.21.15.113:0/2779454144 learned_addr learned my addr 172.21.15.113:0/2779454144 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:19.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.758+0000 7f5c42d9d640 1 --2- 172.21.15.113:0/2779454144 >> v2:172.21.15.151:3300/0 conn(0x7f5c4406c6b0 0x7f5c44166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.758+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568840053 0 0) 0x7f5c4406bb30 con 0x7f5c441449e0 2023-12-19T13:47:19.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.758+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c2c003520 con 0x7f5c441449e0 2023-12-19T13:47:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274514131 0 0) 0x7f5c2c003520 con 0x7f5c441449e0 2023-12-19T13:47:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 >> v2:172.21.15.151:3300/0 conn(0x7f5c4406c6b0 msgr2=0x7f5c44166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 --2- 172.21.15.113:0/2779454144 >> v2:172.21.15.151:3300/0 conn(0x7f5c4406c6b0 0x7f5c44166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 >> v1:172.21.15.151:6789/0 conn(0x7f5c440b0b50 legacy=0x7f5c4406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440b0630 con 0x7f5c441449e0 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5c34001670 con 0x7f5c441449e0 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 >> v1:172.21.15.113:6789/0 conn(0x7f5c441449e0 legacy=0x7f5c440af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c2c003a30 0x7f5c2c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2c0047c0 0x7f5c2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c005180 0x7f5c2c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440b0350 con 0x7f5c2c0047c0 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c00c120 con 0x7f5c2c005180 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c00c2e0 con 0x7f5c2c003a30 2023-12-19T13:47:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.759+0000 7f5c41d9b640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2c0047c0 0x7f5c2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c4259c640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c2c003a30 0x7f5c2c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c42d9d640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c005180 0x7f5c2c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c41d9b640 1 -- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c2c003a30 msgr2=0x7f5c2c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c41d9b640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c2c003a30 0x7f5c2c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c41d9b640 1 -- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c005180 msgr2=0x7f5c2c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c41d9b640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c005180 0x7f5c2c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c41d9b640 1 -- 172.21.15.113:0/2779454144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c003520 con 0x7f5c2c0047c0 2023-12-19T13:47:19.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.760+0000 7f5c42d9d640 1 -- 172.21.15.113:0/2779454144 reap_dead start 2023-12-19T13:47:19.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.762+0000 7f5c41d9b640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2c0047c0 0x7f5c2c004c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c38003db0 tx=0x7f5c2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3013d7b611183b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:19.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.762+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38032600 con 0x7f5c2c0047c0 2023-12-19T13:47:19.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.762+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3802e050 con 0x7f5c2c0047c0 2023-12-19T13:47:19.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.762+0000 7f5c4159a640 1 -- 172.21.15.113:0/2779454144 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c380329e0 con 0x7f5c2c0047c0 2023-12-19T13:47:19.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.762+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2779454144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2c0047c0 msgr2=0x7f5c2c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.762+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2c0047c0 0x7f5c2c004c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c38003db0 tx=0x7f5c2c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.763+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2779454144 shutdown_connections 2023-12-19T13:47:19.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.763+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2779454144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2c0047c0 0x7f5c2c004c40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.763+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2779454144 >> 172.21.15.113:0/2779454144 conn(0x7f5c440cbb70 msgr2=0x7f5c440cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:19.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.763+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2779454144 shutdown_connections 2023-12-19T13:47:19.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.763+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2779454144 wait complete. 2023-12-19T13:47:19.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.764+0000 7f5c48d2e640 1 Processor -- start 2023-12-19T13:47:19.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.765+0000 7f5c48d2e640 1 -- start start 2023-12-19T13:47:19.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.765+0000 7f5c48d2e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c0047c0 0x7f5c441f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.765+0000 7f5c48d2e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4413b4d0 0x7f5c4415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.765+0000 7f5c48d2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4413ca70 0x7f5c440700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.765+0000 7f5c48d2e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4413c5e0 con 0x7f5c4413ca70 2023-12-19T13:47:19.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.765+0000 7f5c48d2e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4413b9d0 con 0x7f5c2c0047c0 2023-12-19T13:47:19.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.765+0000 7f5c48d2e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4413bcb0 con 0x7f5c4413b4d0 2023-12-19T13:47:19.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4413ca70 0x7f5c440700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4413ca70 0x7f5c440700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49504/0 (socket says 172.21.15.113:49504) 2023-12-19T13:47:19.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 -- 172.21.15.113:0/2106722242 learned_addr learned my addr 172.21.15.113:0/2106722242 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c41d9b640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4413b4d0 0x7f5c4415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c4259c640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c0047c0 0x7f5c441f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 -- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4413b4d0 msgr2=0x7f5c4415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4413b4d0 0x7f5c4415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 -- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c0047c0 msgr2=0x7f5c441f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c0047c0 0x7f5c441f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c42d9d640 1 -- 172.21.15.113:0/2106722242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4413bf90 con 0x7f5c4413ca70 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.766+0000 7f5c41d9b640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4413b4d0 0x7f5c4415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:19.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.767+0000 7f5c42d9d640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4413ca70 0x7f5c440700b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c4406d890 tx=0x7f5c3c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:19.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.767+0000 7f5c32ffd640 1 -- 172.21.15.113:0/2106722242 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c003da0 con 0x7f5c4413ca70 2023-12-19T13:47:19.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.767+0000 7f5c32ffd640 1 -- 172.21.15.113:0/2106722242 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c007e80 con 0x7f5c4413ca70 2023-12-19T13:47:19.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.767+0000 7f5c32ffd640 1 -- 172.21.15.113:0/2106722242 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c004270 con 0x7f5c4413ca70 2023-12-19T13:47:19.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.767+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4413c270 con 0x7f5c4413ca70 2023-12-19T13:47:19.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.767+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4415d4a0 con 0x7f5c4413ca70 2023-12-19T13:47:19.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.768+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4413c400 con 0x7f5c4413ca70 2023-12-19T13:47:19.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.769+0000 7f5c32ffd640 1 -- 172.21.15.113:0/2106722242 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c3c0043d0 con 0x7f5c4413ca70 2023-12-19T13:47:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.770+0000 7f5c32ffd640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a460 0x7f5c2406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.770+0000 7f5c32ffd640 1 -- 172.21.15.113:0/2106722242 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5c3c08cde0 con 0x7f5c4413ca70 2023-12-19T13:47:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.770+0000 7f5c4259c640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a460 0x7f5c2406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.771+0000 7f5c4259c640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a460 0x7f5c2406c920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5c34001eb0 tx=0x7f5c34000f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:19.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.775+0000 7f5c32ffd640 1 -- 172.21.15.113:0/2106722242 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c3c058390 con 0x7f5c4413ca70 2023-12-19T13:47:19.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.979+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5c44061910 con 0x7f5c4413ca70 2023-12-19T13:47:19.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.979+0000 7f5c32ffd640 1 -- 172.21.15.113:0/2106722242 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5c3c05b9b0 con 0x7f5c4413ca70 2023-12-19T13:47:19.981 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:47:19.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a460 msgr2=0x7f5c2406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a460 0x7f5c2406c920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5c34001eb0 tx=0x7f5c34000f50 comp rx=0 tx=0).stop 2023-12-19T13:47:19.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4413ca70 msgr2=0x7f5c440700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:19.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4413ca70 0x7f5c440700b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c4406d890 tx=0x7f5c3c007700 comp rx=0 tx=0).stop 2023-12-19T13:47:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 shutdown_connections 2023-12-19T13:47:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c2406a460 0x7f5c2406c920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4413ca70 0x7f5c440700b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c4413b4d0 0x7f5c4415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 --2- 172.21.15.113:0/2106722242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c2c0047c0 0x7f5c441f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:19.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 >> 172.21.15.113:0/2106722242 conn(0x7f5c440cbb70 msgr2=0x7f5c4415acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:19.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 shutdown_connections 2023-12-19T13:47:19.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:19.982+0000 7f5c48d2e640 1 -- 172.21.15.113:0/2106722242 wait complete. 2023-12-19T13:47:20.002 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:47:20.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:20.003 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T13:47:20.099 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:47:20.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:20.099 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:47:20.171 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:20.171 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:20.231 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:20.231 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:20.286 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:20.286 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:20.340 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:20.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.564+0000 7f9cd5363640 1 Processor -- start 2023-12-19T13:47:20.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.564+0000 7f9cd5363640 1 -- start start 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9cd5363640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00d2b00 0x7f9cd00d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9cd5363640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9cd00ce110 0x7f9cd00ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9cd5363640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd00cd840 con 0x7f9cd0146e10 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9cd5363640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd00d2430 con 0x7f9cd00ce110 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9cd5363640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00ceae0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9ccf7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9cd00ce110 0x7f9cd00ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9ccf7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9cd00ce110 0x7f9cd00ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49514/0 (socket says 172.21.15.113:49514) 2023-12-19T13:47:20.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.566+0000 7f9ccf7fe640 1 -- 172.21.15.113:0/764161505 learned_addr learned my addr 172.21.15.113:0/764161505 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:20.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.567+0000 7f9cce7fc640 1 --2- 172.21.15.113:0/764161505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00d2b00 0x7f9cd00d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:20.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.567+0000 7f9ccf7fe640 1 -- 172.21.15.113:0/764161505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00d2b00 msgr2=0x7f9cd00d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:20.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.567+0000 7f9ccf7fe640 1 --2- 172.21.15.113:0/764161505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00d2b00 0x7f9cd00d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.567+0000 7f9ccf7fe640 1 -- 172.21.15.113:0/764161505 >> v1:172.21.15.151:6789/0 conn(0x7f9cd0146e10 legacy=0x7f9cd00b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:20.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.567+0000 7f9ccf7fe640 1 -- 172.21.15.113:0/764161505 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00b6e90 con 0x7f9cd00ce110 2023-12-19T13:47:20.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.568+0000 7f9ccf7fe640 1 --2- 172.21.15.113:0/764161505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00ce110 0x7f9cd00ce5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80098a0 tx=0x7f9cc802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61e056d817868be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:20.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.568+0000 7f9ccdffb640 1 -- 172.21.15.113:0/764161505 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8031640 con 0x7f9cd00ce110 2023-12-19T13:47:20.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9ccdffb640 1 -- 172.21.15.113:0/764161505 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc80317a0 con 0x7f9cd00ce110 2023-12-19T13:47:20.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9ccdffb640 1 -- 172.21.15.113:0/764161505 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8031b30 con 0x7f9cd00ce110 2023-12-19T13:47:20.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 -- 172.21.15.113:0/764161505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00ce110 msgr2=0x7f9cd00ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:20.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 --2- 172.21.15.113:0/764161505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00ce110 0x7f9cd00ce5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80098a0 tx=0x7f9cc802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 -- 172.21.15.113:0/764161505 shutdown_connections 2023-12-19T13:47:20.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 --2- 172.21.15.113:0/764161505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00ce110 0x7f9cd00ce5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 --2- 172.21.15.113:0/764161505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00d2b00 0x7f9cd00d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 -- 172.21.15.113:0/764161505 >> 172.21.15.113:0/764161505 conn(0x7f9cd00b29c0 msgr2=0x7f9cd00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:20.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 -- 172.21.15.113:0/764161505 shutdown_connections 2023-12-19T13:47:20.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.569+0000 7f9cd5363640 1 -- 172.21.15.113:0/764161505 wait complete. 2023-12-19T13:47:20.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.571+0000 7f9cd5363640 1 Processor -- start 2023-12-19T13:47:20.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.571+0000 7f9cd5363640 1 -- start start 2023-12-19T13:47:20.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cd5363640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00ce110 0x7f9cd0150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:20.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cd5363640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00d2b00 0x7f9cd013d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:20.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cd5363640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd0146e10 0x7f9cd0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:20.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cd5363640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd015fb80 con 0x7f9cd00d2b00 2023-12-19T13:47:20.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cd5363640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0071000 con 0x7f9cd0146e10 2023-12-19T13:47:20.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cd5363640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd013df90 con 0x7f9cd00ce110 2023-12-19T13:47:20.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cce7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00d2b00 0x7f9cd013d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cce7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00d2b00 0x7f9cd013d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49516/0 (socket says 172.21.15.113:49516) 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.572+0000 7f9cce7fc640 1 -- 172.21.15.113:0/3090145598 learned_addr learned my addr 172.21.15.113:0/3090145598 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cceffd640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00ce110 0x7f9cd0150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cce7fc640 1 -- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00ce110 msgr2=0x7f9cd0150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cce7fc640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00ce110 0x7f9cd0150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cce7fc640 1 -- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd0146e10 msgr2=0x7f9cd0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cce7fc640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd0146e10 0x7f9cd0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cce7fc640 1 -- 172.21.15.113:0/3090145598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80094d0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cceffd640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00ce110 0x7f9cd0150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:20.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cce7fc640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00d2b00 0x7f9cd013d900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800d830 tx=0x7f9cb800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:20.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cc77fe640 1 -- 172.21.15.113:0/3090145598 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800b6c0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cc77fe640 1 -- 172.21.15.113:0/3090145598 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb800b820 con 0x7f9cd00d2b00 2023-12-19T13:47:20.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd013e270 con 0x7f9cd00d2b00 2023-12-19T13:47:20.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.573+0000 7f9cc77fe640 1 -- 172.21.15.113:0/3090145598 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800bbb0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.574+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd013e830 con 0x7f9cd00d2b00 2023-12-19T13:47:20.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.575+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd015fcc0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.575+0000 7f9cc77fe640 1 -- 172.21.15.113:0/3090145598 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9cb801e460 con 0x7f9cd00d2b00 2023-12-19T13:47:20.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.577+0000 7f9cc77fe640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9cb006a460 0x7f9cb006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:20.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.577+0000 7f9cc77fe640 1 -- 172.21.15.113:0/3090145598 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9cb8089090 con 0x7f9cd00d2b00 2023-12-19T13:47:20.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.577+0000 7f9cceffd640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9cb006a460 0x7f9cb006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:20.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.578+0000 7f9cceffd640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9cb006a460 0x7f9cb006c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0004520 tx=0x7f9cc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:20.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.581+0000 7f9cc77fe640 1 -- 172.21.15.113:0/3090145598 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9cd015fcc0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.772+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cd015fcc0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.775+0000 7f9cc77fe640 1 -- 172.21.15.113:0/3090145598 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16184 (secure 0 0 0) 0x7f9cd015fcc0 con 0x7f9cd00d2b00 2023-12-19T13:47:20.776 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:20.777 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":22,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:20.429480+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2a","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9cb006a460 msgr2=0x7f9cb006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9cb006a460 0x7f9cb006c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0004520 tx=0x7f9cc0009040 comp rx=0 tx=0).stop 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00d2b00 msgr2=0x7f9cd013d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00d2b00 0x7f9cd013d900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800d830 tx=0x7f9cb800dcf0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 shutdown_connections 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9cb006a460 0x7f9cb006c920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd0146e10 0x7f9cd0070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9cd00d2b00 0x7f9cd013d900 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 --2- 172.21.15.113:0/3090145598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cd00ce110 0x7f9cd0150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 >> 172.21.15.113:0/3090145598 conn(0x7f9cd00b29c0 msgr2=0x7f9cd00b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:20.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 shutdown_connections 2023-12-19T13:47:20.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:20.778+0000 7f9cd5363640 1 -- 172.21.15.113:0/3090145598 wait complete. 2023-12-19T13:47:20.796 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:20.797 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:21.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.010+0000 7fb10f59e640 1 Processor -- start 2023-12-19T13:47:21.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.011+0000 7fb10f59e640 1 -- start start 2023-12-19T13:47:21.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.012+0000 7fb10f59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb11015d2d0 0x7fb11015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.012+0000 7fb10f59e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100ccec0 con 0x7fb1100cbbb0 2023-12-19T13:47:21.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.012+0000 7fb10f59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100cc2b0 con 0x7fb1100cebf0 2023-12-19T13:47:21.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.012+0000 7fb10f59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11015dc90 con 0x7fb11015d2d0 2023-12-19T13:47:21.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10e59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb1100cbbb0 0x7fb1100afdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46034/0 (socket says 172.21.15.113:46034) 2023-12-19T13:47:21.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10e59c640 1 -- 172.21.15.113:0/2692436621 learned_addr learned my addr 172.21.15.113:0/2692436621 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:21.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10dd9b640 1 --2- 172.21.15.113:0/2692436621 >> v2:172.21.15.113:3300/0 conn(0x7fb11015d2d0 0x7fb11015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10d59a640 1 -- 172.21.15.113:0/2692436621 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255275241 0 0) 0x7fb1100ccec0 con 0x7fb1100cbbb0 2023-12-19T13:47:21.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10d59a640 1 -- 172.21.15.113:0/2692436621 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0fc003520 con 0x7fb1100cbbb0 2023-12-19T13:47:21.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10dd9b640 1 -- 172.21.15.113:0/2692436621 >> v1:172.21.15.151:6789/0 conn(0x7fb1100cebf0 legacy=0x7fb1100cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:21.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10dd9b640 1 -- 172.21.15.113:0/2692436621 >> v1:172.21.15.113:6789/0 conn(0x7fb1100cbbb0 legacy=0x7fb1100afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.013+0000 7fb10dd9b640 1 -- 172.21.15.113:0/2692436621 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100cc590 con 0x7fb11015d2d0 2023-12-19T13:47:21.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.014+0000 7fb10dd9b640 1 --2- 172.21.15.113:0/2692436621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb11015d2d0 0x7fb11015d750 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80097a0 tx=0x7fb0f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf046a9799d5bb21 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.014+0000 7fb10d59a640 1 -- 172.21.15.113:0/2692436621 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8031830 con 0x7fb11015d2d0 2023-12-19T13:47:21.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.014+0000 7fb10d59a640 1 -- 172.21.15.113:0/2692436621 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8031990 con 0x7fb11015d2d0 2023-12-19T13:47:21.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10d59a640 1 -- 172.21.15.113:0/2692436621 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8031d20 con 0x7fb11015d2d0 2023-12-19T13:47:21.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10f59e640 1 -- 172.21.15.113:0/2692436621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb11015d2d0 msgr2=0x7fb11015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10f59e640 1 --2- 172.21.15.113:0/2692436621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb11015d2d0 0x7fb11015d750 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80097a0 tx=0x7fb0f802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10f59e640 1 -- 172.21.15.113:0/2692436621 shutdown_connections 2023-12-19T13:47:21.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10f59e640 1 --2- 172.21.15.113:0/2692436621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb11015d2d0 0x7fb11015d750 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10f59e640 1 -- 172.21.15.113:0/2692436621 >> 172.21.15.113:0/2692436621 conn(0x7fb11006f630 msgr2=0x7fb11006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:21.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10f59e640 1 -- 172.21.15.113:0/2692436621 shutdown_connections 2023-12-19T13:47:21.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.015+0000 7fb10f59e640 1 -- 172.21.15.113:0/2692436621 wait complete. 2023-12-19T13:47:21.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.018+0000 7fb10f59e640 1 Processor -- start 2023-12-19T13:47:21.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.018+0000 7fb10f59e640 1 -- start start 2023-12-19T13:47:21.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100cbbb0 0x7fb1101427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10f59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1100cebf0 0x7fb11006b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb11015d2d0 0x7fb1100ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10f59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11006dd20 con 0x7fb1100cebf0 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11006ce90 con 0x7fb1100cbbb0 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11006d0a0 con 0x7fb11015d2d0 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10dd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1100cebf0 0x7fb11006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10dd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1100cebf0 0x7fb11006b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49520/0 (socket says 172.21.15.113:49520) 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.019+0000 7fb10dd9b640 1 -- 172.21.15.113:0/3032228035 learned_addr learned my addr 172.21.15.113:0/3032228035 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10e59c640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100cbbb0 0x7fb1101427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10ed9d640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb11015d2d0 0x7fb1100ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10dd9b640 1 -- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb11015d2d0 msgr2=0x7fb1100ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10dd9b640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb11015d2d0 0x7fb1100ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10dd9b640 1 -- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100cbbb0 msgr2=0x7fb1101427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10dd9b640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100cbbb0 0x7fb1101427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10dd9b640 1 -- 172.21.15.113:0/3032228035 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8009400 con 0x7fb1100cebf0 2023-12-19T13:47:21.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.020+0000 7fb10dd9b640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1100cebf0 0x7fb11006b220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098c0 tx=0x7fb0f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.021+0000 7fb106ffd640 1 -- 172.21.15.113:0/3032228035 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f803a6f0 con 0x7fb1100cebf0 2023-12-19T13:47:21.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.021+0000 7fb106ffd640 1 -- 172.21.15.113:0/3032228035 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f803a870 con 0x7fb1100cebf0 2023-12-19T13:47:21.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.021+0000 7fb106ffd640 1 -- 172.21.15.113:0/3032228035 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f803ac20 con 0x7fb1100cebf0 2023-12-19T13:47:21.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.021+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11006d380 con 0x7fb1100cebf0 2023-12-19T13:47:21.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.021+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11006d940 con 0x7fb1100cebf0 2023-12-19T13:47:21.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.022+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11006de60 con 0x7fb1100cebf0 2023-12-19T13:47:21.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.023+0000 7fb106ffd640 1 -- 172.21.15.113:0/3032228035 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0f804c3b0 con 0x7fb1100cebf0 2023-12-19T13:47:21.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.024+0000 7fb106ffd640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb0f006a430 0x7fb0f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.024+0000 7fb106ffd640 1 -- 172.21.15.113:0/3032228035 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb0f80aa5e0 con 0x7fb1100cebf0 2023-12-19T13:47:21.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.024+0000 7fb10e59c640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb0f006a430 0x7fb0f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.025+0000 7fb10e59c640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb0f006a430 0x7fb0f006c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb100001560 tx=0x7fb1000019f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.028+0000 7fb106ffd640 1 -- 172.21.15.113:0/3032228035 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb11006de60 con 0x7fb1100cebf0 2023-12-19T13:47:21.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.217+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb11006de60 con 0x7fb1100cebf0 2023-12-19T13:47:21.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.218+0000 7fb106ffd640 1 -- 172.21.15.113:0/3032228035 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb11006de60 con 0x7fb1100cebf0 2023-12-19T13:47:21.219 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.220+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb0f006a430 msgr2=0x7fb0f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.220+0000 7fb10f59e640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb0f006a430 0x7fb0f006c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb100001560 tx=0x7fb1000019f0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.220+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1100cebf0 msgr2=0x7fb11006b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.220+0000 7fb10f59e640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1100cebf0 0x7fb11006b220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098c0 tx=0x7fb0f80046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 shutdown_connections 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb0f006a430 0x7fb0f006c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb11015d2d0 0x7fb1100ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1100cebf0 0x7fb11006b220 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 --2- 172.21.15.113:0/3032228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100cbbb0 0x7fb1101427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 >> 172.21.15.113:0/3032228035 conn(0x7fb11006f630 msgr2=0x7fb110159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 shutdown_connections 2023-12-19T13:47:21.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.221+0000 7fb10f59e640 1 -- 172.21.15.113:0/3032228035 wait complete. 2023-12-19T13:47:21.241 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:21.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.457+0000 7f20bfe04640 1 Processor -- start 2023-12-19T13:47:21.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.457+0000 7f20bfe04640 1 -- start start 2023-12-19T13:47:21.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.458+0000 7f20bfe04640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20b815e750 0x7f20b806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.458+0000 7f20bfe04640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b80b2600 con 0x7f20b80b1710 2023-12-19T13:47:21.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.458+0000 7f20bfe04640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b80b1d60 con 0x7f20b8157aa0 2023-12-19T13:47:21.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.458+0000 7f20bfe04640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b80b2040 con 0x7f20b815e750 2023-12-19T13:47:21.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.459+0000 7f20bd39f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f20b80b1710 0x7f20b815e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46040/0 (socket says 172.21.15.113:46040) 2023-12-19T13:47:21.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.459+0000 7f20bd39f640 1 -- 172.21.15.113:0/1984023378 learned_addr learned my addr 172.21.15.113:0/1984023378 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.459+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561903474 0 0) 0x7f20b80b2600 con 0x7f20b80b1710 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.459+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a4003520 con 0x7f20b80b1710 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.459+0000 7f20be3a1640 1 --2- 172.21.15.113:0/1984023378 >> v2:172.21.15.151:3300/0 conn(0x7f20b815e750 0x7f20b806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20948938 0 0) 0x7f20a4003520 con 0x7f20b80b1710 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 >> v2:172.21.15.151:3300/0 conn(0x7f20b815e750 msgr2=0x7f20b806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 --2- 172.21.15.113:0/1984023378 >> v2:172.21.15.151:3300/0 conn(0x7f20b815e750 0x7f20b806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 >> v1:172.21.15.151:6789/0 conn(0x7f20b8157aa0 legacy=0x7f20b8161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80b2320 con 0x7f20b80b1710 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f20a8001670 con 0x7f20b80b1710 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 >> v1:172.21.15.113:6789/0 conn(0x7f20b80b1710 legacy=0x7f20b815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a40039e0 0x7f20a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a40047c0 0x7f20a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80b2040 con 0x7f20a40051d0 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a400c120 con 0x7f20a40047c0 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a400c2e0 con 0x7f20a40039e0 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20be3a1640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bd39f640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a40047c0 0x7f20a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.460+0000 7f20bdba0640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a40039e0 0x7f20a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.461+0000 7f20be3a1640 1 -- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a40039e0 msgr2=0x7f20a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.461+0000 7f20be3a1640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a40039e0 0x7f20a4003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.461+0000 7f20be3a1640 1 -- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a40047c0 msgr2=0x7f20a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.461+0000 7f20be3a1640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a40047c0 0x7f20a4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.461+0000 7f20be3a1640 1 -- 172.21.15.113:0/1984023378 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4003520 con 0x7f20a40051d0 2023-12-19T13:47:21.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.461+0000 7f20be3a1640 1 -- 172.21.15.113:0/1984023378 reap_dead start 2023-12-19T13:47:21.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.462+0000 7f20be3a1640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20a400b980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20b80cc9b0 tx=0x7f20a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd3ecaee763bca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.462+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b002cca0 con 0x7f20a40051d0 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.462+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b002ce00 con 0x7f20a40051d0 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.462+0000 7f20bcb9e640 1 -- 172.21.15.113:0/1984023378 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0034660 con 0x7f20a40051d0 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.462+0000 7f20bfe04640 1 -- 172.21.15.113:0/1984023378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 msgr2=0x7f20a400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.462+0000 7f20bfe04640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20a400b980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20b80cc9b0 tx=0x7f20a40057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.463+0000 7f20bfe04640 1 -- 172.21.15.113:0/1984023378 shutdown_connections 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.463+0000 7f20bfe04640 1 --2- 172.21.15.113:0/1984023378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20a400b980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.463+0000 7f20bfe04640 1 -- 172.21.15.113:0/1984023378 >> 172.21.15.113:0/1984023378 conn(0x7f20b80cbb70 msgr2=0x7f20b80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.463+0000 7f20bfe04640 1 -- 172.21.15.113:0/1984023378 shutdown_connections 2023-12-19T13:47:21.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.463+0000 7f20bfe04640 1 -- 172.21.15.113:0/1984023378 wait complete. 2023-12-19T13:47:21.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.464+0000 7f20bfe04640 1 Processor -- start 2023-12-19T13:47:21.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.464+0000 7f20bfe04640 1 -- start start 2023-12-19T13:47:21.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.465+0000 7f20bfe04640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20b8152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.465+0000 7f20bfe04640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b81f65d0 0x7f20b81f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.465+0000 7f20bfe04640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b80ceae0 0x7f20b80cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.465+0000 7f20bfe04640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8152690 con 0x7f20a40051d0 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.465+0000 7f20bfe04640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b815ebb0 con 0x7f20b81f65d0 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.465+0000 7f20bfe04640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80cf4a0 con 0x7f20b80ceae0 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20b8152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20b8152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49528/0 (socket says 172.21.15.113:49528) 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 -- 172.21.15.113:0/2668326322 learned_addr learned my addr 172.21.15.113:0/2668326322 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20be3a1640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b80ceae0 0x7f20b80cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bd39f640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b81f65d0 0x7f20b81f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 -- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b80ceae0 msgr2=0x7f20b80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b80ceae0 0x7f20b80cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 -- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b81f65d0 msgr2=0x7f20b81f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b81f65d0 0x7f20b81f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 -- 172.21.15.113:0/2668326322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b81f7050 con 0x7f20a40051d0 2023-12-19T13:47:21.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20be3a1640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b80ceae0 0x7f20b80cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.466+0000 7f20bdba0640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20b8152150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f20b400d4f0 tx=0x7f20b400d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.467+0000 7f20ae7fc640 1 -- 172.21.15.113:0/2668326322 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b40052d0 con 0x7f20a40051d0 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.467+0000 7f20ae7fc640 1 -- 172.21.15.113:0/2668326322 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b4005430 con 0x7f20a40051d0 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.467+0000 7f20ae7fc640 1 -- 172.21.15.113:0/2668326322 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4012840 con 0x7f20a40051d0 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.467+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b81f7330 con 0x7f20a40051d0 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.467+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b815f0a0 con 0x7f20a40051d0 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.468+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b81f7520 con 0x7f20a40051d0 2023-12-19T13:47:21.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.469+0000 7f20ae7fc640 1 -- 172.21.15.113:0/2668326322 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20b40129a0 con 0x7f20a40051d0 2023-12-19T13:47:21.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.470+0000 7f20ae7fc640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f209c06a480 0x7f209c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.470+0000 7f20ae7fc640 1 -- 172.21.15.113:0/2668326322 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f20b4088b10 con 0x7f20a40051d0 2023-12-19T13:47:21.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.470+0000 7f20bd39f640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f209c06a480 0x7f209c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.471+0000 7f20bd39f640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f209c06a480 0x7f209c06c940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20a8007810 tx=0x7f20a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.474+0000 7f20ae7fc640 1 -- 172.21.15.113:0/2668326322 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f20b81f7520 con 0x7f20a40051d0 2023-12-19T13:47:21.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.665+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20b81f7520 con 0x7f20a40051d0 2023-12-19T13:47:21.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.666+0000 7f20ae7fc640 1 -- 172.21.15.113:0/2668326322 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20b81f7520 con 0x7f20a40051d0 2023-12-19T13:47:21.666 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f209c06a480 msgr2=0x7f209c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f209c06a480 0x7f209c06c940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20a8007810 tx=0x7f20a8009040 comp rx=0 tx=0).stop 2023-12-19T13:47:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 msgr2=0x7f20b8152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20b8152150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f20b400d4f0 tx=0x7f20b400d9b0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 shutdown_connections 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f209c06a480 0x7f209c06c940 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b80ceae0 0x7f20b80cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b81f65d0 0x7f20b81f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.668+0000 7f20bfe04640 1 --2- 172.21.15.113:0/2668326322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20a40051d0 0x7f20b8152150 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.669+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 >> 172.21.15.113:0/2668326322 conn(0x7f20b80cbb70 msgr2=0x7f20b80cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.669+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 shutdown_connections 2023-12-19T13:47:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.669+0000 7f20bfe04640 1 -- 172.21.15.113:0/2668326322 wait complete. 2023-12-19T13:47:21.688 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:21.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.891+0000 7f182d269640 1 Processor -- start 2023-12-19T13:47:21.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.891+0000 7f182d269640 1 -- start start 2023-12-19T13:47:21.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.893+0000 7f182d269640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18280cf5b0 0x7f18280b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.893+0000 7f182d269640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182815fde0 con 0x7f18280b2760 2023-12-19T13:47:21.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.893+0000 7f182d269640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280b2bc0 con 0x7f182815b1d0 2023-12-19T13:47:21.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.893+0000 7f182d269640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280b2400 con 0x7f18280cf5b0 2023-12-19T13:47:21.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.893+0000 7f181e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f18280b2760 0x7f18280ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46044/0 (socket says 172.21.15.113:46044) 2023-12-19T13:47:21.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.893+0000 7f181e7fc640 1 -- 172.21.15.113:0/1669748051 learned_addr learned my addr 172.21.15.113:0/1669748051 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:21.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18277fe640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18280cf5b0 0x7f18280b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420259998 0 0) 0x7f182815fde0 con 0x7f18280b2760 2023-12-19T13:47:21.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1814003520 con 0x7f18280b2760 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276640186 0 0) 0x7f1814003520 con 0x7f18280b2760 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18280cf5b0 msgr2=0x7f18280b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18280cf5b0 0x7f18280b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 >> v1:172.21.15.151:6789/0 conn(0x7f182815b1d0 legacy=0x7f182815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182815ef10 con 0x7f18280b2760 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1810001670 con 0x7f18280b2760 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.894+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 >> v1:172.21.15.113:6789/0 conn(0x7f18280b2760 legacy=0x7f18280ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f18267fc640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1814003a10 0x7f1814003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f18267fc640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18280cf5b0 0x7f18140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f18267fc640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1814004d00 0x7f1814005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181400ba90 con 0x7f1814003a10 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181400bc00 con 0x7f1814004d00 2023-12-19T13:47:21.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181400bdc0 con 0x7f18280cf5b0 2023-12-19T13:47:21.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1814003a10 0x7f1814003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f1826ffd640 1 -- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18280cf5b0 msgr2=0x7f18140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:21.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18280cf5b0 0x7f18140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f1826ffd640 1 -- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1814004d00 msgr2=0x7f1814005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:21.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1814004d00 0x7f1814005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.895+0000 7f1826ffd640 1 -- 172.21.15.113:0/1669748051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814003520 con 0x7f1814003a10 2023-12-19T13:47:21.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.896+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1814003a10 0x7f1814003e30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1818001e20 tx=0x7f18140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ce85d6e8331ee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818003b70 con 0x7f1814003a10 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818003cd0 con 0x7f1814003a10 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f18267fc640 1 -- 172.21.15.113:0/1669748051 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818005310 con 0x7f1814003a10 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f182d269640 1 -- 172.21.15.113:0/1669748051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1814003a10 msgr2=0x7f1814003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f182d269640 1 --2- 172.21.15.113:0/1669748051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1814003a10 0x7f1814003e30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1818001e20 tx=0x7f18140057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f18277fe640 1 -- 172.21.15.113:0/1669748051 reap_dead start 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f182d269640 1 -- 172.21.15.113:0/1669748051 shutdown_connections 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f182d269640 1 -- 172.21.15.113:0/1669748051 >> 172.21.15.113:0/1669748051 conn(0x7f1828073150 msgr2=0x7f18280659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f182d269640 1 -- 172.21.15.113:0/1669748051 shutdown_connections 2023-12-19T13:47:21.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.897+0000 7f182d269640 1 -- 172.21.15.113:0/1669748051 wait complete. 2023-12-19T13:47:21.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.899+0000 7f182d269640 1 Processor -- start 2023-12-19T13:47:21.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.899+0000 7f182d269640 1 -- start start 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.900+0000 7f182d269640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1814003a10 0x7f1828154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.900+0000 7f182d269640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1828159ca0 0x7f182815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.900+0000 7f182d269640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18280ccc40 0x7f18280cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.900+0000 7f182d269640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280cd600 con 0x7f18280ccc40 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.900+0000 7f182d269640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828158c00 con 0x7f1828159ca0 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.900+0000 7f182d269640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1828158ee0 con 0x7f1814003a10 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.900+0000 7f18277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18280ccc40 0x7f18280cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18280ccc40 0x7f18280cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49550/0 (socket says 172.21.15.113:49550) 2023-12-19T13:47:21.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 -- 172.21.15.113:0/1656024551 learned_addr learned my addr 172.21.15.113:0/1656024551 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1814003a10 0x7f1828154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f181e7fc640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1828159ca0 0x7f182815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 -- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1814003a10 msgr2=0x7f1828154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1814003a10 0x7f1828154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 -- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1828159ca0 msgr2=0x7f182815a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1828159ca0 0x7f182815a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 -- 172.21.15.113:0/1656024551 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18281591c0 con 0x7f18280ccc40 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1814003a10 0x7f1828154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:21.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f181e7fc640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1828159ca0 0x7f182815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:21.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.901+0000 7f18277fe640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18280ccc40 0x7f18280cd0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f18280cfd50 tx=0x7f182000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.902+0000 7f181ffff640 1 -- 172.21.15.113:0/1656024551 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820019070 con 0x7f18280ccc40 2023-12-19T13:47:21.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.902+0000 7f181ffff640 1 -- 172.21.15.113:0/1656024551 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820004020 con 0x7f18280ccc40 2023-12-19T13:47:21.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.902+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18281594a0 con 0x7f18280ccc40 2023-12-19T13:47:21.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.902+0000 7f181ffff640 1 -- 172.21.15.113:0/1656024551 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820004210 con 0x7f18280ccc40 2023-12-19T13:47:21.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.902+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1828154ad0 con 0x7f18280ccc40 2023-12-19T13:47:21.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.903+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18281599c0 con 0x7f18280ccc40 2023-12-19T13:47:21.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.904+0000 7f181ffff640 1 -- 172.21.15.113:0/1656024551 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1820004370 con 0x7f18280ccc40 2023-12-19T13:47:21.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.905+0000 7f181ffff640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f180806a430 0x7f180806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:21.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.905+0000 7f181ffff640 1 -- 172.21.15.113:0/1656024551 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1820087e90 con 0x7f18280ccc40 2023-12-19T13:47:21.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.905+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f180806a430 0x7f180806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:21.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.906+0000 7f1826ffd640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f180806a430 0x7f180806c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1818034000 tx=0x7f1818009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:21.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:21.909+0000 7f181ffff640 1 -- 172.21.15.113:0/1656024551 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f18281599c0 con 0x7f18280ccc40 2023-12-19T13:47:22.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.099+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1828061910 con 0x7f18280ccc40 2023-12-19T13:47:22.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.100+0000 7f181ffff640 1 -- 172.21.15.113:0/1656024551 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1820053440 con 0x7f18280ccc40 2023-12-19T13:47:22.100 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f180806a430 msgr2=0x7f180806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f180806a430 0x7f180806c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1818034000 tx=0x7f1818009030 comp rx=0 tx=0).stop 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18280ccc40 msgr2=0x7f18280cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18280ccc40 0x7f18280cd0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f18280cfd50 tx=0x7f182000ec00 comp rx=0 tx=0).stop 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 shutdown_connections 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f180806a430 0x7f180806c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18280ccc40 0x7f18280cd0c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1828159ca0 0x7f182815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 --2- 172.21.15.113:0/1656024551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1814003a10 0x7f1828154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.102+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 >> 172.21.15.113:0/1656024551 conn(0x7f1828073150 msgr2=0x7f18280cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.103+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 shutdown_connections 2023-12-19T13:47:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.103+0000 7f182d269640 1 -- 172.21.15.113:0/1656024551 wait complete. 2023-12-19T13:47:22.121 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:47:22.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.329+0000 7f85dc1a4640 1 Processor -- start 2023-12-19T13:47:22.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.330+0000 7f85dc1a4640 1 -- start start 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85dc1a4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f85d40d2b00 0x7f85d40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85dc1a4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d40ce110 0x7f85d40ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85dc1a4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40cd840 con 0x7f85d4146e10 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85dc1a4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d40d2430 con 0x7f85d40d2b00 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85dc1a4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40ceac0 con 0x7f85d40ce110 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85d9f40640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f85d4146e10 0x7f85d40b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46056/0 (socket says 172.21.15.113:46056) 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85d9f40640 1 -- 172.21.15.113:0/4011000221 learned_addr learned my addr 172.21.15.113:0/4011000221 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.331+0000 7f85d973f640 1 --2- 172.21.15.113:0/4011000221 >> v2:172.21.15.113:3300/0 conn(0x7f85d40d2b00 0x7f85d40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:22.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85da741640 1 --2- 172.21.15.113:0/4011000221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d40ce110 0x7f85d40ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:22.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85d8f3e640 1 -- 172.21.15.113:0/4011000221 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271889963 0 0) 0x7f85d40cd840 con 0x7f85d4146e10 2023-12-19T13:47:22.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85d8f3e640 1 -- 172.21.15.113:0/4011000221 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c0003520 con 0x7f85d4146e10 2023-12-19T13:47:22.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85d973f640 1 -- 172.21.15.113:0/4011000221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d40ce110 msgr2=0x7f85d40ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:22.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85d973f640 1 --2- 172.21.15.113:0/4011000221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d40ce110 0x7f85d40ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85d973f640 1 -- 172.21.15.113:0/4011000221 >> v1:172.21.15.113:6789/0 conn(0x7f85d4146e10 legacy=0x7f85d40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85d973f640 1 -- 172.21.15.113:0/4011000221 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40b6e90 con 0x7f85d40d2b00 2023-12-19T13:47:22.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.332+0000 7f85da741640 1 --2- 172.21.15.113:0/4011000221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d40ce110 0x7f85d40ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:22.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.333+0000 7f85d973f640 1 --2- 172.21.15.113:0/4011000221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d40d1ef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f85c40097d0 tx=0x7f85c402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd8163747d848a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.333+0000 7f85d8f3e640 1 -- 172.21.15.113:0/4011000221 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4031800 con 0x7f85d40d2b00 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.333+0000 7f85d8f3e640 1 -- 172.21.15.113:0/4011000221 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4031960 con 0x7f85d40d2b00 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.333+0000 7f85d8f3e640 1 -- 172.21.15.113:0/4011000221 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4031cf0 con 0x7f85d40d2b00 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 -- 172.21.15.113:0/4011000221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 msgr2=0x7f85d40d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/4011000221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d40d1ef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f85c40097d0 tx=0x7f85c402b8a0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 -- 172.21.15.113:0/4011000221 shutdown_connections 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/4011000221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d40ce110 0x7f85d40ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/4011000221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d40d1ef0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 -- 172.21.15.113:0/4011000221 >> 172.21.15.113:0/4011000221 conn(0x7f85d40b29c0 msgr2=0x7f85d40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 -- 172.21.15.113:0/4011000221 shutdown_connections 2023-12-19T13:47:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.334+0000 7f85dc1a4640 1 -- 172.21.15.113:0/4011000221 wait complete. 2023-12-19T13:47:22.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.336+0000 7f85dc1a4640 1 Processor -- start 2023-12-19T13:47:22.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.336+0000 7f85dc1a4640 1 -- start start 2023-12-19T13:47:22.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85dc1a4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d40ce110 0x7f85d413c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:22.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85dc1a4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:22.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85dc1a4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d4146e10 0x7f85d415ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:22.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85dc1a4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4155260 con 0x7f85d40d2b00 2023-12-19T13:47:22.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85dc1a4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4155540 con 0x7f85d40ce110 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85dc1a4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4155820 con 0x7f85d4146e10 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85d973f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85d973f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d415f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49576/0 (socket says 172.21.15.113:49576) 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.337+0000 7f85d973f640 1 -- 172.21.15.113:0/2771613673 learned_addr learned my addr 172.21.15.113:0/2771613673 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85da741640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d4146e10 0x7f85d415ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d9f40640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d40ce110 0x7f85d413c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d973f640 1 -- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d4146e10 msgr2=0x7f85d415ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d973f640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d4146e10 0x7f85d415ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d973f640 1 -- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d40ce110 msgr2=0x7f85d413c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d973f640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d40ce110 0x7f85d413c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d973f640 1 -- 172.21.15.113:0/2771613673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4009400 con 0x7f85d40d2b00 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85da741640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d4146e10 0x7f85d415ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d9f40640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d40ce110 0x7f85d413c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:22.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85d973f640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d415f560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f85c40098f0 tx=0x7f85c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85ca7fc640 1 -- 172.21.15.113:0/2771613673 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c403bc70 con 0x7f85d40d2b00 2023-12-19T13:47:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85ca7fc640 1 -- 172.21.15.113:0/2771613673 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c403be10 con 0x7f85d40d2b00 2023-12-19T13:47:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85ca7fc640 1 -- 172.21.15.113:0/2771613673 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4045630 con 0x7f85d40d2b00 2023-12-19T13:47:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.338+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d4155b00 con 0x7f85d40d2b00 2023-12-19T13:47:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.339+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d413ce60 con 0x7f85d40d2b00 2023-12-19T13:47:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.340+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d4156020 con 0x7f85d40d2b00 2023-12-19T13:47:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.341+0000 7f85ca7fc640 1 -- 172.21.15.113:0/2771613673 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f85c404e450 con 0x7f85d40d2b00 2023-12-19T13:47:22.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.341+0000 7f85ca7fc640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85b806a430 0x7f85b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:22.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.342+0000 7f85ca7fc640 1 -- 172.21.15.113:0/2771613673 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f85c402e070 con 0x7f85d40d2b00 2023-12-19T13:47:22.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.342+0000 7f85d9f40640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85b806a430 0x7f85b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:22.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.342+0000 7f85d9f40640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85b806a430 0x7f85b806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f85d00011e0 tx=0x7f85d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.346+0000 7f85ca7fc640 1 -- 172.21.15.113:0/2771613673 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f85d4156020 con 0x7f85d40d2b00 2023-12-19T13:47:22.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.535+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f85d4156020 con 0x7f85d40d2b00 2023-12-19T13:47:22.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.536+0000 7f85ca7fc640 1 -- 172.21.15.113:0/2771613673 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f85d4156020 con 0x7f85d40d2b00 2023-12-19T13:47:22.537 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85b806a430 msgr2=0x7f85b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85b806a430 0x7f85b806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f85d00011e0 tx=0x7f85d0009040 comp rx=0 tx=0).stop 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 msgr2=0x7f85d415f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d415f560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f85c40098f0 tx=0x7f85c40046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 shutdown_connections 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85b806a430 0x7f85b806c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d4146e10 0x7f85d415ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85d40d2b00 0x7f85d415f560 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 --2- 172.21.15.113:0/2771613673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d40ce110 0x7f85d413c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:22.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 >> 172.21.15.113:0/2771613673 conn(0x7f85d40b29c0 msgr2=0x7f85d41618a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:22.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 shutdown_connections 2023-12-19T13:47:22.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:22.538+0000 7f85dc1a4640 1 -- 172.21.15.113:0/2771613673 wait complete. 2023-12-19T13:47:22.555 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:47:22.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:22.555 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-19T13:47:22.670 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:47:22.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:22.670 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:47:22.728 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:47:22.728 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:22.785 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:47:22.785 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:22.836 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:47:22.836 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:22.889 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:23.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.096+0000 7f3ce2f8e640 1 Processor -- start 2023-12-19T13:47:23.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.096+0000 7f3ce2f8e640 1 -- start start 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce2f8e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3cdc0b8070 0x7f3cdc0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce2f8e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3cdc0d0a90 0x7f3cdc15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce2f8e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc0d12d0 con 0x7f3cdc146e30 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce2f8e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc147210 con 0x7f3cdc0b8070 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce2f8e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc0d2370 con 0x7f3cdc0d0a90 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce178b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3cdc0b8070 0x7f3cdc0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce1f8c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3cdc146e30 0x7f3cdc0b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46072/0 (socket says 172.21.15.113:46072) 2023-12-19T13:47:23.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.098+0000 7f3ce1f8c640 1 -- 172.21.15.113:0/2275985 learned_addr learned my addr 172.21.15.113:0/2275985 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.099+0000 7f3ce278d640 1 --2- 172.21.15.113:0/2275985 >> v2:172.21.15.151:3300/0 conn(0x7f3cdc0d0a90 0x7f3cdc15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.099+0000 7f3ce178b640 1 -- 172.21.15.113:0/2275985 >> v2:172.21.15.151:3300/0 conn(0x7f3cdc0d0a90 msgr2=0x7f3cdc15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.099+0000 7f3ce178b640 1 --2- 172.21.15.113:0/2275985 >> v2:172.21.15.151:3300/0 conn(0x7f3cdc0d0a90 0x7f3cdc15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.099+0000 7f3ce178b640 1 -- 172.21.15.113:0/2275985 >> v1:172.21.15.113:6789/0 conn(0x7f3cdc146e30 legacy=0x7f3cdc0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.099+0000 7f3ce178b640 1 -- 172.21.15.113:0/2275985 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0d15b0 con 0x7f3cdc0b8070 2023-12-19T13:47:23.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.099+0000 7f3ce0f8a640 1 -- 172.21.15.113:0/2275985 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840942671 0 0) 0x7f3cdc0d12d0 con 0x7f3cdc146e30 2023-12-19T13:47:23.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.100+0000 7f3ce178b640 1 --2- 172.21.15.113:0/2275985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc0b8070 0x7f3cdc0d0550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc071060 tx=0x7f3ccc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4dfaf759f748ec6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.100+0000 7f3ce0f8a640 1 -- 172.21.15.113:0/2275985 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc02e070 con 0x7f3cdc0b8070 2023-12-19T13:47:23.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.100+0000 7f3ce0f8a640 1 -- 172.21.15.113:0/2275985 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0315a0 con 0x7f3cdc0b8070 2023-12-19T13:47:23.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.100+0000 7f3ce0f8a640 1 -- 172.21.15.113:0/2275985 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc031930 con 0x7f3cdc0b8070 2023-12-19T13:47:23.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/2275985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc0b8070 msgr2=0x7f3cdc0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/2275985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc0b8070 0x7f3cdc0d0550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc071060 tx=0x7f3ccc02b840 comp rx=0 tx=0).stop 2023-12-19T13:47:23.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/2275985 shutdown_connections 2023-12-19T13:47:23.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/2275985 >> v2:172.21.15.151:3300/0 conn(0x7f3cdc0d0a90 0x7f3cdc15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/2275985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc0b8070 0x7f3cdc0d0550 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/2275985 >> 172.21.15.113:0/2275985 conn(0x7f3cdc0b2990 msgr2=0x7f3cdc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:23.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/2275985 shutdown_connections 2023-12-19T13:47:23.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.101+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/2275985 wait complete. 2023-12-19T13:47:23.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.103+0000 7f3ce2f8e640 1 Processor -- start 2023-12-19T13:47:23.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.103+0000 7f3ce2f8e640 1 -- start start 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce2f8e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cdc0b8070 0x7f3cdc1e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce2f8e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cdc0d0a90 0x7f3cdc13e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce2f8e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc146e30 0x7f3cdc140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce2f8e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc13feb0 con 0x7f3cdc146e30 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce2f8e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc13f2a0 con 0x7f3cdc0b8070 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce2f8e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc13f580 con 0x7f3cdc0d0a90 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce278d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc146e30 0x7f3cdc140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce278d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc146e30 0x7f3cdc140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49592/0 (socket says 172.21.15.113:49592) 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.104+0000 7f3ce278d640 1 -- 172.21.15.113:0/1339236819 learned_addr learned my addr 172.21.15.113:0/1339236819 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce278d640 1 -- 172.21.15.113:0/1339236819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cdc0d0a90 msgr2=0x7f3cdc13e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce278d640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cdc0d0a90 0x7f3cdc13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce278d640 1 -- 172.21.15.113:0/1339236819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cdc0b8070 msgr2=0x7f3cdc1e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce1f8c640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cdc0b8070 0x7f3cdc1e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce278d640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cdc0b8070 0x7f3cdc1e3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce278d640 1 -- 172.21.15.113:0/1339236819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc009400 con 0x7f3cdc146e30 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce278d640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc146e30 0x7f3cdc140620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007e40 tx=0x7f3cd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3cd27fc640 1 -- 172.21.15.113:0/1339236819 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4014620 con 0x7f3cdc146e30 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3cd27fc640 1 -- 172.21.15.113:0/1339236819 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400ee90 con 0x7f3cdc146e30 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3cd27fc640 1 -- 172.21.15.113:0/1339236819 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40149e0 con 0x7f3cdc146e30 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc13f860 con 0x7f3cdc146e30 2023-12-19T13:47:23.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.105+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc1e3ed0 con 0x7f3cdc146e30 2023-12-19T13:47:23.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.107+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc140020 con 0x7f3cdc146e30 2023-12-19T13:47:23.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.107+0000 7f3cd27fc640 1 -- 172.21.15.113:0/1339236819 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3cd4014b40 con 0x7f3cdc146e30 2023-12-19T13:47:23.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.108+0000 7f3cd27fc640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cc006a460 0x7f3cc006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.108+0000 7f3cd27fc640 1 -- 172.21.15.113:0/1339236819 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3cd4089320 con 0x7f3cdc146e30 2023-12-19T13:47:23.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.108+0000 7f3ce1f8c640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cc006a460 0x7f3cc006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.109+0000 7f3ce1f8c640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cc006a460 0x7f3cc006c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8000f60 tx=0x7f3cd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.112+0000 7f3cd27fc640 1 -- 172.21.15.113:0/1339236819 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3cd40548c0 con 0x7f3cdc146e30 2023-12-19T13:47:23.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.286+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cdc061910 con 0x7f3cdc146e30 2023-12-19T13:47:23.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.289+0000 7f3cd27fc640 1 -- 172.21.15.113:0/1339236819 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16184 (secure 0 0 0) 0x7f3cd4057ee0 con 0x7f3cdc146e30 2023-12-19T13:47:23.290 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:23.290 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":22,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:20.429480+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2a","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:23.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cc006a460 msgr2=0x7f3cc006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cc006a460 0x7f3cc006c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8000f60 tx=0x7f3cd8009040 comp rx=0 tx=0).stop 2023-12-19T13:47:23.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc146e30 msgr2=0x7f3cdc140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc146e30 0x7f3cdc140620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007e40 tx=0x7f3cd400e4b0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 shutdown_connections 2023-12-19T13:47:23.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cc006a460 0x7f3cc006c920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cdc146e30 0x7f3cdc140620 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cdc0d0a90 0x7f3cdc13e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 --2- 172.21.15.113:0/1339236819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cdc0b8070 0x7f3cdc1e3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 >> 172.21.15.113:0/1339236819 conn(0x7f3cdc0b2990 msgr2=0x7f3cdc0b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:23.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 shutdown_connections 2023-12-19T13:47:23.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.292+0000 7f3ce2f8e640 1 -- 172.21.15.113:0/1339236819 wait complete. 2023-12-19T13:47:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:23.312 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:23.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.528+0000 7f1aa7527640 1 Processor -- start 2023-12-19T13:47:23.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.528+0000 7f1aa7527640 1 -- start start 2023-12-19T13:47:23.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.529+0000 7f1aa7527640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1aa015b1d0 0x7f1aa00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.529+0000 7f1aa7527640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.529+0000 7f1aa7527640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa015ef10 con 0x7f1aa00ceea0 2023-12-19T13:47:23.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.529+0000 7f1aa7527640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00b2320 con 0x7f1aa015b1d0 2023-12-19T13:47:23.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.529+0000 7f1aa7527640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00b2e40 con 0x7f1aa00b1ec0 2023-12-19T13:47:23.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.530+0000 7f1aa4ac2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.530+0000 7f1aa52c3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1aa015b1d0 0x7f1aa00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.530+0000 7f1aa4ac2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:52126/0 (socket says 172.21.15.113:52126) 2023-12-19T13:47:23.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.530+0000 7f1aa5ac4640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f1aa00ceea0 0x7f1aa006c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:60188/0 (socket says 172.21.15.113:60188) 2023-12-19T13:47:23.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.530+0000 7f1aa4ac2640 1 -- 172.21.15.113:0/3912755991 learned_addr learned my addr 172.21.15.113:0/3912755991 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:23.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.531+0000 7f1aa4ac2640 1 -- 172.21.15.113:0/3912755991 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015b1d0 msgr2=0x7f1aa00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:23.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.531+0000 7f1aa4ac2640 1 --2- 172.21.15.113:0/3912755991 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015b1d0 0x7f1aa00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.531+0000 7f1aa4ac2640 1 -- 172.21.15.113:0/3912755991 >> v1:172.21.15.151:6789/0 conn(0x7f1aa00ceea0 legacy=0x7f1aa006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.531+0000 7f1aa4ac2640 1 -- 172.21.15.113:0/3912755991 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00b3120 con 0x7f1aa00b1ec0 2023-12-19T13:47:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.533+0000 7f1aa4ac2640 1 --2- 172.21.15.113:0/3912755991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa015f6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009870 tx=0x7f1a9002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c96736ad08d3b416 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.533+0000 7f1a97fff640 1 -- 172.21.15.113:0/3912755991 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90030840 con 0x7f1aa00b1ec0 2023-12-19T13:47:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1a97fff640 1 -- 172.21.15.113:0/3912755991 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900309a0 con 0x7f1aa00b1ec0 2023-12-19T13:47:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1a97fff640 1 -- 172.21.15.113:0/3912755991 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90030d30 con 0x7f1aa00b1ec0 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 -- 172.21.15.113:0/3912755991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 msgr2=0x7f1aa015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 --2- 172.21.15.113:0/3912755991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa015f6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009870 tx=0x7f1a9002b980 comp rx=0 tx=0).stop 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 -- 172.21.15.113:0/3912755991 shutdown_connections 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 --2- 172.21.15.113:0/3912755991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa015f6d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 --2- 172.21.15.113:0/3912755991 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015b1d0 0x7f1aa00b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 -- 172.21.15.113:0/3912755991 >> 172.21.15.113:0/3912755991 conn(0x7f1aa0073150 msgr2=0x7f1aa00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 -- 172.21.15.113:0/3912755991 shutdown_connections 2023-12-19T13:47:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.534+0000 7f1aa7527640 1 -- 172.21.15.113:0/3912755991 wait complete. 2023-12-19T13:47:23.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.537+0000 7f1aa7527640 1 Processor -- start 2023-12-19T13:47:23.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.537+0000 7f1aa7527640 1 -- start start 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa7527640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa00b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa7527640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa00ceea0 0x7f1aa0149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa7527640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1aa015b1d0 0x7f1aa00aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa7527640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00af9e0 con 0x7f1aa015b1d0 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa7527640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00afcc0 con 0x7f1aa00ceea0 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa7527640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00affa0 con 0x7f1aa00b1ec0 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa5ac4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1aa015b1d0 0x7f1aa00aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa5ac4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1aa015b1d0 0x7f1aa00aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49606/0 (socket says 172.21.15.113:49606) 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.538+0000 7f1aa5ac4640 1 -- 172.21.15.113:0/1710239841 learned_addr learned my addr 172.21.15.113:0/1710239841 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa4ac2640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa00ceea0 0x7f1aa0149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa52c3640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa00b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa5ac4640 1 -- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 msgr2=0x7f1aa00b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa5ac4640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa00b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa5ac4640 1 -- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa00ceea0 msgr2=0x7f1aa0149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa5ac4640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa00ceea0 0x7f1aa0149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa5ac4640 1 -- 172.21.15.113:0/1710239841 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900094d0 con 0x7f1aa015b1d0 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.539+0000 7f1aa5ac4640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1aa015b1d0 0x7f1aa00aef20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c710 tx=0x7f1a9800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.540+0000 7f1a95ffb640 1 -- 172.21.15.113:0/1710239841 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9800ce20 con 0x7f1aa015b1d0 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.540+0000 7f1a95ffb640 1 -- 172.21.15.113:0/1710239841 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9800a640 con 0x7f1aa015b1d0 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.540+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa00b0280 con 0x7f1aa015b1d0 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.540+0000 7f1a95ffb640 1 -- 172.21.15.113:0/1710239841 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9800a9d0 con 0x7f1aa015b1d0 2023-12-19T13:47:23.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.540+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa0153ab0 con 0x7f1aa015b1d0 2023-12-19T13:47:23.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.541+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa00afe00 con 0x7f1aa015b1d0 2023-12-19T13:47:23.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.542+0000 7f1a95ffb640 1 -- 172.21.15.113:0/1710239841 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1a9800ab30 con 0x7f1aa015b1d0 2023-12-19T13:47:23.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.543+0000 7f1a95ffb640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a8406a430 0x7f1a8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.543+0000 7f1a95ffb640 1 -- 172.21.15.113:0/1710239841 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1a98088230 con 0x7f1aa015b1d0 2023-12-19T13:47:23.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.543+0000 7f1aa52c3640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a8406a430 0x7f1a8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.544+0000 7f1aa52c3640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a8406a430 0x7f1a8406c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009a30 tx=0x7f1a9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.548+0000 7f1a95ffb640 1 -- 172.21.15.113:0/1710239841 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1aa00afe00 con 0x7f1aa015b1d0 2023-12-19T13:47:23.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.739+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1aa00b07a0 con 0x7f1aa015b1d0 2023-12-19T13:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.740+0000 7f1a95ffb640 1 -- 172.21.15.113:0/1710239841 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1aa00b07a0 con 0x7f1aa015b1d0 2023-12-19T13:47:23.741 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:23.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.742+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a8406a430 msgr2=0x7f1a8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.742+0000 7f1aa7527640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a8406a430 0x7f1a8406c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009a30 tx=0x7f1a9c008040 comp rx=0 tx=0).stop 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.742+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1aa015b1d0 msgr2=0x7f1aa00aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.742+0000 7f1aa7527640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1aa015b1d0 0x7f1aa00aef20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c710 tx=0x7f1a9800cbd0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 shutdown_connections 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a8406a430 0x7f1a8406c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1aa015b1d0 0x7f1aa00aef20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa00ceea0 0x7f1aa0149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 --2- 172.21.15.113:0/1710239841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa00b1ec0 0x7f1aa00b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 >> 172.21.15.113:0/1710239841 conn(0x7f1aa0073150 msgr2=0x7f1aa0159120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 shutdown_connections 2023-12-19T13:47:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.743+0000 7f1aa7527640 1 -- 172.21.15.113:0/1710239841 wait complete. 2023-12-19T13:47:23.762 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:23.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.977+0000 7ffaba143640 1 Processor -- start 2023-12-19T13:47:23.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.978+0000 7ffaba143640 1 -- start start 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.979+0000 7ffaba143640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffab40b0b50 0x7ffab406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.979+0000 7ffaba143640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 0x7ffab406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.979+0000 7ffaba143640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab406bb30 con 0x7ffab41449e0 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.979+0000 7ffaba143640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40b0070 con 0x7ffab40b0b50 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.979+0000 7ffaba143640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40b0350 con 0x7ffab406b590 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.979+0000 7ffab37fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffab41449e0 0x7ffab40af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46078/0 (socket says 172.21.15.113:46078) 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.979+0000 7ffab37fe640 1 -- 172.21.15.113:0/3938146387 learned_addr learned my addr 172.21.15.113:0/3938146387 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:23.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab2ffd640 1 --2- 172.21.15.113:0/3938146387 >> v2:172.21.15.113:3300/0 conn(0x7ffab40b0b50 0x7ffab406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab27fc640 1 -- 172.21.15.113:0/3938146387 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370833001 0 0) 0x7ffab406bb30 con 0x7ffab41449e0 2023-12-19T13:47:23.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab27fc640 1 -- 172.21.15.113:0/3938146387 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa0003520 con 0x7ffab41449e0 2023-12-19T13:47:23.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab3fff640 1 --2- 172.21.15.113:0/3938146387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 0x7ffab406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab2ffd640 1 -- 172.21.15.113:0/3938146387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 msgr2=0x7ffab406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:23.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab2ffd640 1 --2- 172.21.15.113:0/3938146387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 0x7ffab406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab2ffd640 1 -- 172.21.15.113:0/3938146387 >> v1:172.21.15.113:6789/0 conn(0x7ffab41449e0 legacy=0x7ffab40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.980+0000 7ffab2ffd640 1 -- 172.21.15.113:0/3938146387 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40b0630 con 0x7ffab40b0b50 2023-12-19T13:47:23.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.981+0000 7ffab2ffd640 1 --2- 172.21.15.113:0/3938146387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab406bfa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0097a0 tx=0x7ffa9c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed7d6313d0054a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffab27fc640 1 -- 172.21.15.113:0/3938146387 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c02d040 con 0x7ffab40b0b50 2023-12-19T13:47:23.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffab27fc640 1 -- 172.21.15.113:0/3938146387 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c031810 con 0x7ffab40b0b50 2023-12-19T13:47:23.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffab27fc640 1 -- 172.21.15.113:0/3938146387 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c031ba0 con 0x7ffab40b0b50 2023-12-19T13:47:23.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffaba143640 1 -- 172.21.15.113:0/3938146387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 msgr2=0x7ffab406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffaba143640 1 --2- 172.21.15.113:0/3938146387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab406bfa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0097a0 tx=0x7ffa9c02b8b0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffaba143640 1 -- 172.21.15.113:0/3938146387 shutdown_connections 2023-12-19T13:47:23.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffaba143640 1 --2- 172.21.15.113:0/3938146387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 0x7ffab406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffaba143640 1 --2- 172.21.15.113:0/3938146387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab406bfa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.982+0000 7ffaba143640 1 -- 172.21.15.113:0/3938146387 >> 172.21.15.113:0/3938146387 conn(0x7ffab40cbb70 msgr2=0x7ffab40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:23.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.983+0000 7ffaba143640 1 -- 172.21.15.113:0/3938146387 shutdown_connections 2023-12-19T13:47:23.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.983+0000 7ffaba143640 1 -- 172.21.15.113:0/3938146387 wait complete. 2023-12-19T13:47:23.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.984+0000 7ffaba143640 1 Processor -- start 2023-12-19T13:47:23.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.984+0000 7ffaba143640 1 -- start start 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffaba143640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 0x7ffab413aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffaba143640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffaba143640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab41449e0 0x7ffab41f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffaba143640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40ad010 con 0x7ffab40b0b50 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffaba143640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab413afd0 con 0x7ffab41449e0 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffaba143640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab415e370 con 0x7ffab406b590 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab415d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49618/0 (socket says 172.21.15.113:49618) 2023-12-19T13:47:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.985+0000 7ffab2ffd640 1 -- 172.21.15.113:0/3388556820 learned_addr learned my addr 172.21.15.113:0/3388556820 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffab2ffd640 1 -- 172.21.15.113:0/3388556820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 msgr2=0x7ffab413aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffab2ffd640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 0x7ffab413aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffab2ffd640 1 -- 172.21.15.113:0/3388556820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab41449e0 msgr2=0x7ffab41f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffab2ffd640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab41449e0 0x7ffab41f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffab2ffd640 1 -- 172.21.15.113:0/3388556820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009400 con 0x7ffab40b0b50 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffab2ffd640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab415d8b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098c0 tx=0x7ffa9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffaabfff640 1 -- 172.21.15.113:0/3388556820 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c006e10 con 0x7ffab40b0b50 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffaabfff640 1 -- 172.21.15.113:0/3388556820 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c03ad60 con 0x7ffab40b0b50 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.986+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab415e650 con 0x7ffab40b0b50 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.987+0000 7ffaabfff640 1 -- 172.21.15.113:0/3388556820 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c044620 con 0x7ffab40b0b50 2023-12-19T13:47:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.987+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab40acc30 con 0x7ffab40b0b50 2023-12-19T13:47:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.988+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab40ad150 con 0x7ffab40b0b50 2023-12-19T13:47:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.989+0000 7ffaabfff640 1 -- 172.21.15.113:0/3388556820 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa9c04d440 con 0x7ffab40b0b50 2023-12-19T13:47:23.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.989+0000 7ffaabfff640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa9406a430 0x7ffa9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:23.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.990+0000 7ffaabfff640 1 -- 172.21.15.113:0/3388556820 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffa9c0aacd0 con 0x7ffab40b0b50 2023-12-19T13:47:23.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.990+0000 7ffab37fe640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa9406a430 0x7ffa9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:23.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.990+0000 7ffab37fe640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa9406a430 0x7ffa9406c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffab40ae4d0 tx=0x7ffaa40015f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:23.994+0000 7ffaabfff640 1 -- 172.21.15.113:0/3388556820 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffab40ad150 con 0x7ffab40b0b50 2023-12-19T13:47:24.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.183+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffab40ad150 con 0x7ffab40b0b50 2023-12-19T13:47:24.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.183+0000 7ffaabfff640 1 -- 172.21.15.113:0/3388556820 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa9c035020 con 0x7ffab40b0b50 2023-12-19T13:47:24.184 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:24.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.186+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa9406a430 msgr2=0x7ffa9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.186+0000 7ffaba143640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa9406a430 0x7ffa9406c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffab40ae4d0 tx=0x7ffaa40015f0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.186+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 msgr2=0x7ffab415d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.186+0000 7ffaba143640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab415d8b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098c0 tx=0x7ffa9c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 shutdown_connections 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa9406a430 0x7ffa9406c8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab41449e0 0x7ffab41f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab40b0b50 0x7ffab415d8b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 --2- 172.21.15.113:0/3388556820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab406b590 0x7ffab413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 >> 172.21.15.113:0/3388556820 conn(0x7ffab40cbb70 msgr2=0x7ffab40702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 shutdown_connections 2023-12-19T13:47:24.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.187+0000 7ffaba143640 1 -- 172.21.15.113:0/3388556820 wait complete. 2023-12-19T13:47:24.206 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:24.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.408+0000 7fecd9abd640 1 Processor -- start 2023-12-19T13:47:24.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.408+0000 7fecd9abd640 1 -- start start 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7fecd9abd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fecd40cf580 0x7fecd415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7fecd9abd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fecd40cc1a0 0x7fecd415a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7fecd9abd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40b2580 con 0x7fecd40cc880 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7fecd9abd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40b33e0 con 0x7fecd40cf580 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7fecd9abd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40b1ea0 con 0x7fecd40cc1a0 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7feccaffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fecd40cf580 0x7fecd415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7feccaffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fecd40cf580 0x7fecd415af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49620/0 (socket says 172.21.15.113:49620) 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7feccaffd640 1 -- 172.21.15.113:0/4072042788 learned_addr learned my addr 172.21.15.113:0/4072042788 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7fecd37fe640 1 --1- 172.21.15.113:0/4072042788 >> v1:172.21.15.113:6789/0 conn(0x7fecd40cc880 0x7fecd40ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46086/0 (socket says 172.21.15.113:46086) 2023-12-19T13:47:24.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.410+0000 7fecd3fff640 1 --2- 172.21.15.113:0/4072042788 >> v2:172.21.15.151:3300/0 conn(0x7fecd40cc1a0 0x7fecd415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.411+0000 7feccaffd640 1 -- 172.21.15.113:0/4072042788 >> v2:172.21.15.151:3300/0 conn(0x7fecd40cc1a0 msgr2=0x7fecd415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:24.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.411+0000 7feccaffd640 1 --2- 172.21.15.113:0/4072042788 >> v2:172.21.15.151:3300/0 conn(0x7fecd40cc1a0 0x7fecd415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.411+0000 7feccaffd640 1 -- 172.21.15.113:0/4072042788 >> v1:172.21.15.113:6789/0 conn(0x7fecd40cc880 legacy=0x7fecd40ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.411+0000 7feccaffd640 1 -- 172.21.15.113:0/4072042788 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40b27d0 con 0x7fecd40cf580 2023-12-19T13:47:24.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.412+0000 7feccaffd640 1 --2- 172.21.15.113:0/4072042788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cf580 0x7fecd415af20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fecd4159d60 tx=0x7fecbc02dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa98978365d32fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:24.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.412+0000 7fecd2ffd640 1 -- 172.21.15.113:0/4072042788 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc02e970 con 0x7fecd40cf580 2023-12-19T13:47:24.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.412+0000 7fecd2ffd640 1 -- 172.21.15.113:0/4072042788 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc02ead0 con 0x7fecd40cf580 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.412+0000 7fecd2ffd640 1 -- 172.21.15.113:0/4072042788 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc02ee60 con 0x7fecd40cf580 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 -- 172.21.15.113:0/4072042788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cf580 msgr2=0x7fecd415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 --2- 172.21.15.113:0/4072042788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cf580 0x7fecd415af20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fecd4159d60 tx=0x7fecbc02dbc0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 -- 172.21.15.113:0/4072042788 shutdown_connections 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 --2- 172.21.15.113:0/4072042788 >> v2:172.21.15.151:3300/0 conn(0x7fecd40cc1a0 0x7fecd415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 --2- 172.21.15.113:0/4072042788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cf580 0x7fecd415af20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 -- 172.21.15.113:0/4072042788 >> 172.21.15.113:0/4072042788 conn(0x7fecd4073150 msgr2=0x7fecd40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 -- 172.21.15.113:0/4072042788 shutdown_connections 2023-12-19T13:47:24.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.413+0000 7fecd9abd640 1 -- 172.21.15.113:0/4072042788 wait complete. 2023-12-19T13:47:24.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.414+0000 7fecd9abd640 1 Processor -- start 2023-12-19T13:47:24.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.415+0000 7fecd9abd640 1 -- start start 2023-12-19T13:47:24.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.415+0000 7fecd9abd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cc1a0 0x7fecd414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd9abd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd40cc880 0x7fecd40b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd9abd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecd40cf580 0x7fecd40b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd9abd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd414fe00 con 0x7fecd40cc1a0 2023-12-19T13:47:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd9abd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd406c3f0 con 0x7fecd40cc880 2023-12-19T13:47:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd9abd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd406c6d0 con 0x7fecd40cf580 2023-12-19T13:47:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cc1a0 0x7fecd414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cc1a0 0x7fecd414f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49636/0 (socket says 172.21.15.113:49636) 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 -- 172.21.15.113:0/3236349853 learned_addr learned my addr 172.21.15.113:0/3236349853 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd3fff640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecd40cf580 0x7fecd40b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 -- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecd40cf580 msgr2=0x7fecd40b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7feccaffd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd40cc880 0x7fecd40b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecd40cf580 0x7fecd40b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 -- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd40cc880 msgr2=0x7fecd40b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd40cc880 0x7fecd40b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.416+0000 7fecd37fe640 1 -- 172.21.15.113:0/3236349853 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0094d0 con 0x7fecd40cc1a0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.417+0000 7fecd37fe640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cc1a0 0x7fecd414f8c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c3e0 tx=0x7fecc400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.417+0000 7fecd0ff9640 1 -- 172.21.15.113:0/3236349853 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40074e0 con 0x7fecd40cc1a0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.417+0000 7fecd0ff9640 1 -- 172.21.15.113:0/3236349853 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4007640 con 0x7fecd40cc1a0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.417+0000 7fecd0ff9640 1 -- 172.21.15.113:0/3236349853 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40049e0 con 0x7fecd40cc1a0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.417+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd406c9b0 con 0x7fecd40cc1a0 2023-12-19T13:47:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.417+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd406cf70 con 0x7fecd40cc1a0 2023-12-19T13:47:24.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.418+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd4061910 con 0x7fecd40cc1a0 2023-12-19T13:47:24.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.419+0000 7fecd0ff9640 1 -- 172.21.15.113:0/3236349853 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fecc4004b40 con 0x7fecd40cc1a0 2023-12-19T13:47:24.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.420+0000 7fecd0ff9640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fecb806a430 0x7fecb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.420+0000 7fecd0ff9640 1 -- 172.21.15.113:0/3236349853 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fecc40882e0 con 0x7fecd40cc1a0 2023-12-19T13:47:24.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.421+0000 7feccaffd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fecb806a430 0x7fecb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.421+0000 7feccaffd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fecb806a430 0x7fecb806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fecbc038000 tx=0x7fecbc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:24.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.425+0000 7fecd0ff9640 1 -- 172.21.15.113:0/3236349853 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fecc4053920 con 0x7fecd40cc1a0 2023-12-19T13:47:24.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.617+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecd414ffb0 con 0x7fecd40cc1a0 2023-12-19T13:47:24.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.618+0000 7fecd0ff9640 1 -- 172.21.15.113:0/3236349853 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecc4056f40 con 0x7fecd40cc1a0 2023-12-19T13:47:24.618 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fecb806a430 msgr2=0x7fecb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fecb806a430 0x7fecb806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fecbc038000 tx=0x7fecbc032000 comp rx=0 tx=0).stop 2023-12-19T13:47:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cc1a0 msgr2=0x7fecd414f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cc1a0 0x7fecd414f8c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c3e0 tx=0x7fecc400c8a0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 shutdown_connections 2023-12-19T13:47:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fecb806a430 0x7fecb806c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecd40cf580 0x7fecd40b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd40cc880 0x7fecd40b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 --2- 172.21.15.113:0/3236349853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecd40cc1a0 0x7fecd414f8c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.620+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 >> 172.21.15.113:0/3236349853 conn(0x7fecd4073150 msgr2=0x7fecd4157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.621+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 shutdown_connections 2023-12-19T13:47:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.621+0000 7fecd9abd640 1 -- 172.21.15.113:0/3236349853 wait complete. 2023-12-19T13:47:24.639 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:47:24.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.849+0000 7fd5f6739640 1 Processor -- start 2023-12-19T13:47:24.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.849+0000 7fd5f6739640 1 -- start start 2023-12-19T13:47:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.851+0000 7fd5f6739640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f00b1710 0x7fd5f006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.851+0000 7fd5f6739640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f00b2600 con 0x7fd5f015e040 2023-12-19T13:47:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.851+0000 7fd5f6739640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f00b1d60 con 0x7fd5f0157aa0 2023-12-19T13:47:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.851+0000 7fd5f6739640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00b2040 con 0x7fd5f00b1710 2023-12-19T13:47:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.851+0000 7fd5f4cd6640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd5f015e040 0x7fd5f015e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46102/0 (socket says 172.21.15.113:46102) 2023-12-19T13:47:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.851+0000 7fd5f4cd6640 1 -- 172.21.15.113:0/2229149425 learned_addr learned my addr 172.21.15.113:0/2229149425 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.851+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f00b1710 0x7fd5f006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401175980 0 0) 0x7fd5f00b2600 con 0x7fd5f015e040 2023-12-19T13:47:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d8003520 con 0x7fd5f015e040 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1470078425 0 0) 0x7fd5d8003520 con 0x7fd5f015e040 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f00b1710 msgr2=0x7fd5f006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f00b1710 0x7fd5f006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 >> v1:172.21.15.151:6789/0 conn(0x7fd5f0157aa0 legacy=0x7fd5f0161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f00b2320 con 0x7fd5f015e040 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fd5e80019f0 con 0x7fd5f015e040 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 >> v1:172.21.15.113:6789/0 conn(0x7fd5f015e040 legacy=0x7fd5f015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8003a10 0x7fd5d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5d80047c0 0x7fd5d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5d80051d0 0x7fd5d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00b2040 con 0x7fd5d80047c0 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d800c0b0 con 0x7fd5d8003a10 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d800c270 con 0x7fd5d80051d0 2023-12-19T13:47:24.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.852+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f00b1710 0x7fd5f006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:24.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5d80047c0 0x7fd5d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5effff640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8003a10 0x7fd5d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5f4cd6640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5d80051d0 0x7fd5d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5ef7fe640 1 -- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5d80051d0 msgr2=0x7fd5d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5d80051d0 0x7fd5d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5ef7fe640 1 -- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8003a10 msgr2=0x7fd5d8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8003a10 0x7fd5d8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.853+0000 7fd5ef7fe640 1 -- 172.21.15.113:0/2229149425 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8003520 con 0x7fd5d80047c0 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.854+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5d80047c0 0x7fd5d8004c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4006fd0 tx=0x7fd5d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93a14f04383ea35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4033600 con 0x7fd5d80047c0 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e402f050 con 0x7fd5d80047c0 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5eeffd640 1 -- 172.21.15.113:0/2229149425 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4033980 con 0x7fd5d80047c0 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5f6739640 1 -- 172.21.15.113:0/2229149425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5d80047c0 msgr2=0x7fd5d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5f6739640 1 --2- 172.21.15.113:0/2229149425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5d80047c0 0x7fd5d8004c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4006fd0 tx=0x7fd5d80057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5f4cd6640 1 -- 172.21.15.113:0/2229149425 reap_dead start 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5f6739640 1 -- 172.21.15.113:0/2229149425 shutdown_connections 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5f6739640 1 -- 172.21.15.113:0/2229149425 >> 172.21.15.113:0/2229149425 conn(0x7fd5f00cbb70 msgr2=0x7fd5f00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5f6739640 1 -- 172.21.15.113:0/2229149425 shutdown_connections 2023-12-19T13:47:24.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.855+0000 7fd5f6739640 1 -- 172.21.15.113:0/2229149425 wait complete. 2023-12-19T13:47:24.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.857+0000 7fd5f6739640 1 Processor -- start 2023-12-19T13:47:24.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.857+0000 7fd5f6739640 1 -- start start 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.858+0000 7fd5f6739640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d80047c0 0x7fd5f0154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.858+0000 7fd5f6739640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f0156860 0x7fd5f0156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.858+0000 7fd5f6739640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f014d320 0x7fd5f006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.858+0000 7fd5f6739640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01e8610 con 0x7fd5f0156860 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.858+0000 7fd5f6739640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01e7720 con 0x7fd5d80047c0 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.858+0000 7fd5f6739640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0156130 con 0x7fd5f014d320 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f0156860 0x7fd5f0156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f0156860 0x7fd5f0156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49648/0 (socket says 172.21.15.113:49648) 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 -- 172.21.15.113:0/2070960486 learned_addr learned my addr 172.21.15.113:0/2070960486 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5effff640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d80047c0 0x7fd5f0154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5f4cd6640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f014d320 0x7fd5f006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 -- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f014d320 msgr2=0x7fd5f006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f014d320 0x7fd5f006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 -- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d80047c0 msgr2=0x7fd5f0154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d80047c0 0x7fd5f0154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 -- 172.21.15.113:0/2070960486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f014d7d0 con 0x7fd5f0156860 2023-12-19T13:47:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.859+0000 7fd5ef7fe640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f0156860 0x7fd5f0156da0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00acc00 tx=0x7fd5e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.860+0000 7fd5ecff9640 1 -- 172.21.15.113:0/2070960486 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40328f0 con 0x7fd5f0156860 2023-12-19T13:47:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.860+0000 7fd5ecff9640 1 -- 172.21.15.113:0/2070960486 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e4032a50 con 0x7fd5f0156860 2023-12-19T13:47:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.860+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f01e71a0 con 0x7fd5f0156860 2023-12-19T13:47:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.860+0000 7fd5ecff9640 1 -- 172.21.15.113:0/2070960486 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4032de0 con 0x7fd5f0156860 2023-12-19T13:47:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.860+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f0156340 con 0x7fd5f0156860 2023-12-19T13:47:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.861+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f0061910 con 0x7fd5f0156860 2023-12-19T13:47:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.862+0000 7fd5ecff9640 1 -- 172.21.15.113:0/2070960486 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd5e403d410 con 0x7fd5f0156860 2023-12-19T13:47:24.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.863+0000 7fd5ecff9640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd5dc06a460 0x7fd5dc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:24.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.863+0000 7fd5ecff9640 1 -- 172.21.15.113:0/2070960486 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd5e40aade0 con 0x7fd5f0156860 2023-12-19T13:47:24.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.863+0000 7fd5effff640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd5dc06a460 0x7fd5dc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.863+0000 7fd5effff640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd5dc06a460 0x7fd5dc06c920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007fd0 tx=0x7fd5e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:24.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:24.867+0000 7fd5ecff9640 1 -- 172.21.15.113:0/2070960486 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd5e40762f0 con 0x7fd5f0156860 2023-12-19T13:47:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.068+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd5f0071ae0 con 0x7fd5f0156860 2023-12-19T13:47:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.068+0000 7fd5ecff9640 1 -- 172.21.15.113:0/2070960486 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd5e400f040 con 0x7fd5f0156860 2023-12-19T13:47:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd5dc06a460 msgr2=0x7fd5dc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd5dc06a460 0x7fd5dc06c920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007fd0 tx=0x7fd5e0009040 comp rx=0 tx=0).stop 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f0156860 msgr2=0x7fd5f0156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f0156860 0x7fd5f0156da0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00acc00 tx=0x7fd5e4004730 comp rx=0 tx=0).stop 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 shutdown_connections 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd5dc06a460 0x7fd5dc06c920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f014d320 0x7fd5f006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f0156860 0x7fd5f0156da0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 --2- 172.21.15.113:0/2070960486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d80047c0 0x7fd5f0154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 >> 172.21.15.113:0/2070960486 conn(0x7fd5f00cbb70 msgr2=0x7fd5f00af520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 shutdown_connections 2023-12-19T13:47:25.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.071+0000 7fd5f6739640 1 -- 172.21.15.113:0/2070960486 wait complete. 2023-12-19T13:47:25.088 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-19T13:47:25.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:25.089 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-19T13:47:25.182 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:47:25.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:25.182 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T13:47:25.231 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:25.231 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:25.293 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:25.293 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:25.346 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:25.346 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:25.395 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:25.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.620+0000 7fc3ecd3c640 1 Processor -- start 2023-12-19T13:47:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.620+0000 7fc3ecd3c640 1 -- start start 2023-12-19T13:47:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.622+0000 7fc3ecd3c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc3e8161900 0x7fc3e8168580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.622+0000 7fc3ecd3c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e80d1070 con 0x7fc3e8146da0 2023-12-19T13:47:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.622+0000 7fc3ecd3c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e8162020 con 0x7fc3e8147180 2023-12-19T13:47:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.622+0000 7fc3ecd3c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80aabd0 con 0x7fc3e8161900 2023-12-19T13:47:25.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.622+0000 7fc3e659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc3e8146da0 0x7fc3e80aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46118/0 (socket says 172.21.15.113:46118) 2023-12-19T13:47:25.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.622+0000 7fc3e659c640 1 -- 172.21.15.113:0/3925980252 learned_addr learned my addr 172.21.15.113:0/3925980252 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:25.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.622+0000 7fc3e6d9d640 1 --2- 172.21.15.113:0/3925980252 >> v2:172.21.15.113:3300/0 conn(0x7fc3e8161900 0x7fc3e8168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:25.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.623+0000 7fc3e6d9d640 1 -- 172.21.15.113:0/3925980252 >> v1:172.21.15.151:6789/0 conn(0x7fc3e8147180 legacy=0x7fc3e81611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:25.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.623+0000 7fc3e6d9d640 1 -- 172.21.15.113:0/3925980252 >> v1:172.21.15.113:6789/0 conn(0x7fc3e8146da0 legacy=0x7fc3e80aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.623+0000 7fc3e6d9d640 1 -- 172.21.15.113:0/3925980252 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80aaeb0 con 0x7fc3e8161900 2023-12-19T13:47:25.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.624+0000 7fc3e6d9d640 1 --2- 172.21.15.113:0/3925980252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e8168580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009d90 tx=0x7fc3e002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890521373b7d16fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:25.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.624+0000 7fc3e5d9b640 1 -- 172.21.15.113:0/3925980252 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e002cc60 con 0x7fc3e8161900 2023-12-19T13:47:25.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.624+0000 7fc3e5d9b640 1 -- 172.21.15.113:0/3925980252 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e002cdc0 con 0x7fc3e8161900 2023-12-19T13:47:25.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.624+0000 7fc3e5d9b640 1 -- 172.21.15.113:0/3925980252 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0034660 con 0x7fc3e8161900 2023-12-19T13:47:25.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.624+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/3925980252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 msgr2=0x7fc3e8168580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.624+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/3925980252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e8168580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009d90 tx=0x7fc3e002beb0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.625+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/3925980252 shutdown_connections 2023-12-19T13:47:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.625+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/3925980252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e8168580 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.625+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/3925980252 >> 172.21.15.113:0/3925980252 conn(0x7fc3e8071a50 msgr2=0x7fc3e80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.625+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/3925980252 shutdown_connections 2023-12-19T13:47:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.625+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/3925980252 wait complete. 2023-12-19T13:47:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.626+0000 7fc3ecd3c640 1 Processor -- start 2023-12-19T13:47:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.626+0000 7fc3ecd3c640 1 -- start start 2023-12-19T13:47:25.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.627+0000 7fc3ecd3c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3e8146da0 0x7fc3e80aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:25.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.627+0000 7fc3ecd3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e815c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:25.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.627+0000 7fc3ecd3c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3e8158f00 0x7fc3e80b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:25.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.627+0000 7fc3ecd3c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80af810 con 0x7fc3e8161900 2023-12-19T13:47:25.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.627+0000 7fc3ecd3c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81598c0 con 0x7fc3e8158f00 2023-12-19T13:47:25.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.627+0000 7fc3ecd3c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80af250 con 0x7fc3e8146da0 2023-12-19T13:47:25.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:25.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e815c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49666/0 (socket says 172.21.15.113:49666) 2023-12-19T13:47:25.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 -- 172.21.15.113:0/2526587269 learned_addr learned my addr 172.21.15.113:0/2526587269 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3e6d9d640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3e8158f00 0x7fc3e80b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3e659c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3e8146da0 0x7fc3e80aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 -- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3e8146da0 msgr2=0x7fc3e80aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3e8146da0 0x7fc3e80aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 -- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3e8158f00 msgr2=0x7fc3e80b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3e8158f00 0x7fc3e80b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 -- 172.21.15.113:0/2526587269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0009a70 con 0x7fc3e8161900 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3e6d9d640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3e8158f00 0x7fc3e80b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:25.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.628+0000 7fc3dffff640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e815c590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c430 tx=0x7fc3d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:25.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.629+0000 7fc3deffd640 1 -- 172.21.15.113:0/2526587269 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0011790 con 0x7fc3e8161900 2023-12-19T13:47:25.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.629+0000 7fc3deffd640 1 -- 172.21.15.113:0/2526587269 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00118f0 con 0x7fc3e8161900 2023-12-19T13:47:25.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.629+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e80af530 con 0x7fc3e8161900 2023-12-19T13:47:25.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.629+0000 7fc3deffd640 1 -- 172.21.15.113:0/2526587269 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0011ca0 con 0x7fc3e8161900 2023-12-19T13:47:25.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.629+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e81f2e70 con 0x7fc3e8161900 2023-12-19T13:47:25.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.630+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8073ec0 con 0x7fc3e8161900 2023-12-19T13:47:25.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.631+0000 7fc3deffd640 1 -- 172.21.15.113:0/2526587269 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc3d001c460 con 0x7fc3e8161900 2023-12-19T13:47:25.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.632+0000 7fc3deffd640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3c806a430 0x7fc3c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:25.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.632+0000 7fc3deffd640 1 -- 172.21.15.113:0/2526587269 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc3d00888c0 con 0x7fc3e8161900 2023-12-19T13:47:25.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.632+0000 7fc3e659c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3c806a430 0x7fc3c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:25.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.633+0000 7fc3e659c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3c806a430 0x7fc3c806c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8005880 tx=0x7fc3d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:25.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.636+0000 7fc3deffd640 1 -- 172.21.15.113:0/2526587269 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc3d0053e60 con 0x7fc3e8161900 2023-12-19T13:47:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.828+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3e8159720 con 0x7fc3e8161900 2023-12-19T13:47:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.830+0000 7fc3deffd640 1 -- 172.21.15.113:0/2526587269 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16184 (secure 0 0 0) 0x7fc3e8159720 con 0x7fc3e8161900 2023-12-19T13:47:25.831 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:25.831 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":22,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:20.429480+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2a","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3c806a430 msgr2=0x7fc3c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3c806a430 0x7fc3c806c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8005880 tx=0x7fc3d8009040 comp rx=0 tx=0).stop 2023-12-19T13:47:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 msgr2=0x7fc3e815c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e815c590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c430 tx=0x7fc3d000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 shutdown_connections 2023-12-19T13:47:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3c806a430 0x7fc3c806c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3e8158f00 0x7fc3e80b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e8161900 0x7fc3e815c590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 --2- 172.21.15.113:0/2526587269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3e8146da0 0x7fc3e80aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 >> 172.21.15.113:0/2526587269 conn(0x7fc3e8071a50 msgr2=0x7fc3e8144360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 shutdown_connections 2023-12-19T13:47:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:25.832+0000 7fc3ecd3c640 1 -- 172.21.15.113:0/2526587269 wait complete. 2023-12-19T13:47:25.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:25.852 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:26.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.056+0000 7f344d877640 1 Processor -- start 2023-12-19T13:47:26.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.056+0000 7f344d877640 1 -- start start 2023-12-19T13:47:26.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.058+0000 7f344d877640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3448154760 0x7f344815b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.058+0000 7f344d877640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34480ccbd0 con 0x7f34480cb810 2023-12-19T13:47:26.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.058+0000 7f344d877640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3448154b40 con 0x7f34480b0070 2023-12-19T13:47:26.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.058+0000 7f344d877640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34480ccf20 con 0x7f3448154760 2023-12-19T13:47:26.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.058+0000 7f3446ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3448154760 0x7f344815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.058+0000 7f3446ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3448154760 0x7f344815b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49682/0 (socket says 172.21.15.113:49682) 2023-12-19T13:47:26.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.058+0000 7f3446ffd640 1 -- 172.21.15.113:0/2758916803 learned_addr learned my addr 172.21.15.113:0/2758916803 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.059+0000 7f3446ffd640 1 -- 172.21.15.113:0/2758916803 >> v1:172.21.15.151:6789/0 conn(0x7f34480b0070 legacy=0x7f34480cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.059+0000 7f3446ffd640 1 -- 172.21.15.113:0/2758916803 >> v1:172.21.15.113:6789/0 conn(0x7f34480cb810 legacy=0x7f34480b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.059+0000 7f3446ffd640 1 -- 172.21.15.113:0/2758916803 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480cc060 con 0x7f3448154760 2023-12-19T13:47:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.060+0000 7f3446ffd640 1 --2- 172.21.15.113:0/2758916803 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f344815b290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3438009870 tx=0x7f343802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defa32f57c69d0ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.060+0000 7f34467fc640 1 -- 172.21.15.113:0/2758916803 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438031870 con 0x7f3448154760 2023-12-19T13:47:26.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.060+0000 7f34467fc640 1 -- 172.21.15.113:0/2758916803 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34380319d0 con 0x7f3448154760 2023-12-19T13:47:26.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.060+0000 7f34467fc640 1 -- 172.21.15.113:0/2758916803 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438031d60 con 0x7f3448154760 2023-12-19T13:47:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.061+0000 7f344d877640 1 -- 172.21.15.113:0/2758916803 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 msgr2=0x7f344815b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.061+0000 7f344d877640 1 --2- 172.21.15.113:0/2758916803 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f344815b290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3438009870 tx=0x7f343802b910 comp rx=0 tx=0).stop 2023-12-19T13:47:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.061+0000 7f344d877640 1 -- 172.21.15.113:0/2758916803 shutdown_connections 2023-12-19T13:47:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.061+0000 7f344d877640 1 --2- 172.21.15.113:0/2758916803 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f344815b290 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.061+0000 7f344d877640 1 -- 172.21.15.113:0/2758916803 >> 172.21.15.113:0/2758916803 conn(0x7f3448073150 msgr2=0x7f34480659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.061+0000 7f344d877640 1 -- 172.21.15.113:0/2758916803 shutdown_connections 2023-12-19T13:47:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.061+0000 7f344d877640 1 -- 172.21.15.113:0/2758916803 wait complete. 2023-12-19T13:47:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.063+0000 7f344d877640 1 Processor -- start 2023-12-19T13:47:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.063+0000 7f344d877640 1 -- start start 2023-12-19T13:47:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f344d877640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b0070 0x7f344815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f344d877640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480cb810 0x7f34480acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f344d877640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f34480ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f344d877640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344813e490 con 0x7f3448154760 2023-12-19T13:47:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f344d877640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344806e550 con 0x7f34480cb810 2023-12-19T13:47:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f344d877640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344806d940 con 0x7f34480b0070 2023-12-19T13:47:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f34480ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f34480ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49696/0 (socket says 172.21.15.113:49696) 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 -- 172.21.15.113:0/2709333028 learned_addr learned my addr 172.21.15.113:0/2709333028 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 -- 172.21.15.113:0/2709333028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b0070 msgr2=0x7f344815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b0070 0x7f344815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 -- 172.21.15.113:0/2709333028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480cb810 msgr2=0x7f34480acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480cb810 0x7f34480acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.064+0000 7f34477fe640 1 -- 172.21.15.113:0/2709333028 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380094d0 con 0x7f3448154760 2023-12-19T13:47:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.065+0000 7f34477fe640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f34480ad4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f344000b990 tx=0x7f344000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.065+0000 7f3444ff9640 1 -- 172.21.15.113:0/2709333028 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000cba0 con 0x7f3448154760 2023-12-19T13:47:26.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.065+0000 7f3444ff9640 1 -- 172.21.15.113:0/2709333028 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344000cd00 con 0x7f3448154760 2023-12-19T13:47:26.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.065+0000 7f3444ff9640 1 -- 172.21.15.113:0/2709333028 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440014680 con 0x7f3448154760 2023-12-19T13:47:26.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.065+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344806dc20 con 0x7f3448154760 2023-12-19T13:47:26.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.065+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344806e1e0 con 0x7f3448154760 2023-12-19T13:47:26.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.067+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344806e700 con 0x7f3448154760 2023-12-19T13:47:26.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.067+0000 7f3444ff9640 1 -- 172.21.15.113:0/2709333028 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f344001d3b0 con 0x7f3448154760 2023-12-19T13:47:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.068+0000 7f3444ff9640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.068+0000 7f3444ff9640 1 -- 172.21.15.113:0/2709333028 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3440088910 con 0x7f3448154760 2023-12-19T13:47:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.069+0000 7f3446ffd640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.069+0000 7f3446ffd640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f342806a430 0x7f342806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3438036000 tx=0x7f3438030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.073+0000 7f3444ff9640 1 -- 172.21.15.113:0/2709333028 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f344806e700 con 0x7f3448154760 2023-12-19T13:47:26.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.263+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f344806e6c0 con 0x7f3448154760 2023-12-19T13:47:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.264+0000 7f3444ff9640 1 -- 172.21.15.113:0/2709333028 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3440019020 con 0x7f3448154760 2023-12-19T13:47:26.265 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:26.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.266+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f342806a430 msgr2=0x7f342806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.266+0000 7f344d877640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f342806a430 0x7f342806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3438036000 tx=0x7f3438030000 comp rx=0 tx=0).stop 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.266+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 msgr2=0x7f34480ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.266+0000 7f344d877640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f34480ad4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f344000b990 tx=0x7f344000be50 comp rx=0 tx=0).stop 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 shutdown_connections 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3448154760 0x7f34480ad4b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480cb810 0x7f34480acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 --2- 172.21.15.113:0/2709333028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b0070 0x7f344815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 >> 172.21.15.113:0/2709333028 conn(0x7f3448073150 msgr2=0x7f34480ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 shutdown_connections 2023-12-19T13:47:26.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.267+0000 7f344d877640 1 -- 172.21.15.113:0/2709333028 wait complete. 2023-12-19T13:47:26.286 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.505+0000 7f0bc1877640 1 Processor -- start 2023-12-19T13:47:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.505+0000 7f0bc1877640 1 -- start start 2023-12-19T13:47:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.507+0000 7f0bc1877640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0bbc0d2d00 0x7f0bbc0b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.507+0000 7f0bc1877640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.507+0000 7f0bc1877640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc142bf0 con 0x7f0bbc0b6c80 2023-12-19T13:47:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.507+0000 7f0bc1877640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc142e40 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.507+0000 7f0bc1877640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc143120 con 0x7f0bbc0b8d60 2023-12-19T13:47:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.508+0000 7f0bb27fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.508+0000 7f0bbaffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0bbc0d2d00 0x7f0bbc0b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.508+0000 7f0bbaffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0bbc0d2d00 0x7f0bbc0b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:35004/0 (socket says 172.21.15.113:35004) 2023-12-19T13:47:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.508+0000 7f0bbaffd640 1 -- 172.21.15.113:0/957991763 learned_addr learned my addr 172.21.15.113:0/957991763 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.509+0000 7f0bb27fc640 1 -- 172.21.15.113:0/957991763 >> v2:172.21.15.151:3300/0 conn(0x7f0bbc0d2d00 msgr2=0x7f0bbc0b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.509+0000 7f0bb27fc640 1 --2- 172.21.15.113:0/957991763 >> v2:172.21.15.151:3300/0 conn(0x7f0bbc0d2d00 0x7f0bbc0b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.509+0000 7f0bb27fc640 1 -- 172.21.15.113:0/957991763 >> v1:172.21.15.151:6789/0 conn(0x7f0bbc0b6c80 legacy=0x7f0bbc160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.509+0000 7f0bb27fc640 1 -- 172.21.15.113:0/957991763 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc143400 con 0x7f0bbc0b8d60 2023-12-19T13:47:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.509+0000 7f0bbaffd640 1 --2- 172.21.15.113:0/957991763 >> v2:172.21.15.151:3300/0 conn(0x7f0bbc0d2d00 0x7f0bbc0b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:47:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.510+0000 7f0bb27fc640 1 --2- 172.21.15.113:0/957991763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc0b6740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40097a0 tx=0x7f0ba402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52e202e89cd32c52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bba7fc640 1 -- 172.21.15.113:0/957991763 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba402d040 con 0x7f0bbc0b8d60 2023-12-19T13:47:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bba7fc640 1 -- 172.21.15.113:0/957991763 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4031810 con 0x7f0bbc0b8d60 2023-12-19T13:47:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bba7fc640 1 -- 172.21.15.113:0/957991763 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4031ba0 con 0x7f0bbc0b8d60 2023-12-19T13:47:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bc1877640 1 -- 172.21.15.113:0/957991763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 msgr2=0x7f0bbc0b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bc1877640 1 --2- 172.21.15.113:0/957991763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc0b6740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40097a0 tx=0x7f0ba402b8b0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bc1877640 1 -- 172.21.15.113:0/957991763 shutdown_connections 2023-12-19T13:47:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bc1877640 1 --2- 172.21.15.113:0/957991763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc0b6740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bc1877640 1 --2- 172.21.15.113:0/957991763 >> v2:172.21.15.151:3300/0 conn(0x7f0bbc0d2d00 0x7f0bbc0b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.511+0000 7f0bc1877640 1 -- 172.21.15.113:0/957991763 >> 172.21.15.113:0/957991763 conn(0x7f0bbc0cfe10 msgr2=0x7f0bbc0d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.512+0000 7f0bc1877640 1 -- 172.21.15.113:0/957991763 shutdown_connections 2023-12-19T13:47:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.512+0000 7f0bc1877640 1 -- 172.21.15.113:0/957991763 wait complete. 2023-12-19T13:47:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.513+0000 7f0bc1877640 1 Processor -- start 2023-12-19T13:47:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.513+0000 7f0bc1877640 1 -- start start 2023-12-19T13:47:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.514+0000 7f0bc1877640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0b6c80 0x7f0bbc13fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.514+0000 7f0bc1877640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc15de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.514+0000 7f0bc1877640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bbc0d2d00 0x7f0bbc15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.514+0000 7f0bc1877640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc158bd0 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.514+0000 7f0bc1877640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc158eb0 con 0x7f0bbc0b6c80 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.514+0000 7f0bc1877640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc159190 con 0x7f0bbc0b8d60 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bbc0d2d00 0x7f0bbc15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bbc0d2d00 0x7f0bbc15e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49706/0 (socket says 172.21.15.113:49706) 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 -- 172.21.15.113:0/4169028144 learned_addr learned my addr 172.21.15.113:0/4169028144 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbaffd640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0b6c80 0x7f0bbc13fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bb27fc640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 -- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 msgr2=0x7f0bbc15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc15de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 -- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0b6c80 msgr2=0x7f0bbc13fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0b6c80 0x7f0bbc13fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.515+0000 7f0bbb7fe640 1 -- 172.21.15.113:0/4169028144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0094d0 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.516+0000 7f0bbb7fe640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bbc0d2d00 0x7f0bbc15e3d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400c6b0 tx=0x7f0bb400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.516+0000 7f0bb8ff9640 1 -- 172.21.15.113:0/4169028144 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4003b70 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.516+0000 7f0bb8ff9640 1 -- 172.21.15.113:0/4169028144 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb4003cf0 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.516+0000 7f0bb8ff9640 1 -- 172.21.15.113:0/4169028144 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4003ea0 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.516+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba4009400 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.516+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc159750 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.517+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc061910 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.518+0000 7f0bb8ff9640 1 -- 172.21.15.113:0/4169028144 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bb4005310 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.519+0000 7f0bb8ff9640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.519+0000 7f0bb8ff9640 1 -- 172.21.15.113:0/4169028144 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0bb4088790 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.519+0000 7f0bbaffd640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.520+0000 7f0bbaffd640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009cf0 tx=0x7f0bac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.523+0000 7f0bb8ff9640 1 -- 172.21.15.113:0/4169028144 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0bb4053ca0 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.715+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bbc1436b0 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.716+0000 7f0bb8ff9640 1 -- 172.21.15.113:0/4169028144 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bb40572c0 con 0x7f0bbc0d2d00 2023-12-19T13:47:26.716 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0b9c06a430 msgr2=0x7f0b9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009cf0 tx=0x7f0bac008040 comp rx=0 tx=0).stop 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bbc0d2d00 msgr2=0x7f0bbc15e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bbc0d2d00 0x7f0bbc15e3d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400c6b0 tx=0x7f0bb400cb70 comp rx=0 tx=0).stop 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 shutdown_connections 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bbc0d2d00 0x7f0bbc15e3d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bbc0b8d60 0x7f0bbc15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 --2- 172.21.15.113:0/4169028144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0b6c80 0x7f0bbc13fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 >> 172.21.15.113:0/4169028144 conn(0x7f0bbc0cfe10 msgr2=0x7f0bbc15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:26.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 shutdown_connections 2023-12-19T13:47:26.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.719+0000 7f0bc1877640 1 -- 172.21.15.113:0/4169028144 wait complete. 2023-12-19T13:47:26.738 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.953+0000 7ff21cb62640 1 Processor -- start 2023-12-19T13:47:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.953+0000 7ff21cb62640 1 -- start start 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.955+0000 7ff21cb62640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 0x7ff2180d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.955+0000 7ff21cb62640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff218070260 con 0x7ff21806f490 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.955+0000 7ff21cb62640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180b6ea0 con 0x7ff218146cd0 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.955+0000 7ff21cb62640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2181470b0 con 0x7ff21806f8f0 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.956+0000 7ff216ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff21806f490 0x7ff2180d1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46142/0 (socket says 172.21.15.113:46142) 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.956+0000 7ff216ffd640 1 -- 172.21.15.113:0/2340196413 learned_addr learned my addr 172.21.15.113:0/2340196413 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.956+0000 7ff217fff640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 0x7ff2180d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.956+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998172913 0 0) 0x7ff218070260 con 0x7ff21806f490 2023-12-19T13:47:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.956+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff200003520 con 0x7ff21806f490 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253425779 0 0) 0x7ff200003520 con 0x7ff21806f490 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 msgr2=0x7ff2180d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 0x7ff2180d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 >> v1:172.21.15.151:6789/0 conn(0x7ff218146cd0 legacy=0x7ff2180b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180b7180 con 0x7ff21806f490 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff20c001670 con 0x7ff21806f490 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 >> v1:172.21.15.113:6789/0 conn(0x7ff21806f490 legacy=0x7ff2180d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 0x7ff2000039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff200003f20 0x7ff2000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff200004d00 0x7ff200005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2181470b0 con 0x7ff200003f20 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000bb10 con 0x7ff200004d00 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000bcd0 con 0x7ff21806f8f0 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.957+0000 7ff216ffd640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff200003f20 0x7ff2000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff217fff640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff200004d00 0x7ff200005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff2177fe640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 0x7ff2000039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff216ffd640 1 -- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 msgr2=0x7ff2000039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff216ffd640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 0x7ff2000039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff216ffd640 1 -- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff200004d00 msgr2=0x7ff200005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff216ffd640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff200004d00 0x7ff200005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff216ffd640 1 -- 172.21.15.113:0/2340196413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200003520 con 0x7ff200003f20 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff2177fe640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff21806f8f0 0x7ff2000039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.958+0000 7ff217fff640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff200004d00 0x7ff200005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.959+0000 7ff216ffd640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff200003f20 0x7ff2000047c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c240 tx=0x7ff2000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b53b19e3a37690 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.959+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c005ad0 con 0x7ff200003f20 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.959+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c005c30 con 0x7ff200003f20 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.959+0000 7ff2167fc640 1 -- 172.21.15.113:0/2340196413 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c02c8b0 con 0x7ff200003f20 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.960+0000 7ff21cb62640 1 -- 172.21.15.113:0/2340196413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff200003f20 msgr2=0x7ff2000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.960+0000 7ff21cb62640 1 --2- 172.21.15.113:0/2340196413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff200003f20 0x7ff2000047c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c240 tx=0x7ff2000057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.960+0000 7ff217fff640 1 -- 172.21.15.113:0/2340196413 reap_dead start 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.960+0000 7ff21cb62640 1 -- 172.21.15.113:0/2340196413 shutdown_connections 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.960+0000 7ff21cb62640 1 -- 172.21.15.113:0/2340196413 >> 172.21.15.113:0/2340196413 conn(0x7ff2180d3200 msgr2=0x7ff2180d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.960+0000 7ff21cb62640 1 -- 172.21.15.113:0/2340196413 shutdown_connections 2023-12-19T13:47:26.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.960+0000 7ff21cb62640 1 -- 172.21.15.113:0/2340196413 wait complete. 2023-12-19T13:47:26.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.962+0000 7ff21cb62640 1 Processor -- start 2023-12-19T13:47:26.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.962+0000 7ff21cb62640 1 -- start start 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff21cb62640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff200003f20 0x7ff21813c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff21cb62640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2180b5150 0x7ff2180b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff21cb62640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff218140df0 0x7ff218141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff21cb62640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180b5b10 con 0x7ff2180b5150 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff21cb62640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff218141be0 con 0x7ff218140df0 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff21cb62640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff218141ec0 con 0x7ff200003f20 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2180b5150 0x7ff2180b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2180b5150 0x7ff2180b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49726/0 (socket says 172.21.15.113:49726) 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff216ffd640 1 -- 172.21.15.113:0/714827516 learned_addr learned my addr 172.21.15.113:0/714827516 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.963+0000 7ff2177fe640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff200003f20 0x7ff21813c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff216ffd640 1 -- 172.21.15.113:0/714827516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff200003f20 msgr2=0x7ff21813c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff216ffd640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff200003f20 0x7ff21813c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff216ffd640 1 -- 172.21.15.113:0/714827516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff218140df0 msgr2=0x7ff218141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff216ffd640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff218140df0 0x7ff218141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff216ffd640 1 -- 172.21.15.113:0/714827516 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2181421a0 con 0x7ff2180b5150 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff216ffd640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2180b5150 0x7ff2180b55d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000f60 tx=0x7ff20c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff1fffff640 1 -- 172.21.15.113:0/714827516 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c039070 con 0x7ff2180b5150 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff1fffff640 1 -- 172.21.15.113:0/714827516 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c02ccc0 con 0x7ff2180b5150 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff218142480 con 0x7ff2180b5150 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff1fffff640 1 -- 172.21.15.113:0/714827516 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c007270 con 0x7ff2180b5150 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.964+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21813c8d0 con 0x7ff2180b5150 2023-12-19T13:47:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.966+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21813ca60 con 0x7ff2180b5150 2023-12-19T13:47:26.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.966+0000 7ff1fffff640 1 -- 172.21.15.113:0/714827516 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff20c032070 con 0x7ff2180b5150 2023-12-19T13:47:26.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.967+0000 7ff1fffff640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a460 0x7ff20406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:26.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.967+0000 7ff1fffff640 1 -- 172.21.15.113:0/714827516 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff20c03c040 con 0x7ff2180b5150 2023-12-19T13:47:26.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.967+0000 7ff2177fe640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a460 0x7ff20406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:26.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.968+0000 7ff2177fe640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a460 0x7ff20406c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff208001630 tx=0x7ff208009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:26.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:26.971+0000 7ff1fffff640 1 -- 172.21.15.113:0/714827516 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff21813ca60 con 0x7ff2180b5150 2023-12-19T13:47:27.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.160+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff21813ca60 con 0x7ff2180b5150 2023-12-19T13:47:27.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.161+0000 7ff1fffff640 1 -- 172.21.15.113:0/714827516 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff21813ca60 con 0x7ff2180b5150 2023-12-19T13:47:27.162 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a460 msgr2=0x7ff20406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a460 0x7ff20406c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff208001630 tx=0x7ff208009040 comp rx=0 tx=0).stop 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2180b5150 msgr2=0x7ff2180b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2180b5150 0x7ff2180b55d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000f60 tx=0x7ff20c001a00 comp rx=0 tx=0).stop 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 shutdown_connections 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a460 0x7ff20406c920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff218140df0 0x7ff218141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2180b5150 0x7ff2180b55d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.163+0000 7ff21cb62640 1 --2- 172.21.15.113:0/714827516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff200003f20 0x7ff21813c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.164+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 >> 172.21.15.113:0/714827516 conn(0x7ff2180d3200 msgr2=0x7ff218145ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:27.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.164+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 shutdown_connections 2023-12-19T13:47:27.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.164+0000 7ff21cb62640 1 -- 172.21.15.113:0/714827516 wait complete. 2023-12-19T13:47:27.182 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:47:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.398+0000 7fc7b760e640 1 Processor -- start 2023-12-19T13:47:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.398+0000 7fc7b760e640 1 -- start start 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b760e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7b00b0b50 0x7fc7b006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b760e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7b006b590 0x7fc7b006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b760e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b006bb30 con 0x7fc7b01449e0 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b760e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00b0070 con 0x7fc7b006b590 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b760e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00b0350 con 0x7fc7b00b0b50 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b5bab640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7b006b590 0x7fc7b006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b5bab640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7b006b590 0x7fc7b006c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49742/0 (socket says 172.21.15.113:49742) 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b5bab640 1 -- 172.21.15.113:0/3274405725 learned_addr learned my addr 172.21.15.113:0/3274405725 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:27.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.400+0000 7fc7b4ba9640 1 --2- 172.21.15.113:0/3274405725 >> v2:172.21.15.151:3300/0 conn(0x7fc7b00b0b50 0x7fc7b006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:27.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.401+0000 7fc7b5bab640 1 -- 172.21.15.113:0/3274405725 >> v2:172.21.15.151:3300/0 conn(0x7fc7b00b0b50 msgr2=0x7fc7b006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:27.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.401+0000 7fc7b5bab640 1 --2- 172.21.15.113:0/3274405725 >> v2:172.21.15.151:3300/0 conn(0x7fc7b00b0b50 0x7fc7b006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.401+0000 7fc7b5bab640 1 -- 172.21.15.113:0/3274405725 >> v1:172.21.15.113:6789/0 conn(0x7fc7b01449e0 legacy=0x7fc7b00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.401+0000 7fc7b5bab640 1 -- 172.21.15.113:0/3274405725 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00b0630 con 0x7fc7b006b590 2023-12-19T13:47:27.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.401+0000 7fc7a7fff640 1 -- 172.21.15.113:0/3274405725 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800443584 0 0) 0x7fc7b006bb30 con 0x7fc7b01449e0 2023-12-19T13:47:27.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.402+0000 7fc7b5bab640 1 --2- 172.21.15.113:0/3274405725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006b590 0x7fc7b006c4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0071c80 tx=0x7fc7a802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e1cc0116aac577 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.402+0000 7fc7a7fff640 1 -- 172.21.15.113:0/3274405725 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a802cb20 con 0x7fc7b006b590 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.402+0000 7fc7a7fff640 1 -- 172.21.15.113:0/3274405725 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a802cc80 con 0x7fc7b006b590 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.402+0000 7fc7a7fff640 1 -- 172.21.15.113:0/3274405725 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80343f0 con 0x7fc7b006b590 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 -- 172.21.15.113:0/3274405725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006b590 msgr2=0x7fc7b006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 --2- 172.21.15.113:0/3274405725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006b590 0x7fc7b006c4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0071c80 tx=0x7fc7a802bf80 comp rx=0 tx=0).stop 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 -- 172.21.15.113:0/3274405725 shutdown_connections 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 --2- 172.21.15.113:0/3274405725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006b590 0x7fc7b006c4e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 --2- 172.21.15.113:0/3274405725 >> v2:172.21.15.151:3300/0 conn(0x7fc7b00b0b50 0x7fc7b006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 -- 172.21.15.113:0/3274405725 >> 172.21.15.113:0/3274405725 conn(0x7fc7b00cbb70 msgr2=0x7fc7b00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 -- 172.21.15.113:0/3274405725 shutdown_connections 2023-12-19T13:47:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.403+0000 7fc7b760e640 1 -- 172.21.15.113:0/3274405725 wait complete. 2023-12-19T13:47:27.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.405+0000 7fc7b760e640 1 Processor -- start 2023-12-19T13:47:27.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.405+0000 7fc7b760e640 1 -- start start 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.406+0000 7fc7b760e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b006b590 0x7fc7b0157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.406+0000 7fc7b760e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7b00b0b50 0x7fc7b013ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.406+0000 7fc7b760e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b01449e0 0x7fc7b00cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.406+0000 7fc7b760e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b01582a0 con 0x7fc7b01449e0 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.406+0000 7fc7b760e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b013b890 con 0x7fc7b006b590 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.406+0000 7fc7b760e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0142d40 con 0x7fc7b00b0b50 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.406+0000 7fc7b5bab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b01449e0 0x7fc7b00cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b01449e0 0x7fc7b00cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49752/0 (socket says 172.21.15.113:49752) 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 -- 172.21.15.113:0/1746902964 learned_addr learned my addr 172.21.15.113:0/1746902964 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 -- 172.21.15.113:0/1746902964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7b00b0b50 msgr2=0x7fc7b013ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7b00b0b50 0x7fc7b013ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b53aa640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b006b590 0x7fc7b0157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 -- 172.21.15.113:0/1746902964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b006b590 msgr2=0x7fc7b0157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b006b590 0x7fc7b0157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 -- 172.21.15.113:0/1746902964 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8009b30 con 0x7fc7b01449e0 2023-12-19T13:47:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.407+0000 7fc7b5bab640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b01449e0 0x7fc7b00cdc80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8036040 tx=0x7fc7a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.408+0000 7fc7a5ffb640 1 -- 172.21.15.113:0/1746902964 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8009510 con 0x7fc7b01449e0 2023-12-19T13:47:27.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.408+0000 7fc7a5ffb640 1 -- 172.21.15.113:0/1746902964 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a803e450 con 0x7fc7b01449e0 2023-12-19T13:47:27.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.408+0000 7fc7a5ffb640 1 -- 172.21.15.113:0/1746902964 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a803e5e0 con 0x7fc7b01449e0 2023-12-19T13:47:27.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.408+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b013d1f0 con 0x7fc7b01449e0 2023-12-19T13:47:27.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.408+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b0142410 con 0x7fc7b01449e0 2023-12-19T13:47:27.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.409+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b0061910 con 0x7fc7b01449e0 2023-12-19T13:47:27.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.410+0000 7fc7a5ffb640 1 -- 172.21.15.113:0/1746902964 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc7a803e740 con 0x7fc7b01449e0 2023-12-19T13:47:27.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.411+0000 7fc7a5ffb640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc79406a430 0x7fc79406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:27.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.411+0000 7fc7a5ffb640 1 -- 172.21.15.113:0/1746902964 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc7a80aafb0 con 0x7fc7b01449e0 2023-12-19T13:47:27.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.411+0000 7fc7b53aa640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc79406a430 0x7fc79406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:27.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.412+0000 7fc7b53aa640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc79406a430 0x7fc79406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000f60 tx=0x7fc7ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:27.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.415+0000 7fc7a5ffb640 1 -- 172.21.15.113:0/1746902964 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc7a8076550 con 0x7fc7b01449e0 2023-12-19T13:47:27.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.619+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc7b00ae560 con 0x7fc7b01449e0 2023-12-19T13:47:27.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.620+0000 7fc7a5ffb640 1 -- 172.21.15.113:0/1746902964 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc7a8079b70 con 0x7fc7b01449e0 2023-12-19T13:47:27.620 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc79406a430 msgr2=0x7fc79406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc79406a430 0x7fc79406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000f60 tx=0x7fc7ac009040 comp rx=0 tx=0).stop 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b01449e0 msgr2=0x7fc7b00cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b01449e0 0x7fc7b00cdc80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8036040 tx=0x7fc7a8004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 shutdown_connections 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc79406a430 0x7fc79406c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b01449e0 0x7fc7b00cdc80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7b00b0b50 0x7fc7b013ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 --2- 172.21.15.113:0/1746902964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b006b590 0x7fc7b0157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:27.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 >> 172.21.15.113:0/1746902964 conn(0x7fc7b00cbb70 msgr2=0x7fc7b00b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:27.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 shutdown_connections 2023-12-19T13:47:27.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:27.622+0000 7fc7b760e640 1 -- 172.21.15.113:0/1746902964 wait complete. 2023-12-19T13:47:27.641 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-19T13:47:27.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:27.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-19T13:47:27.750 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:47:27.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:27.750 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T13:47:27.800 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:47:27.800 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:28.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.019+0000 7f11bc841640 1 Processor -- start 2023-12-19T13:47:28.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.020+0000 7f11bc841640 1 -- start start 2023-12-19T13:47:28.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.021+0000 7f11bc841640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f11b806c6b0 0x7f11b8166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.021+0000 7f11bc841640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b806bb30 con 0x7f11b81449e0 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.021+0000 7f11bc841640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b80b0070 con 0x7f11b80b0b50 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.021+0000 7f11bc841640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b80b0350 con 0x7f11b806c6b0 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.021+0000 7f11b659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f11b81449e0 0x7f11b80af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55314/0 (socket says 172.21.15.113:55314) 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.021+0000 7f11b659c640 1 -- 172.21.15.113:0/1774965214 learned_addr learned my addr 172.21.15.113:0/1774965214 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.021+0000 7f11b6d9d640 1 --2- 172.21.15.113:0/1774965214 >> v2:172.21.15.113:3300/0 conn(0x7f11b806c6b0 0x7f11b8166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.022+0000 7f11b5d9b640 1 -- 172.21.15.113:0/1774965214 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130479869 0 0) 0x7f11b806bb30 con 0x7f11b81449e0 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.022+0000 7f11b5d9b640 1 -- 172.21.15.113:0/1774965214 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a4003520 con 0x7f11b81449e0 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.022+0000 7f11b6d9d640 1 -- 172.21.15.113:0/1774965214 >> v1:172.21.15.151:6789/0 conn(0x7f11b80b0b50 legacy=0x7f11b806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.022+0000 7f11b6d9d640 1 -- 172.21.15.113:0/1774965214 >> v1:172.21.15.113:6789/0 conn(0x7f11b81449e0 legacy=0x7f11b80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.022+0000 7f11b6d9d640 1 -- 172.21.15.113:0/1774965214 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80b0630 con 0x7f11b806c6b0 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.023+0000 7f11b6d9d640 1 --2- 172.21.15.113:0/1774965214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b806c6b0 0x7f11b8166200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009d90 tx=0x7f11b002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6277785d994e6c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.023+0000 7f11b5d9b640 1 -- 172.21.15.113:0/1774965214 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b002cc60 con 0x7f11b806c6b0 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.023+0000 7f11b5d9b640 1 -- 172.21.15.113:0/1774965214 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b002cdc0 con 0x7f11b806c6b0 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.023+0000 7f11b5d9b640 1 -- 172.21.15.113:0/1774965214 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0034660 con 0x7f11b806c6b0 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.024+0000 7f11bc841640 1 -- 172.21.15.113:0/1774965214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b806c6b0 msgr2=0x7f11b8166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.024+0000 7f11bc841640 1 --2- 172.21.15.113:0/1774965214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b806c6b0 0x7f11b8166200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009d90 tx=0x7f11b002beb0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.024+0000 7f11bc841640 1 -- 172.21.15.113:0/1774965214 shutdown_connections 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.024+0000 7f11bc841640 1 --2- 172.21.15.113:0/1774965214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b806c6b0 0x7f11b8166200 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.024+0000 7f11bc841640 1 -- 172.21.15.113:0/1774965214 >> 172.21.15.113:0/1774965214 conn(0x7f11b80cbb70 msgr2=0x7f11b80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.024+0000 7f11bc841640 1 -- 172.21.15.113:0/1774965214 shutdown_connections 2023-12-19T13:47:28.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.024+0000 7f11bc841640 1 -- 172.21.15.113:0/1774965214 wait complete. 2023-12-19T13:47:28.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.026+0000 7f11bc841640 1 Processor -- start 2023-12-19T13:47:28.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.026+0000 7f11bc841640 1 -- start start 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11bc841640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b806c6b0 0x7f11b8158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11bc841640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b80b0b50 0x7f11b815b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11bc841640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b81449e0 0x7f11b815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11bc841640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80ce2b0 con 0x7f11b81449e0 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11bc841640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80acdc0 con 0x7f11b80b0b50 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11bc841640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80cdcf0 con 0x7f11b806c6b0 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11b6d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b81449e0 0x7f11b815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11b6d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b81449e0 0x7f11b815c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59868/0 (socket says 172.21.15.113:59868) 2023-12-19T13:47:28.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.027+0000 7f11b6d9d640 1 -- 172.21.15.113:0/2309331484 learned_addr learned my addr 172.21.15.113:0/2309331484 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b659c640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b806c6b0 0x7f11b8158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b6d9d640 1 -- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b806c6b0 msgr2=0x7f11b8158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11affff640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b80b0b50 0x7f11b815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b6d9d640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b806c6b0 0x7f11b8158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b6d9d640 1 -- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b80b0b50 msgr2=0x7f11b815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b6d9d640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b80b0b50 0x7f11b815b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b6d9d640 1 -- 172.21.15.113:0/2309331484 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009a70 con 0x7f11b81449e0 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b659c640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b806c6b0 0x7f11b8158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11affff640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b80b0b50 0x7f11b815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:28.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11b6d9d640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b81449e0 0x7f11b815c200 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009d90 tx=0x7f11b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11aeffd640 1 -- 172.21.15.113:0/2309331484 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0040650 con 0x7f11b81449e0 2023-12-19T13:47:28.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11aeffd640 1 -- 172.21.15.113:0/2309331484 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b00407b0 con 0x7f11b81449e0 2023-12-19T13:47:28.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.028+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b80cdfd0 con 0x7f11b81449e0 2023-12-19T13:47:28.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.029+0000 7f11aeffd640 1 -- 172.21.15.113:0/2309331484 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0040b60 con 0x7f11b81449e0 2023-12-19T13:47:28.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.029+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b81591b0 con 0x7f11b81449e0 2023-12-19T13:47:28.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.030+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b80ac8b0 con 0x7f11b81449e0 2023-12-19T13:47:28.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.031+0000 7f11aeffd640 1 -- 172.21.15.113:0/2309331484 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f11b0040cc0 con 0x7f11b81449e0 2023-12-19T13:47:28.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.031+0000 7f11aeffd640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f119806a430 0x7f119806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.032+0000 7f11aeffd640 1 -- 172.21.15.113:0/2309331484 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f11b00ab780 con 0x7f11b81449e0 2023-12-19T13:47:28.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.032+0000 7f11b659c640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f119806a430 0x7f119806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.032+0000 7f11b659c640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f119806a430 0x7f119806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11a80011e0 tx=0x7f11a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.036+0000 7f11aeffd640 1 -- 172.21.15.113:0/2309331484 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f11b80ac8b0 con 0x7f11b81449e0 2023-12-19T13:47:28.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.263+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11b80ac8b0 con 0x7f11b81449e0 2023-12-19T13:47:28.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.264+0000 7f11aeffd640 1 -- 172.21.15.113:0/2309331484 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f11b80ac8b0 con 0x7f11b81449e0 2023-12-19T13:47:28.265 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:28.265 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:47:28.265 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:47:28.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.266+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f119806a430 msgr2=0x7f119806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.266+0000 7f11bc841640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f119806a430 0x7f119806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11a80011e0 tx=0x7f11a8009040 comp rx=0 tx=0).stop 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.266+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b81449e0 msgr2=0x7f11b815c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b81449e0 0x7f11b815c200 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009d90 tx=0x7f11b0004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 shutdown_connections 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f119806a430 0x7f119806c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11b81449e0 0x7f11b815c200 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b80b0b50 0x7f11b815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 --2- 172.21.15.113:0/2309331484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b806c6b0 0x7f11b8158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 >> 172.21.15.113:0/2309331484 conn(0x7f11b80cbb70 msgr2=0x7f11b806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 shutdown_connections 2023-12-19T13:47:28.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.267+0000 7f11bc841640 1 -- 172.21.15.113:0/2309331484 wait complete. 2023-12-19T13:47:28.285 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:28.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.496+0000 7f8189ef7640 1 Processor -- start 2023-12-19T13:47:28.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.497+0000 7f8189ef7640 1 -- start start 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.498+0000 7f8189ef7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81841449e0 0x7f81840af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.498+0000 7f8189ef7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f81840b0b50 0x7f818406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.498+0000 7f8189ef7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f818406b590 0x7f818406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.498+0000 7f8189ef7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840afb10 con 0x7f81840b0b50 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.498+0000 7f8189ef7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406bb30 con 0x7f818406b590 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.498+0000 7f8189ef7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840b0070 con 0x7f81841449e0 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f81840b0b50 0x7f818406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f81840b0b50 0x7f818406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59880/0 (socket says 172.21.15.113:59880) 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 -- 172.21.15.113:0/3209123112 learned_addr learned my addr 172.21.15.113:0/3209123112 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f8183fff640 1 --2- 172.21.15.113:0/3209123112 >> v2:172.21.15.151:3300/0 conn(0x7f818406b590 0x7f818406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f81837fe640 1 --2- 172.21.15.113:0/3209123112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81841449e0 0x7f81840af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 -- 172.21.15.113:0/3209123112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81841449e0 msgr2=0x7f81840af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:28.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 --2- 172.21.15.113:0/3209123112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81841449e0 0x7f81840af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 -- 172.21.15.113:0/3209123112 >> v2:172.21.15.151:3300/0 conn(0x7f818406b590 msgr2=0x7f818406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:28.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 --2- 172.21.15.113:0/3209123112 >> v2:172.21.15.151:3300/0 conn(0x7f818406b590 0x7f818406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.499+0000 7f817affd640 1 -- 172.21.15.113:0/3209123112 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840b0350 con 0x7f81840b0b50 2023-12-19T13:47:28.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.500+0000 7f817affd640 1 --2- 172.21.15.113:0/3209123112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81840b0b50 0x7f818406bfa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8184071c50 tx=0x7f816c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1368e3aa4cd5b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8182ffd640 1 -- 172.21.15.113:0/3209123112 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c031860 con 0x7f81840b0b50 2023-12-19T13:47:28.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8182ffd640 1 -- 172.21.15.113:0/3209123112 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c0319c0 con 0x7f81840b0b50 2023-12-19T13:47:28.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8182ffd640 1 -- 172.21.15.113:0/3209123112 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c031d50 con 0x7f81840b0b50 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 -- 172.21.15.113:0/3209123112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81840b0b50 msgr2=0x7f818406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 --2- 172.21.15.113:0/3209123112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81840b0b50 0x7f818406bfa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8184071c50 tx=0x7f816c02b900 comp rx=0 tx=0).stop 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 -- 172.21.15.113:0/3209123112 shutdown_connections 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 --2- 172.21.15.113:0/3209123112 >> v2:172.21.15.151:3300/0 conn(0x7f818406b590 0x7f818406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 --2- 172.21.15.113:0/3209123112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81840b0b50 0x7f818406bfa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 --2- 172.21.15.113:0/3209123112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81841449e0 0x7f81840af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 -- 172.21.15.113:0/3209123112 >> 172.21.15.113:0/3209123112 conn(0x7f81840cbb70 msgr2=0x7f81840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 -- 172.21.15.113:0/3209123112 shutdown_connections 2023-12-19T13:47:28.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.501+0000 7f8189ef7640 1 -- 172.21.15.113:0/3209123112 wait complete. 2023-12-19T13:47:28.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.503+0000 7f8189ef7640 1 Processor -- start 2023-12-19T13:47:28.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.503+0000 7f8189ef7640 1 -- start start 2023-12-19T13:47:28.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.504+0000 7f8189ef7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f818406b590 0x7f8184141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.504+0000 7f8189ef7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81840b0b50 0x7f81840b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.504+0000 7f8189ef7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81841449e0 0x7f81841f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.504+0000 7f8189ef7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ad7a0 con 0x7f818406b590 2023-12-19T13:47:28.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.504+0000 7f8189ef7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ac8b0 con 0x7f81841449e0 2023-12-19T13:47:28.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.504+0000 7f8189ef7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840acb90 con 0x7f81840b0b50 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.504+0000 7f81837fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f818406b590 0x7f8184141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f818406b590 0x7f8184141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59892/0 (socket says 172.21.15.113:59892) 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 -- 172.21.15.113:0/4164021980 learned_addr learned my addr 172.21.15.113:0/4164021980 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f8183fff640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81841449e0 0x7f81841f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f817affd640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81840b0b50 0x7f81840b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 -- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81840b0b50 msgr2=0x7f81840b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81840b0b50 0x7f81840b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 -- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81841449e0 msgr2=0x7f81841f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81841449e0 0x7f81841f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 -- 172.21.15.113:0/4164021980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c0094d0 con 0x7f818406b590 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f8183fff640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81841449e0 0x7f81841f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f81837fe640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f818406b590 0x7f8184141c30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f817400d800 tx=0x7f817400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.505+0000 7f8180ff9640 1 -- 172.21.15.113:0/4164021980 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817400b6c0 con 0x7f818406b590 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.506+0000 7f8180ff9640 1 -- 172.21.15.113:0/4164021980 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817400b820 con 0x7f818406b590 2023-12-19T13:47:28.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.506+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81840ace70 con 0x7f818406b590 2023-12-19T13:47:28.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.506+0000 7f8180ff9640 1 -- 172.21.15.113:0/4164021980 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817400bbb0 con 0x7f818406b590 2023-12-19T13:47:28.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.506+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81840ad430 con 0x7f818406b590 2023-12-19T13:47:28.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.507+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818413f2c0 con 0x7f818406b590 2023-12-19T13:47:28.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.508+0000 7f8180ff9640 1 -- 172.21.15.113:0/4164021980 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f817400bd10 con 0x7f818406b590 2023-12-19T13:47:28.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.509+0000 7f8180ff9640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f816406a430 0x7f816406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.509+0000 7f8180ff9640 1 -- 172.21.15.113:0/4164021980 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8174088eb0 con 0x7f818406b590 2023-12-19T13:47:28.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.509+0000 7f817affd640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f816406a430 0x7f816406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.510+0000 7f817affd640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f816406a430 0x7f816406c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f816c036000 tx=0x7f816c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.514+0000 7f8180ff9640 1 -- 172.21.15.113:0/4164021980 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8174054450 con 0x7f818406b590 2023-12-19T13:47:28.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.704+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8184061910 con 0x7f818406b590 2023-12-19T13:47:28.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.706+0000 7f8180ff9640 1 -- 172.21.15.113:0/4164021980 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16184 (secure 0 0 0) 0x7f8174057a70 con 0x7f818406b590 2023-12-19T13:47:28.708 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:28.708 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":22,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:20.429480+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2a","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:28.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.709+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f816406a430 msgr2=0x7f816406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.709+0000 7f8189ef7640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f816406a430 0x7f816406c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f816c036000 tx=0x7f816c03c040 comp rx=0 tx=0).stop 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.709+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f818406b590 msgr2=0x7f8184141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.709+0000 7f8189ef7640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f818406b590 0x7f8184141c30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f817400d800 tx=0x7f817400dcc0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 shutdown_connections 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f816406a430 0x7f816406c8f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81841449e0 0x7f81841f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81840b0b50 0x7f81840b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 --2- 172.21.15.113:0/4164021980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f818406b590 0x7f8184141c30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 >> 172.21.15.113:0/4164021980 conn(0x7f81840cbb70 msgr2=0x7f81840cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 shutdown_connections 2023-12-19T13:47:28.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.710+0000 7f8189ef7640 1 -- 172.21.15.113:0/4164021980 wait complete. 2023-12-19T13:47:28.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:46:28.982854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:46:29.927804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:28.729 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:28.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.945+0000 7f7e96711640 1 Processor -- start 2023-12-19T13:47:28.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.945+0000 7f7e96711640 1 -- start start 2023-12-19T13:47:28.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.946+0000 7f7e96711640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e900b0470 0x7f7e900b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.946+0000 7f7e96711640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9015dae0 con 0x7f7e900cd4e0 2023-12-19T13:47:28.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e96711640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9015b000 con 0x7f7e9015e580 2023-12-19T13:47:28.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e96711640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9015ea30 con 0x7f7e900b0470 2023-12-19T13:47:28.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e9570f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7e900cd4e0 0x7f7e9015a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55324/0 (socket says 172.21.15.113:55324) 2023-12-19T13:47:28.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e9570f640 1 -- 172.21.15.113:0/554042122 learned_addr learned my addr 172.21.15.113:0/554042122 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:28.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e95f10640 1 --2- 172.21.15.113:0/554042122 >> v2:172.21.15.113:3300/0 conn(0x7f7e900b0470 0x7f7e900b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e95f10640 1 -- 172.21.15.113:0/554042122 >> v1:172.21.15.151:6789/0 conn(0x7f7e9015e580 legacy=0x7f7e900afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:28.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e95f10640 1 -- 172.21.15.113:0/554042122 >> v1:172.21.15.113:6789/0 conn(0x7f7e900cd4e0 legacy=0x7f7e9015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e87fff640 1 -- 172.21.15.113:0/554042122 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260207208 0 0) 0x7f7e9015dae0 con 0x7f7e900cd4e0 2023-12-19T13:47:28.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.947+0000 7f7e95f10640 1 -- 172.21.15.113:0/554042122 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9015b2e0 con 0x7f7e900b0470 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.948+0000 7f7e95f10640 1 --2- 172.21.15.113:0/554042122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900b0470 0x7f7e900b1130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009d90 tx=0x7f7e8802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35cb34fe890dc5c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e87fff640 1 -- 172.21.15.113:0/554042122 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8802cc60 con 0x7f7e900b0470 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e87fff640 1 -- 172.21.15.113:0/554042122 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8802cdc0 con 0x7f7e900b0470 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e87fff640 1 -- 172.21.15.113:0/554042122 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88034660 con 0x7f7e900b0470 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e96711640 1 -- 172.21.15.113:0/554042122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900b0470 msgr2=0x7f7e900b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e96711640 1 --2- 172.21.15.113:0/554042122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900b0470 0x7f7e900b1130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009d90 tx=0x7f7e8802beb0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e96711640 1 -- 172.21.15.113:0/554042122 shutdown_connections 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e96711640 1 --2- 172.21.15.113:0/554042122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900b0470 0x7f7e900b1130 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e96711640 1 -- 172.21.15.113:0/554042122 >> 172.21.15.113:0/554042122 conn(0x7f7e9006f630 msgr2=0x7f7e9006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:28.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e96711640 1 -- 172.21.15.113:0/554042122 shutdown_connections 2023-12-19T13:47:28.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.949+0000 7f7e96711640 1 -- 172.21.15.113:0/554042122 wait complete. 2023-12-19T13:47:28.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.951+0000 7f7e96711640 1 Processor -- start 2023-12-19T13:47:28.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.951+0000 7f7e96711640 1 -- start start 2023-12-19T13:47:28.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.952+0000 7f7e96711640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e900b0470 0x7f7e900cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.952+0000 7f7e96711640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900cd4e0 0x7f7e901566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.952+0000 7f7e96711640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e9015e580 0x7f7e9006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.952+0000 7f7e96711640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900cbb30 con 0x7f7e900cd4e0 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.952+0000 7f7e96711640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90157170 con 0x7f7e9015e580 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.952+0000 7f7e96711640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90157450 con 0x7f7e900b0470 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900cd4e0 0x7f7e901566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900cd4e0 0x7f7e901566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59902/0 (socket says 172.21.15.113:59902) 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 -- 172.21.15.113:0/1175482486 learned_addr learned my addr 172.21.15.113:0/1175482486 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e9570f640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e900b0470 0x7f7e900cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e95f10640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e9015e580 0x7f7e9006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 -- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e900b0470 msgr2=0x7f7e900cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e900b0470 0x7f7e900cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 -- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e9015e580 msgr2=0x7f7e9006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e9015e580 0x7f7e9006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 -- 172.21.15.113:0/1175482486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88009a70 con 0x7f7e900cd4e0 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e95f10640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e9015e580 0x7f7e9006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e9570f640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e900b0470 0x7f7e900cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.953+0000 7f7e94f0e640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900cd4e0 0x7f7e901566b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000b3f0 tx=0x7f7e8000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.954+0000 7f7e85ffb640 1 -- 172.21.15.113:0/1175482486 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80011830 con 0x7f7e900cd4e0 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.954+0000 7f7e85ffb640 1 -- 172.21.15.113:0/1175482486 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80011990 con 0x7f7e900cd4e0 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.954+0000 7f7e85ffb640 1 -- 172.21.15.113:0/1175482486 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80011d40 con 0x7f7e900cd4e0 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.954+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e90157730 con 0x7f7e900cd4e0 2023-12-19T13:47:28.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.954+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e90157cf0 con 0x7f7e900cd4e0 2023-12-19T13:47:28.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.955+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e901564e0 con 0x7f7e900cd4e0 2023-12-19T13:47:28.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.956+0000 7f7e85ffb640 1 -- 172.21.15.113:0/1175482486 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e8001a400 con 0x7f7e900cd4e0 2023-12-19T13:47:28.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.957+0000 7f7e85ffb640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e7406a460 0x7f7e7406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:28.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.957+0000 7f7e85ffb640 1 -- 172.21.15.113:0/1175482486 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7e800887b0 con 0x7f7e900cd4e0 2023-12-19T13:47:28.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.957+0000 7f7e9570f640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e7406a460 0x7f7e7406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:28.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.958+0000 7f7e9570f640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e7406a460 0x7f7e7406c920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000f60 tx=0x7f7e8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:28.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:28.961+0000 7f7e85ffb640 1 -- 172.21.15.113:0/1175482486 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e80053d60 con 0x7f7e900cd4e0 2023-12-19T13:47:29.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.148+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e900ad8f0 con 0x7f7e900cd4e0 2023-12-19T13:47:29.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.149+0000 7f7e85ffb640 1 -- 172.21.15.113:0/1175482486 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e80057380 con 0x7f7e900cd4e0 2023-12-19T13:47:29.150 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.151+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e7406a460 msgr2=0x7f7e7406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e7406a460 0x7f7e7406c920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000f60 tx=0x7f7e8c009040 comp rx=0 tx=0).stop 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900cd4e0 msgr2=0x7f7e901566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900cd4e0 0x7f7e901566b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000b3f0 tx=0x7f7e8000b8b0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 shutdown_connections 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e7406a460 0x7f7e7406c920 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e9015e580 0x7f7e9006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e900cd4e0 0x7f7e901566b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 --2- 172.21.15.113:0/1175482486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e900b0470 0x7f7e900cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 >> 172.21.15.113:0/1175482486 conn(0x7f7e9006f630 msgr2=0x7f7e9006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:29.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 shutdown_connections 2023-12-19T13:47:29.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.152+0000 7f7e96711640 1 -- 172.21.15.113:0/1175482486 wait complete. 2023-12-19T13:47:29.172 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:47:29.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.383+0000 7fbf2e395640 1 Processor -- start 2023-12-19T13:47:29.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.383+0000 7fbf2e395640 1 -- start start 2023-12-19T13:47:29.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.384+0000 7fbf2e395640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbf28157bf0 0x7fbf2815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf2e395640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 0x7fbf280b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf2e395640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf280b0a90 con 0x7fbf280b0640 2023-12-19T13:47:29.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf2e395640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2806b8c0 con 0x7fbf28157bf0 2023-12-19T13:47:29.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf2e395640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2815b740 con 0x7fbf280ae110 2023-12-19T13:47:29.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf2c932640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbf280b0640 0x7fbf2815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55340/0 (socket says 172.21.15.113:55340) 2023-12-19T13:47:29.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf2c932640 1 -- 172.21.15.113:0/1973474206 learned_addr learned my addr 172.21.15.113:0/1973474206 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:29.387 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf27fff640 1 --2- 172.21.15.113:0/1973474206 >> v2:172.21.15.151:3300/0 conn(0x7fbf28157bf0 0x7fbf2815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf277fe640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 0x7fbf280b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.385+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974991912 0 0) 0x7fbf20001490 con 0x7fbf280b0640 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf10005730 con 0x7fbf280b0640 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3536757232 0 0) 0x7fbf10005730 con 0x7fbf280b0640 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 msgr2=0x7fbf280b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 0x7fbf280b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 >> v2:172.21.15.151:3300/0 conn(0x7fbf28157bf0 msgr2=0x7fbf2815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 --2- 172.21.15.113:0/1973474206 >> v2:172.21.15.151:3300/0 conn(0x7fbf28157bf0 0x7fbf2815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280ae640 con 0x7fbf280b0640 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbf20001b80 con 0x7fbf280b0640 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 >> v1:172.21.15.113:6789/0 conn(0x7fbf280b0640 legacy=0x7fbf2815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf10005bf0 0x7fbf10006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 0x7fbf100069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf10006f10 0x7fbf10007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2806b8c0 con 0x7fbf10006f10 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2815b740 con 0x7fbf10005bf0 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1000db90 con 0x7fbf280ae110 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.386+0000 7fbf2c932640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf10006f10 0x7fbf10007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf27fff640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf10005bf0 0x7fbf10006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf277fe640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 0x7fbf100069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf2c932640 1 -- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 msgr2=0x7fbf100069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf2c932640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280ae110 0x7fbf100069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf2c932640 1 -- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf10005bf0 msgr2=0x7fbf10006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf2c932640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf10005bf0 0x7fbf10006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf2c932640 1 -- 172.21.15.113:0/1973474206 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10005730 con 0x7fbf10006f10 2023-12-19T13:47:29.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.387+0000 7fbf27fff640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf10005bf0 0x7fbf10006010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:29.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.388+0000 7fbf2c932640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf10006f10 0x7fbf10007390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000a830 tx=0x7fbf10007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a261ca38fac2533b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.388+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20034630 con 0x7fbf10006f10 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.388+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2002f070 con 0x7fbf10006f10 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.388+0000 7fbf26ffd640 1 -- 172.21.15.113:0/1973474206 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20034990 con 0x7fbf10006f10 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.389+0000 7fbf2e395640 1 -- 172.21.15.113:0/1973474206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf10006f10 msgr2=0x7fbf10007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.389+0000 7fbf2e395640 1 --2- 172.21.15.113:0/1973474206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf10006f10 0x7fbf10007390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000a830 tx=0x7fbf10007a00 comp rx=0 tx=0).stop 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.389+0000 7fbf2c932640 1 -- 172.21.15.113:0/1973474206 reap_dead start 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.389+0000 7fbf2e395640 1 -- 172.21.15.113:0/1973474206 shutdown_connections 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.389+0000 7fbf2e395640 1 -- 172.21.15.113:0/1973474206 >> 172.21.15.113:0/1973474206 conn(0x7fbf280cbb70 msgr2=0x7fbf280cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.389+0000 7fbf2e395640 1 -- 172.21.15.113:0/1973474206 shutdown_connections 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.389+0000 7fbf2e395640 1 -- 172.21.15.113:0/1973474206 wait complete. 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.391+0000 7fbf2e395640 1 Processor -- start 2023-12-19T13:47:29.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.391+0000 7fbf2e395640 1 -- start start 2023-12-19T13:47:29.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf2e395640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf2814adb0 0x7fbf28153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf2e395640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf2814b190 0x7fbf2814bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf2e395640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2814e0d0 0x7fbf2814c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf2e395640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2814eb50 con 0x7fbf2814adb0 2023-12-19T13:47:29.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf2e395640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2815bc90 con 0x7fbf2814e0d0 2023-12-19T13:47:29.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf2e395640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28153880 con 0x7fbf2814b190 2023-12-19T13:47:29.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf2814adb0 0x7fbf28153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf2814adb0 0x7fbf28153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59932/0 (socket says 172.21.15.113:59932) 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 -- 172.21.15.113:0/4239894094 learned_addr learned my addr 172.21.15.113:0/4239894094 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 -- 172.21.15.113:0/4239894094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf2814b190 msgr2=0x7fbf2814bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf277fe640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf2814b190 0x7fbf2814bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf2814b190 0x7fbf2814bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 -- 172.21.15.113:0/4239894094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2814e0d0 msgr2=0x7fbf2814c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2814e0d0 0x7fbf2814c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.392+0000 7fbf27fff640 1 -- 172.21.15.113:0/4239894094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28153b60 con 0x7fbf2814adb0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.393+0000 7fbf27fff640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf2814adb0 0x7fbf28153050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbf180109d0 tx=0x7fbf18010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.393+0000 7fbf24ff9640 1 -- 172.21.15.113:0/4239894094 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800ec20 con 0x7fbf2814adb0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.393+0000 7fbf24ff9640 1 -- 172.21.15.113:0/4239894094 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1800ed80 con 0x7fbf2814adb0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.393+0000 7fbf24ff9640 1 -- 172.21.15.113:0/4239894094 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1801c600 con 0x7fbf2814adb0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.393+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf28153e40 con 0x7fbf2814adb0 2023-12-19T13:47:29.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.393+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf28153590 con 0x7fbf2814adb0 2023-12-19T13:47:29.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.394+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf28061910 con 0x7fbf2814adb0 2023-12-19T13:47:29.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.395+0000 7fbf24ff9640 1 -- 172.21.15.113:0/4239894094 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf1801c760 con 0x7fbf2814adb0 2023-12-19T13:47:29.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.396+0000 7fbf24ff9640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf1406a460 0x7fbf1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.397+0000 7fbf24ff9640 1 -- 172.21.15.113:0/4239894094 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbf18088f70 con 0x7fbf2814adb0 2023-12-19T13:47:29.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.397+0000 7fbf277fe640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf1406a460 0x7fbf1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.397+0000 7fbf277fe640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf1406a460 0x7fbf1406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf28152180 tx=0x7fbf1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:29.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.401+0000 7fbf24ff9640 1 -- 172.21.15.113:0/4239894094 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf180545c0 con 0x7fbf2814adb0 2023-12-19T13:47:29.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.590+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf28154f60 con 0x7fbf2814adb0 2023-12-19T13:47:29.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.591+0000 7fbf24ff9640 1 -- 172.21.15.113:0/4239894094 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf18057be0 con 0x7fbf2814adb0 2023-12-19T13:47:29.592 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:47:29.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf1406a460 msgr2=0x7fbf1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf1406a460 0x7fbf1406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf28152180 tx=0x7fbf1c008040 comp rx=0 tx=0).stop 2023-12-19T13:47:29.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf2814adb0 msgr2=0x7fbf28153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf2814adb0 0x7fbf28153050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbf180109d0 tx=0x7fbf18010e90 comp rx=0 tx=0).stop 2023-12-19T13:47:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 shutdown_connections 2023-12-19T13:47:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf1406a460 0x7fbf1406c920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2814e0d0 0x7fbf2814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf2814b190 0x7fbf2814bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 --2- 172.21.15.113:0/4239894094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf2814adb0 0x7fbf28153050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 >> 172.21.15.113:0/4239894094 conn(0x7fbf280cbb70 msgr2=0x7fbf280cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 shutdown_connections 2023-12-19T13:47:29.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.594+0000 7fbf2e395640 1 -- 172.21.15.113:0/4239894094 wait complete. 2023-12-19T13:47:29.613 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:47:29.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.836+0000 7fedcfe00640 1 Processor -- start 2023-12-19T13:47:29.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.837+0000 7fedcfe00640 1 -- start start 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcfe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc8146ff0 0x7fedc80d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcfe00640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fedc80b6430 0x7fedc806f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcfe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc806fed0 con 0x7fedc806fa70 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcfe00640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc8161080 con 0x7fedc80b6430 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcfe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8161e70 con 0x7fedc8146ff0 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcd39b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fedc80b6430 0x7fedc806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcd39b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fedc80b6430 0x7fedc806f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59934/0 (socket says 172.21.15.113:59934) 2023-12-19T13:47:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.838+0000 7fedcd39b640 1 -- 172.21.15.113:0/2187957691 learned_addr learned my addr 172.21.15.113:0/2187957691 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:29.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.839+0000 7fedcdb9c640 1 --2- 172.21.15.113:0/2187957691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc8146ff0 0x7fedc80d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.839+0000 7fedcd39b640 1 -- 172.21.15.113:0/2187957691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc8146ff0 msgr2=0x7fedc80d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:29.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.839+0000 7fedcd39b640 1 --2- 172.21.15.113:0/2187957691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc8146ff0 0x7fedc80d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.839+0000 7fedcd39b640 1 -- 172.21.15.113:0/2187957691 >> v1:172.21.15.151:6789/0 conn(0x7fedc806fa70 legacy=0x7fedc815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:29.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.839+0000 7fedcd39b640 1 -- 172.21.15.113:0/2187957691 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8161260 con 0x7fedc80b6430 2023-12-19T13:47:29.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.840+0000 7fedcd39b640 1 --2- 172.21.15.113:0/2187957691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc80b6430 0x7fedc806f530 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009870 tx=0x7fedbc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c76b0a376c5d10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:29.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.840+0000 7fedccb9a640 1 -- 172.21.15.113:0/2187957691 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc031640 con 0x7fedc80b6430 2023-12-19T13:47:29.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.840+0000 7fedccb9a640 1 -- 172.21.15.113:0/2187957691 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc0317a0 con 0x7fedc80b6430 2023-12-19T13:47:29.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.840+0000 7fedccb9a640 1 -- 172.21.15.113:0/2187957691 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc031b30 con 0x7fedc80b6430 2023-12-19T13:47:29.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 -- 172.21.15.113:0/2187957691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc80b6430 msgr2=0x7fedc806f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 --2- 172.21.15.113:0/2187957691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc80b6430 0x7fedc806f530 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009870 tx=0x7fedbc02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 -- 172.21.15.113:0/2187957691 shutdown_connections 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 --2- 172.21.15.113:0/2187957691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc80b6430 0x7fedc806f530 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 --2- 172.21.15.113:0/2187957691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc8146ff0 0x7fedc80d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 -- 172.21.15.113:0/2187957691 >> 172.21.15.113:0/2187957691 conn(0x7fedc80d3520 msgr2=0x7fedc80d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 -- 172.21.15.113:0/2187957691 shutdown_connections 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.841+0000 7fedcfe00640 1 -- 172.21.15.113:0/2187957691 wait complete. 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.843+0000 7fedcfe00640 1 Processor -- start 2023-12-19T13:47:29.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.843+0000 7fedcfe00640 1 -- start start 2023-12-19T13:47:29.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcfe00640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc806fa70 0x7fedc815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcfe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc80b6430 0x7fedc8140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcfe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedc8146ff0 0x7fedc8141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcfe00640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc81418a0 con 0x7fedc806fa70 2023-12-19T13:47:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcfe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc814f780 con 0x7fedc8146ff0 2023-12-19T13:47:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcfe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80cb480 con 0x7fedc80b6430 2023-12-19T13:47:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcdb9c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc806fa70 0x7fedc815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcdb9c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc806fa70 0x7fedc815fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59936/0 (socket says 172.21.15.113:59936) 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcdb9c640 1 -- 172.21.15.113:0/3844725847 learned_addr learned my addr 172.21.15.113:0/3844725847 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcdb9c640 1 -- 172.21.15.113:0/3844725847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc80b6430 msgr2=0x7fedc8140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcdb9c640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc80b6430 0x7fedc8140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcdb9c640 1 -- 172.21.15.113:0/3844725847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedc8146ff0 msgr2=0x7fedc8141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.844+0000 7fedcdb9c640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedc8146ff0 0x7fedc8141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.845+0000 7fedcdb9c640 1 -- 172.21.15.113:0/3844725847 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc0094d0 con 0x7fedc806fa70 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.845+0000 7fedcdb9c640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc806fa70 0x7fedc815fe80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007e40 tx=0x7fedb800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.845+0000 7fedc67fc640 1 -- 172.21.15.113:0/3844725847 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8014620 con 0x7fedc806fa70 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.845+0000 7fedc67fc640 1 -- 172.21.15.113:0/3844725847 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb800ee90 con 0x7fedc806fa70 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.845+0000 7fedc67fc640 1 -- 172.21.15.113:0/3844725847 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80149c0 con 0x7fedc806fa70 2023-12-19T13:47:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.845+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc80c8560 con 0x7fedc806fa70 2023-12-19T13:47:29.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.845+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc80c8b20 con 0x7fedc806fa70 2023-12-19T13:47:29.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.846+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc8061910 con 0x7fedc806fa70 2023-12-19T13:47:29.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.847+0000 7fedc67fc640 1 -- 172.21.15.113:0/3844725847 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fedb8014b20 con 0x7fedc806fa70 2023-12-19T13:47:29.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.848+0000 7fedc67fc640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fedb406a430 0x7fedb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:29.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.848+0000 7fedc67fc640 1 -- 172.21.15.113:0/3844725847 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fedb8089360 con 0x7fedc806fa70 2023-12-19T13:47:29.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.849+0000 7fedcd39b640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fedb406a430 0x7fedb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:29.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.849+0000 7fedcd39b640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fedb406a430 0x7fedb406c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fedbc036000 tx=0x7fedbc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:29.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:29.852+0000 7fedc67fc640 1 -- 172.21.15.113:0/3844725847 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fedb8054870 con 0x7fedc806fa70 2023-12-19T13:47:30.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.043+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedc80b61f0 con 0x7fedc806fa70 2023-12-19T13:47:30.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.044+0000 7fedc67fc640 1 -- 172.21.15.113:0/3844725847 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fedb8057e90 con 0x7fedc806fa70 2023-12-19T13:47:30.046 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fedb406a430 msgr2=0x7fedb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fedb406a430 0x7fedb406c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fedbc036000 tx=0x7fedbc030000 comp rx=0 tx=0).stop 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc806fa70 msgr2=0x7fedc815fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc806fa70 0x7fedc815fe80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007e40 tx=0x7fedb800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 shutdown_connections 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fedb406a430 0x7fedb406c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedc8146ff0 0x7fedc8141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc80b6430 0x7fedc8140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 --2- 172.21.15.113:0/3844725847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fedc806fa70 0x7fedc815fe80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.046+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 >> 172.21.15.113:0/3844725847 conn(0x7fedc80d3520 msgr2=0x7fedc80b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:30.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.047+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 shutdown_connections 2023-12-19T13:47:30.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.047+0000 7fedcfe00640 1 -- 172.21.15.113:0/3844725847 wait complete. 2023-12-19T13:47:30.070 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:30.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.264+0000 7fd136adf640 1 Processor -- start 2023-12-19T13:47:30.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.264+0000 7fd136adf640 1 -- start start 2023-12-19T13:47:30.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.266+0000 7fd136adf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1300b1710 0x7fd13006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.266+0000 7fd136adf640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300b2600 con 0x7fd13015e040 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.266+0000 7fd136adf640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300b1d60 con 0x7fd130157aa0 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.266+0000 7fd136adf640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1300b2040 con 0x7fd1300b1710 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.267+0000 7fd12ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1300b1710 0x7fd13006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.267+0000 7fd12ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1300b1710 0x7fd13006e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59952/0 (socket says 172.21.15.113:59952) 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.267+0000 7fd12ffff640 1 -- 172.21.15.113:0/2063190148 learned_addr learned my addr 172.21.15.113:0/2063190148 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.267+0000 7fd13507c640 1 --1- 172.21.15.113:0/2063190148 >> v1:172.21.15.113:6789/0 conn(0x7fd13015e040 0x7fd1300b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55350/0 (socket says 172.21.15.113:55350) 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.267+0000 7fd12ffff640 1 -- 172.21.15.113:0/2063190148 >> v1:172.21.15.151:6789/0 conn(0x7fd130157aa0 legacy=0x7fd130161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.267+0000 7fd12ffff640 1 -- 172.21.15.113:0/2063190148 >> v1:172.21.15.113:6789/0 conn(0x7fd13015e040 legacy=0x7fd1300b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.267+0000 7fd12ffff640 1 -- 172.21.15.113:0/2063190148 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300b2320 con 0x7fd1300b1710 2023-12-19T13:47:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.269+0000 7fd12ffff640 1 --2- 172.21.15.113:0/2063190148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1300b1710 0x7fd13006e410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c519d6e3328d535 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.269+0000 7fd12f7fe640 1 -- 172.21.15.113:0/2063190148 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c02f850 con 0x7fd1300b1710 2023-12-19T13:47:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.269+0000 7fd12f7fe640 1 -- 172.21.15.113:0/2063190148 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c02f9b0 con 0x7fd1300b1710 2023-12-19T13:47:30.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.269+0000 7fd12f7fe640 1 -- 172.21.15.113:0/2063190148 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c02fd40 con 0x7fd1300b1710 2023-12-19T13:47:30.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.269+0000 7fd136adf640 1 -- 172.21.15.113:0/2063190148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1300b1710 msgr2=0x7fd13006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.269+0000 7fd136adf640 1 --2- 172.21.15.113:0/2063190148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1300b1710 0x7fd13006e410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c02ba30 comp rx=0 tx=0).stop 2023-12-19T13:47:30.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.270+0000 7fd136adf640 1 -- 172.21.15.113:0/2063190148 shutdown_connections 2023-12-19T13:47:30.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.270+0000 7fd136adf640 1 --2- 172.21.15.113:0/2063190148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1300b1710 0x7fd13006e410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.270+0000 7fd136adf640 1 -- 172.21.15.113:0/2063190148 >> 172.21.15.113:0/2063190148 conn(0x7fd1300cbb70 msgr2=0x7fd1300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:30.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.270+0000 7fd136adf640 1 -- 172.21.15.113:0/2063190148 shutdown_connections 2023-12-19T13:47:30.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.270+0000 7fd136adf640 1 -- 172.21.15.113:0/2063190148 wait complete. 2023-12-19T13:47:30.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.271+0000 7fd136adf640 1 Processor -- start 2023-12-19T13:47:30.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.272+0000 7fd136adf640 1 -- start start 2023-12-19T13:47:30.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.272+0000 7fd136adf640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1300b1710 0x7fd130159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.272+0000 7fd136adf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd130157aa0 0x7fd130155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd136adf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd13015e040 0x7fd1301561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd136adf640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301566e0 con 0x7fd130157aa0 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd136adf640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13015f3f0 con 0x7fd13015e040 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd136adf640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13015f6d0 con 0x7fd1300b1710 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd130157aa0 0x7fd130155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd130157aa0 0x7fd130155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59954/0 (socket says 172.21.15.113:59954) 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 -- 172.21.15.113:0/467077154 learned_addr learned my addr 172.21.15.113:0/467077154 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd13487b640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1300b1710 0x7fd130159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd13507c640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd13015e040 0x7fd1301561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 -- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1300b1710 msgr2=0x7fd130159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1300b1710 0x7fd130159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 -- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd13015e040 msgr2=0x7fd1301561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd13015e040 0x7fd1301561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.273+0000 7fd12ffff640 1 -- 172.21.15.113:0/467077154 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c0094d0 con 0x7fd130157aa0 2023-12-19T13:47:30.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.274+0000 7fd12ffff640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd130157aa0 0x7fd130155c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:30.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.274+0000 7fd12d7fa640 1 -- 172.21.15.113:0/467077154 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c02f820 con 0x7fd130157aa0 2023-12-19T13:47:30.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.274+0000 7fd12d7fa640 1 -- 172.21.15.113:0/467077154 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c041400 con 0x7fd130157aa0 2023-12-19T13:47:30.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.274+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13015f9b0 con 0x7fd130157aa0 2023-12-19T13:47:30.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.274+0000 7fd12d7fa640 1 -- 172.21.15.113:0/467077154 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0417d0 con 0x7fd130157aa0 2023-12-19T13:47:30.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.274+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13015ff70 con 0x7fd130157aa0 2023-12-19T13:47:30.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.275+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130061910 con 0x7fd130157aa0 2023-12-19T13:47:30.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.276+0000 7fd12d7fa640 1 -- 172.21.15.113:0/467077154 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd11c041930 con 0x7fd130157aa0 2023-12-19T13:47:30.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.277+0000 7fd12d7fa640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd11406a460 0x7fd11406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.277+0000 7fd12d7fa640 1 -- 172.21.15.113:0/467077154 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd11c03c070 con 0x7fd130157aa0 2023-12-19T13:47:30.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.277+0000 7fd13487b640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd11406a460 0x7fd11406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.278+0000 7fd13487b640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd11406a460 0x7fd11406c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd124000f60 tx=0x7fd124009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:30.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.281+0000 7fd12d7fa640 1 -- 172.21.15.113:0/467077154 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd11c076ed0 con 0x7fd130157aa0 2023-12-19T13:47:30.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.510+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd130071ae0 con 0x7fd130157aa0 2023-12-19T13:47:30.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.511+0000 7fd12d7fa640 1 -- 172.21.15.113:0/467077154 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fd11c07a4f0 con 0x7fd130157aa0 2023-12-19T13:47:30.512 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:30.512 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:47:30.512 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd11406a460 msgr2=0x7fd11406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd11406a460 0x7fd11406c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd124000f60 tx=0x7fd124009040 comp rx=0 tx=0).stop 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd130157aa0 msgr2=0x7fd130155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd130157aa0 0x7fd130155c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c004730 comp rx=0 tx=0).stop 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 shutdown_connections 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd11406a460 0x7fd11406c920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd13015e040 0x7fd1301561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd130157aa0 0x7fd130155c60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 --2- 172.21.15.113:0/467077154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1300b1710 0x7fd130159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 >> 172.21.15.113:0/467077154 conn(0x7fd1300cbb70 msgr2=0x7fd13015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:30.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 shutdown_connections 2023-12-19T13:47:30.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.514+0000 7fd136adf640 1 -- 172.21.15.113:0/467077154 wait complete. 2023-12-19T13:47:30.534 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:30.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.740+0000 7f2ec2363640 1 Processor -- start 2023-12-19T13:47:30.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.740+0000 7f2ec2363640 1 -- start start 2023-12-19T13:47:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ec2363640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2ebc06c6b0 0x7f2ebc166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ec2363640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc06bb30 con 0x7f2ebc1449e0 2023-12-19T13:47:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ec2363640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0b0070 con 0x7f2ebc0b0b50 2023-12-19T13:47:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ec2363640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b0350 con 0x7f2ebc06c6b0 2023-12-19T13:47:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ebbfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2ebc1449e0 0x7f2ebc0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55352/0 (socket says 172.21.15.113:55352) 2023-12-19T13:47:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ebbfff640 1 -- 172.21.15.113:0/2079290754 learned_addr learned my addr 172.21.15.113:0/2079290754 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ec0900640 1 --2- 172.21.15.113:0/2079290754 >> v2:172.21.15.151:3300/0 conn(0x7f2ebc06c6b0 0x7f2ebc166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928294545 0 0) 0x7f2ebc06bb30 con 0x7f2ebc1449e0 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.742+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea8003520 con 0x7f2ebc1449e0 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2068140934 0 0) 0x7f2ea8003520 con 0x7f2ebc1449e0 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 >> v2:172.21.15.151:3300/0 conn(0x7f2ebc06c6b0 msgr2=0x7f2ebc166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 --2- 172.21.15.113:0/2079290754 >> v2:172.21.15.151:3300/0 conn(0x7f2ebc06c6b0 0x7f2ebc166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 >> v1:172.21.15.151:6789/0 conn(0x7f2ebc0b0b50 legacy=0x7f2ebc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc0b0630 con 0x7f2ebc1449e0 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f2eac001670 con 0x7f2ebc1449e0 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 >> v1:172.21.15.113:6789/0 conn(0x7f2ebc1449e0 legacy=0x7f2ebc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ea80039e0 0x7f2ea8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ea80047c0 0x7f2ea8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea8005180 0x7f2ea800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b0350 con 0x7f2ea80047c0 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea800c0b0 con 0x7f2ea8005180 2023-12-19T13:47:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea800c270 con 0x7f2ea80039e0 2023-12-19T13:47:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.743+0000 7f2eb3fff640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ea80047c0 0x7f2ea8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2ebbfff640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ea80039e0 0x7f2ea8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2ec0900640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea8005180 0x7f2ea800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2eb3fff640 1 -- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ea80039e0 msgr2=0x7f2ea8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2eb3fff640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ea80039e0 0x7f2ea8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2eb3fff640 1 -- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea8005180 msgr2=0x7f2ea800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2eb3fff640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea8005180 0x7f2ea800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2eb3fff640 1 -- 172.21.15.113:0/2079290754 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8003520 con 0x7f2ea80047c0 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2ec0900640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea8005180 0x7f2ea800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2ec0900640 1 -- 172.21.15.113:0/2079290754 reap_dead start 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.744+0000 7f2ebbfff640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ea80039e0 0x7f2ea8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.745+0000 7f2eb3fff640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ea80047c0 0x7f2ea8004c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4001750 tx=0x7f2ea80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f870f39d9d5c8d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.745+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40052d0 con 0x7f2ea80047c0 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.745+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea402e050 con 0x7f2ea80047c0 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.745+0000 7f2ebb7fe640 1 -- 172.21.15.113:0/2079290754 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4003830 con 0x7f2ea80047c0 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.746+0000 7f2ec2363640 1 -- 172.21.15.113:0/2079290754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ea80047c0 msgr2=0x7f2ea8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.746+0000 7f2ec2363640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ea80047c0 0x7f2ea8004c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4001750 tx=0x7f2ea80057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.746+0000 7f2ec2363640 1 -- 172.21.15.113:0/2079290754 shutdown_connections 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.746+0000 7f2ec2363640 1 --2- 172.21.15.113:0/2079290754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ea80047c0 0x7f2ea8004c40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.746+0000 7f2ec2363640 1 -- 172.21.15.113:0/2079290754 >> 172.21.15.113:0/2079290754 conn(0x7f2ebc0cbb70 msgr2=0x7f2ebc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.746+0000 7f2ec2363640 1 -- 172.21.15.113:0/2079290754 shutdown_connections 2023-12-19T13:47:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.746+0000 7f2ec2363640 1 -- 172.21.15.113:0/2079290754 wait complete. 2023-12-19T13:47:30.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.748+0000 7f2ec2363640 1 Processor -- start 2023-12-19T13:47:30.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.748+0000 7f2ec2363640 1 -- start start 2023-12-19T13:47:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec2363640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea80047c0 0x7f2ebc1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec2363640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ebc150440 0x7f2ebc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec2363640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ebc14d820 0x7f2ebc13a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec2363640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc158d60 con 0x7f2ebc14d820 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec2363640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc159040 con 0x7f2ea80047c0 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec2363640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc159320 con 0x7f2ebc150440 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec0900640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ebc14d820 0x7f2ebc13a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec0900640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ebc14d820 0x7f2ebc13a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59972/0 (socket says 172.21.15.113:59972) 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.749+0000 7f2ec0900640 1 -- 172.21.15.113:0/671895399 learned_addr learned my addr 172.21.15.113:0/671895399 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ebbfff640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea80047c0 0x7f2ebc1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2eb3fff640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ebc150440 0x7f2ebc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec0900640 1 -- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ebc150440 msgr2=0x7f2ebc15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec0900640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ebc150440 0x7f2ebc15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec0900640 1 -- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea80047c0 msgr2=0x7f2ebc1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec0900640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea80047c0 0x7f2ebc1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec0900640 1 -- 172.21.15.113:0/671895399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc159600 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ebbfff640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea80047c0 0x7f2ebc1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec0900640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ebc14d820 0x7f2ebc13a6f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc06d890 tx=0x7f2eb400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2eb97fa640 1 -- 172.21.15.113:0/671895399 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4016420 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2eb97fa640 1 -- 172.21.15.113:0/671895399 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb4016580 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2eb97fa640 1 -- 172.21.15.113:0/671895399 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40168f0 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc1598e0 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.750+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc15db70 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.752+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc061910 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.753+0000 7f2eb97fa640 1 -- 172.21.15.113:0/671895399 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2eb4016a50 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.753+0000 7f2eb97fa640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2e9c06a460 0x7f2e9c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.754+0000 7f2eb97fa640 1 -- 172.21.15.113:0/671895399 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2eb4089960 con 0x7f2ebc14d820 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.754+0000 7f2ebbfff640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2e9c06a460 0x7f2e9c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.754+0000 7f2ebbfff640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2e9c06a460 0x7f2e9c06c920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc04f980 tx=0x7f2eac001b40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.758+0000 7f2eb97fa640 1 -- 172.21.15.113:0/671895399 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2eb4054e70 con 0x7f2ebc14d820 2023-12-19T13:47:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.953+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ebc0af700 con 0x7f2ebc14d820 2023-12-19T13:47:30.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.956+0000 7f2eb97fa640 1 -- 172.21.15.113:0/671895399 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16184 (secure 0 0 0) 0x7f2eb4058490 con 0x7f2ebc14d820 2023-12-19T13:47:30.957 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:30.957 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":22,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:20.429480+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2a","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2e9c06a460 msgr2=0x7f2e9c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2e9c06a460 0x7f2e9c06c920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc04f980 tx=0x7f2eac001b40 comp rx=0 tx=0).stop 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ebc14d820 msgr2=0x7f2ebc13a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ebc14d820 0x7f2ebc13a6f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc06d890 tx=0x7f2eb400f520 comp rx=0 tx=0).stop 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 shutdown_connections 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2e9c06a460 0x7f2e9c06c920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ebc14d820 0x7f2ebc13a6f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ebc150440 0x7f2ebc15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 --2- 172.21.15.113:0/671895399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea80047c0 0x7f2ebc1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:30.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 >> 172.21.15.113:0/671895399 conn(0x7f2ebc0cbb70 msgr2=0x7f2ebc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:30.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 shutdown_connections 2023-12-19T13:47:30.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:30.959+0000 7f2ec2363640 1 -- 172.21.15.113:0/671895399 wait complete. 2023-12-19T13:47:30.980 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:47:30.980 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:31.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.189+0000 7f1ebf84c640 1 Processor -- start 2023-12-19T13:47:31.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.189+0000 7f1ebf84c640 1 -- start start 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebf84c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1eb8157bf0 0x7f1eb815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebf84c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1eb80b0810 0x7f1eb806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebf84c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb815b740 con 0x7f1eb80ae110 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebf84c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb806b8c0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebf84c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb80ae640 con 0x7f1eb80b0810 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebd5e8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1eb8157bf0 0x7f1eb815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebd5e8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1eb8157bf0 0x7f1eb815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59976/0 (socket says 172.21.15.113:59976) 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebd5e8640 1 -- 172.21.15.113:0/2521919918 learned_addr learned my addr 172.21.15.113:0/2521919918 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:31.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.191+0000 7f1ebdde9640 1 --2- 172.21.15.113:0/2521919918 >> v2:172.21.15.151:3300/0 conn(0x7f1eb80b0810 0x7f1eb806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.192+0000 7f1ebd5e8640 1 -- 172.21.15.113:0/2521919918 >> v2:172.21.15.151:3300/0 conn(0x7f1eb80b0810 msgr2=0x7f1eb806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.192+0000 7f1ebd5e8640 1 --2- 172.21.15.113:0/2521919918 >> v2:172.21.15.151:3300/0 conn(0x7f1eb80b0810 0x7f1eb806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.192+0000 7f1ebd5e8640 1 -- 172.21.15.113:0/2521919918 >> v1:172.21.15.151:6789/0 conn(0x7f1eb80ae110 legacy=0x7f1eb80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.192+0000 7f1ebd5e8640 1 -- 172.21.15.113:0/2521919918 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80ae920 con 0x7f1eb8157bf0 2023-12-19T13:47:31.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.193+0000 7f1ebd5e8640 1 --2- 172.21.15.113:0/2521919918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb815b200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80b1210 tx=0x7f1eb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d005809f726c3279 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:31.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.193+0000 7f1eaffff640 1 -- 172.21.15.113:0/2521919918 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4031870 con 0x7f1eb8157bf0 2023-12-19T13:47:31.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.193+0000 7f1eaffff640 1 -- 172.21.15.113:0/2521919918 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb40319d0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.193+0000 7f1eaffff640 1 -- 172.21.15.113:0/2521919918 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4031d60 con 0x7f1eb8157bf0 2023-12-19T13:47:31.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 -- 172.21.15.113:0/2521919918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 msgr2=0x7f1eb815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/2521919918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb815b200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80b1210 tx=0x7f1eb402b910 comp rx=0 tx=0).stop 2023-12-19T13:47:31.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 -- 172.21.15.113:0/2521919918 shutdown_connections 2023-12-19T13:47:31.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/2521919918 >> v2:172.21.15.151:3300/0 conn(0x7f1eb80b0810 0x7f1eb806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/2521919918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb815b200 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 -- 172.21.15.113:0/2521919918 >> 172.21.15.113:0/2521919918 conn(0x7f1eb80cbb70 msgr2=0x7f1eb80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:31.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 -- 172.21.15.113:0/2521919918 shutdown_connections 2023-12-19T13:47:31.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.194+0000 7f1ebf84c640 1 -- 172.21.15.113:0/2521919918 wait complete. 2023-12-19T13:47:31.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.196+0000 7f1ebf84c640 1 Processor -- start 2023-12-19T13:47:31.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.196+0000 7f1ebf84c640 1 -- start start 2023-12-19T13:47:31.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebf84c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ae110 0x7f1eb8158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebf84c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80b0810 0x7f1eb8158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebf84c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb80cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebf84c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb814dd40 con 0x7f1eb8157bf0 2023-12-19T13:47:31.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebf84c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80ce210 con 0x7f1eb80b0810 2023-12-19T13:47:31.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebf84c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80ce4f0 con 0x7f1eb80ae110 2023-12-19T13:47:31.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebdde9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb80cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebdde9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb80cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59980/0 (socket says 172.21.15.113:59980) 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebdde9640 1 -- 172.21.15.113:0/1839066233 learned_addr learned my addr 172.21.15.113:0/1839066233 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.197+0000 7f1ebd5e8640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ae110 0x7f1eb8158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebcde7640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80b0810 0x7f1eb8158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebdde9640 1 -- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ae110 msgr2=0x7f1eb8158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebdde9640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ae110 0x7f1eb8158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebdde9640 1 -- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80b0810 msgr2=0x7f1eb8158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebdde9640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80b0810 0x7f1eb8158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebdde9640 1 -- 172.21.15.113:0/1839066233 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40094d0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebcde7640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80b0810 0x7f1eb8158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebdde9640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb80cd630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0007e40 tx=0x7f1eb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1eadffb640 1 -- 172.21.15.113:0/1839066233 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0014620 con 0x7f1eb8157bf0 2023-12-19T13:47:31.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1eadffb640 1 -- 172.21.15.113:0/1839066233 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb000ee90 con 0x7f1eb8157bf0 2023-12-19T13:47:31.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1eadffb640 1 -- 172.21.15.113:0/1839066233 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb00149e0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb80ce7d0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.198+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb815bc00 con 0x7f1eb8157bf0 2023-12-19T13:47:31.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.200+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8061910 con 0x7f1eb8157bf0 2023-12-19T13:47:31.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.201+0000 7f1eadffb640 1 -- 172.21.15.113:0/1839066233 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1eb0014b40 con 0x7f1eb8157bf0 2023-12-19T13:47:31.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.201+0000 7f1eadffb640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9c06a430 0x7f1e9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.202+0000 7f1eadffb640 1 -- 172.21.15.113:0/1839066233 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1eb0089270 con 0x7f1eb8157bf0 2023-12-19T13:47:31.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.202+0000 7f1ebd5e8640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9c06a430 0x7f1e9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.203+0000 7f1ebd5e8640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9c06a430 0x7f1e9c06c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4036000 tx=0x7f1eb403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:31.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.206+0000 7f1eadffb640 1 -- 172.21.15.113:0/1839066233 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1eb00548b0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.431+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1eb815bdc0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.432+0000 7f1eadffb640 1 -- 172.21.15.113:0/1839066233 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f1eb0057ed0 con 0x7f1eb8157bf0 2023-12-19T13:47:31.433 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:31.433 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:47:31.434 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:47:31.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.435+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9c06a430 msgr2=0x7f1e9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.435+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9c06a430 0x7f1e9c06c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4036000 tx=0x7f1eb403c040 comp rx=0 tx=0).stop 2023-12-19T13:47:31.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.435+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 msgr2=0x7f1eb80cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.435+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb80cd630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0007e40 tx=0x7f1eb000e4b0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.435+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 shutdown_connections 2023-12-19T13:47:31.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.436+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9c06a430 0x7f1e9c06c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.436+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eb8157bf0 0x7f1eb80cd630 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.436+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80b0810 0x7f1eb8158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.436+0000 7f1ebf84c640 1 --2- 172.21.15.113:0/1839066233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ae110 0x7f1eb8158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.436+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 >> 172.21.15.113:0/1839066233 conn(0x7f1eb80cbb70 msgr2=0x7f1eb806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:31.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.436+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 shutdown_connections 2023-12-19T13:47:31.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.436+0000 7f1ebf84c640 1 -- 172.21.15.113:0/1839066233 wait complete. 2023-12-19T13:47:31.455 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:31.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.662+0000 7f36e6511640 1 Processor -- start 2023-12-19T13:47:31.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.662+0000 7f36e6511640 1 -- start start 2023-12-19T13:47:31.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.663+0000 7f36e6511640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 0x7f36e00b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.663+0000 7f36e6511640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f36e015f680 0x7f36e00b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36e6511640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e015ec30 con 0x7f36e00cdbf0 2023-12-19T13:47:31.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36e6511640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e00b2cc0 con 0x7f36e015f680 2023-12-19T13:47:31.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36e6511640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e015e980 con 0x7f36e015e5a0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36e5d10640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f36e00cdbf0 0x7f36e006c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55368/0 (socket says 172.21.15.113:55368) 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36e5d10640 1 -- 172.21.15.113:0/1907542107 learned_addr learned my addr 172.21.15.113:0/1907542107 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1907542107 >> v2:172.21.15.151:3300/0 conn(0x7f36e015f680 0x7f36e00b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36e550f640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 0x7f36e00b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412766815 0 0) 0x7f36e015ec30 con 0x7f36e00cdbf0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.664+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36cc003520 con 0x7f36e00cdbf0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 77185063 0 0) 0x7f36cc003520 con 0x7f36e00cdbf0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 msgr2=0x7f36e00b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 0x7f36e00b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 >> v2:172.21.15.151:3300/0 conn(0x7f36e015f680 msgr2=0x7f36e00b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 --2- 172.21.15.113:0/1907542107 >> v2:172.21.15.151:3300/0 conn(0x7f36e015f680 0x7f36e00b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00b2f90 con 0x7f36e00cdbf0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f36d80019f0 con 0x7f36e00cdbf0 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 >> v1:172.21.15.113:6789/0 conn(0x7f36e00cdbf0 legacy=0x7f36e006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 0x7f36cc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36cc004d00 0x7f36cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e00b2cc0 con 0x7f36cc003ef0 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e015e980 con 0x7f36cc004d00 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc00b9d0 con 0x7f36e015e5a0 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.665+0000 7f36e550f640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 0x7f36cc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.666+0000 7f36e4d0e640 1 -- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 msgr2=0x7f36cc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.666+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e015e5a0 0x7f36cc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.666+0000 7f36e4d0e640 1 -- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36cc004d00 msgr2=0x7f36cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.666+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36cc004d00 0x7f36cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.666+0000 7f36e4d0e640 1 -- 172.21.15.113:0/1907542107 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc003520 con 0x7f36cc003ef0 2023-12-19T13:47:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.667+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36cc0047c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009ac0 tx=0x7f36cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b683c6a2b0bf9c86 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.667+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d002c710 con 0x7f36cc003ef0 2023-12-19T13:47:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.667+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d002c870 con 0x7f36cc003ef0 2023-12-19T13:47:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.667+0000 7f36d7fff640 1 -- 172.21.15.113:0/1907542107 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d002cc00 con 0x7f36cc003ef0 2023-12-19T13:47:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.667+0000 7f36e6511640 1 -- 172.21.15.113:0/1907542107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 msgr2=0x7f36cc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.667+0000 7f36e6511640 1 --2- 172.21.15.113:0/1907542107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36cc0047c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009ac0 tx=0x7f36cc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.667+0000 7f36e5d10640 1 -- 172.21.15.113:0/1907542107 reap_dead start 2023-12-19T13:47:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.668+0000 7f36e6511640 1 -- 172.21.15.113:0/1907542107 shutdown_connections 2023-12-19T13:47:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.668+0000 7f36e6511640 1 -- 172.21.15.113:0/1907542107 >> 172.21.15.113:0/1907542107 conn(0x7f36e00b0100 msgr2=0x7f36e00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.668+0000 7f36e6511640 1 -- 172.21.15.113:0/1907542107 shutdown_connections 2023-12-19T13:47:31.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.668+0000 7f36e6511640 1 -- 172.21.15.113:0/1907542107 wait complete. 2023-12-19T13:47:31.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.670+0000 7f36e6511640 1 Processor -- start 2023-12-19T13:47:31.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.670+0000 7f36e6511640 1 -- start start 2023-12-19T13:47:31.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e6511640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36e0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e6511640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e0157420 0x7f36e00cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e6511640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e00ccdb0 0x7f36e01f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e6511640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0157000 con 0x7f36cc003ef0 2023-12-19T13:47:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e6511640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0156380 con 0x7f36e0157420 2023-12-19T13:47:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e6511640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0156660 con 0x7f36e00ccdb0 2023-12-19T13:47:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36e0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36e0155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60004/0 (socket says 172.21.15.113:60004) 2023-12-19T13:47:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 -- 172.21.15.113:0/1679016621 learned_addr learned my addr 172.21.15.113:0/1679016621 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e0157420 0x7f36e00cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e5d10640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e00ccdb0 0x7f36e01f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 -- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e00ccdb0 msgr2=0x7f36e01f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e00ccdb0 0x7f36e01f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 -- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e0157420 msgr2=0x7f36e00cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e0157420 0x7f36e00cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.671+0000 7f36e550f640 1 -- 172.21.15.113:0/1679016621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0156940 con 0x7f36cc003ef0 2023-12-19T13:47:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.672+0000 7f36e550f640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36e0155b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00f580 tx=0x7f36dc00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.672+0000 7f36d5ffb640 1 -- 172.21.15.113:0/1679016621 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc014870 con 0x7f36cc003ef0 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.672+0000 7f36d5ffb640 1 -- 172.21.15.113:0/1679016621 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc0149d0 con 0x7f36cc003ef0 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.672+0000 7f36d5ffb640 1 -- 172.21.15.113:0/1679016621 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc014d80 con 0x7f36cc003ef0 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.672+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e0156c20 con 0x7f36cc003ef0 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.672+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e0156070 con 0x7f36cc003ef0 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.673+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e0061910 con 0x7f36cc003ef0 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.674+0000 7f36d5ffb640 1 -- 172.21.15.113:0/1679016621 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f36dc015410 con 0x7f36cc003ef0 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.676+0000 7f36d5ffb640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f36c406a460 0x7f36c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.676+0000 7f36d5ffb640 1 -- 172.21.15.113:0/1679016621 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f36dc0891f0 con 0x7f36cc003ef0 2023-12-19T13:47:31.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.676+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f36c406a460 0x7f36c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:31.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.677+0000 7f36e4d0e640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f36c406a460 0x7f36c406c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f36d0036000 tx=0x7f36d0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:31.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.681+0000 7f36d5ffb640 1 -- 172.21.15.113:0/1679016621 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f36dc054790 con 0x7f36cc003ef0 2023-12-19T13:47:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.916+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e00ce980 con 0x7f36cc003ef0 2023-12-19T13:47:31.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.917+0000 7f36d5ffb640 1 -- 172.21.15.113:0/1679016621 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f36dc057db0 con 0x7f36cc003ef0 2023-12-19T13:47:31.918 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:31.918 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/872458574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":872458574},{"type":"v1","addr":"172.21.15.151:6833","nonce":872458574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2021196691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2021196691},{"type":"v1","addr":"172.21.15.113:6835","nonce":2021196691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4226945997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":4226945997},{"type":"v1","addr":"172.21.15.113:6837","nonce":4226945997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:46:30.918938+0000","modified":"2023-12-19T13:46:34.411633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/155547423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":155547423},{"type":"v1","addr":"172.21.15.151:6835","nonce":155547423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:47:31.918 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 8 2023-12-19T13:47:31.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f36c406a460 msgr2=0x7f36c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f36c406a460 0x7f36c406c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f36d0036000 tx=0x7f36d0030000 comp rx=0 tx=0).stop 2023-12-19T13:47:31.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 msgr2=0x7f36e0155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:31.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36e0155b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00f580 tx=0x7f36dc00fa40 comp rx=0 tx=0).stop 2023-12-19T13:47:31.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 shutdown_connections 2023-12-19T13:47:31.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f36c406a460 0x7f36c406c920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36e00ccdb0 0x7f36e01f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e0157420 0x7f36e00cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 --2- 172.21.15.113:0/1679016621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36cc003ef0 0x7f36e0155b30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:31.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.919+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 >> 172.21.15.113:0/1679016621 conn(0x7f36e00b0100 msgr2=0x7f36e006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:31.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.920+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 shutdown_connections 2023-12-19T13:47:31.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:31.920+0000 7f36e6511640 1 -- 172.21.15.113:0/1679016621 wait complete. 2023-12-19T13:47:31.939 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:32.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.150+0000 7f0f5f59e640 1 Processor -- start 2023-12-19T13:47:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.151+0000 7f0f5f59e640 1 -- start start 2023-12-19T13:47:32.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.152+0000 7f0f5f59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0f6015e5a0 0x7f0f600b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.152+0000 7f0f5f59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f6015f680 0x7f0f600b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.152+0000 7f0f5f59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6015ec30 con 0x7f0f600cdbf0 2023-12-19T13:47:32.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.152+0000 7f0f5f59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600b2cc0 con 0x7f0f6015e5a0 2023-12-19T13:47:32.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.152+0000 7f0f5f59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6015e980 con 0x7f0f6015f680 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.152+0000 7f0f5e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0f6015e5a0 0x7f0f600b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f5e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0f6015e5a0 0x7f0f600b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60016/0 (socket says 172.21.15.113:60016) 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f5e59c640 1 -- 172.21.15.113:0/1618762041 learned_addr learned my addr 172.21.15.113:0/1618762041 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f57fff640 1 --2- 172.21.15.113:0/1618762041 >> v2:172.21.15.151:3300/0 conn(0x7f0f6015f680 0x7f0f600b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f5e59c640 1 -- 172.21.15.113:0/1618762041 >> v2:172.21.15.151:3300/0 conn(0x7f0f6015f680 msgr2=0x7f0f600b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f5e59c640 1 --2- 172.21.15.113:0/1618762041 >> v2:172.21.15.151:3300/0 conn(0x7f0f6015f680 0x7f0f600b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f5e59c640 1 -- 172.21.15.113:0/1618762041 >> v1:172.21.15.151:6789/0 conn(0x7f0f600cdbf0 legacy=0x7f0f6006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f5e59c640 1 -- 172.21.15.113:0/1618762041 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600b2f90 con 0x7f0f6015e5a0 2023-12-19T13:47:32.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.153+0000 7f0f57fff640 1 --2- 172.21.15.113:0/1618762041 >> v2:172.21.15.151:3300/0 conn(0x7f0f6015f680 0x7f0f600b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:32.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.154+0000 7f0f5e59c640 1 --2- 172.21.15.113:0/1618762041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015e5a0 0x7f0f600b2030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009870 tx=0x7f0f5002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b673476dbaebf38 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:32.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.155+0000 7f0f5dd9b640 1 -- 172.21.15.113:0/1618762041 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50031860 con 0x7f0f6015e5a0 2023-12-19T13:47:32.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.155+0000 7f0f5dd9b640 1 -- 172.21.15.113:0/1618762041 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f500319c0 con 0x7f0f6015e5a0 2023-12-19T13:47:32.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.155+0000 7f0f5dd9b640 1 -- 172.21.15.113:0/1618762041 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50031d50 con 0x7f0f6015e5a0 2023-12-19T13:47:32.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.155+0000 7f0f5f59e640 1 -- 172.21.15.113:0/1618762041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015e5a0 msgr2=0x7f0f600b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.155+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/1618762041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015e5a0 0x7f0f600b2030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009870 tx=0x7f0f5002b900 comp rx=0 tx=0).stop 2023-12-19T13:47:32.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.156+0000 7f0f5f59e640 1 -- 172.21.15.113:0/1618762041 shutdown_connections 2023-12-19T13:47:32.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.156+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/1618762041 >> v2:172.21.15.151:3300/0 conn(0x7f0f6015f680 0x7f0f600b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.156+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/1618762041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015e5a0 0x7f0f600b2030 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.156+0000 7f0f5f59e640 1 -- 172.21.15.113:0/1618762041 >> 172.21.15.113:0/1618762041 conn(0x7f0f600b0100 msgr2=0x7f0f600b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:32.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.156+0000 7f0f5f59e640 1 -- 172.21.15.113:0/1618762041 shutdown_connections 2023-12-19T13:47:32.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.156+0000 7f0f5f59e640 1 -- 172.21.15.113:0/1618762041 wait complete. 2023-12-19T13:47:32.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.157+0000 7f0f5f59e640 1 Processor -- start 2023-12-19T13:47:32.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.158+0000 7f0f5f59e640 1 -- start start 2023-12-19T13:47:32.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f600cdbf0 0x7f0f60158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f6015e5a0 0x7f0f60158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5f59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015f680 0x7f0f600a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5f59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6014c7f0 con 0x7f0f6015f680 2023-12-19T13:47:32.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600a9440 con 0x7f0f600cdbf0 2023-12-19T13:47:32.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600cb510 con 0x7f0f6015e5a0 2023-12-19T13:47:32.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015f680 0x7f0f600a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015f680 0x7f0f600a86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60032/0 (socket says 172.21.15.113:60032) 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 -- 172.21.15.113:0/2224114344 learned_addr learned my addr 172.21.15.113:0/2224114344 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5e59c640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f600cdbf0 0x7f0f60158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f57fff640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f6015e5a0 0x7f0f60158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 -- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f6015e5a0 msgr2=0x7f0f60158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f6015e5a0 0x7f0f60158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 -- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f600cdbf0 msgr2=0x7f0f60158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f600cdbf0 0x7f0f60158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.159+0000 7f0f5ed9d640 1 -- 172.21.15.113:0/2224114344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f500094d0 con 0x7f0f6015f680 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.160+0000 7f0f5ed9d640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015f680 0x7f0f600a86d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c780 tx=0x7f0f5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.160+0000 7f0f56ffd640 1 -- 172.21.15.113:0/2224114344 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58003d80 con 0x7f0f6015f680 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.160+0000 7f0f56ffd640 1 -- 172.21.15.113:0/2224114344 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800ce90 con 0x7f0f6015f680 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.160+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f600cb7f0 con 0x7f0f6015f680 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.160+0000 7f0f56ffd640 1 -- 172.21.15.113:0/2224114344 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580052b0 con 0x7f0f6015f680 2023-12-19T13:47:32.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.160+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f600a8c10 con 0x7f0f6015f680 2023-12-19T13:47:32.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.161+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f600cb370 con 0x7f0f6015f680 2023-12-19T13:47:32.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.162+0000 7f0f56ffd640 1 -- 172.21.15.113:0/2224114344 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f58005410 con 0x7f0f6015f680 2023-12-19T13:47:32.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.163+0000 7f0f56ffd640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f4006a430 0x7f0f4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.163+0000 7f0f56ffd640 1 -- 172.21.15.113:0/2224114344 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0f58087ee0 con 0x7f0f6015f680 2023-12-19T13:47:32.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.164+0000 7f0f5e59c640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f4006a430 0x7f0f4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.164+0000 7f0f5e59c640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f4006a430 0x7f0f4006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f50036000 tx=0x7f0f5003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:32.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.168+0000 7f0f56ffd640 1 -- 172.21.15.113:0/2224114344 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f600cb370 con 0x7f0f6015f680 2023-12-19T13:47:32.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.357+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f600cbd10 con 0x7f0f6015f680 2023-12-19T13:47:32.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.360+0000 7f0f56ffd640 1 -- 172.21.15.113:0/2224114344 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16184 (secure 0 0 0) 0x7f0f600cbd10 con 0x7f0f6015f680 2023-12-19T13:47:32.361 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:32.361 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":22,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:20.429480+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:46:28.982854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:46:29.927804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2a","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:32.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f4006a430 msgr2=0x7f0f4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f4006a430 0x7f0f4006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f50036000 tx=0x7f0f5003c040 comp rx=0 tx=0).stop 2023-12-19T13:47:32.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015f680 msgr2=0x7f0f600a86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015f680 0x7f0f600a86d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c780 tx=0x7f0f5800cc40 comp rx=0 tx=0).stop 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 shutdown_connections 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f4006a430 0x7f0f4006c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f6015f680 0x7f0f600a86d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f6015e5a0 0x7f0f60158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 --2- 172.21.15.113:0/2224114344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f600cdbf0 0x7f0f60158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.362+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 >> 172.21.15.113:0/2224114344 conn(0x7f0f600b0100 msgr2=0x7f0f600b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.363+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 shutdown_connections 2023-12-19T13:47:32.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.363+0000 7f0f5f59e640 1 -- 172.21.15.113:0/2224114344 wait complete. 2023-12-19T13:47:32.382 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:47:32.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.588+0000 7f7dd8cc4640 1 Processor -- start 2023-12-19T13:47:32.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.588+0000 7f7dd8cc4640 1 -- start start 2023-12-19T13:47:32.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.589+0000 7f7dd8cc4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd40ae110 0x7f7dd40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.589+0000 7f7dd8cc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd40b0640 0x7f7dd406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.589+0000 7f7dd8cc4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd40ae640 con 0x7f7dd4157bf0 2023-12-19T13:47:32.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.589+0000 7f7dd8cc4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd406b8c0 con 0x7f7dd40ae110 2023-12-19T13:47:32.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.589+0000 7f7dd8cc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40b0ab0 con 0x7f7dd40b0640 2023-12-19T13:47:32.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dc9d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd40ae110 0x7f7dd40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dc9d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd40ae110 0x7f7dd40b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60048/0 (socket says 172.21.15.113:60048) 2023-12-19T13:47:32.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/1721833986 learned_addr learned my addr 172.21.15.113:0/1721833986 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:32.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dd2d9d640 1 --2- 172.21.15.113:0/1721833986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd40b0640 0x7f7dd406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/1721833986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd40b0640 msgr2=0x7f7dd406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:32.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/1721833986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd40b0640 0x7f7dd406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/1721833986 >> v1:172.21.15.151:6789/0 conn(0x7f7dd4157bf0 legacy=0x7f7dd415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:32.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.590+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/1721833986 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40ae920 con 0x7f7dd40ae110 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.591+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/1721833986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40ae110 0x7f7dd40b0100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40af4b0 tx=0x7f7dbc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6f1feddf79786c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd1d9b640 1 -- 172.21.15.113:0/1721833986 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc02d040 con 0x7f7dd40ae110 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd1d9b640 1 -- 172.21.15.113:0/1721833986 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc031810 con 0x7f7dd40ae110 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd1d9b640 1 -- 172.21.15.113:0/1721833986 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc031ba0 con 0x7f7dd40ae110 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/1721833986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40ae110 msgr2=0x7f7dd40b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/1721833986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40ae110 0x7f7dd40b0100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40af4b0 tx=0x7f7dbc02b8b0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/1721833986 shutdown_connections 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/1721833986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd40b0640 0x7f7dd406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/1721833986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40ae110 0x7f7dd40b0100 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/1721833986 >> 172.21.15.113:0/1721833986 conn(0x7f7dd40cbb70 msgr2=0x7f7dd40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:32.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/1721833986 shutdown_connections 2023-12-19T13:47:32.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.592+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/1721833986 wait complete. 2023-12-19T13:47:32.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.594+0000 7f7dd8cc4640 1 Processor -- start 2023-12-19T13:47:32.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.594+0000 7f7dd8cc4640 1 -- start start 2023-12-19T13:47:32.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dd8cc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd40ae110 0x7f7dd4139350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dd8cc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b0640 0x7f7dd414dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dd8cc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157bf0 0x7f7dd40ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dd8cc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414eea0 con 0x7f7dd40b0640 2023-12-19T13:47:32.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dd8cc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414e600 con 0x7f7dd40ae110 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dd8cc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414e8e0 con 0x7f7dd4157bf0 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dc9d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b0640 0x7f7dd414dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dc9d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b0640 0x7f7dd414dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60056/0 (socket says 172.21.15.113:60056) 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.595+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/385288247 learned_addr learned my addr 172.21.15.113:0/385288247 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/385288247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157bf0 msgr2=0x7f7dd40ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157bf0 0x7f7dd40ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/385288247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd40ae110 msgr2=0x7f7dd4139350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd40ae110 0x7f7dd4139350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dc9d9b640 1 -- 172.21.15.113:0/385288247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0094d0 con 0x7f7dd40b0640 2023-12-19T13:47:32.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b0640 0x7f7dd414dbb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc02b8f0 tx=0x7f7dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:32.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/385288247 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc03ad60 con 0x7f7dd40b0640 2023-12-19T13:47:32.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/385288247 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc0443f0 con 0x7f7dd40b0640 2023-12-19T13:47:32.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/385288247 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0447a0 con 0x7f7dd40b0640 2023-12-19T13:47:32.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd414ebc0 con 0x7f7dd40b0640 2023-12-19T13:47:32.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.596+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd414f2a0 con 0x7f7dd40b0640 2023-12-19T13:47:32.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.598+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd4139d80 con 0x7f7dd40b0640 2023-12-19T13:47:32.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.598+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/385288247 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7dbc04d450 con 0x7f7dd40b0640 2023-12-19T13:47:32.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.600+0000 7f7dcb7fe640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:32.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.600+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/385288247 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7dbc0aac00 con 0x7f7dd40b0640 2023-12-19T13:47:32.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.600+0000 7f7dd259c640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:32.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.601+0000 7f7dd259c640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4006fd0 tx=0x7f7dc4006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:32.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.604+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/385288247 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7dd4139d80 con 0x7f7dd40b0640 2023-12-19T13:47:32.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.831+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7dd4139d80 con 0x7f7dd40b0640 2023-12-19T13:47:32.834 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:47:32.833+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:47:32.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.850+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/385288247 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7dd4139d80 con 0x7f7dd40b0640 2023-12-19T13:47:32.851 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:47:32.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.852+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 msgr2=0x7f7db406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.852+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4006fd0 tx=0x7f7dc4006bc0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.852+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b0640 msgr2=0x7f7dd414dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:32.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b0640 0x7f7dd414dbb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc02b8f0 tx=0x7f7dbc0046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 shutdown_connections 2023-12-19T13:47:32.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157bf0 0x7f7dd40ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b0640 0x7f7dd414dbb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 --2- 172.21.15.113:0/385288247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd40ae110 0x7f7dd4139350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:32.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 >> 172.21.15.113:0/385288247 conn(0x7f7dd40cbb70 msgr2=0x7f7dd415a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:32.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 shutdown_connections 2023-12-19T13:47:32.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:32.853+0000 7f7dd8cc4640 1 -- 172.21.15.113:0/385288247 wait complete. 2023-12-19T13:47:32.872 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:47:32.888 INFO:tasks.ceph.mds.d.smithi151.stderr: -7623> 2023-12-19T13:46:32.046+0000 7f0e0e2ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:47:32.958 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:47:33.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.076+0000 7f230759e640 1 Processor -- start 2023-12-19T13:47:33.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.077+0000 7f230759e640 1 -- start start 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.078+0000 7f230759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2308159e40 0x7f23080b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.078+0000 7f230759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f23080cd430 0x7f23080b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.078+0000 7f230759e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f23080b0830 0x7f230815da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.078+0000 7f230759e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23080b23e0 con 0x7f23080b0830 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.078+0000 7f230759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230806b3a0 con 0x7f23080cd430 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.078+0000 7f230759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23080b0c80 con 0x7f2308159e40 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.078+0000 7f2306d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f23080b0830 0x7f230815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f2306d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f23080b0830 0x7f230815da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60058/0 (socket says 172.21.15.113:60058) 2023-12-19T13:47:33.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f2306d9d640 1 -- 172.21.15.113:0/1735763417 learned_addr learned my addr 172.21.15.113:0/1735763417 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:33.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f230659c640 1 --2- 172.21.15.113:0/1735763417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2308159e40 0x7f23080b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:33.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f22fffff640 1 --2- 172.21.15.113:0/1735763417 >> v2:172.21.15.151:3300/0 conn(0x7f23080cd430 0x7f23080b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:33.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f2306d9d640 1 -- 172.21.15.113:0/1735763417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2308159e40 msgr2=0x7f23080b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:33.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f2306d9d640 1 --2- 172.21.15.113:0/1735763417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2308159e40 0x7f23080b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f2306d9d640 1 -- 172.21.15.113:0/1735763417 >> v2:172.21.15.151:3300/0 conn(0x7f23080cd430 msgr2=0x7f23080b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:33.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f2306d9d640 1 --2- 172.21.15.113:0/1735763417 >> v2:172.21.15.151:3300/0 conn(0x7f23080cd430 0x7f23080b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.079+0000 7f2306d9d640 1 -- 172.21.15.113:0/1735763417 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080b1860 con 0x7f23080b0830 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.080+0000 7f2306d9d640 1 --2- 172.21.15.113:0/1735763417 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23080b0830 0x7f230815da60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f23080b0f30 tx=0x7f230002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d436d3d266415c84 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.080+0000 7f2305d9b640 1 -- 172.21.15.113:0/1735763417 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230002cb00 con 0x7f23080b0830 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.080+0000 7f2305d9b640 1 -- 172.21.15.113:0/1735763417 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230002cc60 con 0x7f23080b0830 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.080+0000 7f2305d9b640 1 -- 172.21.15.113:0/1735763417 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000343f0 con 0x7f23080b0830 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 -- 172.21.15.113:0/1735763417 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23080b0830 msgr2=0x7f230815da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 --2- 172.21.15.113:0/1735763417 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23080b0830 0x7f230815da60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f23080b0f30 tx=0x7f230002bf60 comp rx=0 tx=0).stop 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 -- 172.21.15.113:0/1735763417 shutdown_connections 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 --2- 172.21.15.113:0/1735763417 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23080b0830 0x7f230815da60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 --2- 172.21.15.113:0/1735763417 >> v2:172.21.15.151:3300/0 conn(0x7f23080cd430 0x7f23080b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 --2- 172.21.15.113:0/1735763417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2308159e40 0x7f23080b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 -- 172.21.15.113:0/1735763417 >> 172.21.15.113:0/1735763417 conn(0x7f23080659a0 msgr2=0x7f2308065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:33.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 -- 172.21.15.113:0/1735763417 shutdown_connections 2023-12-19T13:47:33.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.081+0000 7f230759e640 1 -- 172.21.15.113:0/1735763417 wait complete. 2023-12-19T13:47:33.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.083+0000 7f230759e640 1 Processor -- start 2023-12-19T13:47:33.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.083+0000 7f230759e640 1 -- start start 2023-12-19T13:47:33.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.084+0000 7f230759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23080b0830 0x7f230814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:33.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f230759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23080cd430 0x7f2308149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:33.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f230759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2308159e40 0x7f2308154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:33.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f230759e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230814c750 con 0x7f2308159e40 2023-12-19T13:47:33.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f230759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308149b90 con 0x7f23080cd430 2023-12-19T13:47:33.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f230759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23081f24b0 con 0x7f23080b0830 2023-12-19T13:47:33.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2308159e40 0x7f2308154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:33.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2308159e40 0x7f2308154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60072/0 (socket says 172.21.15.113:60072) 2023-12-19T13:47:33.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 -- 172.21.15.113:0/3104029074 learned_addr learned my addr 172.21.15.113:0/3104029074 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f22fffff640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23080cd430 0x7f2308149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 -- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23080b0830 msgr2=0x7f230814c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23080b0830 0x7f230814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 -- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23080cd430 msgr2=0x7f2308149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23080cd430 0x7f2308149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f2306d9d640 1 -- 172.21.15.113:0/3104029074 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300009b30 con 0x7f2308159e40 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.085+0000 7f22fffff640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23080cd430 0x7f2308149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:33.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.086+0000 7f2306d9d640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2308159e40 0x7f2308154070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2300009f40 tx=0x7f2300004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:33.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.086+0000 7f22feffd640 1 -- 172.21.15.113:0/3104029074 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300009510 con 0x7f2308159e40 2023-12-19T13:47:33.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.086+0000 7f22feffd640 1 -- 172.21.15.113:0/3104029074 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230003e450 con 0x7f2308159e40 2023-12-19T13:47:33.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.086+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23081f1930 con 0x7f2308159e40 2023-12-19T13:47:33.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.086+0000 7f22feffd640 1 -- 172.21.15.113:0/3104029074 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230003e800 con 0x7f2308159e40 2023-12-19T13:47:33.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.086+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23081f1ef0 con 0x7f2308159e40 2023-12-19T13:47:33.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.087+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2308061910 con 0x7f2308159e40 2023-12-19T13:47:33.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.088+0000 7f22feffd640 1 -- 172.21.15.113:0/3104029074 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f230003e960 con 0x7f2308159e40 2023-12-19T13:47:33.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.089+0000 7f22feffd640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f22e806a430 0x7f22e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:33.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.089+0000 7f22feffd640 1 -- 172.21.15.113:0/3104029074 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f23000ab800 con 0x7f2308159e40 2023-12-19T13:47:33.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.089+0000 7f230659c640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f22e806a430 0x7f22e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:33.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.090+0000 7f230659c640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f22e806a430 0x7f22e806c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f22f8006b10 tx=0x7f22f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:33.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.093+0000 7f22feffd640 1 -- 172.21.15.113:0/3104029074 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2300076e00 con 0x7f2308159e40 2023-12-19T13:47:33.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.319+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f230814d090 con 0x7f2308159e40 2023-12-19T13:47:33.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.853+0000 7f22feffd640 1 -- 172.21.15.113:0/3104029074 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f230007a420 con 0x7f2308159e40 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f22e806a430 msgr2=0x7f22e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f22e806a430 0x7f22e806c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f22f8006b10 tx=0x7f22f8008040 comp rx=0 tx=0).stop 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2308159e40 msgr2=0x7f2308154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2308159e40 0x7f2308154070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2300009f40 tx=0x7f2300004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 shutdown_connections 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f22e806a430 0x7f22e806c8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2308159e40 0x7f2308154070 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23080cd430 0x7f2308149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 --2- 172.21.15.113:0/3104029074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23080b0830 0x7f230814c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 >> 172.21.15.113:0/3104029074 conn(0x7f23080659a0 msgr2=0x7f230814a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 shutdown_connections 2023-12-19T13:47:33.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:33.857+0000 7f230759e640 1 -- 172.21.15.113:0/3104029074 wait complete. 2023-12-19T13:47:33.878 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:47:34.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.094+0000 7f0f27d1b640 1 Processor -- start 2023-12-19T13:47:34.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.095+0000 7f0f27d1b640 1 -- start start 2023-12-19T13:47:34.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.096+0000 7f0f27d1b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013e200 0x7f0f200ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.096+0000 7f0f27d1b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200b1880 con 0x7f0f20141660 2023-12-19T13:47:34.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.096+0000 7f0f27d1b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200b26e0 con 0x7f0f20141140 2023-12-19T13:47:34.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.096+0000 7f0f27d1b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200cf020 con 0x7f0f2013e200 2023-12-19T13:47:34.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f252b6640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0f20141660 0x7f0f20140a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55374/0 (socket says 172.21.15.113:55374) 2023-12-19T13:47:34.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f252b6640 1 -- 172.21.15.113:0/3064996162 learned_addr learned my addr 172.21.15.113:0/3064996162 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f25ab7640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013e200 0x7f0f200ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471285848 0 0) 0x7f0f200b1880 con 0x7f0f20141660 2023-12-19T13:47:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f0c003520 con 0x7f0f20141660 2023-12-19T13:47:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 686707526 0 0) 0x7f0f0c003520 con 0x7f0f20141660 2023-12-19T13:47:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013e200 msgr2=0x7f0f200ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013e200 0x7f0f200ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 >> v1:172.21.15.151:6789/0 conn(0x7f0f20141140 legacy=0x7f0f200cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200b1ad0 con 0x7f0f20141660 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0f10001670 con 0x7f0f20141660 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 >> v1:172.21.15.113:6789/0 conn(0x7f0f20141660 legacy=0x7f0f20140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f0c003a10 0x7f0f0c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f0c0047c0 0x7f0f0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.097+0000 7f0f24ab5640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200cf020 con 0x7f0f0c005180 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c00c0b0 con 0x7f0f0c003a10 2023-12-19T13:47:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c00c270 con 0x7f0f0c0047c0 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f25ab7640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013e200 0x7f0f200ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f262b8640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f262b8640 1 -- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f0c0047c0 msgr2=0x7f0f0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f262b8640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f0c0047c0 0x7f0f0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f262b8640 1 -- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f0c003a10 msgr2=0x7f0f0c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f262b8640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f0c003a10 0x7f0f0c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.098+0000 7f0f262b8640 1 -- 172.21.15.113:0/3064996162 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c003520 con 0x7f0f0c005180 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.099+0000 7f0f262b8640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f0c00b980 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f2006e730 tx=0x7f0f0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516d3f99712148fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.099+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18003b70 con 0x7f0f0c005180 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.099+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f18003cd0 con 0x7f0f0c005180 2023-12-19T13:47:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.099+0000 7f0f24ab5640 1 -- 172.21.15.113:0/3064996162 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18005310 con 0x7f0f0c005180 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.100+0000 7f0f27d1b640 1 -- 172.21.15.113:0/3064996162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 msgr2=0x7f0f0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.100+0000 7f0f27d1b640 1 --2- 172.21.15.113:0/3064996162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f0c00b980 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f2006e730 tx=0x7f0f0c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.100+0000 7f0f262b8640 1 -- 172.21.15.113:0/3064996162 reap_dead start 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.100+0000 7f0f27d1b640 1 -- 172.21.15.113:0/3064996162 shutdown_connections 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.100+0000 7f0f27d1b640 1 -- 172.21.15.113:0/3064996162 >> 172.21.15.113:0/3064996162 conn(0x7f0f200cf230 msgr2=0x7f0f200cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.100+0000 7f0f27d1b640 1 -- 172.21.15.113:0/3064996162 shutdown_connections 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.100+0000 7f0f27d1b640 1 -- 172.21.15.113:0/3064996162 wait complete. 2023-12-19T13:47:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.102+0000 7f0f27d1b640 1 Processor -- start 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.102+0000 7f0f27d1b640 1 -- start start 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f27d1b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f201f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f27d1b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013ed60 0x7f0f200aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f27d1b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f201402a0 0x7f0f2006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f27d1b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2013f4c0 con 0x7f0f0c005180 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f27d1b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2013fe10 con 0x7f0f201402a0 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f27d1b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200b0ee0 con 0x7f0f2013ed60 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f25ab7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f201f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f25ab7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f201f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60094/0 (socket says 172.21.15.113:60094) 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.103+0000 7f0f25ab7640 1 -- 172.21.15.113:0/1008689561 learned_addr learned my addr 172.21.15.113:0/1008689561 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f25ab7640 1 -- 172.21.15.113:0/1008689561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013ed60 msgr2=0x7f0f200aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f25ab7640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013ed60 0x7f0f200aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f25ab7640 1 -- 172.21.15.113:0/1008689561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f201402a0 msgr2=0x7f0f2006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f25ab7640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f201402a0 0x7f0f2006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f25ab7640 1 -- 172.21.15.113:0/1008689561 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f201f3bf0 con 0x7f0f0c005180 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f25ab7640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f201f36b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00e590 tx=0x7f0f1c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f167fc640 1 -- 172.21.15.113:0/1008689561 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c004230 con 0x7f0f0c005180 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f167fc640 1 -- 172.21.15.113:0/1008689561 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c0043b0 con 0x7f0f0c005180 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f167fc640 1 -- 172.21.15.113:0/1008689561 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c004520 con 0x7f0f0c005180 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2013f1e0 con 0x7f0f0c005180 2023-12-19T13:47:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.104+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2013faa0 con 0x7f0f0c005180 2023-12-19T13:47:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.106+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f20061910 con 0x7f0f0c005180 2023-12-19T13:47:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.106+0000 7f0f167fc640 1 -- 172.21.15.113:0/1008689561 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f1c003850 con 0x7f0f0c005180 2023-12-19T13:47:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.108+0000 7f0f167fc640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f0406a430 0x7f0f0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:34.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.108+0000 7f0f167fc640 1 -- 172.21.15.113:0/1008689561 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0f1c088500 con 0x7f0f0c005180 2023-12-19T13:47:34.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.108+0000 7f0f252b6640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f0406a430 0x7f0f0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:34.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.109+0000 7f0f252b6640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f0406a430 0x7f0f0406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f20140cd0 tx=0x7f0f10001520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:34.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.112+0000 7f0f167fc640 1 -- 172.21.15.113:0/1008689561 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f1c0539d0 con 0x7f0f0c005180 2023-12-19T13:47:34.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.297+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f200cc990 con 0x7f0f0c005180 2023-12-19T13:47:34.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.865+0000 7f0f167fc640 1 -- 172.21.15.113:0/1008689561 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0f1c056ff0 con 0x7f0f0c005180 2023-12-19T13:47:34.866 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:47:34.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f0406a430 msgr2=0x7f0f0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:34.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f0406a430 0x7f0f0406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f20140cd0 tx=0x7f0f10001520 comp rx=0 tx=0).stop 2023-12-19T13:47:34.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 msgr2=0x7f0f201f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:34.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f201f36b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00e590 tx=0x7f0f1c00ea50 comp rx=0 tx=0).stop 2023-12-19T13:47:34.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 shutdown_connections 2023-12-19T13:47:34.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f0406a430 0x7f0f0406c8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f201402a0 0x7f0f2006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2013ed60 0x7f0f200aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 --2- 172.21.15.113:0/1008689561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f0c005180 0x7f0f201f36b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:34.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 >> 172.21.15.113:0/1008689561 conn(0x7f0f200cf230 msgr2=0x7f0f200cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:34.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.868+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 shutdown_connections 2023-12-19T13:47:34.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:34.869+0000 7f0f27d1b640 1 -- 172.21.15.113:0/1008689561 wait complete. 2023-12-19T13:47:34.890 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:47:35.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.103+0000 7f8ae4743640 1 Processor -- start 2023-12-19T13:47:35.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.103+0000 7f8ae4743640 1 -- start start 2023-12-19T13:47:35.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae4743640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8adc06dac0 0x7f8adc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae4743640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8adc0aee40 0x7f8adc15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae4743640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8adc0b0770 con 0x7f8adc06dea0 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae4743640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8adc0af290 con 0x7f8adc0aee40 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae4743640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8adc0b0490 con 0x7f8adc06dac0 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae2ce0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8adc0aee40 0x7f8adc15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae2ce0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8adc0aee40 0x7f8adc15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60104/0 (socket says 172.21.15.113:60104) 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/2867792951 learned_addr learned my addr 172.21.15.113:0/2867792951 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:35.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/2867792951 >> v2:172.21.15.151:3300/0 conn(0x7f8adc06dac0 msgr2=0x7f8adc0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:35.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae2ce0640 1 --2- 172.21.15.113:0/2867792951 >> v2:172.21.15.151:3300/0 conn(0x7f8adc06dac0 0x7f8adc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/2867792951 >> v1:172.21.15.151:6789/0 conn(0x7f8adc06dea0 legacy=0x7f8adc0ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:35.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.105+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/2867792951 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc15ca00 con 0x7f8adc0aee40 2023-12-19T13:47:35.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.106+0000 7f8ae2ce0640 1 --2- 172.21.15.113:0/2867792951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc15c4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0af430 tx=0x7f8ad402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42b8e171e5041c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:35.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.107+0000 7f8ae14dd640 1 -- 172.21.15.113:0/2867792951 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad402ca80 con 0x7f8adc0aee40 2023-12-19T13:47:35.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.107+0000 7f8ae14dd640 1 -- 172.21.15.113:0/2867792951 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad402cbe0 con 0x7f8adc0aee40 2023-12-19T13:47:35.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.107+0000 7f8ae14dd640 1 -- 172.21.15.113:0/2867792951 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40343f0 con 0x7f8adc0aee40 2023-12-19T13:47:35.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.107+0000 7f8ae4743640 1 -- 172.21.15.113:0/2867792951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 msgr2=0x7f8adc15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:35.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.107+0000 7f8ae4743640 1 --2- 172.21.15.113:0/2867792951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc15c4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0af430 tx=0x7f8ad402bee0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.108+0000 7f8ae4743640 1 -- 172.21.15.113:0/2867792951 shutdown_connections 2023-12-19T13:47:35.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.108+0000 7f8ae4743640 1 --2- 172.21.15.113:0/2867792951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc15c4c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.108+0000 7f8ae4743640 1 --2- 172.21.15.113:0/2867792951 >> v2:172.21.15.151:3300/0 conn(0x7f8adc06dac0 0x7f8adc0af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.108+0000 7f8ae4743640 1 -- 172.21.15.113:0/2867792951 >> 172.21.15.113:0/2867792951 conn(0x7f8adc0cf2f0 msgr2=0x7f8adc0cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:35.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.108+0000 7f8ae4743640 1 -- 172.21.15.113:0/2867792951 shutdown_connections 2023-12-19T13:47:35.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.108+0000 7f8ae4743640 1 -- 172.21.15.113:0/2867792951 wait complete. 2023-12-19T13:47:35.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.109+0000 7f8ae4743640 1 Processor -- start 2023-12-19T13:47:35.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.110+0000 7f8ae4743640 1 -- start start 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.110+0000 7f8ae4743640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8adc06dac0 0x7f8adc139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.110+0000 7f8ae4743640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8adc06dea0 0x7f8adc157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae4743640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae4743640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc139fb0 con 0x7f8adc0aee40 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae4743640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc06bdc0 con 0x7f8adc06dea0 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae4743640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc06c0a0 con 0x7f8adc06dac0 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc06ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60110/0 (socket says 172.21.15.113:60110) 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/3817708273 learned_addr learned my addr 172.21.15.113:0/3817708273 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/3817708273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8adc06dac0 msgr2=0x7f8adc139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:35.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8adc06dac0 0x7f8adc139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/3817708273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8adc06dea0 msgr2=0x7f8adc157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:35.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8adc06dea0 0x7f8adc157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 -- 172.21.15.113:0/3817708273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad4009b30 con 0x7f8adc0aee40 2023-12-19T13:47:35.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.111+0000 7f8ae2ce0640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc06ce60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4036040 tx=0x7f8ad4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:35.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.112+0000 7f8ad2ffd640 1 -- 172.21.15.113:0/3817708273 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad403e450 con 0x7f8adc0aee40 2023-12-19T13:47:35.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.112+0000 7f8ad2ffd640 1 -- 172.21.15.113:0/3817708273 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad403e5d0 con 0x7f8adc0aee40 2023-12-19T13:47:35.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.112+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc06c380 con 0x7f8adc0aee40 2023-12-19T13:47:35.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.112+0000 7f8ad2ffd640 1 -- 172.21.15.113:0/3817708273 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad403e980 con 0x7f8adc0aee40 2023-12-19T13:47:35.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.112+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc06c940 con 0x7f8adc0aee40 2023-12-19T13:47:35.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.113+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8adc074770 con 0x7f8adc0aee40 2023-12-19T13:47:35.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.114+0000 7f8ad2ffd640 1 -- 172.21.15.113:0/3817708273 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ad402cd50 con 0x7f8adc0aee40 2023-12-19T13:47:35.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.115+0000 7f8ad2ffd640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ac006a430 0x7f8ac006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:35.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.115+0000 7f8ad2ffd640 1 -- 172.21.15.113:0/3817708273 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f8ad40ab390 con 0x7f8adc0aee40 2023-12-19T13:47:35.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.115+0000 7f8ae24df640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ac006a430 0x7f8ac006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:35.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.116+0000 7f8ae24df640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ac006a430 0x7f8ac006c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009670 tx=0x7f8ad8006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:35.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.119+0000 7f8ad2ffd640 1 -- 172.21.15.113:0/3817708273 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ad4076b30 con 0x7f8adc0aee40 2023-12-19T13:47:35.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.312+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8adc06cb60 con 0x7f8adc0aee40 2023-12-19T13:47:35.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.867+0000 7f8ad2ffd640 1 -- 172.21.15.113:0/3817708273 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8ad407a150 con 0x7f8adc0aee40 2023-12-19T13:47:35.868 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:47:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ac006a430 msgr2=0x7f8ac006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ac006a430 0x7f8ac006c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009670 tx=0x7f8ad8006bf0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 msgr2=0x7f8adc06ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc06ce60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4036040 tx=0x7f8ad4004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 shutdown_connections 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ac006a430 0x7f8ac006c8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8adc0aee40 0x7f8adc06ce60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8adc06dea0 0x7f8adc157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 --2- 172.21.15.113:0/3817708273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8adc06dac0 0x7f8adc139a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 >> 172.21.15.113:0/3817708273 conn(0x7f8adc0cf2f0 msgr2=0x7f8adc0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 shutdown_connections 2023-12-19T13:47:35.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:35.872+0000 7f8ae4743640 1 -- 172.21.15.113:0/3817708273 wait complete. 2023-12-19T13:47:35.895 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:47:35.895 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:47:35.895 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:47:35.895 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:47:35.896 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:47:35.896 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:47:35.896 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:47:35.896 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:47:35.896 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:47:35.896 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:47:35.896 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:47:35.897 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:47:35.897 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:47:35.900 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:47:35.900 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:47:35.900 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:47:35.917 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:47:35.917 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:47:35.918 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:47:35.918 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:47:35.931 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:47:35.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:47:35.933 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:47:35.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:47:35.965 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:47:35.965 DEBUG:teuthology.parallel:result is None 2023-12-19T13:47:35.972 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:47:35.972 DEBUG:teuthology.parallel:result is None 2023-12-19T13:47:35.981 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:47:35.982 DEBUG:teuthology.parallel:result is None 2023-12-19T13:47:35.990 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:47:35.990 DEBUG:teuthology.parallel:result is None 2023-12-19T13:47:35.990 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:47:36.136 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:47:36.139 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:47:36.145 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:47:36.145 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:47:36.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.194+0000 7f2bdceda640 1 Processor -- start 2023-12-19T13:47:36.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.194+0000 7f2bdceda640 1 -- start start 2023-12-19T13:47:36.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.195+0000 7f2bdceda640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2bd8146c40 0x7f2bd8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:36.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.195+0000 7f2bdceda640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd8161d00 con 0x7f2bd80b7360 2023-12-19T13:47:36.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.195+0000 7f2bdceda640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd806f160 con 0x7f2bd80d08f0 2023-12-19T13:47:36.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.195+0000 7f2bdceda640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80700c0 con 0x7f2bd8146c40 2023-12-19T13:47:36.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.195+0000 7f2bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2bd8146c40 0x7f2bd8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:36.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.195+0000 7f2bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2bd8146c40 0x7f2bd8070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60150/0 (socket says 172.21.15.113:60150) 2023-12-19T13:47:36.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.195+0000 7f2bd77fe640 1 -- 172.21.15.113:0/3827767141 learned_addr learned my addr 172.21.15.113:0/3827767141 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:36.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.196+0000 7f2bd77fe640 1 -- 172.21.15.113:0/3827767141 >> v1:172.21.15.151:6789/0 conn(0x7f2bd80d08f0 legacy=0x7f2bd81615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:36.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.196+0000 7f2bd77fe640 1 -- 172.21.15.113:0/3827767141 >> v1:172.21.15.113:6789/0 conn(0x7f2bd80b7360 legacy=0x7f2bd8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:36.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.196+0000 7f2bd77fe640 1 -- 172.21.15.113:0/3827767141 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd806f440 con 0x7f2bd8146c40 2023-12-19T13:47:36.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.197+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/3827767141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8146c40 0x7f2bd8070e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009870 tx=0x7f2bc802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc7a5b65b839f9c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:36.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.197+0000 7f2bd67fc640 1 -- 172.21.15.113:0/3827767141 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc802f840 con 0x7f2bd8146c40 2023-12-19T13:47:36.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.197+0000 7f2bd67fc640 1 -- 172.21.15.113:0/3827767141 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc802f9a0 con 0x7f2bd8146c40 2023-12-19T13:47:36.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.197+0000 7f2bd67fc640 1 -- 172.21.15.113:0/3827767141 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc802fd30 con 0x7f2bd8146c40 2023-12-19T13:47:36.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.198+0000 7f2bdceda640 1 -- 172.21.15.113:0/3827767141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8146c40 msgr2=0x7f2bd8070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:36.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.198+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3827767141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8146c40 0x7f2bd8070e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009870 tx=0x7f2bc802ba20 comp rx=0 tx=0).stop 2023-12-19T13:47:36.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.198+0000 7f2bdceda640 1 -- 172.21.15.113:0/3827767141 shutdown_connections 2023-12-19T13:47:36.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.198+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3827767141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8146c40 0x7f2bd8070e70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:36.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.198+0000 7f2bdceda640 1 -- 172.21.15.113:0/3827767141 >> 172.21.15.113:0/3827767141 conn(0x7f2bd80d31b0 msgr2=0x7f2bd80d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:36.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.198+0000 7f2bdceda640 1 -- 172.21.15.113:0/3827767141 shutdown_connections 2023-12-19T13:47:36.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.198+0000 7f2bdceda640 1 -- 172.21.15.113:0/3827767141 wait complete. 2023-12-19T13:47:36.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.199+0000 7f2bdceda640 1 Processor -- start 2023-12-19T13:47:36.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.200+0000 7f2bdceda640 1 -- start start 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.200+0000 7f2bdceda640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bd80b7360 0x7f2bd813ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.200+0000 7f2bdceda640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd80d08f0 0x7f2bd815c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bdceda640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bd8146c40 0x7f2bd81407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bdceda640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd813c5d0 con 0x7f2bd80d08f0 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bdceda640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd813fe60 con 0x7f2bd80b7360 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bdceda640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd813f5c0 con 0x7f2bd8146c40 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd80d08f0 0x7f2bd815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:36.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd80d08f0 0x7f2bd815c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60152/0 (socket says 172.21.15.113:60152) 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/3529113259 learned_addr learned my addr 172.21.15.113:0/3529113259 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bd80b7360 0x7f2bd813ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd7fff640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bd8146c40 0x7f2bd81407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bd8146c40 msgr2=0x7f2bd81407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bd8146c40 0x7f2bd81407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bd80b7360 msgr2=0x7f2bd813ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bd80b7360 0x7f2bd813ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/3529113259 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80094d0 con 0x7f2bd80d08f0 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.201+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bd80b7360 0x7f2bd813ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:36.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.202+0000 7f2bd6ffd640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd80d08f0 0x7f2bd815c2c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c450 tx=0x7f2bcc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:36.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.202+0000 7f2bbffff640 1 -- 172.21.15.113:0/3529113259 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0052d0 con 0x7f2bd80d08f0 2023-12-19T13:47:36.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.202+0000 7f2bbffff640 1 -- 172.21.15.113:0/3529113259 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc005430 con 0x7f2bd80d08f0 2023-12-19T13:47:36.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.202+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd813f8a0 con 0x7f2bd80d08f0 2023-12-19T13:47:36.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.202+0000 7f2bbffff640 1 -- 172.21.15.113:0/3529113259 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc012870 con 0x7f2bd80d08f0 2023-12-19T13:47:36.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.202+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd813c800 con 0x7f2bd80d08f0 2023-12-19T13:47:36.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.203+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd8061910 con 0x7f2bd80d08f0 2023-12-19T13:47:36.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.204+0000 7f2bbffff640 1 -- 172.21.15.113:0/3529113259 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2bcc0129d0 con 0x7f2bd80d08f0 2023-12-19T13:47:36.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.205+0000 7f2bbffff640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2bc406a430 0x7f2bc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:36.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.207+0000 7f2bbffff640 1 -- 172.21.15.113:0/3529113259 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2bcc088220 con 0x7f2bd80d08f0 2023-12-19T13:47:36.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.207+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2bc406a430 0x7f2bc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:36.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.207+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2bc406a430 0x7f2bc406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8036000 tx=0x7f2bc8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:36.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.210+0000 7f2bbffff640 1 -- 172.21.15.113:0/3529113259 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2bcc053a70 con 0x7f2bd80d08f0 2023-12-19T13:47:36.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:36.414+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2bd80b8a50 con 0x7f2bd80d08f0 2023-12-19T13:47:37.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.197+0000 7f2bbffff640 1 -- 172.21.15.113:0/3529113259 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2bcc057090 con 0x7f2bd80d08f0 2023-12-19T13:47:37.198 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:47:37.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2bc406a430 msgr2=0x7f2bc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2bc406a430 0x7f2bc406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8036000 tx=0x7f2bc8008030 comp rx=0 tx=0).stop 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd80d08f0 msgr2=0x7f2bd815c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd80d08f0 0x7f2bd815c2c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c450 tx=0x7f2bcc00c910 comp rx=0 tx=0).stop 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 shutdown_connections 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2bc406a430 0x7f2bc406c8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bd8146c40 0x7f2bd81407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd80d08f0 0x7f2bd815c2c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 --2- 172.21.15.113:0/3529113259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bd80b7360 0x7f2bd813ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 >> 172.21.15.113:0/3529113259 conn(0x7f2bd80d31b0 msgr2=0x7f2bd80d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 shutdown_connections 2023-12-19T13:47:37.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.201+0000 7f2bdceda640 1 -- 172.21.15.113:0/3529113259 wait complete. 2023-12-19T13:47:37.221 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:47:37.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.430+0000 7fb4b31f0640 1 Processor -- start 2023-12-19T13:47:37.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.430+0000 7fb4b31f0640 1 -- start start 2023-12-19T13:47:37.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.431+0000 7fb4b31f0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4ac0b0b50 0x7fb4ac06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.431+0000 7fb4b31f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4ac06b590 0x7fb4ac06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4b31f0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac06bb30 con 0x7fb4ac1449e0 2023-12-19T13:47:37.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4b31f0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b0070 con 0x7fb4ac0b0b50 2023-12-19T13:47:37.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4b31f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b0350 con 0x7fb4ac06b590 2023-12-19T13:47:37.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4b0f8c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb4ac1449e0 0x7fb4ac0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55412/0 (socket says 172.21.15.113:55412) 2023-12-19T13:47:37.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4b0f8c640 1 -- 172.21.15.113:0/303347614 learned_addr learned my addr 172.21.15.113:0/303347614 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/303347614 >> v2:172.21.15.151:3300/0 conn(0x7fb4ac0b0b50 0x7fb4ac06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336274205 0 0) 0x7fb4ac06bb30 con 0x7fb4ac1449e0 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.432+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb494003520 con 0x7fb4ac1449e0 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4b178d640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4ac06b590 0x7fb4ac06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2673090519 0 0) 0x7fb494003520 con 0x7fb4ac1449e0 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4ac06b590 msgr2=0x7fb4ac06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4ac06b590 0x7fb4ac06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 >> v2:172.21.15.151:3300/0 conn(0x7fb4ac0b0b50 msgr2=0x7fb4ac06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 --2- 172.21.15.113:0/303347614 >> v2:172.21.15.151:3300/0 conn(0x7fb4ac0b0b50 0x7fb4ac06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0b0630 con 0x7fb4ac1449e0 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb4a8001670 con 0x7fb4ac1449e0 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 >> v1:172.21.15.113:6789/0 conn(0x7fb4ac1449e0 legacy=0x7fb4ac0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4940039e0 0x7fb494003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4940047c0 0x7fb494004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4ac06b590 0x7fb494005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b0070 con 0x7fb4940047c0 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b0350 con 0x7fb4940039e0 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49400ba00 con 0x7fb4ac06b590 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.433+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4940047c0 0x7fb494004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.434+0000 7fb4a3fff640 1 -- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4ac06b590 msgr2=0x7fb494005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.434+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4ac06b590 0x7fb494005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.434+0000 7fb4a3fff640 1 -- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4940039e0 msgr2=0x7fb494003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:37.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.434+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4940039e0 0x7fb494003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.434+0000 7fb4a3fff640 1 -- 172.21.15.113:0/303347614 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494003520 con 0x7fb4940047c0 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.435+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4940047c0 0x7fb494004c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009ac0 tx=0x7fb4940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8236a05598ac3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.435+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c02c710 con 0x7fb4940047c0 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.435+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c02c870 con 0x7fb4940047c0 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.435+0000 7fb4a37fe640 1 -- 172.21.15.113:0/303347614 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c02cc00 con 0x7fb4940047c0 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.436+0000 7fb4b31f0640 1 -- 172.21.15.113:0/303347614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4940047c0 msgr2=0x7fb494004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.436+0000 7fb4b31f0640 1 --2- 172.21.15.113:0/303347614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4940047c0 0x7fb494004c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009ac0 tx=0x7fb4940057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.436+0000 7fb4b178d640 1 -- 172.21.15.113:0/303347614 reap_dead start 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.436+0000 7fb4b31f0640 1 -- 172.21.15.113:0/303347614 shutdown_connections 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.436+0000 7fb4b31f0640 1 -- 172.21.15.113:0/303347614 >> 172.21.15.113:0/303347614 conn(0x7fb4ac0cbb70 msgr2=0x7fb4ac0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.436+0000 7fb4b31f0640 1 -- 172.21.15.113:0/303347614 shutdown_connections 2023-12-19T13:47:37.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.436+0000 7fb4b31f0640 1 -- 172.21.15.113:0/303347614 wait complete. 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.438+0000 7fb4b31f0640 1 Processor -- start 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.438+0000 7fb4b31f0640 1 -- start start 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4b31f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4940047c0 0x7fb4ac1f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4b31f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4ac15c200 0x7fb4ac15e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4b31f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac1f4530 0x7fb4ac1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4b31f0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1f4ef0 con 0x7fb4ac15c200 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4b31f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac15d2a0 con 0x7fb4ac1f4530 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4b31f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac15c690 con 0x7fb4940047c0 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4ac15c200 0x7fb4ac15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4ac15c200 0x7fb4ac15e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60178/0 (socket says 172.21.15.113:60178) 2023-12-19T13:47:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 -- 172.21.15.113:0/1698005416 learned_addr learned my addr 172.21.15.113:0/1698005416 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4b0f8c640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4940047c0 0x7fb4ac1f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 -- 172.21.15.113:0/1698005416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4940047c0 msgr2=0x7fb4ac1f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4940047c0 0x7fb4ac1f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 -- 172.21.15.113:0/1698005416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac1f4530 msgr2=0x7fb4ac1f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac1f4530 0x7fb4ac1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.439+0000 7fb4a3fff640 1 -- 172.21.15.113:0/1698005416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac15c970 con 0x7fb4ac15c200 2023-12-19T13:47:37.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.440+0000 7fb4a3fff640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4ac15c200 0x7fb4ac15e030 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb49c037040 tx=0x7fb49c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:37.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.440+0000 7fb4a17fa640 1 -- 172.21.15.113:0/1698005416 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c003810 con 0x7fb4ac15c200 2023-12-19T13:47:37.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.440+0000 7fb4a17fa640 1 -- 172.21.15.113:0/1698005416 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c003970 con 0x7fb4ac15c200 2023-12-19T13:47:37.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.440+0000 7fb4a17fa640 1 -- 172.21.15.113:0/1698005416 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c003d00 con 0x7fb4ac15c200 2023-12-19T13:47:37.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.440+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac15cc50 con 0x7fb4ac15c200 2023-12-19T13:47:37.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.440+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac1f4260 con 0x7fb4ac15c200 2023-12-19T13:47:37.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.441+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac061910 con 0x7fb4ac15c200 2023-12-19T13:47:37.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.442+0000 7fb4a17fa640 1 -- 172.21.15.113:0/1698005416 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb49c040450 con 0x7fb4ac15c200 2023-12-19T13:47:37.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.443+0000 7fb4a17fa640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb49806a460 0x7fb49806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.443+0000 7fb4a17fa640 1 -- 172.21.15.113:0/1698005416 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb49c0aa590 con 0x7fb4ac15c200 2023-12-19T13:47:37.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.443+0000 7fb4b0f8c640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb49806a460 0x7fb49806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.444+0000 7fb4b0f8c640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb49806a460 0x7fb49806c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80018a0 tx=0x7fb4a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:37.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.448+0000 7fb4a17fa640 1 -- 172.21.15.113:0/1698005416 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb49c075e30 con 0x7fb4ac15c200 2023-12-19T13:47:37.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.706+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb4ac134b50 con 0x7fb4ac15c200 2023-12-19T13:47:37.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.708+0000 7fb4a17fa640 1 -- 172.21.15.113:0/1698005416 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb49c003e60 con 0x7fb4ac15c200 2023-12-19T13:47:37.707 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:37.707 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:47:37.708 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:47:37.709 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:47:37.710 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.711 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.712 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.713 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.714 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.715 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.716 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:47:37.717 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.718 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.719 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:47:37.720 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-mds", 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQClnoFlWBI1JxAAiBwifoRuGbScm1S8/oTCcg==", 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T13:47:37.721 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQClnoFlTzM1JxAAAv4ElLmJtamLjtJfwjEhnw==", 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-osd", 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQClnoFl6U01JxAAKbpv+8jqh8NVT/eRVK0KmQ==", 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.722 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQClnoFlTmg1JxAAGrFcdUQesXqupoeHesB3mg==", 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQClnoFl3oI1JxAA1ZtM00HCUT3SGRlJsDbtUQ==", 2023-12-19T13:47:37.723 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQClnoFlP501JxAA77NaoxFKj8kXXd55acU2mA==", 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:47:37.724 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:47:37.725 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:47:37.726 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.726 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:37.726 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:47:37.726 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:47:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb49806a460 msgr2=0x7fb49806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb49806a460 0x7fb49806c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80018a0 tx=0x7fb4a8009040 comp rx=0 tx=0).stop 2023-12-19T13:47:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4ac15c200 msgr2=0x7fb4ac15e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4ac15c200 0x7fb4ac15e030 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb49c037040 tx=0x7fb49c004730 comp rx=0 tx=0).stop 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 shutdown_connections 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb49806a460 0x7fb49806c920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac1f4530 0x7fb4ac1f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4ac15c200 0x7fb4ac15e030 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 --2- 172.21.15.113:0/1698005416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4940047c0 0x7fb4ac1f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 >> 172.21.15.113:0/1698005416 conn(0x7fb4ac0cbb70 msgr2=0x7fb4ac13ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 shutdown_connections 2023-12-19T13:47:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.710+0000 7fb4b31f0640 1 -- 172.21.15.113:0/1698005416 wait complete. 2023-12-19T13:47:37.728 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T13:47:37.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.940+0000 7f74fe142640 1 Processor -- start 2023-12-19T13:47:37.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.941+0000 7f74fe142640 1 -- start start 2023-12-19T13:47:37.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.942+0000 7f74fe142640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74f8146e30 0x7f74f80b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.942+0000 7f74fe142640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f74f80d0c60 0x7f74f815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.942+0000 7f74fe142640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f80d1070 con 0x7f74f80b7ea0 2023-12-19T13:47:37.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.942+0000 7f74fe142640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f8147210 con 0x7f74f8146e30 2023-12-19T13:47:37.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.942+0000 7f74fe142640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f80b8330 con 0x7f74f80d0c60 2023-12-19T13:47:37.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.942+0000 7f74fd140640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74f8146e30 0x7f74f80b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.943+0000 7f74fd140640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74f8146e30 0x7f74f80b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50506/0 (socket says 172.21.15.113:50506) 2023-12-19T13:47:37.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.943+0000 7f74fd140640 1 -- 172.21.15.113:0/1264363135 learned_addr learned my addr 172.21.15.113:0/1264363135 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:37.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.943+0000 7f74fd140640 1 -- 172.21.15.113:0/1264363135 >> v2:172.21.15.151:3300/0 conn(0x7f74f80d0c60 msgr2=0x7f74f815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:37.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.943+0000 7f74fd140640 1 --2- 172.21.15.113:0/1264363135 >> v2:172.21.15.151:3300/0 conn(0x7f74f80d0c60 0x7f74f815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.943+0000 7f74fd140640 1 -- 172.21.15.113:0/1264363135 >> v1:172.21.15.151:6789/0 conn(0x7f74f80b7ea0 legacy=0x7f74f80d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:37.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.943+0000 7f74fd140640 1 -- 172.21.15.113:0/1264363135 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80d12d0 con 0x7f74f8146e30 2023-12-19T13:47:37.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.944+0000 7f74fd140640 1 --2- 172.21.15.113:0/1264363135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80b7960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f74f80b6450 tx=0x7f74f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29151c082d72dfc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:37.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.944+0000 7f74ebfff640 1 -- 172.21.15.113:0/1264363135 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40317e0 con 0x7f74f8146e30 2023-12-19T13:47:37.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.944+0000 7f74ebfff640 1 -- 172.21.15.113:0/1264363135 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f4031940 con 0x7f74f8146e30 2023-12-19T13:47:37.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.944+0000 7f74ebfff640 1 -- 172.21.15.113:0/1264363135 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f4031cd0 con 0x7f74f8146e30 2023-12-19T13:47:37.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 -- 172.21.15.113:0/1264363135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 msgr2=0x7f74f80b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 --2- 172.21.15.113:0/1264363135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80b7960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f74f80b6450 tx=0x7f74f402b880 comp rx=0 tx=0).stop 2023-12-19T13:47:37.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 -- 172.21.15.113:0/1264363135 shutdown_connections 2023-12-19T13:47:37.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 --2- 172.21.15.113:0/1264363135 >> v2:172.21.15.151:3300/0 conn(0x7f74f80d0c60 0x7f74f815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 --2- 172.21.15.113:0/1264363135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80b7960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 -- 172.21.15.113:0/1264363135 >> 172.21.15.113:0/1264363135 conn(0x7f74f80b2990 msgr2=0x7f74f80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:37.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 -- 172.21.15.113:0/1264363135 shutdown_connections 2023-12-19T13:47:37.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.945+0000 7f74fe142640 1 -- 172.21.15.113:0/1264363135 wait complete. 2023-12-19T13:47:37.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.947+0000 7f74fe142640 1 Processor -- start 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.947+0000 7f74fe142640 1 -- start start 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fe142640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74f80b7ea0 0x7f74f80c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fe142640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74f80d0c60 0x7f74f81410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fe142640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fe142640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8140ca0 con 0x7f74f8146e30 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fe142640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f81e5b50 con 0x7f74f80d0c60 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fe142640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8140390 con 0x7f74f80b7ea0 2023-12-19T13:47:37.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fd941640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fd941640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50516/0 (socket says 172.21.15.113:50516) 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.948+0000 7f74fd941640 1 -- 172.21.15.113:0/3086243405 learned_addr learned my addr 172.21.15.113:0/3086243405 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd140640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74f80b7ea0 0x7f74f80c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fc93f640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74f80d0c60 0x7f74f81410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd941640 1 -- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74f80b7ea0 msgr2=0x7f74f80c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd941640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74f80b7ea0 0x7f74f80c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd941640 1 -- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74f80d0c60 msgr2=0x7f74f81410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:37.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd941640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74f80d0c60 0x7f74f81410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd941640 1 -- 172.21.15.113:0/3086243405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40094d0 con 0x7f74f8146e30 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fc93f640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74f80d0c60 0x7f74f81410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd140640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74f80b7ea0 0x7f74f80c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fd941640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80ce370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f74f000b970 tx=0x7f74f000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74e9ffb640 1 -- 172.21.15.113:0/3086243405 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f000cb40 con 0x7f74f8146e30 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74e9ffb640 1 -- 172.21.15.113:0/3086243405 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f000ccc0 con 0x7f74f8146e30 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74e9ffb640 1 -- 172.21.15.113:0/3086243405 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0014680 con 0x7f74f8146e30 2023-12-19T13:47:37.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.949+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f80c8f60 con 0x7f74f8146e30 2023-12-19T13:47:37.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.950+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f81408c0 con 0x7f74f8146e30 2023-12-19T13:47:37.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.951+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f8140de0 con 0x7f74f8146e30 2023-12-19T13:47:37.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.952+0000 7f74e9ffb640 1 -- 172.21.15.113:0/3086243405 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f74f001d3b0 con 0x7f74f8146e30 2023-12-19T13:47:37.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.952+0000 7f74e9ffb640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f74dc06a430 0x7f74dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:37.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.953+0000 7f74e9ffb640 1 -- 172.21.15.113:0/3086243405 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f74f0088570 con 0x7f74f8146e30 2023-12-19T13:47:37.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.953+0000 7f74fd140640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f74dc06a430 0x7f74dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:37.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.953+0000 7f74fd140640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f74dc06a430 0x7f74dc06c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f74f4036000 tx=0x7f74f403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:37.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:37.957+0000 7f74e9ffb640 1 -- 172.21.15.113:0/3086243405 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f74f8140de0 con 0x7f74f8146e30 2023-12-19T13:47:38.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.202+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f74f8140de0 con 0x7f74f8146e30 2023-12-19T13:47:38.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.210+0000 7f74e9ffb640 1 -- 172.21.15.113:0/3086243405 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f74f8140de0 con 0x7f74f8146e30 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f74dc06a430 msgr2=0x7f74dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f74dc06a430 0x7f74dc06c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f74f4036000 tx=0x7f74f403d040 comp rx=0 tx=0).stop 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 msgr2=0x7f74f80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80ce370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f74f000b970 tx=0x7f74f000be30 comp rx=0 tx=0).stop 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 shutdown_connections 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f74dc06a430 0x7f74dc06c8f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74f8146e30 0x7f74f80ce370 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74f80d0c60 0x7f74f81410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 --2- 172.21.15.113:0/3086243405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74f80b7ea0 0x7f74f80c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 >> 172.21.15.113:0/3086243405 conn(0x7f74f80b2990 msgr2=0x7f74f8144530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 shutdown_connections 2023-12-19T13:47:38.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.213+0000 7f74fe142640 1 -- 172.21.15.113:0/3086243405 wait complete. 2023-12-19T13:47:38.232 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T13:47:38.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.446+0000 7fb67f59e640 1 Processor -- start 2023-12-19T13:47:38.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.446+0000 7fb67f59e640 1 -- start start 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67f59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb680159f80 0x7fb68006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67f59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb68015aa70 0x7fb68015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67f59e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68006b520 con 0x7fb68015b1e0 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67f59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6800b2b20 con 0x7fb68015aa70 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67f59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6800b2fb0 con 0x7fb680159f80 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67dd9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb68015b1e0 0x7fb68015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48426/0 (socket says 172.21.15.113:48426) 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67ed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb68015aa70 0x7fb68015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.448+0000 7fb67dd9b640 1 -- 172.21.15.113:0/627104112 learned_addr learned my addr 172.21.15.113:0/627104112 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:38.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.449+0000 7fb67e59c640 1 --2- 172.21.15.113:0/627104112 >> v2:172.21.15.151:3300/0 conn(0x7fb680159f80 0x7fb68006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.449+0000 7fb67ed9d640 1 -- 172.21.15.113:0/627104112 >> v2:172.21.15.151:3300/0 conn(0x7fb680159f80 msgr2=0x7fb68006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.449+0000 7fb67ed9d640 1 --2- 172.21.15.113:0/627104112 >> v2:172.21.15.151:3300/0 conn(0x7fb680159f80 0x7fb68006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.449+0000 7fb67ed9d640 1 -- 172.21.15.113:0/627104112 >> v1:172.21.15.113:6789/0 conn(0x7fb68015b1e0 legacy=0x7fb68015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.449+0000 7fb67d59a640 1 -- 172.21.15.113:0/627104112 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719938047 0 0) 0x7fb68006b520 con 0x7fb68015b1e0 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.449+0000 7fb67ed9d640 1 -- 172.21.15.113:0/627104112 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800b1f10 con 0x7fb68015aa70 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.449+0000 7fb67e59c640 1 --2- 172.21.15.113:0/627104112 >> v2:172.21.15.151:3300/0 conn(0x7fb680159f80 0x7fb68006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.450+0000 7fb67ed9d640 1 --2- 172.21.15.113:0/627104112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb68015aa70 0x7fb68015b770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6800b3230 tx=0x7fb67802e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e405a3dacc93733 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.450+0000 7fb67d59a640 1 -- 172.21.15.113:0/627104112 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678036440 con 0x7fb68015aa70 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.450+0000 7fb67d59a640 1 -- 172.21.15.113:0/627104112 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6780365a0 con 0x7fb68015aa70 2023-12-19T13:47:38.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.450+0000 7fb67d59a640 1 -- 172.21.15.113:0/627104112 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678036930 con 0x7fb68015aa70 2023-12-19T13:47:38.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.450+0000 7fb67f59e640 1 -- 172.21.15.113:0/627104112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb68015aa70 msgr2=0x7fb68015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.450+0000 7fb67f59e640 1 --2- 172.21.15.113:0/627104112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb68015aa70 0x7fb68015b770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6800b3230 tx=0x7fb67802e160 comp rx=0 tx=0).stop 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.451+0000 7fb67f59e640 1 -- 172.21.15.113:0/627104112 shutdown_connections 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.451+0000 7fb67f59e640 1 --2- 172.21.15.113:0/627104112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb68015aa70 0x7fb68015b770 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.451+0000 7fb67f59e640 1 --2- 172.21.15.113:0/627104112 >> v2:172.21.15.151:3300/0 conn(0x7fb680159f80 0x7fb68006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.451+0000 7fb67f59e640 1 -- 172.21.15.113:0/627104112 >> 172.21.15.113:0/627104112 conn(0x7fb6800b0100 msgr2=0x7fb6800b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.451+0000 7fb67f59e640 1 -- 172.21.15.113:0/627104112 shutdown_connections 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.451+0000 7fb67f59e640 1 -- 172.21.15.113:0/627104112 wait complete. 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.452+0000 7fb67f59e640 1 Processor -- start 2023-12-19T13:47:38.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.452+0000 7fb67f59e640 1 -- start start 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.453+0000 7fb67f59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb680159f80 0x7fb680141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.453+0000 7fb67f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb68015aa70 0x7fb680148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb68015b1e0 0x7fb6800ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67f59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb680149f40 con 0x7fb680159f80 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb680149330 con 0x7fb68015b1e0 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb680149610 con 0x7fb68015aa70 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb680159f80 0x7fb680141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb680159f80 0x7fb680141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50526/0 (socket says 172.21.15.113:50526) 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 -- 172.21.15.113:0/565884215 learned_addr learned my addr 172.21.15.113:0/565884215 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 -- 172.21.15.113:0/565884215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb68015aa70 msgr2=0x7fb680148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb68015aa70 0x7fb680148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 -- 172.21.15.113:0/565884215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb68015b1e0 msgr2=0x7fb6800ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb68015b1e0 0x7fb6800ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 -- 172.21.15.113:0/565884215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb678009a70 con 0x7fb680159f80 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.454+0000 7fb67e59c640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb680159f80 0x7fb680141a50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c7f0 tx=0x7fb67000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.455+0000 7fb66effd640 1 -- 172.21.15.113:0/565884215 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670007a30 con 0x7fb680159f80 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.455+0000 7fb66effd640 1 -- 172.21.15.113:0/565884215 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670007b90 con 0x7fb680159f80 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.455+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6801498f0 con 0x7fb680159f80 2023-12-19T13:47:38.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.455+0000 7fb66effd640 1 -- 172.21.15.113:0/565884215 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000ce40 con 0x7fb680159f80 2023-12-19T13:47:38.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.455+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb680141f90 con 0x7fb680159f80 2023-12-19T13:47:38.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.456+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb680061910 con 0x7fb680159f80 2023-12-19T13:47:38.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.457+0000 7fb66effd640 1 -- 172.21.15.113:0/565884215 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb6700113f0 con 0x7fb680159f80 2023-12-19T13:47:38.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.457+0000 7fb66effd640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb66006a430 0x7fb66006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.458+0000 7fb66effd640 1 -- 172.21.15.113:0/565884215 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb670088830 con 0x7fb680159f80 2023-12-19T13:47:38.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.458+0000 7fb67dd9b640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb66006a430 0x7fb66006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.458+0000 7fb67dd9b640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb66006a430 0x7fb66006c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb674007fd0 tx=0x7fb674007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:38.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.462+0000 7fb66effd640 1 -- 172.21.15.113:0/565884215 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb6700540d0 con 0x7fb680159f80 2023-12-19T13:47:38.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.718+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb6800b0f70 con 0x7fb680159f80 2023-12-19T13:47:38.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.726+0000 7fb66effd640 1 -- 172.21.15.113:0/565884215 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb6700576f0 con 0x7fb680159f80 2023-12-19T13:47:38.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb66006a430 msgr2=0x7fb66006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb66006a430 0x7fb66006c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb674007fd0 tx=0x7fb674007960 comp rx=0 tx=0).stop 2023-12-19T13:47:38.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb680159f80 msgr2=0x7fb680141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb680159f80 0x7fb680141a50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c7f0 tx=0x7fb67000cbf0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 shutdown_connections 2023-12-19T13:47:38.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb66006a430 0x7fb66006c8f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb68015b1e0 0x7fb6800ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb68015aa70 0x7fb680148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 --2- 172.21.15.113:0/565884215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb680159f80 0x7fb680141a50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.728+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 >> 172.21.15.113:0/565884215 conn(0x7fb6800b0100 msgr2=0x7fb6800ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:38.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.729+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 shutdown_connections 2023-12-19T13:47:38.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.729+0000 7fb67f59e640 1 -- 172.21.15.113:0/565884215 wait complete. 2023-12-19T13:47:38.747 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T13:47:38.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.953+0000 7fd05f52e640 1 Processor -- start 2023-12-19T13:47:38.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.953+0000 7fd05f52e640 1 -- start start 2023-12-19T13:47:38.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05f52e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd058157aa0 0x7fd0580b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05f52e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05815e040 0x7fd05815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05f52e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05806e8c0 con 0x7fd05806e410 2023-12-19T13:47:38.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05f52e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05815e9c0 con 0x7fd058157aa0 2023-12-19T13:47:38.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05f52e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580b2600 con 0x7fd05815e040 2023-12-19T13:47:38.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05d2ca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd058157aa0 0x7fd0580b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05d2ca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd058157aa0 0x7fd0580b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50538/0 (socket says 172.21.15.113:50538) 2023-12-19T13:47:38.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.955+0000 7fd05d2ca640 1 -- 172.21.15.113:0/3679186807 learned_addr learned my addr 172.21.15.113:0/3679186807 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:38.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.956+0000 7fd05d2ca640 1 -- 172.21.15.113:0/3679186807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05815e040 msgr2=0x7fd05815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:38.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.956+0000 7fd05d2ca640 1 --2- 172.21.15.113:0/3679186807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05815e040 0x7fd05815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.956+0000 7fd05d2ca640 1 -- 172.21.15.113:0/3679186807 >> v1:172.21.15.151:6789/0 conn(0x7fd05806e410 legacy=0x7fd058161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:38.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.956+0000 7fd05d2ca640 1 -- 172.21.15.113:0/3679186807 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580b1d60 con 0x7fd058157aa0 2023-12-19T13:47:38.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.957+0000 7fd05d2ca640 1 --2- 172.21.15.113:0/3679186807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd058157aa0 0x7fd0580b1710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd054009870 tx=0x7fd05402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e8eba547ec40fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:38.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.957+0000 7fd04ffff640 1 -- 172.21.15.113:0/3679186807 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054031640 con 0x7fd058157aa0 2023-12-19T13:47:38.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.957+0000 7fd04ffff640 1 -- 172.21.15.113:0/3679186807 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0540317a0 con 0x7fd058157aa0 2023-12-19T13:47:38.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.957+0000 7fd04ffff640 1 -- 172.21.15.113:0/3679186807 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054031b30 con 0x7fd058157aa0 2023-12-19T13:47:38.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 -- 172.21.15.113:0/3679186807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd058157aa0 msgr2=0x7fd0580b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 --2- 172.21.15.113:0/3679186807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd058157aa0 0x7fd0580b1710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd054009870 tx=0x7fd05402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 -- 172.21.15.113:0/3679186807 shutdown_connections 2023-12-19T13:47:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 --2- 172.21.15.113:0/3679186807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05815e040 0x7fd05815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 --2- 172.21.15.113:0/3679186807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd058157aa0 0x7fd0580b1710 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 -- 172.21.15.113:0/3679186807 >> 172.21.15.113:0/3679186807 conn(0x7fd0580cbb70 msgr2=0x7fd0580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 -- 172.21.15.113:0/3679186807 shutdown_connections 2023-12-19T13:47:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.958+0000 7fd05f52e640 1 -- 172.21.15.113:0/3679186807 wait complete. 2023-12-19T13:47:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.959+0000 7fd05f52e640 1 Processor -- start 2023-12-19T13:47:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.960+0000 7fd05f52e640 1 -- start start 2023-12-19T13:47:38.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.960+0000 7fd05f52e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05806e410 0x7fd058158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.960+0000 7fd05f52e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd058157aa0 0x7fd0581537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05f52e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd05815e040 0x7fd058153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05f52e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580ad230 con 0x7fd05815e040 2023-12-19T13:47:38.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05f52e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd058160260 con 0x7fd058157aa0 2023-12-19T13:47:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05f52e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd058160540 con 0x7fd05806e410 2023-12-19T13:47:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd05815e040 0x7fd058153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd05815e040 0x7fd058153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50548/0 (socket says 172.21.15.113:50548) 2023-12-19T13:47:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 -- 172.21.15.113:0/349819308 learned_addr learned my addr 172.21.15.113:0/349819308 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05cac9640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd058157aa0 0x7fd0581537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05d2ca640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05806e410 0x7fd058158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 -- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05806e410 msgr2=0x7fd058158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05806e410 0x7fd058158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 -- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd058157aa0 msgr2=0x7fd0581537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd058157aa0 0x7fd0581537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.961+0000 7fd05dacb640 1 -- 172.21.15.113:0/349819308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540094d0 con 0x7fd05815e040 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.962+0000 7fd05dacb640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd05815e040 0x7fd058153d30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b970 tx=0x7fd05000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.962+0000 7fd04dffb640 1 -- 172.21.15.113:0/349819308 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000cb40 con 0x7fd05815e040 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.962+0000 7fd04dffb640 1 -- 172.21.15.113:0/349819308 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000ccc0 con 0x7fd05815e040 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.962+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0580ad480 con 0x7fd05815e040 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.962+0000 7fd04dffb640 1 -- 172.21.15.113:0/349819308 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050014680 con 0x7fd05815e040 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.962+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0581588d0 con 0x7fd05815e040 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.963+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0580ad9a0 con 0x7fd05815e040 2023-12-19T13:47:38.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.964+0000 7fd04dffb640 1 -- 172.21.15.113:0/349819308 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd05001d3b0 con 0x7fd05815e040 2023-12-19T13:47:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.965+0000 7fd04dffb640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd03c06a460 0x7fd03c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.965+0000 7fd04dffb640 1 -- 172.21.15.113:0/349819308 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0500884b0 con 0x7fd05815e040 2023-12-19T13:47:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.965+0000 7fd05d2ca640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd03c06a460 0x7fd03c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.966+0000 7fd05d2ca640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd03c06a460 0x7fd03c06c920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd054036000 tx=0x7fd05403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:38.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:38.969+0000 7fd04dffb640 1 -- 172.21.15.113:0/349819308 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0580ad9a0 con 0x7fd05815e040 2023-12-19T13:47:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.226+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd0580ad9a0 con 0x7fd05815e040 2023-12-19T13:47:39.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.234+0000 7fd04dffb640 1 -- 172.21.15.113:0/349819308 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd0580ad9a0 con 0x7fd05815e040 2023-12-19T13:47:39.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd03c06a460 msgr2=0x7fd03c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd03c06a460 0x7fd03c06c920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd054036000 tx=0x7fd05403c040 comp rx=0 tx=0).stop 2023-12-19T13:47:39.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd05815e040 msgr2=0x7fd058153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd05815e040 0x7fd058153d30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b970 tx=0x7fd05000be30 comp rx=0 tx=0).stop 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 shutdown_connections 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd03c06a460 0x7fd03c06c920 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd05815e040 0x7fd058153d30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd058157aa0 0x7fd0581537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 --2- 172.21.15.113:0/349819308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd05806e410 0x7fd058158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.237+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 >> 172.21.15.113:0/349819308 conn(0x7fd0580cbb70 msgr2=0x7fd0580cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.238+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 shutdown_connections 2023-12-19T13:47:39.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.238+0000 7fd05f52e640 1 -- 172.21.15.113:0/349819308 wait complete. 2023-12-19T13:47:39.256 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T13:47:39.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.458+0000 7f6412a10640 1 Processor -- start 2023-12-19T13:47:39.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.459+0000 7f6412a10640 1 -- start start 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6412a10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 0x7f640c0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6412a10640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f640c0ce1e0 0x7f640c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6412a10640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0ce9d0 con 0x7f640c0d01b0 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6412a10640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0ce6f0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6412a10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c15dcc0 con 0x7f640c15e7a0 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6410fad640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f640c0ce1e0 0x7f640c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6410fad640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f640c0ce1e0 0x7f640c15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50562/0 (socket says 172.21.15.113:50562) 2023-12-19T13:47:39.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6410fad640 1 -- 172.21.15.113:0/663759151 learned_addr learned my addr 172.21.15.113:0/663759151 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:39.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f640bfff640 1 --1- 172.21.15.113:0/663759151 >> v1:172.21.15.113:6789/0 conn(0x7f640c0d01b0 0x7f640c0d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48440/0 (socket says 172.21.15.113:48440) 2023-12-19T13:47:39.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6410fad640 1 -- 172.21.15.113:0/663759151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 msgr2=0x7f640c0cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:39.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6410fad640 1 --2- 172.21.15.113:0/663759151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 0x7f640c0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6410fad640 1 -- 172.21.15.113:0/663759151 >> v1:172.21.15.113:6789/0 conn(0x7f640c0d01b0 legacy=0x7f640c0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.460+0000 7f6410fad640 1 -- 172.21.15.113:0/663759151 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c15dfa0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.461+0000 7f6410fad640 1 --2- 172.21.15.113:0/663759151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c15efa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6404009e50 tx=0x7f640402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3bd54fc5765a10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f640b7fe640 1 -- 172.21.15.113:0/663759151 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640402cb00 con 0x7f640c0ce1e0 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f640b7fe640 1 -- 172.21.15.113:0/663759151 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640402cc60 con 0x7f640c0ce1e0 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f640b7fe640 1 -- 172.21.15.113:0/663759151 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64040343f0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f6412a10640 1 -- 172.21.15.113:0/663759151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 msgr2=0x7f640c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f6412a10640 1 --2- 172.21.15.113:0/663759151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c15efa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6404009e50 tx=0x7f640402bf60 comp rx=0 tx=0).stop 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f6412a10640 1 -- 172.21.15.113:0/663759151 shutdown_connections 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f6412a10640 1 --2- 172.21.15.113:0/663759151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c15efa0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f6412a10640 1 --2- 172.21.15.113:0/663759151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 0x7f640c0cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f6412a10640 1 -- 172.21.15.113:0/663759151 >> 172.21.15.113:0/663759151 conn(0x7f640c0b27a0 msgr2=0x7f640c0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:39.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.462+0000 7f6412a10640 1 -- 172.21.15.113:0/663759151 shutdown_connections 2023-12-19T13:47:39.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.463+0000 7f6412a10640 1 -- 172.21.15.113:0/663759151 wait complete. 2023-12-19T13:47:39.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.464+0000 7f6412a10640 1 Processor -- start 2023-12-19T13:47:39.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.464+0000 7f6412a10640 1 -- start start 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f6412a10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f6412a10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f640c0d01b0 0x7f640c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f6412a10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 0x7f640c144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f6412a10640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c151840 con 0x7f640c0ce1e0 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f6412a10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c151a70 con 0x7f640c0d01b0 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f6412a10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c151d50 con 0x7f640c15e7a0 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f640bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f640bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c0b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50566/0 (socket says 172.21.15.113:50566) 2023-12-19T13:47:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.465+0000 7f640bfff640 1 -- 172.21.15.113:0/2997138546 learned_addr learned my addr 172.21.15.113:0/2997138546 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f640bfff640 1 -- 172.21.15.113:0/2997138546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 msgr2=0x7f640c144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f640bfff640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 0x7f640c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f640bfff640 1 -- 172.21.15.113:0/2997138546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f640c0d01b0 msgr2=0x7f640c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f640bfff640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f640c0d01b0 0x7f640c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f640bfff640 1 -- 172.21.15.113:0/2997138546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404009b30 con 0x7f640c0ce1e0 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f640bfff640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c0b7680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00c4d0 tx=0x7f63fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f64097fa640 1 -- 172.21.15.113:0/2997138546 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc007480 con 0x7f640c0ce1e0 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f64097fa640 1 -- 172.21.15.113:0/2997138546 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc0075e0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c152030 con 0x7f640c0ce1e0 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f64097fa640 1 -- 172.21.15.113:0/2997138546 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0049e0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.466+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c1525f0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.468+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c1527e0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.468+0000 7f64097fa640 1 -- 172.21.15.113:0/2997138546 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f63fc004b40 con 0x7f640c0ce1e0 2023-12-19T13:47:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.469+0000 7f64097fa640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63ec06a460 0x7f63ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.469+0000 7f64097fa640 1 -- 172.21.15.113:0/2997138546 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63fc087bd0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.469+0000 7f6403fff640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63ec06a460 0x7f63ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.470+0000 7f6403fff640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63ec06a460 0x7f63ec06c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f640c1f6d80 tx=0x7f63f4006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.474+0000 7f64097fa640 1 -- 172.21.15.113:0/2997138546 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f63fc053480 con 0x7f640c0ce1e0 2023-12-19T13:47:39.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.731+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f640c061910 con 0x7f640c0ce1e0 2023-12-19T13:47:39.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.740+0000 7f64097fa640 1 -- 172.21.15.113:0/2997138546 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f63fc056aa0 con 0x7f640c0ce1e0 2023-12-19T13:47:39.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63ec06a460 msgr2=0x7f63ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63ec06a460 0x7f63ec06c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f640c1f6d80 tx=0x7f63f4006bf0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 msgr2=0x7f640c0b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c0b7680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00c4d0 tx=0x7f63fc00c990 comp rx=0 tx=0).stop 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 shutdown_connections 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63ec06a460 0x7f63ec06c920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f640c15e7a0 0x7f640c144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f640c0d01b0 0x7f640c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 --2- 172.21.15.113:0/2997138546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f640c0ce1e0 0x7f640c0b7680 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.742+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 >> 172.21.15.113:0/2997138546 conn(0x7f640c0b27a0 msgr2=0x7f640c15c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.743+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 shutdown_connections 2023-12-19T13:47:39.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.743+0000 7f6412a10640 1 -- 172.21.15.113:0/2997138546 wait complete. 2023-12-19T13:47:39.760 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.967+0000 7f9283677640 1 Processor -- start 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.968+0000 7f9283677640 1 -- start start 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.969+0000 7f9283677640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 0x7f927c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.969+0000 7f9283677640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f927c06c6b0 0x7f927c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.969+0000 7f9283677640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927c0afb10 con 0x7f927c0b0b50 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.969+0000 7f9283677640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c06bb30 con 0x7f927c06c6b0 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.969+0000 7f9283677640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0b0070 con 0x7f927c1449e0 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.969+0000 7f9280c12640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f927c0b0b50 0x7f927c06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48448/0 (socket says 172.21.15.113:48448) 2023-12-19T13:47:39.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.969+0000 7f9280c12640 1 -- 172.21.15.113:0/3155159468 learned_addr learned my addr 172.21.15.113:0/3155159468 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:39.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9281c14640 1 --2- 172.21.15.113:0/3155159468 >> v2:172.21.15.151:3300/0 conn(0x7f927c06c6b0 0x7f927c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193341379 0 0) 0x7f927c0afb10 con 0x7f927c0b0b50 2023-12-19T13:47:39.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9268003520 con 0x7f927c0b0b50 2023-12-19T13:47:39.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9281413640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 0x7f927c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373785374 0 0) 0x7f9268003520 con 0x7f927c0b0b50 2023-12-19T13:47:39.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 msgr2=0x7f927c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:39.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 0x7f927c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 >> v2:172.21.15.151:3300/0 conn(0x7f927c06c6b0 msgr2=0x7f927c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 --2- 172.21.15.113:0/3155159468 >> v2:172.21.15.151:3300/0 conn(0x7f927c06c6b0 0x7f927c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0b0350 con 0x7f927c0b0b50 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f926c001670 con 0x7f927c0b0b50 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 >> v1:172.21.15.113:6789/0 conn(0x7f927c0b0b50 legacy=0x7f927c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 0x7f92680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9268003f60 0x7f92680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9268004d00 0x7f9268005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c06bb30 con 0x7f9268004d00 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0b0070 con 0x7f9268003f60 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.970+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926800ba60 con 0x7f927c1449e0 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9281c14640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9268004d00 0x7f9268005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9281413640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 0x7f92680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9281c14640 1 -- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 msgr2=0x7f92680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9280c12640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9268003f60 0x7f92680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9281c14640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c1449e0 0x7f92680039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9281c14640 1 -- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9268003f60 msgr2=0x7f92680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9281c14640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9268003f60 0x7f92680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9281c14640 1 -- 172.21.15.113:0/3155159468 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268003520 con 0x7f9268004d00 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.971+0000 7f9280c12640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9268003f60 0x7f92680047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.972+0000 7f9281c14640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9268004d00 0x7f9268005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9274009fc0 tx=0x7f92680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27240bb8c2a7386 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.972+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927402cc60 con 0x7f9268004d00 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927400f040 con 0x7f9268004d00 2023-12-19T13:47:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9273fff640 1 -- 172.21.15.113:0/3155159468 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274034440 con 0x7f9268004d00 2023-12-19T13:47:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9283677640 1 -- 172.21.15.113:0/3155159468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9268004d00 msgr2=0x7f9268005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9283677640 1 --2- 172.21.15.113:0/3155159468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9268004d00 0x7f9268005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9274009fc0 tx=0x7f92680057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9281c14640 1 -- 172.21.15.113:0/3155159468 reap_dead start 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9283677640 1 -- 172.21.15.113:0/3155159468 shutdown_connections 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9283677640 1 -- 172.21.15.113:0/3155159468 >> 172.21.15.113:0/3155159468 conn(0x7f927c0cbb70 msgr2=0x7f927c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9283677640 1 -- 172.21.15.113:0/3155159468 shutdown_connections 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.973+0000 7f9283677640 1 -- 172.21.15.113:0/3155159468 wait complete. 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.975+0000 7f9283677640 1 Processor -- start 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.975+0000 7f9283677640 1 -- start start 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.976+0000 7f9283677640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c13f690 0x7f927c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.976+0000 7f9283677640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927c13fa70 0x7f927c1f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.976+0000 7f9283677640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f927c1f6510 0x7f927c1f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.976+0000 7f9283677640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0c2b90 con 0x7f927c1f6510 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.976+0000 7f9283677640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c1f2850 con 0x7f927c13fa70 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.976+0000 7f9283677640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c15c970 con 0x7f927c13f690 2023-12-19T13:47:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.976+0000 7f9281c14640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f927c1f6510 0x7f927c1f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f927c1f6510 0x7f927c1f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50580/0 (socket says 172.21.15.113:50580) 2023-12-19T13:47:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 -- 172.21.15.113:0/1753152219 learned_addr learned my addr 172.21.15.113:0/1753152219 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281413640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c13f690 0x7f927c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9280c12640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927c13fa70 0x7f927c1f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 -- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c13f690 msgr2=0x7f927c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c13f690 0x7f927c15c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 -- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927c13fa70 msgr2=0x7f927c1f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927c13fa70 0x7f927c1f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 -- 172.21.15.113:0/1753152219 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c15cc50 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9280c12640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927c13fa70 0x7f927c1f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.977+0000 7f9281c14640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f927c1f6510 0x7f927c1f6990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9274037040 tx=0x7f9274009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.978+0000 7f9271ffb640 1 -- 172.21.15.113:0/1753152219 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274034d50 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.978+0000 7f9271ffb640 1 -- 172.21.15.113:0/1753152219 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9274003990 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.978+0000 7f9271ffb640 1 -- 172.21.15.113:0/1753152219 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274003d40 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.978+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c15cf30 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.978+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c140100 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.979+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c15d450 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.980+0000 7f9271ffb640 1 -- 172.21.15.113:0/1753152219 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9274004030 con 0x7f927c1f6510 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.981+0000 7f9271ffb640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f926006a430 0x7f926006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.981+0000 7f9271ffb640 1 -- 172.21.15.113:0/1753152219 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92740a9b80 con 0x7f927c1f6510 2023-12-19T13:47:39.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.981+0000 7f9281413640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f926006a430 0x7f926006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:39.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.981+0000 7f9281413640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f926006a430 0x7f926006c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f927c0caec0 tx=0x7f9278008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:39.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:39.985+0000 7f9271ffb640 1 -- 172.21.15.113:0/1753152219 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9274075570 con 0x7f927c1f6510 2023-12-19T13:47:40.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.251+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f927c0d0020 con 0x7f927c1f6510 2023-12-19T13:47:40.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.258+0000 7f9271ffb640 1 -- 172.21.15.113:0/1753152219 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9274078b90 con 0x7f927c1f6510 2023-12-19T13:47:40.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f926006a430 msgr2=0x7f926006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f926006a430 0x7f926006c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f927c0caec0 tx=0x7f9278008040 comp rx=0 tx=0).stop 2023-12-19T13:47:40.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f927c1f6510 msgr2=0x7f927c1f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f927c1f6510 0x7f927c1f6990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9274037040 tx=0x7f9274009750 comp rx=0 tx=0).stop 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 shutdown_connections 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f926006a430 0x7f926006c8f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f927c1f6510 0x7f927c1f6990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927c13fa70 0x7f927c1f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 --2- 172.21.15.113:0/1753152219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f927c13f690 0x7f927c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.261+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 >> 172.21.15.113:0/1753152219 conn(0x7f927c0cbb70 msgr2=0x7f927c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.262+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 shutdown_connections 2023-12-19T13:47:40.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.262+0000 7f9283677640 1 -- 172.21.15.113:0/1753152219 wait complete. 2023-12-19T13:47:40.279 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T13:47:40.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.493+0000 7fe81cd5c640 1 Processor -- start 2023-12-19T13:47:40.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.494+0000 7fe81cd5c640 1 -- start start 2023-12-19T13:47:40.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.495+0000 7fe81cd5c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe81815da30 0x7fe8180b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.495+0000 7fe81cd5c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81815e1a0 con 0x7fe818161020 2023-12-19T13:47:40.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.495+0000 7fe81cd5c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81815e480 con 0x7fe8180b6900 2023-12-19T13:47:40.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.495+0000 7fe81cd5c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81815e760 con 0x7fe81815da30 2023-12-19T13:47:40.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.495+0000 7fe81659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe818161020 0x7fe818143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48452/0 (socket says 172.21.15.113:48452) 2023-12-19T13:47:40.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81659c640 1 -- 172.21.15.113:0/3902651931 learned_addr learned my addr 172.21.15.113:0/3902651931 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe815d9b640 1 --2- 172.21.15.113:0/3902651931 >> v2:172.21.15.151:3300/0 conn(0x7fe81815da30 0x7fe8180b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696373667 0 0) 0x7fe81815e1a0 con 0x7fe818161020 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe804003520 con 0x7fe818161020 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 572039632 0 0) 0x7fe804003520 con 0x7fe818161020 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 >> v2:172.21.15.151:3300/0 conn(0x7fe81815da30 msgr2=0x7fe8180b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 --2- 172.21.15.113:0/3902651931 >> v2:172.21.15.151:3300/0 conn(0x7fe81815da30 0x7fe8180b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 >> v1:172.21.15.151:6789/0 conn(0x7fe8180b6900 legacy=0x7fe8180b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818142d10 con 0x7fe818161020 2023-12-19T13:47:40.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe8080019f0 con 0x7fe818161020 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 >> v1:172.21.15.113:6789/0 conn(0x7fe818161020 legacy=0x7fe818143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.496+0000 7fe81559a640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe804003a30 0x7fe804003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81559a640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8040047c0 0x7fe804004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81559a640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8040051d0 0x7fe80400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81815e760 con 0x7fe804003a30 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80400c100 con 0x7fe8040047c0 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80400c2c0 con 0x7fe8040051d0 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81659c640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe804003a30 0x7fe804003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe815d9b640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8040047c0 0x7fe804004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81659c640 1 -- 172.21.15.113:0/3902651931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8040051d0 msgr2=0x7fe80400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81659c640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8040051d0 0x7fe80400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81659c640 1 -- 172.21.15.113:0/3902651931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8040047c0 msgr2=0x7fe804004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81659c640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8040047c0 0x7fe804004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe81659c640 1 -- 172.21.15.113:0/3902651931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804003520 con 0x7fe804003a30 2023-12-19T13:47:40.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.497+0000 7fe816d9d640 1 -- 172.21.15.113:0/3902651931 reap_dead start 2023-12-19T13:47:40.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.498+0000 7fe81659c640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe804003a30 0x7fe804003e50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe80800a760 tx=0x7fe8040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fbf9a063940077 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:40.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808034630 con 0x7fe804003a30 2023-12-19T13:47:40.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80802f070 con 0x7fe804003a30 2023-12-19T13:47:40.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81559a640 1 -- 172.21.15.113:0/3902651931 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808034a50 con 0x7fe804003a30 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81cd5c640 1 -- 172.21.15.113:0/3902651931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe804003a30 msgr2=0x7fe804003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe804003a30 0x7fe804003e50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe80800a760 tx=0x7fe8040057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81cd5c640 1 -- 172.21.15.113:0/3902651931 shutdown_connections 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/3902651931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe804003a30 0x7fe804003e50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81cd5c640 1 -- 172.21.15.113:0/3902651931 >> 172.21.15.113:0/3902651931 conn(0x7fe8180b26f0 msgr2=0x7fe8180b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81cd5c640 1 -- 172.21.15.113:0/3902651931 shutdown_connections 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.499+0000 7fe81cd5c640 1 -- 172.21.15.113:0/3902651931 wait complete. 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.501+0000 7fe81cd5c640 1 Processor -- start 2023-12-19T13:47:40.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.501+0000 7fe81cd5c640 1 -- start start 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.502+0000 7fe81cd5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe804003a30 0x7fe818143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.502+0000 7fe81cd5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8181450c0 0x7fe818145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.502+0000 7fe81cd5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe818141100 0x7fe818141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.502+0000 7fe81cd5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8181f2750 con 0x7fe8181450c0 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.502+0000 7fe81cd5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818154bc0 con 0x7fe818141100 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.502+0000 7fe81cd5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe818141ac0 con 0x7fe804003a30 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.502+0000 7fe815d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8181450c0 0x7fe818145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8181450c0 0x7fe818145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50594/0 (socket says 172.21.15.113:50594) 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 -- 172.21.15.113:0/964405550 learned_addr learned my addr 172.21.15.113:0/964405550 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe816d9d640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe818141100 0x7fe818141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 -- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe804003a30 msgr2=0x7fe818143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe804003a30 0x7fe818143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 -- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe818141100 msgr2=0x7fe818141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe818141100 0x7fe818141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 -- 172.21.15.113:0/964405550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8181438c0 con 0x7fe8181450c0 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe816d9d640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe818141100 0x7fe818141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe815d9b640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8181450c0 0x7fe818145c70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8000116d0 tx=0x7fe800011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.503+0000 7fe80effd640 1 -- 172.21.15.113:0/964405550 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000f9c0 con 0x7fe8181450c0 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.504+0000 7fe80effd640 1 -- 172.21.15.113:0/964405550 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80000fb20 con 0x7fe8181450c0 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.504+0000 7fe80effd640 1 -- 172.21.15.113:0/964405550 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000fe90 con 0x7fe8181450c0 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.504+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe818143ba0 con 0x7fe8181450c0 2023-12-19T13:47:40.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.504+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe818144160 con 0x7fe8181450c0 2023-12-19T13:47:40.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.505+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe818061910 con 0x7fe8181450c0 2023-12-19T13:47:40.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.506+0000 7fe80effd640 1 -- 172.21.15.113:0/964405550 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe800015460 con 0x7fe8181450c0 2023-12-19T13:47:40.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.507+0000 7fe80effd640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7f806a460 0x7fe7f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.507+0000 7fe80effd640 1 -- 172.21.15.113:0/964405550 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe800088a20 con 0x7fe8181450c0 2023-12-19T13:47:40.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.507+0000 7fe81659c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7f806a460 0x7fe7f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.508+0000 7fe81659c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7f806a460 0x7fe7f806c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe808034000 tx=0x7fe808009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:40.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.511+0000 7fe80effd640 1 -- 172.21.15.113:0/964405550 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe800054410 con 0x7fe8181450c0 2023-12-19T13:47:40.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.763+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe8180b2b70 con 0x7fe8181450c0 2023-12-19T13:47:40.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.771+0000 7fe80effd640 1 -- 172.21.15.113:0/964405550 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe800057a30 con 0x7fe8181450c0 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7f806a460 msgr2=0x7fe7f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7f806a460 0x7fe7f806c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe808034000 tx=0x7fe808009030 comp rx=0 tx=0).stop 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8181450c0 msgr2=0x7fe818145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8181450c0 0x7fe818145c70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8000116d0 tx=0x7fe800011b90 comp rx=0 tx=0).stop 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 shutdown_connections 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe7f806a460 0x7fe7f806c920 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe818141100 0x7fe818141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8181450c0 0x7fe818145c70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 --2- 172.21.15.113:0/964405550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe804003a30 0x7fe818143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 >> 172.21.15.113:0/964405550 conn(0x7fe8180b26f0 msgr2=0x7fe8180d3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:40.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.774+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 shutdown_connections 2023-12-19T13:47:40.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.775+0000 7fe81cd5c640 1 -- 172.21.15.113:0/964405550 wait complete. 2023-12-19T13:47:40.792 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:40.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.991+0000 7f8f9a3c9640 1 Processor -- start 2023-12-19T13:47:40.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.991+0000 7f8f9a3c9640 1 -- start start 2023-12-19T13:47:40.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f9a3c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 0x7f8f940af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f9a3c9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8f9406c6b0 0x7f8f940b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f9a3c9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f940afb10 con 0x7f8f940b0b50 2023-12-19T13:47:40.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f9a3c9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9406bb30 con 0x7f8f9406c6b0 2023-12-19T13:47:40.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f9a3c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940b0070 con 0x7f8f941449e0 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f98966640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8f9406c6b0 0x7f8f940b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f98966640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8f9406c6b0 0x7f8f940b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50600/0 (socket says 172.21.15.113:50600) 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f98966640 1 -- 172.21.15.113:0/4056533147 learned_addr learned my addr 172.21.15.113:0/4056533147 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.993+0000 7f8f93fff640 1 --2- 172.21.15.113:0/4056533147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 0x7f8f940af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.994+0000 7f8f98966640 1 -- 172.21.15.113:0/4056533147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 msgr2=0x7f8f940af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.994+0000 7f8f98966640 1 --2- 172.21.15.113:0/4056533147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 0x7f8f940af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.994+0000 7f8f98966640 1 -- 172.21.15.113:0/4056533147 >> v1:172.21.15.151:6789/0 conn(0x7f8f940b0b50 legacy=0x7f8f9406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:40.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.994+0000 7f8f98966640 1 -- 172.21.15.113:0/4056533147 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f940b0350 con 0x7f8f9406c6b0 2023-12-19T13:47:40.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.995+0000 7f8f98966640 1 --2- 172.21.15.113:0/4056533147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f940b1710 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009e50 tx=0x7f8f8c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6cae374a9182cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:40.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.995+0000 7f8f92ffd640 1 -- 172.21.15.113:0/4056533147 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c02ca70 con 0x7f8f9406c6b0 2023-12-19T13:47:40.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.995+0000 7f8f92ffd640 1 -- 172.21.15.113:0/4056533147 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c02cbd0 con 0x7f8f9406c6b0 2023-12-19T13:47:40.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.995+0000 7f8f92ffd640 1 -- 172.21.15.113:0/4056533147 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0343f0 con 0x7f8f9406c6b0 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/4056533147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 msgr2=0x7f8f940b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/4056533147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f940b1710 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009e50 tx=0x7f8f8c02bed0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/4056533147 shutdown_connections 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/4056533147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f940b1710 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/4056533147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 0x7f8f940af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/4056533147 >> 172.21.15.113:0/4056533147 conn(0x7f8f940cbb70 msgr2=0x7f8f940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/4056533147 shutdown_connections 2023-12-19T13:47:40.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.996+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/4056533147 wait complete. 2023-12-19T13:47:40.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.998+0000 7f8f9a3c9640 1 Processor -- start 2023-12-19T13:47:40.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.998+0000 7f8f9a3c9640 1 -- start start 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f9a3c9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f9415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f9a3c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f940b0b50 0x7f8f940ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f9a3c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 0x7f8f940ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f9a3c9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940ad520 con 0x7f8f9406c6b0 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f9a3c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9413ea50 con 0x7f8f940b0b50 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f9a3c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940acc80 con 0x7f8f941449e0 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f9415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:40.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f9415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50614/0 (socket says 172.21.15.113:50614) 2023-12-19T13:47:41.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 -- 172.21.15.113:0/3096501966 learned_addr learned my addr 172.21.15.113:0/3096501966 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:41.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 -- 172.21.15.113:0/3096501966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 msgr2=0x7f8f940ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 0x7f8f940ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 -- 172.21.15.113:0/3096501966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f940b0b50 msgr2=0x7f8f940ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f940b0b50 0x7f8f940ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:40.999+0000 7f8f93fff640 1 -- 172.21.15.113:0/3096501966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c009b30 con 0x7f8f9406c6b0 2023-12-19T13:47:41.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.000+0000 7f8f93fff640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f9415aab0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400d5f0 tx=0x7f8f8400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.000+0000 7f8f90ff9640 1 -- 172.21.15.113:0/3096501966 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840125f0 con 0x7f8f9406c6b0 2023-12-19T13:47:41.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.000+0000 7f8f90ff9640 1 -- 172.21.15.113:0/3096501966 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f84012750 con 0x7f8f9406c6b0 2023-12-19T13:47:41.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.000+0000 7f8f90ff9640 1 -- 172.21.15.113:0/3096501966 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84012ae0 con 0x7f8f9406c6b0 2023-12-19T13:47:41.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.000+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f940acf60 con 0x7f8f9406c6b0 2023-12-19T13:47:41.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.000+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f940a8640 con 0x7f8f9406c6b0 2023-12-19T13:47:41.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.001+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f940a8800 con 0x7f8f9406c6b0 2023-12-19T13:47:41.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.002+0000 7f8f90ff9640 1 -- 172.21.15.113:0/3096501966 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f84012c40 con 0x7f8f9406c6b0 2023-12-19T13:47:41.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.003+0000 7f8f90ff9640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f8006a430 0x7f8f8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.003+0000 7f8f90ff9640 1 -- 172.21.15.113:0/3096501966 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8f84088af0 con 0x7f8f9406c6b0 2023-12-19T13:47:41.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.003+0000 7f8f937fe640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f8006a430 0x7f8f8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.004+0000 7f8f937fe640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f8006a430 0x7f8f8006c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f941431d0 tx=0x7f8f880079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.007+0000 7f8f90ff9640 1 -- 172.21.15.113:0/3096501966 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f84054390 con 0x7f8f9406c6b0 2023-12-19T13:47:41.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.195+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f940a84a0 con 0x7f8f9406c6b0 2023-12-19T13:47:41.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.197+0000 7f8f90ff9640 1 -- 172.21.15.113:0/3096501966 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12437 (secure 0 0 0) 0x7f8f940a84a0 con 0x7f8f9406c6b0 2023-12-19T13:47:41.197 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:41.198 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":30,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:37.185263+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:41.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.200+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f8006a430 msgr2=0x7f8f8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.200+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f8006a430 0x7f8f8006c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f941431d0 tx=0x7f8f880079b0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.200+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 msgr2=0x7f8f9415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.200+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f9415aab0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400d5f0 tx=0x7f8f8400dab0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.200+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 shutdown_connections 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.201+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f8006a430 0x7f8f8006c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.201+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f941449e0 0x7f8f940ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.201+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f940b0b50 0x7f8f940ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.201+0000 7f8f9a3c9640 1 --2- 172.21.15.113:0/3096501966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f9406c6b0 0x7f8f9415aab0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.201+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 >> 172.21.15.113:0/3096501966 conn(0x7f8f940cbb70 msgr2=0x7f8f9406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.201+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 shutdown_connections 2023-12-19T13:47:41.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.201+0000 7f8f9a3c9640 1 -- 172.21.15.113:0/3096501966 wait complete. 2023-12-19T13:47:41.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:47:41.221 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:47:41.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.437+0000 7fbb65118640 1 Processor -- start 2023-12-19T13:47:41.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.438+0000 7fbb65118640 1 -- start start 2023-12-19T13:47:41.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.439+0000 7fbb65118640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbb60146ff0 0x7fbb600d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.439+0000 7fbb65118640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.439+0000 7fbb65118640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb60161e70 con 0x7fbb600b6430 2023-12-19T13:47:41.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.439+0000 7fbb65118640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb60161080 con 0x7fbb60146ff0 2023-12-19T13:47:41.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.439+0000 7fbb65118640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb60161260 con 0x7fbb6006fc40 2023-12-19T13:47:41.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:38622/0 (socket says 172.21.15.113:38622) 2023-12-19T13:47:41.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5f59e640 1 -- 172.21.15.113:0/2868036328 learned_addr learned my addr 172.21.15.113:0/2868036328 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:41.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5ed9d640 1 --2- 172.21.15.113:0/2868036328 >> v2:172.21.15.151:3300/0 conn(0x7fbb60146ff0 0x7fbb600d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5f59e640 1 -- 172.21.15.113:0/2868036328 >> v2:172.21.15.151:3300/0 conn(0x7fbb60146ff0 msgr2=0x7fbb600d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:41.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5f59e640 1 --2- 172.21.15.113:0/2868036328 >> v2:172.21.15.151:3300/0 conn(0x7fbb60146ff0 0x7fbb600d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5f59e640 1 -- 172.21.15.113:0/2868036328 >> v1:172.21.15.151:6789/0 conn(0x7fbb600b6430 legacy=0x7fbb6006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.440+0000 7fbb5f59e640 1 -- 172.21.15.113:0/2868036328 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60161540 con 0x7fbb6006fc40 2023-12-19T13:47:41.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.442+0000 7fbb5f59e640 1 --2- 172.21.15.113:0/2868036328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015dd40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009870 tx=0x7fbb5802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d82f08fe9193b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.442+0000 7fbb5dd9b640 1 -- 172.21.15.113:0/2868036328 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58030840 con 0x7fbb6006fc40 2023-12-19T13:47:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.442+0000 7fbb5dd9b640 1 -- 172.21.15.113:0/2868036328 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb580309a0 con 0x7fbb6006fc40 2023-12-19T13:47:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.442+0000 7fbb5dd9b640 1 -- 172.21.15.113:0/2868036328 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58030d30 con 0x7fbb6006fc40 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 -- 172.21.15.113:0/2868036328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 msgr2=0x7fbb6015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 --2- 172.21.15.113:0/2868036328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015dd40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009870 tx=0x7fbb5802b980 comp rx=0 tx=0).stop 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 -- 172.21.15.113:0/2868036328 shutdown_connections 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 --2- 172.21.15.113:0/2868036328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015dd40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 --2- 172.21.15.113:0/2868036328 >> v2:172.21.15.151:3300/0 conn(0x7fbb60146ff0 0x7fbb600d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 -- 172.21.15.113:0/2868036328 >> 172.21.15.113:0/2868036328 conn(0x7fbb600d3520 msgr2=0x7fbb600d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 -- 172.21.15.113:0/2868036328 shutdown_connections 2023-12-19T13:47:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.443+0000 7fbb65118640 1 -- 172.21.15.113:0/2868036328 wait complete. 2023-12-19T13:47:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.445+0000 7fbb65118640 1 Processor -- start 2023-12-19T13:47:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.445+0000 7fbb65118640 1 -- start start 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb65118640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb65118640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb600b6430 0x7fbb600ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb65118640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60146ff0 0x7fbb600b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb65118640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6015d2f0 con 0x7fbb600b6430 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb65118640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c8540 con 0x7fbb60146ff0 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb65118640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c8820 con 0x7fbb6006fc40 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb5e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb600b6430 0x7fbb600ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb5e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb600b6430 0x7fbb600ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50626/0 (socket says 172.21.15.113:50626) 2023-12-19T13:47:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.446+0000 7fbb5e59c640 1 -- 172.21.15.113:0/850967768 learned_addr learned my addr 172.21.15.113:0/850967768 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5f59e640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60146ff0 0x7fbb600b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5ed9d640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5e59c640 1 -- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 msgr2=0x7fbb6015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5e59c640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5e59c640 1 -- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60146ff0 msgr2=0x7fbb600b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5e59c640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60146ff0 0x7fbb600b7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5e59c640 1 -- 172.21.15.113:0/850967768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580094d0 con 0x7fbb600b6430 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5ed9d640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb5e59c640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb600b6430 0x7fbb600ca7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c7a0 tx=0x7fbb5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb577fe640 1 -- 172.21.15.113:0/850967768 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50003b70 con 0x7fbb600b6430 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb577fe640 1 -- 172.21.15.113:0/850967768 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50003cd0 con 0x7fbb600b6430 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb600c8b00 con 0x7fbb600b6430 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.447+0000 7fbb577fe640 1 -- 172.21.15.113:0/850967768 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000aa90 con 0x7fbb600b6430 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.448+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb600c90c0 con 0x7fbb600b6430 2023-12-19T13:47:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.449+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb60061910 con 0x7fbb600b6430 2023-12-19T13:47:41.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.449+0000 7fbb577fe640 1 -- 172.21.15.113:0/850967768 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb5000abf0 con 0x7fbb600b6430 2023-12-19T13:47:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.451+0000 7fbb577fe640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbb4006a460 0x7fbb4006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.451+0000 7fbb577fe640 1 -- 172.21.15.113:0/850967768 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb50088430 con 0x7fbb600b6430 2023-12-19T13:47:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.451+0000 7fbb5ed9d640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbb4006a460 0x7fbb4006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.452+0000 7fbb5ed9d640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbb4006a460 0x7fbb4006c920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009ac0 tx=0x7fbb48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.455+0000 7fbb577fe640 1 -- 172.21.15.113:0/850967768 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb50053e20 con 0x7fbb600b6430 2023-12-19T13:47:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.643+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb6015de40 con 0x7fbb600b6430 2023-12-19T13:47:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.644+0000 7fbb577fe640 1 -- 172.21.15.113:0/850967768 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb50057440 con 0x7fbb600b6430 2023-12-19T13:47:41.644 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:47:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbb4006a460 msgr2=0x7fbb4006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbb4006a460 0x7fbb4006c920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009ac0 tx=0x7fbb48008040 comp rx=0 tx=0).stop 2023-12-19T13:47:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb600b6430 msgr2=0x7fbb600ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb600b6430 0x7fbb600ca7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c7a0 tx=0x7fbb5000cc60 comp rx=0 tx=0).stop 2023-12-19T13:47:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 shutdown_connections 2023-12-19T13:47:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbb4006a460 0x7fbb4006c920 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60146ff0 0x7fbb600b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb600b6430 0x7fbb600ca7e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 --2- 172.21.15.113:0/850967768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6006fc40 0x7fbb6015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.647+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 >> 172.21.15.113:0/850967768 conn(0x7fbb600d3520 msgr2=0x7fbb6015fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.648+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 shutdown_connections 2023-12-19T13:47:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.648+0000 7fbb65118640 1 -- 172.21.15.113:0/850967768 wait complete. 2023-12-19T13:47:41.667 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:47:41.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.877+0000 7fbade177640 1 Processor -- start 2023-12-19T13:47:41.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.878+0000 7fbade177640 1 -- start start 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.879+0000 7fbade177640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbad806d610 0x7fbad806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.879+0000 7fbade177640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbad80ac8b0 0x7fbad815da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.879+0000 7fbade177640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad815dfb0 0x7fbad80b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.879+0000 7fbade177640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad8143b50 con 0x7fbad806d610 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.879+0000 7fbade177640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad8161060 con 0x7fbad80ac8b0 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.879+0000 7fbade177640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80acd40 con 0x7fbad815dfb0 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.879+0000 7fbad77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbad806d610 0x7fbad806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbad806d610 0x7fbad806f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50640/0 (socket says 172.21.15.113:50640) 2023-12-19T13:47:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad77fe640 1 -- 172.21.15.113:0/1715126813 learned_addr learned my addr 172.21.15.113:0/1715126813 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad6ffd640 1 --2- 172.21.15.113:0/1715126813 >> v2:172.21.15.151:3300/0 conn(0x7fbad80ac8b0 0x7fbad815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad7fff640 1 --2- 172.21.15.113:0/1715126813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad815dfb0 0x7fbad80b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad77fe640 1 -- 172.21.15.113:0/1715126813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad815dfb0 msgr2=0x7fbad80b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad77fe640 1 --2- 172.21.15.113:0/1715126813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad815dfb0 0x7fbad80b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad77fe640 1 -- 172.21.15.113:0/1715126813 >> v2:172.21.15.151:3300/0 conn(0x7fbad80ac8b0 msgr2=0x7fbad815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad77fe640 1 --2- 172.21.15.113:0/1715126813 >> v2:172.21.15.151:3300/0 conn(0x7fbad80ac8b0 0x7fbad815da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.880+0000 7fbad77fe640 1 -- 172.21.15.113:0/1715126813 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80ad020 con 0x7fbad806d610 2023-12-19T13:47:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.882+0000 7fbad77fe640 1 --2- 172.21.15.113:0/1715126813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad806f320 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbad8066180 tx=0x7fbac802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7d68fbfefcae10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.882+0000 7fbad67fc640 1 -- 172.21.15.113:0/1715126813 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac802c9e0 con 0x7fbad806d610 2023-12-19T13:47:41.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.882+0000 7fbad67fc640 1 -- 172.21.15.113:0/1715126813 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac802cb40 con 0x7fbad806d610 2023-12-19T13:47:41.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.882+0000 7fbad67fc640 1 -- 172.21.15.113:0/1715126813 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80343f0 con 0x7fbad806d610 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 -- 172.21.15.113:0/1715126813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 msgr2=0x7fbad806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 --2- 172.21.15.113:0/1715126813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad806f320 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbad8066180 tx=0x7fbac802be40 comp rx=0 tx=0).stop 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 -- 172.21.15.113:0/1715126813 shutdown_connections 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 --2- 172.21.15.113:0/1715126813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad815dfb0 0x7fbad80b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 --2- 172.21.15.113:0/1715126813 >> v2:172.21.15.151:3300/0 conn(0x7fbad80ac8b0 0x7fbad815da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 --2- 172.21.15.113:0/1715126813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad806f320 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 -- 172.21.15.113:0/1715126813 >> 172.21.15.113:0/1715126813 conn(0x7fbad80b0ec0 msgr2=0x7fbad80b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 -- 172.21.15.113:0/1715126813 shutdown_connections 2023-12-19T13:47:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.883+0000 7fbade177640 1 -- 172.21.15.113:0/1715126813 wait complete. 2023-12-19T13:47:41.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.885+0000 7fbade177640 1 Processor -- start 2023-12-19T13:47:41.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.885+0000 7fbade177640 1 -- start start 2023-12-19T13:47:41.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbade177640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad81e6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbade177640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad8143fd0 0x7fbad8140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbade177640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbad8144430 0x7fbad81410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbade177640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81e7440 con 0x7fbad806d610 2023-12-19T13:47:41.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbade177640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81e6830 con 0x7fbad8144430 2023-12-19T13:47:41.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbade177640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81e6b10 con 0x7fbad8143fd0 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad81e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad81e6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50648/0 (socket says 172.21.15.113:50648) 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbad77fe640 1 -- 172.21.15.113:0/1879884716 learned_addr learned my addr 172.21.15.113:0/1879884716 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbad77fe640 1 -- 172.21.15.113:0/1879884716 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad8143fd0 msgr2=0x7fbad8140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.886+0000 7fbad77fe640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad8143fd0 0x7fbad8140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbad77fe640 1 -- 172.21.15.113:0/1879884716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbad8144430 msgr2=0x7fbad81410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbad77fe640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbad8144430 0x7fbad81410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbad77fe640 1 -- 172.21.15.113:0/1879884716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009b30 con 0x7fbad806d610 2023-12-19T13:47:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbad77fe640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad81e6170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbac8000f80 tx=0x7fbac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbacffff640 1 -- 172.21.15.113:0/1879884716 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8009510 con 0x7fbad806d610 2023-12-19T13:47:41.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbacffff640 1 -- 172.21.15.113:0/1879884716 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac803e450 con 0x7fbad806d610 2023-12-19T13:47:41.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbacffff640 1 -- 172.21.15.113:0/1879884716 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac803e800 con 0x7fbad806d610 2023-12-19T13:47:41.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad81e6df0 con 0x7fbad806d610 2023-12-19T13:47:41.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.887+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad81e78d0 con 0x7fbad806d610 2023-12-19T13:47:41.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.888+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad8061910 con 0x7fbad806d610 2023-12-19T13:47:41.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.889+0000 7fbacffff640 1 -- 172.21.15.113:0/1879884716 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbac803e960 con 0x7fbad806d610 2023-12-19T13:47:41.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.891+0000 7fbacffff640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbab806a460 0x7fbab806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:41.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.891+0000 7fbacffff640 1 -- 172.21.15.113:0/1879884716 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbac80ab530 con 0x7fbad806d610 2023-12-19T13:47:41.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.891+0000 7fbad6ffd640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbab806a460 0x7fbab806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:41.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.892+0000 7fbad6ffd640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbab806a460 0x7fbab806c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbac0006fd0 tx=0x7fbac0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:41.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:41.895+0000 7fbacffff640 1 -- 172.21.15.113:0/1879884716 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbac8076d40 con 0x7fbad806d610 2023-12-19T13:47:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.085+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbad81e7a60 con 0x7fbad806d610 2023-12-19T13:47:42.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.086+0000 7fbacffff640 1 -- 172.21.15.113:0/1879884716 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbac80ab070 con 0x7fbad806d610 2023-12-19T13:47:42.086 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:42.086 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:47:42.086 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:42.086 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:47:42.086 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:47:42.086 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:42.087 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:47:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbab806a460 msgr2=0x7fbab806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbab806a460 0x7fbab806c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbac0006fd0 tx=0x7fbac0008040 comp rx=0 tx=0).stop 2023-12-19T13:47:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 msgr2=0x7fbad81e6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad81e6170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbac8000f80 tx=0x7fbac8004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 shutdown_connections 2023-12-19T13:47:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbab806a460 0x7fbab806c920 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbad8144430 0x7fbad81410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbad8143fd0 0x7fbad8140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 --2- 172.21.15.113:0/1879884716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbad806d610 0x7fbad81e6170 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 >> 172.21.15.113:0/1879884716 conn(0x7fbad80b0ec0 msgr2=0x7fbad80b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:42.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 shutdown_connections 2023-12-19T13:47:42.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.089+0000 7fbade177640 1 -- 172.21.15.113:0/1879884716 wait complete. 2023-12-19T13:47:42.107 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:47:42.107 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:47:42.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.315+0000 7ff422a3e640 1 Processor -- start 2023-12-19T13:47:42.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.315+0000 7ff422a3e640 1 -- start start 2023-12-19T13:47:42.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.317+0000 7ff422a3e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 0x7ff41c0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.317+0000 7ff422a3e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0b7c10 con 0x7ff41c0d0b80 2023-12-19T13:47:42.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.317+0000 7ff422a3e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0b7ef0 con 0x7ff41c146ac0 2023-12-19T13:47:42.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.317+0000 7ff422a3e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0d1010 con 0x7ff41c0b7650 2023-12-19T13:47:42.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.317+0000 7ff42223d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff41c0d0b80 0x7ff41c0d24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48460/0 (socket says 172.21.15.113:48460) 2023-12-19T13:47:42.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.317+0000 7ff42223d640 1 -- 172.21.15.113:0/14253346 learned_addr learned my addr 172.21.15.113:0/14253346 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff42123b640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 0x7ff41c0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731176816 0 0) 0x7ff41c0b7c10 con 0x7ff41c0d0b80 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff404003520 con 0x7ff41c0d0b80 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858711916 0 0) 0x7ff404003520 con 0x7ff41c0d0b80 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 msgr2=0x7ff41c0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 0x7ff41c0d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 >> v1:172.21.15.151:6789/0 conn(0x7ff41c146ac0 legacy=0x7ff41c161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0b81d0 con 0x7ff41c0d0b80 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff4140019f0 con 0x7ff41c0d0b80 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 >> v1:172.21.15.113:6789/0 conn(0x7ff41c0d0b80 legacy=0x7ff41c0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:42.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 0x7ff404003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff404003f90 0x7ff4040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff404004d00 0x7ff404005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0d1010 con 0x7ff404004d00 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40400bae0 con 0x7ff404003f90 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.318+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40400bca0 con 0x7ff41c0b7650 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff42223d640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff404004d00 0x7ff404005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff42123b640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff404003f90 0x7ff4040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff42223d640 1 -- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 msgr2=0x7ff404003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff421a3c640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 0x7ff404003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff42223d640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0b7650 0x7ff404003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff42223d640 1 -- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff404003f90 msgr2=0x7ff4040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff42223d640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff404003f90 0x7ff4040047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.319+0000 7ff42223d640 1 -- 172.21.15.113:0/14253346 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff404003520 con 0x7ff404004d00 2023-12-19T13:47:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.320+0000 7ff42223d640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff404004d00 0x7ff404005180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff41400a830 tx=0x7ff4040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448bdfa8e3e32d1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.320+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4140072d0 con 0x7ff404004d00 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.320+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41402f070 con 0x7ff404004d00 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.320+0000 7ff420a3a640 1 -- 172.21.15.113:0/14253346 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4140076f0 con 0x7ff404004d00 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.321+0000 7ff422a3e640 1 -- 172.21.15.113:0/14253346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff404004d00 msgr2=0x7ff404005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.321+0000 7ff422a3e640 1 --2- 172.21.15.113:0/14253346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff404004d00 0x7ff404005180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff41400a830 tx=0x7ff4040057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.321+0000 7ff42223d640 1 -- 172.21.15.113:0/14253346 reap_dead start 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.321+0000 7ff422a3e640 1 -- 172.21.15.113:0/14253346 shutdown_connections 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.321+0000 7ff422a3e640 1 -- 172.21.15.113:0/14253346 >> 172.21.15.113:0/14253346 conn(0x7ff41c0659d0 msgr2=0x7ff41c065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.321+0000 7ff422a3e640 1 -- 172.21.15.113:0/14253346 shutdown_connections 2023-12-19T13:47:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.321+0000 7ff422a3e640 1 -- 172.21.15.113:0/14253346 wait complete. 2023-12-19T13:47:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.323+0000 7ff422a3e640 1 Processor -- start 2023-12-19T13:47:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.323+0000 7ff422a3e640 1 -- start start 2023-12-19T13:47:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff422a3e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff41c13cbb0 0x7ff41c159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff422a3e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0cecc0 0x7ff41c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff422a3e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c15b200 0x7ff41c1f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff422a3e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c159b80 con 0x7ff41c13cbb0 2023-12-19T13:47:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff422a3e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c15b680 con 0x7ff41c15b200 2023-12-19T13:47:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff422a3e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c15a8f0 con 0x7ff41c0cecc0 2023-12-19T13:47:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff41c13cbb0 0x7ff41c159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff41c13cbb0 0x7ff41c159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50672/0 (socket says 172.21.15.113:50672) 2023-12-19T13:47:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 -- 172.21.15.113:0/1236298538 learned_addr learned my addr 172.21.15.113:0/1236298538 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff42123b640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0cecc0 0x7ff41c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff42223d640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c15b200 0x7ff41c1f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 -- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0cecc0 msgr2=0x7ff41c15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0cecc0 0x7ff41c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 -- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c15b200 msgr2=0x7ff41c1f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c15b200 0x7ff41c1f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.324+0000 7ff421a3c640 1 -- 172.21.15.113:0/1236298538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0cf140 con 0x7ff41c13cbb0 2023-12-19T13:47:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.325+0000 7ff421a3c640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff41c13cbb0 0x7ff41c159640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00d570 tx=0x7ff40c00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.325+0000 7ff4127fc640 1 -- 172.21.15.113:0/1236298538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c005480 con 0x7ff41c13cbb0 2023-12-19T13:47:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.325+0000 7ff4127fc640 1 -- 172.21.15.113:0/1236298538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c003610 con 0x7ff41c13cbb0 2023-12-19T13:47:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.325+0000 7ff4127fc640 1 -- 172.21.15.113:0/1236298538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c003980 con 0x7ff41c13cbb0 2023-12-19T13:47:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.325+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c13cf90 con 0x7ff41c13cbb0 2023-12-19T13:47:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.325+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c15a050 con 0x7ff41c13cbb0 2023-12-19T13:47:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.326+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c061910 con 0x7ff41c13cbb0 2023-12-19T13:47:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.327+0000 7ff4127fc640 1 -- 172.21.15.113:0/1236298538 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff40c003ae0 con 0x7ff41c13cbb0 2023-12-19T13:47:42.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.328+0000 7ff4127fc640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff40806a430 0x7ff40806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:42.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.328+0000 7ff4127fc640 1 -- 172.21.15.113:0/1236298538 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff40c0884a0 con 0x7ff41c13cbb0 2023-12-19T13:47:42.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.328+0000 7ff42123b640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff40806a430 0x7ff40806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:42.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.329+0000 7ff42123b640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff40806a430 0x7ff40806c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff41c157e50 tx=0x7ff418008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:42.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.332+0000 7ff4127fc640 1 -- 172.21.15.113:0/1236298538 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff40c053dd0 con 0x7ff41c13cbb0 2023-12-19T13:47:42.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:42.522+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff41c0b7430 con 0x7ff41c13cbb0 2023-12-19T13:47:43.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.281+0000 7ff4127fc640 1 -- 172.21.15.113:0/1236298538 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff40c001230 con 0x7ff41c13cbb0 2023-12-19T13:47:43.281 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:47:43.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.287+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff40806a430 msgr2=0x7ff40806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:43.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.287+0000 7ff422a3e640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff40806a430 0x7ff40806c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff41c157e50 tx=0x7ff418008040 comp rx=0 tx=0).stop 2023-12-19T13:47:43.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.287+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff41c13cbb0 msgr2=0x7ff41c159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:43.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.287+0000 7ff422a3e640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff41c13cbb0 0x7ff41c159640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00d570 tx=0x7ff40c00da30 comp rx=0 tx=0).stop 2023-12-19T13:47:43.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 shutdown_connections 2023-12-19T13:47:43.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff40806a430 0x7ff40806c8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c15b200 0x7ff41c1f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c0cecc0 0x7ff41c15acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 --2- 172.21.15.113:0/1236298538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff41c13cbb0 0x7ff41c159640 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 >> 172.21.15.113:0/1236298538 conn(0x7ff41c0659d0 msgr2=0x7ff41c145750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:43.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 shutdown_connections 2023-12-19T13:47:43.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.288+0000 7ff422a3e640 1 -- 172.21.15.113:0/1236298538 wait complete. 2023-12-19T13:47:43.310 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:47:43.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.528+0000 7f034f59e640 1 Processor -- start 2023-12-19T13:47:43.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.528+0000 7f034f59e640 1 -- start start 2023-12-19T13:47:43.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.529+0000 7f034f59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f03501449f0 0x7f035015b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:43.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.529+0000 7f034f59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f03500cbda0 0x7f03500b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:43.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034f59e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035006cb40 con 0x7f035015bad0 2023-12-19T13:47:43.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034f59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035015c5f0 con 0x7f03501449f0 2023-12-19T13:47:43.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034f59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035006c530 con 0x7f03500cbda0 2023-12-19T13:47:43.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f03501449f0 0x7f035015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:43.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f03501449f0 0x7f035015b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50684/0 (socket says 172.21.15.113:50684) 2023-12-19T13:47:43.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034e59c640 1 -- 172.21.15.113:0/313164964 learned_addr learned my addr 172.21.15.113:0/313164964 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034e59c640 1 -- 172.21.15.113:0/313164964 >> v2:172.21.15.151:3300/0 conn(0x7f03500cbda0 msgr2=0x7f03500b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f0347fff640 1 --2- 172.21.15.113:0/313164964 >> v2:172.21.15.151:3300/0 conn(0x7f03500cbda0 0x7f03500b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034e59c640 1 --2- 172.21.15.113:0/313164964 >> v2:172.21.15.151:3300/0 conn(0x7f03500cbda0 0x7f03500b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034e59c640 1 -- 172.21.15.113:0/313164964 >> v1:172.21.15.113:6789/0 conn(0x7f035015bad0 legacy=0x7f03500add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034e59c640 1 -- 172.21.15.113:0/313164964 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035015c030 con 0x7f03501449f0 2023-12-19T13:47:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.530+0000 7f034dd9b640 1 -- 172.21.15.113:0/313164964 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760703030 0 0) 0x7f035006cb40 con 0x7f035015bad0 2023-12-19T13:47:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.532+0000 7f034e59c640 1 --2- 172.21.15.113:0/313164964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03501449f0 0x7f035015b590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f03500cb880 tx=0x7f034002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffec5669eac3b07 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:43.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.532+0000 7f034dd9b640 1 -- 172.21.15.113:0/313164964 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03400317e0 con 0x7f03501449f0 2023-12-19T13:47:43.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.532+0000 7f034dd9b640 1 -- 172.21.15.113:0/313164964 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340031940 con 0x7f03501449f0 2023-12-19T13:47:43.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.532+0000 7f034dd9b640 1 -- 172.21.15.113:0/313164964 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340031cd0 con 0x7f03501449f0 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 -- 172.21.15.113:0/313164964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03501449f0 msgr2=0x7f035015b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 --2- 172.21.15.113:0/313164964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03501449f0 0x7f035015b590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f03500cb880 tx=0x7f034002b880 comp rx=0 tx=0).stop 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 -- 172.21.15.113:0/313164964 shutdown_connections 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 --2- 172.21.15.113:0/313164964 >> v2:172.21.15.151:3300/0 conn(0x7f03500cbda0 0x7f03500b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 --2- 172.21.15.113:0/313164964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03501449f0 0x7f035015b590 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 -- 172.21.15.113:0/313164964 >> 172.21.15.113:0/313164964 conn(0x7f03500659a0 msgr2=0x7f0350065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 -- 172.21.15.113:0/313164964 shutdown_connections 2023-12-19T13:47:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.533+0000 7f034f59e640 1 -- 172.21.15.113:0/313164964 wait complete. 2023-12-19T13:47:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.534+0000 7f034f59e640 1 Processor -- start 2023-12-19T13:47:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.535+0000 7f034f59e640 1 -- start start 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03500cbda0 0x7f03500b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03501449f0 0x7f0350140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034f59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f035015bad0 0x7f03500ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034f59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03501e38f0 con 0x7f035015bad0 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03501e3bd0 con 0x7f03500cbda0 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03501e3eb0 con 0x7f03501449f0 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f035015bad0 0x7f03500ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f035015bad0 0x7f03500ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50686/0 (socket says 172.21.15.113:50686) 2023-12-19T13:47:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 -- 172.21.15.113:0/3651896431 learned_addr learned my addr 172.21.15.113:0/3651896431 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034e59c640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03500cbda0 0x7f03500b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f0347fff640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03501449f0 0x7f0350140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 -- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03501449f0 msgr2=0x7f0350140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03501449f0 0x7f0350140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 -- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03500cbda0 msgr2=0x7f03500b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03500cbda0 0x7f03500b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.536+0000 7f034ed9d640 1 -- 172.21.15.113:0/3651896431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03400094d0 con 0x7f035015bad0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.537+0000 7f034ed9d640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f035015bad0 0x7f03500ae680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f034800c780 tx=0x7f034800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.537+0000 7f0346ffd640 1 -- 172.21.15.113:0/3651896431 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348003b70 con 0x7f035015bad0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.537+0000 7f0346ffd640 1 -- 172.21.15.113:0/3651896431 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348003cd0 con 0x7f035015bad0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.537+0000 7f0346ffd640 1 -- 172.21.15.113:0/3651896431 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348005270 con 0x7f035015bad0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.537+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03501e4190 con 0x7f035015bad0 2023-12-19T13:47:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.537+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0350140dd0 con 0x7f035015bad0 2023-12-19T13:47:43.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.538+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03501e46b0 con 0x7f035015bad0 2023-12-19T13:47:43.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.539+0000 7f0346ffd640 1 -- 172.21.15.113:0/3651896431 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f03480053d0 con 0x7f035015bad0 2023-12-19T13:47:43.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.540+0000 7f0346ffd640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f033006a430 0x7f033006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:43.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.540+0000 7f0346ffd640 1 -- 172.21.15.113:0/3651896431 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f03480886c0 con 0x7f035015bad0 2023-12-19T13:47:43.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.541+0000 7f034e59c640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f033006a430 0x7f033006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:43.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.541+0000 7f034e59c640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f033006a430 0x7f033006c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0340036000 tx=0x7f034003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:43.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.545+0000 7f0346ffd640 1 -- 172.21.15.113:0/3651896431 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f03501e46b0 con 0x7f035015bad0 2023-12-19T13:47:43.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:43.738+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f03501e46b0 con 0x7f035015bad0 2023-12-19T13:47:44.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.294+0000 7f0346ffd640 1 -- 172.21.15.113:0/3651896431 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f03501e46b0 con 0x7f035015bad0 2023-12-19T13:47:44.297 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:47:44.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.300+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f033006a430 msgr2=0x7f033006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.300+0000 7f034f59e640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f033006a430 0x7f033006c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0340036000 tx=0x7f034003d040 comp rx=0 tx=0).stop 2023-12-19T13:47:44.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.300+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f035015bad0 msgr2=0x7f03500ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.300+0000 7f034f59e640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f035015bad0 0x7f03500ae680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f034800c780 tx=0x7f034800cb80 comp rx=0 tx=0).stop 2023-12-19T13:47:44.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.301+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 shutdown_connections 2023-12-19T13:47:44.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.301+0000 7f034f59e640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f033006a430 0x7f033006c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.301+0000 7f034f59e640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f035015bad0 0x7f03500ae680 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.301+0000 7f034f59e640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03501449f0 0x7f0350140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.301+0000 7f034f59e640 1 --2- 172.21.15.113:0/3651896431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03500cbda0 0x7f03500b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.301+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 >> 172.21.15.113:0/3651896431 conn(0x7f03500659a0 msgr2=0x7f03500cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:44.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.302+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 shutdown_connections 2023-12-19T13:47:44.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.304+0000 7f034f59e640 1 -- 172.21.15.113:0/3651896431 wait complete. 2023-12-19T13:47:44.326 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:47:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.515+0000 7febb5cf7640 1 Processor -- start 2023-12-19T13:47:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.515+0000 7febb5cf7640 1 -- start start 2023-12-19T13:47:44.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.517+0000 7febb5cf7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 0x7febb00b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.517+0000 7febb5cf7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb015fde0 con 0x7febb00ceea0 2023-12-19T13:47:44.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.517+0000 7febb5cf7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb00b2bc0 con 0x7febb015b1d0 2023-12-19T13:47:44.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.517+0000 7febb5cf7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb00b2400 con 0x7febb00b2760 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.517+0000 7febaffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7febb00ceea0 0x7febb006c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48476/0 (socket says 172.21.15.113:48476) 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.517+0000 7febaffff640 1 -- 172.21.15.113:0/2521139968 learned_addr learned my addr 172.21.15.113:0/2521139968 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7feba7fff640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 0x7febb00b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718704396 0 0) 0x7febb015fde0 con 0x7febb00ceea0 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb9c003520 con 0x7febb00ceea0 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 180345858 0 0) 0x7feb9c003520 con 0x7febb00ceea0 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 msgr2=0x7febb00b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 0x7febb00b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 >> v1:172.21.15.151:6789/0 conn(0x7febb015b1d0 legacy=0x7febb015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb015ef10 con 0x7febb00ceea0 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7feba80019f0 con 0x7febb00ceea0 2023-12-19T13:47:44.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 >> v1:172.21.15.113:6789/0 conn(0x7febb00ceea0 legacy=0x7febb006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb9c003a10 0x7feb9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7feb9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 0x7feb9c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c00bb10 con 0x7feb9c0047c0 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c00bc80 con 0x7feb9c003a10 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.518+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c00be40 con 0x7febb00b2760 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7feba7fff640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7feb9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7febaffff640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 0x7feb9c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7febaf7fe640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb9c003a10 0x7feb9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7feba7fff640 1 -- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 msgr2=0x7feb9c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7feba7fff640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 0x7feb9c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7feba7fff640 1 -- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb9c003a10 msgr2=0x7feb9c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:44.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7feba7fff640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb9c003a10 0x7feb9c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7feba7fff640 1 -- 172.21.15.113:0/2521139968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c003520 con 0x7feb9c0047c0 2023-12-19T13:47:44.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7febaffff640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00b2760 0x7feb9c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:44.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.519+0000 7febaf7fe640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb9c003a10 0x7feb9c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.520+0000 7feba7fff640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7feb9c004c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb98009ac0 tx=0x7feb9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bdbda41ee50e9e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9802c6b0 con 0x7feb9c0047c0 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9802c810 con 0x7feb9c0047c0 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febaeffd640 1 -- 172.21.15.113:0/2521139968 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9802cba0 con 0x7feb9c0047c0 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febb5cf7640 1 -- 172.21.15.113:0/2521139968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 msgr2=0x7feb9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febb5cf7640 1 --2- 172.21.15.113:0/2521139968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7feb9c004c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb98009ac0 tx=0x7feb9c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febaffff640 1 -- 172.21.15.113:0/2521139968 reap_dead start 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febb5cf7640 1 -- 172.21.15.113:0/2521139968 shutdown_connections 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febb5cf7640 1 -- 172.21.15.113:0/2521139968 >> 172.21.15.113:0/2521139968 conn(0x7febb0073150 msgr2=0x7febb00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febb5cf7640 1 -- 172.21.15.113:0/2521139968 shutdown_connections 2023-12-19T13:47:44.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.521+0000 7febb5cf7640 1 -- 172.21.15.113:0/2521139968 wait complete. 2023-12-19T13:47:44.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.523+0000 7febb5cf7640 1 Processor -- start 2023-12-19T13:47:44.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.523+0000 7febb5cf7640 1 -- start start 2023-12-19T13:47:44.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.524+0000 7febb5cf7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7febb0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.524+0000 7febb5cf7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00ca2b0 0x7febb00ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.524+0000 7febb5cf7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febb015cce0 0x7febb015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.524+0000 7febb5cf7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb0156260 con 0x7feb9c0047c0 2023-12-19T13:47:44.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.524+0000 7febb5cf7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb00cac50 con 0x7febb015cce0 2023-12-19T13:47:44.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.524+0000 7febb5cf7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb015daa0 con 0x7febb00ca2b0 2023-12-19T13:47:44.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.524+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7febb0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7febb0155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50710/0 (socket says 172.21.15.113:50710) 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 -- 172.21.15.113:0/3189734616 learned_addr learned my addr 172.21.15.113:0/3189734616 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaffff640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febb015cce0 0x7febb015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7feba7fff640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00ca2b0 0x7febb00ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 -- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00ca2b0 msgr2=0x7febb00ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00ca2b0 0x7febb00ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 -- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febb015cce0 msgr2=0x7febb015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febb015cce0 0x7febb015d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 -- 172.21.15.113:0/3189734616 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb015dd80 con 0x7feb9c0047c0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.525+0000 7febaf7fe640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7febb0155d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feba000d7d0 tx=0x7feba000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.526+0000 7febacff9640 1 -- 172.21.15.113:0/3189734616 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0017070 con 0x7feb9c0047c0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.526+0000 7febacff9640 1 -- 172.21.15.113:0/3189734616 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0005070 con 0x7feb9c0047c0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.526+0000 7febacff9640 1 -- 172.21.15.113:0/3189734616 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0005400 con 0x7feb9c0047c0 2023-12-19T13:47:44.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.526+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb015e060 con 0x7feb9c0047c0 2023-12-19T13:47:44.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.526+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb01f3b40 con 0x7feb9c0047c0 2023-12-19T13:47:44.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.527+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb0061910 con 0x7feb9c0047c0 2023-12-19T13:47:44.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.528+0000 7febacff9640 1 -- 172.21.15.113:0/3189734616 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feba0007030 con 0x7feb9c0047c0 2023-12-19T13:47:44.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.529+0000 7febacff9640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb9006a430 0x7feb9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.529+0000 7febacff9640 1 -- 172.21.15.113:0/3189734616 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7feba00881c0 con 0x7feb9c0047c0 2023-12-19T13:47:44.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.529+0000 7feba7fff640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb9006a430 0x7feb9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.530+0000 7feba7fff640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb9006a430 0x7feb9006c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feb98036000 tx=0x7feb98030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:44.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.534+0000 7febacff9640 1 -- 172.21.15.113:0/3189734616 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feba0053810 con 0x7feb9c0047c0 2023-12-19T13:47:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.763+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7febb00cdc90 con 0x7feb9c0047c0 2023-12-19T13:47:44.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.775+0000 7febacff9640 1 -- 172.21.15.113:0/3189734616 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7feba0056e30 con 0x7feb9c0047c0 2023-12-19T13:47:44.781 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 4 and data pool 5 2023-12-19T13:47:44.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.782+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb9006a430 msgr2=0x7feb9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.782+0000 7febb5cf7640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb9006a430 0x7feb9006c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feb98036000 tx=0x7feb98030000 comp rx=0 tx=0).stop 2023-12-19T13:47:44.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.782+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 msgr2=0x7febb0155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.782+0000 7febb5cf7640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7febb0155d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feba000d7d0 tx=0x7feba000dc90 comp rx=0 tx=0).stop 2023-12-19T13:47:44.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.787+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 shutdown_connections 2023-12-19T13:47:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.787+0000 7febb5cf7640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb9006a430 0x7feb9006c8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.787+0000 7febb5cf7640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febb015cce0 0x7febb015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.787+0000 7febb5cf7640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febb00ca2b0 0x7febb00ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.787+0000 7febb5cf7640 1 --2- 172.21.15.113:0/3189734616 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c0047c0 0x7febb0155d20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.787+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 >> 172.21.15.113:0/3189734616 conn(0x7febb0073150 msgr2=0x7febb00cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.788+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 shutdown_connections 2023-12-19T13:47:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.788+0000 7febb5cf7640 1 -- 172.21.15.113:0/3189734616 wait complete. 2023-12-19T13:47:44.810 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:44.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.987+0000 7f178e922640 1 Processor -- start 2023-12-19T13:47:44.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.987+0000 7f178e922640 1 -- start start 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f178e922640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17880b2460 0x7f1788070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f178e922640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f17880b6960 0x7f17880b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f178e922640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178815dc30 con 0x7f1788157c50 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f178e922640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178815e8b0 con 0x7f17880b2460 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f178e922640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17880b7330 con 0x7f17880b6960 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f1787fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17880b2460 0x7f1788070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f1787fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17880b2460 0x7f1788070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50722/0 (socket says 172.21.15.113:50722) 2023-12-19T13:47:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.989+0000 7f1787fff640 1 -- 172.21.15.113:0/3156254621 learned_addr learned my addr 172.21.15.113:0/3156254621 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.990+0000 7f178cebf640 1 --2- 172.21.15.113:0/3156254621 >> v2:172.21.15.151:3300/0 conn(0x7f17880b6960 0x7f17880b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.990+0000 7f1787fff640 1 -- 172.21.15.113:0/3156254621 >> v2:172.21.15.151:3300/0 conn(0x7f17880b6960 msgr2=0x7f17880b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.990+0000 7f1787fff640 1 --2- 172.21.15.113:0/3156254621 >> v2:172.21.15.151:3300/0 conn(0x7f17880b6960 0x7f17880b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.990+0000 7f1787fff640 1 -- 172.21.15.113:0/3156254621 >> v1:172.21.15.113:6789/0 conn(0x7f1788157c50 legacy=0x7f17880b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.990+0000 7f1787fff640 1 -- 172.21.15.113:0/3156254621 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178815df10 con 0x7f17880b2460 2023-12-19T13:47:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.990+0000 7f178cebf640 1 --2- 172.21.15.113:0/3156254621 >> v2:172.21.15.151:3300/0 conn(0x7f17880b6960 0x7f17880b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:44.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.991+0000 7f1787fff640 1 --2- 172.21.15.113:0/3156254621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788070740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f17880d11a0 tx=0x7f177802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaebb37605357d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:44.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.991+0000 7f1786ffd640 1 -- 172.21.15.113:0/3156254621 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778030880 con 0x7f17880b2460 2023-12-19T13:47:44.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.991+0000 7f1786ffd640 1 -- 172.21.15.113:0/3156254621 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17780309e0 con 0x7f17880b2460 2023-12-19T13:47:44.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.991+0000 7f1786ffd640 1 -- 172.21.15.113:0/3156254621 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778030d70 con 0x7f17880b2460 2023-12-19T13:47:44.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 -- 172.21.15.113:0/3156254621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 msgr2=0x7f1788070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 --2- 172.21.15.113:0/3156254621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788070740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f17880d11a0 tx=0x7f177802b9c0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 -- 172.21.15.113:0/3156254621 shutdown_connections 2023-12-19T13:47:44.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 --2- 172.21.15.113:0/3156254621 >> v2:172.21.15.151:3300/0 conn(0x7f17880b6960 0x7f17880b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 --2- 172.21.15.113:0/3156254621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788070740 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 -- 172.21.15.113:0/3156254621 >> 172.21.15.113:0/3156254621 conn(0x7f17880659d0 msgr2=0x7f1788065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:44.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 -- 172.21.15.113:0/3156254621 shutdown_connections 2023-12-19T13:47:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.992+0000 7f178e922640 1 -- 172.21.15.113:0/3156254621 wait complete. 2023-12-19T13:47:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.994+0000 7f178e922640 1 Processor -- start 2023-12-19T13:47:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.994+0000 7f178e922640 1 -- start start 2023-12-19T13:47:44.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f178e922640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f178e922640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17880b6960 0x7f17881f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f178e922640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1788157c50 0x7f17881f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:44.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f178e922640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1788144a50 con 0x7f17880b2460 2023-12-19T13:47:44.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f178e922640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17881f71f0 con 0x7f1788157c50 2023-12-19T13:47:44.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f178e922640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1788144c50 con 0x7f17880b6960 2023-12-19T13:47:44.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f1787fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:44.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f1787fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788144510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50734/0 (socket says 172.21.15.113:50734) 2023-12-19T13:47:44.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.995+0000 7f1787fff640 1 -- 172.21.15.113:0/3731092394 learned_addr learned my addr 172.21.15.113:0/3731092394 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:44.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1787fff640 1 -- 172.21.15.113:0/3731092394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17880b6960 msgr2=0x7f17881f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1787fff640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17880b6960 0x7f17881f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1787fff640 1 -- 172.21.15.113:0/3731092394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1788157c50 msgr2=0x7f17881f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:44.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1787fff640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1788157c50 0x7f17881f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:44.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1787fff640 1 -- 172.21.15.113:0/3731092394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780094d0 con 0x7f17880b2460 2023-12-19T13:47:44.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1787fff640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788144510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f177802ba00 tx=0x7f1778004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:44.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1784ff9640 1 -- 172.21.15.113:0/3731092394 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778030870 con 0x7f17880b2460 2023-12-19T13:47:44.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1784ff9640 1 -- 172.21.15.113:0/3731092394 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778039d90 con 0x7f17880b2460 2023-12-19T13:47:45.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f1784ff9640 1 -- 172.21.15.113:0/3731092394 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778043650 con 0x7f17880b2460 2023-12-19T13:47:45.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1788144f30 con 0x7f17880b2460 2023-12-19T13:47:45.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.996+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17881454f0 con 0x7f17880b2460 2023-12-19T13:47:45.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.998+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1788061910 con 0x7f17880b2460 2023-12-19T13:47:45.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.998+0000 7f1784ff9640 1 -- 172.21.15.113:0/3731092394 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17780437b0 con 0x7f17880b2460 2023-12-19T13:47:45.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.999+0000 7f1784ff9640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f177406a430 0x7f177406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.999+0000 7f1784ff9640 1 -- 172.21.15.113:0/3731092394 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17780aad30 con 0x7f17880b2460 2023-12-19T13:47:45.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:44.999+0000 7f17877fe640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f177406a430 0x7f177406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.000+0000 7f17877fe640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f177406a430 0x7f177406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f177c000f60 tx=0x7f177c0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:45.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.004+0000 7f1784ff9640 1 -- 172.21.15.113:0/3731092394 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1778076580 con 0x7f17880b2460 2023-12-19T13:47:45.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.180+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17880b3310 con 0x7f17880b2460 2023-12-19T13:47:45.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.182+0000 7f1784ff9640 1 -- 172.21.15.113:0/3731092394 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f1778034090 con 0x7f17880b2460 2023-12-19T13:47:45.182 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:45.182 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:44.764722+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f177406a430 msgr2=0x7f177406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f177406a430 0x7f177406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f177c000f60 tx=0x7f177c0079b0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 msgr2=0x7f1788144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788144510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f177802ba00 tx=0x7f1778004730 comp rx=0 tx=0).stop 2023-12-19T13:47:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 shutdown_connections 2023-12-19T13:47:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f177406a430 0x7f177406c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1788157c50 0x7f17881f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17880b6960 0x7f17881f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 --2- 172.21.15.113:0/3731092394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17880b2460 0x7f1788144510 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 >> 172.21.15.113:0/3731092394 conn(0x7f17880659d0 msgr2=0x7f17880b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 shutdown_connections 2023-12-19T13:47:45.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.184+0000 7f178e922640 1 -- 172.21.15.113:0/3731092394 wait complete. 2023-12-19T13:47:45.202 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:45.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.402+0000 7f63abae2640 1 Processor -- start 2023-12-19T13:47:45.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.403+0000 7f63abae2640 1 -- start start 2023-12-19T13:47:45.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.404+0000 7f63abae2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63a406c6b0 0x7f63a4166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.404+0000 7f63abae2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a406bb30 con 0x7f63a41449e0 2023-12-19T13:47:45.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.404+0000 7f63abae2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a40b0070 con 0x7f63a40b0b50 2023-12-19T13:47:45.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.404+0000 7f63abae2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b0350 con 0x7f63a406c6b0 2023-12-19T13:47:45.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.404+0000 7f63a987e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f63a41449e0 0x7f63a40af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48500/0 (socket says 172.21.15.113:48500) 2023-12-19T13:47:45.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.404+0000 7f63a987e640 1 -- 172.21.15.113:0/2835895090 learned_addr learned my addr 172.21.15.113:0/2835895090 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:45.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63aa07f640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63a406c6b0 0x7f63a4166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186626883 0 0) 0x7f63a406bb30 con 0x7f63a41449e0 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6390003520 con 0x7f63a41449e0 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4233435592 0 0) 0x7f6390003520 con 0x7f63a41449e0 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63a406c6b0 msgr2=0x7f63a4166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63a406c6b0 0x7f63a4166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 >> v1:172.21.15.151:6789/0 conn(0x7f63a40b0b50 legacy=0x7f63a406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40b0630 con 0x7f63a41449e0 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f63a0001670 con 0x7f63a41449e0 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 >> v1:172.21.15.113:6789/0 conn(0x7f63a41449e0 legacy=0x7f63a40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63a406c6b0 0x7f6390003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6390004040 0x7f63900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6390004d50 0x7f63900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b0350 con 0x7f6390004040 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639000bb90 con 0x7f6390004d50 2023-12-19T13:47:45.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639000bd50 con 0x7f63a406c6b0 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.405+0000 7f63a907d640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6390004040 0x7f63900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.406+0000 7f63a907d640 1 -- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63a406c6b0 msgr2=0x7f6390003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.406+0000 7f63a907d640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63a406c6b0 0x7f6390003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.406+0000 7f63a907d640 1 -- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6390004d50 msgr2=0x7f63900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.406+0000 7f63a907d640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6390004d50 0x7f63900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.406+0000 7f63a907d640 1 -- 172.21.15.113:0/2835895090 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390003520 con 0x7f6390004040 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.407+0000 7f63a907d640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6390004040 0x7f63900047c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6394001750 tx=0x7f63900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63deabbed041cf40 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.407+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63940052d0 con 0x7f6390004040 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.407+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639402e050 con 0x7f6390004040 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.407+0000 7f63a887c640 1 -- 172.21.15.113:0/2835895090 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394003830 con 0x7f6390004040 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.408+0000 7f63abae2640 1 -- 172.21.15.113:0/2835895090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6390004040 msgr2=0x7f63900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.408+0000 7f63abae2640 1 --2- 172.21.15.113:0/2835895090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6390004040 0x7f63900047c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6394001750 tx=0x7f63900057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.408+0000 7f63aa07f640 1 -- 172.21.15.113:0/2835895090 reap_dead start 2023-12-19T13:47:45.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.408+0000 7f63abae2640 1 -- 172.21.15.113:0/2835895090 shutdown_connections 2023-12-19T13:47:45.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.408+0000 7f63abae2640 1 -- 172.21.15.113:0/2835895090 >> 172.21.15.113:0/2835895090 conn(0x7f63a40cbb70 msgr2=0x7f63a40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:45.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.408+0000 7f63abae2640 1 -- 172.21.15.113:0/2835895090 shutdown_connections 2023-12-19T13:47:45.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.408+0000 7f63abae2640 1 -- 172.21.15.113:0/2835895090 wait complete. 2023-12-19T13:47:45.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.410+0000 7f63abae2640 1 Processor -- start 2023-12-19T13:47:45.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.410+0000 7f63abae2640 1 -- start start 2023-12-19T13:47:45.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63abae2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6390004040 0x7f63a415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63abae2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63a415a8b0 0x7f63a40adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63abae2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63a415a160 0x7f63a4140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63abae2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a415b150 con 0x7f63a415a8b0 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63abae2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a415d2f0 con 0x7f63a415a160 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63abae2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a415d590 con 0x7f6390004040 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63a415a8b0 0x7f63a40adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63a415a8b0 0x7f63a40adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50744/0 (socket says 172.21.15.113:50744) 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 -- 172.21.15.113:0/2364546135 learned_addr learned my addr 172.21.15.113:0/2364546135 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:45.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a987e640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6390004040 0x7f63a415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63aa07f640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63a415a160 0x7f63a4140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 -- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6390004040 msgr2=0x7f63a415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6390004040 0x7f63a415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 -- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63a415a160 msgr2=0x7f63a4140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63a415a160 0x7f63a4140830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a907d640 1 -- 172.21.15.113:0/2364546135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a415d870 con 0x7f63a415a8b0 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.411+0000 7f63a987e640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6390004040 0x7f63a415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.412+0000 7f63a907d640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63a415a8b0 0x7f63a40adb40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6394008fd0 tx=0x7f6394001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.412+0000 7f639a7fc640 1 -- 172.21.15.113:0/2364546135 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63940076c0 con 0x7f63a415a8b0 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.412+0000 7f639a7fc640 1 -- 172.21.15.113:0/2364546135 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6394007a30 con 0x7f63a415a8b0 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.412+0000 7f639a7fc640 1 -- 172.21.15.113:0/2364546135 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394006c00 con 0x7f63a415a8b0 2023-12-19T13:47:45.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.412+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a415b150 con 0x7f63a415a8b0 2023-12-19T13:47:45.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.412+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a40ae240 con 0x7f63a415a8b0 2023-12-19T13:47:45.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.413+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a4061910 con 0x7f63a415a8b0 2023-12-19T13:47:45.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.414+0000 7f639a7fc640 1 -- 172.21.15.113:0/2364546135 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f63940035f0 con 0x7f63a415a8b0 2023-12-19T13:47:45.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.415+0000 7f639a7fc640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f638806a430 0x7f638806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.415+0000 7f639a7fc640 1 -- 172.21.15.113:0/2364546135 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63940aa650 con 0x7f63a415a8b0 2023-12-19T13:47:45.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.415+0000 7f63a987e640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f638806a430 0x7f638806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.416+0000 7f63a987e640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f638806a430 0x7f638806c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63a00018e0 tx=0x7f63a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:45.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.419+0000 7f639a7fc640 1 -- 172.21.15.113:0/2364546135 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f63940796d0 con 0x7f63a415a8b0 2023-12-19T13:47:45.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.614+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63a40cec70 con 0x7f63a415a8b0 2023-12-19T13:47:45.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.617+0000 7f639a7fc640 1 -- 172.21.15.113:0/2364546135 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f6394079260 con 0x7f63a415a8b0 2023-12-19T13:47:45.617 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:45.617 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:44.764722+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:45.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f638806a430 msgr2=0x7f638806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f638806a430 0x7f638806c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63a00018e0 tx=0x7f63a0009040 comp rx=0 tx=0).stop 2023-12-19T13:47:45.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63a415a8b0 msgr2=0x7f63a40adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63a415a8b0 0x7f63a40adb40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6394008fd0 tx=0x7f6394001120 comp rx=0 tx=0).stop 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 shutdown_connections 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f638806a430 0x7f638806c8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63a415a160 0x7f63a4140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63a415a8b0 0x7f63a40adb40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 --2- 172.21.15.113:0/2364546135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6390004040 0x7f63a415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.619+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 >> 172.21.15.113:0/2364546135 conn(0x7f63a40cbb70 msgr2=0x7f63a40ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.620+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 shutdown_connections 2023-12-19T13:47:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.620+0000 7f63abae2640 1 -- 172.21.15.113:0/2364546135 wait complete. 2023-12-19T13:47:45.638 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:47:45.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.856+0000 7fa1e3f01640 1 Processor -- start 2023-12-19T13:47:45.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.856+0000 7fa1e3f01640 1 -- start start 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e3f01640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e3f01640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1dc0b0640 0x7fa1dc06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e3f01640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc0b0a90 con 0x7fa1dc157bf0 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e3f01640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc06b8c0 con 0x7fa1dc0b0640 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e3f01640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0ae640 con 0x7fa1dc0ae110 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e249e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1dc0b0640 0x7fa1dc06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e249e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1dc0b0640 0x7fa1dc06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50756/0 (socket says 172.21.15.113:50756) 2023-12-19T13:47:45.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.857+0000 7fa1e249e640 1 -- 172.21.15.113:0/1754967473 learned_addr learned my addr 172.21.15.113:0/1754967473 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:45.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.858+0000 7fa1e249e640 1 -- 172.21.15.113:0/1754967473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 msgr2=0x7fa1dc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:45.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.858+0000 7fa1e249e640 1 --2- 172.21.15.113:0/1754967473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.858+0000 7fa1e249e640 1 -- 172.21.15.113:0/1754967473 >> v1:172.21.15.151:6789/0 conn(0x7fa1dc157bf0 legacy=0x7fa1dc15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:45.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.858+0000 7fa1e249e640 1 -- 172.21.15.113:0/1754967473 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0ae920 con 0x7fa1dc0b0640 2023-12-19T13:47:45.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.859+0000 7fa1e249e640 1 --2- 172.21.15.113:0/1754967473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc06d230 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009e50 tx=0x7fa1d402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac594429ffb1f01e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:45.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.859+0000 7fa1e0c9b640 1 -- 172.21.15.113:0/1754967473 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d402ec80 con 0x7fa1dc0b0640 2023-12-19T13:47:45.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.859+0000 7fa1e0c9b640 1 -- 172.21.15.113:0/1754967473 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d402ede0 con 0x7fa1dc0b0640 2023-12-19T13:47:45.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.859+0000 7fa1e0c9b640 1 -- 172.21.15.113:0/1754967473 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4036610 con 0x7fa1dc0b0640 2023-12-19T13:47:45.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1754967473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 msgr2=0x7fa1dc06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1754967473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc06d230 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009e50 tx=0x7fa1d402e0e0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1754967473 shutdown_connections 2023-12-19T13:47:45.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1754967473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc06d230 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1754967473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1754967473 >> 172.21.15.113:0/1754967473 conn(0x7fa1dc0cbb70 msgr2=0x7fa1dc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:45.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1754967473 shutdown_connections 2023-12-19T13:47:45.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.860+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1754967473 wait complete. 2023-12-19T13:47:45.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.861+0000 7fa1e3f01640 1 Processor -- start 2023-12-19T13:47:45.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.862+0000 7fa1e3f01640 1 -- start start 2023-12-19T13:47:45.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.862+0000 7fa1e3f01640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.862+0000 7fa1e3f01640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.862+0000 7fa1e3f01640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1dc157bf0 0x7fa1dc1f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.862+0000 7fa1e3f01640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1ee950 con 0x7fa1dc0b0640 2023-12-19T13:47:45.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.862+0000 7fa1e3f01640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0a9e60 con 0x7fa1dc157bf0 2023-12-19T13:47:45.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.862+0000 7fa1e3f01640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1f2190 con 0x7fa1dc0ae110 2023-12-19T13:47:45.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50766/0 (socket says 172.21.15.113:50766) 2023-12-19T13:47:45.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 -- 172.21.15.113:0/1312439604 learned_addr learned my addr 172.21.15.113:0/1312439604 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e1c9d640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e249e640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1dc157bf0 0x7fa1dc1f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 -- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 msgr2=0x7fa1dc154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 -- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1dc157bf0 msgr2=0x7fa1dc1f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1dc157bf0 0x7fa1dc1f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 -- 172.21.15.113:0/1312439604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4009b30 con 0x7fa1dc0b0640 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e1c9d640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.863+0000 7fa1e149c640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc156750 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00b480 tx=0x7fa1cc00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:45.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.864+0000 7fa1d27fc640 1 -- 172.21.15.113:0/1312439604 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc010870 con 0x7fa1dc0b0640 2023-12-19T13:47:45.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.864+0000 7fa1d27fc640 1 -- 172.21.15.113:0/1312439604 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0109d0 con 0x7fa1dc0b0640 2023-12-19T13:47:45.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.864+0000 7fa1d27fc640 1 -- 172.21.15.113:0/1312439604 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc010d80 con 0x7fa1dc0b0640 2023-12-19T13:47:45.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.864+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc1f2380 con 0x7fa1dc0b0640 2023-12-19T13:47:45.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.864+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc1f2940 con 0x7fa1dc0b0640 2023-12-19T13:47:45.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.865+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc1eea90 con 0x7fa1dc0b0640 2023-12-19T13:47:45.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.866+0000 7fa1d27fc640 1 -- 172.21.15.113:0/1312439604 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1cc00f3c0 con 0x7fa1dc0b0640 2023-12-19T13:47:45.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.867+0000 7fa1d27fc640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1c006a430 0x7fa1c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:45.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.867+0000 7fa1d27fc640 1 -- 172.21.15.113:0/1312439604 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1cc088970 con 0x7fa1dc0b0640 2023-12-19T13:47:45.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.867+0000 7fa1e1c9d640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1c006a430 0x7fa1c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:45.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.868+0000 7fa1e1c9d640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1c006a430 0x7fa1c006c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0ace80 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:45.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:45.871+0000 7fa1d27fc640 1 -- 172.21.15.113:0/1312439604 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1cc053f50 con 0x7fa1dc0b0640 2023-12-19T13:47:46.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.099+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa1dc0b1090 con 0x7fa1dc0b0640 2023-12-19T13:47:46.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.788+0000 7fa1d27fc640 1 -- 172.21.15.113:0/1312439604 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa1cc0140b0 con 0x7fa1dc0b0640 2023-12-19T13:47:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1c006a430 msgr2=0x7fa1c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1c006a430 0x7fa1c006c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0ace80 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2023-12-19T13:47:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 msgr2=0x7fa1dc156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc156750 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00b480 tx=0x7fa1cc00b940 comp rx=0 tx=0).stop 2023-12-19T13:47:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 shutdown_connections 2023-12-19T13:47:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1c006a430 0x7fa1c006c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1dc157bf0 0x7fa1dc1f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:46.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1dc0b0640 0x7fa1dc156750 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:46.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 --2- 172.21.15.113:0/1312439604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1dc0ae110 0x7fa1dc154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:46.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 >> 172.21.15.113:0/1312439604 conn(0x7fa1dc0cbb70 msgr2=0x7fa1dc06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:46.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 shutdown_connections 2023-12-19T13:47:46.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:46.792+0000 7fa1e3f01640 1 -- 172.21.15.113:0/1312439604 wait complete. 2023-12-19T13:47:46.814 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:47:46.815 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:47:46.906 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-12-19T13:47:46.905+0000 7f71a6b3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:47:47.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.032+0000 7f50a6181640 1 Processor -- start 2023-12-19T13:47:47.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.032+0000 7f50a6181640 1 -- start start 2023-12-19T13:47:47.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.033+0000 7f50a6181640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 0x7f50a0161980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.033+0000 7f50a6181640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a0070e00 con 0x7f50a0071290 2023-12-19T13:47:47.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.033+0000 7f50a6181640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a0070540 con 0x7f50a0146cf0 2023-12-19T13:47:47.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.033+0000 7f50a6181640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00d2d20 con 0x7f50a00b7a70 2023-12-19T13:47:47.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.034+0000 7f50a497e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f50a0071290 0x7f50a00b7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48514/0 (socket says 172.21.15.113:48514) 2023-12-19T13:47:47.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.034+0000 7f50a497e640 1 -- 172.21.15.113:0/2150851058 learned_addr learned my addr 172.21.15.113:0/2150851058 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.034+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663343633 0 0) 0x7f50a0070e00 con 0x7f50a0071290 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.034+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f508c003520 con 0x7f50a0071290 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.034+0000 7f50a5980640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 0x7f50a0161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.034+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 510225250 0 0) 0x7f508c003520 con 0x7f50a0071290 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 msgr2=0x7f50a0161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 0x7f50a0161980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 >> v1:172.21.15.151:6789/0 conn(0x7f50a0146cf0 legacy=0x7f50a00d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a01470d0 con 0x7f50a0071290 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5090001670 con 0x7f50a0071290 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 >> v1:172.21.15.113:6789/0 conn(0x7f50a0071290 legacy=0x7f50a00b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c003a10 0x7f508c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 0x7f508c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508c004d70 0x7f508c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00d2d20 con 0x7f508c004d70 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c00bbc0 con 0x7f508c003a10 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c00bd80 con 0x7f50a00b7a70 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f50a5980640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508c004d70 0x7f508c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f50a497e640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 0x7f508c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f50a517f640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c003a10 0x7f508c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f50a5980640 1 -- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 msgr2=0x7f508c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f50a5980640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a00b7a70 0x7f508c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.035+0000 7f50a5980640 1 -- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c003a10 msgr2=0x7f508c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.036+0000 7f50a5980640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c003a10 0x7f508c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.036+0000 7f50a5980640 1 -- 172.21.15.113:0/2150851058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c003520 con 0x7f508c004d70 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.037+0000 7f50a5980640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508c004d70 0x7f508c0051f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f50a00b3590 tx=0x7f508c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1faf7092ef5225a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.037+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509802cb70 con 0x7f508c004d70 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.037+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509802ccd0 con 0x7f508c004d70 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.037+0000 7f5097fff640 1 -- 172.21.15.113:0/2150851058 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098034660 con 0x7f508c004d70 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.037+0000 7f50a6181640 1 -- 172.21.15.113:0/2150851058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508c004d70 msgr2=0x7f508c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.037+0000 7f50a6181640 1 --2- 172.21.15.113:0/2150851058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508c004d70 0x7f508c0051f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f50a00b3590 tx=0x7f508c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.037+0000 7f50a5980640 1 -- 172.21.15.113:0/2150851058 reap_dead start 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.038+0000 7f50a6181640 1 -- 172.21.15.113:0/2150851058 shutdown_connections 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.038+0000 7f50a6181640 1 -- 172.21.15.113:0/2150851058 >> 172.21.15.113:0/2150851058 conn(0x7f50a00d31b0 msgr2=0x7f50a00d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.038+0000 7f50a6181640 1 -- 172.21.15.113:0/2150851058 shutdown_connections 2023-12-19T13:47:47.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.038+0000 7f50a6181640 1 -- 172.21.15.113:0/2150851058 wait complete. 2023-12-19T13:47:47.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.040+0000 7f50a6181640 1 Processor -- start 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.040+0000 7f50a6181640 1 -- start start 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a6181640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c004d70 0x7f50a0144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a6181640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50a015cbb0 0x7f50a01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a6181640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a015d030 0x7f50a0158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a6181640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a015c790 con 0x7f50a015cbb0 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a6181640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a015b8c0 con 0x7f508c004d70 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a6181640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a015bb10 con 0x7f50a015d030 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50a015cbb0 0x7f50a01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50a015cbb0 0x7f50a01584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50786/0 (socket says 172.21.15.113:50786) 2023-12-19T13:47:47.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 -- 172.21.15.113:0/2351802954 learned_addr learned my addr 172.21.15.113:0/2351802954 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:47.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a517f640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c004d70 0x7f50a0144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a5980640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a015d030 0x7f50a0158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 -- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a015d030 msgr2=0x7f50a0158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a015d030 0x7f50a0158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 -- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c004d70 msgr2=0x7f50a0144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c004d70 0x7f50a0144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a497e640 1 -- 172.21.15.113:0/2351802954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a015bdf0 con 0x7f50a015cbb0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.041+0000 7f50a517f640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c004d70 0x7f50a0144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.042+0000 7f50a497e640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50a015cbb0 0x7f50a01584d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f509000e830 tx=0x7f509000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.042+0000 7f5095ffb640 1 -- 172.21.15.113:0/2351802954 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000eee0 con 0x7f50a015cbb0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.042+0000 7f5095ffb640 1 -- 172.21.15.113:0/2351802954 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000c8d0 con 0x7f50a015cbb0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.042+0000 7f5095ffb640 1 -- 172.21.15.113:0/2351802954 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000cc80 con 0x7f50a015cbb0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.042+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a015c0d0 con 0x7f50a015cbb0 2023-12-19T13:47:47.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.042+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a0144d50 con 0x7f50a015cbb0 2023-12-19T13:47:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.043+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a015c8d0 con 0x7f50a015cbb0 2023-12-19T13:47:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.044+0000 7f5095ffb640 1 -- 172.21.15.113:0/2351802954 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f509001d460 con 0x7f50a015cbb0 2023-12-19T13:47:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.045+0000 7f5095ffb640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f508406a460 0x7f508406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.045+0000 7f5095ffb640 1 -- 172.21.15.113:0/2351802954 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5090088900 con 0x7f50a015cbb0 2023-12-19T13:47:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.045+0000 7f50a517f640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f508406a460 0x7f508406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.046+0000 7f50a517f640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f508406a460 0x7f508406c920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50a00cec50 tx=0x7f509c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.049+0000 7f5095ffb640 1 -- 172.21.15.113:0/2351802954 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f50a015c8d0 con 0x7f50a015cbb0 2023-12-19T13:47:47.157 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:47.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:47.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.278+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f50a015c8d0 con 0x7f50a015cbb0 2023-12-19T13:47:47.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.792+0000 7f5095ffb640 1 -- 172.21.15.113:0/2351802954 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f50a015c8d0 con 0x7f50a015cbb0 2023-12-19T13:47:47.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f508406a460 msgr2=0x7f508406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:47.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f508406a460 0x7f508406c920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50a00cec50 tx=0x7f509c009040 comp rx=0 tx=0).stop 2023-12-19T13:47:47.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50a015cbb0 msgr2=0x7f50a01584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:47.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50a015cbb0 0x7f50a01584d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f509000e830 tx=0x7f509000ecf0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 shutdown_connections 2023-12-19T13:47:47.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f508406a460 0x7f508406c920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50a015d030 0x7f50a0158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50a015cbb0 0x7f50a01584d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 --2- 172.21.15.113:0/2351802954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508c004d70 0x7f50a0144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:47.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 >> 172.21.15.113:0/2351802954 conn(0x7f50a00d31b0 msgr2=0x7f50a00b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:47.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.795+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 shutdown_connections 2023-12-19T13:47:47.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:47.796+0000 7f50a6181640 1 -- 172.21.15.113:0/2351802954 wait complete. 2023-12-19T13:47:47.814 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:47:47.814 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.030+0000 7f7d350d5640 1 Processor -- start 2023-12-19T13:47:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.030+0000 7f7d350d5640 1 -- start start 2023-12-19T13:47:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.031+0000 7f7d350d5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7d30157bf0 0x7f7d3015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d350d5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3015b740 con 0x7f7d300b0810 2023-12-19T13:47:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d350d5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300ae640 con 0x7f7d300ae110 2023-12-19T13:47:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d350d5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3006b8c0 con 0x7f7d30157bf0 2023-12-19T13:47:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d2f59e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7d300b0810 0x7f7d3006d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33934/0 (socket says 172.21.15.113:33934) 2023-12-19T13:47:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d2f59e640 1 -- 172.21.15.113:0/1532889072 learned_addr learned my addr 172.21.15.113:0/1532889072 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d2ed9d640 1 --2- 172.21.15.113:0/1532889072 >> v2:172.21.15.151:3300/0 conn(0x7f7d30157bf0 0x7f7d3015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441203965 0 0) 0x7f7d3015b740 con 0x7f7d300b0810 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.032+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d1c003520 con 0x7f7d300b0810 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 61726457 0 0) 0x7f7d1c003520 con 0x7f7d300b0810 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 >> v2:172.21.15.151:3300/0 conn(0x7f7d30157bf0 msgr2=0x7f7d3015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 --2- 172.21.15.113:0/1532889072 >> v2:172.21.15.151:3300/0 conn(0x7f7d30157bf0 0x7f7d3015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 >> v1:172.21.15.151:6789/0 conn(0x7f7d300ae110 legacy=0x7f7d300b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300ae920 con 0x7f7d300b0810 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f7d280019f0 con 0x7f7d300b0810 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 >> v1:172.21.15.113:6789/0 conn(0x7f7d300b0810 legacy=0x7f7d3006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c003a30 0x7f7d1c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d1c0047c0 0x7f7d1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d1c0051d0 0x7f7d1c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3006b8c0 con 0x7f7d1c0051d0 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c00c100 con 0x7f7d1c003a30 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c00c2c0 con 0x7f7d1c0047c0 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.033+0000 7f7d2f59e640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d1c0051d0 0x7f7d1c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.034+0000 7f7d2ed9d640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c003a30 0x7f7d1c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.034+0000 7f7d27fff640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d1c0047c0 0x7f7d1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.034+0000 7f7d2f59e640 1 -- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d1c0047c0 msgr2=0x7f7d1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.034+0000 7f7d2f59e640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d1c0047c0 0x7f7d1c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.034+0000 7f7d2f59e640 1 -- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c003a30 msgr2=0x7f7d1c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.034+0000 7f7d2f59e640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c003a30 0x7f7d1c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.034+0000 7f7d2f59e640 1 -- 172.21.15.113:0/1532889072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c003520 con 0x7f7d1c0051d0 2023-12-19T13:47:48.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.035+0000 7f7d2f59e640 1 -- 172.21.15.113:0/1532889072 reap_dead start 2023-12-19T13:47:48.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.035+0000 7f7d2f59e640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d1c0051d0 0x7f7d1c00b980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800a760 tx=0x7f7d1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de36be103f18d6b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.035+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28034630 con 0x7f7d1c0051d0 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.035+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2802f070 con 0x7f7d1c0051d0 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.035+0000 7f7d2e59c640 1 -- 172.21.15.113:0/1532889072 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28034a10 con 0x7f7d1c0051d0 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.036+0000 7f7d350d5640 1 -- 172.21.15.113:0/1532889072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d1c0051d0 msgr2=0x7f7d1c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.036+0000 7f7d350d5640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d1c0051d0 0x7f7d1c00b980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800a760 tx=0x7f7d1c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.036+0000 7f7d350d5640 1 -- 172.21.15.113:0/1532889072 shutdown_connections 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.036+0000 7f7d350d5640 1 --2- 172.21.15.113:0/1532889072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d1c0051d0 0x7f7d1c00b980 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.036+0000 7f7d350d5640 1 -- 172.21.15.113:0/1532889072 >> 172.21.15.113:0/1532889072 conn(0x7f7d300cbb70 msgr2=0x7f7d300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.036+0000 7f7d350d5640 1 -- 172.21.15.113:0/1532889072 shutdown_connections 2023-12-19T13:47:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.036+0000 7f7d350d5640 1 -- 172.21.15.113:0/1532889072 wait complete. 2023-12-19T13:47:48.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.038+0000 7f7d350d5640 1 Processor -- start 2023-12-19T13:47:48.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.038+0000 7f7d350d5640 1 -- start start 2023-12-19T13:47:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d350d5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c0051d0 0x7f7d301ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d350d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d30152b80 0x7f7d30155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d350d5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d301562c0 0x7f7d3015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d350d5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30154210 con 0x7f7d30152b80 2023-12-19T13:47:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d350d5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30157070 con 0x7f7d1c0051d0 2023-12-19T13:47:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d350d5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301567d0 con 0x7f7d301562c0 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d30152b80 0x7f7d30155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d30152b80 0x7f7d30155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54866/0 (socket says 172.21.15.113:54866) 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 -- 172.21.15.113:0/3444936476 learned_addr learned my addr 172.21.15.113:0/3444936476 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 -- 172.21.15.113:0/3444936476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d301562c0 msgr2=0x7f7d3015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d301562c0 0x7f7d3015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 -- 172.21.15.113:0/3444936476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c0051d0 msgr2=0x7f7d301ee7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d2ed9d640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c0051d0 0x7f7d301ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c0051d0 0x7f7d301ee7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.039+0000 7f7d27fff640 1 -- 172.21.15.113:0/3444936476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30156ab0 con 0x7f7d30152b80 2023-12-19T13:47:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.040+0000 7f7d27fff640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d30152b80 0x7f7d30155d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7d18001eb0 tx=0x7f7d1800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.040+0000 7f7d277fe640 1 -- 172.21.15.113:0/3444936476 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18005480 con 0x7f7d30152b80 2023-12-19T13:47:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.040+0000 7f7d277fe640 1 -- 172.21.15.113:0/3444936476 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d18003610 con 0x7f7d30152b80 2023-12-19T13:47:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.040+0000 7f7d277fe640 1 -- 172.21.15.113:0/3444936476 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18003980 con 0x7f7d30152b80 2023-12-19T13:47:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.040+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d30156d90 con 0x7f7d30152b80 2023-12-19T13:47:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.040+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301f1f00 con 0x7f7d30152b80 2023-12-19T13:47:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.041+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d30154070 con 0x7f7d30152b80 2023-12-19T13:47:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.042+0000 7f7d277fe640 1 -- 172.21.15.113:0/3444936476 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d18003ae0 con 0x7f7d30152b80 2023-12-19T13:47:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.043+0000 7f7d277fe640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1006a460 0x7f7d1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.043+0000 7f7d277fe640 1 -- 172.21.15.113:0/3444936476 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d18088820 con 0x7f7d30152b80 2023-12-19T13:47:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.043+0000 7f7d2ed9d640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1006a460 0x7f7d1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.044+0000 7f7d2ed9d640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1006a460 0x7f7d1006c920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d200098d0 tx=0x7f7d20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.048+0000 7f7d277fe640 1 -- 172.21.15.113:0/3444936476 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7d30154070 con 0x7f7d30152b80 2023-12-19T13:47:48.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.275+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d30154070 con 0x7f7d30152b80 2023-12-19T13:47:48.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.276+0000 7f7d277fe640 1 -- 172.21.15.113:0/3444936476 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f7d30154070 con 0x7f7d30152b80 2023-12-19T13:47:48.276 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:48.276 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:47:48.276 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1006a460 msgr2=0x7f7d1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1006a460 0x7f7d1006c920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d200098d0 tx=0x7f7d20008040 comp rx=0 tx=0).stop 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d30152b80 msgr2=0x7f7d30155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d30152b80 0x7f7d30155d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7d18001eb0 tx=0x7f7d1800d9d0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 shutdown_connections 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1006a460 0x7f7d1006c920 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d301562c0 0x7f7d3015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d30152b80 0x7f7d30155d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 --2- 172.21.15.113:0/3444936476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d1c0051d0 0x7f7d301ee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 >> 172.21.15.113:0/3444936476 conn(0x7f7d300cbb70 msgr2=0x7f7d3006d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:48.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.278+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 shutdown_connections 2023-12-19T13:47:48.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.279+0000 7f7d350d5640 1 -- 172.21.15.113:0/3444936476 wait complete. 2023-12-19T13:47:48.298 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:48.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.515+0000 7f3e56e57640 1 Processor -- start 2023-12-19T13:47:48.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.515+0000 7f3e56e57640 1 -- start start 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e56e57640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e5015e5a0 0x7f3e500b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e56e57640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e500cdbf0 0x7f3e500ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e56e57640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5015ec30 con 0x7f3e5015f680 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e56e57640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500ce560 con 0x7f3e5015e5a0 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e56e57640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5015e980 con 0x7f3e500cdbf0 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e55e55640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e5015e5a0 0x7f3e500b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e55e55640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e5015e5a0 0x7f3e500b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54868/0 (socket says 172.21.15.113:54868) 2023-12-19T13:47:48.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e55e55640 1 -- 172.21.15.113:0/3490003893 learned_addr learned my addr 172.21.15.113:0/3490003893 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:48.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e55e55640 1 -- 172.21.15.113:0/3490003893 >> v2:172.21.15.151:3300/0 conn(0x7f3e500cdbf0 msgr2=0x7f3e500ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:48.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.517+0000 7f3e55e55640 1 --2- 172.21.15.113:0/3490003893 >> v2:172.21.15.151:3300/0 conn(0x7f3e500cdbf0 0x7f3e500ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.518+0000 7f3e55e55640 1 -- 172.21.15.113:0/3490003893 >> v1:172.21.15.151:6789/0 conn(0x7f3e5015f680 legacy=0x7f3e500b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:48.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.518+0000 7f3e55e55640 1 -- 172.21.15.113:0/3490003893 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500b2f90 con 0x7f3e5015e5a0 2023-12-19T13:47:48.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.519+0000 7f3e55e55640 1 --2- 172.21.15.113:0/3490003893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e5015e5a0 0x7f3e500b2030 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009870 tx=0x7f3e4c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559a7b1c4ba88a25 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.519+0000 7f3e54e53640 1 -- 172.21.15.113:0/3490003893 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c031870 con 0x7f3e5015e5a0 2023-12-19T13:47:48.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.519+0000 7f3e54e53640 1 -- 172.21.15.113:0/3490003893 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0319d0 con 0x7f3e5015e5a0 2023-12-19T13:47:48.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.519+0000 7f3e54e53640 1 -- 172.21.15.113:0/3490003893 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c031d60 con 0x7f3e5015e5a0 2023-12-19T13:47:48.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 -- 172.21.15.113:0/3490003893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e5015e5a0 msgr2=0x7f3e500b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 --2- 172.21.15.113:0/3490003893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e5015e5a0 0x7f3e500b2030 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009870 tx=0x7f3e4c02b910 comp rx=0 tx=0).stop 2023-12-19T13:47:48.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 -- 172.21.15.113:0/3490003893 shutdown_connections 2023-12-19T13:47:48.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 --2- 172.21.15.113:0/3490003893 >> v2:172.21.15.151:3300/0 conn(0x7f3e500cdbf0 0x7f3e500ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 --2- 172.21.15.113:0/3490003893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e5015e5a0 0x7f3e500b2030 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 -- 172.21.15.113:0/3490003893 >> 172.21.15.113:0/3490003893 conn(0x7f3e500b0100 msgr2=0x7f3e500b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:48.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 -- 172.21.15.113:0/3490003893 shutdown_connections 2023-12-19T13:47:48.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.520+0000 7f3e56e57640 1 -- 172.21.15.113:0/3490003893 wait complete. 2023-12-19T13:47:48.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.522+0000 7f3e56e57640 1 Processor -- start 2023-12-19T13:47:48.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.522+0000 7f3e56e57640 1 -- start start 2023-12-19T13:47:48.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.523+0000 7f3e56e57640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500cdbf0 0x7f3e500cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.523+0000 7f3e56e57640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5015e5a0 0x7f3e500b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e56e57640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5015f680 0x7f3e500b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e56e57640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c8520 con 0x7f3e500cdbf0 2023-12-19T13:47:48.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e56e57640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5014a340 con 0x7f3e5015e5a0 2023-12-19T13:47:48.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e56e57640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500ca0c0 con 0x7f3e5015f680 2023-12-19T13:47:48.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500cdbf0 0x7f3e500cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500cdbf0 0x7f3e500cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54874/0 (socket says 172.21.15.113:54874) 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 -- 172.21.15.113:0/2072152933 learned_addr learned my addr 172.21.15.113:0/2072152933 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 -- 172.21.15.113:0/2072152933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5015f680 msgr2=0x7f3e500b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5015f680 0x7f3e500b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 -- 172.21.15.113:0/2072152933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5015e5a0 msgr2=0x7f3e500b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5015e5a0 0x7f3e500b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 -- 172.21.15.113:0/2072152933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0094d0 con 0x7f3e500cdbf0 2023-12-19T13:47:48.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.524+0000 7f3e55e55640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500cdbf0 0x7f3e500cd6a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c000c00 tx=0x7f3e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.525+0000 7f3e467fc640 1 -- 172.21.15.113:0/2072152933 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c031820 con 0x7f3e500cdbf0 2023-12-19T13:47:48.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.525+0000 7f3e467fc640 1 -- 172.21.15.113:0/2072152933 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0443f0 con 0x7f3e500cdbf0 2023-12-19T13:47:48.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.525+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e50149aa0 con 0x7f3e500cdbf0 2023-12-19T13:47:48.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.525+0000 7f3e467fc640 1 -- 172.21.15.113:0/2072152933 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0447a0 con 0x7f3e500cdbf0 2023-12-19T13:47:48.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.525+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5014a060 con 0x7f3e500cdbf0 2023-12-19T13:47:48.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.526+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e50061910 con 0x7f3e500cdbf0 2023-12-19T13:47:48.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.527+0000 7f3e467fc640 1 -- 172.21.15.113:0/2072152933 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e4c04d450 con 0x7f3e500cdbf0 2023-12-19T13:47:48.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.528+0000 7f3e467fc640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e3406a430 0x7f3e3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.528+0000 7f3e467fc640 1 -- 172.21.15.113:0/2072152933 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e4c02d040 con 0x7f3e500cdbf0 2023-12-19T13:47:48.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.528+0000 7f3e55654640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e3406a430 0x7f3e3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.529+0000 7f3e55654640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e3406a430 0x7f3e3406c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e5014da60 tx=0x7f3e40007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.533+0000 7f3e467fc640 1 -- 172.21.15.113:0/2072152933 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e4c0ddc80 con 0x7f3e500cdbf0 2023-12-19T13:47:48.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.724+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e500ce980 con 0x7f3e500cdbf0 2023-12-19T13:47:48.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.727+0000 7f3e467fc640 1 -- 172.21.15.113:0/2072152933 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f3e4c076730 con 0x7f3e500cdbf0 2023-12-19T13:47:48.727 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:48.727 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":34,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:45.770335+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e3406a430 msgr2=0x7f3e3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e3406a430 0x7f3e3406c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e5014da60 tx=0x7f3e40007990 comp rx=0 tx=0).stop 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500cdbf0 msgr2=0x7f3e500cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500cdbf0 0x7f3e500cd6a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c000c00 tx=0x7f3e4c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 shutdown_connections 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e3406a430 0x7f3e3406c8f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5015f680 0x7f3e500b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5015e5a0 0x7f3e500b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 --2- 172.21.15.113:0/2072152933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500cdbf0 0x7f3e500cd6a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 >> 172.21.15.113:0/2072152933 conn(0x7f3e500b0100 msgr2=0x7f3e5015b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:48.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 shutdown_connections 2023-12-19T13:47:48.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.731+0000 7f3e56e57640 1 -- 172.21.15.113:0/2072152933 wait complete. 2023-12-19T13:47:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:47:48.750 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:47:48.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.961+0000 7fbdba1f0640 1 Processor -- start 2023-12-19T13:47:48.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.962+0000 7fbdba1f0640 1 -- start start 2023-12-19T13:47:48.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.963+0000 7fbdba1f0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbdb4157c50 0x7fbdb4070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.963+0000 7fbdba1f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb40b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.963+0000 7fbdba1f0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb415dc30 con 0x7fbdb40b2460 2023-12-19T13:47:48.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.963+0000 7fbdba1f0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb415e8b0 con 0x7fbdb4157c50 2023-12-19T13:47:48.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.963+0000 7fbdba1f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb415df10 con 0x7fbdb40b6960 2023-12-19T13:47:48.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.964+0000 7fbdb3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb40b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.964+0000 7fbdb2ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbdb4157c50 0x7fbdb4070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.964+0000 7fbdb3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb40b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:55844/0 (socket says 172.21.15.113:55844) 2023-12-19T13:47:48.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.964+0000 7fbdb3fff640 1 -- 172.21.15.113:0/2076984074 learned_addr learned my addr 172.21.15.113:0/2076984074 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:48.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.965+0000 7fbdb3fff640 1 -- 172.21.15.113:0/2076984074 >> v2:172.21.15.151:3300/0 conn(0x7fbdb4157c50 msgr2=0x7fbdb4070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:48.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.965+0000 7fbdb3fff640 1 --2- 172.21.15.113:0/2076984074 >> v2:172.21.15.151:3300/0 conn(0x7fbdb4157c50 0x7fbdb4070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.965+0000 7fbdb3fff640 1 -- 172.21.15.113:0/2076984074 >> v1:172.21.15.151:6789/0 conn(0x7fbdb40b2460 legacy=0x7fbdb40b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.965+0000 7fbdb3fff640 1 -- 172.21.15.113:0/2076984074 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb415e1f0 con 0x7fbdb40b6960 2023-12-19T13:47:48.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.965+0000 7fbdb2ffd640 1 --2- 172.21.15.113:0/2076984074 >> v2:172.21.15.151:3300/0 conn(0x7fbdb4157c50 0x7fbdb4070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:47:48.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.966+0000 7fbdb3fff640 1 --2- 172.21.15.113:0/2076984074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb40b6e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009e50 tx=0x7fbdac02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44253b8fc03ef27a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.967+0000 7fbdb27fc640 1 -- 172.21.15.113:0/2076984074 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac02cb00 con 0x7fbdb40b6960 2023-12-19T13:47:48.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.967+0000 7fbdb27fc640 1 -- 172.21.15.113:0/2076984074 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac02cc60 con 0x7fbdb40b6960 2023-12-19T13:47:48.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.967+0000 7fbdb27fc640 1 -- 172.21.15.113:0/2076984074 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0343f0 con 0x7fbdb40b6960 2023-12-19T13:47:48.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 -- 172.21.15.113:0/2076984074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 msgr2=0x7fbdb40b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/2076984074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb40b6e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009e50 tx=0x7fbdac02bf60 comp rx=0 tx=0).stop 2023-12-19T13:47:48.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 -- 172.21.15.113:0/2076984074 shutdown_connections 2023-12-19T13:47:48.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/2076984074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb40b6e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/2076984074 >> v2:172.21.15.151:3300/0 conn(0x7fbdb4157c50 0x7fbdb4070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 -- 172.21.15.113:0/2076984074 >> 172.21.15.113:0/2076984074 conn(0x7fbdb40659d0 msgr2=0x7fbdb4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:48.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 -- 172.21.15.113:0/2076984074 shutdown_connections 2023-12-19T13:47:48.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.968+0000 7fbdba1f0640 1 -- 172.21.15.113:0/2076984074 wait complete. 2023-12-19T13:47:48.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.970+0000 7fbdba1f0640 1 Processor -- start 2023-12-19T13:47:48.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.970+0000 7fbdba1f0640 1 -- start start 2023-12-19T13:47:48.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.971+0000 7fbdba1f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb40b2460 0x7fbdb4153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.971+0000 7fbdba1f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb41f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.971+0000 7fbdba1f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdb4157c50 0x7fbdb41f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.971+0000 7fbdba1f0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4142a10 con 0x7fbdb40b2460 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.971+0000 7fbdba1f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4141e00 con 0x7fbdb4157c50 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.971+0000 7fbdba1f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb41420e0 con 0x7fbdb40b6960 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb40b2460 0x7fbdb4153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb40b2460 0x7fbdb4153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54890/0 (socket says 172.21.15.113:54890) 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 -- 172.21.15.113:0/4069676510 learned_addr learned my addr 172.21.15.113:0/4069676510 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb3fff640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdb4157c50 0x7fbdb41f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb2ffd640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb41f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 -- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 msgr2=0x7fbdb41f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb41f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 -- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdb4157c50 msgr2=0x7fbdb41f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdb4157c50 0x7fbdb41f6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:48.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb37fe640 1 -- 172.21.15.113:0/4069676510 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8009400 con 0x7fbdb40b2460 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb3fff640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdb4157c50 0x7fbdb41f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.972+0000 7fbdb2ffd640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb41f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.973+0000 7fbdb37fe640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb40b2460 0x7fbdb4153bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbda400c450 tx=0x7fbda400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.973+0000 7fbd9bfff640 1 -- 172.21.15.113:0/4069676510 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40052d0 con 0x7fbdb40b2460 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.973+0000 7fbd9bfff640 1 -- 172.21.15.113:0/4069676510 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4005430 con 0x7fbdb40b2460 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.973+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac009b30 con 0x7fbdb40b2460 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.973+0000 7fbd9bfff640 1 -- 172.21.15.113:0/4069676510 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4012870 con 0x7fbdb40b2460 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.973+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb41426a0 con 0x7fbdb40b2460 2023-12-19T13:47:48.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.974+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb4142830 con 0x7fbdb40b2460 2023-12-19T13:47:48.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.975+0000 7fbd9bfff640 1 -- 172.21.15.113:0/4069676510 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbda40129d0 con 0x7fbdb40b2460 2023-12-19T13:47:48.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.976+0000 7fbd9bfff640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbda006a430 0x7fbda006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:48.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.976+0000 7fbd9bfff640 1 -- 172.21.15.113:0/4069676510 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda4088430 con 0x7fbdb40b2460 2023-12-19T13:47:48.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.976+0000 7fbdb2ffd640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbda006a430 0x7fbda006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:48.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.977+0000 7fbdb2ffd640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbda006a430 0x7fbda006c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40d1110 tx=0x7fbda8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:48.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:48.980+0000 7fbd9bfff640 1 -- 172.21.15.113:0/4069676510 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbda4053a20 con 0x7fbdb40b2460 2023-12-19T13:47:49.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.165+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdb415d920 con 0x7fbda006a430 2023-12-19T13:47:49.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.179+0000 7fbd9bfff640 1 -- 172.21.15.113:0/4069676510 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283091 (secure 0 0 0) 0x7fbda80109a0 con 0x7fbda006a430 2023-12-19T13:47:49.183 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:49.184 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:47:49.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbda006a430 msgr2=0x7fbda006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbda006a430 0x7fbda006c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40d1110 tx=0x7fbda8008040 comp rx=0 tx=0).stop 2023-12-19T13:47:49.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb40b2460 msgr2=0x7fbdb4153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb40b2460 0x7fbdb4153bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbda400c450 tx=0x7fbda400c910 comp rx=0 tx=0).stop 2023-12-19T13:47:49.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 shutdown_connections 2023-12-19T13:47:49.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbda006a430 0x7fbda006c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdb4157c50 0x7fbdb41f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdb40b6960 0x7fbdb41f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 --2- 172.21.15.113:0/4069676510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb40b2460 0x7fbdb4153bf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 >> 172.21.15.113:0/4069676510 conn(0x7fbdb40659d0 msgr2=0x7fbdb40b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:49.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 shutdown_connections 2023-12-19T13:47:49.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.185+0000 7fbdba1f0640 1 -- 172.21.15.113:0/4069676510 wait complete. 2023-12-19T13:47:49.204 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-12-19T13:47:48.433533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2276,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560223,"statfs":{"total":1600000000,"available":1597668912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.156215"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793581+0000","last_change":"2023-12-19T13:47:44.792140+0000","last_active":"2023-12-19T13:47:44.793581+0000","last_peered":"2023-12-19T13:47:44.793581+0000","last_clean":"2023-12-19T13:47:44.793581+0000","last_became_active":"2023-12-19T13:47:44.791729+0000","last_became_peered":"2023-12-19T13:47:44.791729+0000","last_unstale":"2023-12-19T13:47:44.793581+0000","last_undegraded":"2023-12-19T13:47:44.793581+0000","last_fullsized":"2023-12-19T13:47:44.793581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:02.832767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789306+0000","last_change":"2023-12-19T13:47:44.789175+0000","last_active":"2023-12-19T13:47:44.789306+0000","last_peered":"2023-12-19T13:47:44.789306+0000","last_clean":"2023-12-19T13:47:44.789306+0000","last_became_active":"2023-12-19T13:47:44.788032+0000","last_became_peered":"2023-12-19T13:47:44.788032+0000","last_unstale":"2023-12-19T13:47:44.789306+0000","last_undegraded":"2023-12-19T13:47:44.789306+0000","last_fullsized":"2023-12-19T13:47:44.789306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:02.832767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793701+0000","last_change":"2023-12-19T13:47:44.793637+0000","last_active":"2023-12-19T13:47:44.793701+0000","last_peered":"2023-12-19T13:47:44.793701+0000","last_clean":"2023-12-19T13:47:44.793701+0000","last_became_active":"2023-12-19T13:47:44.793213+0000","last_became_peered":"2023-12-19T13:47:44.793213+0000","last_unstale":"2023-12-19T13:47:44.793701+0000","last_undegraded":"2023-12-19T13:47:44.793701+0000","last_fullsized":"2023-12-19T13:47:44.793701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:59.611272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797466+0000","last_change":"2023-12-19T13:47:44.797011+0000","last_active":"2023-12-19T13:47:44.797466+0000","last_peered":"2023-12-19T13:47:44.797466+0000","last_clean":"2023-12-19T13:47:44.797466+0000","last_became_active":"2023-12-19T13:47:44.795664+0000","last_became_peered":"2023-12-19T13:47:44.795664+0000","last_unstale":"2023-12-19T13:47:44.797466+0000","last_undegraded":"2023-12-19T13:47:44.797466+0000","last_fullsized":"2023-12-19T13:47:44.797466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:54.100559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.795499+0000","last_change":"2023-12-19T13:47:44.795135+0000","last_active":"2023-12-19T13:47:44.795499+0000","last_peered":"2023-12-19T13:47:44.795499+0000","last_clean":"2023-12-19T13:47:44.795499+0000","last_became_active":"2023-12-19T13:47:44.794895+0000","last_became_peered":"2023-12-19T13:47:44.794895+0000","last_unstale":"2023-12-19T13:47:44.795499+0000","last_undegraded":"2023-12-19T13:47:44.795499+0000","last_fullsized":"2023-12-19T13:47:44.795499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:10.688471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793868+0000","last_change":"2023-12-19T13:47:44.793597+0000","last_active":"2023-12-19T13:47:44.793868+0000","last_peered":"2023-12-19T13:47:44.793868+0000","last_clean":"2023-12-19T13:47:44.793868+0000","last_became_active":"2023-12-19T13:47:44.793360+0000","last_became_peered":"2023-12-19T13:47:44.793360+0000","last_unstale":"2023-12-19T13:47:44.793868+0000","last_undegraded":"2023-12-19T13:47:44.793868+0000","last_fullsized":"2023-12-19T13:47:44.793868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:08.182342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.795417+0000","last_change":"2023-12-19T13:47:44.795097+0000","last_active":"2023-12-19T13:47:44.795417+0000","last_peered":"2023-12-19T13:47:44.795417+0000","last_clean":"2023-12-19T13:47:44.795417+0000","last_became_active":"2023-12-19T13:47:44.794891+0000","last_became_peered":"2023-12-19T13:47:44.794891+0000","last_unstale":"2023-12-19T13:47:44.795417+0000","last_undegraded":"2023-12-19T13:47:44.795417+0000","last_fullsized":"2023-12-19T13:47:44.795417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:21.895844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793536+0000","last_change":"2023-12-19T13:47:44.791453+0000","last_active":"2023-12-19T13:47:44.793536+0000","last_peered":"2023-12-19T13:47:44.793536+0000","last_clean":"2023-12-19T13:47:44.793536+0000","last_became_active":"2023-12-19T13:47:44.791044+0000","last_became_peered":"2023-12-19T13:47:44.791044+0000","last_unstale":"2023-12-19T13:47:44.793536+0000","last_undegraded":"2023-12-19T13:47:44.793536+0000","last_fullsized":"2023-12-19T13:47:44.793536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790242+0000","last_change":"2023-12-19T13:47:44.789483+0000","last_active":"2023-12-19T13:47:44.790242+0000","last_peered":"2023-12-19T13:47:44.790242+0000","last_clean":"2023-12-19T13:47:44.790242+0000","last_became_active":"2023-12-19T13:47:44.789229+0000","last_became_peered":"2023-12-19T13:47:44.789229+0000","last_unstale":"2023-12-19T13:47:44.790242+0000","last_undegraded":"2023-12-19T13:47:44.790242+0000","last_fullsized":"2023-12-19T13:47:44.790242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:33.834040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788560+0000","last_change":"2023-12-19T13:47:44.787785+0000","last_active":"2023-12-19T13:47:44.788560+0000","last_peered":"2023-12-19T13:47:44.788560+0000","last_clean":"2023-12-19T13:47:44.788560+0000","last_became_active":"2023-12-19T13:47:44.787547+0000","last_became_peered":"2023-12-19T13:47:44.787547+0000","last_unstale":"2023-12-19T13:47:44.788560+0000","last_undegraded":"2023-12-19T13:47:44.788560+0000","last_fullsized":"2023-12-19T13:47:44.788560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:21.895844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787528+0000","last_change":"2023-12-19T13:47:44.783521+0000","last_active":"2023-12-19T13:47:44.787528+0000","last_peered":"2023-12-19T13:47:44.787528+0000","last_clean":"2023-12-19T13:47:44.787528+0000","last_became_active":"2023-12-19T13:47:44.783303+0000","last_became_peered":"2023-12-19T13:47:44.783303+0000","last_unstale":"2023-12-19T13:47:44.787528+0000","last_undegraded":"2023-12-19T13:47:44.787528+0000","last_fullsized":"2023-12-19T13:47:44.787528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:07.543874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790207+0000","last_change":"2023-12-19T13:47:44.787781+0000","last_active":"2023-12-19T13:47:44.790207+0000","last_peered":"2023-12-19T13:47:44.790207+0000","last_clean":"2023-12-19T13:47:44.790207+0000","last_became_active":"2023-12-19T13:47:44.787487+0000","last_became_peered":"2023-12-19T13:47:44.787487+0000","last_unstale":"2023-12-19T13:47:44.790207+0000","last_undegraded":"2023-12-19T13:47:44.790207+0000","last_fullsized":"2023-12-19T13:47:44.790207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:08.182342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.792081+0000","last_change":"2023-12-19T13:47:44.790872+0000","last_active":"2023-12-19T13:47:44.792081+0000","last_peered":"2023-12-19T13:47:44.792081+0000","last_clean":"2023-12-19T13:47:44.792081+0000","last_became_active":"2023-12-19T13:47:44.790644+0000","last_became_peered":"2023-12-19T13:47:44.790644+0000","last_unstale":"2023-12-19T13:47:44.792081+0000","last_undegraded":"2023-12-19T13:47:44.792081+0000","last_fullsized":"2023-12-19T13:47:44.792081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788466+0000","last_change":"2023-12-19T13:47:44.788294+0000","last_active":"2023-12-19T13:47:44.788466+0000","last_peered":"2023-12-19T13:47:44.788466+0000","last_clean":"2023-12-19T13:47:44.788466+0000","last_became_active":"2023-12-19T13:47:44.787369+0000","last_became_peered":"2023-12-19T13:47:44.787369+0000","last_unstale":"2023-12-19T13:47:44.788466+0000","last_undegraded":"2023-12-19T13:47:44.788466+0000","last_fullsized":"2023-12-19T13:47:44.788466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:13.400041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796072+0000","last_change":"2023-12-19T13:47:44.795236+0000","last_active":"2023-12-19T13:47:44.796072+0000","last_peered":"2023-12-19T13:47:44.796072+0000","last_clean":"2023-12-19T13:47:44.796072+0000","last_became_active":"2023-12-19T13:47:44.795024+0000","last_became_peered":"2023-12-19T13:47:44.795024+0000","last_unstale":"2023-12-19T13:47:44.796072+0000","last_undegraded":"2023-12-19T13:47:44.796072+0000","last_fullsized":"2023-12-19T13:47:44.796072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:10.688471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781938+0000","last_change":"2023-12-19T13:47:44.781680+0000","last_active":"2023-12-19T13:47:44.781938+0000","last_peered":"2023-12-19T13:47:44.781938+0000","last_clean":"2023-12-19T13:47:44.781938+0000","last_became_active":"2023-12-19T13:47:44.781288+0000","last_became_peered":"2023-12-19T13:47:44.781288+0000","last_unstale":"2023-12-19T13:47:44.781938+0000","last_undegraded":"2023-12-19T13:47:44.781938+0000","last_fullsized":"2023-12-19T13:47:44.781938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797290+0000","last_change":"2023-12-19T13:47:44.797070+0000","last_active":"2023-12-19T13:47:44.797290+0000","last_peered":"2023-12-19T13:47:44.797290+0000","last_clean":"2023-12-19T13:47:44.797290+0000","last_became_active":"2023-12-19T13:47:44.795123+0000","last_became_peered":"2023-12-19T13:47:44.795123+0000","last_unstale":"2023-12-19T13:47:44.797290+0000","last_undegraded":"2023-12-19T13:47:44.797290+0000","last_fullsized":"2023-12-19T13:47:44.797290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:10.775424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790320+0000","last_change":"2023-12-19T13:47:44.790068+0000","last_active":"2023-12-19T13:47:44.790320+0000","last_peered":"2023-12-19T13:47:44.790320+0000","last_clean":"2023-12-19T13:47:44.790320+0000","last_became_active":"2023-12-19T13:47:44.789562+0000","last_became_peered":"2023-12-19T13:47:44.789562+0000","last_unstale":"2023-12-19T13:47:44.790320+0000","last_undegraded":"2023-12-19T13:47:44.790320+0000","last_fullsized":"2023-12-19T13:47:44.790320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:08.285735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788998+0000","last_change":"2023-12-19T13:47:44.786305+0000","last_active":"2023-12-19T13:47:44.788998+0000","last_peered":"2023-12-19T13:47:44.788998+0000","last_clean":"2023-12-19T13:47:44.788998+0000","last_became_active":"2023-12-19T13:47:44.785961+0000","last_became_peered":"2023-12-19T13:47:44.785961+0000","last_unstale":"2023-12-19T13:47:44.788998+0000","last_undegraded":"2023-12-19T13:47:44.788998+0000","last_fullsized":"2023-12-19T13:47:44.788998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:35.081586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793524+0000","last_change":"2023-12-19T13:47:44.792819+0000","last_active":"2023-12-19T13:47:44.793524+0000","last_peered":"2023-12-19T13:47:44.793524+0000","last_clean":"2023-12-19T13:47:44.793524+0000","last_became_active":"2023-12-19T13:47:44.792404+0000","last_became_peered":"2023-12-19T13:47:44.792404+0000","last_unstale":"2023-12-19T13:47:44.793524+0000","last_undegraded":"2023-12-19T13:47:44.793524+0000","last_fullsized":"2023-12-19T13:47:44.793524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:46.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790463+0000","last_change":"2023-12-19T13:47:44.790337+0000","last_active":"2023-12-19T13:47:44.790463+0000","last_peered":"2023-12-19T13:47:44.790463+0000","last_clean":"2023-12-19T13:47:44.790463+0000","last_became_active":"2023-12-19T13:47:44.790098+0000","last_became_peered":"2023-12-19T13:47:44.790098+0000","last_unstale":"2023-12-19T13:47:44.790463+0000","last_undegraded":"2023-12-19T13:47:44.790463+0000","last_fullsized":"2023-12-19T13:47:44.790463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:00.798164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797912+0000","last_change":"2023-12-19T13:47:44.797662+0000","last_active":"2023-12-19T13:47:44.797912+0000","last_peered":"2023-12-19T13:47:44.797912+0000","last_clean":"2023-12-19T13:47:44.797912+0000","last_became_active":"2023-12-19T13:47:44.796995+0000","last_became_peered":"2023-12-19T13:47:44.796995+0000","last_unstale":"2023-12-19T13:47:44.797912+0000","last_undegraded":"2023-12-19T13:47:44.797912+0000","last_fullsized":"2023-12-19T13:47:44.797912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793883+0000","last_change":"2023-12-19T13:47:44.793833+0000","last_active":"2023-12-19T13:47:44.793883+0000","last_peered":"2023-12-19T13:47:44.793883+0000","last_clean":"2023-12-19T13:47:44.793883+0000","last_became_active":"2023-12-19T13:47:44.793619+0000","last_became_peered":"2023-12-19T13:47:44.793619+0000","last_unstale":"2023-12-19T13:47:44.793883+0000","last_undegraded":"2023-12-19T13:47:44.793883+0000","last_fullsized":"2023-12-19T13:47:44.793883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:51:35.444912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793506+0000","last_change":"2023-12-19T13:47:44.791203+0000","last_active":"2023-12-19T13:47:44.793506+0000","last_peered":"2023-12-19T13:47:44.793506+0000","last_clean":"2023-12-19T13:47:44.793506+0000","last_became_active":"2023-12-19T13:47:44.790286+0000","last_became_peered":"2023-12-19T13:47:44.790286+0000","last_unstale":"2023-12-19T13:47:44.793506+0000","last_undegraded":"2023-12-19T13:47:44.793506+0000","last_fullsized":"2023-12-19T13:47:44.793506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:10.688471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789295+0000","last_change":"2023-12-19T13:47:44.788982+0000","last_active":"2023-12-19T13:47:44.789295+0000","last_peered":"2023-12-19T13:47:44.789295+0000","last_clean":"2023-12-19T13:47:44.789295+0000","last_became_active":"2023-12-19T13:47:44.788758+0000","last_became_peered":"2023-12-19T13:47:44.788758+0000","last_unstale":"2023-12-19T13:47:44.789295+0000","last_undegraded":"2023-12-19T13:47:44.789295+0000","last_fullsized":"2023-12-19T13:47:44.789295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:10.284266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.792674+0000","last_change":"2023-12-19T13:47:44.789402+0000","last_active":"2023-12-19T13:47:44.792674+0000","last_peered":"2023-12-19T13:47:44.792674+0000","last_clean":"2023-12-19T13:47:44.792674+0000","last_became_active":"2023-12-19T13:47:44.789098+0000","last_became_peered":"2023-12-19T13:47:44.789098+0000","last_unstale":"2023-12-19T13:47:44.792674+0000","last_undegraded":"2023-12-19T13:47:44.792674+0000","last_fullsized":"2023-12-19T13:47:44.792674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:53:01.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790222+0000","last_change":"2023-12-19T13:47:44.790133+0000","last_active":"2023-12-19T13:47:44.790222+0000","last_peered":"2023-12-19T13:47:44.790222+0000","last_clean":"2023-12-19T13:47:44.790222+0000","last_became_active":"2023-12-19T13:47:44.789763+0000","last_became_peered":"2023-12-19T13:47:44.789763+0000","last_unstale":"2023-12-19T13:47:44.790222+0000","last_undegraded":"2023-12-19T13:47:44.790222+0000","last_fullsized":"2023-12-19T13:47:44.790222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793476+0000","last_change":"2023-12-19T13:47:44.790837+0000","last_active":"2023-12-19T13:47:44.793476+0000","last_peered":"2023-12-19T13:47:44.793476+0000","last_clean":"2023-12-19T13:47:44.793476+0000","last_became_active":"2023-12-19T13:47:44.789559+0000","last_became_peered":"2023-12-19T13:47:44.789559+0000","last_unstale":"2023-12-19T13:47:44.793476+0000","last_undegraded":"2023-12-19T13:47:44.793476+0000","last_fullsized":"2023-12-19T13:47:44.793476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:30.119612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786045+0000","last_change":"2023-12-19T13:47:44.783305+0000","last_active":"2023-12-19T13:47:44.786045+0000","last_peered":"2023-12-19T13:47:44.786045+0000","last_clean":"2023-12-19T13:47:44.786045+0000","last_became_active":"2023-12-19T13:47:44.782428+0000","last_became_peered":"2023-12-19T13:47:44.782428+0000","last_unstale":"2023-12-19T13:47:44.786045+0000","last_undegraded":"2023-12-19T13:47:44.786045+0000","last_fullsized":"2023-12-19T13:47:44.786045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:02.832767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781393+0000","last_change":"2023-12-19T13:47:44.781320+0000","last_active":"2023-12-19T13:47:44.781393+0000","last_peered":"2023-12-19T13:47:44.781393+0000","last_clean":"2023-12-19T13:47:44.781393+0000","last_became_active":"2023-12-19T13:47:44.781107+0000","last_became_peered":"2023-12-19T13:47:44.781107+0000","last_unstale":"2023-12-19T13:47:44.781393+0000","last_undegraded":"2023-12-19T13:47:44.781393+0000","last_fullsized":"2023-12-19T13:47:44.781393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793662+0000","last_change":"2023-12-19T13:47:44.793079+0000","last_active":"2023-12-19T13:47:44.793662+0000","last_peered":"2023-12-19T13:47:44.793662+0000","last_clean":"2023-12-19T13:47:44.793662+0000","last_became_active":"2023-12-19T13:47:44.792827+0000","last_became_peered":"2023-12-19T13:47:44.792827+0000","last_unstale":"2023-12-19T13:47:44.793662+0000","last_undegraded":"2023-12-19T13:47:44.793662+0000","last_fullsized":"2023-12-19T13:47:44.793662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:46.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797015+0000","last_change":"2023-12-19T13:47:44.796916+0000","last_active":"2023-12-19T13:47:44.797015+0000","last_peered":"2023-12-19T13:47:44.797015+0000","last_clean":"2023-12-19T13:47:44.797015+0000","last_became_active":"2023-12-19T13:47:44.794810+0000","last_became_peered":"2023-12-19T13:47:44.794810+0000","last_unstale":"2023-12-19T13:47:44.797015+0000","last_undegraded":"2023-12-19T13:47:44.797015+0000","last_fullsized":"2023-12-19T13:47:44.797015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:44.627092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796180+0000","last_change":"2023-12-19T13:47:44.795762+0000","last_active":"2023-12-19T13:47:44.796180+0000","last_peered":"2023-12-19T13:47:44.796180+0000","last_clean":"2023-12-19T13:47:44.796180+0000","last_became_active":"2023-12-19T13:47:44.794329+0000","last_became_peered":"2023-12-19T13:47:44.794329+0000","last_unstale":"2023-12-19T13:47:44.796180+0000","last_undegraded":"2023-12-19T13:47:44.796180+0000","last_fullsized":"2023-12-19T13:47:44.796180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.802251+0000","last_change":"2023-12-19T13:47:44.311368+0000","last_active":"2023-12-19T13:47:44.802251+0000","last_peered":"2023-12-19T13:47:44.802251+0000","last_clean":"2023-12-19T13:47:44.802251+0000","last_became_active":"2023-12-19T13:47:44.311130+0000","last_became_peered":"2023-12-19T13:47:44.311130+0000","last_unstale":"2023-12-19T13:47:44.802251+0000","last_undegraded":"2023-12-19T13:47:44.802251+0000","last_fullsized":"2023-12-19T13:47:44.802251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:01.820614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793521+0000","last_change":"2023-12-19T13:47:44.791330+0000","last_active":"2023-12-19T13:47:44.793521+0000","last_peered":"2023-12-19T13:47:44.793521+0000","last_clean":"2023-12-19T13:47:44.793521+0000","last_became_active":"2023-12-19T13:47:44.790614+0000","last_became_peered":"2023-12-19T13:47:44.790614+0000","last_unstale":"2023-12-19T13:47:44.793521+0000","last_undegraded":"2023-12-19T13:47:44.793521+0000","last_fullsized":"2023-12-19T13:47:44.793521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800106+0000","last_change":"2023-12-19T13:47:44.313558+0000","last_active":"2023-12-19T13:47:44.800106+0000","last_peered":"2023-12-19T13:47:44.800106+0000","last_clean":"2023-12-19T13:47:44.800106+0000","last_became_active":"2023-12-19T13:47:44.311973+0000","last_became_peered":"2023-12-19T13:47:44.311973+0000","last_unstale":"2023-12-19T13:47:44.800106+0000","last_undegraded":"2023-12-19T13:47:44.800106+0000","last_fullsized":"2023-12-19T13:47:44.800106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:32.821887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793551+0000","last_change":"2023-12-19T13:47:44.792007+0000","last_active":"2023-12-19T13:47:44.793551+0000","last_peered":"2023-12-19T13:47:44.793551+0000","last_clean":"2023-12-19T13:47:44.793551+0000","last_became_active":"2023-12-19T13:47:44.789468+0000","last_became_peered":"2023-12-19T13:47:44.789468+0000","last_unstale":"2023-12-19T13:47:44.793551+0000","last_undegraded":"2023-12-19T13:47:44.793551+0000","last_fullsized":"2023-12-19T13:47:44.793551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:00.798164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.801737+0000","last_change":"2023-12-19T13:47:44.299452+0000","last_active":"2023-12-19T13:47:44.801737+0000","last_peered":"2023-12-19T13:47:44.801737+0000","last_clean":"2023-12-19T13:47:44.801737+0000","last_became_active":"2023-12-19T13:47:44.298779+0000","last_became_peered":"2023-12-19T13:47:44.298779+0000","last_unstale":"2023-12-19T13:47:44.801737+0000","last_undegraded":"2023-12-19T13:47:44.801737+0000","last_fullsized":"2023-12-19T13:47:44.801737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:20.871950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796788+0000","last_change":"2023-12-19T13:47:44.795781+0000","last_active":"2023-12-19T13:47:44.796788+0000","last_peered":"2023-12-19T13:47:44.796788+0000","last_clean":"2023-12-19T13:47:44.796788+0000","last_became_active":"2023-12-19T13:47:44.795407+0000","last_became_peered":"2023-12-19T13:47:44.795407+0000","last_unstale":"2023-12-19T13:47:44.796788+0000","last_undegraded":"2023-12-19T13:47:44.796788+0000","last_fullsized":"2023-12-19T13:47:44.796788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:19.884220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.799510+0000","last_change":"2023-12-19T13:47:44.310346+0000","last_active":"2023-12-19T13:47:44.799510+0000","last_peered":"2023-12-19T13:47:44.799510+0000","last_clean":"2023-12-19T13:47:44.799510+0000","last_became_active":"2023-12-19T13:47:44.310077+0000","last_became_peered":"2023-12-19T13:47:44.310077+0000","last_unstale":"2023-12-19T13:47:44.799510+0000","last_undegraded":"2023-12-19T13:47:44.799510+0000","last_fullsized":"2023-12-19T13:47:44.799510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:06.178538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790227+0000","last_change":"2023-12-19T13:47:44.788625+0000","last_active":"2023-12-19T13:47:44.790227+0000","last_peered":"2023-12-19T13:47:44.790227+0000","last_clean":"2023-12-19T13:47:44.790227+0000","last_became_active":"2023-12-19T13:47:44.787879+0000","last_became_peered":"2023-12-19T13:47:44.787879+0000","last_unstale":"2023-12-19T13:47:44.790227+0000","last_undegraded":"2023-12-19T13:47:44.790227+0000","last_fullsized":"2023-12-19T13:47:44.790227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:07.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800230+0000","last_change":"2023-12-19T13:47:44.304481+0000","last_active":"2023-12-19T13:47:44.800230+0000","last_peered":"2023-12-19T13:47:44.800230+0000","last_clean":"2023-12-19T13:47:44.800230+0000","last_became_active":"2023-12-19T13:47:44.303714+0000","last_became_peered":"2023-12-19T13:47:44.303714+0000","last_unstale":"2023-12-19T13:47:44.800230+0000","last_undegraded":"2023-12-19T13:47:44.800230+0000","last_fullsized":"2023-12-19T13:47:44.800230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:15.688587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.794135+0000","last_change":"2023-12-19T13:47:44.794072+0000","last_active":"2023-12-19T13:47:44.794135+0000","last_peered":"2023-12-19T13:47:44.794135+0000","last_clean":"2023-12-19T13:47:44.794135+0000","last_became_active":"2023-12-19T13:47:44.793688+0000","last_became_peered":"2023-12-19T13:47:44.793688+0000","last_unstale":"2023-12-19T13:47:44.794135+0000","last_undegraded":"2023-12-19T13:47:44.794135+0000","last_fullsized":"2023-12-19T13:47:44.794135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:51:35.444912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800705+0000","last_change":"2023-12-19T13:47:44.304224+0000","last_active":"2023-12-19T13:47:44.800705+0000","last_peered":"2023-12-19T13:47:44.800705+0000","last_clean":"2023-12-19T13:47:44.800705+0000","last_became_active":"2023-12-19T13:47:44.303799+0000","last_became_peered":"2023-12-19T13:47:44.303799+0000","last_unstale":"2023-12-19T13:47:44.800705+0000","last_undegraded":"2023-12-19T13:47:44.800705+0000","last_fullsized":"2023-12-19T13:47:44.800705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:34.069434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.782976+0000","last_change":"2023-12-19T13:47:44.782775+0000","last_active":"2023-12-19T13:47:44.782976+0000","last_peered":"2023-12-19T13:47:44.782976+0000","last_clean":"2023-12-19T13:47:44.782976+0000","last_became_active":"2023-12-19T13:47:44.782455+0000","last_became_peered":"2023-12-19T13:47:44.782455+0000","last_unstale":"2023-12-19T13:47:44.782976+0000","last_undegraded":"2023-12-19T13:47:44.782976+0000","last_fullsized":"2023-12-19T13:47:44.782976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:30.676137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.774392+0000","last_change":"2023-12-19T13:47:44.303863+0000","last_active":"2023-12-19T13:47:44.774392+0000","last_peered":"2023-12-19T13:47:44.774392+0000","last_clean":"2023-12-19T13:47:44.774392+0000","last_became_active":"2023-12-19T13:47:44.303436+0000","last_became_peered":"2023-12-19T13:47:44.303436+0000","last_unstale":"2023-12-19T13:47:44.774392+0000","last_undegraded":"2023-12-19T13:47:44.774392+0000","last_fullsized":"2023-12-19T13:47:44.774392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:07.783819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796804+0000","last_change":"2023-12-19T13:47:44.796005+0000","last_active":"2023-12-19T13:47:44.796804+0000","last_peered":"2023-12-19T13:47:44.796804+0000","last_clean":"2023-12-19T13:47:44.796804+0000","last_became_active":"2023-12-19T13:47:44.794613+0000","last_became_peered":"2023-12-19T13:47:44.794613+0000","last_unstale":"2023-12-19T13:47:44.796804+0000","last_undegraded":"2023-12-19T13:47:44.796804+0000","last_fullsized":"2023-12-19T13:47:44.796804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:55.438021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789646+0000","last_change":"2023-12-19T13:47:44.306019+0000","last_active":"2023-12-19T13:47:44.789646+0000","last_peered":"2023-12-19T13:47:44.789646+0000","last_clean":"2023-12-19T13:47:44.789646+0000","last_became_active":"2023-12-19T13:47:44.305390+0000","last_became_peered":"2023-12-19T13:47:44.305390+0000","last_unstale":"2023-12-19T13:47:44.789646+0000","last_undegraded":"2023-12-19T13:47:44.789646+0000","last_fullsized":"2023-12-19T13:47:44.789646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:53.036919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.791209+0000","last_change":"2023-12-19T13:47:44.789996+0000","last_active":"2023-12-19T13:47:44.791209+0000","last_peered":"2023-12-19T13:47:44.791209+0000","last_clean":"2023-12-19T13:47:44.791209+0000","last_became_active":"2023-12-19T13:47:44.789782+0000","last_became_peered":"2023-12-19T13:47:44.789782+0000","last_unstale":"2023-12-19T13:47:44.791209+0000","last_undegraded":"2023-12-19T13:47:44.791209+0000","last_fullsized":"2023-12-19T13:47:44.791209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:55.438021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779858+0000","last_change":"2023-12-19T13:47:44.300916+0000","last_active":"2023-12-19T13:47:44.779858+0000","last_peered":"2023-12-19T13:47:44.779858+0000","last_clean":"2023-12-19T13:47:44.779858+0000","last_became_active":"2023-12-19T13:47:44.300551+0000","last_became_peered":"2023-12-19T13:47:44.300551+0000","last_unstale":"2023-12-19T13:47:44.779858+0000","last_undegraded":"2023-12-19T13:47:44.779858+0000","last_fullsized":"2023-12-19T13:47:44.779858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:32.821887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787863+0000","last_change":"2023-12-19T13:47:44.787759+0000","last_active":"2023-12-19T13:47:44.787863+0000","last_peered":"2023-12-19T13:47:44.787863+0000","last_clean":"2023-12-19T13:47:44.787863+0000","last_became_active":"2023-12-19T13:47:44.787416+0000","last_became_peered":"2023-12-19T13:47:44.787416+0000","last_unstale":"2023-12-19T13:47:44.787863+0000","last_undegraded":"2023-12-19T13:47:44.787863+0000","last_fullsized":"2023-12-19T13:47:44.787863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:58.999322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781765+0000","last_change":"2023-12-19T13:47:44.300911+0000","last_active":"2023-12-19T13:47:44.781765+0000","last_peered":"2023-12-19T13:47:44.781765+0000","last_clean":"2023-12-19T13:47:44.781765+0000","last_became_active":"2023-12-19T13:47:44.296346+0000","last_became_peered":"2023-12-19T13:47:44.296346+0000","last_unstale":"2023-12-19T13:47:44.781765+0000","last_undegraded":"2023-12-19T13:47:44.781765+0000","last_fullsized":"2023-12-19T13:47:44.781765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:29.663985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796913+0000","last_change":"2023-12-19T13:47:44.796583+0000","last_active":"2023-12-19T13:47:44.796913+0000","last_peered":"2023-12-19T13:47:44.796913+0000","last_clean":"2023-12-19T13:47:44.796913+0000","last_became_active":"2023-12-19T13:47:44.795327+0000","last_became_peered":"2023-12-19T13:47:44.795327+0000","last_unstale":"2023-12-19T13:47:44.796913+0000","last_undegraded":"2023-12-19T13:47:44.796913+0000","last_fullsized":"2023-12-19T13:47:44.796913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:23:31.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800850+0000","last_change":"2023-12-19T13:47:44.309977+0000","last_active":"2023-12-19T13:47:44.800850+0000","last_peered":"2023-12-19T13:47:44.800850+0000","last_clean":"2023-12-19T13:47:44.800850+0000","last_became_active":"2023-12-19T13:47:44.309731+0000","last_became_peered":"2023-12-19T13:47:44.309731+0000","last_unstale":"2023-12-19T13:47:44.800850+0000","last_undegraded":"2023-12-19T13:47:44.800850+0000","last_fullsized":"2023-12-19T13:47:44.800850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:09.676319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787592+0000","last_change":"2023-12-19T13:47:44.786559+0000","last_active":"2023-12-19T13:47:44.787592+0000","last_peered":"2023-12-19T13:47:44.787592+0000","last_clean":"2023-12-19T13:47:44.787592+0000","last_became_active":"2023-12-19T13:47:44.786308+0000","last_became_peered":"2023-12-19T13:47:44.786308+0000","last_unstale":"2023-12-19T13:47:44.787592+0000","last_undegraded":"2023-12-19T13:47:44.787592+0000","last_fullsized":"2023-12-19T13:47:44.787592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:04.411242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.803433+0000","last_change":"2023-12-19T13:47:44.313311+0000","last_active":"2023-12-19T13:47:44.803433+0000","last_peered":"2023-12-19T13:47:44.803433+0000","last_clean":"2023-12-19T13:47:44.803433+0000","last_became_active":"2023-12-19T13:47:44.313076+0000","last_became_peered":"2023-12-19T13:47:44.313076+0000","last_unstale":"2023-12-19T13:47:44.803433+0000","last_undegraded":"2023-12-19T13:47:44.803433+0000","last_fullsized":"2023-12-19T13:47:44.803433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:55.569812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796199+0000","last_change":"2023-12-19T13:47:44.794086+0000","last_active":"2023-12-19T13:47:44.796199+0000","last_peered":"2023-12-19T13:47:44.796199+0000","last_clean":"2023-12-19T13:47:44.796199+0000","last_became_active":"2023-12-19T13:47:44.792414+0000","last_became_peered":"2023-12-19T13:47:44.792414+0000","last_unstale":"2023-12-19T13:47:44.796199+0000","last_undegraded":"2023-12-19T13:47:44.796199+0000","last_fullsized":"2023-12-19T13:47:44.796199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:30.119612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800506+0000","last_change":"2023-12-19T13:47:44.311819+0000","last_active":"2023-12-19T13:47:44.800506+0000","last_peered":"2023-12-19T13:47:44.800506+0000","last_clean":"2023-12-19T13:47:44.800506+0000","last_became_active":"2023-12-19T13:47:44.311490+0000","last_became_peered":"2023-12-19T13:47:44.311490+0000","last_unstale":"2023-12-19T13:47:44.800506+0000","last_undegraded":"2023-12-19T13:47:44.800506+0000","last_fullsized":"2023-12-19T13:47:44.800506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:53.420003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.795425+0000","last_change":"2023-12-19T13:47:44.795033+0000","last_active":"2023-12-19T13:47:44.795425+0000","last_peered":"2023-12-19T13:47:44.795425+0000","last_clean":"2023-12-19T13:47:44.795425+0000","last_became_active":"2023-12-19T13:47:44.794798+0000","last_became_peered":"2023-12-19T13:47:44.794798+0000","last_unstale":"2023-12-19T13:47:44.795425+0000","last_undegraded":"2023-12-19T13:47:44.795425+0000","last_fullsized":"2023-12-19T13:47:44.795425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779555+0000","last_change":"2023-12-19T13:47:44.313048+0000","last_active":"2023-12-19T13:47:44.779555+0000","last_peered":"2023-12-19T13:47:44.779555+0000","last_clean":"2023-12-19T13:47:44.779555+0000","last_became_active":"2023-12-19T13:47:44.312829+0000","last_became_peered":"2023-12-19T13:47:44.312829+0000","last_unstale":"2023-12-19T13:47:44.779555+0000","last_undegraded":"2023-12-19T13:47:44.779555+0000","last_fullsized":"2023-12-19T13:47:44.779555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:58.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793599+0000","last_change":"2023-12-19T13:47:44.792407+0000","last_active":"2023-12-19T13:47:44.793599+0000","last_peered":"2023-12-19T13:47:44.793599+0000","last_clean":"2023-12-19T13:47:44.793599+0000","last_became_active":"2023-12-19T13:47:44.792173+0000","last_became_peered":"2023-12-19T13:47:44.792173+0000","last_unstale":"2023-12-19T13:47:44.793599+0000","last_undegraded":"2023-12-19T13:47:44.793599+0000","last_fullsized":"2023-12-19T13:47:44.793599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:48.298666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.778344+0000","last_change":"2023-12-19T13:47:44.307661+0000","last_active":"2023-12-19T13:47:44.778344+0000","last_peered":"2023-12-19T13:47:44.778344+0000","last_clean":"2023-12-19T13:47:44.778344+0000","last_became_active":"2023-12-19T13:47:44.307237+0000","last_became_peered":"2023-12-19T13:47:44.307237+0000","last_unstale":"2023-12-19T13:47:44.778344+0000","last_undegraded":"2023-12-19T13:47:44.778344+0000","last_fullsized":"2023-12-19T13:47:44.778344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:09:14.488787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796304+0000","last_change":"2023-12-19T13:47:44.795540+0000","last_active":"2023-12-19T13:47:44.796304+0000","last_peered":"2023-12-19T13:47:44.796304+0000","last_clean":"2023-12-19T13:47:44.796304+0000","last_became_active":"2023-12-19T13:47:44.794499+0000","last_became_peered":"2023-12-19T13:47:44.794499+0000","last_unstale":"2023-12-19T13:47:44.796304+0000","last_undegraded":"2023-12-19T13:47:44.796304+0000","last_fullsized":"2023-12-19T13:47:44.796304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:18.009013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.802018+0000","last_change":"2023-12-19T13:47:44.309501+0000","last_active":"2023-12-19T13:47:44.802018+0000","last_peered":"2023-12-19T13:47:44.802018+0000","last_clean":"2023-12-19T13:47:44.802018+0000","last_became_active":"2023-12-19T13:47:44.309144+0000","last_became_peered":"2023-12-19T13:47:44.309144+0000","last_unstale":"2023-12-19T13:47:44.802018+0000","last_undegraded":"2023-12-19T13:47:44.802018+0000","last_fullsized":"2023-12-19T13:47:44.802018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:52:46.974148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787576+0000","last_change":"2023-12-19T13:47:44.784957+0000","last_active":"2023-12-19T13:47:44.787576+0000","last_peered":"2023-12-19T13:47:44.787576+0000","last_clean":"2023-12-19T13:47:44.787576+0000","last_became_active":"2023-12-19T13:47:44.784586+0000","last_became_peered":"2023-12-19T13:47:44.784586+0000","last_unstale":"2023-12-19T13:47:44.787576+0000","last_undegraded":"2023-12-19T13:47:44.787576+0000","last_fullsized":"2023-12-19T13:47:44.787576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:54.100559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.802409+0000","last_change":"2023-12-19T13:47:44.307363+0000","last_active":"2023-12-19T13:47:44.802409+0000","last_peered":"2023-12-19T13:47:44.802409+0000","last_clean":"2023-12-19T13:47:44.802409+0000","last_became_active":"2023-12-19T13:47:44.306933+0000","last_became_peered":"2023-12-19T13:47:44.306933+0000","last_unstale":"2023-12-19T13:47:44.802409+0000","last_undegraded":"2023-12-19T13:47:44.802409+0000","last_fullsized":"2023-12-19T13:47:44.802409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:15.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786101+0000","last_change":"2023-12-19T13:47:44.785604+0000","last_active":"2023-12-19T13:47:44.786101+0000","last_peered":"2023-12-19T13:47:44.786101+0000","last_clean":"2023-12-19T13:47:44.786101+0000","last_became_active":"2023-12-19T13:47:44.785312+0000","last_became_peered":"2023-12-19T13:47:44.785312+0000","last_unstale":"2023-12-19T13:47:44.786101+0000","last_undegraded":"2023-12-19T13:47:44.786101+0000","last_fullsized":"2023-12-19T13:47:44.786101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:08.285735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800232+0000","last_change":"2023-12-19T13:47:44.301041+0000","last_active":"2023-12-19T13:47:44.800232+0000","last_peered":"2023-12-19T13:47:44.800232+0000","last_clean":"2023-12-19T13:47:44.800232+0000","last_became_active":"2023-12-19T13:47:44.300820+0000","last_became_peered":"2023-12-19T13:47:44.300820+0000","last_unstale":"2023-12-19T13:47:44.800232+0000","last_undegraded":"2023-12-19T13:47:44.800232+0000","last_fullsized":"2023-12-19T13:47:44.800232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:06:25.699306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790127+0000","last_change":"2023-12-19T13:47:44.789988+0000","last_active":"2023-12-19T13:47:44.790127+0000","last_peered":"2023-12-19T13:47:44.790127+0000","last_clean":"2023-12-19T13:47:44.790127+0000","last_became_active":"2023-12-19T13:47:44.789429+0000","last_became_peered":"2023-12-19T13:47:44.789429+0000","last_unstale":"2023-12-19T13:47:44.790127+0000","last_undegraded":"2023-12-19T13:47:44.790127+0000","last_fullsized":"2023-12-19T13:47:44.790127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.798103+0000","last_change":"2023-12-19T13:47:44.311311+0000","last_active":"2023-12-19T13:47:44.798103+0000","last_peered":"2023-12-19T13:47:44.798103+0000","last_clean":"2023-12-19T13:47:44.798103+0000","last_became_active":"2023-12-19T13:47:44.310861+0000","last_became_peered":"2023-12-19T13:47:44.310861+0000","last_unstale":"2023-12-19T13:47:44.798103+0000","last_undegraded":"2023-12-19T13:47:44.798103+0000","last_fullsized":"2023-12-19T13:47:44.798103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:58.108202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788980+0000","last_change":"2023-12-19T13:47:44.786263+0000","last_active":"2023-12-19T13:47:44.788980+0000","last_peered":"2023-12-19T13:47:44.788980+0000","last_clean":"2023-12-19T13:47:44.788980+0000","last_became_active":"2023-12-19T13:47:44.785890+0000","last_became_peered":"2023-12-19T13:47:44.785890+0000","last_unstale":"2023-12-19T13:47:44.788980+0000","last_undegraded":"2023-12-19T13:47:44.788980+0000","last_fullsized":"2023-12-19T13:47:44.788980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:56.581964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.774236+0000","last_change":"2023-12-19T13:47:44.309725+0000","last_active":"2023-12-19T13:47:44.774236+0000","last_peered":"2023-12-19T13:47:44.774236+0000","last_clean":"2023-12-19T13:47:44.774236+0000","last_became_active":"2023-12-19T13:47:44.309397+0000","last_became_peered":"2023-12-19T13:47:44.309397+0000","last_unstale":"2023-12-19T13:47:44.774236+0000","last_undegraded":"2023-12-19T13:47:44.774236+0000","last_fullsized":"2023-12-19T13:47:44.774236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:58.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.791117+0000","last_change":"2023-12-19T13:47:44.789523+0000","last_active":"2023-12-19T13:47:44.791117+0000","last_peered":"2023-12-19T13:47:44.791117+0000","last_clean":"2023-12-19T13:47:44.791117+0000","last_became_active":"2023-12-19T13:47:44.789294+0000","last_became_peered":"2023-12-19T13:47:44.789294+0000","last_unstale":"2023-12-19T13:47:44.791117+0000","last_undegraded":"2023-12-19T13:47:44.791117+0000","last_fullsized":"2023-12-19T13:47:44.791117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:08.346103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.798662+0000","last_change":"2023-12-19T13:47:44.304611+0000","last_active":"2023-12-19T13:47:44.798662+0000","last_peered":"2023-12-19T13:47:44.798662+0000","last_clean":"2023-12-19T13:47:44.798662+0000","last_became_active":"2023-12-19T13:47:44.304260+0000","last_became_peered":"2023-12-19T13:47:44.304260+0000","last_unstale":"2023-12-19T13:47:44.798662+0000","last_undegraded":"2023-12-19T13:47:44.798662+0000","last_fullsized":"2023-12-19T13:47:44.798662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:06.178538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.785879+0000","last_change":"2023-12-19T13:47:44.783465+0000","last_active":"2023-12-19T13:47:44.785879+0000","last_peered":"2023-12-19T13:47:44.785879+0000","last_clean":"2023-12-19T13:47:44.785879+0000","last_became_active":"2023-12-19T13:47:44.783237+0000","last_became_peered":"2023-12-19T13:47:44.783237+0000","last_unstale":"2023-12-19T13:47:44.785879+0000","last_undegraded":"2023-12-19T13:47:44.785879+0000","last_fullsized":"2023-12-19T13:47:44.785879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786031+0000","last_change":"2023-12-19T13:47:44.301198+0000","last_active":"2023-12-19T13:47:44.786031+0000","last_peered":"2023-12-19T13:47:44.786031+0000","last_clean":"2023-12-19T13:47:44.786031+0000","last_became_active":"2023-12-19T13:47:44.300864+0000","last_became_peered":"2023-12-19T13:47:44.300864+0000","last_unstale":"2023-12-19T13:47:44.786031+0000","last_undegraded":"2023-12-19T13:47:44.786031+0000","last_fullsized":"2023-12-19T13:47:44.786031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:34:44.187209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793862+0000","last_change":"2023-12-19T13:47:44.793231+0000","last_active":"2023-12-19T13:47:44.793862+0000","last_peered":"2023-12-19T13:47:44.793862+0000","last_clean":"2023-12-19T13:47:44.793862+0000","last_became_active":"2023-12-19T13:47:44.791755+0000","last_became_peered":"2023-12-19T13:47:44.791755+0000","last_unstale":"2023-12-19T13:47:44.793862+0000","last_undegraded":"2023-12-19T13:47:44.793862+0000","last_fullsized":"2023-12-19T13:47:44.793862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.777966+0000","last_change":"2023-12-19T13:47:44.295165+0000","last_active":"2023-12-19T13:47:44.777966+0000","last_peered":"2023-12-19T13:47:44.777966+0000","last_clean":"2023-12-19T13:47:44.777966+0000","last_became_active":"2023-12-19T13:47:44.294559+0000","last_became_peered":"2023-12-19T13:47:44.294559+0000","last_unstale":"2023-12-19T13:47:44.777966+0000","last_undegraded":"2023-12-19T13:47:44.777966+0000","last_fullsized":"2023-12-19T13:47:44.777966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:10.310288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.782954+0000","last_change":"2023-12-19T13:47:44.782653+0000","last_active":"2023-12-19T13:47:44.782954+0000","last_peered":"2023-12-19T13:47:44.782954+0000","last_clean":"2023-12-19T13:47:44.782954+0000","last_became_active":"2023-12-19T13:47:44.782183+0000","last_became_peered":"2023-12-19T13:47:44.782183+0000","last_unstale":"2023-12-19T13:47:44.782954+0000","last_undegraded":"2023-12-19T13:47:44.782954+0000","last_fullsized":"2023-12-19T13:47:44.782954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:09:15.500939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.777499+0000","last_change":"2023-12-19T13:47:44.311177+0000","last_active":"2023-12-19T13:47:44.777499+0000","last_peered":"2023-12-19T13:47:44.777499+0000","last_clean":"2023-12-19T13:47:44.777499+0000","last_became_active":"2023-12-19T13:47:44.310506+0000","last_became_peered":"2023-12-19T13:47:44.310506+0000","last_unstale":"2023-12-19T13:47:44.777499+0000","last_undegraded":"2023-12-19T13:47:44.777499+0000","last_fullsized":"2023-12-19T13:47:44.777499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:37.481104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.778664+0000","last_change":"2023-12-19T13:47:44.778206+0000","last_active":"2023-12-19T13:47:44.778664+0000","last_peered":"2023-12-19T13:47:44.778664+0000","last_clean":"2023-12-19T13:47:44.778664+0000","last_became_active":"2023-12-19T13:47:44.777960+0000","last_became_peered":"2023-12-19T13:47:44.777960+0000","last_unstale":"2023-12-19T13:47:44.778664+0000","last_undegraded":"2023-12-19T13:47:44.778664+0000","last_fullsized":"2023-12-19T13:47:44.778664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:08.331980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.801570+0000","last_change":"2023-12-19T13:47:44.304296+0000","last_active":"2023-12-19T13:47:44.801570+0000","last_peered":"2023-12-19T13:47:44.801570+0000","last_clean":"2023-12-19T13:47:44.801570+0000","last_became_active":"2023-12-19T13:47:44.303945+0000","last_became_peered":"2023-12-19T13:47:44.303945+0000","last_unstale":"2023-12-19T13:47:44.801570+0000","last_undegraded":"2023-12-19T13:47:44.801570+0000","last_fullsized":"2023-12-19T13:47:44.801570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:07.273583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787620+0000","last_change":"2023-12-19T13:47:44.787139+0000","last_active":"2023-12-19T13:47:44.787620+0000","last_peered":"2023-12-19T13:47:44.787620+0000","last_clean":"2023-12-19T13:47:44.787620+0000","last_became_active":"2023-12-19T13:47:44.786858+0000","last_became_peered":"2023-12-19T13:47:44.786858+0000","last_unstale":"2023-12-19T13:47:44.787620+0000","last_undegraded":"2023-12-19T13:47:44.787620+0000","last_fullsized":"2023-12-19T13:47:44.787620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:58.999322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.780531+0000","last_change":"2023-12-19T13:47:44.301611+0000","last_active":"2023-12-19T13:47:44.780531+0000","last_peered":"2023-12-19T13:47:44.780531+0000","last_clean":"2023-12-19T13:47:44.780531+0000","last_became_active":"2023-12-19T13:47:44.301200+0000","last_became_peered":"2023-12-19T13:47:44.301200+0000","last_unstale":"2023-12-19T13:47:44.780531+0000","last_undegraded":"2023-12-19T13:47:44.780531+0000","last_fullsized":"2023-12-19T13:47:44.780531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:58.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.783568+0000","last_change":"2023-12-19T13:47:44.783396+0000","last_active":"2023-12-19T13:47:44.783568+0000","last_peered":"2023-12-19T13:47:44.783568+0000","last_clean":"2023-12-19T13:47:44.783568+0000","last_became_active":"2023-12-19T13:47:44.783157+0000","last_became_peered":"2023-12-19T13:47:44.783157+0000","last_unstale":"2023-12-19T13:47:44.783568+0000","last_undegraded":"2023-12-19T13:47:44.783568+0000","last_fullsized":"2023-12-19T13:47:44.783568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:16.700739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.785649+0000","last_change":"2023-12-19T13:47:44.307801+0000","last_active":"2023-12-19T13:47:44.785649+0000","last_peered":"2023-12-19T13:47:44.785649+0000","last_clean":"2023-12-19T13:47:44.785649+0000","last_became_active":"2023-12-19T13:47:44.307372+0000","last_became_peered":"2023-12-19T13:47:44.307372+0000","last_unstale":"2023-12-19T13:47:44.785649+0000","last_undegraded":"2023-12-19T13:47:44.785649+0000","last_fullsized":"2023-12-19T13:47:44.785649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:53.420003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781273+0000","last_change":"2023-12-19T13:47:44.780430+0000","last_active":"2023-12-19T13:47:44.781273+0000","last_peered":"2023-12-19T13:47:44.781273+0000","last_clean":"2023-12-19T13:47:44.781273+0000","last_became_active":"2023-12-19T13:47:44.780229+0000","last_became_peered":"2023-12-19T13:47:44.780229+0000","last_unstale":"2023-12-19T13:47:44.781273+0000","last_undegraded":"2023-12-19T13:47:44.781273+0000","last_fullsized":"2023-12-19T13:47:44.781273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:30.119612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.785633+0000","last_change":"2023-12-19T13:47:44.307148+0000","last_active":"2023-12-19T13:47:44.785633+0000","last_peered":"2023-12-19T13:47:44.785633+0000","last_clean":"2023-12-19T13:47:44.785633+0000","last_became_active":"2023-12-19T13:47:44.306915+0000","last_became_peered":"2023-12-19T13:47:44.306915+0000","last_unstale":"2023-12-19T13:47:44.785633+0000","last_undegraded":"2023-12-19T13:47:44.785633+0000","last_fullsized":"2023-12-19T13:47:44.785633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:15.688587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793542+0000","last_change":"2023-12-19T13:47:44.793326+0000","last_active":"2023-12-19T13:47:44.793542+0000","last_peered":"2023-12-19T13:47:44.793542+0000","last_clean":"2023-12-19T13:47:44.793542+0000","last_became_active":"2023-12-19T13:47:44.792383+0000","last_became_peered":"2023-12-19T13:47:44.792383+0000","last_unstale":"2023-12-19T13:47:44.793542+0000","last_undegraded":"2023-12-19T13:47:44.793542+0000","last_fullsized":"2023-12-19T13:47:44.793542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:30.042487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786760+0000","last_change":"2023-12-19T13:47:44.311375+0000","last_active":"2023-12-19T13:47:44.786760+0000","last_peered":"2023-12-19T13:47:44.786760+0000","last_clean":"2023-12-19T13:47:44.786760+0000","last_became_active":"2023-12-19T13:47:44.311125+0000","last_became_peered":"2023-12-19T13:47:44.311125+0000","last_unstale":"2023-12-19T13:47:44.786760+0000","last_undegraded":"2023-12-19T13:47:44.786760+0000","last_fullsized":"2023-12-19T13:47:44.786760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:07.319828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796843+0000","last_change":"2023-12-19T13:47:44.796411+0000","last_active":"2023-12-19T13:47:44.796843+0000","last_peered":"2023-12-19T13:47:44.796843+0000","last_clean":"2023-12-19T13:47:44.796843+0000","last_became_active":"2023-12-19T13:47:44.794999+0000","last_became_peered":"2023-12-19T13:47:44.794999+0000","last_unstale":"2023-12-19T13:47:44.796843+0000","last_undegraded":"2023-12-19T13:47:44.796843+0000","last_fullsized":"2023-12-19T13:47:44.796843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:29:58.073869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789284+0000","last_change":"2023-12-19T13:47:44.311839+0000","last_active":"2023-12-19T13:47:44.789284+0000","last_peered":"2023-12-19T13:47:44.789284+0000","last_clean":"2023-12-19T13:47:44.789284+0000","last_became_active":"2023-12-19T13:47:44.311562+0000","last_became_peered":"2023-12-19T13:47:44.311562+0000","last_unstale":"2023-12-19T13:47:44.789284+0000","last_undegraded":"2023-12-19T13:47:44.789284+0000","last_fullsized":"2023-12-19T13:47:44.789284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:41.250132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779898+0000","last_change":"2023-12-19T13:47:44.779447+0000","last_active":"2023-12-19T13:47:44.779898+0000","last_peered":"2023-12-19T13:47:44.779898+0000","last_clean":"2023-12-19T13:47:44.779898+0000","last_became_active":"2023-12-19T13:47:44.778736+0000","last_became_peered":"2023-12-19T13:47:44.778736+0000","last_unstale":"2023-12-19T13:47:44.779898+0000","last_undegraded":"2023-12-19T13:47:44.779898+0000","last_fullsized":"2023-12-19T13:47:44.779898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:13.400041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779621+0000","last_change":"2023-12-19T13:47:44.313661+0000","last_active":"2023-12-19T13:47:44.779621+0000","last_peered":"2023-12-19T13:47:44.779621+0000","last_clean":"2023-12-19T13:47:44.779621+0000","last_became_active":"2023-12-19T13:47:44.312320+0000","last_became_peered":"2023-12-19T13:47:44.312320+0000","last_unstale":"2023-12-19T13:47:44.779621+0000","last_undegraded":"2023-12-19T13:47:44.779621+0000","last_fullsized":"2023-12-19T13:47:44.779621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:29.663985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786414+0000","last_change":"2023-12-19T13:47:44.786324+0000","last_active":"2023-12-19T13:47:44.786414+0000","last_peered":"2023-12-19T13:47:44.786414+0000","last_clean":"2023-12-19T13:47:44.786414+0000","last_became_active":"2023-12-19T13:47:44.785968+0000","last_became_peered":"2023-12-19T13:47:44.785968+0000","last_unstale":"2023-12-19T13:47:44.786414+0000","last_undegraded":"2023-12-19T13:47:44.786414+0000","last_fullsized":"2023-12-19T13:47:44.786414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.773304+0000","last_change":"2023-12-19T13:47:44.311166+0000","last_active":"2023-12-19T13:47:44.773304+0000","last_peered":"2023-12-19T13:47:44.773304+0000","last_clean":"2023-12-19T13:47:44.773304+0000","last_became_active":"2023-12-19T13:47:44.310161+0000","last_became_peered":"2023-12-19T13:47:44.310161+0000","last_unstale":"2023-12-19T13:47:44.773304+0000","last_undegraded":"2023-12-19T13:47:44.773304+0000","last_fullsized":"2023-12-19T13:47:44.773304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:35.263908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.283808+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:47:44.283808+0000","last_peered":"2023-12-19T13:47:44.283808+0000","last_clean":"2023-12-19T13:47:44.283808+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:47:44.283808+0000","last_undegraded":"2023-12-19T13:47:44.283808+0000","last_fullsized":"2023-12-19T13:47:44.283808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854867,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.3600000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.107}]},{"osd":2,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1619999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.514}]},{"osd":4,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.4119999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.4830000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.452},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.5720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.006},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":3.2069999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.262}]},{"osd":1,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.423},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4590000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":4.3899999999999997,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.4790000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.506}]},{"osd":5,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.181},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.304}]},{"osd":7,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.397},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194593,"statfs":{"total":200000000,"available":199263939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.70599999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.754}]},{"osd":2,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.0620000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.01},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.1319999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.266}]},{"osd":6,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.218},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.179}]},{"osd":7,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.3660000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.98299999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.95299999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.034}]},{"osd":3,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.361},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.135}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.087},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.268}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.3300000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.3839999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854113,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.72999999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.3769999999999998,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.3819999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0070000000000001,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.431},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.532}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.0940000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.73},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":1.6419999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.5609999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.032}]},{"osd":1,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.627},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.0029999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.204}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.964,"5min":2.964,"15min":2.964},"last":1.175},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.0800000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.1619999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.071},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.284}]},{"osd":2,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.2999999999999998,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.349}]},{"osd":3,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":7.157,"5min":7.157,"15min":7.157},"last":1.115}]},{"osd":4,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.0179999999999998,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.663},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.5940000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.7189999999999999,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.748}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.397}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":4.0519999999999996,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.5389999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854889,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.497},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.435}]},{"osd":4,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":4.4269999999999996,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":0.71499999999999997}]},{"osd":6,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":4.3570000000000002,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":0.878}]}]}],"pool_statfs":[]}} 2023-12-19T13:47:49.210 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:47:49.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.462+0000 7f61ac138640 1 Processor -- start 2023-12-19T13:47:49.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.462+0000 7f61ac138640 1 -- start start 2023-12-19T13:47:49.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61ac138640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a4161020 0x7f61a415da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61ac138640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a415df70 con 0x7f61a4143690 2023-12-19T13:47:49.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61ac138640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a4143ac0 con 0x7f61a4143230 2023-12-19T13:47:49.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61ac138640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a415e1a0 con 0x7f61a4161020 2023-12-19T13:47:49.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61aa6d5640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f61a4143690 0x7f61a40b89a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33942/0 (socket says 172.21.15.113:33942) 2023-12-19T13:47:49.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61aa6d5640 1 -- 172.21.15.113:0/3846302675 learned_addr learned my addr 172.21.15.113:0/3846302675 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:49.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61a9ed4640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a4161020 0x7f61a415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141633753 0 0) 0x7f61a415df70 con 0x7f61a4143690 2023-12-19T13:47:49.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.464+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6190003520 con 0x7f61a4143690 2023-12-19T13:47:49.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205683182 0 0) 0x7f6190003520 con 0x7f61a4143690 2023-12-19T13:47:49.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a4161020 msgr2=0x7f61a415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a4161020 0x7f61a415da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 >> v1:172.21.15.151:6789/0 conn(0x7f61a4143230 legacy=0x7f61a40b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a415e480 con 0x7f61a4143690 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f619c0019f0 con 0x7f61a4143690 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 >> v1:172.21.15.113:6789/0 conn(0x7f61a4143690 legacy=0x7f61a40b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6190003a10 0x7f6190003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a4161020 0x7f61900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f6190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a415e1a0 con 0x7f6190004d00 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619000ba90 con 0x7f6190003a10 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619000bc50 con 0x7f61a4161020 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61aa6d5640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f6190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61aa6d5640 1 -- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a4161020 msgr2=0x7f61900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:49.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.465+0000 7f61aa6d5640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a4161020 0x7f61900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.466+0000 7f61aa6d5640 1 -- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6190003a10 msgr2=0x7f6190003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:49.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.466+0000 7f61aa6d5640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6190003a10 0x7f6190003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.466+0000 7f61aa6d5640 1 -- 172.21.15.113:0/3846302675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190003520 con 0x7f6190004d00 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61aa6d5640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f6190005180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f619c002230 tx=0x7f61900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b834a56a3343a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c034630 con 0x7f6190004d00 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c02f070 con 0x7f6190004d00 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61a8ed2640 1 -- 172.21.15.113:0/3846302675 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0349d0 con 0x7f6190004d00 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61ac138640 1 -- 172.21.15.113:0/3846302675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 msgr2=0x7f6190005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61ac138640 1 --2- 172.21.15.113:0/3846302675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f6190005180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f619c002230 tx=0x7f61900057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61aa6d5640 1 -- 172.21.15.113:0/3846302675 reap_dead start 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61ac138640 1 -- 172.21.15.113:0/3846302675 shutdown_connections 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.467+0000 7f61ac138640 1 -- 172.21.15.113:0/3846302675 >> 172.21.15.113:0/3846302675 conn(0x7f61a40b26f0 msgr2=0x7f61a40b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.468+0000 7f61ac138640 1 -- 172.21.15.113:0/3846302675 shutdown_connections 2023-12-19T13:47:49.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.468+0000 7f61ac138640 1 -- 172.21.15.113:0/3846302675 wait complete. 2023-12-19T13:47:49.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.469+0000 7f61ac138640 1 Processor -- start 2023-12-19T13:47:49.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.469+0000 7f61ac138640 1 -- start start 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.470+0000 7f61ac138640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f61a4158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.470+0000 7f61ac138640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a41415a0 0x7f61a4141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.470+0000 7f61ac138640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a415fca0 0x7f61a4160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.470+0000 7f61ac138640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4141f60 con 0x7f6190004d00 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.470+0000 7f61ac138640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4155bd0 con 0x7f61a41415a0 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.470+0000 7f61ac138640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4160a70 con 0x7f61a415fca0 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f61a4158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f61a4158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54906/0 (socket says 172.21.15.113:54906) 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 -- 172.21.15.113:0/2057612738 learned_addr learned my addr 172.21.15.113:0/2057612738 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 -- 172.21.15.113:0/2057612738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a415fca0 msgr2=0x7f61a4160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a415fca0 0x7f61a4160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 -- 172.21.15.113:0/2057612738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a41415a0 msgr2=0x7f61a4141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a41415a0 0x7f61a4141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 -- 172.21.15.113:0/2057612738 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a41552a0 con 0x7f6190004d00 2023-12-19T13:47:49.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f61a9ed4640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f61a4158590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f61a000e780 tx=0x7f61a000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:49.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.471+0000 7f619a7fc640 1 -- 172.21.15.113:0/2057612738 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000ee90 con 0x7f6190004d00 2023-12-19T13:47:49.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.472+0000 7f619a7fc640 1 -- 172.21.15.113:0/2057612738 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000c940 con 0x7f6190004d00 2023-12-19T13:47:49.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.472+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a4155580 con 0x7f6190004d00 2023-12-19T13:47:49.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.472+0000 7f619a7fc640 1 -- 172.21.15.113:0/2057612738 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000ccf0 con 0x7f6190004d00 2023-12-19T13:47:49.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.472+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a4158ad0 con 0x7f6190004d00 2023-12-19T13:47:49.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.473+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4061910 con 0x7f6190004d00 2023-12-19T13:47:49.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.474+0000 7f619a7fc640 1 -- 172.21.15.113:0/2057612738 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61a0013470 con 0x7f6190004d00 2023-12-19T13:47:49.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.474+0000 7f619a7fc640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f618806a430 0x7f618806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.475+0000 7f619a7fc640 1 -- 172.21.15.113:0/2057612738 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61a0088d10 con 0x7f6190004d00 2023-12-19T13:47:49.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.475+0000 7f61a96d3640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f618806a430 0x7f618806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.475+0000 7f61a96d3640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f618806a430 0x7f618806c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f61a4155100 tx=0x7f6194007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:49.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.479+0000 7f619a7fc640 1 -- 172.21.15.113:0/2057612738 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61a0054390 con 0x7f6190004d00 2023-12-19T13:47:49.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.663+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61a4142d10 con 0x7f618806a430 2023-12-19T13:47:49.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.685+0000 7f619a7fc640 1 -- 172.21.15.113:0/2057612738 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283091 (secure 0 0 0) 0x7f6194005080 con 0x7f618806a430 2023-12-19T13:47:49.688 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:49.689 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:47:49.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f618806a430 msgr2=0x7f618806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f618806a430 0x7f618806c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f61a4155100 tx=0x7f6194007990 comp rx=0 tx=0).stop 2023-12-19T13:47:49.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 msgr2=0x7f61a4158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f61a4158590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f61a000e780 tx=0x7f61a000ec40 comp rx=0 tx=0).stop 2023-12-19T13:47:49.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 shutdown_connections 2023-12-19T13:47:49.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f618806a430 0x7f618806c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61a415fca0 0x7f61a4160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a41415a0 0x7f61a4141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 --2- 172.21.15.113:0/2057612738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6190004d00 0x7f61a4158590 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.690+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 >> 172.21.15.113:0/2057612738 conn(0x7f61a40b26f0 msgr2=0x7f61a40d38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:49.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.691+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 shutdown_connections 2023-12-19T13:47:49.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.691+0000 7f61ac138640 1 -- 172.21.15.113:0/2057612738 wait complete. 2023-12-19T13:47:49.709 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-12-19T13:47:48.433533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2276,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560223,"statfs":{"total":1600000000,"available":1597668912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.156215"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793581+0000","last_change":"2023-12-19T13:47:44.792140+0000","last_active":"2023-12-19T13:47:44.793581+0000","last_peered":"2023-12-19T13:47:44.793581+0000","last_clean":"2023-12-19T13:47:44.793581+0000","last_became_active":"2023-12-19T13:47:44.791729+0000","last_became_peered":"2023-12-19T13:47:44.791729+0000","last_unstale":"2023-12-19T13:47:44.793581+0000","last_undegraded":"2023-12-19T13:47:44.793581+0000","last_fullsized":"2023-12-19T13:47:44.793581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:02.832767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789306+0000","last_change":"2023-12-19T13:47:44.789175+0000","last_active":"2023-12-19T13:47:44.789306+0000","last_peered":"2023-12-19T13:47:44.789306+0000","last_clean":"2023-12-19T13:47:44.789306+0000","last_became_active":"2023-12-19T13:47:44.788032+0000","last_became_peered":"2023-12-19T13:47:44.788032+0000","last_unstale":"2023-12-19T13:47:44.789306+0000","last_undegraded":"2023-12-19T13:47:44.789306+0000","last_fullsized":"2023-12-19T13:47:44.789306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:02.832767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793701+0000","last_change":"2023-12-19T13:47:44.793637+0000","last_active":"2023-12-19T13:47:44.793701+0000","last_peered":"2023-12-19T13:47:44.793701+0000","last_clean":"2023-12-19T13:47:44.793701+0000","last_became_active":"2023-12-19T13:47:44.793213+0000","last_became_peered":"2023-12-19T13:47:44.793213+0000","last_unstale":"2023-12-19T13:47:44.793701+0000","last_undegraded":"2023-12-19T13:47:44.793701+0000","last_fullsized":"2023-12-19T13:47:44.793701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:59.611272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797466+0000","last_change":"2023-12-19T13:47:44.797011+0000","last_active":"2023-12-19T13:47:44.797466+0000","last_peered":"2023-12-19T13:47:44.797466+0000","last_clean":"2023-12-19T13:47:44.797466+0000","last_became_active":"2023-12-19T13:47:44.795664+0000","last_became_peered":"2023-12-19T13:47:44.795664+0000","last_unstale":"2023-12-19T13:47:44.797466+0000","last_undegraded":"2023-12-19T13:47:44.797466+0000","last_fullsized":"2023-12-19T13:47:44.797466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:54.100559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.795499+0000","last_change":"2023-12-19T13:47:44.795135+0000","last_active":"2023-12-19T13:47:44.795499+0000","last_peered":"2023-12-19T13:47:44.795499+0000","last_clean":"2023-12-19T13:47:44.795499+0000","last_became_active":"2023-12-19T13:47:44.794895+0000","last_became_peered":"2023-12-19T13:47:44.794895+0000","last_unstale":"2023-12-19T13:47:44.795499+0000","last_undegraded":"2023-12-19T13:47:44.795499+0000","last_fullsized":"2023-12-19T13:47:44.795499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:10.688471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793868+0000","last_change":"2023-12-19T13:47:44.793597+0000","last_active":"2023-12-19T13:47:44.793868+0000","last_peered":"2023-12-19T13:47:44.793868+0000","last_clean":"2023-12-19T13:47:44.793868+0000","last_became_active":"2023-12-19T13:47:44.793360+0000","last_became_peered":"2023-12-19T13:47:44.793360+0000","last_unstale":"2023-12-19T13:47:44.793868+0000","last_undegraded":"2023-12-19T13:47:44.793868+0000","last_fullsized":"2023-12-19T13:47:44.793868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:08.182342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.795417+0000","last_change":"2023-12-19T13:47:44.795097+0000","last_active":"2023-12-19T13:47:44.795417+0000","last_peered":"2023-12-19T13:47:44.795417+0000","last_clean":"2023-12-19T13:47:44.795417+0000","last_became_active":"2023-12-19T13:47:44.794891+0000","last_became_peered":"2023-12-19T13:47:44.794891+0000","last_unstale":"2023-12-19T13:47:44.795417+0000","last_undegraded":"2023-12-19T13:47:44.795417+0000","last_fullsized":"2023-12-19T13:47:44.795417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:21.895844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793536+0000","last_change":"2023-12-19T13:47:44.791453+0000","last_active":"2023-12-19T13:47:44.793536+0000","last_peered":"2023-12-19T13:47:44.793536+0000","last_clean":"2023-12-19T13:47:44.793536+0000","last_became_active":"2023-12-19T13:47:44.791044+0000","last_became_peered":"2023-12-19T13:47:44.791044+0000","last_unstale":"2023-12-19T13:47:44.793536+0000","last_undegraded":"2023-12-19T13:47:44.793536+0000","last_fullsized":"2023-12-19T13:47:44.793536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790242+0000","last_change":"2023-12-19T13:47:44.789483+0000","last_active":"2023-12-19T13:47:44.790242+0000","last_peered":"2023-12-19T13:47:44.790242+0000","last_clean":"2023-12-19T13:47:44.790242+0000","last_became_active":"2023-12-19T13:47:44.789229+0000","last_became_peered":"2023-12-19T13:47:44.789229+0000","last_unstale":"2023-12-19T13:47:44.790242+0000","last_undegraded":"2023-12-19T13:47:44.790242+0000","last_fullsized":"2023-12-19T13:47:44.790242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:33.834040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788560+0000","last_change":"2023-12-19T13:47:44.787785+0000","last_active":"2023-12-19T13:47:44.788560+0000","last_peered":"2023-12-19T13:47:44.788560+0000","last_clean":"2023-12-19T13:47:44.788560+0000","last_became_active":"2023-12-19T13:47:44.787547+0000","last_became_peered":"2023-12-19T13:47:44.787547+0000","last_unstale":"2023-12-19T13:47:44.788560+0000","last_undegraded":"2023-12-19T13:47:44.788560+0000","last_fullsized":"2023-12-19T13:47:44.788560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:21.895844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787528+0000","last_change":"2023-12-19T13:47:44.783521+0000","last_active":"2023-12-19T13:47:44.787528+0000","last_peered":"2023-12-19T13:47:44.787528+0000","last_clean":"2023-12-19T13:47:44.787528+0000","last_became_active":"2023-12-19T13:47:44.783303+0000","last_became_peered":"2023-12-19T13:47:44.783303+0000","last_unstale":"2023-12-19T13:47:44.787528+0000","last_undegraded":"2023-12-19T13:47:44.787528+0000","last_fullsized":"2023-12-19T13:47:44.787528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:07.543874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790207+0000","last_change":"2023-12-19T13:47:44.787781+0000","last_active":"2023-12-19T13:47:44.790207+0000","last_peered":"2023-12-19T13:47:44.790207+0000","last_clean":"2023-12-19T13:47:44.790207+0000","last_became_active":"2023-12-19T13:47:44.787487+0000","last_became_peered":"2023-12-19T13:47:44.787487+0000","last_unstale":"2023-12-19T13:47:44.790207+0000","last_undegraded":"2023-12-19T13:47:44.790207+0000","last_fullsized":"2023-12-19T13:47:44.790207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:08.182342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.792081+0000","last_change":"2023-12-19T13:47:44.790872+0000","last_active":"2023-12-19T13:47:44.792081+0000","last_peered":"2023-12-19T13:47:44.792081+0000","last_clean":"2023-12-19T13:47:44.792081+0000","last_became_active":"2023-12-19T13:47:44.790644+0000","last_became_peered":"2023-12-19T13:47:44.790644+0000","last_unstale":"2023-12-19T13:47:44.792081+0000","last_undegraded":"2023-12-19T13:47:44.792081+0000","last_fullsized":"2023-12-19T13:47:44.792081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788466+0000","last_change":"2023-12-19T13:47:44.788294+0000","last_active":"2023-12-19T13:47:44.788466+0000","last_peered":"2023-12-19T13:47:44.788466+0000","last_clean":"2023-12-19T13:47:44.788466+0000","last_became_active":"2023-12-19T13:47:44.787369+0000","last_became_peered":"2023-12-19T13:47:44.787369+0000","last_unstale":"2023-12-19T13:47:44.788466+0000","last_undegraded":"2023-12-19T13:47:44.788466+0000","last_fullsized":"2023-12-19T13:47:44.788466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:13.400041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796072+0000","last_change":"2023-12-19T13:47:44.795236+0000","last_active":"2023-12-19T13:47:44.796072+0000","last_peered":"2023-12-19T13:47:44.796072+0000","last_clean":"2023-12-19T13:47:44.796072+0000","last_became_active":"2023-12-19T13:47:44.795024+0000","last_became_peered":"2023-12-19T13:47:44.795024+0000","last_unstale":"2023-12-19T13:47:44.796072+0000","last_undegraded":"2023-12-19T13:47:44.796072+0000","last_fullsized":"2023-12-19T13:47:44.796072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:10.688471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781938+0000","last_change":"2023-12-19T13:47:44.781680+0000","last_active":"2023-12-19T13:47:44.781938+0000","last_peered":"2023-12-19T13:47:44.781938+0000","last_clean":"2023-12-19T13:47:44.781938+0000","last_became_active":"2023-12-19T13:47:44.781288+0000","last_became_peered":"2023-12-19T13:47:44.781288+0000","last_unstale":"2023-12-19T13:47:44.781938+0000","last_undegraded":"2023-12-19T13:47:44.781938+0000","last_fullsized":"2023-12-19T13:47:44.781938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797290+0000","last_change":"2023-12-19T13:47:44.797070+0000","last_active":"2023-12-19T13:47:44.797290+0000","last_peered":"2023-12-19T13:47:44.797290+0000","last_clean":"2023-12-19T13:47:44.797290+0000","last_became_active":"2023-12-19T13:47:44.795123+0000","last_became_peered":"2023-12-19T13:47:44.795123+0000","last_unstale":"2023-12-19T13:47:44.797290+0000","last_undegraded":"2023-12-19T13:47:44.797290+0000","last_fullsized":"2023-12-19T13:47:44.797290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:10.775424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790320+0000","last_change":"2023-12-19T13:47:44.790068+0000","last_active":"2023-12-19T13:47:44.790320+0000","last_peered":"2023-12-19T13:47:44.790320+0000","last_clean":"2023-12-19T13:47:44.790320+0000","last_became_active":"2023-12-19T13:47:44.789562+0000","last_became_peered":"2023-12-19T13:47:44.789562+0000","last_unstale":"2023-12-19T13:47:44.790320+0000","last_undegraded":"2023-12-19T13:47:44.790320+0000","last_fullsized":"2023-12-19T13:47:44.790320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:08.285735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788998+0000","last_change":"2023-12-19T13:47:44.786305+0000","last_active":"2023-12-19T13:47:44.788998+0000","last_peered":"2023-12-19T13:47:44.788998+0000","last_clean":"2023-12-19T13:47:44.788998+0000","last_became_active":"2023-12-19T13:47:44.785961+0000","last_became_peered":"2023-12-19T13:47:44.785961+0000","last_unstale":"2023-12-19T13:47:44.788998+0000","last_undegraded":"2023-12-19T13:47:44.788998+0000","last_fullsized":"2023-12-19T13:47:44.788998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:35.081586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793524+0000","last_change":"2023-12-19T13:47:44.792819+0000","last_active":"2023-12-19T13:47:44.793524+0000","last_peered":"2023-12-19T13:47:44.793524+0000","last_clean":"2023-12-19T13:47:44.793524+0000","last_became_active":"2023-12-19T13:47:44.792404+0000","last_became_peered":"2023-12-19T13:47:44.792404+0000","last_unstale":"2023-12-19T13:47:44.793524+0000","last_undegraded":"2023-12-19T13:47:44.793524+0000","last_fullsized":"2023-12-19T13:47:44.793524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:46.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790463+0000","last_change":"2023-12-19T13:47:44.790337+0000","last_active":"2023-12-19T13:47:44.790463+0000","last_peered":"2023-12-19T13:47:44.790463+0000","last_clean":"2023-12-19T13:47:44.790463+0000","last_became_active":"2023-12-19T13:47:44.790098+0000","last_became_peered":"2023-12-19T13:47:44.790098+0000","last_unstale":"2023-12-19T13:47:44.790463+0000","last_undegraded":"2023-12-19T13:47:44.790463+0000","last_fullsized":"2023-12-19T13:47:44.790463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:00.798164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797912+0000","last_change":"2023-12-19T13:47:44.797662+0000","last_active":"2023-12-19T13:47:44.797912+0000","last_peered":"2023-12-19T13:47:44.797912+0000","last_clean":"2023-12-19T13:47:44.797912+0000","last_became_active":"2023-12-19T13:47:44.796995+0000","last_became_peered":"2023-12-19T13:47:44.796995+0000","last_unstale":"2023-12-19T13:47:44.797912+0000","last_undegraded":"2023-12-19T13:47:44.797912+0000","last_fullsized":"2023-12-19T13:47:44.797912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793883+0000","last_change":"2023-12-19T13:47:44.793833+0000","last_active":"2023-12-19T13:47:44.793883+0000","last_peered":"2023-12-19T13:47:44.793883+0000","last_clean":"2023-12-19T13:47:44.793883+0000","last_became_active":"2023-12-19T13:47:44.793619+0000","last_became_peered":"2023-12-19T13:47:44.793619+0000","last_unstale":"2023-12-19T13:47:44.793883+0000","last_undegraded":"2023-12-19T13:47:44.793883+0000","last_fullsized":"2023-12-19T13:47:44.793883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:51:35.444912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793506+0000","last_change":"2023-12-19T13:47:44.791203+0000","last_active":"2023-12-19T13:47:44.793506+0000","last_peered":"2023-12-19T13:47:44.793506+0000","last_clean":"2023-12-19T13:47:44.793506+0000","last_became_active":"2023-12-19T13:47:44.790286+0000","last_became_peered":"2023-12-19T13:47:44.790286+0000","last_unstale":"2023-12-19T13:47:44.793506+0000","last_undegraded":"2023-12-19T13:47:44.793506+0000","last_fullsized":"2023-12-19T13:47:44.793506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:10.688471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789295+0000","last_change":"2023-12-19T13:47:44.788982+0000","last_active":"2023-12-19T13:47:44.789295+0000","last_peered":"2023-12-19T13:47:44.789295+0000","last_clean":"2023-12-19T13:47:44.789295+0000","last_became_active":"2023-12-19T13:47:44.788758+0000","last_became_peered":"2023-12-19T13:47:44.788758+0000","last_unstale":"2023-12-19T13:47:44.789295+0000","last_undegraded":"2023-12-19T13:47:44.789295+0000","last_fullsized":"2023-12-19T13:47:44.789295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:40:10.284266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.792674+0000","last_change":"2023-12-19T13:47:44.789402+0000","last_active":"2023-12-19T13:47:44.792674+0000","last_peered":"2023-12-19T13:47:44.792674+0000","last_clean":"2023-12-19T13:47:44.792674+0000","last_became_active":"2023-12-19T13:47:44.789098+0000","last_became_peered":"2023-12-19T13:47:44.789098+0000","last_unstale":"2023-12-19T13:47:44.792674+0000","last_undegraded":"2023-12-19T13:47:44.792674+0000","last_fullsized":"2023-12-19T13:47:44.792674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:53:01.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790222+0000","last_change":"2023-12-19T13:47:44.790133+0000","last_active":"2023-12-19T13:47:44.790222+0000","last_peered":"2023-12-19T13:47:44.790222+0000","last_clean":"2023-12-19T13:47:44.790222+0000","last_became_active":"2023-12-19T13:47:44.789763+0000","last_became_peered":"2023-12-19T13:47:44.789763+0000","last_unstale":"2023-12-19T13:47:44.790222+0000","last_undegraded":"2023-12-19T13:47:44.790222+0000","last_fullsized":"2023-12-19T13:47:44.790222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793476+0000","last_change":"2023-12-19T13:47:44.790837+0000","last_active":"2023-12-19T13:47:44.793476+0000","last_peered":"2023-12-19T13:47:44.793476+0000","last_clean":"2023-12-19T13:47:44.793476+0000","last_became_active":"2023-12-19T13:47:44.789559+0000","last_became_peered":"2023-12-19T13:47:44.789559+0000","last_unstale":"2023-12-19T13:47:44.793476+0000","last_undegraded":"2023-12-19T13:47:44.793476+0000","last_fullsized":"2023-12-19T13:47:44.793476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:30.119612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786045+0000","last_change":"2023-12-19T13:47:44.783305+0000","last_active":"2023-12-19T13:47:44.786045+0000","last_peered":"2023-12-19T13:47:44.786045+0000","last_clean":"2023-12-19T13:47:44.786045+0000","last_became_active":"2023-12-19T13:47:44.782428+0000","last_became_peered":"2023-12-19T13:47:44.782428+0000","last_unstale":"2023-12-19T13:47:44.786045+0000","last_undegraded":"2023-12-19T13:47:44.786045+0000","last_fullsized":"2023-12-19T13:47:44.786045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:02.832767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781393+0000","last_change":"2023-12-19T13:47:44.781320+0000","last_active":"2023-12-19T13:47:44.781393+0000","last_peered":"2023-12-19T13:47:44.781393+0000","last_clean":"2023-12-19T13:47:44.781393+0000","last_became_active":"2023-12-19T13:47:44.781107+0000","last_became_peered":"2023-12-19T13:47:44.781107+0000","last_unstale":"2023-12-19T13:47:44.781393+0000","last_undegraded":"2023-12-19T13:47:44.781393+0000","last_fullsized":"2023-12-19T13:47:44.781393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793662+0000","last_change":"2023-12-19T13:47:44.793079+0000","last_active":"2023-12-19T13:47:44.793662+0000","last_peered":"2023-12-19T13:47:44.793662+0000","last_clean":"2023-12-19T13:47:44.793662+0000","last_became_active":"2023-12-19T13:47:44.792827+0000","last_became_peered":"2023-12-19T13:47:44.792827+0000","last_unstale":"2023-12-19T13:47:44.793662+0000","last_undegraded":"2023-12-19T13:47:44.793662+0000","last_fullsized":"2023-12-19T13:47:44.793662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:46.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.797015+0000","last_change":"2023-12-19T13:47:44.796916+0000","last_active":"2023-12-19T13:47:44.797015+0000","last_peered":"2023-12-19T13:47:44.797015+0000","last_clean":"2023-12-19T13:47:44.797015+0000","last_became_active":"2023-12-19T13:47:44.794810+0000","last_became_peered":"2023-12-19T13:47:44.794810+0000","last_unstale":"2023-12-19T13:47:44.797015+0000","last_undegraded":"2023-12-19T13:47:44.797015+0000","last_fullsized":"2023-12-19T13:47:44.797015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:44.627092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796180+0000","last_change":"2023-12-19T13:47:44.795762+0000","last_active":"2023-12-19T13:47:44.796180+0000","last_peered":"2023-12-19T13:47:44.796180+0000","last_clean":"2023-12-19T13:47:44.796180+0000","last_became_active":"2023-12-19T13:47:44.794329+0000","last_became_peered":"2023-12-19T13:47:44.794329+0000","last_unstale":"2023-12-19T13:47:44.796180+0000","last_undegraded":"2023-12-19T13:47:44.796180+0000","last_fullsized":"2023-12-19T13:47:44.796180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.802251+0000","last_change":"2023-12-19T13:47:44.311368+0000","last_active":"2023-12-19T13:47:44.802251+0000","last_peered":"2023-12-19T13:47:44.802251+0000","last_clean":"2023-12-19T13:47:44.802251+0000","last_became_active":"2023-12-19T13:47:44.311130+0000","last_became_peered":"2023-12-19T13:47:44.311130+0000","last_unstale":"2023-12-19T13:47:44.802251+0000","last_undegraded":"2023-12-19T13:47:44.802251+0000","last_fullsized":"2023-12-19T13:47:44.802251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:54:01.820614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793521+0000","last_change":"2023-12-19T13:47:44.791330+0000","last_active":"2023-12-19T13:47:44.793521+0000","last_peered":"2023-12-19T13:47:44.793521+0000","last_clean":"2023-12-19T13:47:44.793521+0000","last_became_active":"2023-12-19T13:47:44.790614+0000","last_became_peered":"2023-12-19T13:47:44.790614+0000","last_unstale":"2023-12-19T13:47:44.793521+0000","last_undegraded":"2023-12-19T13:47:44.793521+0000","last_fullsized":"2023-12-19T13:47:44.793521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800106+0000","last_change":"2023-12-19T13:47:44.313558+0000","last_active":"2023-12-19T13:47:44.800106+0000","last_peered":"2023-12-19T13:47:44.800106+0000","last_clean":"2023-12-19T13:47:44.800106+0000","last_became_active":"2023-12-19T13:47:44.311973+0000","last_became_peered":"2023-12-19T13:47:44.311973+0000","last_unstale":"2023-12-19T13:47:44.800106+0000","last_undegraded":"2023-12-19T13:47:44.800106+0000","last_fullsized":"2023-12-19T13:47:44.800106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:32.821887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793551+0000","last_change":"2023-12-19T13:47:44.792007+0000","last_active":"2023-12-19T13:47:44.793551+0000","last_peered":"2023-12-19T13:47:44.793551+0000","last_clean":"2023-12-19T13:47:44.793551+0000","last_became_active":"2023-12-19T13:47:44.789468+0000","last_became_peered":"2023-12-19T13:47:44.789468+0000","last_unstale":"2023-12-19T13:47:44.793551+0000","last_undegraded":"2023-12-19T13:47:44.793551+0000","last_fullsized":"2023-12-19T13:47:44.793551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:00.798164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.801737+0000","last_change":"2023-12-19T13:47:44.299452+0000","last_active":"2023-12-19T13:47:44.801737+0000","last_peered":"2023-12-19T13:47:44.801737+0000","last_clean":"2023-12-19T13:47:44.801737+0000","last_became_active":"2023-12-19T13:47:44.298779+0000","last_became_peered":"2023-12-19T13:47:44.298779+0000","last_unstale":"2023-12-19T13:47:44.801737+0000","last_undegraded":"2023-12-19T13:47:44.801737+0000","last_fullsized":"2023-12-19T13:47:44.801737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:20.871950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796788+0000","last_change":"2023-12-19T13:47:44.795781+0000","last_active":"2023-12-19T13:47:44.796788+0000","last_peered":"2023-12-19T13:47:44.796788+0000","last_clean":"2023-12-19T13:47:44.796788+0000","last_became_active":"2023-12-19T13:47:44.795407+0000","last_became_peered":"2023-12-19T13:47:44.795407+0000","last_unstale":"2023-12-19T13:47:44.796788+0000","last_undegraded":"2023-12-19T13:47:44.796788+0000","last_fullsized":"2023-12-19T13:47:44.796788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:19.884220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.799510+0000","last_change":"2023-12-19T13:47:44.310346+0000","last_active":"2023-12-19T13:47:44.799510+0000","last_peered":"2023-12-19T13:47:44.799510+0000","last_clean":"2023-12-19T13:47:44.799510+0000","last_became_active":"2023-12-19T13:47:44.310077+0000","last_became_peered":"2023-12-19T13:47:44.310077+0000","last_unstale":"2023-12-19T13:47:44.799510+0000","last_undegraded":"2023-12-19T13:47:44.799510+0000","last_fullsized":"2023-12-19T13:47:44.799510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:06.178538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790227+0000","last_change":"2023-12-19T13:47:44.788625+0000","last_active":"2023-12-19T13:47:44.790227+0000","last_peered":"2023-12-19T13:47:44.790227+0000","last_clean":"2023-12-19T13:47:44.790227+0000","last_became_active":"2023-12-19T13:47:44.787879+0000","last_became_peered":"2023-12-19T13:47:44.787879+0000","last_unstale":"2023-12-19T13:47:44.790227+0000","last_undegraded":"2023-12-19T13:47:44.790227+0000","last_fullsized":"2023-12-19T13:47:44.790227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:07.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800230+0000","last_change":"2023-12-19T13:47:44.304481+0000","last_active":"2023-12-19T13:47:44.800230+0000","last_peered":"2023-12-19T13:47:44.800230+0000","last_clean":"2023-12-19T13:47:44.800230+0000","last_became_active":"2023-12-19T13:47:44.303714+0000","last_became_peered":"2023-12-19T13:47:44.303714+0000","last_unstale":"2023-12-19T13:47:44.800230+0000","last_undegraded":"2023-12-19T13:47:44.800230+0000","last_fullsized":"2023-12-19T13:47:44.800230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:15.688587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.794135+0000","last_change":"2023-12-19T13:47:44.794072+0000","last_active":"2023-12-19T13:47:44.794135+0000","last_peered":"2023-12-19T13:47:44.794135+0000","last_clean":"2023-12-19T13:47:44.794135+0000","last_became_active":"2023-12-19T13:47:44.793688+0000","last_became_peered":"2023-12-19T13:47:44.793688+0000","last_unstale":"2023-12-19T13:47:44.794135+0000","last_undegraded":"2023-12-19T13:47:44.794135+0000","last_fullsized":"2023-12-19T13:47:44.794135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:51:35.444912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800705+0000","last_change":"2023-12-19T13:47:44.304224+0000","last_active":"2023-12-19T13:47:44.800705+0000","last_peered":"2023-12-19T13:47:44.800705+0000","last_clean":"2023-12-19T13:47:44.800705+0000","last_became_active":"2023-12-19T13:47:44.303799+0000","last_became_peered":"2023-12-19T13:47:44.303799+0000","last_unstale":"2023-12-19T13:47:44.800705+0000","last_undegraded":"2023-12-19T13:47:44.800705+0000","last_fullsized":"2023-12-19T13:47:44.800705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:34.069434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.782976+0000","last_change":"2023-12-19T13:47:44.782775+0000","last_active":"2023-12-19T13:47:44.782976+0000","last_peered":"2023-12-19T13:47:44.782976+0000","last_clean":"2023-12-19T13:47:44.782976+0000","last_became_active":"2023-12-19T13:47:44.782455+0000","last_became_peered":"2023-12-19T13:47:44.782455+0000","last_unstale":"2023-12-19T13:47:44.782976+0000","last_undegraded":"2023-12-19T13:47:44.782976+0000","last_fullsized":"2023-12-19T13:47:44.782976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:30.676137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.774392+0000","last_change":"2023-12-19T13:47:44.303863+0000","last_active":"2023-12-19T13:47:44.774392+0000","last_peered":"2023-12-19T13:47:44.774392+0000","last_clean":"2023-12-19T13:47:44.774392+0000","last_became_active":"2023-12-19T13:47:44.303436+0000","last_became_peered":"2023-12-19T13:47:44.303436+0000","last_unstale":"2023-12-19T13:47:44.774392+0000","last_undegraded":"2023-12-19T13:47:44.774392+0000","last_fullsized":"2023-12-19T13:47:44.774392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:07.783819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796804+0000","last_change":"2023-12-19T13:47:44.796005+0000","last_active":"2023-12-19T13:47:44.796804+0000","last_peered":"2023-12-19T13:47:44.796804+0000","last_clean":"2023-12-19T13:47:44.796804+0000","last_became_active":"2023-12-19T13:47:44.794613+0000","last_became_peered":"2023-12-19T13:47:44.794613+0000","last_unstale":"2023-12-19T13:47:44.796804+0000","last_undegraded":"2023-12-19T13:47:44.796804+0000","last_fullsized":"2023-12-19T13:47:44.796804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:55.438021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789646+0000","last_change":"2023-12-19T13:47:44.306019+0000","last_active":"2023-12-19T13:47:44.789646+0000","last_peered":"2023-12-19T13:47:44.789646+0000","last_clean":"2023-12-19T13:47:44.789646+0000","last_became_active":"2023-12-19T13:47:44.305390+0000","last_became_peered":"2023-12-19T13:47:44.305390+0000","last_unstale":"2023-12-19T13:47:44.789646+0000","last_undegraded":"2023-12-19T13:47:44.789646+0000","last_fullsized":"2023-12-19T13:47:44.789646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:53.036919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.791209+0000","last_change":"2023-12-19T13:47:44.789996+0000","last_active":"2023-12-19T13:47:44.791209+0000","last_peered":"2023-12-19T13:47:44.791209+0000","last_clean":"2023-12-19T13:47:44.791209+0000","last_became_active":"2023-12-19T13:47:44.789782+0000","last_became_peered":"2023-12-19T13:47:44.789782+0000","last_unstale":"2023-12-19T13:47:44.791209+0000","last_undegraded":"2023-12-19T13:47:44.791209+0000","last_fullsized":"2023-12-19T13:47:44.791209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:55.438021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779858+0000","last_change":"2023-12-19T13:47:44.300916+0000","last_active":"2023-12-19T13:47:44.779858+0000","last_peered":"2023-12-19T13:47:44.779858+0000","last_clean":"2023-12-19T13:47:44.779858+0000","last_became_active":"2023-12-19T13:47:44.300551+0000","last_became_peered":"2023-12-19T13:47:44.300551+0000","last_unstale":"2023-12-19T13:47:44.779858+0000","last_undegraded":"2023-12-19T13:47:44.779858+0000","last_fullsized":"2023-12-19T13:47:44.779858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:32.821887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787863+0000","last_change":"2023-12-19T13:47:44.787759+0000","last_active":"2023-12-19T13:47:44.787863+0000","last_peered":"2023-12-19T13:47:44.787863+0000","last_clean":"2023-12-19T13:47:44.787863+0000","last_became_active":"2023-12-19T13:47:44.787416+0000","last_became_peered":"2023-12-19T13:47:44.787416+0000","last_unstale":"2023-12-19T13:47:44.787863+0000","last_undegraded":"2023-12-19T13:47:44.787863+0000","last_fullsized":"2023-12-19T13:47:44.787863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:58.999322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781765+0000","last_change":"2023-12-19T13:47:44.300911+0000","last_active":"2023-12-19T13:47:44.781765+0000","last_peered":"2023-12-19T13:47:44.781765+0000","last_clean":"2023-12-19T13:47:44.781765+0000","last_became_active":"2023-12-19T13:47:44.296346+0000","last_became_peered":"2023-12-19T13:47:44.296346+0000","last_unstale":"2023-12-19T13:47:44.781765+0000","last_undegraded":"2023-12-19T13:47:44.781765+0000","last_fullsized":"2023-12-19T13:47:44.781765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:29.663985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796913+0000","last_change":"2023-12-19T13:47:44.796583+0000","last_active":"2023-12-19T13:47:44.796913+0000","last_peered":"2023-12-19T13:47:44.796913+0000","last_clean":"2023-12-19T13:47:44.796913+0000","last_became_active":"2023-12-19T13:47:44.795327+0000","last_became_peered":"2023-12-19T13:47:44.795327+0000","last_unstale":"2023-12-19T13:47:44.796913+0000","last_undegraded":"2023-12-19T13:47:44.796913+0000","last_fullsized":"2023-12-19T13:47:44.796913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:23:31.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800850+0000","last_change":"2023-12-19T13:47:44.309977+0000","last_active":"2023-12-19T13:47:44.800850+0000","last_peered":"2023-12-19T13:47:44.800850+0000","last_clean":"2023-12-19T13:47:44.800850+0000","last_became_active":"2023-12-19T13:47:44.309731+0000","last_became_peered":"2023-12-19T13:47:44.309731+0000","last_unstale":"2023-12-19T13:47:44.800850+0000","last_undegraded":"2023-12-19T13:47:44.800850+0000","last_fullsized":"2023-12-19T13:47:44.800850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:09.676319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787592+0000","last_change":"2023-12-19T13:47:44.786559+0000","last_active":"2023-12-19T13:47:44.787592+0000","last_peered":"2023-12-19T13:47:44.787592+0000","last_clean":"2023-12-19T13:47:44.787592+0000","last_became_active":"2023-12-19T13:47:44.786308+0000","last_became_peered":"2023-12-19T13:47:44.786308+0000","last_unstale":"2023-12-19T13:47:44.787592+0000","last_undegraded":"2023-12-19T13:47:44.787592+0000","last_fullsized":"2023-12-19T13:47:44.787592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:04.411242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.803433+0000","last_change":"2023-12-19T13:47:44.313311+0000","last_active":"2023-12-19T13:47:44.803433+0000","last_peered":"2023-12-19T13:47:44.803433+0000","last_clean":"2023-12-19T13:47:44.803433+0000","last_became_active":"2023-12-19T13:47:44.313076+0000","last_became_peered":"2023-12-19T13:47:44.313076+0000","last_unstale":"2023-12-19T13:47:44.803433+0000","last_undegraded":"2023-12-19T13:47:44.803433+0000","last_fullsized":"2023-12-19T13:47:44.803433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:55.569812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796199+0000","last_change":"2023-12-19T13:47:44.794086+0000","last_active":"2023-12-19T13:47:44.796199+0000","last_peered":"2023-12-19T13:47:44.796199+0000","last_clean":"2023-12-19T13:47:44.796199+0000","last_became_active":"2023-12-19T13:47:44.792414+0000","last_became_peered":"2023-12-19T13:47:44.792414+0000","last_unstale":"2023-12-19T13:47:44.796199+0000","last_undegraded":"2023-12-19T13:47:44.796199+0000","last_fullsized":"2023-12-19T13:47:44.796199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:30.119612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800506+0000","last_change":"2023-12-19T13:47:44.311819+0000","last_active":"2023-12-19T13:47:44.800506+0000","last_peered":"2023-12-19T13:47:44.800506+0000","last_clean":"2023-12-19T13:47:44.800506+0000","last_became_active":"2023-12-19T13:47:44.311490+0000","last_became_peered":"2023-12-19T13:47:44.311490+0000","last_unstale":"2023-12-19T13:47:44.800506+0000","last_undegraded":"2023-12-19T13:47:44.800506+0000","last_fullsized":"2023-12-19T13:47:44.800506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:53.420003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.795425+0000","last_change":"2023-12-19T13:47:44.795033+0000","last_active":"2023-12-19T13:47:44.795425+0000","last_peered":"2023-12-19T13:47:44.795425+0000","last_clean":"2023-12-19T13:47:44.795425+0000","last_became_active":"2023-12-19T13:47:44.794798+0000","last_became_peered":"2023-12-19T13:47:44.794798+0000","last_unstale":"2023-12-19T13:47:44.795425+0000","last_undegraded":"2023-12-19T13:47:44.795425+0000","last_fullsized":"2023-12-19T13:47:44.795425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779555+0000","last_change":"2023-12-19T13:47:44.313048+0000","last_active":"2023-12-19T13:47:44.779555+0000","last_peered":"2023-12-19T13:47:44.779555+0000","last_clean":"2023-12-19T13:47:44.779555+0000","last_became_active":"2023-12-19T13:47:44.312829+0000","last_became_peered":"2023-12-19T13:47:44.312829+0000","last_unstale":"2023-12-19T13:47:44.779555+0000","last_undegraded":"2023-12-19T13:47:44.779555+0000","last_fullsized":"2023-12-19T13:47:44.779555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:58.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793599+0000","last_change":"2023-12-19T13:47:44.792407+0000","last_active":"2023-12-19T13:47:44.793599+0000","last_peered":"2023-12-19T13:47:44.793599+0000","last_clean":"2023-12-19T13:47:44.793599+0000","last_became_active":"2023-12-19T13:47:44.792173+0000","last_became_peered":"2023-12-19T13:47:44.792173+0000","last_unstale":"2023-12-19T13:47:44.793599+0000","last_undegraded":"2023-12-19T13:47:44.793599+0000","last_fullsized":"2023-12-19T13:47:44.793599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:48.298666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.778344+0000","last_change":"2023-12-19T13:47:44.307661+0000","last_active":"2023-12-19T13:47:44.778344+0000","last_peered":"2023-12-19T13:47:44.778344+0000","last_clean":"2023-12-19T13:47:44.778344+0000","last_became_active":"2023-12-19T13:47:44.307237+0000","last_became_peered":"2023-12-19T13:47:44.307237+0000","last_unstale":"2023-12-19T13:47:44.778344+0000","last_undegraded":"2023-12-19T13:47:44.778344+0000","last_fullsized":"2023-12-19T13:47:44.778344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:09:14.488787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796304+0000","last_change":"2023-12-19T13:47:44.795540+0000","last_active":"2023-12-19T13:47:44.796304+0000","last_peered":"2023-12-19T13:47:44.796304+0000","last_clean":"2023-12-19T13:47:44.796304+0000","last_became_active":"2023-12-19T13:47:44.794499+0000","last_became_peered":"2023-12-19T13:47:44.794499+0000","last_unstale":"2023-12-19T13:47:44.796304+0000","last_undegraded":"2023-12-19T13:47:44.796304+0000","last_fullsized":"2023-12-19T13:47:44.796304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:18.009013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.802018+0000","last_change":"2023-12-19T13:47:44.309501+0000","last_active":"2023-12-19T13:47:44.802018+0000","last_peered":"2023-12-19T13:47:44.802018+0000","last_clean":"2023-12-19T13:47:44.802018+0000","last_became_active":"2023-12-19T13:47:44.309144+0000","last_became_peered":"2023-12-19T13:47:44.309144+0000","last_unstale":"2023-12-19T13:47:44.802018+0000","last_undegraded":"2023-12-19T13:47:44.802018+0000","last_fullsized":"2023-12-19T13:47:44.802018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:52:46.974148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787576+0000","last_change":"2023-12-19T13:47:44.784957+0000","last_active":"2023-12-19T13:47:44.787576+0000","last_peered":"2023-12-19T13:47:44.787576+0000","last_clean":"2023-12-19T13:47:44.787576+0000","last_became_active":"2023-12-19T13:47:44.784586+0000","last_became_peered":"2023-12-19T13:47:44.784586+0000","last_unstale":"2023-12-19T13:47:44.787576+0000","last_undegraded":"2023-12-19T13:47:44.787576+0000","last_fullsized":"2023-12-19T13:47:44.787576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:54.100559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.802409+0000","last_change":"2023-12-19T13:47:44.307363+0000","last_active":"2023-12-19T13:47:44.802409+0000","last_peered":"2023-12-19T13:47:44.802409+0000","last_clean":"2023-12-19T13:47:44.802409+0000","last_became_active":"2023-12-19T13:47:44.306933+0000","last_became_peered":"2023-12-19T13:47:44.306933+0000","last_unstale":"2023-12-19T13:47:44.802409+0000","last_undegraded":"2023-12-19T13:47:44.802409+0000","last_fullsized":"2023-12-19T13:47:44.802409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:15.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786101+0000","last_change":"2023-12-19T13:47:44.785604+0000","last_active":"2023-12-19T13:47:44.786101+0000","last_peered":"2023-12-19T13:47:44.786101+0000","last_clean":"2023-12-19T13:47:44.786101+0000","last_became_active":"2023-12-19T13:47:44.785312+0000","last_became_peered":"2023-12-19T13:47:44.785312+0000","last_unstale":"2023-12-19T13:47:44.786101+0000","last_undegraded":"2023-12-19T13:47:44.786101+0000","last_fullsized":"2023-12-19T13:47:44.786101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:08.285735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.800232+0000","last_change":"2023-12-19T13:47:44.301041+0000","last_active":"2023-12-19T13:47:44.800232+0000","last_peered":"2023-12-19T13:47:44.800232+0000","last_clean":"2023-12-19T13:47:44.800232+0000","last_became_active":"2023-12-19T13:47:44.300820+0000","last_became_peered":"2023-12-19T13:47:44.300820+0000","last_unstale":"2023-12-19T13:47:44.800232+0000","last_undegraded":"2023-12-19T13:47:44.800232+0000","last_fullsized":"2023-12-19T13:47:44.800232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:06:25.699306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.790127+0000","last_change":"2023-12-19T13:47:44.789988+0000","last_active":"2023-12-19T13:47:44.790127+0000","last_peered":"2023-12-19T13:47:44.790127+0000","last_clean":"2023-12-19T13:47:44.790127+0000","last_became_active":"2023-12-19T13:47:44.789429+0000","last_became_peered":"2023-12-19T13:47:44.789429+0000","last_unstale":"2023-12-19T13:47:44.790127+0000","last_undegraded":"2023-12-19T13:47:44.790127+0000","last_fullsized":"2023-12-19T13:47:44.790127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:59.120354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.798103+0000","last_change":"2023-12-19T13:47:44.311311+0000","last_active":"2023-12-19T13:47:44.798103+0000","last_peered":"2023-12-19T13:47:44.798103+0000","last_clean":"2023-12-19T13:47:44.798103+0000","last_became_active":"2023-12-19T13:47:44.310861+0000","last_became_peered":"2023-12-19T13:47:44.310861+0000","last_unstale":"2023-12-19T13:47:44.798103+0000","last_undegraded":"2023-12-19T13:47:44.798103+0000","last_fullsized":"2023-12-19T13:47:44.798103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:58.108202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.788980+0000","last_change":"2023-12-19T13:47:44.786263+0000","last_active":"2023-12-19T13:47:44.788980+0000","last_peered":"2023-12-19T13:47:44.788980+0000","last_clean":"2023-12-19T13:47:44.788980+0000","last_became_active":"2023-12-19T13:47:44.785890+0000","last_became_peered":"2023-12-19T13:47:44.785890+0000","last_unstale":"2023-12-19T13:47:44.788980+0000","last_undegraded":"2023-12-19T13:47:44.788980+0000","last_fullsized":"2023-12-19T13:47:44.788980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:56.581964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.774236+0000","last_change":"2023-12-19T13:47:44.309725+0000","last_active":"2023-12-19T13:47:44.774236+0000","last_peered":"2023-12-19T13:47:44.774236+0000","last_clean":"2023-12-19T13:47:44.774236+0000","last_became_active":"2023-12-19T13:47:44.309397+0000","last_became_peered":"2023-12-19T13:47:44.309397+0000","last_unstale":"2023-12-19T13:47:44.774236+0000","last_undegraded":"2023-12-19T13:47:44.774236+0000","last_fullsized":"2023-12-19T13:47:44.774236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:58.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.791117+0000","last_change":"2023-12-19T13:47:44.789523+0000","last_active":"2023-12-19T13:47:44.791117+0000","last_peered":"2023-12-19T13:47:44.791117+0000","last_clean":"2023-12-19T13:47:44.791117+0000","last_became_active":"2023-12-19T13:47:44.789294+0000","last_became_peered":"2023-12-19T13:47:44.789294+0000","last_unstale":"2023-12-19T13:47:44.791117+0000","last_undegraded":"2023-12-19T13:47:44.791117+0000","last_fullsized":"2023-12-19T13:47:44.791117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:08.346103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.798662+0000","last_change":"2023-12-19T13:47:44.304611+0000","last_active":"2023-12-19T13:47:44.798662+0000","last_peered":"2023-12-19T13:47:44.798662+0000","last_clean":"2023-12-19T13:47:44.798662+0000","last_became_active":"2023-12-19T13:47:44.304260+0000","last_became_peered":"2023-12-19T13:47:44.304260+0000","last_unstale":"2023-12-19T13:47:44.798662+0000","last_undegraded":"2023-12-19T13:47:44.798662+0000","last_fullsized":"2023-12-19T13:47:44.798662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:06.178538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.785879+0000","last_change":"2023-12-19T13:47:44.783465+0000","last_active":"2023-12-19T13:47:44.785879+0000","last_peered":"2023-12-19T13:47:44.785879+0000","last_clean":"2023-12-19T13:47:44.785879+0000","last_became_active":"2023-12-19T13:47:44.783237+0000","last_became_peered":"2023-12-19T13:47:44.783237+0000","last_unstale":"2023-12-19T13:47:44.785879+0000","last_undegraded":"2023-12-19T13:47:44.785879+0000","last_fullsized":"2023-12-19T13:47:44.785879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786031+0000","last_change":"2023-12-19T13:47:44.301198+0000","last_active":"2023-12-19T13:47:44.786031+0000","last_peered":"2023-12-19T13:47:44.786031+0000","last_clean":"2023-12-19T13:47:44.786031+0000","last_became_active":"2023-12-19T13:47:44.300864+0000","last_became_peered":"2023-12-19T13:47:44.300864+0000","last_unstale":"2023-12-19T13:47:44.786031+0000","last_undegraded":"2023-12-19T13:47:44.786031+0000","last_fullsized":"2023-12-19T13:47:44.786031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:34:44.187209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793862+0000","last_change":"2023-12-19T13:47:44.793231+0000","last_active":"2023-12-19T13:47:44.793862+0000","last_peered":"2023-12-19T13:47:44.793862+0000","last_clean":"2023-12-19T13:47:44.793862+0000","last_became_active":"2023-12-19T13:47:44.791755+0000","last_became_peered":"2023-12-19T13:47:44.791755+0000","last_unstale":"2023-12-19T13:47:44.793862+0000","last_undegraded":"2023-12-19T13:47:44.793862+0000","last_fullsized":"2023-12-19T13:47:44.793862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:36.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.777966+0000","last_change":"2023-12-19T13:47:44.295165+0000","last_active":"2023-12-19T13:47:44.777966+0000","last_peered":"2023-12-19T13:47:44.777966+0000","last_clean":"2023-12-19T13:47:44.777966+0000","last_became_active":"2023-12-19T13:47:44.294559+0000","last_became_peered":"2023-12-19T13:47:44.294559+0000","last_unstale":"2023-12-19T13:47:44.777966+0000","last_undegraded":"2023-12-19T13:47:44.777966+0000","last_fullsized":"2023-12-19T13:47:44.777966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:10.310288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.782954+0000","last_change":"2023-12-19T13:47:44.782653+0000","last_active":"2023-12-19T13:47:44.782954+0000","last_peered":"2023-12-19T13:47:44.782954+0000","last_clean":"2023-12-19T13:47:44.782954+0000","last_became_active":"2023-12-19T13:47:44.782183+0000","last_became_peered":"2023-12-19T13:47:44.782183+0000","last_unstale":"2023-12-19T13:47:44.782954+0000","last_undegraded":"2023-12-19T13:47:44.782954+0000","last_fullsized":"2023-12-19T13:47:44.782954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:09:15.500939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.777499+0000","last_change":"2023-12-19T13:47:44.311177+0000","last_active":"2023-12-19T13:47:44.777499+0000","last_peered":"2023-12-19T13:47:44.777499+0000","last_clean":"2023-12-19T13:47:44.777499+0000","last_became_active":"2023-12-19T13:47:44.310506+0000","last_became_peered":"2023-12-19T13:47:44.310506+0000","last_unstale":"2023-12-19T13:47:44.777499+0000","last_undegraded":"2023-12-19T13:47:44.777499+0000","last_fullsized":"2023-12-19T13:47:44.777499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:37.481104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.778664+0000","last_change":"2023-12-19T13:47:44.778206+0000","last_active":"2023-12-19T13:47:44.778664+0000","last_peered":"2023-12-19T13:47:44.778664+0000","last_clean":"2023-12-19T13:47:44.778664+0000","last_became_active":"2023-12-19T13:47:44.777960+0000","last_became_peered":"2023-12-19T13:47:44.777960+0000","last_unstale":"2023-12-19T13:47:44.778664+0000","last_undegraded":"2023-12-19T13:47:44.778664+0000","last_fullsized":"2023-12-19T13:47:44.778664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:08.331980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.801570+0000","last_change":"2023-12-19T13:47:44.304296+0000","last_active":"2023-12-19T13:47:44.801570+0000","last_peered":"2023-12-19T13:47:44.801570+0000","last_clean":"2023-12-19T13:47:44.801570+0000","last_became_active":"2023-12-19T13:47:44.303945+0000","last_became_peered":"2023-12-19T13:47:44.303945+0000","last_unstale":"2023-12-19T13:47:44.801570+0000","last_undegraded":"2023-12-19T13:47:44.801570+0000","last_fullsized":"2023-12-19T13:47:44.801570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:07.273583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.787620+0000","last_change":"2023-12-19T13:47:44.787139+0000","last_active":"2023-12-19T13:47:44.787620+0000","last_peered":"2023-12-19T13:47:44.787620+0000","last_clean":"2023-12-19T13:47:44.787620+0000","last_became_active":"2023-12-19T13:47:44.786858+0000","last_became_peered":"2023-12-19T13:47:44.786858+0000","last_unstale":"2023-12-19T13:47:44.787620+0000","last_undegraded":"2023-12-19T13:47:44.787620+0000","last_fullsized":"2023-12-19T13:47:44.787620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:58.999322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.780531+0000","last_change":"2023-12-19T13:47:44.301611+0000","last_active":"2023-12-19T13:47:44.780531+0000","last_peered":"2023-12-19T13:47:44.780531+0000","last_clean":"2023-12-19T13:47:44.780531+0000","last_became_active":"2023-12-19T13:47:44.301200+0000","last_became_peered":"2023-12-19T13:47:44.301200+0000","last_unstale":"2023-12-19T13:47:44.780531+0000","last_undegraded":"2023-12-19T13:47:44.780531+0000","last_fullsized":"2023-12-19T13:47:44.780531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:58.599119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.783568+0000","last_change":"2023-12-19T13:47:44.783396+0000","last_active":"2023-12-19T13:47:44.783568+0000","last_peered":"2023-12-19T13:47:44.783568+0000","last_clean":"2023-12-19T13:47:44.783568+0000","last_became_active":"2023-12-19T13:47:44.783157+0000","last_became_peered":"2023-12-19T13:47:44.783157+0000","last_unstale":"2023-12-19T13:47:44.783568+0000","last_undegraded":"2023-12-19T13:47:44.783568+0000","last_fullsized":"2023-12-19T13:47:44.783568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:16.700739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.785649+0000","last_change":"2023-12-19T13:47:44.307801+0000","last_active":"2023-12-19T13:47:44.785649+0000","last_peered":"2023-12-19T13:47:44.785649+0000","last_clean":"2023-12-19T13:47:44.785649+0000","last_became_active":"2023-12-19T13:47:44.307372+0000","last_became_peered":"2023-12-19T13:47:44.307372+0000","last_unstale":"2023-12-19T13:47:44.785649+0000","last_undegraded":"2023-12-19T13:47:44.785649+0000","last_fullsized":"2023-12-19T13:47:44.785649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:53.420003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.781273+0000","last_change":"2023-12-19T13:47:44.780430+0000","last_active":"2023-12-19T13:47:44.781273+0000","last_peered":"2023-12-19T13:47:44.781273+0000","last_clean":"2023-12-19T13:47:44.781273+0000","last_became_active":"2023-12-19T13:47:44.780229+0000","last_became_peered":"2023-12-19T13:47:44.780229+0000","last_unstale":"2023-12-19T13:47:44.781273+0000","last_undegraded":"2023-12-19T13:47:44.781273+0000","last_fullsized":"2023-12-19T13:47:44.781273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:30.119612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.785633+0000","last_change":"2023-12-19T13:47:44.307148+0000","last_active":"2023-12-19T13:47:44.785633+0000","last_peered":"2023-12-19T13:47:44.785633+0000","last_clean":"2023-12-19T13:47:44.785633+0000","last_became_active":"2023-12-19T13:47:44.306915+0000","last_became_peered":"2023-12-19T13:47:44.306915+0000","last_unstale":"2023-12-19T13:47:44.785633+0000","last_undegraded":"2023-12-19T13:47:44.785633+0000","last_fullsized":"2023-12-19T13:47:44.785633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:15.688587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.793542+0000","last_change":"2023-12-19T13:47:44.793326+0000","last_active":"2023-12-19T13:47:44.793542+0000","last_peered":"2023-12-19T13:47:44.793542+0000","last_clean":"2023-12-19T13:47:44.793542+0000","last_became_active":"2023-12-19T13:47:44.792383+0000","last_became_peered":"2023-12-19T13:47:44.792383+0000","last_unstale":"2023-12-19T13:47:44.793542+0000","last_undegraded":"2023-12-19T13:47:44.793542+0000","last_fullsized":"2023-12-19T13:47:44.793542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:30.042487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786760+0000","last_change":"2023-12-19T13:47:44.311375+0000","last_active":"2023-12-19T13:47:44.786760+0000","last_peered":"2023-12-19T13:47:44.786760+0000","last_clean":"2023-12-19T13:47:44.786760+0000","last_became_active":"2023-12-19T13:47:44.311125+0000","last_became_peered":"2023-12-19T13:47:44.311125+0000","last_unstale":"2023-12-19T13:47:44.786760+0000","last_undegraded":"2023-12-19T13:47:44.786760+0000","last_fullsized":"2023-12-19T13:47:44.786760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:07.319828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.796843+0000","last_change":"2023-12-19T13:47:44.796411+0000","last_active":"2023-12-19T13:47:44.796843+0000","last_peered":"2023-12-19T13:47:44.796843+0000","last_clean":"2023-12-19T13:47:44.796843+0000","last_became_active":"2023-12-19T13:47:44.794999+0000","last_became_peered":"2023-12-19T13:47:44.794999+0000","last_unstale":"2023-12-19T13:47:44.796843+0000","last_undegraded":"2023-12-19T13:47:44.796843+0000","last_fullsized":"2023-12-19T13:47:44.796843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:29:58.073869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.789284+0000","last_change":"2023-12-19T13:47:44.311839+0000","last_active":"2023-12-19T13:47:44.789284+0000","last_peered":"2023-12-19T13:47:44.789284+0000","last_clean":"2023-12-19T13:47:44.789284+0000","last_became_active":"2023-12-19T13:47:44.311562+0000","last_became_peered":"2023-12-19T13:47:44.311562+0000","last_unstale":"2023-12-19T13:47:44.789284+0000","last_undegraded":"2023-12-19T13:47:44.789284+0000","last_fullsized":"2023-12-19T13:47:44.789284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:41.250132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779898+0000","last_change":"2023-12-19T13:47:44.779447+0000","last_active":"2023-12-19T13:47:44.779898+0000","last_peered":"2023-12-19T13:47:44.779898+0000","last_clean":"2023-12-19T13:47:44.779898+0000","last_became_active":"2023-12-19T13:47:44.778736+0000","last_became_peered":"2023-12-19T13:47:44.778736+0000","last_unstale":"2023-12-19T13:47:44.779898+0000","last_undegraded":"2023-12-19T13:47:44.779898+0000","last_fullsized":"2023-12-19T13:47:44.779898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:13.400041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.779621+0000","last_change":"2023-12-19T13:47:44.313661+0000","last_active":"2023-12-19T13:47:44.779621+0000","last_peered":"2023-12-19T13:47:44.779621+0000","last_clean":"2023-12-19T13:47:44.779621+0000","last_became_active":"2023-12-19T13:47:44.312320+0000","last_became_peered":"2023-12-19T13:47:44.312320+0000","last_unstale":"2023-12-19T13:47:44.779621+0000","last_undegraded":"2023-12-19T13:47:44.779621+0000","last_fullsized":"2023-12-19T13:47:44.779621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:29.663985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.786414+0000","last_change":"2023-12-19T13:47:44.786324+0000","last_active":"2023-12-19T13:47:44.786414+0000","last_peered":"2023-12-19T13:47:44.786414+0000","last_clean":"2023-12-19T13:47:44.786414+0000","last_became_active":"2023-12-19T13:47:44.785968+0000","last_became_peered":"2023-12-19T13:47:44.785968+0000","last_unstale":"2023-12-19T13:47:44.786414+0000","last_undegraded":"2023-12-19T13:47:44.786414+0000","last_fullsized":"2023-12-19T13:47:44.786414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:44.273888+0000","last_clean_scrub_stamp":"2023-12-19T13:47:44.273888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:38.493257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.773304+0000","last_change":"2023-12-19T13:47:44.311166+0000","last_active":"2023-12-19T13:47:44.773304+0000","last_peered":"2023-12-19T13:47:44.773304+0000","last_clean":"2023-12-19T13:47:44.773304+0000","last_became_active":"2023-12-19T13:47:44.310161+0000","last_became_peered":"2023-12-19T13:47:44.310161+0000","last_unstale":"2023-12-19T13:47:44.773304+0000","last_undegraded":"2023-12-19T13:47:44.773304+0000","last_fullsized":"2023-12-19T13:47:44.773304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:47:43.261736+0000","last_clean_scrub_stamp":"2023-12-19T13:47:43.261736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:35.263908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-19T13:47:44.283808+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:47:44.283808+0000","last_peered":"2023-12-19T13:47:44.283808+0000","last_clean":"2023-12-19T13:47:44.283808+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:47:44.283808+0000","last_undegraded":"2023-12-19T13:47:44.283808+0000","last_fullsized":"2023-12-19T13:47:44.283808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854867,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.3600000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.107}]},{"osd":2,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1619999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.514}]},{"osd":4,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.4119999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.4830000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.452},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.5720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.006},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":3.2069999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.262}]},{"osd":1,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.423},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4590000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":4.3899999999999997,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.4790000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.506}]},{"osd":5,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.181},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.304}]},{"osd":7,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.397},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194593,"statfs":{"total":200000000,"available":199263939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.70599999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.754}]},{"osd":2,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.0620000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.01},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.1319999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.266}]},{"osd":6,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.218},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.179}]},{"osd":7,"last update":"Tue Dec 19 13:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.3660000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.98299999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.95299999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.034}]},{"osd":3,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.361},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.135}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.087},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.268}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.3300000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.3839999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854113,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.72999999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.3769999999999998,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.3819999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0070000000000001,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.431},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.532}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.0940000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.73},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":1.6419999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.5609999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.032}]},{"osd":1,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.627},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.0029999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.204}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.964,"5min":2.964,"15min":2.964},"last":1.175},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.0800000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.1619999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.071},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.284}]},{"osd":2,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.2999999999999998,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.349}]},{"osd":3,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":7.157,"5min":7.157,"15min":7.157},"last":1.115}]},{"osd":4,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.0179999999999998,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.663},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.5940000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.7189999999999999,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.748}]},{"osd":6,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.397}]},{"osd":7,"last update":"Tue Dec 19 13:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":4.0519999999999996,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.5389999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854889,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.497},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.435}]},{"osd":4,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":4.4269999999999996,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":0.71499999999999997}]},{"osd":6,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":4.3570000000000002,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":0.878}]}]}],"pool_statfs":[]}} 2023-12-19T13:47:49.714 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:47:49.714 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:47:49.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.979+0000 7f5d7854e640 1 Processor -- start 2023-12-19T13:47:49.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.979+0000 7f5d7854e640 1 -- start start 2023-12-19T13:47:49.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.980+0000 7f5d7854e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d7006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.980+0000 7f5d7854e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5d7006bd10 0x7f5d7006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.980+0000 7f5d7854e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7015bfe0 con 0x7f5d7015ba90 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.980+0000 7f5d7854e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7006f9b0 con 0x7f5d7006bd10 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.980+0000 7f5d7854e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7015c2c0 con 0x7f5d70144ef0 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d75ae9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5d7015ba90 0x7f5d7006b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33954/0 (socket says 172.21.15.113:33954) 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d75ae9640 1 -- 172.21.15.113:0/3446397668 learned_addr learned my addr 172.21.15.113:0/3446397668 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d76aeb640 1 --2- 172.21.15.113:0/3446397668 >> v2:172.21.15.113:3300/0 conn(0x7f5d7006bd10 0x7f5d7006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d762ea640 1 --2- 172.21.15.113:0/3446397668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d7006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d752e8640 1 -- 172.21.15.113:0/3446397668 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720081763 0 0) 0x7f5d7015bfe0 con 0x7f5d7015ba90 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d752e8640 1 -- 172.21.15.113:0/3446397668 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d5c003520 con 0x7f5d7015ba90 2023-12-19T13:47:49.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d76aeb640 1 -- 172.21.15.113:0/3446397668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 msgr2=0x7f5d7006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:49.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d76aeb640 1 --2- 172.21.15.113:0/3446397668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d7006d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d76aeb640 1 -- 172.21.15.113:0/3446397668 >> v1:172.21.15.113:6789/0 conn(0x7f5d7015ba90 legacy=0x7f5d7006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.981+0000 7f5d76aeb640 1 -- 172.21.15.113:0/3446397668 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7015c5a0 con 0x7f5d7006bd10 2023-12-19T13:47:49.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.982+0000 7f5d76aeb640 1 --2- 172.21.15.113:0/3446397668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7006bd10 0x7f5d7006fe00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ec91b2f2f3dbf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:49.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d752e8640 1 -- 172.21.15.113:0/3446397668 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6802cc60 con 0x7f5d7006bd10 2023-12-19T13:47:49.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d752e8640 1 -- 172.21.15.113:0/3446397668 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6802cdc0 con 0x7f5d7006bd10 2023-12-19T13:47:49.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d752e8640 1 -- 172.21.15.113:0/3446397668 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68034660 con 0x7f5d7006bd10 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 -- 172.21.15.113:0/3446397668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7006bd10 msgr2=0x7f5d7006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 --2- 172.21.15.113:0/3446397668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7006bd10 0x7f5d7006fe00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6802beb0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 -- 172.21.15.113:0/3446397668 shutdown_connections 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 --2- 172.21.15.113:0/3446397668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7006bd10 0x7f5d7006fe00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 --2- 172.21.15.113:0/3446397668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d7006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 -- 172.21.15.113:0/3446397668 >> 172.21.15.113:0/3446397668 conn(0x7f5d700659d0 msgr2=0x7f5d70065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 -- 172.21.15.113:0/3446397668 shutdown_connections 2023-12-19T13:47:49.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.983+0000 7f5d7854e640 1 -- 172.21.15.113:0/3446397668 wait complete. 2023-12-19T13:47:49.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.985+0000 7f5d7854e640 1 Processor -- start 2023-12-19T13:47:49.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.985+0000 7f5d7854e640 1 -- start start 2023-12-19T13:47:49.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.986+0000 7f5d7854e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d7006bd10 0x7f5d701f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.986+0000 7f5d7854e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d700c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.986+0000 7f5d7854e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7015ba90 0x7f5d700c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.986+0000 7f5d7854e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700af760 con 0x7f5d7015ba90 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.986+0000 7f5d7854e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70136190 con 0x7f5d7006bd10 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.986+0000 7f5d7854e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700aee30 con 0x7f5d70144ef0 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7015ba90 0x7f5d700c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7015ba90 0x7f5d700c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54930/0 (socket says 172.21.15.113:54930) 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 -- 172.21.15.113:0/2259397410 learned_addr learned my addr 172.21.15.113:0/2259397410 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d75ae9640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d700c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d762ea640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d7006bd10 0x7f5d701f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 -- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 msgr2=0x7f5d700c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d700c50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 -- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d7006bd10 msgr2=0x7f5d701f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d7006bd10 0x7f5d701f3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 -- 172.21.15.113:0/2259397410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68009a70 con 0x7f5d7015ba90 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.987+0000 7f5d76aeb640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7015ba90 0x7f5d700c55f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009eb0 tx=0x7f5d68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.988+0000 7f5d66ffd640 1 -- 172.21.15.113:0/2259397410 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6803e610 con 0x7f5d7015ba90 2023-12-19T13:47:49.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.988+0000 7f5d66ffd640 1 -- 172.21.15.113:0/2259397410 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6803e770 con 0x7f5d7015ba90 2023-12-19T13:47:49.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.988+0000 7f5d66ffd640 1 -- 172.21.15.113:0/2259397410 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6803eb60 con 0x7f5d7015ba90 2023-12-19T13:47:49.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.988+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d700af110 con 0x7f5d7015ba90 2023-12-19T13:47:49.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.988+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d701f2880 con 0x7f5d7015ba90 2023-12-19T13:47:49.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.989+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d700af910 con 0x7f5d7015ba90 2023-12-19T13:47:49.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.990+0000 7f5d66ffd640 1 -- 172.21.15.113:0/2259397410 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d6803b050 con 0x7f5d7015ba90 2023-12-19T13:47:49.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.991+0000 7f5d66ffd640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d5406a430 0x7f5d5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:49.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.991+0000 7f5d66ffd640 1 -- 172.21.15.113:0/2259397410 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d680aab60 con 0x7f5d7015ba90 2023-12-19T13:47:49.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.991+0000 7f5d762ea640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d5406a430 0x7f5d5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:49.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.992+0000 7f5d762ea640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d5406a430 0x7f5d5406c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006fd0 tx=0x7f5d6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:49.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:49.995+0000 7f5d66ffd640 1 -- 172.21.15.113:0/2259397410 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5d700af910 con 0x7f5d7015ba90 2023-12-19T13:47:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.256+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5d70061910 con 0x7f5d7015ba90 2023-12-19T13:47:50.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.264+0000 7f5d66ffd640 1 -- 172.21.15.113:0/2259397410 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5d6804d0e0 con 0x7f5d7015ba90 2023-12-19T13:47:50.264 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:47:50.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.266+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d5406a430 msgr2=0x7f5d5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.266+0000 7f5d7854e640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d5406a430 0x7f5d5406c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006fd0 tx=0x7f5d6c008040 comp rx=0 tx=0).stop 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.266+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7015ba90 msgr2=0x7f5d700c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.266+0000 7f5d7854e640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7015ba90 0x7f5d700c55f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009eb0 tx=0x7f5d68004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 shutdown_connections 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d5406a430 0x7f5d5406c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d7015ba90 0x7f5d700c55f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d70144ef0 0x7f5d700c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 --2- 172.21.15.113:0/2259397410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d7006bd10 0x7f5d701f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 >> 172.21.15.113:0/2259397410 conn(0x7f5d700659d0 msgr2=0x7f5d70065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 shutdown_connections 2023-12-19T13:47:50.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.267+0000 7f5d7854e640 1 -- 172.21.15.113:0/2259397410 wait complete. 2023-12-19T13:47:50.286 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:50.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.500+0000 7f058421a640 1 Processor -- start 2023-12-19T13:47:50.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.500+0000 7f058421a640 1 -- start start 2023-12-19T13:47:50.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.502+0000 7f058421a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f057c157aa0 0x7f057c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.502+0000 7f058421a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 0x7f057c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.502+0000 7f058421a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c06e8c0 con 0x7f057c06e410 2023-12-19T13:47:50.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.502+0000 7f058421a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c15e9c0 con 0x7f057c157aa0 2023-12-19T13:47:50.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.502+0000 7f058421a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c0b2600 con 0x7f057c15e040 2023-12-19T13:47:50.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.502+0000 7f05817b5640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f057c06e410 0x7f057c161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33958/0 (socket says 172.21.15.113:33958) 2023-12-19T13:47:50.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.502+0000 7f05817b5640 1 -- 172.21.15.113:0/3861299563 learned_addr learned my addr 172.21.15.113:0/3861299563 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:50.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0581fb6640 1 --2- 172.21.15.113:0/3861299563 >> v2:172.21.15.151:3300/0 conn(0x7f057c157aa0 0x7f057c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f05827b7640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 0x7f057c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394518262 0 0) 0x7f057c06e8c0 con 0x7f057c06e410 2023-12-19T13:47:50.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0568003520 con 0x7f057c06e410 2023-12-19T13:47:50.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3612063643 0 0) 0x7f0568003520 con 0x7f057c06e410 2023-12-19T13:47:50.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 msgr2=0x7f057c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 0x7f057c15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 >> v2:172.21.15.151:3300/0 conn(0x7f057c157aa0 msgr2=0x7f057c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 --2- 172.21.15.113:0/3861299563 >> v2:172.21.15.151:3300/0 conn(0x7f057c157aa0 0x7f057c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0b1d60 con 0x7f057c06e410 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f056c001670 con 0x7f057c06e410 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 >> v1:172.21.15.113:6789/0 conn(0x7f057c06e410 legacy=0x7f057c161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 0x7f05680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f05680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0568004d00 0x7f0568005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15e9c0 con 0x7f0568003f60 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c0b2600 con 0x7f0568004d00 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056800b9b0 con 0x7f057c15e040 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.503+0000 7f05817b5640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f05680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f0581fb6640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 0x7f05680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f05827b7640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0568004d00 0x7f0568005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f05817b5640 1 -- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 msgr2=0x7f05680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:50.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f05817b5640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 0x7f05680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f05817b5640 1 -- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0568004d00 msgr2=0x7f0568005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:50.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f05817b5640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0568004d00 0x7f0568005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f05817b5640 1 -- 172.21.15.113:0/3861299563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568003520 con 0x7f0568003f60 2023-12-19T13:47:50.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f0581fb6640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c15e040 0x7f05680039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:50.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.504+0000 7f05827b7640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0568004d00 0x7f0568005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:50.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.505+0000 7f05817b5640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f05680047c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c240 tx=0x7f05680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0346ad261e4993 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:50.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.505+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c02cb00 con 0x7f0568003f60 2023-12-19T13:47:50.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.505+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c02cc60 con 0x7f0568003f60 2023-12-19T13:47:50.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.505+0000 7f0580fb4640 1 -- 172.21.15.113:0/3861299563 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c005af0 con 0x7f0568003f60 2023-12-19T13:47:50.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.506+0000 7f058421a640 1 -- 172.21.15.113:0/3861299563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 msgr2=0x7f05680047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.506+0000 7f058421a640 1 --2- 172.21.15.113:0/3861299563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f05680047c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c240 tx=0x7f05680057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.506+0000 7f05827b7640 1 -- 172.21.15.113:0/3861299563 reap_dead start 2023-12-19T13:47:50.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.506+0000 7f058421a640 1 -- 172.21.15.113:0/3861299563 shutdown_connections 2023-12-19T13:47:50.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.506+0000 7f058421a640 1 -- 172.21.15.113:0/3861299563 >> 172.21.15.113:0/3861299563 conn(0x7f057c0cbb70 msgr2=0x7f057c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:50.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.506+0000 7f058421a640 1 -- 172.21.15.113:0/3861299563 shutdown_connections 2023-12-19T13:47:50.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.506+0000 7f058421a640 1 -- 172.21.15.113:0/3861299563 wait complete. 2023-12-19T13:47:50.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.508+0000 7f058421a640 1 Processor -- start 2023-12-19T13:47:50.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.508+0000 7f058421a640 1 -- start start 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f058421a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f057c1f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f058421a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c14ed60 0x7f057c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f058421a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f057c15c6a0 0x7f057c1f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f058421a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15ebd0 con 0x7f0568003f60 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f058421a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15cb20 con 0x7f057c15c6a0 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f058421a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15ede0 con 0x7f057c14ed60 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f0581fb6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f057c1f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f0581fb6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f057c1f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54936/0 (socket says 172.21.15.113:54936) 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.509+0000 7f0581fb6640 1 -- 172.21.15.113:0/2368499984 learned_addr learned my addr 172.21.15.113:0/2368499984 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f05827b7640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f057c15c6a0 0x7f057c1f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f05817b5640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c14ed60 0x7f057c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f0581fb6640 1 -- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c14ed60 msgr2=0x7f057c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f0581fb6640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c14ed60 0x7f057c15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f0581fb6640 1 -- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f057c15c6a0 msgr2=0x7f057c1f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f0581fb6640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f057c15c6a0 0x7f057c1f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f0581fb6640 1 -- 172.21.15.113:0/2368499984 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c15f0c0 con 0x7f0568003f60 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f05827b7640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f057c15c6a0 0x7f057c1f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.510+0000 7f0581fb6640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f057c1f3e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f05780108b0 tx=0x7f0578010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.511+0000 7f05727fc640 1 -- 172.21.15.113:0/2368499984 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800eb60 con 0x7f0568003f60 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.511+0000 7f05727fc640 1 -- 172.21.15.113:0/2368499984 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057800ecc0 con 0x7f0568003f60 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.511+0000 7f05727fc640 1 -- 172.21.15.113:0/2368499984 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057801c400 con 0x7f0568003f60 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.511+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c15f3a0 con 0x7f0568003f60 2023-12-19T13:47:50.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.511+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c14f1e0 con 0x7f0568003f60 2023-12-19T13:47:50.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.512+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c061910 con 0x7f0568003f60 2023-12-19T13:47:50.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.513+0000 7f05727fc640 1 -- 172.21.15.113:0/2368499984 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f057801c560 con 0x7f0568003f60 2023-12-19T13:47:50.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.514+0000 7f05727fc640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f056006a430 0x7f056006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:50.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.514+0000 7f05727fc640 1 -- 172.21.15.113:0/2368499984 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0578088f00 con 0x7f0568003f60 2023-12-19T13:47:50.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.514+0000 7f05817b5640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f056006a430 0x7f056006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:50.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.515+0000 7f05817b5640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f056006a430 0x7f056006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f056c034000 tx=0x7f056c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:50.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.518+0000 7f05727fc640 1 -- 172.21.15.113:0/2368499984 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0578054630 con 0x7f0568003f60 2023-12-19T13:47:50.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.745+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f057c071ae0 con 0x7f0568003f60 2023-12-19T13:47:50.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.746+0000 7f05727fc640 1 -- 172.21.15.113:0/2368499984 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f0578057c50 con 0x7f0568003f60 2023-12-19T13:47:50.746 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:50.746 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:47:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f056006a430 msgr2=0x7f056006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f056006a430 0x7f056006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f056c034000 tx=0x7f056c007000 comp rx=0 tx=0).stop 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 msgr2=0x7f057c1f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f057c1f3e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f05780108b0 tx=0x7f0578010d70 comp rx=0 tx=0).stop 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 shutdown_connections 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f056006a430 0x7f056006c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f057c15c6a0 0x7f057c1f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f057c14ed60 0x7f057c15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 --2- 172.21.15.113:0/2368499984 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0568003f60 0x7f057c1f3e50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:50.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 >> 172.21.15.113:0/2368499984 conn(0x7f057c0cbb70 msgr2=0x7f057c06d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:50.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.748+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 shutdown_connections 2023-12-19T13:47:50.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:50.749+0000 7f058421a640 1 -- 172.21.15.113:0/2368499984 wait complete. 2023-12-19T13:47:51.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:47:44.765620+0000', 'modified': '2023-12-19T13:47:47.785446+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5127': {'gid': 5127, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.151:6835/2023707761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6833', 'nonce': 2023707761}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 2023707761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:47:51.169 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:47:51.169 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T13:47:51.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.396+0000 7f9316615640 1 Processor -- start 2023-12-19T13:47:51.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.396+0000 7f9316615640 1 -- start start 2023-12-19T13:47:51.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9316615640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f93100b77c0 0x7f93100cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9316615640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931006f160 con 0x7f9310146c40 2023-12-19T13:47:51.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9316615640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931006f440 con 0x7f93100b7360 2023-12-19T13:47:51.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9316615640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93100700c0 con 0x7f93100b77c0 2023-12-19T13:47:51.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9315613640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9310146c40 0x7f9310070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33968/0 (socket says 172.21.15.113:33968) 2023-12-19T13:47:51.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9315613640 1 -- 172.21.15.113:0/4101852868 learned_addr learned my addr 172.21.15.113:0/4101852868 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:51.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9315e14640 1 --2- 172.21.15.113:0/4101852868 >> v2:172.21.15.113:3300/0 conn(0x7f93100b77c0 0x7f93100cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9307fff640 1 -- 172.21.15.113:0/4101852868 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082821585 0 0) 0x7f931006f160 con 0x7f9310146c40 2023-12-19T13:47:51.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.398+0000 7f9307fff640 1 -- 172.21.15.113:0/4101852868 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92fc003520 con 0x7f9310146c40 2023-12-19T13:47:51.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.399+0000 7f9315e14640 1 -- 172.21.15.113:0/4101852868 >> v1:172.21.15.151:6789/0 conn(0x7f93100b7360 legacy=0x7f93100cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.399+0000 7f9315e14640 1 -- 172.21.15.113:0/4101852868 >> v1:172.21.15.113:6789/0 conn(0x7f9310146c40 legacy=0x7f9310070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.399+0000 7f9315e14640 1 -- 172.21.15.113:0/4101852868 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931006f720 con 0x7f93100b77c0 2023-12-19T13:47:51.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.400+0000 7f9315e14640 1 --2- 172.21.15.113:0/4101852868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93100b77c0 0x7f93100cfff0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9308009d90 tx=0x7f930802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15af84c015aaf765 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.400+0000 7f9307fff640 1 -- 172.21.15.113:0/4101852868 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930802cc60 con 0x7f93100b77c0 2023-12-19T13:47:51.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.400+0000 7f9307fff640 1 -- 172.21.15.113:0/4101852868 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930802cdc0 con 0x7f93100b77c0 2023-12-19T13:47:51.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.400+0000 7f9307fff640 1 -- 172.21.15.113:0/4101852868 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308034660 con 0x7f93100b77c0 2023-12-19T13:47:51.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.400+0000 7f9316615640 1 -- 172.21.15.113:0/4101852868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93100b77c0 msgr2=0x7f93100cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.400+0000 7f9316615640 1 --2- 172.21.15.113:0/4101852868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93100b77c0 0x7f93100cfff0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9308009d90 tx=0x7f930802beb0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.401+0000 7f9316615640 1 -- 172.21.15.113:0/4101852868 shutdown_connections 2023-12-19T13:47:51.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.401+0000 7f9316615640 1 --2- 172.21.15.113:0/4101852868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93100b77c0 0x7f93100cfff0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.401+0000 7f9316615640 1 -- 172.21.15.113:0/4101852868 >> 172.21.15.113:0/4101852868 conn(0x7f93100d31b0 msgr2=0x7f93100d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.401+0000 7f9316615640 1 -- 172.21.15.113:0/4101852868 shutdown_connections 2023-12-19T13:47:51.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.401+0000 7f9316615640 1 -- 172.21.15.113:0/4101852868 wait complete. 2023-12-19T13:47:51.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.402+0000 7f9316615640 1 Processor -- start 2023-12-19T13:47:51.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.402+0000 7f9316615640 1 -- start start 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.403+0000 7f9316615640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93100b7360 0x7f931013caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.403+0000 7f9316615640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93100b77c0 0x7f931015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.403+0000 7f9316615640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9310146c40 0x7f931013ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.403+0000 7f9316615640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931013cfe0 con 0x7f9310146c40 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.403+0000 7f9316615640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931013c610 con 0x7f93100b77c0 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.403+0000 7f9316615640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931013ba00 con 0x7f93100b7360 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9310146c40 0x7f931013ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9310146c40 0x7f931013ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54952/0 (socket says 172.21.15.113:54952) 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 -- 172.21.15.113:0/1358334612 learned_addr learned my addr 172.21.15.113:0/1358334612 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9314e12640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93100b77c0 0x7f931015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 -- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93100b7360 msgr2=0x7f931013caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93100b7360 0x7f931013caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 -- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93100b77c0 msgr2=0x7f931015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93100b77c0 0x7f931015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 -- 172.21.15.113:0/1358334612 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308009a70 con 0x7f9310146c40 2023-12-19T13:47:51.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9314e12640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93100b77c0 0x7f931015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:51.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.404+0000 7f9315e14640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9310146c40 0x7f931013ded0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9308009d90 tx=0x7f9308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.405+0000 7f9305ffb640 1 -- 172.21.15.113:0/1358334612 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308040650 con 0x7f9310146c40 2023-12-19T13:47:51.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.405+0000 7f9305ffb640 1 -- 172.21.15.113:0/1358334612 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93080407b0 con 0x7f9310146c40 2023-12-19T13:47:51.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.405+0000 7f9305ffb640 1 -- 172.21.15.113:0/1358334612 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308040b60 con 0x7f9310146c40 2023-12-19T13:47:51.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.405+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931013bce0 con 0x7f9310146c40 2023-12-19T13:47:51.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.405+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931013c2a0 con 0x7f9310146c40 2023-12-19T13:47:51.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.407+0000 7f9305ffb640 1 -- 172.21.15.113:0/1358334612 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9308040cc0 con 0x7f9310146c40 2023-12-19T13:47:51.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.408+0000 7f9305ffb640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92f406a460 0x7f92f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.408+0000 7f9305ffb640 1 -- 172.21.15.113:0/1358334612 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93080ab720 con 0x7f9310146c40 2023-12-19T13:47:51.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.408+0000 7f9315613640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92f406a460 0x7f92f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.409+0000 7f931a3e9740 1 Processor -- start 2023-12-19T13:47:51.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.409+0000 7f931a3e9740 1 -- start start 2023-12-19T13:47:51.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.409+0000 7f9315613640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92f406a460 0x7f92f406c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f930c001570 tx=0x7f930c007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99485e90 0x559e994b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e99489a90 0x559e994b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f931a3e9740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e993f5f80 con 0x559e994b5f10 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e993f3710 con 0x559e99485e90 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e993ef000 con 0x559e99489a90 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54960/0 (socket says 172.21.15.113:54960) 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 -- 172.21.15.113:0/2010604912 learned_addr learned my addr 172.21.15.113:0/2010604912 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 -- 172.21.15.113:0/2010604912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e99489a90 msgr2=0x559e994b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e99489a90 0x559e994b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 -- 172.21.15.113:0/2010604912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99485e90 msgr2=0x559e994b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9314e12640 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99485e90 0x559e994b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99485e90 0x559e994b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.410+0000 7f9315613640 1 -- 172.21.15.113:0/2010604912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e993b6690 con 0x559e994b5f10 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.411+0000 7f9315613640 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994b62f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f930c005bd0 tx=0x7f930c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e0700fc03c028d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.411+0000 7f92f2ffd640 1 -- 172.21.15.113:0/2010604912 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c01b070 con 0x559e994b5f10 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.411+0000 7f92f2ffd640 1 -- 172.21.15.113:0/2010604912 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c007720 con 0x559e994b5f10 2023-12-19T13:47:51.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.411+0000 7f92f2ffd640 1 -- 172.21.15.113:0/2010604912 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c012870 con 0x559e994b5f10 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 -- 172.21.15.113:0/2010604912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 msgr2=0x559e994b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994b62f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f930c005bd0 tx=0x7f930c00f000 comp rx=0 tx=0).stop 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 -- 172.21.15.113:0/2010604912 shutdown_connections 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e99489a90 0x559e994b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99485e90 0x559e994b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2010604912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994b62f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 -- 172.21.15.113:0/2010604912 >> 172.21.15.113:0/2010604912 conn(0x559e994881a0 msgr2=0x559e994d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 -- 172.21.15.113:0/2010604912 shutdown_connections 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.412+0000 7f931a3e9740 1 -- 172.21.15.113:0/2010604912 wait complete. 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.413+0000 7f931a3e9740 1 -- start start 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.413+0000 7f931a3e9740 1 Processor -- start 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e994d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994e4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e994d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f931a3e9740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e993907d0 con 0x559e994b5f10 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e99390470 con 0x559e99489a90 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e99156f20 con 0x559e994d4230 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f931a3e9740 10 client.0 _ll_register_callbacks cb 0x559e993df1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f9314e12640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994e4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f9314e12640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994e4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54968/0 (socket says 172.21.15.113:54968) 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f9314e12640 1 -- 172.21.15.113:0/2785230843 learned_addr learned my addr 172.21.15.113:0/2785230843 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.414+0000 7f9315613640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e994d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9314e12640 1 -- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 msgr2=0x559e994d46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9315e14640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e994d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9314e12640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e994d46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9314e12640 1 -- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 msgr2=0x559e994d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9314e12640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e994d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9314e12640 1 -- 172.21.15.113:0/2785230843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc003520 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9315613640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e994d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f9314e12640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994e4280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9300005520 tx=0x7f930000e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f141ec5c7919f5c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f92ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f92ebfff640 1 -- 172.21.15.113:0/2785230843 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300003a60 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f92ebfff640 1 -- 172.21.15.113:0/2785230843 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9300003bc0 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e99419550 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f92ebfff640 1 -- 172.21.15.113:0/2785230843 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9300003d80 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f931a3e9740 10 client.5301 fetch_fsmap learned FSMap version 16 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.415+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559e993ed680 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f92ebfff640 1 -- 172.21.15.113:0/2785230843 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e99419550 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f92ebfff640 1 -- 172.21.15.113:0/2785230843 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9300004050 con 0x559e994b5f10 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f931a3e9740 10 client.5301 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T13:47:51.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f931a3e9740 10 client.5301 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:47:51.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f931a3e9740 20 client.5301 populate_metadata read hostname 'smithi113' 2023-12-19T13:47:51.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949a610 0x559e9949a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f931a3e9740 4 client.5301 mds_command: new command op to 5127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:47:51.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.416+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 --> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e993e1b50 con 0x559e9949a610 2023-12-19T13:47:51.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.417+0000 7f9315613640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949a610 0x559e9949a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.418+0000 7f9315613640 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949a610 0x559e9949a9f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaae383a7d25f345 server_cookie=392f26272827fbe0 in_seq=0 out_seq=0 2023-12-19T13:47:51.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.418+0000 7f92ebfff640 10 client.5301 ms_handle_connect on v2:172.21.15.151:6833/2023707761 2023-12-19T13:47:51.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.419+0000 7f92ebfff640 1 -- 172.21.15.113:0/2785230843 <== mds.0 v2:172.21.15.151:6833/2023707761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559e993e1b50 con 0x559e9949a610 2023-12-19T13:47:51.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.419+0000 7f92ebfff640 10 client.5301 handle_command_reply: tid=0 2023-12-19T13:47:51.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.419+0000 7f931a3e9740 1 client.5301 shutdown 2023-12-19T13:47:51.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 msgr2=0x559e994e4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994e4280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9300005520 tx=0x7f930000e590 comp rx=0 tx=0).stop 2023-12-19T13:47:51.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 shutdown_connections 2023-12-19T13:47:51.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949a610 0x559e9949a9f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e994d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994b5f10 0x559e994e4280 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 --2- 172.21.15.113:0/2785230843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e994d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f92ebfff640 0 client.5301 ms_handle_reset on v2:172.21.15.151:6833/2023707761 2023-12-19T13:47:51.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 >> 172.21.15.113:0/2785230843 conn(0x559e99485e90 msgr2=0x559e9948a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 shutdown_connections 2023-12-19T13:47:51.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 1 -- 172.21.15.113:0/2785230843 wait complete. 2023-12-19T13:47:51.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.420+0000 7f931a3e9740 20 client.5301 trim_cache size 0 max 16384 2023-12-19T13:47:51.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.436+0000 7f931a3e9740 1 Processor -- start 2023-12-19T13:47:51.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.437+0000 7f931a3e9740 1 -- start start 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.437+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e99489a90 0x559e994b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.437+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e994b5f10 0x559e994b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.437+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e9948bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.437+0000 7f931a3e9740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e994b2550 con 0x559e99489a90 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.437+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e994d11e0 con 0x559e994b5f10 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.437+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e994b76d0 con 0x559e994d4230 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e99489a90 0x559e994b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e99489a90 0x559e994b9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54970/0 (socket says 172.21.15.113:54970) 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 -- 172.21.15.113:0/527729164 learned_addr learned my addr 172.21.15.113:0/527729164 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315e14640 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e9948bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 -- 172.21.15.113:0/527729164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 msgr2=0x559e9948bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e9948bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 -- 172.21.15.113:0/527729164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e994b5f10 msgr2=0x559e994b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e994b5f10 0x559e994b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 -- 172.21.15.113:0/527729164 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e9938f9e0 con 0x559e99489a90 2023-12-19T13:47:51.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.438+0000 7f9315613640 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e99489a90 0x559e994b9c80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f930c015000 tx=0x7f930c007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29670b4db2929aab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f92f37fe640 1 -- 172.21.15.113:0/527729164 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c01b040 con 0x559e99489a90 2023-12-19T13:47:51.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f92f37fe640 1 -- 172.21.15.113:0/527729164 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c012ad0 con 0x559e99489a90 2023-12-19T13:47:51.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f92f37fe640 1 -- 172.21.15.113:0/527729164 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c025040 con 0x559e99489a90 2023-12-19T13:47:51.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 -- 172.21.15.113:0/527729164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e99489a90 msgr2=0x559e994b9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e99489a90 0x559e994b9c80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f930c015000 tx=0x7f930c007000 comp rx=0 tx=0).stop 2023-12-19T13:47:51.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 -- 172.21.15.113:0/527729164 shutdown_connections 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994d4230 0x559e9948bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e994b5f10 0x559e994b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 --2- 172.21.15.113:0/527729164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e99489a90 0x559e994b9c80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 -- 172.21.15.113:0/527729164 >> 172.21.15.113:0/527729164 conn(0x559e99485e90 msgr2=0x559e994b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 -- 172.21.15.113:0/527729164 shutdown_connections 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.439+0000 7f931a3e9740 1 -- 172.21.15.113:0/527729164 wait complete. 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.440+0000 7f931a3e9740 1 -- start start 2023-12-19T13:47:51.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.440+0000 7f931a3e9740 1 Processor -- start 2023-12-19T13:47:51.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e99484e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994b5f10 0x559e99535a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f931a3e9740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994d4230 0x559e9949eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f931a3e9740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e9948c0b0 con 0x559e994d4230 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e994b8430 con 0x559e99489a90 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f931a3e9740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e99535f50 con 0x559e994b5f10 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f931a3e9740 10 client.0 _ll_register_callbacks cb 0x7f9300007ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.441+0000 7f9315e14640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994d4230 0x559e9949eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994d4230 0x559e9949eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54978/0 (socket says 172.21.15.113:54978) 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 -- 172.21.15.113:0/3140273076 learned_addr learned my addr 172.21.15.113:0/3140273076 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9314e12640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994b5f10 0x559e99535a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315613640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e99484e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 -- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994b5f10 msgr2=0x559e99535a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994b5f10 0x559e99535a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 -- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 msgr2=0x559e99484e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e99484e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 -- 172.21.15.113:0/3140273076 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e993b6690 con 0x559e994d4230 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9314e12640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994b5f10 0x559e99535a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f9315e14640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994d4230 0x559e9949eec0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f93080a9bb0 tx=0x7f930807b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c3b643b2daf4c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f92ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f92ebfff640 1 -- 172.21.15.113:0/3140273076 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930807ac50 con 0x559e994d4230 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f92ebfff640 1 -- 172.21.15.113:0/3140273076 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f930807adb0 con 0x559e994d4230 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.442+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f930c007720 con 0x559e994d4230 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f92ebfff640 1 -- 172.21.15.113:0/3140273076 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9308093050 con 0x559e994d4230 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 10 client.5307 fetch_fsmap learned FSMap version 16 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559e993b4ef0 con 0x559e994d4230 2023-12-19T13:47:51.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f92ebfff640 1 -- 172.21.15.113:0/3140273076 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c007720 con 0x559e994d4230 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f92ebfff640 1 -- 172.21.15.113:0/3140273076 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9308050020 con 0x559e994d4230 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 10 client.5307 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 10 client.5307 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 20 client.5307 populate_metadata read hostname 'smithi113' 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949ac70 0x559e9949b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 4 client.5307 mds_command: new command op to 5127 tid=0[{"prefix": "status"}] 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.443+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 --> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559e993e8080 con 0x559e9949ac70 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.444+0000 7f9315613640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949ac70 0x559e9949b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.445+0000 7f9315613640 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949ac70 0x559e9949b050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37aec38c0695e6e2 server_cookie=6c70165bb3d9006c in_seq=0 out_seq=0 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.445+0000 7f92ebfff640 10 client.5307 ms_handle_connect on v2:172.21.15.151:6833/2023707761 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.445+0000 7f92ebfff640 1 -- 172.21.15.113:0/3140273076 <== mds.0 v2:172.21.15.151:6833/2023707761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559e993e8080 con 0x559e9949ac70 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.445+0000 7f92ebfff640 10 client.5307 handle_command_reply: tid=0 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.445+0000 7f931a3e9740 1 client.5307 shutdown 2023-12-19T13:47:51.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994d4230 msgr2=0x559e9949eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994d4230 0x559e9949eec0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f93080a9bb0 tx=0x7f930807b230 comp rx=0 tx=0).stop 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 shutdown_connections 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:6833/2023707761,v1:172.21.15.151:6835/2023707761] conn(0x559e9949ac70 0x559e9949b050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x559e994d4230 0x559e9949eec0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559e994b5f10 0x559e99535a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 --2- 172.21.15.113:0/3140273076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e99489a90 0x559e99484e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 >> 172.21.15.113:0/3140273076 conn(0x559e99485e90 msgr2=0x559e9948a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f92ebfff640 0 client.5307 ms_handle_reset on v2:172.21.15.151:6833/2023707761 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 shutdown_connections 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 1 -- 172.21.15.113:0/3140273076 wait complete. 2023-12-19T13:47:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.446+0000 7f931a3e9740 20 client.5307 trim_cache size 0 max 16384 2023-12-19T13:47:51.453 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:47:51.453 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:47:51.453 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:47:51.453 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 5127, 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 6.6747070529999997, 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 16, 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 34, 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 34, 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 15.294161388999999 2023-12-19T13:47:51.454 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:47:51.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92f406a460 msgr2=0x7f92f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92f406a460 0x7f92f406c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f930c001570 tx=0x7f930c007930 comp rx=0 tx=0).stop 2023-12-19T13:47:51.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9310146c40 msgr2=0x7f931013ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9310146c40 0x7f931013ded0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9308009d90 tx=0x7f9308004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:51.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 shutdown_connections 2023-12-19T13:47:51.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92f406a460 0x7f92f406c920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9310146c40 0x7f931013ded0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93100b77c0 0x7f931015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 --2- 172.21.15.113:0/1358334612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93100b7360 0x7f931013caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 >> 172.21.15.113:0/1358334612 conn(0x7f93100d31b0 msgr2=0x7f931015d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 shutdown_connections 2023-12-19T13:47:51.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.447+0000 7f9316615640 1 -- 172.21.15.113:0/1358334612 wait complete. 2023-12-19T13:47:51.465 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:47:51.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.675+0000 7fda8d05f640 1 Processor -- start 2023-12-19T13:47:51.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.675+0000 7fda8d05f640 1 -- start start 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda8d05f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fda88157bf0 0x7fda8815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda8d05f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fda880ae110 0x7fda880b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda8d05f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda880b0640 0x7fda8815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda8d05f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8806b8c0 con 0x7fda880ae110 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda8d05f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda880b0ab0 con 0x7fda88157bf0 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda8d05f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8815b740 con 0x7fda880b0640 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda7e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fda880ae110 0x7fda880b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda7e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fda880ae110 0x7fda880b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54990/0 (socket says 172.21.15.113:54990) 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.677+0000 7fda7e59c640 1 -- 172.21.15.113:0/3498608551 learned_addr learned my addr 172.21.15.113:0/3498608551 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.678+0000 7fda86d9d640 1 --2- 172.21.15.113:0/3498608551 >> v2:172.21.15.151:3300/0 conn(0x7fda88157bf0 0x7fda8815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.678+0000 7fda8759e640 1 --2- 172.21.15.113:0/3498608551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda880b0640 0x7fda8815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.678+0000 7fda7e59c640 1 -- 172.21.15.113:0/3498608551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda880b0640 msgr2=0x7fda8815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.678+0000 7fda7e59c640 1 --2- 172.21.15.113:0/3498608551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda880b0640 0x7fda8815dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.678+0000 7fda7e59c640 1 -- 172.21.15.113:0/3498608551 >> v2:172.21.15.151:3300/0 conn(0x7fda88157bf0 msgr2=0x7fda8815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:51.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.678+0000 7fda7e59c640 1 --2- 172.21.15.113:0/3498608551 >> v2:172.21.15.151:3300/0 conn(0x7fda88157bf0 0x7fda8815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.678+0000 7fda7e59c640 1 -- 172.21.15.113:0/3498608551 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda880ae640 con 0x7fda880ae110 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.679+0000 7fda7e59c640 1 --2- 172.21.15.113:0/3498608551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880ae110 0x7fda880b0100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fda880ccbc0 tx=0x7fda7002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630a5a52ed398b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.679+0000 7fda8659c640 1 -- 172.21.15.113:0/3498608551 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70031640 con 0x7fda880ae110 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.679+0000 7fda8659c640 1 -- 172.21.15.113:0/3498608551 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda700317a0 con 0x7fda880ae110 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.679+0000 7fda8659c640 1 -- 172.21.15.113:0/3498608551 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70031b30 con 0x7fda880ae110 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 -- 172.21.15.113:0/3498608551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880ae110 msgr2=0x7fda880b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 --2- 172.21.15.113:0/3498608551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880ae110 0x7fda880b0100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fda880ccbc0 tx=0x7fda7002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 -- 172.21.15.113:0/3498608551 shutdown_connections 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 --2- 172.21.15.113:0/3498608551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda880b0640 0x7fda8815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 --2- 172.21.15.113:0/3498608551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880ae110 0x7fda880b0100 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 --2- 172.21.15.113:0/3498608551 >> v2:172.21.15.151:3300/0 conn(0x7fda88157bf0 0x7fda8815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 -- 172.21.15.113:0/3498608551 >> 172.21.15.113:0/3498608551 conn(0x7fda880cbb70 msgr2=0x7fda880cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 -- 172.21.15.113:0/3498608551 shutdown_connections 2023-12-19T13:47:51.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.680+0000 7fda8d05f640 1 -- 172.21.15.113:0/3498608551 wait complete. 2023-12-19T13:47:51.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.682+0000 7fda8d05f640 1 Processor -- start 2023-12-19T13:47:51.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.682+0000 7fda8d05f640 1 -- start start 2023-12-19T13:47:51.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda8d05f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda880ae110 0x7fda8814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda8d05f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880b0640 0x7fda88151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda8d05f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda88157bf0 0x7fda880ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda8d05f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda88152c40 con 0x7fda880b0640 2023-12-19T13:47:51.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda8d05f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8814e510 con 0x7fda880ae110 2023-12-19T13:47:51.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda8d05f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda88150a50 con 0x7fda88157bf0 2023-12-19T13:47:51.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880b0640 0x7fda88151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880b0640 0x7fda88151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54996/0 (socket says 172.21.15.113:54996) 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 -- 172.21.15.113:0/2460667020 learned_addr learned my addr 172.21.15.113:0/2460667020 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda86d9d640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda880ae110 0x7fda8814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 -- 172.21.15.113:0/2460667020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda88157bf0 msgr2=0x7fda880ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda88157bf0 0x7fda880ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 -- 172.21.15.113:0/2460667020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda880ae110 msgr2=0x7fda8814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda880ae110 0x7fda8814dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.683+0000 7fda7e59c640 1 -- 172.21.15.113:0/2460667020 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda700094d0 con 0x7fda880b0640 2023-12-19T13:47:51.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.684+0000 7fda7e59c640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880b0640 0x7fda88151a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fda70000c00 tx=0x7fda700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.684+0000 7fda7ffff640 1 -- 172.21.15.113:0/2460667020 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7003ac60 con 0x7fda880b0640 2023-12-19T13:47:51.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.684+0000 7fda7ffff640 1 -- 172.21.15.113:0/2460667020 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7003adc0 con 0x7fda880b0640 2023-12-19T13:47:51.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.684+0000 7fda7ffff640 1 -- 172.21.15.113:0/2460667020 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70044630 con 0x7fda880b0640 2023-12-19T13:47:51.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.684+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda88150ca0 con 0x7fda880b0640 2023-12-19T13:47:51.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.684+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda88151260 con 0x7fda880b0640 2023-12-19T13:47:51.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.685+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda88061910 con 0x7fda880b0640 2023-12-19T13:47:51.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.686+0000 7fda7ffff640 1 -- 172.21.15.113:0/2460667020 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda7002f050 con 0x7fda880b0640 2023-12-19T13:47:51.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.687+0000 7fda7ffff640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda6c06a430 0x7fda6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:51.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.687+0000 7fda7ffff640 1 -- 172.21.15.113:0/2460667020 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda700aa810 con 0x7fda880b0640 2023-12-19T13:47:51.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.687+0000 7fda86d9d640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda6c06a430 0x7fda6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:51.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.688+0000 7fda86d9d640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda6c06a430 0x7fda6c06c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda78006fd0 tx=0x7fda78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:51.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.692+0000 7fda7ffff640 1 -- 172.21.15.113:0/2460667020 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fda70075d60 con 0x7fda880b0640 2023-12-19T13:47:51.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.915+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fda880ae8f0 con 0x7fda880b0640 2023-12-19T13:47:51.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.915+0000 7fda7ffff640 1 -- 172.21.15.113:0/2460667020 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fda70031e60 con 0x7fda880b0640 2023-12-19T13:47:51.915 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:47:51.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda6c06a430 msgr2=0x7fda6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda6c06a430 0x7fda6c06c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda78006fd0 tx=0x7fda78008040 comp rx=0 tx=0).stop 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880b0640 msgr2=0x7fda88151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880b0640 0x7fda88151a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fda70000c00 tx=0x7fda700046c0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 shutdown_connections 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda6c06a430 0x7fda6c06c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda88157bf0 0x7fda880ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda880b0640 0x7fda88151a60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 --2- 172.21.15.113:0/2460667020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda880ae110 0x7fda8814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 >> 172.21.15.113:0/2460667020 conn(0x7fda880cbb70 msgr2=0x7fda880b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 shutdown_connections 2023-12-19T13:47:51.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:51.918+0000 7fda8d05f640 1 -- 172.21.15.113:0/2460667020 wait complete. 2023-12-19T13:47:51.935 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:47:51.935 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:47:51.935 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:47:51.935 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:47:51.935 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:47:51.936 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:47:51.936 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:47:51.936 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:47:51.936 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:47:51.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:51.936 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:47:51.988 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:51.989 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:51.990 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:47:51.991 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:47:51.991 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:47:51.991 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:51.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:51.991 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:47:52.077 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:47:52.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:52.081 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:47:52.128 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:47:52.128 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:47:52.128 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:47:52.128 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:47:52.128 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:47:52.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:52.128 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:47:52.129 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:47:52.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:47:52.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:47:52.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:47:52.129 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:47:52.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:52.357 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:47:52.408 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:47:52.409 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:47:52.410 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:47:52.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:52.410 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:47:52.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:52.503 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:47:52.558 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:47:52.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:52.558 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:47:52.609 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:47:52.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:52.610 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:52.751 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:52.751 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:52.786 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:52.786 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:52.786 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:47:52.786 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:47:52.786 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:47:52.789 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:47:52.789 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:47:52.789 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:47:52.789 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:47:52.789 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:47:52.793 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:47:52.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:52.793 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:47:52.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:52.877 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:52.952 INFO:teuthology.orchestra.run.smithi113.stdout:client4622 2023-12-19T13:47:52.952 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:47:52.952 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:53.004 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:47:53.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.206+0000 7f10128ca640 1 Processor -- start 2023-12-19T13:47:53.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.206+0000 7f10128ca640 1 -- start start 2023-12-19T13:47:53.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f10128ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c157bf0 0x7f100c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f10128ca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f100c0b0810 0x7f100c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f10128ca640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c15b740 con 0x7f100c0ae110 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f10128ca640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c06b8c0 con 0x7f100c0b0810 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f10128ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0ae640 con 0x7f100c157bf0 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f1010e67640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f100c0b0810 0x7f100c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f1010e67640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f100c0b0810 0x7f100c06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55012/0 (socket says 172.21.15.113:55012) 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f1010e67640 1 -- 172.21.15.113:0/4095414498 learned_addr learned my addr 172.21.15.113:0/4095414498 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:53.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f1003fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f100c0ae110 0x7f100c0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33982/0 (socket says 172.21.15.113:33982) 2023-12-19T13:47:53.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.208+0000 7f100bfff640 1 --2- 172.21.15.113:0/4095414498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c157bf0 0x7f100c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:53.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.209+0000 7f1010e67640 1 -- 172.21.15.113:0/4095414498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c157bf0 msgr2=0x7f100c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:53.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.209+0000 7f1010e67640 1 --2- 172.21.15.113:0/4095414498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c157bf0 0x7f100c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.209+0000 7f1010e67640 1 -- 172.21.15.113:0/4095414498 >> v1:172.21.15.113:6789/0 conn(0x7f100c0ae110 legacy=0x7f100c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:53.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.209+0000 7f1010e67640 1 -- 172.21.15.113:0/4095414498 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c0ae920 con 0x7f100c0b0810 2023-12-19T13:47:53.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.210+0000 7f1010e67640 1 --2- 172.21.15.113:0/4095414498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c0b0810 0x7f100c06d230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f100400d150 tx=0x7f100402e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd6556523a80f7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.210+0000 7f100b7fe640 1 -- 172.21.15.113:0/4095414498 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400b0d0 con 0x7f100c0b0810 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.210+0000 7f100b7fe640 1 -- 172.21.15.113:0/4095414498 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400b230 con 0x7f100c0b0810 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.210+0000 7f100b7fe640 1 -- 172.21.15.113:0/4095414498 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004009600 con 0x7f100c0b0810 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 -- 172.21.15.113:0/4095414498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c0b0810 msgr2=0x7f100c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 --2- 172.21.15.113:0/4095414498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c0b0810 0x7f100c06d230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f100400d150 tx=0x7f100402e160 comp rx=0 tx=0).stop 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 -- 172.21.15.113:0/4095414498 shutdown_connections 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 --2- 172.21.15.113:0/4095414498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c0b0810 0x7f100c06d230 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 --2- 172.21.15.113:0/4095414498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c157bf0 0x7f100c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 -- 172.21.15.113:0/4095414498 >> 172.21.15.113:0/4095414498 conn(0x7f100c0cbb70 msgr2=0x7f100c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 -- 172.21.15.113:0/4095414498 shutdown_connections 2023-12-19T13:47:53.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.211+0000 7f10128ca640 1 -- 172.21.15.113:0/4095414498 wait complete. 2023-12-19T13:47:53.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.213+0000 7f10128ca640 1 Processor -- start 2023-12-19T13:47:53.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.213+0000 7f10128ca640 1 -- start start 2023-12-19T13:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f10128ca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f100c0ae110 0x7f100c14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f10128ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c0b0810 0x7f100c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f10128ca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c157bf0 0x7f100c151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f10128ca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c1501f0 con 0x7f100c157bf0 2023-12-19T13:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f10128ca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c154920 con 0x7f100c0ae110 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f10128ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c150530 con 0x7f100c0b0810 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1010e67640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c157bf0 0x7f100c151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1010e67640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c157bf0 0x7f100c151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55018/0 (socket says 172.21.15.113:55018) 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1010e67640 1 -- 172.21.15.113:0/4186348508 learned_addr learned my addr 172.21.15.113:0/4186348508 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1003fff640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c0b0810 0x7f100c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f100bfff640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f100c0ae110 0x7f100c14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1010e67640 1 -- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c0b0810 msgr2=0x7f100c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1010e67640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c0b0810 0x7f100c156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1010e67640 1 -- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f100c0ae110 msgr2=0x7f100c14f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.214+0000 7f1010e67640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f100c0ae110 0x7f100c14f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.215+0000 7f1010e67640 1 -- 172.21.15.113:0/4186348508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100400bd40 con 0x7f100c157bf0 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.215+0000 7f1010e67640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c157bf0 0x7f100c151010 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1004038040 tx=0x7f1004004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.215+0000 7f10097fa640 1 -- 172.21.15.113:0/4186348508 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400b0d0 con 0x7f100c157bf0 2023-12-19T13:47:53.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.215+0000 7f10097fa640 1 -- 172.21.15.113:0/4186348508 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1004036820 con 0x7f100c157bf0 2023-12-19T13:47:53.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.215+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c150810 con 0x7f100c157bf0 2023-12-19T13:47:53.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.215+0000 7f10097fa640 1 -- 172.21.15.113:0/4186348508 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004036bd0 con 0x7f100c157bf0 2023-12-19T13:47:53.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.215+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c154c00 con 0x7f100c157bf0 2023-12-19T13:47:53.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.216+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c150d30 con 0x7f100c157bf0 2023-12-19T13:47:53.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.217+0000 7f10097fa640 1 -- 172.21.15.113:0/4186348508 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1004036d30 con 0x7f100c157bf0 2023-12-19T13:47:53.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.218+0000 7f10097fa640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0fec06a430 0x7f0fec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:53.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.218+0000 7f10097fa640 1 -- 172.21.15.113:0/4186348508 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10040abc40 con 0x7f100c157bf0 2023-12-19T13:47:53.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.218+0000 7f100bfff640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0fec06a430 0x7f0fec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:53.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.219+0000 7f100bfff640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0fec06a430 0x7f0fec06c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc006fd0 tx=0x7f0ffc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:53.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.222+0000 7f10097fa640 1 -- 172.21.15.113:0/4186348508 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1004077340 con 0x7f100c157bf0 2023-12-19T13:47:53.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.450+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f100c0ad790 con 0x7f100c157bf0 2023-12-19T13:47:53.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.451+0000 7f10097fa640 1 -- 172.21.15.113:0/4186348508 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f100400b720 con 0x7f100c157bf0 2023-12-19T13:47:53.452 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:47:53.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0fec06a430 msgr2=0x7f0fec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:53.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0fec06a430 0x7f0fec06c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc006fd0 tx=0x7f0ffc008040 comp rx=0 tx=0).stop 2023-12-19T13:47:53.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c157bf0 msgr2=0x7f100c151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:53.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c157bf0 0x7f100c151010 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1004038040 tx=0x7f1004004a40 comp rx=0 tx=0).stop 2023-12-19T13:47:53.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 shutdown_connections 2023-12-19T13:47:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0fec06a430 0x7f0fec06c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f100c157bf0 0x7f100c151010 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f100c0b0810 0x7f100c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 --2- 172.21.15.113:0/4186348508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f100c0ae110 0x7f100c14f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 >> 172.21.15.113:0/4186348508 conn(0x7f100c0cbb70 msgr2=0x7f100c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 shutdown_connections 2023-12-19T13:47:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:53.454+0000 7f10128ca640 1 -- 172.21.15.113:0/4186348508 wait complete. 2023-12-19T13:47:53.474 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:47:53.474 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:47:53.474 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:47:53.475 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:47:53.475 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:53.475 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:47:53.475 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:47:53.475 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:47:53.475 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:47:53.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:53.475 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:47:53.534 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:53.535 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42321sec preferred_lft 42321sec 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:53.536 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:47:53.537 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:47:53.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:53.538 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:47:53.628 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:47:53.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:53.633 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:47:53.690 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:47:53.690 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:47:53.690 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:47:53.690 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:47:53.690 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:47:53.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:53.691 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:47:53.691 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:47:53.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:47:53.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:47:53.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:47:53.691 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:47:53.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:53.872 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:47:53.925 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:47:53.925 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:47:53.926 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:47:53.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:53.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:47:54.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:54.020 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:54.075 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:47:54.076 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:47:54.076 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:54.127 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:47:54.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:54.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:54.271 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:54.271 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:54.303 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:47:54.303 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:47:54.303 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:47:54.303 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:47:54.303 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:47:54.305 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:47:54.305 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:47:54.305 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:47:54.305 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:47:54.305 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:47:54.308 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:47:54.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:54.308 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:47:54.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:54.395 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:54.451 INFO:teuthology.orchestra.run.smithi151.stdout:client4628 2023-12-19T13:47:54.451 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:47:54.451 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:47:54.500 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:54.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.720+0000 7f6c28954640 1 Processor -- start 2023-12-19T13:47:54.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.720+0000 7f6c28954640 1 -- start start 2023-12-19T13:47:54.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.722+0000 7f6c28954640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6c240b8070 0x7f6c240d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.722+0000 7f6c28954640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 0x7f6c2415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.722+0000 7f6c28954640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c240d12d0 con 0x7f6c24146e30 2023-12-19T13:47:54.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.722+0000 7f6c28954640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c24147210 con 0x7f6c240b8070 2023-12-19T13:47:54.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.722+0000 7f6c28954640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240d2370 con 0x7f6c240d0a90 2023-12-19T13:47:54.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.722+0000 7f6c22d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6c24146e30 0x7f6c240b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33984/0 (socket says 172.21.15.113:33984) 2023-12-19T13:47:54.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.722+0000 7f6c22d9d640 1 -- 172.21.15.113:0/2048280233 learned_addr learned my addr 172.21.15.113:0/2048280233 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c1bfff640 1 --2- 172.21.15.113:0/2048280233 >> v2:172.21.15.151:3300/0 conn(0x7f6c240b8070 0x7f6c240d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019146671 0 0) 0x7f6c240d12d0 con 0x7f6c24146e30 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c10003520 con 0x7f6c24146e30 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2359e640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 0x7f6c2415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3978146993 0 0) 0x7f6c10003520 con 0x7f6c24146e30 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 msgr2=0x7f6c2415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 0x7f6c2415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 >> v2:172.21.15.151:3300/0 conn(0x7f6c240b8070 msgr2=0x7f6c240d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 --2- 172.21.15.113:0/2048280233 >> v2:172.21.15.151:3300/0 conn(0x7f6c240b8070 0x7f6c240d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240d15b0 con 0x7f6c24146e30 2023-12-19T13:47:54.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6c14001670 con 0x7f6c24146e30 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2359e640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 0x7f6c2415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.723+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 >> v1:172.21.15.113:6789/0 conn(0x7f6c24146e30 legacy=0x7f6c240b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c2259c640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c10003970 0x7f6c10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c2259c640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c100047c0 0x7f6c10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c2259c640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 0x7f6c10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c24147210 con 0x7f6c10003970 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240d2370 con 0x7f6c100047c0 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1000ba30 con 0x7f6c240d0a90 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c22d9d640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c10003970 0x7f6c10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c1bfff640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c100047c0 0x7f6c10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c2359e640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 0x7f6c10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c22d9d640 1 -- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 msgr2=0x7f6c10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:54.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c22d9d640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c240d0a90 0x7f6c10005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c22d9d640 1 -- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c100047c0 msgr2=0x7f6c10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:54.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c22d9d640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c100047c0 0x7f6c10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.724+0000 7f6c22d9d640 1 -- 172.21.15.113:0/2048280233 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10003520 con 0x7f6c10003970 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.726+0000 7f6c22d9d640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c10003970 0x7f6c10003d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c0e0 tx=0x7f6c100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e249f5bac22331a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.726+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14005ad0 con 0x7f6c10003970 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.726+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14005c30 con 0x7f6c10003970 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.726+0000 7f6c2259c640 1 -- 172.21.15.113:0/2048280233 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1402c7d0 con 0x7f6c10003970 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.727+0000 7f6c28954640 1 -- 172.21.15.113:0/2048280233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c10003970 msgr2=0x7f6c10003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.727+0000 7f6c28954640 1 --2- 172.21.15.113:0/2048280233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c10003970 0x7f6c10003d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c0e0 tx=0x7f6c100057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.727+0000 7f6c2359e640 1 -- 172.21.15.113:0/2048280233 reap_dead start 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.727+0000 7f6c28954640 1 -- 172.21.15.113:0/2048280233 shutdown_connections 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.727+0000 7f6c28954640 1 -- 172.21.15.113:0/2048280233 >> 172.21.15.113:0/2048280233 conn(0x7f6c240b2990 msgr2=0x7f6c240b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:54.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.727+0000 7f6c28954640 1 -- 172.21.15.113:0/2048280233 shutdown_connections 2023-12-19T13:47:54.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.727+0000 7f6c28954640 1 -- 172.21.15.113:0/2048280233 wait complete. 2023-12-19T13:47:54.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.729+0000 7f6c28954640 1 Processor -- start 2023-12-19T13:47:54.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.729+0000 7f6c28954640 1 -- start start 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c28954640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c10003970 0x7f6c241e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c28954640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c241e1c30 0x7f6c240b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c28954640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c240b57c0 0x7f6c24140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c28954640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240b5c70 con 0x7f6c240b57c0 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c28954640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241e5b90 con 0x7f6c10003970 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c28954640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241e2440 con 0x7f6c241e1c30 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c2359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c240b57c0 0x7f6c24140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c2359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c240b57c0 0x7f6c24140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55040/0 (socket says 172.21.15.113:55040) 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.730+0000 7f6c2359e640 1 -- 172.21.15.113:0/1551821000 learned_addr learned my addr 172.21.15.113:0/1551821000 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c1bfff640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c241e1c30 0x7f6c240b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c22d9d640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c10003970 0x7f6c241e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c2359e640 1 -- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c241e1c30 msgr2=0x7f6c240b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c2359e640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c241e1c30 0x7f6c240b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c2359e640 1 -- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c10003970 msgr2=0x7f6c241e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c2359e640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c10003970 0x7f6c241e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c2359e640 1 -- 172.21.15.113:0/1551821000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c241e5e30 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c2359e640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c240b57c0 0x7f6c24140710 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6c240b86e0 tx=0x7f6c1c0046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c1b7fe640 1 -- 172.21.15.113:0/1551821000 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c007cf0 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c1b7fe640 1 -- 172.21.15.113:0/1551821000 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c007e90 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c1b7fe640 1 -- 172.21.15.113:0/1551821000 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c014640 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.731+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c241e6110 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.732+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c241412f0 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.733+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c24061910 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.734+0000 7f6c1b7fe640 1 -- 172.21.15.113:0/1551821000 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c1c0147a0 con 0x7f6c240b57c0 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.734+0000 7f6c1b7fe640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6c0406a460 0x7f6c0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:54.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.735+0000 7f6c1b7fe640 1 -- 172.21.15.113:0/1551821000 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c1c088610 con 0x7f6c240b57c0 2023-12-19T13:47:54.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.735+0000 7f6c22d9d640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6c0406a460 0x7f6c0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:54.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.736+0000 7f6c22d9d640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6c0406a460 0x7f6c0406c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c14034000 tx=0x7f6c14007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:54.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.739+0000 7f6c1b7fe640 1 -- 172.21.15.113:0/1551821000 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c1c053c10 con 0x7f6c240b57c0 2023-12-19T13:47:54.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.967+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c241e2680 con 0x7f6c240b57c0 2023-12-19T13:47:54.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.968+0000 7f6c1b7fe640 1 -- 172.21.15.113:0/1551821000 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f6c1c057230 con 0x7f6c240b57c0 2023-12-19T13:47:54.968 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:54.968 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:47:54.968 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:47:54.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.970+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6c0406a460 msgr2=0x7f6c0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.970+0000 7f6c28954640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6c0406a460 0x7f6c0406c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c14034000 tx=0x7f6c14007000 comp rx=0 tx=0).stop 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.970+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c240b57c0 msgr2=0x7f6c24140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.970+0000 7f6c28954640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c240b57c0 0x7f6c24140710 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6c240b86e0 tx=0x7f6c1c0046e0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 shutdown_connections 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6c0406a460 0x7f6c0406c920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c240b57c0 0x7f6c24140710 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c241e1c30 0x7f6c240b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 --2- 172.21.15.113:0/1551821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c10003970 0x7f6c241e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 >> 172.21.15.113:0/1551821000 conn(0x7f6c240b2990 msgr2=0x7f6c24142e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 shutdown_connections 2023-12-19T13:47:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:54.971+0000 7f6c28954640 1 -- 172.21.15.113:0/1551821000 wait complete. 2023-12-19T13:47:54.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-19T13:47:55.228 INFO:teuthology.orchestra.run.smithi151.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":5127,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.441143324,"mdsmap_epoch":16,"osdmap_epoch":34,"osdmap_epoch_barrier":34,"uptime":19.060604568999999} 2023-12-19T13:47:55.228 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 5127, "mdsmap_epoch": 16, "osdmap_epoch": 34, "osdmap_epoch_barrier": 34, "rank_uptime": 10.441143324, "state": "up:active", "uptime": 19.060604569, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:47:55.229 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-12-19T13:47:55.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.451+0000 7f4eba727640 1 Processor -- start 2023-12-19T13:47:55.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.451+0000 7f4eba727640 1 -- start start 2023-12-19T13:47:55.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.453+0000 7f4eba727640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4eb41449e0 0x7f4eb40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.453+0000 7f4eba727640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 0x7f4eb406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.453+0000 7f4eba727640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb40afb10 con 0x7f4eb406b590 2023-12-19T13:47:55.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.453+0000 7f4eba727640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb406bb30 con 0x7f4eb41449e0 2023-12-19T13:47:55.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.453+0000 7f4eba727640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b0070 con 0x7f4eb40b0b50 2023-12-19T13:47:55.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.453+0000 7f4eb8cc4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4eb406b590 0x7f4eb415eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33990/0 (socket says 172.21.15.113:33990) 2023-12-19T13:47:55.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.453+0000 7f4eb8cc4640 1 -- 172.21.15.113:0/795757348 learned_addr learned my addr 172.21.15.113:0/795757348 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:55.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726097194 0 0) 0x7f4eb40afb10 con 0x7f4eb406b590 2023-12-19T13:47:55.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ea0003520 con 0x7f4eb406b590 2023-12-19T13:47:55.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/795757348 >> v2:172.21.15.151:3300/0 conn(0x7f4eb41449e0 0x7f4eb40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:55.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb37fe640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 0x7f4eb406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:55.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895955611 0 0) 0x7f4ea0003520 con 0x7f4eb406b590 2023-12-19T13:47:55.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 msgr2=0x7f4eb406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:55.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 0x7f4eb406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 >> v2:172.21.15.151:3300/0 conn(0x7f4eb41449e0 msgr2=0x7f4eb40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:55.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 --2- 172.21.15.113:0/795757348 >> v2:172.21.15.151:3300/0 conn(0x7f4eb41449e0 0x7f4eb40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40b0350 con 0x7f4eb406b590 2023-12-19T13:47:55.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f4ea4001670 con 0x7f4eb406b590 2023-12-19T13:47:55.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb37fe640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 0x7f4eb406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:47:55.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 >> v1:172.21.15.113:6789/0 conn(0x7f4eb406b590 legacy=0x7f4eb415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:55.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4ea0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 0x7f4ea00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea0004d00 0x7f4ea0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb406bb30 con 0x7f4ea00039e0 2023-12-19T13:47:55.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b0070 con 0x7f4ea0004d00 2023-12-19T13:47:55.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea000ba80 con 0x7f4eb40b0b50 2023-12-19T13:47:55.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.454+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4ea0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:55.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.455+0000 7f4eb3fff640 1 -- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 msgr2=0x7f4ea00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:55.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.455+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb40b0b50 0x7f4ea00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.455+0000 7f4eb3fff640 1 -- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea0004d00 msgr2=0x7f4ea0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:55.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.455+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea0004d00 0x7f4ea0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.455+0000 7f4eb3fff640 1 -- 172.21.15.113:0/795757348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0003520 con 0x7f4ea00039e0 2023-12-19T13:47:55.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.456+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4ea0003e00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007360 tx=0x7f4ea00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5602a7543d462 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:55.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.456+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac02ccf0 con 0x7f4ea00039e0 2023-12-19T13:47:55.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.456+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac02ce50 con 0x7f4ea00039e0 2023-12-19T13:47:55.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.456+0000 7f4eb2ffd640 1 -- 172.21.15.113:0/795757348 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac034660 con 0x7f4ea00039e0 2023-12-19T13:47:55.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.457+0000 7f4eba727640 1 -- 172.21.15.113:0/795757348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 msgr2=0x7f4ea0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:55.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.457+0000 7f4eba727640 1 --2- 172.21.15.113:0/795757348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4ea0003e00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007360 tx=0x7f4ea00057f0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.457+0000 7f4eb8cc4640 1 -- 172.21.15.113:0/795757348 reap_dead start 2023-12-19T13:47:55.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.457+0000 7f4eba727640 1 -- 172.21.15.113:0/795757348 shutdown_connections 2023-12-19T13:47:55.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.457+0000 7f4eba727640 1 -- 172.21.15.113:0/795757348 >> 172.21.15.113:0/795757348 conn(0x7f4eb40cbb70 msgr2=0x7f4eb40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:55.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.457+0000 7f4eba727640 1 -- 172.21.15.113:0/795757348 shutdown_connections 2023-12-19T13:47:55.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.457+0000 7f4eba727640 1 -- 172.21.15.113:0/795757348 wait complete. 2023-12-19T13:47:55.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.459+0000 7f4eba727640 1 Processor -- start 2023-12-19T13:47:55.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.459+0000 7f4eba727640 1 -- start start 2023-12-19T13:47:55.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eba727640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4eb40ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eba727640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb4143410 0x7f4eb41f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eba727640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb41f35b0 0x7f4eb41f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eba727640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cd4d0 con 0x7f4ea00039e0 2023-12-19T13:47:55.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eba727640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cd7b0 con 0x7f4eb4143410 2023-12-19T13:47:55.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eba727640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cda90 con 0x7f4eb41f35b0 2023-12-19T13:47:55.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eb3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4eb40ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:55.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eb3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4eb40ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55056/0 (socket says 172.21.15.113:55056) 2023-12-19T13:47:55.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.460+0000 7f4eb3fff640 1 -- 172.21.15.113:0/3797936416 learned_addr learned my addr 172.21.15.113:0/3797936416 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:55.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb3fff640 1 -- 172.21.15.113:0/3797936416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb41f35b0 msgr2=0x7f4eb41f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:55.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb41f35b0 0x7f4eb41f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb3fff640 1 -- 172.21.15.113:0/3797936416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb4143410 msgr2=0x7f4eb41f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:55.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb4143410 0x7f4eb41f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb3fff640 1 -- 172.21.15.113:0/3797936416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40cdd70 con 0x7f4ea00039e0 2023-12-19T13:47:55.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb3fff640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4eb40ccc80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4eac02dfd0 tx=0x7f4eac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:55.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb0ff9640 1 -- 172.21.15.113:0/3797936416 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac003b90 con 0x7f4ea00039e0 2023-12-19T13:47:55.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb0ff9640 1 -- 172.21.15.113:0/3797936416 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac003cf0 con 0x7f4ea00039e0 2023-12-19T13:47:55.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eb0ff9640 1 -- 172.21.15.113:0/3797936416 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac004260 con 0x7f4ea00039e0 2023-12-19T13:47:55.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.461+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb40ce050 con 0x7f4ea00039e0 2023-12-19T13:47:55.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.462+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb40ce570 con 0x7f4ea00039e0 2023-12-19T13:47:55.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.463+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb40ce1e0 con 0x7f4ea00039e0 2023-12-19T13:47:55.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.464+0000 7f4eb0ff9640 1 -- 172.21.15.113:0/3797936416 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4eac03b040 con 0x7f4ea00039e0 2023-12-19T13:47:55.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.465+0000 7f4eb0ff9640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:55.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.465+0000 7f4eb0ff9640 1 -- 172.21.15.113:0/3797936416 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4eac0a9f70 con 0x7f4ea00039e0 2023-12-19T13:47:55.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.465+0000 7f4eb37fe640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:55.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.465+0000 7f4eb37fe640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4eb406d9b0 tx=0x7f4e9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:55.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.469+0000 7f4eb0ff9640 1 -- 172.21.15.113:0/3797936416 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4eac0754c0 con 0x7f4ea00039e0 2023-12-19T13:47:55.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.732+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f4eb4061910 con 0x7f4ea00039e0 2023-12-19T13:47:55.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.733+0000 7f4eb0ff9640 1 -- 172.21.15.113:0/3797936416 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7f4eac039020 con 0x7f4ea00039e0 2023-12-19T13:47:55.732 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:55.732 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:47:55.732 INFO:teuthology.orchestra.run.smithi113.stdout: "stats": { 2023-12-19T13:47:55.732 INFO:teuthology.orchestra.run.smithi113.stdout: "total_bytes": 1600000000, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "total_avail_bytes": 1597603252, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "total_used_bytes": 2396748, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "total_used_raw_bytes": 2396748, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "total_used_raw_ratio": 0.0014979675179347396, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "num_osds": 8, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "num_per_pool_osds": 0, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "num_per_pool_omap_osds": 0 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "stats_by_class": { 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "hdd": { 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "total_bytes": 1600000000, 2023-12-19T13:47:55.733 INFO:teuthology.orchestra.run.smithi113.stdout: "total_avail_bytes": 1597603252, 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "total_used_bytes": 2396748, 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "total_used_raw_bytes": 2396748, 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "total_used_raw_ratio": 0.0014979675179347396 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "name": ".mgr", 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 1, 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "stats": { 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "stored": 590368, 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "objects": 2, 2023-12-19T13:47:55.734 INFO:teuthology.orchestra.run.smithi113.stdout: "kb_used": 577, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "bytes_used": 590368, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "percent_used": 0.00052964512724429369, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "max_avail": 557028928 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "name": "cephfs_metadata", 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "stats": { 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "stored": 2362, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "objects": 22, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "kb_used": 3, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "bytes_used": 2362, 2023-12-19T13:47:55.735 INFO:teuthology.orchestra.run.smithi113.stdout: "percent_used": 2.1201726667641196e-06, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "max_avail": 557028928 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "name": "cephfs_data", 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 5, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "stats": { 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "stored": 0, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "objects": 0, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "kb_used": 0, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "bytes_used": 0, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "percent_used": 0, 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: "max_avail": 557028928 2023-12-19T13:47:55.736 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:55.737 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:47:55.737 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:47:55.737 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:47:55.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 msgr2=0x7f4e9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4eb406d9b0 tx=0x7f4e9c008040 comp rx=0 tx=0).stop 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 msgr2=0x7f4eb40ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4eb40ccc80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4eac02dfd0 tx=0x7f4eac004ab0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 shutdown_connections 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb41f35b0 0x7f4eb41f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb4143410 0x7f4eb41f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 --2- 172.21.15.113:0/3797936416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ea00039e0 0x7f4eb40ccc80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 >> 172.21.15.113:0/3797936416 conn(0x7f4eb40cbb70 msgr2=0x7f4eb415b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 shutdown_connections 2023-12-19T13:47:55.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:55.735+0000 7f4eba727640 1 -- 172.21.15.113:0/3797936416 wait complete. 2023-12-19T13:47:55.755 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:47:55.755 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:47:55.755 DEBUG:teuthology.orchestra.run.smithi113:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T13:47:55.755 DEBUG:teuthology.orchestra.run.smithi113:> os.fchmod(fd, 0O666) 2023-12-19T13:47:55.755 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(fd) 2023-12-19T13:47:55.755 DEBUG:teuthology.orchestra.run.smithi113:> os.close(fd) 2023-12-19T13:47:55.755 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:47:56.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:56.062 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:56.170 INFO:teuthology.orchestra.run.smithi113.stdout:client4622 2023-12-19T13:47:56.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:56.171 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4622/osdmap') 2023-12-19T13:47:56.262 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 34 barrier 34 flags 0x588000 2023-12-19T13:47:56.262 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:47:56.263 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:47:56.264 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:47:56.264 INFO:teuthology.orchestra.run.smithi113.stderr:799 bytes copied, 0.000151467 s, 5.3 MB/s 2023-12-19T13:47:56.267 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-19T13:47:56.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.485+0000 7f601fbf0640 1 Processor -- start 2023-12-19T13:47:56.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.485+0000 7f601fbf0640 1 -- start start 2023-12-19T13:47:56.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601fbf0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:56.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601fbf0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f601806b590 0x7f601806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:56.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601fbf0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601806bb30 con 0x7f60181449e0 2023-12-19T13:47:56.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601fbf0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60180b0070 con 0x7f601806b590 2023-12-19T13:47:56.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601fbf0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180b0350 con 0x7f60180b0b50 2023-12-19T13:47:56.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601d98c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f60181449e0 0x7f60180af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34000/0 (socket says 172.21.15.113:34000) 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601d98c640 1 -- 172.21.15.113:0/3488548288 learned_addr learned my addr 172.21.15.113:0/3488548288 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601e18d640 1 --2- 172.21.15.113:0/3488548288 >> v2:172.21.15.113:3300/0 conn(0x7f601806b590 0x7f601806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601d18b640 1 --2- 172.21.15.113:0/3488548288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.488+0000 7f601e18d640 1 -- 172.21.15.113:0/3488548288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 msgr2=0x7f601806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.487+0000 7f601c98a640 1 -- 172.21.15.113:0/3488548288 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230196461 0 0) 0x7f601806bb30 con 0x7f60181449e0 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.488+0000 7f601e18d640 1 --2- 172.21.15.113:0/3488548288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.488+0000 7f601e18d640 1 -- 172.21.15.113:0/3488548288 >> v1:172.21.15.113:6789/0 conn(0x7f60181449e0 legacy=0x7f60180af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.488+0000 7f601e18d640 1 -- 172.21.15.113:0/3488548288 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180b0630 con 0x7f601806b590 2023-12-19T13:47:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.488+0000 7f601d18b640 1 --2- 172.21.15.113:0/3488548288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:56.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.489+0000 7f601e18d640 1 --2- 172.21.15.113:0/3488548288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f601806c4e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6010009d90 tx=0x7f601002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169677028665070b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:56.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.489+0000 7f601c98a640 1 -- 172.21.15.113:0/3488548288 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601002cc60 con 0x7f601806b590 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.489+0000 7f601c98a640 1 -- 172.21.15.113:0/3488548288 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601002cdc0 con 0x7f601806b590 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.489+0000 7f601c98a640 1 -- 172.21.15.113:0/3488548288 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010034660 con 0x7f601806b590 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 -- 172.21.15.113:0/3488548288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 msgr2=0x7f601806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 --2- 172.21.15.113:0/3488548288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f601806c4e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6010009d90 tx=0x7f601002beb0 comp rx=0 tx=0).stop 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 -- 172.21.15.113:0/3488548288 shutdown_connections 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 --2- 172.21.15.113:0/3488548288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f601806c4e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 --2- 172.21.15.113:0/3488548288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 -- 172.21.15.113:0/3488548288 >> 172.21.15.113:0/3488548288 conn(0x7f60180cbb70 msgr2=0x7f60180cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 -- 172.21.15.113:0/3488548288 shutdown_connections 2023-12-19T13:47:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.490+0000 7f601fbf0640 1 -- 172.21.15.113:0/3488548288 wait complete. 2023-12-19T13:47:56.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.492+0000 7f601fbf0640 1 Processor -- start 2023-12-19T13:47:56.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.492+0000 7f601fbf0640 1 -- start start 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601fbf0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f6018158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601fbf0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601813a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601fbf0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60181449e0 0x7f60181f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601fbf0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6018156650 con 0x7f601806b590 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601fbf0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60181f6b70 con 0x7f60181449e0 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601fbf0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6018156070 con 0x7f60180b0b50 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601d98c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f6018158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601d98c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f6018158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55076/0 (socket says 172.21.15.113:55076) 2023-12-19T13:47:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.493+0000 7f601d98c640 1 -- 172.21.15.113:0/2270934792 learned_addr learned my addr 172.21.15.113:0/2270934792 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601d98c640 1 -- 172.21.15.113:0/2270934792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 msgr2=0x7f601813a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601d98c640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601813a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601d98c640 1 -- 172.21.15.113:0/2270934792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60181449e0 msgr2=0x7f60181f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601d98c640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60181449e0 0x7f60181f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601d98c640 1 -- 172.21.15.113:0/2270934792 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010009a70 con 0x7f601806b590 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601d98c640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f6018158740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f601400c430 tx=0x7f601400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f600e7fc640 1 -- 172.21.15.113:0/2270934792 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014005ce0 con 0x7f601806b590 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f600e7fc640 1 -- 172.21.15.113:0/2270934792 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014005e40 con 0x7f601806b590 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f600e7fc640 1 -- 172.21.15.113:0/2270934792 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140072d0 con 0x7f601806b590 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60181558d0 con 0x7f601806b590 2023-12-19T13:47:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.494+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601813ad40 con 0x7f601806b590 2023-12-19T13:47:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.496+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6018061910 con 0x7f601806b590 2023-12-19T13:47:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.497+0000 7f600e7fc640 1 -- 172.21.15.113:0/2270934792 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6014007430 con 0x7f601806b590 2023-12-19T13:47:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.497+0000 7f600e7fc640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ffc06a460 0x7f5ffc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.498+0000 7f600e7fc640 1 -- 172.21.15.113:0/2270934792 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6014087da0 con 0x7f601806b590 2023-12-19T13:47:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.498+0000 7f601d18b640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ffc06a460 0x7f5ffc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:56.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.498+0000 7f601d18b640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ffc06a460 0x7f5ffc06c920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6008006fd0 tx=0x7f6008008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:56.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.502+0000 7f600e7fc640 1 -- 172.21.15.113:0/2270934792 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6014053440 con 0x7f601806b590 2023-12-19T13:47:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:56.699+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f60180ae560 con 0x7f601806b590 2023-12-19T13:47:57.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.497+0000 7f600e7fc640 1 -- 172.21.15.113:0/2270934792 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6014056a60 con 0x7f601806b590 2023-12-19T13:47:57.497 INFO:teuthology.orchestra.run.smithi113.stderr:pauserd,pausewr is set 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.500+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ffc06a460 msgr2=0x7f5ffc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ffc06a460 0x7f5ffc06c920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6008006fd0 tx=0x7f6008008040 comp rx=0 tx=0).stop 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 msgr2=0x7f6018158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f6018158740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f601400c430 tx=0x7f601400c8f0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 shutdown_connections 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ffc06a460 0x7f5ffc06c920 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60181449e0 0x7f60181f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60180b0b50 0x7f601813a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 --2- 172.21.15.113:0/2270934792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f601806b590 0x7f6018158740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 >> 172.21.15.113:0/2270934792 conn(0x7f60180cbb70 msgr2=0x7f60180ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 shutdown_connections 2023-12-19T13:47:57.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.501+0000 7f601fbf0640 1 -- 172.21.15.113:0/2270934792 wait complete. 2023-12-19T13:47:57.523 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-19T13:47:57.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.738+0000 7f5fea318640 1 Processor -- start 2023-12-19T13:47:57.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.738+0000 7f5fea318640 1 -- start start 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fea318640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe40d2b00 0x7f5fe40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fea318640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5fe40ce110 0x7f5fe40ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fea318640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe40cd840 con 0x7f5fe4146e10 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fea318640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe40d2430 con 0x7f5fe40ce110 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fea318640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40ceae0 con 0x7f5fe40d2b00 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fe3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5fe4146e10 0x7f5fe40b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34012/0 (socket says 172.21.15.113:34012) 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fe3fff640 1 -- 172.21.15.113:0/2181873469 learned_addr learned my addr 172.21.15.113:0/2181873469 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:47:57.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.740+0000 7f5fe88b5640 1 --2- 172.21.15.113:0/2181873469 >> v2:172.21.15.113:3300/0 conn(0x7f5fe40ce110 0x7f5fe40ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.741+0000 7f5fdb7fe640 1 --2- 172.21.15.113:0/2181873469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe40d2b00 0x7f5fe40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.741+0000 7f5fe88b5640 1 -- 172.21.15.113:0/2181873469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe40d2b00 msgr2=0x7f5fe40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.741+0000 7f5fe88b5640 1 --2- 172.21.15.113:0/2181873469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe40d2b00 0x7f5fe40d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.741+0000 7f5fe37fe640 1 -- 172.21.15.113:0/2181873469 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373764835 0 0) 0x7f5fe40cd840 con 0x7f5fe4146e10 2023-12-19T13:47:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.741+0000 7f5fe88b5640 1 -- 172.21.15.113:0/2181873469 >> v1:172.21.15.113:6789/0 conn(0x7f5fe4146e10 legacy=0x7f5fe40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.741+0000 7f5fe88b5640 1 -- 172.21.15.113:0/2181873469 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40b6e90 con 0x7f5fe40ce110 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.742+0000 7f5fe88b5640 1 --2- 172.21.15.113:0/2181873469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40ce110 0x7f5fe40ce5a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0097d0 tx=0x7f5fdc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70da386249f06ffa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.742+0000 7f5fe37fe640 1 -- 172.21.15.113:0/2181873469 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc02d040 con 0x7f5fe40ce110 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.742+0000 7f5fe37fe640 1 -- 172.21.15.113:0/2181873469 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc031810 con 0x7f5fe40ce110 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.742+0000 7f5fe37fe640 1 -- 172.21.15.113:0/2181873469 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc031ba0 con 0x7f5fe40ce110 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 -- 172.21.15.113:0/2181873469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40ce110 msgr2=0x7f5fe40ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 --2- 172.21.15.113:0/2181873469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40ce110 0x7f5fe40ce5a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0097d0 tx=0x7f5fdc02b8b0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 -- 172.21.15.113:0/2181873469 shutdown_connections 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 --2- 172.21.15.113:0/2181873469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40ce110 0x7f5fe40ce5a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 --2- 172.21.15.113:0/2181873469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe40d2b00 0x7f5fe40d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 -- 172.21.15.113:0/2181873469 >> 172.21.15.113:0/2181873469 conn(0x7f5fe40b29c0 msgr2=0x7f5fe40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 -- 172.21.15.113:0/2181873469 shutdown_connections 2023-12-19T13:47:57.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.743+0000 7f5fea318640 1 -- 172.21.15.113:0/2181873469 wait complete. 2023-12-19T13:47:57.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.745+0000 7f5fea318640 1 Processor -- start 2023-12-19T13:47:57.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.745+0000 7f5fea318640 1 -- start start 2023-12-19T13:47:57.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fea318640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe40ce110 0x7f5fe413c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:57.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fea318640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40d2b00 0x7f5fe40b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:57.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fea318640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe4146e10 0x7f5fe415dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:57.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fea318640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40b8af0 con 0x7f5fe40d2b00 2023-12-19T13:47:57.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fea318640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40b8dd0 con 0x7f5fe40ce110 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fea318640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe413e6e0 con 0x7f5fe4146e10 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fdb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40d2b00 0x7f5fe40b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fdb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40d2b00 0x7f5fe40b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55080/0 (socket says 172.21.15.113:55080) 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fdb7fe640 1 -- 172.21.15.113:0/2096989051 learned_addr learned my addr 172.21.15.113:0/2096989051 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.746+0000 7f5fe88b5640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe4146e10 0x7f5fe415dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fe3fff640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe40ce110 0x7f5fe413c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fdb7fe640 1 -- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe4146e10 msgr2=0x7f5fe415dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fdb7fe640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe4146e10 0x7f5fe415dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fdb7fe640 1 -- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe40ce110 msgr2=0x7f5fe413c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fdb7fe640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe40ce110 0x7f5fe413c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fdb7fe640 1 -- 172.21.15.113:0/2096989051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc009400 con 0x7f5fe40d2b00 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fe88b5640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe4146e10 0x7f5fe415dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fdb7fe640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40d2b00 0x7f5fe40b80a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00d800 tx=0x7f5fcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00b6c0 con 0x7f5fe40d2b00 2023-12-19T13:47:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc00b820 con 0x7f5fe40d2b00 2023-12-19T13:47:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe413e9c0 con 0x7f5fe40d2b00 2023-12-19T13:47:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00bbb0 con 0x7f5fe40d2b00 2023-12-19T13:47:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.747+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe40b85e0 con 0x7f5fe40d2b00 2023-12-19T13:47:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.748+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe413e540 con 0x7f5fe40d2b00 2023-12-19T13:47:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.749+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5fcc00bd10 con 0x7f5fe40d2b00 2023-12-19T13:47:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.750+0000 7f5fe17fa640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fc406a430 0x7f5fc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.750+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fcc088dd0 con 0x7f5fe40d2b00 2023-12-19T13:47:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.751+0000 7f5fe3fff640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fc406a430 0x7f5fc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.751+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=36+}) v3 -- 0x7f5fc4071f60 con 0x7f5fe40d2b00 2023-12-19T13:47:57.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.751+0000 7f5fe3fff640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fc406a430 0x7f5fc406c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40012e0 tx=0x7f5fd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:57.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.755+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5fe413e540 con 0x7f5fe40d2b00 2023-12-19T13:47:57.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:57.953+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f5fe413e540 con 0x7f5fe40d2b00 2023-12-19T13:47:58.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.496+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(36..36 src has 1..36) v4 ==== 288+0+0 (secure 0 0 0) 0x7f5fcc058810 con 0x7f5fe40d2b00 2023-12-19T13:47:58.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.496+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=37}) v3 -- 0x7f5fc4072810 con 0x7f5fe40d2b00 2023-12-19T13:47:58.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.501+0000 7f5fe17fa640 1 -- 172.21.15.113:0/2096989051 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5fe413e540 con 0x7f5fe40d2b00 2023-12-19T13:47:58.502 INFO:teuthology.orchestra.run.smithi113.stderr:pauserd,pausewr is unset 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fc406a430 msgr2=0x7f5fc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fc406a430 0x7f5fc406c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40012e0 tx=0x7f5fd4009040 comp rx=0 tx=0).stop 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40d2b00 msgr2=0x7f5fe40b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40d2b00 0x7f5fe40b80a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00d800 tx=0x7f5fcc00dcc0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 shutdown_connections 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fc406a430 0x7f5fc406c8f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe4146e10 0x7f5fe415dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fe40d2b00 0x7f5fe40b80a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 --2- 172.21.15.113:0/2096989051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe40ce110 0x7f5fe413c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 >> 172.21.15.113:0/2096989051 conn(0x7f5fe40b29c0 msgr2=0x7f5fe40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 shutdown_connections 2023-12-19T13:47:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.506+0000 7f5fea318640 1 -- 172.21.15.113:0/2096989051 wait complete. 2023-12-19T13:47:58.527 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:47:58.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.738+0000 7f86fa173640 1 Processor -- start 2023-12-19T13:47:58.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.738+0000 7f86fa173640 1 -- start start 2023-12-19T13:47:58.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.740+0000 7f86fa173640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f40b2ea0 0x7f86f415c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:58.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.740+0000 7f86fa173640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f86f41408f0 0x7f86f4140d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:58.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.740+0000 7f86fa173640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f413e590 con 0x7f86f406c810 2023-12-19T13:47:58.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.740+0000 7f86fa173640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f415b810 con 0x7f86f41408f0 2023-12-19T13:47:58.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.740+0000 7f86fa173640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f415c7d0 con 0x7f86f40b2ea0 2023-12-19T13:47:58.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.741+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f40b2ea0 0x7f86f415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:58.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.741+0000 7f86ebfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f86f41408f0 0x7f86f4140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:58.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.741+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f40b2ea0 0x7f86f415c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:43192/0 (socket says 172.21.15.113:43192) 2023-12-19T13:47:58.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.741+0000 7f86ebfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f86f41408f0 0x7f86f4140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:36448/0 (socket says 172.21.15.113:36448) 2023-12-19T13:47:58.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.741+0000 7f86f37fe640 1 -- 172.21.15.113:0/2870716960 learned_addr learned my addr 172.21.15.113:0/2870716960 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:58.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.742+0000 7f86f37fe640 1 -- 172.21.15.113:0/2870716960 >> v2:172.21.15.151:3300/0 conn(0x7f86f41408f0 msgr2=0x7f86f4140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:58.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.742+0000 7f86f37fe640 1 --2- 172.21.15.113:0/2870716960 >> v2:172.21.15.151:3300/0 conn(0x7f86f41408f0 0x7f86f4140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.742+0000 7f86f37fe640 1 -- 172.21.15.113:0/2870716960 >> v1:172.21.15.151:6789/0 conn(0x7f86f406c810 legacy=0x7f86f40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.742+0000 7f86f37fe640 1 -- 172.21.15.113:0/2870716960 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4141390 con 0x7f86f40b2ea0 2023-12-19T13:47:58.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.743+0000 7f86f37fe640 1 --2- 172.21.15.113:0/2870716960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f40b2ea0 0x7f86f415c290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009870 tx=0x7f86e402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da11cc20249d1312 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:58.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86f2ffd640 1 -- 172.21.15.113:0/2870716960 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4030840 con 0x7f86f40b2ea0 2023-12-19T13:47:58.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86f2ffd640 1 -- 172.21.15.113:0/2870716960 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e40309a0 con 0x7f86f40b2ea0 2023-12-19T13:47:58.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86f2ffd640 1 -- 172.21.15.113:0/2870716960 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4030d30 con 0x7f86f40b2ea0 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86fa173640 1 -- 172.21.15.113:0/2870716960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f40b2ea0 msgr2=0x7f86f415c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86fa173640 1 --2- 172.21.15.113:0/2870716960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f40b2ea0 0x7f86f415c290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009870 tx=0x7f86e402b980 comp rx=0 tx=0).stop 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86fa173640 1 -- 172.21.15.113:0/2870716960 shutdown_connections 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86fa173640 1 --2- 172.21.15.113:0/2870716960 >> v2:172.21.15.151:3300/0 conn(0x7f86f41408f0 0x7f86f4140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86fa173640 1 --2- 172.21.15.113:0/2870716960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f40b2ea0 0x7f86f415c290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86fa173640 1 -- 172.21.15.113:0/2870716960 >> 172.21.15.113:0/2870716960 conn(0x7f86f40659d0 msgr2=0x7f86f4065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.744+0000 7f86fa173640 1 -- 172.21.15.113:0/2870716960 shutdown_connections 2023-12-19T13:47:58.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.745+0000 7f86fa173640 1 -- 172.21.15.113:0/2870716960 wait complete. 2023-12-19T13:47:58.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.746+0000 7f86fa173640 1 Processor -- start 2023-12-19T13:47:58.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.746+0000 7f86fa173640 1 -- start start 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.747+0000 7f86fa173640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406c810 0x7f86f4156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.747+0000 7f86fa173640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f40b2ea0 0x7f86f40cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.747+0000 7f86fa173640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f41408f0 0x7f86f40c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.747+0000 7f86fa173640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40cf520 con 0x7f86f41408f0 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.747+0000 7f86fa173640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40c98f0 con 0x7f86f40b2ea0 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.747+0000 7f86fa173640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40cf730 con 0x7f86f406c810 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f41408f0 0x7f86f40c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f41408f0 0x7f86f40c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46878/0 (socket says 172.21.15.113:46878) 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 -- 172.21.15.113:0/3106772622 learned_addr learned my addr 172.21.15.113:0/3106772622 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f37fe640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406c810 0x7f86f4156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:58.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86ebfff640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f40b2ea0 0x7f86f40cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:58.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 -- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406c810 msgr2=0x7f86f4156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406c810 0x7f86f4156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 -- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f40b2ea0 msgr2=0x7f86f40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f40b2ea0 0x7f86f40cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.748+0000 7f86f3fff640 1 -- 172.21.15.113:0/3106772622 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40094d0 con 0x7f86f41408f0 2023-12-19T13:47:58.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.749+0000 7f86f3fff640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f41408f0 0x7f86f40c93b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c6b0 tx=0x7f86ec00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:58.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.749+0000 7f86f0ff9640 1 -- 172.21.15.113:0/3106772622 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003b70 con 0x7f86f41408f0 2023-12-19T13:47:58.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.749+0000 7f86f0ff9640 1 -- 172.21.15.113:0/3106772622 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec003cf0 con 0x7f86f41408f0 2023-12-19T13:47:58.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.749+0000 7f86f0ff9640 1 -- 172.21.15.113:0/3106772622 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003ea0 con 0x7f86f41408f0 2023-12-19T13:47:58.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.749+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f40c88d0 con 0x7f86f41408f0 2023-12-19T13:47:58.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.749+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f40c8e90 con 0x7f86f41408f0 2023-12-19T13:47:58.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.750+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f4074770 con 0x7f86f41408f0 2023-12-19T13:47:58.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.751+0000 7f86f0ff9640 1 -- 172.21.15.113:0/3106772622 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86ec005310 con 0x7f86f41408f0 2023-12-19T13:47:58.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.752+0000 7f86f0ff9640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86d406a430 0x7f86d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:58.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.752+0000 7f86f0ff9640 1 -- 172.21.15.113:0/3106772622 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86ec0887e0 con 0x7f86f41408f0 2023-12-19T13:47:58.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.752+0000 7f86f37fe640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86d406a430 0x7f86d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:58.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.753+0000 7f86f37fe640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86d406a430 0x7f86d406c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86e4036000 tx=0x7f86e403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:58.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.757+0000 7f86f0ff9640 1 -- 172.21.15.113:0/3106772622 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86ec053ca0 con 0x7f86f41408f0 2023-12-19T13:47:58.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.946+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86f40c90b0 con 0x7f86f41408f0 2023-12-19T13:47:58.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.950+0000 7f86f0ff9640 1 -- 172.21.15.113:0/3106772622 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f86ec0572c0 con 0x7f86f41408f0 2023-12-19T13:47:58.950 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:58.950 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":36,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:58.492769+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:47:58.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.952+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86d406a430 msgr2=0x7f86d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.952+0000 7f86fa173640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86d406a430 0x7f86d406c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86e4036000 tx=0x7f86e403b040 comp rx=0 tx=0).stop 2023-12-19T13:47:58.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.952+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f41408f0 msgr2=0x7f86f40c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:58.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.952+0000 7f86fa173640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f41408f0 0x7f86f40c93b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c6b0 tx=0x7f86ec00cb70 comp rx=0 tx=0).stop 2023-12-19T13:47:58.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.952+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 shutdown_connections 2023-12-19T13:47:58.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.952+0000 7f86fa173640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86d406a430 0x7f86d406c8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.953+0000 7f86fa173640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f41408f0 0x7f86f40c93b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.953+0000 7f86fa173640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f40b2ea0 0x7f86f40cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.953+0000 7f86fa173640 1 --2- 172.21.15.113:0/3106772622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406c810 0x7f86f4156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:58.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.953+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 >> 172.21.15.113:0/3106772622 conn(0x7f86f40659d0 msgr2=0x7f86f4070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:58.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.953+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 shutdown_connections 2023-12-19T13:47:58.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:58.953+0000 7f86fa173640 1 -- 172.21.15.113:0/3106772622 wait complete. 2023-12-19T13:47:58.973 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:47:58.973 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:47:58.973 DEBUG:teuthology.orchestra.run.smithi113:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T13:47:58.973 DEBUG:teuthology.orchestra.run.smithi113:> os.fchmod(fd, 0O666) 2023-12-19T13:47:58.973 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(fd) 2023-12-19T13:47:58.973 DEBUG:teuthology.orchestra.run.smithi113:> os.close(fd) 2023-12-19T13:47:58.974 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:47:59.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:59.280 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:47:59.384 INFO:teuthology.orchestra.run.smithi113.stdout:client4622 2023-12-19T13:47:59.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:47:59.385 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4622/osdmap') 2023-12-19T13:47:59.485 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 34 barrier 34 flags 0x588000 2023-12-19T13:47:59.486 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:47:59.486 INFO:teuthology.orchestra.run.smithi113.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:47:59.486 INFO:teuthology.orchestra.run.smithi113.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:47:59.486 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:47:59.486 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:47:59.486 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:47:59.487 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:47:59.487 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:47:59.487 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:47:59.487 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:47:59.487 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:47:59.488 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:47:59.488 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:47:59.488 INFO:teuthology.orchestra.run.smithi113.stderr:799 bytes copied, 0.000101937 s, 7.8 MB/s 2023-12-19T13:47:59.490 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:47:59.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.702+0000 7f5169bf6640 1 Processor -- start 2023-12-19T13:47:59.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.702+0000 7f5169bf6640 1 -- start start 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f5169bf6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51641599c0 0x7f516415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f5169bf6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f516406e190 0x7f51640cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f5169bf6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516415e400 con 0x7f51640b03b0 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f5169bf6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516415daa0 con 0x7f51641599c0 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f5169bf6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51640ce780 con 0x7f516406e190 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f51637fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51641599c0 0x7f516415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f51637fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51641599c0 0x7f516415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46886/0 (socket says 172.21.15.113:46886) 2023-12-19T13:47:59.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f51637fe640 1 -- 172.21.15.113:0/3957724689 learned_addr learned my addr 172.21.15.113:0/3957724689 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:59.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.704+0000 7f5163fff640 1 --1- 172.21.15.113:0/3957724689 >> v1:172.21.15.113:6789/0 conn(0x7f51640b03b0 0x7f51640af540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:41914/0 (socket says 172.21.15.113:41914) 2023-12-19T13:47:59.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.705+0000 7f51637fe640 1 -- 172.21.15.113:0/3957724689 >> v2:172.21.15.151:3300/0 conn(0x7f516406e190 msgr2=0x7f51640cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:47:59.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.705+0000 7f51637fe640 1 --2- 172.21.15.113:0/3957724689 >> v2:172.21.15.151:3300/0 conn(0x7f516406e190 0x7f51640cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.705+0000 7f51637fe640 1 -- 172.21.15.113:0/3957724689 >> v1:172.21.15.113:6789/0 conn(0x7f51640b03b0 legacy=0x7f51640af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:59.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.705+0000 7f51637fe640 1 -- 172.21.15.113:0/3957724689 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51640cea60 con 0x7f51641599c0 2023-12-19T13:47:59.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.705+0000 7f51627fc640 1 -- 172.21.15.113:0/3957724689 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279667074 0 0) 0x7f516415e400 con 0x7f51640b03b0 2023-12-19T13:47:59.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.706+0000 7f51637fe640 1 --2- 172.21.15.113:0/3957724689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f516415dec0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f51640b0e70 tx=0x7f515402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b38ddb277e6a37 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.706+0000 7f51627fc640 1 -- 172.21.15.113:0/3957724689 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51540317e0 con 0x7f51641599c0 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.706+0000 7f51627fc640 1 -- 172.21.15.113:0/3957724689 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154031940 con 0x7f51641599c0 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.706+0000 7f51627fc640 1 -- 172.21.15.113:0/3957724689 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154031cd0 con 0x7f51641599c0 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 -- 172.21.15.113:0/3957724689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 msgr2=0x7f516415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3957724689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f516415dec0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f51640b0e70 tx=0x7f515402b880 comp rx=0 tx=0).stop 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 -- 172.21.15.113:0/3957724689 shutdown_connections 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3957724689 >> v2:172.21.15.151:3300/0 conn(0x7f516406e190 0x7f51640cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3957724689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f516415dec0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 -- 172.21.15.113:0/3957724689 >> 172.21.15.113:0/3957724689 conn(0x7f51640cbb70 msgr2=0x7f51640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 -- 172.21.15.113:0/3957724689 shutdown_connections 2023-12-19T13:47:59.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.707+0000 7f5169bf6640 1 -- 172.21.15.113:0/3957724689 wait complete. 2023-12-19T13:47:59.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.709+0000 7f5169bf6640 1 Processor -- start 2023-12-19T13:47:59.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.709+0000 7f5169bf6640 1 -- start start 2023-12-19T13:47:59.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5169bf6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f516406e190 0x7f516414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:59.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5169bf6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51640b03b0 0x7f51641671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:59.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5169bf6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f51640cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:59.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5169bf6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164168740 con 0x7f51641599c0 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5169bf6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164167ac0 con 0x7f51640b03b0 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5169bf6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5164167da0 con 0x7f516406e190 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5163fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f51640cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5163fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f51640cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46894/0 (socket says 172.21.15.113:46894) 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.710+0000 7f5163fff640 1 -- 172.21.15.113:0/3653723361 learned_addr learned my addr 172.21.15.113:0/3653723361 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5163fff640 1 -- 172.21.15.113:0/3653723361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f516406e190 msgr2=0x7f516414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5163fff640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f516406e190 0x7f516414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5163fff640 1 -- 172.21.15.113:0/3653723361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51640b03b0 msgr2=0x7f51641671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5163fff640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51640b03b0 0x7f51641671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5163fff640 1 -- 172.21.15.113:0/3653723361 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540094d0 con 0x7f51641599c0 2023-12-19T13:47:59.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5163fff640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f51640cce80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c780 tx=0x7f515c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:59.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f514bfff640 1 -- 172.21.15.113:0/3653723361 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00ce90 con 0x7f51641599c0 2023-12-19T13:47:59.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f514bfff640 1 -- 172.21.15.113:0/3653723361 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c00a640 con 0x7f51641599c0 2023-12-19T13:47:59.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f514bfff640 1 -- 172.21.15.113:0/3653723361 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00a9d0 con 0x7f51641599c0 2023-12-19T13:47:59.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5164168080 con 0x7f51641599c0 2023-12-19T13:47:59.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.711+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5164167700 con 0x7f51641599c0 2023-12-19T13:47:59.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.712+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51640b0860 con 0x7f51641599c0 2023-12-19T13:47:59.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.713+0000 7f514bfff640 1 -- 172.21.15.113:0/3653723361 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f515c00ab30 con 0x7f51641599c0 2023-12-19T13:47:59.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.715+0000 7f514bfff640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f515006a430 0x7f515006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:47:59.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.715+0000 7f514bfff640 1 -- 172.21.15.113:0/3653723361 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f515c087e90 con 0x7f51641599c0 2023-12-19T13:47:59.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.715+0000 7f51637fe640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f515006a430 0x7f515006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:47:59.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.716+0000 7f51637fe640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f515006a430 0x7f515006c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5154036000 tx=0x7f5154030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:47:59.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.720+0000 7f514bfff640 1 -- 172.21.15.113:0/3653723361 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f515c053480 con 0x7f51641599c0 2023-12-19T13:47:59.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.944+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5164061910 con 0x7f51641599c0 2023-12-19T13:47:59.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.945+0000 7f514bfff640 1 -- 172.21.15.113:0/3653723361 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f515c018020 con 0x7f51641599c0 2023-12-19T13:47:59.945 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:47:59.945 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:47:59.945 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.947+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f515006a430 msgr2=0x7f515006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.947+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f515006a430 0x7f515006c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5154036000 tx=0x7f5154030000 comp rx=0 tx=0).stop 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.947+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 msgr2=0x7f51640cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.947+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f51640cce80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c780 tx=0x7f515c00cc40 comp rx=0 tx=0).stop 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 shutdown_connections 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f515006a430 0x7f515006c8f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51641599c0 0x7f51640cce80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51640b03b0 0x7f51641671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 --2- 172.21.15.113:0/3653723361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f516406e190 0x7f516414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 >> 172.21.15.113:0/3653723361 conn(0x7f51640cbb70 msgr2=0x7f51640caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 shutdown_connections 2023-12-19T13:47:59.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:47:59.948+0000 7f5169bf6640 1 -- 172.21.15.113:0/3653723361 wait complete. 2023-12-19T13:47:59.966 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json osdmap barrier 36 2023-12-19T13:48:00.210 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-19T13:48:00.210 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:48:00.210 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:48:00.210 DEBUG:teuthology.orchestra.run.smithi113:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T13:48:00.210 DEBUG:teuthology.orchestra.run.smithi113:> os.fchmod(fd, 0O666) 2023-12-19T13:48:00.211 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(fd) 2023-12-19T13:48:00.211 DEBUG:teuthology.orchestra.run.smithi113:> os.close(fd) 2023-12-19T13:48:00.211 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:48:00.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:00.544 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:48:00.651 INFO:teuthology.orchestra.run.smithi113.stdout:client4622 2023-12-19T13:48:00.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:00.651 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4622/osdmap') 2023-12-19T13:48:00.746 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 36 barrier 36 flags 0x588000 2023-12-19T13:48:00.746 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:48:00.746 INFO:teuthology.orchestra.run.smithi113.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:48:00.747 INFO:teuthology.orchestra.run.smithi113.stderr:799 bytes copied, 0.000112561 s, 7.1 MB/s 2023-12-19T13:48:00.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:00.750 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:48:00.805 INFO:teuthology.orchestra.run.smithi113.stdout:client4622 2023-12-19T13:48:00.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:00.806 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client4622/osdmap') 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 36 barrier 36 flags 0x588000 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:48:00.890 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:48:00.891 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:48:00.891 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:48:00.891 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:48:00.891 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:48:00.891 INFO:teuthology.orchestra.run.smithi113.stderr:799 bytes copied, 8.1556e-05 s, 9.8 MB/s 2023-12-19T13:48:00.893 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:48:00.894 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:48:00.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:48:00.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:48:01.126 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:48:01.126 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:01.126 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:01.185 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:01.186 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:01.238 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:01.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.452+0000 7f90e7223640 1 Processor -- start 2023-12-19T13:48:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.452+0000 7f90e7223640 1 -- start start 2023-12-19T13:48:01.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.453+0000 7f90e7223640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e0157bf0 0x7f90e015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.453+0000 7f90e7223640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90e00ae110 0x7f90e00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.453+0000 7f90e7223640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f90e00b0640 0x7f90e015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.453+0000 7f90e7223640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e006b8c0 con 0x7f90e00b0640 2023-12-19T13:48:01.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.453+0000 7f90e7223640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e00b0a90 con 0x7f90e00ae110 2023-12-19T13:48:01.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.453+0000 7f90e7223640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015b740 con 0x7f90e0157bf0 2023-12-19T13:48:01.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f90e00b0640 0x7f90e015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f90e00b0640 0x7f90e015dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46906/0 (socket says 172.21.15.113:46906) 2023-12-19T13:48:01.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 -- 172.21.15.113:0/2061354714 learned_addr learned my addr 172.21.15.113:0/2061354714 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e4fbf640 1 --2- 172.21.15.113:0/2061354714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e0157bf0 0x7f90e015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90dffff640 1 --2- 172.21.15.113:0/2061354714 >> v2:172.21.15.151:3300/0 conn(0x7f90e00ae110 0x7f90e00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 -- 172.21.15.113:0/2061354714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e0157bf0 msgr2=0x7f90e015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 --2- 172.21.15.113:0/2061354714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e0157bf0 0x7f90e015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 -- 172.21.15.113:0/2061354714 >> v2:172.21.15.151:3300/0 conn(0x7f90e00ae110 msgr2=0x7f90e00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 --2- 172.21.15.113:0/2061354714 >> v2:172.21.15.151:3300/0 conn(0x7f90e00ae110 0x7f90e00b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.454+0000 7f90e57c0640 1 -- 172.21.15.113:0/2061354714 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00ae640 con 0x7f90e00b0640 2023-12-19T13:48:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.455+0000 7f90e57c0640 1 --2- 172.21.15.113:0/2061354714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00b0640 0x7f90e015dd70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90e00cc8a0 tx=0x7f90d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c7663a62f4d5de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90df7fe640 1 -- 172.21.15.113:0/2061354714 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d802ca70 con 0x7f90e00b0640 2023-12-19T13:48:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90df7fe640 1 -- 172.21.15.113:0/2061354714 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d802cbd0 con 0x7f90e00b0640 2023-12-19T13:48:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90df7fe640 1 -- 172.21.15.113:0/2061354714 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80343f0 con 0x7f90e00b0640 2023-12-19T13:48:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 -- 172.21.15.113:0/2061354714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00b0640 msgr2=0x7f90e015dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 --2- 172.21.15.113:0/2061354714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00b0640 0x7f90e015dd70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90e00cc8a0 tx=0x7f90d802bed0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 -- 172.21.15.113:0/2061354714 shutdown_connections 2023-12-19T13:48:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 --2- 172.21.15.113:0/2061354714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00b0640 0x7f90e015dd70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 --2- 172.21.15.113:0/2061354714 >> v2:172.21.15.151:3300/0 conn(0x7f90e00ae110 0x7f90e00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 --2- 172.21.15.113:0/2061354714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e0157bf0 0x7f90e015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 -- 172.21.15.113:0/2061354714 >> 172.21.15.113:0/2061354714 conn(0x7f90e00cbb70 msgr2=0x7f90e00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 -- 172.21.15.113:0/2061354714 shutdown_connections 2023-12-19T13:48:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.456+0000 7f90e7223640 1 -- 172.21.15.113:0/2061354714 wait complete. 2023-12-19T13:48:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.458+0000 7f90e7223640 1 Processor -- start 2023-12-19T13:48:01.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.458+0000 7f90e7223640 1 -- start start 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e7223640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00ae110 0x7f90e01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e7223640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e00b0640 0x7f90e00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e7223640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90e0157bf0 0x7f90e00acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e7223640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e01e5760 con 0x7f90e00ae110 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e7223640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015caf0 con 0x7f90e0157bf0 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e7223640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015cdd0 con 0x7f90e00b0640 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e4fbf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00ae110 0x7f90e01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e4fbf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00ae110 0x7f90e01560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46922/0 (socket says 172.21.15.113:46922) 2023-12-19T13:48:01.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.459+0000 7f90e4fbf640 1 -- 172.21.15.113:0/685068613 learned_addr learned my addr 172.21.15.113:0/685068613 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:01.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e4fbf640 1 -- 172.21.15.113:0/685068613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e00b0640 msgr2=0x7f90e00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e4fbf640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e00b0640 0x7f90e00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e4fbf640 1 -- 172.21.15.113:0/685068613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90e0157bf0 msgr2=0x7f90e00acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e4fbf640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90e0157bf0 0x7f90e00acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e4fbf640 1 -- 172.21.15.113:0/685068613 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009b30 con 0x7f90e00ae110 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e4fbf640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00ae110 0x7f90e01560e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90d400d800 tx=0x7f90d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90dd7fa640 1 -- 172.21.15.113:0/685068613 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d400b6c0 con 0x7f90e00ae110 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90dd7fa640 1 -- 172.21.15.113:0/685068613 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d400b820 con 0x7f90e00ae110 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90dd7fa640 1 -- 172.21.15.113:0/685068613 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d400bbb0 con 0x7f90e00ae110 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e015d0b0 con 0x7f90e00ae110 2023-12-19T13:48:01.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.460+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e0156a00 con 0x7f90e00ae110 2023-12-19T13:48:01.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.462+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e0061910 con 0x7f90e00ae110 2023-12-19T13:48:01.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.463+0000 7f90dd7fa640 1 -- 172.21.15.113:0/685068613 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90d400bd10 con 0x7f90e00ae110 2023-12-19T13:48:01.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.464+0000 7f90dd7fa640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f90c406a430 0x7f90c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.464+0000 7f90dd7fa640 1 -- 172.21.15.113:0/685068613 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90d4088e10 con 0x7f90e00ae110 2023-12-19T13:48:01.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.464+0000 7f90dffff640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f90c406a430 0x7f90c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.465+0000 7f90dffff640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f90c406a430 0x7f90c406c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90e0158370 tx=0x7f90cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:01.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.468+0000 7f90dd7fa640 1 -- 172.21.15.113:0/685068613 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f90d408c030 con 0x7f90e00ae110 2023-12-19T13:48:01.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.658+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e00735b0 con 0x7f90e00ae110 2023-12-19T13:48:01.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.659+0000 7f90dd7fa640 1 -- 172.21.15.113:0/685068613 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f90d40543f0 con 0x7f90e00ae110 2023-12-19T13:48:01.659 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:01.660 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":36,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:58.492769+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:01.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f90c406a430 msgr2=0x7f90c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f90c406a430 0x7f90c406c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90e0158370 tx=0x7f90cc008040 comp rx=0 tx=0).stop 2023-12-19T13:48:01.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00ae110 msgr2=0x7f90e01560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00ae110 0x7f90e01560e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90d400d800 tx=0x7f90d400dcc0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 shutdown_connections 2023-12-19T13:48:01.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f90c406a430 0x7f90c406c8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90e0157bf0 0x7f90e00acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90e00b0640 0x7f90e00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 --2- 172.21.15.113:0/685068613 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90e00ae110 0x7f90e01560e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.662+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 >> 172.21.15.113:0/685068613 conn(0x7f90e00cbb70 msgr2=0x7f90e00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:01.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.663+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 shutdown_connections 2023-12-19T13:48:01.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.663+0000 7f90e7223640 1 -- 172.21.15.113:0/685068613 wait complete. 2023-12-19T13:48:01.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:47:42.574723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:47:43.788651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:48:01.683 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:48:01.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.886+0000 7f6406ffd640 1 Processor -- start 2023-12-19T13:48:01.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.886+0000 7f6406ffd640 1 -- start start 2023-12-19T13:48:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.887+0000 7f6406ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6400154760 0x7f640015b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.887+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000b0070 0x7f64000b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.887+0000 7f6406ffd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000ccbd0 con 0x7f64000cb810 2023-12-19T13:48:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.887+0000 7f6406ffd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000ccf20 con 0x7f6400154760 2023-12-19T13:48:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.887+0000 7f6406ffd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000b0a60 con 0x7f64000b0070 2023-12-19T13:48:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.888+0000 7f6404d99640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6400154760 0x7f640015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.888+0000 7f6404d99640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6400154760 0x7f640015b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:36504/0 (socket says 172.21.15.113:36504) 2023-12-19T13:48:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.888+0000 7f6404d99640 1 -- 172.21.15.113:0/103441241 learned_addr learned my addr 172.21.15.113:0/103441241 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.889+0000 7f640559a640 1 --2- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000b0070 0x7f64000b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.889+0000 7f6404d99640 1 -- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000b0070 msgr2=0x7f64000b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:01.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.889+0000 7f6404d99640 1 --2- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000b0070 0x7f64000b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.889+0000 7f6404d99640 1 -- 172.21.15.113:0/103441241 >> v1:172.21.15.151:6789/0 conn(0x7f64000cb810 legacy=0x7f64000b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.889+0000 7f6404d99640 1 -- 172.21.15.113:0/103441241 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6400154b40 con 0x7f6400154760 2023-12-19T13:48:01.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.890+0000 7f6404d99640 1 --2- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 0x7f640015b290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7726e7ffd9f8d277 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:01.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.891+0000 7f63ff7fe640 1 -- 172.21.15.113:0/103441241 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4031640 con 0x7f6400154760 2023-12-19T13:48:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.891+0000 7f63ff7fe640 1 -- 172.21.15.113:0/103441241 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f40317a0 con 0x7f6400154760 2023-12-19T13:48:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.891+0000 7f63ff7fe640 1 -- 172.21.15.113:0/103441241 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4031b30 con 0x7f6400154760 2023-12-19T13:48:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 -- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 msgr2=0x7f640015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 --2- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 0x7f640015b290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 -- 172.21.15.113:0/103441241 shutdown_connections 2023-12-19T13:48:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 --2- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000b0070 0x7f64000b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 --2- 172.21.15.113:0/103441241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 0x7f640015b290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 -- 172.21.15.113:0/103441241 >> 172.21.15.113:0/103441241 conn(0x7f6400073150 msgr2=0x7f64000659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 -- 172.21.15.113:0/103441241 shutdown_connections 2023-12-19T13:48:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.892+0000 7f6406ffd640 1 -- 172.21.15.113:0/103441241 wait complete. 2023-12-19T13:48:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.893+0000 7f6406ffd640 1 Processor -- start 2023-12-19T13:48:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.894+0000 7f6406ffd640 1 -- start start 2023-12-19T13:48:01.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.894+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64000b0070 0x7f64001ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000cb810 0x7f640015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 0x7f64001582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6406ffd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640015c8f0 con 0x7f64000b0070 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6406ffd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640015bf50 con 0x7f6400154760 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6406ffd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640015c230 con 0x7f64000cb810 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64000b0070 0x7f64001ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64000b0070 0x7f64001ee6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46936/0 (socket says 172.21.15.113:46936) 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 -- 172.21.15.113:0/979322279 learned_addr learned my addr 172.21.15.113:0/979322279 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f63fffff640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000cb810 0x7f640015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f640559a640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 0x7f64001582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 -- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000cb810 msgr2=0x7f640015cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000cb810 0x7f640015cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 -- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 msgr2=0x7f64001582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 0x7f64001582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.895+0000 7f6404d99640 1 -- 172.21.15.113:0/979322279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40094d0 con 0x7f64000b0070 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.896+0000 7f6404d99640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64000b0070 0x7f64001ee6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f63f4000c00 tx=0x7f63f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.896+0000 7f63fd7fa640 1 -- 172.21.15.113:0/979322279 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f403a930 con 0x7f64000b0070 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.896+0000 7f63fd7fa640 1 -- 172.21.15.113:0/979322279 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f403aa90 con 0x7f64000b0070 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.896+0000 7f63fd7fa640 1 -- 172.21.15.113:0/979322279 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f403ae40 con 0x7f64000b0070 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.896+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640015c510 con 0x7f64000b0070 2023-12-19T13:48:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.896+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640014e200 con 0x7f64000b0070 2023-12-19T13:48:01.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.897+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640015c6d0 con 0x7f64000b0070 2023-12-19T13:48:01.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.898+0000 7f63fd7fa640 1 -- 172.21.15.113:0/979322279 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f63f402f050 con 0x7f64000b0070 2023-12-19T13:48:01.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.899+0000 7f63fd7fa640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63e406a430 0x7f63e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:01.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.899+0000 7f63fd7fa640 1 -- 172.21.15.113:0/979322279 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63f40aa760 con 0x7f64000b0070 2023-12-19T13:48:01.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.899+0000 7f63fffff640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63e406a430 0x7f63e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:01.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.900+0000 7f63fffff640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63e406a430 0x7f63e406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f640015a390 tx=0x7f63ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:01.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:01.903+0000 7f63fd7fa640 1 -- 172.21.15.113:0/979322279 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f63f4075d50 con 0x7f64000b0070 2023-12-19T13:48:02.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.089+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f640015cb60 con 0x7f64000b0070 2023-12-19T13:48:02.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.090+0000 7f63fd7fa640 1 -- 172.21.15.113:0/979322279 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63f4079370 con 0x7f64000b0070 2023-12-19T13:48:02.090 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:48:02.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.092+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63e406a430 msgr2=0x7f63e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.092+0000 7f6406ffd640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63e406a430 0x7f63e406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f640015a390 tx=0x7f63ec009040 comp rx=0 tx=0).stop 2023-12-19T13:48:02.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.092+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64000b0070 msgr2=0x7f64001ee6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.092+0000 7f6406ffd640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64000b0070 0x7f64001ee6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f63f4000c00 tx=0x7f63f40046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 shutdown_connections 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63e406a430 0x7f63e406c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6400154760 0x7f64001582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64000cb810 0x7f640015cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 --2- 172.21.15.113:0/979322279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64000b0070 0x7f64001ee6f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 >> 172.21.15.113:0/979322279 conn(0x7f6400073150 msgr2=0x7f64000cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 shutdown_connections 2023-12-19T13:48:02.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.093+0000 7f6406ffd640 1 -- 172.21.15.113:0/979322279 wait complete. 2023-12-19T13:48:02.110 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:48:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.327+0000 7f8942327640 1 Processor -- start 2023-12-19T13:48:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.327+0000 7f8942327640 1 -- start start 2023-12-19T13:48:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8942327640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f893c0ae110 0x7f893c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8942327640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f893c0b0640 0x7f893c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8942327640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c0b0a60 con 0x7f893c157bf0 2023-12-19T13:48:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8942327640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c06b8c0 con 0x7f893c0ae110 2023-12-19T13:48:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8942327640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c0ae640 con 0x7f893c0b0640 2023-12-19T13:48:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8933fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f893c0ae110 0x7f893c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8933fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f893c0ae110 0x7f893c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46948/0 (socket says 172.21.15.113:46948) 2023-12-19T13:48:02.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8933fff640 1 -- 172.21.15.113:0/1424621155 learned_addr learned my addr 172.21.15.113:0/1424621155 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:02.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f89408c4640 1 --2- 172.21.15.113:0/1424621155 >> v2:172.21.15.151:3300/0 conn(0x7f893c0b0640 0x7f893c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8933fff640 1 -- 172.21.15.113:0/1424621155 >> v2:172.21.15.151:3300/0 conn(0x7f893c0b0640 msgr2=0x7f893c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:02.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8933fff640 1 --2- 172.21.15.113:0/1424621155 >> v2:172.21.15.151:3300/0 conn(0x7f893c0b0640 0x7f893c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8933fff640 1 -- 172.21.15.113:0/1424621155 >> v1:172.21.15.151:6789/0 conn(0x7f893c157bf0 legacy=0x7f893c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:02.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.329+0000 7f8933fff640 1 -- 172.21.15.113:0/1424621155 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0ae920 con 0x7f893c0ae110 2023-12-19T13:48:02.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.330+0000 7f8933fff640 1 --2- 172.21.15.113:0/1424621155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c0b0100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b1210 tx=0x7f892402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b854f552c2313b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:02.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f893b7fe640 1 -- 172.21.15.113:0/1424621155 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924031870 con 0x7f893c0ae110 2023-12-19T13:48:02.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f893b7fe640 1 -- 172.21.15.113:0/1424621155 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89240319d0 con 0x7f893c0ae110 2023-12-19T13:48:02.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f893b7fe640 1 -- 172.21.15.113:0/1424621155 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924031d60 con 0x7f893c0ae110 2023-12-19T13:48:02.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f8942327640 1 -- 172.21.15.113:0/1424621155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 msgr2=0x7f893c0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f8942327640 1 --2- 172.21.15.113:0/1424621155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c0b0100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b1210 tx=0x7f892402b910 comp rx=0 tx=0).stop 2023-12-19T13:48:02.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f8942327640 1 -- 172.21.15.113:0/1424621155 shutdown_connections 2023-12-19T13:48:02.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f8942327640 1 --2- 172.21.15.113:0/1424621155 >> v2:172.21.15.151:3300/0 conn(0x7f893c0b0640 0x7f893c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.331+0000 7f8942327640 1 --2- 172.21.15.113:0/1424621155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c0b0100 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.332+0000 7f8942327640 1 -- 172.21.15.113:0/1424621155 >> 172.21.15.113:0/1424621155 conn(0x7f893c0cbb70 msgr2=0x7f893c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:02.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.332+0000 7f8942327640 1 -- 172.21.15.113:0/1424621155 shutdown_connections 2023-12-19T13:48:02.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.332+0000 7f8942327640 1 -- 172.21.15.113:0/1424621155 wait complete. 2023-12-19T13:48:02.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.333+0000 7f8942327640 1 Processor -- start 2023-12-19T13:48:02.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.333+0000 7f8942327640 1 -- start start 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.334+0000 7f8942327640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.334+0000 7f8942327640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893c0b0640 0x7f893c158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.334+0000 7f8942327640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f893c157bf0 0x7f893c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.334+0000 7f8942327640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c159020 con 0x7f893c0ae110 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.334+0000 7f8942327640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c1598d0 con 0x7f893c157bf0 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.334+0000 7f8942327640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c159bb0 con 0x7f893c0b0640 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.334+0000 7f893bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46964/0 (socket says 172.21.15.113:46964) 2023-12-19T13:48:02.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 -- 172.21.15.113:0/2961193262 learned_addr learned my addr 172.21.15.113:0/2961193262 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f8933fff640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893c0b0640 0x7f893c158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f89408c4640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f893c157bf0 0x7f893c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 -- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893c0b0640 msgr2=0x7f893c158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893c0b0640 0x7f893c158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 -- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f893c157bf0 msgr2=0x7f893c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f893c157bf0 0x7f893c0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 -- 172.21.15.113:0/2961193262 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240094d0 con 0x7f893c0ae110 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f8933fff640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893c0b0640 0x7f893c158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f893bfff640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c159240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c430 tx=0x7f892c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.335+0000 7f89397fa640 1 -- 172.21.15.113:0/2961193262 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011790 con 0x7f893c0ae110 2023-12-19T13:48:02.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.336+0000 7f89397fa640 1 -- 172.21.15.113:0/2961193262 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c0118f0 con 0x7f893c0ae110 2023-12-19T13:48:02.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.336+0000 7f89397fa640 1 -- 172.21.15.113:0/2961193262 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011ce0 con 0x7f893c0ae110 2023-12-19T13:48:02.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.336+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c159e90 con 0x7f893c0ae110 2023-12-19T13:48:02.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.336+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c070920 con 0x7f893c0ae110 2023-12-19T13:48:02.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.337+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c165670 con 0x7f893c0ae110 2023-12-19T13:48:02.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.338+0000 7f89397fa640 1 -- 172.21.15.113:0/2961193262 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f892c01c460 con 0x7f893c0ae110 2023-12-19T13:48:02.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.339+0000 7f89397fa640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f891c06a430 0x7f891c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.339+0000 7f89397fa640 1 -- 172.21.15.113:0/2961193262 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f892c088840 con 0x7f893c0ae110 2023-12-19T13:48:02.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.339+0000 7f8933fff640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f891c06a430 0x7f891c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.340+0000 7f8933fff640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f891c06a430 0x7f891c06c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8924036000 tx=0x7f892403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:02.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.343+0000 7f89397fa640 1 -- 172.21.15.113:0/2961193262 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f893c165670 con 0x7f893c0ae110 2023-12-19T13:48:02.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.536+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f893c165670 con 0x7f893c0ae110 2023-12-19T13:48:02.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.536+0000 7f89397fa640 1 -- 172.21.15.113:0/2961193262 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f893c165670 con 0x7f893c0ae110 2023-12-19T13:48:02.536 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f891c06a430 msgr2=0x7f891c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f891c06a430 0x7f891c06c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8924036000 tx=0x7f892403c040 comp rx=0 tx=0).stop 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 msgr2=0x7f893c159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c159240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c430 tx=0x7f892c00c8f0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 shutdown_connections 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f891c06a430 0x7f891c06c8f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f893c157bf0 0x7f893c0703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893c0b0640 0x7f893c158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 --2- 172.21.15.113:0/2961193262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f893c0ae110 0x7f893c159240 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 >> 172.21.15.113:0/2961193262 conn(0x7f893c0cbb70 msgr2=0x7f893c0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 shutdown_connections 2023-12-19T13:48:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.539+0000 7f8942327640 1 -- 172.21.15.113:0/2961193262 wait complete. 2023-12-19T13:48:02.557 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:48:02.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.763+0000 7f678dec4640 1 Processor -- start 2023-12-19T13:48:02.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.763+0000 7f678dec4640 1 -- start start 2023-12-19T13:48:02.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.764+0000 7f678dec4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 0x7f67880b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f678dec4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678815fde0 con 0x7f67880b1ec0 2023-12-19T13:48:02.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f678dec4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678815ef10 con 0x7f67880ceea0 2023-12-19T13:48:02.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f678dec4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880b2320 con 0x7f678815b1d0 2023-12-19T13:48:02.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f677ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f67880b1ec0 0x7f678815f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:41928/0 (socket says 172.21.15.113:41928) 2023-12-19T13:48:02.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f677ffff640 1 -- 172.21.15.113:0/2812766672 learned_addr learned my addr 172.21.15.113:0/2812766672 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:02.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f67877fe640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 0x7f67880b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750940880 0 0) 0x7f678815fde0 con 0x7f67880b1ec0 2023-12-19T13:48:02.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.765+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6774003520 con 0x7f67880b1ec0 2023-12-19T13:48:02.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2195488680 0 0) 0x7f6774003520 con 0x7f67880b1ec0 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 msgr2=0x7f67880b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 0x7f67880b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 >> v1:172.21.15.151:6789/0 conn(0x7f67880ceea0 legacy=0x7f678806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880b2e40 con 0x7f67880b1ec0 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6770001670 con 0x7f67880b1ec0 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 >> v1:172.21.15.113:6789/0 conn(0x7f67880b1ec0 legacy=0x7f678815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774003a10 0x7f6774003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67740047c0 0x7f6774004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 0x7f6774005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880b2320 con 0x7f67740047c0 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677400bb40 con 0x7f6774003a10 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677400bd00 con 0x7f678815b1d0 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.766+0000 7f677ffff640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67740047c0 0x7f6774004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.767+0000 7f67877fe640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774003a10 0x7f6774003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.767+0000 7f6787fff640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 0x7f6774005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.767+0000 7f677ffff640 1 -- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 msgr2=0x7f6774005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:02.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.767+0000 7f677ffff640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815b1d0 0x7f6774005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.767+0000 7f677ffff640 1 -- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774003a10 msgr2=0x7f6774003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:02.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.767+0000 7f677ffff640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774003a10 0x7f6774003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.767+0000 7f677ffff640 1 -- 172.21.15.113:0/2812766672 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774003520 con 0x7f67740047c0 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.768+0000 7f677ffff640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67740047c0 0x7f6774004c40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f677000c240 tx=0x7f67740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edbab8934480816 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.768+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770005ad0 con 0x7f67740047c0 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.768+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770005c30 con 0x7f67740047c0 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.768+0000 7f6786ffd640 1 -- 172.21.15.113:0/2812766672 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677002c8b0 con 0x7f67740047c0 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.769+0000 7f678dec4640 1 -- 172.21.15.113:0/2812766672 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67740047c0 msgr2=0x7f6774004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.769+0000 7f678dec4640 1 --2- 172.21.15.113:0/2812766672 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67740047c0 0x7f6774004c40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f677000c240 tx=0x7f67740057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.769+0000 7f6787fff640 1 -- 172.21.15.113:0/2812766672 reap_dead start 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.769+0000 7f678dec4640 1 -- 172.21.15.113:0/2812766672 shutdown_connections 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.769+0000 7f678dec4640 1 -- 172.21.15.113:0/2812766672 >> 172.21.15.113:0/2812766672 conn(0x7f6788073150 msgr2=0x7f67880659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:02.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.769+0000 7f678dec4640 1 -- 172.21.15.113:0/2812766672 shutdown_connections 2023-12-19T13:48:02.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.769+0000 7f678dec4640 1 -- 172.21.15.113:0/2812766672 wait complete. 2023-12-19T13:48:02.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.771+0000 7f678dec4640 1 Processor -- start 2023-12-19T13:48:02.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.771+0000 7f678dec4640 1 -- start start 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f678dec4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67740047c0 0x7f67880c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f678dec4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6788157e70 0x7f6788147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f678dec4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815cc30 0x7f678815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f678dec4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678815d600 con 0x7f6788157e70 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f678dec4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788159030 con 0x7f67740047c0 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f678dec4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c4470 con 0x7f678815cc30 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f677ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6788157e70 0x7f6788147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f677ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6788157e70 0x7f6788147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46982/0 (socket says 172.21.15.113:46982) 2023-12-19T13:48:02.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.772+0000 7f677ffff640 1 -- 172.21.15.113:0/1884496003 learned_addr learned my addr 172.21.15.113:0/1884496003 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f67877fe640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67740047c0 0x7f67880c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f6787fff640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815cc30 0x7f678815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f677ffff640 1 -- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815cc30 msgr2=0x7f678815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f677ffff640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815cc30 0x7f678815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f677ffff640 1 -- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67740047c0 msgr2=0x7f67880c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f677ffff640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67740047c0 0x7f67880c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f677ffff640 1 -- 172.21.15.113:0/1884496003 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67881589e0 con 0x7f6788157e70 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f677ffff640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6788157e70 0x7f6788147ae0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6770001930 tx=0x7f6770001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f6784ff9640 1 -- 172.21.15.113:0/1884496003 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770039070 con 0x7f6788157e70 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.773+0000 7f6784ff9640 1 -- 172.21.15.113:0/1884496003 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677002dd50 con 0x7f6788157e70 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.774+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6788158cc0 con 0x7f6788157e70 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.774+0000 7f6784ff9640 1 -- 172.21.15.113:0/1884496003 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677003c040 con 0x7f6788157e70 2023-12-19T13:48:02.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.774+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6788148020 con 0x7f6788157e70 2023-12-19T13:48:02.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.775+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67881591c0 con 0x7f6788157e70 2023-12-19T13:48:02.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.776+0000 7f6784ff9640 1 -- 172.21.15.113:0/1884496003 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6770032070 con 0x7f6788157e70 2023-12-19T13:48:02.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.776+0000 7f6784ff9640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f676806a430 0x7f676806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:02.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.777+0000 7f6784ff9640 1 -- 172.21.15.113:0/1884496003 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67700a9e40 con 0x7f6788157e70 2023-12-19T13:48:02.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.777+0000 7f67877fe640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f676806a430 0x7f676806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:02.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.777+0000 7f67877fe640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f676806a430 0x7f676806c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6788157210 tx=0x7f6778008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:02.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.781+0000 7f6784ff9640 1 -- 172.21.15.113:0/1884496003 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f67700755e0 con 0x7f6788157e70 2023-12-19T13:48:02.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.973+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6788061910 con 0x7f6788157e70 2023-12-19T13:48:02.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.975+0000 7f6784ff9640 1 -- 172.21.15.113:0/1884496003 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6770046020 con 0x7f6788157e70 2023-12-19T13:48:02.974 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:48:02.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f676806a430 msgr2=0x7f676806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f676806a430 0x7f676806c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6788157210 tx=0x7f6778008040 comp rx=0 tx=0).stop 2023-12-19T13:48:02.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6788157e70 msgr2=0x7f6788147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6788157e70 0x7f6788147ae0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6770001930 tx=0x7f6770001a00 comp rx=0 tx=0).stop 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 shutdown_connections 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f676806a430 0x7f676806c8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f678815cc30 0x7f678815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6788157e70 0x7f6788147ae0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 --2- 172.21.15.113:0/1884496003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67740047c0 0x7f67880c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 >> 172.21.15.113:0/1884496003 conn(0x7f6788073150 msgr2=0x7f67880ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.977+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 shutdown_connections 2023-12-19T13:48:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:02.978+0000 7f678dec4640 1 -- 172.21.15.113:0/1884496003 wait complete. 2023-12-19T13:48:02.996 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:48:03.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.200+0000 7f4a8c78b640 1 Processor -- start 2023-12-19T13:48:03.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.200+0000 7f4a8c78b640 1 -- start start 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.202+0000 7f4a8c78b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4a84146ef0 0x7f4a840ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.202+0000 7f4a8c78b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a840b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.202+0000 7f4a8c78b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840d2a50 con 0x7f4a840b6710 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.202+0000 7f4a8c78b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a840cda90 con 0x7f4a84146ef0 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.202+0000 7f4a8c78b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840cdca0 con 0x7f4a841618a0 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.203+0000 7f4a8a527640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4a84146ef0 0x7f4a840ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.203+0000 7f4a8ad28640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a840b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.203+0000 7f4a89d26640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4a840b6710 0x7f4a84161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:47136/0 (socket says 172.21.15.113:47136) 2023-12-19T13:48:03.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.203+0000 7f4a89d26640 1 -- 172.21.15.113:0/617464296 learned_addr learned my addr 172.21.15.113:0/617464296 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:03.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.203+0000 7f4a89525640 1 -- 172.21.15.113:0/617464296 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018554775 0 0) 0x7f4a840d2a50 con 0x7f4a840b6710 2023-12-19T13:48:03.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.204+0000 7f4a89525640 1 -- 172.21.15.113:0/617464296 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a70003520 con 0x7f4a840b6710 2023-12-19T13:48:03.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.204+0000 7f4a8a527640 1 -- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 msgr2=0x7f4a840b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:03.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.204+0000 7f4a8a527640 1 --2- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a840b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.204+0000 7f4a8a527640 1 -- 172.21.15.113:0/617464296 >> v1:172.21.15.151:6789/0 conn(0x7f4a840b6710 legacy=0x7f4a84161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.204+0000 7f4a8a527640 1 -- 172.21.15.113:0/617464296 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840cdf80 con 0x7f4a84146ef0 2023-12-19T13:48:03.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.204+0000 7f4a8ad28640 1 --2- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a840b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:48:03.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.205+0000 7f4a8a527640 1 --2- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 0x7f4a840ce4a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a800097a0 tx=0x7f4a8002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=956d0215f996412d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:03.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a89525640 1 -- 172.21.15.113:0/617464296 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800316f0 con 0x7f4a84146ef0 2023-12-19T13:48:03.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a89525640 1 -- 172.21.15.113:0/617464296 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a80031850 con 0x7f4a84146ef0 2023-12-19T13:48:03.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a89525640 1 -- 172.21.15.113:0/617464296 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80031bc0 con 0x7f4a84146ef0 2023-12-19T13:48:03.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 -- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 msgr2=0x7f4a840ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 0x7f4a840ce4a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a800097a0 tx=0x7f4a8002b790 comp rx=0 tx=0).stop 2023-12-19T13:48:03.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 -- 172.21.15.113:0/617464296 shutdown_connections 2023-12-19T13:48:03.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a840b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/617464296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 0x7f4a840ce4a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 -- 172.21.15.113:0/617464296 >> 172.21.15.113:0/617464296 conn(0x7f4a840b29c0 msgr2=0x7f4a840b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:03.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 -- 172.21.15.113:0/617464296 shutdown_connections 2023-12-19T13:48:03.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.206+0000 7f4a8c78b640 1 -- 172.21.15.113:0/617464296 wait complete. 2023-12-19T13:48:03.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.208+0000 7f4a8c78b640 1 Processor -- start 2023-12-19T13:48:03.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.208+0000 7f4a8c78b640 1 -- start start 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.209+0000 7f4a8c78b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a840b6710 0x7f4a84159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.209+0000 7f4a8c78b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 0x7f4a841601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.209+0000 7f4a8c78b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a84070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.209+0000 7f4a8c78b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840c8a90 con 0x7f4a840b6710 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.209+0000 7f4a8c78b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84159980 con 0x7f4a84146ef0 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.209+0000 7f4a8c78b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84160720 con 0x7f4a841618a0 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.209+0000 7f4a8a527640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a840b6710 0x7f4a84159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a840b6710 0x7f4a84159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46990/0 (socket says 172.21.15.113:46990) 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 -- 172.21.15.113:0/3221526507 learned_addr learned my addr 172.21.15.113:0/3221526507 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a89d26640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 0x7f4a841601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8ad28640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a84070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 -- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 msgr2=0x7f4a84070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a84070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 -- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 msgr2=0x7f4a841601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 0x7f4a841601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 -- 172.21.15.113:0/3221526507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c009a70 con 0x7f4a840b6710 2023-12-19T13:48:03.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.210+0000 7f4a8a527640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a840b6710 0x7f4a84159440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4a8002b7d0 tx=0x7f4a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:03.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.211+0000 7f4a7affd640 1 -- 172.21.15.113:0/3221526507 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800319c0 con 0x7f4a840b6710 2023-12-19T13:48:03.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.211+0000 7f4a7affd640 1 -- 172.21.15.113:0/3221526507 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a80031b20 con 0x7f4a840b6710 2023-12-19T13:48:03.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.211+0000 7f4a7affd640 1 -- 172.21.15.113:0/3221526507 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80031e90 con 0x7f4a840b6710 2023-12-19T13:48:03.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.211+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a80009400 con 0x7f4a840b6710 2023-12-19T13:48:03.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.211+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a840cd090 con 0x7f4a840b6710 2023-12-19T13:48:03.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.212+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a84061910 con 0x7f4a840b6710 2023-12-19T13:48:03.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.213+0000 7f4a7affd640 1 -- 172.21.15.113:0/3221526507 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a8003b070 con 0x7f4a840b6710 2023-12-19T13:48:03.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.214+0000 7f4a7affd640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4a6806a460 0x7f4a6806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.214+0000 7f4a7affd640 1 -- 172.21.15.113:0/3221526507 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a800aa0d0 con 0x7f4a840b6710 2023-12-19T13:48:03.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.214+0000 7f4a89d26640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4a6806a460 0x7f4a6806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.215+0000 7f4a89d26640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4a6806a460 0x7f4a6806c920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4a841f5b70 tx=0x7f4a74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:03.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.218+0000 7f4a7affd640 1 -- 172.21.15.113:0/3221526507 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4a80075800 con 0x7f4a840b6710 2023-12-19T13:48:03.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.411+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a840b8e00 con 0x7f4a840b6710 2023-12-19T13:48:03.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.412+0000 7f4a7affd640 1 -- 172.21.15.113:0/3221526507 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4a80078e20 con 0x7f4a840b6710 2023-12-19T13:48:03.412 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:48:03.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4a6806a460 msgr2=0x7f4a6806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4a6806a460 0x7f4a6806c920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4a841f5b70 tx=0x7f4a74009040 comp rx=0 tx=0).stop 2023-12-19T13:48:03.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a840b6710 msgr2=0x7f4a84159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a840b6710 0x7f4a84159440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4a8002b7d0 tx=0x7f4a800046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 shutdown_connections 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4a6806a460 0x7f4a6806c920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a841618a0 0x7f4a84070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84146ef0 0x7f4a841601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 --2- 172.21.15.113:0/3221526507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a840b6710 0x7f4a84159440 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.414+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 >> 172.21.15.113:0/3221526507 conn(0x7f4a840b29c0 msgr2=0x7f4a840b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.415+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 shutdown_connections 2023-12-19T13:48:03.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.415+0000 7f4a8c78b640 1 -- 172.21.15.113:0/3221526507 wait complete. 2023-12-19T13:48:03.432 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:48:03.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:03.432 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:48:03.579 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:48:03.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:03.579 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:48:03.618 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:48:03.618 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:03.661 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:48:03.662 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:03.755 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:03.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.961+0000 7fe29cba2640 1 Processor -- start 2023-12-19T13:48:03.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.961+0000 7fe29cba2640 1 -- start start 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.962+0000 7fe29cba2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe298159f80 0x7fe29806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.962+0000 7fe29cba2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe29815b1e0 0x7fe29815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.962+0000 7fe29cba2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe29815a8a0 0x7fe29815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.962+0000 7fe29cba2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29806b520 con 0x7fe29815a8a0 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.962+0000 7fe29cba2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980b2b20 con 0x7fe29815b1e0 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.962+0000 7fe29cba2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980b2fb0 con 0x7fe298159f80 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.962+0000 7fe297fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe29815a8a0 0x7fe29815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe297fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe29815a8a0 0x7fe29815dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47004/0 (socket says 172.21.15.113:47004) 2023-12-19T13:48:03.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe297fff640 1 -- 172.21.15.113:0/1258515583 learned_addr learned my addr 172.21.15.113:0/1258515583 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:03.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe297fff640 1 -- 172.21.15.113:0/1258515583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe298159f80 msgr2=0x7fe29806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:03.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe28ffff640 1 --2- 172.21.15.113:0/1258515583 >> v2:172.21.15.151:3300/0 conn(0x7fe29815b1e0 0x7fe29815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe2977fe640 1 --2- 172.21.15.113:0/1258515583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe298159f80 0x7fe29806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe297fff640 1 --2- 172.21.15.113:0/1258515583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe298159f80 0x7fe29806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe297fff640 1 -- 172.21.15.113:0/1258515583 >> v2:172.21.15.151:3300/0 conn(0x7fe29815b1e0 msgr2=0x7fe29815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:03.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe297fff640 1 --2- 172.21.15.113:0/1258515583 >> v2:172.21.15.151:3300/0 conn(0x7fe29815b1e0 0x7fe29815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe297fff640 1 -- 172.21.15.113:0/1258515583 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980b1f10 con 0x7fe29815a8a0 2023-12-19T13:48:03.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.963+0000 7fe28ffff640 1 --2- 172.21.15.113:0/1258515583 >> v2:172.21.15.151:3300/0 conn(0x7fe29815b1e0 0x7fe29815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:03.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.964+0000 7fe297fff640 1 --2- 172.21.15.113:0/1258515583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe29815dba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2980cfe20 tx=0x7fe29002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251ded6b8b254cf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.964+0000 7fe296ffd640 1 -- 172.21.15.113:0/1258515583 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29002cb00 con 0x7fe29815a8a0 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.964+0000 7fe296ffd640 1 -- 172.21.15.113:0/1258515583 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29002cc60 con 0x7fe29815a8a0 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.964+0000 7fe296ffd640 1 -- 172.21.15.113:0/1258515583 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900343f0 con 0x7fe29815a8a0 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 -- 172.21.15.113:0/1258515583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 msgr2=0x7fe29815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 --2- 172.21.15.113:0/1258515583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe29815dba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2980cfe20 tx=0x7fe29002bf60 comp rx=0 tx=0).stop 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 -- 172.21.15.113:0/1258515583 shutdown_connections 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 --2- 172.21.15.113:0/1258515583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe29815dba0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 --2- 172.21.15.113:0/1258515583 >> v2:172.21.15.151:3300/0 conn(0x7fe29815b1e0 0x7fe29815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 --2- 172.21.15.113:0/1258515583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe298159f80 0x7fe29806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 -- 172.21.15.113:0/1258515583 >> 172.21.15.113:0/1258515583 conn(0x7fe2980b0100 msgr2=0x7fe2980b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:03.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 -- 172.21.15.113:0/1258515583 shutdown_connections 2023-12-19T13:48:03.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.965+0000 7fe29cba2640 1 -- 172.21.15.113:0/1258515583 wait complete. 2023-12-19T13:48:03.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.967+0000 7fe29cba2640 1 Processor -- start 2023-12-19T13:48:03.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.967+0000 7fe29cba2640 1 -- start start 2023-12-19T13:48:03.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe29cba2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298159f80 0x7fe298156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe29cba2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe298157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe29cba2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe29815b1e0 0x7fe2981582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe29cba2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815c950 con 0x7fe29815a8a0 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe29cba2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815cc30 con 0x7fe298159f80 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe29cba2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815cf10 con 0x7fe29815b1e0 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe28ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe298157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe28ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe298157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47010/0 (socket says 172.21.15.113:47010) 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.968+0000 7fe28ffff640 1 -- 172.21.15.113:0/51822780 learned_addr learned my addr 172.21.15.113:0/51822780 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe2977fe640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298159f80 0x7fe298156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe297fff640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe29815b1e0 0x7fe2981582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe28ffff640 1 -- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe29815b1e0 msgr2=0x7fe2981582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe28ffff640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe29815b1e0 0x7fe2981582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe28ffff640 1 -- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298159f80 msgr2=0x7fe298156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe28ffff640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298159f80 0x7fe298156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe28ffff640 1 -- 172.21.15.113:0/51822780 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009b30 con 0x7fe29815a8a0 2023-12-19T13:48:03.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe297fff640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe29815b1e0 0x7fe2981582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:03.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe28ffff640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe298157d60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c7f0 tx=0x7fe28000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:03.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe294ff9640 1 -- 172.21.15.113:0/51822780 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007820 con 0x7fe29815a8a0 2023-12-19T13:48:03.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe294ff9640 1 -- 172.21.15.113:0/51822780 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280007980 con 0x7fe29815a8a0 2023-12-19T13:48:03.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29815d1f0 con 0x7fe29815a8a0 2023-12-19T13:48:03.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe294ff9640 1 -- 172.21.15.113:0/51822780 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007cf0 con 0x7fe29815a8a0 2023-12-19T13:48:03.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.969+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe298156ad0 con 0x7fe29815a8a0 2023-12-19T13:48:03.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.970+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe298061910 con 0x7fe29815a8a0 2023-12-19T13:48:03.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.972+0000 7fe294ff9640 1 -- 172.21.15.113:0/51822780 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2800113f0 con 0x7fe29815a8a0 2023-12-19T13:48:03.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.972+0000 7fe294ff9640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe27806a430 0x7fe27806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:03.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.973+0000 7fe294ff9640 1 -- 172.21.15.113:0/51822780 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe280088c70 con 0x7fe29815a8a0 2023-12-19T13:48:03.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.973+0000 7fe2977fe640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe27806a430 0x7fe27806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:03.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.974+0000 7fe2977fe640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe27806a430 0x7fe27806c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe28800a990 tx=0x7fe288008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:03.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:03.977+0000 7fe294ff9640 1 -- 172.21.15.113:0/51822780 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe280054260 con 0x7fe29815a8a0 2023-12-19T13:48:04.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.153+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2980b24a0 con 0x7fe29815a8a0 2023-12-19T13:48:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.156+0000 7fe294ff9640 1 -- 172.21.15.113:0/51822780 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fe28001f090 con 0x7fe29815a8a0 2023-12-19T13:48:04.157 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:04.157 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":36,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:58.492769+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe27806a430 msgr2=0x7fe27806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe27806a430 0x7fe27806c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe28800a990 tx=0x7fe288008040 comp rx=0 tx=0).stop 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 msgr2=0x7fe298157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe298157d60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c7f0 tx=0x7fe28000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 shutdown_connections 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe27806a430 0x7fe27806c8f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe29815b1e0 0x7fe2981582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29815a8a0 0x7fe298157d60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 --2- 172.21.15.113:0/51822780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298159f80 0x7fe298156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 >> 172.21.15.113:0/51822780 conn(0x7fe2980b0100 msgr2=0x7fe2980ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:04.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 shutdown_connections 2023-12-19T13:48:04.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.159+0000 7fe29cba2640 1 -- 172.21.15.113:0/51822780 wait complete. 2023-12-19T13:48:04.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:47:42.574723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:47:43.788651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:48:04.176 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:48:04.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.388+0000 7f0a339fd640 1 Processor -- start 2023-12-19T13:48:04.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.388+0000 7f0a339fd640 1 -- start start 2023-12-19T13:48:04.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a339fd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0a2c154760 0x7f0a2c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a339fd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a2c0b0070 0x7f0a2c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a339fd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0ccbd0 con 0x7f0a2c0cb810 2023-12-19T13:48:04.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a339fd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0ccf20 con 0x7f0a2c0b0070 2023-12-19T13:48:04.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a339fd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b0a60 con 0x7f0a2c154760 2023-12-19T13:48:04.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a30f98640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0a2c0cb810 0x7f0a2c0b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:41940/0 (socket says 172.21.15.113:41940) 2023-12-19T13:48:04.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a30f98640 1 -- 172.21.15.113:0/946539912 learned_addr learned my addr 172.21.15.113:0/946539912 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:04.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.390+0000 7f0a31f9a640 1 --2- 172.21.15.113:0/946539912 >> v2:172.21.15.113:3300/0 conn(0x7f0a2c0b0070 0x7f0a2c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.391+0000 7f0a31799640 1 --2- 172.21.15.113:0/946539912 >> v2:172.21.15.151:3300/0 conn(0x7f0a2c154760 0x7f0a2c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.391+0000 7f0a31f9a640 1 -- 172.21.15.113:0/946539912 >> v2:172.21.15.151:3300/0 conn(0x7f0a2c154760 msgr2=0x7f0a2c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:04.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.391+0000 7f0a31f9a640 1 --2- 172.21.15.113:0/946539912 >> v2:172.21.15.151:3300/0 conn(0x7f0a2c154760 0x7f0a2c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.391+0000 7f0a31f9a640 1 -- 172.21.15.113:0/946539912 >> v1:172.21.15.113:6789/0 conn(0x7f0a2c0cb810 legacy=0x7f0a2c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.391+0000 7f0a23fff640 1 -- 172.21.15.113:0/946539912 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489299106 0 0) 0x7f0a2c0ccbd0 con 0x7f0a2c0cb810 2023-12-19T13:48:04.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.391+0000 7f0a31f9a640 1 -- 172.21.15.113:0/946539912 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c154b40 con 0x7f0a2c0b0070 2023-12-19T13:48:04.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.392+0000 7f0a31f9a640 1 --2- 172.21.15.113:0/946539912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0b0070 0x7f0a2c0b0520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0b2d10 tx=0x7f0a2402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f445e43a6001b51c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:04.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a23fff640 1 -- 172.21.15.113:0/946539912 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2402cbf0 con 0x7f0a2c0b0070 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a23fff640 1 -- 172.21.15.113:0/946539912 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2402cd50 con 0x7f0a2c0b0070 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a23fff640 1 -- 172.21.15.113:0/946539912 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24034660 con 0x7f0a2c0b0070 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a339fd640 1 -- 172.21.15.113:0/946539912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0b0070 msgr2=0x7f0a2c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a339fd640 1 --2- 172.21.15.113:0/946539912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0b0070 0x7f0a2c0b0520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0b2d10 tx=0x7f0a2402be40 comp rx=0 tx=0).stop 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a339fd640 1 -- 172.21.15.113:0/946539912 shutdown_connections 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a339fd640 1 --2- 172.21.15.113:0/946539912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0b0070 0x7f0a2c0b0520 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a339fd640 1 --2- 172.21.15.113:0/946539912 >> v2:172.21.15.151:3300/0 conn(0x7f0a2c154760 0x7f0a2c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.393+0000 7f0a339fd640 1 -- 172.21.15.113:0/946539912 >> 172.21.15.113:0/946539912 conn(0x7f0a2c073150 msgr2=0x7f0a2c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:04.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.394+0000 7f0a339fd640 1 -- 172.21.15.113:0/946539912 shutdown_connections 2023-12-19T13:48:04.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.394+0000 7f0a339fd640 1 -- 172.21.15.113:0/946539912 wait complete. 2023-12-19T13:48:04.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.395+0000 7f0a339fd640 1 Processor -- start 2023-12-19T13:48:04.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.395+0000 7f0a339fd640 1 -- start start 2023-12-19T13:48:04.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.396+0000 7f0a339fd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a2c0b0070 0x7f0a2c155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.396+0000 7f0a339fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0cb810 0x7f0a2c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.396+0000 7f0a339fd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a2c154760 0x7f0a2c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.396+0000 7f0a339fd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c155e40 con 0x7f0a2c0cb810 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.396+0000 7f0a339fd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c157840 con 0x7f0a2c154760 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.396+0000 7f0a339fd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c157a90 con 0x7f0a2c0b0070 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0cb810 0x7f0a2c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0cb810 0x7f0a2c157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47034/0 (socket says 172.21.15.113:47034) 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 -- 172.21.15.113:0/476081297 learned_addr learned my addr 172.21.15.113:0/476081297 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 -- 172.21.15.113:0/476081297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a2c0b0070 msgr2=0x7f0a2c155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a2c0b0070 0x7f0a2c155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 -- 172.21.15.113:0/476081297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a2c154760 msgr2=0x7f0a2c0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a2c154760 0x7f0a2c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 -- 172.21.15.113:0/476081297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24009a70 con 0x7f0a2c0cb810 2023-12-19T13:48:04.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a30f98640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0cb810 0x7f0a2c157300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c410 tx=0x7f0a1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:04.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.397+0000 7f0a21ffb640 1 -- 172.21.15.113:0/476081297 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0074e0 con 0x7f0a2c0cb810 2023-12-19T13:48:04.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.398+0000 7f0a21ffb640 1 -- 172.21.15.113:0/476081297 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c007660 con 0x7f0a2c0cb810 2023-12-19T13:48:04.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.398+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c15b820 con 0x7f0a2c0cb810 2023-12-19T13:48:04.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.398+0000 7f0a21ffb640 1 -- 172.21.15.113:0/476081297 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c004a20 con 0x7f0a2c0cb810 2023-12-19T13:48:04.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.398+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c15c0c0 con 0x7f0a2c0cb810 2023-12-19T13:48:04.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.399+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c15ba10 con 0x7f0a2c0cb810 2023-12-19T13:48:04.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.400+0000 7f0a21ffb640 1 -- 172.21.15.113:0/476081297 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a1c004b80 con 0x7f0a2c0cb810 2023-12-19T13:48:04.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.401+0000 7f0a21ffb640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a1006a430 0x7f0a1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.401+0000 7f0a21ffb640 1 -- 172.21.15.113:0/476081297 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a1c088700 con 0x7f0a2c0cb810 2023-12-19T13:48:04.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.401+0000 7f0a31799640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a1006a430 0x7f0a1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.402+0000 7f0a31799640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a1006a430 0x7f0a1006c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0a280098f0 tx=0x7f0a28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:04.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.405+0000 7f0a21ffb640 1 -- 172.21.15.113:0/476081297 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a1c057770 con 0x7f0a2c0cb810 2023-12-19T13:48:04.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.594+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a2c15c2e0 con 0x7f0a2c0cb810 2023-12-19T13:48:04.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.595+0000 7f0a21ffb640 1 -- 172.21.15.113:0/476081297 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a1c057300 con 0x7f0a2c0cb810 2023-12-19T13:48:04.595 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:48:04.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.597+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a1006a430 msgr2=0x7f0a1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.597+0000 7f0a339fd640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a1006a430 0x7f0a1006c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0a280098f0 tx=0x7f0a28008040 comp rx=0 tx=0).stop 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.597+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0cb810 msgr2=0x7f0a2c157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.597+0000 7f0a339fd640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0cb810 0x7f0a2c157300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c410 tx=0x7f0a1c00c8d0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 shutdown_connections 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a1006a430 0x7f0a1006c8f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a2c154760 0x7f0a2c0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a2c0cb810 0x7f0a2c157300 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 --2- 172.21.15.113:0/476081297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a2c0b0070 0x7f0a2c155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 >> 172.21.15.113:0/476081297 conn(0x7f0a2c073150 msgr2=0x7f0a2c164440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 shutdown_connections 2023-12-19T13:48:04.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.598+0000 7f0a339fd640 1 -- 172.21.15.113:0/476081297 wait complete. 2023-12-19T13:48:04.616 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:48:04.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.827+0000 7fae364ec640 1 Processor -- start 2023-12-19T13:48:04.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.827+0000 7fae364ec640 1 -- start start 2023-12-19T13:48:04.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.829+0000 7fae364ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 0x7fae3015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.829+0000 7fae364ec640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3015b740 con 0x7fae300b0810 2023-12-19T13:48:04.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.829+0000 7fae364ec640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae300ae640 con 0x7fae300ae110 2023-12-19T13:48:04.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.829+0000 7fae364ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3006b8c0 con 0x7fae30157bf0 2023-12-19T13:48:04.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.829+0000 7fae34a89640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fae300b0810 0x7fae3006d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:41954/0 (socket says 172.21.15.113:41954) 2023-12-19T13:48:04.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.829+0000 7fae34a89640 1 -- 172.21.15.113:0/3722584903 learned_addr learned my addr 172.21.15.113:0/3722584903 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.829+0000 7fae2ffff640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 0x7fae3015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491049862 0 0) 0x7fae3015b740 con 0x7fae300b0810 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae18003520 con 0x7fae300b0810 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3307489590 0 0) 0x7fae18003520 con 0x7fae300b0810 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 msgr2=0x7fae3015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 0x7fae3015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 >> v1:172.21.15.151:6789/0 conn(0x7fae300ae110 legacy=0x7fae300b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300ae920 con 0x7fae300b0810 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fae280019f0 con 0x7fae300b0810 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 >> v1:172.21.15.113:6789/0 conn(0x7fae300b0810 legacy=0x7fae3006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 0x7fae18003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae18003fe0 0x7fae180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae18004d00 0x7fae18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3006b8c0 con 0x7fae18004d00 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1800bb40 con 0x7fae18003fe0 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1800df10 con 0x7fae30157bf0 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.830+0000 7fae34a89640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae18004d00 0x7fae18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae2ffff640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 0x7fae18003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae2f7fe640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae18003fe0 0x7fae180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae34a89640 1 -- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 msgr2=0x7fae18003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae34a89640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae30157bf0 0x7fae18003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae34a89640 1 -- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae18003fe0 msgr2=0x7fae180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:04.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae34a89640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae18003fe0 0x7fae180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae34a89640 1 -- 172.21.15.113:0/3722584903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18003520 con 0x7fae18004d00 2023-12-19T13:48:04.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.831+0000 7fae2f7fe640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae18003fe0 0x7fae180047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:04.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.832+0000 7fae34a89640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae18004d00 0x7fae18005180 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae3015dcd0 tx=0x7fae180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df1a54e2f720918 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:04.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.832+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28034630 con 0x7fae18004d00 2023-12-19T13:48:04.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.832+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2802f070 con 0x7fae18004d00 2023-12-19T13:48:04.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.832+0000 7fae2effd640 1 -- 172.21.15.113:0/3722584903 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28034a50 con 0x7fae18004d00 2023-12-19T13:48:04.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.833+0000 7fae364ec640 1 -- 172.21.15.113:0/3722584903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae18004d00 msgr2=0x7fae18005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.833+0000 7fae364ec640 1 --2- 172.21.15.113:0/3722584903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae18004d00 0x7fae18005180 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae3015dcd0 tx=0x7fae180057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.833+0000 7fae34a89640 1 -- 172.21.15.113:0/3722584903 reap_dead start 2023-12-19T13:48:04.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.833+0000 7fae364ec640 1 -- 172.21.15.113:0/3722584903 shutdown_connections 2023-12-19T13:48:04.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.833+0000 7fae364ec640 1 -- 172.21.15.113:0/3722584903 >> 172.21.15.113:0/3722584903 conn(0x7fae300cbb70 msgr2=0x7fae300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:04.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.833+0000 7fae364ec640 1 -- 172.21.15.113:0/3722584903 shutdown_connections 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.833+0000 7fae364ec640 1 -- 172.21.15.113:0/3722584903 wait complete. 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.835+0000 7fae364ec640 1 Processor -- start 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.835+0000 7fae364ec640 1 -- start start 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae364ec640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3006d3a0 0x7fae30157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae364ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3014ae80 0x7fae30139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae364ec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae3006d780 0x7fae30139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae364ec640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3006f120 con 0x7fae3006d780 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae364ec640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3006f370 con 0x7fae3006d3a0 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae364ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3006f650 con 0x7fae3014ae80 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae34a89640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae3006d780 0x7fae30139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae34a89640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae3006d780 0x7fae30139c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47056/0 (socket says 172.21.15.113:47056) 2023-12-19T13:48:04.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae34a89640 1 -- 172.21.15.113:0/1590091945 learned_addr learned my addr 172.21.15.113:0/1590091945 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae2f7fe640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3014ae80 0x7fae30139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.836+0000 7fae2ffff640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3006d3a0 0x7fae30157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae34a89640 1 -- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3014ae80 msgr2=0x7fae30139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae34a89640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3014ae80 0x7fae30139750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae34a89640 1 -- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3006d3a0 msgr2=0x7fae30157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae34a89640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3006d3a0 0x7fae30157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae34a89640 1 -- 172.21.15.113:0/1590091945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3006f930 con 0x7fae3006d780 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae34a89640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae3006d780 0x7fae30139c90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae2800a850 tx=0x7fae28001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae2cff9640 1 -- 172.21.15.113:0/1590091945 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28034840 con 0x7fae3006d780 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae2cff9640 1 -- 172.21.15.113:0/1590091945 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280349a0 con 0x7fae3006d780 2023-12-19T13:48:04.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae2cff9640 1 -- 172.21.15.113:0/1590091945 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28034d10 con 0x7fae3006d780 2023-12-19T13:48:04.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3006fc10 con 0x7fae3006d780 2023-12-19T13:48:04.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.837+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae30158510 con 0x7fae3006d780 2023-12-19T13:48:04.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.839+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae30158700 con 0x7fae3006d780 2023-12-19T13:48:04.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.839+0000 7fae2cff9640 1 -- 172.21.15.113:0/1590091945 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae28031030 con 0x7fae3006d780 2023-12-19T13:48:04.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.840+0000 7fae2cff9640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae1c06a430 0x7fae1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:04.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.840+0000 7fae2cff9640 1 -- 172.21.15.113:0/1590091945 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae280aac20 con 0x7fae3006d780 2023-12-19T13:48:04.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.840+0000 7fae2ffff640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae1c06a430 0x7fae1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:04.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.841+0000 7fae2ffff640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae1c06a430 0x7fae1c06c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae20009950 tx=0x7fae20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:04.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:04.844+0000 7fae2cff9640 1 -- 172.21.15.113:0/1590091945 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae30158700 con 0x7fae3006d780 2023-12-19T13:48:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.031+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae30158700 con 0x7fae3006d780 2023-12-19T13:48:05.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.032+0000 7fae2cff9640 1 -- 172.21.15.113:0/1590091945 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae30158700 con 0x7fae3006d780 2023-12-19T13:48:05.032 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:48:05.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.034+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae1c06a430 msgr2=0x7fae1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.034+0000 7fae364ec640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae1c06a430 0x7fae1c06c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae20009950 tx=0x7fae20008040 comp rx=0 tx=0).stop 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae3006d780 msgr2=0x7fae30139c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae3006d780 0x7fae30139c90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae2800a850 tx=0x7fae28001cb0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 shutdown_connections 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae1c06a430 0x7fae1c06c8f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae3006d780 0x7fae30139c90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3014ae80 0x7fae30139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 --2- 172.21.15.113:0/1590091945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3006d3a0 0x7fae30157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 >> 172.21.15.113:0/1590091945 conn(0x7fae300cbb70 msgr2=0x7fae300caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 shutdown_connections 2023-12-19T13:48:05.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.035+0000 7fae364ec640 1 -- 172.21.15.113:0/1590091945 wait complete. 2023-12-19T13:48:05.054 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:48:05.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.267+0000 7f5fc6485640 1 Processor -- start 2023-12-19T13:48:05.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.267+0000 7f5fc6485640 1 -- start start 2023-12-19T13:48:05.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.268+0000 7f5fc6485640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5fc015e580 0x7f5fc00afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.268+0000 7f5fc6485640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00b06b0 con 0x7f5fc00cd4e0 2023-12-19T13:48:05.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.268+0000 7f5fc6485640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc015dae0 con 0x7f5fc00b02a0 2023-12-19T13:48:05.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.268+0000 7f5fc6485640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc015ea30 con 0x7f5fc015e580 2023-12-19T13:48:05.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fc5483640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5fc00cd4e0 0x7f5fc015a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:41958/0 (socket says 172.21.15.113:41958) 2023-12-19T13:48:05.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fc5483640 1 -- 172.21.15.113:0/1219414449 learned_addr learned my addr 172.21.15.113:0/1219414449 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:05.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714537341 0 0) 0x7f5fc00b06b0 con 0x7f5fc00cd4e0 2023-12-19T13:48:05.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fc4c82640 1 --2- 172.21.15.113:0/1219414449 >> v2:172.21.15.151:3300/0 conn(0x7f5fc015e580 0x7f5fc00afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fac003520 con 0x7f5fc00cd4e0 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424840641 0 0) 0x7f5fac003520 con 0x7f5fc00cd4e0 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 >> v2:172.21.15.151:3300/0 conn(0x7f5fc015e580 msgr2=0x7f5fc00afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.269+0000 7f5fb7fff640 1 --2- 172.21.15.113:0/1219414449 >> v2:172.21.15.151:3300/0 conn(0x7f5fc015e580 0x7f5fc00afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 >> v1:172.21.15.151:6789/0 conn(0x7f5fc00b02a0 legacy=0x7f5fc00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc015b000 con 0x7f5fc00cd4e0 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5fbc001670 con 0x7f5fc00cd4e0 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 >> v1:172.21.15.113:6789/0 conn(0x7f5fc00cd4e0 legacy=0x7f5fc015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fac003970 0x7f5fac003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fac0047c0 0x7f5fac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac005180 0x7f5fac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc015ea30 con 0x7f5fac003970 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac00c000 con 0x7f5fac005180 2023-12-19T13:48:05.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac00c1c0 con 0x7f5fac0047c0 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5483640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fac003970 0x7f5fac003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5c84640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac005180 0x7f5fac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5483640 1 -- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fac0047c0 msgr2=0x7f5fac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5483640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fac0047c0 0x7f5fac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5483640 1 -- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac005180 msgr2=0x7f5fac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5483640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac005180 0x7f5fac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5483640 1 -- 172.21.15.113:0/1219414449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac003520 con 0x7f5fac003970 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5c84640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac005180 0x7f5fac00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.270+0000 7f5fc5c84640 1 -- 172.21.15.113:0/1219414449 reap_dead start 2023-12-19T13:48:05.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.271+0000 7f5fc5483640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fac003970 0x7f5fac003d70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007fc0 tx=0x7f5fac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa75c5eeaa604a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:05.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc005ad0 con 0x7f5fac003970 2023-12-19T13:48:05.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc005c50 con 0x7f5fac003970 2023-12-19T13:48:05.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fb7fff640 1 -- 172.21.15.113:0/1219414449 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc02c7c0 con 0x7f5fac003970 2023-12-19T13:48:05.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fc6485640 1 -- 172.21.15.113:0/1219414449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fac003970 msgr2=0x7f5fac003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fc6485640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fac003970 0x7f5fac003d70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007fc0 tx=0x7f5fac0057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fc6485640 1 -- 172.21.15.113:0/1219414449 shutdown_connections 2023-12-19T13:48:05.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fc6485640 1 --2- 172.21.15.113:0/1219414449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fac003970 0x7f5fac003d70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fc6485640 1 -- 172.21.15.113:0/1219414449 >> 172.21.15.113:0/1219414449 conn(0x7f5fc006f630 msgr2=0x7f5fc006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:05.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fc6485640 1 -- 172.21.15.113:0/1219414449 shutdown_connections 2023-12-19T13:48:05.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.272+0000 7f5fc6485640 1 -- 172.21.15.113:0/1219414449 wait complete. 2023-12-19T13:48:05.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.274+0000 7f5fc6485640 1 Processor -- start 2023-12-19T13:48:05.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.274+0000 7f5fc6485640 1 -- start start 2023-12-19T13:48:05.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.275+0000 7f5fc6485640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac003970 0x7f5fc014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.275+0000 7f5fc6485640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc006cc60 0x7f5fc00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.275+0000 7f5fc6485640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fc006d0c0 0x7f5fc00acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.275+0000 7f5fc6485640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00b0ee0 con 0x7f5fc006d0c0 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.275+0000 7f5fc6485640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00b11c0 con 0x7f5fac003970 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.275+0000 7f5fc6485640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00b14a0 con 0x7f5fc006cc60 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fc006d0c0 0x7f5fc00acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fc006d0c0 0x7f5fc00acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47086/0 (socket says 172.21.15.113:47086) 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 -- 172.21.15.113:0/771178444 learned_addr learned my addr 172.21.15.113:0/771178444 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc4c82640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc006cc60 0x7f5fc00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5483640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac003970 0x7f5fc014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 -- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc006cc60 msgr2=0x7f5fc00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc006cc60 0x7f5fc00ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 -- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac003970 msgr2=0x7f5fc014d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac003970 0x7f5fc014d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5c84640 1 -- 172.21.15.113:0/771178444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00b1780 con 0x7f5fc006d0c0 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.276+0000 7f5fc5483640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac003970 0x7f5fc014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.277+0000 7f5fc5c84640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fc006d0c0 0x7f5fc00acdf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00719e0 tx=0x7f5fb800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.277+0000 7f5fb5ffb640 1 -- 172.21.15.113:0/771178444 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8006d50 con 0x7f5fc006d0c0 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.277+0000 7f5fb5ffb640 1 -- 172.21.15.113:0/771178444 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb8012600 con 0x7f5fc006d0c0 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.277+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc00b1a60 con 0x7f5fc006d0c0 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.277+0000 7f5fb5ffb640 1 -- 172.21.15.113:0/771178444 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb80129b0 con 0x7f5fc006d0c0 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.277+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc00cf950 con 0x7f5fc006d0c0 2023-12-19T13:48:05.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.278+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc00b1ca0 con 0x7f5fc006d0c0 2023-12-19T13:48:05.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.279+0000 7f5fb5ffb640 1 -- 172.21.15.113:0/771178444 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5fb8012b10 con 0x7f5fc006d0c0 2023-12-19T13:48:05.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.280+0000 7f5fb5ffb640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fa406a460 0x7f5fa406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.280+0000 7f5fb5ffb640 1 -- 172.21.15.113:0/771178444 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fb8088500 con 0x7f5fc006d0c0 2023-12-19T13:48:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.280+0000 7f5fc5483640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fa406a460 0x7f5fa406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.281+0000 7f5fc5483640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fa406a460 0x7f5fa406c920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc034000 tx=0x7f5fbc007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:05.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.284+0000 7f5fb5ffb640 1 -- 172.21.15.113:0/771178444 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5fc00b1ca0 con 0x7f5fc006d0c0 2023-12-19T13:48:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.474+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fc00b1ca0 con 0x7f5fc006d0c0 2023-12-19T13:48:05.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.474+0000 7f5fb5ffb640 1 -- 172.21.15.113:0/771178444 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fc00b1ca0 con 0x7f5fc006d0c0 2023-12-19T13:48:05.475 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fa406a460 msgr2=0x7f5fa406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fa406a460 0x7f5fa406c920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc034000 tx=0x7f5fbc007000 comp rx=0 tx=0).stop 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fc006d0c0 msgr2=0x7f5fc00acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fc006d0c0 0x7f5fc00acdf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00719e0 tx=0x7f5fb800d9d0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 shutdown_connections 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5fa406a460 0x7f5fa406c920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fc006d0c0 0x7f5fc00acdf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc006cc60 0x7f5fc00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 --2- 172.21.15.113:0/771178444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fac003970 0x7f5fc014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 >> 172.21.15.113:0/771178444 conn(0x7f5fc006f630 msgr2=0x7f5fc0157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 shutdown_connections 2023-12-19T13:48:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.477+0000 7f5fc6485640 1 -- 172.21.15.113:0/771178444 wait complete. 2023-12-19T13:48:05.495 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:48:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.704+0000 7f1a37fff640 1 Processor -- start 2023-12-19T13:48:05.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.704+0000 7f1a37fff640 1 -- start start 2023-12-19T13:48:05.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a38155460 0x7f1a380b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a37fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1a380b0830 0x7f1a3806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a37fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a3806ca80 0x7f1a380cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a37fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a380b0cb0 con 0x7f1a380b0830 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a37fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3815c9c0 con 0x7f1a3806ca80 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a37fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3806d270 con 0x7f1a38155460 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1a380b0830 0x7f1a3806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1a380b0830 0x7f1a3806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47090/0 (socket says 172.21.15.113:47090) 2023-12-19T13:48:05.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 -- 172.21.15.113:0/2872137402 learned_addr learned my addr 172.21.15.113:0/2872137402 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a36ffd640 1 --2- 172.21.15.113:0/2872137402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a38155460 0x7f1a380b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a377fe640 1 --2- 172.21.15.113:0/2872137402 >> v2:172.21.15.151:3300/0 conn(0x7f1a3806ca80 0x7f1a380cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 -- 172.21.15.113:0/2872137402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a38155460 msgr2=0x7f1a380b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 --2- 172.21.15.113:0/2872137402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a38155460 0x7f1a380b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 -- 172.21.15.113:0/2872137402 >> v2:172.21.15.151:3300/0 conn(0x7f1a3806ca80 msgr2=0x7f1a380cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 --2- 172.21.15.113:0/2872137402 >> v2:172.21.15.151:3300/0 conn(0x7f1a3806ca80 0x7f1a380cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.706+0000 7f1a367fc640 1 -- 172.21.15.113:0/2872137402 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3806d550 con 0x7f1a380b0830 2023-12-19T13:48:05.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.708+0000 7f1a367fc640 1 --2- 172.21.15.113:0/2872137402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a380b0830 0x7f1a3806c540 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1a380afac0 tx=0x7f1a2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c493eada83f86f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:05.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.708+0000 7f1a35ffb640 1 -- 172.21.15.113:0/2872137402 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20031870 con 0x7f1a380b0830 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.708+0000 7f1a35ffb640 1 -- 172.21.15.113:0/2872137402 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a200319d0 con 0x7f1a380b0830 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.708+0000 7f1a35ffb640 1 -- 172.21.15.113:0/2872137402 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20031d60 con 0x7f1a380b0830 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.708+0000 7f1a37fff640 1 -- 172.21.15.113:0/2872137402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a380b0830 msgr2=0x7f1a3806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.708+0000 7f1a37fff640 1 --2- 172.21.15.113:0/2872137402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a380b0830 0x7f1a3806c540 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1a380afac0 tx=0x7f1a2002b910 comp rx=0 tx=0).stop 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.709+0000 7f1a37fff640 1 -- 172.21.15.113:0/2872137402 shutdown_connections 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.709+0000 7f1a37fff640 1 --2- 172.21.15.113:0/2872137402 >> v2:172.21.15.151:3300/0 conn(0x7f1a3806ca80 0x7f1a380cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.709+0000 7f1a37fff640 1 --2- 172.21.15.113:0/2872137402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a380b0830 0x7f1a3806c540 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.709+0000 7f1a37fff640 1 --2- 172.21.15.113:0/2872137402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a38155460 0x7f1a380b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.709+0000 7f1a37fff640 1 -- 172.21.15.113:0/2872137402 >> 172.21.15.113:0/2872137402 conn(0x7f1a380659a0 msgr2=0x7f1a38065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.709+0000 7f1a37fff640 1 -- 172.21.15.113:0/2872137402 shutdown_connections 2023-12-19T13:48:05.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.709+0000 7f1a37fff640 1 -- 172.21.15.113:0/2872137402 wait complete. 2023-12-19T13:48:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.710+0000 7f1a37fff640 1 Processor -- start 2023-12-19T13:48:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.711+0000 7f1a37fff640 1 -- start start 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3806ca80 0x7f1a38150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a380b0830 0x7f1a3815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a38155460 0x7f1a3815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a37fff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815d790 con 0x7f1a38155460 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a37fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815cdf0 con 0x7f1a3806ca80 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a37fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815d0d0 con 0x7f1a380b0830 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a38155460 0x7f1a3815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a38155460 0x7f1a3815e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47104/0 (socket says 172.21.15.113:47104) 2023-12-19T13:48:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 -- 172.21.15.113:0/1487209388 learned_addr learned my addr 172.21.15.113:0/1487209388 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a36ffd640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3806ca80 0x7f1a38150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a367fc640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a380b0830 0x7f1a3815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 -- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a380b0830 msgr2=0x7f1a3815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a380b0830 0x7f1a3815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 -- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3806ca80 msgr2=0x7f1a38150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3806ca80 0x7f1a38150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a377fe640 1 -- 172.21.15.113:0/1487209388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200094d0 con 0x7f1a38155460 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a36ffd640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3806ca80 0x7f1a38150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.712+0000 7f1a367fc640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a380b0830 0x7f1a3815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.713+0000 7f1a377fe640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a38155460 0x7f1a3815e0f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000cd70 tx=0x7f1a3000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.713+0000 7f1a2f7fe640 1 -- 172.21.15.113:0/1487209388 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30003b90 con 0x7f1a38155460 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.713+0000 7f1a2f7fe640 1 -- 172.21.15.113:0/1487209388 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a30003cf0 con 0x7f1a38155460 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.713+0000 7f1a2f7fe640 1 -- 172.21.15.113:0/1487209388 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30004240 con 0x7f1a38155460 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.713+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3815d3b0 con 0x7f1a38155460 2023-12-19T13:48:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.713+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a38151110 con 0x7f1a38155460 2023-12-19T13:48:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.715+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3815d8d0 con 0x7f1a38155460 2023-12-19T13:48:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.715+0000 7f1a2f7fe640 1 -- 172.21.15.113:0/1487209388 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1a300043a0 con 0x7f1a38155460 2023-12-19T13:48:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.716+0000 7f1a2f7fe640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a1c06a430 0x7f1a1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:05.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.716+0000 7f1a2f7fe640 1 -- 172.21.15.113:0/1487209388 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a30012070 con 0x7f1a38155460 2023-12-19T13:48:05.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.717+0000 7f1a36ffd640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a1c06a430 0x7f1a1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:05.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.717+0000 7f1a36ffd640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a1c06a430 0x7f1a1c06c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800b800 tx=0x7f1a28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:05.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.720+0000 7f1a2f7fe640 1 -- 172.21.15.113:0/1487209388 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1a3815d8d0 con 0x7f1a38155460 2023-12-19T13:48:05.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.923+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1a3815d8d0 con 0x7f1a38155460 2023-12-19T13:48:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.923+0000 7f1a2f7fe640 1 -- 172.21.15.113:0/1487209388 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1a3815d8d0 con 0x7f1a38155460 2023-12-19T13:48:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:48:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a1c06a430 msgr2=0x7f1a1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a1c06a430 0x7f1a1c06c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800b800 tx=0x7f1a28008040 comp rx=0 tx=0).stop 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a38155460 msgr2=0x7f1a3815e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a38155460 0x7f1a3815e0f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000cd70 tx=0x7f1a3000a660 comp rx=0 tx=0).stop 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 shutdown_connections 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1a1c06a430 0x7f1a1c06c8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a38155460 0x7f1a3815e0f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a380b0830 0x7f1a3815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 --2- 172.21.15.113:0/1487209388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3806ca80 0x7f1a38150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 >> 172.21.15.113:0/1487209388 conn(0x7f1a380659a0 msgr2=0x7f1a380b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 shutdown_connections 2023-12-19T13:48:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:05.926+0000 7f1a37fff640 1 -- 172.21.15.113:0/1487209388 wait complete. 2023-12-19T13:48:05.944 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:48:05.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:05.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:48:06.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:48:06.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:06.054 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:48:06.103 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:06.103 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:06.161 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:48:06.161 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:48:06.162 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:06.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:48:06.218 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:06.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.437+0000 7fb9729e9640 1 Processor -- start 2023-12-19T13:48:06.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.437+0000 7fb9729e9640 1 -- start start 2023-12-19T13:48:06.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.439+0000 7fb9729e9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb96c15b1e0 0x7fb96c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.439+0000 7fb9729e9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 0x7fb96c15b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.439+0000 7fb9729e9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c06b520 con 0x7fb96c159f80 2023-12-19T13:48:06.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.439+0000 7fb9729e9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c0b2b20 con 0x7fb96c15b1e0 2023-12-19T13:48:06.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.439+0000 7fb9729e9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0b2fb0 con 0x7fb96c15a8a0 2023-12-19T13:48:06.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.440+0000 7fb9719e7640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb96c159f80 0x7fb96c06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:41974/0 (socket says 172.21.15.113:41974) 2023-12-19T13:48:06.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.440+0000 7fb9719e7640 1 -- 172.21.15.113:0/3416678200 learned_addr learned my addr 172.21.15.113:0/3416678200 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.440+0000 7fb9711e6640 1 --2- 172.21.15.113:0/3416678200 >> v2:172.21.15.151:3300/0 conn(0x7fb96c15b1e0 0x7fb96c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.440+0000 7fb9721e8640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 0x7fb96c15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.440+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444261130 0 0) 0x7fb96c06b520 con 0x7fb96c159f80 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.440+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb958003520 con 0x7fb96c159f80 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795382641 0 0) 0x7fb958003520 con 0x7fb96c159f80 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 msgr2=0x7fb96c15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 0x7fb96c15b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 >> v2:172.21.15.151:3300/0 conn(0x7fb96c15b1e0 msgr2=0x7fb96c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 --2- 172.21.15.113:0/3416678200 >> v2:172.21.15.151:3300/0 conn(0x7fb96c15b1e0 0x7fb96c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c0b1f10 con 0x7fb96c159f80 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb968001670 con 0x7fb96c159f80 2023-12-19T13:48:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 >> v1:172.21.15.113:6789/0 conn(0x7fb96c159f80 legacy=0x7fb96c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 0x7fb958003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb958003ef0 0x7fb9580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb958004d00 0x7fb958005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0b2b20 con 0x7fb958003ef0 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0b2fb0 con 0x7fb958004d00 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95800dbc0 con 0x7fb96c15a8a0 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9711e6640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb958003ef0 0x7fb9580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.441+0000 7fb9721e8640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb958004d00 0x7fb958005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.442+0000 7fb9719e7640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 0x7fb958003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.442+0000 7fb9711e6640 1 -- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 msgr2=0x7fb958003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.442+0000 7fb9711e6640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 0x7fb958003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.442+0000 7fb9711e6640 1 -- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb958004d00 msgr2=0x7fb958005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.442+0000 7fb9711e6640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb958004d00 0x7fb958005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.442+0000 7fb9711e6640 1 -- 172.21.15.113:0/3416678200 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958003520 con 0x7fb958003ef0 2023-12-19T13:48:06.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.442+0000 7fb9719e7640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb96c15a8a0 0x7fb958003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.443+0000 7fb9711e6640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb958003ef0 0x7fb9580047c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009ac0 tx=0x7fb9580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12504a10611c2eb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.443+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c02c710 con 0x7fb958003ef0 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.443+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c02c870 con 0x7fb958003ef0 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.443+0000 7fb9709e5640 1 -- 172.21.15.113:0/3416678200 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c02cc00 con 0x7fb958003ef0 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.444+0000 7fb9729e9640 1 -- 172.21.15.113:0/3416678200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb958003ef0 msgr2=0x7fb9580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.444+0000 7fb9729e9640 1 --2- 172.21.15.113:0/3416678200 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb958003ef0 0x7fb9580047c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009ac0 tx=0x7fb9580057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.444+0000 7fb9721e8640 1 -- 172.21.15.113:0/3416678200 reap_dead start 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.444+0000 7fb9729e9640 1 -- 172.21.15.113:0/3416678200 shutdown_connections 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.444+0000 7fb9729e9640 1 -- 172.21.15.113:0/3416678200 >> 172.21.15.113:0/3416678200 conn(0x7fb96c0b0100 msgr2=0x7fb96c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.444+0000 7fb9729e9640 1 -- 172.21.15.113:0/3416678200 shutdown_connections 2023-12-19T13:48:06.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.444+0000 7fb9729e9640 1 -- 172.21.15.113:0/3416678200 wait complete. 2023-12-19T13:48:06.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.446+0000 7fb9729e9640 1 Processor -- start 2023-12-19T13:48:06.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.446+0000 7fb9729e9640 1 -- start start 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.446+0000 7fb9729e9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb958003ef0 0x7fb96c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9729e9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb96c1523f0 0x7fb96c152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9729e9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96c1530a0 0x7fb96c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9729e9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c06bec0 con 0x7fb96c1523f0 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9729e9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c153a60 con 0x7fb96c1530a0 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9729e9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c06c8a0 con 0x7fb958003ef0 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb96c1523f0 0x7fb96c152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb96c1523f0 0x7fb96c152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47134/0 (socket says 172.21.15.113:47134) 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 -- 172.21.15.113:0/1795484527 learned_addr learned my addr 172.21.15.113:0/1795484527 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9721e8640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96c1530a0 0x7fb96c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9719e7640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb958003ef0 0x7fb96c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 -- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb958003ef0 msgr2=0x7fb96c14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb958003ef0 0x7fb96c14ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 -- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96c1530a0 msgr2=0x7fb96c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96c1530a0 0x7fb96c153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9711e6640 1 -- 172.21.15.113:0/1795484527 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c06de60 con 0x7fb96c1523f0 2023-12-19T13:48:06.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.447+0000 7fb9719e7640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb958003ef0 0x7fb96c14ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:06.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.448+0000 7fb9711e6640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb96c1523f0 0x7fb96c152b60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009ac0 tx=0x7fb95c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:06.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.448+0000 7fb9627fc640 1 -- 172.21.15.113:0/1795484527 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c003810 con 0x7fb96c1523f0 2023-12-19T13:48:06.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.448+0000 7fb9627fc640 1 -- 172.21.15.113:0/1795484527 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c02de90 con 0x7fb96c1523f0 2023-12-19T13:48:06.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.448+0000 7fb9627fc640 1 -- 172.21.15.113:0/1795484527 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c003b90 con 0x7fb96c1523f0 2023-12-19T13:48:06.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.448+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c06e140 con 0x7fb96c1523f0 2023-12-19T13:48:06.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.448+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c06c380 con 0x7fb96c1523f0 2023-12-19T13:48:06.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.449+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c061910 con 0x7fb96c1523f0 2023-12-19T13:48:06.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.450+0000 7fb9627fc640 1 -- 172.21.15.113:0/1795484527 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb95c003cf0 con 0x7fb96c1523f0 2023-12-19T13:48:06.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.451+0000 7fb9627fc640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb95006a460 0x7fb95006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.451+0000 7fb9627fc640 1 -- 172.21.15.113:0/1795484527 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb95c0aac70 con 0x7fb96c1523f0 2023-12-19T13:48:06.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.451+0000 7fb9719e7640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb95006a460 0x7fb95006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.452+0000 7fb9719e7640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb95006a460 0x7fb95006c920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb96c14b5e0 tx=0x7fb968009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:06.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.455+0000 7fb9627fc640 1 -- 172.21.15.113:0/1795484527 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb95c0762e0 con 0x7fb96c1523f0 2023-12-19T13:48:06.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.684+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb96c0b0f70 con 0x7fb96c1523f0 2023-12-19T13:48:06.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.685+0000 7fb9627fc640 1 -- 172.21.15.113:0/1795484527 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7fb95c079900 con 0x7fb96c1523f0 2023-12-19T13:48:06.686 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:06.686 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:48:06.686 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:48:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb95006a460 msgr2=0x7fb95006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb95006a460 0x7fb95006c920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb96c14b5e0 tx=0x7fb968009040 comp rx=0 tx=0).stop 2023-12-19T13:48:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb96c1523f0 msgr2=0x7fb96c152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb96c1523f0 0x7fb96c152b60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009ac0 tx=0x7fb95c004730 comp rx=0 tx=0).stop 2023-12-19T13:48:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 shutdown_connections 2023-12-19T13:48:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb95006a460 0x7fb95006c920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96c1530a0 0x7fb96c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb96c1523f0 0x7fb96c152b60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 --2- 172.21.15.113:0/1795484527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb958003ef0 0x7fb96c14ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.687+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 >> 172.21.15.113:0/1795484527 conn(0x7fb96c0b0100 msgr2=0x7fb96c155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:06.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.688+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 shutdown_connections 2023-12-19T13:48:06.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.688+0000 7fb9729e9640 1 -- 172.21.15.113:0/1795484527 wait complete. 2023-12-19T13:48:06.707 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:06.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.916+0000 7fab95df6640 1 Processor -- start 2023-12-19T13:48:06.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.916+0000 7fab95df6640 1 -- start start 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.917+0000 7fab95df6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab901449e0 0x7fab900af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.917+0000 7fab95df6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fab9006c6b0 0x7fab900b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.917+0000 7fab95df6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900afb10 con 0x7fab900b0b50 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.917+0000 7fab95df6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9006bb30 con 0x7fab9006c6b0 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.917+0000 7fab95df6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900b0070 con 0x7fab901449e0 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fab9006c6b0 0x7fab900b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fab9006c6b0 0x7fab900b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47146/0 (socket says 172.21.15.113:47146) 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8ffff640 1 -- 172.21.15.113:0/203682897 learned_addr learned my addr 172.21.15.113:0/203682897 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8f7fe640 1 --2- 172.21.15.113:0/203682897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab901449e0 0x7fab900af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8ffff640 1 -- 172.21.15.113:0/203682897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab901449e0 msgr2=0x7fab900af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:06.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8ffff640 1 --2- 172.21.15.113:0/203682897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab901449e0 0x7fab900af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8ffff640 1 -- 172.21.15.113:0/203682897 >> v1:172.21.15.151:6789/0 conn(0x7fab900b0b50 legacy=0x7fab9006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:06.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.918+0000 7fab8ffff640 1 -- 172.21.15.113:0/203682897 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900b0350 con 0x7fab9006c6b0 2023-12-19T13:48:06.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.919+0000 7fab8ffff640 1 --2- 172.21.15.113:0/203682897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab900b1710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab88009e50 tx=0x7fab8802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b35855a20b6edc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:06.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.920+0000 7fab8effd640 1 -- 172.21.15.113:0/203682897 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8802ca70 con 0x7fab9006c6b0 2023-12-19T13:48:06.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.920+0000 7fab8effd640 1 -- 172.21.15.113:0/203682897 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8802cbd0 con 0x7fab9006c6b0 2023-12-19T13:48:06.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.920+0000 7fab8effd640 1 -- 172.21.15.113:0/203682897 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab880343f0 con 0x7fab9006c6b0 2023-12-19T13:48:06.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.920+0000 7fab95df6640 1 -- 172.21.15.113:0/203682897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 msgr2=0x7fab900b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.920+0000 7fab95df6640 1 --2- 172.21.15.113:0/203682897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab900b1710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab88009e50 tx=0x7fab8802bed0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.921+0000 7fab95df6640 1 -- 172.21.15.113:0/203682897 shutdown_connections 2023-12-19T13:48:06.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.921+0000 7fab95df6640 1 --2- 172.21.15.113:0/203682897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab900b1710 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.921+0000 7fab95df6640 1 --2- 172.21.15.113:0/203682897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab901449e0 0x7fab900af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.921+0000 7fab95df6640 1 -- 172.21.15.113:0/203682897 >> 172.21.15.113:0/203682897 conn(0x7fab900cbb70 msgr2=0x7fab900cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:06.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.921+0000 7fab95df6640 1 -- 172.21.15.113:0/203682897 shutdown_connections 2023-12-19T13:48:06.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.921+0000 7fab95df6640 1 -- 172.21.15.113:0/203682897 wait complete. 2023-12-19T13:48:06.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.922+0000 7fab95df6640 1 Processor -- start 2023-12-19T13:48:06.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.923+0000 7fab95df6640 1 -- start start 2023-12-19T13:48:06.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.923+0000 7fab95df6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab90131840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.923+0000 7fab95df6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab900b0b50 0x7fab9015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab95df6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab901449e0 0x7fab9015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab95df6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab901313b0 con 0x7fab9006c6b0 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab95df6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90131d80 con 0x7fab901449e0 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab95df6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab901307a0 con 0x7fab900b0b50 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab90131840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab90131840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47154/0 (socket says 172.21.15.113:47154) 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 -- 172.21.15.113:0/1458620145 learned_addr learned my addr 172.21.15.113:0/1458620145 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:06.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab87fff640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab900b0b50 0x7fab9015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8ffff640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab901449e0 0x7fab9015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 -- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab900b0b50 msgr2=0x7fab9015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab900b0b50 0x7fab9015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 -- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab901449e0 msgr2=0x7fab9015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab901449e0 0x7fab9015bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab8f7fe640 1 -- 172.21.15.113:0/1458620145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88009b30 con 0x7fab9006c6b0 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.924+0000 7fab87fff640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab900b0b50 0x7fab9015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.925+0000 7fab8f7fe640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab90131840 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fab8000d5f0 tx=0x7fab8000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:06.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.925+0000 7fab8cff9640 1 -- 172.21.15.113:0/1458620145 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800125f0 con 0x7fab9006c6b0 2023-12-19T13:48:06.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.925+0000 7fab8cff9640 1 -- 172.21.15.113:0/1458620145 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab80012750 con 0x7fab9006c6b0 2023-12-19T13:48:06.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.925+0000 7fab8cff9640 1 -- 172.21.15.113:0/1458620145 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab80012b00 con 0x7fab9006c6b0 2023-12-19T13:48:06.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.925+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab90130a80 con 0x7fab9006c6b0 2023-12-19T13:48:06.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.925+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90131040 con 0x7fab9006c6b0 2023-12-19T13:48:06.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.926+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90061910 con 0x7fab9006c6b0 2023-12-19T13:48:06.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.927+0000 7fab8cff9640 1 -- 172.21.15.113:0/1458620145 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab80012c60 con 0x7fab9006c6b0 2023-12-19T13:48:06.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.928+0000 7fab8cff9640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fab7006a460 0x7fab7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:06.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.928+0000 7fab8cff9640 1 -- 172.21.15.113:0/1458620145 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab80088d60 con 0x7fab9006c6b0 2023-12-19T13:48:06.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.928+0000 7fab87fff640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fab7006a460 0x7fab7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:06.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.929+0000 7fab87fff640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fab7006a460 0x7fab7006c920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab90144260 tx=0x7fab78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:06.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:06.932+0000 7fab8cff9640 1 -- 172.21.15.113:0/1458620145 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fab80054350 con 0x7fab9006c6b0 2023-12-19T13:48:07.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.121+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab900cb750 con 0x7fab9006c6b0 2023-12-19T13:48:07.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.123+0000 7fab8cff9640 1 -- 172.21.15.113:0/1458620145 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fab80057970 con 0x7fab9006c6b0 2023-12-19T13:48:07.124 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:07.124 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":36,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:58.492769+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:07.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fab7006a460 msgr2=0x7fab7006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fab7006a460 0x7fab7006c920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab90144260 tx=0x7fab78009040 comp rx=0 tx=0).stop 2023-12-19T13:48:07.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 msgr2=0x7fab90131840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab90131840 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fab8000d5f0 tx=0x7fab8000dab0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 shutdown_connections 2023-12-19T13:48:07.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fab7006a460 0x7fab7006c920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab901449e0 0x7fab9015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab900b0b50 0x7fab9015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 --2- 172.21.15.113:0/1458620145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab9006c6b0 0x7fab90131840 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 >> 172.21.15.113:0/1458620145 conn(0x7fab900cbb70 msgr2=0x7fab9013e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:07.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 shutdown_connections 2023-12-19T13:48:07.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.126+0000 7fab95df6640 1 -- 172.21.15.113:0/1458620145 wait complete. 2023-12-19T13:48:07.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:47:42.574723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:47:43.788651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:48:07.145 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:48:07.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.350+0000 7fe8a6c70640 1 Processor -- start 2023-12-19T13:48:07.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.350+0000 7fe8a6c70640 1 -- start start 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe8a6c70640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 0x7fe8a015e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe8a6c70640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a015ea80 con 0x7fe8a006f530 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe8a6c70640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00b6730 con 0x7fe8a0147010 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe8a6c70640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a006f9c0 con 0x7fe8a00b8500 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe89ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe8a006f530 0x7fe8a00b7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:41986/0 (socket says 172.21.15.113:41986) 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe89ffff640 1 -- 172.21.15.113:0/836193839 learned_addr learned my addr 172.21.15.113:0/836193839 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe8a520d640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 0x7fe8a015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.352+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996238666 0 0) 0x7fe890001490 con 0x7fe8a006f530 2023-12-19T13:48:07.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe88c003520 con 0x7fe8a006f530 2023-12-19T13:48:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1400541966 0 0) 0x7fe88c003520 con 0x7fe8a006f530 2023-12-19T13:48:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 msgr2=0x7fe8a015e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 0x7fe8a015e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 >> v1:172.21.15.151:6789/0 conn(0x7fe8a0147010 legacy=0x7fe8a015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a006fca0 con 0x7fe8a006f530 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe890001b80 con 0x7fe8a006f530 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 >> v1:172.21.15.113:6789/0 conn(0x7fe8a006f530 legacy=0x7fe8a00b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 0x7fe88c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe88c003fe0 0x7fe88c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe88c004d00 0x7fe88c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a006f9c0 con 0x7fe88c003fe0 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c00bbc0 con 0x7fe88c004d00 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c00bd80 con 0x7fe8a00b8500 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.353+0000 7fe89ffff640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe88c003fe0 0x7fe88c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe8a520d640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe88c004d00 0x7fe88c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe89ffff640 1 -- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 msgr2=0x7fe88c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe8a4a0c640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 0x7fe88c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe89ffff640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 0x7fe88c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe89ffff640 1 -- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe88c004d00 msgr2=0x7fe88c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe89ffff640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe88c004d00 0x7fe88c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe89ffff640 1 -- 172.21.15.113:0/836193839 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c003520 con 0x7fe88c003fe0 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe8a520d640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe88c004d00 0x7fe88c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.354+0000 7fe8a4a0c640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8a00b8500 0x7fe88c003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.355+0000 7fe89ffff640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe88c003fe0 0x7fe88c0047c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe89000a730 tx=0x7fe88c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14137473c26a63e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.355+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900072d0 con 0x7fe88c003fe0 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.355+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89002f070 con 0x7fe88c003fe0 2023-12-19T13:48:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.355+0000 7fe89f7fe640 1 -- 172.21.15.113:0/836193839 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900076d0 con 0x7fe88c003fe0 2023-12-19T13:48:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.356+0000 7fe8a6c70640 1 -- 172.21.15.113:0/836193839 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe88c003fe0 msgr2=0x7fe88c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.356+0000 7fe8a6c70640 1 --2- 172.21.15.113:0/836193839 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe88c003fe0 0x7fe88c0047c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe89000a730 tx=0x7fe88c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.356+0000 7fe8a520d640 1 -- 172.21.15.113:0/836193839 reap_dead start 2023-12-19T13:48:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.356+0000 7fe8a6c70640 1 -- 172.21.15.113:0/836193839 shutdown_connections 2023-12-19T13:48:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.356+0000 7fe8a6c70640 1 -- 172.21.15.113:0/836193839 >> 172.21.15.113:0/836193839 conn(0x7fe8a00d3520 msgr2=0x7fe8a00d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.356+0000 7fe8a6c70640 1 -- 172.21.15.113:0/836193839 shutdown_connections 2023-12-19T13:48:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.356+0000 7fe8a6c70640 1 -- 172.21.15.113:0/836193839 wait complete. 2023-12-19T13:48:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.358+0000 7fe8a6c70640 1 Processor -- start 2023-12-19T13:48:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.358+0000 7fe8a6c70640 1 -- start start 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe8a6c70640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe88c003fe0 0x7fe8a00ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe8a6c70640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a00d10d0 0x7fe8a00d1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe8a6c70640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8a00cc8c0 0x7fe8a00ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe8a6c70640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00d1a90 con 0x7fe8a00d10d0 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe8a6c70640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0143410 con 0x7fe8a00cc8c0 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe8a6c70640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00cf410 con 0x7fe88c003fe0 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe89ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a00d10d0 0x7fe8a00d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe89ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a00d10d0 0x7fe8a00d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47184/0 (socket says 172.21.15.113:47184) 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe89ffff640 1 -- 172.21.15.113:0/1339785201 learned_addr learned my addr 172.21.15.113:0/1339785201 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe8a4a0c640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe88c003fe0 0x7fe8a00ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.359+0000 7fe89ffff640 1 -- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe88c003fe0 msgr2=0x7fe8a00ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89ffff640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe88c003fe0 0x7fe8a00ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89ffff640 1 -- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8a00cc8c0 msgr2=0x7fe8a00ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe8a520d640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8a00cc8c0 0x7fe8a00ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89ffff640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8a00cc8c0 0x7fe8a00ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89ffff640 1 -- 172.21.15.113:0/1339785201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0144700 con 0x7fe8a00d10d0 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89ffff640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a00d10d0 0x7fe8a00d1550 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe89002cb70 tx=0x7fe890001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89d7fa640 1 -- 172.21.15.113:0/1339785201 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890042070 con 0x7fe8a00d10d0 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89d7fa640 1 -- 172.21.15.113:0/1339785201 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe890004b60 con 0x7fe8a00d10d0 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe89d7fa640 1 -- 172.21.15.113:0/1339785201 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900070d0 con 0x7fe8a00d10d0 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a00cd280 con 0x7fe8a00d10d0 2023-12-19T13:48:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.360+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a0143940 con 0x7fe8a00d10d0 2023-12-19T13:48:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.361+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0061910 con 0x7fe8a00d10d0 2023-12-19T13:48:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.362+0000 7fe89d7fa640 1 -- 172.21.15.113:0/1339785201 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe890031030 con 0x7fe8a00d10d0 2023-12-19T13:48:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.363+0000 7fe89d7fa640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe88006a460 0x7fe88006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.363+0000 7fe89d7fa640 1 -- 172.21.15.113:0/1339785201 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8900a9d40 con 0x7fe8a00d10d0 2023-12-19T13:48:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.364+0000 7fe8a4a0c640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe88006a460 0x7fe88006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.364+0000 7fe8a4a0c640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe88006a460 0x7fe88006c920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe8880015f0 tx=0x7fe888009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.367+0000 7fe89d7fa640 1 -- 172.21.15.113:0/1339785201 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe890075320 con 0x7fe8a00d10d0 2023-12-19T13:48:07.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.560+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8a015ea80 con 0x7fe8a00d10d0 2023-12-19T13:48:07.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.561+0000 7fe89d7fa640 1 -- 172.21.15.113:0/1339785201 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8a015ea80 con 0x7fe8a00d10d0 2023-12-19T13:48:07.561 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:48:07.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe88006a460 msgr2=0x7fe88006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe88006a460 0x7fe88006c920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe8880015f0 tx=0x7fe888009040 comp rx=0 tx=0).stop 2023-12-19T13:48:07.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a00d10d0 msgr2=0x7fe8a00d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a00d10d0 0x7fe8a00d1550 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe89002cb70 tx=0x7fe890001e40 comp rx=0 tx=0).stop 2023-12-19T13:48:07.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 shutdown_connections 2023-12-19T13:48:07.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe88006a460 0x7fe88006c920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8a00cc8c0 0x7fe8a00ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a00d10d0 0x7fe8a00d1550 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 --2- 172.21.15.113:0/1339785201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe88c003fe0 0x7fe8a00ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.563+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 >> 172.21.15.113:0/1339785201 conn(0x7fe8a00d3520 msgr2=0x7fe8a00d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.564+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 shutdown_connections 2023-12-19T13:48:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.564+0000 7fe8a6c70640 1 -- 172.21.15.113:0/1339785201 wait complete. 2023-12-19T13:48:07.581 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:48:07.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.791+0000 7fbda1c95640 1 Processor -- start 2023-12-19T13:48:07.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.791+0000 7fbda1c95640 1 -- start start 2023-12-19T13:48:07.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.792+0000 7fbda1c95640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0b0a00 0x7fbd9c0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.792+0000 7fbda1c95640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c06b3a0 con 0x7fbd9c159e40 2023-12-19T13:48:07.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.792+0000 7fbda1c95640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c0b1860 con 0x7fbd9c0cd430 2023-12-19T13:48:07.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.792+0000 7fbda1c95640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9c0b23e0 con 0x7fbd9c0b0a00 2023-12-19T13:48:07.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.793+0000 7fbda0c93640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbd9c159e40 0x7fbd9c0b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42000/0 (socket says 172.21.15.113:42000) 2023-12-19T13:48:07.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.793+0000 7fbda0c93640 1 -- 172.21.15.113:0/676357201 learned_addr learned my addr 172.21.15.113:0/676357201 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:07.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.793+0000 7fbd9bfff640 1 --2- 172.21.15.113:0/676357201 >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0b0a00 0x7fbd9c0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.793+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527941927 0 0) 0x7fbd9c06b3a0 con 0x7fbd9c159e40 2023-12-19T13:48:07.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.793+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd8c005730 con 0x7fbd9c159e40 2023-12-19T13:48:07.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876988993 0 0) 0x7fbd8c005730 con 0x7fbd9c159e40 2023-12-19T13:48:07.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0b0a00 msgr2=0x7fbd9c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:07.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 --2- 172.21.15.113:0/676357201 >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0b0a00 0x7fbd9c0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 >> v1:172.21.15.151:6789/0 conn(0x7fbd9c0cd430 legacy=0x7fbd9c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0b1b40 con 0x7fbd9c159e40 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbd90001670 con 0x7fbd9c159e40 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 >> v1:172.21.15.113:6789/0 conn(0x7fbd9c159e40 legacy=0x7fbd9c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c005c40 0x7fbd8c006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0069d0 0x7fbd8c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0073e0 0x7fbd8c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0b23e0 con 0x7fbd8c005c40 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c00e2f0 con 0x7fbd8c0069d0 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c00e4b0 con 0x7fbd8c0073e0 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbda0c93640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c005c40 0x7fbd8c006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbda0c93640 1 -- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0073e0 msgr2=0x7fbd8c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbda1494640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0073e0 0x7fbd8c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.794+0000 7fbda0c93640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0073e0 0x7fbd8c00db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.795+0000 7fbda0c93640 1 -- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0069d0 msgr2=0x7fbd8c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:07.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.795+0000 7fbd9bfff640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0069d0 0x7fbd8c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.795+0000 7fbda0c93640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0069d0 0x7fbd8c006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.795+0000 7fbda1494640 1 -- 172.21.15.113:0/676357201 reap_dead start 2023-12-19T13:48:07.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.795+0000 7fbda0c93640 1 -- 172.21.15.113:0/676357201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c005730 con 0x7fbd8c005c40 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.796+0000 7fbda0c93640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c005c40 0x7fbd8c006060 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbd90001050 tx=0x7fbd8c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba4fff8ecb1dac4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.796+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90005ad0 con 0x7fbd8c005c40 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.796+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90005c30 con 0x7fbd8c005c40 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.796+0000 7fbd9b7fe640 1 -- 172.21.15.113:0/676357201 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9002c7c0 con 0x7fbd8c005c40 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.796+0000 7fbda1c95640 1 -- 172.21.15.113:0/676357201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c005c40 msgr2=0x7fbd8c006060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.796+0000 7fbda1c95640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c005c40 0x7fbd8c006060 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbd90001050 tx=0x7fbd8c007a00 comp rx=0 tx=0).stop 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.797+0000 7fbda1c95640 1 -- 172.21.15.113:0/676357201 shutdown_connections 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.797+0000 7fbda1c95640 1 --2- 172.21.15.113:0/676357201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c005c40 0x7fbd8c006060 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.797+0000 7fbda1c95640 1 -- 172.21.15.113:0/676357201 >> 172.21.15.113:0/676357201 conn(0x7fbd9c0659a0 msgr2=0x7fbd9c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:07.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.797+0000 7fbda1c95640 1 -- 172.21.15.113:0/676357201 shutdown_connections 2023-12-19T13:48:07.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.797+0000 7fbda1c95640 1 -- 172.21.15.113:0/676357201 wait complete. 2023-12-19T13:48:07.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.798+0000 7fbda1c95640 1 Processor -- start 2023-12-19T13:48:07.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.799+0000 7fbda1c95640 1 -- start start 2023-12-19T13:48:07.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.799+0000 7fbda1c95640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c005c40 0x7fbd9c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.799+0000 7fbda1c95640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c155830 0x7fbd9c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.799+0000 7fbda1c95640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0ad2c0 0x7fbd9c0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbda1c95640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0ae2d0 con 0x7fbd9c155830 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbda1c95640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c1561f0 con 0x7fbd9c0ad2c0 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbda1c95640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0adff0 con 0x7fbd8c005c40 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c155830 0x7fbd9c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c155830 0x7fbd9c155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47198/0 (socket says 172.21.15.113:47198) 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 -- 172.21.15.113:0/2152872203 learned_addr learned my addr 172.21.15.113:0/2152872203 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbda0c93640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c005c40 0x7fbd9c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbda1494640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0ad2c0 0x7fbd9c0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 -- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c005c40 msgr2=0x7fbd9c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c005c40 0x7fbd9c159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 -- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0ad2c0 msgr2=0x7fbd9c0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0ad2c0 0x7fbd9c0ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbd9bfff640 1 -- 172.21.15.113:0/2152872203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c143590 con 0x7fbd9c155830 2023-12-19T13:48:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbda0c93640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c005c40 0x7fbd9c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.800+0000 7fbda1494640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0ad2c0 0x7fbd9c0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.801+0000 7fbd9bfff640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c155830 0x7fbd9c155cb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbd88010810 tx=0x7fbd88010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.801+0000 7fbd997fa640 1 -- 172.21.15.113:0/2152872203 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88009630 con 0x7fbd9c155830 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.801+0000 7fbd997fa640 1 -- 172.21.15.113:0/2152872203 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8800eb60 con 0x7fbd9c155830 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.801+0000 7fbd997fa640 1 -- 172.21.15.113:0/2152872203 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88010ec0 con 0x7fbd9c155830 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.801+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c143870 con 0x7fbd9c155830 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.801+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c157680 con 0x7fbd9c155830 2023-12-19T13:48:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.802+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c1433f0 con 0x7fbd9c155830 2023-12-19T13:48:07.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.803+0000 7fbd997fa640 1 -- 172.21.15.113:0/2152872203 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd8801c400 con 0x7fbd9c155830 2023-12-19T13:48:07.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.804+0000 7fbd997fa640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd8006a430 0x7fbd8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:07.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.804+0000 7fbd997fa640 1 -- 172.21.15.113:0/2152872203 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd88088d90 con 0x7fbd9c155830 2023-12-19T13:48:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.804+0000 7fbda0c93640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd8006a430 0x7fbd8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.805+0000 7fbda0c93640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd8006a430 0x7fbd8006c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd90007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:07.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.808+0000 7fbd997fa640 1 -- 172.21.15.113:0/2152872203 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbd9c1433f0 con 0x7fbd9c155830 2023-12-19T13:48:07.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.997+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd9c1433f0 con 0x7fbd9c155830 2023-12-19T13:48:07.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:07.998+0000 7fbd997fa640 1 -- 172.21.15.113:0/2152872203 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd9c1433f0 con 0x7fbd9c155830 2023-12-19T13:48:07.998 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:48:08.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd8006a430 msgr2=0x7fbd8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd8006a430 0x7fbd8006c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd90007000 comp rx=0 tx=0).stop 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c155830 msgr2=0x7fbd9c155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c155830 0x7fbd9c155cb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbd88010810 tx=0x7fbd88010cd0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 shutdown_connections 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd8006a430 0x7fbd8006c8f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0ad2c0 0x7fbd9c0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c155830 0x7fbd9c155cb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 --2- 172.21.15.113:0/2152872203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c005c40 0x7fbd9c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 >> 172.21.15.113:0/2152872203 conn(0x7fbd9c0659a0 msgr2=0x7fbd9c06c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.000+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 shutdown_connections 2023-12-19T13:48:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.001+0000 7fbda1c95640 1 -- 172.21.15.113:0/2152872203 wait complete. 2023-12-19T13:48:08.019 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:48:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.235+0000 7f6da8277640 1 Processor -- start 2023-12-19T13:48:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.236+0000 7f6da8277640 1 -- start start 2023-12-19T13:48:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.237+0000 7f6da8277640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6da015b1d0 0x7f6da00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.237+0000 7f6da8277640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 0x7f6da015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.237+0000 7f6da8277640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da015ef10 con 0x7f6da00ceea0 2023-12-19T13:48:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.237+0000 7f6da8277640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da00b2320 con 0x7f6da015b1d0 2023-12-19T13:48:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.237+0000 7f6da8277640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00b2e40 con 0x7f6da00b1ec0 2023-12-19T13:48:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.238+0000 7f6da6814640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6da00ceea0 0x7f6da006c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57626/0 (socket says 172.21.15.113:57626) 2023-12-19T13:48:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.238+0000 7f6da6814640 1 -- 172.21.15.113:0/1965185927 learned_addr learned my addr 172.21.15.113:0/1965185927 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.238+0000 7f6da6013640 1 --2- 172.21.15.113:0/1965185927 >> v2:172.21.15.151:3300/0 conn(0x7f6da015b1d0 0x7f6da00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.238+0000 7f6da5812640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 0x7f6da015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.238+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896485842 0 0) 0x7f6da015ef10 con 0x7f6da00ceea0 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.238+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d8c003520 con 0x7f6da00ceea0 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308253691 0 0) 0x7f6d8c003520 con 0x7f6da00ceea0 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 msgr2=0x7f6da015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 0x7f6da015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 >> v2:172.21.15.151:3300/0 conn(0x7f6da015b1d0 msgr2=0x7f6da00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 --2- 172.21.15.113:0/1965185927 >> v2:172.21.15.151:3300/0 conn(0x7f6da015b1d0 0x7f6da00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da00b3120 con 0x7f6da00ceea0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6d980019f0 con 0x7f6da00ceea0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 >> v1:172.21.15.113:6789/0 conn(0x7f6da00ceea0 legacy=0x7f6da006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0039e0 0x7f6d8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d8c0047c0 0x7f6d8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 0x7f6d8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00b2320 con 0x7f6d8c0047c0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00b2e40 con 0x7f6d8c0039e0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c00b9b0 con 0x7f6da00b1ec0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5812640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d8c0047c0 0x7f6d8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da6814640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 0x7f6d8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da6013640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0039e0 0x7f6d8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5812640 1 -- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 msgr2=0x7f6d8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5812640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00b1ec0 0x7f6d8c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5812640 1 -- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0039e0 msgr2=0x7f6d8c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.239+0000 7f6da5812640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0039e0 0x7f6d8c003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.240+0000 7f6da5812640 1 -- 172.21.15.113:0/1965185927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c003520 con 0x7f6d8c0047c0 2023-12-19T13:48:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.241+0000 7f6da5812640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d8c0047c0 0x7f6d8c004c40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009ac0 tx=0x7f6d8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d85f5b3d574e470 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.241+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9002c6b0 con 0x7f6d8c0047c0 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.241+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9002c810 con 0x7f6d8c0047c0 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.241+0000 7f6da5011640 1 -- 172.21.15.113:0/1965185927 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9002cba0 con 0x7f6d8c0047c0 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.241+0000 7f6da8277640 1 -- 172.21.15.113:0/1965185927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d8c0047c0 msgr2=0x7f6d8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.241+0000 7f6da8277640 1 --2- 172.21.15.113:0/1965185927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d8c0047c0 0x7f6d8c004c40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009ac0 tx=0x7f6d8c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.241+0000 7f6da6814640 1 -- 172.21.15.113:0/1965185927 reap_dead start 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.242+0000 7f6da8277640 1 -- 172.21.15.113:0/1965185927 shutdown_connections 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.242+0000 7f6da8277640 1 -- 172.21.15.113:0/1965185927 >> 172.21.15.113:0/1965185927 conn(0x7f6da0073150 msgr2=0x7f6da00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.242+0000 7f6da8277640 1 -- 172.21.15.113:0/1965185927 shutdown_connections 2023-12-19T13:48:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.242+0000 7f6da8277640 1 -- 172.21.15.113:0/1965185927 wait complete. 2023-12-19T13:48:08.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.243+0000 7f6da8277640 1 Processor -- start 2023-12-19T13:48:08.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.244+0000 7f6da8277640 1 -- start start 2023-12-19T13:48:08.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.244+0000 7f6da8277640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0047c0 0x7f6da0156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.244+0000 7f6da8277640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6da00c52a0 0x7f6da00cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.244+0000 7f6da8277640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00c8d70 0x7f6da00c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.244+0000 7f6da8277640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00c9730 con 0x7f6da00c52a0 2023-12-19T13:48:08.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.244+0000 7f6da8277640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da01568c0 con 0x7f6d8c0047c0 2023-12-19T13:48:08.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.244+0000 7f6da8277640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00cb620 con 0x7f6da00c8d70 2023-12-19T13:48:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6da00c52a0 0x7f6da00cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6da00c52a0 0x7f6da00cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42002/0 (socket says 172.21.15.113:42002) 2023-12-19T13:48:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 -- 172.21.15.113:0/4220891014 learned_addr learned my addr 172.21.15.113:0/4220891014 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da6013640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0047c0 0x7f6da0156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 -- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00c8d70 msgr2=0x7f6da00c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da6814640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00c8d70 0x7f6da00c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00c8d70 0x7f6da00c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 -- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0047c0 msgr2=0x7f6da0156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0047c0 0x7f6da0156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da5812640 1 -- 172.21.15.113:0/4220891014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da00c4200 con 0x7f6da00c52a0 2023-12-19T13:48:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.245+0000 7f6da6013640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0047c0 0x7f6da0156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.246+0000 7f6da5812640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6da00c52a0 0x7f6da00cb0e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6d90037040 tx=0x7f6d90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.246+0000 7f6d96ffd640 1 -- 172.21.15.113:0/4220891014 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90003810 con 0x7f6da00c52a0 2023-12-19T13:48:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.246+0000 7f6d96ffd640 1 -- 172.21.15.113:0/4220891014 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90003970 con 0x7f6da00c52a0 2023-12-19T13:48:08.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.246+0000 7f6d96ffd640 1 -- 172.21.15.113:0/4220891014 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90003d00 con 0x7f6da00c52a0 2023-12-19T13:48:08.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.246+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da00c44e0 con 0x7f6da00c52a0 2023-12-19T13:48:08.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.246+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da00c4aa0 con 0x7f6da00c52a0 2023-12-19T13:48:08.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.247+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da0061910 con 0x7f6da00c52a0 2023-12-19T13:48:08.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.248+0000 7f6d96ffd640 1 -- 172.21.15.113:0/4220891014 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d90040450 con 0x7f6da00c52a0 2023-12-19T13:48:08.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.249+0000 7f6d96ffd640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d8406a430 0x7f6d8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.249+0000 7f6d96ffd640 1 -- 172.21.15.113:0/4220891014 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d900aa7e0 con 0x7f6da00c52a0 2023-12-19T13:48:08.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.249+0000 7f6da6013640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d8406a430 0x7f6d8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.250+0000 7f6da6013640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d8406a430 0x7f6d8406c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6da0157110 tx=0x7f6d9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:08.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.253+0000 7f6d96ffd640 1 -- 172.21.15.113:0/4220891014 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d90075dc0 con 0x7f6da00c52a0 2023-12-19T13:48:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.445+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6da00cdc90 con 0x7f6da00c52a0 2023-12-19T13:48:08.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.446+0000 7f6d96ffd640 1 -- 172.21.15.113:0/4220891014 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d900044e0 con 0x7f6da00c52a0 2023-12-19T13:48:08.447 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d8406a430 msgr2=0x7f6d8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d8406a430 0x7f6d8406c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6da0157110 tx=0x7f6d9c008040 comp rx=0 tx=0).stop 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6da00c52a0 msgr2=0x7f6da00cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6da00c52a0 0x7f6da00cb0e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6d90037040 tx=0x7f6d90004730 comp rx=0 tx=0).stop 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 shutdown_connections 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d8406a430 0x7f6d8406c8f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6da00c8d70 0x7f6da00c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6da00c52a0 0x7f6da00cb0e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 --2- 172.21.15.113:0/4220891014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d8c0047c0 0x7f6da0156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 >> 172.21.15.113:0/4220891014 conn(0x7f6da0073150 msgr2=0x7f6da015b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 shutdown_connections 2023-12-19T13:48:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.449+0000 7f6da8277640 1 -- 172.21.15.113:0/4220891014 wait complete. 2023-12-19T13:48:08.470 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:08.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.682+0000 7f8157edb640 1 Processor -- start 2023-12-19T13:48:08.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.682+0000 7f8157edb640 1 -- start start 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8157edb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f815015efa0 0x7f815015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8157edb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81500ce9d0 con 0x7f815015e7a0 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8157edb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81500ce6f0 con 0x7f81500d01b0 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8157edb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815015dcc0 con 0x7f815015efa0 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8155476640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f815015e7a0 0x7f81500cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57632/0 (socket says 172.21.15.113:57632) 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8155476640 1 -- 172.21.15.113:0/922207199 learned_addr learned my addr 172.21.15.113:0/922207199 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8156478640 1 --2- 172.21.15.113:0/922207199 >> v2:172.21.15.151:3300/0 conn(0x7f815015efa0 0x7f815015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330981529 0 0) 0x7f81500ce9d0 con 0x7f815015e7a0 2023-12-19T13:48:08.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.684+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f813c003520 con 0x7f815015e7a0 2023-12-19T13:48:08.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083169091 0 0) 0x7f813c003520 con 0x7f815015e7a0 2023-12-19T13:48:08.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 >> v2:172.21.15.151:3300/0 conn(0x7f815015efa0 msgr2=0x7f815015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 --2- 172.21.15.113:0/922207199 >> v2:172.21.15.151:3300/0 conn(0x7f815015efa0 0x7f815015f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 >> v1:172.21.15.151:6789/0 conn(0x7f81500d01b0 legacy=0x7f81500d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815015dfa0 con 0x7f815015e7a0 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8140001670 con 0x7f815015e7a0 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 >> v1:172.21.15.113:6789/0 conn(0x7f815015e7a0 legacy=0x7f81500cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c003a30 0x7f813c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f813c0047c0 0x7f813c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f813c0051d0 0x7f813c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815015dcc0 con 0x7f813c0051d0 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c00c100 con 0x7f813c0047c0 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c00c2c0 con 0x7f813c003a30 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.685+0000 7f8156478640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f813c0051d0 0x7f813c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.686+0000 7f8155c77640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c003a30 0x7f813c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.686+0000 7f8155476640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f813c0047c0 0x7f813c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.686+0000 7f8156478640 1 -- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c003a30 msgr2=0x7f813c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.686+0000 7f8156478640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c003a30 0x7f813c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.686+0000 7f8156478640 1 -- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f813c0047c0 msgr2=0x7f813c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.686+0000 7f8156478640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f813c0047c0 0x7f813c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.686+0000 7f8156478640 1 -- 172.21.15.113:0/922207199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c003520 con 0x7f813c0051d0 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.687+0000 7f8156478640 1 -- 172.21.15.113:0/922207199 reap_dead start 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.687+0000 7f8156478640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f813c0051d0 0x7f813c00b980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8148009fc0 tx=0x7f813c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef25e10d83548ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.687+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814802cc60 con 0x7f813c0051d0 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.687+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814800f040 con 0x7f813c0051d0 2023-12-19T13:48:08.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.687+0000 7f8154c75640 1 -- 172.21.15.113:0/922207199 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148003990 con 0x7f813c0051d0 2023-12-19T13:48:08.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.688+0000 7f8157edb640 1 -- 172.21.15.113:0/922207199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f813c0051d0 msgr2=0x7f813c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.688+0000 7f8157edb640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f813c0051d0 0x7f813c00b980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8148009fc0 tx=0x7f813c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.688+0000 7f8157edb640 1 -- 172.21.15.113:0/922207199 shutdown_connections 2023-12-19T13:48:08.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.688+0000 7f8157edb640 1 --2- 172.21.15.113:0/922207199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f813c0051d0 0x7f813c00b980 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.688+0000 7f8157edb640 1 -- 172.21.15.113:0/922207199 >> 172.21.15.113:0/922207199 conn(0x7f81500b27a0 msgr2=0x7f81500b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:08.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.688+0000 7f8157edb640 1 -- 172.21.15.113:0/922207199 shutdown_connections 2023-12-19T13:48:08.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.688+0000 7f8157edb640 1 -- 172.21.15.113:0/922207199 wait complete. 2023-12-19T13:48:08.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.690+0000 7f8157edb640 1 Processor -- start 2023-12-19T13:48:08.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.690+0000 7f8157edb640 1 -- start start 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8157edb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c0051d0 0x7f8150149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8157edb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81501f3560 0x7f81501554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8157edb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81501f39e0 0x7f8150155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8157edb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500b7200 con 0x7f81501f39e0 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8157edb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81501498a0 con 0x7f81501f3560 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8157edb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81501526c0 con 0x7f813c0051d0 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81501f39e0 0x7f8150155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81501f39e0 0x7f8150155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42012/0 (socket says 172.21.15.113:42012) 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 -- 172.21.15.113:0/2523123431 learned_addr learned my addr 172.21.15.113:0/2523123431 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8155c77640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c0051d0 0x7f8150149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8155476640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81501f3560 0x7f81501554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 -- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c0051d0 msgr2=0x7f8150149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c0051d0 0x7f8150149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 -- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81501f3560 msgr2=0x7f81501554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81501f3560 0x7f81501554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.691+0000 7f8156478640 1 -- 172.21.15.113:0/2523123431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500b7410 con 0x7f81501f39e0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.692+0000 7f8156478640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81501f39e0 0x7f8150155a00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f814802c6d0 tx=0x7f8148009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.692+0000 7f81467fc640 1 -- 172.21.15.113:0/2523123431 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148003da0 con 0x7f81501f39e0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.692+0000 7f81467fc640 1 -- 172.21.15.113:0/2523123431 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148035950 con 0x7f81501f39e0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.692+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81500b76f0 con 0x7f81501f39e0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.692+0000 7f81467fc640 1 -- 172.21.15.113:0/2523123431 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148035d40 con 0x7f81501f39e0 2023-12-19T13:48:08.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.692+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81500b7cb0 con 0x7f81501f39e0 2023-12-19T13:48:08.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.693+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81500d0fb0 con 0x7f81501f39e0 2023-12-19T13:48:08.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.694+0000 7f81467fc640 1 -- 172.21.15.113:0/2523123431 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8148004030 con 0x7f81501f39e0 2023-12-19T13:48:08.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.695+0000 7f81467fc640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f813406a430 0x7f813406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:08.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.695+0000 7f81467fc640 1 -- 172.21.15.113:0/2523123431 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81480ab6d0 con 0x7f81501f39e0 2023-12-19T13:48:08.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.695+0000 7f8155c77640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f813406a430 0x7f813406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:08.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.696+0000 7f8155c77640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f813406a430 0x7f813406c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f814c005490 tx=0x7f814c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:08.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.700+0000 7f81467fc640 1 -- 172.21.15.113:0/2523123431 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8148076d40 con 0x7f81501f39e0 2023-12-19T13:48:08.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.930+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8150061910 con 0x7f81501f39e0 2023-12-19T13:48:08.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.931+0000 7f81467fc640 1 -- 172.21.15.113:0/2523123431 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f814807a360 con 0x7f81501f39e0 2023-12-19T13:48:08.932 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:08.932 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:48:08.932 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:48:08.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f813406a430 msgr2=0x7f813406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f813406a430 0x7f813406c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f814c005490 tx=0x7f814c009040 comp rx=0 tx=0).stop 2023-12-19T13:48:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81501f39e0 msgr2=0x7f8150155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81501f39e0 0x7f8150155a00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f814802c6d0 tx=0x7f8148009750 comp rx=0 tx=0).stop 2023-12-19T13:48:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 shutdown_connections 2023-12-19T13:48:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f813406a430 0x7f813406c8f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81501f39e0 0x7f8150155a00 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81501f3560 0x7f81501554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 --2- 172.21.15.113:0/2523123431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f813c0051d0 0x7f8150149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:08.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 >> 172.21.15.113:0/2523123431 conn(0x7f81500b27a0 msgr2=0x7f8150070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:08.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 shutdown_connections 2023-12-19T13:48:08.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:08.934+0000 7f8157edb640 1 -- 172.21.15.113:0/2523123431 wait complete. 2023-12-19T13:48:08.954 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:09.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.147+0000 7f80602db640 1 Processor -- start 2023-12-19T13:48:09.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.147+0000 7f80602db640 1 -- start start 2023-12-19T13:48:09.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.149+0000 7f80602db640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f805815d490 0x7f8058070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.149+0000 7f80602db640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f805815d870 0x7f8058071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.149+0000 7f80602db640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8058071740 con 0x7f805806f160 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.149+0000 7f80602db640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805806ce20 con 0x7f805815d870 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.149+0000 7f80602db640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805806f690 con 0x7f805815d490 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805d876640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f805815d870 0x7f8058071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805d876640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f805815d870 0x7f8058071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42026/0 (socket says 172.21.15.113:42026) 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805d876640 1 -- 172.21.15.113:0/4045316676 learned_addr learned my addr 172.21.15.113:0/4045316676 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805e077640 1 --2- 172.21.15.113:0/4045316676 >> v2:172.21.15.151:3300/0 conn(0x7f805815d490 0x7f8058070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805d876640 1 -- 172.21.15.113:0/4045316676 >> v2:172.21.15.151:3300/0 conn(0x7f805815d490 msgr2=0x7f8058070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805d876640 1 --2- 172.21.15.113:0/4045316676 >> v2:172.21.15.151:3300/0 conn(0x7f805815d490 0x7f8058070cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805d876640 1 -- 172.21.15.113:0/4045316676 >> v1:172.21.15.151:6789/0 conn(0x7f805806f160 legacy=0x7f8058161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:09.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.150+0000 7f805d876640 1 -- 172.21.15.113:0/4045316676 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580ad5a0 con 0x7f805815d870 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.151+0000 7f805d876640 1 --2- 172.21.15.113:0/4045316676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f8058071200 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f80580b1b60 tx=0x7f804802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6696d9a4d8fc4be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.151+0000 7f805d075640 1 -- 172.21.15.113:0/4045316676 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80480317e0 con 0x7f805815d870 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.151+0000 7f805d075640 1 -- 172.21.15.113:0/4045316676 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8048031940 con 0x7f805815d870 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.151+0000 7f805d075640 1 -- 172.21.15.113:0/4045316676 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048031cd0 con 0x7f805815d870 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 -- 172.21.15.113:0/4045316676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 msgr2=0x7f8058071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 --2- 172.21.15.113:0/4045316676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f8058071200 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f80580b1b60 tx=0x7f804802b880 comp rx=0 tx=0).stop 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 -- 172.21.15.113:0/4045316676 shutdown_connections 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 --2- 172.21.15.113:0/4045316676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f8058071200 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 --2- 172.21.15.113:0/4045316676 >> v2:172.21.15.151:3300/0 conn(0x7f805815d490 0x7f8058070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 -- 172.21.15.113:0/4045316676 >> 172.21.15.113:0/4045316676 conn(0x7f80580b11d0 msgr2=0x7f80580cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:09.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 -- 172.21.15.113:0/4045316676 shutdown_connections 2023-12-19T13:48:09.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.152+0000 7f80602db640 1 -- 172.21.15.113:0/4045316676 wait complete. 2023-12-19T13:48:09.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.154+0000 7f80602db640 1 Processor -- start 2023-12-19T13:48:09.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.154+0000 7f80602db640 1 -- start start 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f80602db640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f805806f160 0x7f80581598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f80602db640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f805815d490 0x7f805815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f80602db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f80581601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f80602db640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8058152d00 con 0x7f805815d870 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f80602db640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805815f350 con 0x7f805815d490 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f80602db640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8058159e10 con 0x7f805806f160 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f805e878640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f80581601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f805e878640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f80581601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42030/0 (socket says 172.21.15.113:42030) 2023-12-19T13:48:09.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.155+0000 7f805e878640 1 -- 172.21.15.113:0/2850783577 learned_addr learned my addr 172.21.15.113:0/2850783577 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f805e077640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f805806f160 0x7f80581598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f805e878640 1 -- 172.21.15.113:0/2850783577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f805806f160 msgr2=0x7f80581598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f805e878640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f805806f160 0x7f80581598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f805e878640 1 -- 172.21.15.113:0/2850783577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f805815d490 msgr2=0x7f805815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f805e878640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f805815d490 0x7f805815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f805e878640 1 -- 172.21.15.113:0/2850783577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480094d0 con 0x7f805815d870 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f805e878640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f80581601d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f805000c780 tx=0x7f805000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f804effd640 1 -- 172.21.15.113:0/2850783577 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050003d80 con 0x7f805815d870 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f804effd640 1 -- 172.21.15.113:0/2850783577 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805000ce30 con 0x7f805815d870 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805815e740 con 0x7f805815d870 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f804effd640 1 -- 172.21.15.113:0/2850783577 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050005290 con 0x7f805815d870 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.156+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805815ed00 con 0x7f805815d870 2023-12-19T13:48:09.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.157+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8058074770 con 0x7f805815d870 2023-12-19T13:48:09.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.159+0000 7f804effd640 1 -- 172.21.15.113:0/2850783577 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80500053f0 con 0x7f805815d870 2023-12-19T13:48:09.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.159+0000 7f804effd640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f803c06a430 0x7f803c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.160+0000 7f804effd640 1 -- 172.21.15.113:0/2850783577 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80500881e0 con 0x7f805815d870 2023-12-19T13:48:09.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.160+0000 7f805e077640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f803c06a430 0x7f803c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.160+0000 7f805e077640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f803c06a430 0x7f803c06c8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8054006fd0 tx=0x7f8054008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:09.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.164+0000 7f804effd640 1 -- 172.21.15.113:0/2850783577 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8050053770 con 0x7f805815d870 2023-12-19T13:48:09.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.359+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8058061910 con 0x7f805815d870 2023-12-19T13:48:09.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.362+0000 7f804effd640 1 -- 172.21.15.113:0/2850783577 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f8050056d90 con 0x7f805815d870 2023-12-19T13:48:09.363 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:09.363 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":36,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:58.492769+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:09.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f803c06a430 msgr2=0x7f803c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f803c06a430 0x7f803c06c8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8054006fd0 tx=0x7f8054008040 comp rx=0 tx=0).stop 2023-12-19T13:48:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 msgr2=0x7f80581601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f80581601d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f805000c780 tx=0x7f805000cc40 comp rx=0 tx=0).stop 2023-12-19T13:48:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 shutdown_connections 2023-12-19T13:48:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f803c06a430 0x7f803c06c8f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f805815d870 0x7f80581601d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f805815d490 0x7f805815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 --2- 172.21.15.113:0/2850783577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f805806f160 0x7f80581598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 >> 172.21.15.113:0/2850783577 conn(0x7f80580b11d0 msgr2=0x7f80580cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:09.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 shutdown_connections 2023-12-19T13:48:09.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.365+0000 7f80602db640 1 -- 172.21.15.113:0/2850783577 wait complete. 2023-12-19T13:48:09.384 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:48:09.384 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:09.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.592+0000 7f1dfbdc9640 1 Processor -- start 2023-12-19T13:48:09.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.592+0000 7f1dfbdc9640 1 -- start start 2023-12-19T13:48:09.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.593+0000 7f1dfbdc9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1df40ae110 0x7f1df40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1dfbdc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df40b0640 0x7f1df406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1dfbdc9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df40ae640 con 0x7f1df4157bf0 2023-12-19T13:48:09.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1dfbdc9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df406b8c0 con 0x7f1df40ae110 2023-12-19T13:48:09.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1dfbdc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40b0ab0 con 0x7f1df40b0640 2023-12-19T13:48:09.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1df9b65640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1df4157bf0 0x7f1df415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57636/0 (socket says 172.21.15.113:57636) 2023-12-19T13:48:09.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1df9b65640 1 -- 172.21.15.113:0/498359065 learned_addr learned my addr 172.21.15.113:0/498359065 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:09.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1df9364640 1 --2- 172.21.15.113:0/498359065 >> v2:172.21.15.151:3300/0 conn(0x7f1df40ae110 0x7f1df40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138328970 0 0) 0x7f1df40ae640 con 0x7f1df4157bf0 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1dfa366640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df40b0640 0x7f1df406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.594+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de0003520 con 0x7f1df4157bf0 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393408040 0 0) 0x7f1de0003520 con 0x7f1df4157bf0 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df40b0640 msgr2=0x7f1df406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df40b0640 0x7f1df406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 >> v2:172.21.15.151:3300/0 conn(0x7f1df40ae110 msgr2=0x7f1df40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 --2- 172.21.15.113:0/498359065 >> v2:172.21.15.151:3300/0 conn(0x7f1df40ae110 0x7f1df40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40ae920 con 0x7f1df4157bf0 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1df0001690 con 0x7f1df4157bf0 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 >> v1:172.21.15.113:6789/0 conn(0x7f1df4157bf0 legacy=0x7f1df415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de0003a10 0x7f1de0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00047c0 0x7f1de0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de0005180 0x7f1de000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df406b8c0 con 0x7f1de00047c0 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40b0ab0 con 0x7f1de0003a10 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de000c050 con 0x7f1de0005180 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1dfa366640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df40b0640 0x7f1df406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df9364640 1 --2- 172.21.15.113:0/498359065 >> v2:172.21.15.151:3300/0 conn(0x7f1df40ae110 0x7f1df40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df9364640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00047c0 0x7f1de0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.595+0000 7f1df9b65640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de0003a10 0x7f1de0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.596+0000 7f1dfa366640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de0005180 0x7f1de000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.596+0000 7f1df9364640 1 -- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de0005180 msgr2=0x7f1de000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.596+0000 7f1df9364640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de0005180 0x7f1de000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.596+0000 7f1df9364640 1 -- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de0003a10 msgr2=0x7f1de0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:09.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.596+0000 7f1df9364640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de0003a10 0x7f1de0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.596+0000 7f1df9364640 1 -- 172.21.15.113:0/498359065 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0003520 con 0x7f1de00047c0 2023-12-19T13:48:09.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.597+0000 7f1df9364640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00047c0 0x7f1de0004c40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1de80098d0 tx=0x7f1de00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5bf0047467131c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:09.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.597+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8030680 con 0x7f1de00047c0 2023-12-19T13:48:09.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.597+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de80307e0 con 0x7f1de00047c0 2023-12-19T13:48:09.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.597+0000 7f1df8b63640 1 -- 172.21.15.113:0/498359065 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8030b50 con 0x7f1de00047c0 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.598+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/498359065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00047c0 msgr2=0x7f1de0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.598+0000 7f1dfbdc9640 1 --2- 172.21.15.113:0/498359065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00047c0 0x7f1de0004c40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1de80098d0 tx=0x7f1de00057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.598+0000 7f1dfa366640 1 -- 172.21.15.113:0/498359065 reap_dead start 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.598+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/498359065 shutdown_connections 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.598+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/498359065 >> 172.21.15.113:0/498359065 conn(0x7f1df40cbb70 msgr2=0x7f1df40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.598+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/498359065 shutdown_connections 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.598+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/498359065 wait complete. 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.599+0000 7f1dfbdc9640 1 Processor -- start 2023-12-19T13:48:09.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.600+0000 7f1dfbdc9640 1 -- start start 2023-12-19T13:48:09.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfbdc9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00047c0 0x7f1df413bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfbdc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df406e3a0 0x7f1df414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfbdc9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1df4155a10 0x7f1df4155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfbdc9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4156400 con 0x7f1df4155a10 2023-12-19T13:48:09.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfbdc9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df41ee900 con 0x7f1de00047c0 2023-12-19T13:48:09.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfbdc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df41eeb80 con 0x7f1df406e3a0 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1df4155a10 0x7f1df4155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1df4155a10 0x7f1df4155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42048/0 (socket says 172.21.15.113:42048) 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 -- 172.21.15.113:0/2935459528 learned_addr learned my addr 172.21.15.113:0/2935459528 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1df9b65640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00047c0 0x7f1df413bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 -- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df406e3a0 msgr2=0x7f1df414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1df9364640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df406e3a0 0x7f1df414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df406e3a0 0x7f1df414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 -- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00047c0 msgr2=0x7f1df413bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00047c0 0x7f1df413bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1dfa366640 1 -- 172.21.15.113:0/2935459528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df41eee60 con 0x7f1df4155a10 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.601+0000 7f1df9364640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df406e3a0 0x7f1df414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:09.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.602+0000 7f1dfa366640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1df4155a10 0x7f1df4155ec0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1df415dcd0 tx=0x7f1dec004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:09.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.602+0000 7f1de67fc640 1 -- 172.21.15.113:0/2935459528 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec007cb0 con 0x7f1df4155a10 2023-12-19T13:48:09.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.602+0000 7f1de67fc640 1 -- 172.21.15.113:0/2935459528 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec007e50 con 0x7f1df4155a10 2023-12-19T13:48:09.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.602+0000 7f1de67fc640 1 -- 172.21.15.113:0/2935459528 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec014640 con 0x7f1df4155a10 2023-12-19T13:48:09.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.602+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df41ef140 con 0x7f1df4155a10 2023-12-19T13:48:09.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.602+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df41ef700 con 0x7f1df4155a10 2023-12-19T13:48:09.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.603+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df41ef8f0 con 0x7f1df4155a10 2023-12-19T13:48:09.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.604+0000 7f1de67fc640 1 -- 172.21.15.113:0/2935459528 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1dec0147a0 con 0x7f1df4155a10 2023-12-19T13:48:09.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.605+0000 7f1de67fc640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1dd806a450 0x7f1dd806c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:09.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.605+0000 7f1de67fc640 1 -- 172.21.15.113:0/2935459528 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dec0884f0 con 0x7f1df4155a10 2023-12-19T13:48:09.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.605+0000 7f1df9b65640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1dd806a450 0x7f1dd806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:09.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.606+0000 7f1df9b65640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1dd806a450 0x7f1dd806c910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1df0001050 tx=0x7f1df0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:09.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.609+0000 7f1de67fc640 1 -- 172.21.15.113:0/2935459528 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1dec053b80 con 0x7f1df4155a10 2023-12-19T13:48:09.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.833+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1df4061910 con 0x7f1df4155a10 2023-12-19T13:48:09.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.834+0000 7f1de67fc640 1 -- 172.21.15.113:0/2935459528 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f1dec0571a0 con 0x7f1df4155a10 2023-12-19T13:48:09.834 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:09.835 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:48:09.835 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1dd806a450 msgr2=0x7f1dd806c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1dd806a450 0x7f1dd806c910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1df0001050 tx=0x7f1df0009040 comp rx=0 tx=0).stop 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1df4155a10 msgr2=0x7f1df4155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1df4155a10 0x7f1df4155ec0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1df415dcd0 tx=0x7f1dec004840 comp rx=0 tx=0).stop 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 shutdown_connections 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1dd806a450 0x7f1dd806c910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1df4155a10 0x7f1df4155ec0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df406e3a0 0x7f1df414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 --2- 172.21.15.113:0/2935459528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00047c0 0x7f1df413bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 >> 172.21.15.113:0/2935459528 conn(0x7f1df40cbb70 msgr2=0x7f1df40b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.836+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 shutdown_connections 2023-12-19T13:48:09.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:09.837+0000 7f1dfbdc9640 1 -- 172.21.15.113:0/2935459528 wait complete. 2023-12-19T13:48:09.857 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:10.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.069+0000 7fa1f18c4640 1 Processor -- start 2023-12-19T13:48:10.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.069+0000 7fa1f18c4640 1 -- start start 2023-12-19T13:48:10.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1f18c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1f18c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1ec0ae110 0x7fa1ec0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1f18c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ec0b0a90 con 0x7fa1ec0b0640 2023-12-19T13:48:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1f18c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ec06b8c0 con 0x7fa1ec0ae110 2023-12-19T13:48:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1f18c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec15b740 con 0x7fa1ec157bf0 2023-12-19T13:48:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1ea7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1ec0ae110 0x7fa1ec0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1ea7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1ec0ae110 0x7fa1ec0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42052/0 (socket says 172.21.15.113:42052) 2023-12-19T13:48:10.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1ea7fc640 1 -- 172.21.15.113:0/3036875859 learned_addr learned my addr 172.21.15.113:0/3036875859 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.071+0000 7fa1eaffd640 1 --2- 172.21.15.113:0/3036875859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.072+0000 7fa1ea7fc640 1 -- 172.21.15.113:0/3036875859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 msgr2=0x7fa1ec15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.072+0000 7fa1ea7fc640 1 --2- 172.21.15.113:0/3036875859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.072+0000 7fa1ea7fc640 1 -- 172.21.15.113:0/3036875859 >> v1:172.21.15.151:6789/0 conn(0x7fa1ec0b0640 legacy=0x7fa1ec15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.072+0000 7fa1ea7fc640 1 -- 172.21.15.113:0/3036875859 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec0ae640 con 0x7fa1ec0ae110 2023-12-19T13:48:10.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.073+0000 7fa1ea7fc640 1 --2- 172.21.15.113:0/3036875859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0b0100 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f98bb11aa0546a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.073+0000 7fa1e9ffb640 1 -- 172.21.15.113:0/3036875859 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0031640 con 0x7fa1ec0ae110 2023-12-19T13:48:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.073+0000 7fa1e9ffb640 1 -- 172.21.15.113:0/3036875859 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e00317a0 con 0x7fa1ec0ae110 2023-12-19T13:48:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.073+0000 7fa1e9ffb640 1 -- 172.21.15.113:0/3036875859 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0031b30 con 0x7fa1ec0ae110 2023-12-19T13:48:10.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 -- 172.21.15.113:0/3036875859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 msgr2=0x7fa1ec0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/3036875859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0b0100 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 -- 172.21.15.113:0/3036875859 shutdown_connections 2023-12-19T13:48:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/3036875859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0b0100 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/3036875859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 -- 172.21.15.113:0/3036875859 >> 172.21.15.113:0/3036875859 conn(0x7fa1ec0cbb70 msgr2=0x7fa1ec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 -- 172.21.15.113:0/3036875859 shutdown_connections 2023-12-19T13:48:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.074+0000 7fa1f18c4640 1 -- 172.21.15.113:0/3036875859 wait complete. 2023-12-19T13:48:10.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.076+0000 7fa1f18c4640 1 Processor -- start 2023-12-19T13:48:10.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.076+0000 7fa1f18c4640 1 -- start start 2023-12-19T13:48:10.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1f18c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1f18c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec0b0640 0x7fa1ec155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1f18c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1f18c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec1562f0 con 0x7fa1ec0ae110 2023-12-19T13:48:10.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1f18c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0a8620 con 0x7fa1ec0b0640 2023-12-19T13:48:10.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1f18c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec1f1b10 con 0x7fa1ec157bf0 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1eaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1eaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0a90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42066/0 (socket says 172.21.15.113:42066) 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.077+0000 7fa1eaffd640 1 -- 172.21.15.113:0/751533540 learned_addr learned my addr 172.21.15.113:0/751533540 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1eb7fe640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1eaffd640 1 -- 172.21.15.113:0/751533540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 msgr2=0x7fa1ec15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1eaffd640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1eaffd640 1 -- 172.21.15.113:0/751533540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec0b0640 msgr2=0x7fa1ec155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1eaffd640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec0b0640 0x7fa1ec155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1eaffd640 1 -- 172.21.15.113:0/751533540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00094d0 con 0x7fa1ec0ae110 2023-12-19T13:48:10.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1eaffd640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0a90e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c7f0 tx=0x7fa1dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:10.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1d3fff640 1 -- 172.21.15.113:0/751533540 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc004220 con 0x7fa1ec0ae110 2023-12-19T13:48:10.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1d3fff640 1 -- 172.21.15.113:0/751533540 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc004380 con 0x7fa1ec0ae110 2023-12-19T13:48:10.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1d3fff640 1 -- 172.21.15.113:0/751533540 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc007840 con 0x7fa1ec0ae110 2023-12-19T13:48:10.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ec0a88e0 con 0x7fa1ec0ae110 2023-12-19T13:48:10.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.078+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec15c6b0 con 0x7fa1ec0ae110 2023-12-19T13:48:10.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.080+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ec0a8e00 con 0x7fa1ec0ae110 2023-12-19T13:48:10.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.080+0000 7fa1d3fff640 1 -- 172.21.15.113:0/751533540 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1dc007bb0 con 0x7fa1ec0ae110 2023-12-19T13:48:10.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.082+0000 7fa1d3fff640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1d806a460 0x7fa1d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.082+0000 7fa1d3fff640 1 -- 172.21.15.113:0/751533540 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1dc088860 con 0x7fa1ec0ae110 2023-12-19T13:48:10.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.082+0000 7fa1ea7fc640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1d806a460 0x7fa1d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.083+0000 7fa1ea7fc640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1d806a460 0x7fa1d806c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0036000 tx=0x7fa1e0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:10.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.087+0000 7fa1d3fff640 1 -- 172.21.15.113:0/751533540 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1ec0a8e00 con 0x7fa1ec0ae110 2023-12-19T13:48:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.311+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1ec0a8e00 con 0x7fa1ec0ae110 2023-12-19T13:48:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.312+0000 7fa1d3fff640 1 -- 172.21.15.113:0/751533540 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4660 (secure 0 0 0) 0x7fa1ec0a8e00 con 0x7fa1ec0ae110 2023-12-19T13:48:10.313 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:10.313 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:47:44.765620+0000","modified":"2023-12-19T13:47:47.785446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/2023707761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2023707761},{"type":"v1","addr":"172.21.15.151:6835","nonce":2023707761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:48:10.313 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1d806a460 msgr2=0x7fa1d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1d806a460 0x7fa1d806c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0036000 tx=0x7fa1e0030000 comp rx=0 tx=0).stop 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 msgr2=0x7fa1ec0a90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0a90e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c7f0 tx=0x7fa1dc00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 shutdown_connections 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa1d806a460 0x7fa1d806c920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1ec157bf0 0x7fa1ec15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec0b0640 0x7fa1ec155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 --2- 172.21.15.113:0/751533540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1ec0ae110 0x7fa1ec0a90e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 >> 172.21.15.113:0/751533540 conn(0x7fa1ec0cbb70 msgr2=0x7fa1ec0b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:10.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 shutdown_connections 2023-12-19T13:48:10.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.314+0000 7fa1f18c4640 1 -- 172.21.15.113:0/751533540 wait complete. 2023-12-19T13:48:10.334 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:10.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.537+0000 7f5458f88640 1 Processor -- start 2023-12-19T13:48:10.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.537+0000 7f5458f88640 1 -- start start 2023-12-19T13:48:10.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.539+0000 7f5458f88640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f545415da30 0x7f54540b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.539+0000 7f5458f88640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545415e1a0 con 0x7f5454161020 2023-12-19T13:48:10.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.539+0000 7f5458f88640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545415e480 con 0x7f54540b6900 2023-12-19T13:48:10.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.539+0000 7f5458f88640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545415e760 con 0x7f545415da30 2023-12-19T13:48:10.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.539+0000 7f545259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5454161020 0x7f5454143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57650/0 (socket says 172.21.15.113:57650) 2023-12-19T13:48:10.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.539+0000 7f545259c640 1 -- 172.21.15.113:0/1889494888 learned_addr learned my addr 172.21.15.113:0/1889494888 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:10.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.539+0000 7f5451d9b640 1 --2- 172.21.15.113:0/1889494888 >> v2:172.21.15.113:3300/0 conn(0x7f545415da30 0x7f54540b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.540+0000 7f545159a640 1 -- 172.21.15.113:0/1889494888 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764523103 0 0) 0x7f545415e1a0 con 0x7f5454161020 2023-12-19T13:48:10.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.540+0000 7f5451d9b640 1 -- 172.21.15.113:0/1889494888 >> v1:172.21.15.151:6789/0 conn(0x7f54540b6900 legacy=0x7f54540b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:10.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.540+0000 7f5451d9b640 1 -- 172.21.15.113:0/1889494888 >> v1:172.21.15.113:6789/0 conn(0x7f5454161020 legacy=0x7f5454143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.540+0000 7f5451d9b640 1 -- 172.21.15.113:0/1889494888 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454142d10 con 0x7f545415da30 2023-12-19T13:48:10.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.541+0000 7f5451d9b640 1 --2- 172.21.15.113:0/1889494888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f545415da30 0x7f54540b63c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f543c009d90 tx=0x7f543c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278ce843899659e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:10.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.541+0000 7f545159a640 1 -- 172.21.15.113:0/1889494888 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c02cc60 con 0x7f545415da30 2023-12-19T13:48:10.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.541+0000 7f545159a640 1 -- 172.21.15.113:0/1889494888 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c02cdc0 con 0x7f545415da30 2023-12-19T13:48:10.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.541+0000 7f545159a640 1 -- 172.21.15.113:0/1889494888 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c034660 con 0x7f545415da30 2023-12-19T13:48:10.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.542+0000 7f5458f88640 1 -- 172.21.15.113:0/1889494888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f545415da30 msgr2=0x7f54540b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.542+0000 7f5458f88640 1 --2- 172.21.15.113:0/1889494888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f545415da30 0x7f54540b63c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f543c009d90 tx=0x7f543c02beb0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.542+0000 7f5458f88640 1 -- 172.21.15.113:0/1889494888 shutdown_connections 2023-12-19T13:48:10.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.542+0000 7f5458f88640 1 --2- 172.21.15.113:0/1889494888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f545415da30 0x7f54540b63c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.542+0000 7f5458f88640 1 -- 172.21.15.113:0/1889494888 >> 172.21.15.113:0/1889494888 conn(0x7f54540b26f0 msgr2=0x7f54540b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:10.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.542+0000 7f5458f88640 1 -- 172.21.15.113:0/1889494888 shutdown_connections 2023-12-19T13:48:10.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.542+0000 7f5458f88640 1 -- 172.21.15.113:0/1889494888 wait complete. 2023-12-19T13:48:10.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.544+0000 7f5458f88640 1 Processor -- start 2023-12-19T13:48:10.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.545+0000 7f5458f88640 1 -- start start 2023-12-19T13:48:10.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5458f88640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54540b6900 0x7f5454153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5458f88640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f545415da30 0x7f5454158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5458f88640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5454161020 0x7f545415ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5458f88640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5454155d20 con 0x7f5454161020 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5458f88640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5454155fc0 con 0x7f54540b6900 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5458f88640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54541562a0 con 0x7f545415da30 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5452d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5454161020 0x7f545415ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5452d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5454161020 0x7f545415ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42084/0 (socket says 172.21.15.113:42084) 2023-12-19T13:48:10.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5452d9d640 1 -- 172.21.15.113:0/2312958013 learned_addr learned my addr 172.21.15.113:0/2312958013 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:10.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f545259c640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54540b6900 0x7f5454153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.546+0000 7f5451d9b640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f545415da30 0x7f5454158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5452d9d640 1 -- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f545415da30 msgr2=0x7f5454158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5452d9d640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f545415da30 0x7f5454158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5452d9d640 1 -- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54540b6900 msgr2=0x7f5454153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5452d9d640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54540b6900 0x7f5454153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5452d9d640 1 -- 172.21.15.113:0/2312958013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c009a70 con 0x7f5454161020 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5452d9d640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5454161020 0x7f545415ff90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c410 tx=0x7f544c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f544affd640 1 -- 172.21.15.113:0/2312958013 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c011790 con 0x7f5454161020 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f544affd640 1 -- 172.21.15.113:0/2312958013 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c0118f0 con 0x7f5454161020 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5454156580 con 0x7f5454161020 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f544affd640 1 -- 172.21.15.113:0/2312958013 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c011ce0 con 0x7f5454161020 2023-12-19T13:48:10.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.547+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5454131890 con 0x7f5454161020 2023-12-19T13:48:10.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.549+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5454156aa0 con 0x7f5454161020 2023-12-19T13:48:10.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.549+0000 7f544affd640 1 -- 172.21.15.113:0/2312958013 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f544c01c460 con 0x7f5454161020 2023-12-19T13:48:10.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.551+0000 7f544affd640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543806a430 0x7f543806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.551+0000 7f544affd640 1 -- 172.21.15.113:0/2312958013 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f544c0885d0 con 0x7f5454161020 2023-12-19T13:48:10.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.551+0000 7f545259c640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543806a430 0x7f543806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.552+0000 7f545259c640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543806a430 0x7f543806c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5444000f60 tx=0x7f5444009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:10.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.555+0000 7f544affd640 1 -- 172.21.15.113:0/2312958013 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5454156aa0 con 0x7f5454161020 2023-12-19T13:48:10.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.749+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5454156aa0 con 0x7f5454161020 2023-12-19T13:48:10.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.751+0000 7f544affd640 1 -- 172.21.15.113:0/2312958013 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f5454156aa0 con 0x7f5454161020 2023-12-19T13:48:10.752 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:10.752 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":36,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:47:58.492769+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:47:42.574723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:47:43.788651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:10.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543806a430 msgr2=0x7f543806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543806a430 0x7f543806c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5444000f60 tx=0x7f5444009040 comp rx=0 tx=0).stop 2023-12-19T13:48:10.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5454161020 msgr2=0x7f545415ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5454161020 0x7f545415ff90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c410 tx=0x7f544c00c8d0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 shutdown_connections 2023-12-19T13:48:10.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543806a430 0x7f543806c8f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5454161020 0x7f545415ff90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f545415da30 0x7f5454158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 --2- 172.21.15.113:0/2312958013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54540b6900 0x7f5454153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.754+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 >> 172.21.15.113:0/2312958013 conn(0x7f54540b26f0 msgr2=0x7f5454153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:10.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.755+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 shutdown_connections 2023-12-19T13:48:10.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.755+0000 7f5458f88640 1 -- 172.21.15.113:0/2312958013 wait complete. 2023-12-19T13:48:10.773 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:48:10.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.983+0000 7fe4be547640 1 Processor -- start 2023-12-19T13:48:10.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.984+0000 7fe4be547640 1 -- start start 2023-12-19T13:48:10.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.985+0000 7fe4be547640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe4b81449e0 0x7fe4b80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.985+0000 7fe4be547640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b80afb10 con 0x7fe4b80b0b50 2023-12-19T13:48:10.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.985+0000 7fe4be547640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b806bb30 con 0x7fe4b806c6b0 2023-12-19T13:48:10.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.985+0000 7fe4be547640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b80b0070 con 0x7fe4b81449e0 2023-12-19T13:48:10.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4affff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe4b80b0b50 0x7fe4b806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57660/0 (socket says 172.21.15.113:57660) 2023-12-19T13:48:10.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4affff640 1 -- 172.21.15.113:0/599259280 learned_addr learned my addr 172.21.15.113:0/599259280 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:10.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/599259280 >> v2:172.21.15.151:3300/0 conn(0x7fe4b81449e0 0x7fe4b80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372210623 0 0) 0x7fe4b80afb10 con 0x7fe4b80b0b50 2023-12-19T13:48:10.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a4003520 con 0x7fe4b80b0b50 2023-12-19T13:48:10.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737731024 0 0) 0x7fe4a4003520 con 0x7fe4b80b0b50 2023-12-19T13:48:10.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 >> v2:172.21.15.151:3300/0 conn(0x7fe4b81449e0 msgr2=0x7fe4b80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 --2- 172.21.15.113:0/599259280 >> v2:172.21.15.151:3300/0 conn(0x7fe4b81449e0 0x7fe4b80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 >> v1:172.21.15.151:6789/0 conn(0x7fe4b806c6b0 legacy=0x7fe4b80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80b0350 con 0x7fe4b80b0b50 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.986+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe4a0001670 con 0x7fe4b80b0b50 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 >> v1:172.21.15.113:6789/0 conn(0x7fe4b80b0b50 legacy=0x7fe4b806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b77fe640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b77fe640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4a40047c0 0x7fe4a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b77fe640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4a40051f0 0x7fe4a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80b0070 con 0x7fe4a40039e0 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400c150 con 0x7fe4a40047c0 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400c310 con 0x7fe4a40051f0 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4affff640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4a40047c0 0x7fe4a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4bcae4640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4a40051f0 0x7fe4a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b7fff640 1 -- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4a40051f0 msgr2=0x7fe4a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:10.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4a40051f0 0x7fe4a400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b7fff640 1 -- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4a40047c0 msgr2=0x7fe4a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:10.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4a40047c0 0x7fe4a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4b7fff640 1 -- 172.21.15.113:0/599259280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4003520 con 0x7fe4a40039e0 2023-12-19T13:48:10.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4bcae4640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4a40051f0 0x7fe4a400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:10.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4affff640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4a40047c0 0x7fe4a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:10.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.987+0000 7fe4bcae4640 1 -- 172.21.15.113:0/599259280 reap_dead start 2023-12-19T13:48:10.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.988+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4a4003e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800ba30 tx=0x7fe4a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7a48356472c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:10.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8032630 con 0x7fe4a40039e0 2023-12-19T13:48:10.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a8032790 con 0x7fe4a40039e0 2023-12-19T13:48:10.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4b77fe640 1 -- 172.21.15.113:0/599259280 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8032b20 con 0x7fe4a40039e0 2023-12-19T13:48:10.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4be547640 1 -- 172.21.15.113:0/599259280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 msgr2=0x7fe4a4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4be547640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4a4003e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800ba30 tx=0x7fe4a40057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4be547640 1 -- 172.21.15.113:0/599259280 shutdown_connections 2023-12-19T13:48:10.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4be547640 1 --2- 172.21.15.113:0/599259280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4a4003e00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.989+0000 7fe4be547640 1 -- 172.21.15.113:0/599259280 >> 172.21.15.113:0/599259280 conn(0x7fe4b80cbb70 msgr2=0x7fe4b80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:10.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.990+0000 7fe4be547640 1 -- 172.21.15.113:0/599259280 shutdown_connections 2023-12-19T13:48:10.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.990+0000 7fe4be547640 1 -- 172.21.15.113:0/599259280 wait complete. 2023-12-19T13:48:10.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.991+0000 7fe4be547640 1 Processor -- start 2023-12-19T13:48:10.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.991+0000 7fe4be547640 1 -- start start 2023-12-19T13:48:10.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.992+0000 7fe4be547640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4b815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.992+0000 7fe4be547640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b8135070 0x7fe4b8133460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.992+0000 7fe4be547640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4b81354f0 0x7fe4b81339a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.992+0000 7fe4be547640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815af10 con 0x7fe4a40039e0 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.992+0000 7fe4be547640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8136280 con 0x7fe4b8135070 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.992+0000 7fe4be547640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8133fd0 con 0x7fe4b81354f0 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4b815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4b815a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42102/0 (socket says 172.21.15.113:42102) 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 -- 172.21.15.113:0/2214281316 learned_addr learned my addr 172.21.15.113:0/2214281316 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4affff640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b8135070 0x7fe4b8133460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 -- 172.21.15.113:0/2214281316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4b81354f0 msgr2=0x7fe4b81339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4b81354f0 0x7fe4b81339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 -- 172.21.15.113:0/2214281316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b8135070 msgr2=0x7fe4b8133460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b8135070 0x7fe4b8133460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:10.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.993+0000 7fe4b7fff640 1 -- 172.21.15.113:0/2214281316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b81342b0 con 0x7fe4a40039e0 2023-12-19T13:48:11.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.994+0000 7fe4b7fff640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4b815a9d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe4a802beb0 tx=0x7fe4a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:11.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.994+0000 7fe4b57fa640 1 -- 172.21.15.113:0/2214281316 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a803ba70 con 0x7fe4a40039e0 2023-12-19T13:48:11.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.994+0000 7fe4b57fa640 1 -- 172.21.15.113:0/2214281316 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a803bbd0 con 0x7fe4a40039e0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.994+0000 7fe4b57fa640 1 -- 172.21.15.113:0/2214281316 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8030400 con 0x7fe4a40039e0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.994+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b8134590 con 0x7fe4a40039e0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.994+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b8134b50 con 0x7fe4a40039e0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.996+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b8061910 con 0x7fe4a40039e0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.996+0000 7fe4b57fa640 1 -- 172.21.15.113:0/2214281316 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe4a8030560 con 0x7fe4a40039e0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.998+0000 7fe4b57fa640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe49806a480 0x7fe49806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.998+0000 7fe4b57fa640 1 -- 172.21.15.113:0/2214281316 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4a80aaf00 con 0x7fe4a40039e0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.998+0000 7fe4affff640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe49806a480 0x7fe49806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:11.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:10.999+0000 7fe4affff640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe49806a480 0x7fe49806c940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001200 tx=0x7fe4a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:11.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.003+0000 7fe4b57fa640 1 -- 172.21.15.113:0/2214281316 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe4a80765d0 con 0x7fe4a40039e0 2023-12-19T13:48:11.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.228+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe4b806c280 con 0x7fe4a40039e0 2023-12-19T13:48:11.230 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:48:11.230+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:48:11.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.244+0000 7fe4b57fa640 1 -- 172.21.15.113:0/2214281316 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe4a8036090 con 0x7fe4a40039e0 2023-12-19T13:48:11.245 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:48:11.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe49806a480 msgr2=0x7fe49806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:11.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe49806a480 0x7fe49806c940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001200 tx=0x7fe4a0009040 comp rx=0 tx=0).stop 2023-12-19T13:48:11.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 msgr2=0x7fe4b815a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:11.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4b815a9d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe4a802beb0 tx=0x7fe4a8004730 comp rx=0 tx=0).stop 2023-12-19T13:48:11.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 shutdown_connections 2023-12-19T13:48:11.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe49806a480 0x7fe49806c940 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4b81354f0 0x7fe4b81339a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b8135070 0x7fe4b8133460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 --2- 172.21.15.113:0/2214281316 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a40039e0 0x7fe4b815a9d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 >> 172.21.15.113:0/2214281316 conn(0x7fe4b80cbb70 msgr2=0x7fe4b815b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:11.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.247+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 shutdown_connections 2023-12-19T13:48:11.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.248+0000 7fe4be547640 1 -- 172.21.15.113:0/2214281316 wait complete. 2023-12-19T13:48:11.266 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:48:11.273 INFO:tasks.ceph.mds.b.smithi151.stderr: -4931> 2023-12-19T13:47:46.905+0000 7f71a6b3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:48:11.346 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:48:11.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.477+0000 7f7018807640 1 Processor -- start 2023-12-19T13:48:11.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.477+0000 7f7018807640 1 -- start start 2023-12-19T13:48:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.478+0000 7f7018807640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7014155460 0x7f70140b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.478+0000 7f7018807640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f701406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.478+0000 7f7018807640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701415c9c0 con 0x7f701406ca80 2023-12-19T13:48:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f7018807640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140b0cb0 con 0x7f7014155460 2023-12-19T13:48:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f7018807640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701406d270 con 0x7f70140b0830 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f70137fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7014155460 0x7f70140b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f70137fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7014155460 0x7f70140b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42112/0 (socket says 172.21.15.113:42112) 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f70137fe640 1 -- 172.21.15.113:0/2532574301 learned_addr learned my addr 172.21.15.113:0/2532574301 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f700bfff640 1 --2- 172.21.15.113:0/2532574301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f701406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f70137fe640 1 -- 172.21.15.113:0/2532574301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 msgr2=0x7f701406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f70137fe640 1 --2- 172.21.15.113:0/2532574301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f701406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f70137fe640 1 -- 172.21.15.113:0/2532574301 >> v1:172.21.15.113:6789/0 conn(0x7f701406ca80 legacy=0x7f70140cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f70137fe640 1 -- 172.21.15.113:0/2532574301 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701406d550 con 0x7f7014155460 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f700bfff640 1 --2- 172.21.15.113:0/2532574301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f701406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.479+0000 7f7012ffd640 1 -- 172.21.15.113:0/2532574301 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708158148 0 0) 0x7f701415c9c0 con 0x7f701406ca80 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.481+0000 7f70137fe640 1 --2- 172.21.15.113:0/2532574301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f70140b02f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7004009870 tx=0x7f700402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d4f7f5e27552b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.481+0000 7f7012ffd640 1 -- 172.21.15.113:0/2532574301 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004030840 con 0x7f7014155460 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.481+0000 7f7012ffd640 1 -- 172.21.15.113:0/2532574301 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040309a0 con 0x7f7014155460 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.481+0000 7f7012ffd640 1 -- 172.21.15.113:0/2532574301 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004030d30 con 0x7f7014155460 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.481+0000 7f7018807640 1 -- 172.21.15.113:0/2532574301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 msgr2=0x7f70140b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.481+0000 7f7018807640 1 --2- 172.21.15.113:0/2532574301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f70140b02f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7004009870 tx=0x7f700402b980 comp rx=0 tx=0).stop 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.482+0000 7f7018807640 1 -- 172.21.15.113:0/2532574301 shutdown_connections 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.482+0000 7f7018807640 1 --2- 172.21.15.113:0/2532574301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f701406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.482+0000 7f7018807640 1 --2- 172.21.15.113:0/2532574301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f70140b02f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.482+0000 7f7018807640 1 -- 172.21.15.113:0/2532574301 >> 172.21.15.113:0/2532574301 conn(0x7f70140659a0 msgr2=0x7f7014065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:11.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.482+0000 7f7018807640 1 -- 172.21.15.113:0/2532574301 shutdown_connections 2023-12-19T13:48:11.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.482+0000 7f7018807640 1 -- 172.21.15.113:0/2532574301 wait complete. 2023-12-19T13:48:11.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.483+0000 7f7018807640 1 Processor -- start 2023-12-19T13:48:11.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.484+0000 7f7018807640 1 -- start start 2023-12-19T13:48:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7018807640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f701406ca80 0x7f70141f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7018807640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f7014155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7018807640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f7014159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7018807640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014157590 con 0x7f7014155460 2023-12-19T13:48:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7018807640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014157240 con 0x7f701406ca80 2023-12-19T13:48:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7018807640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7014156400 con 0x7f70140b0830 2023-12-19T13:48:11.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f7014159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:11.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f7014159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42124/0 (socket says 172.21.15.113:42124) 2023-12-19T13:48:11.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 -- 172.21.15.113:0/3766163543 learned_addr learned my addr 172.21.15.113:0/3766163543 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:11.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f70137fe640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f701406ca80 0x7f70141f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f700bfff640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f7014155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 -- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 msgr2=0x7f7014155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f7014155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 -- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f701406ca80 msgr2=0x7f70141f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f701406ca80 0x7f70141f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.485+0000 7f7013fff640 1 -- 172.21.15.113:0/3766163543 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040094d0 con 0x7f7014155460 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.486+0000 7f7013fff640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f7014159f20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f700c001560 tx=0x7f700c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.486+0000 7f7010ff9640 1 -- 172.21.15.113:0/3766163543 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c003da0 con 0x7f7014155460 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.486+0000 7f7010ff9640 1 -- 172.21.15.113:0/3766163543 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c005070 con 0x7f7014155460 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.486+0000 7f7010ff9640 1 -- 172.21.15.113:0/3766163543 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c005420 con 0x7f7014155460 2023-12-19T13:48:11.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.486+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70141566a0 con 0x7f7014155460 2023-12-19T13:48:11.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.486+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7014156c60 con 0x7f7014155460 2023-12-19T13:48:11.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.487+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70141576d0 con 0x7f7014155460 2023-12-19T13:48:11.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.488+0000 7f7010ff9640 1 -- 172.21.15.113:0/3766163543 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f700c005580 con 0x7f7014155460 2023-12-19T13:48:11.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.489+0000 7f7010ff9640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6ff806a430 0x7f6ff806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:11.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.489+0000 7f7010ff9640 1 -- 172.21.15.113:0/3766163543 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f700c088210 con 0x7f7014155460 2023-12-19T13:48:11.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.490+0000 7f70137fe640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6ff806a430 0x7f6ff806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:11.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.490+0000 7f70137fe640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6ff806a430 0x7f6ff806c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7004036000 tx=0x7f700403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:11.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.493+0000 7f7010ff9640 1 -- 172.21.15.113:0/3766163543 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70141576d0 con 0x7f7014155460 2023-12-19T13:48:11.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:11.722+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f70141576d0 con 0x7f7014155460 2023-12-19T13:48:12.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.250+0000 7f7010ff9640 1 -- 172.21.15.113:0/3766163543 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f70141576d0 con 0x7f7014155460 2023-12-19T13:48:12.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6ff806a430 msgr2=0x7f6ff806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:12.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6ff806a430 0x7f6ff806c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7004036000 tx=0x7f700403b040 comp rx=0 tx=0).stop 2023-12-19T13:48:12.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 msgr2=0x7f7014159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:12.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f7014159f20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f700c001560 tx=0x7f700c00cc70 comp rx=0 tx=0).stop 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 shutdown_connections 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6ff806a430 0x7f6ff806c8f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7014155460 0x7f7014159f20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140b0830 0x7f7014155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 --2- 172.21.15.113:0/3766163543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f701406ca80 0x7f70141f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.254+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 >> 172.21.15.113:0/3766163543 conn(0x7f70140659a0 msgr2=0x7f701415eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.255+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 shutdown_connections 2023-12-19T13:48:12.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.255+0000 7f7018807640 1 -- 172.21.15.113:0/3766163543 wait complete. 2023-12-19T13:48:12.276 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:48:12.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.496+0000 7f513cd63640 1 Processor -- start 2023-12-19T13:48:12.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.497+0000 7f513cd63640 1 -- start start 2023-12-19T13:48:12.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f513cd63640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f513813e200 0x7f51380ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:12.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f513cd63640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5138141140 0x7f51380cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:12.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f513cd63640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380b1880 con 0x7f5138141660 2023-12-19T13:48:12.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f513cd63640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380b26e0 con 0x7f5138141140 2023-12-19T13:48:12.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f513cd63640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380cf020 con 0x7f513813e200 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f5136d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5138141140 0x7f51380cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f5136d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5138141140 0x7f51380cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42138/0 (socket says 172.21.15.113:42138) 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.498+0000 7f5136d9d640 1 -- 172.21.15.113:0/810144057 learned_addr learned my addr 172.21.15.113:0/810144057 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.499+0000 7f513659c640 1 --2- 172.21.15.113:0/810144057 >> v2:172.21.15.151:3300/0 conn(0x7f513813e200 0x7f51380ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.499+0000 7f5136d9d640 1 -- 172.21.15.113:0/810144057 >> v2:172.21.15.151:3300/0 conn(0x7f513813e200 msgr2=0x7f51380ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.499+0000 7f5136d9d640 1 --2- 172.21.15.113:0/810144057 >> v2:172.21.15.151:3300/0 conn(0x7f513813e200 0x7f51380ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.499+0000 7f5136d9d640 1 -- 172.21.15.113:0/810144057 >> v1:172.21.15.151:6789/0 conn(0x7f5138141660 legacy=0x7f5138140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:12.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.499+0000 7f5136d9d640 1 -- 172.21.15.113:0/810144057 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380b1ad0 con 0x7f5138141140 2023-12-19T13:48:12.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.500+0000 7f5136d9d640 1 --2- 172.21.15.113:0/810144057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5138141140 0x7f51380cbca0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f51380b1530 tx=0x7f513002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320d1b18aca81538 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:12.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.500+0000 7f513559a640 1 -- 172.21.15.113:0/810144057 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130031870 con 0x7f5138141140 2023-12-19T13:48:12.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.500+0000 7f513559a640 1 -- 172.21.15.113:0/810144057 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51300319d0 con 0x7f5138141140 2023-12-19T13:48:12.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.500+0000 7f513559a640 1 -- 172.21.15.113:0/810144057 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130031d60 con 0x7f5138141140 2023-12-19T13:48:12.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 -- 172.21.15.113:0/810144057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5138141140 msgr2=0x7f51380cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:12.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 --2- 172.21.15.113:0/810144057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5138141140 0x7f51380cbca0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f51380b1530 tx=0x7f513002b910 comp rx=0 tx=0).stop 2023-12-19T13:48:12.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 -- 172.21.15.113:0/810144057 shutdown_connections 2023-12-19T13:48:12.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 --2- 172.21.15.113:0/810144057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5138141140 0x7f51380cbca0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 --2- 172.21.15.113:0/810144057 >> v2:172.21.15.151:3300/0 conn(0x7f513813e200 0x7f51380ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 -- 172.21.15.113:0/810144057 >> 172.21.15.113:0/810144057 conn(0x7f51380cf230 msgr2=0x7f51380cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:12.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 -- 172.21.15.113:0/810144057 shutdown_connections 2023-12-19T13:48:12.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.501+0000 7f513cd63640 1 -- 172.21.15.113:0/810144057 wait complete. 2023-12-19T13:48:12.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.503+0000 7f513cd63640 1 Processor -- start 2023-12-19T13:48:12.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.503+0000 7f513cd63640 1 -- start start 2023-12-19T13:48:12.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.504+0000 7f513cd63640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f513813e200 0x7f51381f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:12.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.504+0000 7f513cd63640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5138141140 0x7f513806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:12.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.504+0000 7f513cd63640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5138141660 0x7f5138139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:12.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.504+0000 7f513cd63640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138071390 con 0x7f513813e200 2023-12-19T13:48:12.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.504+0000 7f513cd63640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138070310 con 0x7f5138141140 2023-12-19T13:48:12.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.504+0000 7f513cd63640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380705f0 con 0x7f5138141660 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f513813e200 0x7f51381f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f513813e200 0x7f51381f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42140/0 (socket says 172.21.15.113:42140) 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 -- 172.21.15.113:0/1508963144 learned_addr learned my addr 172.21.15.113:0/1508963144 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f5135d9b640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5138141140 0x7f513806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f5136d9d640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5138141660 0x7f5138139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 -- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5138141660 msgr2=0x7f5138139310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5138141660 0x7f5138139310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 -- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5138141140 msgr2=0x7f513806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:12.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5138141140 0x7f513806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:12.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.505+0000 7f513659c640 1 -- 172.21.15.113:0/1508963144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51300094d0 con 0x7f513813e200 2023-12-19T13:48:12.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.506+0000 7f513659c640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f513813e200 0x7f51381f3b80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f512000d5f0 tx=0x7f512000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:12.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.506+0000 7f512effd640 1 -- 172.21.15.113:0/1508963144 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51200125f0 con 0x7f513813e200 2023-12-19T13:48:12.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.506+0000 7f512effd640 1 -- 172.21.15.113:0/1508963144 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5120012750 con 0x7f513813e200 2023-12-19T13:48:12.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.506+0000 7f512effd640 1 -- 172.21.15.113:0/1508963144 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120012b00 con 0x7f513813e200 2023-12-19T13:48:12.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.506+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51380708d0 con 0x7f513813e200 2023-12-19T13:48:12.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.506+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5138070e90 con 0x7f513813e200 2023-12-19T13:48:12.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.507+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5138071020 con 0x7f513813e200 2023-12-19T13:48:12.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.508+0000 7f512effd640 1 -- 172.21.15.113:0/1508963144 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5120012c60 con 0x7f513813e200 2023-12-19T13:48:12.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.509+0000 7f512effd640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511806a430 0x7f511806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:12.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.509+0000 7f512effd640 1 -- 172.21.15.113:0/1508963144 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5120088ee0 con 0x7f513813e200 2023-12-19T13:48:12.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.509+0000 7f5135d9b640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511806a430 0x7f511806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:12.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.510+0000 7f5135d9b640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511806a430 0x7f511806c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f51380accf0 tx=0x7f5128009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:12.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.514+0000 7f512effd640 1 -- 172.21.15.113:0/1508963144 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f51200543d0 con 0x7f513813e200 2023-12-19T13:48:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:12.705+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5138061910 con 0x7f513813e200 2023-12-19T13:48:13.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.593+0000 7f512effd640 1 -- 172.21.15.113:0/1508963144 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f51200579f0 con 0x7f513813e200 2023-12-19T13:48:13.594 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511806a430 msgr2=0x7f511806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511806a430 0x7f511806c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f51380accf0 tx=0x7f5128009040 comp rx=0 tx=0).stop 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f513813e200 msgr2=0x7f51381f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f513813e200 0x7f51381f3b80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f512000d5f0 tx=0x7f512000dab0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 shutdown_connections 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511806a430 0x7f511806c8f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5138141660 0x7f5138139310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5138141140 0x7f513806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 --2- 172.21.15.113:0/1508963144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f513813e200 0x7f51381f3b80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 >> 172.21.15.113:0/1508963144 conn(0x7f51380cf230 msgr2=0x7f51380cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:13.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 shutdown_connections 2023-12-19T13:48:13.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.597+0000 7f513cd63640 1 -- 172.21.15.113:0/1508963144 wait complete. 2023-12-19T13:48:13.619 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:48:13.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.836+0000 7f3e0f763640 1 Processor -- start 2023-12-19T13:48:13.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.836+0000 7f3e0f763640 1 -- start start 2023-12-19T13:48:13.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.837+0000 7f3e0f763640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e0815a970 0x7f3e0815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.837+0000 7f3e0f763640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e080cd680 con 0x7f3e0815b460 2023-12-19T13:48:13.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.837+0000 7f3e0f763640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e080cc160 con 0x7f3e080cae20 2023-12-19T13:48:13.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.837+0000 7f3e0f763640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e080cb8c0 con 0x7f3e0815a970 2023-12-19T13:48:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.838+0000 7f3e0dd00640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3e0815b460 0x7f3e080cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57684/0 (socket says 172.21.15.113:57684) 2023-12-19T13:48:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.838+0000 7f3e0dd00640 1 -- 172.21.15.113:0/4029228828 learned_addr learned my addr 172.21.15.113:0/4029228828 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.838+0000 7f3e0d4ff640 1 --2- 172.21.15.113:0/4029228828 >> v2:172.21.15.151:3300/0 conn(0x7f3e0815a970 0x7f3e0815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.838+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529167554 0 0) 0x7f3e080cd680 con 0x7f3e0815b460 2023-12-19T13:48:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.838+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df4003520 con 0x7f3e0815b460 2023-12-19T13:48:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3385776165 0 0) 0x7f3df4003520 con 0x7f3e0815b460 2023-12-19T13:48:13.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 >> v2:172.21.15.151:3300/0 conn(0x7f3e0815a970 msgr2=0x7f3e0815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 --2- 172.21.15.113:0/4029228828 >> v2:172.21.15.151:3300/0 conn(0x7f3e0815a970 0x7f3e0815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 >> v1:172.21.15.151:6789/0 conn(0x7f3e080cae20 legacy=0x7f3e0815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080cbba0 con 0x7f3e0815b460 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3e000019f0 con 0x7f3e0815b460 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 >> v1:172.21.15.113:6789/0 conn(0x7f3e0815b460 legacy=0x7f3e080cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4003970 0x7f3df4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40047c0 0x7f3df4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3df4005180 0x7f3df400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080cb8c0 con 0x7f3df4005180 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df400c020 con 0x7f3df40047c0 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df400c1e0 con 0x7f3df4003970 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3e0dd00640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3df4005180 0x7f3df400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3e0d4ff640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4003970 0x7f3df4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3e0dd00640 1 -- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4003970 msgr2=0x7f3df4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:13.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3e0dd00640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4003970 0x7f3df4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.839+0000 7f3e0dd00640 1 -- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40047c0 msgr2=0x7f3df4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:13.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.840+0000 7f3e0ccfe640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40047c0 0x7f3df4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.840+0000 7f3e0dd00640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40047c0 0x7f3df4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.840+0000 7f3e0dd00640 1 -- 172.21.15.113:0/4029228828 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4003520 con 0x7f3df4005180 2023-12-19T13:48:13.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.840+0000 7f3e0ccfe640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40047c0 0x7f3df4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.840+0000 7f3e0dd00640 1 -- 172.21.15.113:0/4029228828 reap_dead start 2023-12-19T13:48:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.841+0000 7f3e0dd00640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3df4005180 0x7f3df400b980 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000a830 tx=0x7f3df40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e0ec3cf3e9d99b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.841+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000072d0 con 0x7f3df4005180 2023-12-19T13:48:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.841+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0002f070 con 0x7f3df4005180 2023-12-19T13:48:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.841+0000 7f3dfffff640 1 -- 172.21.15.113:0/4029228828 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000076b0 con 0x7f3df4005180 2023-12-19T13:48:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.841+0000 7f3e0f763640 1 -- 172.21.15.113:0/4029228828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3df4005180 msgr2=0x7f3df400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:13.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.841+0000 7f3e0f763640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3df4005180 0x7f3df400b980 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000a830 tx=0x7f3df40057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.842+0000 7f3e0f763640 1 -- 172.21.15.113:0/4029228828 shutdown_connections 2023-12-19T13:48:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.842+0000 7f3e0f763640 1 --2- 172.21.15.113:0/4029228828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3df4005180 0x7f3df400b980 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.842+0000 7f3e0f763640 1 -- 172.21.15.113:0/4029228828 >> 172.21.15.113:0/4029228828 conn(0x7f3e080cf2f0 msgr2=0x7f3e080cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.842+0000 7f3e0f763640 1 -- 172.21.15.113:0/4029228828 shutdown_connections 2023-12-19T13:48:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.842+0000 7f3e0f763640 1 -- 172.21.15.113:0/4029228828 wait complete. 2023-12-19T13:48:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.844+0000 7f3e0f763640 1 Processor -- start 2023-12-19T13:48:13.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.844+0000 7f3e0f763640 1 -- start start 2023-12-19T13:48:13.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0f763640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4005180 0x7f3e08156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0f763640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0813edc0 0x7f3e0814b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0f763640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0814be60 0x7f3e081553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0f763640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0814c2e0 con 0x7f3e0813edc0 2023-12-19T13:48:13.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0f763640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0814d310 con 0x7f3e0814be60 2023-12-19T13:48:13.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0f763640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0814e170 con 0x7f3df4005180 2023-12-19T13:48:13.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0813edc0 0x7f3e0814b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0813edc0 0x7f3e0814b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42152/0 (socket says 172.21.15.113:42152) 2023-12-19T13:48:13.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 -- 172.21.15.113:0/1050589508 learned_addr learned my addr 172.21.15.113:0/1050589508 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:13.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0d4ff640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4005180 0x7f3e08156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 -- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4005180 msgr2=0x7f3e08156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:13.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4005180 0x7f3e08156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 -- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0814be60 msgr2=0x7f3e081553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:13.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0dd00640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0814be60 0x7f3e081553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0814be60 0x7f3e081553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:13.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.845+0000 7f3e0ccfe640 1 -- 172.21.15.113:0/1050589508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0814e600 con 0x7f3e0813edc0 2023-12-19T13:48:13.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.846+0000 7f3e0ccfe640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0813edc0 0x7f3e0814b920 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d7d0 tx=0x7f3df800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:13.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.846+0000 7f3dfdffb640 1 -- 172.21.15.113:0/1050589508 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8005270 con 0x7f3e0813edc0 2023-12-19T13:48:13.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.846+0000 7f3dfdffb640 1 -- 172.21.15.113:0/1050589508 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df80053d0 con 0x7f3e0813edc0 2023-12-19T13:48:13.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.846+0000 7f3dfdffb640 1 -- 172.21.15.113:0/1050589508 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df800b890 con 0x7f3e0813edc0 2023-12-19T13:48:13.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.846+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e08157160 con 0x7f3e0813edc0 2023-12-19T13:48:13.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.846+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0814d840 con 0x7f3e0813edc0 2023-12-19T13:48:13.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.847+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e08074770 con 0x7f3e0813edc0 2023-12-19T13:48:13.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.848+0000 7f3dfdffb640 1 -- 172.21.15.113:0/1050589508 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3df800b9f0 con 0x7f3e0813edc0 2023-12-19T13:48:13.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.849+0000 7f3dfdffb640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3dec06a460 0x7f3dec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:13.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.849+0000 7f3dfdffb640 1 -- 172.21.15.113:0/1050589508 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3df80886a0 con 0x7f3e0813edc0 2023-12-19T13:48:13.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.849+0000 7f3e0d4ff640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3dec06a460 0x7f3dec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:13.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.850+0000 7f3e0d4ff640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3dec06a460 0x7f3dec06c920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009910 tx=0x7f3e04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:13.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:13.853+0000 7f3dfdffb640 1 -- 172.21.15.113:0/1050589508 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3df8053de0 con 0x7f3e0813edc0 2023-12-19T13:48:14.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.048+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e08061910 con 0x7f3e0813edc0 2023-12-19T13:48:14.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.597+0000 7f3dfdffb640 1 -- 172.21.15.113:0/1050589508 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3df8019310 con 0x7f3e0813edc0 2023-12-19T13:48:14.598 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:48:14.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3dec06a460 msgr2=0x7f3dec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:14.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3dec06a460 0x7f3dec06c920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009910 tx=0x7f3e04008040 comp rx=0 tx=0).stop 2023-12-19T13:48:14.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0813edc0 msgr2=0x7f3e0814b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0813edc0 0x7f3e0814b920 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d7d0 tx=0x7f3df800dc90 comp rx=0 tx=0).stop 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 shutdown_connections 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3dec06a460 0x7f3dec06c920 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0814be60 0x7f3e081553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0813edc0 0x7f3e0814b920 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 --2- 172.21.15.113:0/1050589508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df4005180 0x7f3e08156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 >> 172.21.15.113:0/1050589508 conn(0x7f3e080cf2f0 msgr2=0x7f3e0814ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 shutdown_connections 2023-12-19T13:48:14.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.601+0000 7f3e0f763640 1 -- 172.21.15.113:0/1050589508 wait complete. 2023-12-19T13:48:14.623 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:48:14.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.832+0000 7efeb035c640 1 Processor -- start 2023-12-19T13:48:14.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.832+0000 7efeb035c640 1 -- start start 2023-12-19T13:48:14.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.834+0000 7efeb035c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efea80b02b0 0x7efea80b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.834+0000 7efeb035c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80af110 con 0x7efea80ce420 2023-12-19T13:48:14.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.834+0000 7efeb035c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80ad960 con 0x7efea815a190 2023-12-19T13:48:14.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.834+0000 7efeb035c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea80b0c80 con 0x7efea80b02b0 2023-12-19T13:48:14.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.834+0000 7efeae8f9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7efea80ce420 0x7efea80ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57688/0 (socket says 172.21.15.113:57688) 2023-12-19T13:48:14.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.834+0000 7efeae8f9640 1 -- 172.21.15.113:0/2531174147 learned_addr learned my addr 172.21.15.113:0/2531174147 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:14.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead8f7640 1 --2- 172.21.15.113:0/2531174147 >> v2:172.21.15.151:3300/0 conn(0x7efea80b02b0 0x7efea80b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:14.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408533408 0 0) 0x7efea80af110 con 0x7efea80ce420 2023-12-19T13:48:14.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe94003520 con 0x7efea80ce420 2023-12-19T13:48:14.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887640109 0 0) 0x7efe94003520 con 0x7efea80ce420 2023-12-19T13:48:14.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 >> v2:172.21.15.151:3300/0 conn(0x7efea80b02b0 msgr2=0x7efea80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:14.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 --2- 172.21.15.113:0/2531174147 >> v2:172.21.15.151:3300/0 conn(0x7efea80b02b0 0x7efea80b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 >> v1:172.21.15.151:6789/0 conn(0x7efea815a190 legacy=0x7efea80aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80adc40 con 0x7efea80ce420 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7efea00019f0 con 0x7efea80ce420 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 >> v1:172.21.15.113:6789/0 conn(0x7efea80ce420 legacy=0x7efea80ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.835+0000 7efead0f6640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efe94003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efead0f6640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe940047c0 0x7efe94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efead0f6640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe940052a0 0x7efe9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80b0c80 con 0x7efe94003a30 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9400c170 con 0x7efe940052a0 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9400e540 con 0x7efe940047c0 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efeae0f8640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efe94003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efeae0f8640 1 -- 172.21.15.113:0/2531174147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe940047c0 msgr2=0x7efe94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efeae0f8640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe940047c0 0x7efe94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efeae0f8640 1 -- 172.21.15.113:0/2531174147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe940052a0 msgr2=0x7efe9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:14.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efeae0f8640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe940052a0 0x7efe9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efeae0f8640 1 -- 172.21.15.113:0/2531174147 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe94003520 con 0x7efe94003a30 2023-12-19T13:48:14.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.836+0000 7efeae8f9640 1 -- 172.21.15.113:0/2531174147 reap_dead start 2023-12-19T13:48:14.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.837+0000 7efeae0f8640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efe94003e50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efea4001750 tx=0x7efe940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c1cf090cf9c752 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:14.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.837+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40052d0 con 0x7efe94003a30 2023-12-19T13:48:14.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.837+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea402e050 con 0x7efe94003a30 2023-12-19T13:48:14.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.837+0000 7efead0f6640 1 -- 172.21.15.113:0/2531174147 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4003830 con 0x7efe94003a30 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.838+0000 7efeb035c640 1 -- 172.21.15.113:0/2531174147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 msgr2=0x7efe94003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.838+0000 7efeb035c640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efe94003e50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efea4001750 tx=0x7efe940057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.838+0000 7efeb035c640 1 -- 172.21.15.113:0/2531174147 shutdown_connections 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.838+0000 7efeb035c640 1 --2- 172.21.15.113:0/2531174147 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efe94003e50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.838+0000 7efeb035c640 1 -- 172.21.15.113:0/2531174147 >> 172.21.15.113:0/2531174147 conn(0x7efea8066160 msgr2=0x7efea80cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.838+0000 7efeb035c640 1 -- 172.21.15.113:0/2531174147 shutdown_connections 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.838+0000 7efeb035c640 1 -- 172.21.15.113:0/2531174147 wait complete. 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.840+0000 7efeb035c640 1 Processor -- start 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.840+0000 7efeb035c640 1 -- start start 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeb035c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efea815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeb035c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efea814be10 0x7efea814c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeb035c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efea8156020 0x7efea814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeb035c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea815c130 con 0x7efe94003a30 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeb035c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea806cad0 con 0x7efea814be10 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeb035c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea815c3d0 con 0x7efea8156020 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeae0f8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efea815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeae0f8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efea815ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42162/0 (socket says 172.21.15.113:42162) 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.841+0000 7efeae0f8640 1 -- 172.21.15.113:0/782677810 learned_addr learned my addr 172.21.15.113:0/782677810 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeae0f8640 1 -- 172.21.15.113:0/782677810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efea8156020 msgr2=0x7efea814cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeae0f8640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efea8156020 0x7efea814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeae0f8640 1 -- 172.21.15.113:0/782677810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efea814be10 msgr2=0x7efea814c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeae0f8640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efea814be10 0x7efea814c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeae0f8640 1 -- 172.21.15.113:0/782677810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea815c6b0 con 0x7efe94003a30 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeae0f8640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efea815ceb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efea402bc30 tx=0x7efea4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efe9effd640 1 -- 172.21.15.113:0/782677810 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40076c0 con 0x7efe94003a30 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efe9effd640 1 -- 172.21.15.113:0/782677810 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4007a30 con 0x7efe94003a30 2023-12-19T13:48:14.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efe9effd640 1 -- 172.21.15.113:0/782677810 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4006c20 con 0x7efe94003a30 2023-12-19T13:48:14.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea815c990 con 0x7efe94003a30 2023-12-19T13:48:14.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.842+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea814d0e0 con 0x7efe94003a30 2023-12-19T13:48:14.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.844+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea8061910 con 0x7efe94003a30 2023-12-19T13:48:14.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.845+0000 7efe9effd640 1 -- 172.21.15.113:0/782677810 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efea40035f0 con 0x7efe94003a30 2023-12-19T13:48:14.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.845+0000 7efe9effd640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe8c06a430 0x7efe8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:14.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.846+0000 7efe9effd640 1 -- 172.21.15.113:0/782677810 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efea40aa2c0 con 0x7efe94003a30 2023-12-19T13:48:14.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.846+0000 7efead8f7640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe8c06a430 0x7efe8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:14.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.846+0000 7efead8f7640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe8c06a430 0x7efe8c06c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efea806fdf0 tx=0x7efe98006dd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:14.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:14.850+0000 7efe9effd640 1 -- 172.21.15.113:0/782677810 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efea4075bb0 con 0x7efe94003a30 2023-12-19T13:48:15.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.045+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efea815da60 con 0x7efe94003a30 2023-12-19T13:48:15.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.052+0000 7efe9effd640 1 -- 172.21.15.113:0/782677810 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7efea4048ed0 con 0x7efe94003a30 2023-12-19T13:48:15.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe8c06a430 msgr2=0x7efe8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe8c06a430 0x7efe8c06c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efea806fdf0 tx=0x7efe98006dd0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 msgr2=0x7efea815ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efea815ceb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efea402bc30 tx=0x7efea4001120 comp rx=0 tx=0).stop 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 shutdown_connections 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe8c06a430 0x7efe8c06c8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efea8156020 0x7efea814cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efea814be10 0x7efea814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 --2- 172.21.15.113:0/782677810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe94003a30 0x7efea815ceb0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 >> 172.21.15.113:0/782677810 conn(0x7efea8066160 msgr2=0x7efea806fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 shutdown_connections 2023-12-19T13:48:15.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.055+0000 7efeb035c640 1 -- 172.21.15.113:0/782677810 wait complete. 2023-12-19T13:48:15.074 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-19T13:48:15.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.272+0000 7fa910e62640 1 Processor -- start 2023-12-19T13:48:15.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.272+0000 7fa910e62640 1 -- start start 2023-12-19T13:48:15.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.273+0000 7fa910e62640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c15e5a0 0x7fa90c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.273+0000 7fa910e62640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa90c15f680 0x7fa90c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.273+0000 7fa910e62640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa90c0cdbf0 0x7fa90c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.273+0000 7fa910e62640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c0ce5c0 con 0x7fa90c0cdbf0 2023-12-19T13:48:15.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.273+0000 7fa910e62640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c15ec30 con 0x7fa90c15f680 2023-12-19T13:48:15.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.273+0000 7fa910e62640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b2cc0 con 0x7fa90c15e5a0 2023-12-19T13:48:15.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa90c0cdbf0 0x7fa90c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa90c0cdbf0 0x7fa90c0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42178/0 (socket says 172.21.15.113:42178) 2023-12-19T13:48:15.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 -- 172.21.15.113:0/2490659990 learned_addr learned my addr 172.21.15.113:0/2490659990 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:15.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90affd640 1 --2- 172.21.15.113:0/2490659990 >> v2:172.21.15.151:3300/0 conn(0x7fa90c15f680 0x7fa90c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90b7fe640 1 --2- 172.21.15.113:0/2490659990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c15e5a0 0x7fa90c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 -- 172.21.15.113:0/2490659990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c15e5a0 msgr2=0x7fa90c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 --2- 172.21.15.113:0/2490659990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c15e5a0 0x7fa90c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 -- 172.21.15.113:0/2490659990 >> v2:172.21.15.151:3300/0 conn(0x7fa90c15f680 msgr2=0x7fa90c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 --2- 172.21.15.113:0/2490659990 >> v2:172.21.15.151:3300/0 conn(0x7fa90c15f680 0x7fa90c0b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.274+0000 7fa90bfff640 1 -- 172.21.15.113:0/2490659990 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c15e980 con 0x7fa90c0cdbf0 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.275+0000 7fa90bfff640 1 --2- 172.21.15.113:0/2490659990 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c0cdbf0 0x7fa90c0ce080 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0cfe20 tx=0x7fa90402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f4a9b23f92e384 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa90a7fc640 1 -- 172.21.15.113:0/2490659990 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90402ca70 con 0x7fa90c0cdbf0 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa90a7fc640 1 -- 172.21.15.113:0/2490659990 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90402cbd0 con 0x7fa90c0cdbf0 2023-12-19T13:48:15.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa90a7fc640 1 -- 172.21.15.113:0/2490659990 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040343f0 con 0x7fa90c0cdbf0 2023-12-19T13:48:15.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 -- 172.21.15.113:0/2490659990 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c0cdbf0 msgr2=0x7fa90c0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 --2- 172.21.15.113:0/2490659990 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c0cdbf0 0x7fa90c0ce080 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0cfe20 tx=0x7fa90402bed0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 -- 172.21.15.113:0/2490659990 shutdown_connections 2023-12-19T13:48:15.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 --2- 172.21.15.113:0/2490659990 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c0cdbf0 0x7fa90c0ce080 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 --2- 172.21.15.113:0/2490659990 >> v2:172.21.15.151:3300/0 conn(0x7fa90c15f680 0x7fa90c0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 --2- 172.21.15.113:0/2490659990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c15e5a0 0x7fa90c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 -- 172.21.15.113:0/2490659990 >> 172.21.15.113:0/2490659990 conn(0x7fa90c0b0100 msgr2=0x7fa90c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:15.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 -- 172.21.15.113:0/2490659990 shutdown_connections 2023-12-19T13:48:15.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.276+0000 7fa910e62640 1 -- 172.21.15.113:0/2490659990 wait complete. 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.278+0000 7fa910e62640 1 Processor -- start 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.278+0000 7fa910e62640 1 -- start start 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa910e62640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c0cdbf0 0x7fa90c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa910e62640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa90c15e5a0 0x7fa90c0af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa910e62640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c15f680 0x7fa90c14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa910e62640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c155890 con 0x7fa90c15f680 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa910e62640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c154c10 con 0x7fa90c15e5a0 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa910e62640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c154ef0 con 0x7fa90c0cdbf0 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c15f680 0x7fa90c14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c15f680 0x7fa90c14e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42180/0 (socket says 172.21.15.113:42180) 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.279+0000 7fa90bfff640 1 -- 172.21.15.113:0/3891485558 learned_addr learned my addr 172.21.15.113:0/3891485558 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa90bfff640 1 -- 172.21.15.113:0/3891485558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c0cdbf0 msgr2=0x7fa90c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa90bfff640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c0cdbf0 0x7fa90c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa90bfff640 1 -- 172.21.15.113:0/3891485558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa90c15e5a0 msgr2=0x7fa90c0af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa90bfff640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa90c15e5a0 0x7fa90c0af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa90bfff640 1 -- 172.21.15.113:0/3891485558 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904009b30 con 0x7fa90c15f680 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa90bfff640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c15f680 0x7fa90c14e310 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa904036040 tx=0x7fa904004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa8f3fff640 1 -- 172.21.15.113:0/3891485558 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90403e450 con 0x7fa90c15f680 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa8f3fff640 1 -- 172.21.15.113:0/3891485558 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90403e5b0 con 0x7fa90c15f680 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa8f3fff640 1 -- 172.21.15.113:0/3891485558 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90403e960 con 0x7fa90c15f680 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.280+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c1551d0 con 0x7fa90c15f680 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.281+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c14e850 con 0x7fa90c15f680 2023-12-19T13:48:15.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.282+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c061910 con 0x7fa90c15f680 2023-12-19T13:48:15.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.282+0000 7fa8f3fff640 1 -- 172.21.15.113:0/3891485558 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa90403eac0 con 0x7fa90c15f680 2023-12-19T13:48:15.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.284+0000 7fa8f3fff640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8f806a430 0x7fa8f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.284+0000 7fa8f3fff640 1 -- 172.21.15.113:0/3891485558 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa9040ab520 con 0x7fa90c15f680 2023-12-19T13:48:15.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.284+0000 7fa90b7fe640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8f806a430 0x7fa8f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.285+0000 7fa90b7fe640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8f806a430 0x7fa8f806c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc006fd0 tx=0x7fa8fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:15.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.288+0000 7fa8f3fff640 1 -- 172.21.15.113:0/3891485558 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa904076e00 con 0x7fa90c15f680 2023-12-19T13:48:15.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.540+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fa90c0ce980 con 0x7fa90c15f680 2023-12-19T13:48:15.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.614+0000 7fa8f3fff640 1 -- 172.21.15.113:0/3891485558 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v115) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa90407a420 con 0x7fa90c15f680 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.617+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8f806a430 msgr2=0x7fa8f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.617+0000 7fa910e62640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8f806a430 0x7fa8f806c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc006fd0 tx=0x7fa8fc008040 comp rx=0 tx=0).stop 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.617+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c15f680 msgr2=0x7fa90c14e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.617+0000 7fa910e62640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c15f680 0x7fa90c14e310 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa904036040 tx=0x7fa904004a40 comp rx=0 tx=0).stop 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 shutdown_connections 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8f806a430 0x7fa8f806c8f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa90c15f680 0x7fa90c14e310 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa90c15e5a0 0x7fa90c0af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 --2- 172.21.15.113:0/3891485558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa90c0cdbf0 0x7fa90c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 >> 172.21.15.113:0/3891485558 conn(0x7fa90c0b0100 msgr2=0x7fa90c0b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:15.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 shutdown_connections 2023-12-19T13:48:15.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.618+0000 7fa910e62640 1 -- 172.21.15.113:0/3891485558 wait complete. 2023-12-19T13:48:15.637 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-19T13:48:15.638 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T13:48:15.638 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:15.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.850+0000 7f151cbf6640 1 Processor -- start 2023-12-19T13:48:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.850+0000 7f151cbf6640 1 -- start start 2023-12-19T13:48:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.851+0000 7f151cbf6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f15181449e0 0x7f15180af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.851+0000 7f151cbf6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15180afb10 con 0x7f15180b0b50 2023-12-19T13:48:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.851+0000 7f151cbf6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151806bb30 con 0x7f151806c6b0 2023-12-19T13:48:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.851+0000 7f151cbf6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180b0070 con 0x7f15181449e0 2023-12-19T13:48:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f151659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f15181449e0 0x7f15180af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f151659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f15181449e0 0x7f15180af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42192/0 (socket says 172.21.15.113:42192) 2023-12-19T13:48:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f1515d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f15180b0b50 0x7f151806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57696/0 (socket says 172.21.15.113:57696) 2023-12-19T13:48:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f151659c640 1 -- 172.21.15.113:0/777841129 learned_addr learned my addr 172.21.15.113:0/777841129 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f151659c640 1 -- 172.21.15.113:0/777841129 >> v1:172.21.15.151:6789/0 conn(0x7f151806c6b0 legacy=0x7f15180b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f151659c640 1 -- 172.21.15.113:0/777841129 >> v1:172.21.15.113:6789/0 conn(0x7f15180b0b50 legacy=0x7f151806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f151659c640 1 -- 172.21.15.113:0/777841129 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180b0350 con 0x7f15181449e0 2023-12-19T13:48:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.852+0000 7f151559a640 1 -- 172.21.15.113:0/777841129 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676678645 0 0) 0x7f15180afb10 con 0x7f15180b0b50 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.853+0000 7f151659c640 1 --2- 172.21.15.113:0/777841129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180af5d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1508009870 tx=0x7f150802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5389798afef09f77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.853+0000 7f151559a640 1 -- 172.21.15.113:0/777841129 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508030850 con 0x7f15181449e0 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.853+0000 7f151559a640 1 -- 172.21.15.113:0/777841129 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15080309b0 con 0x7f15181449e0 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.853+0000 7f151559a640 1 -- 172.21.15.113:0/777841129 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508030d40 con 0x7f15181449e0 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.854+0000 7f151cbf6640 1 -- 172.21.15.113:0/777841129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 msgr2=0x7f15180af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.854+0000 7f151cbf6640 1 --2- 172.21.15.113:0/777841129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180af5d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1508009870 tx=0x7f150802b990 comp rx=0 tx=0).stop 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.854+0000 7f151cbf6640 1 -- 172.21.15.113:0/777841129 shutdown_connections 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.854+0000 7f151cbf6640 1 --2- 172.21.15.113:0/777841129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180af5d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.854+0000 7f151cbf6640 1 -- 172.21.15.113:0/777841129 >> 172.21.15.113:0/777841129 conn(0x7f15180cbb70 msgr2=0x7f15180cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.854+0000 7f151cbf6640 1 -- 172.21.15.113:0/777841129 shutdown_connections 2023-12-19T13:48:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.854+0000 7f151cbf6640 1 -- 172.21.15.113:0/777841129 wait complete. 2023-12-19T13:48:15.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.856+0000 7f151cbf6640 1 Processor -- start 2023-12-19T13:48:15.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.856+0000 7f151cbf6640 1 -- start start 2023-12-19T13:48:15.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f151cbf6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f151806c6b0 0x7f15181f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f151cbf6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15180b0b50 0x7f15181f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f151cbf6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f151cbf6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151813d2e0 con 0x7f15181449e0 2023-12-19T13:48:15.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f151cbf6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15181f09f0 con 0x7f15180b0b50 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f151cbf6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151813c6a0 con 0x7f151806c6b0 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f1516d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f1516d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42194/0 (socket says 172.21.15.113:42194) 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.857+0000 7f1516d9d640 1 -- 172.21.15.113:0/3399326733 learned_addr learned my addr 172.21.15.113:0/3399326733 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f1516d9d640 1 -- 172.21.15.113:0/3399326733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f151806c6b0 msgr2=0x7f15181f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f1516d9d640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f151806c6b0 0x7f15181f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f1516d9d640 1 -- 172.21.15.113:0/3399326733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15180b0b50 msgr2=0x7f15181f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f1515d9b640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15180b0b50 0x7f15181f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f1516d9d640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15180b0b50 0x7f15181f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f1516d9d640 1 -- 172.21.15.113:0/3399326733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080094d0 con 0x7f15181449e0 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f1516d9d640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180703b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f151000c390 tx=0x7f151000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f150effd640 1 -- 172.21.15.113:0/3399326733 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15100035f0 con 0x7f15181449e0 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f150effd640 1 -- 172.21.15.113:0/3399326733 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1510003750 con 0x7f15181449e0 2023-12-19T13:48:15.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f150effd640 1 -- 172.21.15.113:0/3399326733 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510003b00 con 0x7f15181449e0 2023-12-19T13:48:15.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151813c940 con 0x7f15181449e0 2023-12-19T13:48:15.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.858+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151813cf00 con 0x7f15181449e0 2023-12-19T13:48:15.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.859+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1518061910 con 0x7f15181449e0 2023-12-19T13:48:15.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.860+0000 7f150effd640 1 -- 172.21.15.113:0/3399326733 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1510003c60 con 0x7f15181449e0 2023-12-19T13:48:15.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.861+0000 7f150effd640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:15.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.861+0000 7f150effd640 1 -- 172.21.15.113:0/3399326733 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1510087920 con 0x7f15181449e0 2023-12-19T13:48:15.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.862+0000 7f151659c640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:15.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.862+0000 7f151659c640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f14f806a430 0x7f14f806c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1508036000 tx=0x7f150803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:15.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:15.866+0000 7f150effd640 1 -- 172.21.15.113:0/3399326733 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1510053170 con 0x7f15181449e0 2023-12-19T13:48:16.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.058+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15180ae560 con 0x7f15181449e0 2023-12-19T13:48:16.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.060+0000 7f150effd640 1 -- 172.21.15.113:0/3399326733 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12568 (secure 0 0 0) 0x7f1510017090 con 0x7f15181449e0 2023-12-19T13:48:16.061 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:16.062 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":39,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:48:14.587626+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:6835/2023707761":"2023-12-20T13:48:11.231052+0000","172.21.15.151:6833/2023707761":"2023-12-20T13:48:11.231052+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:16.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.062+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f14f806a430 msgr2=0x7f14f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.062+0000 7f151cbf6640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f14f806a430 0x7f14f806c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1508036000 tx=0x7f150803b040 comp rx=0 tx=0).stop 2023-12-19T13:48:16.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 msgr2=0x7f15180703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180703b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f151000c390 tx=0x7f151000c850 comp rx=0 tx=0).stop 2023-12-19T13:48:16.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 shutdown_connections 2023-12-19T13:48:16.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15181449e0 0x7f15180703b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15180b0b50 0x7f15181f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 --2- 172.21.15.113:0/3399326733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f151806c6b0 0x7f15181f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 >> 172.21.15.113:0/3399326733 conn(0x7f15180cbb70 msgr2=0x7f151815b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:16.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 shutdown_connections 2023-12-19T13:48:16.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.063+0000 7f151cbf6640 1 -- 172.21.15.113:0/3399326733 wait complete. 2023-12-19T13:48:16.082 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:48:16.083 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:48:16.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.296+0000 7fafb8057640 1 Processor -- start 2023-12-19T13:48:16.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.296+0000 7fafb8057640 1 -- start start 2023-12-19T13:48:16.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb8057640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fafb015b1d0 0x7fafb00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb8057640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb00b1ec0 0x7fafb015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb8057640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb015ef10 con 0x7fafb00ceea0 2023-12-19T13:48:16.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb8057640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00b2320 con 0x7fafb015b1d0 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb8057640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00b2e40 con 0x7fafb00b1ec0 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb5df3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fafb015b1d0 0x7fafb00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb5df3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fafb015b1d0 0x7fafb00b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42196/0 (socket says 172.21.15.113:42196) 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.298+0000 7fafb5df3640 1 -- 172.21.15.113:0/75557248 learned_addr learned my addr 172.21.15.113:0/75557248 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.299+0000 7fafb55f2640 1 --2- 172.21.15.113:0/75557248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb00b1ec0 0x7fafb015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.299+0000 7fafb5df3640 1 -- 172.21.15.113:0/75557248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb00b1ec0 msgr2=0x7fafb015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.299+0000 7fafb5df3640 1 --2- 172.21.15.113:0/75557248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb00b1ec0 0x7fafb015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.299+0000 7fafb5df3640 1 -- 172.21.15.113:0/75557248 >> v1:172.21.15.113:6789/0 conn(0x7fafb00ceea0 legacy=0x7fafb006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.299+0000 7fafb5df3640 1 -- 172.21.15.113:0/75557248 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00b3120 con 0x7fafb015b1d0 2023-12-19T13:48:16.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.300+0000 7fafb5df3640 1 --2- 172.21.15.113:0/75557248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb015b1d0 0x7fafb00b2760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fafac009e50 tx=0x7fafac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b607444dd6107074 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:16.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.300+0000 7fafb4df1640 1 -- 172.21.15.113:0/75557248 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac02cb00 con 0x7fafb015b1d0 2023-12-19T13:48:16.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.300+0000 7fafb4df1640 1 -- 172.21.15.113:0/75557248 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac02cc60 con 0x7fafb015b1d0 2023-12-19T13:48:16.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.300+0000 7fafb4df1640 1 -- 172.21.15.113:0/75557248 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0343f0 con 0x7fafb015b1d0 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 -- 172.21.15.113:0/75557248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb015b1d0 msgr2=0x7fafb00b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 --2- 172.21.15.113:0/75557248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb015b1d0 0x7fafb00b2760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fafac009e50 tx=0x7fafac02bf60 comp rx=0 tx=0).stop 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 -- 172.21.15.113:0/75557248 shutdown_connections 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 --2- 172.21.15.113:0/75557248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb00b1ec0 0x7fafb015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 --2- 172.21.15.113:0/75557248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb015b1d0 0x7fafb00b2760 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 -- 172.21.15.113:0/75557248 >> 172.21.15.113:0/75557248 conn(0x7fafb0073150 msgr2=0x7fafb00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 -- 172.21.15.113:0/75557248 shutdown_connections 2023-12-19T13:48:16.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.301+0000 7fafb8057640 1 -- 172.21.15.113:0/75557248 wait complete. 2023-12-19T13:48:16.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.303+0000 7fafb8057640 1 Processor -- start 2023-12-19T13:48:16.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.303+0000 7fafb8057640 1 -- start start 2023-12-19T13:48:16.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb8057640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb00b1ec0 0x7fafb014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb8057640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00ceea0 0x7fafb0151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb8057640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb015b1d0 0x7fafb00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb8057640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cd880 con 0x7fafb00ceea0 2023-12-19T13:48:16.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb8057640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01e4b00 con 0x7fafb00b1ec0 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb8057640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01e44f0 con 0x7fafb015b1d0 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb55f2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00ceea0 0x7fafb0151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb55f2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00ceea0 0x7fafb0151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42210/0 (socket says 172.21.15.113:42210) 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.304+0000 7fafb55f2640 1 -- 172.21.15.113:0/2069325354 learned_addr learned my addr 172.21.15.113:0/2069325354 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb55f2640 1 -- 172.21.15.113:0/2069325354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb015b1d0 msgr2=0x7fafb00ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb55f2640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb015b1d0 0x7fafb00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb55f2640 1 -- 172.21.15.113:0/2069325354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb00b1ec0 msgr2=0x7fafb014d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb55f2640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb00b1ec0 0x7fafb014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb55f2640 1 -- 172.21.15.113:0/2069325354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac009b30 con 0x7fafb00ceea0 2023-12-19T13:48:16.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb55f2640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00ceea0 0x7fafb0151f50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fafa000d5f0 tx=0x7fafa000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:16.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafa67fc640 1 -- 172.21.15.113:0/2069325354 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00125f0 con 0x7fafb00ceea0 2023-12-19T13:48:16.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafa67fc640 1 -- 172.21.15.113:0/2069325354 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0012750 con 0x7fafb00ceea0 2023-12-19T13:48:16.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafa67fc640 1 -- 172.21.15.113:0/2069325354 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0012b00 con 0x7fafb00ceea0 2023-12-19T13:48:16.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00cd5a0 con 0x7fafb00ceea0 2023-12-19T13:48:16.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.305+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb014d670 con 0x7fafb00ceea0 2023-12-19T13:48:16.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.306+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb01e4350 con 0x7fafb00ceea0 2023-12-19T13:48:16.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.307+0000 7fafa67fc640 1 -- 172.21.15.113:0/2069325354 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fafa0012c60 con 0x7fafb00ceea0 2023-12-19T13:48:16.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.308+0000 7fafa67fc640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf9406a460 0x7faf9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.308+0000 7fafa67fc640 1 -- 172.21.15.113:0/2069325354 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fafa0088ad0 con 0x7fafb00ceea0 2023-12-19T13:48:16.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.308+0000 7fafb5df3640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf9406a460 0x7faf9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.309+0000 7fafb5df3640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf9406a460 0x7faf9406c920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafac035000 tx=0x7fafac02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:16.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.313+0000 7fafa67fc640 1 -- 172.21.15.113:0/2069325354 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fafb01e4350 con 0x7fafb00ceea0 2023-12-19T13:48:16.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.488+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafb01e4350 con 0x7fafb00ceea0 2023-12-19T13:48:16.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.489+0000 7fafa67fc640 1 -- 172.21.15.113:0/2069325354 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafb01e4350 con 0x7fafb00ceea0 2023-12-19T13:48:16.489 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:48:16.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf9406a460 msgr2=0x7faf9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf9406a460 0x7faf9406c920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafac035000 tx=0x7fafac02e000 comp rx=0 tx=0).stop 2023-12-19T13:48:16.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00ceea0 msgr2=0x7fafb0151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00ceea0 0x7fafb0151f50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fafa000d5f0 tx=0x7fafa000dab0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 shutdown_connections 2023-12-19T13:48:16.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf9406a460 0x7faf9406c920 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb015b1d0 0x7fafb00ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00ceea0 0x7fafb0151f50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 --2- 172.21.15.113:0/2069325354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb00b1ec0 0x7fafb014d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 >> 172.21.15.113:0/2069325354 conn(0x7fafb0073150 msgr2=0x7fafb00af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:16.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 shutdown_connections 2023-12-19T13:48:16.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.491+0000 7fafb8057640 1 -- 172.21.15.113:0/2069325354 wait complete. 2023-12-19T13:48:16.510 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-19T13:48:16.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.718+0000 7f11753d9640 1 Processor -- start 2023-12-19T13:48:16.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.718+0000 7f11753d9640 1 -- start start 2023-12-19T13:48:16.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f11753d9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1170146e10 0x7f11700d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f11753d9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700ce110 0x7f11700ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f11753d9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700cd840 con 0x7f11700d2b00 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f11753d9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700d2430 con 0x7f1170146e10 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f11753d9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700ceac0 con 0x7f11700ce110 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f116effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1170146e10 0x7f11700d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f116effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1170146e10 0x7f11700d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42226/0 (socket says 172.21.15.113:42226) 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.720+0000 7f116effd640 1 -- 172.21.15.113:0/2065338478 learned_addr learned my addr 172.21.15.113:0/2065338478 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.721+0000 7f116effd640 1 -- 172.21.15.113:0/2065338478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700ce110 msgr2=0x7f11700ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.721+0000 7f116effd640 1 --2- 172.21.15.113:0/2065338478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700ce110 0x7f11700ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.721+0000 7f116effd640 1 -- 172.21.15.113:0/2065338478 >> v1:172.21.15.151:6789/0 conn(0x7f11700d2b00 legacy=0x7f11700b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:16.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.721+0000 7f116effd640 1 -- 172.21.15.113:0/2065338478 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700b6e90 con 0x7f1170146e10 2023-12-19T13:48:16.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.722+0000 7f116effd640 1 --2- 172.21.15.113:0/2065338478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170146e10 0x7f11700d1ef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e80 tx=0x7f116802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334b8627f97bf77a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:16.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.722+0000 7f116dffb640 1 -- 172.21.15.113:0/2065338478 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116802ca50 con 0x7f1170146e10 2023-12-19T13:48:16.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.722+0000 7f116dffb640 1 -- 172.21.15.113:0/2065338478 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116802cbb0 con 0x7f1170146e10 2023-12-19T13:48:16.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.722+0000 7f116dffb640 1 -- 172.21.15.113:0/2065338478 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680343f0 con 0x7f1170146e10 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 -- 172.21.15.113:0/2065338478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170146e10 msgr2=0x7f11700d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 --2- 172.21.15.113:0/2065338478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170146e10 0x7f11700d1ef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e80 tx=0x7f116802beb0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 -- 172.21.15.113:0/2065338478 shutdown_connections 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 --2- 172.21.15.113:0/2065338478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700ce110 0x7f11700ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 --2- 172.21.15.113:0/2065338478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170146e10 0x7f11700d1ef0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 -- 172.21.15.113:0/2065338478 >> 172.21.15.113:0/2065338478 conn(0x7f11700b29c0 msgr2=0x7f11700b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 -- 172.21.15.113:0/2065338478 shutdown_connections 2023-12-19T13:48:16.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.723+0000 7f11753d9640 1 -- 172.21.15.113:0/2065338478 wait complete. 2023-12-19T13:48:16.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.725+0000 7f11753d9640 1 Processor -- start 2023-12-19T13:48:16.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.725+0000 7f11753d9640 1 -- start start 2023-12-19T13:48:16.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f11753d9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11700ce110 0x7f11700ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f11753d9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700d2b00 0x7f117014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f11753d9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1170146e10 0x7f117014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f11753d9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117014e3f0 con 0x7f11700ce110 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f11753d9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117014e6d0 con 0x7f1170146e10 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f11753d9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117014e9b0 con 0x7f11700d2b00 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11700ce110 0x7f11700ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11700ce110 0x7f11700ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:42240/0 (socket says 172.21.15.113:42240) 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 -- 172.21.15.113:0/1764699610 learned_addr learned my addr 172.21.15.113:0/1764699610 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700d2b00 0x7f117014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116f7fe640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1170146e10 0x7f117014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 -- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700d2b00 msgr2=0x7f117014d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700d2b00 0x7f117014d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 -- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1170146e10 msgr2=0x7f117014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:16.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1170146e10 0x7f117014dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116effd640 1 -- 172.21.15.113:0/1764699610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1168009b30 con 0x7f11700ce110 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700d2b00 0x7f117014d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.726+0000 7f116f7fe640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1170146e10 0x7f117014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.727+0000 7f116effd640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11700ce110 0x7f11700ccb40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1168036040 tx=0x7f1168004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.727+0000 7f11677fe640 1 -- 172.21.15.113:0/1764699610 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168009510 con 0x7f11700ce110 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.727+0000 7f11677fe640 1 -- 172.21.15.113:0/1764699610 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116803e450 con 0x7f11700ce110 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.727+0000 7f11677fe640 1 -- 172.21.15.113:0/1764699610 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116803e820 con 0x7f11700ce110 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.727+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117014ec90 con 0x7f11700ce110 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.727+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117014e110 con 0x7f11700ce110 2023-12-19T13:48:16.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.728+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170061910 con 0x7f11700ce110 2023-12-19T13:48:16.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.729+0000 7f11677fe640 1 -- 172.21.15.113:0/1764699610 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f116803e980 con 0x7f11700ce110 2023-12-19T13:48:16.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.730+0000 7f11677fe640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f115006a430 0x7f115006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:16.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.730+0000 7f11677fe640 1 -- 172.21.15.113:0/1764699610 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f11680ab510 con 0x7f11700ce110 2023-12-19T13:48:16.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.730+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f115006a430 0x7f115006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:16.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.731+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f115006a430 0x7f115006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1170160890 tx=0x7f1160009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:16.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.734+0000 7f11677fe640 1 -- 172.21.15.113:0/1764699610 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1168076e00 con 0x7f11700ce110 2023-12-19T13:48:16.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:16.994+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f11700b6360 con 0x7f11700ce110 2023-12-19T13:48:17.307 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:17.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:17.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.628+0000 7f11677fe640 1 -- 172.21.15.113:0/1764699610 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v117) v1 ==== 145+0+0 (secure 0 0 0) 0x7f116807a420 con 0x7f11700ce110 2023-12-19T13:48:17.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.631+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f115006a430 msgr2=0x7f115006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:17.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.631+0000 7f11753d9640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f115006a430 0x7f115006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1170160890 tx=0x7f1160009040 comp rx=0 tx=0).stop 2023-12-19T13:48:17.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.631+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11700ce110 msgr2=0x7f11700ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:17.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.631+0000 7f11753d9640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11700ce110 0x7f11700ccb40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1168036040 tx=0x7f1168004a40 comp rx=0 tx=0).stop 2023-12-19T13:48:17.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 shutdown_connections 2023-12-19T13:48:17.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f115006a430 0x7f115006c8f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:17.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1170146e10 0x7f117014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:17.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11700d2b00 0x7f117014d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:17.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 --2- 172.21.15.113:0/1764699610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11700ce110 0x7f11700ccb40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:17.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 >> 172.21.15.113:0/1764699610 conn(0x7f11700b29c0 msgr2=0x7f1170161010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:17.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 shutdown_connections 2023-12-19T13:48:17.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:17.632+0000 7f11753d9640 1 -- 172.21.15.113:0/1764699610 wait complete. 2023-12-19T13:48:17.653 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T13:48:17.873 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_objectstore":"memstore"} 2023-12-19T13:48:17.874 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T13:48:17.874 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:48:18.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.089+0000 7f2409188640 1 Processor -- start 2023-12-19T13:48:18.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.089+0000 7f2409188640 1 -- start start 2023-12-19T13:48:18.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.091+0000 7f2409188640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040b8890 0x7f240415d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:18.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.091+0000 7f2409188640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2404071030 0x7f24040d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:18.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.091+0000 7f2409188640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24040d2ec0 con 0x7f24040d2a40 2023-12-19T13:48:18.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.091+0000 7f2409188640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040d26d0 con 0x7f2404071030 2023-12-19T13:48:18.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.091+0000 7f2409188640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2404140830 con 0x7f24040b8890 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.092+0000 7f2408987640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2404071030 0x7f24040d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.092+0000 7f2403fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040b8890 0x7f240415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.092+0000 7f2408987640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2404071030 0x7f24040d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:57380/0 (socket says 172.21.15.113:57380) 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.092+0000 7f2403fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040b8890 0x7f240415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:59764/0 (socket says 172.21.15.113:59764) 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.092+0000 7f2408987640 1 -- 172.21.15.113:0/1918664307 learned_addr learned my addr 172.21.15.113:0/1918664307 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.093+0000 7f2408987640 1 -- 172.21.15.113:0/1918664307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040b8890 msgr2=0x7f240415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.093+0000 7f2408987640 1 --2- 172.21.15.113:0/1918664307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040b8890 0x7f240415d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.093+0000 7f2408987640 1 -- 172.21.15.113:0/1918664307 >> v1:172.21.15.151:6789/0 conn(0x7f24040d2a40 legacy=0x7f2404070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:18.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.093+0000 7f2408987640 1 -- 172.21.15.113:0/1918664307 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040b8c70 con 0x7f2404071030 2023-12-19T13:48:18.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.094+0000 7f2408987640 1 --2- 172.21.15.113:0/1918664307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2404071030 0x7f24040d0060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009e50 tx=0x7f23fc02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe7e73d7c6124ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:18.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2402ffd640 1 -- 172.21.15.113:0/1918664307 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc02cb00 con 0x7f2404071030 2023-12-19T13:48:18.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2402ffd640 1 -- 172.21.15.113:0/1918664307 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc02cc60 con 0x7f2404071030 2023-12-19T13:48:18.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2402ffd640 1 -- 172.21.15.113:0/1918664307 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0343f0 con 0x7f2404071030 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 -- 172.21.15.113:0/1918664307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2404071030 msgr2=0x7f24040d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 --2- 172.21.15.113:0/1918664307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2404071030 0x7f24040d0060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009e50 tx=0x7f23fc02bf60 comp rx=0 tx=0).stop 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 -- 172.21.15.113:0/1918664307 shutdown_connections 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 --2- 172.21.15.113:0/1918664307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2404071030 0x7f24040d0060 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 --2- 172.21.15.113:0/1918664307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040b8890 0x7f240415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 -- 172.21.15.113:0/1918664307 >> 172.21.15.113:0/1918664307 conn(0x7f24040d30b0 msgr2=0x7f24040d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 -- 172.21.15.113:0/1918664307 shutdown_connections 2023-12-19T13:48:18.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.095+0000 7f2409188640 1 -- 172.21.15.113:0/1918664307 wait complete. 2023-12-19T13:48:18.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.097+0000 7f2409188640 1 Processor -- start 2023-12-19T13:48:18.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.097+0000 7f2409188640 1 -- start start 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2409188640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2404071030 0x7f240414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2409188640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24040b8890 0x7f240415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2409188640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040d2a40 0x7f240415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2409188640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240414db00 con 0x7f2404071030 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2409188640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240414e360 con 0x7f24040b8890 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2409188640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24041f63e0 con 0x7f24040d2a40 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2403fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2404071030 0x7f240414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2403fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2404071030 0x7f240414e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60496/0 (socket says 172.21.15.113:60496) 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.098+0000 7f2403fff640 1 -- 172.21.15.113:0/2832084104 learned_addr learned my addr 172.21.15.113:0/2832084104 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f24037fe640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24040b8890 0x7f240415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2408987640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040d2a40 0x7f240415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2403fff640 1 -- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040d2a40 msgr2=0x7f240415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:18.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2403fff640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040d2a40 0x7f240415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2403fff640 1 -- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24040b8890 msgr2=0x7f240415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2403fff640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24040b8890 0x7f240415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2403fff640 1 -- 172.21.15.113:0/2832084104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc009b30 con 0x7f2404071030 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f24037fe640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24040b8890 0x7f240415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2403fff640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2404071030 0x7f240414e7f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f23f400e9b0 tx=0x7f23f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.099+0000 7f2400ff9640 1 -- 172.21.15.113:0/2832084104 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4009670 con 0x7f2404071030 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.100+0000 7f2400ff9640 1 -- 172.21.15.113:0/2832084104 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f400c9a0 con 0x7f2404071030 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.100+0000 7f2400ff9640 1 -- 172.21.15.113:0/2832084104 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400cd50 con 0x7f2404071030 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.100+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240414dd10 con 0x7f2404071030 2023-12-19T13:48:18.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.100+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24041f56d0 con 0x7f2404071030 2023-12-19T13:48:18.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.101+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2404061910 con 0x7f2404071030 2023-12-19T13:48:18.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.102+0000 7f2400ff9640 1 -- 172.21.15.113:0/2832084104 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23f4013470 con 0x7f2404071030 2023-12-19T13:48:18.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.103+0000 7f2400ff9640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23f006a460 0x7f23f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:18.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.103+0000 7f2400ff9640 1 -- 172.21.15.113:0/2832084104 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f23f40888d0 con 0x7f2404071030 2023-12-19T13:48:18.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.103+0000 7f24037fe640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23f006a460 0x7f23f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:18.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.104+0000 7f24037fe640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23f006a460 0x7f23f006c920 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f24041545b0 tx=0x7f23f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:18.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.107+0000 7f2400ff9640 1 -- 172.21.15.113:0/2832084104 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23f4054120 con 0x7f2404071030 2023-12-19T13:48:18.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.297+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f24040677f0 con 0x7f2404071030 2023-12-19T13:48:18.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.303+0000 7f2400ff9640 1 -- 172.21.15.113:0/2832084104 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f23f40170c0 con 0x7f2404071030 2023-12-19T13:48:18.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.306+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23f006a460 msgr2=0x7f23f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:18.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.306+0000 7f2409188640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23f006a460 0x7f23f006c920 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f24041545b0 tx=0x7f23f8009040 comp rx=0 tx=0).stop 2023-12-19T13:48:18.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.306+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2404071030 msgr2=0x7f240414e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.306+0000 7f2409188640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2404071030 0x7f240414e7f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f23f400e9b0 tx=0x7f23f400ee70 comp rx=0 tx=0).stop 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 shutdown_connections 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23f006a460 0x7f23f006c920 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24040d2a40 0x7f240415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24040b8890 0x7f240415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 --2- 172.21.15.113:0/2832084104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2404071030 0x7f240414e7f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 >> 172.21.15.113:0/2832084104 conn(0x7f24040d30b0 msgr2=0x7f24040cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 shutdown_connections 2023-12-19T13:48:18.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:18.307+0000 7f2409188640 1 -- 172.21.15.113:0/2832084104 wait complete. 2023-12-19T13:48:18.327 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:48:18.327 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:48:18.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:48:18.575 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:48:18.575 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:18.575 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:18.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:48:18.636 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:48:18.636 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:18.697 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:48:18.697 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:18.697 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:18.757 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:48:18.757 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:48:18.757 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:18.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:48:18.818 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:48:18.818 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:19.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.038+0000 7f86dcaa1640 1 Processor -- start 2023-12-19T13:48:19.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.038+0000 7f86dcaa1640 1 -- start start 2023-12-19T13:48:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.039+0000 7f86dcaa1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86d80b0b50 0x7f86d806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.039+0000 7f86dcaa1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d806b590 0x7f86d806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.039+0000 7f86dcaa1640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d806bb30 con 0x7f86d81449e0 2023-12-19T13:48:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.040+0000 7f86dcaa1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80b0070 con 0x7f86d80b0b50 2023-12-19T13:48:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.040+0000 7f86dcaa1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80b0350 con 0x7f86d806b590 2023-12-19T13:48:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.040+0000 7f86cdd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86d80b0b50 0x7f86d806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.040+0000 7f86cdd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86d80b0b50 0x7f86d806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60510/0 (socket says 172.21.15.113:60510) 2023-12-19T13:48:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.040+0000 7f86cdd9b640 1 -- 172.21.15.113:0/1639678856 learned_addr learned my addr 172.21.15.113:0/1639678856 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.040+0000 7f86d6d9d640 1 --2- 172.21.15.113:0/1639678856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d806b590 0x7f86d806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.041+0000 7f86cdd9b640 1 -- 172.21.15.113:0/1639678856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d806b590 msgr2=0x7f86d806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.041+0000 7f86cdd9b640 1 --2- 172.21.15.113:0/1639678856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d806b590 0x7f86d806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.041+0000 7f86cdd9b640 1 -- 172.21.15.113:0/1639678856 >> v1:172.21.15.151:6789/0 conn(0x7f86d81449e0 legacy=0x7f86d80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.041+0000 7f86cdd9b640 1 -- 172.21.15.113:0/1639678856 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80b0630 con 0x7f86d80b0b50 2023-12-19T13:48:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.042+0000 7f86cdd9b640 1 --2- 172.21.15.113:0/1639678856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d806bfa0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9df0adc1d0aa45 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:19.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.042+0000 7f86d5d9b640 1 -- 172.21.15.113:0/1639678856 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0031640 con 0x7f86d80b0b50 2023-12-19T13:48:19.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.042+0000 7f86d5d9b640 1 -- 172.21.15.113:0/1639678856 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00317a0 con 0x7f86d80b0b50 2023-12-19T13:48:19.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.042+0000 7f86d5d9b640 1 -- 172.21.15.113:0/1639678856 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0031b30 con 0x7f86d80b0b50 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 -- 172.21.15.113:0/1639678856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 msgr2=0x7f86d806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/1639678856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d806bfa0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 -- 172.21.15.113:0/1639678856 shutdown_connections 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/1639678856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d806b590 0x7f86d806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/1639678856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d806bfa0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 -- 172.21.15.113:0/1639678856 >> 172.21.15.113:0/1639678856 conn(0x7f86d80cbb70 msgr2=0x7f86d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 -- 172.21.15.113:0/1639678856 shutdown_connections 2023-12-19T13:48:19.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.043+0000 7f86dcaa1640 1 -- 172.21.15.113:0/1639678856 wait complete. 2023-12-19T13:48:19.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.045+0000 7f86dcaa1640 1 Processor -- start 2023-12-19T13:48:19.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.045+0000 7f86dcaa1640 1 -- start start 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86dcaa1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86d806b590 0x7f86d81f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86dcaa1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86dcaa1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d81449e0 0x7f86d80cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86dcaa1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d813e380 con 0x7f86d80b0b50 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86dcaa1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d815c330 con 0x7f86d806b590 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86dcaa1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d813d800 con 0x7f86d81449e0 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86cdd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86cdd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d80cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60522/0 (socket says 172.21.15.113:60522) 2023-12-19T13:48:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.046+0000 7f86cdd9b640 1 -- 172.21.15.113:0/3489436238 learned_addr learned my addr 172.21.15.113:0/3489436238 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:19.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86d659c640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86d806b590 0x7f86d81f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:19.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cdd9b640 1 -- 172.21.15.113:0/3489436238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d81449e0 msgr2=0x7f86d80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:19.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cdd9b640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d81449e0 0x7f86d80cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cdd9b640 1 -- 172.21.15.113:0/3489436238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86d806b590 msgr2=0x7f86d81f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cdd9b640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86d806b590 0x7f86d81f22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cdd9b640 1 -- 172.21.15.113:0/3489436238 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00094d0 con 0x7f86d80b0b50 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cdd9b640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d80cd3e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cf7fe640 1 -- 172.21.15.113:0/3489436238 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c003ac60 con 0x7f86d80b0b50 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cf7fe640 1 -- 172.21.15.113:0/3489436238 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c003adc0 con 0x7f86d80b0b50 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86cf7fe640 1 -- 172.21.15.113:0/3489436238 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0044630 con 0x7f86d80b0b50 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.047+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d813dae0 con 0x7f86d80b0b50 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.048+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d813e0a0 con 0x7f86d80b0b50 2023-12-19T13:48:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.049+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d8061910 con 0x7f86d80b0b50 2023-12-19T13:48:19.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.050+0000 7f86cf7fe640 1 -- 172.21.15.113:0/3489436238 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86c002f050 con 0x7f86d80b0b50 2023-12-19T13:48:19.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.050+0000 7f86cf7fe640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86b806a430 0x7f86b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:19.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.050+0000 7f86cf7fe640 1 -- 172.21.15.113:0/3489436238 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86c00aa530 con 0x7f86d80b0b50 2023-12-19T13:48:19.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.051+0000 7f86d659c640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86b806a430 0x7f86b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:19.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.051+0000 7f86d659c640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86b806a430 0x7f86b806c8f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86c800a750 tx=0x7f86c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:19.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.055+0000 7f86cf7fe640 1 -- 172.21.15.113:0/3489436238 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86c0075e20 con 0x7f86d80b0b50 2023-12-19T13:48:19.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.281+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d806e160 con 0x7f86d80b0b50 2023-12-19T13:48:19.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.282+0000 7f86cf7fe640 1 -- 172.21.15.113:0/3489436238 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f86c0035df0 con 0x7f86d80b0b50 2023-12-19T13:48:19.283 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:19.283 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1089768818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1089768818},{"type":"v1","addr":"172.21.15.151:6834","nonce":1089768818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4691,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/656915903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":656915903},{"type":"v1","addr":"172.21.15.151:6835","nonce":656915903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2992094432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2992094432},{"type":"v1","addr":"172.21.15.113:6835","nonce":2992094432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2701225253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2701225253},{"type":"v1","addr":"172.21.15.113:6837","nonce":2701225253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2023-12-19T13:48:19.283 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 18 2023-12-19T13:48:19.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.284+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86b806a430 msgr2=0x7f86b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:19.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86b806a430 0x7f86b806c8f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86c800a750 tx=0x7f86c8008040 comp rx=0 tx=0).stop 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 msgr2=0x7f86d80cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d80cd3e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c00046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 shutdown_connections 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86b806a430 0x7f86b806c8f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86d81449e0 0x7f86d80cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86d80b0b50 0x7f86d80cd3e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 --2- 172.21.15.113:0/3489436238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86d806b590 0x7f86d81f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 >> 172.21.15.113:0/3489436238 conn(0x7f86d80cbb70 msgr2=0x7f86d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 shutdown_connections 2023-12-19T13:48:19.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:19.285+0000 7f86dcaa1640 1 -- 172.21.15.113:0/3489436238 wait complete. 2023-12-19T13:48:19.304 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:48:19.304 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:48:19.305 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:48:19.305 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:48:19.305 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:48:19.305 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:48:19.305 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:48:19.305 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:48:19.305 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:48:19.306 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:48:19.306 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:48:19.306 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:48:19.306 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:48:19.306 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:48:19.306 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:48:19.306 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:48:19.325 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:48:19.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:48:19.326 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:48:19.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:48:19.328 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:48:19.328 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:48:19.374 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:48:19.374 DEBUG:teuthology.parallel:result is None 2023-12-19T13:48:19.377 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:48:19.377 DEBUG:teuthology.parallel:result is None 2023-12-19T13:48:19.382 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:48:19.382 DEBUG:teuthology.parallel:result is None 2023-12-19T13:48:19.535 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:48:19.539 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:48:19.561 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:48:23.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-19T13:48:25.328 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:48:25.328 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:48:25.338 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:48:25.338 DEBUG:teuthology.parallel:result is None 2023-12-19T13:48:25.338 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:48:25.514 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:48:25.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.549+0000 7f77dfbfd640 1 Processor -- start 2023-12-19T13:48:25.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.549+0000 7f77dfbfd640 1 -- start start 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.549+0000 7f77dfbfd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77d806e190 0x7f77d80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dfbfd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d80ce780 con 0x7f77d80af540 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dfbfd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d80cea60 con 0x7f77d81599c0 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dfbfd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d815daa0 con 0x7f77d806e190 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dd198640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77d806e190 0x7f77d80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77de19a640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f77d80af540 0x7f77d80ae130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:35994/0 (socket says 172.21.15.113:35994) 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77de19a640 1 -- 172.21.15.113:0/2513353593 learned_addr learned my addr 172.21.15.113:0/2513353593 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dd198640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77d806e190 0x7f77d80cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60546/0 (socket says 172.21.15.113:60546) 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dd198640 1 -- 172.21.15.113:0/2513353593 >> v1:172.21.15.151:6789/0 conn(0x7f77d81599c0 legacy=0x7f77d815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dd198640 1 -- 172.21.15.113:0/2513353593 >> v1:172.21.15.113:6789/0 conn(0x7f77d80af540 legacy=0x7f77d80ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:25.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dc997640 1 -- 172.21.15.113:0/2513353593 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117905615 0 0) 0x7f77d80ce780 con 0x7f77d80af540 2023-12-19T13:48:25.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.550+0000 7f77dd198640 1 -- 172.21.15.113:0/2513353593 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d815d6c0 con 0x7f77d806e190 2023-12-19T13:48:25.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.551+0000 7f77dd198640 1 --2- 172.21.15.113:0/2513353593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d806e190 0x7f77d80cdea0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f77c800ba40 tx=0x7f77c802dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d34d79edb9f0d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:25.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dc997640 1 -- 172.21.15.113:0/2513353593 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c802eb10 con 0x7f77d806e190 2023-12-19T13:48:25.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dc997640 1 -- 172.21.15.113:0/2513353593 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c8032070 con 0x7f77d806e190 2023-12-19T13:48:25.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dc997640 1 -- 172.21.15.113:0/2513353593 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c802ee90 con 0x7f77d806e190 2023-12-19T13:48:25.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dfbfd640 1 -- 172.21.15.113:0/2513353593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d806e190 msgr2=0x7f77d80cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:25.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/2513353593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d806e190 0x7f77d80cdea0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f77c800ba40 tx=0x7f77c802dd60 comp rx=0 tx=0).stop 2023-12-19T13:48:25.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dfbfd640 1 -- 172.21.15.113:0/2513353593 shutdown_connections 2023-12-19T13:48:25.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/2513353593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d806e190 0x7f77d80cdea0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:25.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dfbfd640 1 -- 172.21.15.113:0/2513353593 >> 172.21.15.113:0/2513353593 conn(0x7f77d80cbb70 msgr2=0x7f77d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:25.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dfbfd640 1 -- 172.21.15.113:0/2513353593 shutdown_connections 2023-12-19T13:48:25.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.552+0000 7f77dfbfd640 1 -- 172.21.15.113:0/2513353593 wait complete. 2023-12-19T13:48:25.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.555+0000 7f77dfbfd640 1 Processor -- start 2023-12-19T13:48:25.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.555+0000 7f77dfbfd640 1 -- start start 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.556+0000 7f77dfbfd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77d806e190 0x7f77d814ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.556+0000 7f77dfbfd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d80af540 0x7f77d80ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.556+0000 7f77dfbfd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77d81599c0 0x7f77d80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.556+0000 7f77dfbfd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d815af70 con 0x7f77d80af540 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.556+0000 7f77dfbfd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d814b360 con 0x7f77d81599c0 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.556+0000 7f77dfbfd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d815b210 con 0x7f77d806e190 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d80af540 0x7f77d80ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d80af540 0x7f77d80ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60560/0 (socket says 172.21.15.113:60560) 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 -- 172.21.15.113:0/728263802 learned_addr learned my addr 172.21.15.113:0/728263802 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:25.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd999640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77d806e190 0x7f77d814ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77de19a640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77d81599c0 0x7f77d80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 -- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77d806e190 msgr2=0x7f77d814ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77d806e190 0x7f77d814ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 -- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77d81599c0 msgr2=0x7f77d80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77d81599c0 0x7f77d80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 -- 172.21.15.113:0/728263802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c800b6a0 con 0x7f77d80af540 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77de19a640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77d81599c0 0x7f77d80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:25.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.557+0000 7f77dd198640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d80af540 0x7f77d80ad500 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f77c803a040 tx=0x7f77c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:25.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.558+0000 7f77ce7fc640 1 -- 172.21.15.113:0/728263802 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8046070 con 0x7f77d80af540 2023-12-19T13:48:25.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.558+0000 7f77ce7fc640 1 -- 172.21.15.113:0/728263802 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c8038de0 con 0x7f77d80af540 2023-12-19T13:48:25.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.558+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d815b4f0 con 0x7f77d80af540 2023-12-19T13:48:25.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.558+0000 7f77ce7fc640 1 -- 172.21.15.113:0/728263802 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8042650 con 0x7f77d80af540 2023-12-19T13:48:25.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.558+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d815bab0 con 0x7f77d80af540 2023-12-19T13:48:25.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.559+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d815bca0 con 0x7f77d80af540 2023-12-19T13:48:25.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.560+0000 7f77ce7fc640 1 -- 172.21.15.113:0/728263802 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77c80427b0 con 0x7f77d80af540 2023-12-19T13:48:25.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.562+0000 7f77ce7fc640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77bc06a430 0x7f77bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:25.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.562+0000 7f77ce7fc640 1 -- 172.21.15.113:0/728263802 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f77c80aaa20 con 0x7f77d80af540 2023-12-19T13:48:25.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.562+0000 7f77dd999640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77bc06a430 0x7f77bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:25.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.563+0000 7f77dd999640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77bc06a430 0x7f77bc06c8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006fd0 tx=0x7f77d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:25.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.567+0000 7f77ce7fc640 1 -- 172.21.15.113:0/728263802 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f77c8076310 con 0x7f77d80af540 2023-12-19T13:48:25.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:25.772+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f77d8061910 con 0x7f77d80af540 2023-12-19T13:48:26.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.541+0000 7f77ce7fc640 1 -- 172.21.15.113:0/728263802 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7f77c8079930 con 0x7f77d80af540 2023-12-19T13:48:26.541 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77bc06a430 msgr2=0x7f77bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77bc06a430 0x7f77bc06c8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006fd0 tx=0x7f77d4008040 comp rx=0 tx=0).stop 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d80af540 msgr2=0x7f77d80ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d80af540 0x7f77d80ad500 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f77c803a040 tx=0x7f77c80046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 shutdown_connections 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77bc06a430 0x7f77bc06c8f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77d81599c0 0x7f77d80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d80af540 0x7f77d80ad500 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 --2- 172.21.15.113:0/728263802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77d806e190 0x7f77d814ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 >> 172.21.15.113:0/728263802 conn(0x7f77d80cbb70 msgr2=0x7f77d815dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:26.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 shutdown_connections 2023-12-19T13:48:26.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.545+0000 7f77dfbfd640 1 -- 172.21.15.113:0/728263802 wait complete. 2023-12-19T13:48:26.566 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:48:26.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.754+0000 7f4fd6570640 1 Processor -- start 2023-12-19T13:48:26.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.754+0000 7f4fd6570640 1 -- start start 2023-12-19T13:48:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.755+0000 7f4fd6570640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd0161810 0x7f4fd00cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.755+0000 7f4fd6570640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4fd00cc8a0 0x7f4fd00cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.755+0000 7f4fd6570640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd00b22b0 con 0x7f4fd00ce490 2023-12-19T13:48:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.755+0000 7f4fd6570640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd0161bf0 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.755+0000 7f4fd6570640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd00b2830 con 0x7f4fd0161810 2023-12-19T13:48:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fd4d6d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4fd00cc8a0 0x7f4fd00cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fd5d6f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4fd00ce490 0x7f4fd0165260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36008/0 (socket says 172.21.15.113:36008) 2023-12-19T13:48:26.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fd5d6f640 1 -- 172.21.15.113:0/2730779513 learned_addr learned my addr 172.21.15.113:0/2730779513 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:26.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fd4d6d640 1 -- 172.21.15.113:0/2730779513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd0161810 msgr2=0x7f4fd00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:26.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fd4d6d640 1 --2- 172.21.15.113:0/2730779513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd0161810 0x7f4fd00cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fd4d6d640 1 -- 172.21.15.113:0/2730779513 >> v1:172.21.15.113:6789/0 conn(0x7f4fd00ce490 legacy=0x7f4fd0165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:26.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fd4d6d640 1 -- 172.21.15.113:0/2730779513 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd00b2550 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.756+0000 7f4fc7fff640 1 -- 172.21.15.113:0/2730779513 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657090952 0 0) 0x7f4fd00b22b0 con 0x7f4fd00ce490 2023-12-19T13:48:26.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.757+0000 7f4fd4d6d640 1 --2- 172.21.15.113:0/2730779513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd00cdf50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a040f22b925aa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.757+0000 7f4fc7fff640 1 -- 172.21.15.113:0/2730779513 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc002e070 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.757+0000 7f4fc7fff640 1 -- 172.21.15.113:0/2730779513 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc00315a0 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.757+0000 7f4fc7fff640 1 -- 172.21.15.113:0/2730779513 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0031930 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 -- 172.21.15.113:0/2730779513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 msgr2=0x7f4fd00cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2730779513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd00cdf50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002b840 comp rx=0 tx=0).stop 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 -- 172.21.15.113:0/2730779513 shutdown_connections 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2730779513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd00cdf50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2730779513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd0161810 0x7f4fd00cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 -- 172.21.15.113:0/2730779513 >> 172.21.15.113:0/2730779513 conn(0x7f4fd00b0100 msgr2=0x7f4fd00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 -- 172.21.15.113:0/2730779513 shutdown_connections 2023-12-19T13:48:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.758+0000 7f4fd6570640 1 -- 172.21.15.113:0/2730779513 wait complete. 2023-12-19T13:48:26.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.760+0000 7f4fd6570640 1 Processor -- start 2023-12-19T13:48:26.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.760+0000 7f4fd6570640 1 -- start start 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd6570640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd01504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd6570640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd00ce490 0x7f4fd0161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd6570640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fd0161810 0x7f4fd006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd6570640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd01509f0 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd6570640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd0162710 con 0x7f4fd0161810 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd6570640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd01629f0 con 0x7f4fd00ce490 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd01504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd01504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60586/0 (socket says 172.21.15.113:60586) 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 -- 172.21.15.113:0/2642111398 learned_addr learned my addr 172.21.15.113:0/2642111398 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 -- 172.21.15.113:0/2642111398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd00ce490 msgr2=0x7f4fd0161d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd00ce490 0x7f4fd0161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 -- 172.21.15.113:0/2642111398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fd0161810 msgr2=0x7f4fd006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:26.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fd0161810 0x7f4fd006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:26.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 -- 172.21.15.113:0/2642111398 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009400 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.761+0000 7f4fd556e640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd01504b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00b4a0 tx=0x7f4fcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:26.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.762+0000 7f4fc5ffb640 1 -- 172.21.15.113:0/2642111398 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc010610 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.762+0000 7f4fc5ffb640 1 -- 172.21.15.113:0/2642111398 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc010770 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.762+0000 7f4fc5ffb640 1 -- 172.21.15.113:0/2642111398 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc010b20 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.762+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd0162cd0 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.762+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd0163290 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.763+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd0061910 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.764+0000 7f4fc5ffb640 1 -- 172.21.15.113:0/2642111398 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4fcc010c80 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.765+0000 7f4fc5ffb640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4fb406a460 0x7f4fb406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:26.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.765+0000 7f4fc5ffb640 1 -- 172.21.15.113:0/2642111398 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4fcc0881f0 con 0x7f4fd00cc8a0 2023-12-19T13:48:26.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.765+0000 7f4fd4d6d640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4fb406a460 0x7f4fb406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:26.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.766+0000 7f4fd4d6d640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4fb406a460 0x7f4fb406c920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0036000 tx=0x7f4fc0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:26.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:26.770+0000 7f4fc5ffb640 1 -- 172.21.15.113:0/2642111398 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4fcc053b20 con 0x7f4fd00cc8a0 2023-12-19T13:48:27.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.005+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4fd00afee0 con 0x7f4fd00cc8a0 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.006+0000 7f4fc5ffb640 1 -- 172.21.15.113:0/2642111398 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4fcc057140 con 0x7f4fd00cc8a0 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.006 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.007 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:48:27.008 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.012 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.013 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.014 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:48:27.017 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.018 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:27.019 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:48:27.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4fb406a460 msgr2=0x7f4fb406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4fb406a460 0x7f4fb406c920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0036000 tx=0x7f4fc0030000 comp rx=0 tx=0).stop 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 msgr2=0x7f4fd01504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd01504b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00b4a0 tx=0x7f4fcc00b960 comp rx=0 tx=0).stop 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 shutdown_connections 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4fb406a460 0x7f4fb406c920 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fd0161810 0x7f4fd006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fd00ce490 0x7f4fd0161d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 --2- 172.21.15.113:0/2642111398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fd00cc8a0 0x7f4fd01504b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 >> 172.21.15.113:0/2642111398 conn(0x7f4fd00b0100 msgr2=0x7f4fd00b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 shutdown_connections 2023-12-19T13:48:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.009+0000 7f4fd6570640 1 -- 172.21.15.113:0/2642111398 wait complete. 2023-12-19T13:48:27.027 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.228+0000 7fb5cc500640 1 Processor -- start 2023-12-19T13:48:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.228+0000 7fb5cc500640 1 -- start start 2023-12-19T13:48:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.230+0000 7fb5cc500640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c41449e0 0x7fb5c40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.230+0000 7fb5cc500640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5c40b0b50 0x7fb5c406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.230+0000 7fb5cc500640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c40afb10 con 0x7fb5c406b590 2023-12-19T13:48:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.230+0000 7fb5cc500640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c406bb30 con 0x7fb5c40b0b50 2023-12-19T13:48:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.230+0000 7fb5cc500640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40b0070 con 0x7fb5c41449e0 2023-12-19T13:48:27.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.231+0000 7fb5c9a9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5c40b0b50 0x7fb5c406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.231+0000 7fb5ca29c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c41449e0 0x7fb5c40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.231+0000 7fb5c9a9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5c40b0b50 0x7fb5c406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:57470/0 (socket says 172.21.15.113:57470) 2023-12-19T13:48:27.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.231+0000 7fb5c9a9b640 1 -- 172.21.15.113:0/1393952741 learned_addr learned my addr 172.21.15.113:0/1393952741 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.232+0000 7fb5c9a9b640 1 -- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c41449e0 msgr2=0x7fb5c40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.232+0000 7fb5c9a9b640 1 --2- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c41449e0 0x7fb5c40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.232+0000 7fb5c9a9b640 1 -- 172.21.15.113:0/1393952741 >> v1:172.21.15.151:6789/0 conn(0x7fb5c406b590 legacy=0x7fb5c415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.232+0000 7fb5c9a9b640 1 -- 172.21.15.113:0/1393952741 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40b0350 con 0x7fb5c40b0b50 2023-12-19T13:48:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.232+0000 7fb5c929a640 1 -- 172.21.15.113:0/1393952741 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980502638 0 0) 0x7fb5c40afb10 con 0x7fb5c406b590 2023-12-19T13:48:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.232+0000 7fb5ca29c640 1 --2- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c41449e0 0x7fb5c40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:48:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.233+0000 7fb5c9a9b640 1 --2- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c40b0b50 0x7fb5c406bfa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009870 tx=0x7fb5b402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e80f69e4f7bccda server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.234+0000 7fb5c929a640 1 -- 172.21.15.113:0/1393952741 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4030840 con 0x7fb5c40b0b50 2023-12-19T13:48:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.234+0000 7fb5c929a640 1 -- 172.21.15.113:0/1393952741 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b40309a0 con 0x7fb5c40b0b50 2023-12-19T13:48:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.234+0000 7fb5c929a640 1 -- 172.21.15.113:0/1393952741 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4030d30 con 0x7fb5c40b0b50 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 -- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c40b0b50 msgr2=0x7fb5c406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 --2- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c40b0b50 0x7fb5c406bfa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009870 tx=0x7fb5b402b980 comp rx=0 tx=0).stop 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 -- 172.21.15.113:0/1393952741 shutdown_connections 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 --2- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c40b0b50 0x7fb5c406bfa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 --2- 172.21.15.113:0/1393952741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c41449e0 0x7fb5c40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 -- 172.21.15.113:0/1393952741 >> 172.21.15.113:0/1393952741 conn(0x7fb5c40cbb70 msgr2=0x7fb5c40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 -- 172.21.15.113:0/1393952741 shutdown_connections 2023-12-19T13:48:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.235+0000 7fb5cc500640 1 -- 172.21.15.113:0/1393952741 wait complete. 2023-12-19T13:48:27.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.237+0000 7fb5cc500640 1 Processor -- start 2023-12-19T13:48:27.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.237+0000 7fb5cc500640 1 -- start start 2023-12-19T13:48:27.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5cc500640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5c406b590 0x7fb5c41f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5cc500640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c40b0b50 0x7fb5c41f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5cc500640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c41449e0 0x7fb5c4142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5cc500640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c41434e0 con 0x7fb5c406b590 2023-12-19T13:48:27.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5cc500640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c415bb20 con 0x7fb5c41449e0 2023-12-19T13:48:27.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5cc500640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c415be00 con 0x7fb5c40b0b50 2023-12-19T13:48:27.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5c406b590 0x7fb5c41f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5c406b590 0x7fb5c41f3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60600/0 (socket says 172.21.15.113:60600) 2023-12-19T13:48:27.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 -- 172.21.15.113:0/3123134374 learned_addr learned my addr 172.21.15.113:0/3123134374 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:27.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 -- 172.21.15.113:0/3123134374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c40b0b50 msgr2=0x7fb5c41f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c40b0b50 0x7fb5c41f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 -- 172.21.15.113:0/3123134374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c41449e0 msgr2=0x7fb5c4142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5caa9d640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c41449e0 0x7fb5c4142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c41449e0 0x7fb5c4142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.238+0000 7fb5ca29c640 1 -- 172.21.15.113:0/3123134374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c0009400 con 0x7fb5c406b590 2023-12-19T13:48:27.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.239+0000 7fb5ca29c640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5c406b590 0x7fb5c41f3790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e960 tx=0x7fb5c000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.239+0000 7fb5baffd640 1 -- 172.21.15.113:0/3123134374 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000ca00 con 0x7fb5c406b590 2023-12-19T13:48:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.239+0000 7fb5baffd640 1 -- 172.21.15.113:0/3123134374 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c000cb60 con 0x7fb5c406b590 2023-12-19T13:48:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.239+0000 7fb5baffd640 1 -- 172.21.15.113:0/3123134374 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0013470 con 0x7fb5c406b590 2023-12-19T13:48:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.239+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b40094d0 con 0x7fb5c406b590 2023-12-19T13:48:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.239+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c415c3c0 con 0x7fb5c406b590 2023-12-19T13:48:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.240+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4061910 con 0x7fb5c406b590 2023-12-19T13:48:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.241+0000 7fb5baffd640 1 -- 172.21.15.113:0/3123134374 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5c00135d0 con 0x7fb5c406b590 2023-12-19T13:48:27.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.242+0000 7fb5baffd640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5a806a460 0x7fb5a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.242+0000 7fb5baffd640 1 -- 172.21.15.113:0/3123134374 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb5c0088840 con 0x7fb5c406b590 2023-12-19T13:48:27.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.242+0000 7fb5c9a9b640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5a806a460 0x7fb5a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.243+0000 7fb5c9a9b640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5a806a460 0x7fb5a806c920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4036000 tx=0x7fb5b403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:27.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.247+0000 7fb5baffd640 1 -- 172.21.15.113:0/3123134374 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5c0054180 con 0x7fb5c406b590 2023-12-19T13:48:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.423+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5c415bc60 con 0x7fb5c406b590 2023-12-19T13:48:27.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.424+0000 7fb5baffd640 1 -- 172.21.15.113:0/3123134374 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12437 (secure 0 0 0) 0x7fb5c415bc60 con 0x7fb5c406b590 2023-12-19T13:48:27.424 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:27.424 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":44,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:48:26.534540+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:27.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.426+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5a806a460 msgr2=0x7fb5a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.426+0000 7fb5cc500640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5a806a460 0x7fb5a806c920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4036000 tx=0x7fb5b403b040 comp rx=0 tx=0).stop 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.426+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5c406b590 msgr2=0x7fb5c41f3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.426+0000 7fb5cc500640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5c406b590 0x7fb5c41f3790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e960 tx=0x7fb5c000ee20 comp rx=0 tx=0).stop 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 shutdown_connections 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5a806a460 0x7fb5a806c920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5c41449e0 0x7fb5c4142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5c40b0b50 0x7fb5c41f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 --2- 172.21.15.113:0/3123134374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5c406b590 0x7fb5c41f3790 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 >> 172.21.15.113:0/3123134374 conn(0x7fb5c40cbb70 msgr2=0x7fb5c40b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 shutdown_connections 2023-12-19T13:48:27.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.427+0000 7fb5cc500640 1 -- 172.21.15.113:0/3123134374 wait complete. 2023-12-19T13:48:27.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:48:27.444 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:48:27.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.662+0000 7f448ae9e640 1 Processor -- start 2023-12-19T13:48:27.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.662+0000 7f448ae9e640 1 -- start start 2023-12-19T13:48:27.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.664+0000 7f448ae9e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f448406f490 0x7f448406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.664+0000 7f448ae9e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44840d1670 0x7f44840d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.664+0000 7f448ae9e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448406fe30 con 0x7f4484146cd0 2023-12-19T13:48:27.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.664+0000 7f448ae9e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44841470b0 con 0x7f44840d1670 2023-12-19T13:48:27.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.664+0000 7f448ae9e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4484070260 con 0x7f448406f490 2023-12-19T13:48:27.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.665+0000 7f448969b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f448406f490 0x7f448406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.665+0000 7f448a69d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44840d1670 0x7f44840d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.665+0000 7f448a69d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44840d1670 0x7f44840d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:57486/0 (socket says 172.21.15.113:57486) 2023-12-19T13:48:27.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.665+0000 7f448a69d640 1 -- 172.21.15.113:0/1420579462 learned_addr learned my addr 172.21.15.113:0/1420579462 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:27.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.665+0000 7f448969b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f448406f490 0x7f448406f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:59908/0 (socket says 172.21.15.113:59908) 2023-12-19T13:48:27.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.665+0000 7f448969b640 1 -- 172.21.15.113:0/1420579462 >> v2:172.21.15.151:3300/0 conn(0x7f44840d1670 msgr2=0x7f44840d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:27.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.665+0000 7f448969b640 1 --2- 172.21.15.113:0/1420579462 >> v2:172.21.15.151:3300/0 conn(0x7f44840d1670 0x7f44840d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.666+0000 7f448969b640 1 -- 172.21.15.113:0/1420579462 >> v1:172.21.15.151:6789/0 conn(0x7f4484146cd0 legacy=0x7f44840b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.666+0000 7f448969b640 1 -- 172.21.15.113:0/1420579462 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840b6ea0 con 0x7f448406f490 2023-12-19T13:48:27.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.667+0000 7f448969b640 1 --2- 172.21.15.113:0/1420579462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f448406f490 0x7f448406f8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44700097a0 tx=0x7f447002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316cc328714ed934 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:27.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f4488e9a640 1 -- 172.21.15.113:0/1420579462 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470031780 con 0x7f448406f490 2023-12-19T13:48:27.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f4488e9a640 1 -- 172.21.15.113:0/1420579462 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44700318e0 con 0x7f448406f490 2023-12-19T13:48:27.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f4488e9a640 1 -- 172.21.15.113:0/1420579462 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470031c70 con 0x7f448406f490 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 -- 172.21.15.113:0/1420579462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f448406f490 msgr2=0x7f448406f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 --2- 172.21.15.113:0/1420579462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f448406f490 0x7f448406f8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44700097a0 tx=0x7f447002b820 comp rx=0 tx=0).stop 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 -- 172.21.15.113:0/1420579462 shutdown_connections 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 --2- 172.21.15.113:0/1420579462 >> v2:172.21.15.151:3300/0 conn(0x7f44840d1670 0x7f44840d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 --2- 172.21.15.113:0/1420579462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f448406f490 0x7f448406f8f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 -- 172.21.15.113:0/1420579462 >> 172.21.15.113:0/1420579462 conn(0x7f44840d3200 msgr2=0x7f44840d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 -- 172.21.15.113:0/1420579462 shutdown_connections 2023-12-19T13:48:27.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.668+0000 7f448ae9e640 1 -- 172.21.15.113:0/1420579462 wait complete. 2023-12-19T13:48:27.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.670+0000 7f448ae9e640 1 Processor -- start 2023-12-19T13:48:27.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.670+0000 7f448ae9e640 1 -- start start 2023-12-19T13:48:27.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.671+0000 7f448ae9e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448406f490 0x7f44841f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.671+0000 7f448ae9e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44840d1670 0x7f4484155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.671+0000 7f448ae9e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4484146cd0 0x7f44841560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.671+0000 7f448ae9e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44841580c0 con 0x7f44840d1670 2023-12-19T13:48:27.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.671+0000 7f448ae9e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448413e660 con 0x7f448406f490 2023-12-19T13:48:27.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.671+0000 7f448ae9e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448413e940 con 0x7f4484146cd0 2023-12-19T13:48:27.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44840d1670 0x7f4484155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44840d1670 0x7f4484155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60612/0 (socket says 172.21.15.113:60612) 2023-12-19T13:48:27.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 -- 172.21.15.113:0/714149216 learned_addr learned my addr 172.21.15.113:0/714149216 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f4489e9c640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448406f490 0x7f44841f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448a69d640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4484146cd0 0x7f44841560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 -- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4484146cd0 msgr2=0x7f44841560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4484146cd0 0x7f44841560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 -- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448406f490 msgr2=0x7f44841f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448406f490 0x7f44841f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 -- 172.21.15.113:0/714149216 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470009400 con 0x7f44840d1670 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f4489e9c640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448406f490 0x7f44841f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:27.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.672+0000 7f448969b640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44840d1670 0x7f4484155b90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4470034040 tx=0x7f44700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:27.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.673+0000 7f44827fc640 1 -- 172.21.15.113:0/714149216 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470032820 con 0x7f44840d1670 2023-12-19T13:48:27.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.673+0000 7f44827fc640 1 -- 172.21.15.113:0/714149216 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44700329a0 con 0x7f44840d1670 2023-12-19T13:48:27.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.673+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448413ec20 con 0x7f44840d1670 2023-12-19T13:48:27.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.673+0000 7f44827fc640 1 -- 172.21.15.113:0/714149216 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470032d50 con 0x7f44840d1670 2023-12-19T13:48:27.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.673+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44841f2820 con 0x7f44840d1670 2023-12-19T13:48:27.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.674+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4484061910 con 0x7f44840d1670 2023-12-19T13:48:27.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.675+0000 7f44827fc640 1 -- 172.21.15.113:0/714149216 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f447004e440 con 0x7f44840d1670 2023-12-19T13:48:27.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.676+0000 7f44827fc640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f446806a430 0x7f446806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:27.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.676+0000 7f44827fc640 1 -- 172.21.15.113:0/714149216 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44700aa6e0 con 0x7f44840d1670 2023-12-19T13:48:27.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.676+0000 7f4489e9c640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f446806a430 0x7f446806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:27.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.677+0000 7f4489e9c640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f446806a430 0x7f446806c8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f44780012e0 tx=0x7f4478009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:27.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.680+0000 7f44827fc640 1 -- 172.21.15.113:0/714149216 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f44700760a0 con 0x7f44840d1670 2023-12-19T13:48:27.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.869+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44840b6600 con 0x7f44840d1670 2023-12-19T13:48:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.869+0000 7f44827fc640 1 -- 172.21.15.113:0/714149216 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44700796c0 con 0x7f44840d1670 2023-12-19T13:48:27.869 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:48:27.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.872+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f446806a430 msgr2=0x7f446806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.872+0000 7f448ae9e640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f446806a430 0x7f446806c8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f44780012e0 tx=0x7f4478009040 comp rx=0 tx=0).stop 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.872+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44840d1670 msgr2=0x7f4484155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.872+0000 7f448ae9e640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44840d1670 0x7f4484155b90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4470034040 tx=0x7f44700046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 shutdown_connections 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f446806a430 0x7f446806c8f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4484146cd0 0x7f44841560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44840d1670 0x7f4484155b90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 --2- 172.21.15.113:0/714149216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448406f490 0x7f44841f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 >> 172.21.15.113:0/714149216 conn(0x7f44840d3200 msgr2=0x7f44840b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 shutdown_connections 2023-12-19T13:48:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:27.873+0000 7f448ae9e640 1 -- 172.21.15.113:0/714149216 wait complete. 2023-12-19T13:48:27.892 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:48:28.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.102+0000 7fea7b59e640 1 Processor -- start 2023-12-19T13:48:28.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.103+0000 7fea7b59e640 1 -- start start 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.104+0000 7fea7b59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fea7c0b86e0 0x7fea7c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.104+0000 7fea7b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b7710 0x7fea7c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.104+0000 7fea7b59e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c142df0 con 0x7fea7c0d2a60 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.104+0000 7fea7b59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c1430d0 con 0x7fea7c0b86e0 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.104+0000 7fea7b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c1433b0 con 0x7fea7c0b7710 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.104+0000 7fea7a59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fea7c0b86e0 0x7fea7c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea7a59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fea7c0b86e0 0x7fea7c15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49860/0 (socket says 172.21.15.113:49860) 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea7a59c640 1 -- 172.21.15.113:0/2721163038 learned_addr learned my addr 172.21.15.113:0/2721163038 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea7ad9d640 1 --1- 172.21.15.113:0/2721163038 >> v1:172.21.15.113:6789/0 conn(0x7fea7c0d2a60 0x7fea7c0b6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50048/0 (socket says 172.21.15.113:50048) 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea73fff640 1 --2- 172.21.15.113:0/2721163038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b7710 0x7fea7c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea7a59c640 1 -- 172.21.15.113:0/2721163038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b7710 msgr2=0x7fea7c0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea7a59c640 1 --2- 172.21.15.113:0/2721163038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b7710 0x7fea7c0d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea7a59c640 1 -- 172.21.15.113:0/2721163038 >> v1:172.21.15.113:6789/0 conn(0x7fea7c0d2a60 legacy=0x7fea7c0b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea7a59c640 1 -- 172.21.15.113:0/2721163038 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c143690 con 0x7fea7c0b86e0 2023-12-19T13:48:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.105+0000 7fea73fff640 1 --2- 172.21.15.113:0/2721163038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b7710 0x7fea7c0d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.106+0000 7fea7a59c640 1 --2- 172.21.15.113:0/2721163038 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b86e0 0x7fea7c15e2d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009870 tx=0x7fea6c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717c48a26719e320 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.106+0000 7fea79d9b640 1 -- 172.21.15.113:0/2721163038 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c031640 con 0x7fea7c0b86e0 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.106+0000 7fea79d9b640 1 -- 172.21.15.113:0/2721163038 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0317a0 con 0x7fea7c0b86e0 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.106+0000 7fea79d9b640 1 -- 172.21.15.113:0/2721163038 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c031b30 con 0x7fea7c0b86e0 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 -- 172.21.15.113:0/2721163038 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b86e0 msgr2=0x7fea7c15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 --2- 172.21.15.113:0/2721163038 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b86e0 0x7fea7c15e2d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009870 tx=0x7fea6c02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 -- 172.21.15.113:0/2721163038 shutdown_connections 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 --2- 172.21.15.113:0/2721163038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b7710 0x7fea7c0d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 --2- 172.21.15.113:0/2721163038 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b86e0 0x7fea7c15e2d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 -- 172.21.15.113:0/2721163038 >> 172.21.15.113:0/2721163038 conn(0x7fea7c0d3230 msgr2=0x7fea7c0d3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 -- 172.21.15.113:0/2721163038 shutdown_connections 2023-12-19T13:48:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.107+0000 7fea7b59e640 1 -- 172.21.15.113:0/2721163038 wait complete. 2023-12-19T13:48:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.109+0000 7fea7b59e640 1 Processor -- start 2023-12-19T13:48:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.109+0000 7fea7b59e640 1 -- start start 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7b59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b7710 0x7fea7c1f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b86e0 0x7fea7c145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7b59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c0d2a60 0x7fea7c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7b59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c1571d0 con 0x7fea7c0b7710 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7b59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0b50d0 con 0x7fea7c0d2a60 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c15ff80 con 0x7fea7c0b86e0 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b7710 0x7fea7c1f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b7710 0x7fea7c1f56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49864/0 (socket says 172.21.15.113:49864) 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.110+0000 7fea7a59c640 1 -- 172.21.15.113:0/3879191877 learned_addr learned my addr 172.21.15.113:0/3879191877 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7a59c640 1 -- 172.21.15.113:0/3879191877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b86e0 msgr2=0x7fea7c145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7a59c640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b86e0 0x7fea7c145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7a59c640 1 -- 172.21.15.113:0/3879191877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c0d2a60 msgr2=0x7fea7c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7a59c640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c0d2a60 0x7fea7c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7a59c640 1 -- 172.21.15.113:0/3879191877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c0094d0 con 0x7fea7c0b7710 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7a59c640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b7710 0x7fea7c1f56c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fea6c02b930 tx=0x7fea6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea72ffd640 1 -- 172.21.15.113:0/3879191877 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c03ac60 con 0x7fea7c0b7710 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea72ffd640 1 -- 172.21.15.113:0/3879191877 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c03ade0 con 0x7fea7c0b7710 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea72ffd640 1 -- 172.21.15.113:0/3879191877 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c042630 con 0x7fea7c0b7710 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c15fd10 con 0x7fea7c0b7710 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.111+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c0b5320 con 0x7fea7c0b7710 2023-12-19T13:48:28.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.112+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c061910 con 0x7fea7c0b7710 2023-12-19T13:48:28.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.113+0000 7fea72ffd640 1 -- 172.21.15.113:0/3879191877 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea6c02f050 con 0x7fea7c0b7710 2023-12-19T13:48:28.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.114+0000 7fea72ffd640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea5c06a430 0x7fea5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.114+0000 7fea72ffd640 1 -- 172.21.15.113:0/3879191877 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea6c0aa6b0 con 0x7fea7c0b7710 2023-12-19T13:48:28.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.114+0000 7fea73fff640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea5c06a430 0x7fea5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.115+0000 7fea73fff640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea5c06a430 0x7fea5c06c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fea64006fd0 tx=0x7fea64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:28.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.119+0000 7fea72ffd640 1 -- 172.21.15.113:0/3879191877 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea6c076110 con 0x7fea7c0b7710 2023-12-19T13:48:28.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.308+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea7c1458d0 con 0x7fea7c0b7710 2023-12-19T13:48:28.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.309+0000 7fea72ffd640 1 -- 172.21.15.113:0/3879191877 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+65 (secure 0 0 0) 0x7fea6c079730 con 0x7fea7c0b7710 2023-12-19T13:48:28.309 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:28.309 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:48:28.309 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:28.309 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:48:28.309 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:48:28.309 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:28.309 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:48:28.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.311+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea5c06a430 msgr2=0x7fea5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.311+0000 7fea7b59e640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea5c06a430 0x7fea5c06c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fea64006fd0 tx=0x7fea64008040 comp rx=0 tx=0).stop 2023-12-19T13:48:28.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.311+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b7710 msgr2=0x7fea7c1f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.311+0000 7fea7b59e640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b7710 0x7fea7c1f56c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fea6c02b930 tx=0x7fea6c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 shutdown_connections 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea5c06a430 0x7fea5c06c8f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c0d2a60 0x7fea7c15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea7c0b86e0 0x7fea7c145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 --2- 172.21.15.113:0/3879191877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea7c0b7710 0x7fea7c1f56c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 >> 172.21.15.113:0/3879191877 conn(0x7fea7c0d3230 msgr2=0x7fea7c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 shutdown_connections 2023-12-19T13:48:28.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.312+0000 7fea7b59e640 1 -- 172.21.15.113:0/3879191877 wait complete. 2023-12-19T13:48:28.330 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:48:28.330 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:48:28.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.542+0000 7f9b22e68640 1 Processor -- start 2023-12-19T13:48:28.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.542+0000 7f9b22e68640 1 -- start start 2023-12-19T13:48:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b22e68640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9b1c15afd0 0x7f9b1c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b22e68640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9b1c0b04c0 0x7f9b1c06b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b22e68640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c15f920 con 0x7f9b1c06d070 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b22e68640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0adc40 con 0x7f9b1c0b04c0 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b22e68640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c15ed10 con 0x7f9b1c15afd0 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b22667640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9b1c0b04c0 0x7f9b1c06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b22667640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9b1c0b04c0 0x7f9b1c06b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49866/0 (socket says 172.21.15.113:49866) 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.545+0000 7f9b22667640 1 -- 172.21.15.113:0/3938531171 learned_addr learned my addr 172.21.15.113:0/3938531171 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.544+0000 7f9b21665640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9b1c06d070 0x7f9b1c0afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50054/0 (socket says 172.21.15.113:50054) 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.545+0000 7f9b21e66640 1 --2- 172.21.15.113:0/3938531171 >> v2:172.21.15.151:3300/0 conn(0x7f9b1c15afd0 0x7f9b1c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.545+0000 7f9b22667640 1 -- 172.21.15.113:0/3938531171 >> v2:172.21.15.151:3300/0 conn(0x7f9b1c15afd0 msgr2=0x7f9b1c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.545+0000 7f9b22667640 1 --2- 172.21.15.113:0/3938531171 >> v2:172.21.15.151:3300/0 conn(0x7f9b1c15afd0 0x7f9b1c0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.545+0000 7f9b22667640 1 -- 172.21.15.113:0/3938531171 >> v1:172.21.15.113:6789/0 conn(0x7f9b1c06d070 legacy=0x7f9b1c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.545+0000 7f9b22667640 1 -- 172.21.15.113:0/3938531171 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c15eff0 con 0x7f9b1c0b04c0 2023-12-19T13:48:28.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.546+0000 7f9b22667640 1 --2- 172.21.15.113:0/3938531171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c06b450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0cfd80 tx=0x7f9b1402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf19b965e7519ab2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:28.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.546+0000 7f9b20e64640 1 -- 172.21.15.113:0/3938531171 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1402cb10 con 0x7f9b1c0b04c0 2023-12-19T13:48:28.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.546+0000 7f9b20e64640 1 -- 172.21.15.113:0/3938531171 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1402cc70 con 0x7f9b1c0b04c0 2023-12-19T13:48:28.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.546+0000 7f9b20e64640 1 -- 172.21.15.113:0/3938531171 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b140343f0 con 0x7f9b1c0b04c0 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 -- 172.21.15.113:0/3938531171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c0b04c0 msgr2=0x7f9b1c06b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 --2- 172.21.15.113:0/3938531171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c06b450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0cfd80 tx=0x7f9b1402bf70 comp rx=0 tx=0).stop 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 -- 172.21.15.113:0/3938531171 shutdown_connections 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 --2- 172.21.15.113:0/3938531171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c06b450 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 --2- 172.21.15.113:0/3938531171 >> v2:172.21.15.151:3300/0 conn(0x7f9b1c15afd0 0x7f9b1c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 -- 172.21.15.113:0/3938531171 >> 172.21.15.113:0/3938531171 conn(0x7f9b1c0b4750 msgr2=0x7f9b1c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 -- 172.21.15.113:0/3938531171 shutdown_connections 2023-12-19T13:48:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.547+0000 7f9b22e68640 1 -- 172.21.15.113:0/3938531171 wait complete. 2023-12-19T13:48:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.549+0000 7f9b22e68640 1 Processor -- start 2023-12-19T13:48:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.549+0000 7f9b22e68640 1 -- start start 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b22e68640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c06d070 0x7f9b1c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b22e68640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b22e68640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b1c15afd0 0x7f9b1c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b22e68640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1f6bf0 con 0x7f9b1c06d070 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b22e68640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1f5fb0 con 0x7f9b1c0b04c0 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b22e68640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b3270 con 0x7f9b1c15afd0 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b21e66640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c06d070 0x7f9b1c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b21e66640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c06d070 0x7f9b1c0b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49870/0 (socket says 172.21.15.113:49870) 2023-12-19T13:48:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.550+0000 7f9b21e66640 1 -- 172.21.15.113:0/893815384 learned_addr learned my addr 172.21.15.113:0/893815384 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:28.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b22667640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b1c15afd0 0x7f9b1c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21e66640 1 -- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b1c15afd0 msgr2=0x7f9b1c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21e66640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b1c15afd0 0x7f9b1c157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21e66640 1 -- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c0b04c0 msgr2=0x7f9b1c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21665640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21e66640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c15bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21e66640 1 -- 172.21.15.113:0/893815384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14009b30 con 0x7f9b1c06d070 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21665640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b21e66640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c06d070 0x7f9b1c0b2d30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d5f0 tx=0x7f9b1800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b127fc640 1 -- 172.21.15.113:0/893815384 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180125f0 con 0x7f9b1c06d070 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b127fc640 1 -- 172.21.15.113:0/893815384 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b18012750 con 0x7f9b1c06d070 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b127fc640 1 -- 172.21.15.113:0/893815384 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18012b00 con 0x7f9b1c06d070 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.551+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c1f6250 con 0x7f9b1c06d070 2023-12-19T13:48:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.552+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c1f6810 con 0x7f9b1c06d070 2023-12-19T13:48:28.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.553+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c061910 con 0x7f9b1c06d070 2023-12-19T13:48:28.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.554+0000 7f9b127fc640 1 -- 172.21.15.113:0/893815384 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9b18012c60 con 0x7f9b1c06d070 2023-12-19T13:48:28.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.554+0000 7f9b127fc640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b0006a430 0x7f9b0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:28.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.555+0000 7f9b127fc640 1 -- 172.21.15.113:0/893815384 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b18088a10 con 0x7f9b1c06d070 2023-12-19T13:48:28.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.555+0000 7f9b21665640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b0006a430 0x7f9b0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:28.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.555+0000 7f9b21665640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b0006a430 0x7f9b0006c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c154050 tx=0x7f9b0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:28.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.559+0000 7f9b127fc640 1 -- 172.21.15.113:0/893815384 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9b18054350 con 0x7f9b1c06d070 2023-12-19T13:48:28.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:28.746+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9b1c066710 con 0x7f9b1c06d070 2023-12-19T13:48:29.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.541+0000 7f9b127fc640 1 -- 172.21.15.113:0/893815384 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9b18057970 con 0x7f9b1c06d070 2023-12-19T13:48:29.542 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:48:29.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.547+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b0006a430 msgr2=0x7f9b0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.547+0000 7f9b22e68640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b0006a430 0x7f9b0006c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c154050 tx=0x7f9b0c009040 comp rx=0 tx=0).stop 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.547+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c06d070 msgr2=0x7f9b1c0b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.547+0000 7f9b22e68640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c06d070 0x7f9b1c0b2d30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d5f0 tx=0x7f9b1800dab0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 shutdown_connections 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b0006a430 0x7f9b0006c8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b1c15afd0 0x7f9b1c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c0b04c0 0x7f9b1c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 --2- 172.21.15.113:0/893815384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b1c06d070 0x7f9b1c0b2d30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 >> 172.21.15.113:0/893815384 conn(0x7f9b1c0b4750 msgr2=0x7f9b1c06c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:29.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 shutdown_connections 2023-12-19T13:48:29.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.548+0000 7f9b22e68640 1 -- 172.21.15.113:0/893815384 wait complete. 2023-12-19T13:48:29.568 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:48:29.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.782+0000 7f4227fff640 1 Processor -- start 2023-12-19T13:48:29.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.783+0000 7f4227fff640 1 -- start start 2023-12-19T13:48:29.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.784+0000 7f4227fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f42280cbda0 0x7f42280b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:29.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.784+0000 7f4227fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422806cb40 con 0x7f42281449f0 2023-12-19T13:48:29.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.784+0000 7f4227fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422806c530 con 0x7f42280b0870 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.784+0000 7f4227fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280b0d00 con 0x7f42280cbda0 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.785+0000 7f4226ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f42281449f0 0x7f422815b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50060/0 (socket says 172.21.15.113:50060) 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.785+0000 7f4226ffd640 1 -- 172.21.15.113:0/2011202032 learned_addr learned my addr 172.21.15.113:0/2011202032 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.785+0000 7f42267fc640 1 --2- 172.21.15.113:0/2011202032 >> v2:172.21.15.113:3300/0 conn(0x7f42280cbda0 0x7f42280b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.785+0000 7f42267fc640 1 -- 172.21.15.113:0/2011202032 >> v1:172.21.15.151:6789/0 conn(0x7f42280b0870 legacy=0x7f422806cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.785+0000 7f42267fc640 1 -- 172.21.15.113:0/2011202032 >> v1:172.21.15.113:6789/0 conn(0x7f42281449f0 legacy=0x7f422815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.785+0000 7f42267fc640 1 -- 172.21.15.113:0/2011202032 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422815c030 con 0x7f42280cbda0 2023-12-19T13:48:29.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.786+0000 7f42267fc640 1 --2- 172.21.15.113:0/2011202032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280cbda0 0x7f42280b0330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f42100097a0 tx=0x7f421002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f597cc3babddc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:29.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4225ffb640 1 -- 172.21.15.113:0/2011202032 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421002e070 con 0x7f42280cbda0 2023-12-19T13:48:29.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4225ffb640 1 -- 172.21.15.113:0/2011202032 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42100315a0 con 0x7f42280cbda0 2023-12-19T13:48:29.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4225ffb640 1 -- 172.21.15.113:0/2011202032 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210031930 con 0x7f42280cbda0 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4227fff640 1 -- 172.21.15.113:0/2011202032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280cbda0 msgr2=0x7f42280b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4227fff640 1 --2- 172.21.15.113:0/2011202032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280cbda0 0x7f42280b0330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f42100097a0 tx=0x7f421002b840 comp rx=0 tx=0).stop 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4227fff640 1 -- 172.21.15.113:0/2011202032 shutdown_connections 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4227fff640 1 --2- 172.21.15.113:0/2011202032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280cbda0 0x7f42280b0330 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4227fff640 1 -- 172.21.15.113:0/2011202032 >> 172.21.15.113:0/2011202032 conn(0x7f42280659a0 msgr2=0x7f4228065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.787+0000 7f4227fff640 1 -- 172.21.15.113:0/2011202032 shutdown_connections 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.788+0000 7f4227fff640 1 -- 172.21.15.113:0/2011202032 wait complete. 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.789+0000 7f4227fff640 1 Processor -- start 2023-12-19T13:48:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.789+0000 7f4227fff640 1 -- start start 2023-12-19T13:48:29.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.790+0000 7f4227fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280b0870 0x7f42281535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:29.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.790+0000 7f4227fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42280cbda0 0x7f422813a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:29.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.790+0000 7f4227fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281449f0 0x7f42280ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.790+0000 7f4227fff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422813b050 con 0x7f42280b0870 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.790+0000 7f4227fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422813b330 con 0x7f42280cbda0 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.790+0000 7f4227fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422813b610 con 0x7f42281449f0 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280b0870 0x7f42281535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280b0870 0x7f42281535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49890/0 (socket says 172.21.15.113:49890) 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 -- 172.21.15.113:0/117221898 learned_addr learned my addr 172.21.15.113:0/117221898 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f42267fc640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42280cbda0 0x7f422813a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f42277fe640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281449f0 0x7f42280ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 -- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281449f0 msgr2=0x7f42280ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281449f0 0x7f42280ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 -- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42280cbda0 msgr2=0x7f422813a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42280cbda0 0x7f422813a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.791+0000 7f4226ffd640 1 -- 172.21.15.113:0/117221898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4210009400 con 0x7f42280b0870 2023-12-19T13:48:29.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.792+0000 7f4226ffd640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280b0870 0x7f42281535c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f421800cbc0 tx=0x7f421800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:29.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.792+0000 7f421f7fe640 1 -- 172.21.15.113:0/117221898 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800aca0 con 0x7f42280b0870 2023-12-19T13:48:29.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.792+0000 7f421f7fe640 1 -- 172.21.15.113:0/117221898 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800ae00 con 0x7f42280b0870 2023-12-19T13:48:29.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.792+0000 7f421f7fe640 1 -- 172.21.15.113:0/117221898 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218012600 con 0x7f42280b0870 2023-12-19T13:48:29.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.792+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422813b8f0 con 0x7f42280b0870 2023-12-19T13:48:29.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.792+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4228153b00 con 0x7f42280b0870 2023-12-19T13:48:29.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.793+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422813be10 con 0x7f42280b0870 2023-12-19T13:48:29.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.794+0000 7f421f7fe640 1 -- 172.21.15.113:0/117221898 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4218007070 con 0x7f42280b0870 2023-12-19T13:48:29.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.795+0000 7f421f7fe640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f420806a430 0x7f420806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:29.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.795+0000 7f421f7fe640 1 -- 172.21.15.113:0/117221898 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4218088540 con 0x7f42280b0870 2023-12-19T13:48:29.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.796+0000 7f42267fc640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f420806a430 0x7f420806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:29.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.796+0000 7f42267fc640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f420806a430 0x7f420806c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4210036000 tx=0x7f421003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:29.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.801+0000 7f421f7fe640 1 -- 172.21.15.113:0/117221898 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f422813be10 con 0x7f42280b0870 2023-12-19T13:48:29.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:29.990+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f422813be10 con 0x7f42280b0870 2023-12-19T13:48:30.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-19T13:48:30.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.547+0000 7f421f7fe640 1 -- 172.21.15.113:0/117221898 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f42180170d0 con 0x7f42280b0870 2023-12-19T13:48:30.549 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:48:30.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.555+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f420806a430 msgr2=0x7f420806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:30.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.555+0000 7f4227fff640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f420806a430 0x7f420806c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4210036000 tx=0x7f421003d040 comp rx=0 tx=0).stop 2023-12-19T13:48:30.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.555+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280b0870 msgr2=0x7f42281535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:30.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.555+0000 7f4227fff640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280b0870 0x7f42281535c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f421800cbc0 tx=0x7f421800a060 comp rx=0 tx=0).stop 2023-12-19T13:48:30.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.556+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 shutdown_connections 2023-12-19T13:48:30.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.556+0000 7f4227fff640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f420806a430 0x7f420806c8f0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4210036000 tx=0x7f421003d040 comp rx=0 tx=0).stop 2023-12-19T13:48:30.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.556+0000 7f4227fff640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281449f0 0x7f42280ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.556+0000 7f4227fff640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42280cbda0 0x7f422813a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.556+0000 7f4227fff640 1 --2- 172.21.15.113:0/117221898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42280b0870 0x7f42281535c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.556+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 >> 172.21.15.113:0/117221898 conn(0x7f42280659a0 msgr2=0x7f422806f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:30.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.558+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 shutdown_connections 2023-12-19T13:48:30.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.559+0000 7f4227fff640 1 -- 172.21.15.113:0/117221898 wait complete. 2023-12-19T13:48:30.585 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:48:30.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.773+0000 7f48186c7640 1 Processor -- start 2023-12-19T13:48:30.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.773+0000 7f48186c7640 1 -- start start 2023-12-19T13:48:30.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.775+0000 7f48186c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f481006fc40 0x7f48100d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:30.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.775+0000 7f48186c7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48100b6430 0x7f481015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:30.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.775+0000 7f48186c7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4810161e70 con 0x7f4810146ff0 2023-12-19T13:48:30.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.775+0000 7f48186c7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4810161080 con 0x7f48100b6430 2023-12-19T13:48:30.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.775+0000 7f48186c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4810161260 con 0x7f481006fc40 2023-12-19T13:48:30.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.775+0000 7f4815c62640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f481006fc40 0x7f48100d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:30.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.775+0000 7f4816c64640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48100b6430 0x7f481015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:30.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.776+0000 7f4816c64640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48100b6430 0x7f481015dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:33660/0 (socket says 172.21.15.113:33660) 2023-12-19T13:48:30.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.776+0000 7f4815c62640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f481006fc40 0x7f48100d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:45188/0 (socket says 172.21.15.113:45188) 2023-12-19T13:48:30.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.776+0000 7f4816c64640 1 -- 172.21.15.113:0/573491295 learned_addr learned my addr 172.21.15.113:0/573491295 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:30.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.776+0000 7f4816c64640 1 -- 172.21.15.113:0/573491295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f481006fc40 msgr2=0x7f48100d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:30.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.776+0000 7f4816c64640 1 --2- 172.21.15.113:0/573491295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f481006fc40 0x7f48100d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.776+0000 7f4816c64640 1 -- 172.21.15.113:0/573491295 >> v1:172.21.15.151:6789/0 conn(0x7f4810146ff0 legacy=0x7f481006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:30.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.776+0000 7f4816c64640 1 -- 172.21.15.113:0/573491295 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810161540 con 0x7f48100b6430 2023-12-19T13:48:30.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.778+0000 7f4816c64640 1 --2- 172.21.15.113:0/573491295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48100b6430 0x7f481015dd40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4808009870 tx=0x7f480802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14feb1256645bc87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:30.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.778+0000 7f4815461640 1 -- 172.21.15.113:0/573491295 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808031640 con 0x7f48100b6430 2023-12-19T13:48:30.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.778+0000 7f4815461640 1 -- 172.21.15.113:0/573491295 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48080317a0 con 0x7f48100b6430 2023-12-19T13:48:30.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.778+0000 7f4815461640 1 -- 172.21.15.113:0/573491295 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808031b30 con 0x7f48100b6430 2023-12-19T13:48:30.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 -- 172.21.15.113:0/573491295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48100b6430 msgr2=0x7f481015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:30.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 --2- 172.21.15.113:0/573491295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48100b6430 0x7f481015dd40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4808009870 tx=0x7f480802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 -- 172.21.15.113:0/573491295 shutdown_connections 2023-12-19T13:48:30.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 --2- 172.21.15.113:0/573491295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48100b6430 0x7f481015dd40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 --2- 172.21.15.113:0/573491295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f481006fc40 0x7f48100d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 -- 172.21.15.113:0/573491295 >> 172.21.15.113:0/573491295 conn(0x7f48100d3520 msgr2=0x7f48100d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:30.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 -- 172.21.15.113:0/573491295 shutdown_connections 2023-12-19T13:48:30.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.779+0000 7f48186c7640 1 -- 172.21.15.113:0/573491295 wait complete. 2023-12-19T13:48:30.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.781+0000 7f48186c7640 1 Processor -- start 2023-12-19T13:48:30.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.781+0000 7f48186c7640 1 -- start start 2023-12-19T13:48:30.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f48186c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f481006fc40 0x7f481015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:30.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f48186c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48100b6430 0x7f4810144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:30.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f48186c7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4810146ff0 0x7f481015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:30.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f48186c7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481015d560 con 0x7f4810146ff0 2023-12-19T13:48:30.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f48186c7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48101f3200 con 0x7f481006fc40 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f48186c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48101f34e0 con 0x7f48100b6430 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f4816c64640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4810146ff0 0x7f481015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f4816c64640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4810146ff0 0x7f481015ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49906/0 (socket says 172.21.15.113:49906) 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.782+0000 7f4816c64640 1 -- 172.21.15.113:0/908092044 learned_addr learned my addr 172.21.15.113:0/908092044 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4815c62640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48100b6430 0x7f4810144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4816463640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f481006fc40 0x7f481015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4816c64640 1 -- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48100b6430 msgr2=0x7f4810144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4816c64640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48100b6430 0x7f4810144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4816c64640 1 -- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f481006fc40 msgr2=0x7f481015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4816c64640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f481006fc40 0x7f481015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:30.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4816c64640 1 -- 172.21.15.113:0/908092044 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080094d0 con 0x7f4810146ff0 2023-12-19T13:48:30.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f4816c64640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4810146ff0 0x7f481015ebc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4808009870 tx=0x7f48080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:30.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f480effd640 1 -- 172.21.15.113:0/908092044 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480803a930 con 0x7f4810146ff0 2023-12-19T13:48:30.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f480effd640 1 -- 172.21.15.113:0/908092044 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480803aab0 con 0x7f4810146ff0 2023-12-19T13:48:30.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f480effd640 1 -- 172.21.15.113:0/908092044 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480803ae60 con 0x7f4810146ff0 2023-12-19T13:48:30.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.783+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48101f37c0 con 0x7f4810146ff0 2023-12-19T13:48:30.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.784+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48100c83a0 con 0x7f4810146ff0 2023-12-19T13:48:30.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.785+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48100674e0 con 0x7f4810146ff0 2023-12-19T13:48:30.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.786+0000 7f480effd640 1 -- 172.21.15.113:0/908092044 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f480802f050 con 0x7f4810146ff0 2023-12-19T13:48:30.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.787+0000 7f480effd640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f47f406a430 0x7f47f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:30.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.787+0000 7f480effd640 1 -- 172.21.15.113:0/908092044 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f48080aa740 con 0x7f4810146ff0 2023-12-19T13:48:30.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.787+0000 7f4816463640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f47f406a430 0x7f47f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:30.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.788+0000 7f4816463640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f47f406a430 0x7f47f406c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4804001d40 tx=0x7f4804009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:30.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:30.792+0000 7f480effd640 1 -- 172.21.15.113:0/908092044 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4808075d30 con 0x7f4810146ff0 2023-12-19T13:48:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.020+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f48100c8590 con 0x7f4810146ff0 2023-12-19T13:48:31.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.032+0000 7f480effd640 1 -- 172.21.15.113:0/908092044 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f48080350c0 con 0x7f4810146ff0 2023-12-19T13:48:31.034 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 6 and data pool 7 2023-12-19T13:48:31.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.039+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f47f406a430 msgr2=0x7f47f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.039+0000 7f48186c7640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f47f406a430 0x7f47f406c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4804001d40 tx=0x7f4804009040 comp rx=0 tx=0).stop 2023-12-19T13:48:31.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.039+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4810146ff0 msgr2=0x7f481015ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.039+0000 7f48186c7640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4810146ff0 0x7f481015ebc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4808009870 tx=0x7f48080046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.040+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 shutdown_connections 2023-12-19T13:48:31.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.040+0000 7f48186c7640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f47f406a430 0x7f47f406c8f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.040+0000 7f48186c7640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4810146ff0 0x7f481015ebc0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.040+0000 7f48186c7640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48100b6430 0x7f4810144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.040+0000 7f48186c7640 1 --2- 172.21.15.113:0/908092044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f481006fc40 0x7f481015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.040+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 >> 172.21.15.113:0/908092044 conn(0x7f48100d3520 msgr2=0x7f4810160480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:31.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.041+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 shutdown_connections 2023-12-19T13:48:31.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.042+0000 7f48186c7640 1 -- 172.21.15.113:0/908092044 wait complete. 2023-12-19T13:48:31.065 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.243+0000 7f732e27a640 1 Processor -- start 2023-12-19T13:48:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.244+0000 7f732e27a640 1 -- start start 2023-12-19T13:48:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.245+0000 7f732e27a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 0x7f73280af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.245+0000 7f732e27a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f73280b0b50 0x7f732806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.245+0000 7f732e27a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280afb10 con 0x7f732806b590 2023-12-19T13:48:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.245+0000 7f732e27a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732806bb30 con 0x7f73280b0b50 2023-12-19T13:48:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.245+0000 7f732e27a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280b0070 con 0x7f73281449e0 2023-12-19T13:48:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f732c817640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f732806b590 0x7f732815eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50074/0 (socket says 172.21.15.113:50074) 2023-12-19T13:48:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f732c817640 1 -- 172.21.15.113:0/1463491037 learned_addr learned my addr 172.21.15.113:0/1463491037 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f7327fff640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 0x7f73280af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720840053 0 0) 0x7f73280afb10 con 0x7f732806b590 2023-12-19T13:48:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7314003520 con 0x7f732806b590 2023-12-19T13:48:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f731ffff640 1 --2- 172.21.15.113:0/1463491037 >> v2:172.21.15.151:3300/0 conn(0x7f73280b0b50 0x7f732806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1178994017 0 0) 0x7f7314003520 con 0x7f732806b590 2023-12-19T13:48:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 msgr2=0x7f73280af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 0x7f73280af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 >> v2:172.21.15.151:3300/0 conn(0x7f73280b0b50 msgr2=0x7f732806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 --2- 172.21.15.113:0/1463491037 >> v2:172.21.15.151:3300/0 conn(0x7f73280b0b50 0x7f732806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280b0350 con 0x7f732806b590 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.246+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f73200019f0 con 0x7f732806b590 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 >> v1:172.21.15.113:6789/0 conn(0x7f732806b590 legacy=0x7f732815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f73277fe640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73140039e0 0x7f7314003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f73277fe640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 0x7f73140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f73277fe640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7314004d00 0x7f7314005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732806bb30 con 0x7f73140039e0 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280b0070 con 0x7f7314004d00 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731400ba00 con 0x7f73281449e0 2023-12-19T13:48:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f7327fff640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73140039e0 0x7f7314003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f7327fff640 1 -- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 msgr2=0x7f73140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f731ffff640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 0x7f73140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f7327fff640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73281449e0 0x7f73140047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f7327fff640 1 -- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7314004d00 msgr2=0x7f7314005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f7327fff640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7314004d00 0x7f7314005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.247+0000 7f7327fff640 1 -- 172.21.15.113:0/1463491037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314003520 con 0x7f73140039e0 2023-12-19T13:48:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f7327fff640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73140039e0 0x7f7314003e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7318009ac0 tx=0x7f73140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c853253574167ff0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731802c6b0 con 0x7f73140039e0 2023-12-19T13:48:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731802c810 con 0x7f73140039e0 2023-12-19T13:48:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f73277fe640 1 -- 172.21.15.113:0/1463491037 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731802cba0 con 0x7f73140039e0 2023-12-19T13:48:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f732e27a640 1 -- 172.21.15.113:0/1463491037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73140039e0 msgr2=0x7f7314003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f732e27a640 1 --2- 172.21.15.113:0/1463491037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73140039e0 0x7f7314003e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7318009ac0 tx=0x7f73140057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f732c817640 1 -- 172.21.15.113:0/1463491037 reap_dead start 2023-12-19T13:48:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f732e27a640 1 -- 172.21.15.113:0/1463491037 shutdown_connections 2023-12-19T13:48:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.249+0000 7f732e27a640 1 -- 172.21.15.113:0/1463491037 >> 172.21.15.113:0/1463491037 conn(0x7f73280cbb70 msgr2=0x7f73280cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.250+0000 7f732e27a640 1 -- 172.21.15.113:0/1463491037 shutdown_connections 2023-12-19T13:48:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.250+0000 7f732e27a640 1 -- 172.21.15.113:0/1463491037 wait complete. 2023-12-19T13:48:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.251+0000 7f732e27a640 1 Processor -- start 2023-12-19T13:48:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.251+0000 7f732e27a640 1 -- start start 2023-12-19T13:48:31.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.252+0000 7f732e27a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73140039e0 0x7f732815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.252+0000 7f732e27a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f732815aba0 0x7f73281f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.252+0000 7f732e27a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73281f3370 0x7f732813a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.252+0000 7f732e27a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328142490 con 0x7f73281f3370 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.252+0000 7f732e27a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328142770 con 0x7f732815aba0 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.252+0000 7f732e27a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328142a50 con 0x7f73140039e0 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.252+0000 7f732c817640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73281f3370 0x7f732813a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73281f3370 0x7f732813a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49934/0 (socket says 172.21.15.113:49934) 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 -- 172.21.15.113:0/3691651325 learned_addr learned my addr 172.21.15.113:0/3691651325 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 -- 172.21.15.113:0/3691651325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73140039e0 msgr2=0x7f732815a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73140039e0 0x7f732815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 -- 172.21.15.113:0/3691651325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f732815aba0 msgr2=0x7f73281f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f732815aba0 0x7f73281f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 -- 172.21.15.113:0/3691651325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328142d30 con 0x7f73281f3370 2023-12-19T13:48:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732c817640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73281f3370 0x7f732813a680 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7328071cd0 tx=0x7f732000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:31.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f73257fa640 1 -- 172.21.15.113:0/3691651325 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000a610 con 0x7f73281f3370 2023-12-19T13:48:31.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f73257fa640 1 -- 172.21.15.113:0/3691651325 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000a7b0 con 0x7f73281f3370 2023-12-19T13:48:31.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328143010 con 0x7f73281f3370 2023-12-19T13:48:31.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.253+0000 7f73257fa640 1 -- 172.21.15.113:0/3691651325 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000ab60 con 0x7f73281f3370 2023-12-19T13:48:31.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.254+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73281420f0 con 0x7f73281f3370 2023-12-19T13:48:31.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.255+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7328143200 con 0x7f73281f3370 2023-12-19T13:48:31.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.256+0000 7f73257fa640 1 -- 172.21.15.113:0/3691651325 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f732000acc0 con 0x7f73281f3370 2023-12-19T13:48:31.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.257+0000 7f73257fa640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f730806a430 0x7f730806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.257+0000 7f73257fa640 1 -- 172.21.15.113:0/3691651325 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73200885c0 con 0x7f73281f3370 2023-12-19T13:48:31.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.257+0000 7f7327fff640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f730806a430 0x7f730806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.258+0000 7f7327fff640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f730806a430 0x7f730806c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7318036000 tx=0x7f731802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:31.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.262+0000 7f73257fa640 1 -- 172.21.15.113:0/3691651325 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7320053bb0 con 0x7f73281f3370 2023-12-19T13:48:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.438+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7328061910 con 0x7f73281f3370 2023-12-19T13:48:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.439+0000 7f73257fa640 1 -- 172.21.15.113:0/3691651325 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f73200571d0 con 0x7f73281f3370 2023-12-19T13:48:31.439 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:31.440 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":47,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:48:31.022150+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f730806a430 msgr2=0x7f730806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f730806a430 0x7f730806c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7318036000 tx=0x7f731802e000 comp rx=0 tx=0).stop 2023-12-19T13:48:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73281f3370 msgr2=0x7f732813a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73281f3370 0x7f732813a680 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7328071cd0 tx=0x7f732000ccd0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 shutdown_connections 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f730806a430 0x7f730806c8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73281f3370 0x7f732813a680 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f732815aba0 0x7f73281f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 --2- 172.21.15.113:0/3691651325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73140039e0 0x7f732815a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 >> 172.21.15.113:0/3691651325 conn(0x7f73280cbb70 msgr2=0x7f732815bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 shutdown_connections 2023-12-19T13:48:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.442+0000 7f732e27a640 1 -- 172.21.15.113:0/3691651325 wait complete. 2023-12-19T13:48:31.459 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.670+0000 7f79fad0a640 1 Processor -- start 2023-12-19T13:48:31.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.670+0000 7f79fad0a640 1 -- start start 2023-12-19T13:48:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.672+0000 7f79fad0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f40afa50 0x7f79f4166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.672+0000 7f79fad0a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f79f4161a40 0x7f79f40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.672+0000 7f79fad0a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f4165bc0 con 0x7f79f4161660 2023-12-19T13:48:31.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.672+0000 7f79fad0a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f406e520 con 0x7f79f4161a40 2023-12-19T13:48:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.672+0000 7f79fad0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40afef0 con 0x7f79f40afa50 2023-12-19T13:48:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f40afa50 0x7f79f4166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f92a7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f79f4161a40 0x7f79f40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f40afa50 0x7f79f4166050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:45230/0 (socket says 172.21.15.113:45230) 2023-12-19T13:48:31.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f3fff640 1 -- 172.21.15.113:0/3918741413 learned_addr learned my addr 172.21.15.113:0/3918741413 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f3fff640 1 -- 172.21.15.113:0/3918741413 >> v2:172.21.15.151:3300/0 conn(0x7f79f4161a40 msgr2=0x7f79f40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f3fff640 1 --2- 172.21.15.113:0/3918741413 >> v2:172.21.15.151:3300/0 conn(0x7f79f4161a40 0x7f79f40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f3fff640 1 -- 172.21.15.113:0/3918741413 >> v1:172.21.15.151:6789/0 conn(0x7f79f4161660 legacy=0x7f79f40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.673+0000 7f79f3fff640 1 -- 172.21.15.113:0/3918741413 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4165570 con 0x7f79f40afa50 2023-12-19T13:48:31.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.675+0000 7f79f3fff640 1 --2- 172.21.15.113:0/3918741413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f40afa50 0x7f79f4166050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009870 tx=0x7f79e002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4497c091fb69ad29 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:31.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.676+0000 7f79f37fe640 1 -- 172.21.15.113:0/3918741413 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0030840 con 0x7f79f40afa50 2023-12-19T13:48:31.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.676+0000 7f79f37fe640 1 -- 172.21.15.113:0/3918741413 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e00309a0 con 0x7f79f40afa50 2023-12-19T13:48:31.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.676+0000 7f79f37fe640 1 -- 172.21.15.113:0/3918741413 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0030d30 con 0x7f79f40afa50 2023-12-19T13:48:31.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.676+0000 7f79fad0a640 1 -- 172.21.15.113:0/3918741413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f40afa50 msgr2=0x7f79f4166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.676+0000 7f79fad0a640 1 --2- 172.21.15.113:0/3918741413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f40afa50 0x7f79f4166050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009870 tx=0x7f79e002b980 comp rx=0 tx=0).stop 2023-12-19T13:48:31.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.677+0000 7f79fad0a640 1 -- 172.21.15.113:0/3918741413 shutdown_connections 2023-12-19T13:48:31.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.677+0000 7f79fad0a640 1 --2- 172.21.15.113:0/3918741413 >> v2:172.21.15.151:3300/0 conn(0x7f79f4161a40 0x7f79f40b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.677+0000 7f79fad0a640 1 --2- 172.21.15.113:0/3918741413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f40afa50 0x7f79f4166050 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.677+0000 7f79fad0a640 1 -- 172.21.15.113:0/3918741413 >> 172.21.15.113:0/3918741413 conn(0x7f79f40cbb70 msgr2=0x7f79f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:31.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.677+0000 7f79fad0a640 1 -- 172.21.15.113:0/3918741413 shutdown_connections 2023-12-19T13:48:31.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.677+0000 7f79fad0a640 1 -- 172.21.15.113:0/3918741413 wait complete. 2023-12-19T13:48:31.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.679+0000 7f79fad0a640 1 Processor -- start 2023-12-19T13:48:31.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.679+0000 7f79fad0a640 1 -- start start 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.680+0000 7f79fad0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f40afa50 0x7f79f41f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.680+0000 7f79fad0a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79f4161660 0x7f79f41f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.680+0000 7f79fad0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f4161a40 0x7f79f414a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.680+0000 7f79fad0a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f41f8050 con 0x7f79f4161660 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.680+0000 7f79fad0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f414a660 con 0x7f79f40afa50 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.680+0000 7f79fad0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f414cad0 con 0x7f79f4161a40 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79f4161660 0x7f79f41f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79f4161660 0x7f79f41f7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49950/0 (socket says 172.21.15.113:49950) 2023-12-19T13:48:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 -- 172.21.15.113:0/1936216157 learned_addr learned my addr 172.21.15.113:0/1936216157 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 -- 172.21.15.113:0/1936216157 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f4161a40 msgr2=0x7f79f414a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f4161a40 0x7f79f414a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 -- 172.21.15.113:0/1936216157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f40afa50 msgr2=0x7f79f41f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f40afa50 0x7f79f41f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 -- 172.21.15.113:0/1936216157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00094d0 con 0x7f79f4161660 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.681+0000 7f79f3fff640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79f4161660 0x7f79f41f7b10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f79e002b9c0 tx=0x7f79e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.682+0000 7f79f17fa640 1 -- 172.21.15.113:0/1936216157 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0039c10 con 0x7f79f4161660 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.682+0000 7f79f17fa640 1 -- 172.21.15.113:0/1936216157 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0039d70 con 0x7f79f4161660 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.682+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f40a87d0 con 0x7f79f4161660 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.682+0000 7f79f17fa640 1 -- 172.21.15.113:0/1936216157 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00446c0 con 0x7f79f4161660 2023-12-19T13:48:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.682+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f41faeb0 con 0x7f79f4161660 2023-12-19T13:48:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.683+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f4061910 con 0x7f79f4161660 2023-12-19T13:48:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.684+0000 7f79f17fa640 1 -- 172.21.15.113:0/1936216157 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79e004d3b0 con 0x7f79f4161660 2023-12-19T13:48:31.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.685+0000 7f79f17fa640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79d806a460 0x7f79d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:31.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.685+0000 7f79f17fa640 1 -- 172.21.15.113:0/1936216157 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79e003e070 con 0x7f79f4161660 2023-12-19T13:48:31.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.685+0000 7f79f8aa6640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79d806a460 0x7f79d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:31.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.686+0000 7f79f8aa6640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79d806a460 0x7f79d806c920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000f60 tx=0x7f79e80079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:31.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.689+0000 7f79f17fa640 1 -- 172.21.15.113:0/1936216157 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f79e0076980 con 0x7f79f4161660 2023-12-19T13:48:31.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.882+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79f40adab0 con 0x7f79f4161660 2023-12-19T13:48:31.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.885+0000 7f79f17fa640 1 -- 172.21.15.113:0/1936216157 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f79e0079fa0 con 0x7f79f4161660 2023-12-19T13:48:31.885 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:31.885 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":47,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:48:31.022150+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79d806a460 msgr2=0x7f79d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79d806a460 0x7f79d806c920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000f60 tx=0x7f79e80079d0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79f4161660 msgr2=0x7f79f41f7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79f4161660 0x7f79f41f7b10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f79e002b9c0 tx=0x7f79e0004730 comp rx=0 tx=0).stop 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 shutdown_connections 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79d806a460 0x7f79d806c920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f4161a40 0x7f79f414a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79f4161660 0x7f79f41f7b10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 --2- 172.21.15.113:0/1936216157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f40afa50 0x7f79f41f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 >> 172.21.15.113:0/1936216157 conn(0x7f79f40cbb70 msgr2=0x7f79f406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 shutdown_connections 2023-12-19T13:48:31.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:31.888+0000 7f79fad0a640 1 -- 172.21.15.113:0/1936216157 wait complete. 2023-12-19T13:48:31.906 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:48:32.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.110+0000 7fc159030640 1 Processor -- start 2023-12-19T13:48:32.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.110+0000 7fc159030640 1 -- start start 2023-12-19T13:48:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.111+0000 7fc159030640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc1540ae110 0x7fc1540b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.111+0000 7fc159030640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1540b0640 0x7fc15406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.111+0000 7fc159030640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1540b0a60 con 0x7fc154157bf0 2023-12-19T13:48:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.111+0000 7fc159030640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15406b8c0 con 0x7fc1540b0640 2023-12-19T13:48:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.111+0000 7fc159030640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1540ae640 con 0x7fc1540ae110 2023-12-19T13:48:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15359e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1540b0640 0x7fc15406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15359e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1540b0640 0x7fc15406d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49964/0 (socket says 172.21.15.113:49964) 2023-12-19T13:48:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc152d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc154157bf0 0x7fc15415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50084/0 (socket says 172.21.15.113:50084) 2023-12-19T13:48:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15359e640 1 -- 172.21.15.113:0/1384318854 learned_addr learned my addr 172.21.15.113:0/1384318854 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc14bfff640 1 --2- 172.21.15.113:0/1384318854 >> v2:172.21.15.151:3300/0 conn(0x7fc1540ae110 0x7fc1540b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15259c640 1 -- 172.21.15.113:0/1384318854 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362808305 0 0) 0x7fc1540b0a60 con 0x7fc154157bf0 2023-12-19T13:48:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15259c640 1 -- 172.21.15.113:0/1384318854 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc140003520 con 0x7fc154157bf0 2023-12-19T13:48:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15359e640 1 -- 172.21.15.113:0/1384318854 >> v2:172.21.15.151:3300/0 conn(0x7fc1540ae110 msgr2=0x7fc1540b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15359e640 1 --2- 172.21.15.113:0/1384318854 >> v2:172.21.15.151:3300/0 conn(0x7fc1540ae110 0x7fc1540b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15359e640 1 -- 172.21.15.113:0/1384318854 >> v1:172.21.15.113:6789/0 conn(0x7fc154157bf0 legacy=0x7fc15415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.112+0000 7fc15359e640 1 -- 172.21.15.113:0/1384318854 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540ae920 con 0x7fc1540b0640 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.113+0000 7fc15359e640 1 --2- 172.21.15.113:0/1384318854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540b0640 0x7fc15406d230 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc1540af4b0 tx=0x7fc14c02e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42936a132de5ad61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc15259c640 1 -- 172.21.15.113:0/1384318854 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c00b0d0 con 0x7fc1540b0640 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc15259c640 1 -- 172.21.15.113:0/1384318854 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c00b230 con 0x7fc1540b0640 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc15259c640 1 -- 172.21.15.113:0/1384318854 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c009600 con 0x7fc1540b0640 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 -- 172.21.15.113:0/1384318854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540b0640 msgr2=0x7fc15406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 --2- 172.21.15.113:0/1384318854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540b0640 0x7fc15406d230 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc1540af4b0 tx=0x7fc14c02e180 comp rx=0 tx=0).stop 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 -- 172.21.15.113:0/1384318854 shutdown_connections 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 --2- 172.21.15.113:0/1384318854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540b0640 0x7fc15406d230 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 --2- 172.21.15.113:0/1384318854 >> v2:172.21.15.151:3300/0 conn(0x7fc1540ae110 0x7fc1540b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 -- 172.21.15.113:0/1384318854 >> 172.21.15.113:0/1384318854 conn(0x7fc1540cbb70 msgr2=0x7fc1540cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 -- 172.21.15.113:0/1384318854 shutdown_connections 2023-12-19T13:48:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.114+0000 7fc159030640 1 -- 172.21.15.113:0/1384318854 wait complete. 2023-12-19T13:48:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.116+0000 7fc159030640 1 Processor -- start 2023-12-19T13:48:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.116+0000 7fc159030640 1 -- start start 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc159030640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540ae110 0x7fc15413b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc159030640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1540b0640 0x7fc154156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc159030640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc154157bf0 0x7fc154156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc159030640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15415d710 con 0x7fc1540ae110 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc159030640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15413e330 con 0x7fc1540b0640 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc159030640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15413e610 con 0x7fc154157bf0 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc152d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540ae110 0x7fc15413b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc152d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540ae110 0x7fc15413b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49970/0 (socket says 172.21.15.113:49970) 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.117+0000 7fc152d9d640 1 -- 172.21.15.113:0/828221357 learned_addr learned my addr 172.21.15.113:0/828221357 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc15359e640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc154157bf0 0x7fc154156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc14bfff640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1540b0640 0x7fc154156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc152d9d640 1 -- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc154157bf0 msgr2=0x7fc154156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc152d9d640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc154157bf0 0x7fc154156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc152d9d640 1 -- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1540b0640 msgr2=0x7fc154156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc152d9d640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1540b0640 0x7fc154156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc152d9d640 1 -- 172.21.15.113:0/828221357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c00bd40 con 0x7fc1540ae110 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc152d9d640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540ae110 0x7fc15413b6e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c410 tx=0x7fc14400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc14b7fe640 1 -- 172.21.15.113:0/828221357 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440074e0 con 0x7fc1540ae110 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc14b7fe640 1 -- 172.21.15.113:0/828221357 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc144007640 con 0x7fc1540ae110 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.118+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15413e8f0 con 0x7fc1540ae110 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.119+0000 7fc14b7fe640 1 -- 172.21.15.113:0/828221357 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144004a00 con 0x7fc1540ae110 2023-12-19T13:48:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.119+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15413dfd0 con 0x7fc1540ae110 2023-12-19T13:48:32.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.120+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15413eb30 con 0x7fc1540ae110 2023-12-19T13:48:32.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.121+0000 7fc14b7fe640 1 -- 172.21.15.113:0/828221357 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc144004b60 con 0x7fc1540ae110 2023-12-19T13:48:32.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.121+0000 7fc14b7fe640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc13406a430 0x7fc13406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:32.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.122+0000 7fc14b7fe640 1 -- 172.21.15.113:0/828221357 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc144088430 con 0x7fc1540ae110 2023-12-19T13:48:32.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.122+0000 7fc14bfff640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc13406a430 0x7fc13406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:32.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.123+0000 7fc14bfff640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc13406a430 0x7fc13406c8f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1541f1870 tx=0x7fc13c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:32.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.126+0000 7fc14b7fe640 1 -- 172.21.15.113:0/828221357 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc15413eb30 con 0x7fc1540ae110 2023-12-19T13:48:32.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:32.355+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc15413eb30 con 0x7fc1540ae110 2023-12-19T13:48:33.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.052+0000 7fc14b7fe640 1 -- 172.21.15.113:0/828221357 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc15413eb30 con 0x7fc1540ae110 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc13406a430 msgr2=0x7fc13406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc13406a430 0x7fc13406c8f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1541f1870 tx=0x7fc13c008040 comp rx=0 tx=0).stop 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540ae110 msgr2=0x7fc15413b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540ae110 0x7fc15413b6e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c410 tx=0x7fc14400c8d0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 shutdown_connections 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc13406a430 0x7fc13406c8f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc154157bf0 0x7fc154156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1540b0640 0x7fc154156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 --2- 172.21.15.113:0/828221357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1540ae110 0x7fc15413b6e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 >> 172.21.15.113:0/828221357 conn(0x7fc1540cbb70 msgr2=0x7fc15406e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:33.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 shutdown_connections 2023-12-19T13:48:33.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.056+0000 7fc159030640 1 -- 172.21.15.113:0/828221357 wait complete. 2023-12-19T13:48:33.076 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:48:33.076 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:48:33.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.285+0000 7f2a2c73c640 1 Processor -- start 2023-12-19T13:48:33.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.285+0000 7f2a2c73c640 1 -- start start 2023-12-19T13:48:33.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.287+0000 7f2a2c73c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 0x7f2a2415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.287+0000 7f2a2c73c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2a240cc540 0x7f2a2406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.287+0000 7f2a2c73c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a24161510 con 0x7f2a2406f6a0 2023-12-19T13:48:33.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.287+0000 7f2a2c73c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2415ed70 con 0x7f2a240cc540 2023-12-19T13:48:33.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.287+0000 7f2a2c73c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2415e4d0 con 0x7f2a2415b3c0 2023-12-19T13:48:33.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.287+0000 7f2a2acd9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2a2406f6a0 0x7f2a2406c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50086/0 (socket says 172.21.15.113:50086) 2023-12-19T13:48:33.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.287+0000 7f2a2acd9640 1 -- 172.21.15.113:0/1622659450 learned_addr learned my addr 172.21.15.113:0/1622659450 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:33.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a2a4d8640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 0x7f2a2415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:33.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a29cd7640 1 --2- 172.21.15.113:0/1622659450 >> v2:172.21.15.151:3300/0 conn(0x7f2a240cc540 0x7f2a2406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:33.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130281228 0 0) 0x7f2a24161510 con 0x7f2a2406f6a0 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a10003520 con 0x7f2a2406f6a0 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 474597433 0 0) 0x7f2a10003520 con 0x7f2a2406f6a0 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 msgr2=0x7f2a2415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 0x7f2a2415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 >> v2:172.21.15.151:3300/0 conn(0x7f2a240cc540 msgr2=0x7f2a2406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 --2- 172.21.15.113:0/1622659450 >> v2:172.21.15.151:3300/0 conn(0x7f2a240cc540 0x7f2a2406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2415e7b0 con 0x7f2a2406f6a0 2023-12-19T13:48:33.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f2a1c0019f0 con 0x7f2a2406f6a0 2023-12-19T13:48:33.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 >> v1:172.21.15.113:6789/0 conn(0x7f2a2406f6a0 legacy=0x7f2a2406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:33.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 0x7f2a100039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a10003fb0 0x7f2a100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2415ed70 con 0x7f2a10004d00 2023-12-19T13:48:33.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2415e4d0 con 0x7f2a10003fb0 2023-12-19T13:48:33.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.288+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1000ba00 con 0x7f2a2415b3c0 2023-12-19T13:48:33.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a2acd9640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:33.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a29cd7640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a10003fb0 0x7f2a100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:33.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a2a4d8640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 0x7f2a100039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:33.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a2acd9640 1 -- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 msgr2=0x7f2a100039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:33.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a2acd9640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a2415b3c0 0x7f2a100039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a2acd9640 1 -- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a10003fb0 msgr2=0x7f2a100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:33.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a2acd9640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a10003fb0 0x7f2a100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.289+0000 7f2a2acd9640 1 -- 172.21.15.113:0/1622659450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10003520 con 0x7f2a10004d00 2023-12-19T13:48:33.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.290+0000 7f2a2acd9640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2a24067980 tx=0x7f2a100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2c84ec60e610f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:33.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.290+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c034630 con 0x7f2a10004d00 2023-12-19T13:48:33.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.290+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c02f070 con 0x7f2a10004d00 2023-12-19T13:48:33.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.290+0000 7f2a294d6640 1 -- 172.21.15.113:0/1622659450 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c034a30 con 0x7f2a10004d00 2023-12-19T13:48:33.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.291+0000 7f2a2c73c640 1 -- 172.21.15.113:0/1622659450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 msgr2=0x7f2a10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:33.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.291+0000 7f2a2c73c640 1 --2- 172.21.15.113:0/1622659450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2a24067980 tx=0x7f2a100057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.291+0000 7f2a2acd9640 1 -- 172.21.15.113:0/1622659450 reap_dead start 2023-12-19T13:48:33.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.291+0000 7f2a2c73c640 1 -- 172.21.15.113:0/1622659450 shutdown_connections 2023-12-19T13:48:33.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.291+0000 7f2a2c73c640 1 -- 172.21.15.113:0/1622659450 >> 172.21.15.113:0/1622659450 conn(0x7f2a240d01a0 msgr2=0x7f2a240d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:33.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.291+0000 7f2a2c73c640 1 -- 172.21.15.113:0/1622659450 shutdown_connections 2023-12-19T13:48:33.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.291+0000 7f2a2c73c640 1 -- 172.21.15.113:0/1622659450 wait complete. 2023-12-19T13:48:33.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.293+0000 7f2a2c73c640 1 Processor -- start 2023-12-19T13:48:33.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.293+0000 7f2a2c73c640 1 -- start start 2023-12-19T13:48:33.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2c73c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a241e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2c73c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a240cddd0 0x7f2a240ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2c73c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a24158b00 0x7f2a24158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2c73c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240cfaa0 con 0x7f2a10004d00 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2c73c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240ce790 con 0x7f2a24158b00 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2c73c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240cea20 con 0x7f2a240cddd0 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2a4d8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a241e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2a4d8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a241e7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49986/0 (socket says 172.21.15.113:49986) 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.294+0000 7f2a2a4d8640 1 -- 172.21.15.113:0/2139824610 learned_addr learned my addr 172.21.15.113:0/2139824610 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2a4d8640 1 -- 172.21.15.113:0/2139824610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a240cddd0 msgr2=0x7f2a240ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2a4d8640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a240cddd0 0x7f2a240ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2a4d8640 1 -- 172.21.15.113:0/2139824610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a24158b00 msgr2=0x7f2a24158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2a4d8640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a24158b00 0x7f2a24158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:33.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2a4d8640 1 -- 172.21.15.113:0/2139824610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240ced00 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2a4d8640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a241e7350 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2a20011600 tx=0x7f2a20011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a1affd640 1 -- 172.21.15.113:0/2139824610 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20015870 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a1affd640 1 -- 172.21.15.113:0/2139824610 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a200159d0 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a1affd640 1 -- 172.21.15.113:0/2139824610 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20015d40 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240cefe0 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.295+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a240cf5a0 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.296+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a241616c0 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.297+0000 7f2a1affd640 1 -- 172.21.15.113:0/2139824610 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a2000f490 con 0x7f2a10004d00 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.298+0000 7f2a1affd640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2a0806a430 0x7f2a0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:33.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.298+0000 7f2a1affd640 1 -- 172.21.15.113:0/2139824610 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a20088e30 con 0x7f2a10004d00 2023-12-19T13:48:33.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.298+0000 7f2a29cd7640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2a0806a430 0x7f2a0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:33.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.299+0000 7f2a29cd7640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2a0806a430 0x7f2a0806c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a240cdd60 tx=0x7f2a14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:33.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.302+0000 7f2a1affd640 1 -- 172.21.15.113:0/2139824610 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a20054380 con 0x7f2a10004d00 2023-12-19T13:48:33.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:33.532+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2a24061910 con 0x7f2a10004d00 2023-12-19T13:48:34.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.460+0000 7f2a1affd640 1 -- 172.21.15.113:0/2139824610 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2a200579a0 con 0x7f2a10004d00 2023-12-19T13:48:34.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2a0806a430 msgr2=0x7f2a0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2a0806a430 0x7f2a0806c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a240cdd60 tx=0x7f2a14008040 comp rx=0 tx=0).stop 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 msgr2=0x7f2a241e7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a241e7350 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2a20011600 tx=0x7f2a20011ac0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 shutdown_connections 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2a0806a430 0x7f2a0806c8f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a24158b00 0x7f2a24158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a240cddd0 0x7f2a240ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 --2- 172.21.15.113:0/2139824610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a10004d00 0x7f2a241e7350 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.463+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 >> 172.21.15.113:0/2139824610 conn(0x7f2a240d01a0 msgr2=0x7f2a24160700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.464+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 shutdown_connections 2023-12-19T13:48:34.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.464+0000 7f2a2c73c640 1 -- 172.21.15.113:0/2139824610 wait complete. 2023-12-19T13:48:34.482 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:48:34.482 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:34.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.695+0000 7fc524b0a640 1 Processor -- start 2023-12-19T13:48:34.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.695+0000 7fc524b0a640 1 -- start start 2023-12-19T13:48:34.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.696+0000 7fc524b0a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5200b0b50 0x7fc52006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.696+0000 7fc524b0a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52006bb30 con 0x7fc52006b590 2023-12-19T13:48:34.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.696+0000 7fc524b0a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5200b0070 con 0x7fc5201449e0 2023-12-19T13:48:34.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.697+0000 7fc524b0a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200b0350 con 0x7fc5200b0b50 2023-12-19T13:48:34.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.697+0000 7fc51ed9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc52006b590 0x7fc5200b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50098/0 (socket says 172.21.15.113:50098) 2023-12-19T13:48:34.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.697+0000 7fc51ed9d640 1 -- 172.21.15.113:0/2974064752 learned_addr learned my addr 172.21.15.113:0/2974064752 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.697+0000 7fc515d9b640 1 --2- 172.21.15.113:0/2974064752 >> v2:172.21.15.151:3300/0 conn(0x7fc5200b0b50 0x7fc52006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.697+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117045794 0 0) 0x7fc52006bb30 con 0x7fc52006b590 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.697+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc50c003520 con 0x7fc52006b590 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1276110108 0 0) 0x7fc50c003520 con 0x7fc52006b590 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 >> v2:172.21.15.151:3300/0 conn(0x7fc5200b0b50 msgr2=0x7fc52006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 --2- 172.21.15.113:0/2974064752 >> v2:172.21.15.151:3300/0 conn(0x7fc5200b0b50 0x7fc52006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 >> v1:172.21.15.151:6789/0 conn(0x7fc5201449e0 legacy=0x7fc5200af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200b0630 con 0x7fc52006b590 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc5180019f0 con 0x7fc52006b590 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 >> v1:172.21.15.113:6789/0 conn(0x7fc52006b590 legacy=0x7fc5200b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c003a30 0x7fc50c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc50c0051d0 0x7fc50c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200b0350 con 0x7fc50c0047c0 2023-12-19T13:48:34.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c00c100 con 0x7fc50c003a30 2023-12-19T13:48:34.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c00c2c0 con 0x7fc50c0051d0 2023-12-19T13:48:34.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.698+0000 7fc515d9b640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc51e59c640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c003a30 0x7fc50c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc51ed9d640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc50c0051d0 0x7fc50c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc515d9b640 1 -- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc50c0051d0 msgr2=0x7fc50c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc515d9b640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc50c0051d0 0x7fc50c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc515d9b640 1 -- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c003a30 msgr2=0x7fc50c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc515d9b640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c003a30 0x7fc50c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc515d9b640 1 -- 172.21.15.113:0/2974064752 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c003520 con 0x7fc50c0047c0 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc51e59c640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c003a30 0x7fc50c003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc51ed9d640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc50c0051d0 0x7fc50c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.699+0000 7fc51ed9d640 1 -- 172.21.15.113:0/2974064752 reap_dead start 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.700+0000 7fc515d9b640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc508009ac0 tx=0x7fc50c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1d40a20c89f225 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.700+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50802c6b0 con 0x7fc50c0047c0 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.700+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50802c810 con 0x7fc50c0047c0 2023-12-19T13:48:34.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.700+0000 7fc51dd9b640 1 -- 172.21.15.113:0/2974064752 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50802cba0 con 0x7fc50c0047c0 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.701+0000 7fc524b0a640 1 -- 172.21.15.113:0/2974064752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc50c0047c0 msgr2=0x7fc50c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.701+0000 7fc524b0a640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc508009ac0 tx=0x7fc50c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.701+0000 7fc524b0a640 1 -- 172.21.15.113:0/2974064752 shutdown_connections 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.701+0000 7fc524b0a640 1 --2- 172.21.15.113:0/2974064752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.701+0000 7fc524b0a640 1 -- 172.21.15.113:0/2974064752 >> 172.21.15.113:0/2974064752 conn(0x7fc5200cbb70 msgr2=0x7fc5200cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.701+0000 7fc524b0a640 1 -- 172.21.15.113:0/2974064752 shutdown_connections 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.701+0000 7fc524b0a640 1 -- 172.21.15.113:0/2974064752 wait complete. 2023-12-19T13:48:34.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.703+0000 7fc524b0a640 1 Processor -- start 2023-12-19T13:48:34.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.703+0000 7fc524b0a640 1 -- start start 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc524b0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c0047c0 0x7fc5201566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc524b0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52013a960 0x7fc52006fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc524b0a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc52013f8e0 0x7fc52013fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc524b0a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5201402a0 con 0x7fc52013f8e0 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc524b0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520156cb0 con 0x7fc50c0047c0 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc524b0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc520156f90 con 0x7fc52013a960 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc52013f8e0 0x7fc52013fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc52013f8e0 0x7fc52013fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49992/0 (socket says 172.21.15.113:49992) 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 -- 172.21.15.113:0/3929404935 learned_addr learned my addr 172.21.15.113:0/3929404935 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51e59c640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c0047c0 0x7fc5201566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc515d9b640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52013a960 0x7fc52006fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 -- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52013a960 msgr2=0x7fc52006fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52013a960 0x7fc52006fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 -- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c0047c0 msgr2=0x7fc5201566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c0047c0 0x7fc5201566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51ed9d640 1 -- 172.21.15.113:0/3929404935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc520157270 con 0x7fc52013f8e0 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.704+0000 7fc51e59c640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c0047c0 0x7fc5201566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.705+0000 7fc51ed9d640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc52013f8e0 0x7fc52013fd60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc520071c50 tx=0x7fc51800df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.705+0000 7fc5177fe640 1 -- 172.21.15.113:0/3929404935 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800b860 con 0x7fc52013f8e0 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.705+0000 7fc5177fe640 1 -- 172.21.15.113:0/3929404935 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800b9c0 con 0x7fc52013f8e0 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.705+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc520157550 con 0x7fc52013f8e0 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.705+0000 7fc5177fe640 1 -- 172.21.15.113:0/3929404935 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800bd70 con 0x7fc52013f8e0 2023-12-19T13:48:34.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.705+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52013adc0 con 0x7fc52013f8e0 2023-12-19T13:48:34.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.706+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520061910 con 0x7fc52013f8e0 2023-12-19T13:48:34.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.707+0000 7fc5177fe640 1 -- 172.21.15.113:0/3929404935 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc518007070 con 0x7fc52013f8e0 2023-12-19T13:48:34.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.708+0000 7fc5177fe640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc50006a460 0x7fc50006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:34.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.708+0000 7fc5177fe640 1 -- 172.21.15.113:0/3929404935 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5180884b0 con 0x7fc52013f8e0 2023-12-19T13:48:34.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.708+0000 7fc51e59c640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc50006a460 0x7fc50006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:34.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.709+0000 7fc51e59c640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc50006a460 0x7fc50006c920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc5100016f0 tx=0x7fc510009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.713+0000 7fc5177fe640 1 -- 172.21.15.113:0/3929404935 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc518053b30 con 0x7fc52013f8e0 2023-12-19T13:48:34.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.942+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5200706d0 con 0x7fc52013f8e0 2023-12-19T13:48:34.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.943+0000 7fc5177fe640 1 -- 172.21.15.113:0/3929404935 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fc518057150 con 0x7fc52013f8e0 2023-12-19T13:48:34.943 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:48:34.943 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:48:34.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.945+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc50006a460 msgr2=0x7fc50006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.945+0000 7fc524b0a640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc50006a460 0x7fc50006c920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc5100016f0 tx=0x7fc510009040 comp rx=0 tx=0).stop 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.945+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc52013f8e0 msgr2=0x7fc52013fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.945+0000 7fc524b0a640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc52013f8e0 0x7fc52013fd60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc520071c50 tx=0x7fc51800df60 comp rx=0 tx=0).stop 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 shutdown_connections 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc50006a460 0x7fc50006c920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc52013f8e0 0x7fc52013fd60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52013a960 0x7fc52006fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 --2- 172.21.15.113:0/3929404935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc50c0047c0 0x7fc5201566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 >> 172.21.15.113:0/3929404935 conn(0x7fc5200cbb70 msgr2=0x7fc52015cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 shutdown_connections 2023-12-19T13:48:34.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:34.946+0000 7fc524b0a640 1 -- 172.21.15.113:0/3929404935 wait complete. 2023-12-19T13:48:34.964 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:48:35.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.171+0000 7eff8998b640 1 Processor -- start 2023-12-19T13:48:35.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.171+0000 7eff8998b640 1 -- start start 2023-12-19T13:48:35.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff8998b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7eff840b0b50 0x7eff8406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff8998b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff8406b590 0x7eff8406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff8998b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8406bb30 con 0x7eff841449e0 2023-12-19T13:48:35.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff8998b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840b0070 con 0x7eff8406b590 2023-12-19T13:48:35.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff8998b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840b0350 con 0x7eff840b0b50 2023-12-19T13:48:35.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff837fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff8406b590 0x7eff8406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff837fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff8406b590 0x7eff8406c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50008/0 (socket says 172.21.15.113:50008) 2023-12-19T13:48:35.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff837fe640 1 -- 172.21.15.113:0/3624791187 learned_addr learned my addr 172.21.15.113:0/3624791187 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:35.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.173+0000 7eff827fc640 1 --2- 172.21.15.113:0/3624791187 >> v2:172.21.15.151:3300/0 conn(0x7eff840b0b50 0x7eff8406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.174+0000 7eff837fe640 1 -- 172.21.15.113:0/3624791187 >> v2:172.21.15.151:3300/0 conn(0x7eff840b0b50 msgr2=0x7eff8406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:35.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.174+0000 7eff837fe640 1 --2- 172.21.15.113:0/3624791187 >> v2:172.21.15.151:3300/0 conn(0x7eff840b0b50 0x7eff8406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.174+0000 7eff837fe640 1 -- 172.21.15.113:0/3624791187 >> v1:172.21.15.113:6789/0 conn(0x7eff841449e0 legacy=0x7eff840af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.174+0000 7eff837fe640 1 -- 172.21.15.113:0/3624791187 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840b0630 con 0x7eff8406b590 2023-12-19T13:48:35.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.175+0000 7eff837fe640 1 --2- 172.21.15.113:0/3624791187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff8406b590 0x7eff8406c4e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7eff84071c80 tx=0x7eff7c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7901fc707ec24e63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:35.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.175+0000 7eff81ffb640 1 -- 172.21.15.113:0/3624791187 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c02cb20 con 0x7eff8406b590 2023-12-19T13:48:35.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.175+0000 7eff81ffb640 1 -- 172.21.15.113:0/3624791187 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c02cc80 con 0x7eff8406b590 2023-12-19T13:48:35.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.175+0000 7eff81ffb640 1 -- 172.21.15.113:0/3624791187 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0343f0 con 0x7eff8406b590 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 -- 172.21.15.113:0/3624791187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff8406b590 msgr2=0x7eff8406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 --2- 172.21.15.113:0/3624791187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff8406b590 0x7eff8406c4e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7eff84071c80 tx=0x7eff7c02bf80 comp rx=0 tx=0).stop 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 -- 172.21.15.113:0/3624791187 shutdown_connections 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 --2- 172.21.15.113:0/3624791187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff8406b590 0x7eff8406c4e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 --2- 172.21.15.113:0/3624791187 >> v2:172.21.15.151:3300/0 conn(0x7eff840b0b50 0x7eff8406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 -- 172.21.15.113:0/3624791187 >> 172.21.15.113:0/3624791187 conn(0x7eff840cbb70 msgr2=0x7eff840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 -- 172.21.15.113:0/3624791187 shutdown_connections 2023-12-19T13:48:35.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.176+0000 7eff8998b640 1 -- 172.21.15.113:0/3624791187 wait complete. 2023-12-19T13:48:35.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.178+0000 7eff8998b640 1 Processor -- start 2023-12-19T13:48:35.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.178+0000 7eff8998b640 1 -- start start 2023-12-19T13:48:35.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff8998b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8406b590 0x7eff840ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff8998b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff840b0b50 0x7eff8413ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff8998b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff841449e0 0x7eff8415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff8998b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff840cdee0 con 0x7eff840b0b50 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff8998b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff84144210 con 0x7eff8406b590 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff8998b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff840ab820 con 0x7eff841449e0 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff827fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff840b0b50 0x7eff8413ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff827fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff840b0b50 0x7eff8413ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50022/0 (socket says 172.21.15.113:50022) 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.179+0000 7eff827fc640 1 -- 172.21.15.113:0/974130113 learned_addr learned my addr 172.21.15.113:0/974130113 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff827fc640 1 -- 172.21.15.113:0/974130113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff841449e0 msgr2=0x7eff8415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff827fc640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff841449e0 0x7eff8415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff827fc640 1 -- 172.21.15.113:0/974130113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8406b590 msgr2=0x7eff840ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff82ffd640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8406b590 0x7eff840ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff827fc640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8406b590 0x7eff840ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff827fc640 1 -- 172.21.15.113:0/974130113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c009b30 con 0x7eff840b0b50 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff827fc640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff840b0b50 0x7eff8413ac20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7eff7800d800 tx=0x7eff7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff6bfff640 1 -- 172.21.15.113:0/974130113 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800b6c0 con 0x7eff840b0b50 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff6bfff640 1 -- 172.21.15.113:0/974130113 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7800b820 con 0x7eff840b0b50 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff6bfff640 1 -- 172.21.15.113:0/974130113 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800bbb0 con 0x7eff840b0b50 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff840cd360 con 0x7eff840b0b50 2023-12-19T13:48:35.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.180+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff840cd920 con 0x7eff840b0b50 2023-12-19T13:48:35.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.182+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff84061910 con 0x7eff840b0b50 2023-12-19T13:48:35.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.182+0000 7eff6bfff640 1 -- 172.21.15.113:0/974130113 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7eff7800bd10 con 0x7eff840b0b50 2023-12-19T13:48:35.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.183+0000 7eff6bfff640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff7006a460 0x7eff7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.183+0000 7eff6bfff640 1 -- 172.21.15.113:0/974130113 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff78088e90 con 0x7eff840b0b50 2023-12-19T13:48:35.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.184+0000 7eff82ffd640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff7006a460 0x7eff7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.184+0000 7eff82ffd640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff7006a460 0x7eff7006c920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff74000f60 tx=0x7eff74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:35.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.187+0000 7eff6bfff640 1 -- 172.21.15.113:0/974130113 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7eff780543d0 con 0x7eff840b0b50 2023-12-19T13:48:35.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.377+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff84070a30 con 0x7eff840b0b50 2023-12-19T13:48:35.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.379+0000 7eff6bfff640 1 -- 172.21.15.113:0/974130113 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16089 (secure 0 0 0) 0x7eff780579f0 con 0x7eff840b0b50 2023-12-19T13:48:35.379 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:35.379 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":48,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:48:32.028059+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff7006a460 msgr2=0x7eff7006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff7006a460 0x7eff7006c920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff74000f60 tx=0x7eff74009040 comp rx=0 tx=0).stop 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff840b0b50 msgr2=0x7eff8413ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff840b0b50 0x7eff8413ac20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7eff7800d800 tx=0x7eff7800dcc0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 shutdown_connections 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff7006a460 0x7eff7006c920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff841449e0 0x7eff8415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.382+0000 7eff8998b640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff840b0b50 0x7eff8413ac20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.383+0000 7eff8998b640 1 --2- 172.21.15.113:0/974130113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8406b590 0x7eff840ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.383+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 >> 172.21.15.113:0/974130113 conn(0x7eff840cbb70 msgr2=0x7eff840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:35.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.383+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 shutdown_connections 2023-12-19T13:48:35.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.383+0000 7eff8998b640 1 -- 172.21.15.113:0/974130113 wait complete. 2023-12-19T13:48:35.401 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:48:35.402 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:48:35.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.615+0000 7f2801a0b640 1 Processor -- start 2023-12-19T13:48:35.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.615+0000 7f2801a0b640 1 -- start start 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f2801a0b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f27fc06e190 0x7f27fc0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f2801a0b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc0af540 0x7f27fc0af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f2801a0b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27fc0ce780 con 0x7f27fc1599c0 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f2801a0b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc15daa0 con 0x7f27fc06e190 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f2801a0b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0aff30 con 0x7f27fc0af540 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f27fa7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f27fc06e190 0x7f27fc0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f27fa7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f27fc06e190 0x7f27fc0cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50034/0 (socket says 172.21.15.113:50034) 2023-12-19T13:48:35.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f27fa7fc640 1 -- 172.21.15.113:0/698897529 learned_addr learned my addr 172.21.15.113:0/698897529 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:35.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f27fb7fe640 1 --2- 172.21.15.113:0/698897529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc0af540 0x7f27fc0af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f27fa7fc640 1 -- 172.21.15.113:0/698897529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc0af540 msgr2=0x7f27fc0af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:35.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.617+0000 7f27fa7fc640 1 --2- 172.21.15.113:0/698897529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc0af540 0x7f27fc0af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.618+0000 7f27fa7fc640 1 -- 172.21.15.113:0/698897529 >> v1:172.21.15.151:6789/0 conn(0x7f27fc1599c0 legacy=0x7f27fc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:35.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.618+0000 7f27fa7fc640 1 -- 172.21.15.113:0/698897529 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc0cea60 con 0x7f27fc06e190 2023-12-19T13:48:35.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.618+0000 7f27fb7fe640 1 --2- 172.21.15.113:0/698897529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc0af540 0x7f27fc0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:35.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.619+0000 7f27fa7fc640 1 --2- 172.21.15.113:0/698897529 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc06e190 0x7f27fc0cdea0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f27f000bb10 tx=0x7f27f002dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c942d25bdef94187 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:35.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.619+0000 7f27f9ffb640 1 -- 172.21.15.113:0/698897529 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f002ed50 con 0x7f27fc06e190 2023-12-19T13:48:35.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.619+0000 7f27f9ffb640 1 -- 172.21.15.113:0/698897529 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0036440 con 0x7f27fc06e190 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.619+0000 7f27f9ffb640 1 -- 172.21.15.113:0/698897529 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00367d0 con 0x7f27fc06e190 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.619+0000 7f2801a0b640 1 -- 172.21.15.113:0/698897529 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc06e190 msgr2=0x7f27fc0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.619+0000 7f2801a0b640 1 --2- 172.21.15.113:0/698897529 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc06e190 0x7f27fc0cdea0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f27f000bb10 tx=0x7f27f002dfa0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.620+0000 7f2801a0b640 1 -- 172.21.15.113:0/698897529 shutdown_connections 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.620+0000 7f2801a0b640 1 --2- 172.21.15.113:0/698897529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc0af540 0x7f27fc0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.620+0000 7f2801a0b640 1 --2- 172.21.15.113:0/698897529 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc06e190 0x7f27fc0cdea0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.620+0000 7f2801a0b640 1 -- 172.21.15.113:0/698897529 >> 172.21.15.113:0/698897529 conn(0x7f27fc0cbb70 msgr2=0x7f27fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.620+0000 7f2801a0b640 1 -- 172.21.15.113:0/698897529 shutdown_connections 2023-12-19T13:48:35.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.620+0000 7f2801a0b640 1 -- 172.21.15.113:0/698897529 wait complete. 2023-12-19T13:48:35.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.621+0000 7f2801a0b640 1 Processor -- start 2023-12-19T13:48:35.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.622+0000 7f2801a0b640 1 -- start start 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.622+0000 7f2801a0b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc06e190 0x7f27fc144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.622+0000 7f2801a0b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27fc0af540 0x7f27fc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.622+0000 7f2801a0b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc1599c0 0x7f27fc158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.622+0000 7f2801a0b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc152550 con 0x7f27fc1599c0 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.622+0000 7f2801a0b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc15ac60 con 0x7f27fc0af540 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.622+0000 7f2801a0b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0cfd50 con 0x7f27fc06e190 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc1599c0 0x7f27fc158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc1599c0 0x7f27fc158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50050/0 (socket says 172.21.15.113:50050) 2023-12-19T13:48:35.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 -- 172.21.15.113:0/6191350 learned_addr learned my addr 172.21.15.113:0/6191350 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27faffd640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc06e190 0x7f27fc144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fa7fc640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27fc0af540 0x7f27fc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 -- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc06e190 msgr2=0x7f27fc144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc06e190 0x7f27fc144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 -- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27fc0af540 msgr2=0x7f27fc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27fc0af540 0x7f27fc0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fb7fe640 1 -- 172.21.15.113:0/6191350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f000b770 con 0x7f27fc1599c0 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.623+0000 7f27fa7fc640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27fc0af540 0x7f27fc0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:35.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.624+0000 7f27fb7fe640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc1599c0 0x7f27fc158740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f27f400cd80 tx=0x7f27f400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:35.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.624+0000 7f27e3fff640 1 -- 172.21.15.113:0/6191350 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400f680 con 0x7f27fc1599c0 2023-12-19T13:48:35.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.624+0000 7f27e3fff640 1 -- 172.21.15.113:0/6191350 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f400f800 con 0x7f27fc1599c0 2023-12-19T13:48:35.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.624+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc15a050 con 0x7f27fc1599c0 2023-12-19T13:48:35.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.624+0000 7f27e3fff640 1 -- 172.21.15.113:0/6191350 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400fbb0 con 0x7f27fc1599c0 2023-12-19T13:48:35.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.624+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc15a610 con 0x7f27fc1599c0 2023-12-19T13:48:35.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.625+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc15ae10 con 0x7f27fc1599c0 2023-12-19T13:48:35.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.626+0000 7f27e3fff640 1 -- 172.21.15.113:0/6191350 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27f400b040 con 0x7f27fc1599c0 2023-12-19T13:48:35.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.627+0000 7f27e3fff640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f27e806a430 0x7f27e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:35.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.627+0000 7f27e3fff640 1 -- 172.21.15.113:0/6191350 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27f40892f0 con 0x7f27fc1599c0 2023-12-19T13:48:35.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.627+0000 7f27faffd640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f27e806a430 0x7f27e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:35.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.628+0000 7f27faffd640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f27e806a430 0x7f27e806c8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f27ec004ea0 tx=0x7f27ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:35.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.631+0000 7f27e3fff640 1 -- 172.21.15.113:0/6191350 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f27fc15ae10 con 0x7f27fc1599c0 2023-12-19T13:48:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.817+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27fc159da0 con 0x7f27e806a430 2023-12-19T13:48:35.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.840+0000 7f27e3fff640 1 -- 172.21.15.113:0/6191350 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273629 (secure 0 0 0) 0x7f27ec005420 con 0x7f27e806a430 2023-12-19T13:48:35.843 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:35.845 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:48:35.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.845+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f27e806a430 msgr2=0x7f27e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.845+0000 7f2801a0b640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f27e806a430 0x7f27e806c8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f27ec004ea0 tx=0x7f27ec009040 comp rx=0 tx=0).stop 2023-12-19T13:48:35.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.845+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc1599c0 msgr2=0x7f27fc158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:35.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.845+0000 7f2801a0b640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc1599c0 0x7f27fc158740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f27f400cd80 tx=0x7f27f400a650 comp rx=0 tx=0).stop 2023-12-19T13:48:35.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 shutdown_connections 2023-12-19T13:48:35.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f27e806a430 0x7f27e806c8f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27fc1599c0 0x7f27fc158740 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27fc0af540 0x7f27fc0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 --2- 172.21.15.113:0/6191350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27fc06e190 0x7f27fc144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:35.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 >> 172.21.15.113:0/6191350 conn(0x7f27fc0cbb70 msgr2=0x7f27fc15ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:35.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 shutdown_connections 2023-12-19T13:48:35.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:35.846+0000 7f2801a0b640 1 -- 172.21.15.113:0/6191350 wait complete. 2023-12-19T13:48:35.864 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-12-19T13:48:34.447117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559693,"statfs":{"total":1600000000,"available":1597125929,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.910515"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542700+0000","last_change":"2023-12-19T13:48:29.542700+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542700+0000","last_undegraded":"2023-12-19T13:48:29.542700+0000","last_fullsized":"2023-12-19T13:48:29.542700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544081+0000","last_change":"2023-12-19T13:48:29.544081+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544081+0000","last_undegraded":"2023-12-19T13:48:29.544081+0000","last_fullsized":"2023-12-19T13:48:29.544081+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542519+0000","last_change":"2023-12-19T13:48:29.542519+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542519+0000","last_undegraded":"2023-12-19T13:48:29.542519+0000","last_fullsized":"2023-12-19T13:48:29.542519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546428+0000","last_change":"2023-12-19T13:48:29.546428+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546428+0000","last_undegraded":"2023-12-19T13:48:29.546428+0000","last_fullsized":"2023-12-19T13:48:29.546428+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:47.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542943+0000","last_change":"2023-12-19T13:48:29.542943+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542943+0000","last_undegraded":"2023-12-19T13:48:29.542943+0000","last_fullsized":"2023-12-19T13:48:29.542943+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544714+0000","last_change":"2023-12-19T13:48:29.544714+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544714+0000","last_undegraded":"2023-12-19T13:48:29.544714+0000","last_fullsized":"2023-12-19T13:48:29.544714+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.550271+0000","last_change":"2023-12-19T13:48:29.550271+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.550271+0000","last_undegraded":"2023-12-19T13:48:29.550271+0000","last_fullsized":"2023-12-19T13:48:29.550271+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:08.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545788+0000","last_change":"2023-12-19T13:48:29.545788+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545788+0000","last_undegraded":"2023-12-19T13:48:29.545788+0000","last_fullsized":"2023-12-19T13:48:29.545788+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.549365+0000","last_change":"2023-12-19T13:48:29.549365+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.549365+0000","last_undegraded":"2023-12-19T13:48:29.549365+0000","last_fullsized":"2023-12-19T13:48:29.549365+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544784+0000","last_change":"2023-12-19T13:48:29.544784+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544784+0000","last_undegraded":"2023-12-19T13:48:29.544784+0000","last_fullsized":"2023-12-19T13:48:29.544784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:31.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545932+0000","last_change":"2023-12-19T13:48:29.545932+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545932+0000","last_undegraded":"2023-12-19T13:48:29.545932+0000","last_fullsized":"2023-12-19T13:48:29.545932+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545316+0000","last_change":"2023-12-19T13:48:29.545316+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545316+0000","last_undegraded":"2023-12-19T13:48:29.545316+0000","last_fullsized":"2023-12-19T13:48:29.545316+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.539369+0000","last_change":"2023-12-19T13:48:29.539369+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.539369+0000","last_undegraded":"2023-12-19T13:48:29.539369+0000","last_fullsized":"2023-12-19T13:48:29.539369+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:30.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.548763+0000","last_change":"2023-12-19T13:48:29.548763+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.548763+0000","last_undegraded":"2023-12-19T13:48:29.548763+0000","last_fullsized":"2023-12-19T13:48:29.548763+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542341+0000","last_change":"2023-12-19T13:48:29.542341+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542341+0000","last_undegraded":"2023-12-19T13:48:29.542341+0000","last_fullsized":"2023-12-19T13:48:29.542341+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546274+0000","last_change":"2023-12-19T13:48:29.546274+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546274+0000","last_undegraded":"2023-12-19T13:48:29.546274+0000","last_fullsized":"2023-12-19T13:48:29.546274+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:38.580105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538264+0000","last_change":"2023-12-19T13:48:29.538264+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538264+0000","last_undegraded":"2023-12-19T13:48:29.538264+0000","last_fullsized":"2023-12-19T13:48:29.538264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544057+0000","last_change":"2023-12-19T13:48:29.544057+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544057+0000","last_undegraded":"2023-12-19T13:48:29.544057+0000","last_fullsized":"2023-12-19T13:48:29.544057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:59.915604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.548272+0000","last_change":"2023-12-19T13:48:29.548272+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.548272+0000","last_undegraded":"2023-12-19T13:48:29.548272+0000","last_fullsized":"2023-12-19T13:48:29.548272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.541642+0000","last_change":"2023-12-19T13:48:29.541642+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.541642+0000","last_undegraded":"2023-12-19T13:48:29.541642+0000","last_fullsized":"2023-12-19T13:48:29.541642+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545411+0000","last_change":"2023-12-19T13:48:29.545411+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545411+0000","last_undegraded":"2023-12-19T13:48:29.545411+0000","last_fullsized":"2023-12-19T13:48:29.545411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:53.297196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546971+0000","last_change":"2023-12-19T13:48:29.546971+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546971+0000","last_undegraded":"2023-12-19T13:48:29.546971+0000","last_fullsized":"2023-12-19T13:48:29.546971+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544811+0000","last_change":"2023-12-19T13:48:29.544811+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544811+0000","last_undegraded":"2023-12-19T13:48:29.544811+0000","last_fullsized":"2023-12-19T13:48:29.544811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:34.650395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545531+0000","last_change":"2023-12-19T13:48:29.545531+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545531+0000","last_undegraded":"2023-12-19T13:48:29.545531+0000","last_fullsized":"2023-12-19T13:48:29.545531+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:22.368082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538533+0000","last_change":"2023-12-19T13:48:29.538533+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538533+0000","last_undegraded":"2023-12-19T13:48:29.538533+0000","last_fullsized":"2023-12-19T13:48:29.538533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546393+0000","last_change":"2023-12-19T13:48:29.546393+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546393+0000","last_undegraded":"2023-12-19T13:48:29.546393+0000","last_fullsized":"2023-12-19T13:48:29.546393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538354+0000","last_change":"2023-12-19T13:48:29.538354+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538354+0000","last_undegraded":"2023-12-19T13:48:29.538354+0000","last_fullsized":"2023-12-19T13:48:29.538354+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546465+0000","last_change":"2023-12-19T13:48:29.546465+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546465+0000","last_undegraded":"2023-12-19T13:48:29.546465+0000","last_fullsized":"2023-12-19T13:48:29.546465+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544123+0000","last_change":"2023-12-19T13:48:29.544123+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544123+0000","last_undegraded":"2023-12-19T13:48:29.544123+0000","last_fullsized":"2023-12-19T13:48:29.544123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:14.229510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.541741+0000","last_change":"2023-12-19T13:48:29.541741+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.541741+0000","last_undegraded":"2023-12-19T13:48:29.541741+0000","last_fullsized":"2023-12-19T13:48:29.541741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538389+0000","last_change":"2023-12-19T13:48:29.538389+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538389+0000","last_undegraded":"2023-12-19T13:48:29.538389+0000","last_fullsized":"2023-12-19T13:48:29.538389+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544524+0000","last_change":"2023-12-19T13:48:29.544524+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544524+0000","last_undegraded":"2023-12-19T13:48:29.544524+0000","last_fullsized":"2023-12-19T13:48:29.544524+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:03.503460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-19T13:48:27.006886+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:48:27.006886+0000","last_peered":"2023-12-19T13:48:27.006886+0000","last_clean":"2023-12-19T13:48:27.006886+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:48:27.006886+0000","last_undegraded":"2023-12-19T13:48:27.006886+0000","last_fullsized":"2023-12-19T13:48:27.006886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.008,"15min":1},"min":{"1min":0.64200000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98699999999999999,"15min":0.97699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4339999999999999,"5min":2.008,"15min":2.008},"last":1.4339999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.077,"15min":1.069},"min":{"1min":0.73299999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6160000000000001,"5min":1.617,"15min":1.617},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4390000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.1679999999999999,"15min":1.1459999999999999},"min":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.871,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.8120000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.1619999999999999,"15min":1.145},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.252,"15min":1.23},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.486}]},{"osd":4,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.298,"15min":1.292},"min":{"1min":0.90600000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6739999999999999,"5min":2.181,"15min":2.181},"last":1.357},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.415,"15min":1.407},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2109999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.881}]},{"osd":5,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.653},{"interface":"front","average":{"1min":1.504,"5min":1.4419999999999999,"15min":1.4319999999999999},"min":{"1min":1.0649999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.024,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.7709999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.2749999999999999,"15min":1.256},"min":{"1min":0.79500000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.5029999999999999,"15min":1.4870000000000001},"min":{"1min":1.121,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.6759999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0349999999999999,"15min":1.0249999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.679,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.113,"15min":1.129},"min":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6020000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.071}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.044,"15min":1.028},"min":{"1min":0.83499999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.962,"15min":1.962},"last":1.54},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.524,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2250000000000001,"15min":1.2150000000000001},"min":{"1min":0.86899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.798,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.151,"15min":1.1439999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.504,"5min":1.786,"15min":1.786},"last":1.2749999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3620000000000001},"min":{"1min":0.90600000000000003,"5min":0.87,"15min":0.87},"max":{"1min":1.6910000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.46},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8799999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.4299999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1970000000000001,"15min":1.194},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.403},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.282},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6499999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.5249999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.236},"min":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.363,"15min":1.359},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7989999999999999,"5min":1.907,"15min":1.907},"last":1.579}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4059999999999999,"15min":1.4119999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.347,"15min":1.345},"min":{"1min":0.65000000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.635}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.042,"15min":1.0580000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4359999999999999,"5min":1.516,"15min":1.516},"last":1.528}]},{"osd":1,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.099,"15min":1.099},"min":{"1min":0.70999999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5369999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.998,"15min":0.995},"min":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2270000000000001,"15min":1.254},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5069999999999999,"5min":2.827,"15min":2.827},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2629999999999999,"15min":1.2729999999999999},"min":{"1min":0.81599999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6160000000000001,"5min":2.863,"15min":2.863},"last":1.173}]},{"osd":3,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.623},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.246,"15min":1.242},"min":{"1min":0.97499999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5329999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.48}]},{"osd":4,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.141,"15min":1.133},"min":{"1min":0.79400000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.276,"15min":1.276},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4370000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.333,"15min":1.3129999999999999},"min":{"1min":1.089,"5min":0.623,"15min":0.623},"max":{"1min":1.772,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.579},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.0609999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3899999999999999,"15min":1.399},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7410000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.351},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.417,"15min":1.3999999999999999},"min":{"1min":1.244,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.825,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.6910000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793423,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.347},{"interface":"front","average":{"1min":1.089,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5149999999999999,"5min":2.016,"15min":2.016},"last":1.252}]},{"osd":1,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0629999999999999,"15min":1.0649999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4830000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.995},{"interface":"front","average":{"1min":1.091,"5min":1.115,"15min":1.119},"min":{"1min":0.69699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.4550000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.1200000000000001,"15min":1.1080000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.222,"15min":1.2150000000000001},"min":{"1min":0.90800000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.74,"5min":1.952,"15min":1.952},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.27,"15min":1.278},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6739999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.238,"15min":1.256},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.611,"5min":2.165,"15min":2.165},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8280000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.5640000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6379999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.466,"15min":1.4850000000000001},"min":{"1min":0.88600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.1339999999999999,"5min":2.335,"15min":2.335},"last":1.2270000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4690000000000001,"15min":1.4670000000000001},"min":{"1min":0.82499999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8340000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.7729999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.518,"15min":1.528},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7529999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.4019999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.94199999999999995,"15min":0.97199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.024,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4430000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.60299999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.014,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.077},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3300000000000001,"5min":2.387,"15min":2.387},"last":1.2589999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.5129999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.1359999999999999,"15min":1.1559999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8620000000000001,"5min":2.657,"15min":2.657},"last":1.3400000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5309999999999999,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.161},{"interface":"front","average":{"1min":1.153,"5min":1.2230000000000001,"15min":1.2350000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.532,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.6419999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3080000000000001,"15min":1.3240000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.577},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.88100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.6679999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.81899999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.899,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3460000000000001,"15min":1.357},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9730000000000001,"5min":2.698,"15min":2.698},"last":1.417}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7649999999999999,"5min":3.609,"15min":3.609},"last":1.603},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.89700000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.0910000000000002,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.538}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.083,"5min":2.258,"15min":2.258},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.145}]},{"osd":1,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48799999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.587,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.262,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.044}]},{"osd":3,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.121},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.9950000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.2789999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.099,"15min":1.1060000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.3720000000000001,"5min":1.456,"15min":1.456},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.84299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.635,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.194}]},{"osd":5,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.171,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.407},{"interface":"front","average":{"1min":1.248,"5min":1.296,"15min":1.304},"min":{"1min":0.76700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8859999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4850000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2969999999999999,"15min":1.3129999999999999},"min":{"1min":0.754,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7470000000000001,"5min":2.964,"15min":2.964},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.248,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.708,"5min":2.286,"15min":2.286},"last":1.2430000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.351,"15min":2.351},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.22,"15min":1.23},"min":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.96,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.5249999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2949999999999999,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.749}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.087,"15min":1.115},"min":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.466,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.006},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.179,"15min":1.196},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4139999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.3979999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6899999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.206},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3360000000000001,"5min":7.157,"15min":7.157},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.222,"15min":1.242},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.663,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2929999999999999,"15min":1.3080000000000001},"min":{"1min":0.82499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5940000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.355}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3240000000000001,"15min":1.347},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4550000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.748,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.234}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3500000000000001,"15min":1.3560000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7290000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.296},{"interface":"front","average":{"1min":1.232,"5min":1.4159999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.625,"5min":3.786,"15min":3.786},"last":1.036}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.446,"15min":1.47},"min":{"1min":0.86699999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.47,"15min":1.492},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.7490000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.1240000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2170000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89400000000000002,"15min":0.91400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.365,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.78500000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85399999999999998,"15min":0.86299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.542}]},{"osd":3,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.085,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.085,"15min":1.1080000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4690000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4690000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.84499999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.53,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.147},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.6240000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1539999999999999,"15min":1.1559999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2709999999999999,"15min":1.292},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6299999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.284}]},{"osd":6,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.2310000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.7749999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.244,"15min":1.2470000000000001},"min":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.6719999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.367,"15min":1.3919999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6479999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.4059999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:48:35.870 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:48:36.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.124+0000 7f964acda640 1 Processor -- start 2023-12-19T13:48:36.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.124+0000 7f964acda640 1 -- start start 2023-12-19T13:48:36.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f964acda640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f964415e5a0 0x7f96440b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f964acda640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f964415f680 0x7f96440b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f964acda640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964415ec30 con 0x7f96440cdbf0 2023-12-19T13:48:36.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f964acda640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96440b2cc0 con 0x7f964415e5a0 2023-12-19T13:48:36.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f964acda640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964415e980 con 0x7f964415f680 2023-12-19T13:48:36.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f9649cd8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f964415e5a0 0x7f96440b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f964a4d9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f96440cdbf0 0x7f964406c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50128/0 (socket says 172.21.15.113:50128) 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.126+0000 7f964a4d9640 1 -- 172.21.15.113:0/1980163882 learned_addr learned my addr 172.21.15.113:0/1980163882 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.127+0000 7f96494d7640 1 --2- 172.21.15.113:0/1980163882 >> v2:172.21.15.151:3300/0 conn(0x7f964415f680 0x7f96440b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.127+0000 7f9649cd8640 1 -- 172.21.15.113:0/1980163882 >> v2:172.21.15.151:3300/0 conn(0x7f964415f680 msgr2=0x7f96440b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.127+0000 7f9649cd8640 1 --2- 172.21.15.113:0/1980163882 >> v2:172.21.15.151:3300/0 conn(0x7f964415f680 0x7f96440b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.127+0000 7f9649cd8640 1 -- 172.21.15.113:0/1980163882 >> v1:172.21.15.113:6789/0 conn(0x7f96440cdbf0 legacy=0x7f964406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.127+0000 7f9649cd8640 1 -- 172.21.15.113:0/1980163882 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440b2f90 con 0x7f964415e5a0 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.127+0000 7f9648cd6640 1 -- 172.21.15.113:0/1980163882 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223650246 0 0) 0x7f964415ec30 con 0x7f96440cdbf0 2023-12-19T13:48:36.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.127+0000 7f96494d7640 1 --2- 172.21.15.113:0/1980163882 >> v2:172.21.15.151:3300/0 conn(0x7f964415f680 0x7f96440b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.128+0000 7f9649cd8640 1 --2- 172.21.15.113:0/1980163882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f96440b2030 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f96400097a0 tx=0x7f964002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9708b2af1bf59a0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.128+0000 7f9648cd6640 1 -- 172.21.15.113:0/1980163882 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640031830 con 0x7f964415e5a0 2023-12-19T13:48:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.128+0000 7f9648cd6640 1 -- 172.21.15.113:0/1980163882 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9640031990 con 0x7f964415e5a0 2023-12-19T13:48:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.128+0000 7f9648cd6640 1 -- 172.21.15.113:0/1980163882 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640031d20 con 0x7f964415e5a0 2023-12-19T13:48:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 -- 172.21.15.113:0/1980163882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 msgr2=0x7f96440b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 --2- 172.21.15.113:0/1980163882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f96440b2030 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f96400097a0 tx=0x7f964002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 -- 172.21.15.113:0/1980163882 shutdown_connections 2023-12-19T13:48:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 --2- 172.21.15.113:0/1980163882 >> v2:172.21.15.151:3300/0 conn(0x7f964415f680 0x7f96440b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 --2- 172.21.15.113:0/1980163882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f96440b2030 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 -- 172.21.15.113:0/1980163882 >> 172.21.15.113:0/1980163882 conn(0x7f96440b0100 msgr2=0x7f96440b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 -- 172.21.15.113:0/1980163882 shutdown_connections 2023-12-19T13:48:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.129+0000 7f964acda640 1 -- 172.21.15.113:0/1980163882 wait complete. 2023-12-19T13:48:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.130+0000 7f964acda640 1 Processor -- start 2023-12-19T13:48:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.131+0000 7f964acda640 1 -- start start 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.131+0000 7f964acda640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96440cdbf0 0x7f9644151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.131+0000 7f964acda640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f964414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.131+0000 7f964acda640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f964415f680 0x7f96441e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.131+0000 7f964acda640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96441e53e0 con 0x7f964415e5a0 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.131+0000 7f964acda640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964414f6c0 con 0x7f96440cdbf0 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.131+0000 7f964acda640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96441f6fa0 con 0x7f964415f680 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f964414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f964414f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50072/0 (socket says 172.21.15.113:50072) 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 -- 172.21.15.113:0/3845631674 learned_addr learned my addr 172.21.15.113:0/3845631674 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:36.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f9649cd8640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96440cdbf0 0x7f9644151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 -- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f964415f680 msgr2=0x7f96441e6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f964a4d9640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f964415f680 0x7f96441e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f964415f680 0x7f96441e6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 -- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96440cdbf0 msgr2=0x7f9644151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96440cdbf0 0x7f9644151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f96494d7640 1 -- 172.21.15.113:0/3845631674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640009400 con 0x7f964415e5a0 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.132+0000 7f9649cd8640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96440cdbf0 0x7f9644151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.133+0000 7f96494d7640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f964414f180 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f963400c820 tx=0x7f963400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.133+0000 7f963a7fc640 1 -- 172.21.15.113:0/3845631674 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634007a30 con 0x7f964415e5a0 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.133+0000 7f963a7fc640 1 -- 172.21.15.113:0/3845631674 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634007b90 con 0x7f964415e5a0 2023-12-19T13:48:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.133+0000 7f963a7fc640 1 -- 172.21.15.113:0/3845631674 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400ce10 con 0x7f964415e5a0 2023-12-19T13:48:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.133+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96441e4ab0 con 0x7f964415e5a0 2023-12-19T13:48:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.133+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96441e5070 con 0x7f964415e5a0 2023-12-19T13:48:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.134+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96441e5590 con 0x7f964415e5a0 2023-12-19T13:48:36.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.135+0000 7f963a7fc640 1 -- 172.21.15.113:0/3845631674 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96340113f0 con 0x7f964415e5a0 2023-12-19T13:48:36.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.136+0000 7f963a7fc640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f962806a430 0x7f962806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.136+0000 7f963a7fc640 1 -- 172.21.15.113:0/3845631674 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9634088a10 con 0x7f964415e5a0 2023-12-19T13:48:36.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.136+0000 7f9649cd8640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f962806a430 0x7f962806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.137+0000 7f9649cd8640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f962806a430 0x7f962806c8f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9640036000 tx=0x7f9640008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:36.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.141+0000 7f963a7fc640 1 -- 172.21.15.113:0/3845631674 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f96441e5590 con 0x7f964415e5a0 2023-12-19T13:48:36.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.328+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f964415ee80 con 0x7f962806a430 2023-12-19T13:48:36.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.349+0000 7f963a7fc640 1 -- 172.21.15.113:0/3845631674 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273629 (secure 0 0 0) 0x7f9640031b80 con 0x7f962806a430 2023-12-19T13:48:36.352 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:36.353 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f962806a430 msgr2=0x7f962806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f962806a430 0x7f962806c8f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9640036000 tx=0x7f9640008030 comp rx=0 tx=0).stop 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 msgr2=0x7f964414f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f964414f180 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f963400c820 tx=0x7f963400cce0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 shutdown_connections 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f962806a430 0x7f962806c8f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f964415f680 0x7f96441e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f964415e5a0 0x7f964414f180 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 --2- 172.21.15.113:0/3845631674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96440cdbf0 0x7f9644151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 >> 172.21.15.113:0/3845631674 conn(0x7f96440b0100 msgr2=0x7f96441e8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 shutdown_connections 2023-12-19T13:48:36.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.354+0000 7f964acda640 1 -- 172.21.15.113:0/3845631674 wait complete. 2023-12-19T13:48:36.372 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-12-19T13:48:34.447117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559693,"statfs":{"total":1600000000,"available":1597125929,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.910515"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542700+0000","last_change":"2023-12-19T13:48:29.542700+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542700+0000","last_undegraded":"2023-12-19T13:48:29.542700+0000","last_fullsized":"2023-12-19T13:48:29.542700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544081+0000","last_change":"2023-12-19T13:48:29.544081+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544081+0000","last_undegraded":"2023-12-19T13:48:29.544081+0000","last_fullsized":"2023-12-19T13:48:29.544081+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542519+0000","last_change":"2023-12-19T13:48:29.542519+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542519+0000","last_undegraded":"2023-12-19T13:48:29.542519+0000","last_fullsized":"2023-12-19T13:48:29.542519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546428+0000","last_change":"2023-12-19T13:48:29.546428+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546428+0000","last_undegraded":"2023-12-19T13:48:29.546428+0000","last_fullsized":"2023-12-19T13:48:29.546428+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:47.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542943+0000","last_change":"2023-12-19T13:48:29.542943+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542943+0000","last_undegraded":"2023-12-19T13:48:29.542943+0000","last_fullsized":"2023-12-19T13:48:29.542943+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544714+0000","last_change":"2023-12-19T13:48:29.544714+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544714+0000","last_undegraded":"2023-12-19T13:48:29.544714+0000","last_fullsized":"2023-12-19T13:48:29.544714+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.550271+0000","last_change":"2023-12-19T13:48:29.550271+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.550271+0000","last_undegraded":"2023-12-19T13:48:29.550271+0000","last_fullsized":"2023-12-19T13:48:29.550271+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:08.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545788+0000","last_change":"2023-12-19T13:48:29.545788+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545788+0000","last_undegraded":"2023-12-19T13:48:29.545788+0000","last_fullsized":"2023-12-19T13:48:29.545788+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.549365+0000","last_change":"2023-12-19T13:48:29.549365+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.549365+0000","last_undegraded":"2023-12-19T13:48:29.549365+0000","last_fullsized":"2023-12-19T13:48:29.549365+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544784+0000","last_change":"2023-12-19T13:48:29.544784+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544784+0000","last_undegraded":"2023-12-19T13:48:29.544784+0000","last_fullsized":"2023-12-19T13:48:29.544784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:31.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545932+0000","last_change":"2023-12-19T13:48:29.545932+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545932+0000","last_undegraded":"2023-12-19T13:48:29.545932+0000","last_fullsized":"2023-12-19T13:48:29.545932+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545316+0000","last_change":"2023-12-19T13:48:29.545316+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545316+0000","last_undegraded":"2023-12-19T13:48:29.545316+0000","last_fullsized":"2023-12-19T13:48:29.545316+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.539369+0000","last_change":"2023-12-19T13:48:29.539369+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.539369+0000","last_undegraded":"2023-12-19T13:48:29.539369+0000","last_fullsized":"2023-12-19T13:48:29.539369+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:30.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.548763+0000","last_change":"2023-12-19T13:48:29.548763+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.548763+0000","last_undegraded":"2023-12-19T13:48:29.548763+0000","last_fullsized":"2023-12-19T13:48:29.548763+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.542341+0000","last_change":"2023-12-19T13:48:29.542341+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.542341+0000","last_undegraded":"2023-12-19T13:48:29.542341+0000","last_fullsized":"2023-12-19T13:48:29.542341+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546274+0000","last_change":"2023-12-19T13:48:29.546274+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546274+0000","last_undegraded":"2023-12-19T13:48:29.546274+0000","last_fullsized":"2023-12-19T13:48:29.546274+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:38.580105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538264+0000","last_change":"2023-12-19T13:48:29.538264+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538264+0000","last_undegraded":"2023-12-19T13:48:29.538264+0000","last_fullsized":"2023-12-19T13:48:29.538264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544057+0000","last_change":"2023-12-19T13:48:29.544057+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544057+0000","last_undegraded":"2023-12-19T13:48:29.544057+0000","last_fullsized":"2023-12-19T13:48:29.544057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:59.915604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.548272+0000","last_change":"2023-12-19T13:48:29.548272+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.548272+0000","last_undegraded":"2023-12-19T13:48:29.548272+0000","last_fullsized":"2023-12-19T13:48:29.548272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.541642+0000","last_change":"2023-12-19T13:48:29.541642+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.541642+0000","last_undegraded":"2023-12-19T13:48:29.541642+0000","last_fullsized":"2023-12-19T13:48:29.541642+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545411+0000","last_change":"2023-12-19T13:48:29.545411+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545411+0000","last_undegraded":"2023-12-19T13:48:29.545411+0000","last_fullsized":"2023-12-19T13:48:29.545411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:53.297196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546971+0000","last_change":"2023-12-19T13:48:29.546971+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546971+0000","last_undegraded":"2023-12-19T13:48:29.546971+0000","last_fullsized":"2023-12-19T13:48:29.546971+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544811+0000","last_change":"2023-12-19T13:48:29.544811+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544811+0000","last_undegraded":"2023-12-19T13:48:29.544811+0000","last_fullsized":"2023-12-19T13:48:29.544811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:34.650395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.545531+0000","last_change":"2023-12-19T13:48:29.545531+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.545531+0000","last_undegraded":"2023-12-19T13:48:29.545531+0000","last_fullsized":"2023-12-19T13:48:29.545531+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:22.368082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538533+0000","last_change":"2023-12-19T13:48:29.538533+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538533+0000","last_undegraded":"2023-12-19T13:48:29.538533+0000","last_fullsized":"2023-12-19T13:48:29.538533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546393+0000","last_change":"2023-12-19T13:48:29.546393+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546393+0000","last_undegraded":"2023-12-19T13:48:29.546393+0000","last_fullsized":"2023-12-19T13:48:29.546393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538354+0000","last_change":"2023-12-19T13:48:29.538354+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538354+0000","last_undegraded":"2023-12-19T13:48:29.538354+0000","last_fullsized":"2023-12-19T13:48:29.538354+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.546465+0000","last_change":"2023-12-19T13:48:29.546465+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.546465+0000","last_undegraded":"2023-12-19T13:48:29.546465+0000","last_fullsized":"2023-12-19T13:48:29.546465+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544123+0000","last_change":"2023-12-19T13:48:29.544123+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544123+0000","last_undegraded":"2023-12-19T13:48:29.544123+0000","last_fullsized":"2023-12-19T13:48:29.544123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:14.229510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.541741+0000","last_change":"2023-12-19T13:48:29.541741+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.541741+0000","last_undegraded":"2023-12-19T13:48:29.541741+0000","last_fullsized":"2023-12-19T13:48:29.541741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.538389+0000","last_change":"2023-12-19T13:48:29.538389+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.538389+0000","last_undegraded":"2023-12-19T13:48:29.538389+0000","last_fullsized":"2023-12-19T13:48:29.538389+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:48:30.534071+0000","last_change":"2023-12-19T13:48:30.534071+0000","last_active":"2023-12-19T13:48:30.534071+0000","last_peered":"2023-12-19T13:48:30.534071+0000","last_clean":"2023-12-19T13:48:30.534071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:30.534071+0000","last_undegraded":"2023-12-19T13:48:30.534071+0000","last_fullsized":"2023-12-19T13:48:30.534071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-12-19T13:48:29.544524+0000","last_change":"2023-12-19T13:48:29.544524+0000","last_active":"2023-12-19T13:48:29.528950+0000","last_peered":"2023-12-19T13:48:29.528950+0000","last_clean":"2023-12-19T13:48:29.528950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:48:29.544524+0000","last_undegraded":"2023-12-19T13:48:29.544524+0000","last_fullsized":"2023-12-19T13:48:29.544524+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:03.503460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-19T13:48:27.006886+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:48:27.006886+0000","last_peered":"2023-12-19T13:48:27.006886+0000","last_clean":"2023-12-19T13:48:27.006886+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:48:27.006886+0000","last_undegraded":"2023-12-19T13:48:27.006886+0000","last_fullsized":"2023-12-19T13:48:27.006886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.008,"15min":1},"min":{"1min":0.64200000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98699999999999999,"15min":0.97699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4339999999999999,"5min":2.008,"15min":2.008},"last":1.4339999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.077,"15min":1.069},"min":{"1min":0.73299999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6160000000000001,"5min":1.617,"15min":1.617},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4390000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.1679999999999999,"15min":1.1459999999999999},"min":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.871,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.8120000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.1619999999999999,"15min":1.145},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.252,"15min":1.23},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.486}]},{"osd":4,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.298,"15min":1.292},"min":{"1min":0.90600000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6739999999999999,"5min":2.181,"15min":2.181},"last":1.357},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.415,"15min":1.407},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2109999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.881}]},{"osd":5,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.653},{"interface":"front","average":{"1min":1.504,"5min":1.4419999999999999,"15min":1.4319999999999999},"min":{"1min":1.0649999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.024,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.7709999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.2749999999999999,"15min":1.256},"min":{"1min":0.79500000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.5029999999999999,"15min":1.4870000000000001},"min":{"1min":1.121,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.6759999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0349999999999999,"15min":1.0249999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.679,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.113,"15min":1.129},"min":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6020000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.071}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.044,"15min":1.028},"min":{"1min":0.83499999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.962,"15min":1.962},"last":1.54},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.524,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2250000000000001,"15min":1.2150000000000001},"min":{"1min":0.86899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.798,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.151,"15min":1.1439999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.504,"5min":1.786,"15min":1.786},"last":1.2749999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3620000000000001},"min":{"1min":0.90600000000000003,"5min":0.87,"15min":0.87},"max":{"1min":1.6910000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.46},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8799999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.4299999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1970000000000001,"15min":1.194},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.403},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.282},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6499999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.5249999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.236},"min":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.363,"15min":1.359},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7989999999999999,"5min":1.907,"15min":1.907},"last":1.579}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4059999999999999,"15min":1.4119999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.347,"15min":1.345},"min":{"1min":0.65000000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.635}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.042,"15min":1.0580000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4359999999999999,"5min":1.516,"15min":1.516},"last":1.528}]},{"osd":1,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.099,"15min":1.099},"min":{"1min":0.70999999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5369999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.998,"15min":0.995},"min":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2270000000000001,"15min":1.254},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5069999999999999,"5min":2.827,"15min":2.827},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2629999999999999,"15min":1.2729999999999999},"min":{"1min":0.81599999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6160000000000001,"5min":2.863,"15min":2.863},"last":1.173}]},{"osd":3,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.623},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.246,"15min":1.242},"min":{"1min":0.97499999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5329999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.48}]},{"osd":4,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.141,"15min":1.133},"min":{"1min":0.79400000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.276,"15min":1.276},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4370000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.333,"15min":1.3129999999999999},"min":{"1min":1.089,"5min":0.623,"15min":0.623},"max":{"1min":1.772,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.579},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.0609999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3899999999999999,"15min":1.399},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7410000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.351},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.417,"15min":1.3999999999999999},"min":{"1min":1.244,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.825,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.6910000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793423,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.347},{"interface":"front","average":{"1min":1.089,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5149999999999999,"5min":2.016,"15min":2.016},"last":1.252}]},{"osd":1,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0629999999999999,"15min":1.0649999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4830000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.995},{"interface":"front","average":{"1min":1.091,"5min":1.115,"15min":1.119},"min":{"1min":0.69699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.4550000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.1200000000000001,"15min":1.1080000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.222,"15min":1.2150000000000001},"min":{"1min":0.90800000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.74,"5min":1.952,"15min":1.952},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.27,"15min":1.278},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6739999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.238,"15min":1.256},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.611,"5min":2.165,"15min":2.165},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8280000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.5640000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6379999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.466,"15min":1.4850000000000001},"min":{"1min":0.88600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.1339999999999999,"5min":2.335,"15min":2.335},"last":1.2270000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4690000000000001,"15min":1.4670000000000001},"min":{"1min":0.82499999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8340000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.7729999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.518,"15min":1.528},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7529999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.4019999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.94199999999999995,"15min":0.97199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.024,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4430000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.60299999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.014,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.077},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3300000000000001,"5min":2.387,"15min":2.387},"last":1.2589999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.5129999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.1359999999999999,"15min":1.1559999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8620000000000001,"5min":2.657,"15min":2.657},"last":1.3400000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5309999999999999,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.161},{"interface":"front","average":{"1min":1.153,"5min":1.2230000000000001,"15min":1.2350000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.532,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.6419999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3080000000000001,"15min":1.3240000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.577},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.88100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.6679999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.81899999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.899,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3460000000000001,"15min":1.357},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9730000000000001,"5min":2.698,"15min":2.698},"last":1.417}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7649999999999999,"5min":3.609,"15min":3.609},"last":1.603},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.89700000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.0910000000000002,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.538}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.083,"5min":2.258,"15min":2.258},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.145}]},{"osd":1,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48799999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.587,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.262,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.044}]},{"osd":3,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.121},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.9950000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.2789999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.099,"15min":1.1060000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.3720000000000001,"5min":1.456,"15min":1.456},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.84299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.635,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.194}]},{"osd":5,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.171,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.407},{"interface":"front","average":{"1min":1.248,"5min":1.296,"15min":1.304},"min":{"1min":0.76700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8859999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4850000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2969999999999999,"15min":1.3129999999999999},"min":{"1min":0.754,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7470000000000001,"5min":2.964,"15min":2.964},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.248,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.708,"5min":2.286,"15min":2.286},"last":1.2430000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.351,"15min":2.351},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.22,"15min":1.23},"min":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.96,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.5249999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2949999999999999,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.749}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.087,"15min":1.115},"min":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.466,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.006},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.179,"15min":1.196},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4139999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.3979999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6899999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.206},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3360000000000001,"5min":7.157,"15min":7.157},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.222,"15min":1.242},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.663,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2929999999999999,"15min":1.3080000000000001},"min":{"1min":0.82499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5940000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.355}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3240000000000001,"15min":1.347},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4550000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.748,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.234}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3500000000000001,"15min":1.3560000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7290000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.296},{"interface":"front","average":{"1min":1.232,"5min":1.4159999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.625,"5min":3.786,"15min":3.786},"last":1.036}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.446,"15min":1.47},"min":{"1min":0.86699999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.47,"15min":1.492},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.7490000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.1240000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2170000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89400000000000002,"15min":0.91400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.365,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.78500000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85399999999999998,"15min":0.86299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.542}]},{"osd":3,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.085,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.085,"15min":1.1080000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4690000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4690000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.84499999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.53,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.147},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.6240000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1539999999999999,"15min":1.1559999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2709999999999999,"15min":1.292},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6299999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.284}]},{"osd":6,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.2310000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.7749999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.244,"15min":1.2470000000000001},"min":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.6719999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.367,"15min":1.3919999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6479999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.4059999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:48:36.377 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:48:36.529 INFO:tasks.ceph.mds.c.smithi113.stderr:2023-12-19T13:48:36.530+0000 7f0204b78640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:48:36.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.628+0000 7f4d78777640 1 Processor -- start 2023-12-19T13:48:36.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.628+0000 7f4d78777640 1 -- start start 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d78777640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d700d2b00 0x7f4d700d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d78777640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700cd840 con 0x7f4d70146e10 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d78777640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700b6e90 con 0x7f4d700ce110 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d78777640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700d2430 con 0x7f4d700d2b00 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d75d12640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d700d2b00 0x7f4d700d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d76513640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4d70146e10 0x7f4d700b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50140/0 (socket says 172.21.15.113:50140) 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d76513640 1 -- 172.21.15.113:0/3779248643 learned_addr learned my addr 172.21.15.113:0/3779248643 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d75d12640 1 -- 172.21.15.113:0/3779248643 >> v1:172.21.15.151:6789/0 conn(0x7f4d700ce110 legacy=0x7f4d700b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:36.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.630+0000 7f4d75d12640 1 -- 172.21.15.113:0/3779248643 >> v1:172.21.15.113:6789/0 conn(0x7f4d70146e10 legacy=0x7f4d700b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.631+0000 7f4d75d12640 1 -- 172.21.15.113:0/3779248643 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700d2620 con 0x7f4d700d2b00 2023-12-19T13:48:36.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d75d12640 1 --2- 172.21.15.113:0/3779248643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700d2b00 0x7f4d700d1ef0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097a0 tx=0x7f4d6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786a5965ba7ecd3f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:36.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d75511640 1 -- 172.21.15.113:0/3779248643 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6002e070 con 0x7f4d700d2b00 2023-12-19T13:48:36.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d75511640 1 -- 172.21.15.113:0/3779248643 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600315a0 con 0x7f4d700d2b00 2023-12-19T13:48:36.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d75511640 1 -- 172.21.15.113:0/3779248643 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60031930 con 0x7f4d700d2b00 2023-12-19T13:48:36.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d78777640 1 -- 172.21.15.113:0/3779248643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700d2b00 msgr2=0x7f4d700d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d78777640 1 --2- 172.21.15.113:0/3779248643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700d2b00 0x7f4d700d1ef0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097a0 tx=0x7f4d6002b840 comp rx=0 tx=0).stop 2023-12-19T13:48:36.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d78777640 1 -- 172.21.15.113:0/3779248643 shutdown_connections 2023-12-19T13:48:36.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.632+0000 7f4d78777640 1 --2- 172.21.15.113:0/3779248643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700d2b00 0x7f4d700d1ef0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.633+0000 7f4d78777640 1 -- 172.21.15.113:0/3779248643 >> 172.21.15.113:0/3779248643 conn(0x7f4d700b29c0 msgr2=0x7f4d700b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:36.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.633+0000 7f4d78777640 1 -- 172.21.15.113:0/3779248643 shutdown_connections 2023-12-19T13:48:36.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.633+0000 7f4d78777640 1 -- 172.21.15.113:0/3779248643 wait complete. 2023-12-19T13:48:36.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.634+0000 7f4d78777640 1 Processor -- start 2023-12-19T13:48:36.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.634+0000 7f4d78777640 1 -- start start 2023-12-19T13:48:36.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.635+0000 7f4d78777640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700ce110 0x7f4d70141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.635+0000 7f4d78777640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d700d2b00 0x7f4d700702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.635+0000 7f4d78777640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d70146e10 0x7f4d70070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.635+0000 7f4d78777640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700b1ad0 con 0x7f4d700ce110 2023-12-19T13:48:36.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.635+0000 7f4d78777640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700b1db0 con 0x7f4d700d2b00 2023-12-19T13:48:36.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.635+0000 7f4d78777640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701430a0 con 0x7f4d70146e10 2023-12-19T13:48:36.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700ce110 0x7f4d70141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700ce110 0x7f4d70141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50090/0 (socket says 172.21.15.113:50090) 2023-12-19T13:48:36.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 -- 172.21.15.113:0/3230490858 learned_addr learned my addr 172.21.15.113:0/3230490858 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:36.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 -- 172.21.15.113:0/3230490858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d70146e10 msgr2=0x7f4d70070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d70146e10 0x7f4d70070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 -- 172.21.15.113:0/3230490858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d700d2b00 msgr2=0x7f4d700702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d700d2b00 0x7f4d700702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 -- 172.21.15.113:0/3230490858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009400 con 0x7f4d700ce110 2023-12-19T13:48:36.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d76513640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700ce110 0x7f4d70141890 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c4b0 tx=0x7f4d6c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:36.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.636+0000 7f4d66ffd640 1 -- 172.21.15.113:0/3230490858 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c005ce0 con 0x7f4d700ce110 2023-12-19T13:48:36.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.637+0000 7f4d66ffd640 1 -- 172.21.15.113:0/3230490858 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c005e40 con 0x7f4d700ce110 2023-12-19T13:48:36.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.637+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7015dc80 con 0x7f4d700ce110 2023-12-19T13:48:36.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.637+0000 7f4d66ffd640 1 -- 172.21.15.113:0/3230490858 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c007270 con 0x7f4d700ce110 2023-12-19T13:48:36.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.637+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d701f6ac0 con 0x7f4d700ce110 2023-12-19T13:48:36.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.638+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d701f6d10 con 0x7f4d700ce110 2023-12-19T13:48:36.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.639+0000 7f4d66ffd640 1 -- 172.21.15.113:0/3230490858 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d6c0073d0 con 0x7f4d700ce110 2023-12-19T13:48:36.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.640+0000 7f4d66ffd640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d5406a430 0x7f4d5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:36.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.640+0000 7f4d66ffd640 1 -- 172.21.15.113:0/3230490858 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d6c087d90 con 0x7f4d700ce110 2023-12-19T13:48:36.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.640+0000 7f4d75d12640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d5406a430 0x7f4d5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:36.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.641+0000 7f4d75d12640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d5406a430 0x7f4d5406c8f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d60036000 tx=0x7f4d60030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:36.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.644+0000 7f4d66ffd640 1 -- 172.21.15.113:0/3230490858 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d6c056eb0 con 0x7f4d700ce110 2023-12-19T13:48:36.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.817+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d700b44a0 con 0x7f4d5406a430 2023-12-19T13:48:36.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.838+0000 7f4d66ffd640 1 -- 172.21.15.113:0/3230490858 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282467 (secure 0 0 0) 0x7f4d60031a90 con 0x7f4d5406a430 2023-12-19T13:48:36.842 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:36.843 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:48:36.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.843+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d5406a430 msgr2=0x7f4d5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.843+0000 7f4d78777640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d5406a430 0x7f4d5406c8f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d60036000 tx=0x7f4d60030000 comp rx=0 tx=0).stop 2023-12-19T13:48:36.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.843+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700ce110 msgr2=0x7f4d70141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:36.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.843+0000 7f4d78777640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700ce110 0x7f4d70141890 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c4b0 tx=0x7f4d6c00c970 comp rx=0 tx=0).stop 2023-12-19T13:48:36.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.843+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 shutdown_connections 2023-12-19T13:48:36.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.844+0000 7f4d78777640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d5406a430 0x7f4d5406c8f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.844+0000 7f4d78777640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d70146e10 0x7f4d70070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.844+0000 7f4d78777640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d700d2b00 0x7f4d700702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.844+0000 7f4d78777640 1 --2- 172.21.15.113:0/3230490858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700ce110 0x7f4d70141890 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:36.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.844+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 >> 172.21.15.113:0/3230490858 conn(0x7f4d700b29c0 msgr2=0x7f4d7006f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:36.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.844+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 shutdown_connections 2023-12-19T13:48:36.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:36.844+0000 7f4d78777640 1 -- 172.21.15.113:0/3230490858 wait complete. 2023-12-19T13:48:36.862 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-19T13:48:36.447643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559531,"statfs":{"total":1600000000,"available":1596960588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001889"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291950+0000","last_change":"2023-12-19T13:48:31.044642+0000","last_active":"2023-12-19T13:48:32.291950+0000","last_peered":"2023-12-19T13:48:32.291950+0000","last_clean":"2023-12-19T13:48:32.291950+0000","last_became_active":"2023-12-19T13:48:31.044404+0000","last_became_peered":"2023-12-19T13:48:31.044404+0000","last_unstale":"2023-12-19T13:48:32.291950+0000","last_undegraded":"2023-12-19T13:48:32.291950+0000","last_fullsized":"2023-12-19T13:48:32.291950+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042500+0000","last_change":"2023-12-19T13:48:31.051159+0000","last_active":"2023-12-19T13:48:32.042500+0000","last_peered":"2023-12-19T13:48:32.042500+0000","last_clean":"2023-12-19T13:48:32.042500+0000","last_became_active":"2023-12-19T13:48:31.051029+0000","last_became_peered":"2023-12-19T13:48:31.051029+0000","last_unstale":"2023-12-19T13:48:32.042500+0000","last_undegraded":"2023-12-19T13:48:32.042500+0000","last_fullsized":"2023-12-19T13:48:32.042500+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290704+0000","last_change":"2023-12-19T13:48:31.048954+0000","last_active":"2023-12-19T13:48:32.290704+0000","last_peered":"2023-12-19T13:48:32.290704+0000","last_clean":"2023-12-19T13:48:32.290704+0000","last_became_active":"2023-12-19T13:48:31.048739+0000","last_became_peered":"2023-12-19T13:48:31.048739+0000","last_unstale":"2023-12-19T13:48:32.290704+0000","last_undegraded":"2023-12-19T13:48:32.290704+0000","last_fullsized":"2023-12-19T13:48:32.290704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:55.364518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291898+0000","last_change":"2023-12-19T13:48:31.057026+0000","last_active":"2023-12-19T13:48:32.291898+0000","last_peered":"2023-12-19T13:48:32.291898+0000","last_clean":"2023-12-19T13:48:32.291898+0000","last_became_active":"2023-12-19T13:48:31.056603+0000","last_became_peered":"2023-12-19T13:48:31.056603+0000","last_unstale":"2023-12-19T13:48:32.291898+0000","last_undegraded":"2023-12-19T13:48:32.291898+0000","last_fullsized":"2023-12-19T13:48:32.291898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:47.540113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292168+0000","last_change":"2023-12-19T13:48:31.063988+0000","last_active":"2023-12-19T13:48:32.292168+0000","last_peered":"2023-12-19T13:48:32.292168+0000","last_clean":"2023-12-19T13:48:32.292168+0000","last_became_active":"2023-12-19T13:48:31.063771+0000","last_became_peered":"2023-12-19T13:48:31.063771+0000","last_unstale":"2023-12-19T13:48:32.292168+0000","last_undegraded":"2023-12-19T13:48:32.292168+0000","last_fullsized":"2023-12-19T13:48:32.292168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292305+0000","last_change":"2023-12-19T13:48:31.064483+0000","last_active":"2023-12-19T13:48:32.292305+0000","last_peered":"2023-12-19T13:48:32.292305+0000","last_clean":"2023-12-19T13:48:32.292305+0000","last_became_active":"2023-12-19T13:48:31.064224+0000","last_became_peered":"2023-12-19T13:48:31.064224+0000","last_unstale":"2023-12-19T13:48:32.292305+0000","last_undegraded":"2023-12-19T13:48:32.292305+0000","last_fullsized":"2023-12-19T13:48:32.292305+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042523+0000","last_change":"2023-12-19T13:48:31.054245+0000","last_active":"2023-12-19T13:48:32.042523+0000","last_peered":"2023-12-19T13:48:32.042523+0000","last_clean":"2023-12-19T13:48:32.042523+0000","last_became_active":"2023-12-19T13:48:31.053974+0000","last_became_peered":"2023-12-19T13:48:31.053974+0000","last_unstale":"2023-12-19T13:48:32.042523+0000","last_undegraded":"2023-12-19T13:48:32.042523+0000","last_fullsized":"2023-12-19T13:48:32.042523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:44.149292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293318+0000","last_change":"2023-12-19T13:48:31.060864+0000","last_active":"2023-12-19T13:48:32.293318+0000","last_peered":"2023-12-19T13:48:32.293318+0000","last_clean":"2023-12-19T13:48:32.293318+0000","last_became_active":"2023-12-19T13:48:31.057459+0000","last_became_peered":"2023-12-19T13:48:31.057459+0000","last_unstale":"2023-12-19T13:48:32.293318+0000","last_undegraded":"2023-12-19T13:48:32.293318+0000","last_fullsized":"2023-12-19T13:48:32.293318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:39.585226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291888+0000","last_change":"2023-12-19T13:48:31.066252+0000","last_active":"2023-12-19T13:48:32.291888+0000","last_peered":"2023-12-19T13:48:32.291888+0000","last_clean":"2023-12-19T13:48:32.291888+0000","last_became_active":"2023-12-19T13:48:31.064257+0000","last_became_peered":"2023-12-19T13:48:31.064257+0000","last_unstale":"2023-12-19T13:48:32.291888+0000","last_undegraded":"2023-12-19T13:48:32.291888+0000","last_fullsized":"2023-12-19T13:48:32.291888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:12.317229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.294770+0000","last_change":"2023-12-19T13:48:31.062233+0000","last_active":"2023-12-19T13:48:32.294770+0000","last_peered":"2023-12-19T13:48:32.294770+0000","last_clean":"2023-12-19T13:48:32.294770+0000","last_became_active":"2023-12-19T13:48:31.059606+0000","last_became_peered":"2023-12-19T13:48:31.059606+0000","last_unstale":"2023-12-19T13:48:32.294770+0000","last_undegraded":"2023-12-19T13:48:32.294770+0000","last_fullsized":"2023-12-19T13:48:32.294770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:01.890904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292230+0000","last_change":"2023-12-19T13:48:31.066122+0000","last_active":"2023-12-19T13:48:32.292230+0000","last_peered":"2023-12-19T13:48:32.292230+0000","last_clean":"2023-12-19T13:48:32.292230+0000","last_became_active":"2023-12-19T13:48:31.065042+0000","last_became_peered":"2023-12-19T13:48:31.065042+0000","last_unstale":"2023-12-19T13:48:32.292230+0000","last_undegraded":"2023-12-19T13:48:32.292230+0000","last_fullsized":"2023-12-19T13:48:32.292230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:05.367712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042744+0000","last_change":"2023-12-19T13:48:31.041244+0000","last_active":"2023-12-19T13:48:32.042744+0000","last_peered":"2023-12-19T13:48:32.042744+0000","last_clean":"2023-12-19T13:48:32.042744+0000","last_became_active":"2023-12-19T13:48:31.041036+0000","last_became_peered":"2023-12-19T13:48:31.041036+0000","last_unstale":"2023-12-19T13:48:32.042744+0000","last_undegraded":"2023-12-19T13:48:32.042744+0000","last_fullsized":"2023-12-19T13:48:32.042744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:34.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292651+0000","last_change":"2023-12-19T13:48:31.062333+0000","last_active":"2023-12-19T13:48:32.292651+0000","last_peered":"2023-12-19T13:48:32.292651+0000","last_clean":"2023-12-19T13:48:32.292651+0000","last_became_active":"2023-12-19T13:48:31.062119+0000","last_became_peered":"2023-12-19T13:48:31.062119+0000","last_unstale":"2023-12-19T13:48:32.292651+0000","last_undegraded":"2023-12-19T13:48:32.292651+0000","last_fullsized":"2023-12-19T13:48:32.292651+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292881+0000","last_change":"2023-12-19T13:48:31.063490+0000","last_active":"2023-12-19T13:48:32.292881+0000","last_peered":"2023-12-19T13:48:32.292881+0000","last_clean":"2023-12-19T13:48:32.292881+0000","last_became_active":"2023-12-19T13:48:31.062321+0000","last_became_peered":"2023-12-19T13:48:31.062321+0000","last_unstale":"2023-12-19T13:48:32.292881+0000","last_undegraded":"2023-12-19T13:48:32.292881+0000","last_fullsized":"2023-12-19T13:48:32.292881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:23.373203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292561+0000","last_change":"2023-12-19T13:48:31.060376+0000","last_active":"2023-12-19T13:48:32.292561+0000","last_peered":"2023-12-19T13:48:32.292561+0000","last_clean":"2023-12-19T13:48:32.292561+0000","last_became_active":"2023-12-19T13:48:31.055583+0000","last_became_peered":"2023-12-19T13:48:31.055583+0000","last_unstale":"2023-12-19T13:48:32.292561+0000","last_undegraded":"2023-12-19T13:48:32.292561+0000","last_fullsized":"2023-12-19T13:48:32.292561+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:14:22.998770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292340+0000","last_change":"2023-12-19T13:48:31.060807+0000","last_active":"2023-12-19T13:48:32.292340+0000","last_peered":"2023-12-19T13:48:32.292340+0000","last_clean":"2023-12-19T13:48:32.292340+0000","last_became_active":"2023-12-19T13:48:31.060563+0000","last_became_peered":"2023-12-19T13:48:31.060563+0000","last_unstale":"2023-12-19T13:48:32.292340+0000","last_undegraded":"2023-12-19T13:48:32.292340+0000","last_fullsized":"2023-12-19T13:48:32.292340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:16.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042986+0000","last_change":"2023-12-19T13:48:31.046263+0000","last_active":"2023-12-19T13:48:32.042986+0000","last_peered":"2023-12-19T13:48:32.042986+0000","last_clean":"2023-12-19T13:48:32.042986+0000","last_became_active":"2023-12-19T13:48:31.045298+0000","last_became_peered":"2023-12-19T13:48:31.045298+0000","last_unstale":"2023-12-19T13:48:32.042986+0000","last_undegraded":"2023-12-19T13:48:32.042986+0000","last_fullsized":"2023-12-19T13:48:32.042986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:35.655516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290931+0000","last_change":"2023-12-19T13:48:31.062078+0000","last_active":"2023-12-19T13:48:32.290931+0000","last_peered":"2023-12-19T13:48:32.290931+0000","last_clean":"2023-12-19T13:48:32.290931+0000","last_became_active":"2023-12-19T13:48:31.061681+0000","last_became_peered":"2023-12-19T13:48:31.061681+0000","last_unstale":"2023-12-19T13:48:32.290931+0000","last_undegraded":"2023-12-19T13:48:32.290931+0000","last_fullsized":"2023-12-19T13:48:32.290931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:47.949416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291001+0000","last_change":"2023-12-19T13:48:31.064382+0000","last_active":"2023-12-19T13:48:32.291001+0000","last_peered":"2023-12-19T13:48:32.291001+0000","last_clean":"2023-12-19T13:48:32.291001+0000","last_became_active":"2023-12-19T13:48:31.064164+0000","last_became_peered":"2023-12-19T13:48:31.064164+0000","last_unstale":"2023-12-19T13:48:32.291001+0000","last_undegraded":"2023-12-19T13:48:32.291001+0000","last_fullsized":"2023-12-19T13:48:32.291001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.295433+0000","last_change":"2023-12-19T13:48:31.062892+0000","last_active":"2023-12-19T13:48:32.295433+0000","last_peered":"2023-12-19T13:48:32.295433+0000","last_clean":"2023-12-19T13:48:32.295433+0000","last_became_active":"2023-12-19T13:48:31.060518+0000","last_became_peered":"2023-12-19T13:48:31.060518+0000","last_unstale":"2023-12-19T13:48:32.295433+0000","last_undegraded":"2023-12-19T13:48:32.295433+0000","last_fullsized":"2023-12-19T13:48:32.295433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:23.369417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292587+0000","last_change":"2023-12-19T13:48:31.061636+0000","last_active":"2023-12-19T13:48:32.292587+0000","last_peered":"2023-12-19T13:48:32.292587+0000","last_clean":"2023-12-19T13:48:32.292587+0000","last_became_active":"2023-12-19T13:48:31.058665+0000","last_became_peered":"2023-12-19T13:48:31.058665+0000","last_unstale":"2023-12-19T13:48:32.292587+0000","last_undegraded":"2023-12-19T13:48:32.292587+0000","last_fullsized":"2023-12-19T13:48:32.292587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:15.234631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043320+0000","last_change":"2023-12-19T13:48:31.040705+0000","last_active":"2023-12-19T13:48:32.043320+0000","last_peered":"2023-12-19T13:48:32.043320+0000","last_clean":"2023-12-19T13:48:32.043320+0000","last_became_active":"2023-12-19T13:48:31.039983+0000","last_became_peered":"2023-12-19T13:48:31.039983+0000","last_unstale":"2023-12-19T13:48:32.043320+0000","last_undegraded":"2023-12-19T13:48:32.043320+0000","last_fullsized":"2023-12-19T13:48:32.043320+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:29.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042513+0000","last_change":"2023-12-19T13:48:31.044408+0000","last_active":"2023-12-19T13:48:32.042513+0000","last_peered":"2023-12-19T13:48:32.042513+0000","last_clean":"2023-12-19T13:48:32.042513+0000","last_became_active":"2023-12-19T13:48:31.044036+0000","last_became_peered":"2023-12-19T13:48:31.044036+0000","last_unstale":"2023-12-19T13:48:32.042513+0000","last_undegraded":"2023-12-19T13:48:32.042513+0000","last_fullsized":"2023-12-19T13:48:32.042513+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.871928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042205+0000","last_change":"2023-12-19T13:48:31.058117+0000","last_active":"2023-12-19T13:48:32.042205+0000","last_peered":"2023-12-19T13:48:32.042205+0000","last_clean":"2023-12-19T13:48:32.042205+0000","last_became_active":"2023-12-19T13:48:31.057815+0000","last_became_peered":"2023-12-19T13:48:31.057815+0000","last_unstale":"2023-12-19T13:48:32.042205+0000","last_undegraded":"2023-12-19T13:48:32.042205+0000","last_fullsized":"2023-12-19T13:48:32.042205+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:39.585226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292374+0000","last_change":"2023-12-19T13:48:31.045414+0000","last_active":"2023-12-19T13:48:32.292374+0000","last_peered":"2023-12-19T13:48:32.292374+0000","last_clean":"2023-12-19T13:48:32.292374+0000","last_became_active":"2023-12-19T13:48:31.045218+0000","last_became_peered":"2023-12-19T13:48:31.045218+0000","last_unstale":"2023-12-19T13:48:32.292374+0000","last_undegraded":"2023-12-19T13:48:32.292374+0000","last_fullsized":"2023-12-19T13:48:32.292374+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292399+0000","last_change":"2023-12-19T13:48:31.065352+0000","last_active":"2023-12-19T13:48:32.292399+0000","last_peered":"2023-12-19T13:48:32.292399+0000","last_clean":"2023-12-19T13:48:32.292399+0000","last_became_active":"2023-12-19T13:48:31.064726+0000","last_became_peered":"2023-12-19T13:48:31.064726+0000","last_unstale":"2023-12-19T13:48:32.292399+0000","last_undegraded":"2023-12-19T13:48:32.292399+0000","last_fullsized":"2023-12-19T13:48:32.292399+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:48.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042631+0000","last_change":"2023-12-19T13:48:31.039929+0000","last_active":"2023-12-19T13:48:32.042631+0000","last_peered":"2023-12-19T13:48:32.042631+0000","last_clean":"2023-12-19T13:48:32.042631+0000","last_became_active":"2023-12-19T13:48:31.039057+0000","last_became_peered":"2023-12-19T13:48:31.039057+0000","last_unstale":"2023-12-19T13:48:32.042631+0000","last_undegraded":"2023-12-19T13:48:32.042631+0000","last_fullsized":"2023-12-19T13:48:32.042631+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:41:17.848618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042615+0000","last_change":"2023-12-19T13:48:31.035261+0000","last_active":"2023-12-19T13:48:32.042615+0000","last_peered":"2023-12-19T13:48:32.042615+0000","last_clean":"2023-12-19T13:48:32.042615+0000","last_became_active":"2023-12-19T13:48:31.035036+0000","last_became_peered":"2023-12-19T13:48:31.035036+0000","last_unstale":"2023-12-19T13:48:32.042615+0000","last_undegraded":"2023-12-19T13:48:32.042615+0000","last_fullsized":"2023-12-19T13:48:32.042615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:53.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290363+0000","last_change":"2023-12-19T13:48:31.050415+0000","last_active":"2023-12-19T13:48:32.290363+0000","last_peered":"2023-12-19T13:48:32.290363+0000","last_clean":"2023-12-19T13:48:32.290363+0000","last_became_active":"2023-12-19T13:48:31.050284+0000","last_became_peered":"2023-12-19T13:48:31.050284+0000","last_unstale":"2023-12-19T13:48:32.290363+0000","last_undegraded":"2023-12-19T13:48:32.290363+0000","last_fullsized":"2023-12-19T13:48:32.290363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:35.655516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043895+0000","last_change":"2023-12-19T13:48:31.036365+0000","last_active":"2023-12-19T13:48:32.043895+0000","last_peered":"2023-12-19T13:48:32.043895+0000","last_clean":"2023-12-19T13:48:32.043895+0000","last_became_active":"2023-12-19T13:48:31.036157+0000","last_became_peered":"2023-12-19T13:48:31.036157+0000","last_unstale":"2023-12-19T13:48:32.043895+0000","last_undegraded":"2023-12-19T13:48:32.043895+0000","last_fullsized":"2023-12-19T13:48:32.043895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292586+0000","last_change":"2023-12-19T13:48:31.059900+0000","last_active":"2023-12-19T13:48:32.292586+0000","last_peered":"2023-12-19T13:48:32.292586+0000","last_clean":"2023-12-19T13:48:32.292586+0000","last_became_active":"2023-12-19T13:48:31.059662+0000","last_became_peered":"2023-12-19T13:48:31.059662+0000","last_unstale":"2023-12-19T13:48:32.292586+0000","last_undegraded":"2023-12-19T13:48:32.292586+0000","last_fullsized":"2023-12-19T13:48:32.292586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:33.366100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292352+0000","last_change":"2023-12-19T13:48:31.056145+0000","last_active":"2023-12-19T13:48:32.292352+0000","last_peered":"2023-12-19T13:48:32.292352+0000","last_clean":"2023-12-19T13:48:32.292352+0000","last_became_active":"2023-12-19T13:48:31.053672+0000","last_became_peered":"2023-12-19T13:48:31.053672+0000","last_unstale":"2023-12-19T13:48:32.292352+0000","last_undegraded":"2023-12-19T13:48:32.292352+0000","last_fullsized":"2023-12-19T13:48:32.292352+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042737+0000","last_change":"2023-12-19T13:48:31.051669+0000","last_active":"2023-12-19T13:48:32.042737+0000","last_peered":"2023-12-19T13:48:32.042737+0000","last_clean":"2023-12-19T13:48:32.042737+0000","last_became_active":"2023-12-19T13:48:31.051139+0000","last_became_peered":"2023-12-19T13:48:31.051139+0000","last_unstale":"2023-12-19T13:48:32.042737+0000","last_undegraded":"2023-12-19T13:48:32.042737+0000","last_fullsized":"2023-12-19T13:48:32.042737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:31.393201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.066366+0000","last_change":"2023-12-19T13:48:30.569175+0000","last_active":"2023-12-19T13:48:31.066366+0000","last_peered":"2023-12-19T13:48:31.066366+0000","last_clean":"2023-12-19T13:48:31.066366+0000","last_became_active":"2023-12-19T13:48:30.567045+0000","last_became_peered":"2023-12-19T13:48:30.567045+0000","last_unstale":"2023-12-19T13:48:31.066366+0000","last_undegraded":"2023-12-19T13:48:31.066366+0000","last_fullsized":"2023-12-19T13:48:31.066366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291255+0000","last_change":"2023-12-19T13:48:31.064482+0000","last_active":"2023-12-19T13:48:32.291255+0000","last_peered":"2023-12-19T13:48:32.291255+0000","last_clean":"2023-12-19T13:48:32.291255+0000","last_became_active":"2023-12-19T13:48:31.063591+0000","last_became_peered":"2023-12-19T13:48:31.063591+0000","last_unstale":"2023-12-19T13:48:32.291255+0000","last_undegraded":"2023-12-19T13:48:32.291255+0000","last_fullsized":"2023-12-19T13:48:32.291255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.045006+0000","last_change":"2023-12-19T13:48:30.563689+0000","last_active":"2023-12-19T13:48:31.045006+0000","last_peered":"2023-12-19T13:48:31.045006+0000","last_clean":"2023-12-19T13:48:31.045006+0000","last_became_active":"2023-12-19T13:48:30.562331+0000","last_became_peered":"2023-12-19T13:48:30.562331+0000","last_unstale":"2023-12-19T13:48:31.045006+0000","last_undegraded":"2023-12-19T13:48:31.045006+0000","last_fullsized":"2023-12-19T13:48:31.045006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043182+0000","last_change":"2023-12-19T13:48:31.038378+0000","last_active":"2023-12-19T13:48:32.043182+0000","last_peered":"2023-12-19T13:48:32.043182+0000","last_clean":"2023-12-19T13:48:32.043182+0000","last_became_active":"2023-12-19T13:48:31.038172+0000","last_became_peered":"2023-12-19T13:48:31.038172+0000","last_unstale":"2023-12-19T13:48:32.043182+0000","last_undegraded":"2023-12-19T13:48:32.043182+0000","last_fullsized":"2023-12-19T13:48:32.043182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:16.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063973+0000","last_change":"2023-12-19T13:48:30.570820+0000","last_active":"2023-12-19T13:48:31.063973+0000","last_peered":"2023-12-19T13:48:31.063973+0000","last_clean":"2023-12-19T13:48:31.063973+0000","last_became_active":"2023-12-19T13:48:30.570263+0000","last_became_peered":"2023-12-19T13:48:30.570263+0000","last_unstale":"2023-12-19T13:48:31.063973+0000","last_undegraded":"2023-12-19T13:48:31.063973+0000","last_fullsized":"2023-12-19T13:48:31.063973+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292733+0000","last_change":"2023-12-19T13:48:31.055844+0000","last_active":"2023-12-19T13:48:32.292733+0000","last_peered":"2023-12-19T13:48:32.292733+0000","last_clean":"2023-12-19T13:48:32.292733+0000","last_became_active":"2023-12-19T13:48:31.055269+0000","last_became_peered":"2023-12-19T13:48:31.055269+0000","last_unstale":"2023-12-19T13:48:32.292733+0000","last_undegraded":"2023-12-19T13:48:32.292733+0000","last_fullsized":"2023-12-19T13:48:32.292733+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:53.451620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.046197+0000","last_change":"2023-12-19T13:48:30.563559+0000","last_active":"2023-12-19T13:48:31.046197+0000","last_peered":"2023-12-19T13:48:31.046197+0000","last_clean":"2023-12-19T13:48:31.046197+0000","last_became_active":"2023-12-19T13:48:30.563220+0000","last_became_peered":"2023-12-19T13:48:30.563220+0000","last_unstale":"2023-12-19T13:48:31.046197+0000","last_undegraded":"2023-12-19T13:48:31.046197+0000","last_fullsized":"2023-12-19T13:48:31.046197+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:47.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042698+0000","last_change":"2023-12-19T13:48:31.039253+0000","last_active":"2023-12-19T13:48:32.042698+0000","last_peered":"2023-12-19T13:48:32.042698+0000","last_clean":"2023-12-19T13:48:32.042698+0000","last_became_active":"2023-12-19T13:48:31.039027+0000","last_became_peered":"2023-12-19T13:48:31.039027+0000","last_unstale":"2023-12-19T13:48:32.042698+0000","last_undegraded":"2023-12-19T13:48:32.042698+0000","last_fullsized":"2023-12-19T13:48:32.042698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:03:27.377713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.062942+0000","last_change":"2023-12-19T13:48:30.571536+0000","last_active":"2023-12-19T13:48:31.062942+0000","last_peered":"2023-12-19T13:48:31.062942+0000","last_clean":"2023-12-19T13:48:31.062942+0000","last_became_active":"2023-12-19T13:48:30.571266+0000","last_became_peered":"2023-12-19T13:48:30.571266+0000","last_unstale":"2023-12-19T13:48:31.062942+0000","last_undegraded":"2023-12-19T13:48:31.062942+0000","last_fullsized":"2023-12-19T13:48:31.062942+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293400+0000","last_change":"2023-12-19T13:48:31.059349+0000","last_active":"2023-12-19T13:48:32.293400+0000","last_peered":"2023-12-19T13:48:32.293400+0000","last_clean":"2023-12-19T13:48:32.293400+0000","last_became_active":"2023-12-19T13:48:31.058702+0000","last_became_peered":"2023-12-19T13:48:31.058702+0000","last_unstale":"2023-12-19T13:48:32.293400+0000","last_undegraded":"2023-12-19T13:48:32.293400+0000","last_fullsized":"2023-12-19T13:48:32.293400+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:52.208906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.044227+0000","last_change":"2023-12-19T13:48:30.561942+0000","last_active":"2023-12-19T13:48:31.044227+0000","last_peered":"2023-12-19T13:48:31.044227+0000","last_clean":"2023-12-19T13:48:31.044227+0000","last_became_active":"2023-12-19T13:48:30.559026+0000","last_became_peered":"2023-12-19T13:48:30.559026+0000","last_unstale":"2023-12-19T13:48:31.044227+0000","last_undegraded":"2023-12-19T13:48:31.044227+0000","last_fullsized":"2023-12-19T13:48:31.044227+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.294999+0000","last_change":"2023-12-19T13:48:31.060791+0000","last_active":"2023-12-19T13:48:32.294999+0000","last_peered":"2023-12-19T13:48:32.294999+0000","last_clean":"2023-12-19T13:48:32.294999+0000","last_became_active":"2023-12-19T13:48:31.056175+0000","last_became_peered":"2023-12-19T13:48:31.056175+0000","last_unstale":"2023-12-19T13:48:32.294999+0000","last_undegraded":"2023-12-19T13:48:32.294999+0000","last_fullsized":"2023-12-19T13:48:32.294999+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:04.955458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.040148+0000","last_change":"2023-12-19T13:48:30.569040+0000","last_active":"2023-12-19T13:48:31.040148+0000","last_peered":"2023-12-19T13:48:31.040148+0000","last_clean":"2023-12-19T13:48:31.040148+0000","last_became_active":"2023-12-19T13:48:30.568735+0000","last_became_peered":"2023-12-19T13:48:30.568735+0000","last_unstale":"2023-12-19T13:48:31.040148+0000","last_undegraded":"2023-12-19T13:48:31.040148+0000","last_fullsized":"2023-12-19T13:48:31.040148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:08.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042154+0000","last_change":"2023-12-19T13:48:31.064711+0000","last_active":"2023-12-19T13:48:32.042154+0000","last_peered":"2023-12-19T13:48:32.042154+0000","last_clean":"2023-12-19T13:48:32.042154+0000","last_became_active":"2023-12-19T13:48:31.064494+0000","last_became_peered":"2023-12-19T13:48:31.064494+0000","last_unstale":"2023-12-19T13:48:32.042154+0000","last_undegraded":"2023-12-19T13:48:32.042154+0000","last_fullsized":"2023-12-19T13:48:32.042154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:25.175664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053035+0000","last_change":"2023-12-19T13:48:30.547571+0000","last_active":"2023-12-19T13:48:31.053035+0000","last_peered":"2023-12-19T13:48:31.053035+0000","last_clean":"2023-12-19T13:48:31.053035+0000","last_became_active":"2023-12-19T13:48:30.546977+0000","last_became_peered":"2023-12-19T13:48:30.546977+0000","last_unstale":"2023-12-19T13:48:31.053035+0000","last_undegraded":"2023-12-19T13:48:31.053035+0000","last_fullsized":"2023-12-19T13:48:31.053035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291320+0000","last_change":"2023-12-19T13:48:31.045498+0000","last_active":"2023-12-19T13:48:32.291320+0000","last_peered":"2023-12-19T13:48:32.291320+0000","last_clean":"2023-12-19T13:48:32.291320+0000","last_became_active":"2023-12-19T13:48:31.045247+0000","last_became_peered":"2023-12-19T13:48:31.045247+0000","last_unstale":"2023-12-19T13:48:32.291320+0000","last_undegraded":"2023-12-19T13:48:32.291320+0000","last_fullsized":"2023-12-19T13:48:32.291320+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:29.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.036915+0000","last_change":"2023-12-19T13:48:30.569024+0000","last_active":"2023-12-19T13:48:31.036915+0000","last_peered":"2023-12-19T13:48:31.036915+0000","last_clean":"2023-12-19T13:48:31.036915+0000","last_became_active":"2023-12-19T13:48:30.567954+0000","last_became_peered":"2023-12-19T13:48:30.567954+0000","last_unstale":"2023-12-19T13:48:31.036915+0000","last_undegraded":"2023-12-19T13:48:31.036915+0000","last_fullsized":"2023-12-19T13:48:31.036915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291559+0000","last_change":"2023-12-19T13:48:31.043152+0000","last_active":"2023-12-19T13:48:32.291559+0000","last_peered":"2023-12-19T13:48:32.291559+0000","last_clean":"2023-12-19T13:48:32.291559+0000","last_became_active":"2023-12-19T13:48:31.042920+0000","last_became_peered":"2023-12-19T13:48:31.042920+0000","last_unstale":"2023-12-19T13:48:32.291559+0000","last_undegraded":"2023-12-19T13:48:32.291559+0000","last_fullsized":"2023-12-19T13:48:32.291559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:31.393201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.037454+0000","last_change":"2023-12-19T13:48:30.558837+0000","last_active":"2023-12-19T13:48:31.037454+0000","last_peered":"2023-12-19T13:48:31.037454+0000","last_clean":"2023-12-19T13:48:31.037454+0000","last_became_active":"2023-12-19T13:48:30.556293+0000","last_became_peered":"2023-12-19T13:48:30.556293+0000","last_unstale":"2023-12-19T13:48:31.037454+0000","last_undegraded":"2023-12-19T13:48:31.037454+0000","last_fullsized":"2023-12-19T13:48:31.037454+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:31.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292329+0000","last_change":"2023-12-19T13:48:31.063653+0000","last_active":"2023-12-19T13:48:32.292329+0000","last_peered":"2023-12-19T13:48:32.292329+0000","last_clean":"2023-12-19T13:48:32.292329+0000","last_became_active":"2023-12-19T13:48:31.062676+0000","last_became_peered":"2023-12-19T13:48:31.062676+0000","last_unstale":"2023-12-19T13:48:32.292329+0000","last_undegraded":"2023-12-19T13:48:32.292329+0000","last_fullsized":"2023-12-19T13:48:32.292329+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.045902+0000","last_change":"2023-12-19T13:48:30.566173+0000","last_active":"2023-12-19T13:48:31.045902+0000","last_peered":"2023-12-19T13:48:31.045902+0000","last_clean":"2023-12-19T13:48:31.045902+0000","last_became_active":"2023-12-19T13:48:30.565902+0000","last_became_peered":"2023-12-19T13:48:30.565902+0000","last_unstale":"2023-12-19T13:48:31.045902+0000","last_undegraded":"2023-12-19T13:48:31.045902+0000","last_fullsized":"2023-12-19T13:48:31.045902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042778+0000","last_change":"2023-12-19T13:48:31.061537+0000","last_active":"2023-12-19T13:48:32.042778+0000","last_peered":"2023-12-19T13:48:32.042778+0000","last_clean":"2023-12-19T13:48:32.042778+0000","last_became_active":"2023-12-19T13:48:31.061314+0000","last_became_peered":"2023-12-19T13:48:31.061314+0000","last_unstale":"2023-12-19T13:48:32.042778+0000","last_undegraded":"2023-12-19T13:48:32.042778+0000","last_fullsized":"2023-12-19T13:48:32.042778+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:13.462370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.067460+0000","last_change":"2023-12-19T13:48:30.568619+0000","last_active":"2023-12-19T13:48:31.067460+0000","last_peered":"2023-12-19T13:48:31.067460+0000","last_clean":"2023-12-19T13:48:31.067460+0000","last_became_active":"2023-12-19T13:48:30.567775+0000","last_became_peered":"2023-12-19T13:48:30.567775+0000","last_unstale":"2023-12-19T13:48:31.067460+0000","last_undegraded":"2023-12-19T13:48:31.067460+0000","last_fullsized":"2023-12-19T13:48:31.067460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291850+0000","last_change":"2023-12-19T13:48:31.061830+0000","last_active":"2023-12-19T13:48:32.291850+0000","last_peered":"2023-12-19T13:48:32.291850+0000","last_clean":"2023-12-19T13:48:32.291850+0000","last_became_active":"2023-12-19T13:48:31.061531+0000","last_became_peered":"2023-12-19T13:48:31.061531+0000","last_unstale":"2023-12-19T13:48:32.291850+0000","last_undegraded":"2023-12-19T13:48:32.291850+0000","last_fullsized":"2023-12-19T13:48:32.291850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:00.081221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.060451+0000","last_change":"2023-12-19T13:48:30.571590+0000","last_active":"2023-12-19T13:48:31.060451+0000","last_peered":"2023-12-19T13:48:31.060451+0000","last_clean":"2023-12-19T13:48:31.060451+0000","last_became_active":"2023-12-19T13:48:30.570999+0000","last_became_peered":"2023-12-19T13:48:30.570999+0000","last_unstale":"2023-12-19T13:48:31.060451+0000","last_undegraded":"2023-12-19T13:48:31.060451+0000","last_fullsized":"2023-12-19T13:48:31.060451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:30.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043661+0000","last_change":"2023-12-19T13:48:31.040521+0000","last_active":"2023-12-19T13:48:32.043661+0000","last_peered":"2023-12-19T13:48:32.043661+0000","last_clean":"2023-12-19T13:48:32.043661+0000","last_became_active":"2023-12-19T13:48:31.039864+0000","last_became_peered":"2023-12-19T13:48:31.039864+0000","last_unstale":"2023-12-19T13:48:32.043661+0000","last_undegraded":"2023-12-19T13:48:32.043661+0000","last_fullsized":"2023-12-19T13:48:32.043661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:55.364518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041698+0000","last_change":"2023-12-19T13:48:30.565828+0000","last_active":"2023-12-19T13:48:31.041698+0000","last_peered":"2023-12-19T13:48:31.041698+0000","last_clean":"2023-12-19T13:48:31.041698+0000","last_became_active":"2023-12-19T13:48:30.564126+0000","last_became_peered":"2023-12-19T13:48:30.564126+0000","last_unstale":"2023-12-19T13:48:31.041698+0000","last_undegraded":"2023-12-19T13:48:31.041698+0000","last_fullsized":"2023-12-19T13:48:31.041698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042739+0000","last_change":"2023-12-19T13:48:31.052967+0000","last_active":"2023-12-19T13:48:32.042739+0000","last_peered":"2023-12-19T13:48:32.042739+0000","last_clean":"2023-12-19T13:48:32.042739+0000","last_became_active":"2023-12-19T13:48:31.052503+0000","last_became_peered":"2023-12-19T13:48:31.052503+0000","last_unstale":"2023-12-19T13:48:32.042739+0000","last_undegraded":"2023-12-19T13:48:32.042739+0000","last_fullsized":"2023-12-19T13:48:32.042739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:55.457446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.048836+0000","last_change":"2023-12-19T13:48:30.573421+0000","last_active":"2023-12-19T13:48:31.048836+0000","last_peered":"2023-12-19T13:48:31.048836+0000","last_clean":"2023-12-19T13:48:31.048836+0000","last_became_active":"2023-12-19T13:48:30.573100+0000","last_became_peered":"2023-12-19T13:48:30.573100+0000","last_unstale":"2023-12-19T13:48:31.048836+0000","last_undegraded":"2023-12-19T13:48:31.048836+0000","last_fullsized":"2023-12-19T13:48:31.048836+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043185+0000","last_change":"2023-12-19T13:48:31.045582+0000","last_active":"2023-12-19T13:48:32.043185+0000","last_peered":"2023-12-19T13:48:32.043185+0000","last_clean":"2023-12-19T13:48:32.043185+0000","last_became_active":"2023-12-19T13:48:31.045022+0000","last_became_peered":"2023-12-19T13:48:31.045022+0000","last_unstale":"2023-12-19T13:48:32.043185+0000","last_undegraded":"2023-12-19T13:48:32.043185+0000","last_fullsized":"2023-12-19T13:48:32.043185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.062660+0000","last_change":"2023-12-19T13:48:30.567294+0000","last_active":"2023-12-19T13:48:31.062660+0000","last_peered":"2023-12-19T13:48:31.062660+0000","last_clean":"2023-12-19T13:48:31.062660+0000","last_became_active":"2023-12-19T13:48:30.566881+0000","last_became_peered":"2023-12-19T13:48:30.566881+0000","last_unstale":"2023-12-19T13:48:31.062660+0000","last_undegraded":"2023-12-19T13:48:31.062660+0000","last_fullsized":"2023-12-19T13:48:31.062660+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:38.580105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043887+0000","last_change":"2023-12-19T13:48:31.047150+0000","last_active":"2023-12-19T13:48:32.043887+0000","last_peered":"2023-12-19T13:48:32.043887+0000","last_clean":"2023-12-19T13:48:32.043887+0000","last_became_active":"2023-12-19T13:48:31.046514+0000","last_became_peered":"2023-12-19T13:48:31.046514+0000","last_unstale":"2023-12-19T13:48:32.043887+0000","last_undegraded":"2023-12-19T13:48:32.043887+0000","last_fullsized":"2023-12-19T13:48:32.043887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:00.081221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063327+0000","last_change":"2023-12-19T13:48:30.562754+0000","last_active":"2023-12-19T13:48:31.063327+0000","last_peered":"2023-12-19T13:48:31.063327+0000","last_clean":"2023-12-19T13:48:31.063327+0000","last_became_active":"2023-12-19T13:48:30.558728+0000","last_became_peered":"2023-12-19T13:48:30.558728+0000","last_unstale":"2023-12-19T13:48:31.063327+0000","last_undegraded":"2023-12-19T13:48:31.063327+0000","last_fullsized":"2023-12-19T13:48:31.063327+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042995+0000","last_change":"2023-12-19T13:48:31.056207+0000","last_active":"2023-12-19T13:48:32.042995+0000","last_peered":"2023-12-19T13:48:32.042995+0000","last_clean":"2023-12-19T13:48:32.042995+0000","last_became_active":"2023-12-19T13:48:31.055546+0000","last_became_peered":"2023-12-19T13:48:31.055546+0000","last_unstale":"2023-12-19T13:48:32.042995+0000","last_undegraded":"2023-12-19T13:48:32.042995+0000","last_fullsized":"2023-12-19T13:48:32.042995+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:08.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.048889+0000","last_change":"2023-12-19T13:48:30.569667+0000","last_active":"2023-12-19T13:48:31.048889+0000","last_peered":"2023-12-19T13:48:31.048889+0000","last_clean":"2023-12-19T13:48:31.048889+0000","last_became_active":"2023-12-19T13:48:30.569444+0000","last_became_peered":"2023-12-19T13:48:30.569444+0000","last_unstale":"2023-12-19T13:48:31.048889+0000","last_undegraded":"2023-12-19T13:48:31.048889+0000","last_fullsized":"2023-12-19T13:48:31.048889+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:59.915604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043389+0000","last_change":"2023-12-19T13:48:31.057340+0000","last_active":"2023-12-19T13:48:32.043389+0000","last_peered":"2023-12-19T13:48:32.043389+0000","last_clean":"2023-12-19T13:48:32.043389+0000","last_became_active":"2023-12-19T13:48:31.057076+0000","last_became_peered":"2023-12-19T13:48:31.057076+0000","last_unstale":"2023-12-19T13:48:32.043389+0000","last_undegraded":"2023-12-19T13:48:32.043389+0000","last_fullsized":"2023-12-19T13:48:32.043389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.052137+0000","last_change":"2023-12-19T13:48:30.562794+0000","last_active":"2023-12-19T13:48:31.052137+0000","last_peered":"2023-12-19T13:48:31.052137+0000","last_clean":"2023-12-19T13:48:31.052137+0000","last_became_active":"2023-12-19T13:48:30.562376+0000","last_became_peered":"2023-12-19T13:48:30.562376+0000","last_unstale":"2023-12-19T13:48:31.052137+0000","last_undegraded":"2023-12-19T13:48:31.052137+0000","last_fullsized":"2023-12-19T13:48:31.052137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292068+0000","last_change":"2023-12-19T13:48:31.052222+0000","last_active":"2023-12-19T13:48:32.292068+0000","last_peered":"2023-12-19T13:48:32.292068+0000","last_clean":"2023-12-19T13:48:32.292068+0000","last_became_active":"2023-12-19T13:48:31.051936+0000","last_became_peered":"2023-12-19T13:48:31.051936+0000","last_unstale":"2023-12-19T13:48:32.292068+0000","last_undegraded":"2023-12-19T13:48:32.292068+0000","last_fullsized":"2023-12-19T13:48:32.292068+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:08.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.049036+0000","last_change":"2023-12-19T13:48:30.573292+0000","last_active":"2023-12-19T13:48:31.049036+0000","last_peered":"2023-12-19T13:48:31.049036+0000","last_clean":"2023-12-19T13:48:31.049036+0000","last_became_active":"2023-12-19T13:48:30.572798+0000","last_became_peered":"2023-12-19T13:48:30.572798+0000","last_unstale":"2023-12-19T13:48:31.049036+0000","last_undegraded":"2023-12-19T13:48:31.049036+0000","last_fullsized":"2023-12-19T13:48:31.049036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293677+0000","last_change":"2023-12-19T13:48:31.066773+0000","last_active":"2023-12-19T13:48:32.293677+0000","last_peered":"2023-12-19T13:48:32.293677+0000","last_clean":"2023-12-19T13:48:32.293677+0000","last_became_active":"2023-12-19T13:48:31.066441+0000","last_became_peered":"2023-12-19T13:48:31.066441+0000","last_unstale":"2023-12-19T13:48:32.293677+0000","last_undegraded":"2023-12-19T13:48:32.293677+0000","last_fullsized":"2023-12-19T13:48:32.293677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:40:06.460024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063658+0000","last_change":"2023-12-19T13:48:30.556702+0000","last_active":"2023-12-19T13:48:31.063658+0000","last_peered":"2023-12-19T13:48:31.063658+0000","last_clean":"2023-12-19T13:48:31.063658+0000","last_became_active":"2023-12-19T13:48:30.555906+0000","last_became_peered":"2023-12-19T13:48:30.555906+0000","last_unstale":"2023-12-19T13:48:31.063658+0000","last_undegraded":"2023-12-19T13:48:31.063658+0000","last_fullsized":"2023-12-19T13:48:31.063658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:53.297196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292875+0000","last_change":"2023-12-19T13:48:31.058717+0000","last_active":"2023-12-19T13:48:32.292875+0000","last_peered":"2023-12-19T13:48:32.292875+0000","last_clean":"2023-12-19T13:48:32.292875+0000","last_became_active":"2023-12-19T13:48:31.057801+0000","last_became_peered":"2023-12-19T13:48:31.057801+0000","last_unstale":"2023-12-19T13:48:32.292875+0000","last_undegraded":"2023-12-19T13:48:32.292875+0000","last_fullsized":"2023-12-19T13:48:32.292875+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:34.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.040271+0000","last_change":"2023-12-19T13:48:30.573217+0000","last_active":"2023-12-19T13:48:31.040271+0000","last_peered":"2023-12-19T13:48:31.040271+0000","last_clean":"2023-12-19T13:48:31.040271+0000","last_became_active":"2023-12-19T13:48:30.572589+0000","last_became_peered":"2023-12-19T13:48:30.572589+0000","last_unstale":"2023-12-19T13:48:31.040271+0000","last_undegraded":"2023-12-19T13:48:31.040271+0000","last_fullsized":"2023-12-19T13:48:31.040271+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292869+0000","last_change":"2023-12-19T13:48:31.060286+0000","last_active":"2023-12-19T13:48:32.292869+0000","last_peered":"2023-12-19T13:48:32.292869+0000","last_clean":"2023-12-19T13:48:32.292869+0000","last_became_active":"2023-12-19T13:48:31.058371+0000","last_became_peered":"2023-12-19T13:48:31.058371+0000","last_unstale":"2023-12-19T13:48:32.292869+0000","last_undegraded":"2023-12-19T13:48:32.292869+0000","last_fullsized":"2023-12-19T13:48:32.292869+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:04.508581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.054826+0000","last_change":"2023-12-19T13:48:30.563907+0000","last_active":"2023-12-19T13:48:31.054826+0000","last_peered":"2023-12-19T13:48:31.054826+0000","last_clean":"2023-12-19T13:48:31.054826+0000","last_became_active":"2023-12-19T13:48:30.560821+0000","last_became_peered":"2023-12-19T13:48:30.560821+0000","last_unstale":"2023-12-19T13:48:31.054826+0000","last_undegraded":"2023-12-19T13:48:31.054826+0000","last_fullsized":"2023-12-19T13:48:31.054826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:34.650395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292888+0000","last_change":"2023-12-19T13:48:31.061838+0000","last_active":"2023-12-19T13:48:32.292888+0000","last_peered":"2023-12-19T13:48:32.292888+0000","last_clean":"2023-12-19T13:48:32.292888+0000","last_became_active":"2023-12-19T13:48:31.061595+0000","last_became_peered":"2023-12-19T13:48:31.061595+0000","last_unstale":"2023-12-19T13:48:32.292888+0000","last_undegraded":"2023-12-19T13:48:32.292888+0000","last_fullsized":"2023-12-19T13:48:32.292888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.030734+0000","last_change":"2023-12-19T13:48:30.567145+0000","last_active":"2023-12-19T13:48:31.030734+0000","last_peered":"2023-12-19T13:48:31.030734+0000","last_clean":"2023-12-19T13:48:31.030734+0000","last_became_active":"2023-12-19T13:48:30.566807+0000","last_became_peered":"2023-12-19T13:48:30.566807+0000","last_unstale":"2023-12-19T13:48:31.030734+0000","last_undegraded":"2023-12-19T13:48:31.030734+0000","last_fullsized":"2023-12-19T13:48:31.030734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:22.368082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042731+0000","last_change":"2023-12-19T13:48:31.058944+0000","last_active":"2023-12-19T13:48:32.042731+0000","last_peered":"2023-12-19T13:48:32.042731+0000","last_clean":"2023-12-19T13:48:32.042731+0000","last_became_active":"2023-12-19T13:48:31.058653+0000","last_became_peered":"2023-12-19T13:48:31.058653+0000","last_unstale":"2023-12-19T13:48:32.042731+0000","last_undegraded":"2023-12-19T13:48:32.042731+0000","last_fullsized":"2023-12-19T13:48:32.042731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:41.317283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053890+0000","last_change":"2023-12-19T13:48:30.565161+0000","last_active":"2023-12-19T13:48:31.053890+0000","last_peered":"2023-12-19T13:48:31.053890+0000","last_clean":"2023-12-19T13:48:31.053890+0000","last_became_active":"2023-12-19T13:48:30.564755+0000","last_became_peered":"2023-12-19T13:48:30.564755+0000","last_unstale":"2023-12-19T13:48:31.053890+0000","last_undegraded":"2023-12-19T13:48:31.053890+0000","last_fullsized":"2023-12-19T13:48:31.053890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.295219+0000","last_change":"2023-12-19T13:48:31.059990+0000","last_active":"2023-12-19T13:48:32.295219+0000","last_peered":"2023-12-19T13:48:32.295219+0000","last_clean":"2023-12-19T13:48:32.295219+0000","last_became_active":"2023-12-19T13:48:31.055899+0000","last_became_peered":"2023-12-19T13:48:31.055899+0000","last_unstale":"2023-12-19T13:48:32.295219+0000","last_undegraded":"2023-12-19T13:48:32.295219+0000","last_fullsized":"2023-12-19T13:48:32.295219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:19.784553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041605+0000","last_change":"2023-12-19T13:48:30.572933+0000","last_active":"2023-12-19T13:48:31.041605+0000","last_peered":"2023-12-19T13:48:31.041605+0000","last_clean":"2023-12-19T13:48:31.041605+0000","last_became_active":"2023-12-19T13:48:30.572148+0000","last_became_peered":"2023-12-19T13:48:30.572148+0000","last_unstale":"2023-12-19T13:48:31.041605+0000","last_undegraded":"2023-12-19T13:48:31.041605+0000","last_fullsized":"2023-12-19T13:48:31.041605+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042247+0000","last_change":"2023-12-19T13:48:31.057783+0000","last_active":"2023-12-19T13:48:32.042247+0000","last_peered":"2023-12-19T13:48:32.042247+0000","last_clean":"2023-12-19T13:48:32.042247+0000","last_became_active":"2023-12-19T13:48:31.057420+0000","last_became_peered":"2023-12-19T13:48:31.057420+0000","last_unstale":"2023-12-19T13:48:32.042247+0000","last_undegraded":"2023-12-19T13:48:32.042247+0000","last_fullsized":"2023-12-19T13:48:32.042247+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:06.958823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.037294+0000","last_change":"2023-12-19T13:48:30.571319+0000","last_active":"2023-12-19T13:48:31.037294+0000","last_peered":"2023-12-19T13:48:31.037294+0000","last_clean":"2023-12-19T13:48:31.037294+0000","last_became_active":"2023-12-19T13:48:30.570689+0000","last_became_peered":"2023-12-19T13:48:30.570689+0000","last_unstale":"2023-12-19T13:48:31.037294+0000","last_undegraded":"2023-12-19T13:48:31.037294+0000","last_fullsized":"2023-12-19T13:48:31.037294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293877+0000","last_change":"2023-12-19T13:48:31.059655+0000","last_active":"2023-12-19T13:48:32.293877+0000","last_peered":"2023-12-19T13:48:32.293877+0000","last_clean":"2023-12-19T13:48:32.293877+0000","last_became_active":"2023-12-19T13:48:31.059098+0000","last_became_peered":"2023-12-19T13:48:31.059098+0000","last_unstale":"2023-12-19T13:48:32.293877+0000","last_undegraded":"2023-12-19T13:48:32.293877+0000","last_fullsized":"2023-12-19T13:48:32.293877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:57.676040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041809+0000","last_change":"2023-12-19T13:48:30.571183+0000","last_active":"2023-12-19T13:48:31.041809+0000","last_peered":"2023-12-19T13:48:31.041809+0000","last_clean":"2023-12-19T13:48:31.041809+0000","last_became_active":"2023-12-19T13:48:30.569884+0000","last_became_peered":"2023-12-19T13:48:30.569884+0000","last_unstale":"2023-12-19T13:48:31.041809+0000","last_undegraded":"2023-12-19T13:48:31.041809+0000","last_fullsized":"2023-12-19T13:48:31.041809+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293038+0000","last_change":"2023-12-19T13:48:31.060149+0000","last_active":"2023-12-19T13:48:32.293038+0000","last_peered":"2023-12-19T13:48:32.293038+0000","last_clean":"2023-12-19T13:48:32.293038+0000","last_became_active":"2023-12-19T13:48:31.058109+0000","last_became_peered":"2023-12-19T13:48:31.058109+0000","last_unstale":"2023-12-19T13:48:32.293038+0000","last_undegraded":"2023-12-19T13:48:32.293038+0000","last_fullsized":"2023-12-19T13:48:32.293038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.032246+0000","last_change":"2023-12-19T13:48:30.565835+0000","last_active":"2023-12-19T13:48:31.032246+0000","last_peered":"2023-12-19T13:48:31.032246+0000","last_clean":"2023-12-19T13:48:31.032246+0000","last_became_active":"2023-12-19T13:48:30.565233+0000","last_became_peered":"2023-12-19T13:48:30.565233+0000","last_unstale":"2023-12-19T13:48:31.032246+0000","last_undegraded":"2023-12-19T13:48:31.032246+0000","last_fullsized":"2023-12-19T13:48:31.032246+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:14.229510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290563+0000","last_change":"2023-12-19T13:48:31.057778+0000","last_active":"2023-12-19T13:48:32.290563+0000","last_peered":"2023-12-19T13:48:32.290563+0000","last_clean":"2023-12-19T13:48:32.290563+0000","last_became_active":"2023-12-19T13:48:31.057560+0000","last_became_peered":"2023-12-19T13:48:31.057560+0000","last_unstale":"2023-12-19T13:48:32.290563+0000","last_undegraded":"2023-12-19T13:48:32.290563+0000","last_fullsized":"2023-12-19T13:48:32.290563+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:44.950912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.050189+0000","last_change":"2023-12-19T13:48:30.567267+0000","last_active":"2023-12-19T13:48:31.050189+0000","last_peered":"2023-12-19T13:48:31.050189+0000","last_clean":"2023-12-19T13:48:31.050189+0000","last_became_active":"2023-12-19T13:48:30.566724+0000","last_became_peered":"2023-12-19T13:48:30.566724+0000","last_unstale":"2023-12-19T13:48:31.050189+0000","last_undegraded":"2023-12-19T13:48:31.050189+0000","last_fullsized":"2023-12-19T13:48:31.050189+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042201+0000","last_change":"2023-12-19T13:48:31.040906+0000","last_active":"2023-12-19T13:48:32.042201+0000","last_peered":"2023-12-19T13:48:32.042201+0000","last_clean":"2023-12-19T13:48:32.042201+0000","last_became_active":"2023-12-19T13:48:31.039586+0000","last_became_peered":"2023-12-19T13:48:31.039586+0000","last_unstale":"2023-12-19T13:48:32.042201+0000","last_undegraded":"2023-12-19T13:48:32.042201+0000","last_fullsized":"2023-12-19T13:48:32.042201+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.034655+0000","last_change":"2023-12-19T13:48:30.565424+0000","last_active":"2023-12-19T13:48:31.034655+0000","last_peered":"2023-12-19T13:48:31.034655+0000","last_clean":"2023-12-19T13:48:31.034655+0000","last_became_active":"2023-12-19T13:48:30.564077+0000","last_became_peered":"2023-12-19T13:48:30.564077+0000","last_unstale":"2023-12-19T13:48:31.034655+0000","last_undegraded":"2023-12-19T13:48:31.034655+0000","last_fullsized":"2023-12-19T13:48:31.034655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293587+0000","last_change":"2023-12-19T13:48:31.060557+0000","last_active":"2023-12-19T13:48:32.293587+0000","last_peered":"2023-12-19T13:48:32.293587+0000","last_clean":"2023-12-19T13:48:32.293587+0000","last_became_active":"2023-12-19T13:48:31.057125+0000","last_became_peered":"2023-12-19T13:48:31.057125+0000","last_unstale":"2023-12-19T13:48:32.293587+0000","last_undegraded":"2023-12-19T13:48:32.293587+0000","last_fullsized":"2023-12-19T13:48:32.293587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:32.074797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053748+0000","last_change":"2023-12-19T13:48:30.570334+0000","last_active":"2023-12-19T13:48:31.053748+0000","last_peered":"2023-12-19T13:48:31.053748+0000","last_clean":"2023-12-19T13:48:31.053748+0000","last_became_active":"2023-12-19T13:48:30.570094+0000","last_became_peered":"2023-12-19T13:48:30.570094+0000","last_unstale":"2023-12-19T13:48:31.053748+0000","last_undegraded":"2023-12-19T13:48:31.053748+0000","last_fullsized":"2023-12-19T13:48:31.053748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:03.503460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.036018+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:48:31.036018+0000","last_peered":"2023-12-19T13:48:31.036018+0000","last_clean":"2023-12-19T13:48:31.036018+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:48:31.036018+0000","last_undegraded":"2023-12-19T13:48:31.036018+0000","last_fullsized":"2023-12-19T13:48:31.036018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.008,"15min":1},"min":{"1min":0.64200000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98699999999999999,"15min":0.97699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4339999999999999,"5min":2.008,"15min":2.008},"last":0.90200000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.077,"15min":1.069},"min":{"1min":0.73299999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6160000000000001,"5min":1.617,"15min":1.617},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4390000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.016}]},{"osd":2,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.1679999999999999,"15min":1.1459999999999999},"min":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.871,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.268}]},{"osd":3,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.1619999999999999,"15min":1.145},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.387,"5min":1.252,"15min":1.23},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.4690000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.298,"15min":1.292},"min":{"1min":0.90600000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6739999999999999,"5min":2.181,"15min":2.181},"last":1.232},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.415,"15min":1.407},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2109999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.52}]},{"osd":5,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.302},{"interface":"front","average":{"1min":1.504,"5min":1.4419999999999999,"15min":1.4319999999999999},"min":{"1min":1.0649999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.024,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.2749999999999999,"15min":1.256},"min":{"1min":0.79500000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.5029999999999999,"15min":1.4870000000000001},"min":{"1min":1.121,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.401}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0349999999999999,"15min":1.0249999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.679,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.325},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.113,"15min":1.129},"min":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6020000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.226}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.044,"15min":1.028},"min":{"1min":0.83499999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.962,"15min":1.962},"last":1.26},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.524,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2250000000000001,"15min":1.2150000000000001},"min":{"1min":0.86899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.798,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.151,"15min":1.1439999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.504,"5min":1.786,"15min":1.786},"last":1.5469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3620000000000001},"min":{"1min":0.90600000000000003,"5min":0.87,"15min":0.87},"max":{"1min":1.6910000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.415},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8799999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.099}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1970000000000001,"15min":1.194},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.282},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6499999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.623}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.236},"min":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.462},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.363,"15min":1.359},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7989999999999999,"5min":1.907,"15min":1.907},"last":1.498}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4059999999999999,"15min":1.4119999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.677},{"interface":"front","average":{"1min":1.363,"5min":1.347,"15min":1.345},"min":{"1min":0.65000000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.3700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.107},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.042,"15min":1.0580000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4359999999999999,"5min":1.516,"15min":1.516},"last":1.214}]},{"osd":1,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.099,"15min":1.099},"min":{"1min":0.70999999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5369999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.998,"15min":0.995},"min":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.278}]},{"osd":2,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2270000000000001,"15min":1.254},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5069999999999999,"5min":2.827,"15min":2.827},"last":1.327},{"interface":"front","average":{"1min":1.202,"5min":1.2629999999999999,"15min":1.2729999999999999},"min":{"1min":0.81599999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6160000000000001,"5min":2.863,"15min":2.863},"last":0.98799999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.246,"15min":1.242},"min":{"1min":0.97499999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5329999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.87}]},{"osd":4,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.141,"15min":1.133},"min":{"1min":0.79400000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.415},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.276,"15min":1.276},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.333,"15min":1.3129999999999999},"min":{"1min":1.089,"5min":0.623,"15min":0.623},"max":{"1min":1.772,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.3660000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3899999999999999,"15min":1.399},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7410000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.53},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.417,"15min":1.3999999999999999},"min":{"1min":1.244,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.825,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.4450000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.649},{"interface":"front","average":{"1min":1.089,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5149999999999999,"5min":2.016,"15min":2.016},"last":1.054}]},{"osd":1,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0629999999999999,"15min":1.0649999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4830000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.091,"5min":1.115,"15min":1.119},"min":{"1min":0.69699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.4039999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.1200000000000001,"15min":1.1080000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.222,"15min":1.2150000000000001},"min":{"1min":0.90800000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.74,"5min":1.952,"15min":1.952},"last":1.22},{"interface":"front","average":{"1min":1.218,"5min":1.27,"15min":1.278},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6739999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.363}]},{"osd":5,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.238,"15min":1.256},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.611,"5min":2.165,"15min":2.165},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8280000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.4930000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6379999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.466,"15min":1.4850000000000001},"min":{"1min":0.88600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.1339999999999999,"5min":2.335,"15min":2.335},"last":1.595}]},{"osd":7,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4690000000000001,"15min":1.4670000000000001},"min":{"1min":0.82499999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8340000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.518,"15min":1.528},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7529999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.452}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766692,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.94199999999999995,"15min":0.97199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.024,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4430000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.1080000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.014,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3300000000000001,"5min":2.387,"15min":2.387},"last":1.0489999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.5129999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.1359999999999999,"15min":1.1559999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8620000000000001,"5min":2.657,"15min":2.657},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5309999999999999,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.2230000000000001,"15min":1.2350000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.532,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.335}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3080000000000001,"15min":1.3240000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.546},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.88100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.4950000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.81899999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.899,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3460000000000001,"15min":1.357},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9730000000000001,"5min":2.698,"15min":2.698},"last":1.4570000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7649999999999999,"5min":3.609,"15min":3.609},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.89700000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.0910000000000002,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.276}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768166,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.083,"5min":2.258,"15min":2.258},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48799999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.587,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.262,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.9950000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1910000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.099,"15min":1.1060000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.3720000000000001,"5min":1.456,"15min":1.456},"last":1.127},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.84299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.635,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.1659999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.171,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.296,"15min":1.304},"min":{"1min":0.76700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8859999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4430000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2969999999999999,"15min":1.3129999999999999},"min":{"1min":0.754,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7470000000000001,"5min":2.964,"15min":2.964},"last":1.302},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.248,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.708,"5min":2.286,"15min":2.286},"last":1.4730000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.351,"15min":2.351},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.22,"15min":1.23},"min":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.96,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.5129999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177818,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2949999999999999,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.749}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.087,"15min":1.115},"min":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.466,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.006},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.179,"15min":1.196},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4139999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.3979999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6899999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.206},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3360000000000001,"5min":7.157,"15min":7.157},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.222,"15min":1.242},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.663,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2929999999999999,"15min":1.3080000000000001},"min":{"1min":0.82499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5940000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.355}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3240000000000001,"15min":1.347},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4550000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.748,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.234}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3500000000000001,"15min":1.3560000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7290000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.296},{"interface":"front","average":{"1min":1.232,"5min":1.4159999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.625,"5min":3.786,"15min":3.786},"last":1.036}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.446,"15min":1.47},"min":{"1min":0.86699999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.47,"15min":1.492},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.7490000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.1240000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2170000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89400000000000002,"15min":0.91400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.365,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85399999999999998,"15min":0.86299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.749},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84599999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.085,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.085,"15min":1.1080000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4690000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.84499999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.53,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.147},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1539999999999999,"15min":1.1559999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2709999999999999,"15min":1.292},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6299999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.1799999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.2310000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.244,"15min":1.2470000000000001},"min":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.94799999999999995}]},{"osd":7,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.115},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.367,"15min":1.3919999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6479999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":0.89100000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:48:36.867 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T13:48:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.116+0000 7f1c673b9640 1 Processor -- start 2023-12-19T13:48:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.117+0000 7f1c673b9640 1 -- start start 2023-12-19T13:48:37.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.118+0000 7f1c673b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 0x7f1c600af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.118+0000 7f1c673b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c600afb10 con 0x7f1c600b0b50 2023-12-19T13:48:37.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.118+0000 7f1c673b9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6006bb30 con 0x7f1c6006c6b0 2023-12-19T13:48:37.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.118+0000 7f1c673b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600b0070 con 0x7f1c601449e0 2023-12-19T13:48:37.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.118+0000 7f1c64954640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1c600b0b50 0x7f1c6006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50148/0 (socket says 172.21.15.113:50148) 2023-12-19T13:48:37.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.118+0000 7f1c64954640 1 -- 172.21.15.113:0/3860734554 learned_addr learned my addr 172.21.15.113:0/3860734554 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c65155640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 0x7f1c600af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788738492 0 0) 0x7f1c600afb10 con 0x7f1c600b0b50 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c4c003520 con 0x7f1c600b0b50 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2098345238 0 0) 0x7f1c4c003520 con 0x7f1c600b0b50 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 msgr2=0x7f1c600af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 0x7f1c600af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 >> v1:172.21.15.151:6789/0 conn(0x7f1c6006c6b0 legacy=0x7f1c600b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600b0350 con 0x7f1c600b0b50 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1c50001670 con 0x7f1c600b0b50 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 >> v1:172.21.15.113:6789/0 conn(0x7f1c600b0b50 legacy=0x7f1c6006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c003a10 0x7f1c4c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 0x7f1c4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600b0070 con 0x7f1c4c0047c0 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0054e0 con 0x7f1c4c003a10 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c00bec0 con 0x7f1c601449e0 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.119+0000 7f1c64954640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c65155640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c003a10 0x7f1c4c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c65956640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 0x7f1c4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c64954640 1 -- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 msgr2=0x7f1c4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c64954640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 0x7f1c4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c64954640 1 -- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c003a10 msgr2=0x7f1c4c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:37.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c64954640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c003a10 0x7f1c4c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c64954640 1 -- 172.21.15.113:0/3860734554 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c003520 con 0x7f1c4c0047c0 2023-12-19T13:48:37.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c65155640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c003a10 0x7f1c4c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:37.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.120+0000 7f1c65956640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c601449e0 0x7f1c4c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.121+0000 7f1c64954640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c4c004c40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c0e0 tx=0x7f1c4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9643f0ddb3e79fda server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.121+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50005ad0 con 0x7f1c4c0047c0 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.121+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50005c30 con 0x7f1c4c0047c0 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.121+0000 7f1c57fff640 1 -- 172.21.15.113:0/3860734554 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5002c7f0 con 0x7f1c4c0047c0 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.122+0000 7f1c673b9640 1 -- 172.21.15.113:0/3860734554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 msgr2=0x7f1c4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.122+0000 7f1c673b9640 1 --2- 172.21.15.113:0/3860734554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c4c004c40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c0e0 tx=0x7f1c4c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.122+0000 7f1c65956640 1 -- 172.21.15.113:0/3860734554 reap_dead start 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.122+0000 7f1c673b9640 1 -- 172.21.15.113:0/3860734554 shutdown_connections 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.122+0000 7f1c673b9640 1 -- 172.21.15.113:0/3860734554 >> 172.21.15.113:0/3860734554 conn(0x7f1c600cbb70 msgr2=0x7f1c600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:37.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.122+0000 7f1c673b9640 1 -- 172.21.15.113:0/3860734554 shutdown_connections 2023-12-19T13:48:37.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.122+0000 7f1c673b9640 1 -- 172.21.15.113:0/3860734554 wait complete. 2023-12-19T13:48:37.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.124+0000 7f1c673b9640 1 Processor -- start 2023-12-19T13:48:37.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.124+0000 7f1c673b9640 1 -- start start 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c673b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c60143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c673b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c600a8eb0 0x7f1c600aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c673b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c600aa6f0 0x7f1c600aab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c673b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600ace80 con 0x7f1c4c0047c0 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c673b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60141ab0 con 0x7f1c600aa6f0 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c673b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60143970 con 0x7f1c600a8eb0 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c60143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c60143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50110/0 (socket says 172.21.15.113:50110) 2023-12-19T13:48:37.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 -- 172.21.15.113:0/2733766800 learned_addr learned my addr 172.21.15.113:0/2733766800 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 -- 172.21.15.113:0/2733766800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c600a8eb0 msgr2=0x7f1c600aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c600a8eb0 0x7f1c600aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 -- 172.21.15.113:0/2733766800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c600aa6f0 msgr2=0x7f1c600aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c600aa6f0 0x7f1c600aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.125+0000 7f1c65155640 1 -- 172.21.15.113:0/2733766800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600a93e0 con 0x7f1c4c0047c0 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.126+0000 7f1c65155640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c60143430 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e7e0 tx=0x7f1c5c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.126+0000 7f1c55ffb640 1 -- 172.21.15.113:0/2733766800 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00c6d0 con 0x7f1c4c0047c0 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.126+0000 7f1c55ffb640 1 -- 172.21.15.113:0/2733766800 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00c830 con 0x7f1c4c0047c0 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.126+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c600a96c0 con 0x7f1c4c0047c0 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.126+0000 7f1c55ffb640 1 -- 172.21.15.113:0/2733766800 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00cba0 con 0x7f1c4c0047c0 2023-12-19T13:48:37.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.126+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c600ac790 con 0x7f1c4c0047c0 2023-12-19T13:48:37.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.127+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c600ad0f0 con 0x7f1c4c0047c0 2023-12-19T13:48:37.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.128+0000 7f1c55ffb640 1 -- 172.21.15.113:0/2733766800 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c5c00cd00 con 0x7f1c4c0047c0 2023-12-19T13:48:37.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.130+0000 7f1c55ffb640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4406a430 0x7f1c4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.130+0000 7f1c55ffb640 1 -- 172.21.15.113:0/2733766800 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c5c088730 con 0x7f1c4c0047c0 2023-12-19T13:48:37.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.130+0000 7f1c64954640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4406a430 0x7f1c4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.130+0000 7f1c64954640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4406a430 0x7f1c4406c8f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c50034000 tx=0x7f1c50007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:37.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.134+0000 7f1c55ffb640 1 -- 172.21.15.113:0/2733766800 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c5c053d20 con 0x7f1c4c0047c0 2023-12-19T13:48:37.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.385+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1c60061910 con 0x7f1c4c0047c0 2023-12-19T13:48:37.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.386+0000 7f1c55ffb640 1 -- 172.21.15.113:0/2733766800 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1167 (secure 0 0 0) 0x7f1c5c009420 con 0x7f1c4c0047c0 2023-12-19T13:48:37.386 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:37.386 INFO:teuthology.orchestra.run.smithi113.stdout:{"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":143,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1702993580,"num_in_osds":8,"osd_in_since":1702993577,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":3039412,"bytes_avail":1596960588,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5577}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-19T13:47:28.428194+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T13:48:37.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4406a430 msgr2=0x7f1c4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4406a430 0x7f1c4406c8f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c50034000 tx=0x7f1c50007000 comp rx=0 tx=0).stop 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 msgr2=0x7f1c60143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c60143430 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e7e0 tx=0x7f1c5c00eca0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 shutdown_connections 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4406a430 0x7f1c4406c8f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c600aa6f0 0x7f1c600aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c600a8eb0 0x7f1c600aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 --2- 172.21.15.113:0/2733766800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0047c0 0x7f1c60143430 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 >> 172.21.15.113:0/2733766800 conn(0x7f1c600cbb70 msgr2=0x7f1c6015b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 shutdown_connections 2023-12-19T13:48:37.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.389+0000 7f1c673b9640 1 -- 172.21.15.113:0/2733766800 wait complete. 2023-12-19T13:48:37.405 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T13:48:37.406 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:48:37.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.615+0000 7f2539343640 1 Processor -- start 2023-12-19T13:48:37.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.615+0000 7f2539343640 1 -- start start 2023-12-19T13:48:37.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f2539343640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25340b0b50 0x7f253406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f2539343640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f253406b590 0x7f253406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f2539343640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253406bb30 con 0x7f25341449e0 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f2539343640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340b0070 con 0x7f25340b0b50 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f2539343640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340b0350 con 0x7f253406b590 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f2532ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f25341449e0 0x7f25340af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50162/0 (socket says 172.21.15.113:50162) 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f2532ffd640 1 -- 172.21.15.113:0/3236258397 learned_addr learned my addr 172.21.15.113:0/3236258397 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.617+0000 7f252bfff640 1 --2- 172.21.15.113:0/3236258397 >> v2:172.21.15.113:3300/0 conn(0x7f25340b0b50 0x7f253406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f25327fc640 1 -- 172.21.15.113:0/3236258397 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067879386 0 0) 0x7f253406bb30 con 0x7f25341449e0 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f25327fc640 1 -- 172.21.15.113:0/3236258397 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2520003520 con 0x7f25341449e0 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f25337fe640 1 --2- 172.21.15.113:0/3236258397 >> v2:172.21.15.151:3300/0 conn(0x7f253406b590 0x7f253406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f252bfff640 1 -- 172.21.15.113:0/3236258397 >> v2:172.21.15.151:3300/0 conn(0x7f253406b590 msgr2=0x7f253406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f252bfff640 1 --2- 172.21.15.113:0/3236258397 >> v2:172.21.15.151:3300/0 conn(0x7f253406b590 0x7f253406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f252bfff640 1 -- 172.21.15.113:0/3236258397 >> v1:172.21.15.113:6789/0 conn(0x7f25341449e0 legacy=0x7f25340af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f252bfff640 1 -- 172.21.15.113:0/3236258397 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25340b0630 con 0x7f25340b0b50 2023-12-19T13:48:37.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.618+0000 7f25337fe640 1 --2- 172.21.15.113:0/3236258397 >> v2:172.21.15.151:3300/0 conn(0x7f253406b590 0x7f253406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:37.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.619+0000 7f252bfff640 1 --2- 172.21.15.113:0/3236258397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f253406bfa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f25340b1270 tx=0x7f251c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e975cc8ac3cc2ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:37.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.619+0000 7f25327fc640 1 -- 172.21.15.113:0/3236258397 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c031830 con 0x7f25340b0b50 2023-12-19T13:48:37.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.619+0000 7f25327fc640 1 -- 172.21.15.113:0/3236258397 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c031990 con 0x7f25340b0b50 2023-12-19T13:48:37.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.619+0000 7f25327fc640 1 -- 172.21.15.113:0/3236258397 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c031d20 con 0x7f25340b0b50 2023-12-19T13:48:37.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 -- 172.21.15.113:0/3236258397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 msgr2=0x7f253406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 --2- 172.21.15.113:0/3236258397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f253406bfa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f25340b1270 tx=0x7f251c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 -- 172.21.15.113:0/3236258397 shutdown_connections 2023-12-19T13:48:37.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 --2- 172.21.15.113:0/3236258397 >> v2:172.21.15.151:3300/0 conn(0x7f253406b590 0x7f253406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 --2- 172.21.15.113:0/3236258397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f253406bfa0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 -- 172.21.15.113:0/3236258397 >> 172.21.15.113:0/3236258397 conn(0x7f25340cbb70 msgr2=0x7f25340cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:37.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 -- 172.21.15.113:0/3236258397 shutdown_connections 2023-12-19T13:48:37.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.620+0000 7f2539343640 1 -- 172.21.15.113:0/3236258397 wait complete. 2023-12-19T13:48:37.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.622+0000 7f2539343640 1 Processor -- start 2023-12-19T13:48:37.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.622+0000 7f2539343640 1 -- start start 2023-12-19T13:48:37.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f2539343640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f253406b590 0x7f2534140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f2539343640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f2534141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f2539343640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25341449e0 0x7f25340ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f2539343640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340ad8c0 con 0x7f25340b0b50 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f2539343640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340acd40 con 0x7f25341449e0 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f2539343640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340ad020 con 0x7f253406b590 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f2534141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f2534141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50130/0 (socket says 172.21.15.113:50130) 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 -- 172.21.15.113:0/1512478943 learned_addr learned my addr 172.21.15.113:0/1512478943 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f2532ffd640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f253406b590 0x7f2534140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 -- 172.21.15.113:0/1512478943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f253406b590 msgr2=0x7f2534140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f253406b590 0x7f2534140700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 -- 172.21.15.113:0/1512478943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25341449e0 msgr2=0x7f25340ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25341449e0 0x7f25340ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.623+0000 7f252bfff640 1 -- 172.21.15.113:0/1512478943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c009400 con 0x7f25340b0b50 2023-12-19T13:48:37.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.624+0000 7f252bfff640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f2534141130 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f251c009890 tx=0x7f251c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:37.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.624+0000 7f252b7fe640 1 -- 172.21.15.113:0/1512478943 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c03a6f0 con 0x7f25340b0b50 2023-12-19T13:48:37.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.624+0000 7f252b7fe640 1 -- 172.21.15.113:0/1512478943 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c03a870 con 0x7f25340b0b50 2023-12-19T13:48:37.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.624+0000 7f252b7fe640 1 -- 172.21.15.113:0/1512478943 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c03ac20 con 0x7f25340b0b50 2023-12-19T13:48:37.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.624+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25340ad300 con 0x7f25340b0b50 2023-12-19T13:48:37.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.624+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340ac8b0 con 0x7f25340b0b50 2023-12-19T13:48:37.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.625+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25340acaa0 con 0x7f25340b0b50 2023-12-19T13:48:37.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.626+0000 7f252b7fe640 1 -- 172.21.15.113:0/1512478943 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f251c043410 con 0x7f25340b0b50 2023-12-19T13:48:37.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.627+0000 7f252b7fe640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f251406a430 0x7f251406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:37.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.627+0000 7f252b7fe640 1 -- 172.21.15.113:0/1512478943 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f251c0aa560 con 0x7f25340b0b50 2023-12-19T13:48:37.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.627+0000 7f2532ffd640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f251406a430 0x7f251406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:37.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.628+0000 7f2532ffd640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f251406a430 0x7f251406c8f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f25240011e0 tx=0x7f2524009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:37.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.631+0000 7f252b7fe640 1 -- 172.21.15.113:0/1512478943 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f251c075ab0 con 0x7f25340b0b50 2023-12-19T13:48:37.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.803+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25340ad190 con 0x7f251406a430 2023-12-19T13:48:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.811+0000 7f252b7fe640 1 -- 172.21.15.113:0/1512478943 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282467 (secure 0 0 0) 0x7f25340ad190 con 0x7f251406a430 2023-12-19T13:48:37.815 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:37.816 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:48:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f251406a430 msgr2=0x7f251406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f251406a430 0x7f251406c8f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f25240011e0 tx=0x7f2524009040 comp rx=0 tx=0).stop 2023-12-19T13:48:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 msgr2=0x7f2534141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f2534141130 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f251c009890 tx=0x7f251c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 shutdown_connections 2023-12-19T13:48:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f251406a430 0x7f251406c8f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25341449e0 0x7f25340ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25340b0b50 0x7f2534141130 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 --2- 172.21.15.113:0/1512478943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f253406b590 0x7f2534140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 >> 172.21.15.113:0/1512478943 conn(0x7f25340cbb70 msgr2=0x7f253406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 shutdown_connections 2023-12-19T13:48:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:37.816+0000 7f2539343640 1 -- 172.21.15.113:0/1512478943 wait complete. 2023-12-19T13:48:37.834 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-19T13:48:36.447643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559531,"statfs":{"total":1600000000,"available":1596960588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001889"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291950+0000","last_change":"2023-12-19T13:48:31.044642+0000","last_active":"2023-12-19T13:48:32.291950+0000","last_peered":"2023-12-19T13:48:32.291950+0000","last_clean":"2023-12-19T13:48:32.291950+0000","last_became_active":"2023-12-19T13:48:31.044404+0000","last_became_peered":"2023-12-19T13:48:31.044404+0000","last_unstale":"2023-12-19T13:48:32.291950+0000","last_undegraded":"2023-12-19T13:48:32.291950+0000","last_fullsized":"2023-12-19T13:48:32.291950+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042500+0000","last_change":"2023-12-19T13:48:31.051159+0000","last_active":"2023-12-19T13:48:32.042500+0000","last_peered":"2023-12-19T13:48:32.042500+0000","last_clean":"2023-12-19T13:48:32.042500+0000","last_became_active":"2023-12-19T13:48:31.051029+0000","last_became_peered":"2023-12-19T13:48:31.051029+0000","last_unstale":"2023-12-19T13:48:32.042500+0000","last_undegraded":"2023-12-19T13:48:32.042500+0000","last_fullsized":"2023-12-19T13:48:32.042500+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290704+0000","last_change":"2023-12-19T13:48:31.048954+0000","last_active":"2023-12-19T13:48:32.290704+0000","last_peered":"2023-12-19T13:48:32.290704+0000","last_clean":"2023-12-19T13:48:32.290704+0000","last_became_active":"2023-12-19T13:48:31.048739+0000","last_became_peered":"2023-12-19T13:48:31.048739+0000","last_unstale":"2023-12-19T13:48:32.290704+0000","last_undegraded":"2023-12-19T13:48:32.290704+0000","last_fullsized":"2023-12-19T13:48:32.290704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:55.364518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291898+0000","last_change":"2023-12-19T13:48:31.057026+0000","last_active":"2023-12-19T13:48:32.291898+0000","last_peered":"2023-12-19T13:48:32.291898+0000","last_clean":"2023-12-19T13:48:32.291898+0000","last_became_active":"2023-12-19T13:48:31.056603+0000","last_became_peered":"2023-12-19T13:48:31.056603+0000","last_unstale":"2023-12-19T13:48:32.291898+0000","last_undegraded":"2023-12-19T13:48:32.291898+0000","last_fullsized":"2023-12-19T13:48:32.291898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:47.540113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292168+0000","last_change":"2023-12-19T13:48:31.063988+0000","last_active":"2023-12-19T13:48:32.292168+0000","last_peered":"2023-12-19T13:48:32.292168+0000","last_clean":"2023-12-19T13:48:32.292168+0000","last_became_active":"2023-12-19T13:48:31.063771+0000","last_became_peered":"2023-12-19T13:48:31.063771+0000","last_unstale":"2023-12-19T13:48:32.292168+0000","last_undegraded":"2023-12-19T13:48:32.292168+0000","last_fullsized":"2023-12-19T13:48:32.292168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292305+0000","last_change":"2023-12-19T13:48:31.064483+0000","last_active":"2023-12-19T13:48:32.292305+0000","last_peered":"2023-12-19T13:48:32.292305+0000","last_clean":"2023-12-19T13:48:32.292305+0000","last_became_active":"2023-12-19T13:48:31.064224+0000","last_became_peered":"2023-12-19T13:48:31.064224+0000","last_unstale":"2023-12-19T13:48:32.292305+0000","last_undegraded":"2023-12-19T13:48:32.292305+0000","last_fullsized":"2023-12-19T13:48:32.292305+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042523+0000","last_change":"2023-12-19T13:48:31.054245+0000","last_active":"2023-12-19T13:48:32.042523+0000","last_peered":"2023-12-19T13:48:32.042523+0000","last_clean":"2023-12-19T13:48:32.042523+0000","last_became_active":"2023-12-19T13:48:31.053974+0000","last_became_peered":"2023-12-19T13:48:31.053974+0000","last_unstale":"2023-12-19T13:48:32.042523+0000","last_undegraded":"2023-12-19T13:48:32.042523+0000","last_fullsized":"2023-12-19T13:48:32.042523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:44.149292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293318+0000","last_change":"2023-12-19T13:48:31.060864+0000","last_active":"2023-12-19T13:48:32.293318+0000","last_peered":"2023-12-19T13:48:32.293318+0000","last_clean":"2023-12-19T13:48:32.293318+0000","last_became_active":"2023-12-19T13:48:31.057459+0000","last_became_peered":"2023-12-19T13:48:31.057459+0000","last_unstale":"2023-12-19T13:48:32.293318+0000","last_undegraded":"2023-12-19T13:48:32.293318+0000","last_fullsized":"2023-12-19T13:48:32.293318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:39.585226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291888+0000","last_change":"2023-12-19T13:48:31.066252+0000","last_active":"2023-12-19T13:48:32.291888+0000","last_peered":"2023-12-19T13:48:32.291888+0000","last_clean":"2023-12-19T13:48:32.291888+0000","last_became_active":"2023-12-19T13:48:31.064257+0000","last_became_peered":"2023-12-19T13:48:31.064257+0000","last_unstale":"2023-12-19T13:48:32.291888+0000","last_undegraded":"2023-12-19T13:48:32.291888+0000","last_fullsized":"2023-12-19T13:48:32.291888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:12.317229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.294770+0000","last_change":"2023-12-19T13:48:31.062233+0000","last_active":"2023-12-19T13:48:32.294770+0000","last_peered":"2023-12-19T13:48:32.294770+0000","last_clean":"2023-12-19T13:48:32.294770+0000","last_became_active":"2023-12-19T13:48:31.059606+0000","last_became_peered":"2023-12-19T13:48:31.059606+0000","last_unstale":"2023-12-19T13:48:32.294770+0000","last_undegraded":"2023-12-19T13:48:32.294770+0000","last_fullsized":"2023-12-19T13:48:32.294770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:01.890904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292230+0000","last_change":"2023-12-19T13:48:31.066122+0000","last_active":"2023-12-19T13:48:32.292230+0000","last_peered":"2023-12-19T13:48:32.292230+0000","last_clean":"2023-12-19T13:48:32.292230+0000","last_became_active":"2023-12-19T13:48:31.065042+0000","last_became_peered":"2023-12-19T13:48:31.065042+0000","last_unstale":"2023-12-19T13:48:32.292230+0000","last_undegraded":"2023-12-19T13:48:32.292230+0000","last_fullsized":"2023-12-19T13:48:32.292230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:05.367712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042744+0000","last_change":"2023-12-19T13:48:31.041244+0000","last_active":"2023-12-19T13:48:32.042744+0000","last_peered":"2023-12-19T13:48:32.042744+0000","last_clean":"2023-12-19T13:48:32.042744+0000","last_became_active":"2023-12-19T13:48:31.041036+0000","last_became_peered":"2023-12-19T13:48:31.041036+0000","last_unstale":"2023-12-19T13:48:32.042744+0000","last_undegraded":"2023-12-19T13:48:32.042744+0000","last_fullsized":"2023-12-19T13:48:32.042744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:34.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292651+0000","last_change":"2023-12-19T13:48:31.062333+0000","last_active":"2023-12-19T13:48:32.292651+0000","last_peered":"2023-12-19T13:48:32.292651+0000","last_clean":"2023-12-19T13:48:32.292651+0000","last_became_active":"2023-12-19T13:48:31.062119+0000","last_became_peered":"2023-12-19T13:48:31.062119+0000","last_unstale":"2023-12-19T13:48:32.292651+0000","last_undegraded":"2023-12-19T13:48:32.292651+0000","last_fullsized":"2023-12-19T13:48:32.292651+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292881+0000","last_change":"2023-12-19T13:48:31.063490+0000","last_active":"2023-12-19T13:48:32.292881+0000","last_peered":"2023-12-19T13:48:32.292881+0000","last_clean":"2023-12-19T13:48:32.292881+0000","last_became_active":"2023-12-19T13:48:31.062321+0000","last_became_peered":"2023-12-19T13:48:31.062321+0000","last_unstale":"2023-12-19T13:48:32.292881+0000","last_undegraded":"2023-12-19T13:48:32.292881+0000","last_fullsized":"2023-12-19T13:48:32.292881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:23.373203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292561+0000","last_change":"2023-12-19T13:48:31.060376+0000","last_active":"2023-12-19T13:48:32.292561+0000","last_peered":"2023-12-19T13:48:32.292561+0000","last_clean":"2023-12-19T13:48:32.292561+0000","last_became_active":"2023-12-19T13:48:31.055583+0000","last_became_peered":"2023-12-19T13:48:31.055583+0000","last_unstale":"2023-12-19T13:48:32.292561+0000","last_undegraded":"2023-12-19T13:48:32.292561+0000","last_fullsized":"2023-12-19T13:48:32.292561+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:14:22.998770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292340+0000","last_change":"2023-12-19T13:48:31.060807+0000","last_active":"2023-12-19T13:48:32.292340+0000","last_peered":"2023-12-19T13:48:32.292340+0000","last_clean":"2023-12-19T13:48:32.292340+0000","last_became_active":"2023-12-19T13:48:31.060563+0000","last_became_peered":"2023-12-19T13:48:31.060563+0000","last_unstale":"2023-12-19T13:48:32.292340+0000","last_undegraded":"2023-12-19T13:48:32.292340+0000","last_fullsized":"2023-12-19T13:48:32.292340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:16.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042986+0000","last_change":"2023-12-19T13:48:31.046263+0000","last_active":"2023-12-19T13:48:32.042986+0000","last_peered":"2023-12-19T13:48:32.042986+0000","last_clean":"2023-12-19T13:48:32.042986+0000","last_became_active":"2023-12-19T13:48:31.045298+0000","last_became_peered":"2023-12-19T13:48:31.045298+0000","last_unstale":"2023-12-19T13:48:32.042986+0000","last_undegraded":"2023-12-19T13:48:32.042986+0000","last_fullsized":"2023-12-19T13:48:32.042986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:35.655516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290931+0000","last_change":"2023-12-19T13:48:31.062078+0000","last_active":"2023-12-19T13:48:32.290931+0000","last_peered":"2023-12-19T13:48:32.290931+0000","last_clean":"2023-12-19T13:48:32.290931+0000","last_became_active":"2023-12-19T13:48:31.061681+0000","last_became_peered":"2023-12-19T13:48:31.061681+0000","last_unstale":"2023-12-19T13:48:32.290931+0000","last_undegraded":"2023-12-19T13:48:32.290931+0000","last_fullsized":"2023-12-19T13:48:32.290931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:47.949416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291001+0000","last_change":"2023-12-19T13:48:31.064382+0000","last_active":"2023-12-19T13:48:32.291001+0000","last_peered":"2023-12-19T13:48:32.291001+0000","last_clean":"2023-12-19T13:48:32.291001+0000","last_became_active":"2023-12-19T13:48:31.064164+0000","last_became_peered":"2023-12-19T13:48:31.064164+0000","last_unstale":"2023-12-19T13:48:32.291001+0000","last_undegraded":"2023-12-19T13:48:32.291001+0000","last_fullsized":"2023-12-19T13:48:32.291001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.295433+0000","last_change":"2023-12-19T13:48:31.062892+0000","last_active":"2023-12-19T13:48:32.295433+0000","last_peered":"2023-12-19T13:48:32.295433+0000","last_clean":"2023-12-19T13:48:32.295433+0000","last_became_active":"2023-12-19T13:48:31.060518+0000","last_became_peered":"2023-12-19T13:48:31.060518+0000","last_unstale":"2023-12-19T13:48:32.295433+0000","last_undegraded":"2023-12-19T13:48:32.295433+0000","last_fullsized":"2023-12-19T13:48:32.295433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:23.369417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292587+0000","last_change":"2023-12-19T13:48:31.061636+0000","last_active":"2023-12-19T13:48:32.292587+0000","last_peered":"2023-12-19T13:48:32.292587+0000","last_clean":"2023-12-19T13:48:32.292587+0000","last_became_active":"2023-12-19T13:48:31.058665+0000","last_became_peered":"2023-12-19T13:48:31.058665+0000","last_unstale":"2023-12-19T13:48:32.292587+0000","last_undegraded":"2023-12-19T13:48:32.292587+0000","last_fullsized":"2023-12-19T13:48:32.292587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:15.234631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043320+0000","last_change":"2023-12-19T13:48:31.040705+0000","last_active":"2023-12-19T13:48:32.043320+0000","last_peered":"2023-12-19T13:48:32.043320+0000","last_clean":"2023-12-19T13:48:32.043320+0000","last_became_active":"2023-12-19T13:48:31.039983+0000","last_became_peered":"2023-12-19T13:48:31.039983+0000","last_unstale":"2023-12-19T13:48:32.043320+0000","last_undegraded":"2023-12-19T13:48:32.043320+0000","last_fullsized":"2023-12-19T13:48:32.043320+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:29.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042513+0000","last_change":"2023-12-19T13:48:31.044408+0000","last_active":"2023-12-19T13:48:32.042513+0000","last_peered":"2023-12-19T13:48:32.042513+0000","last_clean":"2023-12-19T13:48:32.042513+0000","last_became_active":"2023-12-19T13:48:31.044036+0000","last_became_peered":"2023-12-19T13:48:31.044036+0000","last_unstale":"2023-12-19T13:48:32.042513+0000","last_undegraded":"2023-12-19T13:48:32.042513+0000","last_fullsized":"2023-12-19T13:48:32.042513+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.871928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042205+0000","last_change":"2023-12-19T13:48:31.058117+0000","last_active":"2023-12-19T13:48:32.042205+0000","last_peered":"2023-12-19T13:48:32.042205+0000","last_clean":"2023-12-19T13:48:32.042205+0000","last_became_active":"2023-12-19T13:48:31.057815+0000","last_became_peered":"2023-12-19T13:48:31.057815+0000","last_unstale":"2023-12-19T13:48:32.042205+0000","last_undegraded":"2023-12-19T13:48:32.042205+0000","last_fullsized":"2023-12-19T13:48:32.042205+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:39.585226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292374+0000","last_change":"2023-12-19T13:48:31.045414+0000","last_active":"2023-12-19T13:48:32.292374+0000","last_peered":"2023-12-19T13:48:32.292374+0000","last_clean":"2023-12-19T13:48:32.292374+0000","last_became_active":"2023-12-19T13:48:31.045218+0000","last_became_peered":"2023-12-19T13:48:31.045218+0000","last_unstale":"2023-12-19T13:48:32.292374+0000","last_undegraded":"2023-12-19T13:48:32.292374+0000","last_fullsized":"2023-12-19T13:48:32.292374+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292399+0000","last_change":"2023-12-19T13:48:31.065352+0000","last_active":"2023-12-19T13:48:32.292399+0000","last_peered":"2023-12-19T13:48:32.292399+0000","last_clean":"2023-12-19T13:48:32.292399+0000","last_became_active":"2023-12-19T13:48:31.064726+0000","last_became_peered":"2023-12-19T13:48:31.064726+0000","last_unstale":"2023-12-19T13:48:32.292399+0000","last_undegraded":"2023-12-19T13:48:32.292399+0000","last_fullsized":"2023-12-19T13:48:32.292399+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:48.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042631+0000","last_change":"2023-12-19T13:48:31.039929+0000","last_active":"2023-12-19T13:48:32.042631+0000","last_peered":"2023-12-19T13:48:32.042631+0000","last_clean":"2023-12-19T13:48:32.042631+0000","last_became_active":"2023-12-19T13:48:31.039057+0000","last_became_peered":"2023-12-19T13:48:31.039057+0000","last_unstale":"2023-12-19T13:48:32.042631+0000","last_undegraded":"2023-12-19T13:48:32.042631+0000","last_fullsized":"2023-12-19T13:48:32.042631+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:41:17.848618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042615+0000","last_change":"2023-12-19T13:48:31.035261+0000","last_active":"2023-12-19T13:48:32.042615+0000","last_peered":"2023-12-19T13:48:32.042615+0000","last_clean":"2023-12-19T13:48:32.042615+0000","last_became_active":"2023-12-19T13:48:31.035036+0000","last_became_peered":"2023-12-19T13:48:31.035036+0000","last_unstale":"2023-12-19T13:48:32.042615+0000","last_undegraded":"2023-12-19T13:48:32.042615+0000","last_fullsized":"2023-12-19T13:48:32.042615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:53.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290363+0000","last_change":"2023-12-19T13:48:31.050415+0000","last_active":"2023-12-19T13:48:32.290363+0000","last_peered":"2023-12-19T13:48:32.290363+0000","last_clean":"2023-12-19T13:48:32.290363+0000","last_became_active":"2023-12-19T13:48:31.050284+0000","last_became_peered":"2023-12-19T13:48:31.050284+0000","last_unstale":"2023-12-19T13:48:32.290363+0000","last_undegraded":"2023-12-19T13:48:32.290363+0000","last_fullsized":"2023-12-19T13:48:32.290363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:35.655516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043895+0000","last_change":"2023-12-19T13:48:31.036365+0000","last_active":"2023-12-19T13:48:32.043895+0000","last_peered":"2023-12-19T13:48:32.043895+0000","last_clean":"2023-12-19T13:48:32.043895+0000","last_became_active":"2023-12-19T13:48:31.036157+0000","last_became_peered":"2023-12-19T13:48:31.036157+0000","last_unstale":"2023-12-19T13:48:32.043895+0000","last_undegraded":"2023-12-19T13:48:32.043895+0000","last_fullsized":"2023-12-19T13:48:32.043895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292586+0000","last_change":"2023-12-19T13:48:31.059900+0000","last_active":"2023-12-19T13:48:32.292586+0000","last_peered":"2023-12-19T13:48:32.292586+0000","last_clean":"2023-12-19T13:48:32.292586+0000","last_became_active":"2023-12-19T13:48:31.059662+0000","last_became_peered":"2023-12-19T13:48:31.059662+0000","last_unstale":"2023-12-19T13:48:32.292586+0000","last_undegraded":"2023-12-19T13:48:32.292586+0000","last_fullsized":"2023-12-19T13:48:32.292586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:33.366100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292352+0000","last_change":"2023-12-19T13:48:31.056145+0000","last_active":"2023-12-19T13:48:32.292352+0000","last_peered":"2023-12-19T13:48:32.292352+0000","last_clean":"2023-12-19T13:48:32.292352+0000","last_became_active":"2023-12-19T13:48:31.053672+0000","last_became_peered":"2023-12-19T13:48:31.053672+0000","last_unstale":"2023-12-19T13:48:32.292352+0000","last_undegraded":"2023-12-19T13:48:32.292352+0000","last_fullsized":"2023-12-19T13:48:32.292352+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042737+0000","last_change":"2023-12-19T13:48:31.051669+0000","last_active":"2023-12-19T13:48:32.042737+0000","last_peered":"2023-12-19T13:48:32.042737+0000","last_clean":"2023-12-19T13:48:32.042737+0000","last_became_active":"2023-12-19T13:48:31.051139+0000","last_became_peered":"2023-12-19T13:48:31.051139+0000","last_unstale":"2023-12-19T13:48:32.042737+0000","last_undegraded":"2023-12-19T13:48:32.042737+0000","last_fullsized":"2023-12-19T13:48:32.042737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:31.393201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.066366+0000","last_change":"2023-12-19T13:48:30.569175+0000","last_active":"2023-12-19T13:48:31.066366+0000","last_peered":"2023-12-19T13:48:31.066366+0000","last_clean":"2023-12-19T13:48:31.066366+0000","last_became_active":"2023-12-19T13:48:30.567045+0000","last_became_peered":"2023-12-19T13:48:30.567045+0000","last_unstale":"2023-12-19T13:48:31.066366+0000","last_undegraded":"2023-12-19T13:48:31.066366+0000","last_fullsized":"2023-12-19T13:48:31.066366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291255+0000","last_change":"2023-12-19T13:48:31.064482+0000","last_active":"2023-12-19T13:48:32.291255+0000","last_peered":"2023-12-19T13:48:32.291255+0000","last_clean":"2023-12-19T13:48:32.291255+0000","last_became_active":"2023-12-19T13:48:31.063591+0000","last_became_peered":"2023-12-19T13:48:31.063591+0000","last_unstale":"2023-12-19T13:48:32.291255+0000","last_undegraded":"2023-12-19T13:48:32.291255+0000","last_fullsized":"2023-12-19T13:48:32.291255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.045006+0000","last_change":"2023-12-19T13:48:30.563689+0000","last_active":"2023-12-19T13:48:31.045006+0000","last_peered":"2023-12-19T13:48:31.045006+0000","last_clean":"2023-12-19T13:48:31.045006+0000","last_became_active":"2023-12-19T13:48:30.562331+0000","last_became_peered":"2023-12-19T13:48:30.562331+0000","last_unstale":"2023-12-19T13:48:31.045006+0000","last_undegraded":"2023-12-19T13:48:31.045006+0000","last_fullsized":"2023-12-19T13:48:31.045006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043182+0000","last_change":"2023-12-19T13:48:31.038378+0000","last_active":"2023-12-19T13:48:32.043182+0000","last_peered":"2023-12-19T13:48:32.043182+0000","last_clean":"2023-12-19T13:48:32.043182+0000","last_became_active":"2023-12-19T13:48:31.038172+0000","last_became_peered":"2023-12-19T13:48:31.038172+0000","last_unstale":"2023-12-19T13:48:32.043182+0000","last_undegraded":"2023-12-19T13:48:32.043182+0000","last_fullsized":"2023-12-19T13:48:32.043182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:16.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063973+0000","last_change":"2023-12-19T13:48:30.570820+0000","last_active":"2023-12-19T13:48:31.063973+0000","last_peered":"2023-12-19T13:48:31.063973+0000","last_clean":"2023-12-19T13:48:31.063973+0000","last_became_active":"2023-12-19T13:48:30.570263+0000","last_became_peered":"2023-12-19T13:48:30.570263+0000","last_unstale":"2023-12-19T13:48:31.063973+0000","last_undegraded":"2023-12-19T13:48:31.063973+0000","last_fullsized":"2023-12-19T13:48:31.063973+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292733+0000","last_change":"2023-12-19T13:48:31.055844+0000","last_active":"2023-12-19T13:48:32.292733+0000","last_peered":"2023-12-19T13:48:32.292733+0000","last_clean":"2023-12-19T13:48:32.292733+0000","last_became_active":"2023-12-19T13:48:31.055269+0000","last_became_peered":"2023-12-19T13:48:31.055269+0000","last_unstale":"2023-12-19T13:48:32.292733+0000","last_undegraded":"2023-12-19T13:48:32.292733+0000","last_fullsized":"2023-12-19T13:48:32.292733+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:53.451620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.046197+0000","last_change":"2023-12-19T13:48:30.563559+0000","last_active":"2023-12-19T13:48:31.046197+0000","last_peered":"2023-12-19T13:48:31.046197+0000","last_clean":"2023-12-19T13:48:31.046197+0000","last_became_active":"2023-12-19T13:48:30.563220+0000","last_became_peered":"2023-12-19T13:48:30.563220+0000","last_unstale":"2023-12-19T13:48:31.046197+0000","last_undegraded":"2023-12-19T13:48:31.046197+0000","last_fullsized":"2023-12-19T13:48:31.046197+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:47.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042698+0000","last_change":"2023-12-19T13:48:31.039253+0000","last_active":"2023-12-19T13:48:32.042698+0000","last_peered":"2023-12-19T13:48:32.042698+0000","last_clean":"2023-12-19T13:48:32.042698+0000","last_became_active":"2023-12-19T13:48:31.039027+0000","last_became_peered":"2023-12-19T13:48:31.039027+0000","last_unstale":"2023-12-19T13:48:32.042698+0000","last_undegraded":"2023-12-19T13:48:32.042698+0000","last_fullsized":"2023-12-19T13:48:32.042698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:03:27.377713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.062942+0000","last_change":"2023-12-19T13:48:30.571536+0000","last_active":"2023-12-19T13:48:31.062942+0000","last_peered":"2023-12-19T13:48:31.062942+0000","last_clean":"2023-12-19T13:48:31.062942+0000","last_became_active":"2023-12-19T13:48:30.571266+0000","last_became_peered":"2023-12-19T13:48:30.571266+0000","last_unstale":"2023-12-19T13:48:31.062942+0000","last_undegraded":"2023-12-19T13:48:31.062942+0000","last_fullsized":"2023-12-19T13:48:31.062942+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293400+0000","last_change":"2023-12-19T13:48:31.059349+0000","last_active":"2023-12-19T13:48:32.293400+0000","last_peered":"2023-12-19T13:48:32.293400+0000","last_clean":"2023-12-19T13:48:32.293400+0000","last_became_active":"2023-12-19T13:48:31.058702+0000","last_became_peered":"2023-12-19T13:48:31.058702+0000","last_unstale":"2023-12-19T13:48:32.293400+0000","last_undegraded":"2023-12-19T13:48:32.293400+0000","last_fullsized":"2023-12-19T13:48:32.293400+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:52.208906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.044227+0000","last_change":"2023-12-19T13:48:30.561942+0000","last_active":"2023-12-19T13:48:31.044227+0000","last_peered":"2023-12-19T13:48:31.044227+0000","last_clean":"2023-12-19T13:48:31.044227+0000","last_became_active":"2023-12-19T13:48:30.559026+0000","last_became_peered":"2023-12-19T13:48:30.559026+0000","last_unstale":"2023-12-19T13:48:31.044227+0000","last_undegraded":"2023-12-19T13:48:31.044227+0000","last_fullsized":"2023-12-19T13:48:31.044227+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.294999+0000","last_change":"2023-12-19T13:48:31.060791+0000","last_active":"2023-12-19T13:48:32.294999+0000","last_peered":"2023-12-19T13:48:32.294999+0000","last_clean":"2023-12-19T13:48:32.294999+0000","last_became_active":"2023-12-19T13:48:31.056175+0000","last_became_peered":"2023-12-19T13:48:31.056175+0000","last_unstale":"2023-12-19T13:48:32.294999+0000","last_undegraded":"2023-12-19T13:48:32.294999+0000","last_fullsized":"2023-12-19T13:48:32.294999+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:04.955458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.040148+0000","last_change":"2023-12-19T13:48:30.569040+0000","last_active":"2023-12-19T13:48:31.040148+0000","last_peered":"2023-12-19T13:48:31.040148+0000","last_clean":"2023-12-19T13:48:31.040148+0000","last_became_active":"2023-12-19T13:48:30.568735+0000","last_became_peered":"2023-12-19T13:48:30.568735+0000","last_unstale":"2023-12-19T13:48:31.040148+0000","last_undegraded":"2023-12-19T13:48:31.040148+0000","last_fullsized":"2023-12-19T13:48:31.040148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:08.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042154+0000","last_change":"2023-12-19T13:48:31.064711+0000","last_active":"2023-12-19T13:48:32.042154+0000","last_peered":"2023-12-19T13:48:32.042154+0000","last_clean":"2023-12-19T13:48:32.042154+0000","last_became_active":"2023-12-19T13:48:31.064494+0000","last_became_peered":"2023-12-19T13:48:31.064494+0000","last_unstale":"2023-12-19T13:48:32.042154+0000","last_undegraded":"2023-12-19T13:48:32.042154+0000","last_fullsized":"2023-12-19T13:48:32.042154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:25.175664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053035+0000","last_change":"2023-12-19T13:48:30.547571+0000","last_active":"2023-12-19T13:48:31.053035+0000","last_peered":"2023-12-19T13:48:31.053035+0000","last_clean":"2023-12-19T13:48:31.053035+0000","last_became_active":"2023-12-19T13:48:30.546977+0000","last_became_peered":"2023-12-19T13:48:30.546977+0000","last_unstale":"2023-12-19T13:48:31.053035+0000","last_undegraded":"2023-12-19T13:48:31.053035+0000","last_fullsized":"2023-12-19T13:48:31.053035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291320+0000","last_change":"2023-12-19T13:48:31.045498+0000","last_active":"2023-12-19T13:48:32.291320+0000","last_peered":"2023-12-19T13:48:32.291320+0000","last_clean":"2023-12-19T13:48:32.291320+0000","last_became_active":"2023-12-19T13:48:31.045247+0000","last_became_peered":"2023-12-19T13:48:31.045247+0000","last_unstale":"2023-12-19T13:48:32.291320+0000","last_undegraded":"2023-12-19T13:48:32.291320+0000","last_fullsized":"2023-12-19T13:48:32.291320+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:29.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.036915+0000","last_change":"2023-12-19T13:48:30.569024+0000","last_active":"2023-12-19T13:48:31.036915+0000","last_peered":"2023-12-19T13:48:31.036915+0000","last_clean":"2023-12-19T13:48:31.036915+0000","last_became_active":"2023-12-19T13:48:30.567954+0000","last_became_peered":"2023-12-19T13:48:30.567954+0000","last_unstale":"2023-12-19T13:48:31.036915+0000","last_undegraded":"2023-12-19T13:48:31.036915+0000","last_fullsized":"2023-12-19T13:48:31.036915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291559+0000","last_change":"2023-12-19T13:48:31.043152+0000","last_active":"2023-12-19T13:48:32.291559+0000","last_peered":"2023-12-19T13:48:32.291559+0000","last_clean":"2023-12-19T13:48:32.291559+0000","last_became_active":"2023-12-19T13:48:31.042920+0000","last_became_peered":"2023-12-19T13:48:31.042920+0000","last_unstale":"2023-12-19T13:48:32.291559+0000","last_undegraded":"2023-12-19T13:48:32.291559+0000","last_fullsized":"2023-12-19T13:48:32.291559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:31.393201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.037454+0000","last_change":"2023-12-19T13:48:30.558837+0000","last_active":"2023-12-19T13:48:31.037454+0000","last_peered":"2023-12-19T13:48:31.037454+0000","last_clean":"2023-12-19T13:48:31.037454+0000","last_became_active":"2023-12-19T13:48:30.556293+0000","last_became_peered":"2023-12-19T13:48:30.556293+0000","last_unstale":"2023-12-19T13:48:31.037454+0000","last_undegraded":"2023-12-19T13:48:31.037454+0000","last_fullsized":"2023-12-19T13:48:31.037454+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:31.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292329+0000","last_change":"2023-12-19T13:48:31.063653+0000","last_active":"2023-12-19T13:48:32.292329+0000","last_peered":"2023-12-19T13:48:32.292329+0000","last_clean":"2023-12-19T13:48:32.292329+0000","last_became_active":"2023-12-19T13:48:31.062676+0000","last_became_peered":"2023-12-19T13:48:31.062676+0000","last_unstale":"2023-12-19T13:48:32.292329+0000","last_undegraded":"2023-12-19T13:48:32.292329+0000","last_fullsized":"2023-12-19T13:48:32.292329+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.045902+0000","last_change":"2023-12-19T13:48:30.566173+0000","last_active":"2023-12-19T13:48:31.045902+0000","last_peered":"2023-12-19T13:48:31.045902+0000","last_clean":"2023-12-19T13:48:31.045902+0000","last_became_active":"2023-12-19T13:48:30.565902+0000","last_became_peered":"2023-12-19T13:48:30.565902+0000","last_unstale":"2023-12-19T13:48:31.045902+0000","last_undegraded":"2023-12-19T13:48:31.045902+0000","last_fullsized":"2023-12-19T13:48:31.045902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042778+0000","last_change":"2023-12-19T13:48:31.061537+0000","last_active":"2023-12-19T13:48:32.042778+0000","last_peered":"2023-12-19T13:48:32.042778+0000","last_clean":"2023-12-19T13:48:32.042778+0000","last_became_active":"2023-12-19T13:48:31.061314+0000","last_became_peered":"2023-12-19T13:48:31.061314+0000","last_unstale":"2023-12-19T13:48:32.042778+0000","last_undegraded":"2023-12-19T13:48:32.042778+0000","last_fullsized":"2023-12-19T13:48:32.042778+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:13.462370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.067460+0000","last_change":"2023-12-19T13:48:30.568619+0000","last_active":"2023-12-19T13:48:31.067460+0000","last_peered":"2023-12-19T13:48:31.067460+0000","last_clean":"2023-12-19T13:48:31.067460+0000","last_became_active":"2023-12-19T13:48:30.567775+0000","last_became_peered":"2023-12-19T13:48:30.567775+0000","last_unstale":"2023-12-19T13:48:31.067460+0000","last_undegraded":"2023-12-19T13:48:31.067460+0000","last_fullsized":"2023-12-19T13:48:31.067460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291850+0000","last_change":"2023-12-19T13:48:31.061830+0000","last_active":"2023-12-19T13:48:32.291850+0000","last_peered":"2023-12-19T13:48:32.291850+0000","last_clean":"2023-12-19T13:48:32.291850+0000","last_became_active":"2023-12-19T13:48:31.061531+0000","last_became_peered":"2023-12-19T13:48:31.061531+0000","last_unstale":"2023-12-19T13:48:32.291850+0000","last_undegraded":"2023-12-19T13:48:32.291850+0000","last_fullsized":"2023-12-19T13:48:32.291850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:00.081221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.060451+0000","last_change":"2023-12-19T13:48:30.571590+0000","last_active":"2023-12-19T13:48:31.060451+0000","last_peered":"2023-12-19T13:48:31.060451+0000","last_clean":"2023-12-19T13:48:31.060451+0000","last_became_active":"2023-12-19T13:48:30.570999+0000","last_became_peered":"2023-12-19T13:48:30.570999+0000","last_unstale":"2023-12-19T13:48:31.060451+0000","last_undegraded":"2023-12-19T13:48:31.060451+0000","last_fullsized":"2023-12-19T13:48:31.060451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:30.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043661+0000","last_change":"2023-12-19T13:48:31.040521+0000","last_active":"2023-12-19T13:48:32.043661+0000","last_peered":"2023-12-19T13:48:32.043661+0000","last_clean":"2023-12-19T13:48:32.043661+0000","last_became_active":"2023-12-19T13:48:31.039864+0000","last_became_peered":"2023-12-19T13:48:31.039864+0000","last_unstale":"2023-12-19T13:48:32.043661+0000","last_undegraded":"2023-12-19T13:48:32.043661+0000","last_fullsized":"2023-12-19T13:48:32.043661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:55.364518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041698+0000","last_change":"2023-12-19T13:48:30.565828+0000","last_active":"2023-12-19T13:48:31.041698+0000","last_peered":"2023-12-19T13:48:31.041698+0000","last_clean":"2023-12-19T13:48:31.041698+0000","last_became_active":"2023-12-19T13:48:30.564126+0000","last_became_peered":"2023-12-19T13:48:30.564126+0000","last_unstale":"2023-12-19T13:48:31.041698+0000","last_undegraded":"2023-12-19T13:48:31.041698+0000","last_fullsized":"2023-12-19T13:48:31.041698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042739+0000","last_change":"2023-12-19T13:48:31.052967+0000","last_active":"2023-12-19T13:48:32.042739+0000","last_peered":"2023-12-19T13:48:32.042739+0000","last_clean":"2023-12-19T13:48:32.042739+0000","last_became_active":"2023-12-19T13:48:31.052503+0000","last_became_peered":"2023-12-19T13:48:31.052503+0000","last_unstale":"2023-12-19T13:48:32.042739+0000","last_undegraded":"2023-12-19T13:48:32.042739+0000","last_fullsized":"2023-12-19T13:48:32.042739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:55.457446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.048836+0000","last_change":"2023-12-19T13:48:30.573421+0000","last_active":"2023-12-19T13:48:31.048836+0000","last_peered":"2023-12-19T13:48:31.048836+0000","last_clean":"2023-12-19T13:48:31.048836+0000","last_became_active":"2023-12-19T13:48:30.573100+0000","last_became_peered":"2023-12-19T13:48:30.573100+0000","last_unstale":"2023-12-19T13:48:31.048836+0000","last_undegraded":"2023-12-19T13:48:31.048836+0000","last_fullsized":"2023-12-19T13:48:31.048836+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043185+0000","last_change":"2023-12-19T13:48:31.045582+0000","last_active":"2023-12-19T13:48:32.043185+0000","last_peered":"2023-12-19T13:48:32.043185+0000","last_clean":"2023-12-19T13:48:32.043185+0000","last_became_active":"2023-12-19T13:48:31.045022+0000","last_became_peered":"2023-12-19T13:48:31.045022+0000","last_unstale":"2023-12-19T13:48:32.043185+0000","last_undegraded":"2023-12-19T13:48:32.043185+0000","last_fullsized":"2023-12-19T13:48:32.043185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.062660+0000","last_change":"2023-12-19T13:48:30.567294+0000","last_active":"2023-12-19T13:48:31.062660+0000","last_peered":"2023-12-19T13:48:31.062660+0000","last_clean":"2023-12-19T13:48:31.062660+0000","last_became_active":"2023-12-19T13:48:30.566881+0000","last_became_peered":"2023-12-19T13:48:30.566881+0000","last_unstale":"2023-12-19T13:48:31.062660+0000","last_undegraded":"2023-12-19T13:48:31.062660+0000","last_fullsized":"2023-12-19T13:48:31.062660+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:38.580105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043887+0000","last_change":"2023-12-19T13:48:31.047150+0000","last_active":"2023-12-19T13:48:32.043887+0000","last_peered":"2023-12-19T13:48:32.043887+0000","last_clean":"2023-12-19T13:48:32.043887+0000","last_became_active":"2023-12-19T13:48:31.046514+0000","last_became_peered":"2023-12-19T13:48:31.046514+0000","last_unstale":"2023-12-19T13:48:32.043887+0000","last_undegraded":"2023-12-19T13:48:32.043887+0000","last_fullsized":"2023-12-19T13:48:32.043887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:00.081221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063327+0000","last_change":"2023-12-19T13:48:30.562754+0000","last_active":"2023-12-19T13:48:31.063327+0000","last_peered":"2023-12-19T13:48:31.063327+0000","last_clean":"2023-12-19T13:48:31.063327+0000","last_became_active":"2023-12-19T13:48:30.558728+0000","last_became_peered":"2023-12-19T13:48:30.558728+0000","last_unstale":"2023-12-19T13:48:31.063327+0000","last_undegraded":"2023-12-19T13:48:31.063327+0000","last_fullsized":"2023-12-19T13:48:31.063327+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042995+0000","last_change":"2023-12-19T13:48:31.056207+0000","last_active":"2023-12-19T13:48:32.042995+0000","last_peered":"2023-12-19T13:48:32.042995+0000","last_clean":"2023-12-19T13:48:32.042995+0000","last_became_active":"2023-12-19T13:48:31.055546+0000","last_became_peered":"2023-12-19T13:48:31.055546+0000","last_unstale":"2023-12-19T13:48:32.042995+0000","last_undegraded":"2023-12-19T13:48:32.042995+0000","last_fullsized":"2023-12-19T13:48:32.042995+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:08.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.048889+0000","last_change":"2023-12-19T13:48:30.569667+0000","last_active":"2023-12-19T13:48:31.048889+0000","last_peered":"2023-12-19T13:48:31.048889+0000","last_clean":"2023-12-19T13:48:31.048889+0000","last_became_active":"2023-12-19T13:48:30.569444+0000","last_became_peered":"2023-12-19T13:48:30.569444+0000","last_unstale":"2023-12-19T13:48:31.048889+0000","last_undegraded":"2023-12-19T13:48:31.048889+0000","last_fullsized":"2023-12-19T13:48:31.048889+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:59.915604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043389+0000","last_change":"2023-12-19T13:48:31.057340+0000","last_active":"2023-12-19T13:48:32.043389+0000","last_peered":"2023-12-19T13:48:32.043389+0000","last_clean":"2023-12-19T13:48:32.043389+0000","last_became_active":"2023-12-19T13:48:31.057076+0000","last_became_peered":"2023-12-19T13:48:31.057076+0000","last_unstale":"2023-12-19T13:48:32.043389+0000","last_undegraded":"2023-12-19T13:48:32.043389+0000","last_fullsized":"2023-12-19T13:48:32.043389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.052137+0000","last_change":"2023-12-19T13:48:30.562794+0000","last_active":"2023-12-19T13:48:31.052137+0000","last_peered":"2023-12-19T13:48:31.052137+0000","last_clean":"2023-12-19T13:48:31.052137+0000","last_became_active":"2023-12-19T13:48:30.562376+0000","last_became_peered":"2023-12-19T13:48:30.562376+0000","last_unstale":"2023-12-19T13:48:31.052137+0000","last_undegraded":"2023-12-19T13:48:31.052137+0000","last_fullsized":"2023-12-19T13:48:31.052137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292068+0000","last_change":"2023-12-19T13:48:31.052222+0000","last_active":"2023-12-19T13:48:32.292068+0000","last_peered":"2023-12-19T13:48:32.292068+0000","last_clean":"2023-12-19T13:48:32.292068+0000","last_became_active":"2023-12-19T13:48:31.051936+0000","last_became_peered":"2023-12-19T13:48:31.051936+0000","last_unstale":"2023-12-19T13:48:32.292068+0000","last_undegraded":"2023-12-19T13:48:32.292068+0000","last_fullsized":"2023-12-19T13:48:32.292068+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:08.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.049036+0000","last_change":"2023-12-19T13:48:30.573292+0000","last_active":"2023-12-19T13:48:31.049036+0000","last_peered":"2023-12-19T13:48:31.049036+0000","last_clean":"2023-12-19T13:48:31.049036+0000","last_became_active":"2023-12-19T13:48:30.572798+0000","last_became_peered":"2023-12-19T13:48:30.572798+0000","last_unstale":"2023-12-19T13:48:31.049036+0000","last_undegraded":"2023-12-19T13:48:31.049036+0000","last_fullsized":"2023-12-19T13:48:31.049036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293677+0000","last_change":"2023-12-19T13:48:31.066773+0000","last_active":"2023-12-19T13:48:32.293677+0000","last_peered":"2023-12-19T13:48:32.293677+0000","last_clean":"2023-12-19T13:48:32.293677+0000","last_became_active":"2023-12-19T13:48:31.066441+0000","last_became_peered":"2023-12-19T13:48:31.066441+0000","last_unstale":"2023-12-19T13:48:32.293677+0000","last_undegraded":"2023-12-19T13:48:32.293677+0000","last_fullsized":"2023-12-19T13:48:32.293677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:40:06.460024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063658+0000","last_change":"2023-12-19T13:48:30.556702+0000","last_active":"2023-12-19T13:48:31.063658+0000","last_peered":"2023-12-19T13:48:31.063658+0000","last_clean":"2023-12-19T13:48:31.063658+0000","last_became_active":"2023-12-19T13:48:30.555906+0000","last_became_peered":"2023-12-19T13:48:30.555906+0000","last_unstale":"2023-12-19T13:48:31.063658+0000","last_undegraded":"2023-12-19T13:48:31.063658+0000","last_fullsized":"2023-12-19T13:48:31.063658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:53.297196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292875+0000","last_change":"2023-12-19T13:48:31.058717+0000","last_active":"2023-12-19T13:48:32.292875+0000","last_peered":"2023-12-19T13:48:32.292875+0000","last_clean":"2023-12-19T13:48:32.292875+0000","last_became_active":"2023-12-19T13:48:31.057801+0000","last_became_peered":"2023-12-19T13:48:31.057801+0000","last_unstale":"2023-12-19T13:48:32.292875+0000","last_undegraded":"2023-12-19T13:48:32.292875+0000","last_fullsized":"2023-12-19T13:48:32.292875+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:34.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.040271+0000","last_change":"2023-12-19T13:48:30.573217+0000","last_active":"2023-12-19T13:48:31.040271+0000","last_peered":"2023-12-19T13:48:31.040271+0000","last_clean":"2023-12-19T13:48:31.040271+0000","last_became_active":"2023-12-19T13:48:30.572589+0000","last_became_peered":"2023-12-19T13:48:30.572589+0000","last_unstale":"2023-12-19T13:48:31.040271+0000","last_undegraded":"2023-12-19T13:48:31.040271+0000","last_fullsized":"2023-12-19T13:48:31.040271+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292869+0000","last_change":"2023-12-19T13:48:31.060286+0000","last_active":"2023-12-19T13:48:32.292869+0000","last_peered":"2023-12-19T13:48:32.292869+0000","last_clean":"2023-12-19T13:48:32.292869+0000","last_became_active":"2023-12-19T13:48:31.058371+0000","last_became_peered":"2023-12-19T13:48:31.058371+0000","last_unstale":"2023-12-19T13:48:32.292869+0000","last_undegraded":"2023-12-19T13:48:32.292869+0000","last_fullsized":"2023-12-19T13:48:32.292869+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:04.508581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.054826+0000","last_change":"2023-12-19T13:48:30.563907+0000","last_active":"2023-12-19T13:48:31.054826+0000","last_peered":"2023-12-19T13:48:31.054826+0000","last_clean":"2023-12-19T13:48:31.054826+0000","last_became_active":"2023-12-19T13:48:30.560821+0000","last_became_peered":"2023-12-19T13:48:30.560821+0000","last_unstale":"2023-12-19T13:48:31.054826+0000","last_undegraded":"2023-12-19T13:48:31.054826+0000","last_fullsized":"2023-12-19T13:48:31.054826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:34.650395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292888+0000","last_change":"2023-12-19T13:48:31.061838+0000","last_active":"2023-12-19T13:48:32.292888+0000","last_peered":"2023-12-19T13:48:32.292888+0000","last_clean":"2023-12-19T13:48:32.292888+0000","last_became_active":"2023-12-19T13:48:31.061595+0000","last_became_peered":"2023-12-19T13:48:31.061595+0000","last_unstale":"2023-12-19T13:48:32.292888+0000","last_undegraded":"2023-12-19T13:48:32.292888+0000","last_fullsized":"2023-12-19T13:48:32.292888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.030734+0000","last_change":"2023-12-19T13:48:30.567145+0000","last_active":"2023-12-19T13:48:31.030734+0000","last_peered":"2023-12-19T13:48:31.030734+0000","last_clean":"2023-12-19T13:48:31.030734+0000","last_became_active":"2023-12-19T13:48:30.566807+0000","last_became_peered":"2023-12-19T13:48:30.566807+0000","last_unstale":"2023-12-19T13:48:31.030734+0000","last_undegraded":"2023-12-19T13:48:31.030734+0000","last_fullsized":"2023-12-19T13:48:31.030734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:22.368082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042731+0000","last_change":"2023-12-19T13:48:31.058944+0000","last_active":"2023-12-19T13:48:32.042731+0000","last_peered":"2023-12-19T13:48:32.042731+0000","last_clean":"2023-12-19T13:48:32.042731+0000","last_became_active":"2023-12-19T13:48:31.058653+0000","last_became_peered":"2023-12-19T13:48:31.058653+0000","last_unstale":"2023-12-19T13:48:32.042731+0000","last_undegraded":"2023-12-19T13:48:32.042731+0000","last_fullsized":"2023-12-19T13:48:32.042731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:41.317283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053890+0000","last_change":"2023-12-19T13:48:30.565161+0000","last_active":"2023-12-19T13:48:31.053890+0000","last_peered":"2023-12-19T13:48:31.053890+0000","last_clean":"2023-12-19T13:48:31.053890+0000","last_became_active":"2023-12-19T13:48:30.564755+0000","last_became_peered":"2023-12-19T13:48:30.564755+0000","last_unstale":"2023-12-19T13:48:31.053890+0000","last_undegraded":"2023-12-19T13:48:31.053890+0000","last_fullsized":"2023-12-19T13:48:31.053890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.295219+0000","last_change":"2023-12-19T13:48:31.059990+0000","last_active":"2023-12-19T13:48:32.295219+0000","last_peered":"2023-12-19T13:48:32.295219+0000","last_clean":"2023-12-19T13:48:32.295219+0000","last_became_active":"2023-12-19T13:48:31.055899+0000","last_became_peered":"2023-12-19T13:48:31.055899+0000","last_unstale":"2023-12-19T13:48:32.295219+0000","last_undegraded":"2023-12-19T13:48:32.295219+0000","last_fullsized":"2023-12-19T13:48:32.295219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:19.784553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041605+0000","last_change":"2023-12-19T13:48:30.572933+0000","last_active":"2023-12-19T13:48:31.041605+0000","last_peered":"2023-12-19T13:48:31.041605+0000","last_clean":"2023-12-19T13:48:31.041605+0000","last_became_active":"2023-12-19T13:48:30.572148+0000","last_became_peered":"2023-12-19T13:48:30.572148+0000","last_unstale":"2023-12-19T13:48:31.041605+0000","last_undegraded":"2023-12-19T13:48:31.041605+0000","last_fullsized":"2023-12-19T13:48:31.041605+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042247+0000","last_change":"2023-12-19T13:48:31.057783+0000","last_active":"2023-12-19T13:48:32.042247+0000","last_peered":"2023-12-19T13:48:32.042247+0000","last_clean":"2023-12-19T13:48:32.042247+0000","last_became_active":"2023-12-19T13:48:31.057420+0000","last_became_peered":"2023-12-19T13:48:31.057420+0000","last_unstale":"2023-12-19T13:48:32.042247+0000","last_undegraded":"2023-12-19T13:48:32.042247+0000","last_fullsized":"2023-12-19T13:48:32.042247+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:06.958823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.037294+0000","last_change":"2023-12-19T13:48:30.571319+0000","last_active":"2023-12-19T13:48:31.037294+0000","last_peered":"2023-12-19T13:48:31.037294+0000","last_clean":"2023-12-19T13:48:31.037294+0000","last_became_active":"2023-12-19T13:48:30.570689+0000","last_became_peered":"2023-12-19T13:48:30.570689+0000","last_unstale":"2023-12-19T13:48:31.037294+0000","last_undegraded":"2023-12-19T13:48:31.037294+0000","last_fullsized":"2023-12-19T13:48:31.037294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293877+0000","last_change":"2023-12-19T13:48:31.059655+0000","last_active":"2023-12-19T13:48:32.293877+0000","last_peered":"2023-12-19T13:48:32.293877+0000","last_clean":"2023-12-19T13:48:32.293877+0000","last_became_active":"2023-12-19T13:48:31.059098+0000","last_became_peered":"2023-12-19T13:48:31.059098+0000","last_unstale":"2023-12-19T13:48:32.293877+0000","last_undegraded":"2023-12-19T13:48:32.293877+0000","last_fullsized":"2023-12-19T13:48:32.293877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:57.676040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041809+0000","last_change":"2023-12-19T13:48:30.571183+0000","last_active":"2023-12-19T13:48:31.041809+0000","last_peered":"2023-12-19T13:48:31.041809+0000","last_clean":"2023-12-19T13:48:31.041809+0000","last_became_active":"2023-12-19T13:48:30.569884+0000","last_became_peered":"2023-12-19T13:48:30.569884+0000","last_unstale":"2023-12-19T13:48:31.041809+0000","last_undegraded":"2023-12-19T13:48:31.041809+0000","last_fullsized":"2023-12-19T13:48:31.041809+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293038+0000","last_change":"2023-12-19T13:48:31.060149+0000","last_active":"2023-12-19T13:48:32.293038+0000","last_peered":"2023-12-19T13:48:32.293038+0000","last_clean":"2023-12-19T13:48:32.293038+0000","last_became_active":"2023-12-19T13:48:31.058109+0000","last_became_peered":"2023-12-19T13:48:31.058109+0000","last_unstale":"2023-12-19T13:48:32.293038+0000","last_undegraded":"2023-12-19T13:48:32.293038+0000","last_fullsized":"2023-12-19T13:48:32.293038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.032246+0000","last_change":"2023-12-19T13:48:30.565835+0000","last_active":"2023-12-19T13:48:31.032246+0000","last_peered":"2023-12-19T13:48:31.032246+0000","last_clean":"2023-12-19T13:48:31.032246+0000","last_became_active":"2023-12-19T13:48:30.565233+0000","last_became_peered":"2023-12-19T13:48:30.565233+0000","last_unstale":"2023-12-19T13:48:31.032246+0000","last_undegraded":"2023-12-19T13:48:31.032246+0000","last_fullsized":"2023-12-19T13:48:31.032246+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:14.229510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290563+0000","last_change":"2023-12-19T13:48:31.057778+0000","last_active":"2023-12-19T13:48:32.290563+0000","last_peered":"2023-12-19T13:48:32.290563+0000","last_clean":"2023-12-19T13:48:32.290563+0000","last_became_active":"2023-12-19T13:48:31.057560+0000","last_became_peered":"2023-12-19T13:48:31.057560+0000","last_unstale":"2023-12-19T13:48:32.290563+0000","last_undegraded":"2023-12-19T13:48:32.290563+0000","last_fullsized":"2023-12-19T13:48:32.290563+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:44.950912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.050189+0000","last_change":"2023-12-19T13:48:30.567267+0000","last_active":"2023-12-19T13:48:31.050189+0000","last_peered":"2023-12-19T13:48:31.050189+0000","last_clean":"2023-12-19T13:48:31.050189+0000","last_became_active":"2023-12-19T13:48:30.566724+0000","last_became_peered":"2023-12-19T13:48:30.566724+0000","last_unstale":"2023-12-19T13:48:31.050189+0000","last_undegraded":"2023-12-19T13:48:31.050189+0000","last_fullsized":"2023-12-19T13:48:31.050189+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042201+0000","last_change":"2023-12-19T13:48:31.040906+0000","last_active":"2023-12-19T13:48:32.042201+0000","last_peered":"2023-12-19T13:48:32.042201+0000","last_clean":"2023-12-19T13:48:32.042201+0000","last_became_active":"2023-12-19T13:48:31.039586+0000","last_became_peered":"2023-12-19T13:48:31.039586+0000","last_unstale":"2023-12-19T13:48:32.042201+0000","last_undegraded":"2023-12-19T13:48:32.042201+0000","last_fullsized":"2023-12-19T13:48:32.042201+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.034655+0000","last_change":"2023-12-19T13:48:30.565424+0000","last_active":"2023-12-19T13:48:31.034655+0000","last_peered":"2023-12-19T13:48:31.034655+0000","last_clean":"2023-12-19T13:48:31.034655+0000","last_became_active":"2023-12-19T13:48:30.564077+0000","last_became_peered":"2023-12-19T13:48:30.564077+0000","last_unstale":"2023-12-19T13:48:31.034655+0000","last_undegraded":"2023-12-19T13:48:31.034655+0000","last_fullsized":"2023-12-19T13:48:31.034655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293587+0000","last_change":"2023-12-19T13:48:31.060557+0000","last_active":"2023-12-19T13:48:32.293587+0000","last_peered":"2023-12-19T13:48:32.293587+0000","last_clean":"2023-12-19T13:48:32.293587+0000","last_became_active":"2023-12-19T13:48:31.057125+0000","last_became_peered":"2023-12-19T13:48:31.057125+0000","last_unstale":"2023-12-19T13:48:32.293587+0000","last_undegraded":"2023-12-19T13:48:32.293587+0000","last_fullsized":"2023-12-19T13:48:32.293587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:32.074797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053748+0000","last_change":"2023-12-19T13:48:30.570334+0000","last_active":"2023-12-19T13:48:31.053748+0000","last_peered":"2023-12-19T13:48:31.053748+0000","last_clean":"2023-12-19T13:48:31.053748+0000","last_became_active":"2023-12-19T13:48:30.570094+0000","last_became_peered":"2023-12-19T13:48:30.570094+0000","last_unstale":"2023-12-19T13:48:31.053748+0000","last_undegraded":"2023-12-19T13:48:31.053748+0000","last_fullsized":"2023-12-19T13:48:31.053748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:03.503460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.036018+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:48:31.036018+0000","last_peered":"2023-12-19T13:48:31.036018+0000","last_clean":"2023-12-19T13:48:31.036018+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:48:31.036018+0000","last_undegraded":"2023-12-19T13:48:31.036018+0000","last_fullsized":"2023-12-19T13:48:31.036018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.008,"15min":1},"min":{"1min":0.64200000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98699999999999999,"15min":0.97699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4339999999999999,"5min":2.008,"15min":2.008},"last":0.90200000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.077,"15min":1.069},"min":{"1min":0.73299999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6160000000000001,"5min":1.617,"15min":1.617},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4390000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.016}]},{"osd":2,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.1679999999999999,"15min":1.1459999999999999},"min":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.871,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.268}]},{"osd":3,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.1619999999999999,"15min":1.145},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.387,"5min":1.252,"15min":1.23},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.4690000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.298,"15min":1.292},"min":{"1min":0.90600000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6739999999999999,"5min":2.181,"15min":2.181},"last":1.232},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.415,"15min":1.407},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2109999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.52}]},{"osd":5,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.302},{"interface":"front","average":{"1min":1.504,"5min":1.4419999999999999,"15min":1.4319999999999999},"min":{"1min":1.0649999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.024,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.2749999999999999,"15min":1.256},"min":{"1min":0.79500000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.5029999999999999,"15min":1.4870000000000001},"min":{"1min":1.121,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.401}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0349999999999999,"15min":1.0249999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.679,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.325},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.113,"15min":1.129},"min":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6020000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.226}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.044,"15min":1.028},"min":{"1min":0.83499999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.962,"15min":1.962},"last":1.26},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.524,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2250000000000001,"15min":1.2150000000000001},"min":{"1min":0.86899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.798,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.151,"15min":1.1439999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.504,"5min":1.786,"15min":1.786},"last":1.5469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3620000000000001},"min":{"1min":0.90600000000000003,"5min":0.87,"15min":0.87},"max":{"1min":1.6910000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.415},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8799999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.099}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1970000000000001,"15min":1.194},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.282},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6499999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.623}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.236},"min":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.462},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.363,"15min":1.359},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7989999999999999,"5min":1.907,"15min":1.907},"last":1.498}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4059999999999999,"15min":1.4119999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.677},{"interface":"front","average":{"1min":1.363,"5min":1.347,"15min":1.345},"min":{"1min":0.65000000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.3700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.107},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.042,"15min":1.0580000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4359999999999999,"5min":1.516,"15min":1.516},"last":1.214}]},{"osd":1,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.099,"15min":1.099},"min":{"1min":0.70999999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5369999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.998,"15min":0.995},"min":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.278}]},{"osd":2,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2270000000000001,"15min":1.254},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5069999999999999,"5min":2.827,"15min":2.827},"last":1.327},{"interface":"front","average":{"1min":1.202,"5min":1.2629999999999999,"15min":1.2729999999999999},"min":{"1min":0.81599999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6160000000000001,"5min":2.863,"15min":2.863},"last":0.98799999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.246,"15min":1.242},"min":{"1min":0.97499999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5329999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.87}]},{"osd":4,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.141,"15min":1.133},"min":{"1min":0.79400000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.415},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.276,"15min":1.276},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.333,"15min":1.3129999999999999},"min":{"1min":1.089,"5min":0.623,"15min":0.623},"max":{"1min":1.772,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.3660000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3899999999999999,"15min":1.399},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7410000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.53},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.417,"15min":1.3999999999999999},"min":{"1min":1.244,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.825,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.4450000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.649},{"interface":"front","average":{"1min":1.089,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5149999999999999,"5min":2.016,"15min":2.016},"last":1.054}]},{"osd":1,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0629999999999999,"15min":1.0649999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4830000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.091,"5min":1.115,"15min":1.119},"min":{"1min":0.69699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.4039999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.1200000000000001,"15min":1.1080000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.222,"15min":1.2150000000000001},"min":{"1min":0.90800000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.74,"5min":1.952,"15min":1.952},"last":1.22},{"interface":"front","average":{"1min":1.218,"5min":1.27,"15min":1.278},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6739999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.363}]},{"osd":5,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.238,"15min":1.256},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.611,"5min":2.165,"15min":2.165},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8280000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.4930000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6379999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.466,"15min":1.4850000000000001},"min":{"1min":0.88600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.1339999999999999,"5min":2.335,"15min":2.335},"last":1.595}]},{"osd":7,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4690000000000001,"15min":1.4670000000000001},"min":{"1min":0.82499999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8340000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.518,"15min":1.528},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7529999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.452}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766692,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.94199999999999995,"15min":0.97199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.024,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4430000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.1080000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.014,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3300000000000001,"5min":2.387,"15min":2.387},"last":1.0489999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.5129999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.1359999999999999,"15min":1.1559999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8620000000000001,"5min":2.657,"15min":2.657},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5309999999999999,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.2230000000000001,"15min":1.2350000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.532,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.335}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3080000000000001,"15min":1.3240000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.546},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.88100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.4950000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.81899999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.899,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3460000000000001,"15min":1.357},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9730000000000001,"5min":2.698,"15min":2.698},"last":1.4570000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7649999999999999,"5min":3.609,"15min":3.609},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.89700000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.0910000000000002,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.276}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768166,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.083,"5min":2.258,"15min":2.258},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48799999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.587,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.262,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.9950000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1910000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.099,"15min":1.1060000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.3720000000000001,"5min":1.456,"15min":1.456},"last":1.127},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.84299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.635,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.1659999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.171,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.296,"15min":1.304},"min":{"1min":0.76700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8859999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4430000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2969999999999999,"15min":1.3129999999999999},"min":{"1min":0.754,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7470000000000001,"5min":2.964,"15min":2.964},"last":1.302},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.248,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.708,"5min":2.286,"15min":2.286},"last":1.4730000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.351,"15min":2.351},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.22,"15min":1.23},"min":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.96,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.5129999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177818,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2949999999999999,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.749}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.087,"15min":1.115},"min":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.466,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.006},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.179,"15min":1.196},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4139999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.3979999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6899999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.206},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3360000000000001,"5min":7.157,"15min":7.157},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.222,"15min":1.242},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.663,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2929999999999999,"15min":1.3080000000000001},"min":{"1min":0.82499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5940000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.355}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3240000000000001,"15min":1.347},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4550000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.748,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.234}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3500000000000001,"15min":1.3560000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7290000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.296},{"interface":"front","average":{"1min":1.232,"5min":1.4159999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.625,"5min":3.786,"15min":3.786},"last":1.036}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.446,"15min":1.47},"min":{"1min":0.86699999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.47,"15min":1.492},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.7490000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.1240000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2170000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89400000000000002,"15min":0.91400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.365,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85399999999999998,"15min":0.86299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.749},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84599999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.085,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.085,"15min":1.1080000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4690000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.84499999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.53,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.147},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1539999999999999,"15min":1.1559999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2709999999999999,"15min":1.292},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6299999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.1799999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.2310000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.244,"15min":1.2470000000000001},"min":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.94799999999999995}]},{"osd":7,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.115},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.367,"15min":1.3919999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6479999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":0.89100000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:48:40.841 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:48:41.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.062+0000 7f872771b640 1 Processor -- start 2023-12-19T13:48:41.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.062+0000 7f872771b640 1 -- start start 2023-12-19T13:48:41.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f872771b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f872006c6b0 0x7f8720166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f872771b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872006bb30 con 0x7f87200b0b50 2023-12-19T13:48:41.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f872771b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87200b0070 con 0x7f87201449e0 2023-12-19T13:48:41.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f872771b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200b0350 con 0x7f872006c6b0 2023-12-19T13:48:41.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f8725cb8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f872006c6b0 0x7f8720166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f8725cb8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f872006c6b0 0x7f8720166200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59526/0 (socket says 172.21.15.113:59526) 2023-12-19T13:48:41.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f8725cb8640 1 -- 172.21.15.113:0/3924955759 learned_addr learned my addr 172.21.15.113:0/3924955759 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:41.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.064+0000 7f8724cb6640 1 --1- 172.21.15.113:0/3924955759 >> v1:172.21.15.113:6789/0 conn(0x7f87200b0b50 0x7f872006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60846/0 (socket says 172.21.15.113:60846) 2023-12-19T13:48:41.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.065+0000 7f8725cb8640 1 -- 172.21.15.113:0/3924955759 >> v1:172.21.15.151:6789/0 conn(0x7f87201449e0 legacy=0x7f87200af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:41.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.065+0000 7f8725cb8640 1 -- 172.21.15.113:0/3924955759 >> v1:172.21.15.113:6789/0 conn(0x7f87200b0b50 legacy=0x7f872006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.065+0000 7f8725cb8640 1 -- 172.21.15.113:0/3924955759 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87200b0630 con 0x7f872006c6b0 2023-12-19T13:48:41.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.065+0000 7f8717fff640 1 -- 172.21.15.113:0/3924955759 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877326563 0 0) 0x7f872006bb30 con 0x7f87200b0b50 2023-12-19T13:48:41.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.066+0000 7f8725cb8640 1 --2- 172.21.15.113:0/3924955759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f872006c6b0 0x7f8720166200 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8718009e50 tx=0x7f871802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ede7e1d66e12cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:41.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.066+0000 7f8717fff640 1 -- 172.21.15.113:0/3924955759 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871802cb20 con 0x7f872006c6b0 2023-12-19T13:48:41.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.066+0000 7f8717fff640 1 -- 172.21.15.113:0/3924955759 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871802cc80 con 0x7f872006c6b0 2023-12-19T13:48:41.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.066+0000 7f8717fff640 1 -- 172.21.15.113:0/3924955759 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180343f0 con 0x7f872006c6b0 2023-12-19T13:48:41.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.066+0000 7f872771b640 1 -- 172.21.15.113:0/3924955759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f872006c6b0 msgr2=0x7f8720166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.067+0000 7f872771b640 1 --2- 172.21.15.113:0/3924955759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f872006c6b0 0x7f8720166200 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8718009e50 tx=0x7f871802bf80 comp rx=0 tx=0).stop 2023-12-19T13:48:41.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.067+0000 7f872771b640 1 -- 172.21.15.113:0/3924955759 shutdown_connections 2023-12-19T13:48:41.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.067+0000 7f872771b640 1 --2- 172.21.15.113:0/3924955759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f872006c6b0 0x7f8720166200 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.067+0000 7f872771b640 1 -- 172.21.15.113:0/3924955759 >> 172.21.15.113:0/3924955759 conn(0x7f87200cbb70 msgr2=0x7f87200cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:41.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.067+0000 7f872771b640 1 -- 172.21.15.113:0/3924955759 shutdown_connections 2023-12-19T13:48:41.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.067+0000 7f872771b640 1 -- 172.21.15.113:0/3924955759 wait complete. 2023-12-19T13:48:41.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.068+0000 7f872771b640 1 Processor -- start 2023-12-19T13:48:41.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.069+0000 7f872771b640 1 -- start start 2023-12-19T13:48:41.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.069+0000 7f872771b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006c6b0 0x7f872013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.069+0000 7f872771b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87200b0b50 0x7f872015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.069+0000 7f872771b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87201449e0 0x7f872015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.069+0000 7f872771b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872013ca20 con 0x7f87200b0b50 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.069+0000 7f872771b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872013ccc0 con 0x7f872006c6b0 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.069+0000 7f872771b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872013cfa0 con 0x7f87201449e0 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87200b0b50 0x7f872015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87200b0b50 0x7f872015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59528/0 (socket says 172.21.15.113:59528) 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 -- 172.21.15.113:0/1173312810 learned_addr learned my addr 172.21.15.113:0/1173312810 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8725cb8640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87201449e0 0x7f872015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f87254b7640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006c6b0 0x7f872013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 -- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87201449e0 msgr2=0x7f872015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87201449e0 0x7f872015c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 -- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006c6b0 msgr2=0x7f872013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006c6b0 0x7f872013ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 -- 172.21.15.113:0/1173312810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718009b30 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.070+0000 7f8724cb6640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87200b0b50 0x7f872015ad90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f871000c4d0 tx=0x7f871000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.071+0000 7f8715ffb640 1 -- 172.21.15.113:0/1173312810 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100074e0 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.071+0000 7f8715ffb640 1 -- 172.21.15.113:0/1173312810 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710007660 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.071+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872013d280 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.071+0000 7f8715ffb640 1 -- 172.21.15.113:0/1173312810 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710004a20 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.071+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872015b2d0 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.072+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872013d4c0 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.073+0000 7f8715ffb640 1 -- 172.21.15.113:0/1173312810 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8710004b80 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.075+0000 7f8715ffb640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f870406a460 0x7f870406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.075+0000 7f8715ffb640 1 -- 172.21.15.113:0/1173312810 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8710087ef0 con 0x7f87200b0b50 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.075+0000 7f87254b7640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f870406a460 0x7f870406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.076+0000 7f87254b7640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f870406a460 0x7f870406c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f871c00a750 tx=0x7f871c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.080+0000 7f8715ffb640 1 -- 172.21.15.113:0/1173312810 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f872013d4c0 con 0x7f87200b0b50 2023-12-19T13:48:41.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.264+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f872013ce30 con 0x7f870406a460 2023-12-19T13:48:41.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.276+0000 7f8715ffb640 1 -- 172.21.15.113:0/1173312810 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282467 (secure 0 0 0) 0x7f872013ce30 con 0x7f870406a460 2023-12-19T13:48:41.280 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:41.282 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:48:41.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f870406a460 msgr2=0x7f870406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f870406a460 0x7f870406c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f871c00a750 tx=0x7f871c008040 comp rx=0 tx=0).stop 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87200b0b50 msgr2=0x7f872015ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87200b0b50 0x7f872015ad90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f871000c4d0 tx=0x7f871000c990 comp rx=0 tx=0).stop 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 shutdown_connections 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f870406a460 0x7f870406c920 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87201449e0 0x7f872015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87200b0b50 0x7f872015ad90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 --2- 172.21.15.113:0/1173312810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006c6b0 0x7f872013ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 >> 172.21.15.113:0/1173312810 conn(0x7f87200cbb70 msgr2=0x7f872006bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 shutdown_connections 2023-12-19T13:48:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.283+0000 7f872771b640 1 -- 172.21.15.113:0/1173312810 wait complete. 2023-12-19T13:48:41.302 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-12-19T13:48:40.449066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559531,"statfs":{"total":1600000000,"available":1596960588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.418421"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291950+0000","last_change":"2023-12-19T13:48:31.044642+0000","last_active":"2023-12-19T13:48:32.291950+0000","last_peered":"2023-12-19T13:48:32.291950+0000","last_clean":"2023-12-19T13:48:32.291950+0000","last_became_active":"2023-12-19T13:48:31.044404+0000","last_became_peered":"2023-12-19T13:48:31.044404+0000","last_unstale":"2023-12-19T13:48:32.291950+0000","last_undegraded":"2023-12-19T13:48:32.291950+0000","last_fullsized":"2023-12-19T13:48:32.291950+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042500+0000","last_change":"2023-12-19T13:48:31.051159+0000","last_active":"2023-12-19T13:48:32.042500+0000","last_peered":"2023-12-19T13:48:32.042500+0000","last_clean":"2023-12-19T13:48:32.042500+0000","last_became_active":"2023-12-19T13:48:31.051029+0000","last_became_peered":"2023-12-19T13:48:31.051029+0000","last_unstale":"2023-12-19T13:48:32.042500+0000","last_undegraded":"2023-12-19T13:48:32.042500+0000","last_fullsized":"2023-12-19T13:48:32.042500+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290704+0000","last_change":"2023-12-19T13:48:31.048954+0000","last_active":"2023-12-19T13:48:32.290704+0000","last_peered":"2023-12-19T13:48:32.290704+0000","last_clean":"2023-12-19T13:48:32.290704+0000","last_became_active":"2023-12-19T13:48:31.048739+0000","last_became_peered":"2023-12-19T13:48:31.048739+0000","last_unstale":"2023-12-19T13:48:32.290704+0000","last_undegraded":"2023-12-19T13:48:32.290704+0000","last_fullsized":"2023-12-19T13:48:32.290704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:55.364518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291898+0000","last_change":"2023-12-19T13:48:31.057026+0000","last_active":"2023-12-19T13:48:32.291898+0000","last_peered":"2023-12-19T13:48:32.291898+0000","last_clean":"2023-12-19T13:48:32.291898+0000","last_became_active":"2023-12-19T13:48:31.056603+0000","last_became_peered":"2023-12-19T13:48:31.056603+0000","last_unstale":"2023-12-19T13:48:32.291898+0000","last_undegraded":"2023-12-19T13:48:32.291898+0000","last_fullsized":"2023-12-19T13:48:32.291898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:47.540113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292168+0000","last_change":"2023-12-19T13:48:31.063988+0000","last_active":"2023-12-19T13:48:32.292168+0000","last_peered":"2023-12-19T13:48:32.292168+0000","last_clean":"2023-12-19T13:48:32.292168+0000","last_became_active":"2023-12-19T13:48:31.063771+0000","last_became_peered":"2023-12-19T13:48:31.063771+0000","last_unstale":"2023-12-19T13:48:32.292168+0000","last_undegraded":"2023-12-19T13:48:32.292168+0000","last_fullsized":"2023-12-19T13:48:32.292168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292305+0000","last_change":"2023-12-19T13:48:31.064483+0000","last_active":"2023-12-19T13:48:32.292305+0000","last_peered":"2023-12-19T13:48:32.292305+0000","last_clean":"2023-12-19T13:48:32.292305+0000","last_became_active":"2023-12-19T13:48:31.064224+0000","last_became_peered":"2023-12-19T13:48:31.064224+0000","last_unstale":"2023-12-19T13:48:32.292305+0000","last_undegraded":"2023-12-19T13:48:32.292305+0000","last_fullsized":"2023-12-19T13:48:32.292305+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042523+0000","last_change":"2023-12-19T13:48:31.054245+0000","last_active":"2023-12-19T13:48:32.042523+0000","last_peered":"2023-12-19T13:48:32.042523+0000","last_clean":"2023-12-19T13:48:32.042523+0000","last_became_active":"2023-12-19T13:48:31.053974+0000","last_became_peered":"2023-12-19T13:48:31.053974+0000","last_unstale":"2023-12-19T13:48:32.042523+0000","last_undegraded":"2023-12-19T13:48:32.042523+0000","last_fullsized":"2023-12-19T13:48:32.042523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:44.149292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293318+0000","last_change":"2023-12-19T13:48:31.060864+0000","last_active":"2023-12-19T13:48:32.293318+0000","last_peered":"2023-12-19T13:48:32.293318+0000","last_clean":"2023-12-19T13:48:32.293318+0000","last_became_active":"2023-12-19T13:48:31.057459+0000","last_became_peered":"2023-12-19T13:48:31.057459+0000","last_unstale":"2023-12-19T13:48:32.293318+0000","last_undegraded":"2023-12-19T13:48:32.293318+0000","last_fullsized":"2023-12-19T13:48:32.293318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:39.585226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291888+0000","last_change":"2023-12-19T13:48:31.066252+0000","last_active":"2023-12-19T13:48:32.291888+0000","last_peered":"2023-12-19T13:48:32.291888+0000","last_clean":"2023-12-19T13:48:32.291888+0000","last_became_active":"2023-12-19T13:48:31.064257+0000","last_became_peered":"2023-12-19T13:48:31.064257+0000","last_unstale":"2023-12-19T13:48:32.291888+0000","last_undegraded":"2023-12-19T13:48:32.291888+0000","last_fullsized":"2023-12-19T13:48:32.291888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:12.317229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.294770+0000","last_change":"2023-12-19T13:48:31.062233+0000","last_active":"2023-12-19T13:48:32.294770+0000","last_peered":"2023-12-19T13:48:32.294770+0000","last_clean":"2023-12-19T13:48:32.294770+0000","last_became_active":"2023-12-19T13:48:31.059606+0000","last_became_peered":"2023-12-19T13:48:31.059606+0000","last_unstale":"2023-12-19T13:48:32.294770+0000","last_undegraded":"2023-12-19T13:48:32.294770+0000","last_fullsized":"2023-12-19T13:48:32.294770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:01.890904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292230+0000","last_change":"2023-12-19T13:48:31.066122+0000","last_active":"2023-12-19T13:48:32.292230+0000","last_peered":"2023-12-19T13:48:32.292230+0000","last_clean":"2023-12-19T13:48:32.292230+0000","last_became_active":"2023-12-19T13:48:31.065042+0000","last_became_peered":"2023-12-19T13:48:31.065042+0000","last_unstale":"2023-12-19T13:48:32.292230+0000","last_undegraded":"2023-12-19T13:48:32.292230+0000","last_fullsized":"2023-12-19T13:48:32.292230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:05.367712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042744+0000","last_change":"2023-12-19T13:48:31.041244+0000","last_active":"2023-12-19T13:48:32.042744+0000","last_peered":"2023-12-19T13:48:32.042744+0000","last_clean":"2023-12-19T13:48:32.042744+0000","last_became_active":"2023-12-19T13:48:31.041036+0000","last_became_peered":"2023-12-19T13:48:31.041036+0000","last_unstale":"2023-12-19T13:48:32.042744+0000","last_undegraded":"2023-12-19T13:48:32.042744+0000","last_fullsized":"2023-12-19T13:48:32.042744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:34.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292651+0000","last_change":"2023-12-19T13:48:31.062333+0000","last_active":"2023-12-19T13:48:32.292651+0000","last_peered":"2023-12-19T13:48:32.292651+0000","last_clean":"2023-12-19T13:48:32.292651+0000","last_became_active":"2023-12-19T13:48:31.062119+0000","last_became_peered":"2023-12-19T13:48:31.062119+0000","last_unstale":"2023-12-19T13:48:32.292651+0000","last_undegraded":"2023-12-19T13:48:32.292651+0000","last_fullsized":"2023-12-19T13:48:32.292651+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292881+0000","last_change":"2023-12-19T13:48:31.063490+0000","last_active":"2023-12-19T13:48:32.292881+0000","last_peered":"2023-12-19T13:48:32.292881+0000","last_clean":"2023-12-19T13:48:32.292881+0000","last_became_active":"2023-12-19T13:48:31.062321+0000","last_became_peered":"2023-12-19T13:48:31.062321+0000","last_unstale":"2023-12-19T13:48:32.292881+0000","last_undegraded":"2023-12-19T13:48:32.292881+0000","last_fullsized":"2023-12-19T13:48:32.292881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:23.373203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292561+0000","last_change":"2023-12-19T13:48:31.060376+0000","last_active":"2023-12-19T13:48:32.292561+0000","last_peered":"2023-12-19T13:48:32.292561+0000","last_clean":"2023-12-19T13:48:32.292561+0000","last_became_active":"2023-12-19T13:48:31.055583+0000","last_became_peered":"2023-12-19T13:48:31.055583+0000","last_unstale":"2023-12-19T13:48:32.292561+0000","last_undegraded":"2023-12-19T13:48:32.292561+0000","last_fullsized":"2023-12-19T13:48:32.292561+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:14:22.998770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292340+0000","last_change":"2023-12-19T13:48:31.060807+0000","last_active":"2023-12-19T13:48:32.292340+0000","last_peered":"2023-12-19T13:48:32.292340+0000","last_clean":"2023-12-19T13:48:32.292340+0000","last_became_active":"2023-12-19T13:48:31.060563+0000","last_became_peered":"2023-12-19T13:48:31.060563+0000","last_unstale":"2023-12-19T13:48:32.292340+0000","last_undegraded":"2023-12-19T13:48:32.292340+0000","last_fullsized":"2023-12-19T13:48:32.292340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:16.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042986+0000","last_change":"2023-12-19T13:48:31.046263+0000","last_active":"2023-12-19T13:48:32.042986+0000","last_peered":"2023-12-19T13:48:32.042986+0000","last_clean":"2023-12-19T13:48:32.042986+0000","last_became_active":"2023-12-19T13:48:31.045298+0000","last_became_peered":"2023-12-19T13:48:31.045298+0000","last_unstale":"2023-12-19T13:48:32.042986+0000","last_undegraded":"2023-12-19T13:48:32.042986+0000","last_fullsized":"2023-12-19T13:48:32.042986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:35.655516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290931+0000","last_change":"2023-12-19T13:48:31.062078+0000","last_active":"2023-12-19T13:48:32.290931+0000","last_peered":"2023-12-19T13:48:32.290931+0000","last_clean":"2023-12-19T13:48:32.290931+0000","last_became_active":"2023-12-19T13:48:31.061681+0000","last_became_peered":"2023-12-19T13:48:31.061681+0000","last_unstale":"2023-12-19T13:48:32.290931+0000","last_undegraded":"2023-12-19T13:48:32.290931+0000","last_fullsized":"2023-12-19T13:48:32.290931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:47.949416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291001+0000","last_change":"2023-12-19T13:48:31.064382+0000","last_active":"2023-12-19T13:48:32.291001+0000","last_peered":"2023-12-19T13:48:32.291001+0000","last_clean":"2023-12-19T13:48:32.291001+0000","last_became_active":"2023-12-19T13:48:31.064164+0000","last_became_peered":"2023-12-19T13:48:31.064164+0000","last_unstale":"2023-12-19T13:48:32.291001+0000","last_undegraded":"2023-12-19T13:48:32.291001+0000","last_fullsized":"2023-12-19T13:48:32.291001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.295433+0000","last_change":"2023-12-19T13:48:31.062892+0000","last_active":"2023-12-19T13:48:32.295433+0000","last_peered":"2023-12-19T13:48:32.295433+0000","last_clean":"2023-12-19T13:48:32.295433+0000","last_became_active":"2023-12-19T13:48:31.060518+0000","last_became_peered":"2023-12-19T13:48:31.060518+0000","last_unstale":"2023-12-19T13:48:32.295433+0000","last_undegraded":"2023-12-19T13:48:32.295433+0000","last_fullsized":"2023-12-19T13:48:32.295433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:23.369417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292587+0000","last_change":"2023-12-19T13:48:31.061636+0000","last_active":"2023-12-19T13:48:32.292587+0000","last_peered":"2023-12-19T13:48:32.292587+0000","last_clean":"2023-12-19T13:48:32.292587+0000","last_became_active":"2023-12-19T13:48:31.058665+0000","last_became_peered":"2023-12-19T13:48:31.058665+0000","last_unstale":"2023-12-19T13:48:32.292587+0000","last_undegraded":"2023-12-19T13:48:32.292587+0000","last_fullsized":"2023-12-19T13:48:32.292587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:15.234631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043320+0000","last_change":"2023-12-19T13:48:31.040705+0000","last_active":"2023-12-19T13:48:32.043320+0000","last_peered":"2023-12-19T13:48:32.043320+0000","last_clean":"2023-12-19T13:48:32.043320+0000","last_became_active":"2023-12-19T13:48:31.039983+0000","last_became_peered":"2023-12-19T13:48:31.039983+0000","last_unstale":"2023-12-19T13:48:32.043320+0000","last_undegraded":"2023-12-19T13:48:32.043320+0000","last_fullsized":"2023-12-19T13:48:32.043320+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:29.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042513+0000","last_change":"2023-12-19T13:48:31.044408+0000","last_active":"2023-12-19T13:48:32.042513+0000","last_peered":"2023-12-19T13:48:32.042513+0000","last_clean":"2023-12-19T13:48:32.042513+0000","last_became_active":"2023-12-19T13:48:31.044036+0000","last_became_peered":"2023-12-19T13:48:31.044036+0000","last_unstale":"2023-12-19T13:48:32.042513+0000","last_undegraded":"2023-12-19T13:48:32.042513+0000","last_fullsized":"2023-12-19T13:48:32.042513+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.871928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042205+0000","last_change":"2023-12-19T13:48:31.058117+0000","last_active":"2023-12-19T13:48:32.042205+0000","last_peered":"2023-12-19T13:48:32.042205+0000","last_clean":"2023-12-19T13:48:32.042205+0000","last_became_active":"2023-12-19T13:48:31.057815+0000","last_became_peered":"2023-12-19T13:48:31.057815+0000","last_unstale":"2023-12-19T13:48:32.042205+0000","last_undegraded":"2023-12-19T13:48:32.042205+0000","last_fullsized":"2023-12-19T13:48:32.042205+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:39.585226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292374+0000","last_change":"2023-12-19T13:48:31.045414+0000","last_active":"2023-12-19T13:48:32.292374+0000","last_peered":"2023-12-19T13:48:32.292374+0000","last_clean":"2023-12-19T13:48:32.292374+0000","last_became_active":"2023-12-19T13:48:31.045218+0000","last_became_peered":"2023-12-19T13:48:31.045218+0000","last_unstale":"2023-12-19T13:48:32.292374+0000","last_undegraded":"2023-12-19T13:48:32.292374+0000","last_fullsized":"2023-12-19T13:48:32.292374+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292399+0000","last_change":"2023-12-19T13:48:31.065352+0000","last_active":"2023-12-19T13:48:32.292399+0000","last_peered":"2023-12-19T13:48:32.292399+0000","last_clean":"2023-12-19T13:48:32.292399+0000","last_became_active":"2023-12-19T13:48:31.064726+0000","last_became_peered":"2023-12-19T13:48:31.064726+0000","last_unstale":"2023-12-19T13:48:32.292399+0000","last_undegraded":"2023-12-19T13:48:32.292399+0000","last_fullsized":"2023-12-19T13:48:32.292399+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:48.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042631+0000","last_change":"2023-12-19T13:48:31.039929+0000","last_active":"2023-12-19T13:48:32.042631+0000","last_peered":"2023-12-19T13:48:32.042631+0000","last_clean":"2023-12-19T13:48:32.042631+0000","last_became_active":"2023-12-19T13:48:31.039057+0000","last_became_peered":"2023-12-19T13:48:31.039057+0000","last_unstale":"2023-12-19T13:48:32.042631+0000","last_undegraded":"2023-12-19T13:48:32.042631+0000","last_fullsized":"2023-12-19T13:48:32.042631+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:41:17.848618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042615+0000","last_change":"2023-12-19T13:48:31.035261+0000","last_active":"2023-12-19T13:48:32.042615+0000","last_peered":"2023-12-19T13:48:32.042615+0000","last_clean":"2023-12-19T13:48:32.042615+0000","last_became_active":"2023-12-19T13:48:31.035036+0000","last_became_peered":"2023-12-19T13:48:31.035036+0000","last_unstale":"2023-12-19T13:48:32.042615+0000","last_undegraded":"2023-12-19T13:48:32.042615+0000","last_fullsized":"2023-12-19T13:48:32.042615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:53.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290363+0000","last_change":"2023-12-19T13:48:31.050415+0000","last_active":"2023-12-19T13:48:32.290363+0000","last_peered":"2023-12-19T13:48:32.290363+0000","last_clean":"2023-12-19T13:48:32.290363+0000","last_became_active":"2023-12-19T13:48:31.050284+0000","last_became_peered":"2023-12-19T13:48:31.050284+0000","last_unstale":"2023-12-19T13:48:32.290363+0000","last_undegraded":"2023-12-19T13:48:32.290363+0000","last_fullsized":"2023-12-19T13:48:32.290363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:35.655516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043895+0000","last_change":"2023-12-19T13:48:31.036365+0000","last_active":"2023-12-19T13:48:32.043895+0000","last_peered":"2023-12-19T13:48:32.043895+0000","last_clean":"2023-12-19T13:48:32.043895+0000","last_became_active":"2023-12-19T13:48:31.036157+0000","last_became_peered":"2023-12-19T13:48:31.036157+0000","last_unstale":"2023-12-19T13:48:32.043895+0000","last_undegraded":"2023-12-19T13:48:32.043895+0000","last_fullsized":"2023-12-19T13:48:32.043895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:50.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292586+0000","last_change":"2023-12-19T13:48:31.059900+0000","last_active":"2023-12-19T13:48:32.292586+0000","last_peered":"2023-12-19T13:48:32.292586+0000","last_clean":"2023-12-19T13:48:32.292586+0000","last_became_active":"2023-12-19T13:48:31.059662+0000","last_became_peered":"2023-12-19T13:48:31.059662+0000","last_unstale":"2023-12-19T13:48:32.292586+0000","last_undegraded":"2023-12-19T13:48:32.292586+0000","last_fullsized":"2023-12-19T13:48:32.292586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:33.366100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292352+0000","last_change":"2023-12-19T13:48:31.056145+0000","last_active":"2023-12-19T13:48:32.292352+0000","last_peered":"2023-12-19T13:48:32.292352+0000","last_clean":"2023-12-19T13:48:32.292352+0000","last_became_active":"2023-12-19T13:48:31.053672+0000","last_became_peered":"2023-12-19T13:48:31.053672+0000","last_unstale":"2023-12-19T13:48:32.292352+0000","last_undegraded":"2023-12-19T13:48:32.292352+0000","last_fullsized":"2023-12-19T13:48:32.292352+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042737+0000","last_change":"2023-12-19T13:48:31.051669+0000","last_active":"2023-12-19T13:48:32.042737+0000","last_peered":"2023-12-19T13:48:32.042737+0000","last_clean":"2023-12-19T13:48:32.042737+0000","last_became_active":"2023-12-19T13:48:31.051139+0000","last_became_peered":"2023-12-19T13:48:31.051139+0000","last_unstale":"2023-12-19T13:48:32.042737+0000","last_undegraded":"2023-12-19T13:48:32.042737+0000","last_fullsized":"2023-12-19T13:48:32.042737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:31.393201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.066366+0000","last_change":"2023-12-19T13:48:30.569175+0000","last_active":"2023-12-19T13:48:31.066366+0000","last_peered":"2023-12-19T13:48:31.066366+0000","last_clean":"2023-12-19T13:48:31.066366+0000","last_became_active":"2023-12-19T13:48:30.567045+0000","last_became_peered":"2023-12-19T13:48:30.567045+0000","last_unstale":"2023-12-19T13:48:31.066366+0000","last_undegraded":"2023-12-19T13:48:31.066366+0000","last_fullsized":"2023-12-19T13:48:31.066366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291255+0000","last_change":"2023-12-19T13:48:31.064482+0000","last_active":"2023-12-19T13:48:32.291255+0000","last_peered":"2023-12-19T13:48:32.291255+0000","last_clean":"2023-12-19T13:48:32.291255+0000","last_became_active":"2023-12-19T13:48:31.063591+0000","last_became_peered":"2023-12-19T13:48:31.063591+0000","last_unstale":"2023-12-19T13:48:32.291255+0000","last_undegraded":"2023-12-19T13:48:32.291255+0000","last_fullsized":"2023-12-19T13:48:32.291255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.045006+0000","last_change":"2023-12-19T13:48:30.563689+0000","last_active":"2023-12-19T13:48:31.045006+0000","last_peered":"2023-12-19T13:48:31.045006+0000","last_clean":"2023-12-19T13:48:31.045006+0000","last_became_active":"2023-12-19T13:48:30.562331+0000","last_became_peered":"2023-12-19T13:48:30.562331+0000","last_unstale":"2023-12-19T13:48:31.045006+0000","last_undegraded":"2023-12-19T13:48:31.045006+0000","last_fullsized":"2023-12-19T13:48:31.045006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043182+0000","last_change":"2023-12-19T13:48:31.038378+0000","last_active":"2023-12-19T13:48:32.043182+0000","last_peered":"2023-12-19T13:48:32.043182+0000","last_clean":"2023-12-19T13:48:32.043182+0000","last_became_active":"2023-12-19T13:48:31.038172+0000","last_became_peered":"2023-12-19T13:48:31.038172+0000","last_unstale":"2023-12-19T13:48:32.043182+0000","last_undegraded":"2023-12-19T13:48:32.043182+0000","last_fullsized":"2023-12-19T13:48:32.043182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:16.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063973+0000","last_change":"2023-12-19T13:48:30.570820+0000","last_active":"2023-12-19T13:48:31.063973+0000","last_peered":"2023-12-19T13:48:31.063973+0000","last_clean":"2023-12-19T13:48:31.063973+0000","last_became_active":"2023-12-19T13:48:30.570263+0000","last_became_peered":"2023-12-19T13:48:30.570263+0000","last_unstale":"2023-12-19T13:48:31.063973+0000","last_undegraded":"2023-12-19T13:48:31.063973+0000","last_fullsized":"2023-12-19T13:48:31.063973+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292733+0000","last_change":"2023-12-19T13:48:31.055844+0000","last_active":"2023-12-19T13:48:32.292733+0000","last_peered":"2023-12-19T13:48:32.292733+0000","last_clean":"2023-12-19T13:48:32.292733+0000","last_became_active":"2023-12-19T13:48:31.055269+0000","last_became_peered":"2023-12-19T13:48:31.055269+0000","last_unstale":"2023-12-19T13:48:32.292733+0000","last_undegraded":"2023-12-19T13:48:32.292733+0000","last_fullsized":"2023-12-19T13:48:32.292733+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:53.451620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.046197+0000","last_change":"2023-12-19T13:48:30.563559+0000","last_active":"2023-12-19T13:48:31.046197+0000","last_peered":"2023-12-19T13:48:31.046197+0000","last_clean":"2023-12-19T13:48:31.046197+0000","last_became_active":"2023-12-19T13:48:30.563220+0000","last_became_peered":"2023-12-19T13:48:30.563220+0000","last_unstale":"2023-12-19T13:48:31.046197+0000","last_undegraded":"2023-12-19T13:48:31.046197+0000","last_fullsized":"2023-12-19T13:48:31.046197+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:47.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042698+0000","last_change":"2023-12-19T13:48:31.039253+0000","last_active":"2023-12-19T13:48:32.042698+0000","last_peered":"2023-12-19T13:48:32.042698+0000","last_clean":"2023-12-19T13:48:32.042698+0000","last_became_active":"2023-12-19T13:48:31.039027+0000","last_became_peered":"2023-12-19T13:48:31.039027+0000","last_unstale":"2023-12-19T13:48:32.042698+0000","last_undegraded":"2023-12-19T13:48:32.042698+0000","last_fullsized":"2023-12-19T13:48:32.042698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:03:27.377713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.062942+0000","last_change":"2023-12-19T13:48:30.571536+0000","last_active":"2023-12-19T13:48:31.062942+0000","last_peered":"2023-12-19T13:48:31.062942+0000","last_clean":"2023-12-19T13:48:31.062942+0000","last_became_active":"2023-12-19T13:48:30.571266+0000","last_became_peered":"2023-12-19T13:48:30.571266+0000","last_unstale":"2023-12-19T13:48:31.062942+0000","last_undegraded":"2023-12-19T13:48:31.062942+0000","last_fullsized":"2023-12-19T13:48:31.062942+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293400+0000","last_change":"2023-12-19T13:48:31.059349+0000","last_active":"2023-12-19T13:48:32.293400+0000","last_peered":"2023-12-19T13:48:32.293400+0000","last_clean":"2023-12-19T13:48:32.293400+0000","last_became_active":"2023-12-19T13:48:31.058702+0000","last_became_peered":"2023-12-19T13:48:31.058702+0000","last_unstale":"2023-12-19T13:48:32.293400+0000","last_undegraded":"2023-12-19T13:48:32.293400+0000","last_fullsized":"2023-12-19T13:48:32.293400+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:52.208906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.044227+0000","last_change":"2023-12-19T13:48:30.561942+0000","last_active":"2023-12-19T13:48:31.044227+0000","last_peered":"2023-12-19T13:48:31.044227+0000","last_clean":"2023-12-19T13:48:31.044227+0000","last_became_active":"2023-12-19T13:48:30.559026+0000","last_became_peered":"2023-12-19T13:48:30.559026+0000","last_unstale":"2023-12-19T13:48:31.044227+0000","last_undegraded":"2023-12-19T13:48:31.044227+0000","last_fullsized":"2023-12-19T13:48:31.044227+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.294999+0000","last_change":"2023-12-19T13:48:31.060791+0000","last_active":"2023-12-19T13:48:32.294999+0000","last_peered":"2023-12-19T13:48:32.294999+0000","last_clean":"2023-12-19T13:48:32.294999+0000","last_became_active":"2023-12-19T13:48:31.056175+0000","last_became_peered":"2023-12-19T13:48:31.056175+0000","last_unstale":"2023-12-19T13:48:32.294999+0000","last_undegraded":"2023-12-19T13:48:32.294999+0000","last_fullsized":"2023-12-19T13:48:32.294999+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:04.955458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.040148+0000","last_change":"2023-12-19T13:48:30.569040+0000","last_active":"2023-12-19T13:48:31.040148+0000","last_peered":"2023-12-19T13:48:31.040148+0000","last_clean":"2023-12-19T13:48:31.040148+0000","last_became_active":"2023-12-19T13:48:30.568735+0000","last_became_peered":"2023-12-19T13:48:30.568735+0000","last_unstale":"2023-12-19T13:48:31.040148+0000","last_undegraded":"2023-12-19T13:48:31.040148+0000","last_fullsized":"2023-12-19T13:48:31.040148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:08.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042154+0000","last_change":"2023-12-19T13:48:31.064711+0000","last_active":"2023-12-19T13:48:32.042154+0000","last_peered":"2023-12-19T13:48:32.042154+0000","last_clean":"2023-12-19T13:48:32.042154+0000","last_became_active":"2023-12-19T13:48:31.064494+0000","last_became_peered":"2023-12-19T13:48:31.064494+0000","last_unstale":"2023-12-19T13:48:32.042154+0000","last_undegraded":"2023-12-19T13:48:32.042154+0000","last_fullsized":"2023-12-19T13:48:32.042154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:25.175664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053035+0000","last_change":"2023-12-19T13:48:30.547571+0000","last_active":"2023-12-19T13:48:31.053035+0000","last_peered":"2023-12-19T13:48:31.053035+0000","last_clean":"2023-12-19T13:48:31.053035+0000","last_became_active":"2023-12-19T13:48:30.546977+0000","last_became_peered":"2023-12-19T13:48:30.546977+0000","last_unstale":"2023-12-19T13:48:31.053035+0000","last_undegraded":"2023-12-19T13:48:31.053035+0000","last_fullsized":"2023-12-19T13:48:31.053035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:23.317943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291320+0000","last_change":"2023-12-19T13:48:31.045498+0000","last_active":"2023-12-19T13:48:32.291320+0000","last_peered":"2023-12-19T13:48:32.291320+0000","last_clean":"2023-12-19T13:48:32.291320+0000","last_became_active":"2023-12-19T13:48:31.045247+0000","last_became_peered":"2023-12-19T13:48:31.045247+0000","last_unstale":"2023-12-19T13:48:32.291320+0000","last_undegraded":"2023-12-19T13:48:32.291320+0000","last_fullsized":"2023-12-19T13:48:32.291320+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:29.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.036915+0000","last_change":"2023-12-19T13:48:30.569024+0000","last_active":"2023-12-19T13:48:31.036915+0000","last_peered":"2023-12-19T13:48:31.036915+0000","last_clean":"2023-12-19T13:48:31.036915+0000","last_became_active":"2023-12-19T13:48:30.567954+0000","last_became_peered":"2023-12-19T13:48:30.567954+0000","last_unstale":"2023-12-19T13:48:31.036915+0000","last_undegraded":"2023-12-19T13:48:31.036915+0000","last_fullsized":"2023-12-19T13:48:31.036915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291559+0000","last_change":"2023-12-19T13:48:31.043152+0000","last_active":"2023-12-19T13:48:32.291559+0000","last_peered":"2023-12-19T13:48:32.291559+0000","last_clean":"2023-12-19T13:48:32.291559+0000","last_became_active":"2023-12-19T13:48:31.042920+0000","last_became_peered":"2023-12-19T13:48:31.042920+0000","last_unstale":"2023-12-19T13:48:32.291559+0000","last_undegraded":"2023-12-19T13:48:32.291559+0000","last_fullsized":"2023-12-19T13:48:32.291559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:31.393201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.037454+0000","last_change":"2023-12-19T13:48:30.558837+0000","last_active":"2023-12-19T13:48:31.037454+0000","last_peered":"2023-12-19T13:48:31.037454+0000","last_clean":"2023-12-19T13:48:31.037454+0000","last_became_active":"2023-12-19T13:48:30.556293+0000","last_became_peered":"2023-12-19T13:48:30.556293+0000","last_unstale":"2023-12-19T13:48:31.037454+0000","last_undegraded":"2023-12-19T13:48:31.037454+0000","last_fullsized":"2023-12-19T13:48:31.037454+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:31.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292329+0000","last_change":"2023-12-19T13:48:31.063653+0000","last_active":"2023-12-19T13:48:32.292329+0000","last_peered":"2023-12-19T13:48:32.292329+0000","last_clean":"2023-12-19T13:48:32.292329+0000","last_became_active":"2023-12-19T13:48:31.062676+0000","last_became_peered":"2023-12-19T13:48:31.062676+0000","last_unstale":"2023-12-19T13:48:32.292329+0000","last_undegraded":"2023-12-19T13:48:32.292329+0000","last_fullsized":"2023-12-19T13:48:32.292329+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.045902+0000","last_change":"2023-12-19T13:48:30.566173+0000","last_active":"2023-12-19T13:48:31.045902+0000","last_peered":"2023-12-19T13:48:31.045902+0000","last_clean":"2023-12-19T13:48:31.045902+0000","last_became_active":"2023-12-19T13:48:30.565902+0000","last_became_peered":"2023-12-19T13:48:30.565902+0000","last_unstale":"2023-12-19T13:48:31.045902+0000","last_undegraded":"2023-12-19T13:48:31.045902+0000","last_fullsized":"2023-12-19T13:48:31.045902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:33.113835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042778+0000","last_change":"2023-12-19T13:48:31.061537+0000","last_active":"2023-12-19T13:48:32.042778+0000","last_peered":"2023-12-19T13:48:32.042778+0000","last_clean":"2023-12-19T13:48:32.042778+0000","last_became_active":"2023-12-19T13:48:31.061314+0000","last_became_peered":"2023-12-19T13:48:31.061314+0000","last_unstale":"2023-12-19T13:48:32.042778+0000","last_undegraded":"2023-12-19T13:48:32.042778+0000","last_fullsized":"2023-12-19T13:48:32.042778+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:13.462370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.067460+0000","last_change":"2023-12-19T13:48:30.568619+0000","last_active":"2023-12-19T13:48:31.067460+0000","last_peered":"2023-12-19T13:48:31.067460+0000","last_clean":"2023-12-19T13:48:31.067460+0000","last_became_active":"2023-12-19T13:48:30.567775+0000","last_became_peered":"2023-12-19T13:48:30.567775+0000","last_unstale":"2023-12-19T13:48:31.067460+0000","last_undegraded":"2023-12-19T13:48:31.067460+0000","last_fullsized":"2023-12-19T13:48:31.067460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:15.519435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.291850+0000","last_change":"2023-12-19T13:48:31.061830+0000","last_active":"2023-12-19T13:48:32.291850+0000","last_peered":"2023-12-19T13:48:32.291850+0000","last_clean":"2023-12-19T13:48:32.291850+0000","last_became_active":"2023-12-19T13:48:31.061531+0000","last_became_peered":"2023-12-19T13:48:31.061531+0000","last_unstale":"2023-12-19T13:48:32.291850+0000","last_undegraded":"2023-12-19T13:48:32.291850+0000","last_fullsized":"2023-12-19T13:48:32.291850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:00.081221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.060451+0000","last_change":"2023-12-19T13:48:30.571590+0000","last_active":"2023-12-19T13:48:31.060451+0000","last_peered":"2023-12-19T13:48:31.060451+0000","last_clean":"2023-12-19T13:48:31.060451+0000","last_became_active":"2023-12-19T13:48:30.570999+0000","last_became_peered":"2023-12-19T13:48:30.570999+0000","last_unstale":"2023-12-19T13:48:31.060451+0000","last_undegraded":"2023-12-19T13:48:31.060451+0000","last_fullsized":"2023-12-19T13:48:31.060451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:30.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043661+0000","last_change":"2023-12-19T13:48:31.040521+0000","last_active":"2023-12-19T13:48:32.043661+0000","last_peered":"2023-12-19T13:48:32.043661+0000","last_clean":"2023-12-19T13:48:32.043661+0000","last_became_active":"2023-12-19T13:48:31.039864+0000","last_became_peered":"2023-12-19T13:48:31.039864+0000","last_unstale":"2023-12-19T13:48:32.043661+0000","last_undegraded":"2023-12-19T13:48:32.043661+0000","last_fullsized":"2023-12-19T13:48:32.043661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:55.364518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041698+0000","last_change":"2023-12-19T13:48:30.565828+0000","last_active":"2023-12-19T13:48:31.041698+0000","last_peered":"2023-12-19T13:48:31.041698+0000","last_clean":"2023-12-19T13:48:31.041698+0000","last_became_active":"2023-12-19T13:48:30.564126+0000","last_became_peered":"2023-12-19T13:48:30.564126+0000","last_unstale":"2023-12-19T13:48:31.041698+0000","last_undegraded":"2023-12-19T13:48:31.041698+0000","last_fullsized":"2023-12-19T13:48:31.041698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:02:04.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042739+0000","last_change":"2023-12-19T13:48:31.052967+0000","last_active":"2023-12-19T13:48:32.042739+0000","last_peered":"2023-12-19T13:48:32.042739+0000","last_clean":"2023-12-19T13:48:32.042739+0000","last_became_active":"2023-12-19T13:48:31.052503+0000","last_became_peered":"2023-12-19T13:48:31.052503+0000","last_unstale":"2023-12-19T13:48:32.042739+0000","last_undegraded":"2023-12-19T13:48:32.042739+0000","last_fullsized":"2023-12-19T13:48:32.042739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:55.457446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.048836+0000","last_change":"2023-12-19T13:48:30.573421+0000","last_active":"2023-12-19T13:48:31.048836+0000","last_peered":"2023-12-19T13:48:31.048836+0000","last_clean":"2023-12-19T13:48:31.048836+0000","last_became_active":"2023-12-19T13:48:30.573100+0000","last_became_peered":"2023-12-19T13:48:30.573100+0000","last_unstale":"2023-12-19T13:48:31.048836+0000","last_undegraded":"2023-12-19T13:48:31.048836+0000","last_fullsized":"2023-12-19T13:48:31.048836+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043185+0000","last_change":"2023-12-19T13:48:31.045582+0000","last_active":"2023-12-19T13:48:32.043185+0000","last_peered":"2023-12-19T13:48:32.043185+0000","last_clean":"2023-12-19T13:48:32.043185+0000","last_became_active":"2023-12-19T13:48:31.045022+0000","last_became_peered":"2023-12-19T13:48:31.045022+0000","last_unstale":"2023-12-19T13:48:32.043185+0000","last_undegraded":"2023-12-19T13:48:32.043185+0000","last_fullsized":"2023-12-19T13:48:32.043185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:27.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.062660+0000","last_change":"2023-12-19T13:48:30.567294+0000","last_active":"2023-12-19T13:48:31.062660+0000","last_peered":"2023-12-19T13:48:31.062660+0000","last_clean":"2023-12-19T13:48:31.062660+0000","last_became_active":"2023-12-19T13:48:30.566881+0000","last_became_peered":"2023-12-19T13:48:30.566881+0000","last_unstale":"2023-12-19T13:48:31.062660+0000","last_undegraded":"2023-12-19T13:48:31.062660+0000","last_fullsized":"2023-12-19T13:48:31.062660+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:38.580105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043887+0000","last_change":"2023-12-19T13:48:31.047150+0000","last_active":"2023-12-19T13:48:32.043887+0000","last_peered":"2023-12-19T13:48:32.043887+0000","last_clean":"2023-12-19T13:48:32.043887+0000","last_became_active":"2023-12-19T13:48:31.046514+0000","last_became_peered":"2023-12-19T13:48:31.046514+0000","last_unstale":"2023-12-19T13:48:32.043887+0000","last_undegraded":"2023-12-19T13:48:32.043887+0000","last_fullsized":"2023-12-19T13:48:32.043887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:00.081221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063327+0000","last_change":"2023-12-19T13:48:30.562754+0000","last_active":"2023-12-19T13:48:31.063327+0000","last_peered":"2023-12-19T13:48:31.063327+0000","last_clean":"2023-12-19T13:48:31.063327+0000","last_became_active":"2023-12-19T13:48:30.558728+0000","last_became_peered":"2023-12-19T13:48:30.558728+0000","last_unstale":"2023-12-19T13:48:31.063327+0000","last_undegraded":"2023-12-19T13:48:31.063327+0000","last_fullsized":"2023-12-19T13:48:31.063327+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042995+0000","last_change":"2023-12-19T13:48:31.056207+0000","last_active":"2023-12-19T13:48:32.042995+0000","last_peered":"2023-12-19T13:48:32.042995+0000","last_clean":"2023-12-19T13:48:32.042995+0000","last_became_active":"2023-12-19T13:48:31.055546+0000","last_became_peered":"2023-12-19T13:48:31.055546+0000","last_unstale":"2023-12-19T13:48:32.042995+0000","last_undegraded":"2023-12-19T13:48:32.042995+0000","last_fullsized":"2023-12-19T13:48:32.042995+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:08.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.048889+0000","last_change":"2023-12-19T13:48:30.569667+0000","last_active":"2023-12-19T13:48:31.048889+0000","last_peered":"2023-12-19T13:48:31.048889+0000","last_clean":"2023-12-19T13:48:31.048889+0000","last_became_active":"2023-12-19T13:48:30.569444+0000","last_became_peered":"2023-12-19T13:48:30.569444+0000","last_unstale":"2023-12-19T13:48:31.048889+0000","last_undegraded":"2023-12-19T13:48:31.048889+0000","last_fullsized":"2023-12-19T13:48:31.048889+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:59.915604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.043389+0000","last_change":"2023-12-19T13:48:31.057340+0000","last_active":"2023-12-19T13:48:32.043389+0000","last_peered":"2023-12-19T13:48:32.043389+0000","last_clean":"2023-12-19T13:48:32.043389+0000","last_became_active":"2023-12-19T13:48:31.057076+0000","last_became_peered":"2023-12-19T13:48:31.057076+0000","last_unstale":"2023-12-19T13:48:32.043389+0000","last_undegraded":"2023-12-19T13:48:32.043389+0000","last_fullsized":"2023-12-19T13:48:32.043389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.052137+0000","last_change":"2023-12-19T13:48:30.562794+0000","last_active":"2023-12-19T13:48:31.052137+0000","last_peered":"2023-12-19T13:48:31.052137+0000","last_clean":"2023-12-19T13:48:31.052137+0000","last_became_active":"2023-12-19T13:48:30.562376+0000","last_became_peered":"2023-12-19T13:48:30.562376+0000","last_unstale":"2023-12-19T13:48:31.052137+0000","last_undegraded":"2023-12-19T13:48:31.052137+0000","last_fullsized":"2023-12-19T13:48:31.052137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292068+0000","last_change":"2023-12-19T13:48:31.052222+0000","last_active":"2023-12-19T13:48:32.292068+0000","last_peered":"2023-12-19T13:48:32.292068+0000","last_clean":"2023-12-19T13:48:32.292068+0000","last_became_active":"2023-12-19T13:48:31.051936+0000","last_became_peered":"2023-12-19T13:48:31.051936+0000","last_unstale":"2023-12-19T13:48:32.292068+0000","last_undegraded":"2023-12-19T13:48:32.292068+0000","last_fullsized":"2023-12-19T13:48:32.292068+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:08.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.049036+0000","last_change":"2023-12-19T13:48:30.573292+0000","last_active":"2023-12-19T13:48:31.049036+0000","last_peered":"2023-12-19T13:48:31.049036+0000","last_clean":"2023-12-19T13:48:31.049036+0000","last_became_active":"2023-12-19T13:48:30.572798+0000","last_became_peered":"2023-12-19T13:48:30.572798+0000","last_unstale":"2023-12-19T13:48:31.049036+0000","last_undegraded":"2023-12-19T13:48:31.049036+0000","last_fullsized":"2023-12-19T13:48:31.049036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293677+0000","last_change":"2023-12-19T13:48:31.066773+0000","last_active":"2023-12-19T13:48:32.293677+0000","last_peered":"2023-12-19T13:48:32.293677+0000","last_clean":"2023-12-19T13:48:32.293677+0000","last_became_active":"2023-12-19T13:48:31.066441+0000","last_became_peered":"2023-12-19T13:48:31.066441+0000","last_unstale":"2023-12-19T13:48:32.293677+0000","last_undegraded":"2023-12-19T13:48:32.293677+0000","last_fullsized":"2023-12-19T13:48:32.293677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:40:06.460024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.063658+0000","last_change":"2023-12-19T13:48:30.556702+0000","last_active":"2023-12-19T13:48:31.063658+0000","last_peered":"2023-12-19T13:48:31.063658+0000","last_clean":"2023-12-19T13:48:31.063658+0000","last_became_active":"2023-12-19T13:48:30.555906+0000","last_became_peered":"2023-12-19T13:48:30.555906+0000","last_unstale":"2023-12-19T13:48:31.063658+0000","last_undegraded":"2023-12-19T13:48:31.063658+0000","last_fullsized":"2023-12-19T13:48:31.063658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:53.297196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292875+0000","last_change":"2023-12-19T13:48:31.058717+0000","last_active":"2023-12-19T13:48:32.292875+0000","last_peered":"2023-12-19T13:48:32.292875+0000","last_clean":"2023-12-19T13:48:32.292875+0000","last_became_active":"2023-12-19T13:48:31.057801+0000","last_became_peered":"2023-12-19T13:48:31.057801+0000","last_unstale":"2023-12-19T13:48:32.292875+0000","last_undegraded":"2023-12-19T13:48:32.292875+0000","last_fullsized":"2023-12-19T13:48:32.292875+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:34.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.040271+0000","last_change":"2023-12-19T13:48:30.573217+0000","last_active":"2023-12-19T13:48:31.040271+0000","last_peered":"2023-12-19T13:48:31.040271+0000","last_clean":"2023-12-19T13:48:31.040271+0000","last_became_active":"2023-12-19T13:48:30.572589+0000","last_became_peered":"2023-12-19T13:48:30.572589+0000","last_unstale":"2023-12-19T13:48:31.040271+0000","last_undegraded":"2023-12-19T13:48:31.040271+0000","last_fullsized":"2023-12-19T13:48:31.040271+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:24.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292869+0000","last_change":"2023-12-19T13:48:31.060286+0000","last_active":"2023-12-19T13:48:32.292869+0000","last_peered":"2023-12-19T13:48:32.292869+0000","last_clean":"2023-12-19T13:48:32.292869+0000","last_became_active":"2023-12-19T13:48:31.058371+0000","last_became_peered":"2023-12-19T13:48:31.058371+0000","last_unstale":"2023-12-19T13:48:32.292869+0000","last_undegraded":"2023-12-19T13:48:32.292869+0000","last_fullsized":"2023-12-19T13:48:32.292869+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:04.508581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.054826+0000","last_change":"2023-12-19T13:48:30.563907+0000","last_active":"2023-12-19T13:48:31.054826+0000","last_peered":"2023-12-19T13:48:31.054826+0000","last_clean":"2023-12-19T13:48:31.054826+0000","last_became_active":"2023-12-19T13:48:30.560821+0000","last_became_peered":"2023-12-19T13:48:30.560821+0000","last_unstale":"2023-12-19T13:48:31.054826+0000","last_undegraded":"2023-12-19T13:48:31.054826+0000","last_fullsized":"2023-12-19T13:48:31.054826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:34.650395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.292888+0000","last_change":"2023-12-19T13:48:31.061838+0000","last_active":"2023-12-19T13:48:32.292888+0000","last_peered":"2023-12-19T13:48:32.292888+0000","last_clean":"2023-12-19T13:48:32.292888+0000","last_became_active":"2023-12-19T13:48:31.061595+0000","last_became_peered":"2023-12-19T13:48:31.061595+0000","last_unstale":"2023-12-19T13:48:32.292888+0000","last_undegraded":"2023-12-19T13:48:32.292888+0000","last_fullsized":"2023-12-19T13:48:32.292888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:54.302317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.030734+0000","last_change":"2023-12-19T13:48:30.567145+0000","last_active":"2023-12-19T13:48:31.030734+0000","last_peered":"2023-12-19T13:48:31.030734+0000","last_clean":"2023-12-19T13:48:31.030734+0000","last_became_active":"2023-12-19T13:48:30.566807+0000","last_became_peered":"2023-12-19T13:48:30.566807+0000","last_unstale":"2023-12-19T13:48:31.030734+0000","last_undegraded":"2023-12-19T13:48:31.030734+0000","last_fullsized":"2023-12-19T13:48:31.030734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:22.368082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042731+0000","last_change":"2023-12-19T13:48:31.058944+0000","last_active":"2023-12-19T13:48:32.042731+0000","last_peered":"2023-12-19T13:48:32.042731+0000","last_clean":"2023-12-19T13:48:32.042731+0000","last_became_active":"2023-12-19T13:48:31.058653+0000","last_became_peered":"2023-12-19T13:48:31.058653+0000","last_unstale":"2023-12-19T13:48:32.042731+0000","last_undegraded":"2023-12-19T13:48:32.042731+0000","last_fullsized":"2023-12-19T13:48:32.042731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:41.317283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053890+0000","last_change":"2023-12-19T13:48:30.565161+0000","last_active":"2023-12-19T13:48:31.053890+0000","last_peered":"2023-12-19T13:48:31.053890+0000","last_clean":"2023-12-19T13:48:31.053890+0000","last_became_active":"2023-12-19T13:48:30.564755+0000","last_became_peered":"2023-12-19T13:48:30.564755+0000","last_unstale":"2023-12-19T13:48:31.053890+0000","last_undegraded":"2023-12-19T13:48:31.053890+0000","last_fullsized":"2023-12-19T13:48:31.053890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:43.945791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.295219+0000","last_change":"2023-12-19T13:48:31.059990+0000","last_active":"2023-12-19T13:48:32.295219+0000","last_peered":"2023-12-19T13:48:32.295219+0000","last_clean":"2023-12-19T13:48:32.295219+0000","last_became_active":"2023-12-19T13:48:31.055899+0000","last_became_peered":"2023-12-19T13:48:31.055899+0000","last_unstale":"2023-12-19T13:48:32.295219+0000","last_undegraded":"2023-12-19T13:48:32.295219+0000","last_fullsized":"2023-12-19T13:48:32.295219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:19.784553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041605+0000","last_change":"2023-12-19T13:48:30.572933+0000","last_active":"2023-12-19T13:48:31.041605+0000","last_peered":"2023-12-19T13:48:31.041605+0000","last_clean":"2023-12-19T13:48:31.041605+0000","last_became_active":"2023-12-19T13:48:30.572148+0000","last_became_peered":"2023-12-19T13:48:30.572148+0000","last_unstale":"2023-12-19T13:48:31.041605+0000","last_undegraded":"2023-12-19T13:48:31.041605+0000","last_fullsized":"2023-12-19T13:48:31.041605+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:31.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042247+0000","last_change":"2023-12-19T13:48:31.057783+0000","last_active":"2023-12-19T13:48:32.042247+0000","last_peered":"2023-12-19T13:48:32.042247+0000","last_clean":"2023-12-19T13:48:32.042247+0000","last_became_active":"2023-12-19T13:48:31.057420+0000","last_became_peered":"2023-12-19T13:48:31.057420+0000","last_unstale":"2023-12-19T13:48:32.042247+0000","last_undegraded":"2023-12-19T13:48:32.042247+0000","last_fullsized":"2023-12-19T13:48:32.042247+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:06.958823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.037294+0000","last_change":"2023-12-19T13:48:30.571319+0000","last_active":"2023-12-19T13:48:31.037294+0000","last_peered":"2023-12-19T13:48:31.037294+0000","last_clean":"2023-12-19T13:48:31.037294+0000","last_became_active":"2023-12-19T13:48:30.570689+0000","last_became_peered":"2023-12-19T13:48:30.570689+0000","last_unstale":"2023-12-19T13:48:31.037294+0000","last_undegraded":"2023-12-19T13:48:31.037294+0000","last_fullsized":"2023-12-19T13:48:31.037294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:08.164702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293877+0000","last_change":"2023-12-19T13:48:31.059655+0000","last_active":"2023-12-19T13:48:32.293877+0000","last_peered":"2023-12-19T13:48:32.293877+0000","last_clean":"2023-12-19T13:48:32.293877+0000","last_became_active":"2023-12-19T13:48:31.059098+0000","last_became_peered":"2023-12-19T13:48:31.059098+0000","last_unstale":"2023-12-19T13:48:32.293877+0000","last_undegraded":"2023-12-19T13:48:32.293877+0000","last_fullsized":"2023-12-19T13:48:32.293877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:57.676040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.041809+0000","last_change":"2023-12-19T13:48:30.571183+0000","last_active":"2023-12-19T13:48:31.041809+0000","last_peered":"2023-12-19T13:48:31.041809+0000","last_clean":"2023-12-19T13:48:31.041809+0000","last_became_active":"2023-12-19T13:48:30.569884+0000","last_became_peered":"2023-12-19T13:48:30.569884+0000","last_unstale":"2023-12-19T13:48:31.041809+0000","last_undegraded":"2023-12-19T13:48:31.041809+0000","last_fullsized":"2023-12-19T13:48:31.041809+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293038+0000","last_change":"2023-12-19T13:48:31.060149+0000","last_active":"2023-12-19T13:48:32.293038+0000","last_peered":"2023-12-19T13:48:32.293038+0000","last_clean":"2023-12-19T13:48:32.293038+0000","last_became_active":"2023-12-19T13:48:31.058109+0000","last_became_peered":"2023-12-19T13:48:31.058109+0000","last_unstale":"2023-12-19T13:48:32.293038+0000","last_undegraded":"2023-12-19T13:48:32.293038+0000","last_fullsized":"2023-12-19T13:48:32.293038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:24.323064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.032246+0000","last_change":"2023-12-19T13:48:30.565835+0000","last_active":"2023-12-19T13:48:31.032246+0000","last_peered":"2023-12-19T13:48:31.032246+0000","last_clean":"2023-12-19T13:48:31.032246+0000","last_became_active":"2023-12-19T13:48:30.565233+0000","last_became_peered":"2023-12-19T13:48:30.565233+0000","last_unstale":"2023-12-19T13:48:31.032246+0000","last_undegraded":"2023-12-19T13:48:31.032246+0000","last_fullsized":"2023-12-19T13:48:31.032246+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:14.229510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.290563+0000","last_change":"2023-12-19T13:48:31.057778+0000","last_active":"2023-12-19T13:48:32.290563+0000","last_peered":"2023-12-19T13:48:32.290563+0000","last_clean":"2023-12-19T13:48:32.290563+0000","last_became_active":"2023-12-19T13:48:31.057560+0000","last_became_peered":"2023-12-19T13:48:31.057560+0000","last_unstale":"2023-12-19T13:48:32.290563+0000","last_undegraded":"2023-12-19T13:48:32.290563+0000","last_fullsized":"2023-12-19T13:48:32.290563+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:44.950912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.050189+0000","last_change":"2023-12-19T13:48:30.567267+0000","last_active":"2023-12-19T13:48:31.050189+0000","last_peered":"2023-12-19T13:48:31.050189+0000","last_clean":"2023-12-19T13:48:31.050189+0000","last_became_active":"2023-12-19T13:48:30.566724+0000","last_became_peered":"2023-12-19T13:48:30.566724+0000","last_unstale":"2023-12-19T13:48:31.050189+0000","last_undegraded":"2023-12-19T13:48:31.050189+0000","last_fullsized":"2023-12-19T13:48:31.050189+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:46.944295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.042201+0000","last_change":"2023-12-19T13:48:31.040906+0000","last_active":"2023-12-19T13:48:32.042201+0000","last_peered":"2023-12-19T13:48:32.042201+0000","last_clean":"2023-12-19T13:48:32.042201+0000","last_became_active":"2023-12-19T13:48:31.039586+0000","last_became_peered":"2023-12-19T13:48:31.039586+0000","last_unstale":"2023-12-19T13:48:32.042201+0000","last_undegraded":"2023-12-19T13:48:32.042201+0000","last_fullsized":"2023-12-19T13:48:32.042201+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:32.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.034655+0000","last_change":"2023-12-19T13:48:30.565424+0000","last_active":"2023-12-19T13:48:31.034655+0000","last_peered":"2023-12-19T13:48:31.034655+0000","last_clean":"2023-12-19T13:48:31.034655+0000","last_became_active":"2023-12-19T13:48:30.564077+0000","last_became_peered":"2023-12-19T13:48:30.564077+0000","last_unstale":"2023-12-19T13:48:31.034655+0000","last_undegraded":"2023-12-19T13:48:31.034655+0000","last_fullsized":"2023-12-19T13:48:31.034655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:23.185590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T13:48:32.293587+0000","last_change":"2023-12-19T13:48:31.060557+0000","last_active":"2023-12-19T13:48:32.293587+0000","last_peered":"2023-12-19T13:48:32.293587+0000","last_clean":"2023-12-19T13:48:32.293587+0000","last_became_active":"2023-12-19T13:48:31.057125+0000","last_became_peered":"2023-12-19T13:48:31.057125+0000","last_unstale":"2023-12-19T13:48:32.293587+0000","last_undegraded":"2023-12-19T13:48:32.293587+0000","last_fullsized":"2023-12-19T13:48:32.293587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:30.534071+0000","last_clean_scrub_stamp":"2023-12-19T13:48:30.534071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:32.074797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.053748+0000","last_change":"2023-12-19T13:48:30.570334+0000","last_active":"2023-12-19T13:48:31.053748+0000","last_peered":"2023-12-19T13:48:31.053748+0000","last_clean":"2023-12-19T13:48:31.053748+0000","last_became_active":"2023-12-19T13:48:30.570094+0000","last_became_peered":"2023-12-19T13:48:30.570094+0000","last_unstale":"2023-12-19T13:48:31.053748+0000","last_undegraded":"2023-12-19T13:48:31.053748+0000","last_fullsized":"2023-12-19T13:48:31.053748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:48:29.528950+0000","last_clean_scrub_stamp":"2023-12-19T13:48:29.528950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:03.503460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T13:48:31.036018+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:48:31.036018+0000","last_peered":"2023-12-19T13:48:31.036018+0000","last_clean":"2023-12-19T13:48:31.036018+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:48:31.036018+0000","last_undegraded":"2023-12-19T13:48:31.036018+0000","last_fullsized":"2023-12-19T13:48:31.036018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.008,"15min":1},"min":{"1min":0.64200000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98699999999999999,"15min":0.97699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4339999999999999,"5min":2.008,"15min":2.008},"last":0.90200000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.077,"15min":1.069},"min":{"1min":0.73299999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6160000000000001,"5min":1.617,"15min":1.617},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4390000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.016}]},{"osd":2,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.1679999999999999,"15min":1.1459999999999999},"min":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.871,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.268}]},{"osd":3,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.1619999999999999,"15min":1.145},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.387,"5min":1.252,"15min":1.23},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.4690000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.298,"15min":1.292},"min":{"1min":0.90600000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6739999999999999,"5min":2.181,"15min":2.181},"last":1.232},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.415,"15min":1.407},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2109999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.52}]},{"osd":5,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.302},{"interface":"front","average":{"1min":1.504,"5min":1.4419999999999999,"15min":1.4319999999999999},"min":{"1min":1.0649999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.024,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.2749999999999999,"15min":1.256},"min":{"1min":0.79500000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.5029999999999999,"15min":1.4870000000000001},"min":{"1min":1.121,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.401}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0349999999999999,"15min":1.0249999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.679,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.325},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.113,"15min":1.129},"min":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6020000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.226}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.044,"15min":1.028},"min":{"1min":0.83499999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.962,"15min":1.962},"last":1.26},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.524,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2250000000000001,"15min":1.2150000000000001},"min":{"1min":0.86899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.798,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.151,"15min":1.1439999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.504,"5min":1.786,"15min":1.786},"last":1.5469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3620000000000001},"min":{"1min":0.90600000000000003,"5min":0.87,"15min":0.87},"max":{"1min":1.6910000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.415},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8799999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.099}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1970000000000001,"15min":1.194},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.282},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6499999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.623}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.236},"min":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.462},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.363,"15min":1.359},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7989999999999999,"5min":1.907,"15min":1.907},"last":1.498}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4059999999999999,"15min":1.4119999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.677},{"interface":"front","average":{"1min":1.363,"5min":1.347,"15min":1.345},"min":{"1min":0.65000000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.3700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.107},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.042,"15min":1.0580000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4359999999999999,"5min":1.516,"15min":1.516},"last":1.214}]},{"osd":1,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.099,"15min":1.099},"min":{"1min":0.70999999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5369999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.998,"15min":0.995},"min":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.278}]},{"osd":2,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2270000000000001,"15min":1.254},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5069999999999999,"5min":2.827,"15min":2.827},"last":1.327},{"interface":"front","average":{"1min":1.202,"5min":1.2629999999999999,"15min":1.2729999999999999},"min":{"1min":0.81599999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6160000000000001,"5min":2.863,"15min":2.863},"last":0.98799999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.246,"15min":1.242},"min":{"1min":0.97499999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5329999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.87}]},{"osd":4,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.141,"15min":1.133},"min":{"1min":0.79400000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.415},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.276,"15min":1.276},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.333,"15min":1.3129999999999999},"min":{"1min":1.089,"5min":0.623,"15min":0.623},"max":{"1min":1.772,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.3660000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:23 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3899999999999999,"15min":1.399},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7410000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.53},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.417,"15min":1.3999999999999999},"min":{"1min":1.244,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.825,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.4450000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.649},{"interface":"front","average":{"1min":1.089,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5149999999999999,"5min":2.016,"15min":2.016},"last":1.054}]},{"osd":1,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0629999999999999,"15min":1.0649999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4830000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.091,"5min":1.115,"15min":1.119},"min":{"1min":0.69699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.4039999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.1200000000000001,"15min":1.1080000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.222,"15min":1.2150000000000001},"min":{"1min":0.90800000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.74,"5min":1.952,"15min":1.952},"last":1.22},{"interface":"front","average":{"1min":1.218,"5min":1.27,"15min":1.278},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6739999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.363}]},{"osd":5,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.238,"15min":1.256},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.611,"5min":2.165,"15min":2.165},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8280000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.4930000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6379999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.466,"15min":1.4850000000000001},"min":{"1min":0.88600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.1339999999999999,"5min":2.335,"15min":2.335},"last":1.595}]},{"osd":7,"last update":"Tue Dec 19 13:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4690000000000001,"15min":1.4670000000000001},"min":{"1min":0.82499999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8340000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.518,"15min":1.528},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7529999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.452}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766692,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.94199999999999995,"15min":0.97199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.024,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4430000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.1080000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.014,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3300000000000001,"5min":2.387,"15min":2.387},"last":1.0489999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.5129999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.1359999999999999,"15min":1.1559999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8620000000000001,"5min":2.657,"15min":2.657},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5309999999999999,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.2230000000000001,"15min":1.2350000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.532,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.335}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3080000000000001,"15min":1.3240000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.546},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.88100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.4950000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.81899999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.899,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3460000000000001,"15min":1.357},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9730000000000001,"5min":2.698,"15min":2.698},"last":1.4570000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7649999999999999,"5min":3.609,"15min":3.609},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.89700000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.0910000000000002,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.276}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768166,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.083,"5min":2.258,"15min":2.258},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48799999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.587,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.262,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.9950000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1910000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.099,"15min":1.1060000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.3720000000000001,"5min":1.456,"15min":1.456},"last":1.127},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.84299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.635,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.1659999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.171,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.296,"15min":1.304},"min":{"1min":0.76700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8859999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4430000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2969999999999999,"15min":1.3129999999999999},"min":{"1min":0.754,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7470000000000001,"5min":2.964,"15min":2.964},"last":1.302},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.248,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.708,"5min":2.286,"15min":2.286},"last":1.4730000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:48:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.351,"15min":2.351},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.22,"15min":1.23},"min":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.96,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.5129999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177818,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2949999999999999,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.749}]},{"osd":2,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.087,"15min":1.115},"min":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.466,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.006},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.179,"15min":1.196},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4139999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.3979999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6899999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.206},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3360000000000001,"5min":7.157,"15min":7.157},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.222,"15min":1.242},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.663,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2929999999999999,"15min":1.3080000000000001},"min":{"1min":0.82499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5940000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.355}]},{"osd":5,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3240000000000001,"15min":1.347},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4550000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.748,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.234}]},{"osd":6,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3500000000000001,"15min":1.3560000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7290000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.296},{"interface":"front","average":{"1min":1.232,"5min":1.4159999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.625,"5min":3.786,"15min":3.786},"last":1.036}]},{"osd":7,"last update":"Tue Dec 19 13:48:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.446,"15min":1.47},"min":{"1min":0.86699999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6619999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.47,"15min":1.492},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.7490000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.1240000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2170000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89400000000000002,"15min":0.91400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.365,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.85399999999999998,"15min":0.86299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.749},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84599999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.085,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.085,"15min":1.1080000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4690000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.84499999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.53,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.147},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1539999999999999,"15min":1.1559999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2709999999999999,"15min":1.292},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6299999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.1799999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.2310000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.244,"15min":1.2470000000000001},"min":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.94799999999999995}]},{"osd":7,"last update":"Tue Dec 19 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.115},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.367,"15min":1.3919999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6479999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":0.89100000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:48:41.307 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:48:41.307 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:48:41.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.573+0000 7fe29fe5f640 1 Processor -- start 2023-12-19T13:48:41.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.574+0000 7fe29fe5f640 1 -- start start 2023-12-19T13:48:41.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.575+0000 7fe29fe5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe29813e110 0x7fe29815b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.575+0000 7fe29fe5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe298065e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.575+0000 7fe29fe5f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe298066350 con 0x7fe298141320 2023-12-19T13:48:41.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.575+0000 7fe29fe5f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29813efd0 con 0x7fe29813e110 2023-12-19T13:48:41.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.575+0000 7fe29fe5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815ee60 con 0x7fe2980659d0 2023-12-19T13:48:41.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29dbfb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe29813e110 0x7fe29815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29d3fa640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe298141320 0x7fe29813e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60862/0 (socket says 172.21.15.113:60862) 2023-12-19T13:48:41.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29d3fa640 1 -- 172.21.15.113:0/3525375810 learned_addr learned my addr 172.21.15.113:0/3525375810 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:41.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29dbfb640 1 -- 172.21.15.113:0/3525375810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 msgr2=0x7fe298065e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:41.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29e3fc640 1 --2- 172.21.15.113:0/3525375810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe298065e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29dbfb640 1 --2- 172.21.15.113:0/3525375810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe298065e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29cbf9640 1 -- 172.21.15.113:0/3525375810 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810040692 0 0) 0x7fe298066350 con 0x7fe298141320 2023-12-19T13:48:41.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29dbfb640 1 -- 172.21.15.113:0/3525375810 >> v1:172.21.15.113:6789/0 conn(0x7fe298141320 legacy=0x7fe29813e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29dbfb640 1 -- 172.21.15.113:0/3525375810 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29815be50 con 0x7fe29813e110 2023-12-19T13:48:41.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.576+0000 7fe29e3fc640 1 --2- 172.21.15.113:0/3525375810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe298065e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:41.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.577+0000 7fe29dbfb640 1 --2- 172.21.15.113:0/3525375810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29813e110 0x7fe29815b870 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe288009d90 tx=0x7fe28802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fd807420063987 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:41.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29cbf9640 1 -- 172.21.15.113:0/3525375810 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28802cc60 con 0x7fe29813e110 2023-12-19T13:48:41.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29cbf9640 1 -- 172.21.15.113:0/3525375810 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28802cdc0 con 0x7fe29813e110 2023-12-19T13:48:41.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29cbf9640 1 -- 172.21.15.113:0/3525375810 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288034660 con 0x7fe29813e110 2023-12-19T13:48:41.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29fe5f640 1 -- 172.21.15.113:0/3525375810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29813e110 msgr2=0x7fe29815b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/3525375810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29813e110 0x7fe29815b870 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe288009d90 tx=0x7fe28802beb0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29fe5f640 1 -- 172.21.15.113:0/3525375810 shutdown_connections 2023-12-19T13:48:41.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/3525375810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe298065e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/3525375810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe29813e110 0x7fe29815b870 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.578+0000 7fe29fe5f640 1 -- 172.21.15.113:0/3525375810 >> 172.21.15.113:0/3525375810 conn(0x7fe29806f160 msgr2=0x7fe29806f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:41.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.579+0000 7fe29fe5f640 1 -- 172.21.15.113:0/3525375810 shutdown_connections 2023-12-19T13:48:41.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.579+0000 7fe29fe5f640 1 -- 172.21.15.113:0/3525375810 wait complete. 2023-12-19T13:48:41.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.580+0000 7fe29fe5f640 1 Processor -- start 2023-12-19T13:48:41.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.580+0000 7fe29fe5f640 1 -- start start 2023-12-19T13:48:41.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.581+0000 7fe29fe5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe29813b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.581+0000 7fe29fe5f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29813e110 0x7fe29813a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.581+0000 7fe29fe5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe298141320 0x7fe2981e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.581+0000 7fe29fe5f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815d640 con 0x7fe298141320 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.581+0000 7fe29fe5f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815d890 con 0x7fe29813e110 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.581+0000 7fe29fe5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815db70 con 0x7fe2980659d0 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe298141320 0x7fe2981e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe298141320 0x7fe2981e59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59554/0 (socket says 172.21.15.113:59554) 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 -- 172.21.15.113:0/992068081 learned_addr learned my addr 172.21.15.113:0/992068081 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29dbfb640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe29813b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29d3fa640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29813e110 0x7fe29813a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 -- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 msgr2=0x7fe29813b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe29813b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 -- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29813e110 msgr2=0x7fe29813a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29813e110 0x7fe29813a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.582+0000 7fe29e3fc640 1 -- 172.21.15.113:0/992068081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe288009a70 con 0x7fe298141320 2023-12-19T13:48:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.583+0000 7fe29e3fc640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe298141320 0x7fe2981e59b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c7f0 tx=0x7fe29000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.583+0000 7fe2967fc640 1 -- 172.21.15.113:0/992068081 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290007820 con 0x7fe298141320 2023-12-19T13:48:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.583+0000 7fe2967fc640 1 -- 172.21.15.113:0/992068081 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe290007980 con 0x7fe298141320 2023-12-19T13:48:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.583+0000 7fe2967fc640 1 -- 172.21.15.113:0/992068081 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290007d70 con 0x7fe298141320 2023-12-19T13:48:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.583+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29815de50 con 0x7fe298141320 2023-12-19T13:48:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.583+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2981e5420 con 0x7fe298141320 2023-12-19T13:48:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.584+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2981e56a0 con 0x7fe298141320 2023-12-19T13:48:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.585+0000 7fe2967fc640 1 -- 172.21.15.113:0/992068081 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2900113f0 con 0x7fe298141320 2023-12-19T13:48:41.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.586+0000 7fe2967fc640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe28406a430 0x7fe28406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:41.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.586+0000 7fe2967fc640 1 -- 172.21.15.113:0/992068081 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe290088be0 con 0x7fe298141320 2023-12-19T13:48:41.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.586+0000 7fe29dbfb640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe28406a430 0x7fe28406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:41.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.587+0000 7fe29dbfb640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe28406a430 0x7fe28406c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe288036000 tx=0x7fe288030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.590+0000 7fe2967fc640 1 -- 172.21.15.113:0/992068081 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe290054260 con 0x7fe298141320 2023-12-19T13:48:41.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.854+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe298061910 con 0x7fe298141320 2023-12-19T13:48:41.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.860+0000 7fe2967fc640 1 -- 172.21.15.113:0/992068081 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe29001f0e0 con 0x7fe298141320 2023-12-19T13:48:41.860 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe28406a430 msgr2=0x7fe28406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe28406a430 0x7fe28406c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe288036000 tx=0x7fe288030000 comp rx=0 tx=0).stop 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe298141320 msgr2=0x7fe2981e59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe298141320 0x7fe2981e59b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c7f0 tx=0x7fe29000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 shutdown_connections 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe28406a430 0x7fe28406c8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe298141320 0x7fe2981e59b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29813e110 0x7fe29813a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 --2- 172.21.15.113:0/992068081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2980659d0 0x7fe29813b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:41.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 >> 172.21.15.113:0/992068081 conn(0x7fe29806f160 msgr2=0x7fe29815c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:41.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 shutdown_connections 2023-12-19T13:48:41.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:41.863+0000 7fe29fe5f640 1 -- 172.21.15.113:0/992068081 wait complete. 2023-12-19T13:48:41.880 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:42.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.090+0000 7f694ce25640 1 Processor -- start 2023-12-19T13:48:42.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.090+0000 7f694ce25640 1 -- start start 2023-12-19T13:48:42.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.091+0000 7f694ce25640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6948159f80 0x7f694806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.091+0000 7f694ce25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815aa70 0x7f694815b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.091+0000 7f694ce25640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694806b520 con 0x7f694815b1e0 2023-12-19T13:48:42.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.091+0000 7f694ce25640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480b2b20 con 0x7f6948159f80 2023-12-19T13:48:42.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.091+0000 7f694ce25640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480b2fb0 con 0x7f694815aa70 2023-12-19T13:48:42.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.092+0000 7f69477fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6948159f80 0x7f694806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.092+0000 7f6947fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815aa70 0x7f694815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.092+0000 7f69477fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6948159f80 0x7f694806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:44746/0 (socket says 172.21.15.113:44746) 2023-12-19T13:48:42.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.092+0000 7f69477fe640 1 -- 172.21.15.113:0/231753415 learned_addr learned my addr 172.21.15.113:0/231753415 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:42.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.093+0000 7f6947fff640 1 -- 172.21.15.113:0/231753415 >> v2:172.21.15.151:3300/0 conn(0x7f6948159f80 msgr2=0x7f694806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:42.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.093+0000 7f6947fff640 1 --2- 172.21.15.113:0/231753415 >> v2:172.21.15.151:3300/0 conn(0x7f6948159f80 0x7f694806f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.093+0000 7f6947fff640 1 -- 172.21.15.113:0/231753415 >> v1:172.21.15.151:6789/0 conn(0x7f694815b1e0 legacy=0x7f694815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.093+0000 7f6947fff640 1 -- 172.21.15.113:0/231753415 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480b1f10 con 0x7f694815aa70 2023-12-19T13:48:42.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.093+0000 7f69477fe640 1 --2- 172.21.15.113:0/231753415 >> v2:172.21.15.151:3300/0 conn(0x7f6948159f80 0x7f694806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:48:42.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.095+0000 7f6947fff640 1 --2- 172.21.15.113:0/231753415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815aa70 0x7f694815b770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69400097a0 tx=0x7f694002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a8ac85130d5918 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:42.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.095+0000 7f69467fc640 1 -- 172.21.15.113:0/231753415 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940030610 con 0x7f694815aa70 2023-12-19T13:48:42.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.095+0000 7f69467fc640 1 -- 172.21.15.113:0/231753415 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940030770 con 0x7f694815aa70 2023-12-19T13:48:42.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.095+0000 7f69467fc640 1 -- 172.21.15.113:0/231753415 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940030b00 con 0x7f694815aa70 2023-12-19T13:48:42.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 -- 172.21.15.113:0/231753415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815aa70 msgr2=0x7f694815b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 --2- 172.21.15.113:0/231753415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815aa70 0x7f694815b770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69400097a0 tx=0x7f694002b960 comp rx=0 tx=0).stop 2023-12-19T13:48:42.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 -- 172.21.15.113:0/231753415 shutdown_connections 2023-12-19T13:48:42.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 --2- 172.21.15.113:0/231753415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815aa70 0x7f694815b770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 --2- 172.21.15.113:0/231753415 >> v2:172.21.15.151:3300/0 conn(0x7f6948159f80 0x7f694806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 -- 172.21.15.113:0/231753415 >> 172.21.15.113:0/231753415 conn(0x7f69480b0100 msgr2=0x7f69480b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:42.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 -- 172.21.15.113:0/231753415 shutdown_connections 2023-12-19T13:48:42.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.096+0000 7f694ce25640 1 -- 172.21.15.113:0/231753415 wait complete. 2023-12-19T13:48:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.098+0000 7f694ce25640 1 Processor -- start 2023-12-19T13:48:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.098+0000 7f694ce25640 1 -- start start 2023-12-19T13:48:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f694ce25640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6948159f80 0x7f6948151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f694ce25640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f694815aa70 0x7f6948151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f694ce25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815b1e0 0x7f6948156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f694ce25640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694806bb30 con 0x7f694815aa70 2023-12-19T13:48:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f694ce25640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948155ba0 con 0x7f6948159f80 2023-12-19T13:48:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f694ce25640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6948155e80 con 0x7f694815b1e0 2023-12-19T13:48:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f6946ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f694815aa70 0x7f6948151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f6946ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f694815aa70 0x7f6948151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59568/0 (socket says 172.21.15.113:59568) 2023-12-19T13:48:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.099+0000 7f6946ffd640 1 -- 172.21.15.113:0/22390418 learned_addr learned my addr 172.21.15.113:0/22390418 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f6947fff640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815b1e0 0x7f6948156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f69477fe640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6948159f80 0x7f6948151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f6946ffd640 1 -- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815b1e0 msgr2=0x7f6948156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f6946ffd640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815b1e0 0x7f6948156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f6946ffd640 1 -- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6948159f80 msgr2=0x7f6948151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f6946ffd640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6948159f80 0x7f6948151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f6946ffd640 1 -- 172.21.15.113:0/22390418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693800bd40 con 0x7f694815aa70 2023-12-19T13:48:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f6946ffd640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f694815aa70 0x7f6948151070 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f693000c3c0 tx=0x7f693000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.100+0000 7f693ffff640 1 -- 172.21.15.113:0/22390418 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300052d0 con 0x7f694815aa70 2023-12-19T13:48:42.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.101+0000 7f693ffff640 1 -- 172.21.15.113:0/22390418 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930005450 con 0x7f694815aa70 2023-12-19T13:48:42.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.101+0000 7f693ffff640 1 -- 172.21.15.113:0/22390418 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930007260 con 0x7f694815aa70 2023-12-19T13:48:42.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.101+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6940009400 con 0x7f694815aa70 2023-12-19T13:48:42.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.101+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694806b750 con 0x7f694815aa70 2023-12-19T13:48:42.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.102+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694806b910 con 0x7f694815aa70 2023-12-19T13:48:42.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.103+0000 7f693ffff640 1 -- 172.21.15.113:0/22390418 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f69300073c0 con 0x7f694815aa70 2023-12-19T13:48:42.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.104+0000 7f693ffff640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f692806a430 0x7f692806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.104+0000 7f693ffff640 1 -- 172.21.15.113:0/22390418 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6930087c30 con 0x7f694815aa70 2023-12-19T13:48:42.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.104+0000 7f69477fe640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f692806a430 0x7f692806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.105+0000 7f69477fe640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f692806a430 0x7f692806c8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f693800bfd0 tx=0x7f693800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:42.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.108+0000 7f693ffff640 1 -- 172.21.15.113:0/22390418 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f69300532b0 con 0x7f694815aa70 2023-12-19T13:48:42.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.333+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6948061910 con 0x7f694815aa70 2023-12-19T13:48:42.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.334+0000 7f693ffff640 1 -- 172.21.15.113:0/22390418 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f69300568d0 con 0x7f694815aa70 2023-12-19T13:48:42.334 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:42.334 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:48:42.334 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:48:42.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.336+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f692806a430 msgr2=0x7f692806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.336+0000 7f694ce25640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f692806a430 0x7f692806c8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f693800bfd0 tx=0x7f693800d040 comp rx=0 tx=0).stop 2023-12-19T13:48:42.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.336+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f694815aa70 msgr2=0x7f6948151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.336+0000 7f694ce25640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f694815aa70 0x7f6948151070 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f693000c3c0 tx=0x7f693000c880 comp rx=0 tx=0).stop 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 shutdown_connections 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f692806a430 0x7f692806c8f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f694815b1e0 0x7f6948156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f694815aa70 0x7f6948151070 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 --2- 172.21.15.113:0/22390418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6948159f80 0x7f6948151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 >> 172.21.15.113:0/22390418 conn(0x7f69480b0100 msgr2=0x7f6948154520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 shutdown_connections 2023-12-19T13:48:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.337+0000 7f694ce25640 1 -- 172.21.15.113:0/22390418 wait complete. 2023-12-19T13:48:42.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:48:31.022976+0000', 'modified': '2023-12-19T13:48:34.453646+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5577}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5577': {'gid': 5577, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.113:6837/1910749856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6836', 'nonce': 1910749856}, {'type': 'v1', 'addr': '172.21.15.113:6837', 'nonce': 1910749856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:48:42.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:48:42.758 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T13:48:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.980+0000 7f5ecc3e0640 1 Processor -- start 2023-12-19T13:48:42.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.980+0000 7f5ecc3e0640 1 -- start start 2023-12-19T13:48:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5ecc3e0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5ec40b0b50 0x7f5ec406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5ecc3e0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ec406b590 0x7f5ec406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5ecc3e0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec406bb30 con 0x7f5ec41449e0 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5ecc3e0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec40b0070 con 0x7f5ec406b590 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5ecc3e0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec40b0350 con 0x7f5ec40b0b50 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5eca97d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ec406b590 0x7f5ec406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5eca97d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ec406b590 0x7f5ec406c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59584/0 (socket says 172.21.15.113:59584) 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5eca97d640 1 -- 172.21.15.113:0/2502918745 learned_addr learned my addr 172.21.15.113:0/2502918745 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5ec997b640 1 --2- 172.21.15.113:0/2502918745 >> v2:172.21.15.151:3300/0 conn(0x7f5ec40b0b50 0x7f5ec406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5eca97d640 1 -- 172.21.15.113:0/2502918745 >> v2:172.21.15.151:3300/0 conn(0x7f5ec40b0b50 msgr2=0x7f5ec406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5eca97d640 1 --2- 172.21.15.113:0/2502918745 >> v2:172.21.15.151:3300/0 conn(0x7f5ec40b0b50 0x7f5ec406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.982+0000 7f5eca97d640 1 -- 172.21.15.113:0/2502918745 >> v1:172.21.15.151:6789/0 conn(0x7f5ec41449e0 legacy=0x7f5ec40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:42.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.983+0000 7f5eca97d640 1 -- 172.21.15.113:0/2502918745 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40b0630 con 0x7f5ec406b590 2023-12-19T13:48:42.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.984+0000 7f5eca97d640 1 --2- 172.21.15.113:0/2502918745 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec406b590 0x7f5ec406c4e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4071c80 tx=0x7f5ebc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c4cb89170bad8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:42.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.984+0000 7f5ec917a640 1 -- 172.21.15.113:0/2502918745 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc02ca80 con 0x7f5ec406b590 2023-12-19T13:48:42.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.984+0000 7f5ec917a640 1 -- 172.21.15.113:0/2502918745 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc02cbe0 con 0x7f5ec406b590 2023-12-19T13:48:42.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.984+0000 7f5ec917a640 1 -- 172.21.15.113:0/2502918745 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0343f0 con 0x7f5ec406b590 2023-12-19T13:48:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2502918745 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec406b590 msgr2=0x7f5ec406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2502918745 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec406b590 0x7f5ec406c4e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4071c80 tx=0x7f5ebc02bee0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2502918745 shutdown_connections 2023-12-19T13:48:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2502918745 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec406b590 0x7f5ec406c4e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2502918745 >> v2:172.21.15.151:3300/0 conn(0x7f5ec40b0b50 0x7f5ec406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2502918745 >> 172.21.15.113:0/2502918745 conn(0x7f5ec40cbb70 msgr2=0x7f5ec40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:42.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2502918745 shutdown_connections 2023-12-19T13:48:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.985+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2502918745 wait complete. 2023-12-19T13:48:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.987+0000 7f5ecc3e0640 1 Processor -- start 2023-12-19T13:48:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.987+0000 7f5ecc3e0640 1 -- start start 2023-12-19T13:48:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ecc3e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec406b590 0x7f5ec41418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ecc3e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec40b0b50 0x7f5ec413ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ecc3e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec41449e0 0x7f5ec413ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ecc3e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec413e0c0 con 0x7f5ec40b0b50 2023-12-19T13:48:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ecc3e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec413e550 con 0x7f5ec41449e0 2023-12-19T13:48:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ecc3e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec413d210 con 0x7f5ec406b590 2023-12-19T13:48:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ec997b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec40b0b50 0x7f5ec413ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ec997b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec40b0b50 0x7f5ec413ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59588/0 (socket says 172.21.15.113:59588) 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5ec997b640 1 -- 172.21.15.113:0/2964266230 learned_addr learned my addr 172.21.15.113:0/2964266230 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.988+0000 7f5eca17c640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec406b590 0x7f5ec41418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5eca97d640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec41449e0 0x7f5ec413ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ec997b640 1 -- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec406b590 msgr2=0x7f5ec41418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ec997b640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec406b590 0x7f5ec41418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ec997b640 1 -- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec41449e0 msgr2=0x7f5ec413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ec997b640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec41449e0 0x7f5ec413ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ec997b640 1 -- 172.21.15.113:0/2964266230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc009b30 con 0x7f5ec40b0b50 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5eca97d640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec41449e0 0x7f5ec413ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ec997b640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec40b0b50 0x7f5ec413ab90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400d800 tx=0x7f5eb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ebaffd640 1 -- 172.21.15.113:0/2964266230 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400b6c0 con 0x7f5ec40b0b50 2023-12-19T13:48:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ebaffd640 1 -- 172.21.15.113:0/2964266230 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400b820 con 0x7f5ec40b0b50 2023-12-19T13:48:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec413d4b0 con 0x7f5ec40b0b50 2023-12-19T13:48:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ebaffd640 1 -- 172.21.15.113:0/2964266230 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400bbb0 con 0x7f5ec40b0b50 2023-12-19T13:48:42.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.989+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec413da70 con 0x7f5ec40b0b50 2023-12-19T13:48:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.991+0000 7f5ebaffd640 1 -- 172.21.15.113:0/2964266230 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5eb400bd10 con 0x7f5ec40b0b50 2023-12-19T13:48:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.993+0000 7f5ebaffd640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ea806a430 0x7f5ea806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.993+0000 7f5ebaffd640 1 -- 172.21.15.113:0/2964266230 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eb4088ec0 con 0x7f5ec40b0b50 2023-12-19T13:48:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.993+0000 7f5eca17c640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ea806a430 0x7f5ea806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.994+0000 7f5ecf02f740 1 Processor -- start 2023-12-19T13:48:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.994+0000 7f5ecf02f740 1 -- start start 2023-12-19T13:48:42.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.994+0000 7f5eca17c640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ea806a430 0x7f5ea806c8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000a750 tx=0x7f5ec0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cbb0d30 0x56067cbb1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb80cb0 0x56067cbadfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 0x56067cbae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067caf0f80 con 0x56067cbb0d30 2023-12-19T13:48:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067caee710 con 0x56067cb80cb0 2023-12-19T13:48:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56067caea000 con 0x56067cb848b0 2023-12-19T13:48:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cbb0d30 0x56067cbb1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cbb0d30 0x56067cbb1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59590/0 (socket says 172.21.15.113:59590) 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 -- 172.21.15.113:0/3784712510 learned_addr learned my addr 172.21.15.113:0/3784712510 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 -- 172.21.15.113:0/3784712510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 msgr2=0x56067cbae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 --2- 172.21.15.113:0/3784712510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 0x56067cbae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 -- 172.21.15.113:0/3784712510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb80cb0 msgr2=0x56067cbadfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 --2- 172.21.15.113:0/3784712510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb80cb0 0x56067cbadfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.995+0000 7f5eca17c640 1 -- 172.21.15.113:0/3784712510 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56067cab1690 con 0x56067cbb0d30 2023-12-19T13:48:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.996+0000 7f5eca17c640 1 --2- 172.21.15.113:0/3784712510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cbb0d30 0x56067cbb1110 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000c930 tx=0x7f5ec000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c369bcc2182b2f03 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.996+0000 7f5ea7fff640 1 -- 172.21.15.113:0/3784712510 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0013b80 con 0x56067cbb0d30 2023-12-19T13:48:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.996+0000 7f5ea7fff640 1 -- 172.21.15.113:0/3784712510 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0013ce0 con 0x56067cbb0d30 2023-12-19T13:48:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.996+0000 7f5ea7fff640 1 -- 172.21.15.113:0/3784712510 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec001d630 con 0x56067cbb0d30 2023-12-19T13:48:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3784712510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cbb0d30 msgr2=0x56067cbb1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3784712510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cbb0d30 0x56067cbb1110 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000c930 tx=0x7f5ec000f000 comp rx=0 tx=0).stop 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3784712510 shutdown_connections 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3784712510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 0x56067cbae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3784712510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb80cb0 0x56067cbadfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3784712510 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cbb0d30 0x56067cbb1110 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3784712510 >> 172.21.15.113:0/3784712510 conn(0x56067cb82fc0 msgr2=0x56067cbcbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3784712510 shutdown_connections 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.997+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3784712510 wait complete. 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.998+0000 7f5ecf02f740 1 -- start start 2023-12-19T13:48:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.998+0000 7f5ecf02f740 1 Processor -- start 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 0x56067cbb1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cbb0d30 0x56067cba5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cba70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067ca8b7d0 con 0x56067cba9cd0 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067ca8b470 con 0x56067cbb0d30 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56067c851f20 con 0x56067cb848b0 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5ecf02f740 10 client.0 _ll_register_callbacks cb 0x56067cada1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cba70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cba70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59596/0 (socket says 172.21.15.113:59596) 2023-12-19T13:48:43.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 -- 172.21.15.113:0/3101906470 learned_addr learned my addr 172.21.15.113:0/3101906470 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 -- 172.21.15.113:0/3101906470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 msgr2=0x56067cbb1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 0x56067cbb1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 -- 172.21.15.113:0/3101906470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cbb0d30 msgr2=0x56067cba5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cbb0d30 0x56067cba5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:42.999+0000 7f5eca97d640 1 -- 172.21.15.113:0/3101906470 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec000c5e0 con 0x56067cba9cd0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5eca97d640 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cba70d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc036040 tx=0x7f5ebc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6f279a6568e24c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ea57fa640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ea57fa640 1 -- 172.21.15.113:0/3101906470 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc034b30 con 0x56067cba9cd0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56067cb14550 con 0x56067cba9cd0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ea57fa640 1 -- 172.21.15.113:0/3101906470 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ebc034c90 con 0x56067cba9cd0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ea57fa640 1 -- 172.21.15.113:0/3101906470 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ebc034e50 con 0x56067cba9cd0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ecf02f740 10 client.5742 fetch_fsmap learned FSMap version 25 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x56067cae8680 con 0x56067cba9cd0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.000+0000 7f5ea57fa640 1 -- 172.21.15.113:0/3101906470 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56067cb14550 con 0x56067cba9cd0 2023-12-19T13:48:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ea57fa640 1 -- 172.21.15.113:0/3101906470 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5ebc03c040 con 0x56067cba9cd0 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ecf02f740 10 client.5742 fetch_fsmap finished waiting for FSMap version 25 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ecf02f740 10 client.5742 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ecf02f740 20 client.5742 populate_metadata read hostname 'smithi113' 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cbe6c00 0x56067cbe8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ecf02f740 4 client.5742 mds_command: new command op to 5577 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 --> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56067cadcb50 con 0x56067cbe6c00 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5eca17c640 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cbe6c00 0x56067cbe8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5eca17c640 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cbe6c00 0x56067cbe8ff0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=155f6f52038d7b47 server_cookie=553b45ebf7eb583e in_seq=0 out_seq=0 2023-12-19T13:48:43.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.001+0000 7f5ea57fa640 10 client.5742 ms_handle_connect on v2:172.21.15.113:6836/1910749856 2023-12-19T13:48:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.002+0000 7f5ea57fa640 1 -- 172.21.15.113:0/3101906470 <== mds.0 v2:172.21.15.113:6836/1910749856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56067cadcb50 con 0x56067cbe6c00 2023-12-19T13:48:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.002+0000 7f5ea57fa640 10 client.5742 handle_command_reply: tid=0 2023-12-19T13:48:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.002+0000 7f5ecf02f740 1 client.5742 shutdown 2023-12-19T13:48:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.002+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 msgr2=0x56067cba70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.002+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cba70d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc036040 tx=0x7f5ebc004a40 comp rx=0 tx=0).stop 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 shutdown_connections 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cba70d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cbe6c00 0x56067cbe8ff0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cbb0d30 0x56067cba5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/3101906470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cb848b0 0x56067cbb1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ea57fa640 0 client.5742 ms_handle_reset on v2:172.21.15.113:6836/1910749856 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 >> 172.21.15.113:0/3101906470 conn(0x56067cb80cb0 msgr2=0x56067cb85270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 shutdown_connections 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 1 -- 172.21.15.113:0/3101906470 wait complete. 2023-12-19T13:48:43.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.003+0000 7f5ecf02f740 20 client.5742 trim_cache size 0 max 16384 2023-12-19T13:48:43.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.019+0000 7f5ecf02f740 1 Processor -- start 2023-12-19T13:48:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.019+0000 7f5ecf02f740 1 -- start start 2023-12-19T13:48:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 0x56067cba9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cbcf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 0x56067cbcf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067caf00c0 con 0x56067cba9cd0 2023-12-19T13:48:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067cba9ac0 con 0x56067cb848b0 2023-12-19T13:48:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56067cb853c0 con 0x56067cbb0d30 2023-12-19T13:48:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cbcf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cbcf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59610/0 (socket says 172.21.15.113:59610) 2023-12-19T13:48:43.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 -- 172.21.15.113:0/369361882 learned_addr learned my addr 172.21.15.113:0/369361882 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:43.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 -- 172.21.15.113:0/369361882 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 msgr2=0x56067cbcf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 --2- 172.21.15.113:0/369361882 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 0x56067cbcf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 -- 172.21.15.113:0/369361882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 msgr2=0x56067cba9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 --2- 172.21.15.113:0/369361882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 0x56067cba9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.020+0000 7f5ec997b640 1 -- 172.21.15.113:0/369361882 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56067ca8a9e0 con 0x56067cba9cd0 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ec997b640 1 --2- 172.21.15.113:0/369361882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cbcf050 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5eb405fb80 tx=0x7f5eb4057c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875b59e25f68f7b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5eb8ff9640 1 -- 172.21.15.113:0/369361882 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40580d0 con 0x56067cba9cd0 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5eb8ff9640 1 -- 172.21.15.113:0/369361882 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb405b070 con 0x56067cba9cd0 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5eb8ff9640 1 -- 172.21.15.113:0/369361882 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb405bf00 con 0x56067cba9cd0 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ecf02f740 1 -- 172.21.15.113:0/369361882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 msgr2=0x56067cbcf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/369361882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cbcf050 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5eb405fb80 tx=0x7f5eb4057c10 comp rx=0 tx=0).stop 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ecf02f740 1 -- 172.21.15.113:0/369361882 shutdown_connections 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/369361882 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 0x56067cbcf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/369361882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cbcf050 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/369361882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 0x56067cba9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.021+0000 7f5ecf02f740 1 -- 172.21.15.113:0/369361882 >> 172.21.15.113:0/369361882 conn(0x56067cb80cb0 msgr2=0x56067cb7c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:43.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.022+0000 7f5ecf02f740 1 -- 172.21.15.113:0/369361882 shutdown_connections 2023-12-19T13:48:43.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.022+0000 7f5ecf02f740 1 -- 172.21.15.113:0/369361882 wait complete. 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.022+0000 7f5ecf02f740 1 -- start start 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.022+0000 7f5ecf02f740 1 Processor -- start 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.023+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 0x56067cc1f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.023+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cb85af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.023+0000 7f5ecf02f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 0x56067cbcf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.023+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067cc1fbc0 con 0x56067cba9cd0 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.023+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067cb86030 con 0x56067cb848b0 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.023+0000 7f5ecf02f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56067cb861d0 con 0x56067cbb0d30 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.023+0000 7f5ecf02f740 10 client.0 _ll_register_callbacks cb 0x7f5ec000a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:48:43.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cb85af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cb85af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59618/0 (socket says 172.21.15.113:59618) 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 -- 172.21.15.113:0/2789840294 learned_addr learned my addr 172.21.15.113:0/2789840294 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 -- 172.21.15.113:0/2789840294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 msgr2=0x56067cbcf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5eca17c640 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 0x56067cc1f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 0x56067cbcf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 -- 172.21.15.113:0/2789840294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 msgr2=0x56067cc1f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 0x56067cc1f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 -- 172.21.15.113:0/2789840294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec413da70 con 0x56067cba9cd0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ec997b640 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cb85af0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5eb405e180 tx=0x7f5eb4006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fb579af07c0850 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ea57fa640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ea57fa640 1 -- 172.21.15.113:0/2789840294 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb405bf00 con 0x56067cba9cd0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.024+0000 7f5ea57fa640 1 -- 172.21.15.113:0/2789840294 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eb40580d0 con 0x56067cba9cd0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ec0013ce0 con 0x56067cba9cd0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ea57fa640 1 -- 172.21.15.113:0/2789840294 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eb40575c0 con 0x56067cba9cd0 2023-12-19T13:48:43.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 10 client.5748 fetch_fsmap learned FSMap version 25 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x56067caafef0 con 0x56067cba9cd0 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ea57fa640 1 -- 172.21.15.113:0/2789840294 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0013ce0 con 0x56067cba9cd0 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ea57fa640 1 -- 172.21.15.113:0/2789840294 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5eb405fc20 con 0x56067cba9cd0 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 10 client.5748 fetch_fsmap finished waiting for FSMap version 25 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 10 client.5748 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 20 client.5748 populate_metadata read hostname 'smithi113' 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cc20010 0x56067cc203f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 4 client.5748 mds_command: new command op to 5577 tid=0[{"prefix": "status"}] 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 --> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56067cae3080 con 0x56067cc20010 2023-12-19T13:48:43.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.025+0000 7f5eca17c640 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cc20010 0x56067cc203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ea57fa640 10 client.5748 ms_handle_connect on v2:172.21.15.113:6836/1910749856 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5eca17c640 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cc20010 0x56067cc203f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73801aedf1076d6 server_cookie=fc2f1064fb05133 in_seq=0 out_seq=0 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ea57fa640 1 -- 172.21.15.113:0/2789840294 <== mds.0 v2:172.21.15.113:6836/1910749856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56067cae3080 con 0x56067cc20010 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ea57fa640 10 client.5748 handle_command_reply: tid=0 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 client.5748 shutdown 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 msgr2=0x56067cb85af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cb85af0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5eb405e180 tx=0x7f5eb4006d30 comp rx=0 tx=0).stop 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 shutdown_connections 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067cbb0d30 0x56067cbcf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56067cba9cd0 0x56067cb85af0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.113:6836/1910749856,v1:172.21.15.113:6837/1910749856] conn(0x56067cc20010 0x56067cc203f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 --2- 172.21.15.113:0/2789840294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067cb848b0 0x56067cc1f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 >> 172.21.15.113:0/2789840294 conn(0x56067cb80cb0 msgr2=0x56067cba8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:43.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.026+0000 7f5ea57fa640 0 client.5748 ms_handle_reset on v2:172.21.15.113:6836/1910749856 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 shutdown_connections 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecf02f740 1 -- 172.21.15.113:0/2789840294 wait complete. 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecf02f740 20 client.5748 trim_cache size 0 max 16384 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 5577, 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:48:43.030 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 11.998751821999999, 2023-12-19T13:48:43.031 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 25, 2023-12-19T13:48:43.031 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 48, 2023-12-19T13:48:43.031 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 48, 2023-12-19T13:48:43.031 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 17.507490479000001 2023-12-19T13:48:43.031 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:48:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ea806a430 msgr2=0x7f5ea806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ea806a430 0x7f5ea806c8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000a750 tx=0x7f5ec0008040 comp rx=0 tx=0).stop 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec40b0b50 msgr2=0x7f5ec413ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec40b0b50 0x7f5ec413ab90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400d800 tx=0x7f5eb400dcc0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 shutdown_connections 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ea806a430 0x7f5ea806c8f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec41449e0 0x7f5ec413ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ec40b0b50 0x7f5ec413ab90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 --2- 172.21.15.113:0/2964266230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec406b590 0x7f5ec41418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 >> 172.21.15.113:0/2964266230 conn(0x7f5ec40cbb70 msgr2=0x7f5ec40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.027+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 shutdown_connections 2023-12-19T13:48:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.028+0000 7f5ecc3e0640 1 -- 172.21.15.113:0/2964266230 wait complete. 2023-12-19T13:48:43.045 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:48:43.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.256+0000 7f6ea66b9640 1 Processor -- start 2023-12-19T13:48:43.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.256+0000 7f6ea66b9640 1 -- start start 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6ea66b9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6ea01449e0 0x7f6ea00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6ea66b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6ea00b0b50 0x7f6ea006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6ea66b9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00afb10 con 0x7f6ea006b590 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6ea66b9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea006bb30 con 0x7f6ea01449e0 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6ea66b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00b0070 con 0x7f6ea00b0b50 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6e9ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6ea01449e0 0x7f6ea00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6e9ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6ea01449e0 0x7f6ea00af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59626/0 (socket says 172.21.15.113:59626) 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6e9ffff640 1 -- 172.21.15.113:0/2977453450 learned_addr learned my addr 172.21.15.113:0/2977453450 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:43.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6e9f7fe640 1 --2- 172.21.15.113:0/2977453450 >> v2:172.21.15.151:3300/0 conn(0x7f6ea00b0b50 0x7f6ea006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6e9ffff640 1 -- 172.21.15.113:0/2977453450 >> v2:172.21.15.151:3300/0 conn(0x7f6ea00b0b50 msgr2=0x7f6ea006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6e9ffff640 1 --2- 172.21.15.113:0/2977453450 >> v2:172.21.15.151:3300/0 conn(0x7f6ea00b0b50 0x7f6ea006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.258+0000 7f6e9ffff640 1 -- 172.21.15.113:0/2977453450 >> v1:172.21.15.151:6789/0 conn(0x7f6ea006b590 legacy=0x7f6ea015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:43.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.259+0000 7f6e9ffff640 1 -- 172.21.15.113:0/2977453450 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00b0350 con 0x7f6ea01449e0 2023-12-19T13:48:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.260+0000 7f6e9ffff640 1 --2- 172.21.15.113:0/2977453450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea01449e0 0x7f6ea00af5d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0071c80 tx=0x7f6e9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c18c920ce19ba8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.260+0000 7f6e9effd640 1 -- 172.21.15.113:0/2977453450 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90031870 con 0x7f6ea01449e0 2023-12-19T13:48:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.260+0000 7f6e9effd640 1 -- 172.21.15.113:0/2977453450 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900319d0 con 0x7f6ea01449e0 2023-12-19T13:48:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.260+0000 7f6e9effd640 1 -- 172.21.15.113:0/2977453450 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90031d60 con 0x7f6ea01449e0 2023-12-19T13:48:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.260+0000 7f6ea66b9640 1 -- 172.21.15.113:0/2977453450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea01449e0 msgr2=0x7f6ea00af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.260+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/2977453450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea01449e0 0x7f6ea00af5d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0071c80 tx=0x7f6e9002b910 comp rx=0 tx=0).stop 2023-12-19T13:48:43.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.261+0000 7f6ea66b9640 1 -- 172.21.15.113:0/2977453450 shutdown_connections 2023-12-19T13:48:43.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.261+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/2977453450 >> v2:172.21.15.151:3300/0 conn(0x7f6ea00b0b50 0x7f6ea006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.261+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/2977453450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea01449e0 0x7f6ea00af5d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.261+0000 7f6ea66b9640 1 -- 172.21.15.113:0/2977453450 >> 172.21.15.113:0/2977453450 conn(0x7f6ea00cbb70 msgr2=0x7f6ea00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:43.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.261+0000 7f6ea66b9640 1 -- 172.21.15.113:0/2977453450 shutdown_connections 2023-12-19T13:48:43.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.261+0000 7f6ea66b9640 1 -- 172.21.15.113:0/2977453450 wait complete. 2023-12-19T13:48:43.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.262+0000 7f6ea66b9640 1 Processor -- start 2023-12-19T13:48:43.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.263+0000 7f6ea66b9640 1 -- start start 2023-12-19T13:48:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.263+0000 7f6ea66b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea006b590 0x7f6ea01f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.263+0000 7f6ea66b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ea00b0b50 0x7f6ea00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.263+0000 7f6ea66b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ea01449e0 0x7f6ea00ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.263+0000 7f6ea66b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00ab080 con 0x7f6ea006b590 2023-12-19T13:48:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.263+0000 7f6ea66b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00ab2d0 con 0x7f6ea01449e0 2023-12-19T13:48:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.263+0000 7f6ea66b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00ab5b0 con 0x7f6ea00b0b50 2023-12-19T13:48:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea006b590 0x7f6ea01f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea006b590 0x7f6ea01f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59642/0 (socket says 172.21.15.113:59642) 2023-12-19T13:48:43.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 -- 172.21.15.113:0/206812794 learned_addr learned my addr 172.21.15.113:0/206812794 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:43.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 -- 172.21.15.113:0/206812794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ea00b0b50 msgr2=0x7f6ea00ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ea00b0b50 0x7f6ea00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 -- 172.21.15.113:0/206812794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ea01449e0 msgr2=0x7f6ea00ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ea01449e0 0x7f6ea00ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 -- 172.21.15.113:0/206812794 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e900094d0 con 0x7f6ea006b590 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.264+0000 7f6e9ffff640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea006b590 0x7f6ea01f3dd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.265+0000 7f6e9cff9640 1 -- 172.21.15.113:0/206812794 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90031840 con 0x7f6ea006b590 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.265+0000 7f6e9cff9640 1 -- 172.21.15.113:0/206812794 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900443f0 con 0x7f6ea006b590 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.265+0000 7f6e9cff9640 1 -- 172.21.15.113:0/206812794 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900447a0 con 0x7f6ea006b590 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.265+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea00ab890 con 0x7f6ea006b590 2023-12-19T13:48:43.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.265+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea00ac090 con 0x7f6ea006b590 2023-12-19T13:48:43.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.266+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea00abdb0 con 0x7f6ea006b590 2023-12-19T13:48:43.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.267+0000 7f6e9cff9640 1 -- 172.21.15.113:0/206812794 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e9004d450 con 0x7f6ea006b590 2023-12-19T13:48:43.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.268+0000 7f6e9cff9640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e8006a430 0x7f6e8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:43.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.268+0000 7f6e9cff9640 1 -- 172.21.15.113:0/206812794 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e9002d040 con 0x7f6ea006b590 2023-12-19T13:48:43.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.268+0000 7f6e9f7fe640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e8006a430 0x7f6e8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:43.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.269+0000 7f6e9f7fe640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e8006a430 0x7f6e8006c8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e88006fd0 tx=0x7f6e88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:43.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.272+0000 7f6e9cff9640 1 -- 172.21.15.113:0/206812794 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ea00abdb0 con 0x7f6ea006b590 2023-12-19T13:48:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.499+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ea00abdb0 con 0x7f6ea006b590 2023-12-19T13:48:43.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.499+0000 7f6e9cff9640 1 -- 172.21.15.113:0/206812794 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6e90076690 con 0x7f6ea006b590 2023-12-19T13:48:43.499 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e8006a430 msgr2=0x7f6e8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e8006a430 0x7f6e8006c8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e88006fd0 tx=0x7f6e88008040 comp rx=0 tx=0).stop 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea006b590 msgr2=0x7f6ea01f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea006b590 0x7f6ea01f3dd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e900046c0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 shutdown_connections 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e8006a430 0x7f6e8006c8f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ea01449e0 0x7f6ea00ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ea00b0b50 0x7f6ea00ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 --2- 172.21.15.113:0/206812794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ea006b590 0x7f6ea01f3dd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:43.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 >> 172.21.15.113:0/206812794 conn(0x7f6ea00cbb70 msgr2=0x7f6ea015ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:43.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 shutdown_connections 2023-12-19T13:48:43.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:43.502+0000 7f6ea66b9640 1 -- 172.21.15.113:0/206812794 wait complete. 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:48:43.519 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:48:43.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:43.520 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:48:43.568 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42297sec preferred_lft 42297sec 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:43.569 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:43.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:43.571 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:48:43.705 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:48:43.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:43.709 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:48:43.760 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:48:43.760 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:48:43.760 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:48:43.760 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:48:43.760 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:48:43.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:43.761 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:48:43.761 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:48:43.761 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:48:43.761 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:48:43.761 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:48:43.761 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:48:43.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:43.944 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:48:43.995 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:48:43.995 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:48:43.996 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:48:43.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:43.996 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:48:44.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:48:44.092 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:48:44.148 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:48:44.148 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:48:44.148 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:48:44.200 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:48:44.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:44.201 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:48:44.333 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:48:44.333 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:48:44.364 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:48:44.364 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:48:44.364 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:48:44.364 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:48:44.364 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:48:44.366 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:48:44.366 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:48:44.366 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:48:44.366 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:48:44.366 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:48:44.370 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:48:44.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:44.370 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:48:44.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:44.451 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:48:44.509 INFO:teuthology.orchestra.run.smithi113.stdout:client5757 2023-12-19T13:48:44.510 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:44.510 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:44.554 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:48:44.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.787+0000 7f6d7a83e640 1 Processor -- start 2023-12-19T13:48:44.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.787+0000 7f6d7a83e640 1 -- start start 2023-12-19T13:48:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d7a83e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 0x7f6d7415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d7a83e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6d7406e190 0x7f6d740cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d7a83e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7415e400 con 0x7f6d740af540 2023-12-19T13:48:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d7a83e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7415daa0 con 0x7f6d7406e190 2023-12-19T13:48:44.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d7a83e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740ce780 con 0x7f6d741599c0 2023-12-19T13:48:44.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d78ddb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6d740af540 0x7f6d740ae130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60868/0 (socket says 172.21.15.113:60868) 2023-12-19T13:48:44.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d78ddb640 1 -- 172.21.15.113:0/2914068847 learned_addr learned my addr 172.21.15.113:0/2914068847 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:44.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d73fff640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 0x7f6d7415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d737fe640 1 --2- 172.21.15.113:0/2914068847 >> v2:172.21.15.151:3300/0 conn(0x7f6d7406e190 0x7f6d740cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913309100 0 0) 0x7f6d7415e400 con 0x7f6d740af540 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.789+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d5c003440 con 0x7f6d740af540 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3100438842 0 0) 0x7f6d5c003440 con 0x7f6d740af540 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 msgr2=0x7f6d7415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 0x7f6d7415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 >> v2:172.21.15.151:3300/0 conn(0x7f6d7406e190 msgr2=0x7f6d740cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 --2- 172.21.15.113:0/2914068847 >> v2:172.21.15.151:3300/0 conn(0x7f6d7406e190 0x7f6d740cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740cea60 con 0x7f6d740af540 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6d6c0019f0 con 0x7f6d740af540 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 >> v1:172.21.15.113:6789/0 conn(0x7f6d740af540 legacy=0x7f6d740ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 0x7f6d5c003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d5c004050 0x7f6d5c00a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d5c00af00 0x7f6d5c00d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7415daa0 con 0x7f6d5c00af00 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740ce780 con 0x7f6d5c004050 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c00dcf0 con 0x7f6d741599c0 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.790+0000 7f6d78ddb640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d5c00af00 0x7f6d5c00d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d73fff640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 0x7f6d5c003ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d737fe640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d5c004050 0x7f6d5c00a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d78ddb640 1 -- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 msgr2=0x7f6d5c003ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d78ddb640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 0x7f6d5c003ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d78ddb640 1 -- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d5c004050 msgr2=0x7f6d5c00a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d78ddb640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d5c004050 0x7f6d5c00a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d78ddb640 1 -- 172.21.15.113:0/2914068847 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c003440 con 0x7f6d5c00af00 2023-12-19T13:48:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.791+0000 7f6d73fff640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d741599c0 0x7f6d5c003ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:44.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.792+0000 7f6d78ddb640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d5c00af00 0x7f6d5c00d390 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00a860 tx=0x7f6d5c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2a616da01d8b6b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.793+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c034630 con 0x7f6d5c00af00 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.793+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c02f070 con 0x7f6d5c00af00 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.793+0000 7f6d72ffd640 1 -- 172.21.15.113:0/2914068847 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c034a30 con 0x7f6d5c00af00 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.793+0000 7f6d7a83e640 1 -- 172.21.15.113:0/2914068847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d5c00af00 msgr2=0x7f6d5c00d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.793+0000 7f6d7a83e640 1 --2- 172.21.15.113:0/2914068847 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d5c00af00 0x7f6d5c00d390 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00a860 tx=0x7f6d5c0036f0 comp rx=0 tx=0).stop 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.793+0000 7f6d78ddb640 1 -- 172.21.15.113:0/2914068847 reap_dead start 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.794+0000 7f6d7a83e640 1 -- 172.21.15.113:0/2914068847 shutdown_connections 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.794+0000 7f6d7a83e640 1 -- 172.21.15.113:0/2914068847 >> 172.21.15.113:0/2914068847 conn(0x7f6d740cbb70 msgr2=0x7f6d740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.794+0000 7f6d7a83e640 1 -- 172.21.15.113:0/2914068847 shutdown_connections 2023-12-19T13:48:44.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.794+0000 7f6d7a83e640 1 -- 172.21.15.113:0/2914068847 wait complete. 2023-12-19T13:48:44.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.795+0000 7f6d7a83e640 1 Processor -- start 2023-12-19T13:48:44.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.796+0000 7f6d7a83e640 1 -- start start 2023-12-19T13:48:44.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.796+0000 7f6d7a83e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d5c00af00 0x7f6d74145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d7a83e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d7415a930 0x7f6d741532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d7a83e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d740b14e0 0x7f6d740b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d7a83e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74153f80 con 0x7f6d740b14e0 2023-12-19T13:48:44.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d7a83e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b1ea0 con 0x7f6d7415a930 2023-12-19T13:48:44.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d7a83e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d741537f0 con 0x7f6d5c00af00 2023-12-19T13:48:44.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d740b14e0 0x7f6d740b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d740b14e0 0x7f6d740b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59668/0 (socket says 172.21.15.113:59668) 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 -- 172.21.15.113:0/3274339932 learned_addr learned my addr 172.21.15.113:0/3274339932 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d737fe640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d7415a930 0x7f6d741532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d73fff640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d5c00af00 0x7f6d74145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 -- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d5c00af00 msgr2=0x7f6d74145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d5c00af00 0x7f6d74145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 -- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d7415a930 msgr2=0x7f6d741532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d7415a930 0x7f6d741532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.797+0000 7f6d78ddb640 1 -- 172.21.15.113:0/3274339932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7415adf0 con 0x7f6d740b14e0 2023-12-19T13:48:44.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.798+0000 7f6d78ddb640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d740b14e0 0x7f6d740b1960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c02cba0 tx=0x7f6d6c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:44.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.798+0000 7f6d70ff9640 1 -- 172.21.15.113:0/3274339932 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c001fd0 con 0x7f6d740b14e0 2023-12-19T13:48:44.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.798+0000 7f6d70ff9640 1 -- 172.21.15.113:0/3274339932 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c034640 con 0x7f6d740b14e0 2023-12-19T13:48:44.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.798+0000 7f6d70ff9640 1 -- 172.21.15.113:0/3274339932 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0349b0 con 0x7f6d740b14e0 2023-12-19T13:48:44.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.798+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7415b0d0 con 0x7f6d740b14e0 2023-12-19T13:48:44.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.798+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7415b690 con 0x7f6d740b14e0 2023-12-19T13:48:44.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.800+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d74061910 con 0x7f6d740b14e0 2023-12-19T13:48:44.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.800+0000 7f6d70ff9640 1 -- 172.21.15.113:0/3274339932 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d6c031030 con 0x7f6d740b14e0 2023-12-19T13:48:44.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.802+0000 7f6d70ff9640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d6006a460 0x7f6d6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:44.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.802+0000 7f6d70ff9640 1 -- 172.21.15.113:0/3274339932 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d6c0aa890 con 0x7f6d740b14e0 2023-12-19T13:48:44.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.802+0000 7f6d73fff640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d6006a460 0x7f6d6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:44.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.803+0000 7f6d73fff640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d6006a460 0x7f6d6006c920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009aa0 tx=0x7f6d64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:44.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:44.806+0000 7f6d70ff9640 1 -- 172.21.15.113:0/3274339932 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d6c079910 con 0x7f6d740b14e0 2023-12-19T13:48:45.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.037+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d74061910 con 0x7f6d740b14e0 2023-12-19T13:48:45.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.037+0000 7f6d70ff9640 1 -- 172.21.15.113:0/3274339932 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6d6c0011c0 con 0x7f6d740b14e0 2023-12-19T13:48:45.037 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:48:45.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d6006a460 msgr2=0x7f6d6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d6006a460 0x7f6d6006c920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009aa0 tx=0x7f6d64008040 comp rx=0 tx=0).stop 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d740b14e0 msgr2=0x7f6d740b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d740b14e0 0x7f6d740b1960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c02cba0 tx=0x7f6d6c001d80 comp rx=0 tx=0).stop 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 shutdown_connections 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d6006a460 0x7f6d6006c920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d740b14e0 0x7f6d740b1960 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d7415a930 0x7f6d741532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 --2- 172.21.15.113:0/3274339932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d5c00af00 0x7f6d74145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 >> 172.21.15.113:0/3274339932 conn(0x7f6d740cbb70 msgr2=0x7f6d740cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 shutdown_connections 2023-12-19T13:48:45.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:45.040+0000 7f6d7a83e640 1 -- 172.21.15.113:0/3274339932 wait complete. 2023-12-19T13:48:45.057 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:48:45.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:48:45.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:48:45.057 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:48:45.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:48:45.057 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:48:45.057 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:48:45.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:48:45.058 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:48:45.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.058 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:48:45.117 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:48:45.117 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:48:45.117 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:48:45.117 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:45.117 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:48:45.117 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:45.117 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42270sec preferred_lft 42270sec 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:45.118 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:48:45.119 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:48:45.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.122 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:48:45.212 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:48:45.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.216 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:48:45.270 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:48:45.270 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:48:45.271 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:48:45.271 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:48:45.271 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:48:45.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.271 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:48:45.271 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:48:45.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:48:45.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:48:45.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:48:45.272 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:48:45.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.450 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:48:45.500 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:48:45.500 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:48:45.501 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:48:45.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:48:45.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:48:45.591 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:48:45.642 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:48:45.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:48:45.643 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:48:45.692 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:48:45.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:48:45.833 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:48:45.833 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:48:45.866 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:48:45.866 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:48:45.866 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:48:45.866 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:48:45.866 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:48:45.868 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:48:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:48:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:48:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:48:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:48:45.872 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:48:45.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.872 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:48:45.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:45.951 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:48:46.004 INFO:teuthology.orchestra.run.smithi151.stdout:client5766 2023-12-19T13:48:46.004 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:48:46.004 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:46.056 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:46.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.281+0000 7f7388810640 1 Processor -- start 2023-12-19T13:48:46.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.282+0000 7f7388810640 1 -- start start 2023-12-19T13:48:46.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.283+0000 7f7388810640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7384157aa0 0x7f73840b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:46.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.283+0000 7f7388810640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f738415e040 0x7f738415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:46.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.283+0000 7f7388810640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738406e8c0 con 0x7f738406e410 2023-12-19T13:48:46.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.283+0000 7f7388810640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738415e9f0 con 0x7f738415e040 2023-12-19T13:48:46.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.283+0000 7f7388810640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840b2600 con 0x7f7384157aa0 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.283+0000 7f7382d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f738415e040 0x7f738415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f7382d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f738415e040 0x7f738415e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59676/0 (socket says 172.21.15.113:59676) 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f737bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f738406e410 0x7f7384161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60884/0 (socket says 172.21.15.113:60884) 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f7382d9d640 1 -- 172.21.15.113:0/3957797085 learned_addr learned my addr 172.21.15.113:0/3957797085 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f738259c640 1 --2- 172.21.15.113:0/3957797085 >> v2:172.21.15.151:3300/0 conn(0x7f7384157aa0 0x7f73840b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f7382d9d640 1 -- 172.21.15.113:0/3957797085 >> v2:172.21.15.151:3300/0 conn(0x7f7384157aa0 msgr2=0x7f73840b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f7382d9d640 1 --2- 172.21.15.113:0/3957797085 >> v2:172.21.15.151:3300/0 conn(0x7f7384157aa0 0x7f73840b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f7382d9d640 1 -- 172.21.15.113:0/3957797085 >> v1:172.21.15.113:6789/0 conn(0x7f738406e410 legacy=0x7f7384161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:46.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f7382d9d640 1 -- 172.21.15.113:0/3957797085 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73840b1d60 con 0x7f738415e040 2023-12-19T13:48:46.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f738259c640 1 --2- 172.21.15.113:0/3957797085 >> v2:172.21.15.151:3300/0 conn(0x7f7384157aa0 0x7f73840b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:46.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.284+0000 7f7381d9b640 1 -- 172.21.15.113:0/3957797085 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226199835 0 0) 0x7f738406e8c0 con 0x7f738406e410 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.285+0000 7f7382d9d640 1 --2- 172.21.15.113:0/3957797085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f738415e040 0x7f738415e4b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f73840cc8c0 tx=0x7f737c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3a832b6e09f034 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7381d9b640 1 -- 172.21.15.113:0/3957797085 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c02cb10 con 0x7f738415e040 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7381d9b640 1 -- 172.21.15.113:0/3957797085 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c02cc70 con 0x7f738415e040 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7381d9b640 1 -- 172.21.15.113:0/3957797085 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c0343f0 con 0x7f738415e040 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 -- 172.21.15.113:0/3957797085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f738415e040 msgr2=0x7f738415e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 --2- 172.21.15.113:0/3957797085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f738415e040 0x7f738415e4b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f73840cc8c0 tx=0x7f737c02bf70 comp rx=0 tx=0).stop 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 -- 172.21.15.113:0/3957797085 shutdown_connections 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 --2- 172.21.15.113:0/3957797085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f738415e040 0x7f738415e4b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 --2- 172.21.15.113:0/3957797085 >> v2:172.21.15.151:3300/0 conn(0x7f7384157aa0 0x7f73840b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 -- 172.21.15.113:0/3957797085 >> 172.21.15.113:0/3957797085 conn(0x7f73840cbb70 msgr2=0x7f73840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:46.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 -- 172.21.15.113:0/3957797085 shutdown_connections 2023-12-19T13:48:46.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.286+0000 7f7388810640 1 -- 172.21.15.113:0/3957797085 wait complete. 2023-12-19T13:48:46.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.288+0000 7f7388810640 1 Processor -- start 2023-12-19T13:48:46.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.288+0000 7f7388810640 1 -- start start 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f7388810640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f738406e410 0x7f7384154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f7388810640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7384157aa0 0x7f73841599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f7388810640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f738415e040 0x7f7384159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f7388810640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7384154930 con 0x7f7384157aa0 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f7388810640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738415a540 con 0x7f738415e040 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f7388810640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738415a820 con 0x7f738406e410 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f737bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7384157aa0 0x7f73841599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f737bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7384157aa0 0x7f73841599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59686/0 (socket says 172.21.15.113:59686) 2023-12-19T13:48:46.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.289+0000 7f737bfff640 1 -- 172.21.15.113:0/1179281478 learned_addr learned my addr 172.21.15.113:0/1179281478 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:46.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737bfff640 1 -- 172.21.15.113:0/1179281478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f738406e410 msgr2=0x7f7384154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737bfff640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f738406e410 0x7f7384154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737bfff640 1 -- 172.21.15.113:0/1179281478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f738415e040 msgr2=0x7f7384159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737bfff640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f738415e040 0x7f7384159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737bfff640 1 -- 172.21.15.113:0/1179281478 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c009b30 con 0x7f7384157aa0 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737bfff640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7384157aa0 0x7f73841599d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f736c00c430 tx=0x7f736c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737affd640 1 -- 172.21.15.113:0/1179281478 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0074e0 con 0x7f7384157aa0 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737affd640 1 -- 172.21.15.113:0/1179281478 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c007660 con 0x7f7384157aa0 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f737affd640 1 -- 172.21.15.113:0/1179281478 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c004a20 con 0x7f7384157aa0 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7384154ba0 con 0x7f7384157aa0 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.290+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738415ab00 con 0x7f7384157aa0 2023-12-19T13:48:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.291+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7384154de0 con 0x7f7384157aa0 2023-12-19T13:48:46.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.292+0000 7f737affd640 1 -- 172.21.15.113:0/1179281478 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f736c004b80 con 0x7f7384157aa0 2023-12-19T13:48:46.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.293+0000 7f737affd640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f736406a430 0x7f736406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:46.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.294+0000 7f737affd640 1 -- 172.21.15.113:0/1179281478 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f736c0887f0 con 0x7f7384157aa0 2023-12-19T13:48:46.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.294+0000 7f738259c640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f736406a430 0x7f736406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:46.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.294+0000 7f738259c640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f736406a430 0x7f736406c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7374006fd0 tx=0x7f7374008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:46.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.298+0000 7f737affd640 1 -- 172.21.15.113:0/1179281478 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7384154de0 con 0x7f7384157aa0 2023-12-19T13:48:46.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.526+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7384154de0 con 0x7f7384157aa0 2023-12-19T13:48:46.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.527+0000 7f737affd640 1 -- 172.21.15.113:0/1179281478 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f7384154de0 con 0x7f7384157aa0 2023-12-19T13:48:46.527 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:46.527 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:48:46.527 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:48:46.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.530+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f736406a430 msgr2=0x7f736406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:46.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.530+0000 7f7388810640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f736406a430 0x7f736406c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7374006fd0 tx=0x7f7374008040 comp rx=0 tx=0).stop 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.530+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7384157aa0 msgr2=0x7f73841599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.530+0000 7f7388810640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7384157aa0 0x7f73841599d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f736c00c430 tx=0x7f736c00c8f0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 shutdown_connections 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f736406a430 0x7f736406c8f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f738415e040 0x7f7384159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7384157aa0 0x7f73841599d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 --2- 172.21.15.113:0/1179281478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f738406e410 0x7f7384154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 >> 172.21.15.113:0/1179281478 conn(0x7f73840cbb70 msgr2=0x7f738415b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 shutdown_connections 2023-12-19T13:48:46.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:46.531+0000 7f7388810640 1 -- 172.21.15.113:0/1179281478 wait complete. 2023-12-19T13:48:46.550 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T13:48:46.766 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":5577,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.724241065999999,"mdsmap_epoch":25,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":21.232991309999999} 2023-12-19T13:48:46.767 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 5577, "mdsmap_epoch": 25, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 15.724241066, "state": "up:active", "uptime": 21.23299131, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:48:46.767 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:48:46.993 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:48:46.993 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:48:46.994 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-19T13:48:46.994 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:46.994 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:47.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:47.050 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-19T13:48:47.457 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:47.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:49.004 INFO:teuthology.orchestra.run.smithi113.stderr:265+0 records in 2023-12-19T13:48:49.004 INFO:teuthology.orchestra.run.smithi113.stderr:265+0 records out 2023-12-19T13:48:49.004 INFO:teuthology.orchestra.run.smithi113.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.89998 s, 146 MB/s 2023-12-19T13:48:49.006 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:49.006 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:49.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:49.052 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-19T13:48:51.165 INFO:teuthology.orchestra.run.smithi113.stderr:292+0 records in 2023-12-19T13:48:51.165 INFO:teuthology.orchestra.run.smithi113.stderr:292+0 records out 2023-12-19T13:48:51.166 INFO:teuthology.orchestra.run.smithi113.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.01793 s, 152 MB/s 2023-12-19T13:48:51.166 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T13:48:51.167 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:48:51.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.342+0000 7f377f1bf640 1 Processor -- start 2023-12-19T13:48:51.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.343+0000 7f377f1bf640 1 -- start start 2023-12-19T13:48:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.344+0000 7f377f1bf640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f377815b1e0 0x7f377815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.344+0000 7f377f1bf640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f377815a8a0 0x7f377815b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.344+0000 7f377f1bf640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377806b520 con 0x7f3778159f80 2023-12-19T13:48:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.344+0000 7f377f1bf640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780b2b20 con 0x7f377815a8a0 2023-12-19T13:48:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.344+0000 7f377f1bf640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37780b2fb0 con 0x7f377815b1e0 2023-12-19T13:48:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.344+0000 7f377e1bd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3778159f80 0x7f377806f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48826/0 (socket says 172.21.15.113:48826) 2023-12-19T13:48:51.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.344+0000 7f377e1bd640 1 -- 172.21.15.113:0/4244634540 learned_addr learned my addr 172.21.15.113:0/4244634540 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551506954 0 0) 0x7f377806b520 con 0x7f3778159f80 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3768003520 con 0x7f3778159f80 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377e9be640 1 --2- 172.21.15.113:0/4244634540 >> v2:172.21.15.151:3300/0 conn(0x7f377815a8a0 0x7f377815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d9bc640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f377815b1e0 0x7f377815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653865869 0 0) 0x7f3768003520 con 0x7f3778159f80 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f377815b1e0 msgr2=0x7f377815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f377815b1e0 0x7f377815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 >> v2:172.21.15.151:3300/0 conn(0x7f377815a8a0 msgr2=0x7f377815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 --2- 172.21.15.113:0/4244634540 >> v2:172.21.15.151:3300/0 conn(0x7f377815a8a0 0x7f377815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780b1f10 con 0x7f3778159f80 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f376c0019f0 con 0x7f3778159f80 2023-12-19T13:48:51.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 >> v1:172.21.15.113:6789/0 conn(0x7f3778159f80 legacy=0x7f377806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3768003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f377815b1e0 0x7f37680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3768004d00 0x7f3768005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780b2b20 con 0x7f3768003970 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780b2fb0 con 0x7f3768004d00 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.345+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376800bab0 con 0x7f377815b1e0 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.346+0000 7f377e1bd640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3768003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.346+0000 7f377e1bd640 1 -- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f377815b1e0 msgr2=0x7f37680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.346+0000 7f377e1bd640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f377815b1e0 0x7f37680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.346+0000 7f377e1bd640 1 -- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3768004d00 msgr2=0x7f3768005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.346+0000 7f377e1bd640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3768004d00 0x7f3768005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.346+0000 7f377e1bd640 1 -- 172.21.15.113:0/4244634540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768003520 con 0x7f3768003970 2023-12-19T13:48:51.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.347+0000 7f377e1bd640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3768003d90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f376c00a440 tx=0x7f37680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349f092f97acaf81 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:51.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.347+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c035640 con 0x7f3768003970 2023-12-19T13:48:51.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.347+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0357a0 con 0x7f3768003970 2023-12-19T13:48:51.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.347+0000 7f377d1bb640 1 -- 172.21.15.113:0/4244634540 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c035b70 con 0x7f3768003970 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.347+0000 7f377f1bf640 1 -- 172.21.15.113:0/4244634540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 msgr2=0x7f3768003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.347+0000 7f377f1bf640 1 --2- 172.21.15.113:0/4244634540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3768003d90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f376c00a440 tx=0x7f37680057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.348+0000 7f377e9be640 1 -- 172.21.15.113:0/4244634540 reap_dead start 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.348+0000 7f377f1bf640 1 -- 172.21.15.113:0/4244634540 shutdown_connections 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.348+0000 7f377f1bf640 1 -- 172.21.15.113:0/4244634540 >> 172.21.15.113:0/4244634540 conn(0x7f37780b0100 msgr2=0x7f37780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.348+0000 7f377f1bf640 1 -- 172.21.15.113:0/4244634540 shutdown_connections 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.348+0000 7f377f1bf640 1 -- 172.21.15.113:0/4244634540 wait complete. 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.349+0000 7f377f1bf640 1 Processor -- start 2023-12-19T13:48:51.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.350+0000 7f377f1bf640 1 -- start start 2023-12-19T13:48:51.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377f1bf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3778155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3778155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:51.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3778155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34914/0 (socket says 172.21.15.113:34914) 2023-12-19T13:48:51.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377f1bf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3778140f70 0x7f37780ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 -- 172.21.15.113:0/1997268649 learned_addr learned my addr 172.21.15.113:0/1997268649 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:51.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377f1bf640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37781413f0 0x7f37780acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778140b70 con 0x7f3768003970 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780cb600 con 0x7f3778140f70 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377813e3f0 con 0x7f37781413f0 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 -- 172.21.15.113:0/1997268649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37781413f0 msgr2=0x7f37780acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37781413f0 0x7f37780acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 -- 172.21.15.113:0/1997268649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3778140f70 msgr2=0x7f37780ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3778140f70 0x7f37780ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.351+0000 7f377e1bd640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37781407d0 con 0x7f3768003970 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.352+0000 7f377e1bd640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3778155af0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f376c001cb0 tx=0x7f376c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.352+0000 7f3776ffd640 1 -- 172.21.15.113:0/1997268649 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c035d20 con 0x7f3768003970 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.352+0000 7f3776ffd640 1 -- 172.21.15.113:0/1997268649 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c035e80 con 0x7f3768003970 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.352+0000 7f3776ffd640 1 -- 172.21.15.113:0/1997268649 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c040620 con 0x7f3768003970 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.352+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3778156340 con 0x7f3768003970 2023-12-19T13:48:51.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.352+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778156030 con 0x7f3768003970 2023-12-19T13:48:51.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.353+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3778061910 con 0x7f3768003970 2023-12-19T13:48:51.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.354+0000 7f3776ffd640 1 -- 172.21.15.113:0/1997268649 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f376c040780 con 0x7f3768003970 2023-12-19T13:48:51.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.355+0000 7f3776ffd640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f375c06a430 0x7f375c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:51.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.355+0000 7f3776ffd640 1 -- 172.21.15.113:0/1997268649 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f376c0ab1b0 con 0x7f3768003970 2023-12-19T13:48:51.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.355+0000 7f377d9bc640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f375c06a430 0x7f375c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:51.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.356+0000 7f377d9bc640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f375c06a430 0x7f375c06c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3764006f00 tx=0x7f3764008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.360+0000 7f3776ffd640 1 -- 172.21.15.113:0/1997268649 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f376c07a2d0 con 0x7f3768003970 2023-12-19T13:48:51.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.537+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3778154c60 con 0x7f3768003970 2023-12-19T13:48:51.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.541+0000 7f3776ffd640 1 -- 172.21.15.113:0/1997268649 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+33524 (secure 0 0 0) 0x7f376c001fd0 con 0x7f3768003970 2023-12-19T13:48:51.541 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:51.541 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:48:51.541 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 48, 2023-12-19T13:48:51.541 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:48:51.541 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:48:32.028059+0000", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:48:51.542 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 7, 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:48:51.543 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:48:51.544 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "16", 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:51.545 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:51.546 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:51.547 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:48:51.548 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 6, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:28.798187+0000", 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:51.549 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:51.550 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "47", 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:51.551 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:51.552 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:51.553 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:48:51.554 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 7, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:30.040745+0000", 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:51.555 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:51.556 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "48", 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:51.557 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:51.558 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:51.559 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:48:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.561 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.562 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.563 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:48:51.564 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:51.565 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.566 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:48:51.567 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.570 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.572 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.573 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.575 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.576 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.577 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.578 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.580 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.581 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.582 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.584 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.586 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:48:51.587 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.588 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.589 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:48:51.590 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.591 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.592 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.593 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:48:51.594 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.596 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.597 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.599 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.600 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:48:51.602 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:51.603 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.604 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.605 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.606 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.607 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:48:51.609 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:48:51.610 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:51.611 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.543+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f375c06a430 msgr2=0x7f375c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.543+0000 7f377f1bf640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f375c06a430 0x7f375c06c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3764006f00 tx=0x7f3764008040 comp rx=0 tx=0).stop 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.543+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 msgr2=0x7f3778155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.543+0000 7f377f1bf640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3778155af0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f376c001cb0 tx=0x7f376c001d80 comp rx=0 tx=0).stop 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 shutdown_connections 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f375c06a430 0x7f375c06c8f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37781413f0 0x7f37780acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3778140f70 0x7f37780ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 --2- 172.21.15.113:0/1997268649 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3768003970 0x7f3778155af0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:51.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 >> 172.21.15.113:0/1997268649 conn(0x7f37780b0100 msgr2=0x7f3778154470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:51.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 shutdown_connections 2023-12-19T13:48:51.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:51.544+0000 7f377f1bf640 1 -- 172.21.15.113:0/1997268649 wait complete. 2023-12-19T13:48:51.614 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:48:52.515 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:48:52.515+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-19T13:48:56.615 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:48:56.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.838+0000 7f613ed5c640 1 Processor -- start 2023-12-19T13:48:56.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.838+0000 7f613ed5c640 1 -- start start 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613ed5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61380b0b50 0x7f613806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613ed5c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f613806b590 0x7f613806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613ed5c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613806bb30 con 0x7f61381449e0 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613ed5c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61380b0070 con 0x7f613806b590 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613ed5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61380b0350 con 0x7f61380b0b50 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613d2f9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f613806b590 0x7f613806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613d2f9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f613806b590 0x7f613806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34922/0 (socket says 172.21.15.113:34922) 2023-12-19T13:48:56.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.840+0000 7f613d2f9640 1 -- 172.21.15.113:0/3331856164 learned_addr learned my addr 172.21.15.113:0/3331856164 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:56.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.841+0000 7f6137fff640 1 --2- 172.21.15.113:0/3331856164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61380b0b50 0x7f613806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:56.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.841+0000 7f613d2f9640 1 -- 172.21.15.113:0/3331856164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61380b0b50 msgr2=0x7f613806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:56.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.841+0000 7f613d2f9640 1 --2- 172.21.15.113:0/3331856164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61380b0b50 0x7f613806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:56.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.841+0000 7f613d2f9640 1 -- 172.21.15.113:0/3331856164 >> v1:172.21.15.151:6789/0 conn(0x7f61381449e0 legacy=0x7f61380af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:56.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.841+0000 7f613d2f9640 1 -- 172.21.15.113:0/3331856164 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61380b0630 con 0x7f613806b590 2023-12-19T13:48:56.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.842+0000 7f613d2f9640 1 --2- 172.21.15.113:0/3331856164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f613806c4e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f61380b2960 tx=0x7f613002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1fd93a2b60ddb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:56.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.842+0000 7f61377fe640 1 -- 172.21.15.113:0/3331856164 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613002ca30 con 0x7f613806b590 2023-12-19T13:48:56.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.842+0000 7f61377fe640 1 -- 172.21.15.113:0/3331856164 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613002cb90 con 0x7f613806b590 2023-12-19T13:48:56.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.842+0000 7f61377fe640 1 -- 172.21.15.113:0/3331856164 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300343f0 con 0x7f613806b590 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 -- 172.21.15.113:0/3331856164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 msgr2=0x7f613806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3331856164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f613806c4e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f61380b2960 tx=0x7f613002be90 comp rx=0 tx=0).stop 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 -- 172.21.15.113:0/3331856164 shutdown_connections 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3331856164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f613806c4e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3331856164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61380b0b50 0x7f613806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 -- 172.21.15.113:0/3331856164 >> 172.21.15.113:0/3331856164 conn(0x7f61380cbb70 msgr2=0x7f61380cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 -- 172.21.15.113:0/3331856164 shutdown_connections 2023-12-19T13:48:56.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.843+0000 7f613ed5c640 1 -- 172.21.15.113:0/3331856164 wait complete. 2023-12-19T13:48:56.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.845+0000 7f613ed5c640 1 Processor -- start 2023-12-19T13:48:56.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.845+0000 7f613ed5c640 1 -- start start 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613ed5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f61381f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613ed5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61380b0b50 0x7f613813df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613ed5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61381449e0 0x7f6138140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613ed5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61381f1910 con 0x7f613806b590 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613ed5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613815a530 con 0x7f61380b0b50 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613ed5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61381f0c90 con 0x7f61381449e0 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f61381f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f61381f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34926/0 (socket says 172.21.15.113:34926) 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 -- 172.21.15.113:0/3056214365 learned_addr learned my addr 172.21.15.113:0/3056214365 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:56.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f6137fff640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61380b0b50 0x7f613813df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613d2f9640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61381449e0 0x7f6138140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 -- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61381449e0 msgr2=0x7f6138140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61381449e0 0x7f6138140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 -- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61380b0b50 msgr2=0x7f613813df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61380b0b50 0x7f613813df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f613caf8640 1 -- 172.21.15.113:0/3056214365 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130009b30 con 0x7f613806b590 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.846+0000 7f6137fff640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61380b0b50 0x7f613813df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:56.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.847+0000 7f613caf8640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f61381f4940 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f612c00b3f0 tx=0x7f612c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:56.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.847+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c011830 con 0x7f613806b590 2023-12-19T13:48:56.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.847+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c011990 con 0x7f613806b590 2023-12-19T13:48:56.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.847+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c011d40 con 0x7f613806b590 2023-12-19T13:48:56.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.847+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61381f0f70 con 0x7f613806b590 2023-12-19T13:48:56.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.847+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61381f1530 con 0x7f613806b590 2023-12-19T13:48:56.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.848+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6138061910 con 0x7f613806b590 2023-12-19T13:48:56.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.849+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f612c01a400 con 0x7f613806b590 2023-12-19T13:48:56.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.850+0000 7f61357fa640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f611c06a430 0x7f611c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:56.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.850+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f612c0886d0 con 0x7f613806b590 2023-12-19T13:48:56.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.850+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7f611c071f60 con 0x7f613806b590 2023-12-19T13:48:56.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.850+0000 7f6137fff640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f611c06a430 0x7f611c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:56.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.851+0000 7f6137fff640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f611c06a430 0x7f611c06c8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f613813d7c0 tx=0x7f6124008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:56.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:56.855+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f612c015060 con 0x7f613806b590 2023-12-19T13:48:57.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.048+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f61380af180 con 0x7f613806b590 2023-12-19T13:48:57.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.052+0000 7f61357fa640 1 -- 172.21.15.113:0/3056214365 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+33683 (secure 0 0 0) 0x7f612c053d50 con 0x7f613806b590 2023-12-19T13:48:57.053 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:57.053 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:48:57.053 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 52, 2023-12-19T13:48:57.053 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:48:57.053 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:48:56.554090+0000", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:48:57.054 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 7, 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:48:57.055 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:48:57.056 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:57.057 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:57.058 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:57.059 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.060 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.061 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 6, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:28.798187+0000", 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:57.062 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.063 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:57.064 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:57.065 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:48:57.066 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:57.067 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 7, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:30.040745+0000", 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:57.068 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:57.069 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:57.070 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:57.071 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:57.072 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:57.072 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:57.072 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:57.072 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:57.072 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:57.072 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:57.072 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:57.073 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:57.074 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.075 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.076 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.077 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.078 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.079 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.080 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.081 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.082 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.084 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.085 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.086 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.087 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.088 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.089 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.090 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.091 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.092 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:48:57.093 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:48:57.094 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:48:57.095 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:48:57.096 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:48:57.097 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.098 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:48:57.099 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.100 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.101 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.102 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.103 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.104 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:48:57.105 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:48:57.106 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.107 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:48:57.108 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.109 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.110 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.111 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.112 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.113 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.114 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:57.115 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.116 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.117 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.118 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:57.119 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.120 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.121 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.122 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.124 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:57.125 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:48:57.126 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:48:57.127 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:48:57.128 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:48:57.128 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:48:57.128 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:48:57.128 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.128 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.054+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f611c06a430 msgr2=0x7f611c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.054+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f611c06a430 0x7f611c06c8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f613813d7c0 tx=0x7f6124008040 comp rx=0 tx=0).stop 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 msgr2=0x7f61381f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f61381f4940 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f612c00b3f0 tx=0x7f612c00b8b0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 shutdown_connections 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f611c06a430 0x7f611c06c8f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61381449e0 0x7f6138140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61380b0b50 0x7f613813df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 --2- 172.21.15.113:0/3056214365 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f613806b590 0x7f61381f4940 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 >> 172.21.15.113:0/3056214365 conn(0x7f61380cbb70 msgr2=0x7f613806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 shutdown_connections 2023-12-19T13:48:57.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.055+0000 7f613ed5c640 1 -- 172.21.15.113:0/3056214365 wait complete. 2023-12-19T13:48:57.131 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T13:48:57.131 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:57.131 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:57.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:57.185 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-19T13:48:57.563 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:48:57.562+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-19T13:48:57.582 INFO:teuthology.orchestra.run.smithi113.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T13:48:57.582 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T13:48:57.582 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T13:48:57.582 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.329737 s, 159 MB/s 2023-12-19T13:48:57.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:48:57.583 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:48:57.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.773+0000 7fb5b26b2640 1 Processor -- start 2023-12-19T13:48:57.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.774+0000 7fb5b26b2640 1 -- start start 2023-12-19T13:48:57.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.775+0000 7fb5b26b2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5ac161810 0x7fb5ac0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.775+0000 7fb5b26b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.775+0000 7fb5b26b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb5ac0ce490 0x7fb5ac165260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.775+0000 7fb5b26b2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac161bf0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.775+0000 7fb5b26b2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b22b0 con 0x7fb5ac161810 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.775+0000 7fb5b26b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b2830 con 0x7fb5ac0cc8a0 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb5ac0ce490 0x7fb5ac165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb5ac0ce490 0x7fb5ac165260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34928/0 (socket says 172.21.15.113:34928) 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 -- 172.21.15.113:0/2390157188 learned_addr learned my addr 172.21.15.113:0/2390157188 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b16b0640 1 --2- 172.21.15.113:0/2390157188 >> v2:172.21.15.151:3300/0 conn(0x7fb5ac161810 0x7fb5ac0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b0eaf640 1 --2- 172.21.15.113:0/2390157188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 -- 172.21.15.113:0/2390157188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 msgr2=0x7fb5ac0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:57.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 --2- 172.21.15.113:0/2390157188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac0cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 -- 172.21.15.113:0/2390157188 >> v2:172.21.15.151:3300/0 conn(0x7fb5ac161810 msgr2=0x7fb5ac0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:57.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 --2- 172.21.15.113:0/2390157188 >> v2:172.21.15.151:3300/0 conn(0x7fb5ac161810 0x7fb5ac0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.776+0000 7fb5b1eb1640 1 -- 172.21.15.113:0/2390157188 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0b2550 con 0x7fb5ac0ce490 2023-12-19T13:48:57.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.777+0000 7fb5b1eb1640 1 --2- 172.21.15.113:0/2390157188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac165260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac070e30 tx=0x7fb5a402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2ea88f6fc0e6d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:57.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5a3fff640 1 -- 172.21.15.113:0/2390157188 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a402c9e0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5a3fff640 1 -- 172.21.15.113:0/2390157188 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a402cb40 con 0x7fb5ac0ce490 2023-12-19T13:48:57.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5a3fff640 1 -- 172.21.15.113:0/2390157188 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40343f0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5b26b2640 1 -- 172.21.15.113:0/2390157188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 msgr2=0x7fb5ac165260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:57.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/2390157188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac165260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac070e30 tx=0x7fb5a402be40 comp rx=0 tx=0).stop 2023-12-19T13:48:57.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5b26b2640 1 -- 172.21.15.113:0/2390157188 shutdown_connections 2023-12-19T13:48:57.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/2390157188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac165260 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/2390157188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac0cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.778+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/2390157188 >> v2:172.21.15.151:3300/0 conn(0x7fb5ac161810 0x7fb5ac0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.779+0000 7fb5b26b2640 1 -- 172.21.15.113:0/2390157188 >> 172.21.15.113:0/2390157188 conn(0x7fb5ac0b0100 msgr2=0x7fb5ac0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:57.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.779+0000 7fb5b26b2640 1 -- 172.21.15.113:0/2390157188 shutdown_connections 2023-12-19T13:48:57.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.779+0000 7fb5b26b2640 1 -- 172.21.15.113:0/2390157188 wait complete. 2023-12-19T13:48:57.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.781+0000 7fb5b26b2640 1 Processor -- start 2023-12-19T13:48:57.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.781+0000 7fb5b26b2640 1 -- start start 2023-12-19T13:48:57.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.782+0000 7fb5b26b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac1fa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:57.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.782+0000 7fb5b26b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:57.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.782+0000 7fb5b26b2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5ac161810 0x7fb5ac1640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:57.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.782+0000 7fb5b26b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1593f0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.782+0000 7fb5b26b2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac158b50 con 0x7fb5ac161810 2023-12-19T13:48:57.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.782+0000 7fb5b26b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac158e30 con 0x7fb5ac0cc8a0 2023-12-19T13:48:57.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:57.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34940/0 (socket says 172.21.15.113:34940) 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 -- 172.21.15.113:0/1721068083 learned_addr learned my addr 172.21.15.113:0/1721068083 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b1eb1640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5ac161810 0x7fb5ac1640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b16b0640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac1fa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 -- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 msgr2=0x7fb5ac1fa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac1fa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 -- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5ac161810 msgr2=0x7fb5ac1640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5ac161810 0x7fb5ac1640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b0eaf640 1 -- 172.21.15.113:0/1721068083 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a4009b30 con 0x7fb5ac0ce490 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.783+0000 7fb5b1eb1640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5ac161810 0x7fb5ac1640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.784+0000 7fb5b0eaf640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac156230 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c540 tx=0x7fb59c00ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.784+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c011800 con 0x7fb5ac0ce490 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.784+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c011960 con 0x7fb5ac0ce490 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.784+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c011cd0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.784+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac159110 con 0x7fb5ac0ce490 2023-12-19T13:48:57.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.784+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac147d20 con 0x7fb5ac0ce490 2023-12-19T13:48:57.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.785+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac15ee00 con 0x7fb5ac0ce490 2023-12-19T13:48:57.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.786+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb59c018360 con 0x7fb5ac0ce490 2023-12-19T13:48:57.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.787+0000 7fb5a1ffb640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb59006a430 0x7fb59006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:57.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.787+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb59c0884a0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.787+0000 7fb5b16b0640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb59006a430 0x7fb59006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:57.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.787+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7fb590071f60 con 0x7fb5ac0ce490 2023-12-19T13:48:57.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.788+0000 7fb5b16b0640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb59006a430 0x7fb59006c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8006fd0 tx=0x7fb5a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.791+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5ac15ee00 con 0x7fb5ac0ce490 2023-12-19T13:48:57.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.985+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb5ac15f1e0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.986+0000 7fb5a1ffb640 1 -- 172.21.15.113:0/1721068083 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+33739 (secure 0 0 0) 0x7fb5ac15f1e0 con 0x7fb5ac0ce490 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 53, 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:48:57.564189+0000", 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:48:57.988 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 7, 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:48:57.989 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:57.990 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:57.991 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:57.991 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:57.991 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:57.991 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:48:57.991 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:57.992 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:57.993 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:57.994 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:48:57.995 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 6, 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:48:57.996 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:28.798187+0000", 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:48:57.997 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:57.998 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:57.999 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:58.000 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:58.001 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:48:58.002 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 7, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:30.040745+0000", 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:58.003 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:58.004 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:58.005 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:58.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:58.007 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:48:58.008 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.009 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.010 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:48:58.011 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.012 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:48:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:48:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.027 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.028 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.029 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.030 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:48:58.031 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.032 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.033 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:48:58.037 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.038 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.039 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.040 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.041 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.042 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.043 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.044 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.045 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.046 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.047 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:48:58.048 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:58.049 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.050 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:48:58.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:48:58.053 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:58.054 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.055 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.056 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.058 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:48:58.060 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:48:58.061 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:58.062 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:48:58.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb59006a430 msgr2=0x7fb59006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb59006a430 0x7fb59006c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8006fd0 tx=0x7fb5a8008040 comp rx=0 tx=0).stop 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 msgr2=0x7fb5ac156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac156230 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c540 tx=0x7fb59c00ca00 comp rx=0 tx=0).stop 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 shutdown_connections 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb59006a430 0x7fb59006c8f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5ac161810 0x7fb5ac1640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5ac0ce490 0x7fb5ac156230 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 --2- 172.21.15.113:0/1721068083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5ac0cc8a0 0x7fb5ac1fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 >> 172.21.15.113:0/1721068083 conn(0x7fb5ac0b0100 msgr2=0x7fb5ac165810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 shutdown_connections 2023-12-19T13:48:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:57.989+0000 7fb5b26b2640 1 -- 172.21.15.113:0/1721068083 wait complete. 2023-12-19T13:48:58.066 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:48:58.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.281+0000 7f8d3ebd0640 1 Processor -- start 2023-12-19T13:48:58.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.281+0000 7f8d3ebd0640 1 -- start start 2023-12-19T13:48:58.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.282+0000 7f8d3ebd0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d3806c6b0 0x7f8d38166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.282+0000 7f8d3ebd0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3806bb30 con 0x7f8d381449e0 2023-12-19T13:48:58.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.282+0000 7f8d3ebd0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d380b0070 con 0x7f8d380b0b50 2023-12-19T13:48:58.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.283+0000 7f8d3ebd0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d380b0350 con 0x7f8d3806c6b0 2023-12-19T13:48:58.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.283+0000 7f8d3c96c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8d381449e0 0x7f8d380af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49850/0 (socket says 172.21.15.113:49850) 2023-12-19T13:48:58.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.283+0000 7f8d3c96c640 1 -- 172.21.15.113:0/1911503191 learned_addr learned my addr 172.21.15.113:0/1911503191 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:48:58.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.283+0000 7f8d3d16d640 1 --2- 172.21.15.113:0/1911503191 >> v2:172.21.15.151:3300/0 conn(0x7f8d3806c6b0 0x7f8d38166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.283+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405495748 0 0) 0x7f8d3806bb30 con 0x7f8d381449e0 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.283+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d28003520 con 0x7f8d381449e0 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944556698 0 0) 0x7f8d28003520 con 0x7f8d381449e0 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 >> v2:172.21.15.151:3300/0 conn(0x7f8d3806c6b0 msgr2=0x7f8d38166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 --2- 172.21.15.113:0/1911503191 >> v2:172.21.15.151:3300/0 conn(0x7f8d3806c6b0 0x7f8d38166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 >> v1:172.21.15.151:6789/0 conn(0x7f8d380b0b50 legacy=0x7f8d3806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380b0630 con 0x7f8d381449e0 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8d2c001670 con 0x7f8d381449e0 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 >> v1:172.21.15.113:6789/0 conn(0x7f8d381449e0 legacy=0x7f8d380af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d28003a30 0x7f8d28003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d280047c0 0x7f8d28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d280051d0 0x7f8d2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380b0350 con 0x7f8d280047c0 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2800c100 con 0x7f8d28003a30 2023-12-19T13:48:58.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2800c2c0 con 0x7f8d280051d0 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.284+0000 7f8d37fff640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d280047c0 0x7f8d28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d3c96c640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d28003a30 0x7f8d28003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d3d16d640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d280051d0 0x7f8d2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d37fff640 1 -- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d280051d0 msgr2=0x7f8d2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d37fff640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d280051d0 0x7f8d2800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d37fff640 1 -- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d28003a30 msgr2=0x7f8d28003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d37fff640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d28003a30 0x7f8d28003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d37fff640 1 -- 172.21.15.113:0/1911503191 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28003520 con 0x7f8d280047c0 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d3d16d640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d280051d0 0x7f8d2800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:58.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.285+0000 7f8d3d16d640 1 -- 172.21.15.113:0/1911503191 reap_dead start 2023-12-19T13:48:58.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.286+0000 7f8d37fff640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d280047c0 0x7f8d28004c40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8d24001750 tx=0x7f8d280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146030db9ccec880 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:58.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d240052d0 con 0x7f8d280047c0 2023-12-19T13:48:58.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2402e050 con 0x7f8d280047c0 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d377fe640 1 -- 172.21.15.113:0/1911503191 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24003830 con 0x7f8d280047c0 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/1911503191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d280047c0 msgr2=0x7f8d28004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d280047c0 0x7f8d28004c40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8d24001750 tx=0x7f8d280057f0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/1911503191 shutdown_connections 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/1911503191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d280047c0 0x7f8d28004c40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/1911503191 >> 172.21.15.113:0/1911503191 conn(0x7f8d380cbb70 msgr2=0x7f8d380cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/1911503191 shutdown_connections 2023-12-19T13:48:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.287+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/1911503191 wait complete. 2023-12-19T13:48:58.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.289+0000 7f8d3ebd0640 1 Processor -- start 2023-12-19T13:48:58.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.289+0000 7f8d3ebd0640 1 -- start start 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.290+0000 7f8d3ebd0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d280047c0 0x7f8d3815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.290+0000 7f8d3ebd0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d3815a0a0 0x7f8d380700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.290+0000 7f8d3ebd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d38070600 0x7f8d380ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.290+0000 7f8d3ebd0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3815ea80 con 0x7f8d3815a0a0 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.290+0000 7f8d3ebd0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38070a80 con 0x7f8d280047c0 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.290+0000 7f8d3ebd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380af300 con 0x7f8d38070600 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d3815a0a0 0x7f8d380700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d3815a0a0 0x7f8d380700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57316/0 (socket says 172.21.15.113:57316) 2023-12-19T13:48:58.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 -- 172.21.15.113:0/4249348751 learned_addr learned my addr 172.21.15.113:0/4249348751 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d3d16d640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d38070600 0x7f8d380ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d3c96c640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d280047c0 0x7f8d3815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 -- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d38070600 msgr2=0x7f8d380ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d38070600 0x7f8d380ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 -- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d280047c0 msgr2=0x7f8d3815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d280047c0 0x7f8d3815e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d37fff640 1 -- 172.21.15.113:0/4249348751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3815d250 con 0x7f8d3815a0a0 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.291+0000 7f8d3c96c640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d280047c0 0x7f8d3815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.292+0000 7f8d37fff640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d3815a0a0 0x7f8d380700c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8d24005040 tx=0x7f8d24001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.292+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24007a30 con 0x7f8d3815a0a0 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.292+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d240069e0 con 0x7f8d3815a0a0 2023-12-19T13:48:58.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.292+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3815d4a0 con 0x7f8d3815a0a0 2023-12-19T13:48:58.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.292+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24006d70 con 0x7f8d3815a0a0 2023-12-19T13:48:58.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.292+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3815da60 con 0x7f8d3815a0a0 2023-12-19T13:48:58.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.293+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d38061910 con 0x7f8d3815a0a0 2023-12-19T13:48:58.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.294+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d240035f0 con 0x7f8d3815a0a0 2023-12-19T13:48:58.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.295+0000 7f8d357fa640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d1c06a430 0x7f8d1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:58.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.295+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d240aa9d0 con 0x7f8d3815a0a0 2023-12-19T13:48:58.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.295+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7f8d1c071f60 con 0x7f8d3815a0a0 2023-12-19T13:48:58.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.295+0000 7f8d3c96c640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d1c06a430 0x7f8d1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:58.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.296+0000 7f8d3c96c640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d1c06a430 0x7f8d1c06c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d380ae530 tx=0x7f8d2c000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:58.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.299+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d2404b020 con 0x7f8d3815a0a0 2023-12-19T13:48:58.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.525+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d380ae560 con 0x7f8d3815a0a0 2023-12-19T13:48:58.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.526+0000 7f8d357fa640 1 -- 172.21.15.113:0/4249348751 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f8d240760e0 con 0x7f8d3815a0a0 2023-12-19T13:48:58.527 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:58.527 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:48:58.527 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:48:58.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d1c06a430 msgr2=0x7f8d1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d1c06a430 0x7f8d1c06c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d380ae530 tx=0x7f8d2c000ed0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d3815a0a0 msgr2=0x7f8d380700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:58.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d3815a0a0 0x7f8d380700c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8d24005040 tx=0x7f8d24001120 comp rx=0 tx=0).stop 2023-12-19T13:48:58.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 shutdown_connections 2023-12-19T13:48:58.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d1c06a430 0x7f8d1c06c8f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d38070600 0x7f8d380ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d3815a0a0 0x7f8d380700c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 --2- 172.21.15.113:0/4249348751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d280047c0 0x7f8d3815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:58.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 >> 172.21.15.113:0/4249348751 conn(0x7f8d380cbb70 msgr2=0x7f8d3806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:58.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.529+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 shutdown_connections 2023-12-19T13:48:58.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:58.530+0000 7f8d3ebd0640 1 -- 172.21.15.113:0/4249348751 wait complete. 2023-12-19T13:48:58.547 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T13:48:58.773 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":5577,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":27.731185352000001,"mdsmap_epoch":25,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":33.239968181000002} 2023-12-19T13:48:58.774 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 5577, "mdsmap_epoch": 25, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 27.731185352, "state": "up:active", "uptime": 33.239968181, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:48:58.774 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:48:58.774 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:48:58.774 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:48:58.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:58.828 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-19T13:48:58.879 INFO:teuthology.orchestra.run.smithi113.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-19T13:48:58.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:48:58.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:58.880 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T13:48:58.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:48:58.935 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T13:48:59.062 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:48:59.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.277+0000 7f08c9b0a640 1 Processor -- start 2023-12-19T13:48:59.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.278+0000 7f08c9b0a640 1 -- start start 2023-12-19T13:48:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.279+0000 7f08c9b0a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f08c415da30 0x7f08c40b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.279+0000 7f08c9b0a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f08c40b6900 0x7f08c40b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.279+0000 7f08c9b0a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c415e1a0 con 0x7f08c4161020 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.279+0000 7f08c9b0a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c415e480 con 0x7f08c40b6900 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.279+0000 7f08c9b0a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c415e760 con 0x7f08c415da30 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.279+0000 7f08c3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f08c40b6900 0x7f08c40b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.280+0000 7f08c3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f08c40b6900 0x7f08c40b89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57328/0 (socket says 172.21.15.113:57328) 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.280+0000 7f08c3fff640 1 -- 172.21.15.113:0/3679086974 learned_addr learned my addr 172.21.15.113:0/3679086974 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.280+0000 7f08c2ffd640 1 --2- 172.21.15.113:0/3679086974 >> v2:172.21.15.151:3300/0 conn(0x7f08c415da30 0x7f08c40b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.280+0000 7f08c3fff640 1 -- 172.21.15.113:0/3679086974 >> v2:172.21.15.151:3300/0 conn(0x7f08c415da30 msgr2=0x7f08c40b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.280+0000 7f08c3fff640 1 --2- 172.21.15.113:0/3679086974 >> v2:172.21.15.151:3300/0 conn(0x7f08c415da30 0x7f08c40b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.280+0000 7f08c3fff640 1 -- 172.21.15.113:0/3679086974 >> v1:172.21.15.151:6789/0 conn(0x7f08c4161020 legacy=0x7f08c4143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.280+0000 7f08c3fff640 1 -- 172.21.15.113:0/3679086974 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4142d10 con 0x7f08c40b6900 2023-12-19T13:48:59.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.281+0000 7f08c3fff640 1 --2- 172.21.15.113:0/3679086974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c40b6900 0x7f08c40b89a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f08c4154af0 tx=0x7f08bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0edd9517b2addf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:59.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c27fc640 1 -- 172.21.15.113:0/3679086974 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc031870 con 0x7f08c40b6900 2023-12-19T13:48:59.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c27fc640 1 -- 172.21.15.113:0/3679086974 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc0319d0 con 0x7f08c40b6900 2023-12-19T13:48:59.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c27fc640 1 -- 172.21.15.113:0/3679086974 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc031d60 con 0x7f08c40b6900 2023-12-19T13:48:59.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 -- 172.21.15.113:0/3679086974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c40b6900 msgr2=0x7f08c40b89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:59.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/3679086974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c40b6900 0x7f08c40b89a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f08c4154af0 tx=0x7f08bc02b910 comp rx=0 tx=0).stop 2023-12-19T13:48:59.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 -- 172.21.15.113:0/3679086974 shutdown_connections 2023-12-19T13:48:59.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/3679086974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c40b6900 0x7f08c40b89a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/3679086974 >> v2:172.21.15.151:3300/0 conn(0x7f08c415da30 0x7f08c40b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 -- 172.21.15.113:0/3679086974 >> 172.21.15.113:0/3679086974 conn(0x7f08c40b26f0 msgr2=0x7f08c40b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:59.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 -- 172.21.15.113:0/3679086974 shutdown_connections 2023-12-19T13:48:59.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.282+0000 7f08c9b0a640 1 -- 172.21.15.113:0/3679086974 wait complete. 2023-12-19T13:48:59.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.284+0000 7f08c9b0a640 1 Processor -- start 2023-12-19T13:48:59.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.284+0000 7f08c9b0a640 1 -- start start 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.285+0000 7f08c9b0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08c40b6900 0x7f08c413fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.285+0000 7f08c9b0a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c415da30 0x7f08c415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.285+0000 7f08c9b0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08c4161020 0x7f08c415f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.285+0000 7f08c9b0a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c415b9c0 con 0x7f08c415da30 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.285+0000 7f08c9b0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c415c7e0 con 0x7f08c4161020 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.285+0000 7f08c9b0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c41402c0 con 0x7f08c40b6900 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c415da30 0x7f08c415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:59.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c415da30 0x7f08c415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57338/0 (socket says 172.21.15.113:57338) 2023-12-19T13:48:59.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 -- 172.21.15.113:0/227641578 learned_addr learned my addr 172.21.15.113:0/227641578 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c3fff640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08c4161020 0x7f08c415f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c37fe640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08c40b6900 0x7f08c413fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 -- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08c40b6900 msgr2=0x7f08c413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08c40b6900 0x7f08c413fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 -- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08c4161020 msgr2=0x7f08c415f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08c4161020 0x7f08c415f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 -- 172.21.15.113:0/227641578 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0094d0 con 0x7f08c415da30 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.286+0000 7f08c2ffd640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c415da30 0x7f08c415f440 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00d800 tx=0x7f08ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:59.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.287+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00b6c0 con 0x7f08c415da30 2023-12-19T13:48:59.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.287+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00b820 con 0x7f08c415da30 2023-12-19T13:48:59.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.287+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00bbb0 con 0x7f08c415da30 2023-12-19T13:48:59.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.287+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c415bbd0 con 0x7f08c415da30 2023-12-19T13:48:59.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.287+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c415c190 con 0x7f08c415da30 2023-12-19T13:48:59.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.288+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c40d05d0 con 0x7f08c415da30 2023-12-19T13:48:59.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.289+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f08ac00bd10 con 0x7f08c415da30 2023-12-19T13:48:59.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.290+0000 7f08bbfff640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f08a406a430 0x7f08a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:48:59.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.290+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08ac088f50 con 0x7f08c415da30 2023-12-19T13:48:59.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.290+0000 7f08c37fe640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f08a406a430 0x7f08a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:48:59.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.290+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7f08a4071f60 con 0x7f08c415da30 2023-12-19T13:48:59.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.291+0000 7f08c37fe640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f08a406a430 0x7f08a406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009f60 tx=0x7f08b40094f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:48:59.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.296+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f08ac054410 con 0x7f08c415da30 2023-12-19T13:48:59.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.488+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f08c4061910 con 0x7f08c415da30 2023-12-19T13:48:59.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.492+0000 7f08bbfff640 1 -- 172.21.15.113:0/227641578 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+33739 (secure 0 0 0) 0x7f08ac057a30 con 0x7f08c415da30 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 53, 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:48:57.564189+0000", 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:48:59.493 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:48:59.494 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 7, 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:59.495 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:59.496 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:59.497 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:59.498 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:59.499 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:48:59.500 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 6, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:28.798187+0000", 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:59.501 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:59.502 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:59.503 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:59.504 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:59.505 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:59.506 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 7, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:30.040745+0000", 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:48:59.507 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:48:59.508 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:48:59.509 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:48:59.510 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:48:59.511 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:48:59.512 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.513 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.514 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.515 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.516 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.517 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:48:59.518 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.519 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.520 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.521 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.522 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.523 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.524 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.525 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.526 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.527 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.528 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.529 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.530 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.531 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.532 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.533 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.534 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.535 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.536 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.537 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.538 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.539 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.541 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.542 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.543 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:48:59.544 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.546 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.546 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:48:59.546 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.546 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.546 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.546 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.549 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.550 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.551 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:48:59.552 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:48:59.553 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.554 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.555 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:48:59.557 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.558 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.559 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:48:59.560 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.561 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:48:59.562 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:48:59.563 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:48:59.564 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:48:59.565 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:48:59.566 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:48:59.566 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:48:59.566 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:48:59.566 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:48:59.566 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:48:59.566 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:48:59.566 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:48:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f08a406a430 msgr2=0x7f08a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f08a406a430 0x7f08a406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009f60 tx=0x7f08b40094f0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c415da30 msgr2=0x7f08c415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:48:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c415da30 0x7f08c415f440 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00d800 tx=0x7f08ac00dcc0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 shutdown_connections 2023-12-19T13:48:59.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f08a406a430 0x7f08a406c8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08c4161020 0x7f08c415f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08c415da30 0x7f08c415f440 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 --2- 172.21.15.113:0/227641578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08c40b6900 0x7f08c413fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:48:59.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 >> 172.21.15.113:0/227641578 conn(0x7f08c40b26f0 msgr2=0x7f08c40d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:48:59.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 shutdown_connections 2023-12-19T13:48:59.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:48:59.494+0000 7f08c9b0a640 1 -- 172.21.15.113:0/227641578 wait complete. 2023-12-19T13:48:59.569 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:49:04.569 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:49:04.606 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:49:04.605+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-19T13:49:04.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.788+0000 7f6e0bcad640 1 Processor -- start 2023-12-19T13:49:04.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.788+0000 7f6e0bcad640 1 -- start start 2023-12-19T13:49:04.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.789+0000 7f6e0bcad640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 0x7f6e04166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.789+0000 7f6e0bcad640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0406bb30 con 0x7f6e041449e0 2023-12-19T13:49:04.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.789+0000 7f6e0bcad640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e040b0070 con 0x7f6e040b0b50 2023-12-19T13:49:04.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.789+0000 7f6e0bcad640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040b0350 con 0x7f6e0406c6b0 2023-12-19T13:49:04.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e09a49640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6e041449e0 0x7f6e040af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49864/0 (socket says 172.21.15.113:49864) 2023-12-19T13:49:04.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e09a49640 1 -- 172.21.15.113:0/3695527131 learned_addr learned my addr 172.21.15.113:0/3695527131 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:04.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670521533 0 0) 0x7f6e0406bb30 con 0x7f6e041449e0 2023-12-19T13:49:04.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df0003520 con 0x7f6e041449e0 2023-12-19T13:49:04.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e0a24a640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 0x7f6e04166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532480328 0 0) 0x7f6df0003520 con 0x7f6e041449e0 2023-12-19T13:49:04.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 msgr2=0x7f6e04166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:04.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 0x7f6e04166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 >> v1:172.21.15.151:6789/0 conn(0x7f6e040b0b50 legacy=0x7f6e0406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040b0630 con 0x7f6e041449e0 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6e00001670 con 0x7f6e041449e0 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.790+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 >> v1:172.21.15.113:6789/0 conn(0x7f6e041449e0 legacy=0x7f6e040af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e08a47640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df0003a10 0x7f6df0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e08a47640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 0x7f6df00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e08a47640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6df0004d70 0x7f6df00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040b0350 con 0x7f6df0004d70 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df000bbc0 con 0x7f6df0003a10 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df000bd80 con 0x7f6e0406c6b0 2023-12-19T13:49:04.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e0a24a640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6df0004d70 0x7f6df00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e09a49640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df0003a10 0x7f6df0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e09248640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 0x7f6df00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e0a24a640 1 -- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 msgr2=0x7f6df00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:04.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e0a24a640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e0406c6b0 0x7f6df00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:04.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e0a24a640 1 -- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df0003a10 msgr2=0x7f6df0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:04.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e0a24a640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df0003a10 0x7f6df0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:04.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e0a24a640 1 -- 172.21.15.113:0/3695527131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df0003520 con 0x7f6df0004d70 2023-12-19T13:49:04.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.791+0000 7f6e09a49640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df0003a10 0x7f6df0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.792+0000 7f6e0a24a640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6df0004d70 0x7f6df00051f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007330 tx=0x7f6df00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9798ba34f971595d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc02cbf0 con 0x7f6df0004d70 2023-12-19T13:49:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc02cd50 con 0x7f6df0004d70 2023-12-19T13:49:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e08a47640 1 -- 172.21.15.113:0/3695527131 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc034660 con 0x7f6df0004d70 2023-12-19T13:49:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e0bcad640 1 -- 172.21.15.113:0/3695527131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6df0004d70 msgr2=0x7f6df00051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e0bcad640 1 --2- 172.21.15.113:0/3695527131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6df0004d70 0x7f6df00051f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007330 tx=0x7f6df00057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e0a24a640 1 -- 172.21.15.113:0/3695527131 reap_dead start 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e0bcad640 1 -- 172.21.15.113:0/3695527131 shutdown_connections 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e0bcad640 1 -- 172.21.15.113:0/3695527131 >> 172.21.15.113:0/3695527131 conn(0x7f6e040cbb70 msgr2=0x7f6e040cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e0bcad640 1 -- 172.21.15.113:0/3695527131 shutdown_connections 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.793+0000 7f6e0bcad640 1 -- 172.21.15.113:0/3695527131 wait complete. 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.795+0000 7f6e0bcad640 1 Processor -- start 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.795+0000 7f6e0bcad640 1 -- start start 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.796+0000 7f6e0bcad640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6df0004d70 0x7f6e0415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.796+0000 7f6e0bcad640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e0413b4d0 0x7f6e0413b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.796+0000 7f6e0bcad640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e0413a680 0x7f6e0413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.796+0000 7f6e0bcad640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0413b040 con 0x7f6e0413b4d0 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.796+0000 7f6e0bcad640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0413cba0 con 0x7f6e0413a680 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.796+0000 7f6e0bcad640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0413bf90 con 0x7f6df0004d70 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.796+0000 7f6e09248640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e0413b4d0 0x7f6e0413b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e0413b4d0 0x7f6e0413b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57368/0 (socket says 172.21.15.113:57368) 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 -- 172.21.15.113:0/2599538653 learned_addr learned my addr 172.21.15.113:0/2599538653 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09a49640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6df0004d70 0x7f6e0415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e0a24a640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e0413a680 0x7f6e0413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 -- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6df0004d70 msgr2=0x7f6e0415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6df0004d70 0x7f6e0415dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 -- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e0413a680 msgr2=0x7f6e0413ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e0413a680 0x7f6e0413ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 -- 172.21.15.113:0/2599538653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0413c270 con 0x7f6e0413b4d0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6e09248640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e0413b4d0 0x7f6e0413b930 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6df400d4f0 tx=0x7f6df400d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4005480 con 0x7f6e0413b4d0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df4003610 con 0x7f6e0413b4d0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.797+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4003980 con 0x7f6e0413b4d0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.798+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0413c550 con 0x7f6e0413b4d0 2023-12-19T13:49:04.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.798+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e040ce8a0 con 0x7f6e0413b4d0 2023-12-19T13:49:04.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.799+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04061910 con 0x7f6e0413b4d0 2023-12-19T13:49:04.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.800+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6df4003ae0 con 0x7f6e0413b4d0 2023-12-19T13:49:04.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.800+0000 7f6dfa7fc640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6de806a430 0x7f6de806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:04.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.801+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6df40887e0 con 0x7f6e0413b4d0 2023-12-19T13:49:04.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.801+0000 7f6e09a49640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6de806a430 0x7f6de806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:04.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.801+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=57}) v3 -- 0x7f6de8071f60 con 0x7f6e0413b4d0 2023-12-19T13:49:04.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.801+0000 7f6e09a49640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6de806a430 0x7f6de806c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e000078d0 tx=0x7f6e00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:04.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.805+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6df4053d30 con 0x7f6e0413b4d0 2023-12-19T13:49:04.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.997+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6e040ae560 con 0x7f6e0413b4d0 2023-12-19T13:49:04.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:04.999+0000 7f6dfa7fc640 1 -- 172.21.15.113:0/2599538653 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+33619 (secure 0 0 0) 0x7f6df4057350 con 0x7f6e0413b4d0 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 56, 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:49:04.606948+0000", 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:49:05.000 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 7, 2023-12-19T13:49:05.001 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:05.002 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:49:05.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:05.004 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:05.005 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:05.006 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:05.007 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 6, 2023-12-19T13:49:05.008 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:28.798187+0000", 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:05.009 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:49:05.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:05.011 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:05.012 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:49:05.013 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:05.014 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 7, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:30.040745+0000", 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:05.015 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:05.016 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "49", 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:05.017 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:05.018 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:05.019 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:49:05.021 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.022 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.023 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.024 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.025 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:49:05.026 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.027 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.028 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.029 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:49:05.032 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.033 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.035 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.037 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.038 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.039 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.040 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.041 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.042 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.043 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.044 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.045 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.046 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.047 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.048 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:49:05.049 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.050 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.053 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.054 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.055 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.056 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.058 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.060 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.060 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.061 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.062 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:05.063 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.064 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:05.065 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:05.066 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:05.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:49:05.068 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:49:05.069 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.070 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:49:05.071 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.073 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:05.074 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:49:05.075 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:49:05.076 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:49:05.077 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:49:05.077 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:49:05.077 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:49:05.077 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:49:05.077 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:49:05.077 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:05.077 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.001+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6de806a430 msgr2=0x7f6de806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.001+0000 7f6e0bcad640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6de806a430 0x7f6de806c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e000078d0 tx=0x7f6e00009040 comp rx=0 tx=0).stop 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.001+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e0413b4d0 msgr2=0x7f6e0413b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.001+0000 7f6e0bcad640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e0413b4d0 0x7f6e0413b930 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6df400d4f0 tx=0x7f6df400d9b0 comp rx=0 tx=0).stop 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.001+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 shutdown_connections 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.001+0000 7f6e0bcad640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6de806a430 0x7f6de806c8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.002+0000 7f6e0bcad640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e0413a680 0x7f6e0413ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.002+0000 7f6e0bcad640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e0413b4d0 0x7f6e0413b930 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.002+0000 7f6e0bcad640 1 --2- 172.21.15.113:0/2599538653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6df0004d70 0x7f6e0415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.002+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 >> 172.21.15.113:0/2599538653 conn(0x7f6e040cbb70 msgr2=0x7f6e040b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.002+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 shutdown_connections 2023-12-19T13:49:05.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:05.002+0000 7f6e0bcad640 1 -- 172.21.15.113:0/2599538653 wait complete. 2023-12-19T13:49:05.080 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:49:10.081 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:49:10.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.303+0000 7f04e1d39640 1 Processor -- start 2023-12-19T13:49:10.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.303+0000 7f04e1d39640 1 -- start start 2023-12-19T13:49:10.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.304+0000 7f04e1d39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc1449e0 0x7f04dc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.304+0000 7f04e1d39640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f04dc06c6b0 0x7f04dc0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04e1d39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0afb10 con 0x7f04dc0b0b50 2023-12-19T13:49:10.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04e1d39640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc06bb30 con 0x7f04dc06c6b0 2023-12-19T13:49:10.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04e1d39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0b0070 con 0x7f04dc1449e0 2023-12-19T13:49:10.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f04dc06c6b0 0x7f04dc0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f04dc06c6b0 0x7f04dc0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58008/0 (socket says 172.21.15.113:58008) 2023-12-19T13:49:10.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04dbfff640 1 -- 172.21.15.113:0/4288891241 learned_addr learned my addr 172.21.15.113:0/4288891241 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:10.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04db7fe640 1 --2- 172.21.15.113:0/4288891241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc1449e0 0x7f04dc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04dbfff640 1 -- 172.21.15.113:0/4288891241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc1449e0 msgr2=0x7f04dc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:10.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.305+0000 7f04dbfff640 1 --2- 172.21.15.113:0/4288891241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc1449e0 0x7f04dc0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.306+0000 7f04dbfff640 1 -- 172.21.15.113:0/4288891241 >> v1:172.21.15.151:6789/0 conn(0x7f04dc0b0b50 legacy=0x7f04dc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.306+0000 7f04dbfff640 1 -- 172.21.15.113:0/4288891241 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0b0350 con 0x7f04dc06c6b0 2023-12-19T13:49:10.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.307+0000 7f04dbfff640 1 --2- 172.21.15.113:0/4288891241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc06c6b0 0x7f04dc0b1710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009e50 tx=0x7f04d402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbd48cca8f96b79 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:10.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.307+0000 7f04daffd640 1 -- 172.21.15.113:0/4288891241 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d402cb00 con 0x7f04dc06c6b0 2023-12-19T13:49:10.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.307+0000 7f04daffd640 1 -- 172.21.15.113:0/4288891241 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d402cc60 con 0x7f04dc06c6b0 2023-12-19T13:49:10.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.307+0000 7f04daffd640 1 -- 172.21.15.113:0/4288891241 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d40343f0 con 0x7f04dc06c6b0 2023-12-19T13:49:10.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 -- 172.21.15.113:0/4288891241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc06c6b0 msgr2=0x7f04dc0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 --2- 172.21.15.113:0/4288891241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc06c6b0 0x7f04dc0b1710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009e50 tx=0x7f04d402bf60 comp rx=0 tx=0).stop 2023-12-19T13:49:10.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 -- 172.21.15.113:0/4288891241 shutdown_connections 2023-12-19T13:49:10.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 --2- 172.21.15.113:0/4288891241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc06c6b0 0x7f04dc0b1710 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 --2- 172.21.15.113:0/4288891241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc1449e0 0x7f04dc0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 -- 172.21.15.113:0/4288891241 >> 172.21.15.113:0/4288891241 conn(0x7f04dc0cbb70 msgr2=0x7f04dc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:10.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 -- 172.21.15.113:0/4288891241 shutdown_connections 2023-12-19T13:49:10.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.308+0000 7f04e1d39640 1 -- 172.21.15.113:0/4288891241 wait complete. 2023-12-19T13:49:10.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.310+0000 7f04e1d39640 1 Processor -- start 2023-12-19T13:49:10.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.310+0000 7f04e1d39640 1 -- start start 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04e1d39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc06c6b0 0x7f04dc141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04e1d39640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc0b0b50 0x7f04dc15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04e1d39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc1449e0 0x7f04dc1f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04e1d39640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc15d930 con 0x7f04dc0b0b50 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04e1d39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc15db40 con 0x7f04dc1449e0 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04e1d39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc15de20 con 0x7f04dc06c6b0 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc0b0b50 0x7f04dc15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc0b0b50 0x7f04dc15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58016/0 (socket says 172.21.15.113:58016) 2023-12-19T13:49:10.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 -- 172.21.15.113:0/3706607569 learned_addr learned my addr 172.21.15.113:0/3706607569 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:10.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 -- 172.21.15.113:0/3706607569 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc06c6b0 msgr2=0x7f04dc141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc06c6b0 0x7f04dc141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 -- 172.21.15.113:0/3706607569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc1449e0 msgr2=0x7f04dc1f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc1449e0 0x7f04dc1f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.311+0000 7f04d3fff640 1 -- 172.21.15.113:0/3706607569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009b30 con 0x7f04dc0b0b50 2023-12-19T13:49:10.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.312+0000 7f04d3fff640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc0b0b50 0x7f04dc15d3f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c450 tx=0x7f04c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:10.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.312+0000 7f04d8ff9640 1 -- 172.21.15.113:0/3706607569 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c40052d0 con 0x7f04dc0b0b50 2023-12-19T13:49:10.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.312+0000 7f04d8ff9640 1 -- 172.21.15.113:0/3706607569 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4005430 con 0x7f04dc0b0b50 2023-12-19T13:49:10.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.312+0000 7f04d8ff9640 1 -- 172.21.15.113:0/3706607569 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4012870 con 0x7f04dc0b0b50 2023-12-19T13:49:10.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.312+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc15e100 con 0x7f04dc0b0b50 2023-12-19T13:49:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.312+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc1f3920 con 0x7f04dc0b0b50 2023-12-19T13:49:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.313+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc1f06d0 con 0x7f04dc0b0b50 2023-12-19T13:49:10.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.314+0000 7f04d8ff9640 1 -- 172.21.15.113:0/3706607569 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f04c40129d0 con 0x7f04dc0b0b50 2023-12-19T13:49:10.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.315+0000 7f04d8ff9640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f04bc06a430 0x7f04bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.315+0000 7f04d8ff9640 1 -- 172.21.15.113:0/3706607569 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04c4088510 con 0x7f04dc0b0b50 2023-12-19T13:49:10.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.316+0000 7f04db7fe640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f04bc06a430 0x7f04bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.316+0000 7f04db7fe640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f04bc06a430 0x7f04bc06c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f04cc006fd0 tx=0x7f04cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:10.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.320+0000 7f04d8ff9640 1 -- 172.21.15.113:0/3706607569 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f04c4053a70 con 0x7f04dc0b0b50 2023-12-19T13:49:10.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.512+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f04dc061910 con 0x7f04dc0b0b50 2023-12-19T13:49:10.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.514+0000 7f04d8ff9640 1 -- 172.21.15.113:0/3706607569 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+33524 (secure 0 0 0) 0x7f04c4086e60 con 0x7f04dc0b0b50 2023-12-19T13:49:10.515 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:10.515 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 59, 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:49:09.466677+0000", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:10.516 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 7, 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:49:10.517 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:10.518 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:10.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "59", 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:10.520 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:10.521 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:10.522 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:49:10.523 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 6, 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:28.798187+0000", 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:49:10.524 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:49:10.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "59", 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:10.526 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:10.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:10.528 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.529 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 7, 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:30.040745+0000", 2023-12-19T13:49:10.530 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:49:10.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:49:10.532 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:49:10.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:10.532 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:10.532 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:10.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:10.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "59", 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:10.533 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:10.534 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:10.535 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:49:10.536 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.537 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.538 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:49:10.539 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:49:10.541 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.542 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.542 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.542 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.542 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:49:10.542 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:10.542 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.543 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.544 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.545 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.548 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.549 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.550 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.551 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.552 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.553 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:49:10.554 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.555 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.556 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.557 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.558 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.559 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.560 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.561 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.564 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:49:10.565 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.566 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:49:10.567 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.568 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.569 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:10.570 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.571 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.572 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:49:10.574 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:49:10.575 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.576 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:10.577 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.578 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.579 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.580 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:49:10.581 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.582 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.583 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.584 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.586 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:10.587 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:49:10.588 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:49:10.589 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:10.590 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:49:10.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f04bc06a430 msgr2=0x7f04bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f04bc06a430 0x7f04bc06c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f04cc006fd0 tx=0x7f04cc008040 comp rx=0 tx=0).stop 2023-12-19T13:49:10.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc0b0b50 msgr2=0x7f04dc15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc0b0b50 0x7f04dc15d3f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c450 tx=0x7f04c400c910 comp rx=0 tx=0).stop 2023-12-19T13:49:10.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 shutdown_connections 2023-12-19T13:49:10.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f04bc06a430 0x7f04bc06c8f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc1449e0 0x7f04dc1f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04dc0b0b50 0x7f04dc15d3f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 --2- 172.21.15.113:0/3706607569 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04dc06c6b0 0x7f04dc141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 >> 172.21.15.113:0/3706607569 conn(0x7f04dc0cbb70 msgr2=0x7f04dc13e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:10.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 shutdown_connections 2023-12-19T13:49:10.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.517+0000 7f04e1d39640 1 -- 172.21.15.113:0/3706607569 wait complete. 2023-12-19T13:49:10.592 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T13:49:10.593 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:49:10.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.810+0000 7f4f61bf4640 1 Processor -- start 2023-12-19T13:49:10.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.811+0000 7f4f61bf4640 1 -- start start 2023-12-19T13:49:10.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f61bf4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4f5c070170 0x7f4f5c16c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f61bf4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0b22b0 con 0x7f4f5c0cdf50 2023-12-19T13:49:10.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f61bf4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0b2830 con 0x7f4f5c161810 2023-12-19T13:49:10.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f61bf4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c161bf0 con 0x7f4f5c070170 2023-12-19T13:49:10.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f613f3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4f5c070170 0x7f4f5c16c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f5bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4f5c0cdf50 0x7f4f5c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49774/0 (socket says 172.21.15.113:49774) 2023-12-19T13:49:10.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f5bfff640 1 -- 172.21.15.113:0/3856853371 learned_addr learned my addr 172.21.15.113:0/3856853371 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:10.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f5b7fe640 1 -- 172.21.15.113:0/3856853371 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228737730 0 0) 0x7f4f5c0b22b0 con 0x7f4f5c0cdf50 2023-12-19T13:49:10.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f613f3640 1 -- 172.21.15.113:0/3856853371 >> v1:172.21.15.151:6789/0 conn(0x7f4f5c161810 legacy=0x7f4f5c0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:10.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.813+0000 7f4f613f3640 1 -- 172.21.15.113:0/3856853371 >> v1:172.21.15.113:6789/0 conn(0x7f4f5c0cdf50 legacy=0x7f4f5c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.814+0000 7f4f613f3640 1 -- 172.21.15.113:0/3856853371 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0b2550 con 0x7f4f5c070170 2023-12-19T13:49:10.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.815+0000 7f4f613f3640 1 --2- 172.21.15.113:0/3856853371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c070170 0x7f4f5c16c5b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097a0 tx=0x7f4f5402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202071766370d25c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:10.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.815+0000 7f4f5b7fe640 1 -- 172.21.15.113:0/3856853371 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5402e070 con 0x7f4f5c070170 2023-12-19T13:49:10.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.815+0000 7f4f5b7fe640 1 -- 172.21.15.113:0/3856853371 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f540315a0 con 0x7f4f5c070170 2023-12-19T13:49:10.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.815+0000 7f4f5b7fe640 1 -- 172.21.15.113:0/3856853371 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54031930 con 0x7f4f5c070170 2023-12-19T13:49:10.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.815+0000 7f4f61bf4640 1 -- 172.21.15.113:0/3856853371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c070170 msgr2=0x7f4f5c16c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.815+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/3856853371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c070170 0x7f4f5c16c5b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097a0 tx=0x7f4f5402b840 comp rx=0 tx=0).stop 2023-12-19T13:49:10.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.816+0000 7f4f61bf4640 1 -- 172.21.15.113:0/3856853371 shutdown_connections 2023-12-19T13:49:10.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.816+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/3856853371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c070170 0x7f4f5c16c5b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.816+0000 7f4f61bf4640 1 -- 172.21.15.113:0/3856853371 >> 172.21.15.113:0/3856853371 conn(0x7f4f5c0b0100 msgr2=0x7f4f5c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:10.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.816+0000 7f4f61bf4640 1 -- 172.21.15.113:0/3856853371 shutdown_connections 2023-12-19T13:49:10.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.816+0000 7f4f61bf4640 1 -- 172.21.15.113:0/3856853371 wait complete. 2023-12-19T13:49:10.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.817+0000 7f4f61bf4640 1 Processor -- start 2023-12-19T13:49:10.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.818+0000 7f4f61bf4640 1 -- start start 2023-12-19T13:49:10.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.818+0000 7f4f61bf4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c070170 0x7f4f5c151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.818+0000 7f4f61bf4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cdf50 0x7f4f5c06bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f61bf4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c161810 0x7f4f5c1fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f61bf4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c152230 con 0x7f4f5c161810 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f61bf4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c162960 con 0x7f4f5c0cdf50 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f61bf4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c1f6a60 con 0x7f4f5c070170 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c161810 0x7f4f5c1fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c161810 0x7f4f5c1fa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58038/0 (socket says 172.21.15.113:58038) 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 -- 172.21.15.113:0/1544846460 learned_addr learned my addr 172.21.15.113:0/1544846460 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f60bf2640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c070170 0x7f4f5c151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f5bfff640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cdf50 0x7f4f5c06bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 -- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c070170 msgr2=0x7f4f5c151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c070170 0x7f4f5c151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 -- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cdf50 msgr2=0x7f4f5c06bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:10.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cdf50 0x7f4f5c06bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:10.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.819+0000 7f4f613f3640 1 -- 172.21.15.113:0/1544846460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54009400 con 0x7f4f5c161810 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.820+0000 7f4f613f3640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c161810 0x7f4f5c1fa150 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097a0 tx=0x7f4f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.820+0000 7f4f597fa640 1 -- 172.21.15.113:0/1544846460 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54032840 con 0x7f4f5c161810 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.820+0000 7f4f597fa640 1 -- 172.21.15.113:0/1544846460 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f540329a0 con 0x7f4f5c161810 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.820+0000 7f4f597fa640 1 -- 172.21.15.113:0/1544846460 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54032d50 con 0x7f4f5c161810 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.820+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c15feb0 con 0x7f4f5c161810 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.820+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c160430 con 0x7f4f5c161810 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.821+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c162af0 con 0x7f4f5c161810 2023-12-19T13:49:10.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.822+0000 7f4f597fa640 1 -- 172.21.15.113:0/1544846460 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f540453f0 con 0x7f4f5c161810 2023-12-19T13:49:10.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.823+0000 7f4f597fa640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4806a430 0x7f4f4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:10.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.823+0000 7f4f597fa640 1 -- 172.21.15.113:0/1544846460 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f540aab40 con 0x7f4f5c161810 2023-12-19T13:49:10.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.823+0000 7f4f60bf2640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4806a430 0x7f4f4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:10.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.824+0000 7f4f60bf2640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4806a430 0x7f4f4806c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c007fd0 tx=0x7f4f4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:10.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:10.827+0000 7f4f597fa640 1 -- 172.21.15.113:0/1544846460 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f54076250 con 0x7f4f5c161810 2023-12-19T13:49:11.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.018+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4f5c061910 con 0x7f4f5c161810 2023-12-19T13:49:11.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.021+0000 7f4f597fa640 1 -- 172.21.15.113:0/1544846460 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+33524 (secure 0 0 0) 0x7f4f54079870 con 0x7f4f5c161810 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 59, 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:49:09.466677+0000", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:49:11.023 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 7, 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:49:11.024 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:11.025 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:11.026 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:11.026 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:11.027 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "59", 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:11.028 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:11.029 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:11.029 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:11.029 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:11.029 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:11.029 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:11.029 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:11.030 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:11.031 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:49:11.032 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 6, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:28.798187+0000", 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:49:11.033 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:11.034 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "59", 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:11.035 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:11.036 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:11.036 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:11.036 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:11.036 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:11.036 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:11.036 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:11.037 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:11.037 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:11.037 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:11.037 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:11.037 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:11.037 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.038 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:49:11.039 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:11.040 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 7, 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:48:30.040745+0000", 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:49:11.041 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:49:11.042 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "59", 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:49:11.043 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:49:11.044 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:49:11.045 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.046 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:49:11.047 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:49:11.047 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:49:11.047 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.047 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.048 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:49:11.048 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:49:11.048 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:49:11.048 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:49:11.048 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:49:11.048 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:49:11.048 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.049 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.050 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:49:11.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:49:11.053 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.054 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.055 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.056 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.058 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.059 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.060 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.061 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.062 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.063 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:49:11.064 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.065 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.066 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.067 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.068 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.069 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:49:11.070 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.071 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.072 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:49:11.073 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:49:11.074 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:49:11.075 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:49:11.076 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.077 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:49:11.080 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.081 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.082 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.083 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.085 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.086 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:49:11.087 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 46, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.088 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.089 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:49:11.091 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:49:11.092 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.093 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.094 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.095 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.096 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:49:11.097 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:49:11.098 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:49:11.099 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:49:11.100 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:49:11.100 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:49:11.100 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:11.100 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:49:11.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4806a430 msgr2=0x7f4f4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:11.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4806a430 0x7f4f4806c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c007fd0 tx=0x7f4f4c009040 comp rx=0 tx=0).stop 2023-12-19T13:49:11.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c161810 msgr2=0x7f4f5c1fa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:11.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c161810 0x7f4f5c1fa150 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097a0 tx=0x7f4f540046c0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 shutdown_connections 2023-12-19T13:49:11.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4806a430 0x7f4f4806c8f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f5c161810 0x7f4f5c1fa150 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cdf50 0x7f4f5c06bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 --2- 172.21.15.113:0/1544846460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c070170 0x7f4f5c151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 >> 172.21.15.113:0/1544846460 conn(0x7f4f5c0b0100 msgr2=0x7f4f5c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 shutdown_connections 2023-12-19T13:49:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.024+0000 7f4f61bf4640 1 -- 172.21.15.113:0/1544846460 wait complete. 2023-12-19T13:49:11.103 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:11.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.320+0000 7f8aed9ae640 1 Processor -- start 2023-12-19T13:49:11.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.320+0000 7f8aed9ae640 1 -- start start 2023-12-19T13:49:11.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8aed9ae640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8ae8157aa0 0x7f8ae80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:11.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8aed9ae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:11.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8aed9ae640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae806e8c0 con 0x7f8ae806e410 2023-12-19T13:49:11.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8aed9ae640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae815e9c0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8aed9ae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80b2600 con 0x7f8ae815e040 2023-12-19T13:49:11.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8ae6ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8ae8157aa0 0x7f8ae80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:11.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8ae6ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8ae8157aa0 0x7f8ae80b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58050/0 (socket says 172.21.15.113:58050) 2023-12-19T13:49:11.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.322+0000 7f8ae6ffd640 1 -- 172.21.15.113:0/2968103766 learned_addr learned my addr 172.21.15.113:0/2968103766 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:11.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.323+0000 7f8ae77fe640 1 --2- 172.21.15.113:0/2968103766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:11.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.323+0000 7f8ae6ffd640 1 -- 172.21.15.113:0/2968103766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 msgr2=0x7f8ae815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:11.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.323+0000 7f8ae6ffd640 1 --2- 172.21.15.113:0/2968103766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae815e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.323+0000 7f8ae6ffd640 1 -- 172.21.15.113:0/2968103766 >> v1:172.21.15.151:6789/0 conn(0x7f8ae806e410 legacy=0x7f8ae8161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:11.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.323+0000 7f8ae6ffd640 1 -- 172.21.15.113:0/2968103766 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80b1d60 con 0x7f8ae8157aa0 2023-12-19T13:49:11.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.323+0000 7f8ae77fe640 1 --2- 172.21.15.113:0/2968103766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:11.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.324+0000 7f8ae6ffd640 1 --2- 172.21.15.113:0/2968103766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae80b1710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009870 tx=0x7f8ad802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6a7c69d475b7b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:11.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.324+0000 7f8ae5ffb640 1 -- 172.21.15.113:0/2968103766 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8031640 con 0x7f8ae8157aa0 2023-12-19T13:49:11.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.324+0000 7f8ae5ffb640 1 -- 172.21.15.113:0/2968103766 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad80317a0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.324+0000 7f8ae5ffb640 1 -- 172.21.15.113:0/2968103766 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8031b30 con 0x7f8ae8157aa0 2023-12-19T13:49:11.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 -- 172.21.15.113:0/2968103766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 msgr2=0x7f8ae80b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:11.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/2968103766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae80b1710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009870 tx=0x7f8ad802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 -- 172.21.15.113:0/2968103766 shutdown_connections 2023-12-19T13:49:11.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/2968103766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/2968103766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae80b1710 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 -- 172.21.15.113:0/2968103766 >> 172.21.15.113:0/2968103766 conn(0x7f8ae80cbb70 msgr2=0x7f8ae80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:11.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 -- 172.21.15.113:0/2968103766 shutdown_connections 2023-12-19T13:49:11.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.325+0000 7f8aed9ae640 1 -- 172.21.15.113:0/2968103766 wait complete. 2023-12-19T13:49:11.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.327+0000 7f8aed9ae640 1 Processor -- start 2023-12-19T13:49:11.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.327+0000 7f8aed9ae640 1 -- start start 2023-12-19T13:49:11.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8aed9ae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ae806e410 0x7f8ae80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8aed9ae640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae81580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8aed9ae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae81438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8aed9ae640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80aebf0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8aed9ae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80ad610 con 0x7f8ae806e410 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8aed9ae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80ad8f0 con 0x7f8ae815e040 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8ae67fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae81580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8ae67fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae81580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58064/0 (socket says 172.21.15.113:58064) 2023-12-19T13:49:11.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.328+0000 7f8ae67fc640 1 -- 172.21.15.113:0/273770353 learned_addr learned my addr 172.21.15.113:0/273770353 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:11.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae77fe640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae81438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:11.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae6ffd640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ae806e410 0x7f8ae80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:11.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae67fc640 1 -- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 msgr2=0x7f8ae81438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:11.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae67fc640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae81438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae67fc640 1 -- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ae806e410 msgr2=0x7f8ae80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae67fc640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ae806e410 0x7f8ae80ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae67fc640 1 -- 172.21.15.113:0/273770353 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80094d0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8ae67fc640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae81580f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c430 tx=0x7f8adc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8acffff640 1 -- 172.21.15.113:0/273770353 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011790 con 0x7f8ae8157aa0 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8acffff640 1 -- 172.21.15.113:0/273770353 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0118f0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8acffff640 1 -- 172.21.15.113:0/273770353 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011ca0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae80adbd0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.329+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae80ae190 con 0x7f8ae8157aa0 2023-12-19T13:49:11.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.331+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae80ae3b0 con 0x7f8ae8157aa0 2023-12-19T13:49:11.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.331+0000 7f8acffff640 1 -- 172.21.15.113:0/273770353 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8adc01c460 con 0x7f8ae8157aa0 2023-12-19T13:49:11.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.332+0000 7f8acffff640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ad406a430 0x7f8ad406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:11.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.333+0000 7f8acffff640 1 -- 172.21.15.113:0/273770353 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8adc088910 con 0x7f8ae8157aa0 2023-12-19T13:49:11.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.333+0000 7f8ae6ffd640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ad406a430 0x7f8ad406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:11.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.334+0000 7f8ae6ffd640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ad406a430 0x7f8ad406c8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8036000 tx=0x7f8ad803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:11.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.337+0000 7f8acffff640 1 -- 172.21.15.113:0/273770353 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8adc053e60 con 0x7f8ae8157aa0 2023-12-19T13:49:11.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.566+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ae8061910 con 0x7f8ae8157aa0 2023-12-19T13:49:11.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.567+0000 7f8acffff640 1 -- 172.21.15.113:0/273770353 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f8adc057480 con 0x7f8ae8157aa0 2023-12-19T13:49:11.568 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:11.568 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:49:11.569 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ad406a430 msgr2=0x7f8ad406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ad406a430 0x7f8ad406c8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8036000 tx=0x7f8ad803c040 comp rx=0 tx=0).stop 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 msgr2=0x7f8ae81580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae81580f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c430 tx=0x7f8adc00c8f0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 shutdown_connections 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8ad406a430 0x7f8ad406c8f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ae815e040 0x7f8ae81438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ae8157aa0 0x7f8ae81580f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 --2- 172.21.15.113:0/273770353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ae806e410 0x7f8ae80ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 >> 172.21.15.113:0/273770353 conn(0x7f8ae80cbb70 msgr2=0x7f8ae815c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:11.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 shutdown_connections 2023-12-19T13:49:11.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:11.570+0000 7f8aed9ae640 1 -- 172.21.15.113:0/273770353 wait complete. 2023-12-19T13:49:11.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T13:49:11.818 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":5577,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":40.775918685000001,"mdsmap_epoch":25,"osdmap_epoch":59,"osdmap_epoch_barrier":52,"uptime":46.284669958999999} 2023-12-19T13:49:11.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 5577, "mdsmap_epoch": 25, "osdmap_epoch": 59, "osdmap_epoch_barrier": 52, "rank_uptime": 40.775918685, "state": "up:active", "uptime": 46.284669959, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:49:11.819 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:49:11.819 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:49:11.819 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:11.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:11.875 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T13:49:12.335 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T13:49:12.335 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T13:49:12.335 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.400032 s, 131 MB/s 2023-12-19T13:49:12.336 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:49:12.336 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:49:12.434 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:49:12.552 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:49:12.553 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:49:12.553 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:12.615 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:49:12.616 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:12.669 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:12.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.880+0000 7f9f7d98b640 1 Processor -- start 2023-12-19T13:49:12.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.880+0000 7f9f7d98b640 1 -- start start 2023-12-19T13:49:12.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.882+0000 7f9f7d98b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 0x7f9f7815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.882+0000 7f9f7d98b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7815b740 con 0x7f9f780b0810 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.882+0000 7f9f7d98b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780ae640 con 0x7f9f780ae110 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.882+0000 7f9f7d98b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7806b8c0 con 0x7f9f78157bf0 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.883+0000 7f9f777fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9f780b0810 0x7f9f7806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49778/0 (socket says 172.21.15.113:49778) 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.883+0000 7f9f777fe640 1 -- 172.21.15.113:0/2769476029 learned_addr learned my addr 172.21.15.113:0/2769476029 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.883+0000 7f9f76ffd640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 0x7f9f7815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.883+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130298382 0 0) 0x7f9f7815b740 con 0x7f9f780b0810 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.883+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f64005730 con 0x7f9f780b0810 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1320543726 0 0) 0x7f9f64005730 con 0x7f9f780b0810 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 msgr2=0x7f9f7815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 0x7f9f7815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 >> v1:172.21.15.151:6789/0 conn(0x7f9f780ae110 legacy=0x7f9f780b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780ae920 con 0x7f9f780b0810 2023-12-19T13:49:12.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9f70001670 con 0x7f9f780b0810 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 >> v1:172.21.15.113:6789/0 conn(0x7f9f780b0810 legacy=0x7f9f7806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 0x7f9f64005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f640069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f64006f10 0x7f9f64007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7806b8c0 con 0x7f9f640061f0 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6400dd50 con 0x7f9f64006f10 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6400df10 con 0x7f9f78157bf0 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f6e7fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f640069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.884+0000 7f9f76ffd640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 0x7f9f64005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.885+0000 7f9f777fe640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f64006f10 0x7f9f64007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:12.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.885+0000 7f9f6e7fc640 1 -- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 msgr2=0x7f9f64005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.885+0000 7f9f6e7fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f78157bf0 0x7f9f64005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.885+0000 7f9f6e7fc640 1 -- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f64006f10 msgr2=0x7f9f64007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.885+0000 7f9f6e7fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f64006f10 0x7f9f64007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.885+0000 7f9f6e7fc640 1 -- 172.21.15.113:0/2769476029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64005730 con 0x7f9f640061f0 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.886+0000 7f9f6e7fc640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f640069d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9f60001e20 tx=0x7f9f64007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb66a944348a4dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.886+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60003b70 con 0x7f9f640061f0 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.886+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60003cd0 con 0x7f9f640061f0 2023-12-19T13:49:12.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.886+0000 7f9f767fc640 1 -- 172.21.15.113:0/2769476029 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60005310 con 0x7f9f640061f0 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.886+0000 7f9f7d98b640 1 -- 172.21.15.113:0/2769476029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 msgr2=0x7f9f640069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.886+0000 7f9f7d98b640 1 --2- 172.21.15.113:0/2769476029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f640069d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9f60001e20 tx=0x7f9f64007a00 comp rx=0 tx=0).stop 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.887+0000 7f9f777fe640 1 -- 172.21.15.113:0/2769476029 reap_dead start 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.887+0000 7f9f7d98b640 1 -- 172.21.15.113:0/2769476029 shutdown_connections 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.887+0000 7f9f7d98b640 1 -- 172.21.15.113:0/2769476029 >> 172.21.15.113:0/2769476029 conn(0x7f9f780cbb70 msgr2=0x7f9f780cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.887+0000 7f9f7d98b640 1 -- 172.21.15.113:0/2769476029 shutdown_connections 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.887+0000 7f9f7d98b640 1 -- 172.21.15.113:0/2769476029 wait complete. 2023-12-19T13:49:12.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.888+0000 7f9f7d98b640 1 Processor -- start 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.889+0000 7f9f7d98b640 1 -- start start 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f7d98b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f781f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f7d98b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7815e150 0x7f9f7815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f7d98b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f781509c0 0x7f9f78150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f7d98b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7815a420 con 0x7f9f640061f0 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f7d98b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7815eb10 con 0x7f9f781509c0 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f7d98b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7814f740 con 0x7f9f7815e150 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f781f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:12.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f781f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58072/0 (socket says 172.21.15.113:58072) 2023-12-19T13:49:12.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 -- 172.21.15.113:0/3275511393 learned_addr learned my addr 172.21.15.113:0/3275511393 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:12.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 -- 172.21.15.113:0/3275511393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7815e150 msgr2=0x7f9f7815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:12.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f6e7fc640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7815e150 0x7f9f7815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:12.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7815e150 0x7f9f7815e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:12.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 -- 172.21.15.113:0/3275511393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f781509c0 msgr2=0x7f9f78150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:12.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f781509c0 0x7f9f78150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:12.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.890+0000 7f9f76ffd640 1 -- 172.21.15.113:0/3275511393 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f781f5d90 con 0x7f9f640061f0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.891+0000 7f9f76ffd640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f781f5850 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9f68011600 tx=0x7f9f68011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.891+0000 7f9f74ff9640 1 -- 172.21.15.113:0/3275511393 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800f920 con 0x7f9f640061f0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.891+0000 7f9f74ff9640 1 -- 172.21.15.113:0/3275511393 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800fa80 con 0x7f9f640061f0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.891+0000 7f9f74ff9640 1 -- 172.21.15.113:0/3275511393 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800fdf0 con 0x7f9f640061f0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.891+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f781597a0 con 0x7f9f640061f0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.891+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f78159d60 con 0x7f9f640061f0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.892+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f78061910 con 0x7f9f640061f0 2023-12-19T13:49:12.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.893+0000 7f9f74ff9640 1 -- 172.21.15.113:0/3275511393 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f68015460 con 0x7f9f640061f0 2023-12-19T13:49:12.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.894+0000 7f9f74ff9640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5806a430 0x7f9f5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:12.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.894+0000 7f9f74ff9640 1 -- 172.21.15.113:0/3275511393 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f68088df0 con 0x7f9f640061f0 2023-12-19T13:49:12.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.894+0000 7f9f6e7fc640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5806a430 0x7f9f5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:12.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.895+0000 7f9f6e7fc640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5806a430 0x7f9f5806c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9f60034000 tx=0x7f9f60009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:12.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:12.899+0000 7f9f74ff9640 1 -- 172.21.15.113:0/3275511393 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f68054470 con 0x7f9f640061f0 2023-12-19T13:49:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.090+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f780b1070 con 0x7f9f640061f0 2023-12-19T13:49:13.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.093+0000 7f9f74ff9640 1 -- 172.21.15.113:0/3275511393 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f9f68057a90 con 0x7f9f640061f0 2023-12-19T13:49:13.095 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:13.095 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":59,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:09.466677+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:13.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5806a430 msgr2=0x7f9f5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5806a430 0x7f9f5806c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9f60034000 tx=0x7f9f60009030 comp rx=0 tx=0).stop 2023-12-19T13:49:13.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 msgr2=0x7f9f781f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f781f5850 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9f68011600 tx=0x7f9f68011ac0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 shutdown_connections 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5806a430 0x7f9f5806c8f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f781509c0 0x7f9f78150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7815e150 0x7f9f7815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 --2- 172.21.15.113:0/3275511393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f640061f0 0x7f9f781f5850 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 >> 172.21.15.113:0/3275511393 conn(0x7f9f780cbb70 msgr2=0x7f9f780b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 shutdown_connections 2023-12-19T13:49:13.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.096+0000 7f9f7d98b640 1 -- 172.21.15.113:0/3275511393 wait complete. 2023-12-19T13:49:13.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:48:28.798187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:48:30.040745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:49:13.118 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:49:13.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.324+0000 7f58a5d00640 1 Processor -- start 2023-12-19T13:49:13.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.325+0000 7f58a5d00640 1 -- start start 2023-12-19T13:49:13.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.326+0000 7f58a5d00640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58a0146ff0 0x7f58a00d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.326+0000 7f58a5d00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f58a006fc40 0x7f58a015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.326+0000 7f58a5d00640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0161e70 con 0x7f58a00b6430 2023-12-19T13:49:13.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.326+0000 7f58a5d00640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a0161080 con 0x7f58a0146ff0 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.326+0000 7f58a5d00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a0161260 con 0x7f58a006fc40 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.326+0000 7f589f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58a0146ff0 0x7f58a00d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f5897fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f58a00b6430 0x7f58a006f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49780/0 (socket says 172.21.15.113:49780) 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f5897fff640 1 -- 172.21.15.113:0/1778605578 learned_addr learned my addr 172.21.15.113:0/1778605578 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f589ffff640 1 --2- 172.21.15.113:0/1778605578 >> v2:172.21.15.151:3300/0 conn(0x7f58a006fc40 0x7f58a015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f589f7fe640 1 -- 172.21.15.113:0/1778605578 >> v2:172.21.15.151:3300/0 conn(0x7f58a006fc40 msgr2=0x7f58a015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f589f7fe640 1 --2- 172.21.15.113:0/1778605578 >> v2:172.21.15.151:3300/0 conn(0x7f58a006fc40 0x7f58a015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f589f7fe640 1 -- 172.21.15.113:0/1778605578 >> v1:172.21.15.113:6789/0 conn(0x7f58a00b6430 legacy=0x7f58a006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f589f7fe640 1 -- 172.21.15.113:0/1778605578 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0161540 con 0x7f58a0146ff0 2023-12-19T13:49:13.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.327+0000 7f589ffff640 1 --2- 172.21.15.113:0/1778605578 >> v2:172.21.15.151:3300/0 conn(0x7f58a006fc40 0x7f58a015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:13.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.328+0000 7f589f7fe640 1 --2- 172.21.15.113:0/1778605578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a0146ff0 0x7f58a00d10f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f58900097a0 tx=0x7f589002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d12180f898c38a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:13.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.328+0000 7f589effd640 1 -- 172.21.15.113:0/1778605578 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890031830 con 0x7f58a0146ff0 2023-12-19T13:49:13.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.328+0000 7f589effd640 1 -- 172.21.15.113:0/1778605578 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890031990 con 0x7f58a0146ff0 2023-12-19T13:49:13.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f589effd640 1 -- 172.21.15.113:0/1778605578 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890031d20 con 0x7f58a0146ff0 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 -- 172.21.15.113:0/1778605578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a0146ff0 msgr2=0x7f58a00d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 --2- 172.21.15.113:0/1778605578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a0146ff0 0x7f58a00d10f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f58900097a0 tx=0x7f589002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 -- 172.21.15.113:0/1778605578 shutdown_connections 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 --2- 172.21.15.113:0/1778605578 >> v2:172.21.15.151:3300/0 conn(0x7f58a006fc40 0x7f58a015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 --2- 172.21.15.113:0/1778605578 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a0146ff0 0x7f58a00d10f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 -- 172.21.15.113:0/1778605578 >> 172.21.15.113:0/1778605578 conn(0x7f58a00d3520 msgr2=0x7f58a00d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 -- 172.21.15.113:0/1778605578 shutdown_connections 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.329+0000 7f58a5d00640 1 -- 172.21.15.113:0/1778605578 wait complete. 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.331+0000 7f58a5d00640 1 Processor -- start 2023-12-19T13:49:13.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.331+0000 7f58a5d00640 1 -- start start 2023-12-19T13:49:13.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.332+0000 7f58a5d00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58a006fc40 0x7f58a0141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.332+0000 7f58a5d00640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a00b6430 0x7f58a01f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.332+0000 7f58a5d00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58a0146ff0 0x7f58a0143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.332+0000 7f58a5d00640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01f3720 con 0x7f58a00b6430 2023-12-19T13:49:13.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.332+0000 7f58a5d00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0144390 con 0x7f58a0146ff0 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.332+0000 7f58a5d00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01430d0 con 0x7f58a006fc40 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a00b6430 0x7f58a01f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a00b6430 0x7f58a01f31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58084/0 (socket says 172.21.15.113:58084) 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 -- 172.21.15.113:0/668646225 learned_addr learned my addr 172.21.15.113:0/668646225 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f589ffff640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58a0146ff0 0x7f58a0143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f589f7fe640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58a006fc40 0x7f58a0141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 -- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58a006fc40 msgr2=0x7f58a0141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58a006fc40 0x7f58a0141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 -- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58a0146ff0 msgr2=0x7f58a0143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58a0146ff0 0x7f58a0143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 -- 172.21.15.113:0/668646225 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009400 con 0x7f58a00b6430 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f589f7fe640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58a006fc40 0x7f58a0141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.333+0000 7f5897fff640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a00b6430 0x7f58a01f31e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f588800c500 tx=0x7f588800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.334+0000 7f589cff9640 1 -- 172.21.15.113:0/668646225 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888005ce0 con 0x7f58a00b6430 2023-12-19T13:49:13.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.334+0000 7f589cff9640 1 -- 172.21.15.113:0/668646225 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888005e40 con 0x7f58a00b6430 2023-12-19T13:49:13.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.334+0000 7f589cff9640 1 -- 172.21.15.113:0/668646225 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880072d0 con 0x7f58a00b6430 2023-12-19T13:49:13.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.334+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a0143370 con 0x7f58a00b6430 2023-12-19T13:49:13.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.334+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a0143930 con 0x7f58a00b6430 2023-12-19T13:49:13.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.335+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a0061910 con 0x7f58a00b6430 2023-12-19T13:49:13.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.336+0000 7f589cff9640 1 -- 172.21.15.113:0/668646225 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58880074f0 con 0x7f58a00b6430 2023-12-19T13:49:13.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.337+0000 7f589cff9640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f588006a430 0x7f588006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.337+0000 7f589cff9640 1 -- 172.21.15.113:0/668646225 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5888087da0 con 0x7f58a00b6430 2023-12-19T13:49:13.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.337+0000 7f589f7fe640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f588006a430 0x7f588006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.338+0000 7f589f7fe640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f588006a430 0x7f588006c8f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5890036000 tx=0x7f589003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:13.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.341+0000 7f589cff9640 1 -- 172.21.15.113:0/668646225 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5888053450 con 0x7f58a00b6430 2023-12-19T13:49:13.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.533+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58a00b5f10 con 0x7f58a00b6430 2023-12-19T13:49:13.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.534+0000 7f589cff9640 1 -- 172.21.15.113:0/668646225 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5888056a70 con 0x7f58a00b6430 2023-12-19T13:49:13.534 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:49:13.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f588006a430 msgr2=0x7f588006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f588006a430 0x7f588006c8f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5890036000 tx=0x7f589003c040 comp rx=0 tx=0).stop 2023-12-19T13:49:13.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a00b6430 msgr2=0x7f58a01f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a00b6430 0x7f58a01f31e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f588800c500 tx=0x7f588800c9c0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 shutdown_connections 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f588006a430 0x7f588006c8f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58a0146ff0 0x7f58a0143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a00b6430 0x7f58a01f31e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 --2- 172.21.15.113:0/668646225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58a006fc40 0x7f58a0141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.536+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 >> 172.21.15.113:0/668646225 conn(0x7f58a00d3520 msgr2=0x7f58a00b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.537+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 shutdown_connections 2023-12-19T13:49:13.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.537+0000 7f58a5d00640 1 -- 172.21.15.113:0/668646225 wait complete. 2023-12-19T13:49:13.556 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:49:13.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.764+0000 7efda6eca640 1 Processor -- start 2023-12-19T13:49:13.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.764+0000 7efda6eca640 1 -- start start 2023-12-19T13:49:13.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.766+0000 7efda6eca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.766+0000 7efda6eca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efda00b0b50 0x7efda006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.766+0000 7efda6eca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efda006b590 0x7efda006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.766+0000 7efda6eca640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda00afb10 con 0x7efda006b590 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.766+0000 7efda6eca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda006bb30 con 0x7efda00b0b50 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.766+0000 7efda6eca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda00b0070 con 0x7efda01449e0 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efda006b590 0x7efda006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efda006b590 0x7efda006c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58086/0 (socket says 172.21.15.113:58086) 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 -- 172.21.15.113:0/1252294106 learned_addr learned my addr 172.21.15.113:0/1252294106 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efd9ffff640 1 --2- 172.21.15.113:0/1252294106 >> v2:172.21.15.151:3300/0 conn(0x7efda00b0b50 0x7efda006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda4c66640 1 --2- 172.21.15.113:0/1252294106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 -- 172.21.15.113:0/1252294106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 msgr2=0x7efda00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:13.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 --2- 172.21.15.113:0/1252294106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda00af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 -- 172.21.15.113:0/1252294106 >> v2:172.21.15.151:3300/0 conn(0x7efda00b0b50 msgr2=0x7efda006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:13.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 --2- 172.21.15.113:0/1252294106 >> v2:172.21.15.151:3300/0 conn(0x7efda00b0b50 0x7efda006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda5467640 1 -- 172.21.15.113:0/1252294106 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda00b0350 con 0x7efda006b590 2023-12-19T13:49:13.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.767+0000 7efda4c66640 1 --2- 172.21.15.113:0/1252294106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.768+0000 7efda5467640 1 --2- 172.21.15.113:0/1252294106 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda006b590 0x7efda006c4e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efda00b14b0 tx=0x7efd9802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9015832ca85a0fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.768+0000 7efd9f7fe640 1 -- 172.21.15.113:0/1252294106 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9802ca80 con 0x7efda006b590 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.768+0000 7efd9f7fe640 1 -- 172.21.15.113:0/1252294106 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9802cbe0 con 0x7efda006b590 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.768+0000 7efd9f7fe640 1 -- 172.21.15.113:0/1252294106 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd980343f0 con 0x7efda006b590 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 -- 172.21.15.113:0/1252294106 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda006b590 msgr2=0x7efda006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 --2- 172.21.15.113:0/1252294106 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda006b590 0x7efda006c4e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efda00b14b0 tx=0x7efd9802bee0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 -- 172.21.15.113:0/1252294106 shutdown_connections 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 --2- 172.21.15.113:0/1252294106 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda006b590 0x7efda006c4e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 --2- 172.21.15.113:0/1252294106 >> v2:172.21.15.151:3300/0 conn(0x7efda00b0b50 0x7efda006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 --2- 172.21.15.113:0/1252294106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 -- 172.21.15.113:0/1252294106 >> 172.21.15.113:0/1252294106 conn(0x7efda00cbb70 msgr2=0x7efda00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:13.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 -- 172.21.15.113:0/1252294106 shutdown_connections 2023-12-19T13:49:13.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.769+0000 7efda6eca640 1 -- 172.21.15.113:0/1252294106 wait complete. 2023-12-19T13:49:13.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.771+0000 7efda6eca640 1 Processor -- start 2023-12-19T13:49:13.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.771+0000 7efda6eca640 1 -- start start 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efda6eca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda006b590 0x7efda0070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efda6eca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda00b0b50 0x7efda00adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efda6eca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efda6eca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda00a8880 con 0x7efda00b0b50 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efda6eca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda00ae3e0 con 0x7efda006b590 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efda6eca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda0152a80 con 0x7efda01449e0 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efd9ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda00b0b50 0x7efda00adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efd9ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda00b0b50 0x7efda00adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58090/0 (socket says 172.21.15.113:58090) 2023-12-19T13:49:13.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.772+0000 7efd9ffff640 1 -- 172.21.15.113:0/4157228660 learned_addr learned my addr 172.21.15.113:0/4157228660 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:13.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efda4c66640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda006b590 0x7efda0070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efda5467640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9ffff640 1 -- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 msgr2=0x7efda015db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9ffff640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda015db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9ffff640 1 -- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda006b590 msgr2=0x7efda0070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9ffff640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda006b590 0x7efda0070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9ffff640 1 -- 172.21.15.113:0/4157228660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009b30 con 0x7efda00b0b50 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efda4c66640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda006b590 0x7efda0070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9ffff640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda00b0b50 0x7efda00adea0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7efd9000c7f0 tx=0x7efd9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9d7fa640 1 -- 172.21.15.113:0/4157228660 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90004220 con 0x7efda00b0b50 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9d7fa640 1 -- 172.21.15.113:0/4157228660 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90004380 con 0x7efda00b0b50 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda00cdb90 con 0x7efda00b0b50 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.773+0000 7efd9d7fa640 1 -- 172.21.15.113:0/4157228660 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90007860 con 0x7efda00b0b50 2023-12-19T13:49:13.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.774+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda00ce150 con 0x7efda00b0b50 2023-12-19T13:49:13.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.775+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda00a89c0 con 0x7efda00b0b50 2023-12-19T13:49:13.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.775+0000 7efd9d7fa640 1 -- 172.21.15.113:0/4157228660 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd90007bd0 con 0x7efda00b0b50 2023-12-19T13:49:13.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.776+0000 7efd9d7fa640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:13.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.777+0000 7efd9d7fa640 1 -- 172.21.15.113:0/4157228660 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd900889e0 con 0x7efda00b0b50 2023-12-19T13:49:13.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.777+0000 7efda4c66640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:13.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.777+0000 7efda4c66640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efd94006fd0 tx=0x7efd94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:13.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.781+0000 7efd9d7fa640 1 -- 172.21.15.113:0/4157228660 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efda00a89c0 con 0x7efda00b0b50 2023-12-19T13:49:13.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.970+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efda00a89c0 con 0x7efda00b0b50 2023-12-19T13:49:13.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.971+0000 7efd9d7fa640 1 -- 172.21.15.113:0/4157228660 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd9001e020 con 0x7efda00b0b50 2023-12-19T13:49:13.972 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:49:13.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.974+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 msgr2=0x7efd8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.974+0000 7efda6eca640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efd94006fd0 tx=0x7efd94008040 comp rx=0 tx=0).stop 2023-12-19T13:49:13.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.974+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda00b0b50 msgr2=0x7efda00adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.974+0000 7efda6eca640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda00b0b50 0x7efda00adea0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7efd9000c7f0 tx=0x7efd9000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 shutdown_connections 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda01449e0 0x7efda015db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda00b0b50 0x7efda00adea0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 --2- 172.21.15.113:0/4157228660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda006b590 0x7efda0070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 >> 172.21.15.113:0/4157228660 conn(0x7efda00cbb70 msgr2=0x7efda00b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 shutdown_connections 2023-12-19T13:49:13.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:13.975+0000 7efda6eca640 1 -- 172.21.15.113:0/4157228660 wait complete. 2023-12-19T13:49:13.995 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:49:14.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.206+0000 7f367d221640 1 Processor -- start 2023-12-19T13:49:14.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.206+0000 7f367d221640 1 -- start start 2023-12-19T13:49:14.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367d221640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36780b2760 0x7f36780b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367d221640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f36780ceea0 0x7f36780cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367d221640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367815fde0 con 0x7f367815b1d0 2023-12-19T13:49:14.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367d221640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780b2400 con 0x7f36780b2760 2023-12-19T13:49:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367d221640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780cf870 con 0x7f36780ceea0 2023-12-19T13:49:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36780b2760 0x7f36780b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36780b2760 0x7f36780b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58098/0 (socket says 172.21.15.113:58098) 2023-12-19T13:49:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.208+0000 7f367659c640 1 -- 172.21.15.113:0/2380685286 learned_addr learned my addr 172.21.15.113:0/2380685286 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:14.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.209+0000 7f367759e640 1 --2- 172.21.15.113:0/2380685286 >> v2:172.21.15.151:3300/0 conn(0x7f36780ceea0 0x7f36780cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.209+0000 7f367659c640 1 -- 172.21.15.113:0/2380685286 >> v2:172.21.15.151:3300/0 conn(0x7f36780ceea0 msgr2=0x7f36780cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:14.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.209+0000 7f367659c640 1 --2- 172.21.15.113:0/2380685286 >> v2:172.21.15.151:3300/0 conn(0x7f36780ceea0 0x7f36780cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.209+0000 7f367659c640 1 -- 172.21.15.113:0/2380685286 >> v1:172.21.15.151:6789/0 conn(0x7f367815b1d0 legacy=0x7f367815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:14.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.209+0000 7f367659c640 1 -- 172.21.15.113:0/2380685286 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780b2bc0 con 0x7f36780b2760 2023-12-19T13:49:14.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.210+0000 7f367659c640 1 --2- 172.21.15.113:0/2380685286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36780b1ec0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f36780663a0 tx=0x7f366c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b49c7406471d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.210+0000 7f3675d9b640 1 -- 172.21.15.113:0/2380685286 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c031870 con 0x7f36780b2760 2023-12-19T13:49:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.210+0000 7f3675d9b640 1 -- 172.21.15.113:0/2380685286 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c0319d0 con 0x7f36780b2760 2023-12-19T13:49:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.210+0000 7f3675d9b640 1 -- 172.21.15.113:0/2380685286 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c031d60 con 0x7f36780b2760 2023-12-19T13:49:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 -- 172.21.15.113:0/2380685286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 msgr2=0x7f36780b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 --2- 172.21.15.113:0/2380685286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36780b1ec0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f36780663a0 tx=0x7f366c02b910 comp rx=0 tx=0).stop 2023-12-19T13:49:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 -- 172.21.15.113:0/2380685286 shutdown_connections 2023-12-19T13:49:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 --2- 172.21.15.113:0/2380685286 >> v2:172.21.15.151:3300/0 conn(0x7f36780ceea0 0x7f36780cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 --2- 172.21.15.113:0/2380685286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36780b1ec0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 -- 172.21.15.113:0/2380685286 >> 172.21.15.113:0/2380685286 conn(0x7f3678073150 msgr2=0x7f36780659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 -- 172.21.15.113:0/2380685286 shutdown_connections 2023-12-19T13:49:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.211+0000 7f367d221640 1 -- 172.21.15.113:0/2380685286 wait complete. 2023-12-19T13:49:14.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.213+0000 7f367d221640 1 Processor -- start 2023-12-19T13:49:14.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.213+0000 7f367d221640 1 -- start start 2023-12-19T13:49:14.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f367d221640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36781438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f367d221640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780ceea0 0x7f3678156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f367d221640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815b1d0 0x7f3678156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f367d221640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780b0790 con 0x7f36780b2760 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f367d221640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780afb10 con 0x7f367815b1d0 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f367d221640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36780afdf0 con 0x7f36780ceea0 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f3676d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36781438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f3676d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36781438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58114/0 (socket says 172.21.15.113:58114) 2023-12-19T13:49:14.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f3676d9d640 1 -- 172.21.15.113:0/561236876 learned_addr learned my addr 172.21.15.113:0/561236876 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:14.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f3676d9d640 1 -- 172.21.15.113:0/561236876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780ceea0 msgr2=0x7f3678156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f3676d9d640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780ceea0 0x7f3678156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f3676d9d640 1 -- 172.21.15.113:0/561236876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815b1d0 msgr2=0x7f3678156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.214+0000 7f3676d9d640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815b1d0 0x7f3678156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.215+0000 7f3676d9d640 1 -- 172.21.15.113:0/561236876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0094d0 con 0x7f36780b2760 2023-12-19T13:49:14.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.215+0000 7f3676d9d640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36781438d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f366800b3e0 tx=0x7f366800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.215+0000 7f365f7fe640 1 -- 172.21.15.113:0/561236876 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668011830 con 0x7f36780b2760 2023-12-19T13:49:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.215+0000 7f365f7fe640 1 -- 172.21.15.113:0/561236876 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36680119b0 con 0x7f36780b2760 2023-12-19T13:49:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.215+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36780b00d0 con 0x7f36780b2760 2023-12-19T13:49:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.215+0000 7f365f7fe640 1 -- 172.21.15.113:0/561236876 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668011d60 con 0x7f36780b2760 2023-12-19T13:49:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.215+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3678143e10 con 0x7f36780b2760 2023-12-19T13:49:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.216+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36780ced10 con 0x7f36780b2760 2023-12-19T13:49:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.217+0000 7f365f7fe640 1 -- 172.21.15.113:0/561236876 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f366801a400 con 0x7f36780b2760 2023-12-19T13:49:14.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.218+0000 7f365f7fe640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f366406a430 0x7f366406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.218+0000 7f365f7fe640 1 -- 172.21.15.113:0/561236876 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3668088a30 con 0x7f36780b2760 2023-12-19T13:49:14.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.218+0000 7f367659c640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f366406a430 0x7f366406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.219+0000 7f367659c640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f366406a430 0x7f366406c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f366c036000 tx=0x7f366c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:14.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.223+0000 7f365f7fe640 1 -- 172.21.15.113:0/561236876 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f36680540b0 con 0x7f36780b2760 2023-12-19T13:49:14.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.411+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36780b08d0 con 0x7f36780b2760 2023-12-19T13:49:14.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.412+0000 7f365f7fe640 1 -- 172.21.15.113:0/561236876 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3668015020 con 0x7f36780b2760 2023-12-19T13:49:14.413 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:49:14.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f366406a430 msgr2=0x7f366406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f366406a430 0x7f366406c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f366c036000 tx=0x7f366c030000 comp rx=0 tx=0).stop 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 msgr2=0x7f36781438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36781438d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f366800b3e0 tx=0x7f366800b8a0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 shutdown_connections 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f366406a430 0x7f366406c8f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815b1d0 0x7f3678156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780ceea0 0x7f3678156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 --2- 172.21.15.113:0/561236876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780b2760 0x7f36781438d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 >> 172.21.15.113:0/561236876 conn(0x7f3678073150 msgr2=0x7f36780b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 shutdown_connections 2023-12-19T13:49:14.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.415+0000 7f367d221640 1 -- 172.21.15.113:0/561236876 wait complete. 2023-12-19T13:49:14.435 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:49:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.645+0000 7f62b0bd3640 1 Processor -- start 2023-12-19T13:49:14.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.645+0000 7f62b0bd3640 1 -- start start 2023-12-19T13:49:14.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.646+0000 7f62b0bd3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f62ac157bf0 0x7f62ac15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.646+0000 7f62b0bd3640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac15b740 con 0x7f62ac0b0810 2023-12-19T13:49:14.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.646+0000 7f62b0bd3640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac0ae640 con 0x7f62ac0ae110 2023-12-19T13:49:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.646+0000 7f62b0bd3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac06b8c0 con 0x7f62ac157bf0 2023-12-19T13:49:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.646+0000 7f62aad9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f62ac0b0810 0x7f62ac06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49784/0 (socket says 172.21.15.113:49784) 2023-12-19T13:49:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.646+0000 7f62aad9d640 1 -- 172.21.15.113:0/1097192857 learned_addr learned my addr 172.21.15.113:0/1097192857 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62aa59c640 1 --2- 172.21.15.113:0/1097192857 >> v2:172.21.15.151:3300/0 conn(0x7f62ac157bf0 0x7f62ac15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674110406 0 0) 0x7f62ac15b740 con 0x7f62ac0b0810 2023-12-19T13:49:14.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6298003520 con 0x7f62ac0b0810 2023-12-19T13:49:14.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374055372 0 0) 0x7f6298003520 con 0x7f62ac0b0810 2023-12-19T13:49:14.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 >> v2:172.21.15.151:3300/0 conn(0x7f62ac157bf0 msgr2=0x7f62ac15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 --2- 172.21.15.113:0/1097192857 >> v2:172.21.15.151:3300/0 conn(0x7f62ac157bf0 0x7f62ac15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 >> v1:172.21.15.151:6789/0 conn(0x7f62ac0ae110 legacy=0x7f62ac0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0ae920 con 0x7f62ac0b0810 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f62a40019f0 con 0x7f62ac0b0810 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 >> v1:172.21.15.113:6789/0 conn(0x7f62ac0b0810 legacy=0x7f62ac06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.647+0000 7f62a9d9b640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6298003a30 0x7f6298003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62a9d9b640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62980047c0 0x7f6298004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62a9d9b640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62980051d0 0x7f629800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac06b8c0 con 0x7f62980051d0 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629800c100 con 0x7f62980047c0 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629800c2c0 con 0x7f6298003a30 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62aad9d640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62980051d0 0x7f629800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62aa59c640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6298003a30 0x7f6298003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62a3fff640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62980047c0 0x7f6298004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62aad9d640 1 -- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6298003a30 msgr2=0x7f6298003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62aad9d640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6298003a30 0x7f6298003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62aad9d640 1 -- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62980047c0 msgr2=0x7f6298004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62aad9d640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62980047c0 0x7f6298004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62aad9d640 1 -- 172.21.15.113:0/1097192857 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298003520 con 0x7f62980051d0 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.648+0000 7f62a3fff640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62980047c0 0x7f6298004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.649+0000 7f62aad9d640 1 -- 172.21.15.113:0/1097192857 reap_dead start 2023-12-19T13:49:14.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.649+0000 7f62aad9d640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62980051d0 0x7f629800b980 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f62a400a760 tx=0x7f62980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a1e922e31e0ee7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:14.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4034630 con 0x7f62980051d0 2023-12-19T13:49:14.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a402f070 con 0x7f62980051d0 2023-12-19T13:49:14.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62a9d9b640 1 -- 172.21.15.113:0/1097192857 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4034a10 con 0x7f62980051d0 2023-12-19T13:49:14.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62b0bd3640 1 -- 172.21.15.113:0/1097192857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62980051d0 msgr2=0x7f629800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62980051d0 0x7f629800b980 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f62a400a760 tx=0x7f62980057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62b0bd3640 1 -- 172.21.15.113:0/1097192857 shutdown_connections 2023-12-19T13:49:14.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/1097192857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62980051d0 0x7f629800b980 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62b0bd3640 1 -- 172.21.15.113:0/1097192857 >> 172.21.15.113:0/1097192857 conn(0x7f62ac0cbb70 msgr2=0x7f62ac0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:14.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62b0bd3640 1 -- 172.21.15.113:0/1097192857 shutdown_connections 2023-12-19T13:49:14.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.650+0000 7f62b0bd3640 1 -- 172.21.15.113:0/1097192857 wait complete. 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.652+0000 7f62b0bd3640 1 Processor -- start 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.652+0000 7f62b0bd3640 1 -- start start 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.653+0000 7f62b0bd3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62980051d0 0x7f62ac145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.653+0000 7f62b0bd3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62ac160020 0x7f62ac1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.653+0000 7f62b0bd3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62ac159250 0x7f62ac1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.653+0000 7f62b0bd3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac15afd0 con 0x7f62ac159250 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.653+0000 7f62b0bd3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac1609e0 con 0x7f62ac160020 2023-12-19T13:49:14.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.653+0000 7f62b0bd3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac15b800 con 0x7f62980051d0 2023-12-19T13:49:14.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62ac159250 0x7f62ac1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62ac159250 0x7f62ac1596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58132/0 (socket says 172.21.15.113:58132) 2023-12-19T13:49:14.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 -- 172.21.15.113:0/860507071 learned_addr learned my addr 172.21.15.113:0/860507071 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aa59c640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62980051d0 0x7f62ac145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62a3fff640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62ac160020 0x7f62ac1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 -- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62980051d0 msgr2=0x7f62ac145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62980051d0 0x7f62ac145ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 -- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62ac160020 msgr2=0x7f62ac1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62ac160020 0x7f62ac1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 -- 172.21.15.113:0/860507071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac159f80 con 0x7f62ac159250 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62a3fff640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62ac160020 0x7f62ac1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.654+0000 7f62aad9d640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62ac159250 0x7f62ac1596d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f62a4002230 tx=0x7f62a4001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.655+0000 7f62a2ffd640 1 -- 172.21.15.113:0/860507071 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4001730 con 0x7f62ac159250 2023-12-19T13:49:14.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.655+0000 7f62a2ffd640 1 -- 172.21.15.113:0/860507071 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4001890 con 0x7f62ac159250 2023-12-19T13:49:14.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.655+0000 7f62a2ffd640 1 -- 172.21.15.113:0/860507071 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4004d80 con 0x7f62ac159250 2023-12-19T13:49:14.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.655+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac15b1b0 con 0x7f62ac159250 2023-12-19T13:49:14.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.655+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac146010 con 0x7f62ac159250 2023-12-19T13:49:14.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.656+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac0719a0 con 0x7f62ac159250 2023-12-19T13:49:14.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.657+0000 7f62a2ffd640 1 -- 172.21.15.113:0/860507071 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62a4031030 con 0x7f62ac159250 2023-12-19T13:49:14.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.658+0000 7f62a2ffd640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f628c06a430 0x7f628c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:14.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.658+0000 7f62a2ffd640 1 -- 172.21.15.113:0/860507071 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62a40a9d30 con 0x7f62ac159250 2023-12-19T13:49:14.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.658+0000 7f62aa59c640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f628c06a430 0x7f628c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:14.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.659+0000 7f62aa59c640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f628c06a430 0x7f628c06c8f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f629c0098d0 tx=0x7f629c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:14.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.663+0000 7f62a2ffd640 1 -- 172.21.15.113:0/860507071 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62a4075280 con 0x7f62ac159250 2023-12-19T13:49:14.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.865+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f62ac061910 con 0x7f62ac159250 2023-12-19T13:49:14.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.866+0000 7f62a2ffd640 1 -- 172.21.15.113:0/860507071 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62a40788a0 con 0x7f62ac159250 2023-12-19T13:49:14.867 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:49:14.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.868+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f628c06a430 msgr2=0x7f628c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f628c06a430 0x7f628c06c8f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f629c0098d0 tx=0x7f629c008040 comp rx=0 tx=0).stop 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62ac159250 msgr2=0x7f62ac1596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62ac159250 0x7f62ac1596d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f62a4002230 tx=0x7f62a4001cb0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 shutdown_connections 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f628c06a430 0x7f628c06c8f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62ac159250 0x7f62ac1596d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62ac160020 0x7f62ac1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 --2- 172.21.15.113:0/860507071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62980051d0 0x7f62ac145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 >> 172.21.15.113:0/860507071 conn(0x7f62ac0cbb70 msgr2=0x7f62ac0b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 shutdown_connections 2023-12-19T13:49:14.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:14.869+0000 7f62b0bd3640 1 -- 172.21.15.113:0/860507071 wait complete. 2023-12-19T13:49:14.888 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:49:14.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:14.889 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:49:15.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:49:15.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:15.032 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:49:15.078 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:49:15.078 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:15.122 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:49:15.122 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:15.218 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:15.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.436+0000 7f91a02ca640 1 Processor -- start 2023-12-19T13:49:15.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.436+0000 7f91a02ca640 1 -- start start 2023-12-19T13:49:15.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.438+0000 7f91a02ca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9198157bf0 0x7f919815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.438+0000 7f91a02ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f919806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.438+0000 7f91a02ca640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919815b740 con 0x7f91980ae110 2023-12-19T13:49:15.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.438+0000 7f91a02ca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919806b8c0 con 0x7f9198157bf0 2023-12-19T13:49:15.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.438+0000 7f91a02ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91980ae640 con 0x7f91980b0810 2023-12-19T13:49:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.439+0000 7f919e066640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9198157bf0 0x7f919815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.439+0000 7f919e066640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9198157bf0 0x7f919815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:51800/0 (socket says 172.21.15.113:51800) 2023-12-19T13:49:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.439+0000 7f919e066640 1 -- 172.21.15.113:0/2962616434 learned_addr learned my addr 172.21.15.113:0/2962616434 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.439+0000 7f919e867640 1 --2- 172.21.15.113:0/2962616434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f919806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.440+0000 7f919e867640 1 -- 172.21.15.113:0/2962616434 >> v2:172.21.15.151:3300/0 conn(0x7f9198157bf0 msgr2=0x7f919815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.440+0000 7f919e867640 1 --2- 172.21.15.113:0/2962616434 >> v2:172.21.15.151:3300/0 conn(0x7f9198157bf0 0x7f919815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.440+0000 7f919e867640 1 -- 172.21.15.113:0/2962616434 >> v1:172.21.15.151:6789/0 conn(0x7f91980ae110 legacy=0x7f91980b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.440+0000 7f919e867640 1 -- 172.21.15.113:0/2962616434 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980ae920 con 0x7f91980b0810 2023-12-19T13:49:15.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.442+0000 7f919e867640 1 --2- 172.21.15.113:0/2962616434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f919806d230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9190009d90 tx=0x7f919002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=489960d478e40bfe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:15.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.442+0000 7f919d064640 1 -- 172.21.15.113:0/2962616434 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919002cc60 con 0x7f91980b0810 2023-12-19T13:49:15.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.442+0000 7f919d064640 1 -- 172.21.15.113:0/2962616434 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919002cdc0 con 0x7f91980b0810 2023-12-19T13:49:15.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.442+0000 7f919d064640 1 -- 172.21.15.113:0/2962616434 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190034660 con 0x7f91980b0810 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 -- 172.21.15.113:0/2962616434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 msgr2=0x7f919806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 --2- 172.21.15.113:0/2962616434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f919806d230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9190009d90 tx=0x7f919002beb0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 -- 172.21.15.113:0/2962616434 shutdown_connections 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 --2- 172.21.15.113:0/2962616434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f919806d230 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 --2- 172.21.15.113:0/2962616434 >> v2:172.21.15.151:3300/0 conn(0x7f9198157bf0 0x7f919815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 -- 172.21.15.113:0/2962616434 >> 172.21.15.113:0/2962616434 conn(0x7f91980cbb70 msgr2=0x7f91980cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 -- 172.21.15.113:0/2962616434 shutdown_connections 2023-12-19T13:49:15.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.443+0000 7f91a02ca640 1 -- 172.21.15.113:0/2962616434 wait complete. 2023-12-19T13:49:15.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.445+0000 7f91a02ca640 1 Processor -- start 2023-12-19T13:49:15.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.445+0000 7f91a02ca640 1 -- start start 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f91a02ca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91980ae110 0x7f919814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f91a02ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f9198152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f91a02ca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9198157bf0 0x7f919814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f91a02ca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919814de30 con 0x7f91980ae110 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f91a02ca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919814f9f0 con 0x7f9198157bf0 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f91a02ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9198152e80 con 0x7f91980b0810 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f919e066640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91980ae110 0x7f919814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f919e066640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91980ae110 0x7f919814d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58134/0 (socket says 172.21.15.113:58134) 2023-12-19T13:49:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.446+0000 7f919e066640 1 -- 172.21.15.113:0/1806488702 learned_addr learned my addr 172.21.15.113:0/1806488702 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:15.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e867640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9198157bf0 0x7f919814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919d865640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f9198152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e066640 1 -- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 msgr2=0x7f9198152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e066640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f9198152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e066640 1 -- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9198157bf0 msgr2=0x7f919814f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e066640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9198157bf0 0x7f919814f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e066640 1 -- 172.21.15.113:0/1806488702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190009a70 con 0x7f91980ae110 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e867640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9198157bf0 0x7f919814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f919e066640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91980ae110 0x7f919814d150 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f919400ea90 tx=0x7f919400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f918effd640 1 -- 172.21.15.113:0/1806488702 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194019480 con 0x7f91980ae110 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f918effd640 1 -- 172.21.15.113:0/1806488702 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91940195e0 con 0x7f91980ae110 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9198152ba0 con 0x7f91980ae110 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f918effd640 1 -- 172.21.15.113:0/1806488702 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194019990 con 0x7f91980ae110 2023-12-19T13:49:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.447+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919815bd30 con 0x7f91980ae110 2023-12-19T13:49:15.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.449+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9198061910 con 0x7f91980ae110 2023-12-19T13:49:15.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.450+0000 7f918effd640 1 -- 172.21.15.113:0/1806488702 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9194019af0 con 0x7f91980ae110 2023-12-19T13:49:15.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.450+0000 7f918effd640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f917c06a430 0x7f917c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.451+0000 7f918effd640 1 -- 172.21.15.113:0/1806488702 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9194014070 con 0x7f91980ae110 2023-12-19T13:49:15.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.451+0000 7f919d865640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f917c06a430 0x7f917c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.451+0000 7f919d865640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f917c06a430 0x7f917c06c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f919815ee00 tx=0x7f9188009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:15.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.454+0000 7f918effd640 1 -- 172.21.15.113:0/1806488702 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9194054950 con 0x7f91980ae110 2023-12-19T13:49:15.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.649+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f919806bf50 con 0x7f91980ae110 2023-12-19T13:49:15.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.652+0000 7f918effd640 1 -- 172.21.15.113:0/1806488702 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f9194057f70 con 0x7f91980ae110 2023-12-19T13:49:15.652 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:15.652 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":59,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:09.466677+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f917c06a430 msgr2=0x7f917c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f917c06a430 0x7f917c06c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f919815ee00 tx=0x7f9188009040 comp rx=0 tx=0).stop 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91980ae110 msgr2=0x7f919814d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91980ae110 0x7f919814d150 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f919400ea90 tx=0x7f919400ef50 comp rx=0 tx=0).stop 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 shutdown_connections 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f917c06a430 0x7f917c06c8f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9198157bf0 0x7f919814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91980b0810 0x7f9198152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 --2- 172.21.15.113:0/1806488702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91980ae110 0x7f919814d150 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.655+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 >> 172.21.15.113:0/1806488702 conn(0x7f91980cbb70 msgr2=0x7f919806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:15.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.656+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 shutdown_connections 2023-12-19T13:49:15.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.656+0000 7f91a02ca640 1 -- 172.21.15.113:0/1806488702 wait complete. 2023-12-19T13:49:15.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:48:28.798187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:48:30.040745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:49:15.675 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:49:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.889+0000 7fb4c8e4c640 1 Processor -- start 2023-12-19T13:49:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.889+0000 7fb4c8e4c640 1 -- start start 2023-12-19T13:49:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.890+0000 7fb4c8e4c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4c415b290 0x7fb4c40b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.890+0000 7fb4c8e4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4c40b0070 0x7fb4c40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.890+0000 7fb4c8e4c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c40ccbd0 con 0x7fb4c4154760 2023-12-19T13:49:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.890+0000 7fb4c8e4c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c40ccf20 con 0x7fb4c415b290 2023-12-19T13:49:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.890+0000 7fb4c8e4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40b0a60 con 0x7fb4c40b0070 2023-12-19T13:49:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.891+0000 7fb4c259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb4c4154760 0x7fb4c40cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49794/0 (socket says 172.21.15.113:49794) 2023-12-19T13:49:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.891+0000 7fb4c259c640 1 -- 172.21.15.113:0/3560750796 learned_addr learned my addr 172.21.15.113:0/3560750796 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:15.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.891+0000 7fb4bbfff640 1 --2- 172.21.15.113:0/3560750796 >> v2:172.21.15.151:3300/0 conn(0x7fb4c415b290 0x7fb4c40b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.891+0000 7fb4c2d9d640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4c40b0070 0x7fb4c40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.891+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249677241 0 0) 0x7fb4c40ccbd0 con 0x7fb4c4154760 2023-12-19T13:49:15.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.891+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b0003520 con 0x7fb4c4154760 2023-12-19T13:49:15.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168704284 0 0) 0x7fb4b0003520 con 0x7fb4c4154760 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4c40b0070 msgr2=0x7fb4c40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4c40b0070 0x7fb4c40b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 >> v2:172.21.15.151:3300/0 conn(0x7fb4c415b290 msgr2=0x7fb4c40b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 --2- 172.21.15.113:0/3560750796 >> v2:172.21.15.151:3300/0 conn(0x7fb4c415b290 0x7fb4c40b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4154b40 con 0x7fb4c4154760 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb4b4001670 con 0x7fb4c4154760 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4bbfff640 1 --2- 172.21.15.113:0/3560750796 >> v2:172.21.15.151:3300/0 conn(0x7fb4c415b290 0x7fb4c40b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 >> v1:172.21.15.113:6789/0 conn(0x7fb4c4154760 legacy=0x7fb4c40cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4b00039e0 0x7fb4b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4b00047c0 0x7fb4b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4c40b0070 0x7fb4b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40ccf20 con 0x7fb4b00039e0 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40b0a60 con 0x7fb4b00047c0 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b000bae0 con 0x7fb4c40b0070 2023-12-19T13:49:15.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c259c640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4b00039e0 0x7fb4b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c259c640 1 -- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4c40b0070 msgr2=0x7fb4b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:15.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.892+0000 7fb4c259c640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4c40b0070 0x7fb4b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.893+0000 7fb4c259c640 1 -- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4b00047c0 msgr2=0x7fb4b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:15.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.893+0000 7fb4c259c640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4b00047c0 0x7fb4b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.893+0000 7fb4c259c640 1 -- 172.21.15.113:0/3560750796 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0003520 con 0x7fb4b00039e0 2023-12-19T13:49:15.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.894+0000 7fb4c259c640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4b00039e0 0x7fb4b0003e00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4001050 tx=0x7fb4b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff0d69a3972f0d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:15.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.894+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b402ec80 con 0x7fb4b00039e0 2023-12-19T13:49:15.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.894+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b402ede0 con 0x7fb4b00039e0 2023-12-19T13:49:15.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.894+0000 7fb4c1d9b640 1 -- 172.21.15.113:0/3560750796 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4005b10 con 0x7fb4b00039e0 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.894+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/3560750796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4b00039e0 msgr2=0x7fb4b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.894+0000 7fb4c8e4c640 1 --2- 172.21.15.113:0/3560750796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4b00039e0 0x7fb4b0003e00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4001050 tx=0x7fb4b00057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.894+0000 7fb4c2d9d640 1 -- 172.21.15.113:0/3560750796 reap_dead start 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.895+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/3560750796 shutdown_connections 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.895+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/3560750796 >> 172.21.15.113:0/3560750796 conn(0x7fb4c4073150 msgr2=0x7fb4c40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.895+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/3560750796 shutdown_connections 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.895+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/3560750796 wait complete. 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.896+0000 7fb4c8e4c640 1 Processor -- start 2023-12-19T13:49:15.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.896+0000 7fb4c8e4c640 1 -- start start 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.897+0000 7fb4c8e4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4b00039e0 0x7fb4c415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.897+0000 7fb4c8e4c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4c41f24f0 0x7fb4c415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.897+0000 7fb4c8e4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4c4154cd0 0x7fb4c40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.897+0000 7fb4c8e4c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41f2970 con 0x7fb4c41f24f0 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.897+0000 7fb4c8e4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41422a0 con 0x7fb4c4154cd0 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.897+0000 7fb4c8e4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4152260 con 0x7fb4b00039e0 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4c41f24f0 0x7fb4c415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4c41f24f0 0x7fb4c415d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58156/0 (socket says 172.21.15.113:58156) 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 -- 172.21.15.113:0/2579095797 learned_addr learned my addr 172.21.15.113:0/2579095797 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:15.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4c2d9d640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4c4154cd0 0x7fb4c40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 -- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4b00039e0 msgr2=0x7fb4c415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4c259c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4b00039e0 0x7fb4c415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4b00039e0 0x7fb4c415b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 -- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4c4154cd0 msgr2=0x7fb4c40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4c4154cd0 0x7fb4c40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 -- 172.21.15.113:0/2579095797 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40b1880 con 0x7fb4c41f24f0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4c2d9d640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4c4154cd0 0x7fb4c40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.898+0000 7fb4bbfff640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4c41f24f0 0x7fb4c415d000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00e5b0 tx=0x7fb4ac00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.899+0000 7fb4baffd640 1 -- 172.21.15.113:0/2579095797 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac013610 con 0x7fb4c41f24f0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.899+0000 7fb4baffd640 1 -- 172.21.15.113:0/2579095797 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac013770 con 0x7fb4c41f24f0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.899+0000 7fb4baffd640 1 -- 172.21.15.113:0/2579095797 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac013b20 con 0x7fb4c41f24f0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.899+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c40b1b60 con 0x7fb4c41f24f0 2023-12-19T13:49:15.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.899+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c40b2120 con 0x7fb4c41f24f0 2023-12-19T13:49:15.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.900+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c4061910 con 0x7fb4c41f24f0 2023-12-19T13:49:15.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.901+0000 7fb4baffd640 1 -- 172.21.15.113:0/2579095797 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb4ac013c80 con 0x7fb4c41f24f0 2023-12-19T13:49:15.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.902+0000 7fb4baffd640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb4a406a430 0x7fb4a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:15.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.902+0000 7fb4baffd640 1 -- 172.21.15.113:0/2579095797 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4ac088590 con 0x7fb4c41f24f0 2023-12-19T13:49:15.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.902+0000 7fb4c259c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb4a406a430 0x7fb4a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:15.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.903+0000 7fb4c259c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb4a406a430 0x7fb4a406c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4036000 tx=0x7fb4b403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:15.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:15.907+0000 7fb4baffd640 1 -- 172.21.15.113:0/2579095797 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb4ac053ae0 con 0x7fb4c41f24f0 2023-12-19T13:49:16.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.096+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4c415e690 con 0x7fb4c41f24f0 2023-12-19T13:49:16.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.097+0000 7fb4baffd640 1 -- 172.21.15.113:0/2579095797 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4ac057100 con 0x7fb4c41f24f0 2023-12-19T13:49:16.097 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:49:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.100+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb4a406a430 msgr2=0x7fb4a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.100+0000 7fb4c8e4c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb4a406a430 0x7fb4a406c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4036000 tx=0x7fb4b403b040 comp rx=0 tx=0).stop 2023-12-19T13:49:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.100+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4c41f24f0 msgr2=0x7fb4c415d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.100+0000 7fb4c8e4c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4c41f24f0 0x7fb4c415d000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00e5b0 tx=0x7fb4ac00ea70 comp rx=0 tx=0).stop 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.100+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 shutdown_connections 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.100+0000 7fb4c8e4c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb4a406a430 0x7fb4a406c8f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.100+0000 7fb4c8e4c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4c4154cd0 0x7fb4c40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.101+0000 7fb4c8e4c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4c41f24f0 0x7fb4c415d000 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.101+0000 7fb4c8e4c640 1 --2- 172.21.15.113:0/2579095797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4b00039e0 0x7fb4c415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.101+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 >> 172.21.15.113:0/2579095797 conn(0x7fb4c4073150 msgr2=0x7fb4c41479e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.101+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 shutdown_connections 2023-12-19T13:49:16.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.101+0000 7fb4c8e4c640 1 -- 172.21.15.113:0/2579095797 wait complete. 2023-12-19T13:49:16.118 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:49:16.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.328+0000 7f6274bef640 1 Processor -- start 2023-12-19T13:49:16.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.328+0000 7f6274bef640 1 -- start start 2023-12-19T13:49:16.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.329+0000 7f6274bef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 0x7f627006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.329+0000 7f6274bef640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627015c9c0 con 0x7f62700b0a00 2023-12-19T13:49:16.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.329+0000 7f6274bef640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627006d270 con 0x7f6270155460 2023-12-19T13:49:16.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.329+0000 7f6274bef640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627006d550 con 0x7f627015de60 2023-12-19T13:49:16.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.330+0000 7f6267fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f62700b0a00 0x7f627006c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49800/0 (socket says 172.21.15.113:49800) 2023-12-19T13:49:16.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.330+0000 7f6267fff640 1 -- 172.21.15.113:0/1329740104 learned_addr learned my addr 172.21.15.113:0/1329740104 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:16.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.330+0000 7f626ffff640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 0x7f627006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.330+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828160334 0 0) 0x7f627015c9c0 con 0x7f62700b0a00 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.330+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f625c003520 con 0x7f62700b0a00 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994737099 0 0) 0x7f625c003520 con 0x7f62700b0a00 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 msgr2=0x7f627006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 0x7f627006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 >> v1:172.21.15.151:6789/0 conn(0x7f6270155460 legacy=0x7f62700b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627006d830 con 0x7f62700b0a00 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6258001670 con 0x7f62700b0a00 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 >> v1:172.21.15.113:6789/0 conn(0x7f62700b0a00 legacy=0x7f627006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c003a10 0x7f625c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 0x7f625c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f625c004d00 0x7f625c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627006d550 con 0x7f625c004d00 2023-12-19T13:49:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c00ba90 con 0x7f625c003a10 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c00bc50 con 0x7f627015de60 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.331+0000 7f626ffff640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f625c004d00 0x7f625c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f626f7fe640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c003a10 0x7f625c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f626ffff640 1 -- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 msgr2=0x7f625c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f6267fff640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 0x7f625c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f626ffff640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 0x7f625c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f626ffff640 1 -- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c003a10 msgr2=0x7f625c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f626ffff640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c003a10 0x7f625c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f626ffff640 1 -- 172.21.15.113:0/1329740104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c003520 con 0x7f625c004d00 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f626f7fe640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c003a10 0x7f625c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:16.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.332+0000 7f6267fff640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627015de60 0x7f625c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.333+0000 7f626ffff640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f625c004d00 0x7f625c005180 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6268009f90 tx=0x7f625c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46a9ca994ffc1ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.333+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626802cbd0 con 0x7f625c004d00 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.333+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800f040 con 0x7f625c004d00 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.333+0000 7f626effd640 1 -- 172.21.15.113:0/1329740104 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268034440 con 0x7f625c004d00 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.334+0000 7f6274bef640 1 -- 172.21.15.113:0/1329740104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f625c004d00 msgr2=0x7f625c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.334+0000 7f6274bef640 1 --2- 172.21.15.113:0/1329740104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f625c004d00 0x7f625c005180 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6268009f90 tx=0x7f625c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.334+0000 7f626ffff640 1 -- 172.21.15.113:0/1329740104 reap_dead start 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.334+0000 7f6274bef640 1 -- 172.21.15.113:0/1329740104 shutdown_connections 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.334+0000 7f6274bef640 1 -- 172.21.15.113:0/1329740104 >> 172.21.15.113:0/1329740104 conn(0x7f62700659a0 msgr2=0x7f6270065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.334+0000 7f6274bef640 1 -- 172.21.15.113:0/1329740104 shutdown_connections 2023-12-19T13:49:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.334+0000 7f6274bef640 1 -- 172.21.15.113:0/1329740104 wait complete. 2023-12-19T13:49:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.336+0000 7f6274bef640 1 Processor -- start 2023-12-19T13:49:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.336+0000 7f6274bef640 1 -- start start 2023-12-19T13:49:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f6274bef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f625c004d00 0x7f62701e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f6274bef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270158450 0x7f6270140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f6274bef640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6270070280 0x7f6270070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f6274bef640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270070c40 con 0x7f6270070280 2023-12-19T13:49:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f6274bef640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627013e520 con 0x7f6270158450 2023-12-19T13:49:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f6274bef640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62701e5040 con 0x7f625c004d00 2023-12-19T13:49:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6270070280 0x7f6270070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6270070280 0x7f6270070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58172/0 (socket says 172.21.15.113:58172) 2023-12-19T13:49:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 -- 172.21.15.113:0/825701362 learned_addr learned my addr 172.21.15.113:0/825701362 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 -- 172.21.15.113:0/825701362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f625c004d00 msgr2=0x7f62701e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f625c004d00 0x7f62701e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 -- 172.21.15.113:0/825701362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270158450 msgr2=0x7f6270140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270158450 0x7f6270140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.337+0000 7f626ffff640 1 -- 172.21.15.113:0/825701362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62701e5320 con 0x7f6270070280 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.338+0000 7f626ffff640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6270070280 0x7f6270070700 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6268037040 tx=0x7f6268009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.338+0000 7f626cff9640 1 -- 172.21.15.113:0/825701362 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268003b90 con 0x7f6270070280 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.338+0000 7f626cff9640 1 -- 172.21.15.113:0/825701362 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268003d10 con 0x7f6270070280 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.338+0000 7f626cff9640 1 -- 172.21.15.113:0/825701362 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268034ac0 con 0x7f6270070280 2023-12-19T13:49:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.338+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62701e5600 con 0x7f6270070280 2023-12-19T13:49:16.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.338+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62701e5bc0 con 0x7f6270070280 2023-12-19T13:49:16.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.339+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6270061910 con 0x7f6270070280 2023-12-19T13:49:16.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.340+0000 7f626cff9640 1 -- 172.21.15.113:0/825701362 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6268034c20 con 0x7f6270070280 2023-12-19T13:49:16.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.341+0000 7f626cff9640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f625006a430 0x7f625006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.341+0000 7f626cff9640 1 -- 172.21.15.113:0/825701362 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62680a9de0 con 0x7f6270070280 2023-12-19T13:49:16.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.342+0000 7f626f7fe640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f625006a430 0x7f625006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.342+0000 7f626f7fe640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f625006a430 0x7f625006c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f62600016d0 tx=0x7f6260009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:16.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.346+0000 7f626cff9640 1 -- 172.21.15.113:0/825701362 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62680753e0 con 0x7f6270070280 2023-12-19T13:49:16.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.537+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62700afaf0 con 0x7f6270070280 2023-12-19T13:49:16.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.538+0000 7f626cff9640 1 -- 172.21.15.113:0/825701362 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6268078a00 con 0x7f6270070280 2023-12-19T13:49:16.538 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f625006a430 msgr2=0x7f625006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f625006a430 0x7f625006c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f62600016d0 tx=0x7f6260009040 comp rx=0 tx=0).stop 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6270070280 msgr2=0x7f6270070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6270070280 0x7f6270070700 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6268037040 tx=0x7f6268009750 comp rx=0 tx=0).stop 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 shutdown_connections 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f625006a430 0x7f625006c8f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6270070280 0x7f6270070700 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270158450 0x7f6270140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 --2- 172.21.15.113:0/825701362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f625c004d00 0x7f62701e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 >> 172.21.15.113:0/825701362 conn(0x7f62700659a0 msgr2=0x7f627006c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 shutdown_connections 2023-12-19T13:49:16.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.541+0000 7f6274bef640 1 -- 172.21.15.113:0/825701362 wait complete. 2023-12-19T13:49:16.560 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:49:16.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.776+0000 7f6f28e73640 1 Processor -- start 2023-12-19T13:49:16.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.777+0000 7f6f28e73640 1 -- start start 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.778+0000 7f6f28e73640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f2415e460 0x7f6f240ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.778+0000 7f6f28e73640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6f240ce750 0x7f6f240cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.778+0000 7f6f28e73640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240cd020 con 0x7f6f2415ae50 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.778+0000 7f6f28e73640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2415e8e0 con 0x7f6f240ce750 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.778+0000 7f6f28e73640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240cca30 con 0x7f6f2415e460 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f237fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6f2415ae50 0x7f6f240b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:49806/0 (socket says 172.21.15.113:49806) 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f237fe640 1 -- 172.21.15.113:0/1074973737 learned_addr learned my addr 172.21.15.113:0/1074973737 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f23fff640 1 --2- 172.21.15.113:0/1074973737 >> v2:172.21.15.113:3300/0 conn(0x7f6f240ce750 0x7f6f240cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f1bfff640 1 --2- 172.21.15.113:0/1074973737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f2415e460 0x7f6f240ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f23fff640 1 -- 172.21.15.113:0/1074973737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f2415e460 msgr2=0x7f6f240ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f23fff640 1 --2- 172.21.15.113:0/1074973737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f2415e460 0x7f6f240ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f23fff640 1 -- 172.21.15.113:0/1074973737 >> v1:172.21.15.113:6789/0 conn(0x7f6f2415ae50 legacy=0x7f6f240b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f23fff640 1 -- 172.21.15.113:0/1074973737 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240b2f20 con 0x7f6f240ce750 2023-12-19T13:49:16.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.779+0000 7f6f22ffd640 1 -- 172.21.15.113:0/1074973737 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729570815 0 0) 0x7f6f240cd020 con 0x7f6f2415ae50 2023-12-19T13:49:16.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.780+0000 7f6f23fff640 1 --2- 172.21.15.113:0/1074973737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f240ce750 0x7f6f240cd4b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009d90 tx=0x7f6f1c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1afcb56f1e4b72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:16.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.781+0000 7f6f22ffd640 1 -- 172.21.15.113:0/1074973737 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c02cc50 con 0x7f6f240ce750 2023-12-19T13:49:16.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.781+0000 7f6f22ffd640 1 -- 172.21.15.113:0/1074973737 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c02cdb0 con 0x7f6f240ce750 2023-12-19T13:49:16.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.781+0000 7f6f22ffd640 1 -- 172.21.15.113:0/1074973737 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c034660 con 0x7f6f240ce750 2023-12-19T13:49:16.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.781+0000 7f6f28e73640 1 -- 172.21.15.113:0/1074973737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f240ce750 msgr2=0x7f6f240cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.781+0000 7f6f28e73640 1 --2- 172.21.15.113:0/1074973737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f240ce750 0x7f6f240cd4b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009d90 tx=0x7f6f1c02bea0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.781+0000 7f6f28e73640 1 -- 172.21.15.113:0/1074973737 shutdown_connections 2023-12-19T13:49:16.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.782+0000 7f6f28e73640 1 --2- 172.21.15.113:0/1074973737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f240ce750 0x7f6f240cd4b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.782+0000 7f6f28e73640 1 --2- 172.21.15.113:0/1074973737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f2415e460 0x7f6f240ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.782+0000 7f6f28e73640 1 -- 172.21.15.113:0/1074973737 >> 172.21.15.113:0/1074973737 conn(0x7f6f2406f630 msgr2=0x7f6f2406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:16.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.782+0000 7f6f28e73640 1 -- 172.21.15.113:0/1074973737 shutdown_connections 2023-12-19T13:49:16.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.782+0000 7f6f28e73640 1 -- 172.21.15.113:0/1074973737 wait complete. 2023-12-19T13:49:16.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.784+0000 7f6f28e73640 1 Processor -- start 2023-12-19T13:49:16.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.784+0000 7f6f28e73640 1 -- start start 2023-12-19T13:49:16.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.785+0000 7f6f28e73640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f240ce750 0x7f6f241f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.785+0000 7f6f28e73640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2415ae50 0x7f6f2406b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.785+0000 7f6f28e73640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f2415e460 0x7f6f241f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.785+0000 7f6f28e73640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2414ad70 con 0x7f6f2415e460 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.785+0000 7f6f28e73640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2406b760 con 0x7f6f2415ae50 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.785+0000 7f6f28e73640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2406d890 con 0x7f6f240ce750 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.785+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f2415e460 0x7f6f241f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f2415e460 0x7f6f241f1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58184/0 (socket says 172.21.15.113:58184) 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f23fff640 1 -- 172.21.15.113:0/684208482 learned_addr learned my addr 172.21.15.113:0/684208482 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f237fe640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f240ce750 0x7f6f241f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f1bfff640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2415ae50 0x7f6f2406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f23fff640 1 -- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f240ce750 msgr2=0x7f6f241f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f23fff640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f240ce750 0x7f6f241f6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f23fff640 1 -- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2415ae50 msgr2=0x7f6f2406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f23fff640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2415ae50 0x7f6f2406b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.786+0000 7f6f23fff640 1 -- 172.21.15.113:0/684208482 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c009a70 con 0x7f6f2415e460 2023-12-19T13:49:16.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.787+0000 7f6f23fff640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f2415e460 0x7f6f241f1f20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009d90 tx=0x7f6f1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.787+0000 7f6f20ff9640 1 -- 172.21.15.113:0/684208482 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c003b90 con 0x7f6f2415e460 2023-12-19T13:49:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.787+0000 7f6f20ff9640 1 -- 172.21.15.113:0/684208482 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c003cf0 con 0x7f6f2415e460 2023-12-19T13:49:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.787+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2406db70 con 0x7f6f2415e460 2023-12-19T13:49:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.787+0000 7f6f20ff9640 1 -- 172.21.15.113:0/684208482 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c004270 con 0x7f6f2415e460 2023-12-19T13:49:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.787+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2406e130 con 0x7f6f2415e460 2023-12-19T13:49:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.788+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2406e2c0 con 0x7f6f2415e460 2023-12-19T13:49:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.789+0000 7f6f20ff9640 1 -- 172.21.15.113:0/684208482 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6f1c03b050 con 0x7f6f2415e460 2023-12-19T13:49:16.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.790+0000 7f6f20ff9640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f0406a430 0x7f6f0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:16.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.790+0000 7f6f20ff9640 1 -- 172.21.15.113:0/684208482 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f1c0aae50 con 0x7f6f2415e460 2023-12-19T13:49:16.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.790+0000 7f6f237fe640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f0406a430 0x7f6f0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:16.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.791+0000 7f6f237fe640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f0406a430 0x7f6f0406c8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f14000f60 tx=0x7f6f14007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:16.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.794+0000 7f6f20ff9640 1 -- 172.21.15.113:0/684208482 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6f1c076440 con 0x7f6f2415e460 2023-12-19T13:49:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.981+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f24061910 con 0x7f6f2415e460 2023-12-19T13:49:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.981+0000 7f6f20ff9640 1 -- 172.21.15.113:0/684208482 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f1c079a60 con 0x7f6f2415e460 2023-12-19T13:49:16.981 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f0406a430 msgr2=0x7f6f0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f0406a430 0x7f6f0406c8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f14000f60 tx=0x7f6f14007b50 comp rx=0 tx=0).stop 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f2415e460 msgr2=0x7f6f241f1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f2415e460 0x7f6f241f1f20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009d90 tx=0x7f6f1c004a40 comp rx=0 tx=0).stop 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 shutdown_connections 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f0406a430 0x7f6f0406c8f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f2415e460 0x7f6f241f1f20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2415ae50 0x7f6f2406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 --2- 172.21.15.113:0/684208482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f240ce750 0x7f6f241f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 >> 172.21.15.113:0/684208482 conn(0x7f6f2406f630 msgr2=0x7f6f24156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 shutdown_connections 2023-12-19T13:49:16.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:16.984+0000 7f6f28e73640 1 -- 172.21.15.113:0/684208482 wait complete. 2023-12-19T13:49:17.001 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:49:17.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.204+0000 7f7c9df6e640 1 Processor -- start 2023-12-19T13:49:17.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.204+0000 7f7c9df6e640 1 -- start start 2023-12-19T13:49:17.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.206+0000 7f7c9df6e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7c980d2b00 0x7f7c980d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.206+0000 7f7c9df6e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7c980ce110 0x7f7c980ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.206+0000 7f7c9df6e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c980cd840 con 0x7f7c98146e10 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.206+0000 7f7c9df6e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980d2430 con 0x7f7c980d2b00 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.206+0000 7f7c9df6e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980ceac0 con 0x7f7c980ce110 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c8effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7c980d2b00 0x7f7c980d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c8effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7c980d2b00 0x7f7c980d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58188/0 (socket says 172.21.15.113:58188) 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c8effd640 1 -- 172.21.15.113:0/3835294250 learned_addr learned my addr 172.21.15.113:0/3835294250 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c97fff640 1 --2- 172.21.15.113:0/3835294250 >> v2:172.21.15.151:3300/0 conn(0x7f7c980ce110 0x7f7c980ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c8effd640 1 -- 172.21.15.113:0/3835294250 >> v2:172.21.15.151:3300/0 conn(0x7f7c980ce110 msgr2=0x7f7c980ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c8effd640 1 --2- 172.21.15.113:0/3835294250 >> v2:172.21.15.151:3300/0 conn(0x7f7c980ce110 0x7f7c980ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c8effd640 1 -- 172.21.15.113:0/3835294250 >> v1:172.21.15.113:6789/0 conn(0x7f7c98146e10 legacy=0x7f7c980b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.207+0000 7f7c8effd640 1 -- 172.21.15.113:0/3835294250 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980b6e90 con 0x7f7c980d2b00 2023-12-19T13:49:17.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.208+0000 7f7c8effd640 1 --2- 172.21.15.113:0/3835294250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c980d2b00 0x7f7c980d1ef0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7c980cedb0 tx=0x7f7c8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d195cd703d715b7e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:17.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.208+0000 7f7c96ffd640 1 -- 172.21.15.113:0/3835294250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80031870 con 0x7f7c980d2b00 2023-12-19T13:49:17.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.208+0000 7f7c96ffd640 1 -- 172.21.15.113:0/3835294250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c800319d0 con 0x7f7c980d2b00 2023-12-19T13:49:17.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.208+0000 7f7c96ffd640 1 -- 172.21.15.113:0/3835294250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80031d60 con 0x7f7c980d2b00 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3835294250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c980d2b00 msgr2=0x7f7c980d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3835294250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c980d2b00 0x7f7c980d1ef0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7c980cedb0 tx=0x7f7c8002b910 comp rx=0 tx=0).stop 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3835294250 shutdown_connections 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3835294250 >> v2:172.21.15.151:3300/0 conn(0x7f7c980ce110 0x7f7c980ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3835294250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c980d2b00 0x7f7c980d1ef0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3835294250 >> 172.21.15.113:0/3835294250 conn(0x7f7c980b29c0 msgr2=0x7f7c980b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3835294250 shutdown_connections 2023-12-19T13:49:17.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.209+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3835294250 wait complete. 2023-12-19T13:49:17.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.211+0000 7f7c9df6e640 1 Processor -- start 2023-12-19T13:49:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.211+0000 7f7c9df6e640 1 -- start start 2023-12-19T13:49:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.212+0000 7f7c9df6e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c980ce110 0x7f7c981f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.212+0000 7f7c9df6e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c980d2b00 0x7f7c9815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.212+0000 7f7c9df6e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c98146e10 0x7f7c9815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.212+0000 7f7c9df6e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815fd10 con 0x7f7c98146e10 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.212+0000 7f7c9df6e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815c450 con 0x7f7c980d2b00 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.212+0000 7f7c9df6e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815fef0 con 0x7f7c980ce110 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c98146e10 0x7f7c9815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c98146e10 0x7f7c9815b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58200/0 (socket says 172.21.15.113:58200) 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 -- 172.21.15.113:0/3138734245 learned_addr learned my addr 172.21.15.113:0/3138734245 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 -- 172.21.15.113:0/3138734245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c980ce110 msgr2=0x7f7c981f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c980ce110 0x7f7c981f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 -- 172.21.15.113:0/3138734245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c980d2b00 msgr2=0x7f7c9815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c980d2b00 0x7f7c9815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 -- 172.21.15.113:0/3138734245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800094d0 con 0x7f7c98146e10 2023-12-19T13:49:17.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c97fff640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c98146e10 0x7f7c9815b9f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cc30 tx=0x7f7c9000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:17.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c94ff9640 1 -- 172.21.15.113:0/3138734245 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000ce40 con 0x7f7c98146e10 2023-12-19T13:49:17.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c94ff9640 1 -- 172.21.15.113:0/3138734245 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90003990 con 0x7f7c98146e10 2023-12-19T13:49:17.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.213+0000 7f7c94ff9640 1 -- 172.21.15.113:0/3138734245 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90003d20 con 0x7f7c98146e10 2023-12-19T13:49:17.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.214+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c981601d0 con 0x7f7c98146e10 2023-12-19T13:49:17.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.214+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c981f6080 con 0x7f7c98146e10 2023-12-19T13:49:17.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.215+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c981603c0 con 0x7f7c98146e10 2023-12-19T13:49:17.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.216+0000 7f7c94ff9640 1 -- 172.21.15.113:0/3138734245 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c90003e80 con 0x7f7c98146e10 2023-12-19T13:49:17.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.216+0000 7f7c94ff9640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c7806a430 0x7f7c7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.217+0000 7f7c94ff9640 1 -- 172.21.15.113:0/3138734245 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c90088dc0 con 0x7f7c98146e10 2023-12-19T13:49:17.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.217+0000 7f7c977fe640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c7806a430 0x7f7c7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.218+0000 7f7c977fe640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c7806a430 0x7f7c7806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000f60 tx=0x7f7c880079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:17.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.221+0000 7f7c94ff9640 1 -- 172.21.15.113:0/3138734245 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c90054310 con 0x7f7c98146e10 2023-12-19T13:49:17.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.405+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c980d0750 con 0x7f7c98146e10 2023-12-19T13:49:17.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.406+0000 7f7c94ff9640 1 -- 172.21.15.113:0/3138734245 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7c9001d020 con 0x7f7c98146e10 2023-12-19T13:49:17.405 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:49:17.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.408+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c7806a430 msgr2=0x7f7c7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.408+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c7806a430 0x7f7c7806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000f60 tx=0x7f7c880079b0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.408+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c98146e10 msgr2=0x7f7c9815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.408+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c98146e10 0x7f7c9815b9f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cc30 tx=0x7f7c9000a5c0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 shutdown_connections 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c7806a430 0x7f7c7806c8f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c98146e10 0x7f7c9815b9f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c980d2b00 0x7f7c9815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 --2- 172.21.15.113:0/3138734245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c980ce110 0x7f7c981f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 >> 172.21.15.113:0/3138734245 conn(0x7f7c980b29c0 msgr2=0x7f7c980b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 shutdown_connections 2023-12-19T13:49:17.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.409+0000 7f7c9df6e640 1 -- 172.21.15.113:0/3138734245 wait complete. 2023-12-19T13:49:17.425 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:49:17.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:17.425 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:49:17.541 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:49:17.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:17.541 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:49:17.591 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:49:17.591 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:17.605 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:17.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:17.648 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:49:17.648 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:49:17.649 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:17.745 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:49:17.745 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.960+0000 7f2fba4b6640 1 Processor -- start 2023-12-19T13:49:17.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.960+0000 7f2fba4b6640 1 -- start start 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fba4b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2fb4157bf0 0x7f2fb415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fba4b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb40b0810 0x7f2fb406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fba4b6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb415b740 con 0x7f2fb40ae110 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fba4b6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb406b8c0 con 0x7f2fb4157bf0 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fba4b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40ae640 con 0x7f2fb40b0810 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fb3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2fb4157bf0 0x7f2fb415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fb3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2fb4157bf0 0x7f2fb415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34068/0 (socket says 172.21.15.113:34068) 2023-12-19T13:49:17.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.962+0000 7f2fb3fff640 1 -- 172.21.15.113:0/1463066064 learned_addr learned my addr 172.21.15.113:0/1463066064 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.963+0000 7f2fb8a53640 1 --2- 172.21.15.113:0/1463066064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb40b0810 0x7f2fb406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.963+0000 7f2fb3fff640 1 -- 172.21.15.113:0/1463066064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb40b0810 msgr2=0x7f2fb406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.963+0000 7f2fb3fff640 1 --2- 172.21.15.113:0/1463066064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb40b0810 0x7f2fb406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.963+0000 7f2fb3fff640 1 -- 172.21.15.113:0/1463066064 >> v1:172.21.15.151:6789/0 conn(0x7f2fb40ae110 legacy=0x7f2fb40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:17.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.963+0000 7f2fb3fff640 1 -- 172.21.15.113:0/1463066064 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb40ae920 con 0x7f2fb4157bf0 2023-12-19T13:49:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.964+0000 7f2fb3fff640 1 --2- 172.21.15.113:0/1463066064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb4157bf0 0x7f2fb415b200 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009870 tx=0x7f2fa402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f586ac54e38770 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.965+0000 7f2fb2ffd640 1 -- 172.21.15.113:0/1463066064 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4031640 con 0x7f2fb4157bf0 2023-12-19T13:49:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.965+0000 7f2fb2ffd640 1 -- 172.21.15.113:0/1463066064 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa40317a0 con 0x7f2fb4157bf0 2023-12-19T13:49:17.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.965+0000 7f2fb2ffd640 1 -- 172.21.15.113:0/1463066064 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4031b30 con 0x7f2fb4157bf0 2023-12-19T13:49:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.965+0000 7f2fba4b6640 1 -- 172.21.15.113:0/1463066064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb4157bf0 msgr2=0x7f2fb415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.965+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/1463066064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb4157bf0 0x7f2fb415b200 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009870 tx=0x7f2fa402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.966+0000 7f2fba4b6640 1 -- 172.21.15.113:0/1463066064 shutdown_connections 2023-12-19T13:49:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.966+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/1463066064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb40b0810 0x7f2fb406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.966+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/1463066064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb4157bf0 0x7f2fb415b200 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.966+0000 7f2fba4b6640 1 -- 172.21.15.113:0/1463066064 >> 172.21.15.113:0/1463066064 conn(0x7f2fb40cbb70 msgr2=0x7f2fb40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:17.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.966+0000 7f2fba4b6640 1 -- 172.21.15.113:0/1463066064 shutdown_connections 2023-12-19T13:49:17.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.966+0000 7f2fba4b6640 1 -- 172.21.15.113:0/1463066064 wait complete. 2023-12-19T13:49:17.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.968+0000 7f2fba4b6640 1 Processor -- start 2023-12-19T13:49:17.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.968+0000 7f2fba4b6640 1 -- start start 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.969+0000 7f2fba4b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fb40ae110 0x7f2fb415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.969+0000 7f2fba4b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb40b0810 0x7f2fb415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.969+0000 7f2fba4b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb4157bf0 0x7f2fb414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.969+0000 7f2fba4b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c4170 con 0x7f2fb40b0810 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.969+0000 7f2fba4b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c3840 con 0x7f2fb40ae110 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.969+0000 7f2fba4b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c3b20 con 0x7f2fb4157bf0 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb40b0810 0x7f2fb415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb40b0810 0x7f2fb415af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34084/0 (socket says 172.21.15.113:34084) 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 -- 172.21.15.113:0/842032314 learned_addr learned my addr 172.21.15.113:0/842032314 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb3fff640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fb40ae110 0x7f2fb415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 -- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb4157bf0 msgr2=0x7f2fb414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb4157bf0 0x7f2fb414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 -- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fb40ae110 msgr2=0x7f2fb415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fb40ae110 0x7f2fb415a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 -- 172.21.15.113:0/842032314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40094d0 con 0x7f2fb40b0810 2023-12-19T13:49:17.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb3fff640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fb40ae110 0x7f2fb415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:17.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.970+0000 7f2fb37fe640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb40b0810 0x7f2fb415af70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c430 tx=0x7f2fa800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:17.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.971+0000 7f2fb0ff9640 1 -- 172.21.15.113:0/842032314 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8011790 con 0x7f2fb40b0810 2023-12-19T13:49:17.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.971+0000 7f2fb0ff9640 1 -- 172.21.15.113:0/842032314 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80118f0 con 0x7f2fb40b0810 2023-12-19T13:49:17.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.971+0000 7f2fb0ff9640 1 -- 172.21.15.113:0/842032314 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8011ce0 con 0x7f2fb40b0810 2023-12-19T13:49:17.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.971+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb40c3e00 con 0x7f2fb40b0810 2023-12-19T13:49:17.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.971+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb4156220 con 0x7f2fb40b0810 2023-12-19T13:49:17.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.972+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb415a090 con 0x7f2fb40b0810 2023-12-19T13:49:17.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.973+0000 7f2fb0ff9640 1 -- 172.21.15.113:0/842032314 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2fa801c460 con 0x7f2fb40b0810 2023-12-19T13:49:17.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.974+0000 7f2fb0ff9640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fa006a460 0x7f2fa006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:17.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.974+0000 7f2fb0ff9640 1 -- 172.21.15.113:0/842032314 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fa8088850 con 0x7f2fb40b0810 2023-12-19T13:49:17.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.974+0000 7f2fb3fff640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fa006a460 0x7f2fa006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:17.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.975+0000 7f2fb3fff640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fa006a460 0x7f2fa006c920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4036000 tx=0x7f2fa403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:17.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:17.978+0000 7f2fb0ff9640 1 -- 172.21.15.113:0/842032314 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2fa8053e40 con 0x7f2fb40b0810 2023-12-19T13:49:18.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.202+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fb4157fd0 con 0x7f2fb40b0810 2023-12-19T13:49:18.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.204+0000 7f2fb0ff9640 1 -- 172.21.15.113:0/842032314 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f2fa8057460 con 0x7f2fb40b0810 2023-12-19T13:49:18.204 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:18.204 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:49:18.204 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:49:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.206+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fa006a460 msgr2=0x7f2fa006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.206+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fa006a460 0x7f2fa006c920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4036000 tx=0x7f2fa403c040 comp rx=0 tx=0).stop 2023-12-19T13:49:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.206+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb40b0810 msgr2=0x7f2fb415af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.206+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb40b0810 0x7f2fb415af70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c430 tx=0x7f2fa800c8f0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 shutdown_connections 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fa006a460 0x7f2fa006c920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fb4157bf0 0x7f2fb414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2fb40b0810 0x7f2fb415af70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 --2- 172.21.15.113:0/842032314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fb40ae110 0x7f2fb415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 >> 172.21.15.113:0/842032314 conn(0x7f2fb40cbb70 msgr2=0x7f2fb406d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 shutdown_connections 2023-12-19T13:49:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.207+0000 7f2fba4b6640 1 -- 172.21.15.113:0/842032314 wait complete. 2023-12-19T13:49:18.225 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:18.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.437+0000 7fbfdd7c4640 1 Processor -- start 2023-12-19T13:49:18.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.437+0000 7fbfdd7c4640 1 -- start start 2023-12-19T13:49:18.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.438+0000 7fbfdd7c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd8157bf0 0x7fbfd815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfdd7c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd815b740 con 0x7fbfd80b0810 2023-12-19T13:49:18.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfdd7c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd80ae640 con 0x7fbfd80ae110 2023-12-19T13:49:18.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfdd7c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd806b8c0 con 0x7fbfd8157bf0 2023-12-19T13:49:18.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfd77fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbfd80b0810 0x7fbfd806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44066/0 (socket says 172.21.15.113:44066) 2023-12-19T13:49:18.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfd77fe640 1 -- 172.21.15.113:0/993098582 learned_addr learned my addr 172.21.15.113:0/993098582 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:18.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd8157bf0 0x7fbfd815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171515445 0 0) 0x7fbfd815b740 con 0x7fbfd80b0810 2023-12-19T13:49:18.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.439+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc4005730 con 0x7fbfd80b0810 2023-12-19T13:49:18.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1498988408 0 0) 0x7fbfc4005730 con 0x7fbfd80b0810 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd8157bf0 msgr2=0x7fbfd815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd8157bf0 0x7fbfd815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 >> v1:172.21.15.151:6789/0 conn(0x7fbfd80ae110 legacy=0x7fbfd80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80ae920 con 0x7fbfd80b0810 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbfd00019f0 con 0x7fbfd80b0810 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 >> v1:172.21.15.113:6789/0 conn(0x7fbfd80b0810 legacy=0x7fbfd806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc4005c20 0x7fbfc4006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd8157bf0 0x7fbfc40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc4006f10 0x7fbfc4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd806b8c0 con 0x7fbfc4005c20 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc400dca0 con 0x7fbfc4006f10 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc400de60 con 0x7fbfd8157bf0 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc4005c20 0x7fbfc4006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.440+0000 7fbfd77fe640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc4006f10 0x7fbfc4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.441+0000 7fbfd6ffd640 1 -- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd8157bf0 msgr2=0x7fbfc40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:18.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.441+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd8157bf0 0x7fbfc40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.441+0000 7fbfd6ffd640 1 -- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc4006f10 msgr2=0x7fbfc4007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:18.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.441+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc4006f10 0x7fbfc4007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.441+0000 7fbfd6ffd640 1 -- 172.21.15.113:0/993098582 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4005730 con 0x7fbfc4005c20 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.442+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc4005c20 0x7fbfc4006040 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009a90 tx=0x7fbfc4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecb1a13f5108644 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.442+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc802c600 con 0x7fbfc4005c20 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.442+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc802c760 con 0x7fbfc4005c20 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.442+0000 7fbfd67fc640 1 -- 172.21.15.113:0/993098582 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc802caf0 con 0x7fbfc4005c20 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.442+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/993098582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc4005c20 msgr2=0x7fbfc4006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.442+0000 7fbfdd7c4640 1 --2- 172.21.15.113:0/993098582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc4005c20 0x7fbfc4006040 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009a90 tx=0x7fbfc4007a00 comp rx=0 tx=0).stop 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.442+0000 7fbfd77fe640 1 -- 172.21.15.113:0/993098582 reap_dead start 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.443+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/993098582 shutdown_connections 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.443+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/993098582 >> 172.21.15.113:0/993098582 conn(0x7fbfd80cbb70 msgr2=0x7fbfd80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.443+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/993098582 shutdown_connections 2023-12-19T13:49:18.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.443+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/993098582 wait complete. 2023-12-19T13:49:18.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.444+0000 7fbfdd7c4640 1 Processor -- start 2023-12-19T13:49:18.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.445+0000 7fbfdd7c4640 1 -- start start 2023-12-19T13:49:18.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.445+0000 7fbfdd7c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4005c20 0x7fbfd815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfdd7c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd8159f80 0x7fbfd8155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfdd7c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd81f2a90 0x7fbfd806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfdd7c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8155850 con 0x7fbfd81f2a90 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfdd7c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd815a510 con 0x7fbfd8159f80 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfdd7c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81e7120 con 0x7fbfc4005c20 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd81f2a90 0x7fbfd806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd81f2a90 0x7fbfd806dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34092/0 (socket says 172.21.15.113:34092) 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 -- 172.21.15.113:0/1576904493 learned_addr learned my addr 172.21.15.113:0/1576904493 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4005c20 0x7fbfd815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfcffff640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd8159f80 0x7fbfd8155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 -- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4005c20 msgr2=0x7fbfd815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4005c20 0x7fbfd815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 -- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd8159f80 msgr2=0x7fbfd8155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd8159f80 0x7fbfd8155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd77fe640 1 -- 172.21.15.113:0/1576904493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd81e7400 con 0x7fbfd81f2a90 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.446+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4005c20 0x7fbfd815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.447+0000 7fbfd77fe640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd81f2a90 0x7fbfd806dc80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0001cb0 tx=0x7fbfd000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.447+0000 7fbfcf7fe640 1 -- 172.21.15.113:0/1576904493 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000bb80 con 0x7fbfd81f2a90 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.447+0000 7fbfcf7fe640 1 -- 172.21.15.113:0/1576904493 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd000bce0 con 0x7fbfd81f2a90 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.447+0000 7fbfcf7fe640 1 -- 172.21.15.113:0/1576904493 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00072b0 con 0x7fbfd81f2a90 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.447+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd81e76e0 con 0x7fbfd81f2a90 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.447+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd81561a0 con 0x7fbfd81f2a90 2023-12-19T13:49:18.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.448+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd81e7c00 con 0x7fbfd81f2a90 2023-12-19T13:49:18.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.449+0000 7fbfcf7fe640 1 -- 172.21.15.113:0/1576904493 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfd0007410 con 0x7fbfd81f2a90 2023-12-19T13:49:18.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.450+0000 7fbfcf7fe640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb806a430 0x7fbfb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.451+0000 7fbfcf7fe640 1 -- 172.21.15.113:0/1576904493 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfd0088c90 con 0x7fbfd81f2a90 2023-12-19T13:49:18.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.451+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb806a430 0x7fbfb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.452+0000 7fbfd6ffd640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb806a430 0x7fbfb806c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8036000 tx=0x7fbfc8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:18.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.455+0000 7fbfcf7fe640 1 -- 172.21.15.113:0/1576904493 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbfd81e7c00 con 0x7fbfd81f2a90 2023-12-19T13:49:18.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.650+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfd81e7c00 con 0x7fbfd81f2a90 2023-12-19T13:49:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.652+0000 7fbfcf7fe640 1 -- 172.21.15.113:0/1576904493 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fbfd81e7c00 con 0x7fbfd81f2a90 2023-12-19T13:49:18.652 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:18.653 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":59,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:09.466677+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb806a430 msgr2=0x7fbfb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb806a430 0x7fbfb806c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8036000 tx=0x7fbfc8030000 comp rx=0 tx=0).stop 2023-12-19T13:49:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd81f2a90 msgr2=0x7fbfd806dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd81f2a90 0x7fbfd806dc80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0001cb0 tx=0x7fbfd000b4a0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 shutdown_connections 2023-12-19T13:49:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb806a430 0x7fbfb806c8f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd81f2a90 0x7fbfd806dc80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd8159f80 0x7fbfd8155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 --2- 172.21.15.113:0/1576904493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4005c20 0x7fbfd815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 >> 172.21.15.113:0/1576904493 conn(0x7fbfd80cbb70 msgr2=0x7fbfd806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 shutdown_connections 2023-12-19T13:49:18.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.655+0000 7fbfdd7c4640 1 -- 172.21.15.113:0/1576904493 wait complete. 2023-12-19T13:49:18.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:48:28.798187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:48:30.040745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:49:18.674 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:49:18.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.891+0000 7f164a992640 1 Processor -- start 2023-12-19T13:49:18.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.891+0000 7f164a992640 1 -- start start 2023-12-19T13:49:18.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.892+0000 7f164a992640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16440b2760 0x7f16440b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.892+0000 7f164a992640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164415fde0 con 0x7f16440ceea0 2023-12-19T13:49:18.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.893+0000 7f164a992640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16440b2bc0 con 0x7f164415b1d0 2023-12-19T13:49:18.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.893+0000 7f164a992640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16440b2400 con 0x7f16440b2760 2023-12-19T13:49:18.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.893+0000 7f1648f2f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f16440ceea0 0x7f164406c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44078/0 (socket says 172.21.15.113:44078) 2023-12-19T13:49:18.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.893+0000 7f1648f2f640 1 -- 172.21.15.113:0/3025420671 learned_addr learned my addr 172.21.15.113:0/3025420671 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:18.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.893+0000 7f16437fe640 1 --2- 172.21.15.113:0/3025420671 >> v2:172.21.15.151:3300/0 conn(0x7f16440b2760 0x7f16440b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.893+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579977712 0 0) 0x7f164415fde0 con 0x7f16440ceea0 2023-12-19T13:49:18.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.893+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f162c003520 con 0x7f16440ceea0 2023-12-19T13:49:18.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216460824 0 0) 0x7f162c003520 con 0x7f16440ceea0 2023-12-19T13:49:18.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 >> v2:172.21.15.151:3300/0 conn(0x7f16440b2760 msgr2=0x7f16440b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:18.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 --2- 172.21.15.113:0/3025420671 >> v2:172.21.15.151:3300/0 conn(0x7f16440b2760 0x7f16440b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 >> v1:172.21.15.151:6789/0 conn(0x7f164415b1d0 legacy=0x7f164415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164415ef10 con 0x7f16440ceea0 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f163c001670 con 0x7f16440ceea0 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 >> v1:172.21.15.113:6789/0 conn(0x7f16440ceea0 legacy=0x7f164406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162c003a30 0x7f162c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f162c0047c0 0x7f162c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0051d0 0x7f162c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c00c0d0 con 0x7f162c0047c0 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c00c240 con 0x7f162c0051d0 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c00c400 con 0x7f162c003a30 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.894+0000 7f16437fe640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f162c0047c0 0x7f162c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.895+0000 7f16437fe640 1 -- 172.21.15.113:0/3025420671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162c003a30 msgr2=0x7f162c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.895+0000 7f16437fe640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162c003a30 0x7f162c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.895+0000 7f16437fe640 1 -- 172.21.15.113:0/3025420671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0051d0 msgr2=0x7f162c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:18.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.895+0000 7f16437fe640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0051d0 0x7f162c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.895+0000 7f16437fe640 1 -- 172.21.15.113:0/3025420671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c003520 con 0x7f162c0047c0 2023-12-19T13:49:18.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.895+0000 7f1648f2f640 1 -- 172.21.15.113:0/3025420671 reap_dead start 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f16437fe640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f162c0047c0 0x7f162c004c40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1638009ac0 tx=0x7f162c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f347bc42082186f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163802c6b0 con 0x7f162c0047c0 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163802c810 con 0x7f162c0047c0 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f1642ffd640 1 -- 172.21.15.113:0/3025420671 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163802cba0 con 0x7f162c0047c0 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f164a992640 1 -- 172.21.15.113:0/3025420671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f162c0047c0 msgr2=0x7f162c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f164a992640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f162c0047c0 0x7f162c004c40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1638009ac0 tx=0x7f162c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f164a992640 1 -- 172.21.15.113:0/3025420671 shutdown_connections 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f164a992640 1 --2- 172.21.15.113:0/3025420671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f162c0047c0 0x7f162c004c40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.896+0000 7f164a992640 1 -- 172.21.15.113:0/3025420671 >> 172.21.15.113:0/3025420671 conn(0x7f1644073150 msgr2=0x7f16440659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.897+0000 7f164a992640 1 -- 172.21.15.113:0/3025420671 shutdown_connections 2023-12-19T13:49:18.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.897+0000 7f164a992640 1 -- 172.21.15.113:0/3025420671 wait complete. 2023-12-19T13:49:18.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.898+0000 7f164a992640 1 Processor -- start 2023-12-19T13:49:18.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.899+0000 7f164a992640 1 -- start start 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.899+0000 7f164a992640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0047c0 0x7f164415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f164a992640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16441f37d0 0x7f16441f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f164a992640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164415dd50 0x7f1644158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f164a992640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16441f2ba0 con 0x7f164415dd50 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f164a992640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164415c010 con 0x7f162c0047c0 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f164a992640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16441f3c50 con 0x7f16441f37d0 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164415dd50 0x7f1644158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164415dd50 0x7f1644158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34112/0 (socket says 172.21.15.113:34112) 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 -- 172.21.15.113:0/3906712471 learned_addr learned my addr 172.21.15.113:0/3906712471 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f16437fe640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16441f37d0 0x7f16441f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1643fff640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0047c0 0x7f164415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 -- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16441f37d0 msgr2=0x7f16441f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16441f37d0 0x7f16441f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 -- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0047c0 msgr2=0x7f164415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:18.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0047c0 0x7f164415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:18.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1648f2f640 1 -- 172.21.15.113:0/3906712471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164415e580 con 0x7f164415dd50 2023-12-19T13:49:18.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f1643fff640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0047c0 0x7f164415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:18.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.900+0000 7f16437fe640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16441f37d0 0x7f16441f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:18.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.901+0000 7f1648f2f640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164415dd50 0x7f1644158df0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f16440cfd50 tx=0x7f163c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:18.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.901+0000 7f1640ff9640 1 -- 172.21.15.113:0/3906712471 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c0074e0 con 0x7f164415dd50 2023-12-19T13:49:18.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.901+0000 7f1640ff9640 1 -- 172.21.15.113:0/3906712471 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c007640 con 0x7f164415dd50 2023-12-19T13:49:18.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.901+0000 7f1640ff9640 1 -- 172.21.15.113:0/3906712471 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c004a20 con 0x7f164415dd50 2023-12-19T13:49:18.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.901+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164415b6e0 con 0x7f164415dd50 2023-12-19T13:49:18.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.901+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164415bca0 con 0x7f164415dd50 2023-12-19T13:49:18.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.902+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164415c180 con 0x7f164415dd50 2023-12-19T13:49:18.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.903+0000 7f1640ff9640 1 -- 172.21.15.113:0/3906712471 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f163c004b80 con 0x7f164415dd50 2023-12-19T13:49:18.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.904+0000 7f1640ff9640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f163006a430 0x7f163006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:18.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.904+0000 7f1640ff9640 1 -- 172.21.15.113:0/3906712471 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f163c087aa0 con 0x7f164415dd50 2023-12-19T13:49:18.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.904+0000 7f1643fff640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f163006a430 0x7f163006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:18.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.905+0000 7f1643fff640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f163006a430 0x7f163006c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1634007fd0 tx=0x7f1634009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:18.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:18.909+0000 7f1640ff9640 1 -- 172.21.15.113:0/3906712471 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f163c053120 con 0x7f164415dd50 2023-12-19T13:49:19.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.102+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1644061910 con 0x7f164415dd50 2023-12-19T13:49:19.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.103+0000 7f1640ff9640 1 -- 172.21.15.113:0/3906712471 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f163c056740 con 0x7f164415dd50 2023-12-19T13:49:19.103 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f163006a430 msgr2=0x7f163006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f163006a430 0x7f163006c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1634007fd0 tx=0x7f1634009040 comp rx=0 tx=0).stop 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164415dd50 msgr2=0x7f1644158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164415dd50 0x7f1644158df0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f16440cfd50 tx=0x7f163c00c820 comp rx=0 tx=0).stop 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 shutdown_connections 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f163006a430 0x7f163006c8f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164415dd50 0x7f1644158df0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16441f37d0 0x7f16441f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 --2- 172.21.15.113:0/3906712471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f162c0047c0 0x7f164415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 >> 172.21.15.113:0/3906712471 conn(0x7f1644073150 msgr2=0x7f164406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 shutdown_connections 2023-12-19T13:49:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.106+0000 7f164a992640 1 -- 172.21.15.113:0/3906712471 wait complete. 2023-12-19T13:49:19.124 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:49:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.328+0000 7f073fc17640 1 Processor -- start 2023-12-19T13:49:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.328+0000 7f073fc17640 1 -- start start 2023-12-19T13:49:19.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073fc17640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 0x7f07380af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073fc17640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f07380b0b50 0x7f073806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073fc17640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07380afb10 con 0x7f073806b590 2023-12-19T13:49:19.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073fc17640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073806bb30 con 0x7f07380b0b50 2023-12-19T13:49:19.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073fc17640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07380b0070 con 0x7f07381449e0 2023-12-19T13:49:19.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073e1b4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f073806b590 0x7f073815eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44088/0 (socket says 172.21.15.113:44088) 2023-12-19T13:49:19.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073e1b4640 1 -- 172.21.15.113:0/1894704572 learned_addr learned my addr 172.21.15.113:0/1894704572 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073d9b3640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 0x7f07380af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073d1b2640 1 --2- 172.21.15.113:0/1894704572 >> v2:172.21.15.151:3300/0 conn(0x7f07380b0b50 0x7f073806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.330+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904103774 0 0) 0x7f07380afb10 con 0x7f073806b590 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0724003520 con 0x7f073806b590 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1608548808 0 0) 0x7f0724003520 con 0x7f073806b590 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 msgr2=0x7f07380af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 0x7f07380af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 >> v2:172.21.15.151:3300/0 conn(0x7f07380b0b50 msgr2=0x7f073806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 --2- 172.21.15.113:0/1894704572 >> v2:172.21.15.151:3300/0 conn(0x7f07380b0b50 0x7f073806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380b0350 con 0x7f073806b590 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f07300019f0 con 0x7f073806b590 2023-12-19T13:49:19.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 >> v1:172.21.15.113:6789/0 conn(0x7f073806b590 legacy=0x7f073815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07240039e0 0x7f0724003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 0x7f07240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0724004d00 0x7f0724005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073806bb30 con 0x7f07240039e0 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380b0070 con 0x7f0724004d00 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072400b980 con 0x7f07381449e0 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.331+0000 7f073d9b3640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07240039e0 0x7f0724003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.332+0000 7f073d9b3640 1 -- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 msgr2=0x7f07240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.332+0000 7f073d1b2640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 0x7f07240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.332+0000 7f073d9b3640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07381449e0 0x7f07240047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.332+0000 7f073e1b4640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0724004d00 0x7f0724005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.332+0000 7f073d9b3640 1 -- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0724004d00 msgr2=0x7f0724005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.332+0000 7f073d9b3640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0724004d00 0x7f0724005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.332+0000 7f073d9b3640 1 -- 172.21.15.113:0/1894704572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724003520 con 0x7f07240039e0 2023-12-19T13:49:19.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.333+0000 7f073d9b3640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07240039e0 0x7f0724003e00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0734009ac0 tx=0x7f07240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b0aa9d38636412 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.333+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073402c6b0 con 0x7f07240039e0 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.333+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073402c810 con 0x7f07240039e0 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.333+0000 7f073c9b1640 1 -- 172.21.15.113:0/1894704572 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073402cba0 con 0x7f07240039e0 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.334+0000 7f073fc17640 1 -- 172.21.15.113:0/1894704572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07240039e0 msgr2=0x7f0724003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.334+0000 7f073fc17640 1 --2- 172.21.15.113:0/1894704572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07240039e0 0x7f0724003e00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0734009ac0 tx=0x7f07240057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.334+0000 7f073e1b4640 1 -- 172.21.15.113:0/1894704572 reap_dead start 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.334+0000 7f073fc17640 1 -- 172.21.15.113:0/1894704572 shutdown_connections 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.334+0000 7f073fc17640 1 -- 172.21.15.113:0/1894704572 >> 172.21.15.113:0/1894704572 conn(0x7f07380cbb70 msgr2=0x7f07380cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.334+0000 7f073fc17640 1 -- 172.21.15.113:0/1894704572 shutdown_connections 2023-12-19T13:49:19.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.334+0000 7f073fc17640 1 -- 172.21.15.113:0/1894704572 wait complete. 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.336+0000 7f073fc17640 1 Processor -- start 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.336+0000 7f073fc17640 1 -- start start 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073fc17640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07240039e0 0x7f073813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073fc17640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07381f2b20 0x7f073813c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073fc17640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07380ce010 0x7f07381edef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073fc17640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07381f2700 con 0x7f07380ce010 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073fc17640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073813cdf0 con 0x7f07381f2b20 2023-12-19T13:49:19.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073fc17640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073813d370 con 0x7f07240039e0 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07380ce010 0x7f07381edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07380ce010 0x7f07381edef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34132/0 (socket says 172.21.15.113:34132) 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 -- 172.21.15.113:0/695025719 learned_addr learned my addr 172.21.15.113:0/695025719 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073d9b3640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07240039e0 0x7f073813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073d1b2640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07381f2b20 0x7f073813c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 -- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07240039e0 msgr2=0x7f073813acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07240039e0 0x7f073813acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 -- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07381f2b20 msgr2=0x7f073813c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07381f2b20 0x7f073813c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073e1b4640 1 -- 172.21.15.113:0/695025719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073813d090 con 0x7f07380ce010 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.337+0000 7f073d9b3640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07240039e0 0x7f073813acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:19.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.338+0000 7f073e1b4640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07380ce010 0x7f07381edef0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f07380b1270 tx=0x7f073000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:19.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.338+0000 7f072e7fc640 1 -- 172.21.15.113:0/695025719 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730004d60 con 0x7f07380ce010 2023-12-19T13:49:19.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.338+0000 7f072e7fc640 1 -- 172.21.15.113:0/695025719 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073000bb20 con 0x7f07380ce010 2023-12-19T13:49:19.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.338+0000 7f072e7fc640 1 -- 172.21.15.113:0/695025719 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073000bed0 con 0x7f07380ce010 2023-12-19T13:49:19.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.338+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07381f2040 con 0x7f07380ce010 2023-12-19T13:49:19.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.338+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07380ce490 con 0x7f07380ce010 2023-12-19T13:49:19.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.339+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0738061910 con 0x7f07380ce010 2023-12-19T13:49:19.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.340+0000 7f072e7fc640 1 -- 172.21.15.113:0/695025719 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0730007070 con 0x7f07380ce010 2023-12-19T13:49:19.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.341+0000 7f072e7fc640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f071c06a430 0x7f071c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.341+0000 7f072e7fc640 1 -- 172.21.15.113:0/695025719 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0730088d70 con 0x7f07380ce010 2023-12-19T13:49:19.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.341+0000 7f073d9b3640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f071c06a430 0x7f071c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.342+0000 7f073d9b3640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f071c06a430 0x7f071c06c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0734036000 tx=0x7f0734030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:19.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.345+0000 7f072e7fc640 1 -- 172.21.15.113:0/695025719 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f073008d070 con 0x7f07380ce010 2023-12-19T13:49:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.535+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f073815e9e0 con 0x7f07380ce010 2023-12-19T13:49:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.536+0000 7f072e7fc640 1 -- 172.21.15.113:0/695025719 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0730054270 con 0x7f07380ce010 2023-12-19T13:49:19.536 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:49:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f071c06a430 msgr2=0x7f071c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f071c06a430 0x7f071c06c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0734036000 tx=0x7f0734030000 comp rx=0 tx=0).stop 2023-12-19T13:49:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07380ce010 msgr2=0x7f07381edef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07380ce010 0x7f07381edef0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f07380b1270 tx=0x7f073000b4a0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 shutdown_connections 2023-12-19T13:49:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f071c06a430 0x7f071c06c8f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07380ce010 0x7f07381edef0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07381f2b20 0x7f073813c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 --2- 172.21.15.113:0/695025719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07240039e0 0x7f073813acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.539+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 >> 172.21.15.113:0/695025719 conn(0x7f07380cbb70 msgr2=0x7f07380cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:19.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.540+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 shutdown_connections 2023-12-19T13:49:19.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.540+0000 7f073fc17640 1 -- 172.21.15.113:0/695025719 wait complete. 2023-12-19T13:49:19.556 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:49:19.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.776+0000 7f6072c26640 1 Processor -- start 2023-12-19T13:49:19.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.776+0000 7f6072c26640 1 -- start start 2023-12-19T13:49:19.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f6072c26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f606c0b2760 0x7f606c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f6072c26640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c15fde0 con 0x7f606c0ceea0 2023-12-19T13:49:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f6072c26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c0b2bc0 con 0x7f606c15b1d0 2023-12-19T13:49:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f6072c26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0b2400 con 0x7f606c0b2760 2023-12-19T13:49:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f60711c3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f606c0ceea0 0x7f606c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44096/0 (socket says 172.21.15.113:44096) 2023-12-19T13:49:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f60711c3640 1 -- 172.21.15.113:0/1164834555 learned_addr learned my addr 172.21.15.113:0/1164834555 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:19.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f606bfff640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f606c0b2760 0x7f606c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.778+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640961633 0 0) 0x7f606c15fde0 con 0x7f606c0ceea0 2023-12-19T13:49:19.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f605c003520 con 0x7f606c0ceea0 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2056387905 0 0) 0x7f605c003520 con 0x7f606c0ceea0 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f606c0b2760 msgr2=0x7f606c0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f606c0b2760 0x7f606c0b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 >> v1:172.21.15.151:6789/0 conn(0x7f606c15b1d0 legacy=0x7f606c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c15ef10 con 0x7f606c0ceea0 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f60640019f0 con 0x7f606c0ceea0 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 >> v1:172.21.15.113:6789/0 conn(0x7f606c0ceea0 legacy=0x7f606c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f605c003a10 0x7f605c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f606c0b2760 0x7f605c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f605c004d00 0x7f605c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c00bb10 con 0x7f605c004d00 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c00bc50 con 0x7f605c003a10 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c00bde0 con 0x7f606c0b2760 2023-12-19T13:49:19.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.779+0000 7f60711c3640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f605c004d00 0x7f605c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.780+0000 7f60711c3640 1 -- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f606c0b2760 msgr2=0x7f605c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.780+0000 7f60709c2640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f605c003a10 0x7f605c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.780+0000 7f60711c3640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f606c0b2760 0x7f605c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.780+0000 7f60711c3640 1 -- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f605c003a10 msgr2=0x7f605c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.780+0000 7f60711c3640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f605c003a10 0x7f605c003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.780+0000 7f60711c3640 1 -- 172.21.15.113:0/1164834555 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c003520 con 0x7f605c004d00 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.781+0000 7f60711c3640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f605c004d00 0x7f605c005180 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f606400a750 tx=0x7f605c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7df7d1c83c31af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.781+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064034630 con 0x7f605c004d00 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.781+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606402f070 con 0x7f605c004d00 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.781+0000 7f606b7fe640 1 -- 172.21.15.113:0/1164834555 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640349f0 con 0x7f605c004d00 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.782+0000 7f6072c26640 1 -- 172.21.15.113:0/1164834555 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f605c004d00 msgr2=0x7f605c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.782+0000 7f6072c26640 1 --2- 172.21.15.113:0/1164834555 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f605c004d00 0x7f605c005180 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f606400a750 tx=0x7f605c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.782+0000 7f60711c3640 1 -- 172.21.15.113:0/1164834555 reap_dead start 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.782+0000 7f6072c26640 1 -- 172.21.15.113:0/1164834555 shutdown_connections 2023-12-19T13:49:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.782+0000 7f6072c26640 1 -- 172.21.15.113:0/1164834555 >> 172.21.15.113:0/1164834555 conn(0x7f606c073150 msgr2=0x7f606c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:19.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.782+0000 7f6072c26640 1 -- 172.21.15.113:0/1164834555 shutdown_connections 2023-12-19T13:49:19.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.782+0000 7f6072c26640 1 -- 172.21.15.113:0/1164834555 wait complete. 2023-12-19T13:49:19.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.784+0000 7f6072c26640 1 Processor -- start 2023-12-19T13:49:19.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.784+0000 7f6072c26640 1 -- start start 2023-12-19T13:49:19.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f6072c26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f605c004d00 0x7f606c154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f6072c26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c154c40 0x7f606c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f6072c26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f606c159060 0x7f606c1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f6072c26640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c15b5b0 con 0x7f606c159060 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f6072c26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c155180 con 0x7f606c154c40 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f6072c26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c155460 con 0x7f605c004d00 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f60711c3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f606c159060 0x7f606c1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f60711c3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f606c159060 0x7f606c1594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34146/0 (socket says 172.21.15.113:34146) 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f60711c3640 1 -- 172.21.15.113:0/2916548332 learned_addr learned my addr 172.21.15.113:0/2916548332 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f606bfff640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c154c40 0x7f606c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.785+0000 7f60709c2640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f605c004d00 0x7f606c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60711c3640 1 -- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f605c004d00 msgr2=0x7f606c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60711c3640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f605c004d00 0x7f606c154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60711c3640 1 -- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c154c40 msgr2=0x7f606c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60711c3640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c154c40 0x7f606c158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60711c3640 1 -- 172.21.15.113:0/2916548332 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c155740 con 0x7f606c159060 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60709c2640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f605c004d00 0x7f606c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f606bfff640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c154c40 0x7f606c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60711c3640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f606c159060 0x7f606c1594f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f606400a750 tx=0x7f606c15f0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60697fa640 1 -- 172.21.15.113:0/2916548332 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064034840 con 0x7f606c159060 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60697fa640 1 -- 172.21.15.113:0/2916548332 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064001a60 con 0x7f606c159060 2023-12-19T13:49:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f60697fa640 1 -- 172.21.15.113:0/2916548332 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064034ba0 con 0x7f606c159060 2023-12-19T13:49:19.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c15b800 con 0x7f606c159060 2023-12-19T13:49:19.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.786+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c15d790 con 0x7f606c159060 2023-12-19T13:49:19.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.787+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c0ccb10 con 0x7f606c159060 2023-12-19T13:49:19.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.788+0000 7f60697fa640 1 -- 172.21.15.113:0/2916548332 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6064031030 con 0x7f606c159060 2023-12-19T13:49:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.789+0000 7f60697fa640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f605006a460 0x7f605006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.789+0000 7f60697fa640 1 -- 172.21.15.113:0/2916548332 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f60640a9fd0 con 0x7f606c159060 2023-12-19T13:49:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.790+0000 7f60709c2640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f605006a460 0x7f605006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.790+0000 7f60709c2640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f605006a460 0x7f605006c920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6060001630 tx=0x7f6060009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.794+0000 7f60697fa640 1 -- 172.21.15.113:0/2916548332 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f60640755c0 con 0x7f606c159060 2023-12-19T13:49:19.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.984+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f606c15b9f0 con 0x7f606c159060 2023-12-19T13:49:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.985+0000 7f60697fa640 1 -- 172.21.15.113:0/2916548332 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60640450a0 con 0x7f606c159060 2023-12-19T13:49:19.984 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:49:19.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f605006a460 msgr2=0x7f605006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f605006a460 0x7f605006c920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6060001630 tx=0x7f6060009040 comp rx=0 tx=0).stop 2023-12-19T13:49:19.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f606c159060 msgr2=0x7f606c1594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:19.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f606c159060 0x7f606c1594f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f606400a750 tx=0x7f606c15f0a0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 shutdown_connections 2023-12-19T13:49:19.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f605006a460 0x7f605006c920 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f606c159060 0x7f606c1594f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c154c40 0x7f606c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 --2- 172.21.15.113:0/2916548332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f605c004d00 0x7f606c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:19.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.987+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 >> 172.21.15.113:0/2916548332 conn(0x7f606c073150 msgr2=0x7f606c1569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:19.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.988+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 shutdown_connections 2023-12-19T13:49:19.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:19.988+0000 7f6072c26640 1 -- 172.21.15.113:0/2916548332 wait complete. 2023-12-19T13:49:20.006 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.220+0000 7f87b09f6640 1 Processor -- start 2023-12-19T13:49:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.220+0000 7f87b09f6640 1 -- start start 2023-12-19T13:49:20.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.222+0000 7f87b09f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 0x7f87ac06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.222+0000 7f87b09f6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0b2600 con 0x7f87ac157aa0 2023-12-19T13:49:20.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.222+0000 7f87b09f6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0b1d60 con 0x7f87ac0b1710 2023-12-19T13:49:20.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.222+0000 7f87b09f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b2040 con 0x7f87ac15e750 2023-12-19T13:49:20.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.222+0000 7f87aa59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f87ac157aa0 0x7f87ac161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44104/0 (socket says 172.21.15.113:44104) 2023-12-19T13:49:20.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.222+0000 7f87aa59c640 1 -- 172.21.15.113:0/3805513135 learned_addr learned my addr 172.21.15.113:0/3805513135 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:20.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909483060 0 0) 0x7f87ac0b2600 con 0x7f87ac157aa0 2023-12-19T13:49:20.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87aad9d640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 0x7f87ac06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8794003520 con 0x7f87ac157aa0 2023-12-19T13:49:20.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051764421 0 0) 0x7f8794003520 con 0x7f87ac157aa0 2023-12-19T13:49:20.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 msgr2=0x7f87ac06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:20.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 0x7f87ac06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 >> v1:172.21.15.151:6789/0 conn(0x7f87ac0b1710 legacy=0x7f87ac15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0b2320 con 0x7f87ac157aa0 2023-12-19T13:49:20.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f879c001670 con 0x7f87ac157aa0 2023-12-19T13:49:20.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 >> v1:172.21.15.113:6789/0 conn(0x7f87ac157aa0 legacy=0x7f87ac161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8794003a10 0x7f8794003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87940047c0 0x7f8794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 0x7f8794005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b2040 con 0x7f87940047c0 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879400ba80 con 0x7f8794003a10 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879400bc40 con 0x7f87ac15e750 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.223+0000 7f87a9d9b640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87940047c0 0x7f8794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.224+0000 7f87aad9d640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 0x7f8794005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.224+0000 7f87aa59c640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8794003a10 0x7f8794003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.224+0000 7f87a9d9b640 1 -- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 msgr2=0x7f8794005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.224+0000 7f87a9d9b640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87ac15e750 0x7f8794005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.224+0000 7f87a9d9b640 1 -- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8794003a10 msgr2=0x7f8794003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.224+0000 7f87a9d9b640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8794003a10 0x7f8794003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.224+0000 7f87a9d9b640 1 -- 172.21.15.113:0/3805513135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794003520 con 0x7f87940047c0 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.225+0000 7f87a9d9b640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87940047c0 0x7f8794004c40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f87a0001750 tx=0x7f87940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64497db498d06b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.225+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a00052d0 con 0x7f87940047c0 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.225+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a002e050 con 0x7f87940047c0 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.225+0000 7f87a959a640 1 -- 172.21.15.113:0/3805513135 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a00035f0 con 0x7f87940047c0 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.226+0000 7f87b09f6640 1 -- 172.21.15.113:0/3805513135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87940047c0 msgr2=0x7f8794004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.226+0000 7f87b09f6640 1 --2- 172.21.15.113:0/3805513135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87940047c0 0x7f8794004c40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f87a0001750 tx=0x7f87940057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.226+0000 7f87aad9d640 1 -- 172.21.15.113:0/3805513135 reap_dead start 2023-12-19T13:49:20.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.226+0000 7f87b09f6640 1 -- 172.21.15.113:0/3805513135 shutdown_connections 2023-12-19T13:49:20.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.226+0000 7f87b09f6640 1 -- 172.21.15.113:0/3805513135 >> 172.21.15.113:0/3805513135 conn(0x7f87ac0cbb70 msgr2=0x7f87ac0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:20.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.226+0000 7f87b09f6640 1 -- 172.21.15.113:0/3805513135 shutdown_connections 2023-12-19T13:49:20.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.226+0000 7f87b09f6640 1 -- 172.21.15.113:0/3805513135 wait complete. 2023-12-19T13:49:20.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.228+0000 7f87b09f6640 1 Processor -- start 2023-12-19T13:49:20.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.228+0000 7f87b09f6640 1 -- start start 2023-12-19T13:49:20.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87b09f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87940047c0 0x7f87ac1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87b09f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87ac06bdc0 0x7f87ac1e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87b09f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87ac1e6ba0 0x7f87ac0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87b09f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1e75e0 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87b09f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1e7020 con 0x7f87ac06bdc0 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87b09f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1e7300 con 0x7f87940047c0 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87ac1e6ba0 0x7f87ac0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87ac1e6ba0 0x7f87ac0ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34158/0 (socket says 172.21.15.113:34158) 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 -- 172.21.15.113:0/332916113 learned_addr learned my addr 172.21.15.113:0/332916113 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aa59c640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87940047c0 0x7f87ac1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 -- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87940047c0 msgr2=0x7f87ac1499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87940047c0 0x7f87ac1499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87a9d9b640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87ac06bdc0 0x7f87ac1e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 -- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87ac06bdc0 msgr2=0x7f87ac1e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87ac06bdc0 0x7f87ac1e6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.229+0000 7f87aad9d640 1 -- 172.21.15.113:0/332916113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac06b5c0 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.230+0000 7f87aad9d640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87ac1e6ba0 0x7f87ac0ae280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0af470 tx=0x7f87a40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.230+0000 7f879affd640 1 -- 172.21.15.113:0/332916113 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400e070 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.230+0000 7f879affd640 1 -- 172.21.15.113:0/332916113 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4011ed0 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.230+0000 7f879affd640 1 -- 172.21.15.113:0/332916113 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4003990 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.230+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac06b8a0 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.230+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac155e30 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.231+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac06ba90 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.232+0000 7f879affd640 1 -- 172.21.15.113:0/332916113 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87a4003b10 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.233+0000 7f879affd640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f878c06a430 0x7f878c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.233+0000 7f879affd640 1 -- 172.21.15.113:0/332916113 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f87a4089340 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.233+0000 7f87aa59c640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f878c06a430 0x7f878c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.234+0000 7f87aa59c640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f878c06a430 0x7f878c06c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f879c0018e0 tx=0x7f879c000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:20.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.237+0000 7f879affd640 1 -- 172.21.15.113:0/332916113 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87a4054800 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.464+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87ac061910 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.465+0000 7f879affd640 1 -- 172.21.15.113:0/332916113 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f87a4057e20 con 0x7f87ac1e6ba0 2023-12-19T13:49:20.465 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:20.465 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:49:20.465 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:49:20.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.467+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f878c06a430 msgr2=0x7f878c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.467+0000 7f87b09f6640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f878c06a430 0x7f878c06c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f879c0018e0 tx=0x7f879c000ed0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.467+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87ac1e6ba0 msgr2=0x7f87ac0ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.467+0000 7f87b09f6640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87ac1e6ba0 0x7f87ac0ae280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0af470 tx=0x7f87a40115a0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 shutdown_connections 2023-12-19T13:49:20.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f878c06a430 0x7f878c06c8f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87ac1e6ba0 0x7f87ac0ae280 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87ac06bdc0 0x7f87ac1e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 --2- 172.21.15.113:0/332916113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87940047c0 0x7f87ac1499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 >> 172.21.15.113:0/332916113 conn(0x7f87ac0cbb70 msgr2=0x7f87ac15c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:20.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 shutdown_connections 2023-12-19T13:49:20.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.468+0000 7f87b09f6640 1 -- 172.21.15.113:0/332916113 wait complete. 2023-12-19T13:49:20.486 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.696+0000 7f9ca2bc4640 1 Processor -- start 2023-12-19T13:49:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.696+0000 7f9ca2bc4640 1 -- start start 2023-12-19T13:49:20.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca2bc4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c9c0b8070 0x7f9c9c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca2bc4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c9c0d0a90 0x7f9c9c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca2bc4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c0d12d0 con 0x7f9c9c146e30 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca2bc4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c147210 con 0x7f9c9c0d0a90 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca2bc4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0d2370 con 0x7f9c9c0b8070 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca23c3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c9c0d0a90 0x7f9c9c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca23c3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c9c0d0a90 0x7f9c9c15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34172/0 (socket says 172.21.15.113:34172) 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.698+0000 7f9ca23c3640 1 -- 172.21.15.113:0/4216321636 learned_addr learned my addr 172.21.15.113:0/4216321636 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.699+0000 7f9ca13c1640 1 --2- 172.21.15.113:0/4216321636 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c0b8070 0x7f9c9c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.699+0000 7f9ca23c3640 1 -- 172.21.15.113:0/4216321636 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c0b8070 msgr2=0x7f9c9c0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.699+0000 7f9ca23c3640 1 --2- 172.21.15.113:0/4216321636 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c0b8070 0x7f9c9c0d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.699+0000 7f9ca23c3640 1 -- 172.21.15.113:0/4216321636 >> v1:172.21.15.151:6789/0 conn(0x7f9c9c146e30 legacy=0x7f9c9c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.699+0000 7f9ca23c3640 1 -- 172.21.15.113:0/4216321636 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c0d15b0 con 0x7f9c9c0d0a90 2023-12-19T13:49:20.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.700+0000 7f9ca23c3640 1 --2- 172.21.15.113:0/4216321636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0d0a90 0x7f9c9c15d870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0b6450 tx=0x7f9c9402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f23cdcf12ac7724 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:20.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca0bc0640 1 -- 172.21.15.113:0/4216321636 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9402c9f0 con 0x7f9c9c0d0a90 2023-12-19T13:49:20.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca0bc0640 1 -- 172.21.15.113:0/4216321636 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9402cb50 con 0x7f9c9c0d0a90 2023-12-19T13:49:20.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca0bc0640 1 -- 172.21.15.113:0/4216321636 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940343f0 con 0x7f9c9c0d0a90 2023-12-19T13:49:20.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/4216321636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0d0a90 msgr2=0x7f9c9c15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/4216321636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0d0a90 0x7f9c9c15d870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0b6450 tx=0x7f9c9402be50 comp rx=0 tx=0).stop 2023-12-19T13:49:20.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/4216321636 shutdown_connections 2023-12-19T13:49:20.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/4216321636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0d0a90 0x7f9c9c15d870 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/4216321636 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c0b8070 0x7f9c9c0d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.701+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/4216321636 >> 172.21.15.113:0/4216321636 conn(0x7f9c9c0b2990 msgr2=0x7f9c9c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:20.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.702+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/4216321636 shutdown_connections 2023-12-19T13:49:20.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.702+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/4216321636 wait complete. 2023-12-19T13:49:20.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.704+0000 7f9ca2bc4640 1 Processor -- start 2023-12-19T13:49:20.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.704+0000 7f9ca2bc4640 1 -- start start 2023-12-19T13:49:20.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.705+0000 7f9ca2bc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b8070 0x7f9c9c13a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.705+0000 7f9ca2bc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0d0a90 0x7f9c9c13e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.705+0000 7f9ca2bc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c146e30 0x7f9c9c13b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.705+0000 7f9ca2bc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c13acf0 con 0x7f9c9c0b8070 2023-12-19T13:49:20.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.705+0000 7f9ca2bc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c13e6d0 con 0x7f9c9c146e30 2023-12-19T13:49:20.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.705+0000 7f9ca2bc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c13bb10 con 0x7f9c9c0d0a90 2023-12-19T13:49:20.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.705+0000 7f9ca1bc2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b8070 0x7f9c9c13a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b8070 0x7f9c9c13a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34180/0 (socket says 172.21.15.113:34180) 2023-12-19T13:49:20.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 -- 172.21.15.113:0/2106367165 learned_addr learned my addr 172.21.15.113:0/2106367165 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:20.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 -- 172.21.15.113:0/2106367165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0d0a90 msgr2=0x7f9c9c13e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0d0a90 0x7f9c9c13e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 -- 172.21.15.113:0/2106367165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c146e30 msgr2=0x7f9c9c13b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c146e30 0x7f9c9c13b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 -- 172.21.15.113:0/2106367165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94009b30 con 0x7f9c9c0b8070 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9ca1bc2640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b8070 0x7f9c9c13a7b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800b3f0 tx=0x7f9c9800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9c927fc640 1 -- 172.21.15.113:0/2106367165 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98011830 con 0x7f9c9c0b8070 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9c927fc640 1 -- 172.21.15.113:0/2106367165 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c98011990 con 0x7f9c9c0b8070 2023-12-19T13:49:20.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.706+0000 7f9c927fc640 1 -- 172.21.15.113:0/2106367165 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98011d80 con 0x7f9c9c0b8070 2023-12-19T13:49:20.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.707+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c13f910 con 0x7f9c9c0b8070 2023-12-19T13:49:20.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.707+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c13efe0 con 0x7f9c9c0b8070 2023-12-19T13:49:20.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.708+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c061910 con 0x7f9c9c0b8070 2023-12-19T13:49:20.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.709+0000 7f9c927fc640 1 -- 172.21.15.113:0/2106367165 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c9801a400 con 0x7f9c9c0b8070 2023-12-19T13:49:20.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.710+0000 7f9c927fc640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8006a430 0x7f9c8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:20.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.710+0000 7f9c927fc640 1 -- 172.21.15.113:0/2106367165 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9c980887b0 con 0x7f9c9c0b8070 2023-12-19T13:49:20.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.710+0000 7f9ca13c1640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8006a430 0x7f9c8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:20.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.711+0000 7f9ca13c1640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8006a430 0x7f9c8006c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c006fd0 tx=0x7f9c8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:20.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.714+0000 7f9c927fc640 1 -- 172.21.15.113:0/2106367165 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c98053d10 con 0x7f9c9c0b8070 2023-12-19T13:49:20.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.917+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c9c0b6e30 con 0x7f9c9c0b8070 2023-12-19T13:49:20.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.920+0000 7f9c927fc640 1 -- 172.21.15.113:0/2106367165 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16381 (secure 0 0 0) 0x7f9c98057330 con 0x7f9c9c0b8070 2023-12-19T13:49:20.920 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:20.920 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":61,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:20.749162+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.1d","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.35","mappings":[{"from":5,"to":0}]},{"pgid":"7.38","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:20.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8006a430 msgr2=0x7f9c8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8006a430 0x7f9c8006c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c006fd0 tx=0x7f9c8c008040 comp rx=0 tx=0).stop 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b8070 msgr2=0x7f9c9c13a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b8070 0x7f9c9c13a7b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800b3f0 tx=0x7f9c9800b8b0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 shutdown_connections 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8006a430 0x7f9c8006c8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c146e30 0x7f9c9c13b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0d0a90 0x7f9c9c13e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 --2- 172.21.15.113:0/2106367165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b8070 0x7f9c9c13a7b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 >> 172.21.15.113:0/2106367165 conn(0x7f9c9c0b2990 msgr2=0x7f9c9c1e3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 shutdown_connections 2023-12-19T13:49:20.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:20.923+0000 7f9ca2bc4640 1 -- 172.21.15.113:0/2106367165 wait complete. 2023-12-19T13:49:20.941 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:49:20.942 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:21.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.149+0000 7f9d51a38640 1 Processor -- start 2023-12-19T13:49:21.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.149+0000 7f9d51a38640 1 -- start start 2023-12-19T13:49:21.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.151+0000 7f9d51a38640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d4c0ce820 0x7f9d4c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.151+0000 7f9d51a38640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c0cd840 con 0x7f9d4c0d2b00 2023-12-19T13:49:21.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.151+0000 7f9d51a38640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c0b6e90 con 0x7f9d4c146e10 2023-12-19T13:49:21.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.151+0000 7f9d51a38640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c0d2430 con 0x7f9d4c0ce820 2023-12-19T13:49:21.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.152+0000 7f9d427fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9d4c0d2b00 0x7f9d4c0ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44110/0 (socket says 172.21.15.113:44110) 2023-12-19T13:49:21.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.152+0000 7f9d427fc640 1 -- 172.21.15.113:0/1996940838 learned_addr learned my addr 172.21.15.113:0/1996940838 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:21.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.152+0000 7f9d4b7fe640 1 --2- 172.21.15.113:0/1996940838 >> v2:172.21.15.151:3300/0 conn(0x7f9d4c0ce820 0x7f9d4c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.152+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416284831 0 0) 0x7f9d4c0cd840 con 0x7f9d4c0d2b00 2023-12-19T13:49:21.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.152+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d38003520 con 0x7f9d4c0d2b00 2023-12-19T13:49:21.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 940704988 0 0) 0x7f9d38003520 con 0x7f9d4c0d2b00 2023-12-19T13:49:21.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 >> v2:172.21.15.151:3300/0 conn(0x7f9d4c0ce820 msgr2=0x7f9d4c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 --2- 172.21.15.113:0/1996940838 >> v2:172.21.15.151:3300/0 conn(0x7f9d4c0ce820 0x7f9d4c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 >> v1:172.21.15.151:6789/0 conn(0x7f9d4c146e10 legacy=0x7f9d4c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0d2620 con 0x7f9d4c0d2b00 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9d34001670 con 0x7f9d4c0d2b00 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 >> v1:172.21.15.113:6789/0 conn(0x7f9d4c0d2b00 legacy=0x7f9d4c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d38003a30 0x7f9d38003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d380047c0 0x7f9d38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d380052a0 0x7f9d3800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3800c140 con 0x7f9d380047c0 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3800c2b0 con 0x7f9d38003a30 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3800c470 con 0x7f9d380052a0 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.153+0000 7f9d427fc640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d380047c0 0x7f9d38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d4affd640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d38003a30 0x7f9d38003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d427fc640 1 -- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d380052a0 msgr2=0x7f9d3800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:21.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d427fc640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d380052a0 0x7f9d3800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d427fc640 1 -- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d38003a30 msgr2=0x7f9d38003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:21.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d427fc640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d38003a30 0x7f9d38003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d427fc640 1 -- 172.21.15.113:0/1996940838 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38003520 con 0x7f9d380047c0 2023-12-19T13:49:21.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d4b7fe640 1 -- 172.21.15.113:0/1996940838 reap_dead start 2023-12-19T13:49:21.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.154+0000 7f9d4affd640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d38003a30 0x7f9d38003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:21.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.155+0000 7f9d427fc640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d380047c0 0x7f9d38004c40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c0e0 tx=0x7f9d380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a734698fa72daaae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:21.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.155+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34005ad0 con 0x7f9d380047c0 2023-12-19T13:49:21.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.155+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34005c30 con 0x7f9d380047c0 2023-12-19T13:49:21.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.155+0000 7f9d4a7fc640 1 -- 172.21.15.113:0/1996940838 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3402ca00 con 0x7f9d380047c0 2023-12-19T13:49:21.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.155+0000 7f9d51a38640 1 -- 172.21.15.113:0/1996940838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d380047c0 msgr2=0x7f9d38004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.155+0000 7f9d51a38640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d380047c0 0x7f9d38004c40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c0e0 tx=0x7f9d380057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.156+0000 7f9d51a38640 1 -- 172.21.15.113:0/1996940838 shutdown_connections 2023-12-19T13:49:21.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.156+0000 7f9d51a38640 1 --2- 172.21.15.113:0/1996940838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d380047c0 0x7f9d38004c40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.156+0000 7f9d51a38640 1 -- 172.21.15.113:0/1996940838 >> 172.21.15.113:0/1996940838 conn(0x7f9d4c0b29c0 msgr2=0x7f9d4c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:21.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.156+0000 7f9d51a38640 1 -- 172.21.15.113:0/1996940838 shutdown_connections 2023-12-19T13:49:21.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.156+0000 7f9d51a38640 1 -- 172.21.15.113:0/1996940838 wait complete. 2023-12-19T13:49:21.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.157+0000 7f9d51a38640 1 Processor -- start 2023-12-19T13:49:21.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.158+0000 7f9d51a38640 1 -- start start 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.158+0000 7f9d51a38640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d380047c0 0x7f9d4c13cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.158+0000 7f9d51a38640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d4c1561d0 0x7f9d4c153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.158+0000 7f9d51a38640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d4c158410 0x7f9d4c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.158+0000 7f9d51a38640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1569c0 con 0x7f9d4c158410 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.158+0000 7f9d51a38640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1566e0 con 0x7f9d380047c0 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.158+0000 7f9d51a38640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1e5ea0 con 0x7f9d4c1561d0 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d4c158410 0x7f9d4c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d4c158410 0x7f9d4c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34196/0 (socket says 172.21.15.113:34196) 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 -- 172.21.15.113:0/3796273758 learned_addr learned my addr 172.21.15.113:0/3796273758 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4affd640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d380047c0 0x7f9d4c13cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d427fc640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d4c1561d0 0x7f9d4c153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 -- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d4c1561d0 msgr2=0x7f9d4c153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d4c1561d0 0x7f9d4c153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 -- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d380047c0 msgr2=0x7f9d4c13cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d380047c0 0x7f9d4c13cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 -- 172.21.15.113:0/3796273758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c1e6180 con 0x7f9d4c158410 2023-12-19T13:49:21.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4affd640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d380047c0 0x7f9d4c13cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:21.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.159+0000 7f9d4b7fe640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d4c158410 0x7f9d4c154240 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0d2f90 tx=0x7f9d4400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:21.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.160+0000 7f9d48ff9640 1 -- 172.21.15.113:0/3796273758 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44010040 con 0x7f9d4c158410 2023-12-19T13:49:21.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.160+0000 7f9d48ff9640 1 -- 172.21.15.113:0/3796273758 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400bce0 con 0x7f9d4c158410 2023-12-19T13:49:21.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.160+0000 7f9d48ff9640 1 -- 172.21.15.113:0/3796273758 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44014640 con 0x7f9d4c158410 2023-12-19T13:49:21.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.160+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c1e6460 con 0x7f9d4c158410 2023-12-19T13:49:21.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.160+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c1588c0 con 0x7f9d4c158410 2023-12-19T13:49:21.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.161+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c1e5d00 con 0x7f9d4c158410 2023-12-19T13:49:21.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.162+0000 7f9d48ff9640 1 -- 172.21.15.113:0/3796273758 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d440147a0 con 0x7f9d4c158410 2023-12-19T13:49:21.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.163+0000 7f9d48ff9640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9d2c06a460 0x7f9d2c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.163+0000 7f9d48ff9640 1 -- 172.21.15.113:0/3796273758 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9d44088e70 con 0x7f9d4c158410 2023-12-19T13:49:21.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.163+0000 7f9d4affd640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9d2c06a460 0x7f9d2c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.164+0000 7f9d4affd640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9d2c06a460 0x7f9d2c06c920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c04f980 tx=0x7f9d3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:21.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.168+0000 7f9d48ff9640 1 -- 172.21.15.113:0/3796273758 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9d4c1e5d00 con 0x7f9d4c158410 2023-12-19T13:49:21.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.401+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d4c1e5d00 con 0x7f9d4c158410 2023-12-19T13:49:21.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.402+0000 7f9d48ff9640 1 -- 172.21.15.113:0/3796273758 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f9d4c1e5d00 con 0x7f9d4c158410 2023-12-19T13:49:21.402 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:21.402 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:49:21.402 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:49:21.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.404+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9d2c06a460 msgr2=0x7f9d2c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.404+0000 7f9d51a38640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9d2c06a460 0x7f9d2c06c920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c04f980 tx=0x7f9d3c009040 comp rx=0 tx=0).stop 2023-12-19T13:49:21.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.404+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d4c158410 msgr2=0x7f9d4c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.404+0000 7f9d51a38640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d4c158410 0x7f9d4c154240 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0d2f90 tx=0x7f9d4400b480 comp rx=0 tx=0).stop 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 shutdown_connections 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9d2c06a460 0x7f9d2c06c920 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d4c158410 0x7f9d4c154240 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d4c1561d0 0x7f9d4c153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 --2- 172.21.15.113:0/3796273758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d380047c0 0x7f9d4c13cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 >> 172.21.15.113:0/3796273758 conn(0x7f9d4c0b29c0 msgr2=0x7f9d4c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 shutdown_connections 2023-12-19T13:49:21.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.405+0000 7f9d51a38640 1 -- 172.21.15.113:0/3796273758 wait complete. 2023-12-19T13:49:21.423 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:21.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.638+0000 7fe2e3c26640 1 Processor -- start 2023-12-19T13:49:21.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.638+0000 7fe2e3c26640 1 -- start start 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e3c26640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe2dc157bf0 0x7fe2dc15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e3c26640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe2dc0b0810 0x7fe2dc06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e3c26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc15b740 con 0x7fe2dc0ae110 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e3c26640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc06b8c0 con 0x7fe2dc157bf0 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e3c26640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0ae640 con 0x7fe2dc0b0810 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e19c2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe2dc157bf0 0x7fe2dc15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e19c2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe2dc157bf0 0x7fe2dc15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34210/0 (socket says 172.21.15.113:34210) 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e19c2640 1 -- 172.21.15.113:0/827324247 learned_addr learned my addr 172.21.15.113:0/827324247 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e21c3640 1 --2- 172.21.15.113:0/827324247 >> v2:172.21.15.151:3300/0 conn(0x7fe2dc0b0810 0x7fe2dc06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e19c2640 1 -- 172.21.15.113:0/827324247 >> v2:172.21.15.151:3300/0 conn(0x7fe2dc0b0810 msgr2=0x7fe2dc06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:21.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e19c2640 1 --2- 172.21.15.113:0/827324247 >> v2:172.21.15.151:3300/0 conn(0x7fe2dc0b0810 0x7fe2dc06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.640+0000 7fe2e19c2640 1 -- 172.21.15.113:0/827324247 >> v1:172.21.15.151:6789/0 conn(0x7fe2dc0ae110 legacy=0x7fe2dc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:21.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.641+0000 7fe2e19c2640 1 -- 172.21.15.113:0/827324247 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0ae920 con 0x7fe2dc157bf0 2023-12-19T13:49:21.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.642+0000 7fe2e19c2640 1 --2- 172.21.15.113:0/827324247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc157bf0 0x7fe2dc15b200 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0b1210 tx=0x7fe2d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eec0211554840fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:21.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.642+0000 7fe2e09c0640 1 -- 172.21.15.113:0/827324247 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8031870 con 0x7fe2dc157bf0 2023-12-19T13:49:21.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.642+0000 7fe2e09c0640 1 -- 172.21.15.113:0/827324247 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d80319d0 con 0x7fe2dc157bf0 2023-12-19T13:49:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.642+0000 7fe2e09c0640 1 -- 172.21.15.113:0/827324247 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8031d60 con 0x7fe2dc157bf0 2023-12-19T13:49:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.642+0000 7fe2e3c26640 1 -- 172.21.15.113:0/827324247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc157bf0 msgr2=0x7fe2dc15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.642+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/827324247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc157bf0 0x7fe2dc15b200 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0b1210 tx=0x7fe2d802b910 comp rx=0 tx=0).stop 2023-12-19T13:49:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.643+0000 7fe2e3c26640 1 -- 172.21.15.113:0/827324247 shutdown_connections 2023-12-19T13:49:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.643+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/827324247 >> v2:172.21.15.151:3300/0 conn(0x7fe2dc0b0810 0x7fe2dc06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.643+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/827324247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc157bf0 0x7fe2dc15b200 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.643+0000 7fe2e3c26640 1 -- 172.21.15.113:0/827324247 >> 172.21.15.113:0/827324247 conn(0x7fe2dc0cbb70 msgr2=0x7fe2dc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.643+0000 7fe2e3c26640 1 -- 172.21.15.113:0/827324247 shutdown_connections 2023-12-19T13:49:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.643+0000 7fe2e3c26640 1 -- 172.21.15.113:0/827324247 wait complete. 2023-12-19T13:49:21.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.644+0000 7fe2e3c26640 1 Processor -- start 2023-12-19T13:49:21.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.644+0000 7fe2e3c26640 1 -- start start 2023-12-19T13:49:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.645+0000 7fe2e3c26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2dc0ae110 0x7fe2dc14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.645+0000 7fe2e3c26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc0b0810 0x7fe2dc156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.645+0000 7fe2e3c26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2dc157bf0 0x7fe2dc14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.645+0000 7fe2e3c26640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc15d420 con 0x7fe2dc0b0810 2023-12-19T13:49:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.645+0000 7fe2e3c26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc15d700 con 0x7fe2dc0ae110 2023-12-19T13:49:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.645+0000 7fe2e3c26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc153100 con 0x7fe2dc157bf0 2023-12-19T13:49:21.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc0b0810 0x7fe2dc156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc0b0810 0x7fe2dc156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34214/0 (socket says 172.21.15.113:34214) 2023-12-19T13:49:21.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 -- 172.21.15.113:0/2838307042 learned_addr learned my addr 172.21.15.113:0/2838307042 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e21c3640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2dc157bf0 0x7fe2dc14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e19c2640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2dc0ae110 0x7fe2dc14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 -- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2dc157bf0 msgr2=0x7fe2dc14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2dc157bf0 0x7fe2dc14dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 -- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2dc0ae110 msgr2=0x7fe2dc14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2dc0ae110 0x7fe2dc14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 -- 172.21.15.113:0/2838307042 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80094d0 con 0x7fe2dc0b0810 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.646+0000 7fe2e11c1640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc0b0810 0x7fe2dc156ff0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c410 tx=0x7fe2cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.647+0000 7fe2d27fc640 1 -- 172.21.15.113:0/2838307042 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0035f0 con 0x7fe2dc0b0810 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.647+0000 7fe2d27fc640 1 -- 172.21.15.113:0/2838307042 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc003750 con 0x7fe2dc0b0810 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.647+0000 7fe2d27fc640 1 -- 172.21.15.113:0/2838307042 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc003b40 con 0x7fe2dc0b0810 2023-12-19T13:49:21.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.647+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc1533e0 con 0x7fe2dc0b0810 2023-12-19T13:49:21.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.647+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc158200 con 0x7fe2dc0b0810 2023-12-19T13:49:21.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.648+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc1597b0 con 0x7fe2dc0b0810 2023-12-19T13:49:21.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.649+0000 7fe2d27fc640 1 -- 172.21.15.113:0/2838307042 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2cc003ca0 con 0x7fe2dc0b0810 2023-12-19T13:49:21.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.650+0000 7fe2d27fc640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2c006a430 0x7fe2c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:21.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.650+0000 7fe2d27fc640 1 -- 172.21.15.113:0/2838307042 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe2cc087be0 con 0x7fe2dc0b0810 2023-12-19T13:49:21.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.651+0000 7fe2e19c2640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2c006a430 0x7fe2c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:21.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.651+0000 7fe2e19c2640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2c006a430 0x7fe2c006c8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8036000 tx=0x7fe2d803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:21.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.655+0000 7fe2d27fc640 1 -- 172.21.15.113:0/2838307042 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe2cc053140 con 0x7fe2dc0b0810 2023-12-19T13:49:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.879+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2dc15d560 con 0x7fe2dc0b0810 2023-12-19T13:49:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.880+0000 7fe2d27fc640 1 -- 172.21.15.113:0/2838307042 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fe2dc15d560 con 0x7fe2dc0b0810 2023-12-19T13:49:21.880 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:21.880 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:48:31.022976+0000","modified":"2023-12-19T13:48:34.453646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5577":{"gid":5577,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/1910749856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1910749856},{"type":"v1","addr":"172.21.15.113:6837","nonce":1910749856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T13:49:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 25 2023-12-19T13:49:21.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.882+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2c006a430 msgr2=0x7fe2c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.882+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2c006a430 0x7fe2c006c8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8036000 tx=0x7fe2d803c040 comp rx=0 tx=0).stop 2023-12-19T13:49:21.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.882+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc0b0810 msgr2=0x7fe2dc156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:21.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.882+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc0b0810 0x7fe2dc156ff0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c410 tx=0x7fe2cc00c8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 shutdown_connections 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2c006a430 0x7fe2c006c8f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2dc157bf0 0x7fe2dc14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2dc0b0810 0x7fe2dc156ff0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 --2- 172.21.15.113:0/2838307042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2dc0ae110 0x7fe2dc14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 >> 172.21.15.113:0/2838307042 conn(0x7fe2dc0cbb70 msgr2=0x7fe2dc154490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 shutdown_connections 2023-12-19T13:49:21.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:21.883+0000 7fe2e3c26640 1 -- 172.21.15.113:0/2838307042 wait complete. 2023-12-19T13:49:21.899 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:22.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.101+0000 7f0a42d77640 1 Processor -- start 2023-12-19T13:49:22.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.101+0000 7f0a42d77640 1 -- start start 2023-12-19T13:49:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a42d77640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a3c1449e0 0x7f0a3c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a42d77640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0a3c0b0b50 0x7f0a3c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a42d77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c06b590 0x7f0a3c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a42d77640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0afb10 con 0x7f0a3c1449e0 2023-12-19T13:49:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a42d77640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c06bb30 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a42d77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0b0070 con 0x7f0a3c06b590 2023-12-19T13:49:22.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a3c1449e0 0x7f0a3c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a3c1449e0 0x7f0a3c0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34228/0 (socket says 172.21.15.113:34228) 2023-12-19T13:49:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 -- 172.21.15.113:0/3930674471 learned_addr learned my addr 172.21.15.113:0/3930674471 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 -- 172.21.15.113:0/3930674471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c06b590 msgr2=0x7f0a3c06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 --2- 172.21.15.113:0/3930674471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c06b590 0x7f0a3c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 -- 172.21.15.113:0/3930674471 >> v2:172.21.15.151:3300/0 conn(0x7f0a3c0b0b50 msgr2=0x7f0a3c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 --2- 172.21.15.113:0/3930674471 >> v2:172.21.15.151:3300/0 conn(0x7f0a3c0b0b50 0x7f0a3c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.103+0000 7f0a40b13640 1 -- 172.21.15.113:0/3930674471 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0b0350 con 0x7f0a3c1449e0 2023-12-19T13:49:22.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.104+0000 7f0a40b13640 1 --2- 172.21.15.113:0/3930674471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c1449e0 0x7f0a3c0af5d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c071c80 tx=0x7f0a3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc885f94486dbc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a3b7fe640 1 -- 172.21.15.113:0/3930674471 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30031870 con 0x7f0a3c1449e0 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a3b7fe640 1 -- 172.21.15.113:0/3930674471 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a300319d0 con 0x7f0a3c1449e0 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a3b7fe640 1 -- 172.21.15.113:0/3930674471 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30031d60 con 0x7f0a3c1449e0 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a42d77640 1 -- 172.21.15.113:0/3930674471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c1449e0 msgr2=0x7f0a3c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a42d77640 1 --2- 172.21.15.113:0/3930674471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c1449e0 0x7f0a3c0af5d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c071c80 tx=0x7f0a3002b910 comp rx=0 tx=0).stop 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a42d77640 1 -- 172.21.15.113:0/3930674471 shutdown_connections 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a42d77640 1 --2- 172.21.15.113:0/3930674471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c06b590 0x7f0a3c06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a42d77640 1 --2- 172.21.15.113:0/3930674471 >> v2:172.21.15.151:3300/0 conn(0x7f0a3c0b0b50 0x7f0a3c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a42d77640 1 --2- 172.21.15.113:0/3930674471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c1449e0 0x7f0a3c0af5d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.105+0000 7f0a42d77640 1 -- 172.21.15.113:0/3930674471 >> 172.21.15.113:0/3930674471 conn(0x7f0a3c0cbb70 msgr2=0x7f0a3c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.106+0000 7f0a42d77640 1 -- 172.21.15.113:0/3930674471 shutdown_connections 2023-12-19T13:49:22.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.106+0000 7f0a42d77640 1 -- 172.21.15.113:0/3930674471 wait complete. 2023-12-19T13:49:22.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.107+0000 7f0a42d77640 1 Processor -- start 2023-12-19T13:49:22.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.107+0000 7f0a42d77640 1 -- start start 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.108+0000 7f0a42d77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a3c06b590 0x7f0a3c15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.108+0000 7f0a42d77640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c0b0b50 0x7f0a3c1e4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.108+0000 7f0a42d77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c1449e0 0x7f0a3c1e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.108+0000 7f0a42d77640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c146490 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.108+0000 7f0a42d77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c15d490 con 0x7f0a3c06b590 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.108+0000 7f0a42d77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c1453f0 con 0x7f0a3c1449e0 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c0b0b50 0x7f0a3c1e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c0b0b50 0x7f0a3c1e4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34236/0 (socket says 172.21.15.113:34236) 2023-12-19T13:49:22.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 -- 172.21.15.113:0/755568505 learned_addr learned my addr 172.21.15.113:0/755568505 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 -- 172.21.15.113:0/755568505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c1449e0 msgr2=0x7f0a3c1e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c1449e0 0x7f0a3c1e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 -- 172.21.15.113:0/755568505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a3c06b590 msgr2=0x7f0a3c15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a40b13640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a3c06b590 0x7f0a3c15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a3c06b590 0x7f0a3c15cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 -- 172.21.15.113:0/755568505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300094d0 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.109+0000 7f0a3bfff640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c0b0b50 0x7f0a3c1e4530 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800b4a0 tx=0x7f0a2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.110+0000 7f0a397fa640 1 -- 172.21.15.113:0/755568505 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28010610 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.110+0000 7f0a397fa640 1 -- 172.21.15.113:0/755568505 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28010770 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.110+0000 7f0a397fa640 1 -- 172.21.15.113:0/755568505 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28010b20 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.110+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c1456d0 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.110+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c145c90 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.111+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c061910 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.112+0000 7f0a397fa640 1 -- 172.21.15.113:0/755568505 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a28010c80 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.112+0000 7f0a397fa640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a2006a460 0x7f0a2006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.113+0000 7f0a397fa640 1 -- 172.21.15.113:0/755568505 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0a280884b0 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.113+0000 7f0a40b13640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a2006a460 0x7f0a2006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:22.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.113+0000 7f0a40b13640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a2006a460 0x7f0a2006c920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0a30036000 tx=0x7f0a3003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:22.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.117+0000 7f0a397fa640 1 -- 172.21.15.113:0/755568505 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a28053aa0 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.305+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a3c0ae560 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.308+0000 7f0a397fa640 1 -- 172.21.15.113:0/755568505 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16381 (secure 0 0 0) 0x7f0a280570c0 con 0x7f0a3c0b0b50 2023-12-19T13:49:22.308 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:22.308 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":61,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:20.749162+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:48:28.798187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T13:48:30.040745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.1d","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.35","mappings":[{"from":5,"to":0}]},{"pgid":"7.38","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a2006a460 msgr2=0x7f0a2006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a2006a460 0x7f0a2006c920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0a30036000 tx=0x7f0a3003c040 comp rx=0 tx=0).stop 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c0b0b50 msgr2=0x7f0a3c1e4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c0b0b50 0x7f0a3c1e4530 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800b4a0 tx=0x7f0a2800b960 comp rx=0 tx=0).stop 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 shutdown_connections 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a2006a460 0x7f0a2006c920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a3c1449e0 0x7f0a3c1e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a3c0b0b50 0x7f0a3c1e4530 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 --2- 172.21.15.113:0/755568505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a3c06b590 0x7f0a3c15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 >> 172.21.15.113:0/755568505 conn(0x7f0a3c0cbb70 msgr2=0x7f0a3c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:22.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 shutdown_connections 2023-12-19T13:49:22.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.311+0000 7f0a42d77640 1 -- 172.21.15.113:0/755568505 wait complete. 2023-12-19T13:49:22.329 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:49:22.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.545+0000 7ff9cf695640 1 Processor -- start 2023-12-19T13:49:22.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.545+0000 7ff9cf695640 1 -- start start 2023-12-19T13:49:22.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9cf695640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff9c8146e10 0x7ff9c80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9cf695640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c80cd840 con 0x7ff9c80d2b00 2023-12-19T13:49:22.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9cf695640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c80b6e90 con 0x7ff9c80ce110 2023-12-19T13:49:22.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9cf695640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c80d2430 con 0x7ff9c8146e10 2023-12-19T13:49:22.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9cd431640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff9c8146e10 0x7ff9c80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:22.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9ccc30640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff9c80d2b00 0x7ff9c80b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44112/0 (socket says 172.21.15.113:44112) 2023-12-19T13:49:22.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9ccc30640 1 -- 172.21.15.113:0/1595674496 learned_addr learned my addr 172.21.15.113:0/1595674496 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:22.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9cd431640 1 -- 172.21.15.113:0/1595674496 >> v1:172.21.15.151:6789/0 conn(0x7ff9c80ce110 legacy=0x7ff9c80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9cd431640 1 -- 172.21.15.113:0/1595674496 >> v1:172.21.15.113:6789/0 conn(0x7ff9c80d2b00 legacy=0x7ff9c80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.548+0000 7ff9cd431640 1 -- 172.21.15.113:0/1595674496 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80d2620 con 0x7ff9c8146e10 2023-12-19T13:49:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.547+0000 7ff9bbfff640 1 -- 172.21.15.113:0/1595674496 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778948290 0 0) 0x7ff9c80cd840 con 0x7ff9c80d2b00 2023-12-19T13:49:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.549+0000 7ff9cd431640 1 --2- 172.21.15.113:0/1595674496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c8146e10 0x7ff9c80d1ef0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40097a0 tx=0x7ff9c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b06213972c76b16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.549+0000 7ff9bbfff640 1 -- 172.21.15.113:0/1595674496 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c402e070 con 0x7ff9c8146e10 2023-12-19T13:49:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.549+0000 7ff9bbfff640 1 -- 172.21.15.113:0/1595674496 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40315a0 con 0x7ff9c8146e10 2023-12-19T13:49:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.549+0000 7ff9bbfff640 1 -- 172.21.15.113:0/1595674496 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4031930 con 0x7ff9c8146e10 2023-12-19T13:49:22.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.549+0000 7ff9cf695640 1 -- 172.21.15.113:0/1595674496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c8146e10 msgr2=0x7ff9c80d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.549+0000 7ff9cf695640 1 --2- 172.21.15.113:0/1595674496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c8146e10 0x7ff9c80d1ef0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40097a0 tx=0x7ff9c402b840 comp rx=0 tx=0).stop 2023-12-19T13:49:22.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.550+0000 7ff9cf695640 1 -- 172.21.15.113:0/1595674496 shutdown_connections 2023-12-19T13:49:22.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.550+0000 7ff9cf695640 1 --2- 172.21.15.113:0/1595674496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c8146e10 0x7ff9c80d1ef0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.550+0000 7ff9cf695640 1 -- 172.21.15.113:0/1595674496 >> 172.21.15.113:0/1595674496 conn(0x7ff9c80b29c0 msgr2=0x7ff9c80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:22.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.550+0000 7ff9cf695640 1 -- 172.21.15.113:0/1595674496 shutdown_connections 2023-12-19T13:49:22.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.550+0000 7ff9cf695640 1 -- 172.21.15.113:0/1595674496 wait complete. 2023-12-19T13:49:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.551+0000 7ff9cf695640 1 Processor -- start 2023-12-19T13:49:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.551+0000 7ff9cf695640 1 -- start start 2023-12-19T13:49:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.552+0000 7ff9cf695640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c80ce110 0x7ff9c81587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.552+0000 7ff9cf695640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9c80d2b00 0x7ff9c81600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.552+0000 7ff9cf695640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9c8146e10 0x7ff9c815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.552+0000 7ff9cf695640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80c98e0 con 0x7ff9c80ce110 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.552+0000 7ff9cf695640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80cc320 con 0x7ff9c8146e10 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.552+0000 7ff9cf695640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c81f2df0 con 0x7ff9c80d2b00 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c80ce110 0x7ff9c81587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c80ce110 0x7ff9c81587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34266/0 (socket says 172.21.15.113:34266) 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 -- 172.21.15.113:0/2913746011 learned_addr learned my addr 172.21.15.113:0/2913746011 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 -- 172.21.15.113:0/2913746011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9c80d2b00 msgr2=0x7ff9c81600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9c80d2b00 0x7ff9c81600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 -- 172.21.15.113:0/2913746011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9c8146e10 msgr2=0x7ff9c815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9c8146e10 0x7ff9c815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 -- 172.21.15.113:0/2913746011 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009400 con 0x7ff9c80ce110 2023-12-19T13:49:22.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.553+0000 7ff9cd431640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c80ce110 0x7ff9c81587a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098c0 tx=0x7ff9c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:22.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.554+0000 7ff9b9ffb640 1 -- 172.21.15.113:0/2913746011 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4032900 con 0x7ff9c80ce110 2023-12-19T13:49:22.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.554+0000 7ff9b9ffb640 1 -- 172.21.15.113:0/2913746011 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4032a60 con 0x7ff9c80ce110 2023-12-19T13:49:22.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.554+0000 7ff9b9ffb640 1 -- 172.21.15.113:0/2913746011 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4032e10 con 0x7ff9c80ce110 2023-12-19T13:49:22.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.554+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c815e020 con 0x7ff9c80ce110 2023-12-19T13:49:22.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.554+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c80cbd10 con 0x7ff9c80ce110 2023-12-19T13:49:22.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.555+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c80674e0 con 0x7ff9c80ce110 2023-12-19T13:49:22.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.556+0000 7ff9b9ffb640 1 -- 172.21.15.113:0/2913746011 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9c40453f0 con 0x7ff9c80ce110 2023-12-19T13:49:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.557+0000 7ff9b9ffb640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9ac06a460 0x7ff9ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.557+0000 7ff9b9ffb640 1 -- 172.21.15.113:0/2913746011 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff9c40aab10 con 0x7ff9c80ce110 2023-12-19T13:49:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.557+0000 7ff9ccc30640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9ac06a460 0x7ff9ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.558+0000 7ff9ccc30640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9ac06a460 0x7ff9ac06c920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0011e0 tx=0x7ff9bc007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:22.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.562+0000 7ff9b9ffb640 1 -- 172.21.15.113:0/2913746011 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9c4076180 con 0x7ff9c80ce110 2023-12-19T13:49:22.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.789+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff9c80674e0 con 0x7ff9c80ce110 2023-12-19T13:49:22.790 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:49:22.790+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:49:22.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.806+0000 7ff9b9ffb640 1 -- 172.21.15.113:0/2913746011 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff9c40797a0 con 0x7ff9c80ce110 2023-12-19T13:49:22.806 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:49:22.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.809+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9ac06a460 msgr2=0x7ff9ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.809+0000 7ff9cf695640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9ac06a460 0x7ff9ac06c920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0011e0 tx=0x7ff9bc007940 comp rx=0 tx=0).stop 2023-12-19T13:49:22.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.809+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c80ce110 msgr2=0x7ff9c81587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.809+0000 7ff9cf695640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c80ce110 0x7ff9c81587a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098c0 tx=0x7ff9c40046c0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 shutdown_connections 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9ac06a460 0x7ff9ac06c920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9c8146e10 0x7ff9c815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9c80d2b00 0x7ff9c81600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 --2- 172.21.15.113:0/2913746011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff9c80ce110 0x7ff9c81587a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 >> 172.21.15.113:0/2913746011 conn(0x7ff9c80b29c0 msgr2=0x7ff9c8161a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 shutdown_connections 2023-12-19T13:49:22.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:22.810+0000 7ff9cf695640 1 -- 172.21.15.113:0/2913746011 wait complete. 2023-12-19T13:49:22.829 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:49:22.932 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:49:23.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.031+0000 7f54ae700640 1 Processor -- start 2023-12-19T13:49:23.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.031+0000 7f54ae700640 1 -- start start 2023-12-19T13:49:23.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.032+0000 7f54ae700640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f54a815a190 0x7f54a80aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:23.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.032+0000 7f54ae700640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80aef40 0x7f54a80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:23.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.032+0000 7f54ae700640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54a80b07f0 0x7f54a80ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:23.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.032+0000 7f54ae700640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80b0c20 con 0x7f54a80b07f0 2023-12-19T13:49:23.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.032+0000 7f54ae700640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80ad960 con 0x7f54a815a190 2023-12-19T13:49:23.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.032+0000 7f54ae700640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80adc40 con 0x7f54a80aef40 2023-12-19T13:49:23.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.032+0000 7f54acc9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54a80b07f0 0x7f54a80ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:23.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54acc9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54a80b07f0 0x7f54a80ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34294/0 (socket says 172.21.15.113:34294) 2023-12-19T13:49:23.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54acc9d640 1 -- 172.21.15.113:0/2589298565 learned_addr learned my addr 172.21.15.113:0/2589298565 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:23.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f549f7fe640 1 --2- 172.21.15.113:0/2589298565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80aef40 0x7f54a80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:23.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54a7fff640 1 --2- 172.21.15.113:0/2589298565 >> v2:172.21.15.151:3300/0 conn(0x7f54a815a190 0x7f54a80aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:23.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54acc9d640 1 -- 172.21.15.113:0/2589298565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80aef40 msgr2=0x7f54a80b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:23.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54acc9d640 1 --2- 172.21.15.113:0/2589298565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80aef40 0x7f54a80b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54acc9d640 1 -- 172.21.15.113:0/2589298565 >> v2:172.21.15.151:3300/0 conn(0x7f54a815a190 msgr2=0x7f54a80aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:23.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54acc9d640 1 --2- 172.21.15.113:0/2589298565 >> v2:172.21.15.151:3300/0 conn(0x7f54a815a190 0x7f54a80aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.033+0000 7f54acc9d640 1 -- 172.21.15.113:0/2589298565 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80adf20 con 0x7f54a80b07f0 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.034+0000 7f54acc9d640 1 --2- 172.21.15.113:0/2589298565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a80b07f0 0x7f54a80ce420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f54a8071b80 tx=0x7f54a002e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3baf6bad84cfa92c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.034+0000 7f54a77fe640 1 -- 172.21.15.113:0/2589298565 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a002ea00 con 0x7f54a80b07f0 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.034+0000 7f54a77fe640 1 -- 172.21.15.113:0/2589298565 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a002eb60 con 0x7f54a80b07f0 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.034+0000 7f54a77fe640 1 -- 172.21.15.113:0/2589298565 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0009600 con 0x7f54a80b07f0 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 -- 172.21.15.113:0/2589298565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a80b07f0 msgr2=0x7f54a80ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 --2- 172.21.15.113:0/2589298565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a80b07f0 0x7f54a80ce420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f54a8071b80 tx=0x7f54a002e060 comp rx=0 tx=0).stop 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 -- 172.21.15.113:0/2589298565 shutdown_connections 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 --2- 172.21.15.113:0/2589298565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a80b07f0 0x7f54a80ce420 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 --2- 172.21.15.113:0/2589298565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80aef40 0x7f54a80b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 --2- 172.21.15.113:0/2589298565 >> v2:172.21.15.151:3300/0 conn(0x7f54a815a190 0x7f54a80aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 -- 172.21.15.113:0/2589298565 >> 172.21.15.113:0/2589298565 conn(0x7f54a8066160 msgr2=0x7f54a80cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:23.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 -- 172.21.15.113:0/2589298565 shutdown_connections 2023-12-19T13:49:23.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.035+0000 7f54ae700640 1 -- 172.21.15.113:0/2589298565 wait complete. 2023-12-19T13:49:23.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.037+0000 7f54ae700640 1 Processor -- start 2023-12-19T13:49:23.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.037+0000 7f54ae700640 1 -- start start 2023-12-19T13:49:23.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54ae700640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80b07f0 0x7f54a814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:23.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54ae700640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a815a190 0x7f54a815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:23.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54ae700640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a81e3a20 0x7f54a80cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:23.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54ae700640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815bbe0 con 0x7f54a81e3a20 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54ae700640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815bdf0 con 0x7f54a815a190 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54ae700640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815c0d0 con 0x7f54a80b07f0 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54acc9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a81e3a20 0x7f54a80cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54acc9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a81e3a20 0x7f54a80cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34308/0 (socket says 172.21.15.113:34308) 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.038+0000 7f54acc9d640 1 -- 172.21.15.113:0/2575146898 learned_addr learned my addr 172.21.15.113:0/2575146898 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54a7fff640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80b07f0 0x7f54a814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f549f7fe640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a815a190 0x7f54a815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54acc9d640 1 -- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80b07f0 msgr2=0x7f54a814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54acc9d640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80b07f0 0x7f54a814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54acc9d640 1 -- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a815a190 msgr2=0x7f54a815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54acc9d640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a815a190 0x7f54a815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54acc9d640 1 -- 172.21.15.113:0/2575146898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a000bd40 con 0x7f54a81e3a20 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54a7fff640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80b07f0 0x7f54a814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:23.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54acc9d640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a81e3a20 0x7f54a80cc990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f54a0038040 tx=0x7f54a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:23.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54a57fa640 1 -- 172.21.15.113:0/2575146898 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a002ea00 con 0x7f54a81e3a20 2023-12-19T13:49:23.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54a57fa640 1 -- 172.21.15.113:0/2575146898 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0036820 con 0x7f54a81e3a20 2023-12-19T13:49:23.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54a57fa640 1 -- 172.21.15.113:0/2575146898 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0036bd0 con 0x7f54a81e3a20 2023-12-19T13:49:23.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.039+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a815c3b0 con 0x7f54a81e3a20 2023-12-19T13:49:23.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.040+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a815c970 con 0x7f54a81e3a20 2023-12-19T13:49:23.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.040+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a8061910 con 0x7f54a81e3a20 2023-12-19T13:49:23.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.041+0000 7f54a57fa640 1 -- 172.21.15.113:0/2575146898 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f54a0036d30 con 0x7f54a81e3a20 2023-12-19T13:49:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.042+0000 7f54a57fa640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f548806a430 0x7f548806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.042+0000 7f54a57fa640 1 -- 172.21.15.113:0/2575146898 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f54a00abd00 con 0x7f54a81e3a20 2023-12-19T13:49:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.043+0000 7f54a7fff640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f548806a430 0x7f548806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.043+0000 7f54a7fff640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f548806a430 0x7f548806c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:23.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.047+0000 7f54a57fa640 1 -- 172.21.15.113:0/2575146898 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f54a0077210 con 0x7f54a81e3a20 2023-12-19T13:49:23.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.282+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f54a815c210 con 0x7f54a81e3a20 2023-12-19T13:49:23.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.809+0000 7f54a57fa640 1 -- 172.21.15.113:0/2575146898 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f54a815c210 con 0x7f54a81e3a20 2023-12-19T13:49:23.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f548806a430 msgr2=0x7f548806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:23.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f548806a430 0x7f548806c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498008040 comp rx=0 tx=0).stop 2023-12-19T13:49:23.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a81e3a20 msgr2=0x7f54a80cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:23.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a81e3a20 0x7f54a80cc990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f54a0038040 tx=0x7f54a0004a40 comp rx=0 tx=0).stop 2023-12-19T13:49:23.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 shutdown_connections 2023-12-19T13:49:23.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f548806a430 0x7f548806c8f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a81e3a20 0x7f54a80cc990 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a815a190 0x7f54a815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 --2- 172.21.15.113:0/2575146898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a80b07f0 0x7f54a814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:23.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.812+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 >> 172.21.15.113:0/2575146898 conn(0x7f54a8066160 msgr2=0x7f54a80c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:23.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.813+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 shutdown_connections 2023-12-19T13:49:23.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:23.813+0000 7f54ae700640 1 -- 172.21.15.113:0/2575146898 wait complete. 2023-12-19T13:49:23.833 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:49:24.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.038+0000 7f342e6b2640 1 Processor -- start 2023-12-19T13:49:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.038+0000 7f342e6b2640 1 -- start start 2023-12-19T13:49:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f342e6b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 0x7f3428143570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f342e6b2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3428160fd0 0x7f3428161430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f342e6b2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3428143ab0 con 0x7f34280b1880 2023-12-19T13:49:24.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f342e6b2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3428143150 con 0x7f3428160fd0 2023-12-19T13:49:24.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f342e6b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3428142b60 con 0x7f34281402b0 2023-12-19T13:49:24.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f342cc4f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f34280b1880 0x7f3428070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44124/0 (socket says 172.21.15.113:44124) 2023-12-19T13:49:24.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f342cc4f640 1 -- 172.21.15.113:0/2322828446 learned_addr learned my addr 172.21.15.113:0/2322828446 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f3427fff640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 0x7f3428143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.040+0000 7f34277fe640 1 --2- 172.21.15.113:0/2322828446 >> v2:172.21.15.151:3300/0 conn(0x7f3428160fd0 0x7f3428161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484767058 0 0) 0x7f3418001110 con 0x7f34280b1880 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3414003520 con 0x7f34280b1880 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227268908 0 0) 0x7f3414003520 con 0x7f34280b1880 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 msgr2=0x7f3428143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 0x7f3428143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 >> v2:172.21.15.151:3300/0 conn(0x7f3428160fd0 msgr2=0x7f3428161430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 --2- 172.21.15.113:0/2322828446 >> v2:172.21.15.151:3300/0 conn(0x7f3428160fd0 0x7f3428161430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3428161a20 con 0x7f34280b1880 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3418001800 con 0x7f34280b1880 2023-12-19T13:49:24.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 >> v1:172.21.15.113:6789/0 conn(0x7f34280b1880 legacy=0x7f3428070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 0x7f34140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3414004010 0x7f34140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f3414005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3428143150 con 0x7f3414004d00 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3428142b60 con 0x7f3414004010 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341400bbc0 con 0x7f34281402b0 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.041+0000 7f342cc4f640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f3414005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.042+0000 7f3427fff640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 0x7f34140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.042+0000 7f34277fe640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3414004010 0x7f34140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.042+0000 7f342cc4f640 1 -- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 msgr2=0x7f34140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.042+0000 7f342cc4f640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34281402b0 0x7f34140039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.042+0000 7f342cc4f640 1 -- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3414004010 msgr2=0x7f34140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.042+0000 7f342cc4f640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3414004010 0x7f34140047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.042+0000 7f342cc4f640 1 -- 172.21.15.113:0/2322828446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414003520 con 0x7f3414004d00 2023-12-19T13:49:24.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.043+0000 7f342cc4f640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f3414005180 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f341800c210 tx=0x7f34140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c8776c4312d609 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:24.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.043+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341802cae0 con 0x7f3414004d00 2023-12-19T13:49:24.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.043+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341802cc60 con 0x7f3414004d00 2023-12-19T13:49:24.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.043+0000 7f3426ffd640 1 -- 172.21.15.113:0/2322828446 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418005b10 con 0x7f3414004d00 2023-12-19T13:49:24.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.043+0000 7f342e6b2640 1 -- 172.21.15.113:0/2322828446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 msgr2=0x7f3414005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:24.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.044+0000 7f342e6b2640 1 --2- 172.21.15.113:0/2322828446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f3414005180 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f341800c210 tx=0x7f34140057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.044+0000 7f342cc4f640 1 -- 172.21.15.113:0/2322828446 reap_dead start 2023-12-19T13:49:24.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.044+0000 7f342e6b2640 1 -- 172.21.15.113:0/2322828446 shutdown_connections 2023-12-19T13:49:24.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.044+0000 7f342e6b2640 1 -- 172.21.15.113:0/2322828446 >> 172.21.15.113:0/2322828446 conn(0x7f34280cf230 msgr2=0x7f34280cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:24.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.044+0000 7f342e6b2640 1 -- 172.21.15.113:0/2322828446 shutdown_connections 2023-12-19T13:49:24.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.044+0000 7f342e6b2640 1 -- 172.21.15.113:0/2322828446 wait complete. 2023-12-19T13:49:24.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.045+0000 7f342e6b2640 1 Processor -- start 2023-12-19T13:49:24.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.046+0000 7f342e6b2640 1 -- start start 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f342e6b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f342815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f342e6b2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f342806c210 0x7f342806c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f342e6b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f342812c8a0 0x7f342812cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f342e6b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342806cbd0 con 0x7f3414004d00 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f342e6b2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342812b560 con 0x7f342806c210 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f342e6b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342812b800 con 0x7f342812c8a0 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f342815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f342815da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34326/0 (socket says 172.21.15.113:34326) 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 -- 172.21.15.113:0/1739432573 learned_addr learned my addr 172.21.15.113:0/1739432573 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 -- 172.21.15.113:0/1739432573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f342812c8a0 msgr2=0x7f342812cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f342812c8a0 0x7f342812cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 -- 172.21.15.113:0/1739432573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f342806c210 msgr2=0x7f342806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f342806c210 0x7f342806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 -- 172.21.15.113:0/1739432573 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342812bae0 con 0x7f3414004d00 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.047+0000 7f3427fff640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f342815da50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3420007e60 tx=0x7f342000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.048+0000 7f3424ff9640 1 -- 172.21.15.113:0/1739432573 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200145f0 con 0x7f3414004d00 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.048+0000 7f3424ff9640 1 -- 172.21.15.113:0/1739432573 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420014750 con 0x7f3414004d00 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.048+0000 7f3424ff9640 1 -- 172.21.15.113:0/1739432573 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420014ae0 con 0x7f3414004d00 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.048+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342812bdc0 con 0x7f3414004d00 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.048+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342812c380 con 0x7f3414004d00 2023-12-19T13:49:24.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.049+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342812c540 con 0x7f3414004d00 2023-12-19T13:49:24.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.050+0000 7f3424ff9640 1 -- 172.21.15.113:0/1739432573 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3420014c40 con 0x7f3414004d00 2023-12-19T13:49:24.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.051+0000 7f3424ff9640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f340806a430 0x7f340806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:24.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.051+0000 7f3424ff9640 1 -- 172.21.15.113:0/1739432573 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f3420089810 con 0x7f3414004d00 2023-12-19T13:49:24.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.051+0000 7f34277fe640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f340806a430 0x7f340806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:24.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.052+0000 7f34277fe640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f340806a430 0x7f340806c8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3410006e80 tx=0x7f3410006e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:24.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.055+0000 7f3424ff9640 1 -- 172.21.15.113:0/1739432573 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3420054c70 con 0x7f3414004d00 2023-12-19T13:49:24.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.245+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3428061910 con 0x7f3414004d00 2023-12-19T13:49:24.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.819+0000 7f3424ff9640 1 -- 172.21.15.113:0/1739432573 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3420058290 con 0x7f3414004d00 2023-12-19T13:49:24.820 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f340806a430 msgr2=0x7f340806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f340806a430 0x7f340806c8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3410006e80 tx=0x7f3410006e10 comp rx=0 tx=0).stop 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 msgr2=0x7f342815da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f342815da50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3420007e60 tx=0x7f342000f520 comp rx=0 tx=0).stop 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 shutdown_connections 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f340806a430 0x7f340806c8f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f342812c8a0 0x7f342812cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f342806c210 0x7f342806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 --2- 172.21.15.113:0/1739432573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3414004d00 0x7f342815da50 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:24.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 >> 172.21.15.113:0/1739432573 conn(0x7f34280cf230 msgr2=0x7f342806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:24.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 shutdown_connections 2023-12-19T13:49:24.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:24.824+0000 7f342e6b2640 1 -- 172.21.15.113:0/1739432573 wait complete. 2023-12-19T13:49:24.846 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:49:25.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.061+0000 7f9b5630a640 1 Processor -- start 2023-12-19T13:49:25.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.061+0000 7f9b5630a640 1 -- start start 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b5630a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9b50161130 0x7f9b50143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b5630a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9b501406a0 0x7f9b500b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b5630a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b50143c50 con 0x7f9b501402c0 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b5630a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500b6760 con 0x7f9b50161130 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b5630a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b50141380 con 0x7f9b501406a0 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b4f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9b50161130 0x7f9b50143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b4f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9b50161130 0x7f9b50143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34336/0 (socket says 172.21.15.113:34336) 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b4f7fe640 1 -- 172.21.15.113:0/1951372666 learned_addr learned my addr 172.21.15.113:0/1951372666 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:25.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b548a7640 1 --2- 172.21.15.113:0/1951372666 >> v2:172.21.15.151:3300/0 conn(0x7f9b501406a0 0x7f9b500b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:25.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b4f7fe640 1 -- 172.21.15.113:0/1951372666 >> v2:172.21.15.151:3300/0 conn(0x7f9b501406a0 msgr2=0x7f9b500b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:25.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b4f7fe640 1 --2- 172.21.15.113:0/1951372666 >> v2:172.21.15.151:3300/0 conn(0x7f9b501406a0 0x7f9b500b7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b4f7fe640 1 -- 172.21.15.113:0/1951372666 >> v1:172.21.15.151:6789/0 conn(0x7f9b501402c0 legacy=0x7f9b50140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:25.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.063+0000 7f9b4f7fe640 1 -- 172.21.15.113:0/1951372666 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5015db40 con 0x7f9b50161130 2023-12-19T13:49:25.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.065+0000 7f9b4f7fe640 1 --2- 172.21.15.113:0/1951372666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b50161130 0x7f9b50143710 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9b500d3240 tx=0x7f9b4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8658f952dd4f9eb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:25.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.065+0000 7f9b4effd640 1 -- 172.21.15.113:0/1951372666 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44031870 con 0x7f9b50161130 2023-12-19T13:49:25.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.065+0000 7f9b4effd640 1 -- 172.21.15.113:0/1951372666 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b440319d0 con 0x7f9b50161130 2023-12-19T13:49:25.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.065+0000 7f9b4effd640 1 -- 172.21.15.113:0/1951372666 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44031d60 con 0x7f9b50161130 2023-12-19T13:49:25.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.065+0000 7f9b5630a640 1 -- 172.21.15.113:0/1951372666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b50161130 msgr2=0x7f9b50143710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:25.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.065+0000 7f9b5630a640 1 --2- 172.21.15.113:0/1951372666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b50161130 0x7f9b50143710 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9b500d3240 tx=0x7f9b4402b910 comp rx=0 tx=0).stop 2023-12-19T13:49:25.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.066+0000 7f9b5630a640 1 -- 172.21.15.113:0/1951372666 shutdown_connections 2023-12-19T13:49:25.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.066+0000 7f9b5630a640 1 --2- 172.21.15.113:0/1951372666 >> v2:172.21.15.151:3300/0 conn(0x7f9b501406a0 0x7f9b500b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.066+0000 7f9b5630a640 1 --2- 172.21.15.113:0/1951372666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b50161130 0x7f9b50143710 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.066+0000 7f9b5630a640 1 -- 172.21.15.113:0/1951372666 >> 172.21.15.113:0/1951372666 conn(0x7f9b50065dc0 msgr2=0x7f9b500b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:25.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.066+0000 7f9b5630a640 1 -- 172.21.15.113:0/1951372666 shutdown_connections 2023-12-19T13:49:25.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.066+0000 7f9b5630a640 1 -- 172.21.15.113:0/1951372666 wait complete. 2023-12-19T13:49:25.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.067+0000 7f9b5630a640 1 Processor -- start 2023-12-19T13:49:25.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.067+0000 7f9b5630a640 1 -- start start 2023-12-19T13:49:25.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.068+0000 7f9b5630a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b501402c0 0x7f9b501f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.068+0000 7f9b5630a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b501406a0 0x7f9b501f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.068+0000 7f9b5630a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b50161130 0x7f9b500b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.068+0000 7f9b5630a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501f74b0 con 0x7f9b501402c0 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.068+0000 7f9b5630a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5012d320 con 0x7f9b501406a0 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.068+0000 7f9b5630a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501f45c0 con 0x7f9b50161130 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b501402c0 0x7f9b501f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b501402c0 0x7f9b501f6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34350/0 (socket says 172.21.15.113:34350) 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 -- 172.21.15.113:0/986677981 learned_addr learned my addr 172.21.15.113:0/986677981 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4f7fe640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b501406a0 0x7f9b501f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b548a7640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b50161130 0x7f9b500b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 -- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b50161130 msgr2=0x7f9b500b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:25.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b50161130 0x7f9b500b7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 -- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b501406a0 msgr2=0x7f9b501f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:25.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b501406a0 0x7f9b501f4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 -- 172.21.15.113:0/986677981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440094d0 con 0x7f9b501402c0 2023-12-19T13:49:25.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.069+0000 7f9b4ffff640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b501402c0 0x7f9b501f6f70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c410 tx=0x7f9b4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.070+0000 7f9b4cff9640 1 -- 172.21.15.113:0/986677981 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b400035f0 con 0x7f9b501402c0 2023-12-19T13:49:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.070+0000 7f9b4cff9640 1 -- 172.21.15.113:0/986677981 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b40003750 con 0x7f9b501402c0 2023-12-19T13:49:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.070+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5012c710 con 0x7f9b501402c0 2023-12-19T13:49:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.070+0000 7f9b4cff9640 1 -- 172.21.15.113:0/986677981 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40003b40 con 0x7f9b501402c0 2023-12-19T13:49:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.070+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5012ccd0 con 0x7f9b501402c0 2023-12-19T13:49:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.071+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b50061910 con 0x7f9b501402c0 2023-12-19T13:49:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.072+0000 7f9b4cff9640 1 -- 172.21.15.113:0/986677981 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9b40003ca0 con 0x7f9b501402c0 2023-12-19T13:49:25.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.073+0000 7f9b4cff9640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b3c06a430 0x7f9b3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:25.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.073+0000 7f9b4cff9640 1 -- 172.21.15.113:0/986677981 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f9b40087ed0 con 0x7f9b501402c0 2023-12-19T13:49:25.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.073+0000 7f9b4f7fe640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b3c06a430 0x7f9b3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:25.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.074+0000 7f9b4f7fe640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b3c06a430 0x7f9b3c06c8f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9b44036000 tx=0x7f9b4403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.078+0000 7f9b4cff9640 1 -- 172.21.15.113:0/986677981 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9b40053580 con 0x7f9b501402c0 2023-12-19T13:49:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.269+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b500b3140 con 0x7f9b501402c0 2023-12-19T13:49:25.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.824+0000 7f9b4cff9640 1 -- 172.21.15.113:0/986677981 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9b400170d0 con 0x7f9b501402c0 2023-12-19T13:49:25.824 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:49:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.829+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b3c06a430 msgr2=0x7f9b3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.829+0000 7f9b5630a640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b3c06a430 0x7f9b3c06c8f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9b44036000 tx=0x7f9b4403c040 comp rx=0 tx=0).stop 2023-12-19T13:49:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.829+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b501402c0 msgr2=0x7f9b501f6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.829+0000 7f9b5630a640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b501402c0 0x7f9b501f6f70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c410 tx=0x7f9b4000c8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.830+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 shutdown_connections 2023-12-19T13:49:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.830+0000 7f9b5630a640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9b3c06a430 0x7f9b3c06c8f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.830+0000 7f9b5630a640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b50161130 0x7f9b500b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.830+0000 7f9b5630a640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b501406a0 0x7f9b501f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.830+0000 7f9b5630a640 1 --2- 172.21.15.113:0/986677981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b501402c0 0x7f9b501f6f70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.830+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 >> 172.21.15.113:0/986677981 conn(0x7f9b50065dc0 msgr2=0x7f9b50160650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.831+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 shutdown_connections 2023-12-19T13:49:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:25.831+0000 7f9b5630a640 1 -- 172.21.15.113:0/986677981 wait complete. 2023-12-19T13:49:25.851 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:49:26.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.058+0000 7fd8f36c7640 1 Processor -- start 2023-12-19T13:49:26.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.058+0000 7fd8f36c7640 1 -- start start 2023-12-19T13:49:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.060+0000 7fd8f36c7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd8ec0c99f0 0x7fd8ec15c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.060+0000 7fd8f36c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 0x7fd8ec0ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.060+0000 7fd8f36c7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec0c9e50 con 0x7fd8ec0adf00 2023-12-19T13:49:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.060+0000 7fd8f36c7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ec15bd00 con 0x7fd8ec0c99f0 2023-12-19T13:49:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.060+0000 7fd8f36c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0b1dd0 con 0x7fd8ec15c660 2023-12-19T13:49:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.060+0000 7fd8f1463640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd8ec0adf00 0x7fd8ec0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44128/0 (socket says 172.21.15.113:44128) 2023-12-19T13:49:26.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.060+0000 7fd8f1463640 1 -- 172.21.15.113:0/1210904584 learned_addr learned my addr 172.21.15.113:0/1210904584 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8f0c62640 1 --2- 172.21.15.113:0/1210904584 >> v2:172.21.15.151:3300/0 conn(0x7fd8ec0c99f0 0x7fd8ec15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140930202 0 0) 0x7fd8ec0c9e50 con 0x7fd8ec0adf00 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8f1c64640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 0x7fd8ec0ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d8003520 con 0x7fd8ec0adf00 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804722593 0 0) 0x7fd8d8003520 con 0x7fd8ec0adf00 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 msgr2=0x7fd8ec0ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 0x7fd8ec0ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 >> v2:172.21.15.151:3300/0 conn(0x7fd8ec0c99f0 msgr2=0x7fd8ec15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 --2- 172.21.15.113:0/1210904584 >> v2:172.21.15.151:3300/0 conn(0x7fd8ec0c99f0 0x7fd8ec15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec0b20b0 con 0x7fd8ec0adf00 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fd8e8001670 con 0x7fd8ec0adf00 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 >> v1:172.21.15.113:6789/0 conn(0x7fd8ec0adf00 legacy=0x7fd8ec0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 0x7fd8d80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.061+0000 7fd8e3fff640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d8003fb0 0x7fd8d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8e3fff640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec15bd00 con 0x7fd8d8004d00 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0b1dd0 con 0x7fd8d8003fb0 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d800bab0 con 0x7fd8ec15c660 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1c64640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1463640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 0x7fd8d80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f0c62640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d8003fb0 0x7fd8d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1c64640 1 -- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 msgr2=0x7fd8d80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1c64640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 0x7fd8d80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1c64640 1 -- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d8003fb0 msgr2=0x7fd8d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1c64640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d8003fb0 0x7fd8d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1c64640 1 -- 172.21.15.113:0/1210904584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8003520 con 0x7fd8d8004d00 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.062+0000 7fd8f1463640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec15c660 0x7fd8d80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.063+0000 7fd8f1c64640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007360 tx=0x7fd8d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67d755b73558dec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:26.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e402ccd0 con 0x7fd8d8004d00 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e402ce30 con 0x7fd8d8004d00 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8e3fff640 1 -- 172.21.15.113:0/1210904584 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4034660 con 0x7fd8d8004d00 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8f36c7640 1 -- 172.21.15.113:0/1210904584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 msgr2=0x7fd8d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8f36c7640 1 --2- 172.21.15.113:0/1210904584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007360 tx=0x7fd8d80057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8f1c64640 1 -- 172.21.15.113:0/1210904584 reap_dead start 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8f36c7640 1 -- 172.21.15.113:0/1210904584 shutdown_connections 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8f36c7640 1 -- 172.21.15.113:0/1210904584 >> 172.21.15.113:0/1210904584 conn(0x7fd8ec066160 msgr2=0x7fd8ec0cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8f36c7640 1 -- 172.21.15.113:0/1210904584 shutdown_connections 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.064+0000 7fd8f36c7640 1 -- 172.21.15.113:0/1210904584 wait complete. 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.066+0000 7fd8f36c7640 1 Processor -- start 2023-12-19T13:49:26.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.066+0000 7fd8f36c7640 1 -- start start 2023-12-19T13:49:26.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.067+0000 7fd8f36c7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8ec148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.067+0000 7fd8f36c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8ec06d780 0x7fd8ec15aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.067+0000 7fd8f36c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec06dc00 0x7fd8ec15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.067+0000 7fd8f36c7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0ceb30 con 0x7fd8d8004d00 2023-12-19T13:49:26.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.067+0000 7fd8f36c7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec06d2f0 con 0x7fd8ec06d780 2023-12-19T13:49:26.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.067+0000 7fd8f36c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec06ca60 con 0x7fd8ec06dc00 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8ec148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8ec148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34372/0 (socket says 172.21.15.113:34372) 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 -- 172.21.15.113:0/3404099503 learned_addr learned my addr 172.21.15.113:0/3404099503 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f0c62640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8ec06d780 0x7fd8ec15aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1c64640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec06dc00 0x7fd8ec15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 -- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec06dc00 msgr2=0x7fd8ec15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec06dc00 0x7fd8ec15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 -- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8ec06d780 msgr2=0x7fd8ec15aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8ec06d780 0x7fd8ec15aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 -- 172.21.15.113:0/3404099503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec06cce0 con 0x7fd8d8004d00 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1c64640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec06dc00 0x7fd8ec15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.068+0000 7fd8f1463640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8ec148b30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800d850 tx=0x7fd8e800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.069+0000 7fd8e1ffb640 1 -- 172.21.15.113:0/3404099503 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80074e0 con 0x7fd8d8004d00 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.069+0000 7fd8e1ffb640 1 -- 172.21.15.113:0/3404099503 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8007640 con 0x7fd8d8004d00 2023-12-19T13:49:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.069+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ec0ce850 con 0x7fd8d8004d00 2023-12-19T13:49:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.069+0000 7fd8e1ffb640 1 -- 172.21.15.113:0/3404099503 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80049e0 con 0x7fd8d8004d00 2023-12-19T13:49:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.069+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ec149070 con 0x7fd8d8004d00 2023-12-19T13:49:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.070+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec061910 con 0x7fd8d8004d00 2023-12-19T13:49:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.071+0000 7fd8e1ffb640 1 -- 172.21.15.113:0/3404099503 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8e8004b40 con 0x7fd8d8004d00 2023-12-19T13:49:26.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.072+0000 7fd8e1ffb640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d006a430 0x7fd8d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.072+0000 7fd8e1ffb640 1 -- 172.21.15.113:0/3404099503 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8e8088400 con 0x7fd8d8004d00 2023-12-19T13:49:26.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.072+0000 7fd8f0c62640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d006a430 0x7fd8d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.073+0000 7fd8f0c62640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d006a430 0x7fd8d006c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0c8da0 tx=0x7fd8dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:26.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.076+0000 7fd8e1ffb640 1 -- 172.21.15.113:0/3404099503 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd8e8053c50 con 0x7fd8d8004d00 2023-12-19T13:49:26.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.264+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd8ec0ae3d0 con 0x7fd8d8004d00 2023-12-19T13:49:26.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.272+0000 7fd8e1ffb640 1 -- 172.21.15.113:0/3404099503 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd8e8057270 con 0x7fd8d8004d00 2023-12-19T13:49:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d006a430 msgr2=0x7fd8d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d006a430 0x7fd8d006c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0c8da0 tx=0x7fd8dc008040 comp rx=0 tx=0).stop 2023-12-19T13:49:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 msgr2=0x7fd8ec148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8ec148b30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800d850 tx=0x7fd8e800dd10 comp rx=0 tx=0).stop 2023-12-19T13:49:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 shutdown_connections 2023-12-19T13:49:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd8d006a430 0x7fd8d006c8f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8ec06dc00 0x7fd8ec15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8ec06d780 0x7fd8ec15aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 --2- 172.21.15.113:0/3404099503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8d8004d00 0x7fd8ec148b30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 >> 172.21.15.113:0/3404099503 conn(0x7fd8ec066160 msgr2=0x7fd8ec0cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:26.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 shutdown_connections 2023-12-19T13:49:26.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.275+0000 7fd8f36c7640 1 -- 172.21.15.113:0/3404099503 wait complete. 2023-12-19T13:49:26.293 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-19T13:49:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.504+0000 7ffa58ffd640 1 Processor -- start 2023-12-19T13:49:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.504+0000 7ffa58ffd640 1 -- start start 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.505+0000 7ffa58ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffa541449e0 0x7ffa540af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.505+0000 7ffa58ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa540b0b50 0x7ffa5406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa58ffd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa540afb10 con 0x7ffa5406b590 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa58ffd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5406bb30 con 0x7ffa540b0b50 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa58ffd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa540b0070 con 0x7ffa541449e0 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa4bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa540b0b50 0x7ffa5406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa4bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa540b0b50 0x7ffa5406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34382/0 (socket says 172.21.15.113:34382) 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa4bfff640 1 -- 172.21.15.113:0/1871850753 learned_addr learned my addr 172.21.15.113:0/1871850753 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa4bfff640 1 -- 172.21.15.113:0/1871850753 >> v2:172.21.15.151:3300/0 conn(0x7ffa541449e0 msgr2=0x7ffa540af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa5259c640 1 --2- 172.21.15.113:0/1871850753 >> v2:172.21.15.151:3300/0 conn(0x7ffa541449e0 0x7ffa540af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa4bfff640 1 --2- 172.21.15.113:0/1871850753 >> v2:172.21.15.151:3300/0 conn(0x7ffa541449e0 0x7ffa540af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa4bfff640 1 -- 172.21.15.113:0/1871850753 >> v1:172.21.15.151:6789/0 conn(0x7ffa5406b590 legacy=0x7ffa5415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.506+0000 7ffa4bfff640 1 -- 172.21.15.113:0/1871850753 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540b0350 con 0x7ffa540b0b50 2023-12-19T13:49:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.507+0000 7ffa4bfff640 1 --2- 172.21.15.113:0/1871850753 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa540b0b50 0x7ffa5406bfa0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ffa54071cd0 tx=0x7ffa3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8fa8e418f69036 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.508+0000 7ffa51d9b640 1 -- 172.21.15.113:0/1871850753 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c031870 con 0x7ffa540b0b50 2023-12-19T13:49:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.508+0000 7ffa51d9b640 1 -- 172.21.15.113:0/1871850753 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c0319d0 con 0x7ffa540b0b50 2023-12-19T13:49:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.508+0000 7ffa51d9b640 1 -- 172.21.15.113:0/1871850753 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c031d60 con 0x7ffa540b0b50 2023-12-19T13:49:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.508+0000 7ffa58ffd640 1 -- 172.21.15.113:0/1871850753 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa540b0b50 msgr2=0x7ffa5406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.508+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/1871850753 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa540b0b50 0x7ffa5406bfa0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ffa54071cd0 tx=0x7ffa3c02b910 comp rx=0 tx=0).stop 2023-12-19T13:49:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.509+0000 7ffa58ffd640 1 -- 172.21.15.113:0/1871850753 shutdown_connections 2023-12-19T13:49:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.509+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/1871850753 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa540b0b50 0x7ffa5406bfa0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.509+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/1871850753 >> v2:172.21.15.151:3300/0 conn(0x7ffa541449e0 0x7ffa540af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.509+0000 7ffa58ffd640 1 -- 172.21.15.113:0/1871850753 >> 172.21.15.113:0/1871850753 conn(0x7ffa540cbb70 msgr2=0x7ffa540cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.509+0000 7ffa58ffd640 1 -- 172.21.15.113:0/1871850753 shutdown_connections 2023-12-19T13:49:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.509+0000 7ffa58ffd640 1 -- 172.21.15.113:0/1871850753 wait complete. 2023-12-19T13:49:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.510+0000 7ffa58ffd640 1 Processor -- start 2023-12-19T13:49:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.510+0000 7ffa58ffd640 1 -- start start 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.511+0000 7ffa58ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5406b590 0x7ffa5415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.511+0000 7ffa58ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa540b0b50 0x7ffa540cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.511+0000 7ffa58ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa541449e0 0x7ffa5415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.511+0000 7ffa58ffd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54140840 con 0x7ffa541449e0 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.511+0000 7ffa58ffd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5413ff80 con 0x7ffa5406b590 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.511+0000 7ffa58ffd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5415ca40 con 0x7ffa540b0b50 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa541449e0 0x7ffa5415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa541449e0 0x7ffa5415a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34388/0 (socket says 172.21.15.113:34388) 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 -- 172.21.15.113:0/3839590444 learned_addr learned my addr 172.21.15.113:0/3839590444 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa5259c640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5406b590 0x7ffa5415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa4bfff640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa540b0b50 0x7ffa540cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 -- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa540b0b50 msgr2=0x7ffa540cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa540b0b50 0x7ffa540cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 -- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5406b590 msgr2=0x7ffa5415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5406b590 0x7ffa5415c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa52d9d640 1 -- 172.21.15.113:0/3839590444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0094d0 con 0x7ffa541449e0 2023-12-19T13:49:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.512+0000 7ffa4bfff640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa540b0b50 0x7ffa540cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.513+0000 7ffa52d9d640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa541449e0 0x7ffa5415a5d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c7b0 tx=0x7ffa4c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.513+0000 7ffa4affd640 1 -- 172.21.15.113:0/3839590444 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c003d80 con 0x7ffa541449e0 2023-12-19T13:49:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.513+0000 7ffa4affd640 1 -- 172.21.15.113:0/3839590444 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c005070 con 0x7ffa541449e0 2023-12-19T13:49:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.513+0000 7ffa4affd640 1 -- 172.21.15.113:0/3839590444 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c005420 con 0x7ffa541449e0 2023-12-19T13:49:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.513+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa541401f0 con 0x7ffa541449e0 2023-12-19T13:49:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.513+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa540ae140 con 0x7ffa541449e0 2023-12-19T13:49:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.514+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa541409f0 con 0x7ffa541449e0 2023-12-19T13:49:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.515+0000 7ffa4affd640 1 -- 172.21.15.113:0/3839590444 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa4c005580 con 0x7ffa541449e0 2023-12-19T13:49:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.516+0000 7ffa4affd640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa3406a430 0x7ffa3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.516+0000 7ffa4affd640 1 -- 172.21.15.113:0/3839590444 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffa4c087b20 con 0x7ffa541449e0 2023-12-19T13:49:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.516+0000 7ffa5259c640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa3406a430 0x7ffa3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.517+0000 7ffa5259c640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa3406a430 0x7ffa3406c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa44006fd0 tx=0x7ffa44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.520+0000 7ffa4affd640 1 -- 172.21.15.113:0/3839590444 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffa541409f0 con 0x7ffa541449e0 2023-12-19T13:49:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.779+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7ffa541409f0 con 0x7ffa541449e0 2023-12-19T13:49:26.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.838+0000 7ffa4affd640 1 -- 172.21.15.113:0/3839590444 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v174) v1 ==== 142+0+0 (secure 0 0 0) 0x7ffa541409f0 con 0x7ffa541449e0 2023-12-19T13:49:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.840+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa3406a430 msgr2=0x7ffa3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.840+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa3406a430 0x7ffa3406c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa44006fd0 tx=0x7ffa44008040 comp rx=0 tx=0).stop 2023-12-19T13:49:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.840+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa541449e0 msgr2=0x7ffa5415a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.840+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa541449e0 0x7ffa5415a5d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c7b0 tx=0x7ffa4c00cc70 comp rx=0 tx=0).stop 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 shutdown_connections 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa3406a430 0x7ffa3406c8f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa541449e0 0x7ffa5415a5d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa540b0b50 0x7ffa540cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 --2- 172.21.15.113:0/3839590444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5406b590 0x7ffa5415c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 >> 172.21.15.113:0/3839590444 conn(0x7ffa540cbb70 msgr2=0x7ffa5413d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 shutdown_connections 2023-12-19T13:49:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:26.841+0000 7ffa58ffd640 1 -- 172.21.15.113:0/3839590444 wait complete. 2023-12-19T13:49:26.858 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-19T13:49:26.858 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T13:49:26.859 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:27.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.062+0000 7feb43fff640 1 Processor -- start 2023-12-19T13:49:27.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.062+0000 7feb43fff640 1 -- start start 2023-12-19T13:49:27.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.063+0000 7feb43fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7feb4415b1e0 0x7feb4415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb43fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4415b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb43fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4406b520 con 0x7feb44159f80 2023-12-19T13:49:27.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb43fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440b2b20 con 0x7feb4415b1e0 2023-12-19T13:49:27.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb43fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb440b2fb0 con 0x7feb4415a8a0 2023-12-19T13:49:27.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb427fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7feb4415b1e0 0x7feb4415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb427fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7feb4415b1e0 0x7feb4415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34392/0 (socket says 172.21.15.113:34392) 2023-12-19T13:49:27.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb427fc640 1 -- 172.21.15.113:0/1721111177 learned_addr learned my addr 172.21.15.113:0/1721111177 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:27.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb437fe640 1 --2- 172.21.15.113:0/1721111177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb427fc640 1 -- 172.21.15.113:0/1721111177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 msgr2=0x7feb4415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb427fc640 1 --2- 172.21.15.113:0/1721111177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4415b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb427fc640 1 -- 172.21.15.113:0/1721111177 >> v1:172.21.15.151:6789/0 conn(0x7feb44159f80 legacy=0x7feb4406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.064+0000 7feb427fc640 1 -- 172.21.15.113:0/1721111177 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440b1f10 con 0x7feb4415b1e0 2023-12-19T13:49:27.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.065+0000 7feb427fc640 1 --2- 172.21.15.113:0/1721111177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb4415b1e0 0x7feb4415a360 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feb38009870 tx=0x7feb3802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff74ac368bf621b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb41ffb640 1 -- 172.21.15.113:0/1721111177 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38030840 con 0x7feb4415b1e0 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb41ffb640 1 -- 172.21.15.113:0/1721111177 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb380309a0 con 0x7feb4415b1e0 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb41ffb640 1 -- 172.21.15.113:0/1721111177 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38030d30 con 0x7feb4415b1e0 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb43fff640 1 -- 172.21.15.113:0/1721111177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb4415b1e0 msgr2=0x7feb4415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb43fff640 1 --2- 172.21.15.113:0/1721111177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb4415b1e0 0x7feb4415a360 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feb38009870 tx=0x7feb3802b980 comp rx=0 tx=0).stop 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb43fff640 1 -- 172.21.15.113:0/1721111177 shutdown_connections 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb43fff640 1 --2- 172.21.15.113:0/1721111177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb43fff640 1 --2- 172.21.15.113:0/1721111177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb4415b1e0 0x7feb4415a360 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.066+0000 7feb43fff640 1 -- 172.21.15.113:0/1721111177 >> 172.21.15.113:0/1721111177 conn(0x7feb440b0100 msgr2=0x7feb440b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.067+0000 7feb43fff640 1 -- 172.21.15.113:0/1721111177 shutdown_connections 2023-12-19T13:49:27.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.067+0000 7feb43fff640 1 -- 172.21.15.113:0/1721111177 wait complete. 2023-12-19T13:49:27.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.068+0000 7feb43fff640 1 Processor -- start 2023-12-19T13:49:27.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.068+0000 7feb43fff640 1 -- start start 2023-12-19T13:49:27.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.069+0000 7feb43fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb44159f80 0x7feb44156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.069+0000 7feb43fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.069+0000 7feb43fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4415b1e0 0x7feb44154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.069+0000 7feb43fff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441572b0 con 0x7feb44159f80 2023-12-19T13:49:27.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.069+0000 7feb43fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44157590 con 0x7feb4415b1e0 2023-12-19T13:49:27.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.069+0000 7feb43fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb44157870 con 0x7feb4415a8a0 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb44159f80 0x7feb44156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb44159f80 0x7feb44156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34402/0 (socket says 172.21.15.113:34402) 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 -- 172.21.15.113:0/2316615723 learned_addr learned my addr 172.21.15.113:0/2316615723 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 -- 172.21.15.113:0/2316615723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 msgr2=0x7feb4414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb427fc640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4414cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 -- 172.21.15.113:0/2316615723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4415b1e0 msgr2=0x7feb44154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4415b1e0 0x7feb44154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 -- 172.21.15.113:0/2316615723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb380094d0 con 0x7feb44159f80 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb42ffd640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb44159f80 0x7feb44156c10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7feb3400c410 tx=0x7feb3400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb2bfff640 1 -- 172.21.15.113:0/2316615723 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340035f0 con 0x7feb44159f80 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.070+0000 7feb2bfff640 1 -- 172.21.15.113:0/2316615723 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb34003750 con 0x7feb44159f80 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.071+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44157b50 con 0x7feb44159f80 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.071+0000 7feb2bfff640 1 -- 172.21.15.113:0/2316615723 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34003b40 con 0x7feb44159f80 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.071+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4414d1b0 con 0x7feb44159f80 2023-12-19T13:49:27.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.072+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb44157d40 con 0x7feb44159f80 2023-12-19T13:49:27.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.072+0000 7feb2bfff640 1 -- 172.21.15.113:0/2316615723 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb34003ca0 con 0x7feb44159f80 2023-12-19T13:49:27.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.073+0000 7feb2bfff640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb3006a430 0x7feb3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.073+0000 7feb2bfff640 1 -- 172.21.15.113:0/2316615723 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb34087d30 con 0x7feb44159f80 2023-12-19T13:49:27.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.074+0000 7feb427fc640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb3006a430 0x7feb3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.074+0000 7feb427fc640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb3006a430 0x7feb3006c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb38036000 tx=0x7feb3803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.077+0000 7feb2bfff640 1 -- 172.21.15.113:0/2316615723 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feb34053580 con 0x7feb44159f80 2023-12-19T13:49:27.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.267+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb44061910 con 0x7feb44159f80 2023-12-19T13:49:27.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.268+0000 7feb2bfff640 1 -- 172.21.15.113:0/2316615723 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12568 (secure 0 0 0) 0x7feb34017090 con 0x7feb44159f80 2023-12-19T13:49:27.268 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:27.268 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":64,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:25.814898+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:6837/1910749856":"2023-12-20T13:49:22.790651+0000","172.21.15.113:6836/1910749856":"2023-12-20T13:49:22.790651+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:27.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb3006a430 msgr2=0x7feb3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb3006a430 0x7feb3006c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb38036000 tx=0x7feb3803b040 comp rx=0 tx=0).stop 2023-12-19T13:49:27.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb44159f80 msgr2=0x7feb44156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb44159f80 0x7feb44156c10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7feb3400c410 tx=0x7feb3400c8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 shutdown_connections 2023-12-19T13:49:27.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb3006a430 0x7feb3006c8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4415b1e0 0x7feb44154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb4415a8a0 0x7feb4414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 --2- 172.21.15.113:0/2316615723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb44159f80 0x7feb44156c10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.271+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 >> 172.21.15.113:0/2316615723 conn(0x7feb440b0100 msgr2=0x7feb440b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:27.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.272+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 shutdown_connections 2023-12-19T13:49:27.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.272+0000 7feb43fff640 1 -- 172.21.15.113:0/2316615723 wait complete. 2023-12-19T13:49:27.290 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:49:27.290 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:49:27.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.503+0000 7f94ab2c7640 1 Processor -- start 2023-12-19T13:49:27.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.503+0000 7f94ab2c7640 1 -- start start 2023-12-19T13:49:27.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94ab2c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 0x7f94a40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94ab2c7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f94a40b6430 0x7f94a415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94ab2c7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a4161e70 con 0x7f94a4146ff0 2023-12-19T13:49:27.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94ab2c7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a4161080 con 0x7f94a40b6430 2023-12-19T13:49:27.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94ab2c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4161260 con 0x7f94a406fc40 2023-12-19T13:49:27.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94a9063640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f94a4146ff0 0x7f94a406f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44142/0 (socket says 172.21.15.113:44142) 2023-12-19T13:49:27.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94a9063640 1 -- 172.21.15.113:0/1892224518 learned_addr learned my addr 172.21.15.113:0/1892224518 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:27.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855777336 0 0) 0x7f94a4161e70 con 0x7f94a4146ff0 2023-12-19T13:49:27.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9490003520 con 0x7f94a4146ff0 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.505+0000 7f94a8862640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 0x7f94a40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f94a9864640 1 --2- 172.21.15.113:0/1892224518 >> v2:172.21.15.151:3300/0 conn(0x7f94a40b6430 0x7f94a415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535280098 0 0) 0x7f9490003520 con 0x7f94a4146ff0 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 msgr2=0x7f94a40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 0x7f94a40d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 >> v2:172.21.15.151:3300/0 conn(0x7f94a40b6430 msgr2=0x7f94a415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 --2- 172.21.15.113:0/1892224518 >> v2:172.21.15.151:3300/0 conn(0x7f94a40b6430 0x7f94a415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4161540 con 0x7f94a4146ff0 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f94a0001670 con 0x7f94a4146ff0 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f94a9864640 1 --2- 172.21.15.113:0/1892224518 >> v2:172.21.15.151:3300/0 conn(0x7f94a40b6430 0x7f94a415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 >> v1:172.21.15.113:6789/0 conn(0x7f94a4146ff0 legacy=0x7f94a406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94900039e0 0x7f9490003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 0x7f94900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9490004d50 0x7f94900051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4161080 con 0x7f94900039e0 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4161260 con 0x7f9490004d50 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949000bc60 con 0x7f94a406fc40 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.506+0000 7f94a9063640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94900039e0 0x7f9490003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a9864640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9490004d50 0x7f94900051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a9063640 1 -- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 msgr2=0x7f94900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a8862640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 0x7f94900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a9063640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94a406fc40 0x7f94900047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a9063640 1 -- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9490004d50 msgr2=0x7f94900051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a9063640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9490004d50 0x7f94900051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a9063640 1 -- 172.21.15.113:0/1892224518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490003520 con 0x7f94900039e0 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.507+0000 7f94a9864640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9490004d50 0x7f94900051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.508+0000 7f94a9063640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94900039e0 0x7f9490003e00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c110 tx=0x7f94900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393e8ad08d1d8fc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.508+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0005ad0 con 0x7f94900039e0 2023-12-19T13:49:27.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.508+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a0005c50 con 0x7f94900039e0 2023-12-19T13:49:27.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.508+0000 7f949bfff640 1 -- 172.21.15.113:0/1892224518 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a002c830 con 0x7f94900039e0 2023-12-19T13:49:27.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.509+0000 7f94ab2c7640 1 -- 172.21.15.113:0/1892224518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94900039e0 msgr2=0x7f9490003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.509+0000 7f94ab2c7640 1 --2- 172.21.15.113:0/1892224518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94900039e0 0x7f9490003e00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c110 tx=0x7f94900057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.509+0000 7f94a9864640 1 -- 172.21.15.113:0/1892224518 reap_dead start 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.509+0000 7f94ab2c7640 1 -- 172.21.15.113:0/1892224518 shutdown_connections 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.509+0000 7f94ab2c7640 1 -- 172.21.15.113:0/1892224518 >> 172.21.15.113:0/1892224518 conn(0x7f94a40d3520 msgr2=0x7f94a40d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.509+0000 7f94ab2c7640 1 -- 172.21.15.113:0/1892224518 shutdown_connections 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.509+0000 7f94ab2c7640 1 -- 172.21.15.113:0/1892224518 wait complete. 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.510+0000 7f94ab2c7640 1 Processor -- start 2023-12-19T13:49:27.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.511+0000 7f94ab2c7640 1 -- start start 2023-12-19T13:49:27.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.511+0000 7f94ab2c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94900039e0 0x7f94a40cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94ab2c7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94a415d3e0 0x7f94a40cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94ab2c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94a40c9f80 0x7f94a40d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94ab2c7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40cc670 con 0x7f94a415d3e0 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94ab2c7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40c8440 con 0x7f94a40c9f80 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94ab2c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40ca8b0 con 0x7f94900039e0 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94a415d3e0 0x7f94a40cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94a415d3e0 0x7f94a40cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34414/0 (socket says 172.21.15.113:34414) 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 -- 172.21.15.113:0/2694343842 learned_addr learned my addr 172.21.15.113:0/2694343842 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a9864640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94a40c9f80 0x7f94a40d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a9063640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94900039e0 0x7f94a40cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 -- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94900039e0 msgr2=0x7f94a40cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94900039e0 0x7f94a40cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 -- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94a40c9f80 msgr2=0x7f94a40d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94a40c9f80 0x7f94a40d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a8862640 1 -- 172.21.15.113:0/2694343842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40c86e0 con 0x7f94a415d3e0 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.512+0000 7f94a9864640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94a40c9f80 0x7f94a40d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.513+0000 7f94a8862640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94a415d3e0 0x7f94a40cdf60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f949400e5e0 tx=0x7f949400eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.513+0000 7f9499ffb640 1 -- 172.21.15.113:0/2694343842 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494013610 con 0x7f94a415d3e0 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.513+0000 7f9499ffb640 1 -- 172.21.15.113:0/2694343842 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494013770 con 0x7f94a415d3e0 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.513+0000 7f9499ffb640 1 -- 172.21.15.113:0/2694343842 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494013b00 con 0x7f94a415d3e0 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.513+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a40c89c0 con 0x7f94a415d3e0 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.513+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a40cab90 con 0x7f94a415d3e0 2023-12-19T13:49:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.514+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a4061910 con 0x7f94a415d3e0 2023-12-19T13:49:27.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.515+0000 7f9499ffb640 1 -- 172.21.15.113:0/2694343842 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9494013c60 con 0x7f94a415d3e0 2023-12-19T13:49:27.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.516+0000 7f9499ffb640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f948806a460 0x7f948806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.516+0000 7f9499ffb640 1 -- 172.21.15.113:0/2694343842 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9494088200 con 0x7f94a415d3e0 2023-12-19T13:49:27.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.516+0000 7f94a9063640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f948806a460 0x7f948806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.517+0000 7f94a9063640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f948806a460 0x7f948806c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94a0034000 tx=0x7f94a0007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.520+0000 7f9499ffb640 1 -- 172.21.15.113:0/2694343842 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9494053af0 con 0x7f94a415d3e0 2023-12-19T13:49:27.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.707+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94a40b6f50 con 0x7f94a415d3e0 2023-12-19T13:49:27.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.707+0000 7f9499ffb640 1 -- 172.21.15.113:0/2694343842 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9494009350 con 0x7f94a415d3e0 2023-12-19T13:49:27.707 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:49:27.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f948806a460 msgr2=0x7f948806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f948806a460 0x7f948806c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94a0034000 tx=0x7f94a0007000 comp rx=0 tx=0).stop 2023-12-19T13:49:27.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94a415d3e0 msgr2=0x7f94a40cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94a415d3e0 0x7f94a40cdf60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f949400e5e0 tx=0x7f949400eaa0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 shutdown_connections 2023-12-19T13:49:27.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f948806a460 0x7f948806c920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94a40c9f80 0x7f94a40d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94a415d3e0 0x7f94a40cdf60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 --2- 172.21.15.113:0/2694343842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94900039e0 0x7f94a40cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 >> 172.21.15.113:0/2694343842 conn(0x7f94a40d3520 msgr2=0x7f94a40d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:27.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 shutdown_connections 2023-12-19T13:49:27.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.710+0000 7f94ab2c7640 1 -- 172.21.15.113:0/2694343842 wait complete. 2023-12-19T13:49:27.727 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-19T13:49:27.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.924+0000 7f7f42988640 1 Processor -- start 2023-12-19T13:49:27.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.924+0000 7f7f42988640 1 -- start start 2023-12-19T13:49:27.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.925+0000 7f7f42988640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 0x7f7f3c0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.925+0000 7f7f42988640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c0ce9d0 con 0x7f7f3c0ce1e0 2023-12-19T13:49:27.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.926+0000 7f7f42988640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c0ce6f0 con 0x7f7f3c0d01b0 2023-12-19T13:49:27.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.926+0000 7f7f42988640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c15dcc0 con 0x7f7f3c15e7a0 2023-12-19T13:49:27.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.926+0000 7f7f40f25640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7f3c0ce1e0 0x7f7f3c15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36044/0 (socket says 172.21.15.113:36044) 2023-12-19T13:49:27.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.926+0000 7f7f40f25640 1 -- 172.21.15.113:0/3394068246 learned_addr learned my addr 172.21.15.113:0/3394068246 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.926+0000 7f7f3b7fe640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 0x7f7f3c0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.926+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310099495 0 0) 0x7f7f3c0ce9d0 con 0x7f7f3c0ce1e0 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.926+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f24003520 con 0x7f7f3c0ce1e0 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164278886 0 0) 0x7f7f24003520 con 0x7f7f3c0ce1e0 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 msgr2=0x7f7f3c0cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 0x7f7f3c0cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 >> v1:172.21.15.151:6789/0 conn(0x7f7f3c0d01b0 legacy=0x7f7f3c0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c15dfa0 con 0x7f7f3c0ce1e0 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f7f340019f0 con 0x7f7f3c0ce1e0 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 >> v1:172.21.15.113:6789/0 conn(0x7f7f3c0ce1e0 legacy=0x7f7f3c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 0x7f7f24003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f24004090 0x7f7f240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f24004d70 0x7f7f240051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c15dcc0 con 0x7f7f24004d70 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2400bbe0 con 0x7f7f24004090 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2400bda0 con 0x7f7f3c15e7a0 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f40f25640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f24004d70 0x7f7f240051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3bfff640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 0x7f7f24003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f3b7fe640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f24004090 0x7f7f240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f40f25640 1 -- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 msgr2=0x7f7f24003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f40f25640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 0x7f7f24003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f40f25640 1 -- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f24004090 msgr2=0x7f7f240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.927+0000 7f7f40f25640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f24004090 0x7f7f240047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.928+0000 7f7f40f25640 1 -- 172.21.15.113:0/3394068246 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24003520 con 0x7f7f24004d70 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.928+0000 7f7f3bfff640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c15e7a0 0x7f7f24003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.928+0000 7f7f40f25640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f24004d70 0x7f7f240051f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0d33f0 tx=0x7f7f240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e30027a6b3913a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34034630 con 0x7f7f24004d70 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3402f070 con 0x7f7f24004d70 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f3affd640 1 -- 172.21.15.113:0/3394068246 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34034a50 con 0x7f7f24004d70 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f42988640 1 -- 172.21.15.113:0/3394068246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f24004d70 msgr2=0x7f7f240051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f42988640 1 --2- 172.21.15.113:0/3394068246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f24004d70 0x7f7f240051f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0d33f0 tx=0x7f7f240057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f40f25640 1 -- 172.21.15.113:0/3394068246 reap_dead start 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f42988640 1 -- 172.21.15.113:0/3394068246 shutdown_connections 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f42988640 1 -- 172.21.15.113:0/3394068246 >> 172.21.15.113:0/3394068246 conn(0x7f7f3c0b27a0 msgr2=0x7f7f3c0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f42988640 1 -- 172.21.15.113:0/3394068246 shutdown_connections 2023-12-19T13:49:27.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.929+0000 7f7f42988640 1 -- 172.21.15.113:0/3394068246 wait complete. 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.931+0000 7f7f42988640 1 Processor -- start 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.931+0000 7f7f42988640 1 -- start start 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.932+0000 7f7f42988640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f3c150220 0x7f7f3c152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.932+0000 7f7f42988640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3c1f4530 0x7f7f3c1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.932+0000 7f7f42988640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c1f3e60 0x7f7f3c1f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.932+0000 7f7f42988640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c150600 con 0x7f7f3c150220 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.932+0000 7f7f42988640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c153db0 con 0x7f7f3c1f4530 2023-12-19T13:49:27.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.932+0000 7f7f42988640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c1f42e0 con 0x7f7f3c1f3e60 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.932+0000 7f7f3bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f3c150220 0x7f7f3c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f3c150220 0x7f7f3c152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40646/0 (socket says 172.21.15.113:40646) 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 -- 172.21.15.113:0/1746297929 learned_addr learned my addr 172.21.15.113:0/1746297929 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 -- 172.21.15.113:0/1746297929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c1f3e60 msgr2=0x7f7f3c1f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c1f3e60 0x7f7f3c1f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3b7fe640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3c1f4530 0x7f7f3c1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 -- 172.21.15.113:0/1746297929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3c1f4530 msgr2=0x7f7f3c1f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3c1f4530 0x7f7f3c1f3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 -- 172.21.15.113:0/1746297929 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c1526a0 con 0x7f7f3c150220 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f3bfff640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f3c150220 0x7f7f3c152160 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00d780 tx=0x7f7f2c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.933+0000 7f7f38ff9640 1 -- 172.21.15.113:0/1746297929 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c005270 con 0x7f7f3c150220 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.934+0000 7f7f38ff9640 1 -- 172.21.15.113:0/1746297929 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0053f0 con 0x7f7f3c150220 2023-12-19T13:49:27.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.934+0000 7f7f38ff9640 1 -- 172.21.15.113:0/1746297929 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00b8f0 con 0x7f7f3c150220 2023-12-19T13:49:27.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.934+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c1531a0 con 0x7f7f3c150220 2023-12-19T13:49:27.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.934+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c153760 con 0x7f7f3c150220 2023-12-19T13:49:27.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.935+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c061910 con 0x7f7f3c150220 2023-12-19T13:49:27.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.936+0000 7f7f38ff9640 1 -- 172.21.15.113:0/1746297929 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f2c00ba50 con 0x7f7f3c150220 2023-12-19T13:49:27.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.937+0000 7f7f38ff9640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f2806a460 0x7f7f2806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:27.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.937+0000 7f7f38ff9640 1 -- 172.21.15.113:0/1746297929 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7f2c0885f0 con 0x7f7f3c150220 2023-12-19T13:49:27.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.937+0000 7f7f3b7fe640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f2806a460 0x7f7f2806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:27.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.938+0000 7f7f3b7fe640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f2806a460 0x7f7f2806c920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0b5e80 tx=0x7f7f30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:27.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:27.941+0000 7f7f38ff9640 1 -- 172.21.15.113:0/1746297929 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f2c053e40 con 0x7f7f3c150220 2023-12-19T13:49:28.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.200+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f7f3c1507d0 con 0x7f7f3c150220 2023-12-19T13:49:28.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.842+0000 7f7f38ff9640 1 -- 172.21.15.113:0/1746297929 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v176) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7f2c019310 con 0x7f7f3c150220 2023-12-19T13:49:28.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f2806a460 msgr2=0x7f7f2806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:28.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f2806a460 0x7f7f2806c920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0b5e80 tx=0x7f7f30008040 comp rx=0 tx=0).stop 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f3c150220 msgr2=0x7f7f3c152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f3c150220 0x7f7f3c152160 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00d780 tx=0x7f7f2c00dc40 comp rx=0 tx=0).stop 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 shutdown_connections 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f2806a460 0x7f7f2806c920 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f3c1f3e60 0x7f7f3c1f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f3c1f4530 0x7f7f3c1f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 --2- 172.21.15.113:0/1746297929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f3c150220 0x7f7f3c152160 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 >> 172.21.15.113:0/1746297929 conn(0x7f7f3c0b27a0 msgr2=0x7f7f3c15efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.846+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 shutdown_connections 2023-12-19T13:49:28.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:28.847+0000 7f7f42988640 1 -- 172.21.15.113:0/1746297929 wait complete. 2023-12-19T13:49:28.867 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T13:49:29.070 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_objectstore":"memstore"} 2023-12-19T13:49:29.071 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T13:49:29.071 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:49:29.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.285+0000 7fc75f038640 1 Processor -- start 2023-12-19T13:49:29.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.285+0000 7fc75f038640 1 -- start start 2023-12-19T13:49:29.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75f038640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc758146ff0 0x7fc7580d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:29.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75f038640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 0x7fc75806f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75f038640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758161e70 con 0x7fc75806fa70 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75f038640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc758161080 con 0x7fc758146ff0 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75f038640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75806fef0 con 0x7fc7580b6430 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75cdd4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc758146ff0 0x7fc7580d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75cdd4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc758146ff0 0x7fc7580d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40658/0 (socket says 172.21.15.113:40658) 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.287+0000 7fc75cdd4640 1 -- 172.21.15.113:0/245424152 learned_addr learned my addr 172.21.15.113:0/245424152 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.288+0000 7fc75cdd4640 1 -- 172.21.15.113:0/245424152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 msgr2=0x7fc75806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.288+0000 7fc75cdd4640 1 --2- 172.21.15.113:0/245424152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 0x7fc75806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.288+0000 7fc75cdd4640 1 -- 172.21.15.113:0/245424152 >> v1:172.21.15.151:6789/0 conn(0x7fc75806fa70 legacy=0x7fc75815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:29.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.288+0000 7fc75cdd4640 1 -- 172.21.15.113:0/245424152 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758161260 con 0x7fc758146ff0 2023-12-19T13:49:29.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.289+0000 7fc75cdd4640 1 --2- 172.21.15.113:0/245424152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc758146ff0 0x7fc7580d10f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc754009870 tx=0x7fc75402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211903bd5e2570e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:29.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.289+0000 7fc74f7fe640 1 -- 172.21.15.113:0/245424152 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754031640 con 0x7fc758146ff0 2023-12-19T13:49:29.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.289+0000 7fc74f7fe640 1 -- 172.21.15.113:0/245424152 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7540317a0 con 0x7fc758146ff0 2023-12-19T13:49:29.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.289+0000 7fc74f7fe640 1 -- 172.21.15.113:0/245424152 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754031b30 con 0x7fc758146ff0 2023-12-19T13:49:29.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 -- 172.21.15.113:0/245424152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc758146ff0 msgr2=0x7fc7580d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:29.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 --2- 172.21.15.113:0/245424152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc758146ff0 0x7fc7580d10f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc754009870 tx=0x7fc75402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 -- 172.21.15.113:0/245424152 shutdown_connections 2023-12-19T13:49:29.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 --2- 172.21.15.113:0/245424152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 0x7fc75806f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 --2- 172.21.15.113:0/245424152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc758146ff0 0x7fc7580d10f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 -- 172.21.15.113:0/245424152 >> 172.21.15.113:0/245424152 conn(0x7fc7580d3520 msgr2=0x7fc7580d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:29.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 -- 172.21.15.113:0/245424152 shutdown_connections 2023-12-19T13:49:29.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.290+0000 7fc75f038640 1 -- 172.21.15.113:0/245424152 wait complete. 2023-12-19T13:49:29.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.292+0000 7fc75f038640 1 Processor -- start 2023-12-19T13:49:29.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.292+0000 7fc75f038640 1 -- start start 2023-12-19T13:49:29.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75f038640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc75806fa70 0x7fc7580c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75f038640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 0x7fc758141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75f038640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758146ff0 0x7fc75815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75f038640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c8bf0 con 0x7fc75806fa70 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75f038640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c8ed0 con 0x7fc758146ff0 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75f038640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c91b0 con 0x7fc7580b6430 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc75806fa70 0x7fc7580c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc75806fa70 0x7fc7580c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40662/0 (socket says 172.21.15.113:40662) 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 -- 172.21.15.113:0/4155793534 learned_addr learned my addr 172.21.15.113:0/4155793534 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc74ffff640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 0x7fc758141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 -- 172.21.15.113:0/4155793534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 msgr2=0x7fc758141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 0x7fc758141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 -- 172.21.15.113:0/4155793534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758146ff0 msgr2=0x7fc75815ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:29.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758146ff0 0x7fc75815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.293+0000 7fc75cdd4640 1 -- 172.21.15.113:0/4155793534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540094d0 con 0x7fc75806fa70 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.294+0000 7fc75cdd4640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc75806fa70 0x7fc7580c83a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc754009870 tx=0x7fc7540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.294+0000 7fc74d7fa640 1 -- 172.21.15.113:0/4155793534 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75403ac60 con 0x7fc75806fa70 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.294+0000 7fc74d7fa640 1 -- 172.21.15.113:0/4155793534 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75403adc0 con 0x7fc75806fa70 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.294+0000 7fc74d7fa640 1 -- 172.21.15.113:0/4155793534 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754044630 con 0x7fc75806fa70 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.294+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7580c9490 con 0x7fc75806fa70 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.294+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7580c88e0 con 0x7fc75806fa70 2023-12-19T13:49:29.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.295+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc758061910 con 0x7fc75806fa70 2023-12-19T13:49:29.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.296+0000 7fc74d7fa640 1 -- 172.21.15.113:0/4155793534 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc75402f050 con 0x7fc75806fa70 2023-12-19T13:49:29.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.297+0000 7fc74d7fa640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc74406a430 0x7fc74406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:29.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.297+0000 7fc74d7fa640 1 -- 172.21.15.113:0/4155793534 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc7540aa710 con 0x7fc75806fa70 2023-12-19T13:49:29.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.297+0000 7fc74ffff640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc74406a430 0x7fc74406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:29.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.298+0000 7fc74ffff640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc74406a430 0x7fc74406c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc758145be0 tx=0x7fc748008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:29.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.302+0000 7fc74d7fa640 1 -- 172.21.15.113:0/4155793534 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc754075f60 con 0x7fc75806fa70 2023-12-19T13:49:29.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.483+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc7580d3130 con 0x7fc75806fa70 2023-12-19T13:49:29.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.491+0000 7fc74d7fa640 1 -- 172.21.15.113:0/4155793534 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc754031e60 con 0x7fc75806fa70 2023-12-19T13:49:29.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc74406a430 msgr2=0x7fc74406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:29.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc74406a430 0x7fc74406c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc758145be0 tx=0x7fc748008040 comp rx=0 tx=0).stop 2023-12-19T13:49:29.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc75806fa70 msgr2=0x7fc7580c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc75806fa70 0x7fc7580c83a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc754009870 tx=0x7fc7540046c0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 shutdown_connections 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc74406a430 0x7fc74406c8f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758146ff0 0x7fc75815ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7580b6430 0x7fc758141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 --2- 172.21.15.113:0/4155793534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc75806fa70 0x7fc7580c83a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 >> 172.21.15.113:0/4155793534 conn(0x7fc7580d3520 msgr2=0x7fc7580d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 shutdown_connections 2023-12-19T13:49:29.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:29.494+0000 7fc75f038640 1 -- 172.21.15.113:0/4155793534 wait complete. 2023-12-19T13:49:29.511 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:49:29.511 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:49:29.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:49:29.738 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:49:29.739 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:49:29.739 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:29.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:49:29.800 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:49:29.800 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:29.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:49:29.859 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:49:29.860 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:29.919 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:49:29.920 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:49:29.920 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:29.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:49:29.983 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:49:29.983 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.199+0000 7ff7e6ff0640 1 Processor -- start 2023-12-19T13:49:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.199+0000 7ff7e6ff0640 1 -- start start 2023-12-19T13:49:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.200+0000 7ff7e6ff0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 0x7ff7e0166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.200+0000 7ff7e6ff0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e006bb30 con 0x7ff7e00b0b50 2023-12-19T13:49:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.200+0000 7ff7e6ff0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e00b0070 con 0x7ff7e01449e0 2023-12-19T13:49:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.200+0000 7ff7e6ff0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e00b0350 con 0x7ff7e006c6b0 2023-12-19T13:49:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.201+0000 7ff7d7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff7e00b0b50 0x7ff7e006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36050/0 (socket says 172.21.15.113:36050) 2023-12-19T13:49:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.201+0000 7ff7d7fff640 1 -- 172.21.15.113:0/3075767874 learned_addr learned my addr 172.21.15.113:0/3075767874 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:30.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.201+0000 7ff7e558d640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 0x7ff7e0166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.201+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224129250 0 0) 0x7ff7e006bb30 con 0x7ff7e00b0b50 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.201+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c8003520 con 0x7ff7e00b0b50 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2800211861 0 0) 0x7ff7c8003520 con 0x7ff7e00b0b50 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 msgr2=0x7ff7e0166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 0x7ff7e0166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 >> v1:172.21.15.151:6789/0 conn(0x7ff7e01449e0 legacy=0x7ff7e00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e00b0630 con 0x7ff7e00b0b50 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff7d0001670 con 0x7ff7e00b0b50 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 >> v1:172.21.15.113:6789/0 conn(0x7ff7e00b0b50 legacy=0x7ff7e006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 0x7ff7c8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c8003fe0 0x7ff7c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e00b0350 con 0x7ff7c8004d00 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800bb40 con 0x7ff7c8003fe0 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800bd00 con 0x7ff7e006c6b0 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.202+0000 7ff7e558d640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7e4d8c640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 0x7ff7c8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7d7fff640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c8003fe0 0x7ff7c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7e558d640 1 -- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 msgr2=0x7ff7c8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7e558d640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 0x7ff7c8003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7e558d640 1 -- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c8003fe0 msgr2=0x7ff7c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7e558d640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c8003fe0 0x7ff7c80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7e558d640 1 -- 172.21.15.113:0/3075767874 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8003520 con 0x7ff7c8004d00 2023-12-19T13:49:30.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.203+0000 7ff7e4d8c640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e006c6b0 0x7ff7c8003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:30.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.204+0000 7ff7e558d640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7c8005180 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009ac0 tx=0x7ff7c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449853204692b435 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:30.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.204+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d802c6b0 con 0x7ff7c8004d00 2023-12-19T13:49:30.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.204+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d802c810 con 0x7ff7c8004d00 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.204+0000 7ff7d77fe640 1 -- 172.21.15.113:0/3075767874 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d802cba0 con 0x7ff7c8004d00 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.205+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/3075767874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 msgr2=0x7ff7c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.205+0000 7ff7e6ff0640 1 --2- 172.21.15.113:0/3075767874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7c8005180 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009ac0 tx=0x7ff7c80057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.205+0000 7ff7e558d640 1 -- 172.21.15.113:0/3075767874 reap_dead start 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.205+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/3075767874 shutdown_connections 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.205+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/3075767874 >> 172.21.15.113:0/3075767874 conn(0x7ff7e00cbb70 msgr2=0x7ff7e00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.205+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/3075767874 shutdown_connections 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.205+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/3075767874 wait complete. 2023-12-19T13:49:30.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.207+0000 7ff7e6ff0640 1 Processor -- start 2023-12-19T13:49:30.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.207+0000 7ff7e6ff0640 1 -- start start 2023-12-19T13:49:30.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e6ff0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7e013dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e6ff0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7e00ac8b0 0x7ff7e01f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e6ff0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e01f65f0 0x7ff7e01430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e6ff0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e013e2b0 con 0x7ff7c8004d00 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e6ff0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e01425f0 con 0x7ff7e00ac8b0 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e6ff0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e01f6b70 con 0x7ff7e01f65f0 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7e013dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7e013dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40674/0 (socket says 172.21.15.113:40674) 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 -- 172.21.15.113:0/207924805 learned_addr learned my addr 172.21.15.113:0/207924805 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 -- 172.21.15.113:0/207924805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e01f65f0 msgr2=0x7ff7e01430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e01f65f0 0x7ff7e01430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 -- 172.21.15.113:0/207924805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7e00ac8b0 msgr2=0x7ff7e01f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7e00ac8b0 0x7ff7e01f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.208+0000 7ff7e4d8c640 1 -- 172.21.15.113:0/207924805 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e01f6e50 con 0x7ff7c8004d00 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.209+0000 7ff7e4d8c640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7e013dd70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00da90 tx=0x7ff7dc00df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.209+0000 7ff7d57fa640 1 -- 172.21.15.113:0/207924805 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc017070 con 0x7ff7c8004d00 2023-12-19T13:49:30.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.209+0000 7ff7d57fa640 1 -- 172.21.15.113:0/207924805 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc003ba0 con 0x7ff7c8004d00 2023-12-19T13:49:30.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.209+0000 7ff7d57fa640 1 -- 172.21.15.113:0/207924805 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc006b50 con 0x7ff7c8004d00 2023-12-19T13:49:30.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.209+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e01428b0 con 0x7ff7c8004d00 2023-12-19T13:49:30.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.209+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e01f2d50 con 0x7ff7c8004d00 2023-12-19T13:49:30.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.210+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e0061910 con 0x7ff7c8004d00 2023-12-19T13:49:30.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.211+0000 7ff7d57fa640 1 -- 172.21.15.113:0/207924805 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff7dc006cb0 con 0x7ff7c8004d00 2023-12-19T13:49:30.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.212+0000 7ff7d57fa640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7cc06a460 0x7ff7cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.212+0000 7ff7d57fa640 1 -- 172.21.15.113:0/207924805 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff7dc088250 con 0x7ff7c8004d00 2023-12-19T13:49:30.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.212+0000 7ff7d7fff640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7cc06a460 0x7ff7cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.213+0000 7ff7d7fff640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7cc06a460 0x7ff7cc06c920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00079b0 tx=0x7ff7d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:30.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.216+0000 7ff7d57fa640 1 -- 172.21.15.113:0/207924805 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff7dc053aa0 con 0x7ff7c8004d00 2023-12-19T13:49:30.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.443+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e00ae560 con 0x7ff7c8004d00 2023-12-19T13:49:30.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.444+0000 7ff7d57fa640 1 -- 172.21.15.113:0/207924805 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3532 (secure 0 0 0) 0x7ff7dc0570c0 con 0x7ff7c8004d00 2023-12-19T13:49:30.444 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:30.444 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/484062601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":484062601},{"type":"v1","addr":"172.21.15.151:6833","nonce":484062601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1858378716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1858378716},{"type":"v1","addr":"172.21.15.151:6835","nonce":1858378716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/873436419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":873436419},{"type":"v1","addr":"172.21.15.113:6835","nonce":873436419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/754469543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":754469543},{"type":"v1","addr":"172.21.15.113:6837","nonce":754469543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-12-19T13:49:30.445 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 27 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7cc06a460 msgr2=0x7ff7cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7cc06a460 0x7ff7cc06c920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00079b0 tx=0x7ff7d0009040 comp rx=0 tx=0).stop 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 msgr2=0x7ff7e013dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7e013dd70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00da90 tx=0x7ff7dc00df50 comp rx=0 tx=0).stop 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 shutdown_connections 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7cc06a460 0x7ff7cc06c920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7e01f65f0 0x7ff7e01430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7e00ac8b0 0x7ff7e01f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 --2- 172.21.15.113:0/207924805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c8004d00 0x7ff7e013dd70 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 >> 172.21.15.113:0/207924805 conn(0x7ff7e00cbb70 msgr2=0x7ff7e00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 shutdown_connections 2023-12-19T13:49:30.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.447+0000 7ff7e6ff0640 1 -- 172.21.15.113:0/207924805 wait complete. 2023-12-19T13:49:30.467 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:49:30.467 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:49:30.467 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:49:30.467 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:49:30.467 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:49:30.467 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:49:30.468 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:49:30.468 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:49:30.468 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:49:30.468 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:49:30.468 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:49:30.468 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:49:30.468 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:49:30.468 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:49:30.469 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:49:30.469 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:49:30.493 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:49:30.493 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:49:30.495 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:49:30.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:49:30.495 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:49:30.496 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:49:30.501 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:49:30.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:49:30.543 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:49:30.544 DEBUG:teuthology.parallel:result is None 2023-12-19T13:49:30.549 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:49:30.550 DEBUG:teuthology.parallel:result is None 2023-12-19T13:49:30.551 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:49:30.552 DEBUG:teuthology.parallel:result is None 2023-12-19T13:49:30.557 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:49:30.557 DEBUG:teuthology.parallel:result is None 2023-12-19T13:49:30.557 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:49:30.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-19T13:49:30.703 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:49:30.704 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:49:30.713 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:49:30.715 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:49:30.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.745+0000 7fb230651640 1 Processor -- start 2023-12-19T13:49:30.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.746+0000 7fb230651640 1 -- start start 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.747+0000 7fb230651640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb228146da0 0x7fb2280aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.747+0000 7fb230651640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228147180 0x7fb2280aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.747+0000 7fb230651640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2280d1070 con 0x7fb2281611f0 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.747+0000 7fb230651640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb228162020 con 0x7fb228146da0 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.747+0000 7fb230651640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280aabd0 con 0x7fb228147180 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22dbec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228147180 0x7fb2280aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22e3ed640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb228146da0 0x7fb2280aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22ebee640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb2281611f0 0x7fb2280abcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:49002/0 (socket says 172.21.15.113:49002) 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22ebee640 1 -- 172.21.15.113:0/1684543343 learned_addr learned my addr 172.21.15.113:0/1684543343 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22d3eb640 1 -- 172.21.15.113:0/1684543343 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123924948 0 0) 0x7fb2280d1070 con 0x7fb2281611f0 2023-12-19T13:49:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22d3eb640 1 -- 172.21.15.113:0/1684543343 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb214003520 con 0x7fb2281611f0 2023-12-19T13:49:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22dbec640 1 -- 172.21.15.113:0/1684543343 >> v2:172.21.15.151:3300/0 conn(0x7fb228146da0 msgr2=0x7fb2280aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22dbec640 1 --2- 172.21.15.113:0/1684543343 >> v2:172.21.15.151:3300/0 conn(0x7fb228146da0 0x7fb2280aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22dbec640 1 -- 172.21.15.113:0/1684543343 >> v1:172.21.15.151:6789/0 conn(0x7fb2281611f0 legacy=0x7fb2280abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22dbec640 1 -- 172.21.15.113:0/1684543343 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280aaeb0 con 0x7fb228147180 2023-12-19T13:49:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.748+0000 7fb22e3ed640 1 --2- 172.21.15.113:0/1684543343 >> v2:172.21.15.151:3300/0 conn(0x7fb228146da0 0x7fb2280aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:49:30.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.750+0000 7fb22dbec640 1 --2- 172.21.15.113:0/1684543343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228147180 0x7fb2280aa5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2180097a0 tx=0x7fb21802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f056f4f9f8a39ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:30.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.752+0000 7fb22d3eb640 1 -- 172.21.15.113:0/1684543343 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21802d040 con 0x7fb228147180 2023-12-19T13:49:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.752+0000 7fb22d3eb640 1 -- 172.21.15.113:0/1684543343 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218031810 con 0x7fb228147180 2023-12-19T13:49:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.752+0000 7fb22d3eb640 1 -- 172.21.15.113:0/1684543343 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218031ba0 con 0x7fb228147180 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 -- 172.21.15.113:0/1684543343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228147180 msgr2=0x7fb2280aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 --2- 172.21.15.113:0/1684543343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228147180 0x7fb2280aa5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2180097a0 tx=0x7fb21802b8b0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 -- 172.21.15.113:0/1684543343 shutdown_connections 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 --2- 172.21.15.113:0/1684543343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228147180 0x7fb2280aa5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 --2- 172.21.15.113:0/1684543343 >> v2:172.21.15.151:3300/0 conn(0x7fb228146da0 0x7fb2280aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 -- 172.21.15.113:0/1684543343 >> 172.21.15.113:0/1684543343 conn(0x7fb228071a50 msgr2=0x7fb2280d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 -- 172.21.15.113:0/1684543343 shutdown_connections 2023-12-19T13:49:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.753+0000 7fb230651640 1 -- 172.21.15.113:0/1684543343 wait complete. 2023-12-19T13:49:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.755+0000 7fb230651640 1 Processor -- start 2023-12-19T13:49:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.755+0000 7fb230651640 1 -- start start 2023-12-19T13:49:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb230651640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228146da0 0x7fb2281f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb230651640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2281611f0 0x7fb2281f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb230651640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2281f3f70 0x7fb22815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb230651640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228144c30 con 0x7fb2281611f0 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb230651640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281f3d70 con 0x7fb2281f3f70 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb230651640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228143fb0 con 0x7fb228146da0 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb22dbec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2281611f0 0x7fb2281f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb22dbec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2281611f0 0x7fb2281f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40722/0 (socket says 172.21.15.113:40722) 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb22dbec640 1 -- 172.21.15.113:0/1896142491 learned_addr learned my addr 172.21.15.113:0/1896142491 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.756+0000 7fb22e3ed640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228146da0 0x7fb2281f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb22ebee640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2281f3f70 0x7fb22815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb22dbec640 1 -- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228146da0 msgr2=0x7fb2281f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb22dbec640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228146da0 0x7fb2281f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb22dbec640 1 -- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2281f3f70 msgr2=0x7fb22815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb22dbec640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2281f3f70 0x7fb22815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb22dbec640 1 -- 172.21.15.113:0/1896142491 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009400 con 0x7fb2281611f0 2023-12-19T13:49:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb22dbec640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2281611f0 0x7fb2281f5a90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb2180098c0 tx=0x7fb2180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb21effd640 1 -- 172.21.15.113:0/1896142491 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21803ad60 con 0x7fb2281611f0 2023-12-19T13:49:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb21effd640 1 -- 172.21.15.113:0/1896142491 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218044400 con 0x7fb2281611f0 2023-12-19T13:49:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb21effd640 1 -- 172.21.15.113:0/1896142491 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180445b0 con 0x7fb2281611f0 2023-12-19T13:49:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.757+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb218009400 con 0x7fb2281611f0 2023-12-19T13:49:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.758+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb228144570 con 0x7fb2281611f0 2023-12-19T13:49:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.759+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb228073ec0 con 0x7fb2281611f0 2023-12-19T13:49:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.760+0000 7fb21effd640 1 -- 172.21.15.113:0/1896142491 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb21804d440 con 0x7fb2281611f0 2023-12-19T13:49:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.760+0000 7fb21effd640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb20c06a430 0x7fb20c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.761+0000 7fb21effd640 1 -- 172.21.15.113:0/1896142491 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb2180aa8e0 con 0x7fb2281611f0 2023-12-19T13:49:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.761+0000 7fb22e3ed640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb20c06a430 0x7fb20c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.761+0000 7fb22e3ed640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb20c06a430 0x7fb20c06c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb22815ead0 tx=0x7fb224008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:30.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.765+0000 7fb21effd640 1 -- 172.21.15.113:0/1896142491 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb2180762f0 con 0x7fb2281611f0 2023-12-19T13:49:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:30.964+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb228061910 con 0x7fb2281611f0 2023-12-19T13:49:31.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.867+0000 7fb21effd640 1 -- 172.21.15.113:0/1896142491 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb218035080 con 0x7fb2281611f0 2023-12-19T13:49:31.868 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:49:31.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.870+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb20c06a430 msgr2=0x7fb20c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:31.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.870+0000 7fb230651640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb20c06a430 0x7fb20c06c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb22815ead0 tx=0x7fb224008040 comp rx=0 tx=0).stop 2023-12-19T13:49:31.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.870+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2281611f0 msgr2=0x7fb2281f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:31.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.870+0000 7fb230651640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2281611f0 0x7fb2281f5a90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb2180098c0 tx=0x7fb2180046c0 comp rx=0 tx=0).stop 2023-12-19T13:49:31.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 shutdown_connections 2023-12-19T13:49:31.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb20c06a430 0x7fb20c06c8f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:31.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2281f3f70 0x7fb22815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:31.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2281611f0 0x7fb2281f5a90 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:31.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 --2- 172.21.15.113:0/1896142491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb228146da0 0x7fb2281f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:31.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 >> 172.21.15.113:0/1896142491 conn(0x7fb228071a50 msgr2=0x7fb228141d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:31.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 shutdown_connections 2023-12-19T13:49:31.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:31.871+0000 7fb230651640 1 -- 172.21.15.113:0/1896142491 wait complete. 2023-12-19T13:49:31.890 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:49:32.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.102+0000 7f3e1156d640 1 Processor -- start 2023-12-19T13:49:32.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.102+0000 7f3e1156d640 1 -- start start 2023-12-19T13:49:32.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.103+0000 7f3e1156d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e0c0ae110 0x7f3e0c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.103+0000 7f3e1156d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e0c0b0640 0x7f3e0c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.103+0000 7f3e1156d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0c0b0a60 con 0x7f3e0c157bf0 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.103+0000 7f3e1156d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c06b8c0 con 0x7f3e0c0b0640 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.103+0000 7f3e1156d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c0ae640 con 0x7f3e0c0ae110 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3e0c157bf0 0x7f3e0c15b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36078/0 (socket says 172.21.15.113:36078) 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0affd640 1 -- 172.21.15.113:0/1063972906 learned_addr learned my addr 172.21.15.113:0/1063972906 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0b7fe640 1 --2- 172.21.15.113:0/1063972906 >> v2:172.21.15.113:3300/0 conn(0x7f3e0c0b0640 0x7f3e0c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e09ffb640 1 -- 172.21.15.113:0/1063972906 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079504861 0 0) 0x7f3e0c0b0a60 con 0x7f3e0c157bf0 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0a7fc640 1 --2- 172.21.15.113:0/1063972906 >> v2:172.21.15.151:3300/0 conn(0x7f3e0c0ae110 0x7f3e0c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e09ffb640 1 -- 172.21.15.113:0/1063972906 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df4005730 con 0x7f3e0c157bf0 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0b7fe640 1 -- 172.21.15.113:0/1063972906 >> v2:172.21.15.151:3300/0 conn(0x7f3e0c0ae110 msgr2=0x7f3e0c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0b7fe640 1 --2- 172.21.15.113:0/1063972906 >> v2:172.21.15.151:3300/0 conn(0x7f3e0c0ae110 0x7f3e0c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0b7fe640 1 -- 172.21.15.113:0/1063972906 >> v1:172.21.15.113:6789/0 conn(0x7f3e0c157bf0 legacy=0x7f3e0c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.104+0000 7f3e0b7fe640 1 -- 172.21.15.113:0/1063972906 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c0ae920 con 0x7f3e0c0b0640 2023-12-19T13:49:32.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.105+0000 7f3e0b7fe640 1 --2- 172.21.15.113:0/1063972906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c0b0640 0x7f3e0c06d230 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0af4b0 tx=0x7f3e0402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649c98c53772a764 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:32.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e09ffb640 1 -- 172.21.15.113:0/1063972906 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0402cc80 con 0x7f3e0c0b0640 2023-12-19T13:49:32.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e09ffb640 1 -- 172.21.15.113:0/1063972906 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0402cde0 con 0x7f3e0c0b0640 2023-12-19T13:49:32.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e09ffb640 1 -- 172.21.15.113:0/1063972906 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04034660 con 0x7f3e0c0b0640 2023-12-19T13:49:32.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 -- 172.21.15.113:0/1063972906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c0b0640 msgr2=0x7f3e0c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1063972906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c0b0640 0x7f3e0c06d230 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0af4b0 tx=0x7f3e0402bed0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 -- 172.21.15.113:0/1063972906 shutdown_connections 2023-12-19T13:49:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1063972906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c0b0640 0x7f3e0c06d230 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1063972906 >> v2:172.21.15.151:3300/0 conn(0x7f3e0c0ae110 0x7f3e0c0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 -- 172.21.15.113:0/1063972906 >> 172.21.15.113:0/1063972906 conn(0x7f3e0c0cbb70 msgr2=0x7f3e0c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 -- 172.21.15.113:0/1063972906 shutdown_connections 2023-12-19T13:49:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.106+0000 7f3e1156d640 1 -- 172.21.15.113:0/1063972906 wait complete. 2023-12-19T13:49:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.108+0000 7f3e1156d640 1 Processor -- start 2023-12-19T13:49:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.108+0000 7f3e1156d640 1 -- start start 2023-12-19T13:49:32.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e1156d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e0c0ae110 0x7f3e0c15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e1156d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0c0b0640 0x7f3e0c147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e1156d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c157bf0 0x7f3e0c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e1156d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c159110 con 0x7f3e0c157bf0 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e1156d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c1593f0 con 0x7f3e0c0b0640 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e1156d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c1596d0 con 0x7f3e0c0ae110 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c157bf0 0x7f3e0c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c157bf0 0x7f3e0c154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40738/0 (socket says 172.21.15.113:40738) 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.109+0000 7f3e0b7fe640 1 -- 172.21.15.113:0/1432133645 learned_addr learned my addr 172.21.15.113:0/1432133645 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3e0b7fe640 1 -- 172.21.15.113:0/1432133645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e0c0ae110 msgr2=0x7f3e0c15a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3e0b7fe640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e0c0ae110 0x7f3e0c15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3e0b7fe640 1 -- 172.21.15.113:0/1432133645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0c0b0640 msgr2=0x7f3e0c147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3e0b7fe640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0c0b0640 0x7f3e0c147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3e0b7fe640 1 -- 172.21.15.113:0/1432133645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04009a70 con 0x7f3e0c157bf0 2023-12-19T13:49:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3e0b7fe640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c157bf0 0x7f3e0c154e40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009e80 tx=0x7f3e04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3df37fe640 1 -- 172.21.15.113:0/1432133645 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04040650 con 0x7f3e0c157bf0 2023-12-19T13:49:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3df37fe640 1 -- 172.21.15.113:0/1432133645 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e040407b0 con 0x7f3e0c157bf0 2023-12-19T13:49:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c1599b0 con 0x7f3e0c157bf0 2023-12-19T13:49:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.110+0000 7f3df37fe640 1 -- 172.21.15.113:0/1432133645 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04040b60 con 0x7f3e0c157bf0 2023-12-19T13:49:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.111+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c147f50 con 0x7f3e0c157bf0 2023-12-19T13:49:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.112+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c159ed0 con 0x7f3e0c157bf0 2023-12-19T13:49:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.112+0000 7f3df37fe640 1 -- 172.21.15.113:0/1432133645 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e04040cc0 con 0x7f3e0c157bf0 2023-12-19T13:49:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.113+0000 7f3df37fe640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3df806a430 0x7f3df806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.113+0000 7f3df37fe640 1 -- 172.21.15.113:0/1432133645 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e040ab370 con 0x7f3e0c157bf0 2023-12-19T13:49:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.114+0000 7f3e0affd640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3df806a430 0x7f3df806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.114+0000 7f3e0affd640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3df806a430 0x7f3df806c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc001610 tx=0x7f3dfc007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.117+0000 7f3df37fe640 1 -- 172.21.15.113:0/1432133645 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e0c159ed0 con 0x7f3e0c157bf0 2023-12-19T13:49:32.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.377+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3e0c159ed0 con 0x7f3e0c157bf0 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.378+0000 7f3df37fe640 1 -- 172.21.15.113:0/1432133645 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3e0c159ed0 con 0x7f3e0c157bf0 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.378 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.379 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.380 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.381 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.382 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.383 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.384 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.385 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.386 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:49:32.387 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:49:32.388 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:49:32.389 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:49:32.390 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:49:32.391 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:49:32.392 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:49:32.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3df806a430 msgr2=0x7f3df806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3df806a430 0x7f3df806c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc001610 tx=0x7f3dfc007930 comp rx=0 tx=0).stop 2023-12-19T13:49:32.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c157bf0 msgr2=0x7f3e0c154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c157bf0 0x7f3e0c154e40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009e80 tx=0x7f3e04004a40 comp rx=0 tx=0).stop 2023-12-19T13:49:32.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 shutdown_connections 2023-12-19T13:49:32.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3df806a430 0x7f3df806c8f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e0c157bf0 0x7f3e0c154e40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e0c0b0640 0x7f3e0c147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 --2- 172.21.15.113:0/1432133645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e0c0ae110 0x7f3e0c15a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 >> 172.21.15.113:0/1432133645 conn(0x7f3e0c0cbb70 msgr2=0x7f3e0c156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:32.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 shutdown_connections 2023-12-19T13:49:32.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.381+0000 7f3e1156d640 1 -- 172.21.15.113:0/1432133645 wait complete. 2023-12-19T13:49:32.400 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:32.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.610+0000 7f39512b6640 1 Processor -- start 2023-12-19T13:49:32.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.610+0000 7f39512b6640 1 -- start start 2023-12-19T13:49:32.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.611+0000 7f39512b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f394c15b3c0 0x7f394c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.611+0000 7f39512b6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f394c0cc540 0x7f394c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.611+0000 7f39512b6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c161510 con 0x7f394c06f6a0 2023-12-19T13:49:32.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.611+0000 7f39512b6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c15ed70 con 0x7f394c15b3c0 2023-12-19T13:49:32.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.611+0000 7f39512b6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c15e4d0 con 0x7f394c0cc540 2023-12-19T13:49:32.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f394c06f6a0 0x7f394c06c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36090/0 (socket says 172.21.15.113:36090) 2023-12-19T13:49:32.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394b7fe640 1 -- 172.21.15.113:0/2131244701 learned_addr learned my addr 172.21.15.113:0/2131244701 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:32.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394affd640 1 --2- 172.21.15.113:0/2131244701 >> v2:172.21.15.113:3300/0 conn(0x7f394c15b3c0 0x7f394c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f3949ffb640 1 -- 172.21.15.113:0/2131244701 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191662395 0 0) 0x7f394c161510 con 0x7f394c06f6a0 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f3949ffb640 1 -- 172.21.15.113:0/2131244701 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3934003520 con 0x7f394c06f6a0 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394affd640 1 -- 172.21.15.113:0/2131244701 >> v2:172.21.15.151:3300/0 conn(0x7f394c0cc540 msgr2=0x7f394c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394a7fc640 1 --2- 172.21.15.113:0/2131244701 >> v2:172.21.15.151:3300/0 conn(0x7f394c0cc540 0x7f394c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394affd640 1 --2- 172.21.15.113:0/2131244701 >> v2:172.21.15.151:3300/0 conn(0x7f394c0cc540 0x7f394c06f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394affd640 1 -- 172.21.15.113:0/2131244701 >> v1:172.21.15.113:6789/0 conn(0x7f394c06f6a0 legacy=0x7f394c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394affd640 1 -- 172.21.15.113:0/2131244701 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c15e7b0 con 0x7f394c15b3c0 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.612+0000 7f394a7fc640 1 --2- 172.21.15.113:0/2131244701 >> v2:172.21.15.151:3300/0 conn(0x7f394c0cc540 0x7f394c06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:32.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.613+0000 7f394affd640 1 --2- 172.21.15.113:0/2131244701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c15b3c0 0x7f394c15ddf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f393c0097a0 tx=0x7f393c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b7ca3e51a0ea2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:32.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f3949ffb640 1 -- 172.21.15.113:0/2131244701 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c031830 con 0x7f394c15b3c0 2023-12-19T13:49:32.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f3949ffb640 1 -- 172.21.15.113:0/2131244701 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c031990 con 0x7f394c15b3c0 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f3949ffb640 1 -- 172.21.15.113:0/2131244701 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c031d20 con 0x7f394c15b3c0 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 -- 172.21.15.113:0/2131244701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c15b3c0 msgr2=0x7f394c15ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 --2- 172.21.15.113:0/2131244701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c15b3c0 0x7f394c15ddf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f393c0097a0 tx=0x7f393c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 -- 172.21.15.113:0/2131244701 shutdown_connections 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 --2- 172.21.15.113:0/2131244701 >> v2:172.21.15.151:3300/0 conn(0x7f394c0cc540 0x7f394c06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 --2- 172.21.15.113:0/2131244701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c15b3c0 0x7f394c15ddf0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 -- 172.21.15.113:0/2131244701 >> 172.21.15.113:0/2131244701 conn(0x7f394c0d01a0 msgr2=0x7f394c0d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 -- 172.21.15.113:0/2131244701 shutdown_connections 2023-12-19T13:49:32.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.614+0000 7f39512b6640 1 -- 172.21.15.113:0/2131244701 wait complete. 2023-12-19T13:49:32.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.616+0000 7f39512b6640 1 Processor -- start 2023-12-19T13:49:32.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.616+0000 7f39512b6640 1 -- start start 2023-12-19T13:49:32.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.617+0000 7f39512b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f394c06f6a0 0x7f394c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.617+0000 7f39512b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c0cc540 0x7f394c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.617+0000 7f39512b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f394c15b3c0 0x7f394c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.617+0000 7f39512b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0cf750 con 0x7f394c0cc540 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.617+0000 7f39512b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0cf960 con 0x7f394c06f6a0 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.617+0000 7f39512b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c156d70 con 0x7f394c15b3c0 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c0cc540 0x7f394c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c0cc540 0x7f394c0cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40756/0 (socket says 172.21.15.113:40756) 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 -- 172.21.15.113:0/1590544487 learned_addr learned my addr 172.21.15.113:0/1590544487 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394affd640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f394c06f6a0 0x7f394c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 -- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f394c15b3c0 msgr2=0x7f394c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f394c15b3c0 0x7f394c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 -- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f394c06f6a0 msgr2=0x7f394c0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f394c06f6a0 0x7f394c0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 -- 172.21.15.113:0/1590544487 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c009400 con 0x7f394c0cc540 2023-12-19T13:49:32.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394affd640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f394c06f6a0 0x7f394c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:32.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f394a7fc640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c0cc540 0x7f394c0cd7a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f394000c7f0 tx=0x7f394000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:32.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.618+0000 7f39337fe640 1 -- 172.21.15.113:0/1590544487 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940007a30 con 0x7f394c0cc540 2023-12-19T13:49:32.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.619+0000 7f39337fe640 1 -- 172.21.15.113:0/1590544487 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940007b90 con 0x7f394c0cc540 2023-12-19T13:49:32.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.619+0000 7f39337fe640 1 -- 172.21.15.113:0/1590544487 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000ce40 con 0x7f394c0cc540 2023-12-19T13:49:32.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.619+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c157050 con 0x7f394c0cc540 2023-12-19T13:49:32.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.619+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c157610 con 0x7f394c0cc540 2023-12-19T13:49:32.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.620+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c157830 con 0x7f394c0cc540 2023-12-19T13:49:32.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.621+0000 7f39337fe640 1 -- 172.21.15.113:0/1590544487 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39400113f0 con 0x7f394c0cc540 2023-12-19T13:49:32.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.621+0000 7f39337fe640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f393806a430 0x7f393806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:32.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.622+0000 7f39337fe640 1 -- 172.21.15.113:0/1590544487 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3940088730 con 0x7f394c0cc540 2023-12-19T13:49:32.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.622+0000 7f394affd640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f393806a430 0x7f393806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:32.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.622+0000 7f394affd640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f393806a430 0x7f393806c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f393c036000 tx=0x7f393c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:32.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.626+0000 7f39337fe640 1 -- 172.21.15.113:0/1590544487 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3940054100 con 0x7f394c0cc540 2023-12-19T13:49:32.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.817+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394c061910 con 0x7f394c0cc540 2023-12-19T13:49:32.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.818+0000 7f39337fe640 1 -- 172.21.15.113:0/1590544487 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+12437 (secure 0 0 0) 0x7f3940057720 con 0x7f394c0cc540 2023-12-19T13:49:32.818 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:32.818 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":69,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:31.852139+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:32.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f393806a430 msgr2=0x7f393806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f393806a430 0x7f393806c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f393c036000 tx=0x7f393c008030 comp rx=0 tx=0).stop 2023-12-19T13:49:32.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c0cc540 msgr2=0x7f394c0cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:32.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c0cc540 0x7f394c0cd7a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f394000c7f0 tx=0x7f394000cbf0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 shutdown_connections 2023-12-19T13:49:32.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f393806a430 0x7f393806c8f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f394c15b3c0 0x7f394c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f394c0cc540 0x7f394c0cd7a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 --2- 172.21.15.113:0/1590544487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f394c06f6a0 0x7f394c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:32.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.821+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 >> 172.21.15.113:0/1590544487 conn(0x7f394c0d01a0 msgr2=0x7f394c160670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:32.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.822+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 shutdown_connections 2023-12-19T13:49:32.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:32.822+0000 7f39512b6640 1 -- 172.21.15.113:0/1590544487 wait complete. 2023-12-19T13:49:32.841 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:49:32.842 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:49:33.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.055+0000 7f410deca640 1 Processor -- start 2023-12-19T13:49:33.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.055+0000 7f410deca640 1 -- start start 2023-12-19T13:49:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f410deca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 0x7f41080b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f410deca640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41080ccbd0 con 0x7f4108154760 2023-12-19T13:49:33.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f410deca640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4108154b40 con 0x7f410815b290 2023-12-19T13:49:33.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f410deca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080ccf20 con 0x7f41080b0070 2023-12-19T13:49:33.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f41077fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4108154760 0x7f41080cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36100/0 (socket says 172.21.15.113:36100) 2023-12-19T13:49:33.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f41077fe640 1 -- 172.21.15.113:0/2195813817 learned_addr learned my addr 172.21.15.113:0/2195813817 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:33.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f4107fff640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 0x7f41080b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471082808 0 0) 0x7f41080ccbd0 con 0x7f4108154760 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.057+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f4003520 con 0x7f4108154760 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2282131635 0 0) 0x7f40f4003520 con 0x7f4108154760 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 msgr2=0x7f41080b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 0x7f41080b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 >> v1:172.21.15.151:6789/0 conn(0x7f410815b290 legacy=0x7f41080b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080cc060 con 0x7f4108154760 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f40f8001670 con 0x7f4108154760 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 >> v1:172.21.15.113:6789/0 conn(0x7f4108154760 legacy=0x7f41080cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f40f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 0x7f40f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40f4004d50 0x7f40f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080ccf20 con 0x7f40f4003a10 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f400de20 con 0x7f40f4004d50 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f400dfe0 con 0x7f41080b0070 2023-12-19T13:49:33.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.058+0000 7f41077fe640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f40f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.059+0000 7f40fffff640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 0x7f40f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.059+0000 7f4107fff640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40f4004d50 0x7f40f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.059+0000 7f41077fe640 1 -- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 msgr2=0x7f40f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:33.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.059+0000 7f41077fe640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0070 0x7f40f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.059+0000 7f41077fe640 1 -- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40f4004d50 msgr2=0x7f40f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:33.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.059+0000 7f41077fe640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40f4004d50 0x7f40f40051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.059+0000 7f41077fe640 1 -- 172.21.15.113:0/2195813817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f4003520 con 0x7f40f4003a10 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.060+0000 7f41077fe640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f40f4003e30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c240 tx=0x7f40f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f286903776b5e173 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.060+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8005ad0 con 0x7f40f4003a10 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.060+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f8005c30 con 0x7f40f4003a10 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.060+0000 7f4106ffd640 1 -- 172.21.15.113:0/2195813817 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f802c8b0 con 0x7f40f4003a10 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.061+0000 7f410deca640 1 -- 172.21.15.113:0/2195813817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 msgr2=0x7f40f4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.061+0000 7f410deca640 1 --2- 172.21.15.113:0/2195813817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f40f4003e30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c240 tx=0x7f40f40057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.061+0000 7f4107fff640 1 -- 172.21.15.113:0/2195813817 reap_dead start 2023-12-19T13:49:33.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.061+0000 7f410deca640 1 -- 172.21.15.113:0/2195813817 shutdown_connections 2023-12-19T13:49:33.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.061+0000 7f410deca640 1 -- 172.21.15.113:0/2195813817 >> 172.21.15.113:0/2195813817 conn(0x7f4108073150 msgr2=0x7f41080659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:33.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.061+0000 7f410deca640 1 -- 172.21.15.113:0/2195813817 shutdown_connections 2023-12-19T13:49:33.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.061+0000 7f410deca640 1 -- 172.21.15.113:0/2195813817 wait complete. 2023-12-19T13:49:33.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.062+0000 7f410deca640 1 Processor -- start 2023-12-19T13:49:33.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.063+0000 7f410deca640 1 -- start start 2023-12-19T13:49:33.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f410deca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f41081ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f410deca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108155860 0x7f4108155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f410deca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410806bb10 0x7f410806bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f410deca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b0a60 con 0x7f40f4003a10 2023-12-19T13:49:33.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f410deca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410806c4d0 con 0x7f4108155860 2023-12-19T13:49:33.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f410deca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41081ee8f0 con 0x7f410806bb10 2023-12-19T13:49:33.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f41081ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f41081ee3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40772/0 (socket says 172.21.15.113:40772) 2023-12-19T13:49:33.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 -- 172.21.15.113:0/3023173289 learned_addr learned my addr 172.21.15.113:0/3023173289 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 -- 172.21.15.113:0/3023173289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410806bb10 msgr2=0x7f410806bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f40fffff640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108155860 0x7f4108155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410806bb10 0x7f410806bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 -- 172.21.15.113:0/3023173289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108155860 msgr2=0x7f4108155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108155860 0x7f4108155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.064+0000 7f41077fe640 1 -- 172.21.15.113:0/3023173289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108156520 con 0x7f40f4003a10 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.065+0000 7f41077fe640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f41081ee3b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f40f802c450 tx=0x7f40f8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.065+0000 7f4104ff9640 1 -- 172.21.15.113:0/3023173289 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8039030 con 0x7f40f4003a10 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.065+0000 7f4104ff9640 1 -- 172.21.15.113:0/3023173289 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f802ccc0 con 0x7f40f4003a10 2023-12-19T13:49:33.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.065+0000 7f4104ff9640 1 -- 172.21.15.113:0/3023173289 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f803c040 con 0x7f40f4003a10 2023-12-19T13:49:33.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.065+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41081567c0 con 0x7f40f4003a10 2023-12-19T13:49:33.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.065+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4108156d80 con 0x7f40f4003a10 2023-12-19T13:49:33.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.066+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410815a6a0 con 0x7f40f4003a10 2023-12-19T13:49:33.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.068+0000 7f4104ff9640 1 -- 172.21.15.113:0/3023173289 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f40f8032070 con 0x7f40f4003a10 2023-12-19T13:49:33.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.068+0000 7f4104ff9640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a460 0x7f40e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.069+0000 7f4104ff9640 1 -- 172.21.15.113:0/3023173289 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40f80a99c0 con 0x7f40f4003a10 2023-12-19T13:49:33.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.069+0000 7f40fffff640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a460 0x7f40e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.070+0000 7f40fffff640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a460 0x7f40e806c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40f0007fd0 tx=0x7f40f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.075+0000 7f4104ff9640 1 -- 172.21.15.113:0/3023173289 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f40f8075390 con 0x7f40f4003a10 2023-12-19T13:49:33.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.265+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4108061910 con 0x7f40f4003a10 2023-12-19T13:49:33.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.266+0000 7f4104ff9640 1 -- 172.21.15.113:0/3023173289 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40f80789b0 con 0x7f40f4003a10 2023-12-19T13:49:33.266 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:49:33.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.268+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a460 msgr2=0x7f40e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.268+0000 7f410deca640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a460 0x7f40e806c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40f0007fd0 tx=0x7f40f0009040 comp rx=0 tx=0).stop 2023-12-19T13:49:33.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.268+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 msgr2=0x7f41081ee3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.268+0000 7f410deca640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f41081ee3b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f40f802c450 tx=0x7f40f8001a00 comp rx=0 tx=0).stop 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 shutdown_connections 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a460 0x7f40e806c920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410806bb10 0x7f410806bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108155860 0x7f4108155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 --2- 172.21.15.113:0/3023173289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40f4003a10 0x7f41081ee3b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 >> 172.21.15.113:0/3023173289 conn(0x7f4108073150 msgr2=0x7f41080b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 shutdown_connections 2023-12-19T13:49:33.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.269+0000 7f410deca640 1 -- 172.21.15.113:0/3023173289 wait complete. 2023-12-19T13:49:33.288 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:49:33.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.493+0000 7f91692c4640 1 Processor -- start 2023-12-19T13:49:33.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.493+0000 7f91692c4640 1 -- start start 2023-12-19T13:49:33.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91692c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f916415a2d0 0x7f91640cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91692c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91640ce830 0x7f9164070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91692c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9164071040 0x7f916406b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91692c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9164071490 con 0x7f9164071040 2023-12-19T13:49:33.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91692c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640cc1f0 con 0x7f916415a2d0 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91692c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916406e840 con 0x7f91640ce830 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91637fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9164071040 0x7f916406b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91637fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9164071040 0x7f916406b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40782/0 (socket says 172.21.15.113:40782) 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.495+0000 7f91637fe640 1 -- 172.21.15.113:0/1295941204 learned_addr learned my addr 172.21.15.113:0/1295941204 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.496+0000 7f91637fe640 1 -- 172.21.15.113:0/1295941204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91640ce830 msgr2=0x7f9164070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.496+0000 7f91637fe640 1 --2- 172.21.15.113:0/1295941204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91640ce830 0x7f9164070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.496+0000 7f91637fe640 1 -- 172.21.15.113:0/1295941204 >> v2:172.21.15.151:3300/0 conn(0x7f916415a2d0 msgr2=0x7f91640cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.496+0000 7f9162ffd640 1 --2- 172.21.15.113:0/1295941204 >> v2:172.21.15.151:3300/0 conn(0x7f916415a2d0 0x7f91640cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.496+0000 7f91637fe640 1 --2- 172.21.15.113:0/1295941204 >> v2:172.21.15.151:3300/0 conn(0x7f916415a2d0 0x7f91640cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.496+0000 7f91637fe640 1 -- 172.21.15.113:0/1295941204 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640cbc30 con 0x7f9164071040 2023-12-19T13:49:33.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.496+0000 7f9162ffd640 1 --2- 172.21.15.113:0/1295941204 >> v2:172.21.15.151:3300/0 conn(0x7f916415a2d0 0x7f91640cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:33.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.497+0000 7f91637fe640 1 --2- 172.21.15.113:0/1295941204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9164071040 0x7f916406b640 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f916406b240 tx=0x7f915c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473e7b099106bcec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.497+0000 7f91627fc640 1 -- 172.21.15.113:0/1295941204 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c02c9e0 con 0x7f9164071040 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.497+0000 7f91627fc640 1 -- 172.21.15.113:0/1295941204 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c02cb40 con 0x7f9164071040 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.497+0000 7f91627fc640 1 -- 172.21.15.113:0/1295941204 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c0343f0 con 0x7f9164071040 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 -- 172.21.15.113:0/1295941204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9164071040 msgr2=0x7f916406b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 --2- 172.21.15.113:0/1295941204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9164071040 0x7f916406b640 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f916406b240 tx=0x7f915c02be40 comp rx=0 tx=0).stop 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 -- 172.21.15.113:0/1295941204 shutdown_connections 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 --2- 172.21.15.113:0/1295941204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9164071040 0x7f916406b640 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 --2- 172.21.15.113:0/1295941204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91640ce830 0x7f9164070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 --2- 172.21.15.113:0/1295941204 >> v2:172.21.15.151:3300/0 conn(0x7f916415a2d0 0x7f91640cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 -- 172.21.15.113:0/1295941204 >> 172.21.15.113:0/1295941204 conn(0x7f91640cf0b0 msgr2=0x7f91640cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 -- 172.21.15.113:0/1295941204 shutdown_connections 2023-12-19T13:49:33.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.498+0000 7f91692c4640 1 -- 172.21.15.113:0/1295941204 wait complete. 2023-12-19T13:49:33.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.500+0000 7f91692c4640 1 Processor -- start 2023-12-19T13:49:33.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.500+0000 7f91692c4640 1 -- start start 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f91692c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9164071040 0x7f91641552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f91692c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91640ce830 0x7f91641e3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f91692c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916415a2d0 0x7f91641e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f91692c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91641f3b80 con 0x7f91640ce830 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f91692c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91641f2f70 con 0x7f916415a2d0 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f91692c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91641f3250 con 0x7f9164071040 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91640ce830 0x7f91641e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91640ce830 0x7f91641e3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40786/0 (socket says 172.21.15.113:40786) 2023-12-19T13:49:33.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 -- 172.21.15.113:0/3088481056 learned_addr learned my addr 172.21.15.113:0/3088481056 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:33.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f9162ffd640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9164071040 0x7f91641552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 -- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9164071040 msgr2=0x7f91641552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f91637fe640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916415a2d0 0x7f91641e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9164071040 0x7f91641552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 -- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916415a2d0 msgr2=0x7f91641e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916415a2d0 0x7f91641e3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.501+0000 7f915bfff640 1 -- 172.21.15.113:0/3088481056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009b30 con 0x7f91640ce830 2023-12-19T13:49:33.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.502+0000 7f915bfff640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91640ce830 0x7f91641e3960 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f914c00b410 tx=0x7f914c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.502+0000 7f915b7fe640 1 -- 172.21.15.113:0/3088481056 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c011830 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.502+0000 7f915b7fe640 1 -- 172.21.15.113:0/3088481056 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c0119b0 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.502+0000 7f915b7fe640 1 -- 172.21.15.113:0/3088481056 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c011d60 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.502+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91641f3530 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.502+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9164155810 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.503+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9164074770 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.504+0000 7f915b7fe640 1 -- 172.21.15.113:0/3088481056 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f914c01a400 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.505+0000 7f915b7fe640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f914406a460 0x7f914406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.505+0000 7f915b7fe640 1 -- 172.21.15.113:0/3088481056 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f914c088760 con 0x7f91640ce830 2023-12-19T13:49:33.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.505+0000 7f9162ffd640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f914406a460 0x7f914406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.506+0000 7f9162ffd640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f914406a460 0x7f914406c920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f91640cb410 tx=0x7f9154008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.510+0000 7f915b7fe640 1 -- 172.21.15.113:0/3088481056 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f914c054000 con 0x7f91640ce830 2023-12-19T13:49:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.703+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f91640ad610 con 0x7f91640ce830 2023-12-19T13:49:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.704+0000 7f915b7fe640 1 -- 172.21.15.113:0/3088481056 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+65 (secure 0 0 0) 0x7f914c015090 con 0x7f91640ce830 2023-12-19T13:49:33.704 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:33.704 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:49:33.704 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:49:33.704 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:49:33.704 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:49:33.704 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:49:33.704 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.706+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f914406a460 msgr2=0x7f914406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.706+0000 7f91692c4640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f914406a460 0x7f914406c920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f91640cb410 tx=0x7f9154008040 comp rx=0 tx=0).stop 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91640ce830 msgr2=0x7f91641e3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91640ce830 0x7f91641e3960 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f914c00b410 tx=0x7f914c00b8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 shutdown_connections 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f914406a460 0x7f914406c920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916415a2d0 0x7f91641e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91640ce830 0x7f91641e3960 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 --2- 172.21.15.113:0/3088481056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9164071040 0x7f91641552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 >> 172.21.15.113:0/3088481056 conn(0x7f91640cf0b0 msgr2=0x7f9164155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 shutdown_connections 2023-12-19T13:49:33.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.707+0000 7f91692c4640 1 -- 172.21.15.113:0/3088481056 wait complete. 2023-12-19T13:49:33.725 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:49:33.726 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:49:33.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.955+0000 7f857dac0640 1 Processor -- start 2023-12-19T13:49:33.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.956+0000 7f857dac0640 1 -- start start 2023-12-19T13:49:33.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.957+0000 7f857dac0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578141660 0x7f8578140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.957+0000 7f857dac0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8578140f70 0x7f85780cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.957+0000 7f857dac0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780b1880 con 0x7f857813e200 2023-12-19T13:49:33.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.957+0000 7f857dac0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8578141400 con 0x7f8578140f70 2023-12-19T13:49:33.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.957+0000 7f857dac0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b26e0 con 0x7f8578141660 2023-12-19T13:49:33.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.958+0000 7f8576ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578141660 0x7f8578140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.958+0000 7f8577fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8578140f70 0x7f85780cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.958+0000 7f8576ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578141660 0x7f8578140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:60750/0 (socket says 172.21.15.113:60750) 2023-12-19T13:49:33.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.958+0000 7f8576ffd640 1 -- 172.21.15.113:0/1140325742 learned_addr learned my addr 172.21.15.113:0/1140325742 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:33.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.959+0000 7f8576ffd640 1 -- 172.21.15.113:0/1140325742 >> v2:172.21.15.151:3300/0 conn(0x7f8578140f70 msgr2=0x7f85780cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:33.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.959+0000 7f8576ffd640 1 --2- 172.21.15.113:0/1140325742 >> v2:172.21.15.151:3300/0 conn(0x7f8578140f70 0x7f85780cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.959+0000 7f8576ffd640 1 -- 172.21.15.113:0/1140325742 >> v1:172.21.15.151:6789/0 conn(0x7f857813e200 legacy=0x7f85780ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.959+0000 7f8576ffd640 1 -- 172.21.15.113:0/1140325742 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780b1ad0 con 0x7f8578141660 2023-12-19T13:49:33.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.959+0000 7f8577fff640 1 --2- 172.21.15.113:0/1140325742 >> v2:172.21.15.151:3300/0 conn(0x7f8578140f70 0x7f85780cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:49:33.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.960+0000 7f8576ffd640 1 --2- 172.21.15.113:0/1140325742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578141660 0x7f8578140a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f856c009870 tx=0x7f856c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212ae10d878f9bb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.961+0000 7f85767fc640 1 -- 172.21.15.113:0/1140325742 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c030840 con 0x7f8578141660 2023-12-19T13:49:33.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.961+0000 7f85767fc640 1 -- 172.21.15.113:0/1140325742 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c0309a0 con 0x7f8578141660 2023-12-19T13:49:33.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.961+0000 7f85767fc640 1 -- 172.21.15.113:0/1140325742 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c030d30 con 0x7f8578141660 2023-12-19T13:49:33.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 -- 172.21.15.113:0/1140325742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578141660 msgr2=0x7f8578140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 --2- 172.21.15.113:0/1140325742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578141660 0x7f8578140a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f856c009870 tx=0x7f856c02b980 comp rx=0 tx=0).stop 2023-12-19T13:49:33.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 -- 172.21.15.113:0/1140325742 shutdown_connections 2023-12-19T13:49:33.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 --2- 172.21.15.113:0/1140325742 >> v2:172.21.15.151:3300/0 conn(0x7f8578140f70 0x7f85780cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 --2- 172.21.15.113:0/1140325742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578141660 0x7f8578140a30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 -- 172.21.15.113:0/1140325742 >> 172.21.15.113:0/1140325742 conn(0x7f85780cf230 msgr2=0x7f85780cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:33.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 -- 172.21.15.113:0/1140325742 shutdown_connections 2023-12-19T13:49:33.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.962+0000 7f857dac0640 1 -- 172.21.15.113:0/1140325742 wait complete. 2023-12-19T13:49:33.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.964+0000 7f857dac0640 1 Processor -- start 2023-12-19T13:49:33.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.964+0000 7f857dac0640 1 -- start start 2023-12-19T13:49:33.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.965+0000 7f857dac0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f857813e200 0x7f8578139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.965+0000 7f857dac0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578140f70 0x7f857813bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.965+0000 7f857dac0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8578141660 0x7f85781f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.965+0000 7f857dac0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857813a1d0 con 0x7f8578141660 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.965+0000 7f857dac0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857806d0a0 con 0x7f857813e200 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.965+0000 7f857dac0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857806d380 con 0x7f8578140f70 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8578141660 0x7f85781f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8578141660 0x7f85781f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40790/0 (socket says 172.21.15.113:40790) 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 -- 172.21.15.113:0/4268445127 learned_addr learned my addr 172.21.15.113:0/4268445127 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8576ffd640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578140f70 0x7f857813bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f85777fe640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f857813e200 0x7f8578139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 -- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578140f70 msgr2=0x7f857813bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578140f70 0x7f857813bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 -- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f857813e200 msgr2=0x7f8578139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:33.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f857813e200 0x7f8578139c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:33.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f8577fff640 1 -- 172.21.15.113:0/4268445127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570009a70 con 0x7f8578141660 2023-12-19T13:49:33.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.966+0000 7f85777fe640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f857813e200 0x7f8578139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:33.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.967+0000 7f8577fff640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8578141660 0x7f85781f6b60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f857000efc0 tx=0x7f8570009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.967+0000 7f855ffff640 1 -- 172.21.15.113:0/4268445127 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570009d70 con 0x7f8578141660 2023-12-19T13:49:33.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.967+0000 7f855ffff640 1 -- 172.21.15.113:0/4268445127 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857000f040 con 0x7f8578141660 2023-12-19T13:49:33.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.967+0000 7f855ffff640 1 -- 172.21.15.113:0/4268445127 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570003990 con 0x7f8578141660 2023-12-19T13:49:33.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.967+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c0094d0 con 0x7f8578141660 2023-12-19T13:49:33.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.967+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781f6360 con 0x7f8578141660 2023-12-19T13:49:33.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.968+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8578061910 con 0x7f8578141660 2023-12-19T13:49:33.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.969+0000 7f855ffff640 1 -- 172.21.15.113:0/4268445127 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f85700144a0 con 0x7f8578141660 2023-12-19T13:49:33.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.970+0000 7f855ffff640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f856406a430 0x7f856406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:33.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.970+0000 7f855ffff640 1 -- 172.21.15.113:0/4268445127 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8570089340 con 0x7f8578141660 2023-12-19T13:49:33.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.970+0000 7f85777fe640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f856406a430 0x7f856406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:33.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.971+0000 7f85777fe640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f856406a430 0x7f856406c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8568000f60 tx=0x7f8568009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:33.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:33.974+0000 7f855ffff640 1 -- 172.21.15.113:0/4268445127 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8570054be0 con 0x7f8578141660 2023-12-19T13:49:34.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.163+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f857813d9b0 con 0x7f8578141660 2023-12-19T13:49:34.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.896+0000 7f855ffff640 1 -- 172.21.15.113:0/4268445127 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8570058200 con 0x7f8578141660 2023-12-19T13:49:34.896 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:49:34.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.902+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f856406a430 msgr2=0x7f856406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:34.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.902+0000 7f857dac0640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f856406a430 0x7f856406c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8568000f60 tx=0x7f8568009040 comp rx=0 tx=0).stop 2023-12-19T13:49:34.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.902+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8578141660 msgr2=0x7f85781f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:34.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.902+0000 7f857dac0640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8578141660 0x7f85781f6b60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f857000efc0 tx=0x7f8570009f90 comp rx=0 tx=0).stop 2023-12-19T13:49:34.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.903+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 shutdown_connections 2023-12-19T13:49:34.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.903+0000 7f857dac0640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f856406a430 0x7f856406c8f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:34.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.903+0000 7f857dac0640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8578141660 0x7f85781f6b60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:34.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.903+0000 7f857dac0640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8578140f70 0x7f857813bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:34.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.903+0000 7f857dac0640 1 --2- 172.21.15.113:0/4268445127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f857813e200 0x7f8578139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:34.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.903+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 >> 172.21.15.113:0/4268445127 conn(0x7f85780cf230 msgr2=0x7f8578159450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:34.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.904+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 shutdown_connections 2023-12-19T13:49:34.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:34.904+0000 7f857dac0640 1 -- 172.21.15.113:0/4268445127 wait complete. 2023-12-19T13:49:34.926 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:49:35.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.149+0000 7fd1b34e2640 1 Processor -- start 2023-12-19T13:49:35.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.149+0000 7fd1b34e2640 1 -- start start 2023-12-19T13:49:35.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.151+0000 7fd1b34e2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ac0b5130 0x7fd1ac0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.151+0000 7fd1b34e2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd1ac140cd0 0x7fd1ac0b8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.151+0000 7fd1b34e2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0b5a50 con 0x7fd1ac0b8e90 2023-12-19T13:49:35.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.151+0000 7fd1b34e2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac15da30 con 0x7fd1ac140cd0 2023-12-19T13:49:35.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.151+0000 7fd1b34e2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac15dc20 con 0x7fd1ac0b5130 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.151+0000 7fd1b1a7f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd1ac0b8e90 0x7fd1ac161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36112/0 (socket says 172.21.15.113:36112) 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1b1a7f640 1 -- 172.21.15.113:0/3382224102 learned_addr learned my addr 172.21.15.113:0/3382224102 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1b0a7d640 1 --2- 172.21.15.113:0/3382224102 >> v2:172.21.15.151:3300/0 conn(0x7fd1ac140cd0 0x7fd1ac0b8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1b127e640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ac0b5130 0x7fd1ac0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100163155 0 0) 0x7fd1ac0b5a50 con 0x7fd1ac0b8e90 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd194003520 con 0x7fd1ac0b8e90 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 353677869 0 0) 0x7fd194003520 con 0x7fd1ac0b8e90 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ac0b5130 msgr2=0x7fd1ac0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ac0b5130 0x7fd1ac0b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 >> v2:172.21.15.151:3300/0 conn(0x7fd1ac140cd0 msgr2=0x7fd1ac0b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 --2- 172.21.15.113:0/3382224102 >> v2:172.21.15.151:3300/0 conn(0x7fd1ac140cd0 0x7fd1ac0b8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac15df00 con 0x7fd1ac0b8e90 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fd1a4001670 con 0x7fd1ac0b8e90 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.152+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 >> v1:172.21.15.113:6789/0 conn(0x7fd1ac0b8e90 legacy=0x7fd1ac161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1abfff640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd194003970 0x7fd194003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1abfff640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ac0b5130 0x7fd1940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1abfff640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd194004d00 0x7fd194005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac15dc20 con 0x7fd194003970 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19400b9d0 con 0x7fd194004d00 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19400bb90 con 0x7fd1ac0b5130 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1b127e640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd194003970 0x7fd194003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1b127e640 1 -- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ac0b5130 msgr2=0x7fd1940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1b127e640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ac0b5130 0x7fd1940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1b127e640 1 -- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd194004d00 msgr2=0x7fd194005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:35.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1b127e640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd194004d00 0x7fd194005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.153+0000 7fd1b127e640 1 -- 172.21.15.113:0/3382224102 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194003520 con 0x7fd194003970 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.154+0000 7fd1b127e640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd194003970 0x7fd194003d90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009fc0 tx=0x7fd1940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b004b58fca47ed5e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c02cc60 con 0x7fd194003970 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00f040 con 0x7fd194003970 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1abfff640 1 -- 172.21.15.113:0/3382224102 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c034440 con 0x7fd194003970 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1b34e2640 1 -- 172.21.15.113:0/3382224102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd194003970 msgr2=0x7fd194003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1b34e2640 1 --2- 172.21.15.113:0/3382224102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd194003970 0x7fd194003d90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009fc0 tx=0x7fd1940057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1b1a7f640 1 -- 172.21.15.113:0/3382224102 reap_dead start 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1b34e2640 1 -- 172.21.15.113:0/3382224102 shutdown_connections 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1b34e2640 1 -- 172.21.15.113:0/3382224102 >> 172.21.15.113:0/3382224102 conn(0x7fd1ac0d3370 msgr2=0x7fd1ac0d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:35.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.155+0000 7fd1b34e2640 1 -- 172.21.15.113:0/3382224102 shutdown_connections 2023-12-19T13:49:35.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.156+0000 7fd1b34e2640 1 -- 172.21.15.113:0/3382224102 wait complete. 2023-12-19T13:49:35.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.158+0000 7fd1b34e2640 1 Processor -- start 2023-12-19T13:49:35.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.158+0000 7fd1b34e2640 1 -- start start 2023-12-19T13:49:35.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b34e2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd194003970 0x7fd1ac0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b34e2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1ac0ce100 0x7fd1ac0d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b34e2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ac0cb760 0x7fd1ac0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b34e2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ccd00 con 0x7fd1ac0ce100 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b34e2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0cbc60 con 0x7fd1ac0cb760 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b34e2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0cbf40 con 0x7fd194003970 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b0a7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1ac0ce100 0x7fd1ac0d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b0a7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1ac0ce100 0x7fd1ac0d1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40804/0 (socket says 172.21.15.113:40804) 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.159+0000 7fd1b0a7d640 1 -- 172.21.15.113:0/655187896 learned_addr learned my addr 172.21.15.113:0/655187896 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b127e640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd194003970 0x7fd1ac0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b1a7f640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ac0cb760 0x7fd1ac0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b0a7d640 1 -- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd194003970 msgr2=0x7fd1ac0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b0a7d640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd194003970 0x7fd1ac0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b0a7d640 1 -- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ac0cb760 msgr2=0x7fd1ac0d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b0a7d640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ac0cb760 0x7fd1ac0d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b0a7d640 1 -- 172.21.15.113:0/655187896 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0cc220 con 0x7fd1ac0ce100 2023-12-19T13:49:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b127e640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd194003970 0x7fd1ac0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:49:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.160+0000 7fd1b0a7d640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1ac0ce100 0x7fd1ac0d1b30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000e860 tx=0x7fd1a000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:35.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.161+0000 7fd1a9ffb640 1 -- 172.21.15.113:0/655187896 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0009600 con 0x7fd1ac0ce100 2023-12-19T13:49:35.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.161+0000 7fd1a9ffb640 1 -- 172.21.15.113:0/655187896 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000c940 con 0x7fd1ac0ce100 2023-12-19T13:49:35.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.161+0000 7fd1a9ffb640 1 -- 172.21.15.113:0/655187896 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000ccd0 con 0x7fd1ac0ce100 2023-12-19T13:49:35.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.161+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac0cc500 con 0x7fd1ac0ce100 2023-12-19T13:49:35.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.161+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac152ad0 con 0x7fd1ac0ce100 2023-12-19T13:49:35.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.162+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac061910 con 0x7fd1ac0ce100 2023-12-19T13:49:35.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.163+0000 7fd1a9ffb640 1 -- 172.21.15.113:0/655187896 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1a0013470 con 0x7fd1ac0ce100 2023-12-19T13:49:35.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.164+0000 7fd1a9ffb640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a430 0x7fd19806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:35.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.164+0000 7fd1a9ffb640 1 -- 172.21.15.113:0/655187896 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd1a0088840 con 0x7fd1ac0ce100 2023-12-19T13:49:35.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.164+0000 7fd1b127e640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a430 0x7fd19806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:35.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.165+0000 7fd1b127e640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a430 0x7fd19806c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd19c036000 tx=0x7fd19c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:35.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.171+0000 7fd1a9ffb640 1 -- 172.21.15.113:0/655187896 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1a00540a0 con 0x7fd1ac0ce100 2023-12-19T13:49:35.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.355+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd1ac0cb540 con 0x7fd1ac0ce100 2023-12-19T13:49:35.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.911+0000 7fd1a9ffb640 1 -- 172.21.15.113:0/655187896 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd1a00576c0 con 0x7fd1ac0ce100 2023-12-19T13:49:35.912 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:49:35.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.918+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a430 msgr2=0x7fd19806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:35.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.918+0000 7fd1b34e2640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a430 0x7fd19806c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd19c036000 tx=0x7fd19c02e000 comp rx=0 tx=0).stop 2023-12-19T13:49:35.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.918+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1ac0ce100 msgr2=0x7fd1ac0d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:35.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.918+0000 7fd1b34e2640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1ac0ce100 0x7fd1ac0d1b30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000e860 tx=0x7fd1a000ed20 comp rx=0 tx=0).stop 2023-12-19T13:49:35.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.919+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 shutdown_connections 2023-12-19T13:49:35.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.919+0000 7fd1b34e2640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a430 0x7fd19806c8f0 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd19c036000 tx=0x7fd19c02e000 comp rx=0 tx=0).stop 2023-12-19T13:49:35.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.919+0000 7fd1b34e2640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ac0cb760 0x7fd1ac0d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.919+0000 7fd1b34e2640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1ac0ce100 0x7fd1ac0d1b30 secure :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000e860 tx=0x7fd1a000ed20 comp rx=0 tx=0).stop 2023-12-19T13:49:35.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.919+0000 7fd1b34e2640 1 --2- 172.21.15.113:0/655187896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd194003970 0x7fd1ac0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:35.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.919+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 >> 172.21.15.113:0/655187896 conn(0x7fd1ac0d3370 msgr2=0x7fd1ac0b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:35.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.921+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 shutdown_connections 2023-12-19T13:49:35.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:35.922+0000 7fd1b34e2640 1 -- 172.21.15.113:0/655187896 wait complete. 2023-12-19T13:49:35.945 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:49:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.132+0000 7f8a2472e640 1 Processor -- start 2023-12-19T13:49:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.132+0000 7f8a2472e640 1 -- start start 2023-12-19T13:49:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a2472e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a1c15b1d0 0x7f8a1c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a2472e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a2472e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8a1c0ceea0 0x7f8a1c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a2472e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c0cf870 con 0x7f8a1c0ceea0 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a2472e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c15ef10 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a2472e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0b2320 con 0x7f8a1c0b1ec0 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a22ccb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8a1c0ceea0 0x7f8a1c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a22ccb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8a1c0ceea0 0x7f8a1c0cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40814/0 (socket says 172.21.15.113:40814) 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.134+0000 7f8a22ccb640 1 -- 172.21.15.113:0/3128138909 learned_addr learned my addr 172.21.15.113:0/3128138909 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a224ca640 1 --2- 172.21.15.113:0/3128138909 >> v2:172.21.15.151:3300/0 conn(0x7f8a1c15b1d0 0x7f8a1c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a22ccb640 1 -- 172.21.15.113:0/3128138909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 msgr2=0x7f8a1c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a21cc9640 1 --2- 172.21.15.113:0/3128138909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a22ccb640 1 --2- 172.21.15.113:0/3128138909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a22ccb640 1 -- 172.21.15.113:0/3128138909 >> v2:172.21.15.151:3300/0 conn(0x7f8a1c15b1d0 msgr2=0x7f8a1c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a22ccb640 1 --2- 172.21.15.113:0/3128138909 >> v2:172.21.15.151:3300/0 conn(0x7f8a1c15b1d0 0x7f8a1c0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a22ccb640 1 -- 172.21.15.113:0/3128138909 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0b2e40 con 0x7f8a1c0ceea0 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a224ca640 1 --2- 172.21.15.113:0/3128138909 >> v2:172.21.15.151:3300/0 conn(0x7f8a1c15b1d0 0x7f8a1c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.135+0000 7f8a21cc9640 1 --2- 172.21.15.113:0/3128138909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.136+0000 7f8a22ccb640 1 --2- 172.21.15.113:0/3128138909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c0ceea0 0x7f8a1c0cf330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ae020 tx=0x7f8a1402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de54b8f19f2b6b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.136+0000 7f8a214c8640 1 -- 172.21.15.113:0/3128138909 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1402ca80 con 0x7f8a1c0ceea0 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.136+0000 7f8a214c8640 1 -- 172.21.15.113:0/3128138909 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1402cbe0 con 0x7f8a1c0ceea0 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.136+0000 7f8a214c8640 1 -- 172.21.15.113:0/3128138909 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140343f0 con 0x7f8a1c0ceea0 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 -- 172.21.15.113:0/3128138909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c0ceea0 msgr2=0x7f8a1c0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 --2- 172.21.15.113:0/3128138909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c0ceea0 0x7f8a1c0cf330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ae020 tx=0x7f8a1402bee0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 -- 172.21.15.113:0/3128138909 shutdown_connections 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 --2- 172.21.15.113:0/3128138909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c0ceea0 0x7f8a1c0cf330 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 --2- 172.21.15.113:0/3128138909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 --2- 172.21.15.113:0/3128138909 >> v2:172.21.15.151:3300/0 conn(0x7f8a1c15b1d0 0x7f8a1c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 -- 172.21.15.113:0/3128138909 >> 172.21.15.113:0/3128138909 conn(0x7f8a1c073150 msgr2=0x7f8a1c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 -- 172.21.15.113:0/3128138909 shutdown_connections 2023-12-19T13:49:36.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.137+0000 7f8a2472e640 1 -- 172.21.15.113:0/3128138909 wait complete. 2023-12-19T13:49:36.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.139+0000 7f8a2472e640 1 Processor -- start 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.140+0000 7f8a2472e640 1 -- start start 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a2472e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c14b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a2472e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a1c0ceea0 0x7f8a1c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a2472e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c15b1d0 0x7f8a1c0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a2472e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0cccc0 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a2472e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0c9820 con 0x7f8a1c0ceea0 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a2472e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0c9b00 con 0x7f8a1c0b1ec0 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a22ccb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c15b1d0 0x7f8a1c0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a22ccb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c15b1d0 0x7f8a1c0c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40830/0 (socket says 172.21.15.113:40830) 2023-12-19T13:49:36.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.141+0000 7f8a22ccb640 1 -- 172.21.15.113:0/1413856126 learned_addr learned my addr 172.21.15.113:0/1413856126 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:36.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a224ca640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c14b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a21cc9640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a1c0ceea0 0x7f8a1c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a22ccb640 1 -- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 msgr2=0x7f8a1c14b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a22ccb640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c14b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a22ccb640 1 -- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a1c0ceea0 msgr2=0x7f8a1c0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a22ccb640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a1c0ceea0 0x7f8a1c0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a22ccb640 1 -- 172.21.15.113:0/1413856126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009b30 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a22ccb640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c15b1d0 0x7f8a1c0c91f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036040 tx=0x7f8a14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a12ffd640 1 -- 172.21.15.113:0/1413856126 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1403e450 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a12ffd640 1 -- 172.21.15.113:0/1413856126 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1403e5d0 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c0c9de0 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.142+0000 7f8a12ffd640 1 -- 172.21.15.113:0/1413856126 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1403e980 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.143+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c0ca0c0 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.144+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c1f29c0 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.146+0000 7f8a12ffd640 1 -- 172.21.15.113:0/1413856126 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a1402cd50 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.146+0000 7f8a12ffd640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a0006a430 0x7f8a0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.147+0000 7f8a12ffd640 1 -- 172.21.15.113:0/1413856126 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8a140ab8f0 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.147+0000 7f8a224ca640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a0006a430 0x7f8a0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.147+0000 7f8a224ca640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a0006a430 0x7f8a0006c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800a950 tx=0x7f8a18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:36.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.151+0000 7f8a12ffd640 1 -- 172.21.15.113:0/1413856126 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a14077020 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.380+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8a1c061910 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.390+0000 7f8a12ffd640 1 -- 172.21.15.113:0/1413856126 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8a1407a640 con 0x7f8a1c15b1d0 2023-12-19T13:49:36.394 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 8 and data pool 9 2023-12-19T13:49:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.398+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a0006a430 msgr2=0x7f8a0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.398+0000 7f8a2472e640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a0006a430 0x7f8a0006c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800a950 tx=0x7f8a18008040 comp rx=0 tx=0).stop 2023-12-19T13:49:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.398+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c15b1d0 msgr2=0x7f8a1c0c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.398+0000 7f8a2472e640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c15b1d0 0x7f8a1c0c91f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036040 tx=0x7f8a14004a40 comp rx=0 tx=0).stop 2023-12-19T13:49:36.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.399+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 shutdown_connections 2023-12-19T13:49:36.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.399+0000 7f8a2472e640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a0006a430 0x7f8a0006c8f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.399+0000 7f8a2472e640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a1c15b1d0 0x7f8a1c0c91f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.399+0000 7f8a2472e640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a1c0ceea0 0x7f8a1c0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.399+0000 7f8a2472e640 1 --2- 172.21.15.113:0/1413856126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a1c0b1ec0 0x7f8a1c14b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.399+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 >> 172.21.15.113:0/1413856126 conn(0x7f8a1c073150 msgr2=0x7f8a1c15e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.400+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 shutdown_connections 2023-12-19T13:49:36.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.400+0000 7f8a2472e640 1 -- 172.21.15.113:0/1413856126 wait complete. 2023-12-19T13:49:36.429 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:36.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.601+0000 7fb8d8588640 1 Processor -- start 2023-12-19T13:49:36.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.601+0000 7fb8d8588640 1 -- start start 2023-12-19T13:49:36.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.602+0000 7fb8d8588640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb8d01449e0 0x7fb8d00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.602+0000 7fb8d8588640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d00afb10 con 0x7fb8d00b0b50 2023-12-19T13:49:36.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.602+0000 7fb8d8588640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d006bb30 con 0x7fb8d006c6b0 2023-12-19T13:49:36.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.602+0000 7fb8d8588640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d00b0070 con 0x7fb8d01449e0 2023-12-19T13:49:36.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5b23640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb8d00b0b50 0x7fb8d006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36124/0 (socket says 172.21.15.113:36124) 2023-12-19T13:49:36.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5b23640 1 -- 172.21.15.113:0/3875768484 learned_addr learned my addr 172.21.15.113:0/3875768484 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588253712 0 0) 0x7fb8d00afb10 con 0x7fb8d00b0b50 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8bc003520 con 0x7fb8d00b0b50 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d6324640 1 --2- 172.21.15.113:0/3875768484 >> v2:172.21.15.151:3300/0 conn(0x7fb8d01449e0 0x7fb8d00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004373166 0 0) 0x7fb8bc003520 con 0x7fb8d00b0b50 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 >> v2:172.21.15.151:3300/0 conn(0x7fb8d01449e0 msgr2=0x7fb8d00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 --2- 172.21.15.113:0/3875768484 >> v2:172.21.15.151:3300/0 conn(0x7fb8d01449e0 0x7fb8d00af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 >> v1:172.21.15.151:6789/0 conn(0x7fb8d006c6b0 legacy=0x7fb8d00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00b0350 con 0x7fb8d00b0b50 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb8c0001670 con 0x7fb8d00b0b50 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.603+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 >> v1:172.21.15.113:6789/0 conn(0x7fb8d00b0b50 legacy=0x7fb8d006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d5322640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8bc003a30 0x7fb8bc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d5322640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8bc0047c0 0x7fb8bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d5322640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0052a0 0x7fb8bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00b0070 con 0x7fb8bc003a30 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc00c1a0 con 0x7fb8bc0052a0 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc00c360 con 0x7fb8bc0047c0 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6324640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8bc003a30 0x7fb8bc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6b25640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0052a0 0x7fb8bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6324640 1 -- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8bc0047c0 msgr2=0x7fb8bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6324640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8bc0047c0 0x7fb8bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6324640 1 -- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0052a0 msgr2=0x7fb8bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:36.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6324640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0052a0 0x7fb8bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6324640 1 -- 172.21.15.113:0/3875768484 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc003520 con 0x7fb8bc003a30 2023-12-19T13:49:36.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6b25640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0052a0 0x7fb8bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:36.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.604+0000 7fb8d6b25640 1 -- 172.21.15.113:0/3875768484 reap_dead start 2023-12-19T13:49:36.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.605+0000 7fb8d6324640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8bc003a30 0x7fb8bc003e50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00ba00 tx=0x7fb8bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9811931ef76566 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:36.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.605+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc032620 con 0x7fb8bc003a30 2023-12-19T13:49:36.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc032780 con 0x7fb8bc003a30 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d5322640 1 -- 172.21.15.113:0/3875768484 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc032b10 con 0x7fb8bc003a30 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d8588640 1 -- 172.21.15.113:0/3875768484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8bc003a30 msgr2=0x7fb8bc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d8588640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8bc003a30 0x7fb8bc003e50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00ba00 tx=0x7fb8bc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d8588640 1 -- 172.21.15.113:0/3875768484 shutdown_connections 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d8588640 1 --2- 172.21.15.113:0/3875768484 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8bc003a30 0x7fb8bc003e50 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d8588640 1 -- 172.21.15.113:0/3875768484 >> 172.21.15.113:0/3875768484 conn(0x7fb8d00cbb70 msgr2=0x7fb8d00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d8588640 1 -- 172.21.15.113:0/3875768484 shutdown_connections 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.606+0000 7fb8d8588640 1 -- 172.21.15.113:0/3875768484 wait complete. 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.608+0000 7fb8d8588640 1 Processor -- start 2023-12-19T13:49:36.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.608+0000 7fb8d8588640 1 -- start start 2023-12-19T13:49:36.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d8588640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc003a30 0x7fb8d00ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d8588640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8d00acf20 0x7fb8d015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d8588640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8d0135cf0 0x7fb8d015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d8588640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d01f1800 con 0x7fb8d0135cf0 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d8588640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d01f0bf0 con 0x7fb8bc003a30 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d8588640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d01f0ed0 con 0x7fb8d00acf20 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d6b25640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8d0135cf0 0x7fb8d015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d6b25640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8d0135cf0 0x7fb8d015e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40846/0 (socket says 172.21.15.113:40846) 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d6b25640 1 -- 172.21.15.113:0/1802510838 learned_addr learned my addr 172.21.15.113:0/1802510838 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.609+0000 7fb8d5b23640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8d00acf20 0x7fb8d015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6324640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc003a30 0x7fb8d00ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6b25640 1 -- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8d00acf20 msgr2=0x7fb8d015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6b25640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8d00acf20 0x7fb8d015db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6b25640 1 -- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc003a30 msgr2=0x7fb8d00ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6b25640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc003a30 0x7fb8d00ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6b25640 1 -- 172.21.15.113:0/1802510838 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d01f11b0 con 0x7fb8d0135cf0 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d5b23640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8d00acf20 0x7fb8d015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6324640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc003a30 0x7fb8d00ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d6b25640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8d0135cf0 0x7fb8d015e0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00cef20 tx=0x7fb8c800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8c6ffd640 1 -- 172.21.15.113:0/1802510838 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8006d50 con 0x7fb8d0135cf0 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8c6ffd640 1 -- 172.21.15.113:0/1802510838 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c8003970 con 0x7fb8d0135cf0 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8c6ffd640 1 -- 172.21.15.113:0/1802510838 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8003d60 con 0x7fb8d0135cf0 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d01f1490 con 0x7fb8d0135cf0 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.610+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d00ac5c0 con 0x7fb8d0135cf0 2023-12-19T13:49:36.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.611+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d01f19b0 con 0x7fb8d0135cf0 2023-12-19T13:49:36.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.612+0000 7fb8c6ffd640 1 -- 172.21.15.113:0/1802510838 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb8c8005070 con 0x7fb8d0135cf0 2023-12-19T13:49:36.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.613+0000 7fb8c6ffd640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb8b406a430 0x7fb8b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:36.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.613+0000 7fb8c6ffd640 1 -- 172.21.15.113:0/1802510838 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8c8087b70 con 0x7fb8d0135cf0 2023-12-19T13:49:36.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.613+0000 7fb8d6324640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb8b406a430 0x7fb8b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:36.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.614+0000 7fb8d6324640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb8b406a430 0x7fb8b406c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0057a0 tx=0x7fb8cc03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:36.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.617+0000 7fb8c6ffd640 1 -- 172.21.15.113:0/1802510838 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb8d01f19b0 con 0x7fb8d0135cf0 2023-12-19T13:49:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.791+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8d01f19b0 con 0x7fb8d0135cf0 2023-12-19T13:49:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.793+0000 7fb8c6ffd640 1 -- 172.21.15.113:0/1802510838 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16158 (secure 0 0 0) 0x7fb8d01f19b0 con 0x7fb8d0135cf0 2023-12-19T13:49:36.793 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:36.381960+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:36.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb8b406a430 msgr2=0x7fb8b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb8b406a430 0x7fb8b406c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0057a0 tx=0x7fb8cc03d040 comp rx=0 tx=0).stop 2023-12-19T13:49:36.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8d0135cf0 msgr2=0x7fb8d015e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:36.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8d0135cf0 0x7fb8d015e0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00cef20 tx=0x7fb8c800dc00 comp rx=0 tx=0).stop 2023-12-19T13:49:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 shutdown_connections 2023-12-19T13:49:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb8b406a430 0x7fb8b406c8f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8d0135cf0 0x7fb8d015e0a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8d00acf20 0x7fb8d015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 --2- 172.21.15.113:0/1802510838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc003a30 0x7fb8d00ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 >> 172.21.15.113:0/1802510838 conn(0x7fb8d00cbb70 msgr2=0x7fb8d00cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 shutdown_connections 2023-12-19T13:49:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:36.796+0000 7fb8d8588640 1 -- 172.21.15.113:0/1802510838 wait complete. 2023-12-19T13:49:36.813 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:37.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.013+0000 7fb2d5041640 1 Processor -- start 2023-12-19T13:49:37.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.013+0000 7fb2d5041640 1 -- start start 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.014+0000 7fb2d5041640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb2d0070750 0x7fb2d00d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.014+0000 7fb2d5041640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb2d00d2450 0x7fb2d00d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2d5041640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d0143940 con 0x7fb2d0142bf0 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2d5041640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d0143750 con 0x7fb2d00d2450 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2d5041640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d0070b30 con 0x7fb2d0070750 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2ce59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb2d00d2450 0x7fb2d00d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2cf59e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb2d0142bf0 0x7fb2d0143040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:36136/0 (socket says 172.21.15.113:36136) 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2cf59e640 1 -- 172.21.15.113:0/2826093370 learned_addr learned my addr 172.21.15.113:0/2826093370 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2ced9d640 1 --2- 172.21.15.113:0/2826093370 >> v2:172.21.15.151:3300/0 conn(0x7fb2d0070750 0x7fb2d00d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2ce59c640 1 -- 172.21.15.113:0/2826093370 >> v2:172.21.15.151:3300/0 conn(0x7fb2d0070750 msgr2=0x7fb2d00d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:37.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2ce59c640 1 --2- 172.21.15.113:0/2826093370 >> v2:172.21.15.151:3300/0 conn(0x7fb2d0070750 0x7fb2d00d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2ce59c640 1 -- 172.21.15.113:0/2826093370 >> v1:172.21.15.113:6789/0 conn(0x7fb2d0142bf0 legacy=0x7fb2d0143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2ce59c640 1 -- 172.21.15.113:0/2826093370 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00cfd60 con 0x7fb2d00d2450 2023-12-19T13:49:37.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2cdd9b640 1 -- 172.21.15.113:0/2826093370 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898794027 0 0) 0x7fb2d0143940 con 0x7fb2d0142bf0 2023-12-19T13:49:37.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.015+0000 7fb2ced9d640 1 --2- 172.21.15.113:0/2826093370 >> v2:172.21.15.151:3300/0 conn(0x7fb2d0070750 0x7fb2d00d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.016+0000 7fb2ce59c640 1 --2- 172.21.15.113:0/2826093370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d00d2450 0x7fb2d00d2870 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00d4410 tx=0x7fb2c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38000d16b6b74a64 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2cdd9b640 1 -- 172.21.15.113:0/2826093370 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4031830 con 0x7fb2d00d2450 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2cdd9b640 1 -- 172.21.15.113:0/2826093370 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4031990 con 0x7fb2d00d2450 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2cdd9b640 1 -- 172.21.15.113:0/2826093370 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4031d20 con 0x7fb2d00d2450 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 -- 172.21.15.113:0/2826093370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d00d2450 msgr2=0x7fb2d00d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 --2- 172.21.15.113:0/2826093370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d00d2450 0x7fb2d00d2870 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00d4410 tx=0x7fb2c402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 -- 172.21.15.113:0/2826093370 shutdown_connections 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 --2- 172.21.15.113:0/2826093370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d00d2450 0x7fb2d00d2870 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 --2- 172.21.15.113:0/2826093370 >> v2:172.21.15.151:3300/0 conn(0x7fb2d0070750 0x7fb2d00d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 -- 172.21.15.113:0/2826093370 >> 172.21.15.113:0/2826093370 conn(0x7fb2d00b2540 msgr2=0x7fb2d00b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:37.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 -- 172.21.15.113:0/2826093370 shutdown_connections 2023-12-19T13:49:37.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.017+0000 7fb2d5041640 1 -- 172.21.15.113:0/2826093370 wait complete. 2023-12-19T13:49:37.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.019+0000 7fb2d5041640 1 Processor -- start 2023-12-19T13:49:37.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.019+0000 7fb2d5041640 1 -- start start 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.020+0000 7fb2d5041640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d0070750 0x7fb2d01f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.020+0000 7fb2d5041640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2d00d2450 0x7fb2d00c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.020+0000 7fb2d5041640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d0142bf0 0x7fb2d0141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.020+0000 7fb2d5041640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00c9280 con 0x7fb2d0142bf0 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.020+0000 7fb2d5041640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d01618a0 con 0x7fb2d0070750 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.020+0000 7fb2d5041640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0160d20 con 0x7fb2d00d2450 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.020+0000 7fb2cf59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d0142bf0 0x7fb2d0141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d0142bf0 0x7fb2d0141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40874/0 (socket says 172.21.15.113:40874) 2023-12-19T13:49:37.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 -- 172.21.15.113:0/172740811 learned_addr learned my addr 172.21.15.113:0/172740811 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2ced9d640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d0070750 0x7fb2d01f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 -- 172.21.15.113:0/172740811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2d00d2450 msgr2=0x7fb2d00c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2d00d2450 0x7fb2d00c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 -- 172.21.15.113:0/172740811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d0070750 msgr2=0x7fb2d01f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d0070750 0x7fb2d01f5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 -- 172.21.15.113:0/172740811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4009400 con 0x7fb2d0142bf0 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2cf59e640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d0142bf0 0x7fb2d0141900 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c7e0 tx=0x7fb2c800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2b77fe640 1 -- 172.21.15.113:0/172740811 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800a640 con 0x7fb2d0142bf0 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2b77fe640 1 -- 172.21.15.113:0/172740811 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800a7c0 con 0x7fb2d0142bf0 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2b77fe640 1 -- 172.21.15.113:0/172740811 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800ab70 con 0x7fb2d0142bf0 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.021+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d0161000 con 0x7fb2d0142bf0 2023-12-19T13:49:37.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.022+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d01615c0 con 0x7fb2d0142bf0 2023-12-19T13:49:37.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.023+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d0061910 con 0x7fb2d0142bf0 2023-12-19T13:49:37.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.023+0000 7fb2b77fe640 1 -- 172.21.15.113:0/172740811 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb2c800acd0 con 0x7fb2d0142bf0 2023-12-19T13:49:37.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.024+0000 7fb2b77fe640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.024+0000 7fb2b77fe640 1 -- 172.21.15.113:0/172740811 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2c8087f10 con 0x7fb2d0142bf0 2023-12-19T13:49:37.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.025+0000 7fb2ced9d640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.025+0000 7fb2ced9d640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000b840 tx=0x7fb2c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:37.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.029+0000 7fb2b77fe640 1 -- 172.21.15.113:0/172740811 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb2c80534f0 con 0x7fb2d0142bf0 2023-12-19T13:49:37.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.218+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2d015d340 con 0x7fb2d0142bf0 2023-12-19T13:49:37.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.220+0000 7fb2b77fe640 1 -- 172.21.15.113:0/172740811 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16158 (secure 0 0 0) 0x7fb2c8018020 con 0x7fb2d0142bf0 2023-12-19T13:49:37.220 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:37.220 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:36.381960+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.222+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2bc06a430 msgr2=0x7fb2bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.222+0000 7fb2d5041640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000b840 tx=0x7fb2c0008040 comp rx=0 tx=0).stop 2023-12-19T13:49:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.222+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d0142bf0 msgr2=0x7fb2d0141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.222+0000 7fb2d5041640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d0142bf0 0x7fb2d0141900 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c7e0 tx=0x7fb2c800cca0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 shutdown_connections 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d0142bf0 0x7fb2d0141900 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2d00d2450 0x7fb2d00c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 --2- 172.21.15.113:0/172740811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d0070750 0x7fb2d01f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 >> 172.21.15.113:0/172740811 conn(0x7fb2d00b2540 msgr2=0x7fb2d00b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 shutdown_connections 2023-12-19T13:49:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.223+0000 7fb2d5041640 1 -- 172.21.15.113:0/172740811 wait complete. 2023-12-19T13:49:37.240 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:49:37.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-19T13:49:37.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.446+0000 7f1cfecb6640 1 Processor -- start 2023-12-19T13:49:37.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.446+0000 7f1cfecb6640 1 -- start start 2023-12-19T13:49:37.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfecb6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1cf81449e0 0x7f1cf80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfecb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf80b0b50 0x7f1cf806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfecb6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cf806b590 0x7f1cf806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfecb6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf80afb10 con 0x7f1cf806b590 2023-12-19T13:49:37.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfecb6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf806bb30 con 0x7f1cf81449e0 2023-12-19T13:49:37.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfecb6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b0070 con 0x7f1cf80b0b50 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfd253640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cf806b590 0x7f1cf806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfd253640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cf806b590 0x7f1cf806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40890/0 (socket says 172.21.15.113:40890) 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.448+0000 7f1cfd253640 1 -- 172.21.15.113:0/2460265462 learned_addr learned my addr 172.21.15.113:0/2460265462 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cf7fff640 1 --2- 172.21.15.113:0/2460265462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf80b0b50 0x7f1cf806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cfca52640 1 --2- 172.21.15.113:0/2460265462 >> v2:172.21.15.151:3300/0 conn(0x7f1cf81449e0 0x7f1cf80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cfd253640 1 -- 172.21.15.113:0/2460265462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf80b0b50 msgr2=0x7f1cf806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cfd253640 1 --2- 172.21.15.113:0/2460265462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf80b0b50 0x7f1cf806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cfd253640 1 -- 172.21.15.113:0/2460265462 >> v2:172.21.15.151:3300/0 conn(0x7f1cf81449e0 msgr2=0x7f1cf80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cfd253640 1 --2- 172.21.15.113:0/2460265462 >> v2:172.21.15.151:3300/0 conn(0x7f1cf81449e0 0x7f1cf80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cfd253640 1 -- 172.21.15.113:0/2460265462 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80b0350 con 0x7f1cf806b590 2023-12-19T13:49:37.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.449+0000 7f1cf7fff640 1 --2- 172.21.15.113:0/2460265462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf80b0b50 0x7f1cf806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:37.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.450+0000 7f1cfd253640 1 --2- 172.21.15.113:0/2460265462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf806c4e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8071cd0 tx=0x7f1cf002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9194a86129f069 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:37.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.450+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2460265462 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf002ca80 con 0x7f1cf806b590 2023-12-19T13:49:37.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.450+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2460265462 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf002cbe0 con 0x7f1cf806b590 2023-12-19T13:49:37.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.450+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2460265462 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00343f0 con 0x7f1cf806b590 2023-12-19T13:49:37.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 -- 172.21.15.113:0/2460265462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 msgr2=0x7f1cf806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/2460265462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf806c4e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8071cd0 tx=0x7f1cf002bee0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 -- 172.21.15.113:0/2460265462 shutdown_connections 2023-12-19T13:49:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/2460265462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf806c4e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/2460265462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf80b0b50 0x7f1cf806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/2460265462 >> v2:172.21.15.151:3300/0 conn(0x7f1cf81449e0 0x7f1cf80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 -- 172.21.15.113:0/2460265462 >> 172.21.15.113:0/2460265462 conn(0x7f1cf80cbb70 msgr2=0x7f1cf80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 -- 172.21.15.113:0/2460265462 shutdown_connections 2023-12-19T13:49:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.451+0000 7f1cfecb6640 1 -- 172.21.15.113:0/2460265462 wait complete. 2023-12-19T13:49:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.453+0000 7f1cfecb6640 1 Processor -- start 2023-12-19T13:49:37.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.453+0000 7f1cfecb6640 1 -- start start 2023-12-19T13:49:37.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.454+0000 7f1cfecb6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf813d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.454+0000 7f1cfecb6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf80b0b50 0x7f1cf813ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.454+0000 7f1cfecb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf81449e0 0x7f1cf815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.454+0000 7f1cfecb6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf813b040 con 0x7f1cf806b590 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.454+0000 7f1cfecb6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80cd1f0 con 0x7f1cf80b0b50 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.454+0000 7f1cfecb6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf815bec0 con 0x7f1cf81449e0 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf813d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf813d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40906/0 (socket says 172.21.15.113:40906) 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 -- 172.21.15.113:0/1740718085 learned_addr learned my addr 172.21.15.113:0/1740718085 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfd253640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf81449e0 0x7f1cf815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 -- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf81449e0 msgr2=0x7f1cf815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf81449e0 0x7f1cf815b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 -- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf80b0b50 msgr2=0x7f1cf813ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:37.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cf7fff640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf80b0b50 0x7f1cf813ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf80b0b50 0x7f1cf813ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 -- 172.21.15.113:0/1740718085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0009b30 con 0x7f1cf806b590 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.455+0000 7f1cfca52640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf813d660 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d830 tx=0x7f1cec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.456+0000 7f1cf57fa640 1 -- 172.21.15.113:0/1740718085 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00b660 con 0x7f1cf806b590 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.456+0000 7f1cf57fa640 1 -- 172.21.15.113:0/1740718085 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00b7c0 con 0x7f1cf806b590 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.456+0000 7f1cf57fa640 1 -- 172.21.15.113:0/1740718085 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00bb50 con 0x7f1cf806b590 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.456+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80ce890 con 0x7f1cf806b590 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.456+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf8140790 con 0x7f1cf806b590 2023-12-19T13:49:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.457+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf80ce6f0 con 0x7f1cf806b590 2023-12-19T13:49:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.458+0000 7f1cf57fa640 1 -- 172.21.15.113:0/1740718085 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cec01e460 con 0x7f1cf806b590 2023-12-19T13:49:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.459+0000 7f1cf57fa640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cdc06a480 0x7f1cdc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.459+0000 7f1cf57fa640 1 -- 172.21.15.113:0/1740718085 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cec088ea0 con 0x7f1cf806b590 2023-12-19T13:49:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.459+0000 7f1cf7fff640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cdc06a480 0x7f1cdc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.460+0000 7f1cf7fff640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cdc06a480 0x7f1cdc06c940 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1cf815a640 tx=0x7f1ce4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:37.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.463+0000 7f1cf57fa640 1 -- 172.21.15.113:0/1740718085 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cf80ce6f0 con 0x7f1cf806b590 2023-12-19T13:49:37.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:37.685+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1cf80ce6f0 con 0x7f1cf806b590 2023-12-19T13:49:38.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.412+0000 7f1cf57fa640 1 -- 172.21.15.113:0/1740718085 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1cf80ce6f0 con 0x7f1cf806b590 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.415+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cdc06a480 msgr2=0x7f1cdc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.415+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cdc06a480 0x7f1cdc06c940 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1cf815a640 tx=0x7f1ce4008040 comp rx=0 tx=0).stop 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 msgr2=0x7f1cf813d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf813d660 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d830 tx=0x7f1cec00dcf0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 shutdown_connections 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cdc06a480 0x7f1cdc06c940 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf81449e0 0x7f1cf815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf80b0b50 0x7f1cf813ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 --2- 172.21.15.113:0/1740718085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cf806b590 0x7f1cf813d660 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 >> 172.21.15.113:0/1740718085 conn(0x7f1cf80cbb70 msgr2=0x7f1cf815add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 shutdown_connections 2023-12-19T13:49:38.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.416+0000 7f1cfecb6640 1 -- 172.21.15.113:0/1740718085 wait complete. 2023-12-19T13:49:38.436 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:49:38.436 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:49:38.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.647+0000 7fc8ba077640 1 Processor -- start 2023-12-19T13:49:38.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.647+0000 7fc8ba077640 1 -- start start 2023-12-19T13:49:38.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8ba077640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b41449e0 0x7fc8b40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:38.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8ba077640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc8b40b0b50 0x7fc8b406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8ba077640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc8b406b590 0x7fc8b406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8ba077640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b40afb10 con 0x7fc8b406b590 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8ba077640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b406bb30 con 0x7fc8b40b0b50 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8ba077640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40b0070 con 0x7fc8b41449e0 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc8b406b590 0x7fc8b406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc8b406b590 0x7fc8b406c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58078/0 (socket says 172.21.15.113:58078) 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.649+0000 7fc8b3fff640 1 -- 172.21.15.113:0/2168836775 learned_addr learned my addr 172.21.15.113:0/2168836775 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.650+0000 7fc8b3fff640 1 -- 172.21.15.113:0/2168836775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b41449e0 msgr2=0x7fc8b40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:38.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.650+0000 7fc8b3fff640 1 --2- 172.21.15.113:0/2168836775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b41449e0 0x7fc8b40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.650+0000 7fc8b3fff640 1 -- 172.21.15.113:0/2168836775 >> v2:172.21.15.151:3300/0 conn(0x7fc8b40b0b50 msgr2=0x7fc8b406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:38.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.650+0000 7fc8b3fff640 1 --2- 172.21.15.113:0/2168836775 >> v2:172.21.15.151:3300/0 conn(0x7fc8b40b0b50 0x7fc8b406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.650+0000 7fc8b3fff640 1 -- 172.21.15.113:0/2168836775 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b40b0350 con 0x7fc8b406b590 2023-12-19T13:49:38.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.651+0000 7fc8b3fff640 1 --2- 172.21.15.113:0/2168836775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b406c4e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40b14b0 tx=0x7fc8ac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14f4854d2f2313b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:38.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.651+0000 7fc8b27fc640 1 -- 172.21.15.113:0/2168836775 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02ca80 con 0x7fc8b406b590 2023-12-19T13:49:38.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.651+0000 7fc8b27fc640 1 -- 172.21.15.113:0/2168836775 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac02cbe0 con 0x7fc8b406b590 2023-12-19T13:49:38.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.651+0000 7fc8b27fc640 1 -- 172.21.15.113:0/2168836775 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0343f0 con 0x7fc8b406b590 2023-12-19T13:49:38.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.651+0000 7fc8ba077640 1 -- 172.21.15.113:0/2168836775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 msgr2=0x7fc8b406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:38.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.651+0000 7fc8ba077640 1 --2- 172.21.15.113:0/2168836775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b406c4e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40b14b0 tx=0x7fc8ac02bee0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.652+0000 7fc8ba077640 1 -- 172.21.15.113:0/2168836775 shutdown_connections 2023-12-19T13:49:38.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.652+0000 7fc8ba077640 1 --2- 172.21.15.113:0/2168836775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b406c4e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.652+0000 7fc8ba077640 1 --2- 172.21.15.113:0/2168836775 >> v2:172.21.15.151:3300/0 conn(0x7fc8b40b0b50 0x7fc8b406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.652+0000 7fc8ba077640 1 --2- 172.21.15.113:0/2168836775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b41449e0 0x7fc8b40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.652+0000 7fc8ba077640 1 -- 172.21.15.113:0/2168836775 >> 172.21.15.113:0/2168836775 conn(0x7fc8b40cbb70 msgr2=0x7fc8b40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:38.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.652+0000 7fc8ba077640 1 -- 172.21.15.113:0/2168836775 shutdown_connections 2023-12-19T13:49:38.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.652+0000 7fc8ba077640 1 -- 172.21.15.113:0/2168836775 wait complete. 2023-12-19T13:49:38.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.653+0000 7fc8ba077640 1 Processor -- start 2023-12-19T13:49:38.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.654+0000 7fc8ba077640 1 -- start start 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.654+0000 7fc8ba077640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b413a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.654+0000 7fc8ba077640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b40b0b50 0x7fc8b406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.654+0000 7fc8ba077640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8b41449e0 0x7fc8b40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.654+0000 7fc8ba077640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b413d480 con 0x7fc8b406b590 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.654+0000 7fc8ba077640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b4159930 con 0x7fc8b41449e0 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.654+0000 7fc8ba077640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b413cb50 con 0x7fc8b40b0b50 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b413a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b413a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58082/0 (socket says 172.21.15.113:58082) 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 -- 172.21.15.113:0/3401264650 learned_addr learned my addr 172.21.15.113:0/3401264650 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b2ffd640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b40b0b50 0x7fc8b406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b3fff640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8b41449e0 0x7fc8b40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:38.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 -- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b40b0b50 msgr2=0x7fc8b406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:38.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b40b0b50 0x7fc8b406fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 -- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8b41449e0 msgr2=0x7fc8b40700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:38.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8b41449e0 0x7fc8b40700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:38.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.655+0000 7fc8b37fe640 1 -- 172.21.15.113:0/3401264650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009b30 con 0x7fc8b406b590 2023-12-19T13:49:38.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.656+0000 7fc8b37fe640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b413a960 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400b4a0 tx=0x7fc8a400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:38.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.656+0000 7fc89bfff640 1 -- 172.21.15.113:0/3401264650 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4010610 con 0x7fc8b406b590 2023-12-19T13:49:38.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.656+0000 7fc89bfff640 1 -- 172.21.15.113:0/3401264650 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4010770 con 0x7fc8b406b590 2023-12-19T13:49:38.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.656+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b413ce30 con 0x7fc8b406b590 2023-12-19T13:49:38.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.656+0000 7fc89bfff640 1 -- 172.21.15.113:0/3401264650 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4010b20 con 0x7fc8b406b590 2023-12-19T13:49:38.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.656+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b413aea0 con 0x7fc8b406b590 2023-12-19T13:49:38.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.657+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b4061910 con 0x7fc8b406b590 2023-12-19T13:49:38.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.658+0000 7fc89bfff640 1 -- 172.21.15.113:0/3401264650 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8a4010c80 con 0x7fc8b406b590 2023-12-19T13:49:38.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.659+0000 7fc89bfff640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a006a460 0x7fc8a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:38.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.659+0000 7fc89bfff640 1 -- 172.21.15.113:0/3401264650 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8a4088570 con 0x7fc8b406b590 2023-12-19T13:49:38.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.659+0000 7fc8b2ffd640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a006a460 0x7fc8a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:38.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.660+0000 7fc8b2ffd640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a006a460 0x7fc8a006c920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40cb0c0 tx=0x7fc8a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:38.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.664+0000 7fc89bfff640 1 -- 172.21.15.113:0/3401264650 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc8a4053ac0 con 0x7fc8b406b590 2023-12-19T13:49:38.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:38.892+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc8b40ae560 con 0x7fc8b406b590 2023-12-19T13:49:39.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.482+0000 7fc89bfff640 1 -- 172.21.15.113:0/3401264650 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8a40570e0 con 0x7fc8b406b590 2023-12-19T13:49:39.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a006a460 msgr2=0x7fc8a006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a006a460 0x7fc8a006c920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40cb0c0 tx=0x7fc8a8008040 comp rx=0 tx=0).stop 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 msgr2=0x7fc8b413a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b413a960 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400b4a0 tx=0x7fc8a400b960 comp rx=0 tx=0).stop 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 shutdown_connections 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a006a460 0x7fc8a006c920 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8b41449e0 0x7fc8b40700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8b40b0b50 0x7fc8b406fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 --2- 172.21.15.113:0/3401264650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8b406b590 0x7fc8b413a960 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 >> 172.21.15.113:0/3401264650 conn(0x7fc8b40cbb70 msgr2=0x7fc8b406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 shutdown_connections 2023-12-19T13:49:39.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.486+0000 7fc8ba077640 1 -- 172.21.15.113:0/3401264650 wait complete. 2023-12-19T13:49:39.506 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:49:39.506 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:39.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.712+0000 7fad469f6640 1 Processor -- start 2023-12-19T13:49:39.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.712+0000 7fad469f6640 1 -- start start 2023-12-19T13:49:39.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.713+0000 7fad469f6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad40154720 0x7fad4015b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.713+0000 7fad469f6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4015e4c0 con 0x7fad400d03e0 2023-12-19T13:49:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.713+0000 7fad469f6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4015b670 con 0x7fad4015e950 2023-12-19T13:49:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.713+0000 7fad469f6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4015de90 con 0x7fad40154720 2023-12-19T13:49:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.714+0000 7fad3ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad40154720 0x7fad4015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.714+0000 7fad44f93640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fad400d03e0 0x7fad400709e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59224/0 (socket says 172.21.15.113:59224) 2023-12-19T13:49:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.714+0000 7fad44f93640 1 -- 172.21.15.113:0/213490096 learned_addr learned my addr 172.21.15.113:0/213490096 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:39.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.714+0000 7fad3ffff640 1 -- 172.21.15.113:0/213490096 >> v1:172.21.15.151:6789/0 conn(0x7fad4015e950 legacy=0x7fad400cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:39.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.714+0000 7fad3ffff640 1 -- 172.21.15.113:0/213490096 >> v1:172.21.15.113:6789/0 conn(0x7fad400d03e0 legacy=0x7fad400709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.714+0000 7fad3ffff640 1 -- 172.21.15.113:0/213490096 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4006def0 con 0x7fad40154720 2023-12-19T13:49:39.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.715+0000 7fad3ffff640 1 --2- 172.21.15.113:0/213490096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad4015b130 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fad300097a0 tx=0x7fad3002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8684a75e43ffd0b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:39.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad3effd640 1 -- 172.21.15.113:0/213490096 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3002e070 con 0x7fad40154720 2023-12-19T13:49:39.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad3effd640 1 -- 172.21.15.113:0/213490096 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad300315a0 con 0x7fad40154720 2023-12-19T13:49:39.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad3effd640 1 -- 172.21.15.113:0/213490096 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30031930 con 0x7fad40154720 2023-12-19T13:49:39.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad469f6640 1 -- 172.21.15.113:0/213490096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 msgr2=0x7fad4015b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad469f6640 1 --2- 172.21.15.113:0/213490096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad4015b130 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fad300097a0 tx=0x7fad3002b840 comp rx=0 tx=0).stop 2023-12-19T13:49:39.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad469f6640 1 -- 172.21.15.113:0/213490096 shutdown_connections 2023-12-19T13:49:39.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad469f6640 1 --2- 172.21.15.113:0/213490096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad4015b130 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad469f6640 1 -- 172.21.15.113:0/213490096 >> 172.21.15.113:0/213490096 conn(0x7fad400cc770 msgr2=0x7fad400ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:39.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad469f6640 1 -- 172.21.15.113:0/213490096 shutdown_connections 2023-12-19T13:49:39.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.716+0000 7fad469f6640 1 -- 172.21.15.113:0/213490096 wait complete. 2023-12-19T13:49:39.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.718+0000 7fad469f6640 1 Processor -- start 2023-12-19T13:49:39.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.718+0000 7fad469f6640 1 -- start start 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad469f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad400d03e0 0x7fad4013e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad469f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad401e4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad469f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad4015e950 0x7fad400af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad469f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad401f2e00 con 0x7fad40154720 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad469f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad401f30e0 con 0x7fad4015e950 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad469f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad401f33c0 con 0x7fad400d03e0 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad3f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad401e4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad3f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad401e4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58102/0 (socket says 172.21.15.113:58102) 2023-12-19T13:49:39.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.719+0000 7fad3f7fe640 1 -- 172.21.15.113:0/515174123 learned_addr learned my addr 172.21.15.113:0/515174123 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3ffff640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad400d03e0 0x7fad4013e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad44f93640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad4015e950 0x7fad400af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3f7fe640 1 -- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad400d03e0 msgr2=0x7fad4013e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3f7fe640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad400d03e0 0x7fad4013e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3f7fe640 1 -- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad4015e950 msgr2=0x7fad400af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3f7fe640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad4015e950 0x7fad400af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3f7fe640 1 -- 172.21.15.113:0/515174123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30009400 con 0x7fad40154720 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3ffff640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad400d03e0 0x7fad4013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad44f93640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad4015e950 0x7fad400af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3f7fe640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad401e4c30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fad3400b3c0 tx=0x7fad3400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3cff9640 1 -- 172.21.15.113:0/515174123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34011830 con 0x7fad40154720 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3cff9640 1 -- 172.21.15.113:0/515174123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad34011990 con 0x7fad40154720 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad401f36a0 con 0x7fad40154720 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.720+0000 7fad3cff9640 1 -- 172.21.15.113:0/515174123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34011d80 con 0x7fad40154720 2023-12-19T13:49:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.721+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4013e8a0 con 0x7fad40154720 2023-12-19T13:49:39.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.722+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad401f3bc0 con 0x7fad40154720 2023-12-19T13:49:39.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.723+0000 7fad3cff9640 1 -- 172.21.15.113:0/515174123 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad3401b460 con 0x7fad40154720 2023-12-19T13:49:39.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.724+0000 7fad3cff9640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2c06a430 0x7fad2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:39.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.724+0000 7fad3cff9640 1 -- 172.21.15.113:0/515174123 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad34088530 con 0x7fad40154720 2023-12-19T13:49:39.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.724+0000 7fad3ffff640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2c06a430 0x7fad2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:39.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.725+0000 7fad3ffff640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2c06a430 0x7fad2c06c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad30036000 tx=0x7fad3003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:39.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.729+0000 7fad3cff9640 1 -- 172.21.15.113:0/515174123 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad401f3bc0 con 0x7fad40154720 2023-12-19T13:49:39.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.954+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad401f3bc0 con 0x7fad40154720 2023-12-19T13:49:39.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.955+0000 7fad3cff9640 1 -- 172.21.15.113:0/515174123 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4660 (secure 0 0 0) 0x7fad401f3bc0 con 0x7fad40154720 2023-12-19T13:49:39.955 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:39.955 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:49:36.382415+0000","modified":"2023-12-19T13:49:39.476500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6066":{"gid":6066,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/4085417322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4085417322},{"type":"v1","addr":"172.21.15.151:6835","nonce":4085417322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T13:49:39.955 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 33 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2c06a430 msgr2=0x7fad2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2c06a430 0x7fad2c06c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad30036000 tx=0x7fad3003d040 comp rx=0 tx=0).stop 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 msgr2=0x7fad401e4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad401e4c30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fad3400b3c0 tx=0x7fad3400b880 comp rx=0 tx=0).stop 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 shutdown_connections 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2c06a430 0x7fad2c06c8f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad4015e950 0x7fad400af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad40154720 0x7fad401e4c30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 --2- 172.21.15.113:0/515174123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad400d03e0 0x7fad4013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 >> 172.21.15.113:0/515174123 conn(0x7fad400cc770 msgr2=0x7fad4015a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:39.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 shutdown_connections 2023-12-19T13:49:39.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:39.958+0000 7fad469f6640 1 -- 172.21.15.113:0/515174123 wait complete. 2023-12-19T13:49:39.977 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:49:40.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.188+0000 7f88a75c6640 1 Processor -- start 2023-12-19T13:49:40.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.189+0000 7f88a75c6640 1 -- start start 2023-12-19T13:49:40.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a75c6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f88a00b0b50 0x7f88a006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a75c6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a75c6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a006bb30 con 0x7f88a01449e0 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a75c6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a00b0070 con 0x7f88a00b0b50 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a75c6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00b0350 con 0x7f88a006b590 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a5362640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f88a01449e0 0x7f88a00af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59234/0 (socket says 172.21.15.113:59234) 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a5362640 1 -- 172.21.15.113:0/2378731441 learned_addr learned my addr 172.21.15.113:0/2378731441 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.190+0000 7f88a4b61640 1 --2- 172.21.15.113:0/2378731441 >> v2:172.21.15.113:3300/0 conn(0x7f88a00b0b50 0x7f88a006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.191+0000 7f88a5b63640 1 --2- 172.21.15.113:0/2378731441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.191+0000 7f8897fff640 1 -- 172.21.15.113:0/2378731441 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640345461 0 0) 0x7f88a006bb30 con 0x7f88a01449e0 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.191+0000 7f8897fff640 1 -- 172.21.15.113:0/2378731441 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f888c003520 con 0x7f88a01449e0 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.191+0000 7f88a4b61640 1 -- 172.21.15.113:0/2378731441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 msgr2=0x7f88a006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.191+0000 7f88a4b61640 1 --2- 172.21.15.113:0/2378731441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.191+0000 7f88a4b61640 1 -- 172.21.15.113:0/2378731441 >> v1:172.21.15.113:6789/0 conn(0x7f88a01449e0 legacy=0x7f88a00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.191+0000 7f88a4b61640 1 -- 172.21.15.113:0/2378731441 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00b0630 con 0x7f88a00b0b50 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.192+0000 7f88a4b61640 1 --2- 172.21.15.113:0/2378731441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a006bfa0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f88900097a0 tx=0x7f889002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781cc031eeaae7e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.192+0000 7f8897fff640 1 -- 172.21.15.113:0/2378731441 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890031830 con 0x7f88a00b0b50 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.192+0000 7f8897fff640 1 -- 172.21.15.113:0/2378731441 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890031990 con 0x7f88a00b0b50 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.192+0000 7f8897fff640 1 -- 172.21.15.113:0/2378731441 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890031d20 con 0x7f88a00b0b50 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 -- 172.21.15.113:0/2378731441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 msgr2=0x7f88a006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2378731441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a006bfa0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f88900097a0 tx=0x7f889002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 -- 172.21.15.113:0/2378731441 shutdown_connections 2023-12-19T13:49:40.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2378731441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2378731441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a006bfa0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 -- 172.21.15.113:0/2378731441 >> 172.21.15.113:0/2378731441 conn(0x7f88a00cbb70 msgr2=0x7f88a00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:40.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 -- 172.21.15.113:0/2378731441 shutdown_connections 2023-12-19T13:49:40.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.193+0000 7f88a75c6640 1 -- 172.21.15.113:0/2378731441 wait complete. 2023-12-19T13:49:40.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.195+0000 7f88a75c6640 1 Processor -- start 2023-12-19T13:49:40.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.195+0000 7f88a75c6640 1 -- start start 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a75c6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a01f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a75c6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a0157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a75c6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a01449e0 0x7f88a01581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a75c6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a01f2930 con 0x7f88a00b0b50 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a75c6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0142710 con 0x7f88a01449e0 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a75c6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00cdb50 con 0x7f88a006b590 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a4b61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a0157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a4b61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a0157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58122/0 (socket says 172.21.15.113:58122) 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.196+0000 7f88a4b61640 1 -- 172.21.15.113:0/2965782359 learned_addr learned my addr 172.21.15.113:0/2965782359 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:40.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a5362640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a01f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a5b63640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a01449e0 0x7f88a01581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a4b61640 1 -- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 msgr2=0x7f88a01f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a4b61640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a01f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a4b61640 1 -- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a01449e0 msgr2=0x7f88a01581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a4b61640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a01449e0 0x7f88a01581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a4b61640 1 -- 172.21.15.113:0/2965782359 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8890009400 con 0x7f88a00b0b50 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.197+0000 7f88a4b61640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a0157c80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f889002bee0 tx=0x7f88900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.198+0000 7f8895ffb640 1 -- 172.21.15.113:0/2965782359 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889003a6f0 con 0x7f88a00b0b50 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.198+0000 7f8895ffb640 1 -- 172.21.15.113:0/2965782359 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889003a870 con 0x7f88a00b0b50 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.198+0000 7f8895ffb640 1 -- 172.21.15.113:0/2965782359 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889003ac20 con 0x7f88a00b0b50 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.198+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a00cde30 con 0x7f88a00b0b50 2023-12-19T13:49:40.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.198+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a00ce3f0 con 0x7f88a00b0b50 2023-12-19T13:49:40.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.199+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a0061910 con 0x7f88a00b0b50 2023-12-19T13:49:40.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.200+0000 7f8895ffb640 1 -- 172.21.15.113:0/2965782359 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f889004c3b0 con 0x7f88a00b0b50 2023-12-19T13:49:40.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.201+0000 7f8895ffb640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f888406a430 0x7f888406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.201+0000 7f8895ffb640 1 -- 172.21.15.113:0/2965782359 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88900aa5f0 con 0x7f88a00b0b50 2023-12-19T13:49:40.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.201+0000 7f88a5362640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f888406a430 0x7f888406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.202+0000 7f88a5362640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f888406a430 0x7f888406c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f889c0011e0 tx=0x7f889c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:40.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.205+0000 7f8895ffb640 1 -- 172.21.15.113:0/2965782359 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8890075be0 con 0x7f88a00b0b50 2023-12-19T13:49:40.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.389+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88a00ce630 con 0x7f88a00b0b50 2023-12-19T13:49:40.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.391+0000 7f8895ffb640 1 -- 172.21.15.113:0/2965782359 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16145 (secure 0 0 0) 0x7f8890079200 con 0x7f88a00b0b50 2023-12-19T13:49:40.391 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:40.391 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":73,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:49:37.386977+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f888406a430 msgr2=0x7f888406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f888406a430 0x7f888406c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f889c0011e0 tx=0x7f889c009040 comp rx=0 tx=0).stop 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 msgr2=0x7f88a0157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a0157c80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f889002bee0 tx=0x7f88900046c0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 shutdown_connections 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f888406a430 0x7f888406c8f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a01449e0 0x7f88a01581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88a00b0b50 0x7f88a0157c80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 --2- 172.21.15.113:0/2965782359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a006b590 0x7f88a01f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 >> 172.21.15.113:0/2965782359 conn(0x7f88a00cbb70 msgr2=0x7f88a006bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:40.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 shutdown_connections 2023-12-19T13:49:40.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.394+0000 7f88a75c6640 1 -- 172.21.15.113:0/2965782359 wait complete. 2023-12-19T13:49:40.411 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:49:40.411 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:49:40.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.612+0000 7f410cd55640 1 Processor -- start 2023-12-19T13:49:40.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.612+0000 7f410cd55640 1 -- start start 2023-12-19T13:49:40.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f410cd55640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f41080ae110 0x7f41080b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f410cd55640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0640 0x7f410806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f410cd55640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41080ae640 con 0x7f4108157bf0 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f410cd55640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410806b8c0 con 0x7f41080ae110 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f410cd55640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b0ab0 con 0x7f41080b0640 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f40fffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f41080ae110 0x7f41080b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f410659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4108157bf0 0x7f410815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59248/0 (socket says 172.21.15.113:59248) 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.614+0000 7f410659c640 1 -- 172.21.15.113:0/2638292034 learned_addr learned my addr 172.21.15.113:0/2638292034 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.615+0000 7f40fffff640 1 -- 172.21.15.113:0/2638292034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0640 msgr2=0x7f410806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.615+0000 7f40fffff640 1 --2- 172.21.15.113:0/2638292034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0640 0x7f410806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.615+0000 7f40fffff640 1 -- 172.21.15.113:0/2638292034 >> v1:172.21.15.113:6789/0 conn(0x7f4108157bf0 legacy=0x7f410815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.615+0000 7f40fffff640 1 -- 172.21.15.113:0/2638292034 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080ae920 con 0x7f41080ae110 2023-12-19T13:49:40.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.615+0000 7f4105d9b640 1 -- 172.21.15.113:0/2638292034 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705467648 0 0) 0x7f41080ae640 con 0x7f4108157bf0 2023-12-19T13:49:40.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.616+0000 7f40fffff640 1 --2- 172.21.15.113:0/2638292034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080ae110 0x7f41080b0100 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f40f00097d0 tx=0x7f40f002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd27e70898fe627 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:40.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.616+0000 7f4105d9b640 1 -- 172.21.15.113:0/2638292034 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0031800 con 0x7f41080ae110 2023-12-19T13:49:40.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.616+0000 7f4105d9b640 1 -- 172.21.15.113:0/2638292034 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f0031960 con 0x7f41080ae110 2023-12-19T13:49:40.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.616+0000 7f4105d9b640 1 -- 172.21.15.113:0/2638292034 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0031cf0 con 0x7f41080ae110 2023-12-19T13:49:40.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 -- 172.21.15.113:0/2638292034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080ae110 msgr2=0x7f41080b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 --2- 172.21.15.113:0/2638292034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080ae110 0x7f41080b0100 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f40f00097d0 tx=0x7f40f002b8a0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 -- 172.21.15.113:0/2638292034 shutdown_connections 2023-12-19T13:49:40.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 --2- 172.21.15.113:0/2638292034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080b0640 0x7f410806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 --2- 172.21.15.113:0/2638292034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080ae110 0x7f41080b0100 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 -- 172.21.15.113:0/2638292034 >> 172.21.15.113:0/2638292034 conn(0x7f41080cbb70 msgr2=0x7f41080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:40.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 -- 172.21.15.113:0/2638292034 shutdown_connections 2023-12-19T13:49:40.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.617+0000 7f410cd55640 1 -- 172.21.15.113:0/2638292034 wait complete. 2023-12-19T13:49:40.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.619+0000 7f410cd55640 1 Processor -- start 2023-12-19T13:49:40.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.619+0000 7f410cd55640 1 -- start start 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410cd55640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080ae110 0x7f41081544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410cd55640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080b0640 0x7f4108145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410cd55640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108157bf0 0x7f41080cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410cd55640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108158070 con 0x7f41080b0640 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410cd55640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108154d80 con 0x7f4108157bf0 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410cd55640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4108155060 con 0x7f41080ae110 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080b0640 0x7f4108145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080b0640 0x7f4108145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58146/0 (socket says 172.21.15.113:58146) 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 -- 172.21.15.113:0/2953173036 learned_addr learned my addr 172.21.15.113:0/2953173036 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410659c640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080ae110 0x7f41081544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f4106d9d640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108157bf0 0x7f41080cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 -- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080ae110 msgr2=0x7f41081544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080ae110 0x7f41081544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 -- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108157bf0 msgr2=0x7f41080cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108157bf0 0x7f41080cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f40fffff640 1 -- 172.21.15.113:0/2953173036 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0009400 con 0x7f41080b0640 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.621+0000 7f410659c640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080ae110 0x7f41081544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.622+0000 7f40fffff640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080b0640 0x7f4108145ab0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f40f00097d0 tx=0x7f40f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.622+0000 7f40feffd640 1 -- 172.21.15.113:0/2953173036 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f003bd80 con 0x7f41080b0640 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.622+0000 7f40feffd640 1 -- 172.21.15.113:0/2953173036 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f00453f0 con 0x7f41080b0640 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.622+0000 7f40feffd640 1 -- 172.21.15.113:0/2953173036 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00457a0 con 0x7f41080b0640 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.622+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108155340 con 0x7f41080b0640 2023-12-19T13:49:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.622+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41081549e0 con 0x7f41080b0640 2023-12-19T13:49:40.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.623+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4108061910 con 0x7f41080b0640 2023-12-19T13:49:40.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.624+0000 7f40feffd640 1 -- 172.21.15.113:0/2953173036 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f40f004e450 con 0x7f41080b0640 2023-12-19T13:49:40.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.625+0000 7f40feffd640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a430 0x7f40e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:40.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.625+0000 7f40feffd640 1 -- 172.21.15.113:0/2953173036 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40f002e070 con 0x7f41080b0640 2023-12-19T13:49:40.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.625+0000 7f410659c640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a430 0x7f40e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:40.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.626+0000 7f410659c640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a430 0x7f40e806c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f40f8000f60 tx=0x7f40f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:40.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.629+0000 7f40feffd640 1 -- 172.21.15.113:0/2953173036 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f40f0076550 con 0x7f41080b0640 2023-12-19T13:49:40.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.801+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41080aeee0 con 0x7f40e806a430 2023-12-19T13:49:40.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.810+0000 7f40feffd640 1 -- 172.21.15.113:0/2953173036 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277051 (secure 0 0 0) 0x7f40f8001ca0 con 0x7f40e806a430 2023-12-19T13:49:40.814 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:40.815 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:49:40.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a430 msgr2=0x7f40e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a430 0x7f40e806c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f40f8000f60 tx=0x7f40f8009040 comp rx=0 tx=0).stop 2023-12-19T13:49:40.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080b0640 msgr2=0x7f4108145ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:40.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080b0640 0x7f4108145ab0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f40f00097d0 tx=0x7f40f00046c0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 shutdown_connections 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40e806a430 0x7f40e806c8f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4108157bf0 0x7f41080cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41080b0640 0x7f4108145ab0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 --2- 172.21.15.113:0/2953173036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41080ae110 0x7f41081544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 >> 172.21.15.113:0/2953173036 conn(0x7f41080cbb70 msgr2=0x7f4108073090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 shutdown_connections 2023-12-19T13:49:40.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:40.817+0000 7f410cd55640 1 -- 172.21.15.113:0/2953173036 wait complete. 2023-12-19T13:49:40.835 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-12-19T13:49:40.467414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4055,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558444,"statfs":{"total":1600000000,"available":1595847165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.573522"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822971+0000","last_change":"2023-12-19T13:49:36.394475+0000","last_active":"2023-12-19T13:49:38.822971+0000","last_peered":"2023-12-19T13:49:38.822971+0000","last_clean":"2023-12-19T13:49:38.822971+0000","last_became_active":"2023-12-19T13:49:36.394262+0000","last_became_peered":"2023-12-19T13:49:36.394262+0000","last_unstale":"2023-12-19T13:49:38.822971+0000","last_undegraded":"2023-12-19T13:49:38.822971+0000","last_fullsized":"2023-12-19T13:49:38.822971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:36.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822286+0000","last_change":"2023-12-19T13:49:36.403203+0000","last_active":"2023-12-19T13:49:38.822286+0000","last_peered":"2023-12-19T13:49:38.822286+0000","last_clean":"2023-12-19T13:49:38.822286+0000","last_became_active":"2023-12-19T13:49:36.402982+0000","last_became_peered":"2023-12-19T13:49:36.402982+0000","last_unstale":"2023-12-19T13:49:38.822286+0000","last_undegraded":"2023-12-19T13:49:38.822286+0000","last_fullsized":"2023-12-19T13:49:38.822286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:39.662682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822451+0000","last_change":"2023-12-19T13:49:36.403126+0000","last_active":"2023-12-19T13:49:38.822451+0000","last_peered":"2023-12-19T13:49:38.822451+0000","last_clean":"2023-12-19T13:49:38.822451+0000","last_became_active":"2023-12-19T13:49:36.399427+0000","last_became_peered":"2023-12-19T13:49:36.399427+0000","last_unstale":"2023-12-19T13:49:38.822451+0000","last_undegraded":"2023-12-19T13:49:38.822451+0000","last_fullsized":"2023-12-19T13:49:38.822451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:39.487118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398255+0000","last_change":"2023-12-19T13:49:36.406555+0000","last_active":"2023-12-19T13:49:37.398255+0000","last_peered":"2023-12-19T13:49:37.398255+0000","last_clean":"2023-12-19T13:49:37.398255+0000","last_became_active":"2023-12-19T13:49:36.405313+0000","last_became_peered":"2023-12-19T13:49:36.405313+0000","last_unstale":"2023-12-19T13:49:37.398255+0000","last_undegraded":"2023-12-19T13:49:37.398255+0000","last_fullsized":"2023-12-19T13:49:37.398255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:56.630159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822858+0000","last_change":"2023-12-19T13:49:36.404369+0000","last_active":"2023-12-19T13:49:38.822858+0000","last_peered":"2023-12-19T13:49:38.822858+0000","last_clean":"2023-12-19T13:49:38.822858+0000","last_became_active":"2023-12-19T13:49:36.404095+0000","last_became_peered":"2023-12-19T13:49:36.404095+0000","last_unstale":"2023-12-19T13:49:38.822858+0000","last_undegraded":"2023-12-19T13:49:38.822858+0000","last_fullsized":"2023-12-19T13:49:38.822858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398615+0000","last_change":"2023-12-19T13:49:36.403893+0000","last_active":"2023-12-19T13:49:37.398615+0000","last_peered":"2023-12-19T13:49:37.398615+0000","last_clean":"2023-12-19T13:49:37.398615+0000","last_became_active":"2023-12-19T13:49:36.400637+0000","last_became_peered":"2023-12-19T13:49:36.400637+0000","last_unstale":"2023-12-19T13:49:37.398615+0000","last_undegraded":"2023-12-19T13:49:37.398615+0000","last_fullsized":"2023-12-19T13:49:37.398615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:04.169818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822427+0000","last_change":"2023-12-19T13:49:36.408953+0000","last_active":"2023-12-19T13:49:38.822427+0000","last_peered":"2023-12-19T13:49:38.822427+0000","last_clean":"2023-12-19T13:49:38.822427+0000","last_became_active":"2023-12-19T13:49:36.408561+0000","last_became_peered":"2023-12-19T13:49:36.408561+0000","last_unstale":"2023-12-19T13:49:38.822427+0000","last_undegraded":"2023-12-19T13:49:38.822427+0000","last_fullsized":"2023-12-19T13:49:38.822427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823203+0000","last_change":"2023-12-19T13:49:36.406690+0000","last_active":"2023-12-19T13:49:38.823203+0000","last_peered":"2023-12-19T13:49:38.823203+0000","last_clean":"2023-12-19T13:49:38.823203+0000","last_became_active":"2023-12-19T13:49:36.402517+0000","last_became_peered":"2023-12-19T13:49:36.402517+0000","last_unstale":"2023-12-19T13:49:38.823203+0000","last_undegraded":"2023-12-19T13:49:38.823203+0000","last_fullsized":"2023-12-19T13:49:38.823203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823578+0000","last_change":"2023-12-19T13:49:36.403170+0000","last_active":"2023-12-19T13:49:38.823578+0000","last_peered":"2023-12-19T13:49:38.823578+0000","last_clean":"2023-12-19T13:49:38.823578+0000","last_became_active":"2023-12-19T13:49:36.402945+0000","last_became_peered":"2023-12-19T13:49:36.402945+0000","last_unstale":"2023-12-19T13:49:38.823578+0000","last_undegraded":"2023-12-19T13:49:38.823578+0000","last_fullsized":"2023-12-19T13:49:38.823578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823214+0000","last_change":"2023-12-19T13:49:36.413468+0000","last_active":"2023-12-19T13:49:38.823214+0000","last_peered":"2023-12-19T13:49:38.823214+0000","last_clean":"2023-12-19T13:49:38.823214+0000","last_became_active":"2023-12-19T13:49:36.413122+0000","last_became_peered":"2023-12-19T13:49:36.413122+0000","last_unstale":"2023-12-19T13:49:38.823214+0000","last_undegraded":"2023-12-19T13:49:38.823214+0000","last_fullsized":"2023-12-19T13:49:38.823214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823105+0000","last_change":"2023-12-19T13:49:36.409909+0000","last_active":"2023-12-19T13:49:38.823105+0000","last_peered":"2023-12-19T13:49:38.823105+0000","last_clean":"2023-12-19T13:49:38.823105+0000","last_became_active":"2023-12-19T13:49:36.409492+0000","last_became_peered":"2023-12-19T13:49:36.409492+0000","last_unstale":"2023-12-19T13:49:38.823105+0000","last_undegraded":"2023-12-19T13:49:38.823105+0000","last_fullsized":"2023-12-19T13:49:38.823105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:05.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398483+0000","last_change":"2023-12-19T13:49:36.406713+0000","last_active":"2023-12-19T13:49:37.398483+0000","last_peered":"2023-12-19T13:49:37.398483+0000","last_clean":"2023-12-19T13:49:37.398483+0000","last_became_active":"2023-12-19T13:49:36.405725+0000","last_became_peered":"2023-12-19T13:49:36.405725+0000","last_unstale":"2023-12-19T13:49:37.398483+0000","last_undegraded":"2023-12-19T13:49:37.398483+0000","last_fullsized":"2023-12-19T13:49:37.398483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:34.189380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823717+0000","last_change":"2023-12-19T13:49:36.404081+0000","last_active":"2023-12-19T13:49:38.823717+0000","last_peered":"2023-12-19T13:49:38.823717+0000","last_clean":"2023-12-19T13:49:38.823717+0000","last_became_active":"2023-12-19T13:49:36.402206+0000","last_became_peered":"2023-12-19T13:49:36.402206+0000","last_unstale":"2023-12-19T13:49:38.823717+0000","last_undegraded":"2023-12-19T13:49:38.823717+0000","last_fullsized":"2023-12-19T13:49:38.823717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:29.166537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823769+0000","last_change":"2023-12-19T13:49:36.410096+0000","last_active":"2023-12-19T13:49:38.823769+0000","last_peered":"2023-12-19T13:49:38.823769+0000","last_clean":"2023-12-19T13:49:38.823769+0000","last_became_active":"2023-12-19T13:49:36.409874+0000","last_became_peered":"2023-12-19T13:49:36.409874+0000","last_unstale":"2023-12-19T13:49:38.823769+0000","last_undegraded":"2023-12-19T13:49:38.823769+0000","last_fullsized":"2023-12-19T13:49:38.823769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407746+0000","last_change":"2023-12-19T13:49:35.928447+0000","last_active":"2023-12-19T13:49:36.407746+0000","last_peered":"2023-12-19T13:49:36.407746+0000","last_clean":"2023-12-19T13:49:36.407746+0000","last_became_active":"2023-12-19T13:49:35.928154+0000","last_became_peered":"2023-12-19T13:49:35.928154+0000","last_unstale":"2023-12-19T13:49:36.407746+0000","last_undegraded":"2023-12-19T13:49:36.407746+0000","last_fullsized":"2023-12-19T13:49:36.407746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:45.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.896599+0000","last_change":"2023-12-19T13:49:34.896599+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.896599+0000","last_undegraded":"2023-12-19T13:49:34.896599+0000","last_fullsized":"2023-12-19T13:49:34.896599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:25.292841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900754+0000","last_change":"2023-12-19T13:49:34.900754+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900754+0000","last_undegraded":"2023-12-19T13:49:34.900754+0000","last_fullsized":"2023-12-19T13:49:34.900754+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:15:25.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414405+0000","last_change":"2023-12-19T13:49:35.924513+0000","last_active":"2023-12-19T13:49:36.414405+0000","last_peered":"2023-12-19T13:49:36.414405+0000","last_clean":"2023-12-19T13:49:36.414405+0000","last_became_active":"2023-12-19T13:49:35.924291+0000","last_became_peered":"2023-12-19T13:49:35.924291+0000","last_unstale":"2023-12-19T13:49:36.414405+0000","last_undegraded":"2023-12-19T13:49:36.414405+0000","last_fullsized":"2023-12-19T13:49:36.414405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:59.357889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416283+0000","last_change":"2023-12-19T13:49:35.929134+0000","last_active":"2023-12-19T13:49:36.416283+0000","last_peered":"2023-12-19T13:49:36.416283+0000","last_clean":"2023-12-19T13:49:36.416283+0000","last_became_active":"2023-12-19T13:49:35.928936+0000","last_became_peered":"2023-12-19T13:49:35.928936+0000","last_unstale":"2023-12-19T13:49:36.416283+0000","last_undegraded":"2023-12-19T13:49:36.416283+0000","last_fullsized":"2023-12-19T13:49:36.416283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:55.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823622+0000","last_change":"2023-12-19T13:49:36.413335+0000","last_active":"2023-12-19T13:49:38.823622+0000","last_peered":"2023-12-19T13:49:38.823622+0000","last_clean":"2023-12-19T13:49:38.823622+0000","last_became_active":"2023-12-19T13:49:36.412708+0000","last_became_peered":"2023-12-19T13:49:36.412708+0000","last_unstale":"2023-12-19T13:49:38.823622+0000","last_undegraded":"2023-12-19T13:49:38.823622+0000","last_fullsized":"2023-12-19T13:49:38.823622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.902229+0000","last_change":"2023-12-19T13:49:34.902229+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.902229+0000","last_undegraded":"2023-12-19T13:49:34.902229+0000","last_fullsized":"2023-12-19T13:49:34.902229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:05.089463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823797+0000","last_change":"2023-12-19T13:49:36.406246+0000","last_active":"2023-12-19T13:49:38.823797+0000","last_peered":"2023-12-19T13:49:38.823797+0000","last_clean":"2023-12-19T13:49:38.823797+0000","last_became_active":"2023-12-19T13:49:36.406037+0000","last_became_peered":"2023-12-19T13:49:36.406037+0000","last_unstale":"2023-12-19T13:49:38.823797+0000","last_undegraded":"2023-12-19T13:49:38.823797+0000","last_fullsized":"2023-12-19T13:49:38.823797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:36.830962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390136+0000","last_change":"2023-12-19T13:49:35.923214+0000","last_active":"2023-12-19T13:49:36.390136+0000","last_peered":"2023-12-19T13:49:36.390136+0000","last_clean":"2023-12-19T13:49:36.390136+0000","last_became_active":"2023-12-19T13:49:35.922966+0000","last_became_peered":"2023-12-19T13:49:35.922966+0000","last_unstale":"2023-12-19T13:49:36.390136+0000","last_undegraded":"2023-12-19T13:49:36.390136+0000","last_fullsized":"2023-12-19T13:49:36.390136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900860+0000","last_change":"2023-12-19T13:49:34.900860+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900860+0000","last_undegraded":"2023-12-19T13:49:34.900860+0000","last_fullsized":"2023-12-19T13:49:34.900860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389174+0000","last_change":"2023-12-19T13:49:35.929803+0000","last_active":"2023-12-19T13:49:36.389174+0000","last_peered":"2023-12-19T13:49:36.389174+0000","last_clean":"2023-12-19T13:49:36.389174+0000","last_became_active":"2023-12-19T13:49:35.929631+0000","last_became_peered":"2023-12-19T13:49:35.929631+0000","last_unstale":"2023-12-19T13:49:36.389174+0000","last_undegraded":"2023-12-19T13:49:36.389174+0000","last_fullsized":"2023-12-19T13:49:36.389174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:58:19.919170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822508+0000","last_change":"2023-12-19T13:49:36.404280+0000","last_active":"2023-12-19T13:49:38.822508+0000","last_peered":"2023-12-19T13:49:38.822508+0000","last_clean":"2023-12-19T13:49:38.822508+0000","last_became_active":"2023-12-19T13:49:36.403858+0000","last_became_peered":"2023-12-19T13:49:36.403858+0000","last_unstale":"2023-12-19T13:49:38.822508+0000","last_undegraded":"2023-12-19T13:49:38.822508+0000","last_fullsized":"2023-12-19T13:49:38.822508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900105+0000","last_change":"2023-12-19T13:49:34.900105+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900105+0000","last_undegraded":"2023-12-19T13:49:34.900105+0000","last_fullsized":"2023-12-19T13:49:34.900105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:51.647666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416507+0000","last_change":"2023-12-19T13:49:35.924025+0000","last_active":"2023-12-19T13:49:36.416507+0000","last_peered":"2023-12-19T13:49:36.416507+0000","last_clean":"2023-12-19T13:49:36.416507+0000","last_became_active":"2023-12-19T13:49:35.923797+0000","last_became_peered":"2023-12-19T13:49:35.923797+0000","last_unstale":"2023-12-19T13:49:36.416507+0000","last_undegraded":"2023-12-19T13:49:36.416507+0000","last_fullsized":"2023-12-19T13:49:36.416507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:18.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823533+0000","last_change":"2023-12-19T13:49:36.415145+0000","last_active":"2023-12-19T13:49:38.823533+0000","last_peered":"2023-12-19T13:49:38.823533+0000","last_clean":"2023-12-19T13:49:38.823533+0000","last_became_active":"2023-12-19T13:49:36.414802+0000","last_became_peered":"2023-12-19T13:49:36.414802+0000","last_unstale":"2023-12-19T13:49:38.823533+0000","last_undegraded":"2023-12-19T13:49:38.823533+0000","last_fullsized":"2023-12-19T13:49:38.823533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:28.229489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.899143+0000","last_change":"2023-12-19T13:49:34.899143+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.899143+0000","last_undegraded":"2023-12-19T13:49:34.899143+0000","last_fullsized":"2023-12-19T13:49:34.899143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398430+0000","last_change":"2023-12-19T13:49:36.401718+0000","last_active":"2023-12-19T13:49:37.398430+0000","last_peered":"2023-12-19T13:49:37.398430+0000","last_clean":"2023-12-19T13:49:37.398430+0000","last_became_active":"2023-12-19T13:49:36.401473+0000","last_became_peered":"2023-12-19T13:49:36.401473+0000","last_unstale":"2023-12-19T13:49:37.398430+0000","last_undegraded":"2023-12-19T13:49:37.398430+0000","last_fullsized":"2023-12-19T13:49:37.398430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:55.233175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.903501+0000","last_change":"2023-12-19T13:49:34.903501+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.903501+0000","last_undegraded":"2023-12-19T13:49:34.903501+0000","last_fullsized":"2023-12-19T13:49:34.903501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:46.501331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824036+0000","last_change":"2023-12-19T13:49:36.401160+0000","last_active":"2023-12-19T13:49:38.824036+0000","last_peered":"2023-12-19T13:49:38.824036+0000","last_clean":"2023-12-19T13:49:38.824036+0000","last_became_active":"2023-12-19T13:49:36.397578+0000","last_became_peered":"2023-12-19T13:49:36.397578+0000","last_unstale":"2023-12-19T13:49:38.824036+0000","last_undegraded":"2023-12-19T13:49:38.824036+0000","last_fullsized":"2023-12-19T13:49:38.824036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.396140+0000","last_change":"2023-12-19T13:49:35.921680+0000","last_active":"2023-12-19T13:49:36.396140+0000","last_peered":"2023-12-19T13:49:36.396140+0000","last_clean":"2023-12-19T13:49:36.396140+0000","last_became_active":"2023-12-19T13:49:35.921416+0000","last_became_peered":"2023-12-19T13:49:35.921416+0000","last_unstale":"2023-12-19T13:49:36.396140+0000","last_undegraded":"2023-12-19T13:49:36.396140+0000","last_fullsized":"2023-12-19T13:49:36.396140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:18.490775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398690+0000","last_change":"2023-12-19T13:49:36.402557+0000","last_active":"2023-12-19T13:49:37.398690+0000","last_peered":"2023-12-19T13:49:37.398690+0000","last_clean":"2023-12-19T13:49:37.398690+0000","last_became_active":"2023-12-19T13:49:36.402039+0000","last_became_peered":"2023-12-19T13:49:36.402039+0000","last_unstale":"2023-12-19T13:49:37.398690+0000","last_undegraded":"2023-12-19T13:49:37.398690+0000","last_fullsized":"2023-12-19T13:49:37.398690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:48.356106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.398168+0000","last_change":"2023-12-19T13:49:35.921988+0000","last_active":"2023-12-19T13:49:36.398168+0000","last_peered":"2023-12-19T13:49:36.398168+0000","last_clean":"2023-12-19T13:49:36.398168+0000","last_became_active":"2023-12-19T13:49:35.921781+0000","last_became_peered":"2023-12-19T13:49:35.921781+0000","last_unstale":"2023-12-19T13:49:36.398168+0000","last_undegraded":"2023-12-19T13:49:36.398168+0000","last_fullsized":"2023-12-19T13:49:36.398168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:20.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822533+0000","last_change":"2023-12-19T13:49:36.412408+0000","last_active":"2023-12-19T13:49:38.822533+0000","last_peered":"2023-12-19T13:49:38.822533+0000","last_clean":"2023-12-19T13:49:38.822533+0000","last_became_active":"2023-12-19T13:49:36.412195+0000","last_became_peered":"2023-12-19T13:49:36.412195+0000","last_unstale":"2023-12-19T13:49:38.822533+0000","last_undegraded":"2023-12-19T13:49:38.822533+0000","last_fullsized":"2023-12-19T13:49:38.822533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:00.107117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414513+0000","last_change":"2023-12-19T13:49:35.922220+0000","last_active":"2023-12-19T13:49:36.414513+0000","last_peered":"2023-12-19T13:49:36.414513+0000","last_clean":"2023-12-19T13:49:36.414513+0000","last_became_active":"2023-12-19T13:49:35.921380+0000","last_became_peered":"2023-12-19T13:49:35.921380+0000","last_unstale":"2023-12-19T13:49:36.414513+0000","last_undegraded":"2023-12-19T13:49:36.414513+0000","last_fullsized":"2023-12-19T13:49:36.414513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:15.756864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824265+0000","last_change":"2023-12-19T13:49:36.401948+0000","last_active":"2023-12-19T13:49:38.824265+0000","last_peered":"2023-12-19T13:49:38.824265+0000","last_clean":"2023-12-19T13:49:38.824265+0000","last_became_active":"2023-12-19T13:49:36.399248+0000","last_became_peered":"2023-12-19T13:49:36.399248+0000","last_unstale":"2023-12-19T13:49:38.824265+0000","last_undegraded":"2023-12-19T13:49:38.824265+0000","last_fullsized":"2023-12-19T13:49:38.824265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:21.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.895594+0000","last_change":"2023-12-19T13:49:34.895594+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.895594+0000","last_undegraded":"2023-12-19T13:49:34.895594+0000","last_fullsized":"2023-12-19T13:49:34.895594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:37.941627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822666+0000","last_change":"2023-12-19T13:49:36.408093+0000","last_active":"2023-12-19T13:49:38.822666+0000","last_peered":"2023-12-19T13:49:38.822666+0000","last_clean":"2023-12-19T13:49:38.822666+0000","last_became_active":"2023-12-19T13:49:36.407151+0000","last_became_peered":"2023-12-19T13:49:36.407151+0000","last_unstale":"2023-12-19T13:49:38.822666+0000","last_undegraded":"2023-12-19T13:49:38.822666+0000","last_fullsized":"2023-12-19T13:49:38.822666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.902664+0000","last_change":"2023-12-19T13:49:34.902664+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.902664+0000","last_undegraded":"2023-12-19T13:49:34.902664+0000","last_fullsized":"2023-12-19T13:49:34.902664+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:17.146776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414006+0000","last_change":"2023-12-19T13:49:35.930716+0000","last_active":"2023-12-19T13:49:36.414006+0000","last_peered":"2023-12-19T13:49:36.414006+0000","last_clean":"2023-12-19T13:49:36.414006+0000","last_became_active":"2023-12-19T13:49:35.930555+0000","last_became_peered":"2023-12-19T13:49:35.930555+0000","last_unstale":"2023-12-19T13:49:36.414006+0000","last_undegraded":"2023-12-19T13:49:36.414006+0000","last_fullsized":"2023-12-19T13:49:36.414006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822845+0000","last_change":"2023-12-19T13:49:36.405403+0000","last_active":"2023-12-19T13:49:38.822845+0000","last_peered":"2023-12-19T13:49:38.822845+0000","last_clean":"2023-12-19T13:49:38.822845+0000","last_became_active":"2023-12-19T13:49:36.405205+0000","last_became_peered":"2023-12-19T13:49:36.405205+0000","last_unstale":"2023-12-19T13:49:38.822845+0000","last_undegraded":"2023-12-19T13:49:38.822845+0000","last_fullsized":"2023-12-19T13:49:38.822845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:14.792675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.899133+0000","last_change":"2023-12-19T13:49:34.899133+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.899133+0000","last_undegraded":"2023-12-19T13:49:34.899133+0000","last_fullsized":"2023-12-19T13:49:34.899133+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:17.486114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398893+0000","last_change":"2023-12-19T13:49:36.406414+0000","last_active":"2023-12-19T13:49:37.398893+0000","last_peered":"2023-12-19T13:49:37.398893+0000","last_clean":"2023-12-19T13:49:37.398893+0000","last_became_active":"2023-12-19T13:49:36.404928+0000","last_became_peered":"2023-12-19T13:49:36.404928+0000","last_unstale":"2023-12-19T13:49:37.398893+0000","last_undegraded":"2023-12-19T13:49:37.398893+0000","last_fullsized":"2023-12-19T13:49:37.398893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:31.791070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407855+0000","last_change":"2023-12-19T13:49:35.932840+0000","last_active":"2023-12-19T13:49:36.407855+0000","last_peered":"2023-12-19T13:49:36.407855+0000","last_clean":"2023-12-19T13:49:36.407855+0000","last_became_active":"2023-12-19T13:49:35.931197+0000","last_became_peered":"2023-12-19T13:49:35.931197+0000","last_unstale":"2023-12-19T13:49:36.407855+0000","last_undegraded":"2023-12-19T13:49:36.407855+0000","last_fullsized":"2023-12-19T13:49:36.407855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:01.364262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.904300+0000","last_change":"2023-12-19T13:49:34.904300+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.904300+0000","last_undegraded":"2023-12-19T13:49:34.904300+0000","last_fullsized":"2023-12-19T13:49:34.904300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:11.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389289+0000","last_change":"2023-12-19T13:49:35.934554+0000","last_active":"2023-12-19T13:49:36.389289+0000","last_peered":"2023-12-19T13:49:36.389289+0000","last_clean":"2023-12-19T13:49:36.389289+0000","last_became_active":"2023-12-19T13:49:35.934390+0000","last_became_peered":"2023-12-19T13:49:35.934390+0000","last_unstale":"2023-12-19T13:49:36.389289+0000","last_undegraded":"2023-12-19T13:49:36.389289+0000","last_fullsized":"2023-12-19T13:49:36.389289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824229+0000","last_change":"2023-12-19T13:49:36.406483+0000","last_active":"2023-12-19T13:49:38.824229+0000","last_peered":"2023-12-19T13:49:38.824229+0000","last_clean":"2023-12-19T13:49:38.824229+0000","last_became_active":"2023-12-19T13:49:36.402037+0000","last_became_peered":"2023-12-19T13:49:36.402037+0000","last_unstale":"2023-12-19T13:49:38.824229+0000","last_undegraded":"2023-12-19T13:49:38.824229+0000","last_fullsized":"2023-12-19T13:49:38.824229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.895432+0000","last_change":"2023-12-19T13:49:34.895432+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.895432+0000","last_undegraded":"2023-12-19T13:49:34.895432+0000","last_fullsized":"2023-12-19T13:49:34.895432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:30.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822793+0000","last_change":"2023-12-19T13:49:36.400530+0000","last_active":"2023-12-19T13:49:38.822793+0000","last_peered":"2023-12-19T13:49:38.822793+0000","last_clean":"2023-12-19T13:49:38.822793+0000","last_became_active":"2023-12-19T13:49:36.400046+0000","last_became_peered":"2023-12-19T13:49:36.400046+0000","last_unstale":"2023-12-19T13:49:38.822793+0000","last_undegraded":"2023-12-19T13:49:38.822793+0000","last_fullsized":"2023-12-19T13:49:38.822793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:56.941388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900983+0000","last_change":"2023-12-19T13:49:34.900983+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900983+0000","last_undegraded":"2023-12-19T13:49:34.900983+0000","last_fullsized":"2023-12-19T13:49:34.900983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:17.202412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390316+0000","last_change":"2023-12-19T13:49:35.924316+0000","last_active":"2023-12-19T13:49:36.390316+0000","last_peered":"2023-12-19T13:49:36.390316+0000","last_clean":"2023-12-19T13:49:36.390316+0000","last_became_active":"2023-12-19T13:49:35.924099+0000","last_became_peered":"2023-12-19T13:49:35.924099+0000","last_unstale":"2023-12-19T13:49:36.390316+0000","last_undegraded":"2023-12-19T13:49:36.390316+0000","last_fullsized":"2023-12-19T13:49:36.390316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:07.758117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.393487+0000","last_change":"2023-12-19T13:49:35.924508+0000","last_active":"2023-12-19T13:49:36.393487+0000","last_peered":"2023-12-19T13:49:36.393487+0000","last_clean":"2023-12-19T13:49:36.393487+0000","last_became_active":"2023-12-19T13:49:35.923964+0000","last_became_peered":"2023-12-19T13:49:35.923964+0000","last_unstale":"2023-12-19T13:49:36.393487+0000","last_undegraded":"2023-12-19T13:49:36.393487+0000","last_fullsized":"2023-12-19T13:49:36.393487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.896352+0000","last_change":"2023-12-19T13:49:34.896352+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.896352+0000","last_undegraded":"2023-12-19T13:49:34.896352+0000","last_fullsized":"2023-12-19T13:49:34.896352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.391631+0000","last_change":"2023-12-19T13:49:35.934965+0000","last_active":"2023-12-19T13:49:36.391631+0000","last_peered":"2023-12-19T13:49:36.391631+0000","last_clean":"2023-12-19T13:49:36.391631+0000","last_became_active":"2023-12-19T13:49:35.934823+0000","last_became_peered":"2023-12-19T13:49:35.934823+0000","last_unstale":"2023-12-19T13:49:36.391631+0000","last_undegraded":"2023-12-19T13:49:36.391631+0000","last_fullsized":"2023-12-19T13:49:36.391631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.898613+0000","last_change":"2023-12-19T13:49:34.898613+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.898613+0000","last_undegraded":"2023-12-19T13:49:34.898613+0000","last_fullsized":"2023-12-19T13:49:34.898613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900116+0000","last_change":"2023-12-19T13:49:34.900116+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900116+0000","last_undegraded":"2023-12-19T13:49:34.900116+0000","last_fullsized":"2023-12-19T13:49:34.900116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:43:25.064014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900087+0000","last_change":"2023-12-19T13:49:34.900087+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900087+0000","last_undegraded":"2023-12-19T13:49:34.900087+0000","last_fullsized":"2023-12-19T13:49:34.900087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390447+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:49:36.390447+0000","last_peered":"2023-12-19T13:49:36.390447+0000","last_clean":"2023-12-19T13:49:36.390447+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:49:36.390447+0000","last_undegraded":"2023-12-19T13:49:36.390447+0000","last_fullsized":"2023-12-19T13:49:36.390447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":348,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194964,"statfs":{"total":200000000,"available":199643629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.0009999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.375,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0049999999999999,"15min":0.98299999999999998},"min":{"1min":0.64000000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3380000000000001,"5min":2.008,"15min":2.008},"last":1.496}]},{"osd":1,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.079,"15min":1.069},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.429},{"interface":"front","average":{"1min":1.101,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4079999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.391}]},{"osd":2,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1399999999999999,"15min":1.133},"min":{"1min":0.81399999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.71,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.653},{"interface":"front","average":{"1min":1.147,"5min":1.1699999999999999,"15min":1.147},"min":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4299999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.597,"5min":1.931,"15min":1.931},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.252,"15min":1.23},"min":{"1min":0.79600000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7470000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.105}]},{"osd":4,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.282,"15min":1.286},"min":{"1min":0.84499999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6519999999999999,"5min":2.181,"15min":2.181},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.3859999999999999,"15min":1.3979999999999999},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.673,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.002}]},{"osd":5,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.24,"15min":1.222},"min":{"1min":0.871,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5429999999999999,"5min":1.956,"15min":1.956},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.4339999999999999,"15min":1.429},"min":{"1min":1.038,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.5209999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.292,"15min":1.262},"min":{"1min":0.90300000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6850000000000001,"5min":2.024,"15min":2.024},"last":1.26},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5049999999999999,"15min":1.4870000000000001},"min":{"1min":1.2050000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.796,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.597}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.0289999999999999},"min":{"1min":0.629,"5min":0.628,"15min":0.628},"max":{"1min":1.502,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.089,"15min":1.121},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3400000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.05,"15min":1.03},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.962,"15min":1.962},"last":1.071},{"interface":"front","average":{"1min":1.137,"5min":1.0620000000000001,"15min":1.032},"min":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5860000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.4319999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.2210000000000001},"min":{"1min":0.82499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6970000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.351},{"interface":"front","average":{"1min":1.254,"5min":1.173,"15min":1.151},"min":{"1min":0.96299999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6140000000000001,"5min":1.786,"15min":1.786},"last":1.0489999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3169999999999999,"15min":1.3520000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.478,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.266,"15min":1.272},"min":{"1min":1.024,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6299999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.2989999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.226,"15min":1.204},"min":{"1min":0.92600000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.484},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.3120000000000001,"15min":1.292},"min":{"1min":1.0920000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.228}]},{"osd":5,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.268,"15min":1.246},"min":{"1min":1.135,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6120000000000001,"5min":1.827,"15min":1.827},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.399,"15min":1.371},"min":{"1min":1.2849999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.5369999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.4159999999999999},"min":{"1min":1.0840000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.377,"15min":1.355},"min":{"1min":1.2430000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.766,"15min":1.766},"last":1.498}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194382,"statfs":{"total":200000000,"available":199047444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.595,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0509999999999999,"15min":1.0609999999999999},"min":{"1min":0.68700000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.1220000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.423,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.125,"5min":1.024,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3939999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.0840000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.202,"15min":1.246},"min":{"1min":0.83399999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3280000000000001,"5min":2.827,"15min":2.827},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.25,"15min":1.2689999999999999},"min":{"1min":0.93200000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5209999999999999,"5min":2.863,"15min":2.863},"last":1.042}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2090000000000001,"15min":1.204},"min":{"1min":1.0429999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.623,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.244,"15min":1.242},"min":{"1min":0.87,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5940000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.3169999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.153,"15min":1.137},"min":{"1min":0.90400000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5169999999999999,"5min":1.982,"15min":1.982},"last":1.228},{"interface":"front","average":{"1min":1.288,"5min":1.278,"15min":1.2769999999999999},"min":{"1min":0.88,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.474,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5980000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.343,"15min":1.3169999999999999},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.579,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.181},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.357,"15min":1.369},"min":{"1min":1.0609999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.6479999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.5029999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3959999999999999,"15min":1.401},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7090000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.427,"15min":1.403},"min":{"1min":1.2470000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6910000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.4830000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199617846,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.657,"15min":1.657},"last":1.113},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1259999999999999},"min":{"1min":0.69499999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.542,"5min":2.016,"15min":2.016},"last":0.85399999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.073,"15min":1.069},"min":{"1min":0.76600000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.1000000000000001,"15min":1.1140000000000001},"min":{"1min":0.754,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4039999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0580000000000001,"15min":1.0169999999999999},"min":{"1min":0.76500000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1120000000000001,"15min":1.105},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.405,"5min":1.575,"15min":1.575},"last":1.143}]},{"osd":3,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.206,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.952,"15min":1.952},"last":1.288},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.258,"15min":1.274},"min":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.482,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.25}]},{"osd":5,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.216,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.165,"15min":2.165},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.325,"15min":1.343},"min":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6970000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.405}]},{"osd":6,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.85099999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.595,"5min":2.335,"15min":2.335},"last":1.5640000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4490000000000001,"15min":1.46},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.782,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.5,"15min":1.522},"min":{"1min":0.89300000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.921,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.6499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.89200000000000002,"15min":0.95599999999999996},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2290000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.94499999999999995,"15min":0.97799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.4590000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":1.032},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.006},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96399999999999997,"15min":0.99399999999999999},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2589999999999999,"5min":2.387,"15min":2.387},"last":0.87}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.097,"15min":1.143},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4690000000000001,"5min":2.657,"15min":2.657},"last":0.78900000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.236,"15min":1.272},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.51,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.353},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.21,"15min":1.23},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6419999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.151}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.278,"15min":1.3140000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.7030000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.256,"15min":1.276},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.671,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.21}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.637,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.321,"15min":1.349},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":2.698,"15min":2.698},"last":1.389}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.337,"15min":1.3759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.76,"5min":3.609,"15min":3.609},"last":1.47},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.02,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.4370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":2.258,"15min":2.258},"last":1.022},{"interface":"front","average":{"1min":1.468,"5min":0.91700000000000004,"15min":0.81699999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":11.85,"5min":11.85,"15min":11.85},"last":1.3560000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.363,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.625,"5min":1.018,"15min":0.92500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":11.788,"5min":11.788,"15min":11.788},"last":1.2150000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.397,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.089},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.0569999999999999,"15min":1.0269999999999999},"min":{"1min":0.501,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.8079999999999998,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":1.2490000000000001,"15min":1.1559999999999999},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6679999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.27}]},{"osd":5,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.321,"15min":1.2190000000000001},"min":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":11.888,"5min":11.888,"15min":11.888},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.302,"15min":1.306},"min":{"1min":1.014,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9850000000000001,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3140000000000001,"15min":1.3180000000000001},"min":{"1min":0.88300000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0640000000000001,"5min":2.964,"15min":2.964},"last":1},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2629999999999999,"15min":1.2490000000000001},"min":{"1min":0.85399999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.944,"5min":2.286,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0369999999999999,"5min":2.351,"15min":2.351},"last":1.1779999999999999},{"interface":"front","average":{"1min":2.0110000000000001,"5min":1.375,"15min":1.282},"min":{"1min":0.82099999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":11.962999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.4570000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194362,"statfs":{"total":200000000,"available":199027512,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.82599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.26,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.351,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.044,"15min":1.1000000000000001},"min":{"1min":0.51600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.012},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.169,"15min":1.1930000000000001},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7829999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.0469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.117,"15min":1.2030000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3009999999999999,"5min":7.157,"15min":7.157},"last":1.079}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.236},"min":{"1min":0.83299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.575,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.282,"15min":1.304},"min":{"1min":0.85499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.738,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.94599999999999995}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.294,"15min":1.337},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1669999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.135},{"interface":"front","average":{"1min":1.994,"5min":1.468,"15min":1.3979999999999999},"min":{"1min":0.81200000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":15.576000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.335,"15min":1.351},"min":{"1min":0.75800000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8260000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.254},{"interface":"front","average":{"1min":1.278,"5min":1.379,"15min":1.4339999999999999},"min":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.226,"5min":3.786,"15min":3.786},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.409,"15min":1.458},"min":{"1min":0.84799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.9039999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.355},{"interface":"front","average":{"1min":1.258,"5min":1.421,"15min":1.476},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6830000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.2290000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4430000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.53600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":14.010999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.7919999999999998,"5min":1.238,"15min":0.99099999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":33.799999999999997,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.1930000000000001},{"interface":"front","average":{"1min":3.302,"5min":1.3759999999999999,"15min":1.0660000000000001},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":41.758000000000003,"5min":41.758000000000003,"15min":41.758000000000003},"last":1.55}]},{"osd":3,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.93500000000000005,"15min":1.0229999999999999},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4330000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.048,"15min":1.0960000000000001},"min":{"1min":0.46600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3759999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.496}]},{"osd":4,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5149999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.994,"5min":1.323,"15min":1.2030000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":1.8140000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.3200000000000001,"15min":1.2110000000000001},"min":{"1min":0.83699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":14.337999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.8999999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.6279999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.282,"15min":1.248},"min":{"1min":0.72999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":5.4669999999999996,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.8939999999999999},{"interface":"front","average":{"1min":2.23,"5min":1.4399999999999999,"15min":1.3120000000000001},"min":{"1min":0.94799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":17.161000000000001,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.774}]},{"osd":7,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.429,"15min":1.323},"min":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":1.325},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.4239999999999999,"15min":1.411},"min":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":9.7080000000000002,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.7230000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:49:40.841 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:49:40.858 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-12-19T13:49:40.859+0000 7f1a2e71c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:49:41.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.091+0000 7fed92657640 1 Processor -- start 2023-12-19T13:49:41.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.092+0000 7fed92657640 1 -- start start 2023-12-19T13:49:41.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.093+0000 7fed92657640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fed8c0b1710 0x7fed8c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.093+0000 7fed92657640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0b2600 con 0x7fed8c157aa0 2023-12-19T13:49:41.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.093+0000 7fed92657640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0b1d60 con 0x7fed8c15e040 2023-12-19T13:49:41.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.093+0000 7fed92657640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0b2040 con 0x7fed8c0b1710 2023-12-19T13:49:41.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed8bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fed8c157aa0 0x7fed8c161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59250/0 (socket says 172.21.15.113:59250) 2023-12-19T13:49:41.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed8bfff640 1 -- 172.21.15.113:0/3808248899 learned_addr learned my addr 172.21.15.113:0/3808248899 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:41.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed83fff640 1 --2- 172.21.15.113:0/3808248899 >> v2:172.21.15.113:3300/0 conn(0x7fed8c0b1710 0x7fed8c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed8b7fe640 1 -- 172.21.15.113:0/3808248899 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952193651 0 0) 0x7fed8c0b2600 con 0x7fed8c157aa0 2023-12-19T13:49:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed8b7fe640 1 -- 172.21.15.113:0/3808248899 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed78003520 con 0x7fed8c157aa0 2023-12-19T13:49:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed83fff640 1 -- 172.21.15.113:0/3808248899 >> v1:172.21.15.151:6789/0 conn(0x7fed8c15e040 legacy=0x7fed8c0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed83fff640 1 -- 172.21.15.113:0/3808248899 >> v1:172.21.15.113:6789/0 conn(0x7fed8c157aa0 legacy=0x7fed8c161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.094+0000 7fed83fff640 1 -- 172.21.15.113:0/3808248899 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0b2320 con 0x7fed8c0b1710 2023-12-19T13:49:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.095+0000 7fed83fff640 1 --2- 172.21.15.113:0/3808248899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c0b1710 0x7fed8c06e410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fed740097a0 tx=0x7fed7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa58919e9020ef3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed8b7fe640 1 -- 172.21.15.113:0/3808248899 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74031830 con 0x7fed8c0b1710 2023-12-19T13:49:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed8b7fe640 1 -- 172.21.15.113:0/3808248899 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed74031990 con 0x7fed8c0b1710 2023-12-19T13:49:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed8b7fe640 1 -- 172.21.15.113:0/3808248899 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74031d00 con 0x7fed8c0b1710 2023-12-19T13:49:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed92657640 1 -- 172.21.15.113:0/3808248899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c0b1710 msgr2=0x7fed8c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed92657640 1 --2- 172.21.15.113:0/3808248899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c0b1710 0x7fed8c06e410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fed740097a0 tx=0x7fed7402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed92657640 1 -- 172.21.15.113:0/3808248899 shutdown_connections 2023-12-19T13:49:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed92657640 1 --2- 172.21.15.113:0/3808248899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c0b1710 0x7fed8c06e410 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed92657640 1 -- 172.21.15.113:0/3808248899 >> 172.21.15.113:0/3808248899 conn(0x7fed8c0cbb70 msgr2=0x7fed8c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:41.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed92657640 1 -- 172.21.15.113:0/3808248899 shutdown_connections 2023-12-19T13:49:41.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.096+0000 7fed92657640 1 -- 172.21.15.113:0/3808248899 wait complete. 2023-12-19T13:49:41.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.098+0000 7fed92657640 1 Processor -- start 2023-12-19T13:49:41.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.098+0000 7fed92657640 1 -- start start 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed92657640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed8c0b1710 0x7fed8c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed92657640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed8c157aa0 0x7fed8c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed92657640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c15e040 0x7fed8c159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed92657640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1f3af0 con 0x7fed8c15e040 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed92657640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c158000 con 0x7fed8c157aa0 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed92657640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1582e0 con 0x7fed8c0b1710 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed90bf4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c15e040 0x7fed8c159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed90bf4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c15e040 0x7fed8c159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58160/0 (socket says 172.21.15.113:58160) 2023-12-19T13:49:41.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.099+0000 7fed90bf4640 1 -- 172.21.15.113:0/1635438701 learned_addr learned my addr 172.21.15.113:0/1635438701 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:41.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed8bfff640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed8c0b1710 0x7fed8c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed83fff640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed8c157aa0 0x7fed8c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed90bf4640 1 -- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed8c0b1710 msgr2=0x7fed8c156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed90bf4640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed8c0b1710 0x7fed8c156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed90bf4640 1 -- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed8c157aa0 msgr2=0x7fed8c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed90bf4640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed8c157aa0 0x7fed8c06d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed90bf4640 1 -- 172.21.15.113:0/1635438701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74009400 con 0x7fed8c15e040 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed90bf4640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c15e040 0x7fed8c159cc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fed8400b970 tx=0x7fed8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed897fa640 1 -- 172.21.15.113:0/1635438701 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400cb40 con 0x7fed8c15e040 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed897fa640 1 -- 172.21.15.113:0/1635438701 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8400cca0 con 0x7fed8c15e040 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed897fa640 1 -- 172.21.15.113:0/1635438701 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84014680 con 0x7fed8c15e040 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.100+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c1585c0 con 0x7fed8c15e040 2023-12-19T13:49:41.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.101+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c158b80 con 0x7fed8c15e040 2023-12-19T13:49:41.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.102+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c0706d0 con 0x7fed8c15e040 2023-12-19T13:49:41.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.103+0000 7fed897fa640 1 -- 172.21.15.113:0/1635438701 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fed8401d3b0 con 0x7fed8c15e040 2023-12-19T13:49:41.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.103+0000 7fed897fa640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fed6c06a430 0x7fed6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.103+0000 7fed897fa640 1 -- 172.21.15.113:0/1635438701 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed84088730 con 0x7fed8c15e040 2023-12-19T13:49:41.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.104+0000 7fed8bfff640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fed6c06a430 0x7fed6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.104+0000 7fed8bfff640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fed6c06a430 0x7fed6c06c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed7c000f60 tx=0x7fed7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:41.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.108+0000 7fed897fa640 1 -- 172.21.15.113:0/1635438701 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fed84053db0 con 0x7fed8c15e040 2023-12-19T13:49:41.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.293+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed8c157e80 con 0x7fed6c06a430 2023-12-19T13:49:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.314+0000 7fed897fa640 1 -- 172.21.15.113:0/1635438701 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277051 (secure 0 0 0) 0x7fed7c0058d0 con 0x7fed6c06a430 2023-12-19T13:49:41.318 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:41.319 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:49:41.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fed6c06a430 msgr2=0x7fed6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fed6c06a430 0x7fed6c06c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed7c000f60 tx=0x7fed7c009040 comp rx=0 tx=0).stop 2023-12-19T13:49:41.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c15e040 msgr2=0x7fed8c159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c15e040 0x7fed8c159cc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fed8400b970 tx=0x7fed8400be30 comp rx=0 tx=0).stop 2023-12-19T13:49:41.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 shutdown_connections 2023-12-19T13:49:41.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fed6c06a430 0x7fed6c06c8f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed8c15e040 0x7fed8c159cc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed8c157aa0 0x7fed8c06d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 --2- 172.21.15.113:0/1635438701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed8c0b1710 0x7fed8c156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 >> 172.21.15.113:0/1635438701 conn(0x7fed8c0cbb70 msgr2=0x7fed8c15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:41.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 shutdown_connections 2023-12-19T13:49:41.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.321+0000 7fed92657640 1 -- 172.21.15.113:0/1635438701 wait complete. 2023-12-19T13:49:41.339 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-12-19T13:49:40.467414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4055,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558444,"statfs":{"total":1600000000,"available":1595847165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.573522"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822971+0000","last_change":"2023-12-19T13:49:36.394475+0000","last_active":"2023-12-19T13:49:38.822971+0000","last_peered":"2023-12-19T13:49:38.822971+0000","last_clean":"2023-12-19T13:49:38.822971+0000","last_became_active":"2023-12-19T13:49:36.394262+0000","last_became_peered":"2023-12-19T13:49:36.394262+0000","last_unstale":"2023-12-19T13:49:38.822971+0000","last_undegraded":"2023-12-19T13:49:38.822971+0000","last_fullsized":"2023-12-19T13:49:38.822971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:36.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822286+0000","last_change":"2023-12-19T13:49:36.403203+0000","last_active":"2023-12-19T13:49:38.822286+0000","last_peered":"2023-12-19T13:49:38.822286+0000","last_clean":"2023-12-19T13:49:38.822286+0000","last_became_active":"2023-12-19T13:49:36.402982+0000","last_became_peered":"2023-12-19T13:49:36.402982+0000","last_unstale":"2023-12-19T13:49:38.822286+0000","last_undegraded":"2023-12-19T13:49:38.822286+0000","last_fullsized":"2023-12-19T13:49:38.822286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:39.662682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822451+0000","last_change":"2023-12-19T13:49:36.403126+0000","last_active":"2023-12-19T13:49:38.822451+0000","last_peered":"2023-12-19T13:49:38.822451+0000","last_clean":"2023-12-19T13:49:38.822451+0000","last_became_active":"2023-12-19T13:49:36.399427+0000","last_became_peered":"2023-12-19T13:49:36.399427+0000","last_unstale":"2023-12-19T13:49:38.822451+0000","last_undegraded":"2023-12-19T13:49:38.822451+0000","last_fullsized":"2023-12-19T13:49:38.822451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:39.487118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398255+0000","last_change":"2023-12-19T13:49:36.406555+0000","last_active":"2023-12-19T13:49:37.398255+0000","last_peered":"2023-12-19T13:49:37.398255+0000","last_clean":"2023-12-19T13:49:37.398255+0000","last_became_active":"2023-12-19T13:49:36.405313+0000","last_became_peered":"2023-12-19T13:49:36.405313+0000","last_unstale":"2023-12-19T13:49:37.398255+0000","last_undegraded":"2023-12-19T13:49:37.398255+0000","last_fullsized":"2023-12-19T13:49:37.398255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:56.630159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822858+0000","last_change":"2023-12-19T13:49:36.404369+0000","last_active":"2023-12-19T13:49:38.822858+0000","last_peered":"2023-12-19T13:49:38.822858+0000","last_clean":"2023-12-19T13:49:38.822858+0000","last_became_active":"2023-12-19T13:49:36.404095+0000","last_became_peered":"2023-12-19T13:49:36.404095+0000","last_unstale":"2023-12-19T13:49:38.822858+0000","last_undegraded":"2023-12-19T13:49:38.822858+0000","last_fullsized":"2023-12-19T13:49:38.822858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398615+0000","last_change":"2023-12-19T13:49:36.403893+0000","last_active":"2023-12-19T13:49:37.398615+0000","last_peered":"2023-12-19T13:49:37.398615+0000","last_clean":"2023-12-19T13:49:37.398615+0000","last_became_active":"2023-12-19T13:49:36.400637+0000","last_became_peered":"2023-12-19T13:49:36.400637+0000","last_unstale":"2023-12-19T13:49:37.398615+0000","last_undegraded":"2023-12-19T13:49:37.398615+0000","last_fullsized":"2023-12-19T13:49:37.398615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:04.169818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822427+0000","last_change":"2023-12-19T13:49:36.408953+0000","last_active":"2023-12-19T13:49:38.822427+0000","last_peered":"2023-12-19T13:49:38.822427+0000","last_clean":"2023-12-19T13:49:38.822427+0000","last_became_active":"2023-12-19T13:49:36.408561+0000","last_became_peered":"2023-12-19T13:49:36.408561+0000","last_unstale":"2023-12-19T13:49:38.822427+0000","last_undegraded":"2023-12-19T13:49:38.822427+0000","last_fullsized":"2023-12-19T13:49:38.822427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823203+0000","last_change":"2023-12-19T13:49:36.406690+0000","last_active":"2023-12-19T13:49:38.823203+0000","last_peered":"2023-12-19T13:49:38.823203+0000","last_clean":"2023-12-19T13:49:38.823203+0000","last_became_active":"2023-12-19T13:49:36.402517+0000","last_became_peered":"2023-12-19T13:49:36.402517+0000","last_unstale":"2023-12-19T13:49:38.823203+0000","last_undegraded":"2023-12-19T13:49:38.823203+0000","last_fullsized":"2023-12-19T13:49:38.823203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823578+0000","last_change":"2023-12-19T13:49:36.403170+0000","last_active":"2023-12-19T13:49:38.823578+0000","last_peered":"2023-12-19T13:49:38.823578+0000","last_clean":"2023-12-19T13:49:38.823578+0000","last_became_active":"2023-12-19T13:49:36.402945+0000","last_became_peered":"2023-12-19T13:49:36.402945+0000","last_unstale":"2023-12-19T13:49:38.823578+0000","last_undegraded":"2023-12-19T13:49:38.823578+0000","last_fullsized":"2023-12-19T13:49:38.823578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823214+0000","last_change":"2023-12-19T13:49:36.413468+0000","last_active":"2023-12-19T13:49:38.823214+0000","last_peered":"2023-12-19T13:49:38.823214+0000","last_clean":"2023-12-19T13:49:38.823214+0000","last_became_active":"2023-12-19T13:49:36.413122+0000","last_became_peered":"2023-12-19T13:49:36.413122+0000","last_unstale":"2023-12-19T13:49:38.823214+0000","last_undegraded":"2023-12-19T13:49:38.823214+0000","last_fullsized":"2023-12-19T13:49:38.823214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823105+0000","last_change":"2023-12-19T13:49:36.409909+0000","last_active":"2023-12-19T13:49:38.823105+0000","last_peered":"2023-12-19T13:49:38.823105+0000","last_clean":"2023-12-19T13:49:38.823105+0000","last_became_active":"2023-12-19T13:49:36.409492+0000","last_became_peered":"2023-12-19T13:49:36.409492+0000","last_unstale":"2023-12-19T13:49:38.823105+0000","last_undegraded":"2023-12-19T13:49:38.823105+0000","last_fullsized":"2023-12-19T13:49:38.823105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:05.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398483+0000","last_change":"2023-12-19T13:49:36.406713+0000","last_active":"2023-12-19T13:49:37.398483+0000","last_peered":"2023-12-19T13:49:37.398483+0000","last_clean":"2023-12-19T13:49:37.398483+0000","last_became_active":"2023-12-19T13:49:36.405725+0000","last_became_peered":"2023-12-19T13:49:36.405725+0000","last_unstale":"2023-12-19T13:49:37.398483+0000","last_undegraded":"2023-12-19T13:49:37.398483+0000","last_fullsized":"2023-12-19T13:49:37.398483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:34.189380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823717+0000","last_change":"2023-12-19T13:49:36.404081+0000","last_active":"2023-12-19T13:49:38.823717+0000","last_peered":"2023-12-19T13:49:38.823717+0000","last_clean":"2023-12-19T13:49:38.823717+0000","last_became_active":"2023-12-19T13:49:36.402206+0000","last_became_peered":"2023-12-19T13:49:36.402206+0000","last_unstale":"2023-12-19T13:49:38.823717+0000","last_undegraded":"2023-12-19T13:49:38.823717+0000","last_fullsized":"2023-12-19T13:49:38.823717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:29.166537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823769+0000","last_change":"2023-12-19T13:49:36.410096+0000","last_active":"2023-12-19T13:49:38.823769+0000","last_peered":"2023-12-19T13:49:38.823769+0000","last_clean":"2023-12-19T13:49:38.823769+0000","last_became_active":"2023-12-19T13:49:36.409874+0000","last_became_peered":"2023-12-19T13:49:36.409874+0000","last_unstale":"2023-12-19T13:49:38.823769+0000","last_undegraded":"2023-12-19T13:49:38.823769+0000","last_fullsized":"2023-12-19T13:49:38.823769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407746+0000","last_change":"2023-12-19T13:49:35.928447+0000","last_active":"2023-12-19T13:49:36.407746+0000","last_peered":"2023-12-19T13:49:36.407746+0000","last_clean":"2023-12-19T13:49:36.407746+0000","last_became_active":"2023-12-19T13:49:35.928154+0000","last_became_peered":"2023-12-19T13:49:35.928154+0000","last_unstale":"2023-12-19T13:49:36.407746+0000","last_undegraded":"2023-12-19T13:49:36.407746+0000","last_fullsized":"2023-12-19T13:49:36.407746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:45.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.896599+0000","last_change":"2023-12-19T13:49:34.896599+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.896599+0000","last_undegraded":"2023-12-19T13:49:34.896599+0000","last_fullsized":"2023-12-19T13:49:34.896599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:25.292841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900754+0000","last_change":"2023-12-19T13:49:34.900754+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900754+0000","last_undegraded":"2023-12-19T13:49:34.900754+0000","last_fullsized":"2023-12-19T13:49:34.900754+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:15:25.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414405+0000","last_change":"2023-12-19T13:49:35.924513+0000","last_active":"2023-12-19T13:49:36.414405+0000","last_peered":"2023-12-19T13:49:36.414405+0000","last_clean":"2023-12-19T13:49:36.414405+0000","last_became_active":"2023-12-19T13:49:35.924291+0000","last_became_peered":"2023-12-19T13:49:35.924291+0000","last_unstale":"2023-12-19T13:49:36.414405+0000","last_undegraded":"2023-12-19T13:49:36.414405+0000","last_fullsized":"2023-12-19T13:49:36.414405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:59.357889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416283+0000","last_change":"2023-12-19T13:49:35.929134+0000","last_active":"2023-12-19T13:49:36.416283+0000","last_peered":"2023-12-19T13:49:36.416283+0000","last_clean":"2023-12-19T13:49:36.416283+0000","last_became_active":"2023-12-19T13:49:35.928936+0000","last_became_peered":"2023-12-19T13:49:35.928936+0000","last_unstale":"2023-12-19T13:49:36.416283+0000","last_undegraded":"2023-12-19T13:49:36.416283+0000","last_fullsized":"2023-12-19T13:49:36.416283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:55.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823622+0000","last_change":"2023-12-19T13:49:36.413335+0000","last_active":"2023-12-19T13:49:38.823622+0000","last_peered":"2023-12-19T13:49:38.823622+0000","last_clean":"2023-12-19T13:49:38.823622+0000","last_became_active":"2023-12-19T13:49:36.412708+0000","last_became_peered":"2023-12-19T13:49:36.412708+0000","last_unstale":"2023-12-19T13:49:38.823622+0000","last_undegraded":"2023-12-19T13:49:38.823622+0000","last_fullsized":"2023-12-19T13:49:38.823622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.902229+0000","last_change":"2023-12-19T13:49:34.902229+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.902229+0000","last_undegraded":"2023-12-19T13:49:34.902229+0000","last_fullsized":"2023-12-19T13:49:34.902229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:05.089463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823797+0000","last_change":"2023-12-19T13:49:36.406246+0000","last_active":"2023-12-19T13:49:38.823797+0000","last_peered":"2023-12-19T13:49:38.823797+0000","last_clean":"2023-12-19T13:49:38.823797+0000","last_became_active":"2023-12-19T13:49:36.406037+0000","last_became_peered":"2023-12-19T13:49:36.406037+0000","last_unstale":"2023-12-19T13:49:38.823797+0000","last_undegraded":"2023-12-19T13:49:38.823797+0000","last_fullsized":"2023-12-19T13:49:38.823797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:36.830962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390136+0000","last_change":"2023-12-19T13:49:35.923214+0000","last_active":"2023-12-19T13:49:36.390136+0000","last_peered":"2023-12-19T13:49:36.390136+0000","last_clean":"2023-12-19T13:49:36.390136+0000","last_became_active":"2023-12-19T13:49:35.922966+0000","last_became_peered":"2023-12-19T13:49:35.922966+0000","last_unstale":"2023-12-19T13:49:36.390136+0000","last_undegraded":"2023-12-19T13:49:36.390136+0000","last_fullsized":"2023-12-19T13:49:36.390136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900860+0000","last_change":"2023-12-19T13:49:34.900860+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900860+0000","last_undegraded":"2023-12-19T13:49:34.900860+0000","last_fullsized":"2023-12-19T13:49:34.900860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389174+0000","last_change":"2023-12-19T13:49:35.929803+0000","last_active":"2023-12-19T13:49:36.389174+0000","last_peered":"2023-12-19T13:49:36.389174+0000","last_clean":"2023-12-19T13:49:36.389174+0000","last_became_active":"2023-12-19T13:49:35.929631+0000","last_became_peered":"2023-12-19T13:49:35.929631+0000","last_unstale":"2023-12-19T13:49:36.389174+0000","last_undegraded":"2023-12-19T13:49:36.389174+0000","last_fullsized":"2023-12-19T13:49:36.389174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:58:19.919170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822508+0000","last_change":"2023-12-19T13:49:36.404280+0000","last_active":"2023-12-19T13:49:38.822508+0000","last_peered":"2023-12-19T13:49:38.822508+0000","last_clean":"2023-12-19T13:49:38.822508+0000","last_became_active":"2023-12-19T13:49:36.403858+0000","last_became_peered":"2023-12-19T13:49:36.403858+0000","last_unstale":"2023-12-19T13:49:38.822508+0000","last_undegraded":"2023-12-19T13:49:38.822508+0000","last_fullsized":"2023-12-19T13:49:38.822508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900105+0000","last_change":"2023-12-19T13:49:34.900105+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900105+0000","last_undegraded":"2023-12-19T13:49:34.900105+0000","last_fullsized":"2023-12-19T13:49:34.900105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:51.647666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416507+0000","last_change":"2023-12-19T13:49:35.924025+0000","last_active":"2023-12-19T13:49:36.416507+0000","last_peered":"2023-12-19T13:49:36.416507+0000","last_clean":"2023-12-19T13:49:36.416507+0000","last_became_active":"2023-12-19T13:49:35.923797+0000","last_became_peered":"2023-12-19T13:49:35.923797+0000","last_unstale":"2023-12-19T13:49:36.416507+0000","last_undegraded":"2023-12-19T13:49:36.416507+0000","last_fullsized":"2023-12-19T13:49:36.416507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:18.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823533+0000","last_change":"2023-12-19T13:49:36.415145+0000","last_active":"2023-12-19T13:49:38.823533+0000","last_peered":"2023-12-19T13:49:38.823533+0000","last_clean":"2023-12-19T13:49:38.823533+0000","last_became_active":"2023-12-19T13:49:36.414802+0000","last_became_peered":"2023-12-19T13:49:36.414802+0000","last_unstale":"2023-12-19T13:49:38.823533+0000","last_undegraded":"2023-12-19T13:49:38.823533+0000","last_fullsized":"2023-12-19T13:49:38.823533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:28.229489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.899143+0000","last_change":"2023-12-19T13:49:34.899143+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.899143+0000","last_undegraded":"2023-12-19T13:49:34.899143+0000","last_fullsized":"2023-12-19T13:49:34.899143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398430+0000","last_change":"2023-12-19T13:49:36.401718+0000","last_active":"2023-12-19T13:49:37.398430+0000","last_peered":"2023-12-19T13:49:37.398430+0000","last_clean":"2023-12-19T13:49:37.398430+0000","last_became_active":"2023-12-19T13:49:36.401473+0000","last_became_peered":"2023-12-19T13:49:36.401473+0000","last_unstale":"2023-12-19T13:49:37.398430+0000","last_undegraded":"2023-12-19T13:49:37.398430+0000","last_fullsized":"2023-12-19T13:49:37.398430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:55.233175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.903501+0000","last_change":"2023-12-19T13:49:34.903501+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.903501+0000","last_undegraded":"2023-12-19T13:49:34.903501+0000","last_fullsized":"2023-12-19T13:49:34.903501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:46.501331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824036+0000","last_change":"2023-12-19T13:49:36.401160+0000","last_active":"2023-12-19T13:49:38.824036+0000","last_peered":"2023-12-19T13:49:38.824036+0000","last_clean":"2023-12-19T13:49:38.824036+0000","last_became_active":"2023-12-19T13:49:36.397578+0000","last_became_peered":"2023-12-19T13:49:36.397578+0000","last_unstale":"2023-12-19T13:49:38.824036+0000","last_undegraded":"2023-12-19T13:49:38.824036+0000","last_fullsized":"2023-12-19T13:49:38.824036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.396140+0000","last_change":"2023-12-19T13:49:35.921680+0000","last_active":"2023-12-19T13:49:36.396140+0000","last_peered":"2023-12-19T13:49:36.396140+0000","last_clean":"2023-12-19T13:49:36.396140+0000","last_became_active":"2023-12-19T13:49:35.921416+0000","last_became_peered":"2023-12-19T13:49:35.921416+0000","last_unstale":"2023-12-19T13:49:36.396140+0000","last_undegraded":"2023-12-19T13:49:36.396140+0000","last_fullsized":"2023-12-19T13:49:36.396140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:18.490775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398690+0000","last_change":"2023-12-19T13:49:36.402557+0000","last_active":"2023-12-19T13:49:37.398690+0000","last_peered":"2023-12-19T13:49:37.398690+0000","last_clean":"2023-12-19T13:49:37.398690+0000","last_became_active":"2023-12-19T13:49:36.402039+0000","last_became_peered":"2023-12-19T13:49:36.402039+0000","last_unstale":"2023-12-19T13:49:37.398690+0000","last_undegraded":"2023-12-19T13:49:37.398690+0000","last_fullsized":"2023-12-19T13:49:37.398690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:48.356106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.398168+0000","last_change":"2023-12-19T13:49:35.921988+0000","last_active":"2023-12-19T13:49:36.398168+0000","last_peered":"2023-12-19T13:49:36.398168+0000","last_clean":"2023-12-19T13:49:36.398168+0000","last_became_active":"2023-12-19T13:49:35.921781+0000","last_became_peered":"2023-12-19T13:49:35.921781+0000","last_unstale":"2023-12-19T13:49:36.398168+0000","last_undegraded":"2023-12-19T13:49:36.398168+0000","last_fullsized":"2023-12-19T13:49:36.398168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:20.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822533+0000","last_change":"2023-12-19T13:49:36.412408+0000","last_active":"2023-12-19T13:49:38.822533+0000","last_peered":"2023-12-19T13:49:38.822533+0000","last_clean":"2023-12-19T13:49:38.822533+0000","last_became_active":"2023-12-19T13:49:36.412195+0000","last_became_peered":"2023-12-19T13:49:36.412195+0000","last_unstale":"2023-12-19T13:49:38.822533+0000","last_undegraded":"2023-12-19T13:49:38.822533+0000","last_fullsized":"2023-12-19T13:49:38.822533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:00.107117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414513+0000","last_change":"2023-12-19T13:49:35.922220+0000","last_active":"2023-12-19T13:49:36.414513+0000","last_peered":"2023-12-19T13:49:36.414513+0000","last_clean":"2023-12-19T13:49:36.414513+0000","last_became_active":"2023-12-19T13:49:35.921380+0000","last_became_peered":"2023-12-19T13:49:35.921380+0000","last_unstale":"2023-12-19T13:49:36.414513+0000","last_undegraded":"2023-12-19T13:49:36.414513+0000","last_fullsized":"2023-12-19T13:49:36.414513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:15.756864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824265+0000","last_change":"2023-12-19T13:49:36.401948+0000","last_active":"2023-12-19T13:49:38.824265+0000","last_peered":"2023-12-19T13:49:38.824265+0000","last_clean":"2023-12-19T13:49:38.824265+0000","last_became_active":"2023-12-19T13:49:36.399248+0000","last_became_peered":"2023-12-19T13:49:36.399248+0000","last_unstale":"2023-12-19T13:49:38.824265+0000","last_undegraded":"2023-12-19T13:49:38.824265+0000","last_fullsized":"2023-12-19T13:49:38.824265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:21.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.895594+0000","last_change":"2023-12-19T13:49:34.895594+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.895594+0000","last_undegraded":"2023-12-19T13:49:34.895594+0000","last_fullsized":"2023-12-19T13:49:34.895594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:37.941627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822666+0000","last_change":"2023-12-19T13:49:36.408093+0000","last_active":"2023-12-19T13:49:38.822666+0000","last_peered":"2023-12-19T13:49:38.822666+0000","last_clean":"2023-12-19T13:49:38.822666+0000","last_became_active":"2023-12-19T13:49:36.407151+0000","last_became_peered":"2023-12-19T13:49:36.407151+0000","last_unstale":"2023-12-19T13:49:38.822666+0000","last_undegraded":"2023-12-19T13:49:38.822666+0000","last_fullsized":"2023-12-19T13:49:38.822666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.902664+0000","last_change":"2023-12-19T13:49:34.902664+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.902664+0000","last_undegraded":"2023-12-19T13:49:34.902664+0000","last_fullsized":"2023-12-19T13:49:34.902664+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:17.146776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414006+0000","last_change":"2023-12-19T13:49:35.930716+0000","last_active":"2023-12-19T13:49:36.414006+0000","last_peered":"2023-12-19T13:49:36.414006+0000","last_clean":"2023-12-19T13:49:36.414006+0000","last_became_active":"2023-12-19T13:49:35.930555+0000","last_became_peered":"2023-12-19T13:49:35.930555+0000","last_unstale":"2023-12-19T13:49:36.414006+0000","last_undegraded":"2023-12-19T13:49:36.414006+0000","last_fullsized":"2023-12-19T13:49:36.414006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822845+0000","last_change":"2023-12-19T13:49:36.405403+0000","last_active":"2023-12-19T13:49:38.822845+0000","last_peered":"2023-12-19T13:49:38.822845+0000","last_clean":"2023-12-19T13:49:38.822845+0000","last_became_active":"2023-12-19T13:49:36.405205+0000","last_became_peered":"2023-12-19T13:49:36.405205+0000","last_unstale":"2023-12-19T13:49:38.822845+0000","last_undegraded":"2023-12-19T13:49:38.822845+0000","last_fullsized":"2023-12-19T13:49:38.822845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:14.792675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.899133+0000","last_change":"2023-12-19T13:49:34.899133+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.899133+0000","last_undegraded":"2023-12-19T13:49:34.899133+0000","last_fullsized":"2023-12-19T13:49:34.899133+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:17.486114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398893+0000","last_change":"2023-12-19T13:49:36.406414+0000","last_active":"2023-12-19T13:49:37.398893+0000","last_peered":"2023-12-19T13:49:37.398893+0000","last_clean":"2023-12-19T13:49:37.398893+0000","last_became_active":"2023-12-19T13:49:36.404928+0000","last_became_peered":"2023-12-19T13:49:36.404928+0000","last_unstale":"2023-12-19T13:49:37.398893+0000","last_undegraded":"2023-12-19T13:49:37.398893+0000","last_fullsized":"2023-12-19T13:49:37.398893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:31.791070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407855+0000","last_change":"2023-12-19T13:49:35.932840+0000","last_active":"2023-12-19T13:49:36.407855+0000","last_peered":"2023-12-19T13:49:36.407855+0000","last_clean":"2023-12-19T13:49:36.407855+0000","last_became_active":"2023-12-19T13:49:35.931197+0000","last_became_peered":"2023-12-19T13:49:35.931197+0000","last_unstale":"2023-12-19T13:49:36.407855+0000","last_undegraded":"2023-12-19T13:49:36.407855+0000","last_fullsized":"2023-12-19T13:49:36.407855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:01.364262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.904300+0000","last_change":"2023-12-19T13:49:34.904300+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.904300+0000","last_undegraded":"2023-12-19T13:49:34.904300+0000","last_fullsized":"2023-12-19T13:49:34.904300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:11.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389289+0000","last_change":"2023-12-19T13:49:35.934554+0000","last_active":"2023-12-19T13:49:36.389289+0000","last_peered":"2023-12-19T13:49:36.389289+0000","last_clean":"2023-12-19T13:49:36.389289+0000","last_became_active":"2023-12-19T13:49:35.934390+0000","last_became_peered":"2023-12-19T13:49:35.934390+0000","last_unstale":"2023-12-19T13:49:36.389289+0000","last_undegraded":"2023-12-19T13:49:36.389289+0000","last_fullsized":"2023-12-19T13:49:36.389289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824229+0000","last_change":"2023-12-19T13:49:36.406483+0000","last_active":"2023-12-19T13:49:38.824229+0000","last_peered":"2023-12-19T13:49:38.824229+0000","last_clean":"2023-12-19T13:49:38.824229+0000","last_became_active":"2023-12-19T13:49:36.402037+0000","last_became_peered":"2023-12-19T13:49:36.402037+0000","last_unstale":"2023-12-19T13:49:38.824229+0000","last_undegraded":"2023-12-19T13:49:38.824229+0000","last_fullsized":"2023-12-19T13:49:38.824229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.895432+0000","last_change":"2023-12-19T13:49:34.895432+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.895432+0000","last_undegraded":"2023-12-19T13:49:34.895432+0000","last_fullsized":"2023-12-19T13:49:34.895432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:30.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822793+0000","last_change":"2023-12-19T13:49:36.400530+0000","last_active":"2023-12-19T13:49:38.822793+0000","last_peered":"2023-12-19T13:49:38.822793+0000","last_clean":"2023-12-19T13:49:38.822793+0000","last_became_active":"2023-12-19T13:49:36.400046+0000","last_became_peered":"2023-12-19T13:49:36.400046+0000","last_unstale":"2023-12-19T13:49:38.822793+0000","last_undegraded":"2023-12-19T13:49:38.822793+0000","last_fullsized":"2023-12-19T13:49:38.822793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:56.941388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900983+0000","last_change":"2023-12-19T13:49:34.900983+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900983+0000","last_undegraded":"2023-12-19T13:49:34.900983+0000","last_fullsized":"2023-12-19T13:49:34.900983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:17.202412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390316+0000","last_change":"2023-12-19T13:49:35.924316+0000","last_active":"2023-12-19T13:49:36.390316+0000","last_peered":"2023-12-19T13:49:36.390316+0000","last_clean":"2023-12-19T13:49:36.390316+0000","last_became_active":"2023-12-19T13:49:35.924099+0000","last_became_peered":"2023-12-19T13:49:35.924099+0000","last_unstale":"2023-12-19T13:49:36.390316+0000","last_undegraded":"2023-12-19T13:49:36.390316+0000","last_fullsized":"2023-12-19T13:49:36.390316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:07.758117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.393487+0000","last_change":"2023-12-19T13:49:35.924508+0000","last_active":"2023-12-19T13:49:36.393487+0000","last_peered":"2023-12-19T13:49:36.393487+0000","last_clean":"2023-12-19T13:49:36.393487+0000","last_became_active":"2023-12-19T13:49:35.923964+0000","last_became_peered":"2023-12-19T13:49:35.923964+0000","last_unstale":"2023-12-19T13:49:36.393487+0000","last_undegraded":"2023-12-19T13:49:36.393487+0000","last_fullsized":"2023-12-19T13:49:36.393487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.896352+0000","last_change":"2023-12-19T13:49:34.896352+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.896352+0000","last_undegraded":"2023-12-19T13:49:34.896352+0000","last_fullsized":"2023-12-19T13:49:34.896352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.391631+0000","last_change":"2023-12-19T13:49:35.934965+0000","last_active":"2023-12-19T13:49:36.391631+0000","last_peered":"2023-12-19T13:49:36.391631+0000","last_clean":"2023-12-19T13:49:36.391631+0000","last_became_active":"2023-12-19T13:49:35.934823+0000","last_became_peered":"2023-12-19T13:49:35.934823+0000","last_unstale":"2023-12-19T13:49:36.391631+0000","last_undegraded":"2023-12-19T13:49:36.391631+0000","last_fullsized":"2023-12-19T13:49:36.391631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.898613+0000","last_change":"2023-12-19T13:49:34.898613+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.898613+0000","last_undegraded":"2023-12-19T13:49:34.898613+0000","last_fullsized":"2023-12-19T13:49:34.898613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900116+0000","last_change":"2023-12-19T13:49:34.900116+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900116+0000","last_undegraded":"2023-12-19T13:49:34.900116+0000","last_fullsized":"2023-12-19T13:49:34.900116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:43:25.064014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900087+0000","last_change":"2023-12-19T13:49:34.900087+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900087+0000","last_undegraded":"2023-12-19T13:49:34.900087+0000","last_fullsized":"2023-12-19T13:49:34.900087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390447+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:49:36.390447+0000","last_peered":"2023-12-19T13:49:36.390447+0000","last_clean":"2023-12-19T13:49:36.390447+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:49:36.390447+0000","last_undegraded":"2023-12-19T13:49:36.390447+0000","last_fullsized":"2023-12-19T13:49:36.390447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":348,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194964,"statfs":{"total":200000000,"available":199643629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.0009999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.375,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0049999999999999,"15min":0.98299999999999998},"min":{"1min":0.64000000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3380000000000001,"5min":2.008,"15min":2.008},"last":1.496}]},{"osd":1,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.079,"15min":1.069},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.429},{"interface":"front","average":{"1min":1.101,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4079999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.391}]},{"osd":2,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1399999999999999,"15min":1.133},"min":{"1min":0.81399999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.71,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.653},{"interface":"front","average":{"1min":1.147,"5min":1.1699999999999999,"15min":1.147},"min":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4299999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.597,"5min":1.931,"15min":1.931},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.252,"15min":1.23},"min":{"1min":0.79600000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7470000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.105}]},{"osd":4,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.282,"15min":1.286},"min":{"1min":0.84499999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6519999999999999,"5min":2.181,"15min":2.181},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.3859999999999999,"15min":1.3979999999999999},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.673,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.002}]},{"osd":5,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.24,"15min":1.222},"min":{"1min":0.871,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5429999999999999,"5min":1.956,"15min":1.956},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.4339999999999999,"15min":1.429},"min":{"1min":1.038,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.5209999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.292,"15min":1.262},"min":{"1min":0.90300000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6850000000000001,"5min":2.024,"15min":2.024},"last":1.26},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5049999999999999,"15min":1.4870000000000001},"min":{"1min":1.2050000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.796,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.597}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.0289999999999999},"min":{"1min":0.629,"5min":0.628,"15min":0.628},"max":{"1min":1.502,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.089,"15min":1.121},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3400000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.05,"15min":1.03},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.962,"15min":1.962},"last":1.071},{"interface":"front","average":{"1min":1.137,"5min":1.0620000000000001,"15min":1.032},"min":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5860000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.4319999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.2210000000000001},"min":{"1min":0.82499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6970000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.351},{"interface":"front","average":{"1min":1.254,"5min":1.173,"15min":1.151},"min":{"1min":0.96299999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6140000000000001,"5min":1.786,"15min":1.786},"last":1.0489999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3169999999999999,"15min":1.3520000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.478,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.266,"15min":1.272},"min":{"1min":1.024,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6299999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.2989999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.226,"15min":1.204},"min":{"1min":0.92600000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.484},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.3120000000000001,"15min":1.292},"min":{"1min":1.0920000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.228}]},{"osd":5,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.268,"15min":1.246},"min":{"1min":1.135,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6120000000000001,"5min":1.827,"15min":1.827},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.399,"15min":1.371},"min":{"1min":1.2849999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.5369999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.4159999999999999},"min":{"1min":1.0840000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.377,"15min":1.355},"min":{"1min":1.2430000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.766,"15min":1.766},"last":1.498}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194382,"statfs":{"total":200000000,"available":199047444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.595,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0509999999999999,"15min":1.0609999999999999},"min":{"1min":0.68700000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.1220000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.423,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.125,"5min":1.024,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3939999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.0840000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.202,"15min":1.246},"min":{"1min":0.83399999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3280000000000001,"5min":2.827,"15min":2.827},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.25,"15min":1.2689999999999999},"min":{"1min":0.93200000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5209999999999999,"5min":2.863,"15min":2.863},"last":1.042}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2090000000000001,"15min":1.204},"min":{"1min":1.0429999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.623,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.244,"15min":1.242},"min":{"1min":0.87,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5940000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.3169999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.153,"15min":1.137},"min":{"1min":0.90400000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5169999999999999,"5min":1.982,"15min":1.982},"last":1.228},{"interface":"front","average":{"1min":1.288,"5min":1.278,"15min":1.2769999999999999},"min":{"1min":0.88,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.474,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5980000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.343,"15min":1.3169999999999999},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.579,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.181},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.357,"15min":1.369},"min":{"1min":1.0609999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.6479999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.5029999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3959999999999999,"15min":1.401},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7090000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.427,"15min":1.403},"min":{"1min":1.2470000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6910000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.4830000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199617846,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.657,"15min":1.657},"last":1.113},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1259999999999999},"min":{"1min":0.69499999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.542,"5min":2.016,"15min":2.016},"last":0.85399999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.073,"15min":1.069},"min":{"1min":0.76600000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.1000000000000001,"15min":1.1140000000000001},"min":{"1min":0.754,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4039999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0580000000000001,"15min":1.0169999999999999},"min":{"1min":0.76500000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1120000000000001,"15min":1.105},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.405,"5min":1.575,"15min":1.575},"last":1.143}]},{"osd":3,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.206,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.952,"15min":1.952},"last":1.288},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.258,"15min":1.274},"min":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.482,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.25}]},{"osd":5,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.216,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.165,"15min":2.165},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.325,"15min":1.343},"min":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6970000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.405}]},{"osd":6,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.85099999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.595,"5min":2.335,"15min":2.335},"last":1.5640000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4490000000000001,"15min":1.46},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.782,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.5,"15min":1.522},"min":{"1min":0.89300000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.921,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.6499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.89200000000000002,"15min":0.95599999999999996},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2290000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.94499999999999995,"15min":0.97799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.4590000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":1.032},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.006},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96399999999999997,"15min":0.99399999999999999},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2589999999999999,"5min":2.387,"15min":2.387},"last":0.87}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.097,"15min":1.143},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4690000000000001,"5min":2.657,"15min":2.657},"last":0.78900000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.236,"15min":1.272},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.51,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.353},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.21,"15min":1.23},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6419999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.151}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.278,"15min":1.3140000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.7030000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.256,"15min":1.276},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.671,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.21}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.637,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.321,"15min":1.349},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":2.698,"15min":2.698},"last":1.389}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.337,"15min":1.3759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.76,"5min":3.609,"15min":3.609},"last":1.47},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.02,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.4370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":2.258,"15min":2.258},"last":1.022},{"interface":"front","average":{"1min":1.468,"5min":0.91700000000000004,"15min":0.81699999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":11.85,"5min":11.85,"15min":11.85},"last":1.3560000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.363,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.625,"5min":1.018,"15min":0.92500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":11.788,"5min":11.788,"15min":11.788},"last":1.2150000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.397,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.089},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.0569999999999999,"15min":1.0269999999999999},"min":{"1min":0.501,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.8079999999999998,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":1.2490000000000001,"15min":1.1559999999999999},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6679999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.27}]},{"osd":5,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.321,"15min":1.2190000000000001},"min":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":11.888,"5min":11.888,"15min":11.888},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.302,"15min":1.306},"min":{"1min":1.014,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9850000000000001,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3140000000000001,"15min":1.3180000000000001},"min":{"1min":0.88300000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0640000000000001,"5min":2.964,"15min":2.964},"last":1},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2629999999999999,"15min":1.2490000000000001},"min":{"1min":0.85399999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.944,"5min":2.286,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0369999999999999,"5min":2.351,"15min":2.351},"last":1.1779999999999999},{"interface":"front","average":{"1min":2.0110000000000001,"5min":1.375,"15min":1.282},"min":{"1min":0.82099999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":11.962999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.4570000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194362,"statfs":{"total":200000000,"available":199027512,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.82599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.26,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.351,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.044,"15min":1.1000000000000001},"min":{"1min":0.51600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.012},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.169,"15min":1.1930000000000001},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7829999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.0469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.117,"15min":1.2030000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3009999999999999,"5min":7.157,"15min":7.157},"last":1.079}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.236},"min":{"1min":0.83299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.575,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.282,"15min":1.304},"min":{"1min":0.85499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.738,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.94599999999999995}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.294,"15min":1.337},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1669999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.135},{"interface":"front","average":{"1min":1.994,"5min":1.468,"15min":1.3979999999999999},"min":{"1min":0.81200000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":15.576000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.335,"15min":1.351},"min":{"1min":0.75800000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8260000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.254},{"interface":"front","average":{"1min":1.278,"5min":1.379,"15min":1.4339999999999999},"min":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.226,"5min":3.786,"15min":3.786},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.409,"15min":1.458},"min":{"1min":0.84799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.9039999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.355},{"interface":"front","average":{"1min":1.258,"5min":1.421,"15min":1.476},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6830000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.2290000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4430000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.53600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":14.010999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.7919999999999998,"5min":1.238,"15min":0.99099999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":33.799999999999997,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.1930000000000001},{"interface":"front","average":{"1min":3.302,"5min":1.3759999999999999,"15min":1.0660000000000001},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":41.758000000000003,"5min":41.758000000000003,"15min":41.758000000000003},"last":1.55}]},{"osd":3,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.93500000000000005,"15min":1.0229999999999999},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4330000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.048,"15min":1.0960000000000001},"min":{"1min":0.46600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3759999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.496}]},{"osd":4,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5149999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.994,"5min":1.323,"15min":1.2030000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":1.8140000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.3200000000000001,"15min":1.2110000000000001},"min":{"1min":0.83699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":14.337999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.8999999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.6279999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.282,"15min":1.248},"min":{"1min":0.72999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":5.4669999999999996,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.8939999999999999},{"interface":"front","average":{"1min":2.23,"5min":1.4399999999999999,"15min":1.3120000000000001},"min":{"1min":0.94799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":17.161000000000001,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.774}]},{"osd":7,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.429,"15min":1.323},"min":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":1.325},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.4239999999999999,"15min":1.411},"min":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":9.7080000000000002,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.7230000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:49:41.343 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:49:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.594+0000 7f4597c5f640 1 Processor -- start 2023-12-19T13:49:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.594+0000 7f4597c5f640 1 -- start start 2023-12-19T13:49:41.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.595+0000 7f4597c5f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f459015ddf0 0x7f459006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.596+0000 7f4597c5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f459006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.596+0000 7f4597c5f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459015e2a0 con 0x7f459015b3c0 2023-12-19T13:49:41.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.596+0000 7f4597c5f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4590161510 con 0x7f459015ddf0 2023-12-19T13:49:41.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.596+0000 7f4597c5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459015ed70 con 0x7f459006f6a0 2023-12-19T13:49:41.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.596+0000 7f45951fa640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f459015ddf0 0x7f459006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.596+0000 7f45961fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f459006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.597+0000 7f45951fa640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f459015ddf0 0x7f459006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:34984/0 (socket says 172.21.15.113:34984) 2023-12-19T13:49:41.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.597+0000 7f45951fa640 1 -- 172.21.15.113:0/506016893 learned_addr learned my addr 172.21.15.113:0/506016893 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:41.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.597+0000 7f45951fa640 1 -- 172.21.15.113:0/506016893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 msgr2=0x7f459006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:41.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.597+0000 7f45951fa640 1 --2- 172.21.15.113:0/506016893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f459006c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.597+0000 7f45951fa640 1 -- 172.21.15.113:0/506016893 >> v1:172.21.15.151:6789/0 conn(0x7f459015b3c0 legacy=0x7f45900cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.597+0000 7f45951fa640 1 -- 172.21.15.113:0/506016893 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459015e4d0 con 0x7f459015ddf0 2023-12-19T13:49:41.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.599+0000 7f45951fa640 1 --2- 172.21.15.113:0/506016893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015ddf0 0x7f459006f160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4580009870 tx=0x7f458002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b50f0f2d8b217290 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:41.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.599+0000 7f45949f9640 1 -- 172.21.15.113:0/506016893 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580030840 con 0x7f459015ddf0 2023-12-19T13:49:41.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.599+0000 7f45949f9640 1 -- 172.21.15.113:0/506016893 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45800309a0 con 0x7f459015ddf0 2023-12-19T13:49:41.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.599+0000 7f45949f9640 1 -- 172.21.15.113:0/506016893 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580030d30 con 0x7f459015ddf0 2023-12-19T13:49:41.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 -- 172.21.15.113:0/506016893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015ddf0 msgr2=0x7f459006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 --2- 172.21.15.113:0/506016893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015ddf0 0x7f459006f160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4580009870 tx=0x7f458002b980 comp rx=0 tx=0).stop 2023-12-19T13:49:41.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 -- 172.21.15.113:0/506016893 shutdown_connections 2023-12-19T13:49:41.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 --2- 172.21.15.113:0/506016893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f459006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 --2- 172.21.15.113:0/506016893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015ddf0 0x7f459006f160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 -- 172.21.15.113:0/506016893 >> 172.21.15.113:0/506016893 conn(0x7f45900d01a0 msgr2=0x7f45900d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:41.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 -- 172.21.15.113:0/506016893 shutdown_connections 2023-12-19T13:49:41.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.600+0000 7f4597c5f640 1 -- 172.21.15.113:0/506016893 wait complete. 2023-12-19T13:49:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.602+0000 7f4597c5f640 1 Processor -- start 2023-12-19T13:49:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.602+0000 7f4597c5f640 1 -- start start 2023-12-19T13:49:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.603+0000 7f4597c5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f4590146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.603+0000 7f4597c5f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015b3c0 0x7f45901468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.603+0000 7f4597c5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f459015ddf0 0x7f45900cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.603+0000 7f4597c5f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4590147f80 con 0x7f459015ddf0 2023-12-19T13:49:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.603+0000 7f4597c5f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4590146640 con 0x7f459015b3c0 2023-12-19T13:49:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.603+0000 7f4597c5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4590147300 con 0x7f459006f6a0 2023-12-19T13:49:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f459015ddf0 0x7f45900cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f459015ddf0 0x7f45900cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58162/0 (socket says 172.21.15.113:58162) 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 -- 172.21.15.113:0/2013830114 learned_addr learned my addr 172.21.15.113:0/2013830114 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45951fa640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015b3c0 0x7f45901468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45959fb640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f4590146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 -- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 msgr2=0x7f4590146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f4590146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 -- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015b3c0 msgr2=0x7f45901468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015b3c0 0x7f45901468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45961fc640 1 -- 172.21.15.113:0/2013830114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800094d0 con 0x7f459015ddf0 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.604+0000 7f45951fa640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015b3c0 0x7f45901468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.605+0000 7f45961fc640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f459015ddf0 0x7f45900cb740 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f458800efc0 tx=0x7f458800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.605+0000 7f45867fc640 1 -- 172.21.15.113:0/2013830114 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588009ca0 con 0x7f459015ddf0 2023-12-19T13:49:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.605+0000 7f45867fc640 1 -- 172.21.15.113:0/2013830114 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458800f040 con 0x7f459015ddf0 2023-12-19T13:49:41.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.605+0000 7f45867fc640 1 -- 172.21.15.113:0/2013830114 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880146c0 con 0x7f459015ddf0 2023-12-19T13:49:41.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.605+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45901475e0 con 0x7f459015ddf0 2023-12-19T13:49:41.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.605+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4590147ba0 con 0x7f459015ddf0 2023-12-19T13:49:41.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.606+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45901480c0 con 0x7f459015ddf0 2023-12-19T13:49:41.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.607+0000 7f45867fc640 1 -- 172.21.15.113:0/2013830114 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4588014820 con 0x7f459015ddf0 2023-12-19T13:49:41.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.608+0000 7f45867fc640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f457406a430 0x7f457406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:41.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.608+0000 7f45867fc640 1 -- 172.21.15.113:0/2013830114 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45880897e0 con 0x7f459015ddf0 2023-12-19T13:49:41.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.608+0000 7f45959fb640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f457406a430 0x7f457406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:41.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.609+0000 7f45959fb640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f457406a430 0x7f457406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f458c000f60 tx=0x7f458c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.612+0000 7f45867fc640 1 -- 172.21.15.113:0/2013830114 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45901480c0 con 0x7f459015ddf0 2023-12-19T13:49:41.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.797+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f459015ea90 con 0x7f457406a430 2023-12-19T13:49:41.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.817+0000 7f45867fc640 1 -- 172.21.15.113:0/2013830114 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277051 (secure 0 0 0) 0x7f458c001c70 con 0x7f457406a430 2023-12-19T13:49:41.819 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:41.822 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:49:41.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f457406a430 msgr2=0x7f457406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f457406a430 0x7f457406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f458c000f60 tx=0x7f458c009040 comp rx=0 tx=0).stop 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f459015ddf0 msgr2=0x7f45900cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f459015ddf0 0x7f45900cb740 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f458800efc0 tx=0x7f458800c490 comp rx=0 tx=0).stop 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 shutdown_connections 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f457406a430 0x7f457406c8f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f459015ddf0 0x7f45900cb740 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459015b3c0 0x7f45901468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 --2- 172.21.15.113:0/2013830114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f459006f6a0 0x7f4590146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 >> 172.21.15.113:0/2013830114 conn(0x7f45900d01a0 msgr2=0x7f459015a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 shutdown_connections 2023-12-19T13:49:41.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:41.825+0000 7f4597c5f640 1 -- 172.21.15.113:0/2013830114 wait complete. 2023-12-19T13:49:41.842 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-12-19T13:49:40.467414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4055,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558444,"statfs":{"total":1600000000,"available":1595847165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.573522"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822971+0000","last_change":"2023-12-19T13:49:36.394475+0000","last_active":"2023-12-19T13:49:38.822971+0000","last_peered":"2023-12-19T13:49:38.822971+0000","last_clean":"2023-12-19T13:49:38.822971+0000","last_became_active":"2023-12-19T13:49:36.394262+0000","last_became_peered":"2023-12-19T13:49:36.394262+0000","last_unstale":"2023-12-19T13:49:38.822971+0000","last_undegraded":"2023-12-19T13:49:38.822971+0000","last_fullsized":"2023-12-19T13:49:38.822971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:36.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822286+0000","last_change":"2023-12-19T13:49:36.403203+0000","last_active":"2023-12-19T13:49:38.822286+0000","last_peered":"2023-12-19T13:49:38.822286+0000","last_clean":"2023-12-19T13:49:38.822286+0000","last_became_active":"2023-12-19T13:49:36.402982+0000","last_became_peered":"2023-12-19T13:49:36.402982+0000","last_unstale":"2023-12-19T13:49:38.822286+0000","last_undegraded":"2023-12-19T13:49:38.822286+0000","last_fullsized":"2023-12-19T13:49:38.822286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:39.662682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822451+0000","last_change":"2023-12-19T13:49:36.403126+0000","last_active":"2023-12-19T13:49:38.822451+0000","last_peered":"2023-12-19T13:49:38.822451+0000","last_clean":"2023-12-19T13:49:38.822451+0000","last_became_active":"2023-12-19T13:49:36.399427+0000","last_became_peered":"2023-12-19T13:49:36.399427+0000","last_unstale":"2023-12-19T13:49:38.822451+0000","last_undegraded":"2023-12-19T13:49:38.822451+0000","last_fullsized":"2023-12-19T13:49:38.822451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:39.487118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398255+0000","last_change":"2023-12-19T13:49:36.406555+0000","last_active":"2023-12-19T13:49:37.398255+0000","last_peered":"2023-12-19T13:49:37.398255+0000","last_clean":"2023-12-19T13:49:37.398255+0000","last_became_active":"2023-12-19T13:49:36.405313+0000","last_became_peered":"2023-12-19T13:49:36.405313+0000","last_unstale":"2023-12-19T13:49:37.398255+0000","last_undegraded":"2023-12-19T13:49:37.398255+0000","last_fullsized":"2023-12-19T13:49:37.398255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:56.630159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822858+0000","last_change":"2023-12-19T13:49:36.404369+0000","last_active":"2023-12-19T13:49:38.822858+0000","last_peered":"2023-12-19T13:49:38.822858+0000","last_clean":"2023-12-19T13:49:38.822858+0000","last_became_active":"2023-12-19T13:49:36.404095+0000","last_became_peered":"2023-12-19T13:49:36.404095+0000","last_unstale":"2023-12-19T13:49:38.822858+0000","last_undegraded":"2023-12-19T13:49:38.822858+0000","last_fullsized":"2023-12-19T13:49:38.822858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398615+0000","last_change":"2023-12-19T13:49:36.403893+0000","last_active":"2023-12-19T13:49:37.398615+0000","last_peered":"2023-12-19T13:49:37.398615+0000","last_clean":"2023-12-19T13:49:37.398615+0000","last_became_active":"2023-12-19T13:49:36.400637+0000","last_became_peered":"2023-12-19T13:49:36.400637+0000","last_unstale":"2023-12-19T13:49:37.398615+0000","last_undegraded":"2023-12-19T13:49:37.398615+0000","last_fullsized":"2023-12-19T13:49:37.398615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:04.169818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822427+0000","last_change":"2023-12-19T13:49:36.408953+0000","last_active":"2023-12-19T13:49:38.822427+0000","last_peered":"2023-12-19T13:49:38.822427+0000","last_clean":"2023-12-19T13:49:38.822427+0000","last_became_active":"2023-12-19T13:49:36.408561+0000","last_became_peered":"2023-12-19T13:49:36.408561+0000","last_unstale":"2023-12-19T13:49:38.822427+0000","last_undegraded":"2023-12-19T13:49:38.822427+0000","last_fullsized":"2023-12-19T13:49:38.822427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823203+0000","last_change":"2023-12-19T13:49:36.406690+0000","last_active":"2023-12-19T13:49:38.823203+0000","last_peered":"2023-12-19T13:49:38.823203+0000","last_clean":"2023-12-19T13:49:38.823203+0000","last_became_active":"2023-12-19T13:49:36.402517+0000","last_became_peered":"2023-12-19T13:49:36.402517+0000","last_unstale":"2023-12-19T13:49:38.823203+0000","last_undegraded":"2023-12-19T13:49:38.823203+0000","last_fullsized":"2023-12-19T13:49:38.823203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823578+0000","last_change":"2023-12-19T13:49:36.403170+0000","last_active":"2023-12-19T13:49:38.823578+0000","last_peered":"2023-12-19T13:49:38.823578+0000","last_clean":"2023-12-19T13:49:38.823578+0000","last_became_active":"2023-12-19T13:49:36.402945+0000","last_became_peered":"2023-12-19T13:49:36.402945+0000","last_unstale":"2023-12-19T13:49:38.823578+0000","last_undegraded":"2023-12-19T13:49:38.823578+0000","last_fullsized":"2023-12-19T13:49:38.823578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823214+0000","last_change":"2023-12-19T13:49:36.413468+0000","last_active":"2023-12-19T13:49:38.823214+0000","last_peered":"2023-12-19T13:49:38.823214+0000","last_clean":"2023-12-19T13:49:38.823214+0000","last_became_active":"2023-12-19T13:49:36.413122+0000","last_became_peered":"2023-12-19T13:49:36.413122+0000","last_unstale":"2023-12-19T13:49:38.823214+0000","last_undegraded":"2023-12-19T13:49:38.823214+0000","last_fullsized":"2023-12-19T13:49:38.823214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823105+0000","last_change":"2023-12-19T13:49:36.409909+0000","last_active":"2023-12-19T13:49:38.823105+0000","last_peered":"2023-12-19T13:49:38.823105+0000","last_clean":"2023-12-19T13:49:38.823105+0000","last_became_active":"2023-12-19T13:49:36.409492+0000","last_became_peered":"2023-12-19T13:49:36.409492+0000","last_unstale":"2023-12-19T13:49:38.823105+0000","last_undegraded":"2023-12-19T13:49:38.823105+0000","last_fullsized":"2023-12-19T13:49:38.823105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:05.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398483+0000","last_change":"2023-12-19T13:49:36.406713+0000","last_active":"2023-12-19T13:49:37.398483+0000","last_peered":"2023-12-19T13:49:37.398483+0000","last_clean":"2023-12-19T13:49:37.398483+0000","last_became_active":"2023-12-19T13:49:36.405725+0000","last_became_peered":"2023-12-19T13:49:36.405725+0000","last_unstale":"2023-12-19T13:49:37.398483+0000","last_undegraded":"2023-12-19T13:49:37.398483+0000","last_fullsized":"2023-12-19T13:49:37.398483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:34.189380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823717+0000","last_change":"2023-12-19T13:49:36.404081+0000","last_active":"2023-12-19T13:49:38.823717+0000","last_peered":"2023-12-19T13:49:38.823717+0000","last_clean":"2023-12-19T13:49:38.823717+0000","last_became_active":"2023-12-19T13:49:36.402206+0000","last_became_peered":"2023-12-19T13:49:36.402206+0000","last_unstale":"2023-12-19T13:49:38.823717+0000","last_undegraded":"2023-12-19T13:49:38.823717+0000","last_fullsized":"2023-12-19T13:49:38.823717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:29.166537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823769+0000","last_change":"2023-12-19T13:49:36.410096+0000","last_active":"2023-12-19T13:49:38.823769+0000","last_peered":"2023-12-19T13:49:38.823769+0000","last_clean":"2023-12-19T13:49:38.823769+0000","last_became_active":"2023-12-19T13:49:36.409874+0000","last_became_peered":"2023-12-19T13:49:36.409874+0000","last_unstale":"2023-12-19T13:49:38.823769+0000","last_undegraded":"2023-12-19T13:49:38.823769+0000","last_fullsized":"2023-12-19T13:49:38.823769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407746+0000","last_change":"2023-12-19T13:49:35.928447+0000","last_active":"2023-12-19T13:49:36.407746+0000","last_peered":"2023-12-19T13:49:36.407746+0000","last_clean":"2023-12-19T13:49:36.407746+0000","last_became_active":"2023-12-19T13:49:35.928154+0000","last_became_peered":"2023-12-19T13:49:35.928154+0000","last_unstale":"2023-12-19T13:49:36.407746+0000","last_undegraded":"2023-12-19T13:49:36.407746+0000","last_fullsized":"2023-12-19T13:49:36.407746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:45.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.896599+0000","last_change":"2023-12-19T13:49:34.896599+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.896599+0000","last_undegraded":"2023-12-19T13:49:34.896599+0000","last_fullsized":"2023-12-19T13:49:34.896599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:25.292841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900754+0000","last_change":"2023-12-19T13:49:34.900754+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900754+0000","last_undegraded":"2023-12-19T13:49:34.900754+0000","last_fullsized":"2023-12-19T13:49:34.900754+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:15:25.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414405+0000","last_change":"2023-12-19T13:49:35.924513+0000","last_active":"2023-12-19T13:49:36.414405+0000","last_peered":"2023-12-19T13:49:36.414405+0000","last_clean":"2023-12-19T13:49:36.414405+0000","last_became_active":"2023-12-19T13:49:35.924291+0000","last_became_peered":"2023-12-19T13:49:35.924291+0000","last_unstale":"2023-12-19T13:49:36.414405+0000","last_undegraded":"2023-12-19T13:49:36.414405+0000","last_fullsized":"2023-12-19T13:49:36.414405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:59.357889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416283+0000","last_change":"2023-12-19T13:49:35.929134+0000","last_active":"2023-12-19T13:49:36.416283+0000","last_peered":"2023-12-19T13:49:36.416283+0000","last_clean":"2023-12-19T13:49:36.416283+0000","last_became_active":"2023-12-19T13:49:35.928936+0000","last_became_peered":"2023-12-19T13:49:35.928936+0000","last_unstale":"2023-12-19T13:49:36.416283+0000","last_undegraded":"2023-12-19T13:49:36.416283+0000","last_fullsized":"2023-12-19T13:49:36.416283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:55.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823622+0000","last_change":"2023-12-19T13:49:36.413335+0000","last_active":"2023-12-19T13:49:38.823622+0000","last_peered":"2023-12-19T13:49:38.823622+0000","last_clean":"2023-12-19T13:49:38.823622+0000","last_became_active":"2023-12-19T13:49:36.412708+0000","last_became_peered":"2023-12-19T13:49:36.412708+0000","last_unstale":"2023-12-19T13:49:38.823622+0000","last_undegraded":"2023-12-19T13:49:38.823622+0000","last_fullsized":"2023-12-19T13:49:38.823622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.902229+0000","last_change":"2023-12-19T13:49:34.902229+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.902229+0000","last_undegraded":"2023-12-19T13:49:34.902229+0000","last_fullsized":"2023-12-19T13:49:34.902229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:05.089463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823797+0000","last_change":"2023-12-19T13:49:36.406246+0000","last_active":"2023-12-19T13:49:38.823797+0000","last_peered":"2023-12-19T13:49:38.823797+0000","last_clean":"2023-12-19T13:49:38.823797+0000","last_became_active":"2023-12-19T13:49:36.406037+0000","last_became_peered":"2023-12-19T13:49:36.406037+0000","last_unstale":"2023-12-19T13:49:38.823797+0000","last_undegraded":"2023-12-19T13:49:38.823797+0000","last_fullsized":"2023-12-19T13:49:38.823797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:36.830962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390136+0000","last_change":"2023-12-19T13:49:35.923214+0000","last_active":"2023-12-19T13:49:36.390136+0000","last_peered":"2023-12-19T13:49:36.390136+0000","last_clean":"2023-12-19T13:49:36.390136+0000","last_became_active":"2023-12-19T13:49:35.922966+0000","last_became_peered":"2023-12-19T13:49:35.922966+0000","last_unstale":"2023-12-19T13:49:36.390136+0000","last_undegraded":"2023-12-19T13:49:36.390136+0000","last_fullsized":"2023-12-19T13:49:36.390136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900860+0000","last_change":"2023-12-19T13:49:34.900860+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900860+0000","last_undegraded":"2023-12-19T13:49:34.900860+0000","last_fullsized":"2023-12-19T13:49:34.900860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389174+0000","last_change":"2023-12-19T13:49:35.929803+0000","last_active":"2023-12-19T13:49:36.389174+0000","last_peered":"2023-12-19T13:49:36.389174+0000","last_clean":"2023-12-19T13:49:36.389174+0000","last_became_active":"2023-12-19T13:49:35.929631+0000","last_became_peered":"2023-12-19T13:49:35.929631+0000","last_unstale":"2023-12-19T13:49:36.389174+0000","last_undegraded":"2023-12-19T13:49:36.389174+0000","last_fullsized":"2023-12-19T13:49:36.389174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:58:19.919170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822508+0000","last_change":"2023-12-19T13:49:36.404280+0000","last_active":"2023-12-19T13:49:38.822508+0000","last_peered":"2023-12-19T13:49:38.822508+0000","last_clean":"2023-12-19T13:49:38.822508+0000","last_became_active":"2023-12-19T13:49:36.403858+0000","last_became_peered":"2023-12-19T13:49:36.403858+0000","last_unstale":"2023-12-19T13:49:38.822508+0000","last_undegraded":"2023-12-19T13:49:38.822508+0000","last_fullsized":"2023-12-19T13:49:38.822508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900105+0000","last_change":"2023-12-19T13:49:34.900105+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900105+0000","last_undegraded":"2023-12-19T13:49:34.900105+0000","last_fullsized":"2023-12-19T13:49:34.900105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:51.647666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416507+0000","last_change":"2023-12-19T13:49:35.924025+0000","last_active":"2023-12-19T13:49:36.416507+0000","last_peered":"2023-12-19T13:49:36.416507+0000","last_clean":"2023-12-19T13:49:36.416507+0000","last_became_active":"2023-12-19T13:49:35.923797+0000","last_became_peered":"2023-12-19T13:49:35.923797+0000","last_unstale":"2023-12-19T13:49:36.416507+0000","last_undegraded":"2023-12-19T13:49:36.416507+0000","last_fullsized":"2023-12-19T13:49:36.416507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:18.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823533+0000","last_change":"2023-12-19T13:49:36.415145+0000","last_active":"2023-12-19T13:49:38.823533+0000","last_peered":"2023-12-19T13:49:38.823533+0000","last_clean":"2023-12-19T13:49:38.823533+0000","last_became_active":"2023-12-19T13:49:36.414802+0000","last_became_peered":"2023-12-19T13:49:36.414802+0000","last_unstale":"2023-12-19T13:49:38.823533+0000","last_undegraded":"2023-12-19T13:49:38.823533+0000","last_fullsized":"2023-12-19T13:49:38.823533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:28.229489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.899143+0000","last_change":"2023-12-19T13:49:34.899143+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.899143+0000","last_undegraded":"2023-12-19T13:49:34.899143+0000","last_fullsized":"2023-12-19T13:49:34.899143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398430+0000","last_change":"2023-12-19T13:49:36.401718+0000","last_active":"2023-12-19T13:49:37.398430+0000","last_peered":"2023-12-19T13:49:37.398430+0000","last_clean":"2023-12-19T13:49:37.398430+0000","last_became_active":"2023-12-19T13:49:36.401473+0000","last_became_peered":"2023-12-19T13:49:36.401473+0000","last_unstale":"2023-12-19T13:49:37.398430+0000","last_undegraded":"2023-12-19T13:49:37.398430+0000","last_fullsized":"2023-12-19T13:49:37.398430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:55.233175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.903501+0000","last_change":"2023-12-19T13:49:34.903501+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.903501+0000","last_undegraded":"2023-12-19T13:49:34.903501+0000","last_fullsized":"2023-12-19T13:49:34.903501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:46.501331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824036+0000","last_change":"2023-12-19T13:49:36.401160+0000","last_active":"2023-12-19T13:49:38.824036+0000","last_peered":"2023-12-19T13:49:38.824036+0000","last_clean":"2023-12-19T13:49:38.824036+0000","last_became_active":"2023-12-19T13:49:36.397578+0000","last_became_peered":"2023-12-19T13:49:36.397578+0000","last_unstale":"2023-12-19T13:49:38.824036+0000","last_undegraded":"2023-12-19T13:49:38.824036+0000","last_fullsized":"2023-12-19T13:49:38.824036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.396140+0000","last_change":"2023-12-19T13:49:35.921680+0000","last_active":"2023-12-19T13:49:36.396140+0000","last_peered":"2023-12-19T13:49:36.396140+0000","last_clean":"2023-12-19T13:49:36.396140+0000","last_became_active":"2023-12-19T13:49:35.921416+0000","last_became_peered":"2023-12-19T13:49:35.921416+0000","last_unstale":"2023-12-19T13:49:36.396140+0000","last_undegraded":"2023-12-19T13:49:36.396140+0000","last_fullsized":"2023-12-19T13:49:36.396140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:18.490775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398690+0000","last_change":"2023-12-19T13:49:36.402557+0000","last_active":"2023-12-19T13:49:37.398690+0000","last_peered":"2023-12-19T13:49:37.398690+0000","last_clean":"2023-12-19T13:49:37.398690+0000","last_became_active":"2023-12-19T13:49:36.402039+0000","last_became_peered":"2023-12-19T13:49:36.402039+0000","last_unstale":"2023-12-19T13:49:37.398690+0000","last_undegraded":"2023-12-19T13:49:37.398690+0000","last_fullsized":"2023-12-19T13:49:37.398690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:48.356106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.398168+0000","last_change":"2023-12-19T13:49:35.921988+0000","last_active":"2023-12-19T13:49:36.398168+0000","last_peered":"2023-12-19T13:49:36.398168+0000","last_clean":"2023-12-19T13:49:36.398168+0000","last_became_active":"2023-12-19T13:49:35.921781+0000","last_became_peered":"2023-12-19T13:49:35.921781+0000","last_unstale":"2023-12-19T13:49:36.398168+0000","last_undegraded":"2023-12-19T13:49:36.398168+0000","last_fullsized":"2023-12-19T13:49:36.398168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:20.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822533+0000","last_change":"2023-12-19T13:49:36.412408+0000","last_active":"2023-12-19T13:49:38.822533+0000","last_peered":"2023-12-19T13:49:38.822533+0000","last_clean":"2023-12-19T13:49:38.822533+0000","last_became_active":"2023-12-19T13:49:36.412195+0000","last_became_peered":"2023-12-19T13:49:36.412195+0000","last_unstale":"2023-12-19T13:49:38.822533+0000","last_undegraded":"2023-12-19T13:49:38.822533+0000","last_fullsized":"2023-12-19T13:49:38.822533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:00.107117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414513+0000","last_change":"2023-12-19T13:49:35.922220+0000","last_active":"2023-12-19T13:49:36.414513+0000","last_peered":"2023-12-19T13:49:36.414513+0000","last_clean":"2023-12-19T13:49:36.414513+0000","last_became_active":"2023-12-19T13:49:35.921380+0000","last_became_peered":"2023-12-19T13:49:35.921380+0000","last_unstale":"2023-12-19T13:49:36.414513+0000","last_undegraded":"2023-12-19T13:49:36.414513+0000","last_fullsized":"2023-12-19T13:49:36.414513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:15.756864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824265+0000","last_change":"2023-12-19T13:49:36.401948+0000","last_active":"2023-12-19T13:49:38.824265+0000","last_peered":"2023-12-19T13:49:38.824265+0000","last_clean":"2023-12-19T13:49:38.824265+0000","last_became_active":"2023-12-19T13:49:36.399248+0000","last_became_peered":"2023-12-19T13:49:36.399248+0000","last_unstale":"2023-12-19T13:49:38.824265+0000","last_undegraded":"2023-12-19T13:49:38.824265+0000","last_fullsized":"2023-12-19T13:49:38.824265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:21.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.895594+0000","last_change":"2023-12-19T13:49:34.895594+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.895594+0000","last_undegraded":"2023-12-19T13:49:34.895594+0000","last_fullsized":"2023-12-19T13:49:34.895594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:37.941627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822666+0000","last_change":"2023-12-19T13:49:36.408093+0000","last_active":"2023-12-19T13:49:38.822666+0000","last_peered":"2023-12-19T13:49:38.822666+0000","last_clean":"2023-12-19T13:49:38.822666+0000","last_became_active":"2023-12-19T13:49:36.407151+0000","last_became_peered":"2023-12-19T13:49:36.407151+0000","last_unstale":"2023-12-19T13:49:38.822666+0000","last_undegraded":"2023-12-19T13:49:38.822666+0000","last_fullsized":"2023-12-19T13:49:38.822666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.902664+0000","last_change":"2023-12-19T13:49:34.902664+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.902664+0000","last_undegraded":"2023-12-19T13:49:34.902664+0000","last_fullsized":"2023-12-19T13:49:34.902664+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:17.146776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414006+0000","last_change":"2023-12-19T13:49:35.930716+0000","last_active":"2023-12-19T13:49:36.414006+0000","last_peered":"2023-12-19T13:49:36.414006+0000","last_clean":"2023-12-19T13:49:36.414006+0000","last_became_active":"2023-12-19T13:49:35.930555+0000","last_became_peered":"2023-12-19T13:49:35.930555+0000","last_unstale":"2023-12-19T13:49:36.414006+0000","last_undegraded":"2023-12-19T13:49:36.414006+0000","last_fullsized":"2023-12-19T13:49:36.414006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822845+0000","last_change":"2023-12-19T13:49:36.405403+0000","last_active":"2023-12-19T13:49:38.822845+0000","last_peered":"2023-12-19T13:49:38.822845+0000","last_clean":"2023-12-19T13:49:38.822845+0000","last_became_active":"2023-12-19T13:49:36.405205+0000","last_became_peered":"2023-12-19T13:49:36.405205+0000","last_unstale":"2023-12-19T13:49:38.822845+0000","last_undegraded":"2023-12-19T13:49:38.822845+0000","last_fullsized":"2023-12-19T13:49:38.822845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:14.792675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.899133+0000","last_change":"2023-12-19T13:49:34.899133+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.899133+0000","last_undegraded":"2023-12-19T13:49:34.899133+0000","last_fullsized":"2023-12-19T13:49:34.899133+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:17.486114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398893+0000","last_change":"2023-12-19T13:49:36.406414+0000","last_active":"2023-12-19T13:49:37.398893+0000","last_peered":"2023-12-19T13:49:37.398893+0000","last_clean":"2023-12-19T13:49:37.398893+0000","last_became_active":"2023-12-19T13:49:36.404928+0000","last_became_peered":"2023-12-19T13:49:36.404928+0000","last_unstale":"2023-12-19T13:49:37.398893+0000","last_undegraded":"2023-12-19T13:49:37.398893+0000","last_fullsized":"2023-12-19T13:49:37.398893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:31.791070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407855+0000","last_change":"2023-12-19T13:49:35.932840+0000","last_active":"2023-12-19T13:49:36.407855+0000","last_peered":"2023-12-19T13:49:36.407855+0000","last_clean":"2023-12-19T13:49:36.407855+0000","last_became_active":"2023-12-19T13:49:35.931197+0000","last_became_peered":"2023-12-19T13:49:35.931197+0000","last_unstale":"2023-12-19T13:49:36.407855+0000","last_undegraded":"2023-12-19T13:49:36.407855+0000","last_fullsized":"2023-12-19T13:49:36.407855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:01.364262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.904300+0000","last_change":"2023-12-19T13:49:34.904300+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.904300+0000","last_undegraded":"2023-12-19T13:49:34.904300+0000","last_fullsized":"2023-12-19T13:49:34.904300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:11.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389289+0000","last_change":"2023-12-19T13:49:35.934554+0000","last_active":"2023-12-19T13:49:36.389289+0000","last_peered":"2023-12-19T13:49:36.389289+0000","last_clean":"2023-12-19T13:49:36.389289+0000","last_became_active":"2023-12-19T13:49:35.934390+0000","last_became_peered":"2023-12-19T13:49:35.934390+0000","last_unstale":"2023-12-19T13:49:36.389289+0000","last_undegraded":"2023-12-19T13:49:36.389289+0000","last_fullsized":"2023-12-19T13:49:36.389289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824229+0000","last_change":"2023-12-19T13:49:36.406483+0000","last_active":"2023-12-19T13:49:38.824229+0000","last_peered":"2023-12-19T13:49:38.824229+0000","last_clean":"2023-12-19T13:49:38.824229+0000","last_became_active":"2023-12-19T13:49:36.402037+0000","last_became_peered":"2023-12-19T13:49:36.402037+0000","last_unstale":"2023-12-19T13:49:38.824229+0000","last_undegraded":"2023-12-19T13:49:38.824229+0000","last_fullsized":"2023-12-19T13:49:38.824229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.895432+0000","last_change":"2023-12-19T13:49:34.895432+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.895432+0000","last_undegraded":"2023-12-19T13:49:34.895432+0000","last_fullsized":"2023-12-19T13:49:34.895432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:30.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822793+0000","last_change":"2023-12-19T13:49:36.400530+0000","last_active":"2023-12-19T13:49:38.822793+0000","last_peered":"2023-12-19T13:49:38.822793+0000","last_clean":"2023-12-19T13:49:38.822793+0000","last_became_active":"2023-12-19T13:49:36.400046+0000","last_became_peered":"2023-12-19T13:49:36.400046+0000","last_unstale":"2023-12-19T13:49:38.822793+0000","last_undegraded":"2023-12-19T13:49:38.822793+0000","last_fullsized":"2023-12-19T13:49:38.822793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:56.941388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900983+0000","last_change":"2023-12-19T13:49:34.900983+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900983+0000","last_undegraded":"2023-12-19T13:49:34.900983+0000","last_fullsized":"2023-12-19T13:49:34.900983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:17.202412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390316+0000","last_change":"2023-12-19T13:49:35.924316+0000","last_active":"2023-12-19T13:49:36.390316+0000","last_peered":"2023-12-19T13:49:36.390316+0000","last_clean":"2023-12-19T13:49:36.390316+0000","last_became_active":"2023-12-19T13:49:35.924099+0000","last_became_peered":"2023-12-19T13:49:35.924099+0000","last_unstale":"2023-12-19T13:49:36.390316+0000","last_undegraded":"2023-12-19T13:49:36.390316+0000","last_fullsized":"2023-12-19T13:49:36.390316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:07.758117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.393487+0000","last_change":"2023-12-19T13:49:35.924508+0000","last_active":"2023-12-19T13:49:36.393487+0000","last_peered":"2023-12-19T13:49:36.393487+0000","last_clean":"2023-12-19T13:49:36.393487+0000","last_became_active":"2023-12-19T13:49:35.923964+0000","last_became_peered":"2023-12-19T13:49:35.923964+0000","last_unstale":"2023-12-19T13:49:36.393487+0000","last_undegraded":"2023-12-19T13:49:36.393487+0000","last_fullsized":"2023-12-19T13:49:36.393487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.896352+0000","last_change":"2023-12-19T13:49:34.896352+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.896352+0000","last_undegraded":"2023-12-19T13:49:34.896352+0000","last_fullsized":"2023-12-19T13:49:34.896352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.391631+0000","last_change":"2023-12-19T13:49:35.934965+0000","last_active":"2023-12-19T13:49:36.391631+0000","last_peered":"2023-12-19T13:49:36.391631+0000","last_clean":"2023-12-19T13:49:36.391631+0000","last_became_active":"2023-12-19T13:49:35.934823+0000","last_became_peered":"2023-12-19T13:49:35.934823+0000","last_unstale":"2023-12-19T13:49:36.391631+0000","last_undegraded":"2023-12-19T13:49:36.391631+0000","last_fullsized":"2023-12-19T13:49:36.391631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.898613+0000","last_change":"2023-12-19T13:49:34.898613+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.898613+0000","last_undegraded":"2023-12-19T13:49:34.898613+0000","last_fullsized":"2023-12-19T13:49:34.898613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900116+0000","last_change":"2023-12-19T13:49:34.900116+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900116+0000","last_undegraded":"2023-12-19T13:49:34.900116+0000","last_fullsized":"2023-12-19T13:49:34.900116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:43:25.064014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:49:35.892418+0000","last_change":"2023-12-19T13:49:35.892418+0000","last_active":"2023-12-19T13:49:35.892418+0000","last_peered":"2023-12-19T13:49:35.892418+0000","last_clean":"2023-12-19T13:49:35.892418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:35.892418+0000","last_undegraded":"2023-12-19T13:49:35.892418+0000","last_fullsized":"2023-12-19T13:49:35.892418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-19T13:49:34.900087+0000","last_change":"2023-12-19T13:49:34.900087+0000","last_active":"2023-12-19T13:49:34.878690+0000","last_peered":"2023-12-19T13:49:34.878690+0000","last_clean":"2023-12-19T13:49:34.878690+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:49:34.900087+0000","last_undegraded":"2023-12-19T13:49:34.900087+0000","last_fullsized":"2023-12-19T13:49:34.900087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390447+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:49:36.390447+0000","last_peered":"2023-12-19T13:49:36.390447+0000","last_clean":"2023-12-19T13:49:36.390447+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:49:36.390447+0000","last_undegraded":"2023-12-19T13:49:36.390447+0000","last_fullsized":"2023-12-19T13:49:36.390447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":348,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194964,"statfs":{"total":200000000,"available":199643629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.0009999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.375,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0049999999999999,"15min":0.98299999999999998},"min":{"1min":0.64000000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3380000000000001,"5min":2.008,"15min":2.008},"last":1.496}]},{"osd":1,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.079,"15min":1.069},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.429},{"interface":"front","average":{"1min":1.101,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4079999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.391}]},{"osd":2,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1399999999999999,"15min":1.133},"min":{"1min":0.81399999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.71,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.653},{"interface":"front","average":{"1min":1.147,"5min":1.1699999999999999,"15min":1.147},"min":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4299999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.597,"5min":1.931,"15min":1.931},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.252,"15min":1.23},"min":{"1min":0.79600000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7470000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.105}]},{"osd":4,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.282,"15min":1.286},"min":{"1min":0.84499999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6519999999999999,"5min":2.181,"15min":2.181},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.3859999999999999,"15min":1.3979999999999999},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.673,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.002}]},{"osd":5,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.24,"15min":1.222},"min":{"1min":0.871,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5429999999999999,"5min":1.956,"15min":1.956},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.4339999999999999,"15min":1.429},"min":{"1min":1.038,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.5209999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.292,"15min":1.262},"min":{"1min":0.90300000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6850000000000001,"5min":2.024,"15min":2.024},"last":1.26},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5049999999999999,"15min":1.4870000000000001},"min":{"1min":1.2050000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.796,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.597}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.0289999999999999},"min":{"1min":0.629,"5min":0.628,"15min":0.628},"max":{"1min":1.502,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.089,"15min":1.121},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3400000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.05,"15min":1.03},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.962,"15min":1.962},"last":1.071},{"interface":"front","average":{"1min":1.137,"5min":1.0620000000000001,"15min":1.032},"min":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5860000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.4319999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.2210000000000001},"min":{"1min":0.82499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6970000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.351},{"interface":"front","average":{"1min":1.254,"5min":1.173,"15min":1.151},"min":{"1min":0.96299999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6140000000000001,"5min":1.786,"15min":1.786},"last":1.0489999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3169999999999999,"15min":1.3520000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.478,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.266,"15min":1.272},"min":{"1min":1.024,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6299999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.2989999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.226,"15min":1.204},"min":{"1min":0.92600000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.484},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.3120000000000001,"15min":1.292},"min":{"1min":1.0920000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.228}]},{"osd":5,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.268,"15min":1.246},"min":{"1min":1.135,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6120000000000001,"5min":1.827,"15min":1.827},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.399,"15min":1.371},"min":{"1min":1.2849999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.5369999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.4159999999999999},"min":{"1min":1.0840000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.377,"15min":1.355},"min":{"1min":1.2430000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.766,"15min":1.766},"last":1.498}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194382,"statfs":{"total":200000000,"available":199047444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.595,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0509999999999999,"15min":1.0609999999999999},"min":{"1min":0.68700000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.1220000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.423,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.125,"5min":1.024,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3939999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.0840000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.202,"15min":1.246},"min":{"1min":0.83399999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3280000000000001,"5min":2.827,"15min":2.827},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.25,"15min":1.2689999999999999},"min":{"1min":0.93200000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5209999999999999,"5min":2.863,"15min":2.863},"last":1.042}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2090000000000001,"15min":1.204},"min":{"1min":1.0429999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.623,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.244,"15min":1.242},"min":{"1min":0.87,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5940000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.3169999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.153,"15min":1.137},"min":{"1min":0.90400000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5169999999999999,"5min":1.982,"15min":1.982},"last":1.228},{"interface":"front","average":{"1min":1.288,"5min":1.278,"15min":1.2769999999999999},"min":{"1min":0.88,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.474,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5980000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.343,"15min":1.3169999999999999},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.579,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.181},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.357,"15min":1.369},"min":{"1min":1.0609999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.6479999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.5029999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3959999999999999,"15min":1.401},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7090000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.427,"15min":1.403},"min":{"1min":1.2470000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6910000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.4830000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199617846,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.657,"15min":1.657},"last":1.113},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1259999999999999},"min":{"1min":0.69499999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.542,"5min":2.016,"15min":2.016},"last":0.85399999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.073,"15min":1.069},"min":{"1min":0.76600000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.1000000000000001,"15min":1.1140000000000001},"min":{"1min":0.754,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4039999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0580000000000001,"15min":1.0169999999999999},"min":{"1min":0.76500000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1120000000000001,"15min":1.105},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.405,"5min":1.575,"15min":1.575},"last":1.143}]},{"osd":3,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.206,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.952,"15min":1.952},"last":1.288},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.258,"15min":1.274},"min":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.482,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.25}]},{"osd":5,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.216,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.165,"15min":2.165},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.325,"15min":1.343},"min":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6970000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.405}]},{"osd":6,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.85099999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.595,"5min":2.335,"15min":2.335},"last":1.5640000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4490000000000001,"15min":1.46},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.782,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.5,"15min":1.522},"min":{"1min":0.89300000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.921,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.6499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.89200000000000002,"15min":0.95599999999999996},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2290000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.94499999999999995,"15min":0.97799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.4590000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":1.032},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.006},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96399999999999997,"15min":0.99399999999999999},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2589999999999999,"5min":2.387,"15min":2.387},"last":0.87}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.097,"15min":1.143},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4690000000000001,"5min":2.657,"15min":2.657},"last":0.78900000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.236,"15min":1.272},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.51,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.353},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.21,"15min":1.23},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6419999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.151}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.278,"15min":1.3140000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.7030000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.256,"15min":1.276},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.671,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.21}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.637,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.321,"15min":1.349},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":2.698,"15min":2.698},"last":1.389}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.337,"15min":1.3759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.76,"5min":3.609,"15min":3.609},"last":1.47},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.02,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.4370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":2.258,"15min":2.258},"last":1.022},{"interface":"front","average":{"1min":1.468,"5min":0.91700000000000004,"15min":0.81699999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":11.85,"5min":11.85,"15min":11.85},"last":1.3560000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.363,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.625,"5min":1.018,"15min":0.92500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":11.788,"5min":11.788,"15min":11.788},"last":1.2150000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.397,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.089},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.0569999999999999,"15min":1.0269999999999999},"min":{"1min":0.501,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.8079999999999998,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":1.2490000000000001,"15min":1.1559999999999999},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6679999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.27}]},{"osd":5,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.321,"15min":1.2190000000000001},"min":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":11.888,"5min":11.888,"15min":11.888},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.302,"15min":1.306},"min":{"1min":1.014,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9850000000000001,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3140000000000001,"15min":1.3180000000000001},"min":{"1min":0.88300000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0640000000000001,"5min":2.964,"15min":2.964},"last":1},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2629999999999999,"15min":1.2490000000000001},"min":{"1min":0.85399999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.944,"5min":2.286,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0369999999999999,"5min":2.351,"15min":2.351},"last":1.1779999999999999},{"interface":"front","average":{"1min":2.0110000000000001,"5min":1.375,"15min":1.282},"min":{"1min":0.82099999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":11.962999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.4570000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194362,"statfs":{"total":200000000,"available":199027512,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.82599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.26,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.351,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.044,"15min":1.1000000000000001},"min":{"1min":0.51600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.012},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.169,"15min":1.1930000000000001},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7829999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.0469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.117,"15min":1.2030000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3009999999999999,"5min":7.157,"15min":7.157},"last":1.079}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.236},"min":{"1min":0.83299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.575,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.282,"15min":1.304},"min":{"1min":0.85499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.738,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.94599999999999995}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.294,"15min":1.337},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1669999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.135},{"interface":"front","average":{"1min":1.994,"5min":1.468,"15min":1.3979999999999999},"min":{"1min":0.81200000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":15.576000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.335,"15min":1.351},"min":{"1min":0.75800000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8260000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.254},{"interface":"front","average":{"1min":1.278,"5min":1.379,"15min":1.4339999999999999},"min":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.226,"5min":3.786,"15min":3.786},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.409,"15min":1.458},"min":{"1min":0.84799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.9039999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.355},{"interface":"front","average":{"1min":1.258,"5min":1.421,"15min":1.476},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6830000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.2290000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4430000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.53600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":14.010999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.7919999999999998,"5min":1.238,"15min":0.99099999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":33.799999999999997,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.1930000000000001},{"interface":"front","average":{"1min":3.302,"5min":1.3759999999999999,"15min":1.0660000000000001},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":41.758000000000003,"5min":41.758000000000003,"15min":41.758000000000003},"last":1.55}]},{"osd":3,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.93500000000000005,"15min":1.0229999999999999},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4330000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.048,"15min":1.0960000000000001},"min":{"1min":0.46600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3759999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.496}]},{"osd":4,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5149999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.994,"5min":1.323,"15min":1.2030000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":1.8140000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.3200000000000001,"15min":1.2110000000000001},"min":{"1min":0.83699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":14.337999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.8999999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.6279999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.282,"15min":1.248},"min":{"1min":0.72999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":5.4669999999999996,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.8939999999999999},{"interface":"front","average":{"1min":2.23,"5min":1.4399999999999999,"15min":1.3120000000000001},"min":{"1min":0.94799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":17.161000000000001,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.774}]},{"osd":7,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.429,"15min":1.323},"min":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":1.325},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.4239999999999999,"15min":1.411},"min":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":9.7080000000000002,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.7230000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:49:41.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-12-19T13:49:41.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-12-19T13:49:41.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-12-19T13:49:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-12-19T13:49:41.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.896599+0000', 'last_change': '2023-12-19T13:49:34.896599+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.896599+0000', 'last_undegraded': '2023-12-19T13:49:34.896599+0000', 'last_fullsized': '2023-12-19T13:49:34.896599+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:02:25.292841+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.900754+0000', 'last_change': '2023-12-19T13:49:34.900754+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.900754+0000', 'last_undegraded': '2023-12-19T13:49:34.900754+0000', 'last_fullsized': '2023-12-19T13:49:34.900754+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:15:25.328752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-12-19T13:49:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.902229+0000', 'last_change': '2023-12-19T13:49:34.902229+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.902229+0000', 'last_undegraded': '2023-12-19T13:49:34.902229+0000', 'last_fullsized': '2023-12-19T13:49:34.902229+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:38:05.089463+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.900860+0000', 'last_change': '2023-12-19T13:49:34.900860+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.900860+0000', 'last_undegraded': '2023-12-19T13:49:34.900860+0000', 'last_fullsized': '2023-12-19T13:49:34.900860+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.900105+0000', 'last_change': '2023-12-19T13:49:34.900105+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.900105+0000', 'last_undegraded': '2023-12-19T13:49:34.900105+0000', 'last_fullsized': '2023-12-19T13:49:34.900105+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:39:51.647666+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:49:41.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.899143+0000', 'last_change': '2023-12-19T13:49:34.899143+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.899143+0000', 'last_undegraded': '2023-12-19T13:49:34.899143+0000', 'last_fullsized': '2023-12-19T13:49:34.899143+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.903501+0000', 'last_change': '2023-12-19T13:49:34.903501+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.903501+0000', 'last_undegraded': '2023-12-19T13:49:34.903501+0000', 'last_fullsized': '2023-12-19T13:49:34.903501+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:53:46.501331+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.895594+0000', 'last_change': '2023-12-19T13:49:34.895594+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.895594+0000', 'last_undegraded': '2023-12-19T13:49:34.895594+0000', 'last_fullsized': '2023-12-19T13:49:34.895594+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:56:37.941627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.902664+0000', 'last_change': '2023-12-19T13:49:34.902664+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.902664+0000', 'last_undegraded': '2023-12-19T13:49:34.902664+0000', 'last_fullsized': '2023-12-19T13:49:34.902664+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:19:17.146776+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-12-19T13:49:41.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.899133+0000', 'last_change': '2023-12-19T13:49:34.899133+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.899133+0000', 'last_undegraded': '2023-12-19T13:49:34.899133+0000', 'last_fullsized': '2023-12-19T13:49:34.899133+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:56:17.486114+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.904300+0000', 'last_change': '2023-12-19T13:49:34.904300+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.904300+0000', 'last_undegraded': '2023-12-19T13:49:34.904300+0000', 'last_fullsized': '2023-12-19T13:49:34.904300+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:04:11.249195+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.895432+0000', 'last_change': '2023-12-19T13:49:34.895432+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.895432+0000', 'last_undegraded': '2023-12-19T13:49:34.895432+0000', 'last_fullsized': '2023-12-19T13:49:34.895432+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:55:30.649898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-12-19T13:49:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.900983+0000', 'last_change': '2023-12-19T13:49:34.900983+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.900983+0000', 'last_undegraded': '2023-12-19T13:49:34.900983+0000', 'last_fullsized': '2023-12-19T13:49:34.900983+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:51:17.202412+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.896352+0000', 'last_change': '2023-12-19T13:49:34.896352+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.896352+0000', 'last_undegraded': '2023-12-19T13:49:34.896352+0000', 'last_fullsized': '2023-12-19T13:49:34.896352+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-12-19T13:49:41.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.898613+0000', 'last_change': '2023-12-19T13:49:34.898613+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.898613+0000', 'last_undegraded': '2023-12-19T13:49:34.898613+0000', 'last_fullsized': '2023-12-19T13:49:34.898613+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.900116+0000', 'last_change': '2023-12-19T13:49:34.900116+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.900116+0000', 'last_undegraded': '2023-12-19T13:49:34.900116+0000', 'last_fullsized': '2023-12-19T13:49:34.900116+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:43:25.064014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T13:49:35.892418+0000', 'last_change': '2023-12-19T13:49:35.892418+0000', 'last_active': '2023-12-19T13:49:35.892418+0000', 'last_peered': '2023-12-19T13:49:35.892418+0000', 'last_clean': '2023-12-19T13:49:35.892418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:35.892418+0000', 'last_undegraded': '2023-12-19T13:49:35.892418+0000', 'last_fullsized': '2023-12-19T13:49:35.892418+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:35.892418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-12-19T13:49:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:49:34.900087+0000', 'last_change': '2023-12-19T13:49:34.900087+0000', 'last_active': '2023-12-19T13:49:34.878690+0000', 'last_peered': '2023-12-19T13:49:34.878690+0000', 'last_clean': '2023-12-19T13:49:34.878690+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:49:34.900087+0000', 'last_undegraded': '2023-12-19T13:49:34.900087+0000', 'last_fullsized': '2023-12-19T13:49:34.900087+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'last_clean_scrub_stamp': '2023-12-19T13:49:34.878690+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:49:41.857 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T13:49:42.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.099+0000 7fc19ccd4640 1 Processor -- start 2023-12-19T13:49:42.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.099+0000 7fc19ccd4640 1 -- start start 2023-12-19T13:49:42.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.101+0000 7fc19ccd4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc198146e10 0x7fc1980d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.101+0000 7fc19ccd4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1980d2b00 0x7fc1980b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.101+0000 7fc19ccd4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1980ce110 0x7fc1980ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.101+0000 7fc19ccd4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1980d2430 con 0x7fc1980ce110 2023-12-19T13:49:42.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.101+0000 7fc19ccd4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1980ceae0 con 0x7fc198146e10 2023-12-19T13:49:42.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.101+0000 7fc19ccd4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980cd840 con 0x7fc1980d2b00 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.101+0000 7fc196d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1980ce110 0x7fc1980ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc196d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1980ce110 0x7fc1980ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58166/0 (socket says 172.21.15.113:58166) 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc196d9d640 1 -- 172.21.15.113:0/3718213250 learned_addr learned my addr 172.21.15.113:0/3718213250 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc18ffff640 1 --2- 172.21.15.113:0/3718213250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1980d2b00 0x7fc1980b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc19659c640 1 --2- 172.21.15.113:0/3718213250 >> v2:172.21.15.151:3300/0 conn(0x7fc198146e10 0x7fc1980d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc196d9d640 1 -- 172.21.15.113:0/3718213250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1980d2b00 msgr2=0x7fc1980b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc196d9d640 1 --2- 172.21.15.113:0/3718213250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1980d2b00 0x7fc1980b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc196d9d640 1 -- 172.21.15.113:0/3718213250 >> v2:172.21.15.151:3300/0 conn(0x7fc198146e10 msgr2=0x7fc1980d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc196d9d640 1 --2- 172.21.15.113:0/3718213250 >> v2:172.21.15.151:3300/0 conn(0x7fc198146e10 0x7fc1980d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.102+0000 7fc196d9d640 1 -- 172.21.15.113:0/3718213250 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1980d2620 con 0x7fc1980ce110 2023-12-19T13:49:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.103+0000 7fc196d9d640 1 --2- 172.21.15.113:0/3718213250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980ce110 0x7fc1980ce5a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc1980d0720 tx=0x7fc19002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64ca91d6cb5c336 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.103+0000 7fc195d9b640 1 -- 172.21.15.113:0/3718213250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19002ca70 con 0x7fc1980ce110 2023-12-19T13:49:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.103+0000 7fc195d9b640 1 -- 172.21.15.113:0/3718213250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19002cbd0 con 0x7fc1980ce110 2023-12-19T13:49:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.103+0000 7fc195d9b640 1 -- 172.21.15.113:0/3718213250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1900343f0 con 0x7fc1980ce110 2023-12-19T13:49:42.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 -- 172.21.15.113:0/3718213250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980ce110 msgr2=0x7fc1980ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/3718213250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980ce110 0x7fc1980ce5a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc1980d0720 tx=0x7fc19002bed0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 -- 172.21.15.113:0/3718213250 shutdown_connections 2023-12-19T13:49:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/3718213250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980ce110 0x7fc1980ce5a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/3718213250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1980d2b00 0x7fc1980b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/3718213250 >> v2:172.21.15.151:3300/0 conn(0x7fc198146e10 0x7fc1980d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 -- 172.21.15.113:0/3718213250 >> 172.21.15.113:0/3718213250 conn(0x7fc1980b29c0 msgr2=0x7fc1980b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 -- 172.21.15.113:0/3718213250 shutdown_connections 2023-12-19T13:49:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.104+0000 7fc19ccd4640 1 -- 172.21.15.113:0/3718213250 wait complete. 2023-12-19T13:49:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.106+0000 7fc19ccd4640 1 Processor -- start 2023-12-19T13:49:42.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.106+0000 7fc19ccd4640 1 -- start start 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc19ccd4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1980ce110 0x7fc19813c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc19ccd4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980d2b00 0x7fc19813ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc19ccd4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc198146e10 0x7fc19813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc19ccd4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1981601d0 con 0x7fc1980d2b00 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc19ccd4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19813cf90 con 0x7fc1980ce110 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc19ccd4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19815f870 con 0x7fc198146e10 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc18ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980d2b00 0x7fc19813ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc18ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980d2b00 0x7fc19813ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58174/0 (socket says 172.21.15.113:58174) 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.107+0000 7fc18ffff640 1 -- 172.21.15.113:0/1575545061 learned_addr learned my addr 172.21.15.113:0/1575545061 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18ffff640 1 -- 172.21.15.113:0/1575545061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc198146e10 msgr2=0x7fc19813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc19659c640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1980ce110 0x7fc19813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18ffff640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc198146e10 0x7fc19813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18ffff640 1 -- 172.21.15.113:0/1575545061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1980ce110 msgr2=0x7fc19813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18ffff640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1980ce110 0x7fc19813c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18ffff640 1 -- 172.21.15.113:0/1575545061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc190009b30 con 0x7fc1980d2b00 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18ffff640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980d2b00 0x7fc19813ca50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc18000e890 tx=0x7fc18000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18effd640 1 -- 172.21.15.113:0/1575545061 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000c940 con 0x7fc1980d2b00 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18effd640 1 -- 172.21.15.113:0/1575545061 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000caa0 con 0x7fc1980d2b00 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc18effd640 1 -- 172.21.15.113:0/1575545061 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000ce30 con 0x7fc1980d2b00 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.108+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc198143630 con 0x7fc1980d2b00 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.109+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19815fdf0 con 0x7fc1980d2b00 2023-12-19T13:49:42.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.110+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc198160310 con 0x7fc1980d2b00 2023-12-19T13:49:42.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.111+0000 7fc18effd640 1 -- 172.21.15.113:0/1575545061 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc180013470 con 0x7fc1980d2b00 2023-12-19T13:49:42.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.111+0000 7fc18effd640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc17806a430 0x7fc17806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.112+0000 7fc18effd640 1 -- 172.21.15.113:0/1575545061 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc180088a60 con 0x7fc1980d2b00 2023-12-19T13:49:42.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.112+0000 7fc19659c640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc17806a430 0x7fc17806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.112+0000 7fc19659c640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc17806a430 0x7fc17806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc188009a10 tx=0x7fc188008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:42.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.116+0000 7fc18effd640 1 -- 172.21.15.113:0/1575545061 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc198160310 con 0x7fc1980d2b00 2023-12-19T13:49:42.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.374+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc198160310 con 0x7fc1980d2b00 2023-12-19T13:49:42.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.375+0000 7fc18effd640 1 -- 172.21.15.113:0/1575545061 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1328 (secure 0 0 0) 0x7fc180017540 con 0x7fc1980d2b00 2023-12-19T13:49:42.375 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:42.375 INFO:teuthology.orchestra.run.smithi113.stdout:{"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":208,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":73,"num_osds":8,"num_up_osds":8,"osd_up_since":1702993580,"num_in_osds":8,"osd_in_since":1702993577,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":44},{"state_name":"unknown","count":36},{"state_name":"creating+peering","count":17}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":591110,"bytes_used":4152835,"bytes_avail":1595847165,"bytes_total":1600000000,"unknown_pgs_ratio":0.37113401293754578,"inactive_pgs_ratio":0.17525772750377655,"write_bytes_sec":551,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":33,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-19T13:49:20.462632+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T13:49:42.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.377+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc17806a430 msgr2=0x7fc17806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.377+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc17806a430 0x7fc17806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc188009a10 tx=0x7fc188008040 comp rx=0 tx=0).stop 2023-12-19T13:49:42.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980d2b00 msgr2=0x7fc19813ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980d2b00 0x7fc19813ca50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc18000e890 tx=0x7fc18000ed50 comp rx=0 tx=0).stop 2023-12-19T13:49:42.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 shutdown_connections 2023-12-19T13:49:42.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc17806a430 0x7fc17806c8f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc198146e10 0x7fc19813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1980d2b00 0x7fc19813ca50 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 --2- 172.21.15.113:0/1575545061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1980ce110 0x7fc19813c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 >> 172.21.15.113:0/1575545061 conn(0x7fc1980b29c0 msgr2=0x7fc1980b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:42.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 shutdown_connections 2023-12-19T13:49:42.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.378+0000 7fc19ccd4640 1 -- 172.21.15.113:0/1575545061 wait complete. 2023-12-19T13:49:42.397 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T13:49:42.398 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:49:42.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.614+0000 7f42db9ae640 1 Processor -- start 2023-12-19T13:49:42.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.614+0000 7f42db9ae640 1 -- start start 2023-12-19T13:49:42.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.615+0000 7f42db9ae640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f42d4146da0 0x7f42d40aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42db9ae640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40d1070 con 0x7f42d4161900 2023-12-19T13:49:42.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42db9ae640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d4162020 con 0x7f42d4147180 2023-12-19T13:49:42.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42db9ae640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40aabd0 con 0x7f42d4146da0 2023-12-19T13:49:42.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42d9f4b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f42d4161900 0x7f42d40d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59254/0 (socket says 172.21.15.113:59254) 2023-12-19T13:49:42.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42d9f4b640 1 -- 172.21.15.113:0/1398523730 learned_addr learned my addr 172.21.15.113:0/1398523730 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:42.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42d974a640 1 --2- 172.21.15.113:0/1398523730 >> v2:172.21.15.151:3300/0 conn(0x7f42d4146da0 0x7f42d40aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748788697 0 0) 0x7f42d40d1070 con 0x7f42d4161900 2023-12-19T13:49:42.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.616+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c0003520 con 0x7f42d4161900 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1545261124 0 0) 0x7f42c0003520 con 0x7f42d4161900 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 >> v2:172.21.15.151:3300/0 conn(0x7f42d4146da0 msgr2=0x7f42d40aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 --2- 172.21.15.113:0/1398523730 >> v2:172.21.15.151:3300/0 conn(0x7f42d4146da0 0x7f42d40aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 >> v1:172.21.15.151:6789/0 conn(0x7f42d4147180 legacy=0x7f42d41611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40aaeb0 con 0x7f42d4161900 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f42cc0019f0 con 0x7f42d4161900 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 >> v1:172.21.15.113:6789/0 conn(0x7f42d4161900 legacy=0x7f42d40d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42c0003a30 0x7f42c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c00047c0 0x7f42c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42c0005180 0x7f42c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40aabd0 con 0x7f42c0003a30 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c000c120 con 0x7f42c00047c0 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c000c2e0 con 0x7f42c0005180 2023-12-19T13:49:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.617+0000 7f42d974a640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42c0003a30 0x7f42c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.618+0000 7f42d974a640 1 -- 172.21.15.113:0/1398523730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42c0005180 msgr2=0x7f42c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:42.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.618+0000 7f42d974a640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42c0005180 0x7f42c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.618+0000 7f42d974a640 1 -- 172.21.15.113:0/1398523730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c00047c0 msgr2=0x7f42c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:42.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.618+0000 7f42d974a640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c00047c0 0x7f42c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.618+0000 7f42d974a640 1 -- 172.21.15.113:0/1398523730 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0003520 con 0x7f42c0003a30 2023-12-19T13:49:42.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.618+0000 7f42d9f4b640 1 -- 172.21.15.113:0/1398523730 reap_dead start 2023-12-19T13:49:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.619+0000 7f42d974a640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42c0003a30 0x7f42c0003e30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ac0 tx=0x7f42c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa78cf0919191da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.619+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d002c6b0 con 0x7f42c0003a30 2023-12-19T13:49:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.619+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d002c810 con 0x7f42c0003a30 2023-12-19T13:49:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.619+0000 7f42cbfff640 1 -- 172.21.15.113:0/1398523730 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d002cba0 con 0x7f42c0003a30 2023-12-19T13:49:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.619+0000 7f42db9ae640 1 -- 172.21.15.113:0/1398523730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42c0003a30 msgr2=0x7f42c0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.620+0000 7f42db9ae640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42c0003a30 0x7f42c0003e30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ac0 tx=0x7f42c00057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.620+0000 7f42db9ae640 1 -- 172.21.15.113:0/1398523730 shutdown_connections 2023-12-19T13:49:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.620+0000 7f42db9ae640 1 --2- 172.21.15.113:0/1398523730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42c0003a30 0x7f42c0003e30 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.620+0000 7f42db9ae640 1 -- 172.21.15.113:0/1398523730 >> 172.21.15.113:0/1398523730 conn(0x7f42d4071a50 msgr2=0x7f42d40d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.620+0000 7f42db9ae640 1 -- 172.21.15.113:0/1398523730 shutdown_connections 2023-12-19T13:49:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.620+0000 7f42db9ae640 1 -- 172.21.15.113:0/1398523730 wait complete. 2023-12-19T13:49:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.622+0000 7f42db9ae640 1 Processor -- start 2023-12-19T13:49:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.622+0000 7f42db9ae640 1 -- start start 2023-12-19T13:49:42.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42db9ae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c0003a30 0x7f42d40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42db9ae640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42d4142b70 0x7f42d4138980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42db9ae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42d41441b0 0x7f42d4144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42db9ae640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b0290 con 0x7f42d4142b70 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42db9ae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b1150 con 0x7f42c0003a30 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42db9ae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d415d020 con 0x7f42d41441b0 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d8f49640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42d4142b70 0x7f42d4138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d8f49640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42d4142b70 0x7f42d4138980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58186/0 (socket says 172.21.15.113:58186) 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d8f49640 1 -- 172.21.15.113:0/2775388782 learned_addr learned my addr 172.21.15.113:0/2775388782 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d974a640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c0003a30 0x7f42d40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d9f4b640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42d41441b0 0x7f42d4144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d8f49640 1 -- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42d41441b0 msgr2=0x7f42d4144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d8f49640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42d41441b0 0x7f42d4144630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d8f49640 1 -- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c0003a30 msgr2=0x7f42d40b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.623+0000 7f42d8f49640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c0003a30 0x7f42d40b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42d8f49640 1 -- 172.21.15.113:0/2775388782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4143110 con 0x7f42d4142b70 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42d974a640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c0003a30 0x7f42d40b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42d8f49640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42d4142b70 0x7f42d4138980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c480 tx=0x7f42c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42c9ffb640 1 -- 172.21.15.113:0/2775388782 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4012830 con 0x7f42d4142b70 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42c9ffb640 1 -- 172.21.15.113:0/2775388782 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4012990 con 0x7f42d4142b70 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42c9ffb640 1 -- 172.21.15.113:0/2775388782 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4012d80 con 0x7f42d4142b70 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d41433f0 con 0x7f42d4142b70 2023-12-19T13:49:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.624+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d41439b0 con 0x7f42d4142b70 2023-12-19T13:49:42.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.625+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4073ec0 con 0x7f42d4142b70 2023-12-19T13:49:42.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.626+0000 7f42c9ffb640 1 -- 172.21.15.113:0/2775388782 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42c401b400 con 0x7f42d4142b70 2023-12-19T13:49:42.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.627+0000 7f42c9ffb640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42b806a430 0x7f42b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:42.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.627+0000 7f42c9ffb640 1 -- 172.21.15.113:0/2775388782 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42c4088ad0 con 0x7f42d4142b70 2023-12-19T13:49:42.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.628+0000 7f42d974a640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42b806a430 0x7f42b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.628+0000 7f42d974a640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42b806a430 0x7f42b806c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f42d0036000 tx=0x7f42d0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:42.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.632+0000 7f42c9ffb640 1 -- 172.21.15.113:0/2775388782 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f42c4054150 con 0x7f42d4142b70 2023-12-19T13:49:42.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.815+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42d40ab470 con 0x7f42b806a430 2023-12-19T13:49:42.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.828+0000 7f42c9ffb640 1 -- 172.21.15.113:0/2775388782 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282010 (secure 0 0 0) 0x7f42d00041c0 con 0x7f42b806a430 2023-12-19T13:49:42.831 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:42.834 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.835+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42b806a430 msgr2=0x7f42b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.835+0000 7f42db9ae640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42b806a430 0x7f42b806c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f42d0036000 tx=0x7f42d0030000 comp rx=0 tx=0).stop 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.835+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42d4142b70 msgr2=0x7f42d4138980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.835+0000 7f42db9ae640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42d4142b70 0x7f42d4138980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c480 tx=0x7f42c400c940 comp rx=0 tx=0).stop 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 shutdown_connections 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42b806a430 0x7f42b806c8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42d41441b0 0x7f42d4144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42d4142b70 0x7f42d4138980 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 --2- 172.21.15.113:0/2775388782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42c0003a30 0x7f42d40b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 >> 172.21.15.113:0/2775388782 conn(0x7f42d4071a50 msgr2=0x7f42d41414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 shutdown_connections 2023-12-19T13:49:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:42.836+0000 7f42db9ae640 1 -- 172.21.15.113:0/2775388782 wait complete. 2023-12-19T13:49:42.853 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2023-12-19T13:49:42.467945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4138,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558361,"statfs":{"total":1600000000,"available":1595762236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.555662"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400360+0000","last_change":"2023-12-19T13:49:36.406923+0000","last_active":"2023-12-19T13:49:37.400360+0000","last_peered":"2023-12-19T13:49:37.400360+0000","last_clean":"2023-12-19T13:49:37.400360+0000","last_became_active":"2023-12-19T13:49:36.406685+0000","last_became_peered":"2023-12-19T13:49:36.406685+0000","last_unstale":"2023-12-19T13:49:37.400360+0000","last_undegraded":"2023-12-19T13:49:37.400360+0000","last_fullsized":"2023-12-19T13:49:37.400360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402388+0000","last_change":"2023-12-19T13:49:36.410699+0000","last_active":"2023-12-19T13:49:37.402388+0000","last_peered":"2023-12-19T13:49:37.402388+0000","last_clean":"2023-12-19T13:49:37.402388+0000","last_became_active":"2023-12-19T13:49:36.409574+0000","last_became_peered":"2023-12-19T13:49:36.409574+0000","last_unstale":"2023-12-19T13:49:37.402388+0000","last_undegraded":"2023-12-19T13:49:37.402388+0000","last_fullsized":"2023-12-19T13:49:37.402388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:34.189380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822971+0000","last_change":"2023-12-19T13:49:36.394475+0000","last_active":"2023-12-19T13:49:38.822971+0000","last_peered":"2023-12-19T13:49:38.822971+0000","last_clean":"2023-12-19T13:49:38.822971+0000","last_became_active":"2023-12-19T13:49:36.394262+0000","last_became_peered":"2023-12-19T13:49:36.394262+0000","last_unstale":"2023-12-19T13:49:38.822971+0000","last_undegraded":"2023-12-19T13:49:38.822971+0000","last_fullsized":"2023-12-19T13:49:38.822971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:36.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822286+0000","last_change":"2023-12-19T13:49:36.403203+0000","last_active":"2023-12-19T13:49:38.822286+0000","last_peered":"2023-12-19T13:49:38.822286+0000","last_clean":"2023-12-19T13:49:38.822286+0000","last_became_active":"2023-12-19T13:49:36.402982+0000","last_became_peered":"2023-12-19T13:49:36.402982+0000","last_unstale":"2023-12-19T13:49:38.822286+0000","last_undegraded":"2023-12-19T13:49:38.822286+0000","last_fullsized":"2023-12-19T13:49:38.822286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:39.662682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400617+0000","last_change":"2023-12-19T13:49:36.414171+0000","last_active":"2023-12-19T13:49:37.400617+0000","last_peered":"2023-12-19T13:49:37.400617+0000","last_clean":"2023-12-19T13:49:37.400617+0000","last_became_active":"2023-12-19T13:49:36.413911+0000","last_became_peered":"2023-12-19T13:49:36.413911+0000","last_unstale":"2023-12-19T13:49:37.400617+0000","last_undegraded":"2023-12-19T13:49:37.400617+0000","last_fullsized":"2023-12-19T13:49:37.400617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:00:50.577976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400525+0000","last_change":"2023-12-19T13:49:36.405513+0000","last_active":"2023-12-19T13:49:37.400525+0000","last_peered":"2023-12-19T13:49:37.400525+0000","last_clean":"2023-12-19T13:49:37.400525+0000","last_became_active":"2023-12-19T13:49:36.404778+0000","last_became_peered":"2023-12-19T13:49:36.404778+0000","last_unstale":"2023-12-19T13:49:37.400525+0000","last_undegraded":"2023-12-19T13:49:37.400525+0000","last_fullsized":"2023-12-19T13:49:37.400525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:18.160505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822451+0000","last_change":"2023-12-19T13:49:36.403126+0000","last_active":"2023-12-19T13:49:38.822451+0000","last_peered":"2023-12-19T13:49:38.822451+0000","last_clean":"2023-12-19T13:49:38.822451+0000","last_became_active":"2023-12-19T13:49:36.399427+0000","last_became_peered":"2023-12-19T13:49:36.399427+0000","last_unstale":"2023-12-19T13:49:38.822451+0000","last_undegraded":"2023-12-19T13:49:38.822451+0000","last_fullsized":"2023-12-19T13:49:38.822451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:39.487118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103436+0000","last_change":"2023-12-19T13:49:36.413414+0000","last_active":"2023-12-19T13:49:38.103436+0000","last_peered":"2023-12-19T13:49:38.103436+0000","last_clean":"2023-12-19T13:49:38.103436+0000","last_became_active":"2023-12-19T13:49:36.413187+0000","last_became_peered":"2023-12-19T13:49:36.413187+0000","last_unstale":"2023-12-19T13:49:38.103436+0000","last_undegraded":"2023-12-19T13:49:38.103436+0000","last_fullsized":"2023-12-19T13:49:38.103436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:19.712354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398255+0000","last_change":"2023-12-19T13:49:36.406555+0000","last_active":"2023-12-19T13:49:37.398255+0000","last_peered":"2023-12-19T13:49:37.398255+0000","last_clean":"2023-12-19T13:49:37.398255+0000","last_became_active":"2023-12-19T13:49:36.405313+0000","last_became_peered":"2023-12-19T13:49:36.405313+0000","last_unstale":"2023-12-19T13:49:37.398255+0000","last_undegraded":"2023-12-19T13:49:37.398255+0000","last_fullsized":"2023-12-19T13:49:37.398255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:56.630159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400744+0000","last_change":"2023-12-19T13:49:36.407941+0000","last_active":"2023-12-19T13:49:37.400744+0000","last_peered":"2023-12-19T13:49:37.400744+0000","last_clean":"2023-12-19T13:49:37.400744+0000","last_became_active":"2023-12-19T13:49:36.407680+0000","last_became_peered":"2023-12-19T13:49:36.407680+0000","last_unstale":"2023-12-19T13:49:37.400744+0000","last_undegraded":"2023-12-19T13:49:37.400744+0000","last_fullsized":"2023-12-19T13:49:37.400744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:18.499842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822858+0000","last_change":"2023-12-19T13:49:36.404369+0000","last_active":"2023-12-19T13:49:38.822858+0000","last_peered":"2023-12-19T13:49:38.822858+0000","last_clean":"2023-12-19T13:49:38.822858+0000","last_became_active":"2023-12-19T13:49:36.404095+0000","last_became_peered":"2023-12-19T13:49:36.404095+0000","last_unstale":"2023-12-19T13:49:38.822858+0000","last_undegraded":"2023-12-19T13:49:38.822858+0000","last_fullsized":"2023-12-19T13:49:38.822858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398615+0000","last_change":"2023-12-19T13:49:36.403893+0000","last_active":"2023-12-19T13:49:37.398615+0000","last_peered":"2023-12-19T13:49:37.398615+0000","last_clean":"2023-12-19T13:49:37.398615+0000","last_became_active":"2023-12-19T13:49:36.400637+0000","last_became_peered":"2023-12-19T13:49:36.400637+0000","last_unstale":"2023-12-19T13:49:37.398615+0000","last_undegraded":"2023-12-19T13:49:37.398615+0000","last_fullsized":"2023-12-19T13:49:37.398615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:04.169818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824845+0000","last_change":"2023-12-19T13:49:36.410612+0000","last_active":"2023-12-19T13:49:38.824845+0000","last_peered":"2023-12-19T13:49:38.824845+0000","last_clean":"2023-12-19T13:49:38.824845+0000","last_became_active":"2023-12-19T13:49:36.410402+0000","last_became_peered":"2023-12-19T13:49:36.410402+0000","last_unstale":"2023-12-19T13:49:38.824845+0000","last_undegraded":"2023-12-19T13:49:38.824845+0000","last_fullsized":"2023-12-19T13:49:38.824845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:00:50.577976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822427+0000","last_change":"2023-12-19T13:49:36.408953+0000","last_active":"2023-12-19T13:49:38.822427+0000","last_peered":"2023-12-19T13:49:38.822427+0000","last_clean":"2023-12-19T13:49:38.822427+0000","last_became_active":"2023-12-19T13:49:36.408561+0000","last_became_peered":"2023-12-19T13:49:36.408561+0000","last_unstale":"2023-12-19T13:49:38.822427+0000","last_undegraded":"2023-12-19T13:49:38.822427+0000","last_fullsized":"2023-12-19T13:49:38.822427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.825022+0000","last_change":"2023-12-19T13:49:36.407816+0000","last_active":"2023-12-19T13:49:38.825022+0000","last_peered":"2023-12-19T13:49:38.825022+0000","last_clean":"2023-12-19T13:49:38.825022+0000","last_became_active":"2023-12-19T13:49:36.407484+0000","last_became_peered":"2023-12-19T13:49:36.407484+0000","last_unstale":"2023-12-19T13:49:38.825022+0000","last_undegraded":"2023-12-19T13:49:38.825022+0000","last_fullsized":"2023-12-19T13:49:38.825022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400435+0000","last_change":"2023-12-19T13:49:36.412291+0000","last_active":"2023-12-19T13:49:37.400435+0000","last_peered":"2023-12-19T13:49:37.400435+0000","last_clean":"2023-12-19T13:49:37.400435+0000","last_became_active":"2023-12-19T13:49:36.412071+0000","last_became_peered":"2023-12-19T13:49:36.412071+0000","last_unstale":"2023-12-19T13:49:37.400435+0000","last_undegraded":"2023-12-19T13:49:37.400435+0000","last_fullsized":"2023-12-19T13:49:37.400435+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:43:26.077742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.399738+0000","last_change":"2023-12-19T13:49:36.402035+0000","last_active":"2023-12-19T13:49:37.399738+0000","last_peered":"2023-12-19T13:49:37.399738+0000","last_clean":"2023-12-19T13:49:37.399738+0000","last_became_active":"2023-12-19T13:49:36.401484+0000","last_became_peered":"2023-12-19T13:49:36.401484+0000","last_unstale":"2023-12-19T13:49:37.399738+0000","last_undegraded":"2023-12-19T13:49:37.399738+0000","last_fullsized":"2023-12-19T13:49:37.399738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:46.388583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823203+0000","last_change":"2023-12-19T13:49:36.406690+0000","last_active":"2023-12-19T13:49:38.823203+0000","last_peered":"2023-12-19T13:49:38.823203+0000","last_clean":"2023-12-19T13:49:38.823203+0000","last_became_active":"2023-12-19T13:49:36.402517+0000","last_became_peered":"2023-12-19T13:49:36.402517+0000","last_unstale":"2023-12-19T13:49:38.823203+0000","last_undegraded":"2023-12-19T13:49:38.823203+0000","last_fullsized":"2023-12-19T13:49:38.823203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400794+0000","last_change":"2023-12-19T13:49:36.408377+0000","last_active":"2023-12-19T13:49:37.400794+0000","last_peered":"2023-12-19T13:49:37.400794+0000","last_clean":"2023-12-19T13:49:37.400794+0000","last_became_active":"2023-12-19T13:49:36.407632+0000","last_became_peered":"2023-12-19T13:49:36.407632+0000","last_unstale":"2023-12-19T13:49:37.400794+0000","last_undegraded":"2023-12-19T13:49:37.400794+0000","last_fullsized":"2023-12-19T13:49:37.400794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:14.495935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823578+0000","last_change":"2023-12-19T13:49:36.403170+0000","last_active":"2023-12-19T13:49:38.823578+0000","last_peered":"2023-12-19T13:49:38.823578+0000","last_clean":"2023-12-19T13:49:38.823578+0000","last_became_active":"2023-12-19T13:49:36.402945+0000","last_became_peered":"2023-12-19T13:49:36.402945+0000","last_unstale":"2023-12-19T13:49:38.823578+0000","last_undegraded":"2023-12-19T13:49:38.823578+0000","last_fullsized":"2023-12-19T13:49:38.823578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822626+0000","last_change":"2023-12-19T13:49:36.403742+0000","last_active":"2023-12-19T13:49:38.822626+0000","last_peered":"2023-12-19T13:49:38.822626+0000","last_clean":"2023-12-19T13:49:38.822626+0000","last_became_active":"2023-12-19T13:49:36.403537+0000","last_became_peered":"2023-12-19T13:49:36.403537+0000","last_unstale":"2023-12-19T13:49:38.822626+0000","last_undegraded":"2023-12-19T13:49:38.822626+0000","last_fullsized":"2023-12-19T13:49:38.822626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:12.262923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823214+0000","last_change":"2023-12-19T13:49:36.413468+0000","last_active":"2023-12-19T13:49:38.823214+0000","last_peered":"2023-12-19T13:49:38.823214+0000","last_clean":"2023-12-19T13:49:38.823214+0000","last_became_active":"2023-12-19T13:49:36.413122+0000","last_became_peered":"2023-12-19T13:49:36.413122+0000","last_unstale":"2023-12-19T13:49:38.823214+0000","last_undegraded":"2023-12-19T13:49:38.823214+0000","last_fullsized":"2023-12-19T13:49:38.823214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823105+0000","last_change":"2023-12-19T13:49:36.409909+0000","last_active":"2023-12-19T13:49:38.823105+0000","last_peered":"2023-12-19T13:49:38.823105+0000","last_clean":"2023-12-19T13:49:38.823105+0000","last_became_active":"2023-12-19T13:49:36.409492+0000","last_became_peered":"2023-12-19T13:49:36.409492+0000","last_unstale":"2023-12-19T13:49:38.823105+0000","last_undegraded":"2023-12-19T13:49:38.823105+0000","last_fullsized":"2023-12-19T13:49:38.823105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:05.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398483+0000","last_change":"2023-12-19T13:49:36.406713+0000","last_active":"2023-12-19T13:49:37.398483+0000","last_peered":"2023-12-19T13:49:37.398483+0000","last_clean":"2023-12-19T13:49:37.398483+0000","last_became_active":"2023-12-19T13:49:36.405725+0000","last_became_peered":"2023-12-19T13:49:36.405725+0000","last_unstale":"2023-12-19T13:49:37.398483+0000","last_undegraded":"2023-12-19T13:49:37.398483+0000","last_fullsized":"2023-12-19T13:49:37.398483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:34.189380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402035+0000","last_change":"2023-12-19T13:49:36.409858+0000","last_active":"2023-12-19T13:49:37.402035+0000","last_peered":"2023-12-19T13:49:37.402035+0000","last_clean":"2023-12-19T13:49:37.402035+0000","last_became_active":"2023-12-19T13:49:36.409342+0000","last_became_peered":"2023-12-19T13:49:36.409342+0000","last_unstale":"2023-12-19T13:49:37.402035+0000","last_undegraded":"2023-12-19T13:49:37.402035+0000","last_fullsized":"2023-12-19T13:49:37.402035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:56.630159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822866+0000","last_change":"2023-12-19T13:49:36.406224+0000","last_active":"2023-12-19T13:49:38.822866+0000","last_peered":"2023-12-19T13:49:38.822866+0000","last_clean":"2023-12-19T13:49:38.822866+0000","last_became_active":"2023-12-19T13:49:36.405943+0000","last_became_peered":"2023-12-19T13:49:36.405943+0000","last_unstale":"2023-12-19T13:49:38.822866+0000","last_undegraded":"2023-12-19T13:49:38.822866+0000","last_fullsized":"2023-12-19T13:49:38.822866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:47.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402555+0000","last_change":"2023-12-19T13:49:36.411435+0000","last_active":"2023-12-19T13:49:37.402555+0000","last_peered":"2023-12-19T13:49:37.402555+0000","last_clean":"2023-12-19T13:49:37.402555+0000","last_became_active":"2023-12-19T13:49:36.410978+0000","last_became_peered":"2023-12-19T13:49:36.410978+0000","last_unstale":"2023-12-19T13:49:37.402555+0000","last_undegraded":"2023-12-19T13:49:37.402555+0000","last_fullsized":"2023-12-19T13:49:37.402555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:55.233175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103740+0000","last_change":"2023-12-19T13:49:36.411210+0000","last_active":"2023-12-19T13:49:38.103740+0000","last_peered":"2023-12-19T13:49:38.103740+0000","last_clean":"2023-12-19T13:49:38.103740+0000","last_became_active":"2023-12-19T13:49:36.410659+0000","last_became_peered":"2023-12-19T13:49:36.410659+0000","last_unstale":"2023-12-19T13:49:38.103740+0000","last_undegraded":"2023-12-19T13:49:38.103740+0000","last_fullsized":"2023-12-19T13:49:38.103740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:19.504503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103936+0000","last_change":"2023-12-19T13:49:36.412535+0000","last_active":"2023-12-19T13:49:38.103936+0000","last_peered":"2023-12-19T13:49:38.103936+0000","last_clean":"2023-12-19T13:49:38.103936+0000","last_became_active":"2023-12-19T13:49:36.411820+0000","last_became_peered":"2023-12-19T13:49:36.411820+0000","last_unstale":"2023-12-19T13:49:38.103936+0000","last_undegraded":"2023-12-19T13:49:38.103936+0000","last_fullsized":"2023-12-19T13:49:38.103936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:06:15.067534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823717+0000","last_change":"2023-12-19T13:49:36.404081+0000","last_active":"2023-12-19T13:49:38.823717+0000","last_peered":"2023-12-19T13:49:38.823717+0000","last_clean":"2023-12-19T13:49:38.823717+0000","last_became_active":"2023-12-19T13:49:36.402206+0000","last_became_peered":"2023-12-19T13:49:36.402206+0000","last_unstale":"2023-12-19T13:49:38.823717+0000","last_undegraded":"2023-12-19T13:49:38.823717+0000","last_fullsized":"2023-12-19T13:49:38.823717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:29.166537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.401186+0000","last_change":"2023-12-19T13:49:36.406221+0000","last_active":"2023-12-19T13:49:37.401186+0000","last_peered":"2023-12-19T13:49:37.401186+0000","last_clean":"2023-12-19T13:49:37.401186+0000","last_became_active":"2023-12-19T13:49:36.404128+0000","last_became_peered":"2023-12-19T13:49:36.404128+0000","last_unstale":"2023-12-19T13:49:37.401186+0000","last_undegraded":"2023-12-19T13:49:37.401186+0000","last_fullsized":"2023-12-19T13:49:37.401186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:43:16.923715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823769+0000","last_change":"2023-12-19T13:49:36.410096+0000","last_active":"2023-12-19T13:49:38.823769+0000","last_peered":"2023-12-19T13:49:38.823769+0000","last_clean":"2023-12-19T13:49:38.823769+0000","last_became_active":"2023-12-19T13:49:36.409874+0000","last_became_peered":"2023-12-19T13:49:36.409874+0000","last_unstale":"2023-12-19T13:49:38.823769+0000","last_undegraded":"2023-12-19T13:49:38.823769+0000","last_fullsized":"2023-12-19T13:49:38.823769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400340+0000","last_change":"2023-12-19T13:49:36.414833+0000","last_active":"2023-12-19T13:49:37.400340+0000","last_peered":"2023-12-19T13:49:37.400340+0000","last_clean":"2023-12-19T13:49:37.400340+0000","last_became_active":"2023-12-19T13:49:36.414149+0000","last_became_peered":"2023-12-19T13:49:36.414149+0000","last_unstale":"2023-12-19T13:49:37.400340+0000","last_undegraded":"2023-12-19T13:49:37.400340+0000","last_fullsized":"2023-12-19T13:49:37.400340+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:02.377990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407746+0000","last_change":"2023-12-19T13:49:35.928447+0000","last_active":"2023-12-19T13:49:36.407746+0000","last_peered":"2023-12-19T13:49:36.407746+0000","last_clean":"2023-12-19T13:49:36.407746+0000","last_became_active":"2023-12-19T13:49:35.928154+0000","last_became_peered":"2023-12-19T13:49:35.928154+0000","last_unstale":"2023-12-19T13:49:36.407746+0000","last_undegraded":"2023-12-19T13:49:36.407746+0000","last_fullsized":"2023-12-19T13:49:36.407746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:45.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.399844+0000","last_change":"2023-12-19T13:49:36.399701+0000","last_active":"2023-12-19T13:49:37.399844+0000","last_peered":"2023-12-19T13:49:37.399844+0000","last_clean":"2023-12-19T13:49:37.399844+0000","last_became_active":"2023-12-19T13:49:36.399441+0000","last_became_peered":"2023-12-19T13:49:36.399441+0000","last_unstale":"2023-12-19T13:49:37.399844+0000","last_undegraded":"2023-12-19T13:49:37.399844+0000","last_fullsized":"2023-12-19T13:49:37.399844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:47.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.413181+0000","last_change":"2023-12-19T13:49:35.932006+0000","last_active":"2023-12-19T13:49:36.413181+0000","last_peered":"2023-12-19T13:49:36.413181+0000","last_clean":"2023-12-19T13:49:36.413181+0000","last_became_active":"2023-12-19T13:49:35.929750+0000","last_became_peered":"2023-12-19T13:49:35.929750+0000","last_unstale":"2023-12-19T13:49:36.413181+0000","last_undegraded":"2023-12-19T13:49:36.413181+0000","last_fullsized":"2023-12-19T13:49:36.413181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:25.292841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104149+0000","last_change":"2023-12-19T13:49:36.409134+0000","last_active":"2023-12-19T13:49:38.104149+0000","last_peered":"2023-12-19T13:49:38.104149+0000","last_clean":"2023-12-19T13:49:38.104149+0000","last_became_active":"2023-12-19T13:49:36.408682+0000","last_became_peered":"2023-12-19T13:49:36.408682+0000","last_unstale":"2023-12-19T13:49:38.104149+0000","last_undegraded":"2023-12-19T13:49:38.104149+0000","last_fullsized":"2023-12-19T13:49:38.104149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:23:40.450095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417754+0000","last_change":"2023-12-19T13:49:35.937199+0000","last_active":"2023-12-19T13:49:36.417754+0000","last_peered":"2023-12-19T13:49:36.417754+0000","last_clean":"2023-12-19T13:49:36.417754+0000","last_became_active":"2023-12-19T13:49:35.936966+0000","last_became_peered":"2023-12-19T13:49:35.936966+0000","last_unstale":"2023-12-19T13:49:36.417754+0000","last_undegraded":"2023-12-19T13:49:36.417754+0000","last_fullsized":"2023-12-19T13:49:36.417754+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:15:25.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400982+0000","last_change":"2023-12-19T13:49:36.409624+0000","last_active":"2023-12-19T13:49:37.400982+0000","last_peered":"2023-12-19T13:49:37.400982+0000","last_clean":"2023-12-19T13:49:37.400982+0000","last_became_active":"2023-12-19T13:49:36.409385+0000","last_became_peered":"2023-12-19T13:49:36.409385+0000","last_unstale":"2023-12-19T13:49:37.400982+0000","last_undegraded":"2023-12-19T13:49:37.400982+0000","last_fullsized":"2023-12-19T13:49:37.400982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:36.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414405+0000","last_change":"2023-12-19T13:49:35.924513+0000","last_active":"2023-12-19T13:49:36.414405+0000","last_peered":"2023-12-19T13:49:36.414405+0000","last_clean":"2023-12-19T13:49:36.414405+0000","last_became_active":"2023-12-19T13:49:35.924291+0000","last_became_peered":"2023-12-19T13:49:35.924291+0000","last_unstale":"2023-12-19T13:49:36.414405+0000","last_undegraded":"2023-12-19T13:49:36.414405+0000","last_fullsized":"2023-12-19T13:49:36.414405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:59.357889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103971+0000","last_change":"2023-12-19T13:49:36.411362+0000","last_active":"2023-12-19T13:49:38.103971+0000","last_peered":"2023-12-19T13:49:38.103971+0000","last_clean":"2023-12-19T13:49:38.103971+0000","last_became_active":"2023-12-19T13:49:36.410972+0000","last_became_peered":"2023-12-19T13:49:36.410972+0000","last_unstale":"2023-12-19T13:49:38.103971+0000","last_undegraded":"2023-12-19T13:49:38.103971+0000","last_fullsized":"2023-12-19T13:49:38.103971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:16.770593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416283+0000","last_change":"2023-12-19T13:49:35.929134+0000","last_active":"2023-12-19T13:49:36.416283+0000","last_peered":"2023-12-19T13:49:36.416283+0000","last_clean":"2023-12-19T13:49:36.416283+0000","last_became_active":"2023-12-19T13:49:35.928936+0000","last_became_peered":"2023-12-19T13:49:35.928936+0000","last_unstale":"2023-12-19T13:49:36.416283+0000","last_undegraded":"2023-12-19T13:49:36.416283+0000","last_fullsized":"2023-12-19T13:49:36.416283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:55.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823622+0000","last_change":"2023-12-19T13:49:36.413335+0000","last_active":"2023-12-19T13:49:38.823622+0000","last_peered":"2023-12-19T13:49:38.823622+0000","last_clean":"2023-12-19T13:49:38.823622+0000","last_became_active":"2023-12-19T13:49:36.412708+0000","last_became_peered":"2023-12-19T13:49:36.412708+0000","last_unstale":"2023-12-19T13:49:38.823622+0000","last_undegraded":"2023-12-19T13:49:38.823622+0000","last_fullsized":"2023-12-19T13:49:38.823622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414870+0000","last_change":"2023-12-19T13:49:35.938579+0000","last_active":"2023-12-19T13:49:36.414870+0000","last_peered":"2023-12-19T13:49:36.414870+0000","last_clean":"2023-12-19T13:49:36.414870+0000","last_became_active":"2023-12-19T13:49:35.938216+0000","last_became_peered":"2023-12-19T13:49:35.938216+0000","last_unstale":"2023-12-19T13:49:36.414870+0000","last_undegraded":"2023-12-19T13:49:36.414870+0000","last_fullsized":"2023-12-19T13:49:36.414870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:05.089463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823797+0000","last_change":"2023-12-19T13:49:36.406246+0000","last_active":"2023-12-19T13:49:38.823797+0000","last_peered":"2023-12-19T13:49:38.823797+0000","last_clean":"2023-12-19T13:49:38.823797+0000","last_became_active":"2023-12-19T13:49:36.406037+0000","last_became_peered":"2023-12-19T13:49:36.406037+0000","last_unstale":"2023-12-19T13:49:38.823797+0000","last_undegraded":"2023-12-19T13:49:38.823797+0000","last_fullsized":"2023-12-19T13:49:38.823797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:36.830962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390136+0000","last_change":"2023-12-19T13:49:35.923214+0000","last_active":"2023-12-19T13:49:36.390136+0000","last_peered":"2023-12-19T13:49:36.390136+0000","last_clean":"2023-12-19T13:49:36.390136+0000","last_became_active":"2023-12-19T13:49:35.922966+0000","last_became_peered":"2023-12-19T13:49:35.922966+0000","last_unstale":"2023-12-19T13:49:36.390136+0000","last_undegraded":"2023-12-19T13:49:36.390136+0000","last_fullsized":"2023-12-19T13:49:36.390136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400987+0000","last_change":"2023-12-19T13:49:36.411228+0000","last_active":"2023-12-19T13:49:37.400987+0000","last_peered":"2023-12-19T13:49:37.400987+0000","last_clean":"2023-12-19T13:49:37.400987+0000","last_became_active":"2023-12-19T13:49:36.411001+0000","last_became_peered":"2023-12-19T13:49:36.411001+0000","last_unstale":"2023-12-19T13:49:37.400987+0000","last_undegraded":"2023-12-19T13:49:37.400987+0000","last_fullsized":"2023-12-19T13:49:37.400987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.397876+0000","last_change":"2023-12-19T13:49:35.934055+0000","last_active":"2023-12-19T13:49:36.397876+0000","last_peered":"2023-12-19T13:49:36.397876+0000","last_clean":"2023-12-19T13:49:36.397876+0000","last_became_active":"2023-12-19T13:49:35.933871+0000","last_became_peered":"2023-12-19T13:49:35.933871+0000","last_unstale":"2023-12-19T13:49:36.397876+0000","last_undegraded":"2023-12-19T13:49:36.397876+0000","last_fullsized":"2023-12-19T13:49:36.397876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823791+0000","last_change":"2023-12-19T13:49:36.400996+0000","last_active":"2023-12-19T13:49:38.823791+0000","last_peered":"2023-12-19T13:49:38.823791+0000","last_clean":"2023-12-19T13:49:38.823791+0000","last_became_active":"2023-12-19T13:49:36.400446+0000","last_became_peered":"2023-12-19T13:49:36.400446+0000","last_unstale":"2023-12-19T13:49:38.823791+0000","last_undegraded":"2023-12-19T13:49:38.823791+0000","last_fullsized":"2023-12-19T13:49:38.823791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:02.377990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389174+0000","last_change":"2023-12-19T13:49:35.929803+0000","last_active":"2023-12-19T13:49:36.389174+0000","last_peered":"2023-12-19T13:49:36.389174+0000","last_clean":"2023-12-19T13:49:36.389174+0000","last_became_active":"2023-12-19T13:49:35.929631+0000","last_became_peered":"2023-12-19T13:49:35.929631+0000","last_unstale":"2023-12-19T13:49:36.389174+0000","last_undegraded":"2023-12-19T13:49:36.389174+0000","last_fullsized":"2023-12-19T13:49:36.389174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:58:19.919170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822508+0000","last_change":"2023-12-19T13:49:36.404280+0000","last_active":"2023-12-19T13:49:38.822508+0000","last_peered":"2023-12-19T13:49:38.822508+0000","last_clean":"2023-12-19T13:49:38.822508+0000","last_became_active":"2023-12-19T13:49:36.403858+0000","last_became_peered":"2023-12-19T13:49:36.403858+0000","last_unstale":"2023-12-19T13:49:38.822508+0000","last_undegraded":"2023-12-19T13:49:38.822508+0000","last_fullsized":"2023-12-19T13:49:38.822508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.401238+0000","last_change":"2023-12-19T13:49:35.933691+0000","last_active":"2023-12-19T13:49:36.401238+0000","last_peered":"2023-12-19T13:49:36.401238+0000","last_clean":"2023-12-19T13:49:36.401238+0000","last_became_active":"2023-12-19T13:49:35.933292+0000","last_became_peered":"2023-12-19T13:49:35.933292+0000","last_unstale":"2023-12-19T13:49:36.401238+0000","last_undegraded":"2023-12-19T13:49:36.401238+0000","last_fullsized":"2023-12-19T13:49:36.401238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:51.647666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104180+0000","last_change":"2023-12-19T13:49:36.408847+0000","last_active":"2023-12-19T13:49:38.104180+0000","last_peered":"2023-12-19T13:49:38.104180+0000","last_clean":"2023-12-19T13:49:38.104180+0000","last_became_active":"2023-12-19T13:49:36.408281+0000","last_became_peered":"2023-12-19T13:49:36.408281+0000","last_unstale":"2023-12-19T13:49:38.104180+0000","last_undegraded":"2023-12-19T13:49:38.104180+0000","last_fullsized":"2023-12-19T13:49:38.104180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:15.403155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416507+0000","last_change":"2023-12-19T13:49:35.924025+0000","last_active":"2023-12-19T13:49:36.416507+0000","last_peered":"2023-12-19T13:49:36.416507+0000","last_clean":"2023-12-19T13:49:36.416507+0000","last_became_active":"2023-12-19T13:49:35.923797+0000","last_became_peered":"2023-12-19T13:49:35.923797+0000","last_unstale":"2023-12-19T13:49:36.416507+0000","last_undegraded":"2023-12-19T13:49:36.416507+0000","last_fullsized":"2023-12-19T13:49:36.416507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:18.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823533+0000","last_change":"2023-12-19T13:49:36.415145+0000","last_active":"2023-12-19T13:49:38.823533+0000","last_peered":"2023-12-19T13:49:38.823533+0000","last_clean":"2023-12-19T13:49:38.823533+0000","last_became_active":"2023-12-19T13:49:36.414802+0000","last_became_peered":"2023-12-19T13:49:36.414802+0000","last_unstale":"2023-12-19T13:49:38.823533+0000","last_undegraded":"2023-12-19T13:49:38.823533+0000","last_fullsized":"2023-12-19T13:49:38.823533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:28.229489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"72'6","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417262+0000","last_change":"2023-12-19T13:49:35.925004+0000","last_active":"2023-12-19T13:49:36.417262+0000","last_peered":"2023-12-19T13:49:36.417262+0000","last_clean":"2023-12-19T13:49:36.417262+0000","last_became_active":"2023-12-19T13:49:35.924778+0000","last_became_peered":"2023-12-19T13:49:35.924778+0000","last_unstale":"2023-12-19T13:49:36.417262+0000","last_undegraded":"2023-12-19T13:49:36.417262+0000","last_fullsized":"2023-12-19T13:49:36.417262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398430+0000","last_change":"2023-12-19T13:49:36.401718+0000","last_active":"2023-12-19T13:49:37.398430+0000","last_peered":"2023-12-19T13:49:37.398430+0000","last_clean":"2023-12-19T13:49:37.398430+0000","last_became_active":"2023-12-19T13:49:36.401473+0000","last_became_peered":"2023-12-19T13:49:36.401473+0000","last_unstale":"2023-12-19T13:49:37.398430+0000","last_undegraded":"2023-12-19T13:49:37.398430+0000","last_fullsized":"2023-12-19T13:49:37.398430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:55.233175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.418092+0000","last_change":"2023-12-19T13:49:35.934180+0000","last_active":"2023-12-19T13:49:36.418092+0000","last_peered":"2023-12-19T13:49:36.418092+0000","last_clean":"2023-12-19T13:49:36.418092+0000","last_became_active":"2023-12-19T13:49:35.933546+0000","last_became_peered":"2023-12-19T13:49:35.933546+0000","last_unstale":"2023-12-19T13:49:36.418092+0000","last_undegraded":"2023-12-19T13:49:36.418092+0000","last_fullsized":"2023-12-19T13:49:36.418092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:46.501331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824036+0000","last_change":"2023-12-19T13:49:36.401160+0000","last_active":"2023-12-19T13:49:38.824036+0000","last_peered":"2023-12-19T13:49:38.824036+0000","last_clean":"2023-12-19T13:49:38.824036+0000","last_became_active":"2023-12-19T13:49:36.397578+0000","last_became_peered":"2023-12-19T13:49:36.397578+0000","last_unstale":"2023-12-19T13:49:38.824036+0000","last_undegraded":"2023-12-19T13:49:38.824036+0000","last_fullsized":"2023-12-19T13:49:38.824036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.396140+0000","last_change":"2023-12-19T13:49:35.921680+0000","last_active":"2023-12-19T13:49:36.396140+0000","last_peered":"2023-12-19T13:49:36.396140+0000","last_clean":"2023-12-19T13:49:36.396140+0000","last_became_active":"2023-12-19T13:49:35.921416+0000","last_became_peered":"2023-12-19T13:49:35.921416+0000","last_unstale":"2023-12-19T13:49:36.396140+0000","last_undegraded":"2023-12-19T13:49:36.396140+0000","last_fullsized":"2023-12-19T13:49:36.396140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:18.490775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398690+0000","last_change":"2023-12-19T13:49:36.402557+0000","last_active":"2023-12-19T13:49:37.398690+0000","last_peered":"2023-12-19T13:49:37.398690+0000","last_clean":"2023-12-19T13:49:37.398690+0000","last_became_active":"2023-12-19T13:49:36.402039+0000","last_became_peered":"2023-12-19T13:49:36.402039+0000","last_unstale":"2023-12-19T13:49:37.398690+0000","last_undegraded":"2023-12-19T13:49:37.398690+0000","last_fullsized":"2023-12-19T13:49:37.398690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:48.356106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.398168+0000","last_change":"2023-12-19T13:49:35.921988+0000","last_active":"2023-12-19T13:49:36.398168+0000","last_peered":"2023-12-19T13:49:36.398168+0000","last_clean":"2023-12-19T13:49:36.398168+0000","last_became_active":"2023-12-19T13:49:35.921781+0000","last_became_peered":"2023-12-19T13:49:35.921781+0000","last_unstale":"2023-12-19T13:49:36.398168+0000","last_undegraded":"2023-12-19T13:49:36.398168+0000","last_fullsized":"2023-12-19T13:49:36.398168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:20.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822533+0000","last_change":"2023-12-19T13:49:36.412408+0000","last_active":"2023-12-19T13:49:38.822533+0000","last_peered":"2023-12-19T13:49:38.822533+0000","last_clean":"2023-12-19T13:49:38.822533+0000","last_became_active":"2023-12-19T13:49:36.412195+0000","last_became_peered":"2023-12-19T13:49:36.412195+0000","last_unstale":"2023-12-19T13:49:38.822533+0000","last_undegraded":"2023-12-19T13:49:38.822533+0000","last_fullsized":"2023-12-19T13:49:38.822533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:00.107117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414513+0000","last_change":"2023-12-19T13:49:35.922220+0000","last_active":"2023-12-19T13:49:36.414513+0000","last_peered":"2023-12-19T13:49:36.414513+0000","last_clean":"2023-12-19T13:49:36.414513+0000","last_became_active":"2023-12-19T13:49:35.921380+0000","last_became_peered":"2023-12-19T13:49:35.921380+0000","last_unstale":"2023-12-19T13:49:36.414513+0000","last_undegraded":"2023-12-19T13:49:36.414513+0000","last_fullsized":"2023-12-19T13:49:36.414513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:15.756864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824265+0000","last_change":"2023-12-19T13:49:36.401948+0000","last_active":"2023-12-19T13:49:38.824265+0000","last_peered":"2023-12-19T13:49:38.824265+0000","last_clean":"2023-12-19T13:49:38.824265+0000","last_became_active":"2023-12-19T13:49:36.399248+0000","last_became_peered":"2023-12-19T13:49:36.399248+0000","last_unstale":"2023-12-19T13:49:38.824265+0000","last_undegraded":"2023-12-19T13:49:38.824265+0000","last_fullsized":"2023-12-19T13:49:38.824265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:21.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.412223+0000","last_change":"2023-12-19T13:49:35.937514+0000","last_active":"2023-12-19T13:49:36.412223+0000","last_peered":"2023-12-19T13:49:36.412223+0000","last_clean":"2023-12-19T13:49:36.412223+0000","last_became_active":"2023-12-19T13:49:35.937228+0000","last_became_peered":"2023-12-19T13:49:35.937228+0000","last_unstale":"2023-12-19T13:49:36.412223+0000","last_undegraded":"2023-12-19T13:49:36.412223+0000","last_fullsized":"2023-12-19T13:49:36.412223+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:37.941627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822666+0000","last_change":"2023-12-19T13:49:36.408093+0000","last_active":"2023-12-19T13:49:38.822666+0000","last_peered":"2023-12-19T13:49:38.822666+0000","last_clean":"2023-12-19T13:49:38.822666+0000","last_became_active":"2023-12-19T13:49:36.407151+0000","last_became_peered":"2023-12-19T13:49:36.407151+0000","last_unstale":"2023-12-19T13:49:38.822666+0000","last_undegraded":"2023-12-19T13:49:38.822666+0000","last_fullsized":"2023-12-19T13:49:38.822666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417919+0000","last_change":"2023-12-19T13:49:35.934350+0000","last_active":"2023-12-19T13:49:36.417919+0000","last_peered":"2023-12-19T13:49:36.417919+0000","last_clean":"2023-12-19T13:49:36.417919+0000","last_became_active":"2023-12-19T13:49:35.933913+0000","last_became_peered":"2023-12-19T13:49:35.933913+0000","last_unstale":"2023-12-19T13:49:36.417919+0000","last_undegraded":"2023-12-19T13:49:36.417919+0000","last_fullsized":"2023-12-19T13:49:36.417919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:17.146776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402615+0000","last_change":"2023-12-19T13:49:36.411178+0000","last_active":"2023-12-19T13:49:37.402615+0000","last_peered":"2023-12-19T13:49:37.402615+0000","last_clean":"2023-12-19T13:49:37.402615+0000","last_became_active":"2023-12-19T13:49:36.410463+0000","last_became_peered":"2023-12-19T13:49:36.410463+0000","last_unstale":"2023-12-19T13:49:37.402615+0000","last_undegraded":"2023-12-19T13:49:37.402615+0000","last_fullsized":"2023-12-19T13:49:37.402615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:48.356106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414006+0000","last_change":"2023-12-19T13:49:35.930716+0000","last_active":"2023-12-19T13:49:36.414006+0000","last_peered":"2023-12-19T13:49:36.414006+0000","last_clean":"2023-12-19T13:49:36.414006+0000","last_became_active":"2023-12-19T13:49:35.930555+0000","last_became_peered":"2023-12-19T13:49:35.930555+0000","last_unstale":"2023-12-19T13:49:36.414006+0000","last_undegraded":"2023-12-19T13:49:36.414006+0000","last_fullsized":"2023-12-19T13:49:36.414006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822845+0000","last_change":"2023-12-19T13:49:36.405403+0000","last_active":"2023-12-19T13:49:38.822845+0000","last_peered":"2023-12-19T13:49:38.822845+0000","last_clean":"2023-12-19T13:49:38.822845+0000","last_became_active":"2023-12-19T13:49:36.405205+0000","last_became_peered":"2023-12-19T13:49:36.405205+0000","last_unstale":"2023-12-19T13:49:38.822845+0000","last_undegraded":"2023-12-19T13:49:38.822845+0000","last_fullsized":"2023-12-19T13:49:38.822845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:14.792675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.401330+0000","last_change":"2023-12-19T13:49:35.935699+0000","last_active":"2023-12-19T13:49:36.401330+0000","last_peered":"2023-12-19T13:49:36.401330+0000","last_clean":"2023-12-19T13:49:36.401330+0000","last_became_active":"2023-12-19T13:49:35.935463+0000","last_became_peered":"2023-12-19T13:49:35.935463+0000","last_unstale":"2023-12-19T13:49:36.401330+0000","last_undegraded":"2023-12-19T13:49:36.401330+0000","last_fullsized":"2023-12-19T13:49:36.401330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:17.486114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398893+0000","last_change":"2023-12-19T13:49:36.406414+0000","last_active":"2023-12-19T13:49:37.398893+0000","last_peered":"2023-12-19T13:49:37.398893+0000","last_clean":"2023-12-19T13:49:37.398893+0000","last_became_active":"2023-12-19T13:49:36.404928+0000","last_became_peered":"2023-12-19T13:49:36.404928+0000","last_unstale":"2023-12-19T13:49:37.398893+0000","last_undegraded":"2023-12-19T13:49:37.398893+0000","last_fullsized":"2023-12-19T13:49:37.398893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:31.791070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407855+0000","last_change":"2023-12-19T13:49:35.932840+0000","last_active":"2023-12-19T13:49:36.407855+0000","last_peered":"2023-12-19T13:49:36.407855+0000","last_clean":"2023-12-19T13:49:36.407855+0000","last_became_active":"2023-12-19T13:49:35.931197+0000","last_became_peered":"2023-12-19T13:49:35.931197+0000","last_unstale":"2023-12-19T13:49:36.407855+0000","last_undegraded":"2023-12-19T13:49:36.407855+0000","last_fullsized":"2023-12-19T13:49:36.407855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:01.364262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104370+0000","last_change":"2023-12-19T13:49:36.414873+0000","last_active":"2023-12-19T13:49:38.104370+0000","last_peered":"2023-12-19T13:49:38.104370+0000","last_clean":"2023-12-19T13:49:38.104370+0000","last_became_active":"2023-12-19T13:49:36.414573+0000","last_became_peered":"2023-12-19T13:49:36.414573+0000","last_unstale":"2023-12-19T13:49:38.104370+0000","last_undegraded":"2023-12-19T13:49:38.104370+0000","last_fullsized":"2023-12-19T13:49:38.104370+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:04.306905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.403538+0000","last_change":"2023-12-19T13:49:35.934429+0000","last_active":"2023-12-19T13:49:36.403538+0000","last_peered":"2023-12-19T13:49:36.403538+0000","last_clean":"2023-12-19T13:49:36.403538+0000","last_became_active":"2023-12-19T13:49:35.934009+0000","last_became_peered":"2023-12-19T13:49:35.934009+0000","last_unstale":"2023-12-19T13:49:36.403538+0000","last_undegraded":"2023-12-19T13:49:36.403538+0000","last_fullsized":"2023-12-19T13:49:36.403538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:11.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103588+0000","last_change":"2023-12-19T13:49:36.410145+0000","last_active":"2023-12-19T13:49:38.103588+0000","last_peered":"2023-12-19T13:49:38.103588+0000","last_clean":"2023-12-19T13:49:38.103588+0000","last_became_active":"2023-12-19T13:49:36.409917+0000","last_became_peered":"2023-12-19T13:49:36.409917+0000","last_unstale":"2023-12-19T13:49:38.103588+0000","last_undegraded":"2023-12-19T13:49:38.103588+0000","last_fullsized":"2023-12-19T13:49:38.103588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389289+0000","last_change":"2023-12-19T13:49:35.934554+0000","last_active":"2023-12-19T13:49:36.389289+0000","last_peered":"2023-12-19T13:49:36.389289+0000","last_clean":"2023-12-19T13:49:36.389289+0000","last_became_active":"2023-12-19T13:49:35.934390+0000","last_became_peered":"2023-12-19T13:49:35.934390+0000","last_unstale":"2023-12-19T13:49:36.389289+0000","last_undegraded":"2023-12-19T13:49:36.389289+0000","last_fullsized":"2023-12-19T13:49:36.389289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824229+0000","last_change":"2023-12-19T13:49:36.406483+0000","last_active":"2023-12-19T13:49:38.824229+0000","last_peered":"2023-12-19T13:49:38.824229+0000","last_clean":"2023-12-19T13:49:38.824229+0000","last_became_active":"2023-12-19T13:49:36.402037+0000","last_became_peered":"2023-12-19T13:49:36.402037+0000","last_unstale":"2023-12-19T13:49:38.824229+0000","last_undegraded":"2023-12-19T13:49:38.824229+0000","last_fullsized":"2023-12-19T13:49:38.824229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417383+0000","last_change":"2023-12-19T13:49:35.933239+0000","last_active":"2023-12-19T13:49:36.417383+0000","last_peered":"2023-12-19T13:49:36.417383+0000","last_clean":"2023-12-19T13:49:36.417383+0000","last_became_active":"2023-12-19T13:49:35.932786+0000","last_became_peered":"2023-12-19T13:49:35.932786+0000","last_unstale":"2023-12-19T13:49:36.417383+0000","last_undegraded":"2023-12-19T13:49:36.417383+0000","last_fullsized":"2023-12-19T13:49:36.417383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:30.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822793+0000","last_change":"2023-12-19T13:49:36.400530+0000","last_active":"2023-12-19T13:49:38.822793+0000","last_peered":"2023-12-19T13:49:38.822793+0000","last_clean":"2023-12-19T13:49:38.822793+0000","last_became_active":"2023-12-19T13:49:36.400046+0000","last_became_peered":"2023-12-19T13:49:36.400046+0000","last_unstale":"2023-12-19T13:49:38.822793+0000","last_undegraded":"2023-12-19T13:49:38.822793+0000","last_fullsized":"2023-12-19T13:49:38.822793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:56.941388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.395202+0000","last_change":"2023-12-19T13:49:35.938422+0000","last_active":"2023-12-19T13:49:36.395202+0000","last_peered":"2023-12-19T13:49:36.395202+0000","last_clean":"2023-12-19T13:49:36.395202+0000","last_became_active":"2023-12-19T13:49:35.937799+0000","last_became_peered":"2023-12-19T13:49:35.937799+0000","last_unstale":"2023-12-19T13:49:36.395202+0000","last_undegraded":"2023-12-19T13:49:36.395202+0000","last_fullsized":"2023-12-19T13:49:36.395202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:17.202412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402283+0000","last_change":"2023-12-19T13:49:36.409624+0000","last_active":"2023-12-19T13:49:37.402283+0000","last_peered":"2023-12-19T13:49:37.402283+0000","last_clean":"2023-12-19T13:49:37.402283+0000","last_became_active":"2023-12-19T13:49:36.408966+0000","last_became_peered":"2023-12-19T13:49:36.408966+0000","last_unstale":"2023-12-19T13:49:37.402283+0000","last_undegraded":"2023-12-19T13:49:37.402283+0000","last_fullsized":"2023-12-19T13:49:37.402283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:04.169818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390316+0000","last_change":"2023-12-19T13:49:35.924316+0000","last_active":"2023-12-19T13:49:36.390316+0000","last_peered":"2023-12-19T13:49:36.390316+0000","last_clean":"2023-12-19T13:49:36.390316+0000","last_became_active":"2023-12-19T13:49:35.924099+0000","last_became_peered":"2023-12-19T13:49:35.924099+0000","last_unstale":"2023-12-19T13:49:36.390316+0000","last_undegraded":"2023-12-19T13:49:36.390316+0000","last_fullsized":"2023-12-19T13:49:36.390316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:07.758117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104404+0000","last_change":"2023-12-19T13:49:36.411570+0000","last_active":"2023-12-19T13:49:38.104404+0000","last_peered":"2023-12-19T13:49:38.104404+0000","last_clean":"2023-12-19T13:49:38.104404+0000","last_became_active":"2023-12-19T13:49:36.408618+0000","last_became_peered":"2023-12-19T13:49:36.408618+0000","last_unstale":"2023-12-19T13:49:38.104404+0000","last_undegraded":"2023-12-19T13:49:38.104404+0000","last_fullsized":"2023-12-19T13:49:38.104404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.393487+0000","last_change":"2023-12-19T13:49:35.924508+0000","last_active":"2023-12-19T13:49:36.393487+0000","last_peered":"2023-12-19T13:49:36.393487+0000","last_clean":"2023-12-19T13:49:36.393487+0000","last_became_active":"2023-12-19T13:49:35.923964+0000","last_became_peered":"2023-12-19T13:49:35.923964+0000","last_unstale":"2023-12-19T13:49:36.393487+0000","last_undegraded":"2023-12-19T13:49:36.393487+0000","last_fullsized":"2023-12-19T13:49:36.393487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.399904+0000","last_change":"2023-12-19T13:49:36.402181+0000","last_active":"2023-12-19T13:49:37.399904+0000","last_peered":"2023-12-19T13:49:37.399904+0000","last_clean":"2023-12-19T13:49:37.399904+0000","last_became_active":"2023-12-19T13:49:36.401814+0000","last_became_peered":"2023-12-19T13:49:36.401814+0000","last_unstale":"2023-12-19T13:49:37.399904+0000","last_undegraded":"2023-12-19T13:49:37.399904+0000","last_fullsized":"2023-12-19T13:49:37.399904+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:12.262923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.400691+0000","last_change":"2023-12-19T13:49:35.936948+0000","last_active":"2023-12-19T13:49:36.400691+0000","last_peered":"2023-12-19T13:49:36.400691+0000","last_clean":"2023-12-19T13:49:36.400691+0000","last_became_active":"2023-12-19T13:49:35.936707+0000","last_became_peered":"2023-12-19T13:49:35.936707+0000","last_unstale":"2023-12-19T13:49:36.400691+0000","last_undegraded":"2023-12-19T13:49:36.400691+0000","last_fullsized":"2023-12-19T13:49:36.400691+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823097+0000","last_change":"2023-12-19T13:49:36.410989+0000","last_active":"2023-12-19T13:49:38.823097+0000","last_peered":"2023-12-19T13:49:38.823097+0000","last_clean":"2023-12-19T13:49:38.823097+0000","last_became_active":"2023-12-19T13:49:36.410740+0000","last_became_peered":"2023-12-19T13:49:36.410740+0000","last_unstale":"2023-12-19T13:49:38.823097+0000","last_undegraded":"2023-12-19T13:49:38.823097+0000","last_fullsized":"2023-12-19T13:49:38.823097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:46.388583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.391631+0000","last_change":"2023-12-19T13:49:35.934965+0000","last_active":"2023-12-19T13:49:36.391631+0000","last_peered":"2023-12-19T13:49:36.391631+0000","last_clean":"2023-12-19T13:49:36.391631+0000","last_became_active":"2023-12-19T13:49:35.934823+0000","last_became_peered":"2023-12-19T13:49:35.934823+0000","last_unstale":"2023-12-19T13:49:36.391631+0000","last_undegraded":"2023-12-19T13:49:36.391631+0000","last_fullsized":"2023-12-19T13:49:36.391631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104584+0000","last_change":"2023-12-19T13:49:36.404350+0000","last_active":"2023-12-19T13:49:38.104584+0000","last_peered":"2023-12-19T13:49:38.104584+0000","last_clean":"2023-12-19T13:49:38.104584+0000","last_became_active":"2023-12-19T13:49:36.404132+0000","last_became_peered":"2023-12-19T13:49:36.404132+0000","last_unstale":"2023-12-19T13:49:38.104584+0000","last_undegraded":"2023-12-19T13:49:38.104584+0000","last_fullsized":"2023-12-19T13:49:38.104584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.395325+0000","last_change":"2023-12-19T13:49:35.936459+0000","last_active":"2023-12-19T13:49:36.395325+0000","last_peered":"2023-12-19T13:49:36.395325+0000","last_clean":"2023-12-19T13:49:36.395325+0000","last_became_active":"2023-12-19T13:49:35.936185+0000","last_became_peered":"2023-12-19T13:49:35.936185+0000","last_unstale":"2023-12-19T13:49:36.395325+0000","last_undegraded":"2023-12-19T13:49:36.395325+0000","last_fullsized":"2023-12-19T13:49:36.395325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.401547+0000","last_change":"2023-12-19T13:49:36.405148+0000","last_active":"2023-12-19T13:49:37.401547+0000","last_peered":"2023-12-19T13:49:37.401547+0000","last_clean":"2023-12-19T13:49:37.401547+0000","last_became_active":"2023-12-19T13:49:36.404871+0000","last_became_peered":"2023-12-19T13:49:36.404871+0000","last_unstale":"2023-12-19T13:49:37.401547+0000","last_undegraded":"2023-12-19T13:49:37.401547+0000","last_fullsized":"2023-12-19T13:49:37.401547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:31.791070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.403627+0000","last_change":"2023-12-19T13:49:35.931094+0000","last_active":"2023-12-19T13:49:36.403627+0000","last_peered":"2023-12-19T13:49:36.403627+0000","last_clean":"2023-12-19T13:49:36.403627+0000","last_became_active":"2023-12-19T13:49:35.930839+0000","last_became_peered":"2023-12-19T13:49:35.930839+0000","last_unstale":"2023-12-19T13:49:36.403627+0000","last_undegraded":"2023-12-19T13:49:36.403627+0000","last_fullsized":"2023-12-19T13:49:36.403627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:43:25.064014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104269+0000","last_change":"2023-12-19T13:49:36.414136+0000","last_active":"2023-12-19T13:49:38.104269+0000","last_peered":"2023-12-19T13:49:38.104269+0000","last_clean":"2023-12-19T13:49:38.104269+0000","last_became_active":"2023-12-19T13:49:36.413790+0000","last_became_peered":"2023-12-19T13:49:36.413790+0000","last_unstale":"2023-12-19T13:49:38.104269+0000","last_undegraded":"2023-12-19T13:49:38.104269+0000","last_fullsized":"2023-12-19T13:49:38.104269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.371617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.398013+0000","last_change":"2023-12-19T13:49:35.926234+0000","last_active":"2023-12-19T13:49:36.398013+0000","last_peered":"2023-12-19T13:49:36.398013+0000","last_clean":"2023-12-19T13:49:36.398013+0000","last_became_active":"2023-12-19T13:49:35.926011+0000","last_became_peered":"2023-12-19T13:49:35.926011+0000","last_unstale":"2023-12-19T13:49:36.398013+0000","last_undegraded":"2023-12-19T13:49:36.398013+0000","last_fullsized":"2023-12-19T13:49:36.398013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390447+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:49:36.390447+0000","last_peered":"2023-12-19T13:49:36.390447+0000","last_clean":"2023-12-19T13:49:36.390447+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:49:36.390447+0000","last_undegraded":"2023-12-19T13:49:36.390447+0000","last_fullsized":"2023-12-19T13:49:36.390447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.0009999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.375,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.02},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0049999999999999,"15min":0.98299999999999998},"min":{"1min":0.64000000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3380000000000001,"5min":2.008,"15min":2.008},"last":1.232}]},{"osd":1,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.079,"15min":1.069},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4079999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4610000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1399999999999999,"15min":1.133},"min":{"1min":0.81399999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.71,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.1699999999999999,"15min":1.147},"min":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4299999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.597,"5min":1.931,"15min":1.931},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.252,"15min":1.23},"min":{"1min":0.79600000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7470000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.371}]},{"osd":4,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.282,"15min":1.286},"min":{"1min":0.84499999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6519999999999999,"5min":2.181,"15min":2.181},"last":1.609},{"interface":"front","average":{"1min":1.262,"5min":1.3859999999999999,"15min":1.3979999999999999},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.673,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.2889999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.24,"15min":1.222},"min":{"1min":0.871,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5429999999999999,"5min":1.956,"15min":1.956},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.4339999999999999,"15min":1.429},"min":{"1min":1.038,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.702}]},{"osd":6,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.292,"15min":1.262},"min":{"1min":0.90300000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6850000000000001,"5min":2.024,"15min":2.024},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5049999999999999,"15min":1.4870000000000001},"min":{"1min":1.2050000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.796,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.8080000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.0289999999999999},"min":{"1min":0.629,"5min":0.628,"15min":0.628},"max":{"1min":1.502,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.089,"15min":1.121},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3400000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.628}]},{"osd":1,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.05,"15min":1.03},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.962,"15min":1.962},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.137,"5min":1.0620000000000001,"15min":1.032},"min":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5860000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.2210000000000001},"min":{"1min":0.82499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6970000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.115},{"interface":"front","average":{"1min":1.254,"5min":1.173,"15min":1.151},"min":{"1min":0.96299999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6140000000000001,"5min":1.786,"15min":1.786},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3169999999999999,"15min":1.3520000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.478,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.266,"15min":1.272},"min":{"1min":1.024,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6299999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.97699999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.226,"15min":1.204},"min":{"1min":0.92600000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.252},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.3120000000000001,"15min":1.292},"min":{"1min":1.0920000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.0580000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.268,"15min":1.246},"min":{"1min":1.135,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6120000000000001,"5min":1.827,"15min":1.827},"last":1.161},{"interface":"front","average":{"1min":1.538,"5min":1.399,"15min":1.371},"min":{"1min":1.2849999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.202}]},{"osd":7,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.4159999999999999},"min":{"1min":1.0840000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.377,"15min":1.355},"min":{"1min":1.2430000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.766,"15min":1.766},"last":1.0800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199028060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.595,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0509999999999999,"15min":1.0609999999999999},"min":{"1min":0.68700000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.538}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.423,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.446},{"interface":"front","average":{"1min":1.125,"5min":1.024,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3939999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.202,"15min":1.246},"min":{"1min":0.83399999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3280000000000001,"5min":2.827,"15min":2.827},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.25,"15min":1.2689999999999999},"min":{"1min":0.93200000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5209999999999999,"5min":2.863,"15min":2.863},"last":1.21}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2090000000000001,"15min":1.204},"min":{"1min":1.0429999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.623,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.244,"15min":1.242},"min":{"1min":0.87,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5940000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.1060000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.153,"15min":1.137},"min":{"1min":0.90400000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5169999999999999,"5min":1.982,"15min":1.982},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.278,"15min":1.2769999999999999},"min":{"1min":0.88,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.474,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.639}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.343,"15min":1.3169999999999999},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.579,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.306},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.357,"15min":1.369},"min":{"1min":1.0609999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.6479999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.8759999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3959999999999999,"15min":1.401},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7090000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.427,"15min":1.403},"min":{"1min":1.2470000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6910000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.587}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199617846,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.657,"15min":1.657},"last":1.113},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1259999999999999},"min":{"1min":0.69499999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.542,"5min":2.016,"15min":2.016},"last":0.85399999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.073,"15min":1.069},"min":{"1min":0.76600000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.1000000000000001,"15min":1.1140000000000001},"min":{"1min":0.754,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4039999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0580000000000001,"15min":1.0169999999999999},"min":{"1min":0.76500000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1120000000000001,"15min":1.105},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.405,"5min":1.575,"15min":1.575},"last":1.143}]},{"osd":3,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.206,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.952,"15min":1.952},"last":1.288},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.258,"15min":1.274},"min":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.482,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.25}]},{"osd":5,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.216,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.165,"15min":2.165},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.325,"15min":1.343},"min":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6970000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.405}]},{"osd":6,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.85099999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.595,"5min":2.335,"15min":2.335},"last":1.5640000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4490000000000001,"15min":1.46},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.782,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.5,"15min":1.522},"min":{"1min":0.89300000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.921,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.6499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.89200000000000002,"15min":0.95599999999999996},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2290000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.94499999999999995,"15min":0.97799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.4590000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":1.032},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.006},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96399999999999997,"15min":0.99399999999999999},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2589999999999999,"5min":2.387,"15min":2.387},"last":0.87}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.097,"15min":1.143},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4690000000000001,"5min":2.657,"15min":2.657},"last":0.78900000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.236,"15min":1.272},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.51,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.353},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.21,"15min":1.23},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6419999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.151}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.278,"15min":1.3140000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.7030000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.256,"15min":1.276},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.671,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.21}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.637,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.321,"15min":1.349},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":2.698,"15min":2.698},"last":1.389}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.337,"15min":1.3759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.76,"5min":3.609,"15min":3.609},"last":1.47},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.02,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.4370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":2.258,"15min":2.258},"last":1.022},{"interface":"front","average":{"1min":1.468,"5min":0.91700000000000004,"15min":0.81699999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":11.85,"5min":11.85,"15min":11.85},"last":1.3560000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.363,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.625,"5min":1.018,"15min":0.92500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":11.788,"5min":11.788,"15min":11.788},"last":1.2150000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.397,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.089},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.0569999999999999,"15min":1.0269999999999999},"min":{"1min":0.501,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.8079999999999998,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":1.2490000000000001,"15min":1.1559999999999999},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6679999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.27}]},{"osd":5,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.321,"15min":1.2190000000000001},"min":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":11.888,"5min":11.888,"15min":11.888},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.302,"15min":1.306},"min":{"1min":1.014,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9850000000000001,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3140000000000001,"15min":1.3180000000000001},"min":{"1min":0.88300000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0640000000000001,"5min":2.964,"15min":2.964},"last":1},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2629999999999999,"15min":1.2490000000000001},"min":{"1min":0.85399999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.944,"5min":2.286,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0369999999999999,"5min":2.351,"15min":2.351},"last":1.1779999999999999},{"interface":"front","average":{"1min":2.0110000000000001,"5min":1.375,"15min":1.282},"min":{"1min":0.82099999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":11.962999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.4570000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194362,"statfs":{"total":200000000,"available":199027512,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.82599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.26,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.351,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.044,"15min":1.1000000000000001},"min":{"1min":0.51600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.012},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.169,"15min":1.1930000000000001},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7829999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.0469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.117,"15min":1.2030000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3009999999999999,"5min":7.157,"15min":7.157},"last":1.079}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.236},"min":{"1min":0.83299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.575,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.282,"15min":1.304},"min":{"1min":0.85499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.738,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.94599999999999995}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.294,"15min":1.337},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1669999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.135},{"interface":"front","average":{"1min":1.994,"5min":1.468,"15min":1.3979999999999999},"min":{"1min":0.81200000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":15.576000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.335,"15min":1.351},"min":{"1min":0.75800000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8260000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.254},{"interface":"front","average":{"1min":1.278,"5min":1.379,"15min":1.4339999999999999},"min":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.226,"5min":3.786,"15min":3.786},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.409,"15min":1.458},"min":{"1min":0.84799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.9039999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.355},{"interface":"front","average":{"1min":1.258,"5min":1.421,"15min":1.476},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6830000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.2290000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4430000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.53600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":14.010999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.7919999999999998,"5min":1.238,"15min":0.99099999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":33.799999999999997,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":3.302,"5min":1.3759999999999999,"15min":1.0660000000000001},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":41.758000000000003,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.70599999999999996}]},{"osd":3,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.93500000000000005,"15min":1.0229999999999999},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4330000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.048,"15min":1.0960000000000001},"min":{"1min":0.46600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3759999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.111}]},{"osd":4,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5149999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.994,"5min":1.323,"15min":1.2030000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":1.5609999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.3200000000000001,"15min":1.2110000000000001},"min":{"1min":0.83699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":14.337999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.8999999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.282,"15min":1.248},"min":{"1min":0.72999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":5.4669999999999996,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.464},{"interface":"front","average":{"1min":2.23,"5min":1.4399999999999999,"15min":1.3120000000000001},"min":{"1min":0.94799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":17.161000000000001,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.488}]},{"osd":7,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.429,"15min":1.323},"min":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.4239999999999999,"15min":1.411},"min":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":9.7080000000000002,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.093}]}]}],"pool_statfs":[]}} 2023-12-19T13:49:45.860 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:49:46.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.088+0000 7f0616cc4640 1 Processor -- start 2023-12-19T13:49:46.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.088+0000 7f0616cc4640 1 -- start start 2023-12-19T13:49:46.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0616cc4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06101449e0 0x7f06100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0616cc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06100b0b50 0x7f061006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0616cc4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06100afb10 con 0x7f061006b590 2023-12-19T13:49:46.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0616cc4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061006bb30 con 0x7f06101449e0 2023-12-19T13:49:46.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0616cc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100b0070 con 0x7f06100b0b50 2023-12-19T13:49:46.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0614a60640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06101449e0 0x7f06100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0614a60640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06101449e0 0x7f06100af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58190/0 (socket says 172.21.15.113:58190) 2023-12-19T13:49:46.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f0614a60640 1 -- 172.21.15.113:0/2211392975 learned_addr learned my addr 172.21.15.113:0/2211392975 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:46.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.090+0000 7f060ffff640 1 --2- 172.21.15.113:0/2211392975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06100b0b50 0x7f061006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.091+0000 7f0614a60640 1 -- 172.21.15.113:0/2211392975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06100b0b50 msgr2=0x7f061006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:46.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.091+0000 7f0614a60640 1 --2- 172.21.15.113:0/2211392975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06100b0b50 0x7f061006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.091+0000 7f0614a60640 1 -- 172.21.15.113:0/2211392975 >> v1:172.21.15.151:6789/0 conn(0x7f061006b590 legacy=0x7f061015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:46.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.091+0000 7f0614a60640 1 -- 172.21.15.113:0/2211392975 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100b0350 con 0x7f06101449e0 2023-12-19T13:49:46.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.092+0000 7f0614a60640 1 --2- 172.21.15.113:0/2211392975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06101449e0 0x7f06100af5d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e50 tx=0x7f060002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7388b7d9db9b71c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:46.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f060f7fe640 1 -- 172.21.15.113:0/2211392975 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060002ca70 con 0x7f06101449e0 2023-12-19T13:49:46.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f060f7fe640 1 -- 172.21.15.113:0/2211392975 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060002cbd0 con 0x7f06101449e0 2023-12-19T13:49:46.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f060f7fe640 1 -- 172.21.15.113:0/2211392975 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000343f0 con 0x7f06101449e0 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f0616cc4640 1 -- 172.21.15.113:0/2211392975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06101449e0 msgr2=0x7f06100af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f0616cc4640 1 --2- 172.21.15.113:0/2211392975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06101449e0 0x7f06100af5d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e50 tx=0x7f060002bed0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f0616cc4640 1 -- 172.21.15.113:0/2211392975 shutdown_connections 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f0616cc4640 1 --2- 172.21.15.113:0/2211392975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06100b0b50 0x7f061006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f0616cc4640 1 --2- 172.21.15.113:0/2211392975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06101449e0 0x7f06100af5d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f0616cc4640 1 -- 172.21.15.113:0/2211392975 >> 172.21.15.113:0/2211392975 conn(0x7f06100cbb70 msgr2=0x7f06100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.093+0000 7f0616cc4640 1 -- 172.21.15.113:0/2211392975 shutdown_connections 2023-12-19T13:49:46.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.094+0000 7f0616cc4640 1 -- 172.21.15.113:0/2211392975 wait complete. 2023-12-19T13:49:46.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.095+0000 7f0616cc4640 1 Processor -- start 2023-12-19T13:49:46.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.095+0000 7f0616cc4640 1 -- start start 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0616cc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f061006b590 0x7f0610140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0616cc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06100b0b50 0x7f06101571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0616cc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06101449e0 0x7f06100b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0616cc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06101416e0 con 0x7f061006b590 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0616cc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06101419c0 con 0x7f06100b0b50 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0616cc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0610141ca0 con 0x7f06101449e0 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0614a60640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f061006b590 0x7f0610140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0614a60640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f061006b590 0x7f0610140db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58194/0 (socket says 172.21.15.113:58194) 2023-12-19T13:49:46.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.096+0000 7f0614a60640 1 -- 172.21.15.113:0/1709898536 learned_addr learned my addr 172.21.15.113:0/1709898536 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:46.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.097+0000 7f0614a60640 1 -- 172.21.15.113:0/1709898536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06101449e0 msgr2=0x7f06100b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.097+0000 7f0614a60640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06101449e0 0x7f06100b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.097+0000 7f0614a60640 1 -- 172.21.15.113:0/1709898536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06100b0b50 msgr2=0x7f06101571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.097+0000 7f0614a60640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06100b0b50 0x7f06101571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.097+0000 7f0614a60640 1 -- 172.21.15.113:0/1709898536 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009b30 con 0x7f061006b590 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.097+0000 7f0614a60640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f061006b590 0x7f0610140db0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e50 tx=0x7f0600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.098+0000 7f060d7fa640 1 -- 172.21.15.113:0/1709898536 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060003e450 con 0x7f061006b590 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.098+0000 7f060d7fa640 1 -- 172.21.15.113:0/1709898536 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060003e5f0 con 0x7f061006b590 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.098+0000 7f060d7fa640 1 -- 172.21.15.113:0/1709898536 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060003e9a0 con 0x7f061006b590 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.098+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0610141f80 con 0x7f061006b590 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.098+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0610157710 con 0x7f061006b590 2023-12-19T13:49:46.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.099+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06101578a0 con 0x7f061006b590 2023-12-19T13:49:46.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.100+0000 7f060d7fa640 1 -- 172.21.15.113:0/1709898536 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f060003eb00 con 0x7f061006b590 2023-12-19T13:49:46.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.101+0000 7f060d7fa640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f05f006a430 0x7f05f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.102+0000 7f060d7fa640 1 -- 172.21.15.113:0/1709898536 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06000ab900 con 0x7f061006b590 2023-12-19T13:49:46.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.102+0000 7f060ffff640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f05f006a430 0x7f05f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.102+0000 7f060ffff640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f05f006a430 0x7f05f006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f05f8006fd0 tx=0x7f05f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:46.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.106+0000 7f060d7fa640 1 -- 172.21.15.113:0/1709898536 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0600076e50 con 0x7f061006b590 2023-12-19T13:49:46.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.290+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06101414d0 con 0x7f05f006a430 2023-12-19T13:49:46.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.313+0000 7f060d7fa640 1 -- 172.21.15.113:0/1709898536 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282010 (secure 0 0 0) 0x7f06101414d0 con 0x7f05f006a430 2023-12-19T13:49:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:46.320 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:49:46.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.319+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f05f006a430 msgr2=0x7f05f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.319+0000 7f0616cc4640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f05f006a430 0x7f05f006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f05f8006fd0 tx=0x7f05f8008040 comp rx=0 tx=0).stop 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.319+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f061006b590 msgr2=0x7f0610140db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.319+0000 7f0616cc4640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f061006b590 0x7f0610140db0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e50 tx=0x7f0600004a40 comp rx=0 tx=0).stop 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 shutdown_connections 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f05f006a430 0x7f05f006c8f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06101449e0 0x7f06100b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06100b0b50 0x7f06101571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 --2- 172.21.15.113:0/1709898536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f061006b590 0x7f0610140db0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 >> 172.21.15.113:0/1709898536 conn(0x7f06100cbb70 msgr2=0x7f06100ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 shutdown_connections 2023-12-19T13:49:46.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.320+0000 7f0616cc4640 1 -- 172.21.15.113:0/1709898536 wait complete. 2023-12-19T13:49:46.340 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-12-19T13:49:44.468674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4138,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558361,"statfs":{"total":1600000000,"available":1595762236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.078508"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400360+0000","last_change":"2023-12-19T13:49:36.406923+0000","last_active":"2023-12-19T13:49:37.400360+0000","last_peered":"2023-12-19T13:49:37.400360+0000","last_clean":"2023-12-19T13:49:37.400360+0000","last_became_active":"2023-12-19T13:49:36.406685+0000","last_became_peered":"2023-12-19T13:49:36.406685+0000","last_unstale":"2023-12-19T13:49:37.400360+0000","last_undegraded":"2023-12-19T13:49:37.400360+0000","last_fullsized":"2023-12-19T13:49:37.400360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402388+0000","last_change":"2023-12-19T13:49:36.410699+0000","last_active":"2023-12-19T13:49:37.402388+0000","last_peered":"2023-12-19T13:49:37.402388+0000","last_clean":"2023-12-19T13:49:37.402388+0000","last_became_active":"2023-12-19T13:49:36.409574+0000","last_became_peered":"2023-12-19T13:49:36.409574+0000","last_unstale":"2023-12-19T13:49:37.402388+0000","last_undegraded":"2023-12-19T13:49:37.402388+0000","last_fullsized":"2023-12-19T13:49:37.402388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:34.189380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822971+0000","last_change":"2023-12-19T13:49:36.394475+0000","last_active":"2023-12-19T13:49:38.822971+0000","last_peered":"2023-12-19T13:49:38.822971+0000","last_clean":"2023-12-19T13:49:38.822971+0000","last_became_active":"2023-12-19T13:49:36.394262+0000","last_became_peered":"2023-12-19T13:49:36.394262+0000","last_unstale":"2023-12-19T13:49:38.822971+0000","last_undegraded":"2023-12-19T13:49:38.822971+0000","last_fullsized":"2023-12-19T13:49:38.822971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:36.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822286+0000","last_change":"2023-12-19T13:49:36.403203+0000","last_active":"2023-12-19T13:49:38.822286+0000","last_peered":"2023-12-19T13:49:38.822286+0000","last_clean":"2023-12-19T13:49:38.822286+0000","last_became_active":"2023-12-19T13:49:36.402982+0000","last_became_peered":"2023-12-19T13:49:36.402982+0000","last_unstale":"2023-12-19T13:49:38.822286+0000","last_undegraded":"2023-12-19T13:49:38.822286+0000","last_fullsized":"2023-12-19T13:49:38.822286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:39.662682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400617+0000","last_change":"2023-12-19T13:49:36.414171+0000","last_active":"2023-12-19T13:49:37.400617+0000","last_peered":"2023-12-19T13:49:37.400617+0000","last_clean":"2023-12-19T13:49:37.400617+0000","last_became_active":"2023-12-19T13:49:36.413911+0000","last_became_peered":"2023-12-19T13:49:36.413911+0000","last_unstale":"2023-12-19T13:49:37.400617+0000","last_undegraded":"2023-12-19T13:49:37.400617+0000","last_fullsized":"2023-12-19T13:49:37.400617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:00:50.577976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400525+0000","last_change":"2023-12-19T13:49:36.405513+0000","last_active":"2023-12-19T13:49:37.400525+0000","last_peered":"2023-12-19T13:49:37.400525+0000","last_clean":"2023-12-19T13:49:37.400525+0000","last_became_active":"2023-12-19T13:49:36.404778+0000","last_became_peered":"2023-12-19T13:49:36.404778+0000","last_unstale":"2023-12-19T13:49:37.400525+0000","last_undegraded":"2023-12-19T13:49:37.400525+0000","last_fullsized":"2023-12-19T13:49:37.400525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:18.160505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822451+0000","last_change":"2023-12-19T13:49:36.403126+0000","last_active":"2023-12-19T13:49:38.822451+0000","last_peered":"2023-12-19T13:49:38.822451+0000","last_clean":"2023-12-19T13:49:38.822451+0000","last_became_active":"2023-12-19T13:49:36.399427+0000","last_became_peered":"2023-12-19T13:49:36.399427+0000","last_unstale":"2023-12-19T13:49:38.822451+0000","last_undegraded":"2023-12-19T13:49:38.822451+0000","last_fullsized":"2023-12-19T13:49:38.822451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:39.487118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103436+0000","last_change":"2023-12-19T13:49:36.413414+0000","last_active":"2023-12-19T13:49:38.103436+0000","last_peered":"2023-12-19T13:49:38.103436+0000","last_clean":"2023-12-19T13:49:38.103436+0000","last_became_active":"2023-12-19T13:49:36.413187+0000","last_became_peered":"2023-12-19T13:49:36.413187+0000","last_unstale":"2023-12-19T13:49:38.103436+0000","last_undegraded":"2023-12-19T13:49:38.103436+0000","last_fullsized":"2023-12-19T13:49:38.103436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:19.712354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398255+0000","last_change":"2023-12-19T13:49:36.406555+0000","last_active":"2023-12-19T13:49:37.398255+0000","last_peered":"2023-12-19T13:49:37.398255+0000","last_clean":"2023-12-19T13:49:37.398255+0000","last_became_active":"2023-12-19T13:49:36.405313+0000","last_became_peered":"2023-12-19T13:49:36.405313+0000","last_unstale":"2023-12-19T13:49:37.398255+0000","last_undegraded":"2023-12-19T13:49:37.398255+0000","last_fullsized":"2023-12-19T13:49:37.398255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:56.630159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400744+0000","last_change":"2023-12-19T13:49:36.407941+0000","last_active":"2023-12-19T13:49:37.400744+0000","last_peered":"2023-12-19T13:49:37.400744+0000","last_clean":"2023-12-19T13:49:37.400744+0000","last_became_active":"2023-12-19T13:49:36.407680+0000","last_became_peered":"2023-12-19T13:49:36.407680+0000","last_unstale":"2023-12-19T13:49:37.400744+0000","last_undegraded":"2023-12-19T13:49:37.400744+0000","last_fullsized":"2023-12-19T13:49:37.400744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:18.499842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822858+0000","last_change":"2023-12-19T13:49:36.404369+0000","last_active":"2023-12-19T13:49:38.822858+0000","last_peered":"2023-12-19T13:49:38.822858+0000","last_clean":"2023-12-19T13:49:38.822858+0000","last_became_active":"2023-12-19T13:49:36.404095+0000","last_became_peered":"2023-12-19T13:49:36.404095+0000","last_unstale":"2023-12-19T13:49:38.822858+0000","last_undegraded":"2023-12-19T13:49:38.822858+0000","last_fullsized":"2023-12-19T13:49:38.822858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398615+0000","last_change":"2023-12-19T13:49:36.403893+0000","last_active":"2023-12-19T13:49:37.398615+0000","last_peered":"2023-12-19T13:49:37.398615+0000","last_clean":"2023-12-19T13:49:37.398615+0000","last_became_active":"2023-12-19T13:49:36.400637+0000","last_became_peered":"2023-12-19T13:49:36.400637+0000","last_unstale":"2023-12-19T13:49:37.398615+0000","last_undegraded":"2023-12-19T13:49:37.398615+0000","last_fullsized":"2023-12-19T13:49:37.398615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:04.169818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824845+0000","last_change":"2023-12-19T13:49:36.410612+0000","last_active":"2023-12-19T13:49:38.824845+0000","last_peered":"2023-12-19T13:49:38.824845+0000","last_clean":"2023-12-19T13:49:38.824845+0000","last_became_active":"2023-12-19T13:49:36.410402+0000","last_became_peered":"2023-12-19T13:49:36.410402+0000","last_unstale":"2023-12-19T13:49:38.824845+0000","last_undegraded":"2023-12-19T13:49:38.824845+0000","last_fullsized":"2023-12-19T13:49:38.824845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:00:50.577976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822427+0000","last_change":"2023-12-19T13:49:36.408953+0000","last_active":"2023-12-19T13:49:38.822427+0000","last_peered":"2023-12-19T13:49:38.822427+0000","last_clean":"2023-12-19T13:49:38.822427+0000","last_became_active":"2023-12-19T13:49:36.408561+0000","last_became_peered":"2023-12-19T13:49:36.408561+0000","last_unstale":"2023-12-19T13:49:38.822427+0000","last_undegraded":"2023-12-19T13:49:38.822427+0000","last_fullsized":"2023-12-19T13:49:38.822427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.825022+0000","last_change":"2023-12-19T13:49:36.407816+0000","last_active":"2023-12-19T13:49:38.825022+0000","last_peered":"2023-12-19T13:49:38.825022+0000","last_clean":"2023-12-19T13:49:38.825022+0000","last_became_active":"2023-12-19T13:49:36.407484+0000","last_became_peered":"2023-12-19T13:49:36.407484+0000","last_unstale":"2023-12-19T13:49:38.825022+0000","last_undegraded":"2023-12-19T13:49:38.825022+0000","last_fullsized":"2023-12-19T13:49:38.825022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400435+0000","last_change":"2023-12-19T13:49:36.412291+0000","last_active":"2023-12-19T13:49:37.400435+0000","last_peered":"2023-12-19T13:49:37.400435+0000","last_clean":"2023-12-19T13:49:37.400435+0000","last_became_active":"2023-12-19T13:49:36.412071+0000","last_became_peered":"2023-12-19T13:49:36.412071+0000","last_unstale":"2023-12-19T13:49:37.400435+0000","last_undegraded":"2023-12-19T13:49:37.400435+0000","last_fullsized":"2023-12-19T13:49:37.400435+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:43:26.077742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.399738+0000","last_change":"2023-12-19T13:49:36.402035+0000","last_active":"2023-12-19T13:49:37.399738+0000","last_peered":"2023-12-19T13:49:37.399738+0000","last_clean":"2023-12-19T13:49:37.399738+0000","last_became_active":"2023-12-19T13:49:36.401484+0000","last_became_peered":"2023-12-19T13:49:36.401484+0000","last_unstale":"2023-12-19T13:49:37.399738+0000","last_undegraded":"2023-12-19T13:49:37.399738+0000","last_fullsized":"2023-12-19T13:49:37.399738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:46.388583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823203+0000","last_change":"2023-12-19T13:49:36.406690+0000","last_active":"2023-12-19T13:49:38.823203+0000","last_peered":"2023-12-19T13:49:38.823203+0000","last_clean":"2023-12-19T13:49:38.823203+0000","last_became_active":"2023-12-19T13:49:36.402517+0000","last_became_peered":"2023-12-19T13:49:36.402517+0000","last_unstale":"2023-12-19T13:49:38.823203+0000","last_undegraded":"2023-12-19T13:49:38.823203+0000","last_fullsized":"2023-12-19T13:49:38.823203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400794+0000","last_change":"2023-12-19T13:49:36.408377+0000","last_active":"2023-12-19T13:49:37.400794+0000","last_peered":"2023-12-19T13:49:37.400794+0000","last_clean":"2023-12-19T13:49:37.400794+0000","last_became_active":"2023-12-19T13:49:36.407632+0000","last_became_peered":"2023-12-19T13:49:36.407632+0000","last_unstale":"2023-12-19T13:49:37.400794+0000","last_undegraded":"2023-12-19T13:49:37.400794+0000","last_fullsized":"2023-12-19T13:49:37.400794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:14.495935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823578+0000","last_change":"2023-12-19T13:49:36.403170+0000","last_active":"2023-12-19T13:49:38.823578+0000","last_peered":"2023-12-19T13:49:38.823578+0000","last_clean":"2023-12-19T13:49:38.823578+0000","last_became_active":"2023-12-19T13:49:36.402945+0000","last_became_peered":"2023-12-19T13:49:36.402945+0000","last_unstale":"2023-12-19T13:49:38.823578+0000","last_undegraded":"2023-12-19T13:49:38.823578+0000","last_fullsized":"2023-12-19T13:49:38.823578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822626+0000","last_change":"2023-12-19T13:49:36.403742+0000","last_active":"2023-12-19T13:49:38.822626+0000","last_peered":"2023-12-19T13:49:38.822626+0000","last_clean":"2023-12-19T13:49:38.822626+0000","last_became_active":"2023-12-19T13:49:36.403537+0000","last_became_peered":"2023-12-19T13:49:36.403537+0000","last_unstale":"2023-12-19T13:49:38.822626+0000","last_undegraded":"2023-12-19T13:49:38.822626+0000","last_fullsized":"2023-12-19T13:49:38.822626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:12.262923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823214+0000","last_change":"2023-12-19T13:49:36.413468+0000","last_active":"2023-12-19T13:49:38.823214+0000","last_peered":"2023-12-19T13:49:38.823214+0000","last_clean":"2023-12-19T13:49:38.823214+0000","last_became_active":"2023-12-19T13:49:36.413122+0000","last_became_peered":"2023-12-19T13:49:36.413122+0000","last_unstale":"2023-12-19T13:49:38.823214+0000","last_undegraded":"2023-12-19T13:49:38.823214+0000","last_fullsized":"2023-12-19T13:49:38.823214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823105+0000","last_change":"2023-12-19T13:49:36.409909+0000","last_active":"2023-12-19T13:49:38.823105+0000","last_peered":"2023-12-19T13:49:38.823105+0000","last_clean":"2023-12-19T13:49:38.823105+0000","last_became_active":"2023-12-19T13:49:36.409492+0000","last_became_peered":"2023-12-19T13:49:36.409492+0000","last_unstale":"2023-12-19T13:49:38.823105+0000","last_undegraded":"2023-12-19T13:49:38.823105+0000","last_fullsized":"2023-12-19T13:49:38.823105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:05.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398483+0000","last_change":"2023-12-19T13:49:36.406713+0000","last_active":"2023-12-19T13:49:37.398483+0000","last_peered":"2023-12-19T13:49:37.398483+0000","last_clean":"2023-12-19T13:49:37.398483+0000","last_became_active":"2023-12-19T13:49:36.405725+0000","last_became_peered":"2023-12-19T13:49:36.405725+0000","last_unstale":"2023-12-19T13:49:37.398483+0000","last_undegraded":"2023-12-19T13:49:37.398483+0000","last_fullsized":"2023-12-19T13:49:37.398483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:34.189380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402035+0000","last_change":"2023-12-19T13:49:36.409858+0000","last_active":"2023-12-19T13:49:37.402035+0000","last_peered":"2023-12-19T13:49:37.402035+0000","last_clean":"2023-12-19T13:49:37.402035+0000","last_became_active":"2023-12-19T13:49:36.409342+0000","last_became_peered":"2023-12-19T13:49:36.409342+0000","last_unstale":"2023-12-19T13:49:37.402035+0000","last_undegraded":"2023-12-19T13:49:37.402035+0000","last_fullsized":"2023-12-19T13:49:37.402035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:56.630159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822866+0000","last_change":"2023-12-19T13:49:36.406224+0000","last_active":"2023-12-19T13:49:38.822866+0000","last_peered":"2023-12-19T13:49:38.822866+0000","last_clean":"2023-12-19T13:49:38.822866+0000","last_became_active":"2023-12-19T13:49:36.405943+0000","last_became_peered":"2023-12-19T13:49:36.405943+0000","last_unstale":"2023-12-19T13:49:38.822866+0000","last_undegraded":"2023-12-19T13:49:38.822866+0000","last_fullsized":"2023-12-19T13:49:38.822866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:47.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402555+0000","last_change":"2023-12-19T13:49:36.411435+0000","last_active":"2023-12-19T13:49:37.402555+0000","last_peered":"2023-12-19T13:49:37.402555+0000","last_clean":"2023-12-19T13:49:37.402555+0000","last_became_active":"2023-12-19T13:49:36.410978+0000","last_became_peered":"2023-12-19T13:49:36.410978+0000","last_unstale":"2023-12-19T13:49:37.402555+0000","last_undegraded":"2023-12-19T13:49:37.402555+0000","last_fullsized":"2023-12-19T13:49:37.402555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:55.233175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103740+0000","last_change":"2023-12-19T13:49:36.411210+0000","last_active":"2023-12-19T13:49:38.103740+0000","last_peered":"2023-12-19T13:49:38.103740+0000","last_clean":"2023-12-19T13:49:38.103740+0000","last_became_active":"2023-12-19T13:49:36.410659+0000","last_became_peered":"2023-12-19T13:49:36.410659+0000","last_unstale":"2023-12-19T13:49:38.103740+0000","last_undegraded":"2023-12-19T13:49:38.103740+0000","last_fullsized":"2023-12-19T13:49:38.103740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:19.504503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103936+0000","last_change":"2023-12-19T13:49:36.412535+0000","last_active":"2023-12-19T13:49:38.103936+0000","last_peered":"2023-12-19T13:49:38.103936+0000","last_clean":"2023-12-19T13:49:38.103936+0000","last_became_active":"2023-12-19T13:49:36.411820+0000","last_became_peered":"2023-12-19T13:49:36.411820+0000","last_unstale":"2023-12-19T13:49:38.103936+0000","last_undegraded":"2023-12-19T13:49:38.103936+0000","last_fullsized":"2023-12-19T13:49:38.103936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:06:15.067534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823717+0000","last_change":"2023-12-19T13:49:36.404081+0000","last_active":"2023-12-19T13:49:38.823717+0000","last_peered":"2023-12-19T13:49:38.823717+0000","last_clean":"2023-12-19T13:49:38.823717+0000","last_became_active":"2023-12-19T13:49:36.402206+0000","last_became_peered":"2023-12-19T13:49:36.402206+0000","last_unstale":"2023-12-19T13:49:38.823717+0000","last_undegraded":"2023-12-19T13:49:38.823717+0000","last_fullsized":"2023-12-19T13:49:38.823717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:29.166537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.401186+0000","last_change":"2023-12-19T13:49:36.406221+0000","last_active":"2023-12-19T13:49:37.401186+0000","last_peered":"2023-12-19T13:49:37.401186+0000","last_clean":"2023-12-19T13:49:37.401186+0000","last_became_active":"2023-12-19T13:49:36.404128+0000","last_became_peered":"2023-12-19T13:49:36.404128+0000","last_unstale":"2023-12-19T13:49:37.401186+0000","last_undegraded":"2023-12-19T13:49:37.401186+0000","last_fullsized":"2023-12-19T13:49:37.401186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:43:16.923715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823769+0000","last_change":"2023-12-19T13:49:36.410096+0000","last_active":"2023-12-19T13:49:38.823769+0000","last_peered":"2023-12-19T13:49:38.823769+0000","last_clean":"2023-12-19T13:49:38.823769+0000","last_became_active":"2023-12-19T13:49:36.409874+0000","last_became_peered":"2023-12-19T13:49:36.409874+0000","last_unstale":"2023-12-19T13:49:38.823769+0000","last_undegraded":"2023-12-19T13:49:38.823769+0000","last_fullsized":"2023-12-19T13:49:38.823769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400340+0000","last_change":"2023-12-19T13:49:36.414833+0000","last_active":"2023-12-19T13:49:37.400340+0000","last_peered":"2023-12-19T13:49:37.400340+0000","last_clean":"2023-12-19T13:49:37.400340+0000","last_became_active":"2023-12-19T13:49:36.414149+0000","last_became_peered":"2023-12-19T13:49:36.414149+0000","last_unstale":"2023-12-19T13:49:37.400340+0000","last_undegraded":"2023-12-19T13:49:37.400340+0000","last_fullsized":"2023-12-19T13:49:37.400340+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:02.377990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407746+0000","last_change":"2023-12-19T13:49:35.928447+0000","last_active":"2023-12-19T13:49:36.407746+0000","last_peered":"2023-12-19T13:49:36.407746+0000","last_clean":"2023-12-19T13:49:36.407746+0000","last_became_active":"2023-12-19T13:49:35.928154+0000","last_became_peered":"2023-12-19T13:49:35.928154+0000","last_unstale":"2023-12-19T13:49:36.407746+0000","last_undegraded":"2023-12-19T13:49:36.407746+0000","last_fullsized":"2023-12-19T13:49:36.407746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:45.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.399844+0000","last_change":"2023-12-19T13:49:36.399701+0000","last_active":"2023-12-19T13:49:37.399844+0000","last_peered":"2023-12-19T13:49:37.399844+0000","last_clean":"2023-12-19T13:49:37.399844+0000","last_became_active":"2023-12-19T13:49:36.399441+0000","last_became_peered":"2023-12-19T13:49:36.399441+0000","last_unstale":"2023-12-19T13:49:37.399844+0000","last_undegraded":"2023-12-19T13:49:37.399844+0000","last_fullsized":"2023-12-19T13:49:37.399844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:47.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.413181+0000","last_change":"2023-12-19T13:49:35.932006+0000","last_active":"2023-12-19T13:49:36.413181+0000","last_peered":"2023-12-19T13:49:36.413181+0000","last_clean":"2023-12-19T13:49:36.413181+0000","last_became_active":"2023-12-19T13:49:35.929750+0000","last_became_peered":"2023-12-19T13:49:35.929750+0000","last_unstale":"2023-12-19T13:49:36.413181+0000","last_undegraded":"2023-12-19T13:49:36.413181+0000","last_fullsized":"2023-12-19T13:49:36.413181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:25.292841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104149+0000","last_change":"2023-12-19T13:49:36.409134+0000","last_active":"2023-12-19T13:49:38.104149+0000","last_peered":"2023-12-19T13:49:38.104149+0000","last_clean":"2023-12-19T13:49:38.104149+0000","last_became_active":"2023-12-19T13:49:36.408682+0000","last_became_peered":"2023-12-19T13:49:36.408682+0000","last_unstale":"2023-12-19T13:49:38.104149+0000","last_undegraded":"2023-12-19T13:49:38.104149+0000","last_fullsized":"2023-12-19T13:49:38.104149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:23:40.450095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417754+0000","last_change":"2023-12-19T13:49:35.937199+0000","last_active":"2023-12-19T13:49:36.417754+0000","last_peered":"2023-12-19T13:49:36.417754+0000","last_clean":"2023-12-19T13:49:36.417754+0000","last_became_active":"2023-12-19T13:49:35.936966+0000","last_became_peered":"2023-12-19T13:49:35.936966+0000","last_unstale":"2023-12-19T13:49:36.417754+0000","last_undegraded":"2023-12-19T13:49:36.417754+0000","last_fullsized":"2023-12-19T13:49:36.417754+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:15:25.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400982+0000","last_change":"2023-12-19T13:49:36.409624+0000","last_active":"2023-12-19T13:49:37.400982+0000","last_peered":"2023-12-19T13:49:37.400982+0000","last_clean":"2023-12-19T13:49:37.400982+0000","last_became_active":"2023-12-19T13:49:36.409385+0000","last_became_peered":"2023-12-19T13:49:36.409385+0000","last_unstale":"2023-12-19T13:49:37.400982+0000","last_undegraded":"2023-12-19T13:49:37.400982+0000","last_fullsized":"2023-12-19T13:49:37.400982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:36.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414405+0000","last_change":"2023-12-19T13:49:35.924513+0000","last_active":"2023-12-19T13:49:36.414405+0000","last_peered":"2023-12-19T13:49:36.414405+0000","last_clean":"2023-12-19T13:49:36.414405+0000","last_became_active":"2023-12-19T13:49:35.924291+0000","last_became_peered":"2023-12-19T13:49:35.924291+0000","last_unstale":"2023-12-19T13:49:36.414405+0000","last_undegraded":"2023-12-19T13:49:36.414405+0000","last_fullsized":"2023-12-19T13:49:36.414405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:59.357889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103971+0000","last_change":"2023-12-19T13:49:36.411362+0000","last_active":"2023-12-19T13:49:38.103971+0000","last_peered":"2023-12-19T13:49:38.103971+0000","last_clean":"2023-12-19T13:49:38.103971+0000","last_became_active":"2023-12-19T13:49:36.410972+0000","last_became_peered":"2023-12-19T13:49:36.410972+0000","last_unstale":"2023-12-19T13:49:38.103971+0000","last_undegraded":"2023-12-19T13:49:38.103971+0000","last_fullsized":"2023-12-19T13:49:38.103971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:16.770593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416283+0000","last_change":"2023-12-19T13:49:35.929134+0000","last_active":"2023-12-19T13:49:36.416283+0000","last_peered":"2023-12-19T13:49:36.416283+0000","last_clean":"2023-12-19T13:49:36.416283+0000","last_became_active":"2023-12-19T13:49:35.928936+0000","last_became_peered":"2023-12-19T13:49:35.928936+0000","last_unstale":"2023-12-19T13:49:36.416283+0000","last_undegraded":"2023-12-19T13:49:36.416283+0000","last_fullsized":"2023-12-19T13:49:36.416283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:55.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823622+0000","last_change":"2023-12-19T13:49:36.413335+0000","last_active":"2023-12-19T13:49:38.823622+0000","last_peered":"2023-12-19T13:49:38.823622+0000","last_clean":"2023-12-19T13:49:38.823622+0000","last_became_active":"2023-12-19T13:49:36.412708+0000","last_became_peered":"2023-12-19T13:49:36.412708+0000","last_unstale":"2023-12-19T13:49:38.823622+0000","last_undegraded":"2023-12-19T13:49:38.823622+0000","last_fullsized":"2023-12-19T13:49:38.823622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414870+0000","last_change":"2023-12-19T13:49:35.938579+0000","last_active":"2023-12-19T13:49:36.414870+0000","last_peered":"2023-12-19T13:49:36.414870+0000","last_clean":"2023-12-19T13:49:36.414870+0000","last_became_active":"2023-12-19T13:49:35.938216+0000","last_became_peered":"2023-12-19T13:49:35.938216+0000","last_unstale":"2023-12-19T13:49:36.414870+0000","last_undegraded":"2023-12-19T13:49:36.414870+0000","last_fullsized":"2023-12-19T13:49:36.414870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:05.089463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823797+0000","last_change":"2023-12-19T13:49:36.406246+0000","last_active":"2023-12-19T13:49:38.823797+0000","last_peered":"2023-12-19T13:49:38.823797+0000","last_clean":"2023-12-19T13:49:38.823797+0000","last_became_active":"2023-12-19T13:49:36.406037+0000","last_became_peered":"2023-12-19T13:49:36.406037+0000","last_unstale":"2023-12-19T13:49:38.823797+0000","last_undegraded":"2023-12-19T13:49:38.823797+0000","last_fullsized":"2023-12-19T13:49:38.823797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:36.830962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390136+0000","last_change":"2023-12-19T13:49:35.923214+0000","last_active":"2023-12-19T13:49:36.390136+0000","last_peered":"2023-12-19T13:49:36.390136+0000","last_clean":"2023-12-19T13:49:36.390136+0000","last_became_active":"2023-12-19T13:49:35.922966+0000","last_became_peered":"2023-12-19T13:49:35.922966+0000","last_unstale":"2023-12-19T13:49:36.390136+0000","last_undegraded":"2023-12-19T13:49:36.390136+0000","last_fullsized":"2023-12-19T13:49:36.390136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.400987+0000","last_change":"2023-12-19T13:49:36.411228+0000","last_active":"2023-12-19T13:49:37.400987+0000","last_peered":"2023-12-19T13:49:37.400987+0000","last_clean":"2023-12-19T13:49:37.400987+0000","last_became_active":"2023-12-19T13:49:36.411001+0000","last_became_peered":"2023-12-19T13:49:36.411001+0000","last_unstale":"2023-12-19T13:49:37.400987+0000","last_undegraded":"2023-12-19T13:49:37.400987+0000","last_fullsized":"2023-12-19T13:49:37.400987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.397876+0000","last_change":"2023-12-19T13:49:35.934055+0000","last_active":"2023-12-19T13:49:36.397876+0000","last_peered":"2023-12-19T13:49:36.397876+0000","last_clean":"2023-12-19T13:49:36.397876+0000","last_became_active":"2023-12-19T13:49:35.933871+0000","last_became_peered":"2023-12-19T13:49:35.933871+0000","last_unstale":"2023-12-19T13:49:36.397876+0000","last_undegraded":"2023-12-19T13:49:36.397876+0000","last_fullsized":"2023-12-19T13:49:36.397876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823791+0000","last_change":"2023-12-19T13:49:36.400996+0000","last_active":"2023-12-19T13:49:38.823791+0000","last_peered":"2023-12-19T13:49:38.823791+0000","last_clean":"2023-12-19T13:49:38.823791+0000","last_became_active":"2023-12-19T13:49:36.400446+0000","last_became_peered":"2023-12-19T13:49:36.400446+0000","last_unstale":"2023-12-19T13:49:38.823791+0000","last_undegraded":"2023-12-19T13:49:38.823791+0000","last_fullsized":"2023-12-19T13:49:38.823791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:02.377990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389174+0000","last_change":"2023-12-19T13:49:35.929803+0000","last_active":"2023-12-19T13:49:36.389174+0000","last_peered":"2023-12-19T13:49:36.389174+0000","last_clean":"2023-12-19T13:49:36.389174+0000","last_became_active":"2023-12-19T13:49:35.929631+0000","last_became_peered":"2023-12-19T13:49:35.929631+0000","last_unstale":"2023-12-19T13:49:36.389174+0000","last_undegraded":"2023-12-19T13:49:36.389174+0000","last_fullsized":"2023-12-19T13:49:36.389174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:58:19.919170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822508+0000","last_change":"2023-12-19T13:49:36.404280+0000","last_active":"2023-12-19T13:49:38.822508+0000","last_peered":"2023-12-19T13:49:38.822508+0000","last_clean":"2023-12-19T13:49:38.822508+0000","last_became_active":"2023-12-19T13:49:36.403858+0000","last_became_peered":"2023-12-19T13:49:36.403858+0000","last_unstale":"2023-12-19T13:49:38.822508+0000","last_undegraded":"2023-12-19T13:49:38.822508+0000","last_fullsized":"2023-12-19T13:49:38.822508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:04:29.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.401238+0000","last_change":"2023-12-19T13:49:35.933691+0000","last_active":"2023-12-19T13:49:36.401238+0000","last_peered":"2023-12-19T13:49:36.401238+0000","last_clean":"2023-12-19T13:49:36.401238+0000","last_became_active":"2023-12-19T13:49:35.933292+0000","last_became_peered":"2023-12-19T13:49:35.933292+0000","last_unstale":"2023-12-19T13:49:36.401238+0000","last_undegraded":"2023-12-19T13:49:36.401238+0000","last_fullsized":"2023-12-19T13:49:36.401238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:51.647666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104180+0000","last_change":"2023-12-19T13:49:36.408847+0000","last_active":"2023-12-19T13:49:38.104180+0000","last_peered":"2023-12-19T13:49:38.104180+0000","last_clean":"2023-12-19T13:49:38.104180+0000","last_became_active":"2023-12-19T13:49:36.408281+0000","last_became_peered":"2023-12-19T13:49:36.408281+0000","last_unstale":"2023-12-19T13:49:38.104180+0000","last_undegraded":"2023-12-19T13:49:38.104180+0000","last_fullsized":"2023-12-19T13:49:38.104180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:15.403155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.416507+0000","last_change":"2023-12-19T13:49:35.924025+0000","last_active":"2023-12-19T13:49:36.416507+0000","last_peered":"2023-12-19T13:49:36.416507+0000","last_clean":"2023-12-19T13:49:36.416507+0000","last_became_active":"2023-12-19T13:49:35.923797+0000","last_became_peered":"2023-12-19T13:49:35.923797+0000","last_unstale":"2023-12-19T13:49:36.416507+0000","last_undegraded":"2023-12-19T13:49:36.416507+0000","last_fullsized":"2023-12-19T13:49:36.416507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:18.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823533+0000","last_change":"2023-12-19T13:49:36.415145+0000","last_active":"2023-12-19T13:49:38.823533+0000","last_peered":"2023-12-19T13:49:38.823533+0000","last_clean":"2023-12-19T13:49:38.823533+0000","last_became_active":"2023-12-19T13:49:36.414802+0000","last_became_peered":"2023-12-19T13:49:36.414802+0000","last_unstale":"2023-12-19T13:49:38.823533+0000","last_undegraded":"2023-12-19T13:49:38.823533+0000","last_fullsized":"2023-12-19T13:49:38.823533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:28.229489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"72'6","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417262+0000","last_change":"2023-12-19T13:49:35.925004+0000","last_active":"2023-12-19T13:49:36.417262+0000","last_peered":"2023-12-19T13:49:36.417262+0000","last_clean":"2023-12-19T13:49:36.417262+0000","last_became_active":"2023-12-19T13:49:35.924778+0000","last_became_peered":"2023-12-19T13:49:35.924778+0000","last_unstale":"2023-12-19T13:49:36.417262+0000","last_undegraded":"2023-12-19T13:49:36.417262+0000","last_fullsized":"2023-12-19T13:49:36.417262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398430+0000","last_change":"2023-12-19T13:49:36.401718+0000","last_active":"2023-12-19T13:49:37.398430+0000","last_peered":"2023-12-19T13:49:37.398430+0000","last_clean":"2023-12-19T13:49:37.398430+0000","last_became_active":"2023-12-19T13:49:36.401473+0000","last_became_peered":"2023-12-19T13:49:36.401473+0000","last_unstale":"2023-12-19T13:49:37.398430+0000","last_undegraded":"2023-12-19T13:49:37.398430+0000","last_fullsized":"2023-12-19T13:49:37.398430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:55.233175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.418092+0000","last_change":"2023-12-19T13:49:35.934180+0000","last_active":"2023-12-19T13:49:36.418092+0000","last_peered":"2023-12-19T13:49:36.418092+0000","last_clean":"2023-12-19T13:49:36.418092+0000","last_became_active":"2023-12-19T13:49:35.933546+0000","last_became_peered":"2023-12-19T13:49:35.933546+0000","last_unstale":"2023-12-19T13:49:36.418092+0000","last_undegraded":"2023-12-19T13:49:36.418092+0000","last_fullsized":"2023-12-19T13:49:36.418092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:46.501331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824036+0000","last_change":"2023-12-19T13:49:36.401160+0000","last_active":"2023-12-19T13:49:38.824036+0000","last_peered":"2023-12-19T13:49:38.824036+0000","last_clean":"2023-12-19T13:49:38.824036+0000","last_became_active":"2023-12-19T13:49:36.397578+0000","last_became_peered":"2023-12-19T13:49:36.397578+0000","last_unstale":"2023-12-19T13:49:38.824036+0000","last_undegraded":"2023-12-19T13:49:38.824036+0000","last_fullsized":"2023-12-19T13:49:38.824036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:58.149218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.396140+0000","last_change":"2023-12-19T13:49:35.921680+0000","last_active":"2023-12-19T13:49:36.396140+0000","last_peered":"2023-12-19T13:49:36.396140+0000","last_clean":"2023-12-19T13:49:36.396140+0000","last_became_active":"2023-12-19T13:49:35.921416+0000","last_became_peered":"2023-12-19T13:49:35.921416+0000","last_unstale":"2023-12-19T13:49:36.396140+0000","last_undegraded":"2023-12-19T13:49:36.396140+0000","last_fullsized":"2023-12-19T13:49:36.396140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:18.490775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398690+0000","last_change":"2023-12-19T13:49:36.402557+0000","last_active":"2023-12-19T13:49:37.398690+0000","last_peered":"2023-12-19T13:49:37.398690+0000","last_clean":"2023-12-19T13:49:37.398690+0000","last_became_active":"2023-12-19T13:49:36.402039+0000","last_became_peered":"2023-12-19T13:49:36.402039+0000","last_unstale":"2023-12-19T13:49:37.398690+0000","last_undegraded":"2023-12-19T13:49:37.398690+0000","last_fullsized":"2023-12-19T13:49:37.398690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:48.356106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.398168+0000","last_change":"2023-12-19T13:49:35.921988+0000","last_active":"2023-12-19T13:49:36.398168+0000","last_peered":"2023-12-19T13:49:36.398168+0000","last_clean":"2023-12-19T13:49:36.398168+0000","last_became_active":"2023-12-19T13:49:35.921781+0000","last_became_peered":"2023-12-19T13:49:35.921781+0000","last_unstale":"2023-12-19T13:49:36.398168+0000","last_undegraded":"2023-12-19T13:49:36.398168+0000","last_fullsized":"2023-12-19T13:49:36.398168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:20.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822533+0000","last_change":"2023-12-19T13:49:36.412408+0000","last_active":"2023-12-19T13:49:38.822533+0000","last_peered":"2023-12-19T13:49:38.822533+0000","last_clean":"2023-12-19T13:49:38.822533+0000","last_became_active":"2023-12-19T13:49:36.412195+0000","last_became_peered":"2023-12-19T13:49:36.412195+0000","last_unstale":"2023-12-19T13:49:38.822533+0000","last_undegraded":"2023-12-19T13:49:38.822533+0000","last_fullsized":"2023-12-19T13:49:38.822533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:00.107117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414513+0000","last_change":"2023-12-19T13:49:35.922220+0000","last_active":"2023-12-19T13:49:36.414513+0000","last_peered":"2023-12-19T13:49:36.414513+0000","last_clean":"2023-12-19T13:49:36.414513+0000","last_became_active":"2023-12-19T13:49:35.921380+0000","last_became_peered":"2023-12-19T13:49:35.921380+0000","last_unstale":"2023-12-19T13:49:36.414513+0000","last_undegraded":"2023-12-19T13:49:36.414513+0000","last_fullsized":"2023-12-19T13:49:36.414513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:15.756864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824265+0000","last_change":"2023-12-19T13:49:36.401948+0000","last_active":"2023-12-19T13:49:38.824265+0000","last_peered":"2023-12-19T13:49:38.824265+0000","last_clean":"2023-12-19T13:49:38.824265+0000","last_became_active":"2023-12-19T13:49:36.399248+0000","last_became_peered":"2023-12-19T13:49:36.399248+0000","last_unstale":"2023-12-19T13:49:38.824265+0000","last_undegraded":"2023-12-19T13:49:38.824265+0000","last_fullsized":"2023-12-19T13:49:38.824265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:21.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.412223+0000","last_change":"2023-12-19T13:49:35.937514+0000","last_active":"2023-12-19T13:49:36.412223+0000","last_peered":"2023-12-19T13:49:36.412223+0000","last_clean":"2023-12-19T13:49:36.412223+0000","last_became_active":"2023-12-19T13:49:35.937228+0000","last_became_peered":"2023-12-19T13:49:35.937228+0000","last_unstale":"2023-12-19T13:49:36.412223+0000","last_undegraded":"2023-12-19T13:49:36.412223+0000","last_fullsized":"2023-12-19T13:49:36.412223+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:37.941627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822666+0000","last_change":"2023-12-19T13:49:36.408093+0000","last_active":"2023-12-19T13:49:38.822666+0000","last_peered":"2023-12-19T13:49:38.822666+0000","last_clean":"2023-12-19T13:49:38.822666+0000","last_became_active":"2023-12-19T13:49:36.407151+0000","last_became_peered":"2023-12-19T13:49:36.407151+0000","last_unstale":"2023-12-19T13:49:38.822666+0000","last_undegraded":"2023-12-19T13:49:38.822666+0000","last_fullsized":"2023-12-19T13:49:38.822666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:53.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417919+0000","last_change":"2023-12-19T13:49:35.934350+0000","last_active":"2023-12-19T13:49:36.417919+0000","last_peered":"2023-12-19T13:49:36.417919+0000","last_clean":"2023-12-19T13:49:36.417919+0000","last_became_active":"2023-12-19T13:49:35.933913+0000","last_became_peered":"2023-12-19T13:49:35.933913+0000","last_unstale":"2023-12-19T13:49:36.417919+0000","last_undegraded":"2023-12-19T13:49:36.417919+0000","last_fullsized":"2023-12-19T13:49:36.417919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:17.146776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402615+0000","last_change":"2023-12-19T13:49:36.411178+0000","last_active":"2023-12-19T13:49:37.402615+0000","last_peered":"2023-12-19T13:49:37.402615+0000","last_clean":"2023-12-19T13:49:37.402615+0000","last_became_active":"2023-12-19T13:49:36.410463+0000","last_became_peered":"2023-12-19T13:49:36.410463+0000","last_unstale":"2023-12-19T13:49:37.402615+0000","last_undegraded":"2023-12-19T13:49:37.402615+0000","last_fullsized":"2023-12-19T13:49:37.402615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:48.356106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.414006+0000","last_change":"2023-12-19T13:49:35.930716+0000","last_active":"2023-12-19T13:49:36.414006+0000","last_peered":"2023-12-19T13:49:36.414006+0000","last_clean":"2023-12-19T13:49:36.414006+0000","last_became_active":"2023-12-19T13:49:35.930555+0000","last_became_peered":"2023-12-19T13:49:35.930555+0000","last_unstale":"2023-12-19T13:49:36.414006+0000","last_undegraded":"2023-12-19T13:49:36.414006+0000","last_fullsized":"2023-12-19T13:49:36.414006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:30.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822845+0000","last_change":"2023-12-19T13:49:36.405403+0000","last_active":"2023-12-19T13:49:38.822845+0000","last_peered":"2023-12-19T13:49:38.822845+0000","last_clean":"2023-12-19T13:49:38.822845+0000","last_became_active":"2023-12-19T13:49:36.405205+0000","last_became_peered":"2023-12-19T13:49:36.405205+0000","last_unstale":"2023-12-19T13:49:38.822845+0000","last_undegraded":"2023-12-19T13:49:38.822845+0000","last_fullsized":"2023-12-19T13:49:38.822845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:14.792675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.401330+0000","last_change":"2023-12-19T13:49:35.935699+0000","last_active":"2023-12-19T13:49:36.401330+0000","last_peered":"2023-12-19T13:49:36.401330+0000","last_clean":"2023-12-19T13:49:36.401330+0000","last_became_active":"2023-12-19T13:49:35.935463+0000","last_became_peered":"2023-12-19T13:49:35.935463+0000","last_unstale":"2023-12-19T13:49:36.401330+0000","last_undegraded":"2023-12-19T13:49:36.401330+0000","last_fullsized":"2023-12-19T13:49:36.401330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:17.486114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.398893+0000","last_change":"2023-12-19T13:49:36.406414+0000","last_active":"2023-12-19T13:49:37.398893+0000","last_peered":"2023-12-19T13:49:37.398893+0000","last_clean":"2023-12-19T13:49:37.398893+0000","last_became_active":"2023-12-19T13:49:36.404928+0000","last_became_peered":"2023-12-19T13:49:36.404928+0000","last_unstale":"2023-12-19T13:49:37.398893+0000","last_undegraded":"2023-12-19T13:49:37.398893+0000","last_fullsized":"2023-12-19T13:49:37.398893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:31.791070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.407855+0000","last_change":"2023-12-19T13:49:35.932840+0000","last_active":"2023-12-19T13:49:36.407855+0000","last_peered":"2023-12-19T13:49:36.407855+0000","last_clean":"2023-12-19T13:49:36.407855+0000","last_became_active":"2023-12-19T13:49:35.931197+0000","last_became_peered":"2023-12-19T13:49:35.931197+0000","last_unstale":"2023-12-19T13:49:36.407855+0000","last_undegraded":"2023-12-19T13:49:36.407855+0000","last_fullsized":"2023-12-19T13:49:36.407855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:01.364262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104370+0000","last_change":"2023-12-19T13:49:36.414873+0000","last_active":"2023-12-19T13:49:38.104370+0000","last_peered":"2023-12-19T13:49:38.104370+0000","last_clean":"2023-12-19T13:49:38.104370+0000","last_became_active":"2023-12-19T13:49:36.414573+0000","last_became_peered":"2023-12-19T13:49:36.414573+0000","last_unstale":"2023-12-19T13:49:38.104370+0000","last_undegraded":"2023-12-19T13:49:38.104370+0000","last_fullsized":"2023-12-19T13:49:38.104370+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:04.306905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.403538+0000","last_change":"2023-12-19T13:49:35.934429+0000","last_active":"2023-12-19T13:49:36.403538+0000","last_peered":"2023-12-19T13:49:36.403538+0000","last_clean":"2023-12-19T13:49:36.403538+0000","last_became_active":"2023-12-19T13:49:35.934009+0000","last_became_peered":"2023-12-19T13:49:35.934009+0000","last_unstale":"2023-12-19T13:49:36.403538+0000","last_undegraded":"2023-12-19T13:49:36.403538+0000","last_fullsized":"2023-12-19T13:49:36.403538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:11.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.103588+0000","last_change":"2023-12-19T13:49:36.410145+0000","last_active":"2023-12-19T13:49:38.103588+0000","last_peered":"2023-12-19T13:49:38.103588+0000","last_clean":"2023-12-19T13:49:38.103588+0000","last_became_active":"2023-12-19T13:49:36.409917+0000","last_became_peered":"2023-12-19T13:49:36.409917+0000","last_unstale":"2023-12-19T13:49:38.103588+0000","last_undegraded":"2023-12-19T13:49:38.103588+0000","last_fullsized":"2023-12-19T13:49:38.103588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.389289+0000","last_change":"2023-12-19T13:49:35.934554+0000","last_active":"2023-12-19T13:49:36.389289+0000","last_peered":"2023-12-19T13:49:36.389289+0000","last_clean":"2023-12-19T13:49:36.389289+0000","last_became_active":"2023-12-19T13:49:35.934390+0000","last_became_peered":"2023-12-19T13:49:35.934390+0000","last_unstale":"2023-12-19T13:49:36.389289+0000","last_undegraded":"2023-12-19T13:49:36.389289+0000","last_fullsized":"2023-12-19T13:49:36.389289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.824229+0000","last_change":"2023-12-19T13:49:36.406483+0000","last_active":"2023-12-19T13:49:38.824229+0000","last_peered":"2023-12-19T13:49:38.824229+0000","last_clean":"2023-12-19T13:49:38.824229+0000","last_became_active":"2023-12-19T13:49:36.402037+0000","last_became_peered":"2023-12-19T13:49:36.402037+0000","last_unstale":"2023-12-19T13:49:38.824229+0000","last_undegraded":"2023-12-19T13:49:38.824229+0000","last_fullsized":"2023-12-19T13:49:38.824229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:06:12.144539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"72'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.417383+0000","last_change":"2023-12-19T13:49:35.933239+0000","last_active":"2023-12-19T13:49:36.417383+0000","last_peered":"2023-12-19T13:49:36.417383+0000","last_clean":"2023-12-19T13:49:36.417383+0000","last_became_active":"2023-12-19T13:49:35.932786+0000","last_became_peered":"2023-12-19T13:49:35.932786+0000","last_unstale":"2023-12-19T13:49:36.417383+0000","last_undegraded":"2023-12-19T13:49:36.417383+0000","last_fullsized":"2023-12-19T13:49:36.417383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:30.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.822793+0000","last_change":"2023-12-19T13:49:36.400530+0000","last_active":"2023-12-19T13:49:38.822793+0000","last_peered":"2023-12-19T13:49:38.822793+0000","last_clean":"2023-12-19T13:49:38.822793+0000","last_became_active":"2023-12-19T13:49:36.400046+0000","last_became_peered":"2023-12-19T13:49:36.400046+0000","last_unstale":"2023-12-19T13:49:38.822793+0000","last_undegraded":"2023-12-19T13:49:38.822793+0000","last_fullsized":"2023-12-19T13:49:38.822793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:56.941388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.395202+0000","last_change":"2023-12-19T13:49:35.938422+0000","last_active":"2023-12-19T13:49:36.395202+0000","last_peered":"2023-12-19T13:49:36.395202+0000","last_clean":"2023-12-19T13:49:36.395202+0000","last_became_active":"2023-12-19T13:49:35.937799+0000","last_became_peered":"2023-12-19T13:49:35.937799+0000","last_unstale":"2023-12-19T13:49:36.395202+0000","last_undegraded":"2023-12-19T13:49:36.395202+0000","last_fullsized":"2023-12-19T13:49:36.395202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:17.202412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.402283+0000","last_change":"2023-12-19T13:49:36.409624+0000","last_active":"2023-12-19T13:49:37.402283+0000","last_peered":"2023-12-19T13:49:37.402283+0000","last_clean":"2023-12-19T13:49:37.402283+0000","last_became_active":"2023-12-19T13:49:36.408966+0000","last_became_peered":"2023-12-19T13:49:36.408966+0000","last_unstale":"2023-12-19T13:49:37.402283+0000","last_undegraded":"2023-12-19T13:49:37.402283+0000","last_fullsized":"2023-12-19T13:49:37.402283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:04.169818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390316+0000","last_change":"2023-12-19T13:49:35.924316+0000","last_active":"2023-12-19T13:49:36.390316+0000","last_peered":"2023-12-19T13:49:36.390316+0000","last_clean":"2023-12-19T13:49:36.390316+0000","last_became_active":"2023-12-19T13:49:35.924099+0000","last_became_peered":"2023-12-19T13:49:35.924099+0000","last_unstale":"2023-12-19T13:49:36.390316+0000","last_undegraded":"2023-12-19T13:49:36.390316+0000","last_fullsized":"2023-12-19T13:49:36.390316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:07.758117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104404+0000","last_change":"2023-12-19T13:49:36.411570+0000","last_active":"2023-12-19T13:49:38.104404+0000","last_peered":"2023-12-19T13:49:38.104404+0000","last_clean":"2023-12-19T13:49:38.104404+0000","last_became_active":"2023-12-19T13:49:36.408618+0000","last_became_peered":"2023-12-19T13:49:36.408618+0000","last_unstale":"2023-12-19T13:49:38.104404+0000","last_undegraded":"2023-12-19T13:49:38.104404+0000","last_fullsized":"2023-12-19T13:49:38.104404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:44:23.275608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.393487+0000","last_change":"2023-12-19T13:49:35.924508+0000","last_active":"2023-12-19T13:49:36.393487+0000","last_peered":"2023-12-19T13:49:36.393487+0000","last_clean":"2023-12-19T13:49:36.393487+0000","last_became_active":"2023-12-19T13:49:35.923964+0000","last_became_peered":"2023-12-19T13:49:35.923964+0000","last_unstale":"2023-12-19T13:49:36.393487+0000","last_undegraded":"2023-12-19T13:49:36.393487+0000","last_fullsized":"2023-12-19T13:49:36.393487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.399904+0000","last_change":"2023-12-19T13:49:36.402181+0000","last_active":"2023-12-19T13:49:37.399904+0000","last_peered":"2023-12-19T13:49:37.399904+0000","last_clean":"2023-12-19T13:49:37.399904+0000","last_became_active":"2023-12-19T13:49:36.401814+0000","last_became_peered":"2023-12-19T13:49:36.401814+0000","last_unstale":"2023-12-19T13:49:37.399904+0000","last_undegraded":"2023-12-19T13:49:37.399904+0000","last_fullsized":"2023-12-19T13:49:37.399904+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:12.262923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.400691+0000","last_change":"2023-12-19T13:49:35.936948+0000","last_active":"2023-12-19T13:49:36.400691+0000","last_peered":"2023-12-19T13:49:36.400691+0000","last_clean":"2023-12-19T13:49:36.400691+0000","last_became_active":"2023-12-19T13:49:35.936707+0000","last_became_peered":"2023-12-19T13:49:35.936707+0000","last_unstale":"2023-12-19T13:49:36.400691+0000","last_undegraded":"2023-12-19T13:49:36.400691+0000","last_fullsized":"2023-12-19T13:49:36.400691+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:41.242102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.823097+0000","last_change":"2023-12-19T13:49:36.410989+0000","last_active":"2023-12-19T13:49:38.823097+0000","last_peered":"2023-12-19T13:49:38.823097+0000","last_clean":"2023-12-19T13:49:38.823097+0000","last_became_active":"2023-12-19T13:49:36.410740+0000","last_became_peered":"2023-12-19T13:49:36.410740+0000","last_unstale":"2023-12-19T13:49:38.823097+0000","last_undegraded":"2023-12-19T13:49:38.823097+0000","last_fullsized":"2023-12-19T13:49:38.823097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:46.388583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.391631+0000","last_change":"2023-12-19T13:49:35.934965+0000","last_active":"2023-12-19T13:49:36.391631+0000","last_peered":"2023-12-19T13:49:36.391631+0000","last_clean":"2023-12-19T13:49:36.391631+0000","last_became_active":"2023-12-19T13:49:35.934823+0000","last_became_peered":"2023-12-19T13:49:35.934823+0000","last_unstale":"2023-12-19T13:49:36.391631+0000","last_undegraded":"2023-12-19T13:49:36.391631+0000","last_fullsized":"2023-12-19T13:49:36.391631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:48:54.219447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104584+0000","last_change":"2023-12-19T13:49:36.404350+0000","last_active":"2023-12-19T13:49:38.104584+0000","last_peered":"2023-12-19T13:49:38.104584+0000","last_clean":"2023-12-19T13:49:38.104584+0000","last_became_active":"2023-12-19T13:49:36.404132+0000","last_became_peered":"2023-12-19T13:49:36.404132+0000","last_unstale":"2023-12-19T13:49:38.104584+0000","last_undegraded":"2023-12-19T13:49:38.104584+0000","last_fullsized":"2023-12-19T13:49:38.104584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:12.293256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.395325+0000","last_change":"2023-12-19T13:49:35.936459+0000","last_active":"2023-12-19T13:49:36.395325+0000","last_peered":"2023-12-19T13:49:36.395325+0000","last_clean":"2023-12-19T13:49:36.395325+0000","last_became_active":"2023-12-19T13:49:35.936185+0000","last_became_peered":"2023-12-19T13:49:35.936185+0000","last_unstale":"2023-12-19T13:49:36.395325+0000","last_undegraded":"2023-12-19T13:49:36.395325+0000","last_fullsized":"2023-12-19T13:49:36.395325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:51.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:37.401547+0000","last_change":"2023-12-19T13:49:36.405148+0000","last_active":"2023-12-19T13:49:37.401547+0000","last_peered":"2023-12-19T13:49:37.401547+0000","last_clean":"2023-12-19T13:49:37.401547+0000","last_became_active":"2023-12-19T13:49:36.404871+0000","last_became_peered":"2023-12-19T13:49:36.404871+0000","last_unstale":"2023-12-19T13:49:37.401547+0000","last_undegraded":"2023-12-19T13:49:37.401547+0000","last_fullsized":"2023-12-19T13:49:37.401547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:31.791070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.403627+0000","last_change":"2023-12-19T13:49:35.931094+0000","last_active":"2023-12-19T13:49:36.403627+0000","last_peered":"2023-12-19T13:49:36.403627+0000","last_clean":"2023-12-19T13:49:36.403627+0000","last_became_active":"2023-12-19T13:49:35.930839+0000","last_became_peered":"2023-12-19T13:49:35.930839+0000","last_unstale":"2023-12-19T13:49:36.403627+0000","last_undegraded":"2023-12-19T13:49:36.403627+0000","last_fullsized":"2023-12-19T13:49:36.403627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:43:25.064014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T13:49:38.104269+0000","last_change":"2023-12-19T13:49:36.414136+0000","last_active":"2023-12-19T13:49:38.104269+0000","last_peered":"2023-12-19T13:49:38.104269+0000","last_clean":"2023-12-19T13:49:38.104269+0000","last_became_active":"2023-12-19T13:49:36.413790+0000","last_became_peered":"2023-12-19T13:49:36.413790+0000","last_unstale":"2023-12-19T13:49:38.104269+0000","last_undegraded":"2023-12-19T13:49:38.104269+0000","last_fullsized":"2023-12-19T13:49:38.104269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:35.892418+0000","last_clean_scrub_stamp":"2023-12-19T13:49:35.892418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:00.371617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.398013+0000","last_change":"2023-12-19T13:49:35.926234+0000","last_active":"2023-12-19T13:49:36.398013+0000","last_peered":"2023-12-19T13:49:36.398013+0000","last_clean":"2023-12-19T13:49:36.398013+0000","last_became_active":"2023-12-19T13:49:35.926011+0000","last_became_peered":"2023-12-19T13:49:35.926011+0000","last_unstale":"2023-12-19T13:49:36.398013+0000","last_undegraded":"2023-12-19T13:49:36.398013+0000","last_fullsized":"2023-12-19T13:49:36.398013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:49:34.878690+0000","last_clean_scrub_stamp":"2023-12-19T13:49:34.878690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:48:33.175651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T13:49:36.390447+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:49:36.390447+0000","last_peered":"2023-12-19T13:49:36.390447+0000","last_clean":"2023-12-19T13:49:36.390447+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:49:36.390447+0000","last_undegraded":"2023-12-19T13:49:36.390447+0000","last_fullsized":"2023-12-19T13:49:36.390447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.0009999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.375,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.02},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0049999999999999,"15min":0.98299999999999998},"min":{"1min":0.64000000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3380000000000001,"5min":2.008,"15min":2.008},"last":1.232}]},{"osd":1,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.079,"15min":1.069},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4079999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4610000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1399999999999999,"15min":1.133},"min":{"1min":0.81399999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.71,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.1699999999999999,"15min":1.147},"min":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4299999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.597,"5min":1.931,"15min":1.931},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.252,"15min":1.23},"min":{"1min":0.79600000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7470000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.371}]},{"osd":4,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.282,"15min":1.286},"min":{"1min":0.84499999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6519999999999999,"5min":2.181,"15min":2.181},"last":1.609},{"interface":"front","average":{"1min":1.262,"5min":1.3859999999999999,"15min":1.3979999999999999},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.673,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.2889999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.24,"15min":1.222},"min":{"1min":0.871,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5429999999999999,"5min":1.956,"15min":1.956},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.4339999999999999,"15min":1.429},"min":{"1min":1.038,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.702}]},{"osd":6,"last update":"Tue Dec 19 13:49:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.292,"15min":1.262},"min":{"1min":0.90300000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6850000000000001,"5min":2.024,"15min":2.024},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5049999999999999,"15min":1.4870000000000001},"min":{"1min":1.2050000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.796,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.8080000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.0289999999999999},"min":{"1min":0.629,"5min":0.628,"15min":0.628},"max":{"1min":1.502,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.089,"15min":1.121},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3400000000000001,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.628}]},{"osd":1,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.05,"15min":1.03},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.962,"15min":1.962},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.137,"5min":1.0620000000000001,"15min":1.032},"min":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5860000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.2210000000000001},"min":{"1min":0.82499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6970000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.115},{"interface":"front","average":{"1min":1.254,"5min":1.173,"15min":1.151},"min":{"1min":0.96299999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6140000000000001,"5min":1.786,"15min":1.786},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3169999999999999,"15min":1.3520000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.478,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.266,"15min":1.272},"min":{"1min":1.024,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6299999999999999,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.97699999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.226,"15min":1.204},"min":{"1min":0.92600000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.252},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.3120000000000001,"15min":1.292},"min":{"1min":1.0920000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.0580000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.268,"15min":1.246},"min":{"1min":1.135,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6120000000000001,"5min":1.827,"15min":1.827},"last":1.161},{"interface":"front","average":{"1min":1.538,"5min":1.399,"15min":1.371},"min":{"1min":1.2849999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.202}]},{"osd":7,"last update":"Tue Dec 19 13:49:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.4159999999999999},"min":{"1min":1.0840000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.377,"15min":1.355},"min":{"1min":1.2430000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.766,"15min":1.766},"last":1.0800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199028060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.595,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0509999999999999,"15min":1.0609999999999999},"min":{"1min":0.68700000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.538}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.423,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.446},{"interface":"front","average":{"1min":1.125,"5min":1.024,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3939999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.202,"15min":1.246},"min":{"1min":0.83399999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3280000000000001,"5min":2.827,"15min":2.827},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.25,"15min":1.2689999999999999},"min":{"1min":0.93200000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5209999999999999,"5min":2.863,"15min":2.863},"last":1.21}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2090000000000001,"15min":1.204},"min":{"1min":1.0429999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.623,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.244,"15min":1.242},"min":{"1min":0.87,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5940000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.1060000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.153,"15min":1.137},"min":{"1min":0.90400000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5169999999999999,"5min":1.982,"15min":1.982},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.278,"15min":1.2769999999999999},"min":{"1min":0.88,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.474,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.639}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.343,"15min":1.3169999999999999},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.623},"max":{"1min":1.579,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.306},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.357,"15min":1.369},"min":{"1min":1.0609999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.6479999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.8759999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3959999999999999,"15min":1.401},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7090000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.427,"15min":1.403},"min":{"1min":1.2470000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6910000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.587}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199617846,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.657,"15min":1.657},"last":1.113},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1259999999999999},"min":{"1min":0.69499999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.542,"5min":2.016,"15min":2.016},"last":0.85399999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.073,"15min":1.069},"min":{"1min":0.76600000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.1000000000000001,"15min":1.1140000000000001},"min":{"1min":0.754,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4039999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0580000000000001,"15min":1.0169999999999999},"min":{"1min":0.76500000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1120000000000001,"15min":1.105},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.405,"5min":1.575,"15min":1.575},"last":1.143}]},{"osd":3,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.206,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.952,"15min":1.952},"last":1.288},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.258,"15min":1.274},"min":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.482,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.25}]},{"osd":5,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.216,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.165,"15min":2.165},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.325,"15min":1.343},"min":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6970000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.405}]},{"osd":6,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.85099999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.595,"5min":2.335,"15min":2.335},"last":1.5640000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4490000000000001,"15min":1.46},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.782,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.5,"15min":1.522},"min":{"1min":0.89300000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.921,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.6499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194939,"statfs":{"total":200000000,"available":199618372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.89200000000000002,"15min":0.95599999999999996},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2290000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.94499999999999995,"15min":0.97799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.4590000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":1.032},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.006},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96399999999999997,"15min":0.99399999999999999},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2589999999999999,"5min":2.387,"15min":2.387},"last":0.87}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.097,"15min":1.143},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4690000000000001,"5min":2.657,"15min":2.657},"last":0.78900000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.236,"15min":1.272},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.51,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.353},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.21,"15min":1.23},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6419999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.151}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.278,"15min":1.3140000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.7030000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.256,"15min":1.276},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.671,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.21}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.637,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.321,"15min":1.349},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":2.698,"15min":2.698},"last":1.389}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.337,"15min":1.3759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.76,"5min":3.609,"15min":3.609},"last":1.47},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.02,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.4370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":2.258,"15min":2.258},"last":1.022},{"interface":"front","average":{"1min":1.468,"5min":0.91700000000000004,"15min":0.81699999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":11.85,"5min":11.85,"15min":11.85},"last":1.3560000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.363,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.625,"5min":1.018,"15min":0.92500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":11.788,"5min":11.788,"15min":11.788},"last":1.2150000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.397,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.089},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.0569999999999999,"15min":1.0269999999999999},"min":{"1min":0.501,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.8079999999999998,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":1.2490000000000001,"15min":1.1559999999999999},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6679999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.27}]},{"osd":5,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.321,"15min":1.2190000000000001},"min":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":11.888,"5min":11.888,"15min":11.888},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.302,"15min":1.306},"min":{"1min":1.014,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9850000000000001,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3140000000000001,"15min":1.3180000000000001},"min":{"1min":0.88300000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0640000000000001,"5min":2.964,"15min":2.964},"last":1},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2629999999999999,"15min":1.2490000000000001},"min":{"1min":0.85399999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.944,"5min":2.286,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:49:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0369999999999999,"5min":2.351,"15min":2.351},"last":1.1779999999999999},{"interface":"front","average":{"1min":2.0110000000000001,"5min":1.375,"15min":1.282},"min":{"1min":0.82099999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":11.962999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.4570000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194362,"statfs":{"total":200000000,"available":199027512,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.82599999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.26,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.351,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.044,"15min":1.1000000000000001},"min":{"1min":0.51600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":1.012},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.169,"15min":1.1930000000000001},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7829999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.0469999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.117,"15min":1.2030000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3009999999999999,"5min":7.157,"15min":7.157},"last":1.079}]},{"osd":4,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.236},"min":{"1min":0.83299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.575,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.282,"15min":1.304},"min":{"1min":0.85499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.738,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.94599999999999995}]},{"osd":5,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.294,"15min":1.337},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1669999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.135},{"interface":"front","average":{"1min":1.994,"5min":1.468,"15min":1.3979999999999999},"min":{"1min":0.81200000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":15.576000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.335,"15min":1.351},"min":{"1min":0.75800000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8260000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.254},{"interface":"front","average":{"1min":1.278,"5min":1.379,"15min":1.4339999999999999},"min":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.226,"5min":3.786,"15min":3.786},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.409,"15min":1.458},"min":{"1min":0.84799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.9039999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.355},{"interface":"front","average":{"1min":1.258,"5min":1.421,"15min":1.476},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6830000000000001,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.2290000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4430000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.53600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":14.010999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.7919999999999998,"5min":1.238,"15min":0.99099999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":33.799999999999997,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":3.302,"5min":1.3759999999999999,"15min":1.0660000000000001},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":41.758000000000003,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.70599999999999996}]},{"osd":3,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.93500000000000005,"15min":1.0229999999999999},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4330000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.048,"15min":1.0960000000000001},"min":{"1min":0.46600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3759999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.111}]},{"osd":4,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5149999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.994,"5min":1.323,"15min":1.2030000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":1.5609999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.3200000000000001,"15min":1.2110000000000001},"min":{"1min":0.83699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":14.337999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.8999999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.282,"15min":1.248},"min":{"1min":0.72999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":5.4669999999999996,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.464},{"interface":"front","average":{"1min":2.23,"5min":1.4399999999999999,"15min":1.3120000000000001},"min":{"1min":0.94799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":17.161000000000001,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.488}]},{"osd":7,"last update":"Tue Dec 19 13:49:28 2023","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.429,"15min":1.323},"min":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.4239999999999999,"15min":1.411},"min":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":9.7080000000000002,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.093}]}]}],"pool_statfs":[]}} 2023-12-19T13:49:46.347 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:49:46.348 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:49:46.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.608+0000 7f3ec2626640 1 Processor -- start 2023-12-19T13:49:46.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.608+0000 7f3ec2626640 1 -- start start 2023-12-19T13:49:46.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec2626640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0c9e40 0x7f3ebc06b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec2626640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc06d2d0 0x7f3ebc06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec2626640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc06ce40 con 0x7f3ebc161a90 2023-12-19T13:49:46.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec2626640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc06c230 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec2626640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc06c510 con 0x7f3ebc0c9e40 2023-12-19T13:49:46.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec0bc3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc06d2d0 0x7f3ebc06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec0bc3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc06d2d0 0x7f3ebc06bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58204/0 (socket says 172.21.15.113:58204) 2023-12-19T13:49:46.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.610+0000 7f3ec0bc3640 1 -- 172.21.15.113:0/213943338 learned_addr learned my addr 172.21.15.113:0/213943338 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:46.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.611+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/213943338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0c9e40 0x7f3ebc06b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.611+0000 7f3ec0bc3640 1 -- 172.21.15.113:0/213943338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0c9e40 msgr2=0x7f3ebc06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:46.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.611+0000 7f3ec0bc3640 1 --2- 172.21.15.113:0/213943338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0c9e40 0x7f3ebc06b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.611+0000 7f3ec0bc3640 1 -- 172.21.15.113:0/213943338 >> v1:172.21.15.151:6789/0 conn(0x7f3ebc161a90 legacy=0x7f3ebc0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:46.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.611+0000 7f3ec0bc3640 1 -- 172.21.15.113:0/213943338 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc06c7f0 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.612+0000 7f3ec0bc3640 1 --2- 172.21.15.113:0/213943338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc06bb40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009e50 tx=0x7f3eb402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3e26ff41ec641 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:46.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.612+0000 7f3ebaffd640 1 -- 172.21.15.113:0/213943338 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb402ca70 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.612+0000 7f3ebaffd640 1 -- 172.21.15.113:0/213943338 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb402cbd0 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.612+0000 7f3ebaffd640 1 -- 172.21.15.113:0/213943338 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40343f0 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 -- 172.21.15.113:0/213943338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 msgr2=0x7f3ebc06bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 --2- 172.21.15.113:0/213943338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc06bb40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009e50 tx=0x7f3eb402bed0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 -- 172.21.15.113:0/213943338 shutdown_connections 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 --2- 172.21.15.113:0/213943338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc06bb40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 --2- 172.21.15.113:0/213943338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0c9e40 0x7f3ebc06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 -- 172.21.15.113:0/213943338 >> 172.21.15.113:0/213943338 conn(0x7f3ebc0659d0 msgr2=0x7f3ebc065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 -- 172.21.15.113:0/213943338 shutdown_connections 2023-12-19T13:49:46.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.613+0000 7f3ec2626640 1 -- 172.21.15.113:0/213943338 wait complete. 2023-12-19T13:49:46.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.615+0000 7f3ec2626640 1 Processor -- start 2023-12-19T13:49:46.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.616+0000 7f3ec2626640 1 -- start start 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ec2626640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc163190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ec2626640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc0c9e40 0x7f3ebc162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ec2626640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc161a90 0x7f3ebc1648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ec2626640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc162ff0 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ec2626640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc163850 con 0x7f3ebc0c9e40 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ec2626640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc163b30 con 0x7f3ebc161a90 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc163190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58212/0 (socket says 172.21.15.113:58212) 2023-12-19T13:49:46.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 -- 172.21.15.113:0/3236023926 learned_addr learned my addr 172.21.15.113:0/3236023926 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:46.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 -- 172.21.15.113:0/3236023926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc161a90 msgr2=0x7f3ebc1648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc161a90 0x7f3ebc1648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 -- 172.21.15.113:0/3236023926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc0c9e40 msgr2=0x7f3ebc162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc0c9e40 0x7f3ebc162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.617+0000 7f3ebbfff640 1 -- 172.21.15.113:0/3236023926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4009b30 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.618+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc163190 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b3f0 tx=0x7f3eac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:46.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.618+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/3236023926 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac011830 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.618+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/3236023926 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac011990 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.618+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/3236023926 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac011d40 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.618+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc163e10 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.618+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc1643d0 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.620+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc061910 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.620+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/3236023926 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3eac01a400 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.621+0000 7f3eb8ff9640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:46.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.622+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/3236023926 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3eac0886e0 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.622+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:46.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.622+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc15e550 tx=0x7f3eb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:46.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.626+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/3236023926 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3eac053d60 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.895+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3ebc161140 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.901+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/3236023926 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3eac057380 con 0x7f3ebc06d2d0 2023-12-19T13:49:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:49:46.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 msgr2=0x7f3ea806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc15e550 tx=0x7f3eb0008040 comp rx=0 tx=0).stop 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 msgr2=0x7f3ebc163190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc163190 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b3f0 tx=0x7f3eac00b8b0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 shutdown_connections 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc161a90 0x7f3ebc1648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc0c9e40 0x7f3ebc162ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 --2- 172.21.15.113:0/3236023926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc06d2d0 0x7f3ebc163190 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 >> 172.21.15.113:0/3236023926 conn(0x7f3ebc0659d0 msgr2=0x7f3ebc1601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 shutdown_connections 2023-12-19T13:49:46.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:46.905+0000 7f3ec2626640 1 -- 172.21.15.113:0/3236023926 wait complete. 2023-12-19T13:49:46.925 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:47.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.132+0000 7fa01f8fb640 1 Processor -- start 2023-12-19T13:49:47.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.133+0000 7fa01f8fb640 1 -- start start 2023-12-19T13:49:47.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.134+0000 7fa01f8fb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa018070750 0x7fa0180d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:47.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.134+0000 7fa01f8fb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa018143940 con 0x7fa018142bf0 2023-12-19T13:49:47.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.134+0000 7fa01f8fb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0180cfd60 con 0x7fa0180d2450 2023-12-19T13:49:47.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.134+0000 7fa01f8fb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa018143750 con 0x7fa018070750 2023-12-19T13:49:47.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.134+0000 7fa01d697640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa018070750 0x7fa0180d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:47.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.134+0000 7fa01de98640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa018142bf0 0x7fa018143040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59262/0 (socket says 172.21.15.113:59262) 2023-12-19T13:49:47.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.134+0000 7fa01de98640 1 -- 172.21.15.113:0/899364385 learned_addr learned my addr 172.21.15.113:0/899364385 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:47.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.135+0000 7fa00ffff640 1 -- 172.21.15.113:0/899364385 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162969418 0 0) 0x7fa018143940 con 0x7fa018142bf0 2023-12-19T13:49:47.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.135+0000 7fa00ffff640 1 -- 172.21.15.113:0/899364385 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa004003520 con 0x7fa018142bf0 2023-12-19T13:49:47.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.135+0000 7fa01d697640 1 -- 172.21.15.113:0/899364385 >> v1:172.21.15.151:6789/0 conn(0x7fa0180d2450 legacy=0x7fa0180d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:47.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.135+0000 7fa01d697640 1 -- 172.21.15.113:0/899364385 >> v1:172.21.15.113:6789/0 conn(0x7fa018142bf0 legacy=0x7fa018143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:47.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.135+0000 7fa01d697640 1 -- 172.21.15.113:0/899364385 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180d0040 con 0x7fa018070750 2023-12-19T13:49:47.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.136+0000 7fa01d697640 1 --2- 172.21.15.113:0/899364385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa018070750 0x7fa0180d0b20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa018143b30 tx=0x7fa01402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc511105eb4cb98 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:47.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.136+0000 7fa00ffff640 1 -- 172.21.15.113:0/899364385 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014031830 con 0x7fa018070750 2023-12-19T13:49:47.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.136+0000 7fa00ffff640 1 -- 172.21.15.113:0/899364385 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014031990 con 0x7fa018070750 2023-12-19T13:49:47.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.136+0000 7fa00ffff640 1 -- 172.21.15.113:0/899364385 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014031d20 con 0x7fa018070750 2023-12-19T13:49:47.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.137+0000 7fa01f8fb640 1 -- 172.21.15.113:0/899364385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa018070750 msgr2=0x7fa0180d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:47.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.137+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/899364385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa018070750 0x7fa0180d0b20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa018143b30 tx=0x7fa01402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.137+0000 7fa01f8fb640 1 -- 172.21.15.113:0/899364385 shutdown_connections 2023-12-19T13:49:47.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.137+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/899364385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa018070750 0x7fa0180d0b20 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.137+0000 7fa01f8fb640 1 -- 172.21.15.113:0/899364385 >> 172.21.15.113:0/899364385 conn(0x7fa0180b2540 msgr2=0x7fa0180b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:47.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.137+0000 7fa01f8fb640 1 -- 172.21.15.113:0/899364385 shutdown_connections 2023-12-19T13:49:47.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.137+0000 7fa01f8fb640 1 -- 172.21.15.113:0/899364385 wait complete. 2023-12-19T13:49:47.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.139+0000 7fa01f8fb640 1 Processor -- start 2023-12-19T13:49:47.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.139+0000 7fa01f8fb640 1 -- start start 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01f8fb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa018070750 0x7fa0181f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01f8fb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0180d2450 0x7fa0181f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01f8fb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa018142bf0 0x7fa018157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01f8fb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018155e80 con 0x7fa0180d2450 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01f8fb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018155270 con 0x7fa018070750 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01f8fb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa018155550 con 0x7fa018142bf0 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01ce96640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0180d2450 0x7fa0181f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01ce96640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0180d2450 0x7fa0181f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58232/0 (socket says 172.21.15.113:58232) 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.140+0000 7fa01ce96640 1 -- 172.21.15.113:0/832047406 learned_addr learned my addr 172.21.15.113:0/832047406 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:47.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01d697640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa018070750 0x7fa0181f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01ce96640 1 -- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa018142bf0 msgr2=0x7fa018157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01de98640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa018142bf0 0x7fa018157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01ce96640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa018142bf0 0x7fa018157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01ce96640 1 -- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa018070750 msgr2=0x7fa0181f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01ce96640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa018070750 0x7fa0181f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01ce96640 1 -- 172.21.15.113:0/832047406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009400 con 0x7fa0180d2450 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01d697640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa018070750 0x7fa0181f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01ce96640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0180d2450 0x7fa0181f6310 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c430 tx=0x7fa00800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa00dffb640 1 -- 172.21.15.113:0/832047406 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011790 con 0x7fa0180d2450 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa00dffb640 1 -- 172.21.15.113:0/832047406 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080118f0 con 0x7fa0180d2450 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa018155830 con 0x7fa0180d2450 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.141+0000 7fa00dffb640 1 -- 172.21.15.113:0/832047406 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011ce0 con 0x7fa0180d2450 2023-12-19T13:49:47.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.142+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa018158470 con 0x7fa0180d2450 2023-12-19T13:49:47.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.143+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa018156030 con 0x7fa0180d2450 2023-12-19T13:49:47.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.144+0000 7fa00dffb640 1 -- 172.21.15.113:0/832047406 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa00801c460 con 0x7fa0180d2450 2023-12-19T13:49:47.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.144+0000 7fa00dffb640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ffc06a460 0x7f9ffc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:47.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.145+0000 7fa00dffb640 1 -- 172.21.15.113:0/832047406 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa008088850 con 0x7fa0180d2450 2023-12-19T13:49:47.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.145+0000 7fa01d697640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ffc06a460 0x7f9ffc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:47.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.145+0000 7fa01d697640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ffc06a460 0x7f9ffc06c920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa014036000 tx=0x7fa014008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.149+0000 7fa00dffb640 1 -- 172.21.15.113:0/832047406 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa018156030 con 0x7fa0180d2450 2023-12-19T13:49:47.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.377+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa018061910 con 0x7fa0180d2450 2023-12-19T13:49:47.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.378+0000 7fa00dffb640 1 -- 172.21.15.113:0/832047406 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4660 (secure 0 0 0) 0x7fa008053e30 con 0x7fa0180d2450 2023-12-19T13:49:47.379 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:47.379 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:49:36.382415+0000","modified":"2023-12-19T13:49:39.476500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6066":{"gid":6066,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/4085417322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4085417322},{"type":"v1","addr":"172.21.15.151:6835","nonce":4085417322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T13:49:47.379 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 33 2023-12-19T13:49:47.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.380+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ffc06a460 msgr2=0x7f9ffc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:47.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.380+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ffc06a460 0x7f9ffc06c920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa014036000 tx=0x7fa014008030 comp rx=0 tx=0).stop 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.380+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0180d2450 msgr2=0x7fa0181f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.380+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0180d2450 0x7fa0181f6310 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c430 tx=0x7fa00800c8f0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 shutdown_connections 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ffc06a460 0x7f9ffc06c920 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa018142bf0 0x7fa018157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0180d2450 0x7fa0181f6310 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 --2- 172.21.15.113:0/832047406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa018070750 0x7fa0181f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 >> 172.21.15.113:0/832047406 conn(0x7fa0180b2540 msgr2=0x7fa018143040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 shutdown_connections 2023-12-19T13:49:47.382 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:47.381+0000 7fa01f8fb640 1 -- 172.21.15.113:0/832047406 wait complete. 2023-12-19T13:49:47.777 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:47.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:47.802 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:49:36.382415+0000', 'modified': '2023-12-19T13:49:39.476500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6066}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6066': {'gid': 6066, 'name': 'b', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/4085417322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6833', 'nonce': 4085417322}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 4085417322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:49:47.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:49:47.803 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T13:49:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.037+0000 7f3772430640 1 Processor -- start 2023-12-19T13:49:48.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.037+0000 7f3772430640 1 -- start start 2023-12-19T13:49:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.038+0000 7f3772430640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f376c146e10 0x7f376c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.038+0000 7f3772430640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0cd840 con 0x7f376c0ce110 2023-12-19T13:49:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.038+0000 7f3772430640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0b6e90 con 0x7f376c0d2b00 2023-12-19T13:49:48.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.038+0000 7f3772430640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0d2430 con 0x7f376c146e10 2023-12-19T13:49:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.039+0000 7f376bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f376c146e10 0x7f376c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.039+0000 7f37709cd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f376c0ce110 0x7f376c0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59336/0 (socket says 172.21.15.113:59336) 2023-12-19T13:49:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.039+0000 7f37709cd640 1 -- 172.21.15.113:0/3168779938 learned_addr learned my addr 172.21.15.113:0/3168779938 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.039+0000 7f376bfff640 1 -- 172.21.15.113:0/3168779938 >> v1:172.21.15.151:6789/0 conn(0x7f376c0d2b00 legacy=0x7f376c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.039+0000 7f376bfff640 1 -- 172.21.15.113:0/3168779938 >> v1:172.21.15.113:6789/0 conn(0x7f376c0ce110 legacy=0x7f376c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.039+0000 7f376bfff640 1 -- 172.21.15.113:0/3168779938 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0d2620 con 0x7f376c146e10 2023-12-19T13:49:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.040+0000 7f376bfff640 1 --2- 172.21.15.113:0/3168779938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c146e10 0x7f376c0d1ef0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3764009d90 tx=0x7f376402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1e6bd751fd3089 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.041+0000 7f376affd640 1 -- 172.21.15.113:0/3168779938 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376402cbd0 con 0x7f376c146e10 2023-12-19T13:49:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.041+0000 7f376affd640 1 -- 172.21.15.113:0/3168779938 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376402cd30 con 0x7f376c146e10 2023-12-19T13:49:48.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.041+0000 7f376affd640 1 -- 172.21.15.113:0/3168779938 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376402cea0 con 0x7f376c146e10 2023-12-19T13:49:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.041+0000 7f3772430640 1 -- 172.21.15.113:0/3168779938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c146e10 msgr2=0x7f376c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.041+0000 7f3772430640 1 --2- 172.21.15.113:0/3168779938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c146e10 0x7f376c0d1ef0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3764009d90 tx=0x7f376402be20 comp rx=0 tx=0).stop 2023-12-19T13:49:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.041+0000 7f3772430640 1 -- 172.21.15.113:0/3168779938 shutdown_connections 2023-12-19T13:49:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.041+0000 7f3772430640 1 --2- 172.21.15.113:0/3168779938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c146e10 0x7f376c0d1ef0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.042+0000 7f3772430640 1 -- 172.21.15.113:0/3168779938 >> 172.21.15.113:0/3168779938 conn(0x7f376c0b29c0 msgr2=0x7f376c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.042+0000 7f3772430640 1 -- 172.21.15.113:0/3168779938 shutdown_connections 2023-12-19T13:49:48.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.042+0000 7f3772430640 1 -- 172.21.15.113:0/3168779938 wait complete. 2023-12-19T13:49:48.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.043+0000 7f3772430640 1 Processor -- start 2023-12-19T13:49:48.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.044+0000 7f3772430640 1 -- start start 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f3772430640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c0ce110 0x7f376c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f3772430640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f376c0d2b00 0x7f376c0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f3772430640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f376c146e10 0x7f376c0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f3772430640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0c9950 con 0x7f376c0ce110 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f3772430640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0c9d70 con 0x7f376c146e10 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f3772430640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0c8cd0 con 0x7f376c0d2b00 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c0ce110 0x7f376c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c0ce110 0x7f376c15bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39928/0 (socket says 172.21.15.113:39928) 2023-12-19T13:49:48.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 -- 172.21.15.113:0/1564248918 learned_addr learned my addr 172.21.15.113:0/1564248918 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 -- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f376c0d2b00 msgr2=0x7f376c0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f376c0d2b00 0x7f376c0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f37709cd640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f376c146e10 0x7f376c0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f376c0d2b00 0x7f376c0c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 -- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f376c146e10 msgr2=0x7f376c0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f376c146e10 0x7f376c0cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.045+0000 7f376bfff640 1 -- 172.21.15.113:0/1564248918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009a70 con 0x7f376c0ce110 2023-12-19T13:49:48.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.046+0000 7f376bfff640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c0ce110 0x7f376c15bad0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3764037040 tx=0x7f3764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.046+0000 7f3768ff9640 1 -- 172.21.15.113:0/1564248918 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376402cea0 con 0x7f376c0ce110 2023-12-19T13:49:48.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.046+0000 7f3768ff9640 1 -- 172.21.15.113:0/1564248918 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764040650 con 0x7f376c0ce110 2023-12-19T13:49:48.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.046+0000 7f3768ff9640 1 -- 172.21.15.113:0/1564248918 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764040a00 con 0x7f376c0ce110 2023-12-19T13:49:48.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.046+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0c8fb0 con 0x7f376c0ce110 2023-12-19T13:49:48.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.046+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c0c9570 con 0x7f376c0ce110 2023-12-19T13:49:48.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.049+0000 7f3768ff9640 1 -- 172.21.15.113:0/1564248918 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3764040b60 con 0x7f376c0ce110 2023-12-19T13:49:48.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.050+0000 7f3768ff9640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f374c06a460 0x7f374c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.051+0000 7f3768ff9640 1 -- 172.21.15.113:0/1564248918 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37640ab470 con 0x7f376c0ce110 2023-12-19T13:49:48.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.051+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f374c06a460 0x7f374c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.051+0000 7f3774f9b740 1 Processor -- start 2023-12-19T13:49:48.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.051+0000 7f3774f9b740 1 -- start start 2023-12-19T13:49:48.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.051+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f374c06a460 0x7f374c06c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f376c13ed40 tx=0x7f3754009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b22195cb0 0x564b221c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b221c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f3774f9b740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b22105f80 con 0x564b22195cb0 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b22103710 con 0x564b221998b0 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b220ff000 con 0x564b221c5d30 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b22195cb0 0x564b221c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b22195cb0 0x564b221c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39944/0 (socket says 172.21.15.113:39944) 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 -- 172.21.15.113:0/1788804625 learned_addr learned my addr 172.21.15.113:0/1788804625 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:48.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 -- 172.21.15.113:0/1788804625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 msgr2=0x564b221c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1788804625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 -- 172.21.15.113:0/1788804625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 msgr2=0x564b221c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1788804625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b221c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.052+0000 7f376b7fe640 1 -- 172.21.15.113:0/1788804625 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b220c6690 con 0x564b22195cb0 2023-12-19T13:49:48.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.053+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1788804625 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b22195cb0 0x564b221c2fa0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3754005460 tx=0x7f3754010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe6531ab51d56c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.053+0000 7f3761ffb640 1 -- 172.21.15.113:0/1788804625 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375401c070 con 0x564b22195cb0 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.053+0000 7f3761ffb640 1 -- 172.21.15.113:0/1788804625 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400d6a0 con 0x564b22195cb0 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.053+0000 7f3761ffb640 1 -- 172.21.15.113:0/1788804625 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400da30 con 0x564b22195cb0 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 -- 172.21.15.113:0/1788804625 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b22195cb0 msgr2=0x564b221c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1788804625 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b22195cb0 0x564b221c2fa0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3754005460 tx=0x7f3754010000 comp rx=0 tx=0).stop 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 -- 172.21.15.113:0/1788804625 shutdown_connections 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1788804625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b221c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1788804625 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b22195cb0 0x564b221c2fa0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1788804625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 -- 172.21.15.113:0/1788804625 >> 172.21.15.113:0/1788804625 conn(0x564b22197fc0 msgr2=0x564b221e0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 -- 172.21.15.113:0/1788804625 shutdown_connections 2023-12-19T13:49:48.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.054+0000 7f3774f9b740 1 -- 172.21.15.113:0/1788804625 wait complete. 2023-12-19T13:49:48.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.055+0000 7f3774f9b740 1 -- start start 2023-12-19T13:49:48.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.055+0000 7f3774f9b740 1 Processor -- start 2023-12-19T13:49:48.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221f0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f3774f9b740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b220a07d0 con 0x564b221998b0 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b220a0470 con 0x564b221f4390 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b21e66f20 con 0x564b221c5d30 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f3774f9b740 10 client.0 _ll_register_callbacks cb 0x564b220ef1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221bb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39956/0 (socket says 172.21.15.113:39956) 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 -- 172.21.15.113:0/1574233550 learned_addr learned my addr 172.21.15.113:0/1574233550 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 -- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 msgr2=0x564b221f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f37709cd640 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221f0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 -- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 msgr2=0x564b221c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.056+0000 7f376bfff640 1 -- 172.21.15.113:0/1574233550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3754005110 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f376bfff640 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221bb670 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f37640a98e0 tx=0x7f376407ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7966093a4e680c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f374affd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f374affd640 1 -- 172.21.15.113:0/1574233550 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640ab2b0 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f374affd640 1 -- 172.21.15.113:0/1574233550 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3764082700 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b22129550 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f374affd640 1 -- 172.21.15.113:0/1574233550 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f376407e120 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f3774f9b740 10 client.6228 fetch_fsmap learned FSMap version 33 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x564b220fd680 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f374affd640 1 -- 172.21.15.113:0/1574233550 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b22129550 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.057+0000 7f374affd640 1 -- 172.21.15.113:0/1574233550 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f376407a980 con 0x564b221998b0 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.058+0000 7f3774f9b740 10 client.6228 fetch_fsmap finished waiting for FSMap version 33 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.058+0000 7f3774f9b740 10 client.6228 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:49:48.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.058+0000 7f3774f9b740 20 client.6228 populate_metadata read hostname 'smithi113' 2023-12-19T13:49:48.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.058+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b221f1d30 0x564b221c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.058+0000 7f3774f9b740 4 client.6228 mds_command: new command op to 6066 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:49:48.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.058+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 --> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b220f1b50 con 0x564b221f1d30 2023-12-19T13:49:48.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.058+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b221f1d30 0x564b221c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.059+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b221f1d30 0x564b221c3ab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39cb9a0364ab0e18 server_cookie=2e3aa0535cfdc55b in_seq=0 out_seq=0 2023-12-19T13:49:48.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.059+0000 7f374affd640 10 client.6228 ms_handle_connect on v2:172.21.15.151:6833/4085417322 2023-12-19T13:49:48.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.061+0000 7f374affd640 1 -- 172.21.15.113:0/1574233550 <== mds.0 v2:172.21.15.151:6833/4085417322 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x564b220f1b50 con 0x564b221f1d30 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.061+0000 7f374affd640 10 client.6228 handle_command_reply: tid=0 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 client.6228 shutdown 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 msgr2=0x564b221bb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221bb670 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f37640a98e0 tx=0x7f376407ae20 comp rx=0 tx=0).stop 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 shutdown_connections 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b221f1d30 0x564b221c3ab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1574233550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221bb670 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 >> 172.21.15.113:0/1574233550 conn(0x564b22195cb0 msgr2=0x564b2219a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f374affd640 0 client.6228 ms_handle_reset on v2:172.21.15.151:6833/4085417322 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 shutdown_connections 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 1 -- 172.21.15.113:0/1574233550 wait complete. 2023-12-19T13:49:48.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.062+0000 7f3774f9b740 20 client.6228 trim_cache size 0 max 16384 2023-12-19T13:49:48.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.078+0000 7f3774f9b740 1 Processor -- start 2023-12-19T13:49:48.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.078+0000 7f3774f9b740 1 -- start start 2023-12-19T13:49:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.079+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221954d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.079+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.079+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221ba680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.079+0000 7f3774f9b740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b22195a10 con 0x564b221998b0 2023-12-19T13:49:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.079+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b221e4b90 con 0x564b221f4390 2023-12-19T13:49:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.079+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b221c7c30 con 0x564b221c5d30 2023-12-19T13:49:48.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.079+0000 7f376bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221954d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39962/0 (socket says 172.21.15.113:39962) 2023-12-19T13:49:48.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 -- 172.21.15.113:0/2677418852 learned_addr learned my addr 172.21.15.113:0/2677418852 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:48.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376b7fe640 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f37709cd640 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221ba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 -- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 msgr2=0x564b221c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 -- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 msgr2=0x564b221ba680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221ba680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 -- 172.21.15.113:0/2677418852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2209f9e0 con 0x564b221998b0 2023-12-19T13:49:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.080+0000 7f376bfff640 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221954d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f376403c4b0 tx=0x7f376403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b007ba66da11f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f37627fc640 1 -- 172.21.15.113:0/2677418852 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376407e120 con 0x564b221998b0 2023-12-19T13:49:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f37627fc640 1 -- 172.21.15.113:0/2677418852 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376407e2d0 con 0x564b221998b0 2023-12-19T13:49:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f37627fc640 1 -- 172.21.15.113:0/2677418852 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640ab2b0 con 0x564b221998b0 2023-12-19T13:49:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 -- 172.21.15.113:0/2677418852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 msgr2=0x564b221954d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221954d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f376403c4b0 tx=0x7f376403f000 comp rx=0 tx=0).stop 2023-12-19T13:49:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 -- 172.21.15.113:0/2677418852 shutdown_connections 2023-12-19T13:49:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221f4390 0x564b221ba680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b221c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 --2- 172.21.15.113:0/2677418852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221998b0 0x564b221954d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 -- 172.21.15.113:0/2677418852 >> 172.21.15.113:0/2677418852 conn(0x564b22195cb0 msgr2=0x564b22199db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 -- 172.21.15.113:0/2677418852 shutdown_connections 2023-12-19T13:49:48.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.081+0000 7f3774f9b740 1 -- 172.21.15.113:0/2677418852 wait complete. 2023-12-19T13:49:48.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.082+0000 7f3774f9b740 1 -- start start 2023-12-19T13:49:48.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.082+0000 7f3774f9b740 1 Processor -- start 2023-12-19T13:49:48.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b2224e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b22194e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f3774f9b740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221f4390 0x564b22195370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f3774f9b740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b221ba7c0 con 0x564b221f4390 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b221e26d0 con 0x564b221998b0 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f3774f9b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b221c7e30 con 0x564b221c5d30 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f3774f9b740 10 client.0 _ll_register_callbacks cb 0x7f3754003a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f37709cd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221f4390 0x564b22195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.083+0000 7f37709cd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221f4390 0x564b22195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39964/0 (socket says 172.21.15.113:39964) 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f37709cd640 1 -- 172.21.15.113:0/1633081349 learned_addr learned my addr 172.21.15.113:0/1633081349 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b22194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f376bfff640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b2224e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f37709cd640 1 -- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 msgr2=0x564b22194e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f37709cd640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b22194e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f37709cd640 1 -- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 msgr2=0x564b2224e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f37709cd640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b2224e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f37709cd640 1 -- 172.21.15.113:0/1633081349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3754005110 con 0x564b221f4390 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f376b7fe640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b22194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f376bfff640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b2224e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f37709cd640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221f4390 0x564b22195370 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f375c000f60 tx=0x7f375c0014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88b8890df3b0b1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f374affd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f374affd640 1 -- 172.21.15.113:0/1633081349 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c005ab0 con 0x564b221f4390 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.084+0000 7f374affd640 1 -- 172.21.15.113:0/1633081349 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f375c00c050 con 0x564b221f4390 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f375400d6a0 con 0x564b221f4390 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f374affd640 1 -- 172.21.15.113:0/1633081349 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f375c010ec0 con 0x564b221f4390 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 10 client.6234 fetch_fsmap learned FSMap version 33 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x564b220c4ef0 con 0x564b221f4390 2023-12-19T13:49:48.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f374affd640 1 -- 172.21.15.113:0/1633081349 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400d6a0 con 0x564b221f4390 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f374affd640 1 -- 172.21.15.113:0/1633081349 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f375c012040 con 0x564b221f4390 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 10 client.6234 fetch_fsmap finished waiting for FSMap version 33 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 10 client.6234 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 20 client.6234 populate_metadata read hostname 'smithi113' 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b22252210 0x564b222525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 4 client.6234 mds_command: new command op to 6066 tid=0[{"prefix": "status"}] 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.085+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 --> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564b220f8080 con 0x564b22252210 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.086+0000 7f376bfff640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b22252210 0x564b222525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.087+0000 7f376bfff640 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b22252210 0x564b222525f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ff3698ecb884f0 server_cookie=82c07c1a4b277f2d in_seq=0 out_seq=0 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.087+0000 7f374affd640 10 client.6234 ms_handle_connect on v2:172.21.15.151:6833/4085417322 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f374affd640 1 -- 172.21.15.113:0/1633081349 <== mds.0 v2:172.21.15.151:6833/4085417322 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564b220f8080 con 0x564b22252210 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f374affd640 10 client.6234 handle_command_reply: tid=0 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 client.6234 shutdown 2023-12-19T13:49:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221f4390 msgr2=0x564b22195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221f4390 0x564b22195370 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f375c000f60 tx=0x7f375c0014f0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 shutdown_connections 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:6833/4085417322,v1:172.21.15.151:6835/4085417322] conn(0x564b22252210 0x564b222525f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x564b221f4390 0x564b22195370 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b221c5d30 0x564b22194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 --2- 172.21.15.113:0/1633081349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b221998b0 0x564b2224e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f374affd640 0 client.6234 ms_handle_reset on v2:172.21.15.151:6833/4085417322 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 >> 172.21.15.113:0/1633081349 conn(0x564b22195cb0 msgr2=0x564b221baa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 shutdown_connections 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 1 -- 172.21.15.113:0/1633081349 wait complete. 2023-12-19T13:49:48.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.088+0000 7f3774f9b740 20 client.6234 trim_cache size 0 max 16384 2023-12-19T13:49:48.094 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:49:48.094 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:49:48.094 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:49:48.094 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 6066, 2023-12-19T13:49:48.094 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:49:48.094 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:49:48.095 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:49:48.095 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 11.700712663999999, 2023-12-19T13:49:48.095 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 33, 2023-12-19T13:49:48.095 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 73, 2023-12-19T13:49:48.095 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 73, 2023-12-19T13:49:48.095 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 17.368363311 2023-12-19T13:49:48.095 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f374c06a460 msgr2=0x7f374c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f374c06a460 0x7f374c06c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f376c13ed40 tx=0x7f3754009040 comp rx=0 tx=0).stop 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c0ce110 msgr2=0x7f376c15bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c0ce110 0x7f376c15bad0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3764037040 tx=0x7f3764004a40 comp rx=0 tx=0).stop 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 shutdown_connections 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f374c06a460 0x7f374c06c920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f376c146e10 0x7f376c0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f376c0d2b00 0x7f376c0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 --2- 172.21.15.113:0/1564248918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f376c0ce110 0x7f376c15bad0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 >> 172.21.15.113:0/1564248918 conn(0x7f376c0b29c0 msgr2=0x7f376c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 shutdown_connections 2023-12-19T13:49:48.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.089+0000 7f3772430640 1 -- 172.21.15.113:0/1564248918 wait complete. 2023-12-19T13:49:48.106 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:49:48.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.314+0000 7f06bc3ce640 1 Processor -- start 2023-12-19T13:49:48.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.314+0000 7f06bc3ce640 1 -- start start 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.315+0000 7f06bc3ce640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06b4157bf0 0x7f06b415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.315+0000 7f06bc3ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b40ae110 0x7f06b40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.315+0000 7f06bc3ce640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b40b0a90 con 0x7f06b40b0640 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.315+0000 7f06bc3ce640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b406b8c0 con 0x7f06b4157bf0 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.315+0000 7f06bc3ce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b415b740 con 0x7f06b40ae110 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba16a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06b4157bf0 0x7f06b415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba96b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f06b40b0640 0x7f06b415dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59338/0 (socket says 172.21.15.113:59338) 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba16a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06b4157bf0 0x7f06b415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39972/0 (socket says 172.21.15.113:39972) 2023-12-19T13:49:48.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba96b640 1 -- 172.21.15.113:0/232845122 learned_addr learned my addr 172.21.15.113:0/232845122 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:48.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06b9969640 1 --2- 172.21.15.113:0/232845122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b40ae110 0x7f06b40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba16a640 1 -- 172.21.15.113:0/232845122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b40ae110 msgr2=0x7f06b40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:48.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba16a640 1 --2- 172.21.15.113:0/232845122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b40ae110 0x7f06b40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba16a640 1 -- 172.21.15.113:0/232845122 >> v1:172.21.15.113:6789/0 conn(0x7f06b40b0640 legacy=0x7f06b415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06ba16a640 1 -- 172.21.15.113:0/232845122 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40ae640 con 0x7f06b4157bf0 2023-12-19T13:49:48.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06b9168640 1 -- 172.21.15.113:0/232845122 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740481640 0 0) 0x7f06ac001490 con 0x7f06b40b0640 2023-12-19T13:49:48.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.316+0000 7f06b9969640 1 --2- 172.21.15.113:0/232845122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b40ae110 0x7f06b40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.317+0000 7f06ba16a640 1 --2- 172.21.15.113:0/232845122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4157bf0 0x7f06b415b200 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f06b00097a0 tx=0x7f06b002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278a5a023a0db66f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06b9168640 1 -- 172.21.15.113:0/232845122 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b002d040 con 0x7f06b4157bf0 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06b9168640 1 -- 172.21.15.113:0/232845122 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0031810 con 0x7f06b4157bf0 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06b9168640 1 -- 172.21.15.113:0/232845122 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0031ba0 con 0x7f06b4157bf0 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 -- 172.21.15.113:0/232845122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4157bf0 msgr2=0x7f06b415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/232845122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4157bf0 0x7f06b415b200 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f06b00097a0 tx=0x7f06b002b8b0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 -- 172.21.15.113:0/232845122 shutdown_connections 2023-12-19T13:49:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/232845122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b40ae110 0x7f06b40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/232845122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4157bf0 0x7f06b415b200 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 -- 172.21.15.113:0/232845122 >> 172.21.15.113:0/232845122 conn(0x7f06b40cbb70 msgr2=0x7f06b40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 -- 172.21.15.113:0/232845122 shutdown_connections 2023-12-19T13:49:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.318+0000 7f06bc3ce640 1 -- 172.21.15.113:0/232845122 wait complete. 2023-12-19T13:49:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.320+0000 7f06bc3ce640 1 Processor -- start 2023-12-19T13:49:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.320+0000 7f06bc3ce640 1 -- start start 2023-12-19T13:49:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06bc3ce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b40ae110 0x7f06b415df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06bc3ce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b40b0640 0x7f06b414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06bc3ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b4157bf0 0x7f06b414e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06bc3ce640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b414d2a0 con 0x7f06b40b0640 2023-12-19T13:49:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06bc3ce640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b414c460 con 0x7f06b40ae110 2023-12-19T13:49:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06bc3ce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4150270 con 0x7f06b4157bf0 2023-12-19T13:49:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06b9969640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b40b0640 0x7f06b414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06b9969640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b40b0640 0x7f06b414dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39974/0 (socket says 172.21.15.113:39974) 2023-12-19T13:49:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.321+0000 7f06b9969640 1 -- 172.21.15.113:0/3976876241 learned_addr learned my addr 172.21.15.113:0/3976876241 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06b9969640 1 -- 172.21.15.113:0/3976876241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b4157bf0 msgr2=0x7f06b414e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06b9969640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b4157bf0 0x7f06b414e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06b9969640 1 -- 172.21.15.113:0/3976876241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b40ae110 msgr2=0x7f06b415df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06b9969640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b40ae110 0x7f06b415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06b9969640 1 -- 172.21.15.113:0/3976876241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b0009400 con 0x7f06b40b0640 2023-12-19T13:49:48.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06b9969640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b40b0640 0x7f06b414dff0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f06a400c7f0 tx=0x7f06a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06aaffd640 1 -- 172.21.15.113:0/3976876241 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400cea0 con 0x7f06b40b0640 2023-12-19T13:49:48.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06aaffd640 1 -- 172.21.15.113:0/3976876241 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4007a30 con 0x7f06b40b0640 2023-12-19T13:49:48.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06aaffd640 1 -- 172.21.15.113:0/3976876241 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4007dc0 con 0x7f06b40b0640 2023-12-19T13:49:48.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b4150a80 con 0x7f06b40b0640 2023-12-19T13:49:48.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.322+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b415e480 con 0x7f06b40b0640 2023-12-19T13:49:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.323+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b40aebe0 con 0x7f06b40b0640 2023-12-19T13:49:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.324+0000 7f06aaffd640 1 -- 172.21.15.113:0/3976876241 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06a40113f0 con 0x7f06b40b0640 2023-12-19T13:49:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.325+0000 7f06aaffd640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f069806a430 0x7f069806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.325+0000 7f06aaffd640 1 -- 172.21.15.113:0/3976876241 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06a4088b40 con 0x7f06b40b0640 2023-12-19T13:49:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.325+0000 7f06ba16a640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f069806a430 0x7f069806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.326+0000 7f06ba16a640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f069806a430 0x7f069806c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f06b0036000 tx=0x7f06b0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:48.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.329+0000 7f06aaffd640 1 -- 172.21.15.113:0/3976876241 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f06b40aebe0 con 0x7f06b40b0640 2023-12-19T13:49:48.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.557+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f06b40aebe0 con 0x7f06b40b0640 2023-12-19T13:49:48.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.558+0000 7f06aaffd640 1 -- 172.21.15.113:0/3976876241 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f06b40aebe0 con 0x7f06b40b0640 2023-12-19T13:49:48.558 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:49:48.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.560+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f069806a430 msgr2=0x7f069806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.560+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f069806a430 0x7f069806c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f06b0036000 tx=0x7f06b0030000 comp rx=0 tx=0).stop 2023-12-19T13:49:48.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.560+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b40b0640 msgr2=0x7f06b414dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:48.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.560+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b40b0640 0x7f06b414dff0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f06a400c7f0 tx=0x7f06a400ccb0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.560+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 shutdown_connections 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.560+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f069806a430 0x7f069806c8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.560+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06b4157bf0 0x7f06b414e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.561+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b40b0640 0x7f06b414dff0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.561+0000 7f06bc3ce640 1 --2- 172.21.15.113:0/3976876241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b40ae110 0x7f06b415df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.561+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 >> 172.21.15.113:0/3976876241 conn(0x7f06b40cbb70 msgr2=0x7f06b406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.561+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 shutdown_connections 2023-12-19T13:49:48.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:48.561+0000 7f06bc3ce640 1 -- 172.21.15.113:0/3976876241 wait complete. 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:49:48.578 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:49:48.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:48.579 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:49:48.629 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:49:48.629 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:49:48.630 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42232sec preferred_lft 42232sec 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:48.631 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:48.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:48.633 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:49:48.721 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:49:48.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:48.725 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:49:48.776 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:49:48.776 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:49:48.776 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:49:48.776 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:49:48.776 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:49:48.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:48.777 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:49:48.777 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:49:48.778 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:49:48.778 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:49:48.778 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:49:48.778 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:49:48.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:48.964 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:49:49.012 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:49:49.013 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:49:49.013 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:49:49.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:49.013 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:49:49.096 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:49:49.096 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:49:49.145 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:49:49.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:49:49.145 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:49:49.193 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:49:49.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:49.193 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:49:49.333 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:49:49.333 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:49:49.365 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:49:49.366 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:49:49.366 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:49:49.366 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:49:49.366 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:49:49.367 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:49:49.367 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:49:49.367 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:49:49.367 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:49:49.368 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:49:49.373 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:49:49.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:49.373 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:49:49.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:49.456 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:49:49.528 INFO:teuthology.orchestra.run.smithi113.stdout:client5125 2023-12-19T13:49:49.529 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:49:49.529 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:49.580 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:49:49.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.842+0000 7fbc5f166640 1 Processor -- start 2023-12-19T13:49:49.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.842+0000 7fbc5f166640 1 -- start start 2023-12-19T13:49:49.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.844+0000 7fbc5f166640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 0x7fbc5815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.844+0000 7fbc5f166640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc580b0810 0x7fbc5806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.844+0000 7fbc5f166640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5815b740 con 0x7fbc580ae110 2023-12-19T13:49:49.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.844+0000 7fbc5f166640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5806b8c0 con 0x7fbc580b0810 2023-12-19T13:49:49.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.844+0000 7fbc5f166640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580ae640 con 0x7fbc58157bf0 2023-12-19T13:49:49.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.844+0000 7fbc57fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbc580ae110 0x7fbc580b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59344/0 (socket says 172.21.15.113:59344) 2023-12-19T13:49:49.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.844+0000 7fbc57fff640 1 -- 172.21.15.113:0/2200464370 learned_addr learned my addr 172.21.15.113:0/2200464370 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:49:49.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973818889 0 0) 0x7fbc5815b740 con 0x7fbc580ae110 2023-12-19T13:49:49.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc48003520 con 0x7fbc580ae110 2023-12-19T13:49:49.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc5d703640 1 --2- 172.21.15.113:0/2200464370 >> v2:172.21.15.151:3300/0 conn(0x7fbc580b0810 0x7fbc5806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:49.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc5cf02640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 0x7fbc5815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:49.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 992740632 0 0) 0x7fbc48003520 con 0x7fbc580ae110 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 msgr2=0x7fbc5815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 0x7fbc5815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 >> v2:172.21.15.151:3300/0 conn(0x7fbc580b0810 msgr2=0x7fbc5806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 --2- 172.21.15.113:0/2200464370 >> v2:172.21.15.151:3300/0 conn(0x7fbc580b0810 0x7fbc5806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc580ae920 con 0x7fbc580ae110 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbc44001670 con 0x7fbc580ae110 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 >> v1:172.21.15.113:6789/0 conn(0x7fbc580ae110 legacy=0x7fbc580b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc480039e0 0x7fbc48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 0x7fbc480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc48004d00 0x7fbc48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5806b8c0 con 0x7fbc48004d00 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580ae640 con 0x7fbc480039e0 2023-12-19T13:49:49.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.845+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4800bb10 con 0x7fbc58157bf0 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc5d703640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc48004d00 0x7fbc48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc5cf02640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc480039e0 0x7fbc48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc57fff640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 0x7fbc480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc5d703640 1 -- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 msgr2=0x7fbc480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc5d703640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 0x7fbc480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc5d703640 1 -- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc480039e0 msgr2=0x7fbc48003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc5d703640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc480039e0 0x7fbc48003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc5d703640 1 -- 172.21.15.113:0/2200464370 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48003520 con 0x7fbc48004d00 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.846+0000 7fbc57fff640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc58157bf0 0x7fbc480047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:49.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.847+0000 7fbc5d703640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc48004d00 0x7fbc48005180 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbc50007330 tx=0x7fbc480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284d48f332ac1be1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:49.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.847+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5002ccd0 con 0x7fbc48004d00 2023-12-19T13:49:49.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.847+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5002ce30 con 0x7fbc48004d00 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.847+0000 7fbc577fe640 1 -- 172.21.15.113:0/2200464370 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50034660 con 0x7fbc48004d00 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.848+0000 7fbc5f166640 1 -- 172.21.15.113:0/2200464370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc48004d00 msgr2=0x7fbc48005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.848+0000 7fbc5f166640 1 --2- 172.21.15.113:0/2200464370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc48004d00 0x7fbc48005180 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbc50007330 tx=0x7fbc480057f0 comp rx=0 tx=0).stop 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.848+0000 7fbc5d703640 1 -- 172.21.15.113:0/2200464370 reap_dead start 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.848+0000 7fbc5f166640 1 -- 172.21.15.113:0/2200464370 shutdown_connections 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.848+0000 7fbc5f166640 1 -- 172.21.15.113:0/2200464370 >> 172.21.15.113:0/2200464370 conn(0x7fbc580cbb70 msgr2=0x7fbc580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.848+0000 7fbc5f166640 1 -- 172.21.15.113:0/2200464370 shutdown_connections 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.848+0000 7fbc5f166640 1 -- 172.21.15.113:0/2200464370 wait complete. 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.850+0000 7fbc5f166640 1 Processor -- start 2023-12-19T13:49:49.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.850+0000 7fbc5f166640 1 -- start start 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5f166640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc580cd550 0x7fbc5814d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5f166640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc580cd930 0x7fbc581f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5f166640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc581f4730 0x7fbc581f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5f166640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5814dbc0 con 0x7fbc580cd550 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5f166640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58150430 con 0x7fbc581f4730 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5f166640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58150710 con 0x7fbc580cd930 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc580cd550 0x7fbc5814d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc580cd550 0x7fbc5814d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39990/0 (socket says 172.21.15.113:39990) 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 -- 172.21.15.113:0/3086579996 learned_addr learned my addr 172.21.15.113:0/3086579996 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:49.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 -- 172.21.15.113:0/3086579996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc580cd930 msgr2=0x7fbc581f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc580cd930 0x7fbc581f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 -- 172.21.15.113:0/3086579996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc581f4730 msgr2=0x7fbc581f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc581f4730 0x7fbc581f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.851+0000 7fbc5cf02640 1 -- 172.21.15.113:0/3086579996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc581509f0 con 0x7fbc580cd550 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.852+0000 7fbc5cf02640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc580cd550 0x7fbc5814d680 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00f580 tx=0x7fbc4c00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.852+0000 7fbc557fa640 1 -- 172.21.15.113:0/3086579996 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c013810 con 0x7fbc580cd550 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.852+0000 7fbc557fa640 1 -- 172.21.15.113:0/3086579996 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c013970 con 0x7fbc580cd550 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.852+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc58150cd0 con 0x7fbc580cd550 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.852+0000 7fbc557fa640 1 -- 172.21.15.113:0/3086579996 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c013ce0 con 0x7fbc580cd550 2023-12-19T13:49:49.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.852+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc581514b0 con 0x7fbc580cd550 2023-12-19T13:49:49.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.853+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc58061910 con 0x7fbc580cd550 2023-12-19T13:49:49.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.854+0000 7fbc557fa640 1 -- 172.21.15.113:0/3086579996 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc4c01f460 con 0x7fbc580cd550 2023-12-19T13:49:49.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.855+0000 7fbc557fa640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbc3c06a430 0x7fbc3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:49.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.855+0000 7fbc557fa640 1 -- 172.21.15.113:0/3086579996 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc4c088ca0 con 0x7fbc580cd550 2023-12-19T13:49:49.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.856+0000 7fbc57fff640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbc3c06a430 0x7fbc3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:49.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.856+0000 7fbc57fff640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbc3c06a430 0x7fbc3c06c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc580cde30 tx=0x7fbc44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:49.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:49.860+0000 7fbc557fa640 1 -- 172.21.15.113:0/3086579996 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbc4c0542a0 con 0x7fbc580cd550 2023-12-19T13:49:50.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.092+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc580cfe20 con 0x7fbc580cd550 2023-12-19T13:49:50.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.093+0000 7fbc557fa640 1 -- 172.21.15.113:0/3086579996 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbc4c0578c0 con 0x7fbc580cd550 2023-12-19T13:49:50.094 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:49:50.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.095+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbc3c06a430 msgr2=0x7fbc3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:50.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.095+0000 7fbc5f166640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbc3c06a430 0x7fbc3c06c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc580cde30 tx=0x7fbc44009040 comp rx=0 tx=0).stop 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.095+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc580cd550 msgr2=0x7fbc5814d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.095+0000 7fbc5f166640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc580cd550 0x7fbc5814d680 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00f580 tx=0x7fbc4c00fa40 comp rx=0 tx=0).stop 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 shutdown_connections 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbc3c06a430 0x7fbc3c06c8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc581f4730 0x7fbc581f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc580cd930 0x7fbc581f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 --2- 172.21.15.113:0/3086579996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc580cd550 0x7fbc5814d680 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 >> 172.21.15.113:0/3086579996 conn(0x7fbc580cbb70 msgr2=0x7fbc58165770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 shutdown_connections 2023-12-19T13:49:50.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:50.096+0000 7fbc5f166640 1 -- 172.21.15.113:0/3086579996 wait complete. 2023-12-19T13:49:50.115 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:49:50.115 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:49:50.115 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:49:50.115 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:49:50.115 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:49:50.115 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:49:50.116 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:49:50.116 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:49:50.116 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:49:50.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.116 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:49:50.177 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:49:50.178 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42205sec preferred_lft 42205sec 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:50.179 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:49:50.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.180 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:49:50.272 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:49:50.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.276 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:49:50.327 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:49:50.327 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:49:50.328 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:49:50.328 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:49:50.328 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:49:50.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.328 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:49:50.328 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:49:50.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:49:50.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:49:50.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:49:50.329 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:49:50.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.512 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:49:50.563 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:49:50.564 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:49:50.564 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:49:50.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.564 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:49:50.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:49:50.660 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:49:50.714 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:49:50.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:49:50.714 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:49:50.764 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:49:50.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:49:50.899 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:49:50.900 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:49:50.931 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:49:50.931 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:49:50.931 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:49:50.931 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:49:50.932 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:49:50.935 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:49:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:49:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:49:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:49:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:49:50.939 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:49:50.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:50.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:49:51.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:49:51.026 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:49:51.083 INFO:teuthology.orchestra.run.smithi151.stdout:client5131 2023-12-19T13:49:51.083 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:49:51.083 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:49:51.133 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:49:51.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.356+0000 7fc9eda7d640 1 Processor -- start 2023-12-19T13:49:51.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.356+0000 7fc9eda7d640 1 -- start start 2023-12-19T13:49:51.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9eda7d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9e8157aa0 0x7fc9e80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:51.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9eda7d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc9e806e410 0x7fc9e8161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9eda7d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e815e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9eda7d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e806e8c0 con 0x7fc9e8157aa0 2023-12-19T13:49:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9eda7d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e80b2600 con 0x7fc9e806e410 2023-12-19T13:49:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9eda7d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80b1d60 con 0x7fc9e8161540 2023-12-19T13:49:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9e77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9e8157aa0 0x7fc9e80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9e77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9e8157aa0 0x7fc9e80b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40002/0 (socket says 172.21.15.113:40002) 2023-12-19T13:49:51.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.358+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1613125922 learned_addr learned my addr 172.21.15.113:0/1613125922 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e6ffd640 1 --2- 172.21.15.113:0/1613125922 >> v2:172.21.15.151:3300/0 conn(0x7fc9e806e410 0x7fc9e8161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e7fff640 1 --2- 172.21.15.113:0/1613125922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1613125922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 msgr2=0x7fc9e815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e77fe640 1 --2- 172.21.15.113:0/1613125922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e815e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1613125922 >> v2:172.21.15.151:3300/0 conn(0x7fc9e806e410 msgr2=0x7fc9e8161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e77fe640 1 --2- 172.21.15.113:0/1613125922 >> v2:172.21.15.151:3300/0 conn(0x7fc9e806e410 0x7fc9e8161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1613125922 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80b2040 con 0x7fc9e8157aa0 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e6ffd640 1 --2- 172.21.15.113:0/1613125922 >> v2:172.21.15.151:3300/0 conn(0x7fc9e806e410 0x7fc9e8161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:51.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.359+0000 7fc9e7fff640 1 --2- 172.21.15.113:0/1613125922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:49:51.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.360+0000 7fc9e77fe640 1 --2- 172.21.15.113:0/1613125922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e8157aa0 0x7fc9e80b1710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc9e806db00 tx=0x7fc9d802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8295e8c676f4d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:51.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.361+0000 7fc9e67fc640 1 -- 172.21.15.113:0/1613125922 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8031860 con 0x7fc9e8157aa0 2023-12-19T13:49:51.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.361+0000 7fc9e67fc640 1 -- 172.21.15.113:0/1613125922 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d80319c0 con 0x7fc9e8157aa0 2023-12-19T13:49:51.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.361+0000 7fc9e67fc640 1 -- 172.21.15.113:0/1613125922 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8031d50 con 0x7fc9e8157aa0 2023-12-19T13:49:51.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.361+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1613125922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e8157aa0 msgr2=0x7fc9e80b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:51.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.361+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1613125922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e8157aa0 0x7fc9e80b1710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc9e806db00 tx=0x7fc9d802b900 comp rx=0 tx=0).stop 2023-12-19T13:49:51.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.362+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1613125922 shutdown_connections 2023-12-19T13:49:51.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.362+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1613125922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.362+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1613125922 >> v2:172.21.15.151:3300/0 conn(0x7fc9e806e410 0x7fc9e8161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.362+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1613125922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e8157aa0 0x7fc9e80b1710 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.362+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1613125922 >> 172.21.15.113:0/1613125922 conn(0x7fc9e80cbb70 msgr2=0x7fc9e80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:51.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.362+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1613125922 shutdown_connections 2023-12-19T13:49:51.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.362+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1613125922 wait complete. 2023-12-19T13:49:51.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.364+0000 7fc9eda7d640 1 Processor -- start 2023-12-19T13:49:51.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.364+0000 7fc9eda7d640 1 -- start start 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9eda7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e806e410 0x7fc9e8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9eda7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e8157aa0 0x7fc9e815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9eda7d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9eda7d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e815b100 con 0x7fc9e806e410 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9eda7d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e815a580 con 0x7fc9e8157aa0 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9eda7d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e815a860 con 0x7fc9e8161540 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e806e410 0x7fc9e8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e806e410 0x7fc9e8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40012/0 (socket says 172.21.15.113:40012) 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1026318550 learned_addr learned my addr 172.21.15.113:0/1026318550 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:49:51.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e6ffd640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e8157aa0 0x7fc9e815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e7fff640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 msgr2=0x7fc9e81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e81583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e8157aa0 msgr2=0x7fc9e815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e8157aa0 0x7fc9e815e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.365+0000 7fc9e77fe640 1 -- 172.21.15.113:0/1026318550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80094d0 con 0x7fc9e806e410 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.366+0000 7fc9e77fe640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e806e410 0x7fc9e8159fa0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9d802b940 tx=0x7fc9d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.366+0000 7fc9cffff640 1 -- 172.21.15.113:0/1026318550 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8031850 con 0x7fc9e806e410 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.366+0000 7fc9cffff640 1 -- 172.21.15.113:0/1026318550 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d80443f0 con 0x7fc9e806e410 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.366+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e815ab40 con 0x7fc9e806e410 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.366+0000 7fc9cffff640 1 -- 172.21.15.113:0/1026318550 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80447a0 con 0x7fc9e806e410 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.366+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e815e950 con 0x7fc9e806e410 2023-12-19T13:49:51.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.367+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e8061910 con 0x7fc9e806e410 2023-12-19T13:49:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.368+0000 7fc9cffff640 1 -- 172.21.15.113:0/1026318550 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc9d8044900 con 0x7fc9e806e410 2023-12-19T13:49:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.369+0000 7fc9cffff640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9d406a430 0x7fc9d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:49:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.369+0000 7fc9cffff640 1 -- 172.21.15.113:0/1026318550 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9d80ab210 con 0x7fc9e806e410 2023-12-19T13:49:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.369+0000 7fc9e6ffd640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9d406a430 0x7fc9d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:49:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.370+0000 7fc9e6ffd640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9d406a430 0x7fc9d406c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc9e815ebf0 tx=0x7fc9dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:49:51.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.373+0000 7fc9cffff640 1 -- 172.21.15.113:0/1026318550 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc9d80767f0 con 0x7fc9e806e410 2023-12-19T13:49:51.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.599+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9e8071ae0 con 0x7fc9e806e410 2023-12-19T13:49:51.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.600+0000 7fc9cffff640 1 -- 172.21.15.113:0/1026318550 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4660 (secure 0 0 0) 0x7fc9d8035020 con 0x7fc9e806e410 2023-12-19T13:49:51.601 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:49:51.602 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:49:36.382415+0000","modified":"2023-12-19T13:49:39.476500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6066":{"gid":6066,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/4085417322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4085417322},{"type":"v1","addr":"172.21.15.151:6835","nonce":4085417322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T13:49:51.602 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 33 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9d406a430 msgr2=0x7fc9d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9d406a430 0x7fc9d406c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc9e815ebf0 tx=0x7fc9dc008040 comp rx=0 tx=0).stop 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e806e410 msgr2=0x7fc9e8159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e806e410 0x7fc9e8159fa0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9d802b940 tx=0x7fc9d80046c0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 shutdown_connections 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9d406a430 0x7fc9d406c8f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9e8161540 0x7fc9e81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e8157aa0 0x7fc9e815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 --2- 172.21.15.113:0/1026318550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9e806e410 0x7fc9e8159fa0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:49:51.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 >> 172.21.15.113:0/1026318550 conn(0x7fc9e80cbb70 msgr2=0x7fc9e80cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:49:51.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 shutdown_connections 2023-12-19T13:49:51.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:49:51.603+0000 7fc9eda7d640 1 -- 172.21.15.113:0/1026318550 wait complete. 2023-12-19T13:49:51.624 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-19T13:49:51.866 INFO:teuthology.orchestra.run.smithi151.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":6066,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.462745196,"mdsmap_epoch":33,"osdmap_epoch":73,"osdmap_epoch_barrier":73,"uptime":21.130392976} 2023-12-19T13:49:51.867 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 6066, "mdsmap_epoch": 33, "osdmap_epoch": 73, "osdmap_epoch_barrier": 73, "rank_uptime": 15.462745196, "state": "up:active", "uptime": 21.130392976, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:49:51.867 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:49:52.093 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:49:52.094 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:49:52.094 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T13:49:52.312 INFO:teuthology.orchestra.run.smithi113.stdout:{"mon_tick_interval":"5"} 2023-12-19T13:49:52.312 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T13:49:52.312 INFO:tasks.cephfs.test_full:pool capacity 557028928, 531MB should be enough to fill it 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> import time 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> import datetime 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> # Write some buffered data through before going full, all should be well 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> print("writing some data through which we expect to succeed") 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> bytes = 0 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-19T13:49:52.313 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> # from write 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> full = False 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> for n in range(0, int(531 * 0.9)): 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> print("done writing {0} bytes".format(bytes)) 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> # OK, now we should sneak in under the full condition 2023-12-19T13:49:52.314 DEBUG:teuthology.orchestra.run.smithi113:> # due to the time it takes the OSDs to report to the 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> # mons, and get a successful fsync on our full-making data 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> # buffered write, add more dirty data to the buffer 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> print("starting buffered write") 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> for n in range(0, int(531 * 0.2)): 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> time.sleep(15.0) 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> except OSError: 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> pass; 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-19T13:49:52.315 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> # Wait long enough for a background flush that should fail 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> time.sleep(30) 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> if False: 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> # ...and check that the failed background flush is reflected in fclose 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> os.close(f) 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> except OSError: 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> print("close() returned an error as expected") 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("close() failed to raise error") 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> # The kernel cephfs client does not raise errors on fclose 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> os.close(f) 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:49:52.316 DEBUG:teuthology.orchestra.run.smithi113:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T13:49:52.317 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:49:55.956 INFO:teuthology.orchestra.run.smithi113.stdout:writing some data through which we expect to succeed 2023-12-19T13:49:55.956 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T13:49:55.956 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-19T13:49:55.956 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-19T13:49:55.956 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-19T13:49:55.956 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-19T13:49:55.957 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-19T13:49:55.958 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-12-19T13:49:55.959 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-12-19T13:49:55.960 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-12-19T13:49:55.961 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-12-19T13:49:55.962 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-12-19T13:49:55.963 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-12-19T13:49:55.964 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-12-19T13:49:55.965 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-12-19T13:49:55.966 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-12-19T13:49:55.967 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-12-19T13:49:55.968 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-12-19T13:49:55.969 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-12-19T13:49:56.134 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-12-19T13:49:56.135 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-12-19T13:49:56.136 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-12-19T13:49:56.137 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-12-19T13:49:56.138 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-12-19T13:49:56.139 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-12-19T13:49:56.140 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-12-19T13:49:56.141 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-12-19T13:49:56.142 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-12-19T13:49:56.143 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-12-19T13:49:56.144 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-12-19T13:49:56.145 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-12-19T13:49:56.145 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-12-19T13:49:56.145 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-12-19T13:49:56.145 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-12-19T13:49:56.145 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-12-19T13:49:56.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-12-19T13:49:56.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-12-19T13:49:56.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-12-19T13:49:56.314 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-12-19T13:49:56.315 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-12-19T13:49:56.317 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-12-19T13:49:56.318 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-12-19T13:49:56.319 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-12-19T13:49:56.320 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-12-19T13:49:56.321 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-12-19T13:49:56.322 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-12-19T13:49:56.323 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-12-19T13:49:56.324 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-12-19T13:49:56.324 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-12-19T13:49:56.324 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-12-19T13:49:59.579 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:49:59.579+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-19T13:49:59.999 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:49:59.999+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 backfillfull osd(s); 1 full osd(s); 3 pool(s) full 2023-12-19T13:50:08.483 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:50:08.483+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-19T13:50:17.927 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:17.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:26.716 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:50:26.716+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-12-19T13:50:48.379 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:48.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:57.395 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-12-19T13:50:57.395 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-12-19T13:50:57.395 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-12-19T13:50:57.395 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-12-19T13:50:57.395 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-12-19T13:50:57.395 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:done writing 500695040 bytes 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:successfully fsync'ed prior to getting full state reported 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:starting buffered write 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:50:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:50:57.397 INFO:teuthology.orchestra.run.smithi113.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-19T13:50:57.548 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:50:57.548 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:50:57.672 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:50:57.812 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:50:57.812 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:50:57.812 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:50:57.873 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:50:57.873 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:50:57.930 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:50:58.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.144+0000 7fc66e89e640 1 Processor -- start 2023-12-19T13:50:58.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.145+0000 7fc66e89e640 1 -- start start 2023-12-19T13:50:58.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.146+0000 7fc66e89e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 0x7fc6680701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.146+0000 7fc66e89e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680b2fa0 con 0x7fc6680ac8b0 2023-12-19T13:50:58.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.146+0000 7fc66e89e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66806f600 con 0x7fc66815e3f0 2023-12-19T13:50:58.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.146+0000 7fc66e89e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815e7d0 con 0x7fc6680acd40 2023-12-19T13:50:58.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.147+0000 7fc66d09b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc6680ac8b0 0x7fc66806fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39250/0 (socket says 172.21.15.113:39250) 2023-12-19T13:50:58.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.147+0000 7fc66d09b640 1 -- 172.21.15.113:0/50076686 learned_addr learned my addr 172.21.15.113:0/50076686 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:50:58.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.147+0000 7fc66e09d640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 0x7fc6680701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.147+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197045560 0 0) 0x7fc6680b2fa0 con 0x7fc6680ac8b0 2023-12-19T13:50:58.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.147+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc654003520 con 0x7fc6680ac8b0 2023-12-19T13:50:58.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.147+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738089056 0 0) 0x7fc654003520 con 0x7fc6680ac8b0 2023-12-19T13:50:58.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 msgr2=0x7fc6680701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 0x7fc6680701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 >> v1:172.21.15.151:6789/0 conn(0x7fc66815e3f0 legacy=0x7fc6680b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6680ad1d0 con 0x7fc6680ac8b0 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc658001670 con 0x7fc6680ac8b0 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 >> v1:172.21.15.113:6789/0 conn(0x7fc6680ac8b0 legacy=0x7fc66806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6540039a0 0x7fc654003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc654004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 0x7fc654005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815e7d0 con 0x7fc6540047c0 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65400bb10 con 0x7fc6540039a0 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65400bcd0 con 0x7fc6680acd40 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d09b640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc654004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d89c640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6540039a0 0x7fc654003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d09b640 1 -- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 msgr2=0x7fc654005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:58.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66e09d640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 0x7fc654005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d09b640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6680acd40 0x7fc654005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d09b640 1 -- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6540039a0 msgr2=0x7fc654003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:58.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d09b640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6540039a0 0x7fc654003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d09b640 1 -- 172.21.15.113:0/50076686 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654003520 con 0x7fc6540047c0 2023-12-19T13:50:58.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.148+0000 7fc66d89c640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6540039a0 0x7fc654003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:50:58.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.149+0000 7fc66d09b640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc654004c40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc658001050 tx=0x7fc6540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733be5017581b561 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:58.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658005ad0 con 0x7fc6540047c0 2023-12-19T13:50:58.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658005c30 con 0x7fc6540047c0 2023-12-19T13:50:58.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66c89a640 1 -- 172.21.15.113:0/50076686 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65802c7c0 con 0x7fc6540047c0 2023-12-19T13:50:58.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66e89e640 1 -- 172.21.15.113:0/50076686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 msgr2=0x7fc654004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66e89e640 1 --2- 172.21.15.113:0/50076686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc654004c40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc658001050 tx=0x7fc6540057f0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66e09d640 1 -- 172.21.15.113:0/50076686 reap_dead start 2023-12-19T13:50:58.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66e89e640 1 -- 172.21.15.113:0/50076686 shutdown_connections 2023-12-19T13:50:58.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.150+0000 7fc66e89e640 1 -- 172.21.15.113:0/50076686 >> 172.21.15.113:0/50076686 conn(0x7fc6680b0100 msgr2=0x7fc6680b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:58.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.151+0000 7fc66e89e640 1 -- 172.21.15.113:0/50076686 shutdown_connections 2023-12-19T13:50:58.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.151+0000 7fc66e89e640 1 -- 172.21.15.113:0/50076686 wait complete. 2023-12-19T13:50:58.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.152+0000 7fc66e89e640 1 Processor -- start 2023-12-19T13:50:58.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.152+0000 7fc66e89e640 1 -- start start 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.153+0000 7fc66e89e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc6681f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.153+0000 7fc66e89e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6681f3730 0x7fc6680cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.153+0000 7fc66e89e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6681f2d70 0x7fc6681447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.153+0000 7fc66e89e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668152ec0 con 0x7fc6540047c0 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.153+0000 7fc66e89e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681531a0 con 0x7fc6681f2d70 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.153+0000 7fc66e89e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66806ce70 con 0x7fc6681f3730 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc6681f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc6681f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44614/0 (socket says 172.21.15.113:44614) 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 -- 172.21.15.113:0/2418516313 learned_addr learned my addr 172.21.15.113:0/2418516313 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 -- 172.21.15.113:0/2418516313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6681f3730 msgr2=0x7fc6680cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6681f3730 0x7fc6680cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 -- 172.21.15.113:0/2418516313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6681f2d70 msgr2=0x7fc6681447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6681f2d70 0x7fc6681447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 -- 172.21.15.113:0/2418516313 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66806d150 con 0x7fc6540047c0 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.154+0000 7fc66d89c640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc6681f6a00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d770 tx=0x7fc66400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.155+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664005270 con 0x7fc6540047c0 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.155+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6640053d0 con 0x7fc6540047c0 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.155+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400b8d0 con 0x7fc6540047c0 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.155+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6681f6f40 con 0x7fc6540047c0 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.155+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66806cad0 con 0x7fc6540047c0 2023-12-19T13:50:58.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.156+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc668153310 con 0x7fc6540047c0 2023-12-19T13:50:58.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.157+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc66400ba30 con 0x7fc6540047c0 2023-12-19T13:50:58.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.158+0000 7fc65e7fc640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc64c06a460 0x7fc64c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.158+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc664088940 con 0x7fc6540047c0 2023-12-19T13:50:58.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.158+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fc64c072050 con 0x7fc6540047c0 2023-12-19T13:50:58.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.158+0000 7fc66d09b640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc64c06a460 0x7fc64c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.159+0000 7fc66d09b640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc64c06a460 0x7fc64c06c920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc658001050 tx=0x7fc65802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:58.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.163+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc664053e50 con 0x7fc6540047c0 2023-12-19T13:50:58.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.351+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc668061910 con 0x7fc6540047c0 2023-12-19T13:50:58.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.355+0000 7fc65e7fc640 1 -- 172.21.15.113:0/2418516313 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16292 (secure 0 0 0) 0x7fc664057470 con 0x7fc6540047c0 2023-12-19T13:50:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:50:58.355 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":78,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:50:21.681397+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":4}]},{"pgid":"9.3e","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:50:58.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc64c06a460 msgr2=0x7fc64c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc64c06a460 0x7fc64c06c920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc658001050 tx=0x7fc65802e000 comp rx=0 tx=0).stop 2023-12-19T13:50:58.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 msgr2=0x7fc6681f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc6681f6a00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d770 tx=0x7fc66400dc30 comp rx=0 tx=0).stop 2023-12-19T13:50:58.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 shutdown_connections 2023-12-19T13:50:58.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc64c06a460 0x7fc64c06c920 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6681f2d70 0x7fc6681447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6681f3730 0x7fc6680cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 --2- 172.21.15.113:0/2418516313 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6540047c0 0x7fc6681f6a00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 >> 172.21.15.113:0/2418516313 conn(0x7fc6680b0100 msgr2=0x7fc6680b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:58.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 shutdown_connections 2023-12-19T13:50:58.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.358+0000 7fc66e89e640 1 -- 172.21.15.113:0/2418516313 wait complete. 2023-12-19T13:50:58.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:49:34.219200+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:49:35.406746+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:50:58.377 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:50:58.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.590+0000 7f4d6e9f5640 1 Processor -- start 2023-12-19T13:50:58.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.590+0000 7f4d6e9f5640 1 -- start start 2023-12-19T13:50:58.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.591+0000 7f4d6e9f5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d680cd4e0 0x7f4d6815e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.591+0000 7f4d6e9f5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 0x7f4d6815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.591+0000 7f4d6e9f5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6815dae0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.591+0000 7f4d6e9f5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6815b000 con 0x7f4d680cd4e0 2023-12-19T13:50:58.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.591+0000 7f4d6e9f5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6815b2e0 con 0x7f4d680b0470 2023-12-19T13:50:58.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.592+0000 7f4d6d9f3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d680cd4e0 0x7f4d6815e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.592+0000 7f4d6d1f2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4d6815a4f0 0x7f4d680afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39264/0 (socket says 172.21.15.113:39264) 2023-12-19T13:50:58.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.592+0000 7f4d6d1f2640 1 -- 172.21.15.113:0/1644322979 learned_addr learned my addr 172.21.15.113:0/1644322979 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:50:58.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.592+0000 7f4d6d9f3640 1 -- 172.21.15.113:0/1644322979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 msgr2=0x7f4d6815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:58.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.592+0000 7f4d6d9f3640 1 --2- 172.21.15.113:0/1644322979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 0x7f4d6815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.592+0000 7f4d6d9f3640 1 -- 172.21.15.113:0/1644322979 >> v1:172.21.15.113:6789/0 conn(0x7f4d6815a4f0 legacy=0x7f4d680afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.592+0000 7f4d6d9f3640 1 -- 172.21.15.113:0/1644322979 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6815dd80 con 0x7f4d680cd4e0 2023-12-19T13:50:58.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.593+0000 7f4d6d9f3640 1 --2- 172.21.15.113:0/1644322979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d680cd4e0 0x7f4d6815e580 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4d640097a0 tx=0x7f4d6402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b262a81d8c8e7532 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:58.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6c9f1640 1 -- 172.21.15.113:0/1644322979 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6402d040 con 0x7f4d680cd4e0 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6c9f1640 1 -- 172.21.15.113:0/1644322979 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64031810 con 0x7f4d680cd4e0 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6c9f1640 1 -- 172.21.15.113:0/1644322979 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64031ba0 con 0x7f4d680cd4e0 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/1644322979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d680cd4e0 msgr2=0x7f4d6815e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/1644322979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d680cd4e0 0x7f4d6815e580 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4d640097a0 tx=0x7f4d6402b8b0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/1644322979 shutdown_connections 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/1644322979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 0x7f4d6815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/1644322979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d680cd4e0 0x7f4d6815e580 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.594+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/1644322979 >> 172.21.15.113:0/1644322979 conn(0x7f4d6806f630 msgr2=0x7f4d6806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.595+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/1644322979 shutdown_connections 2023-12-19T13:50:58.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.595+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/1644322979 wait complete. 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.596+0000 7f4d6e9f5640 1 Processor -- start 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.596+0000 7f4d6e9f5640 1 -- start start 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.597+0000 7f4d6e9f5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 0x7f4d68146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.597+0000 7f4d6e9f5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680cd4e0 0x7f4d681455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.597+0000 7f4d6e9f5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6815a4f0 0x7f4d680abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.597+0000 7f4d6e9f5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68145f00 con 0x7f4d6815a4f0 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.597+0000 7f4d6e9f5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681461e0 con 0x7f4d680cd4e0 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.597+0000 7f4d6e9f5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681464c0 con 0x7f4d680b0470 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6815a4f0 0x7f4d680abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6815a4f0 0x7f4d680abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44638/0 (socket says 172.21.15.113:44638) 2023-12-19T13:50:58.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 -- 172.21.15.113:0/2304627681 learned_addr learned my addr 172.21.15.113:0/2304627681 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6d9f3640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 0x7f4d68146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6d1f2640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680cd4e0 0x7f4d681455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 -- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 msgr2=0x7f4d68146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 0x7f4d68146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 -- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680cd4e0 msgr2=0x7f4d681455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680cd4e0 0x7f4d681455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.598+0000 7f4d6e1f4640 1 -- 172.21.15.113:0/2304627681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64009400 con 0x7f4d6815a4f0 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.599+0000 7f4d6e1f4640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6815a4f0 0x7f4d680abdb0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b9e0 tx=0x7f4d6000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:58.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.599+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000cb20 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.599+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000cca0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.599+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60014680 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.599+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d681467a0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.599+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d68145b10 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.600+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d68146cc0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.601+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d6001d3b0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.602+0000 7f4d5e7fc640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.603+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4d600888b0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.603+0000 7f4d6d9f3640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:58.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.603+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f4d4c072020 con 0x7f4d6815a4f0 2023-12-19T13:50:58.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.603+0000 7f4d6d9f3640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4d64036000 tx=0x7f4d6403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:58.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.607+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d60019020 con 0x7f4d6815a4f0 2023-12-19T13:50:58.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.796+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d680ad8f0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.796+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2304627681 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d68146cc0 con 0x7f4d6815a4f0 2023-12-19T13:50:58.796 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:50:58.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4c06a430 msgr2=0x7f4d4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4d64036000 tx=0x7f4d6403c040 comp rx=0 tx=0).stop 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6815a4f0 msgr2=0x7f4d680abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6815a4f0 0x7f4d680abdb0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b9e0 tx=0x7f4d6000bea0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 shutdown_connections 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6815a4f0 0x7f4d680abdb0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680cd4e0 0x7f4d681455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 --2- 172.21.15.113:0/2304627681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d680b0470 0x7f4d68146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 >> 172.21.15.113:0/2304627681 conn(0x7f4d6806f630 msgr2=0x7f4d680cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 shutdown_connections 2023-12-19T13:50:58.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:58.799+0000 7f4d6e9f5640 1 -- 172.21.15.113:0/2304627681 wait complete. 2023-12-19T13:50:58.818 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:50:59.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.032+0000 7f3006d00640 1 Processor -- start 2023-12-19T13:50:59.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.033+0000 7f3006d00640 1 -- start start 2023-12-19T13:50:59.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.034+0000 7f3006d00640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30000ce820 0x7f30000d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.034+0000 7f3006d00640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30000cd840 con 0x7f30000d2b00 2023-12-19T13:50:59.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.034+0000 7f3006d00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30000b6e90 con 0x7f3000146e10 2023-12-19T13:50:59.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.034+0000 7f3006d00640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30000d2430 con 0x7f30000ce820 2023-12-19T13:50:59.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.035+0000 7f300529d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30000ce820 0x7f30000d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.035+0000 7f2ffffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f30000d2b00 0x7f30000ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39268/0 (socket says 172.21.15.113:39268) 2023-12-19T13:50:59.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.035+0000 7f2ffffff640 1 -- 172.21.15.113:0/588975842 learned_addr learned my addr 172.21.15.113:0/588975842 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:50:59.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.035+0000 7f300529d640 1 -- 172.21.15.113:0/588975842 >> v1:172.21.15.151:6789/0 conn(0x7f3000146e10 legacy=0x7f30000b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:59.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.035+0000 7f300529d640 1 -- 172.21.15.113:0/588975842 >> v1:172.21.15.113:6789/0 conn(0x7f30000d2b00 legacy=0x7f30000ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.035+0000 7f300529d640 1 -- 172.21.15.113:0/588975842 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000d2620 con 0x7f30000ce820 2023-12-19T13:50:59.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.035+0000 7f2fff7fe640 1 -- 172.21.15.113:0/588975842 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147344996 0 0) 0x7f30000cd840 con 0x7f30000d2b00 2023-12-19T13:50:59.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.036+0000 7f300529d640 1 --2- 172.21.15.113:0/588975842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30000ce820 0x7f30000d1ef0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097a0 tx=0x7f2ff802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d758aed4a11cb44e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f2fff7fe640 1 -- 172.21.15.113:0/588975842 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff802e070 con 0x7f30000ce820 2023-12-19T13:50:59.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f2fff7fe640 1 -- 172.21.15.113:0/588975842 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80315a0 con 0x7f30000ce820 2023-12-19T13:50:59.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f2fff7fe640 1 -- 172.21.15.113:0/588975842 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8031930 con 0x7f30000ce820 2023-12-19T13:50:59.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f3006d00640 1 -- 172.21.15.113:0/588975842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30000ce820 msgr2=0x7f30000d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f3006d00640 1 --2- 172.21.15.113:0/588975842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30000ce820 0x7f30000d1ef0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097a0 tx=0x7f2ff802b840 comp rx=0 tx=0).stop 2023-12-19T13:50:59.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f3006d00640 1 -- 172.21.15.113:0/588975842 shutdown_connections 2023-12-19T13:50:59.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f3006d00640 1 --2- 172.21.15.113:0/588975842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30000ce820 0x7f30000d1ef0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f3006d00640 1 -- 172.21.15.113:0/588975842 >> 172.21.15.113:0/588975842 conn(0x7f30000b29c0 msgr2=0x7f30000b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:59.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.037+0000 7f3006d00640 1 -- 172.21.15.113:0/588975842 shutdown_connections 2023-12-19T13:50:59.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.038+0000 7f3006d00640 1 -- 172.21.15.113:0/588975842 wait complete. 2023-12-19T13:50:59.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.039+0000 7f3006d00640 1 Processor -- start 2023-12-19T13:50:59.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.039+0000 7f3006d00640 1 -- start start 2023-12-19T13:50:59.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.040+0000 7f3006d00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30000ce820 0x7f30001402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.040+0000 7f3006d00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30000d2b00 0x7f300015e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.040+0000 7f3006d00640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3000146e10 0x7f3000161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.040+0000 7f3006d00640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000140810 con 0x7f3000146e10 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.040+0000 7f3006d00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300015e920 con 0x7f30000ce820 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.040+0000 7f3006d00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300015ec00 con 0x7f30000d2b00 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3000146e10 0x7f3000161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3000146e10 0x7f3000161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44644/0 (socket says 172.21.15.113:44644) 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 -- 172.21.15.113:0/747947821 learned_addr learned my addr 172.21.15.113:0/747947821 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f3004a9c640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30000ce820 0x7f30001402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f2ffffff640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30000d2b00 0x7f300015e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 -- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30000d2b00 msgr2=0x7f300015e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30000d2b00 0x7f300015e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 -- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30000ce820 msgr2=0x7f30001402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30000ce820 0x7f30001402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 -- 172.21.15.113:0/747947821 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8009400 con 0x7f3000146e10 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.041+0000 7f300529d640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3000146e10 0x7f3000161290 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097a0 tx=0x7f2ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.042+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8032840 con 0x7f3000146e10 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.042+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80329a0 con 0x7f3000146e10 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.042+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8032d50 con 0x7f3000146e10 2023-12-19T13:50:59.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.042+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300015eee0 con 0x7f3000146e10 2023-12-19T13:50:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.042+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300015f4a0 con 0x7f3000146e10 2023-12-19T13:50:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.043+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30000b6780 con 0x7f3000146e10 2023-12-19T13:50:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.044+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ff803b3f0 con 0x7f3000146e10 2023-12-19T13:50:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.045+0000 7f2ffd7fa640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.045+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2ff80aa980 con 0x7f3000146e10 2023-12-19T13:50:59.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.045+0000 7f3004a9c640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.045+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f2fec072020 con 0x7f3000146e10 2023-12-19T13:50:59.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.046+0000 7f3004a9c640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009f20 tx=0x7f2ff00094d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.049+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ff8076020 con 0x7f3000146e10 2023-12-19T13:50:59.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.240+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f300015f690 con 0x7f3000146e10 2023-12-19T13:50:59.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.241+0000 7f2ffd7fa640 1 -- 172.21.15.113:0/747947821 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ff8079640 con 0x7f3000146e10 2023-12-19T13:50:59.240 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 msgr2=0x7f2fec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009f20 tx=0x7f2ff00094d0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3000146e10 msgr2=0x7f3000161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3000146e10 0x7f3000161290 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097a0 tx=0x7f2ff80046c0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 shutdown_connections 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3000146e10 0x7f3000161290 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30000d2b00 0x7f300015e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 --2- 172.21.15.113:0/747947821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30000ce820 0x7f30001402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 >> 172.21.15.113:0/747947821 conn(0x7f30000b29c0 msgr2=0x7f30000704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 shutdown_connections 2023-12-19T13:50:59.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.244+0000 7f3006d00640 1 -- 172.21.15.113:0/747947821 wait complete. 2023-12-19T13:50:59.263 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:50:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.480+0000 7fa56b3b9640 1 Processor -- start 2023-12-19T13:50:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.480+0000 7fa56b3b9640 1 -- start start 2023-12-19T13:50:59.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa56b3b9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa5640cf5b0 0x7fa5640b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa56b3b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56415fde0 con 0x7fa56415b1d0 2023-12-19T13:50:59.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa56b3b9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5640b2bc0 con 0x7fa5640b2760 2023-12-19T13:50:59.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa56b3b9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5640b2400 con 0x7fa5640cf5b0 2023-12-19T13:50:59.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa569155640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa56415b1d0 0x7fa56415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39278/0 (socket says 172.21.15.113:39278) 2023-12-19T13:50:59.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa569155640 1 -- 172.21.15.113:0/2900960773 learned_addr learned my addr 172.21.15.113:0/2900960773 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:50:59.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa569956640 1 --2- 172.21.15.113:0/2900960773 >> v2:172.21.15.113:3300/0 conn(0x7fa5640cf5b0 0x7fa5640b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa55bfff640 1 -- 172.21.15.113:0/2900960773 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081818619 0 0) 0x7fa56415fde0 con 0x7fa56415b1d0 2023-12-19T13:50:59.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.482+0000 7fa55bfff640 1 -- 172.21.15.113:0/2900960773 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa550003520 con 0x7fa56415b1d0 2023-12-19T13:50:59.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.483+0000 7fa569956640 1 -- 172.21.15.113:0/2900960773 >> v1:172.21.15.151:6789/0 conn(0x7fa5640b2760 legacy=0x7fa5640ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:59.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.483+0000 7fa569956640 1 -- 172.21.15.113:0/2900960773 >> v1:172.21.15.113:6789/0 conn(0x7fa56415b1d0 legacy=0x7fa56415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.483+0000 7fa569956640 1 -- 172.21.15.113:0/2900960773 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56415ef10 con 0x7fa5640cf5b0 2023-12-19T13:50:59.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.484+0000 7fa569956640 1 --2- 172.21.15.113:0/2900960773 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5640cf5b0 0x7fa5640b1ec0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009d90 tx=0x7fa55c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6245ad248fbf6719 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.484+0000 7fa55bfff640 1 -- 172.21.15.113:0/2900960773 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c02ccf0 con 0x7fa5640cf5b0 2023-12-19T13:50:59.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.484+0000 7fa55bfff640 1 -- 172.21.15.113:0/2900960773 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c02ce50 con 0x7fa5640cf5b0 2023-12-19T13:50:59.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.484+0000 7fa55bfff640 1 -- 172.21.15.113:0/2900960773 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c034640 con 0x7fa5640cf5b0 2023-12-19T13:50:59.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.485+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2900960773 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5640cf5b0 msgr2=0x7fa5640b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.485+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2900960773 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5640cf5b0 0x7fa5640b1ec0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009d90 tx=0x7fa55c02bf40 comp rx=0 tx=0).stop 2023-12-19T13:50:59.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.485+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2900960773 shutdown_connections 2023-12-19T13:50:59.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.485+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2900960773 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5640cf5b0 0x7fa5640b1ec0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.485+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2900960773 >> 172.21.15.113:0/2900960773 conn(0x7fa564073150 msgr2=0x7fa5640659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:59.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.485+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2900960773 shutdown_connections 2023-12-19T13:50:59.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.485+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2900960773 wait complete. 2023-12-19T13:50:59.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.487+0000 7fa56b3b9640 1 Processor -- start 2023-12-19T13:50:59.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.487+0000 7fa56b3b9640 1 -- start start 2023-12-19T13:50:59.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa56b3b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5640b2760 0x7fa564144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa56b3b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5640cf5b0 0x7fa56415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa56b3b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56415b1d0 0x7fa56406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa56b3b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56415c2d0 con 0x7fa56415b1d0 2023-12-19T13:50:59.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa56b3b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56415b650 con 0x7fa5640cf5b0 2023-12-19T13:50:59.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa56b3b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56415b930 con 0x7fa5640b2760 2023-12-19T13:50:59.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56415b1d0 0x7fa56406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56415b1d0 0x7fa56406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44660/0 (socket says 172.21.15.113:44660) 2023-12-19T13:50:59.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 -- 172.21.15.113:0/2724255658 learned_addr learned my addr 172.21.15.113:0/2724255658 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 -- 172.21.15.113:0/2724255658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5640b2760 msgr2=0x7fa564144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5640b2760 0x7fa564144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 -- 172.21.15.113:0/2724255658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5640cf5b0 msgr2=0x7fa56415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa568954640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5640cf5b0 0x7fa56415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5640cf5b0 0x7fa56415e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.488+0000 7fa569956640 1 -- 172.21.15.113:0/2724255658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009a70 con 0x7fa56415b1d0 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.489+0000 7fa569956640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56415b1d0 0x7fa56406c9d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009d90 tx=0x7fa55c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.489+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c003b90 con 0x7fa56415b1d0 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.489+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c003cf0 con 0x7fa56415b1d0 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.489+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c004270 con 0x7fa56415b1d0 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.489+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56415bc10 con 0x7fa56415b1d0 2023-12-19T13:50:59.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.489+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa564144dd0 con 0x7fa56415b1d0 2023-12-19T13:50:59.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.490+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa564061910 con 0x7fa56415b1d0 2023-12-19T13:50:59.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.491+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa55c03b050 con 0x7fa56415b1d0 2023-12-19T13:50:59.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.492+0000 7fa559ffb640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54806a430 0x7fa54806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.492+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa55c0aae70 con 0x7fa56415b1d0 2023-12-19T13:50:59.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.492+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fa548072020 con 0x7fa56415b1d0 2023-12-19T13:50:59.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.492+0000 7fa569155640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54806a430 0x7fa54806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.493+0000 7fa569155640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54806a430 0x7fa54806c8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa560001570 tx=0x7fa560007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.496+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa55c076410 con 0x7fa56415b1d0 2023-12-19T13:50:59.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.685+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5640cdc90 con 0x7fa56415b1d0 2023-12-19T13:50:59.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.686+0000 7fa559ffb640 1 -- 172.21.15.113:0/2724255658 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa55c039030 con 0x7fa56415b1d0 2023-12-19T13:50:59.685 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:50:59.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.688+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54806a430 msgr2=0x7fa54806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.688+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54806a430 0x7fa54806c8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa560001570 tx=0x7fa560007930 comp rx=0 tx=0).stop 2023-12-19T13:50:59.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.688+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56415b1d0 msgr2=0x7fa56406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.688+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56415b1d0 0x7fa56406c9d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009d90 tx=0x7fa55c004a40 comp rx=0 tx=0).stop 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 shutdown_connections 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54806a430 0x7fa54806c8f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56415b1d0 0x7fa56406c9d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5640cf5b0 0x7fa56415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 --2- 172.21.15.113:0/2724255658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5640b2760 0x7fa564144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 >> 172.21.15.113:0/2724255658 conn(0x7fa564073150 msgr2=0x7fa564154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 shutdown_connections 2023-12-19T13:50:59.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.689+0000 7fa56b3b9640 1 -- 172.21.15.113:0/2724255658 wait complete. 2023-12-19T13:50:59.706 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:50:59.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.922+0000 7f4711e70640 1 Processor -- start 2023-12-19T13:50:59.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.922+0000 7f4711e70640 1 -- start start 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f4711e70640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f470c157bf0 0x7f470c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f4711e70640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f470c0b0810 0x7f470c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f4711e70640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c15b740 con 0x7f470c0ae110 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f4711e70640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c06b8c0 con 0x7f470c157bf0 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f4711e70640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c0ae640 con 0x7f470c0b0810 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f470b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f470c157bf0 0x7f470c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f470b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f470c157bf0 0x7f470c15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44666/0 (socket says 172.21.15.113:44666) 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f470b7fe640 1 -- 172.21.15.113:0/2651255404 learned_addr learned my addr 172.21.15.113:0/2651255404 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.924+0000 7f470bfff640 1 --2- 172.21.15.113:0/2651255404 >> v2:172.21.15.151:3300/0 conn(0x7f470c0b0810 0x7f470c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.925+0000 7f470b7fe640 1 -- 172.21.15.113:0/2651255404 >> v2:172.21.15.151:3300/0 conn(0x7f470c0b0810 msgr2=0x7f470c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:59.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.925+0000 7f470b7fe640 1 --2- 172.21.15.113:0/2651255404 >> v2:172.21.15.151:3300/0 conn(0x7f470c0b0810 0x7f470c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.925+0000 7f470b7fe640 1 -- 172.21.15.113:0/2651255404 >> v1:172.21.15.151:6789/0 conn(0x7f470c0ae110 legacy=0x7f470c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:50:59.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.925+0000 7f470b7fe640 1 -- 172.21.15.113:0/2651255404 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0ae920 con 0x7f470c157bf0 2023-12-19T13:50:59.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.925+0000 7f470bfff640 1 --2- 172.21.15.113:0/2651255404 >> v2:172.21.15.151:3300/0 conn(0x7f470c0b0810 0x7f470c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:50:59.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.926+0000 7f470b7fe640 1 --2- 172.21.15.113:0/2651255404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c15b200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f470c0b1210 tx=0x7f46fc02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e6b18097856e54 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.926+0000 7f470a7fc640 1 -- 172.21.15.113:0/2651255404 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc02ee90 con 0x7f470c157bf0 2023-12-19T13:50:59.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.926+0000 7f470a7fc640 1 -- 172.21.15.113:0/2651255404 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc036440 con 0x7f470c157bf0 2023-12-19T13:50:59.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.926+0000 7f470a7fc640 1 -- 172.21.15.113:0/2651255404 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0367d0 con 0x7f470c157bf0 2023-12-19T13:50:59.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 -- 172.21.15.113:0/2651255404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 msgr2=0x7f470c15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 --2- 172.21.15.113:0/2651255404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c15b200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f470c0b1210 tx=0x7f46fc02e0e0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 -- 172.21.15.113:0/2651255404 shutdown_connections 2023-12-19T13:50:59.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 --2- 172.21.15.113:0/2651255404 >> v2:172.21.15.151:3300/0 conn(0x7f470c0b0810 0x7f470c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 --2- 172.21.15.113:0/2651255404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c15b200 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 -- 172.21.15.113:0/2651255404 >> 172.21.15.113:0/2651255404 conn(0x7f470c0cbb70 msgr2=0x7f470c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:50:59.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 -- 172.21.15.113:0/2651255404 shutdown_connections 2023-12-19T13:50:59.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.927+0000 7f4711e70640 1 -- 172.21.15.113:0/2651255404 wait complete. 2023-12-19T13:50:59.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.929+0000 7f4711e70640 1 Processor -- start 2023-12-19T13:50:59.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.929+0000 7f4711e70640 1 -- start start 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f4711e70640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f470c0ae110 0x7f470c0cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f4711e70640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f470c0b0810 0x7f470c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f4711e70640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f4711e70640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c15c8a0 con 0x7f470c157bf0 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f4711e70640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c15bc90 con 0x7f470c0b0810 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f4711e70640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c15bf70 con 0x7f470c0ae110 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44678/0 (socket says 172.21.15.113:44678) 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 -- 172.21.15.113:0/3208183858 learned_addr learned my addr 172.21.15.113:0/3208183858 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470affd640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f470c0b0810 0x7f470c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470b7fe640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f470c0ae110 0x7f470c0cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 -- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f470c0ae110 msgr2=0x7f470c0cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f470c0ae110 0x7f470c0cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 -- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f470c0b0810 msgr2=0x7f470c159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f470c0b0810 0x7f470c159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.931+0000 7f470bfff640 1 -- 172.21.15.113:0/3208183858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc00b770 con 0x7f470c157bf0 2023-12-19T13:50:59.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.932+0000 7f470bfff640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c157fd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f470400cef0 tx=0x7f470400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.932+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400d840 con 0x7f470c157bf0 2023-12-19T13:50:59.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.932+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400d9c0 con 0x7f470c157bf0 2023-12-19T13:50:59.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.932+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400dd70 con 0x7f470c157bf0 2023-12-19T13:50:59.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.932+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c15c250 con 0x7f470c157bf0 2023-12-19T13:50:59.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.932+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c153fb0 con 0x7f470c157bf0 2023-12-19T13:50:59.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.933+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c15ca50 con 0x7f470c157bf0 2023-12-19T13:50:59.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.934+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f470401e3b0 con 0x7f470c157bf0 2023-12-19T13:50:59.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.936+0000 7f46f3fff640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f46f806a460 0x7f46f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:50:59.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.936+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f47040894f0 con 0x7f470c157bf0 2023-12-19T13:50:59.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.936+0000 7f470b7fe640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f46f806a460 0x7f46f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:50:59.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.936+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f46f8072050 con 0x7f470c157bf0 2023-12-19T13:50:59.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.937+0000 7f470b7fe640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f46f806a460 0x7f46f806c920 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f46fc038000 tx=0x7f46fc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:50:59.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:50:59.941+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f470401a020 con 0x7f470c157bf0 2023-12-19T13:51:00.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.143+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f470c061910 con 0x7f470c157bf0 2023-12-19T13:51:00.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.144+0000 7f46f3fff640 1 -- 172.21.15.113:0/3208183858 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7f470c15ca50 con 0x7f470c157bf0 2023-12-19T13:51:00.143 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f46f806a460 msgr2=0x7f46f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f46f806a460 0x7f46f806c920 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f46fc038000 tx=0x7f46fc032000 comp rx=0 tx=0).stop 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 msgr2=0x7f470c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c157fd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f470400cef0 tx=0x7f470400a710 comp rx=0 tx=0).stop 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 shutdown_connections 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f46f806a460 0x7f46f806c920 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f470c157bf0 0x7f470c157fd0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f470c0b0810 0x7f470c159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 --2- 172.21.15.113:0/3208183858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f470c0ae110 0x7f470c0cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 >> 172.21.15.113:0/3208183858 conn(0x7f470c0cbb70 msgr2=0x7f470c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 shutdown_connections 2023-12-19T13:51:00.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.146+0000 7f4711e70640 1 -- 172.21.15.113:0/3208183858 wait complete. 2023-12-19T13:51:00.164 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:51:00.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:00.165 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:51:00.262 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:51:00.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:00.262 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:51:00.307 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:51:00.307 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:00.368 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:51:00.368 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:00.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:00.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.688+0000 7fdedb7c4640 1 Processor -- start 2023-12-19T13:51:00.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.688+0000 7fdedb7c4640 1 -- start start 2023-12-19T13:51:00.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.690+0000 7fdedb7c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fded4147180 0x7fded41611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.691+0000 7fded9560640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fded4146da0 0x7fded40aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:59532/0 (socket says 172.21.15.113:59532) 2023-12-19T13:51:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.691+0000 7fded8d5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fded4147180 0x7fded41611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.691+0000 7fded8d5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fded4147180 0x7fded41611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44690/0 (socket says 172.21.15.113:44690) 2023-12-19T13:51:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.691+0000 7fded8d5f640 1 -- 172.21.15.113:0/1890421447 learned_addr learned my addr 172.21.15.113:0/1890421447 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.691+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded40d1070 con 0x7fded4161730 2023-12-19T13:51:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.691+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded4162020 con 0x7fded4146da0 2023-12-19T13:51:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.691+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded4161ba0 con 0x7fded4147180 2023-12-19T13:51:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.692+0000 7fdecbfff640 1 -- 172.21.15.113:0/1890421447 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075833226 0 0) 0x7fded4162020 con 0x7fded4146da0 2023-12-19T13:51:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.692+0000 7fded8d5f640 1 -- 172.21.15.113:0/1890421447 >> v1:172.21.15.151:6789/0 conn(0x7fded4146da0 legacy=0x7fded40aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.692+0000 7fded8d5f640 1 -- 172.21.15.113:0/1890421447 >> v1:172.21.15.113:6789/0 conn(0x7fded4161730 legacy=0x7fded40d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.692+0000 7fded8d5f640 1 -- 172.21.15.113:0/1890421447 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40aabd0 con 0x7fded4147180 2023-12-19T13:51:00.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.694+0000 7fded8d5f640 1 --2- 172.21.15.113:0/1890421447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4147180 0x7fded41611f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009870 tx=0x7fdec402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274c4319e2621d7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:00.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.695+0000 7fdecbfff640 1 -- 172.21.15.113:0/1890421447 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec402f850 con 0x7fded4147180 2023-12-19T13:51:00.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.695+0000 7fdecbfff640 1 -- 172.21.15.113:0/1890421447 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec402f9b0 con 0x7fded4147180 2023-12-19T13:51:00.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.695+0000 7fdecbfff640 1 -- 172.21.15.113:0/1890421447 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec402fd40 con 0x7fded4147180 2023-12-19T13:51:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.696+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4147180 msgr2=0x7fded41611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.696+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1890421447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4147180 0x7fded41611f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009870 tx=0x7fdec402ba30 comp rx=0 tx=0).stop 2023-12-19T13:51:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.696+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 shutdown_connections 2023-12-19T13:51:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.696+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1890421447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4147180 0x7fded41611f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.696+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 >> 172.21.15.113:0/1890421447 conn(0x7fded4071a50 msgr2=0x7fded40d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.696+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 shutdown_connections 2023-12-19T13:51:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.696+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1890421447 wait complete. 2023-12-19T13:51:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.699+0000 7fdedb7c4640 1 Processor -- start 2023-12-19T13:51:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.699+0000 7fdedb7c4640 1 -- start start 2023-12-19T13:51:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fdedb7c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded4146da0 0x7fded4138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fdedb7c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4161730 0x7fded41f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fdedb7c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded4145030 0x7fded41454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:00.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fdedb7c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4145a00 con 0x7fded4161730 2023-12-19T13:51:00.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fdedb7c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded413d5c0 con 0x7fded4146da0 2023-12-19T13:51:00.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fdedb7c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded41f70d0 con 0x7fded4145030 2023-12-19T13:51:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fded8d5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4161730 0x7fded41f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fded8d5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4161730 0x7fded41f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44698/0 (socket says 172.21.15.113:44698) 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fded8d5f640 1 -- 172.21.15.113:0/1550411772 learned_addr learned my addr 172.21.15.113:0/1550411772 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.701+0000 7fded9560640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded4146da0 0x7fded4138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.702+0000 7fded9d61640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded4145030 0x7fded41454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.702+0000 7fded8d5f640 1 -- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded4145030 msgr2=0x7fded41454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.702+0000 7fded8d5f640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded4145030 0x7fded41454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.702+0000 7fded8d5f640 1 -- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded4146da0 msgr2=0x7fded4138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.702+0000 7fded8d5f640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded4146da0 0x7fded4138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.702+0000 7fded8d5f640 1 -- 172.21.15.113:0/1550411772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40094d0 con 0x7fded4161730 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.702+0000 7fded8d5f640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4161730 0x7fded41f2830 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdec40090b0 tx=0x7fdec40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.703+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec403b040 con 0x7fded4161730 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.703+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec4037d10 con 0x7fded4161730 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.703+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded41f73b0 con 0x7fded4161730 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.703+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4004260 con 0x7fded4161730 2023-12-19T13:51:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.703+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded4142ef0 con 0x7fded4161730 2023-12-19T13:51:00.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.705+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded4073ec0 con 0x7fded4161730 2023-12-19T13:51:00.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.707+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdec4003610 con 0x7fded4161730 2023-12-19T13:51:00.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.708+0000 7fdec9ffb640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdeb806a480 0x7fdeb806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:00.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.709+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdec40ab450 con 0x7fded4161730 2023-12-19T13:51:00.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.709+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fdeb8072070 con 0x7fded4161730 2023-12-19T13:51:00.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.710+0000 7fded9560640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdeb806a480 0x7fdeb806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:00.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.711+0000 7fded9560640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdeb806a480 0x7fdeb806c940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fded0000f60 tx=0x7fded0007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:00.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.714+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdec4076c90 con 0x7fded4161730 2023-12-19T13:51:00.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.915+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fded4061910 con 0x7fded4161730 2023-12-19T13:51:00.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.917+0000 7fdec9ffb640 1 -- 172.21.15.113:0/1550411772 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16292 (secure 0 0 0) 0x7fdec407a2b0 con 0x7fded4161730 2023-12-19T13:51:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:00.918 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":78,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:50:21.681397+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":4}]},{"pgid":"9.3e","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:00.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.920+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdeb806a480 msgr2=0x7fdeb806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.920+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdeb806a480 0x7fdeb806c940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fded0000f60 tx=0x7fded0007d50 comp rx=0 tx=0).stop 2023-12-19T13:51:00.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.920+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4161730 msgr2=0x7fded41f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:00.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.920+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4161730 0x7fded41f2830 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdec40090b0 tx=0x7fdec40046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 shutdown_connections 2023-12-19T13:51:00.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdeb806a480 0x7fdeb806c940 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded4145030 0x7fded41454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fded4161730 0x7fded41f2830 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 --2- 172.21.15.113:0/1550411772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded4146da0 0x7fded4138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:00.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 >> 172.21.15.113:0/1550411772 conn(0x7fded4071a50 msgr2=0x7fded41602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:00.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 shutdown_connections 2023-12-19T13:51:00.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:00.921+0000 7fdedb7c4640 1 -- 172.21.15.113:0/1550411772 wait complete. 2023-12-19T13:51:00.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:49:34.219200+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:49:35.406746+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:51:00.939 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:51:01.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.156+0000 7fdb4ec26640 1 Processor -- start 2023-12-19T13:51:01.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.156+0000 7fdb4ec26640 1 -- start start 2023-12-19T13:51:01.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.158+0000 7fdb4ec26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb4815b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.158+0000 7fdb4ec26640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb480b0070 0x7fdb480b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.158+0000 7fdb4ec26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb480b0a10 con 0x7fdb480cb810 2023-12-19T13:51:01.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.158+0000 7fdb4ec26640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480ccf20 con 0x7fdb480b0070 2023-12-19T13:51:01.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.158+0000 7fdb4ec26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480b1b50 con 0x7fdb48154760 2023-12-19T13:51:01.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.159+0000 7fdb4d1c3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb480b0070 0x7fdb480b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.159+0000 7fdb4c9c2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb4815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.159+0000 7fdb4c9c2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb4815b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:39320/0 (socket says 172.21.15.113:39320) 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.159+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/1001005753 learned_addr learned my addr 172.21.15.113:0/1001005753 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.159+0000 7fdb4d1c3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb480b0070 0x7fdb480b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:36968/0 (socket says 172.21.15.113:36968) 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.159+0000 7fdb47fff640 1 --1- 172.21.15.113:0/1001005753 >> v1:172.21.15.151:6789/0 conn(0x7fdb480cb810 0x7fdb480b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:59546/0 (socket says 172.21.15.113:59546) 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.160+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/1001005753 >> v2:172.21.15.151:3300/0 conn(0x7fdb480b0070 msgr2=0x7fdb480b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.160+0000 7fdb4c9c2640 1 --2- 172.21.15.113:0/1001005753 >> v2:172.21.15.151:3300/0 conn(0x7fdb480b0070 0x7fdb480b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.160+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/1001005753 >> v1:172.21.15.151:6789/0 conn(0x7fdb480cb810 legacy=0x7fdb480b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.160+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/1001005753 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480ccbd0 con 0x7fdb48154760 2023-12-19T13:51:01.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.160+0000 7fdb4d1c3640 1 --2- 172.21.15.113:0/1001005753 >> v2:172.21.15.151:3300/0 conn(0x7fdb480b0070 0x7fdb480b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:51:01.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.161+0000 7fdb4c9c2640 1 --2- 172.21.15.113:0/1001005753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb4815b290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00bb10 tx=0x7fdb3c02e0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1968c20ff39a7d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:01.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.162+0000 7fdb477fe640 1 -- 172.21.15.113:0/1001005753 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c02ee70 con 0x7fdb48154760 2023-12-19T13:51:01.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.162+0000 7fdb477fe640 1 -- 172.21.15.113:0/1001005753 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c036440 con 0x7fdb48154760 2023-12-19T13:51:01.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.162+0000 7fdb477fe640 1 -- 172.21.15.113:0/1001005753 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0367d0 con 0x7fdb48154760 2023-12-19T13:51:01.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 -- 172.21.15.113:0/1001005753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 msgr2=0x7fdb4815b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/1001005753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb4815b290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00bb10 tx=0x7fdb3c02e0c0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 -- 172.21.15.113:0/1001005753 shutdown_connections 2023-12-19T13:51:01.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/1001005753 >> v2:172.21.15.151:3300/0 conn(0x7fdb480b0070 0x7fdb480b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/1001005753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb4815b290 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 -- 172.21.15.113:0/1001005753 >> 172.21.15.113:0/1001005753 conn(0x7fdb48073150 msgr2=0x7fdb480659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:01.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 -- 172.21.15.113:0/1001005753 shutdown_connections 2023-12-19T13:51:01.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.163+0000 7fdb4ec26640 1 -- 172.21.15.113:0/1001005753 wait complete. 2023-12-19T13:51:01.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.165+0000 7fdb4ec26640 1 Processor -- start 2023-12-19T13:51:01.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.165+0000 7fdb4ec26640 1 -- start start 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4ec26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb480b0070 0x7fdb481f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4ec26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb480cb810 0x7fdb481560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4ec26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb481f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4ec26640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48156620 con 0x7fdb480b0070 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4ec26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480cf8d0 con 0x7fdb480cb810 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4ec26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48147ea0 con 0x7fdb48154760 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4c9c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb480b0070 0x7fdb481f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4c9c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb480b0070 0x7fdb481f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44700/0 (socket says 172.21.15.113:44700) 2023-12-19T13:51:01.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/435914078 learned_addr learned my addr 172.21.15.113:0/435914078 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:01.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/435914078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 msgr2=0x7fdb481f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4c9c2640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb481f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/435914078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb480cb810 msgr2=0x7fdb481560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.166+0000 7fdb4c9c2640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb480cb810 0x7fdb481560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.167+0000 7fdb4c9c2640 1 -- 172.21.15.113:0/435914078 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40009a70 con 0x7fdb480b0070 2023-12-19T13:51:01.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.167+0000 7fdb4c9c2640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb480b0070 0x7fdb481f6a10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c02e100 tx=0x7fdb3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:01.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.167+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c03f850 con 0x7fdb480b0070 2023-12-19T13:51:01.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.167+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c03f9d0 con 0x7fdb480b0070 2023-12-19T13:51:01.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.167+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c03fd80 con 0x7fdb480b0070 2023-12-19T13:51:01.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.167+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3c00b770 con 0x7fdb480b0070 2023-12-19T13:51:01.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.167+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb481f5f30 con 0x7fdb480b0070 2023-12-19T13:51:01.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.169+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48061910 con 0x7fdb480b0070 2023-12-19T13:51:01.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.169+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb3c03d070 con 0x7fdb480b0070 2023-12-19T13:51:01.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.171+0000 7fdb457fa640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb2c06a430 0x7fdb2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.171+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdb3c0aaff0 con 0x7fdb480b0070 2023-12-19T13:51:01.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.171+0000 7fdb47fff640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb2c06a430 0x7fdb2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.171+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fdb2c072020 con 0x7fdb480b0070 2023-12-19T13:51:01.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.172+0000 7fdb47fff640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb2c06a430 0x7fdb2c06c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdb34000f60 tx=0x7fdb34007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:01.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.176+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb3c076680 con 0x7fdb480b0070 2023-12-19T13:51:01.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.363+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb480ad7a0 con 0x7fdb480b0070 2023-12-19T13:51:01.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.364+0000 7fdb457fa640 1 -- 172.21.15.113:0/435914078 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb3c0430a0 con 0x7fdb480b0070 2023-12-19T13:51:01.364 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb2c06a430 msgr2=0x7fdb2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb2c06a430 0x7fdb2c06c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdb34000f60 tx=0x7fdb34007a00 comp rx=0 tx=0).stop 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb480b0070 msgr2=0x7fdb481f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb480b0070 0x7fdb481f6a10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c02e100 tx=0x7fdb3c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 shutdown_connections 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb2c06a430 0x7fdb2c06c8f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb48154760 0x7fdb481f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb480cb810 0x7fdb481560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 --2- 172.21.15.113:0/435914078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb480b0070 0x7fdb481f6a10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 >> 172.21.15.113:0/435914078 conn(0x7fdb48073150 msgr2=0x7fdb48151ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:01.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 shutdown_connections 2023-12-19T13:51:01.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.367+0000 7fdb4ec26640 1 -- 172.21.15.113:0/435914078 wait complete. 2023-12-19T13:51:01.384 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:51:01.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.604+0000 7fb9e5d58640 1 Processor -- start 2023-12-19T13:51:01.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.604+0000 7fb9e5d58640 1 -- start start 2023-12-19T13:51:01.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.606+0000 7fb9e5d58640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e00b1710 0x7fb9e006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.606+0000 7fb9e5d58640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb9e015e040 0x7fb9e015e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.606+0000 7fb9e5d58640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e015e9c0 con 0x7fb9e0157aa0 2023-12-19T13:51:01.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.606+0000 7fb9e5d58640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e00b2600 con 0x7fb9e015e040 2023-12-19T13:51:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.606+0000 7fb9e5d58640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00b1d60 con 0x7fb9e00b1710 2023-12-19T13:51:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.606+0000 7fb9df7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb9e0157aa0 0x7fb9e0161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39294/0 (socket says 172.21.15.113:39294) 2023-12-19T13:51:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.606+0000 7fb9df7fe640 1 -- 172.21.15.113:0/2493671712 learned_addr learned my addr 172.21.15.113:0/2493671712 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9d7fff640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e00b1710 0x7fb9e006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9dffff640 1 --2- 172.21.15.113:0/2493671712 >> v2:172.21.15.151:3300/0 conn(0x7fb9e015e040 0x7fb9e015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849480617 0 0) 0x7fb9e015e9c0 con 0x7fb9e0157aa0 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9cc003520 con 0x7fb9e0157aa0 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4158350929 0 0) 0x7fb9cc003520 con 0x7fb9e0157aa0 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e00b1710 msgr2=0x7fb9e006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e00b1710 0x7fb9e006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 >> v2:172.21.15.151:3300/0 conn(0x7fb9e015e040 msgr2=0x7fb9e015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 --2- 172.21.15.113:0/2493671712 >> v2:172.21.15.151:3300/0 conn(0x7fb9e015e040 0x7fb9e015e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00b2040 con 0x7fb9e0157aa0 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb9d0001670 con 0x7fb9e0157aa0 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 >> v1:172.21.15.113:6789/0 conn(0x7fb9e0157aa0 legacy=0x7fb9e0161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc0039e0 0x7fb9cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e00b1710 0x7fb9cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00b2600 con 0x7fb9cc0047c0 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00b1d60 con 0x7fb9cc0039e0 2023-12-19T13:51:01.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc00b9b0 con 0x7fb9e00b1710 2023-12-19T13:51:01.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.607+0000 7fb9d7fff640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.608+0000 7fb9d7fff640 1 -- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e00b1710 msgr2=0x7fb9cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:01.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.608+0000 7fb9d7fff640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e00b1710 0x7fb9cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.608+0000 7fb9d7fff640 1 -- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc0039e0 msgr2=0x7fb9cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:01.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.608+0000 7fb9d7fff640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc0039e0 0x7fb9cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.608+0000 7fb9d7fff640 1 -- 172.21.15.113:0/2493671712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc003520 con 0x7fb9cc0047c0 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.609+0000 7fb9d7fff640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009ac0 tx=0x7fb9cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bb041f7d2c9aa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.609+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c802c710 con 0x7fb9cc0047c0 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.609+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c802c870 con 0x7fb9cc0047c0 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.609+0000 7fb9deffd640 1 -- 172.21.15.113:0/2493671712 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c802cc00 con 0x7fb9cc0047c0 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.610+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2493671712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9cc0047c0 msgr2=0x7fb9cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.610+0000 7fb9e5d58640 1 --2- 172.21.15.113:0/2493671712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009ac0 tx=0x7fb9cc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.610+0000 7fb9dffff640 1 -- 172.21.15.113:0/2493671712 reap_dead start 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.610+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2493671712 shutdown_connections 2023-12-19T13:51:01.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.610+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2493671712 >> 172.21.15.113:0/2493671712 conn(0x7fb9e00cbb70 msgr2=0x7fb9e00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.610+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2493671712 shutdown_connections 2023-12-19T13:51:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.610+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2493671712 wait complete. 2023-12-19T13:51:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.612+0000 7fb9e5d58640 1 Processor -- start 2023-12-19T13:51:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.612+0000 7fb9e5d58640 1 -- start start 2023-12-19T13:51:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9e5d58640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc0047c0 0x7fb9e015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9e5d58640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e0148c70 0x7fb9e01f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9e5d58640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9e015c630 0x7fb9e015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9e5d58640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00ad7b0 con 0x7fb9e015c630 2023-12-19T13:51:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9e5d58640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e015cff0 con 0x7fb9cc0047c0 2023-12-19T13:51:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9e5d58640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e01f6cf0 con 0x7fb9e0148c70 2023-12-19T13:51:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9e015c630 0x7fb9e015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9e015c630 0x7fb9e015cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44720/0 (socket says 172.21.15.113:44720) 2023-12-19T13:51:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 -- 172.21.15.113:0/2421468501 learned_addr learned my addr 172.21.15.113:0/2421468501 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 -- 172.21.15.113:0/2421468501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e0148c70 msgr2=0x7fb9e01f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e0148c70 0x7fb9e01f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 -- 172.21.15.113:0/2421468501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc0047c0 msgr2=0x7fb9e015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc0047c0 0x7fb9e015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.613+0000 7fb9dffff640 1 -- 172.21.15.113:0/2421468501 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e01f6f90 con 0x7fb9e015c630 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.614+0000 7fb9dffff640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9e015c630 0x7fb9e015cab0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00cd800 tx=0x7fb9d800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.614+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8010040 con 0x7fb9e015c630 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.614+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800bae0 con 0x7fb9e015c630 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.614+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800be70 con 0x7fb9e015c630 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.614+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e01f7270 con 0x7fb9e015c630 2023-12-19T13:51:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.614+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e00ad9c0 con 0x7fb9e015c630 2023-12-19T13:51:01.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.615+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e0061910 con 0x7fb9e015c630 2023-12-19T13:51:01.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.616+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9d801d400 con 0x7fb9e015c630 2023-12-19T13:51:01.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.617+0000 7fb9dcff9640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9c006a430 0x7fb9c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:01.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.618+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb9d8089000 con 0x7fb9e015c630 2023-12-19T13:51:01.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.618+0000 7fb9df7fe640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9c006a430 0x7fb9c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:01.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.618+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fb9c0072020 con 0x7fb9e015c630 2023-12-19T13:51:01.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.618+0000 7fb9df7fe640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9c006a430 0x7fb9c006c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00079b0 tx=0x7fb9d00014d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:01.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.622+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9d80580d0 con 0x7fb9e015c630 2023-12-19T13:51:01.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.813+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9e0071ae0 con 0x7fb9e015c630 2023-12-19T13:51:01.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.814+0000 7fb9dcff9640 1 -- 172.21.15.113:0/2421468501 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9d8018070 con 0x7fb9e015c630 2023-12-19T13:51:01.813 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:51:01.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9c006a430 msgr2=0x7fb9c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9c006a430 0x7fb9c006c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00079b0 tx=0x7fb9d00014d0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9e015c630 msgr2=0x7fb9e015cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9e015c630 0x7fb9e015cab0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00cd800 tx=0x7fb9d800b480 comp rx=0 tx=0).stop 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 shutdown_connections 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9c006a430 0x7fb9c006c8f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9e015c630 0x7fb9e015cab0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e0148c70 0x7fb9e01f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 --2- 172.21.15.113:0/2421468501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc0047c0 0x7fb9e015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.816+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 >> 172.21.15.113:0/2421468501 conn(0x7fb9e00cbb70 msgr2=0x7fb9e015bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.817+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 shutdown_connections 2023-12-19T13:51:01.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:01.817+0000 7fb9e5d58640 1 -- 172.21.15.113:0/2421468501 wait complete. 2023-12-19T13:51:01.836 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:51:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.052+0000 7f2efff47640 1 Processor -- start 2023-12-19T13:51:02.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.052+0000 7f2efff47640 1 -- start start 2023-12-19T13:51:02.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.054+0000 7f2efff47640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2ef80b2760 0x7f2ef80b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.054+0000 7f2efff47640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef815fde0 con 0x7f2ef80ceea0 2023-12-19T13:51:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.054+0000 7f2efff47640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef80b2bc0 con 0x7f2ef815b1d0 2023-12-19T13:51:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.054+0000 7f2efff47640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef80b2400 con 0x7f2ef80b2760 2023-12-19T13:51:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.054+0000 7f2efe4e4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2ef80ceea0 0x7f2ef806c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39302/0 (socket says 172.21.15.113:39302) 2023-12-19T13:51:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.054+0000 7f2efe4e4640 1 -- 172.21.15.113:0/1094632179 learned_addr learned my addr 172.21.15.113:0/1094632179 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.054+0000 7f2efd4e2640 1 --2- 172.21.15.113:0/1094632179 >> v2:172.21.15.151:3300/0 conn(0x7f2ef80b2760 0x7f2ef80b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612667784 0 0) 0x7f2ef815fde0 con 0x7f2ef80ceea0 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee4003520 con 0x7f2ef80ceea0 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 907591165 0 0) 0x7f2ee4003520 con 0x7f2ef80ceea0 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 >> v2:172.21.15.151:3300/0 conn(0x7f2ef80b2760 msgr2=0x7f2ef80b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 --2- 172.21.15.113:0/1094632179 >> v2:172.21.15.151:3300/0 conn(0x7f2ef80b2760 0x7f2ef80b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 >> v1:172.21.15.151:6789/0 conn(0x7f2ef815b1d0 legacy=0x7f2ef815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef815ef10 con 0x7f2ef80ceea0 2023-12-19T13:51:02.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f2ef00019f0 con 0x7f2ef80ceea0 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 >> v1:172.21.15.113:6789/0 conn(0x7f2ef80ceea0 legacy=0x7f2ef806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ee4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee40047c0 0x7f2ee4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee40051d0 0x7f2ee400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400c0d0 con 0x7f2ee4003a30 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400c240 con 0x7f2ee40047c0 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.055+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400c400 con 0x7f2ee40051d0 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efdce3640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ee4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efd4e2640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee40047c0 0x7f2ee4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efe4e4640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee40051d0 0x7f2ee400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efdce3640 1 -- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee40051d0 msgr2=0x7f2ee400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:02.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efdce3640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee40051d0 0x7f2ee400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efdce3640 1 -- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee40047c0 msgr2=0x7f2ee4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:02.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efdce3640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee40047c0 0x7f2ee4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efdce3640 1 -- 172.21.15.113:0/1094632179 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4003520 con 0x7f2ee4003a30 2023-12-19T13:51:02.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efe4e4640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee40051d0 0x7f2ee400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:02.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.056+0000 7f2efe4e4640 1 -- 172.21.15.113:0/1094632179 reap_dead start 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.057+0000 7f2efdce3640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ee4003e50 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001750 tx=0x7f2ee40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afaf3f4af60e6e14 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.057+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40052d0 con 0x7f2ee4003a30 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef402e050 con 0x7f2ee4003a30 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efcce1640 1 -- 172.21.15.113:0/1094632179 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4003830 con 0x7f2ee4003a30 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efff47640 1 -- 172.21.15.113:0/1094632179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 msgr2=0x7f2ee4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efff47640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ee4003e50 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001750 tx=0x7f2ee40057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efff47640 1 -- 172.21.15.113:0/1094632179 shutdown_connections 2023-12-19T13:51:02.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efff47640 1 --2- 172.21.15.113:0/1094632179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ee4003e50 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efff47640 1 -- 172.21.15.113:0/1094632179 >> 172.21.15.113:0/1094632179 conn(0x7f2ef8073150 msgr2=0x7f2ef80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:02.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efff47640 1 -- 172.21.15.113:0/1094632179 shutdown_connections 2023-12-19T13:51:02.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.058+0000 7f2efff47640 1 -- 172.21.15.113:0/1094632179 wait complete. 2023-12-19T13:51:02.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.060+0000 7f2efff47640 1 Processor -- start 2023-12-19T13:51:02.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.060+0000 7f2efff47640 1 -- start start 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efff47640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ef80abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efff47640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef8155e40 0x7f2ef80a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efff47640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ef80b01d0 0x7f2ef80b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efff47640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80b0b90 con 0x7f2ee4003a30 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efff47640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80ad030 con 0x7f2ef8155e40 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efff47640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80ac4b0 con 0x7f2ef80b01d0 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efdce3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ef80abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efdce3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ef80abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44728/0 (socket says 172.21.15.113:44728) 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.061+0000 7f2efdce3640 1 -- 172.21.15.113:0/3693396513 learned_addr learned my addr 172.21.15.113:0/3693396513 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efe4e4640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ef80b01d0 0x7f2ef80b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efd4e2640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef8155e40 0x7f2ef80a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efdce3640 1 -- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ef80b01d0 msgr2=0x7f2ef80b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efdce3640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ef80b01d0 0x7f2ef80b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efdce3640 1 -- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef8155e40 msgr2=0x7f2ef80a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efdce3640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef8155e40 0x7f2ef80a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efdce3640 1 -- 172.21.15.113:0/3693396513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80ac790 con 0x7f2ee4003a30 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2efdce3640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ef80abed0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4005040 tx=0x7f2ef4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.062+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40076c0 con 0x7f2ee4003a30 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.063+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef40069e0 con 0x7f2ee4003a30 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.063+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4006d90 con 0x7f2ee4003a30 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.063+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef80aca70 con 0x7f2ee4003a30 2023-12-19T13:51:02.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.063+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef81562c0 con 0x7f2ee4003a30 2023-12-19T13:51:02.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.064+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef8061910 con 0x7f2ee4003a30 2023-12-19T13:51:02.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.065+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ef40035f0 con 0x7f2ee4003a30 2023-12-19T13:51:02.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.065+0000 7f2eee7fc640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2edc06a430 0x7f2edc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.066+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2ef40aa690 con 0x7f2ee4003a30 2023-12-19T13:51:02.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.066+0000 7f2efd4e2640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2edc06a430 0x7f2edc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.066+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f2edc072020 con 0x7f2ee4003a30 2023-12-19T13:51:02.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.066+0000 7f2efd4e2640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2edc06a430 0x7f2edc06c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80cd180 tx=0x7f2ee8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:02.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.070+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ef404b060 con 0x7f2ee4003a30 2023-12-19T13:51:02.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.255+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ef80cdc90 con 0x7f2ee4003a30 2023-12-19T13:51:02.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.256+0000 7f2eee7fc640 1 -- 172.21.15.113:0/3693396513 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ef4075cd0 con 0x7f2ee4003a30 2023-12-19T13:51:02.255 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:51:02.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2edc06a430 msgr2=0x7f2edc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2edc06a430 0x7f2edc06c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80cd180 tx=0x7f2ee8008040 comp rx=0 tx=0).stop 2023-12-19T13:51:02.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 msgr2=0x7f2ef80abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ef80abed0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4005040 tx=0x7f2ef4001120 comp rx=0 tx=0).stop 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 shutdown_connections 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2edc06a430 0x7f2edc06c8f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ef80b01d0 0x7f2ef80b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef8155e40 0x7f2ef80a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 --2- 172.21.15.113:0/3693396513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ee4003a30 0x7f2ef80abed0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 >> 172.21.15.113:0/3693396513 conn(0x7f2ef8073150 msgr2=0x7f2ef80b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 shutdown_connections 2023-12-19T13:51:02.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.258+0000 7f2efff47640 1 -- 172.21.15.113:0/3693396513 wait complete. 2023-12-19T13:51:02.275 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:51:02.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.487+0000 7ff46538b640 1 Processor -- start 2023-12-19T13:51:02.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.487+0000 7ff46538b640 1 -- start start 2023-12-19T13:51:02.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.488+0000 7ff46538b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff460146e10 0x7ff4600d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.488+0000 7ff46538b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4600cd840 con 0x7ff4600d2b00 2023-12-19T13:51:02.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.488+0000 7ff46538b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4600b6e90 con 0x7ff4600ce110 2023-12-19T13:51:02.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.488+0000 7ff46538b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4600d2430 con 0x7ff460146e10 2023-12-19T13:51:02.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.489+0000 7ff45e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff4600d2b00 0x7ff4600b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39304/0 (socket says 172.21.15.113:39304) 2023-12-19T13:51:02.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.489+0000 7ff45e7fc640 1 -- 172.21.15.113:0/4183253835 learned_addr learned my addr 172.21.15.113:0/4183253835 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:02.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.489+0000 7ff45effd640 1 --2- 172.21.15.113:0/4183253835 >> v2:172.21.15.151:3300/0 conn(0x7ff460146e10 0x7ff4600d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.489+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300779056 0 0) 0x7ff4600cd840 con 0x7ff4600d2b00 2023-12-19T13:51:02.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.489+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff44c003520 con 0x7ff4600d2b00 2023-12-19T13:51:02.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639309208 0 0) 0x7ff44c003520 con 0x7ff4600d2b00 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 >> v2:172.21.15.151:3300/0 conn(0x7ff460146e10 msgr2=0x7ff4600d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 --2- 172.21.15.113:0/4183253835 >> v2:172.21.15.151:3300/0 conn(0x7ff460146e10 0x7ff4600d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 >> v1:172.21.15.151:6789/0 conn(0x7ff4600ce110 legacy=0x7ff4600b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4600d2620 con 0x7ff4600d2b00 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff448001670 con 0x7ff4600d2b00 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 >> v1:172.21.15.113:6789/0 conn(0x7ff4600d2b00 legacy=0x7ff4600b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff44c003a30 0x7ff44c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff44c0047c0 0x7ff44c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0052a0 0x7ff44c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c00c140 con 0x7ff44c0047c0 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c00c2b0 con 0x7ff44c003a30 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c00c470 con 0x7ff44c0052a0 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45e7fc640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff44c0047c0 0x7ff44c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45effd640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff44c003a30 0x7ff44c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45f7fe640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0052a0 0x7ff44c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45e7fc640 1 -- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0052a0 msgr2=0x7ff44c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:02.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45e7fc640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0052a0 0x7ff44c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45e7fc640 1 -- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff44c003a30 msgr2=0x7ff44c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:02.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45e7fc640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff44c003a30 0x7ff44c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45e7fc640 1 -- 172.21.15.113:0/4183253835 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c003520 con 0x7ff44c0047c0 2023-12-19T13:51:02.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.490+0000 7ff45f7fe640 1 -- 172.21.15.113:0/4183253835 reap_dead start 2023-12-19T13:51:02.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.491+0000 7ff45e7fc640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff44c0047c0 0x7ff44c004c40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c0e0 tx=0x7ff44c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78447256ca4d55c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:02.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448005ad0 con 0x7ff44c0047c0 2023-12-19T13:51:02.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448005c30 con 0x7ff44c0047c0 2023-12-19T13:51:02.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff45dffb640 1 -- 172.21.15.113:0/4183253835 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44802ca50 con 0x7ff44c0047c0 2023-12-19T13:51:02.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff46538b640 1 -- 172.21.15.113:0/4183253835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff44c0047c0 msgr2=0x7ff44c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff46538b640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff44c0047c0 0x7ff44c004c40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c0e0 tx=0x7ff44c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff46538b640 1 -- 172.21.15.113:0/4183253835 shutdown_connections 2023-12-19T13:51:02.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff46538b640 1 --2- 172.21.15.113:0/4183253835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff44c0047c0 0x7ff44c004c40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff46538b640 1 -- 172.21.15.113:0/4183253835 >> 172.21.15.113:0/4183253835 conn(0x7ff4600b29c0 msgr2=0x7ff4600b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:02.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff46538b640 1 -- 172.21.15.113:0/4183253835 shutdown_connections 2023-12-19T13:51:02.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.492+0000 7ff46538b640 1 -- 172.21.15.113:0/4183253835 wait complete. 2023-12-19T13:51:02.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.494+0000 7ff46538b640 1 Processor -- start 2023-12-19T13:51:02.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.494+0000 7ff46538b640 1 -- start start 2023-12-19T13:51:02.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.495+0000 7ff46538b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0047c0 0x7ff46015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.495+0000 7ff46538b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff460140140 0x7ff46013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.495+0000 7ff46538b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff46013bf90 0x7ff4601601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.495+0000 7ff46538b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46015ef00 con 0x7ff46013bf90 2023-12-19T13:51:02.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.495+0000 7ff46538b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46015d2b0 con 0x7ff460140140 2023-12-19T13:51:02.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.495+0000 7ff46538b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46015f150 con 0x7ff44c0047c0 2023-12-19T13:51:02.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff46013bf90 0x7ff4601601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff46013bf90 0x7ff4601601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44746/0 (socket says 172.21.15.113:44746) 2023-12-19T13:51:02.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 -- 172.21.15.113:0/3236525911 learned_addr learned my addr 172.21.15.113:0/3236525911 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:02.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45effd640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0047c0 0x7ff46015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45e7fc640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff460140140 0x7ff46013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 -- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0047c0 msgr2=0x7ff46015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0047c0 0x7ff46015cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 -- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff460140140 msgr2=0x7ff46013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff460140140 0x7ff46013ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 -- 172.21.15.113:0/3236525911 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46015f430 con 0x7ff46013bf90 2023-12-19T13:51:02.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.496+0000 7ff45f7fe640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff46013bf90 0x7ff4601601f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff4600b96f0 tx=0x7ff45800d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:02.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.497+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800b070 con 0x7ff46013bf90 2023-12-19T13:51:02.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.497+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4580054e0 con 0x7ff46013bf90 2023-12-19T13:51:02.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.497+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46015f710 con 0x7ff46013bf90 2023-12-19T13:51:02.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.497+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458003810 con 0x7ff46013bf90 2023-12-19T13:51:02.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.497+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46015fcd0 con 0x7ff46013bf90 2023-12-19T13:51:02.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.498+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff460061910 con 0x7ff46013bf90 2023-12-19T13:51:02.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.499+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff458003990 con 0x7ff46013bf90 2023-12-19T13:51:02.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.499+0000 7ff4577fe640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff44006a430 0x7ff44006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:02.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.500+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff4580880b0 con 0x7ff46013bf90 2023-12-19T13:51:02.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.500+0000 7ff45effd640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff44006a430 0x7ff44006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:02.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.500+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7ff440072020 con 0x7ff46013bf90 2023-12-19T13:51:02.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.500+0000 7ff45effd640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff44006a430 0x7ff44006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff46004f860 tx=0x7ff45000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:02.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.503+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff458018060 con 0x7ff46013bf90 2023-12-19T13:51:02.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.663+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(79..79 src has 1..79) v4 ==== 296+0+0 (secure 0 0 0) 0x7ff458057980 con 0x7ff46013bf90 2023-12-19T13:51:02.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.663+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7ff4400728d0 con 0x7ff46013bf90 2023-12-19T13:51:02.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.708+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff4600b8ef0 con 0x7ff46013bf90 2023-12-19T13:51:02.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.709+0000 7ff4577fe640 1 -- 172.21.15.113:0/3236525911 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff4580535c0 con 0x7ff46013bf90 2023-12-19T13:51:02.708 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.711+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff44006a430 msgr2=0x7ff44006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.711+0000 7ff46538b640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff44006a430 0x7ff44006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff46004f860 tx=0x7ff45000b040 comp rx=0 tx=0).stop 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.711+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff46013bf90 msgr2=0x7ff4601601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.711+0000 7ff46538b640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff46013bf90 0x7ff4601601f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff4600b96f0 tx=0x7ff45800d890 comp rx=0 tx=0).stop 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.711+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 shutdown_connections 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.712+0000 7ff46538b640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff44006a430 0x7ff44006c8f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.712+0000 7ff46538b640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff46013bf90 0x7ff4601601f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.712+0000 7ff46538b640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff460140140 0x7ff46013ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.712+0000 7ff46538b640 1 --2- 172.21.15.113:0/3236525911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff44c0047c0 0x7ff46015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:02.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.712+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 >> 172.21.15.113:0/3236525911 conn(0x7ff4600b29c0 msgr2=0x7ff4600b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:02.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.712+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 shutdown_connections 2023-12-19T13:51:02.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:02.712+0000 7ff46538b640 1 -- 172.21.15.113:0/3236525911 wait complete. 2023-12-19T13:51:02.730 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:51:02.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:02.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:51:02.839 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:51:02.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:02.840 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:51:02.890 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:51:02.890 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:02.949 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:51:02.949 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:51:02.949 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:03.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:51:03.008 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:03.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.219+0000 7f735a5f1640 1 Processor -- start 2023-12-19T13:51:03.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.219+0000 7f735a5f1640 1 -- start start 2023-12-19T13:51:03.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f735a5f1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f73541449e0 0x7f73540af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f735a5f1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f73540b0b50 0x7f735406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f735a5f1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f735406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f735a5f1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540afb10 con 0x7f73540b0b50 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f735a5f1640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735406bb30 con 0x7f73541449e0 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f735a5f1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540b0070 con 0x7f735406b590 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f734b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f73540b0b50 0x7f735406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f734b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f73540b0b50 0x7f735406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44754/0 (socket says 172.21.15.113:44754) 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.221+0000 7f734b7fe640 1 -- 172.21.15.113:0/4284275084 learned_addr learned my addr 172.21.15.113:0/4284275084 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f7353fff640 1 --2- 172.21.15.113:0/4284275084 >> v2:172.21.15.151:3300/0 conn(0x7f73541449e0 0x7f73540af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f7358b8e640 1 --2- 172.21.15.113:0/4284275084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f735406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f734b7fe640 1 -- 172.21.15.113:0/4284275084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 msgr2=0x7f735406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f734b7fe640 1 --2- 172.21.15.113:0/4284275084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f735406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f734b7fe640 1 -- 172.21.15.113:0/4284275084 >> v2:172.21.15.151:3300/0 conn(0x7f73541449e0 msgr2=0x7f73540af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f734b7fe640 1 --2- 172.21.15.113:0/4284275084 >> v2:172.21.15.151:3300/0 conn(0x7f73541449e0 0x7f73540af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f734b7fe640 1 -- 172.21.15.113:0/4284275084 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540b0350 con 0x7f73540b0b50 2023-12-19T13:51:03.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.222+0000 7f7358b8e640 1 --2- 172.21.15.113:0/4284275084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f735406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:03.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.223+0000 7f734b7fe640 1 --2- 172.21.15.113:0/4284275084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73540b0b50 0x7f735406bfa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7354071cd0 tx=0x7f733c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3198341238a4f95f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:03.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.223+0000 7f73537fe640 1 -- 172.21.15.113:0/4284275084 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c031870 con 0x7f73540b0b50 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.223+0000 7f73537fe640 1 -- 172.21.15.113:0/4284275084 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c0319d0 con 0x7f73540b0b50 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.223+0000 7f73537fe640 1 -- 172.21.15.113:0/4284275084 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c031d60 con 0x7f73540b0b50 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 -- 172.21.15.113:0/4284275084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73540b0b50 msgr2=0x7f735406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 --2- 172.21.15.113:0/4284275084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73540b0b50 0x7f735406bfa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7354071cd0 tx=0x7f733c02b910 comp rx=0 tx=0).stop 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 -- 172.21.15.113:0/4284275084 shutdown_connections 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 --2- 172.21.15.113:0/4284275084 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f735406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 --2- 172.21.15.113:0/4284275084 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73540b0b50 0x7f735406bfa0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 --2- 172.21.15.113:0/4284275084 >> v2:172.21.15.151:3300/0 conn(0x7f73541449e0 0x7f73540af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 -- 172.21.15.113:0/4284275084 >> 172.21.15.113:0/4284275084 conn(0x7f73540cbb70 msgr2=0x7f73540cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 -- 172.21.15.113:0/4284275084 shutdown_connections 2023-12-19T13:51:03.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.224+0000 7f735a5f1640 1 -- 172.21.15.113:0/4284275084 wait complete. 2023-12-19T13:51:03.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.226+0000 7f735a5f1640 1 Processor -- start 2023-12-19T13:51:03.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.226+0000 7f735a5f1640 1 -- start start 2023-12-19T13:51:03.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f735a5f1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f7354138330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f735a5f1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73540b0b50 0x7f7354152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f735a5f1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73541449e0 0x7f7354137650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f735a5f1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73541397b0 con 0x7f73541449e0 2023-12-19T13:51:03.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f735a5f1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354138c30 con 0x7f73540b0b50 2023-12-19T13:51:03.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f735a5f1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7354138f10 con 0x7f735406b590 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f7358b8e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73541449e0 0x7f7354137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f7358b8e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73541449e0 0x7f7354137650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44758/0 (socket says 172.21.15.113:44758) 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.227+0000 7f7358b8e640 1 -- 172.21.15.113:0/3665244350 learned_addr learned my addr 172.21.15.113:0/3665244350 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f734b7fe640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73540b0b50 0x7f7354152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f7353fff640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f7354138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f7358b8e640 1 -- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 msgr2=0x7f7354138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f7358b8e640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f7354138330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f7358b8e640 1 -- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73540b0b50 msgr2=0x7f7354152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f7358b8e640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73540b0b50 0x7f7354152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f7358b8e640 1 -- 172.21.15.113:0/3665244350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0094d0 con 0x7f73541449e0 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f734b7fe640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73540b0b50 0x7f7354152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f7358b8e640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73541449e0 0x7f7354137650 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f734c00cd10 tx=0x7f734c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00f680 con 0x7f73541449e0 2023-12-19T13:51:03.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c00f800 con 0x7f73541449e0 2023-12-19T13:51:03.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73541391f0 con 0x7f73541449e0 2023-12-19T13:51:03.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.228+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00fbb0 con 0x7f73541449e0 2023-12-19T13:51:03.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.229+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7354138870 con 0x7f73541449e0 2023-12-19T13:51:03.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.230+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354061910 con 0x7f73541449e0 2023-12-19T13:51:03.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.231+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f734c00b040 con 0x7f73541449e0 2023-12-19T13:51:03.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.231+0000 7f73517fa640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733406a430 0x7f733406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.232+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f734c0892a0 con 0x7f73541449e0 2023-12-19T13:51:03.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.232+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f7334072020 con 0x7f73541449e0 2023-12-19T13:51:03.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.232+0000 7f7353fff640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733406a430 0x7f733406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.233+0000 7f7353fff640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733406a430 0x7f733406c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7344006fd0 tx=0x7f7344008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:03.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.236+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f734c054850 con 0x7f73541449e0 2023-12-19T13:51:03.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.463+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73540ae560 con 0x7f73541449e0 2023-12-19T13:51:03.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.465+0000 7f73517fa640 1 -- 172.21.15.113:0/3665244350 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f734c057e70 con 0x7f73541449e0 2023-12-19T13:51:03.464 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:03.464 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:49:36.382415+0000","modified":"2023-12-19T13:49:39.476500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6066":{"gid":6066,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/4085417322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4085417322},{"type":"v1","addr":"172.21.15.151:6835","nonce":4085417322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T13:51:03.464 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 33 2023-12-19T13:51:03.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733406a430 msgr2=0x7f733406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733406a430 0x7f733406c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7344006fd0 tx=0x7f7344008040 comp rx=0 tx=0).stop 2023-12-19T13:51:03.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73541449e0 msgr2=0x7f7354137650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73541449e0 0x7f7354137650 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f734c00cd10 tx=0x7f734c00a650 comp rx=0 tx=0).stop 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 shutdown_connections 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733406a430 0x7f733406c8f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73541449e0 0x7f7354137650 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73540b0b50 0x7f7354152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 --2- 172.21.15.113:0/3665244350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f735406b590 0x7f7354138330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 >> 172.21.15.113:0/3665244350 conn(0x7f73540cbb70 msgr2=0x7f73540b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 shutdown_connections 2023-12-19T13:51:03.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.468+0000 7f735a5f1640 1 -- 172.21.15.113:0/3665244350 wait complete. 2023-12-19T13:51:03.488 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:03.661 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:51:03.662+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-19T13:51:03.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.704+0000 7ffb9a93e640 1 Processor -- start 2023-12-19T13:51:03.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.704+0000 7ffb9a93e640 1 -- start start 2023-12-19T13:51:03.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.705+0000 7ffb9a93e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffb941449e0 0x7ffb940af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.705+0000 7ffb9a93e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffb9406c6b0 0x7ffb940b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.705+0000 7ffb9a93e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb940afb10 con 0x7ffb940b0b50 2023-12-19T13:51:03.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.705+0000 7ffb9a93e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9406bb30 con 0x7ffb9406c6b0 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.705+0000 7ffb9a93e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb940b0070 con 0x7ffb941449e0 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb98edb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffb9406c6b0 0x7ffb940b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb937fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffb940b0b50 0x7ffb9406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39310/0 (socket says 172.21.15.113:39310) 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb937fe640 1 -- 172.21.15.113:0/245812870 learned_addr learned my addr 172.21.15.113:0/245812870 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb93fff640 1 --2- 172.21.15.113:0/245812870 >> v2:172.21.15.151:3300/0 conn(0x7ffb941449e0 0x7ffb940af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb92ffd640 1 -- 172.21.15.113:0/245812870 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776576068 0 0) 0x7ffb940afb10 con 0x7ffb940b0b50 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb98edb640 1 -- 172.21.15.113:0/245812870 >> v2:172.21.15.151:3300/0 conn(0x7ffb941449e0 msgr2=0x7ffb940af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:03.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb98edb640 1 --2- 172.21.15.113:0/245812870 >> v2:172.21.15.151:3300/0 conn(0x7ffb941449e0 0x7ffb940af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb98edb640 1 -- 172.21.15.113:0/245812870 >> v1:172.21.15.113:6789/0 conn(0x7ffb940b0b50 legacy=0x7ffb9406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.706+0000 7ffb98edb640 1 -- 172.21.15.113:0/245812870 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb940b0350 con 0x7ffb9406c6b0 2023-12-19T13:51:03.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.707+0000 7ffb98edb640 1 --2- 172.21.15.113:0/245812870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9406c6b0 0x7ffb940b1710 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ffb94071cd0 tx=0x7ffb8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a63f7ba48ab6eba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:03.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb92ffd640 1 -- 172.21.15.113:0/245812870 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c031830 con 0x7ffb9406c6b0 2023-12-19T13:51:03.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb92ffd640 1 -- 172.21.15.113:0/245812870 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c031990 con 0x7ffb9406c6b0 2023-12-19T13:51:03.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb92ffd640 1 -- 172.21.15.113:0/245812870 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c031d20 con 0x7ffb9406c6b0 2023-12-19T13:51:03.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 -- 172.21.15.113:0/245812870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9406c6b0 msgr2=0x7ffb940b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/245812870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9406c6b0 0x7ffb940b1710 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ffb94071cd0 tx=0x7ffb8c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 -- 172.21.15.113:0/245812870 shutdown_connections 2023-12-19T13:51:03.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/245812870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9406c6b0 0x7ffb940b1710 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/245812870 >> v2:172.21.15.151:3300/0 conn(0x7ffb941449e0 0x7ffb940af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 -- 172.21.15.113:0/245812870 >> 172.21.15.113:0/245812870 conn(0x7ffb940cbb70 msgr2=0x7ffb940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 -- 172.21.15.113:0/245812870 shutdown_connections 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.708+0000 7ffb9a93e640 1 -- 172.21.15.113:0/245812870 wait complete. 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.710+0000 7ffb9a93e640 1 Processor -- start 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.710+0000 7ffb9a93e640 1 -- start start 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb9a93e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9406c6b0 0x7ffb9415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb9a93e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb940b0b50 0x7ffb9415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb9a93e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb941449e0 0x7ffb9415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb9a93e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940aca80 con 0x7ffb941449e0 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb9a93e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9415b360 con 0x7ffb940b0b50 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb9a93e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9415ccb0 con 0x7ffb9406c6b0 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb98edb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb941449e0 0x7ffb9415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb98edb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb941449e0 0x7ffb9415de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44776/0 (socket says 172.21.15.113:44776) 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.711+0000 7ffb98edb640 1 -- 172.21.15.113:0/3745818381 learned_addr learned my addr 172.21.15.113:0/3745818381 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb937fe640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb940b0b50 0x7ffb9415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb98edb640 1 -- 172.21.15.113:0/3745818381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9406c6b0 msgr2=0x7ffb9415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb98edb640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9406c6b0 0x7ffb9415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb98edb640 1 -- 172.21.15.113:0/3745818381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb940b0b50 msgr2=0x7ffb9415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb98edb640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb940b0b50 0x7ffb9415d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb98edb640 1 -- 172.21.15.113:0/3745818381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c009400 con 0x7ffb941449e0 2023-12-19T13:51:03.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb98edb640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb941449e0 0x7ffb9415de30 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c02bee0 tx=0x7ffb8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:03.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0317d0 con 0x7ffb941449e0 2023-12-19T13:51:03.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c03b9f0 con 0x7ffb941449e0 2023-12-19T13:51:03.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c03bda0 con 0x7ffb941449e0 2023-12-19T13:51:03.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.712+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9415cf90 con 0x7ffb941449e0 2023-12-19T13:51:03.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.713+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9415d550 con 0x7ffb941449e0 2023-12-19T13:51:03.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.714+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb94061910 con 0x7ffb941449e0 2023-12-19T13:51:03.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.714+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb8c04e440 con 0x7ffb941449e0 2023-12-19T13:51:03.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.716+0000 7ffb90ff9640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb8006a430 0x7ffb8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:03.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.716+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffb8c0aabb0 con 0x7ffb941449e0 2023-12-19T13:51:03.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.716+0000 7ffb93fff640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb8006a430 0x7ffb8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:03.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.716+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=81}) v3 -- 0x7ffb80072020 con 0x7ffb941449e0 2023-12-19T13:51:03.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.717+0000 7ffb93fff640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb8006a430 0x7ffb8006c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffb84006fd0 tx=0x7ffb84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:03.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.721+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb8c035060 con 0x7ffb941449e0 2023-12-19T13:51:03.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.914+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb940acbc0 con 0x7ffb941449e0 2023-12-19T13:51:03.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.916+0000 7ffb90ff9640 1 -- 172.21.15.113:0/3745818381 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16270 (secure 0 0 0) 0x7ffb940acbc0 con 0x7ffb941449e0 2023-12-19T13:51:03.919 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:03.919 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:03.662540+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":4}]},{"pgid":"9.3e","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:03.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb8006a430 msgr2=0x7ffb8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb8006a430 0x7ffb8006c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffb84006fd0 tx=0x7ffb84008040 comp rx=0 tx=0).stop 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb941449e0 msgr2=0x7ffb9415de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb941449e0 0x7ffb9415de30 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c02bee0 tx=0x7ffb8c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 shutdown_connections 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb8006a430 0x7ffb8006c8f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb941449e0 0x7ffb9415de30 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb940b0b50 0x7ffb9415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.918+0000 7ffb9a93e640 1 --2- 172.21.15.113:0/3745818381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9406c6b0 0x7ffb9415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.919+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 >> 172.21.15.113:0/3745818381 conn(0x7ffb940cbb70 msgr2=0x7ffb940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.919+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 shutdown_connections 2023-12-19T13:51:03.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:03.919+0000 7ffb9a93e640 1 -- 172.21.15.113:0/3745818381 wait complete. 2023-12-19T13:51:03.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:49:34.219200+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:49:35.406746+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:51:03.939 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:51:04.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.147+0000 7f67183f6640 1 Processor -- start 2023-12-19T13:51:04.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.147+0000 7f67183f6640 1 -- start start 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f67183f6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f671015b1d0 0x7f67100b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f67183f6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f67100b1ec0 0x7f671015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f67183f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f67183f6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100cf870 con 0x7f67100b1ec0 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f67183f6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671015ef10 con 0x7f671015b1d0 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f67183f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b2320 con 0x7f67100ceea0 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f6715991640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f67100b1ec0 0x7f671015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f6715991640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f67100b1ec0 0x7f671015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44780/0 (socket says 172.21.15.113:44780) 2023-12-19T13:51:04.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.149+0000 7f6715991640 1 -- 172.21.15.113:0/2288797910 learned_addr learned my addr 172.21.15.113:0/2288797910 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:04.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6716192640 1 --2- 172.21.15.113:0/2288797910 >> v2:172.21.15.151:3300/0 conn(0x7f671015b1d0 0x7f67100b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6715991640 1 -- 172.21.15.113:0/2288797910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 msgr2=0x7f67100cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:04.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6716993640 1 --2- 172.21.15.113:0/2288797910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6715991640 1 --2- 172.21.15.113:0/2288797910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6715991640 1 -- 172.21.15.113:0/2288797910 >> v2:172.21.15.151:3300/0 conn(0x7f671015b1d0 msgr2=0x7f67100b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:04.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6715991640 1 --2- 172.21.15.113:0/2288797910 >> v2:172.21.15.151:3300/0 conn(0x7f671015b1d0 0x7f67100b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6715991640 1 -- 172.21.15.113:0/2288797910 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100b2e40 con 0x7f67100b1ec0 2023-12-19T13:51:04.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6716192640 1 --2- 172.21.15.113:0/2288797910 >> v2:172.21.15.151:3300/0 conn(0x7f671015b1d0 0x7f67100b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:04.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.150+0000 7f6716993640 1 --2- 172.21.15.113:0/2288797910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:04.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.151+0000 7f6715991640 1 --2- 172.21.15.113:0/2288797910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f671015f6d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f67100ae020 tx=0x7f670002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f53493dcc8e99c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:04.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.151+0000 7f6715190640 1 -- 172.21.15.113:0/2288797910 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700031860 con 0x7f67100b1ec0 2023-12-19T13:51:04.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f6715190640 1 -- 172.21.15.113:0/2288797910 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67000319c0 con 0x7f67100b1ec0 2023-12-19T13:51:04.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f6715190640 1 -- 172.21.15.113:0/2288797910 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700031d50 con 0x7f67100b1ec0 2023-12-19T13:51:04.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f67183f6640 1 -- 172.21.15.113:0/2288797910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 msgr2=0x7f671015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f67183f6640 1 --2- 172.21.15.113:0/2288797910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f671015f6d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f67100ae020 tx=0x7f670002b900 comp rx=0 tx=0).stop 2023-12-19T13:51:04.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f67183f6640 1 -- 172.21.15.113:0/2288797910 shutdown_connections 2023-12-19T13:51:04.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f67183f6640 1 --2- 172.21.15.113:0/2288797910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f67183f6640 1 --2- 172.21.15.113:0/2288797910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f671015f6d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f67183f6640 1 --2- 172.21.15.113:0/2288797910 >> v2:172.21.15.151:3300/0 conn(0x7f671015b1d0 0x7f67100b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.152+0000 7f67183f6640 1 -- 172.21.15.113:0/2288797910 >> 172.21.15.113:0/2288797910 conn(0x7f6710073150 msgr2=0x7f67100659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:04.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.153+0000 7f67183f6640 1 -- 172.21.15.113:0/2288797910 shutdown_connections 2023-12-19T13:51:04.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.153+0000 7f67183f6640 1 -- 172.21.15.113:0/2288797910 wait complete. 2023-12-19T13:51:04.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.155+0000 7f67183f6640 1 Processor -- start 2023-12-19T13:51:04.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.155+0000 7f67183f6640 1 -- start start 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f67183f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f6710153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f67183f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f67183f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671015b1d0 0x7f67100c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f67183f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710154370 con 0x7f67100b1ec0 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f67183f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c9d40 con 0x7f671015b1d0 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f67183f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100ca020 con 0x7f67100ceea0 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f6716192640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f6710153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f6716192640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f6710153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44796/0 (socket says 172.21.15.113:44796) 2023-12-19T13:51:04.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.156+0000 7f6716192640 1 -- 172.21.15.113:0/4108587458 learned_addr learned my addr 172.21.15.113:0/4108587458 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:04.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6715991640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6716993640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671015b1d0 0x7f67100c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6716192640 1 -- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 msgr2=0x7f67100c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6716192640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6716192640 1 -- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671015b1d0 msgr2=0x7f67100c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6716192640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671015b1d0 0x7f67100c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6716192640 1 -- 172.21.15.113:0/4108587458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000094d0 con 0x7f67100b1ec0 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6716192640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f6710153e30 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c7f0 tx=0x7f670c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.157+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c007820 con 0x7f67100b1ec0 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.158+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c007980 con 0x7f67100b1ec0 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.158+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c007cf0 con 0x7f67100b1ec0 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.158+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100ca300 con 0x7f67100b1ec0 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.158+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100ca8c0 con 0x7f67100b1ec0 2023-12-19T13:51:04.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.159+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710061910 con 0x7f67100b1ec0 2023-12-19T13:51:04.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.160+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f670c0113f0 con 0x7f67100b1ec0 2023-12-19T13:51:04.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.161+0000 7f6706ffd640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66f406a430 0x7f66f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.161+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f670c088d50 con 0x7f67100b1ec0 2023-12-19T13:51:04.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.161+0000 7f6715991640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66f406a430 0x7f66f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.161+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=81}) v3 -- 0x7f66f4072020 con 0x7f67100b1ec0 2023-12-19T13:51:04.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.162+0000 7f6715991640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66f406a430 0x7f66f406c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6700036000 tx=0x7f670003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:04.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.165+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f670c01f060 con 0x7f67100b1ec0 2023-12-19T13:51:04.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.356+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67100cdc90 con 0x7f67100b1ec0 2023-12-19T13:51:04.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.357+0000 7f6706ffd640 1 -- 172.21.15.113:0/4108587458 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f670c054260 con 0x7f67100b1ec0 2023-12-19T13:51:04.356 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:51:04.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66f406a430 msgr2=0x7f66f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66f406a430 0x7f66f406c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6700036000 tx=0x7f670003c040 comp rx=0 tx=0).stop 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 msgr2=0x7f6710153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f6710153e30 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c7f0 tx=0x7f670c00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 shutdown_connections 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66f406a430 0x7f66f406c8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671015b1d0 0x7f67100c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67100ceea0 0x7f67100c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 --2- 172.21.15.113:0/4108587458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67100b1ec0 0x7f6710153e30 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.359+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 >> 172.21.15.113:0/4108587458 conn(0x7f6710073150 msgr2=0x7f67100cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:04.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.360+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 shutdown_connections 2023-12-19T13:51:04.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.360+0000 7f67183f6640 1 -- 172.21.15.113:0/4108587458 wait complete. 2023-12-19T13:51:04.378 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:51:04.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.595+0000 7fad821c4640 1 Processor -- start 2023-12-19T13:51:04.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.595+0000 7fad821c4640 1 -- start start 2023-12-19T13:51:04.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.597+0000 7fad821c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad7c146da0 0x7fad7c0aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.597+0000 7fad821c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fad7c161900 0x7fad7c0aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.597+0000 7fad821c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c0d1070 con 0x7fad7c147180 2023-12-19T13:51:04.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.597+0000 7fad821c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c162020 con 0x7fad7c161900 2023-12-19T13:51:04.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.597+0000 7fad821c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0aabd0 con 0x7fad7c146da0 2023-12-19T13:51:04.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.597+0000 7fad7affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fad7c147180 0x7fad7c1611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39326/0 (socket says 172.21.15.113:39326) 2023-12-19T13:51:04.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.597+0000 7fad7affd640 1 -- 172.21.15.113:0/1282620385 learned_addr learned my addr 172.21.15.113:0/1282620385 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad7c146da0 0x7fad7c0aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7bfff640 1 --2- 172.21.15.113:0/1282620385 >> v2:172.21.15.151:3300/0 conn(0x7fad7c161900 0x7fad7c0aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478037259 0 0) 0x7fad7c0d1070 con 0x7fad7c147180 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad64003520 con 0x7fad7c147180 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3429193771 0 0) 0x7fad64003520 con 0x7fad7c147180 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad7c146da0 msgr2=0x7fad7c0aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad7c146da0 0x7fad7c0aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 >> v2:172.21.15.151:3300/0 conn(0x7fad7c161900 msgr2=0x7fad7c0aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 --2- 172.21.15.113:0/1282620385 >> v2:172.21.15.151:3300/0 conn(0x7fad7c161900 0x7fad7c0aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0aaeb0 con 0x7fad7c147180 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fad70001670 con 0x7fad7c147180 2023-12-19T13:51:04.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 >> v1:172.21.15.113:6789/0 conn(0x7fad7c147180 legacy=0x7fad7c1611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad640039e0 0x7fad64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad7c146da0 0x7fad640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad64004d00 0x7fad64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c162020 con 0x7fad640039e0 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0aabd0 con 0x7fad64004d00 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.598+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6400b980 con 0x7fad7c146da0 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.599+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad640039e0 0x7fad64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.599+0000 7fad7b7fe640 1 -- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad7c146da0 msgr2=0x7fad640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.599+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad7c146da0 0x7fad640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.599+0000 7fad7b7fe640 1 -- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad64004d00 msgr2=0x7fad64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.599+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad64004d00 0x7fad64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.599+0000 7fad7b7fe640 1 -- 172.21.15.113:0/1282620385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad64003520 con 0x7fad640039e0 2023-12-19T13:51:04.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.600+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad640039e0 0x7fad64003e00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009ac0 tx=0x7fad640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6e043821f9f9fa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.600+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c02c710 con 0x7fad640039e0 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.600+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c02c870 con 0x7fad640039e0 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.600+0000 7fad7a7fc640 1 -- 172.21.15.113:0/1282620385 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c02cc00 con 0x7fad640039e0 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.601+0000 7fad821c4640 1 -- 172.21.15.113:0/1282620385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad640039e0 msgr2=0x7fad64003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.601+0000 7fad821c4640 1 --2- 172.21.15.113:0/1282620385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad640039e0 0x7fad64003e00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009ac0 tx=0x7fad640057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.601+0000 7fad7bfff640 1 -- 172.21.15.113:0/1282620385 reap_dead start 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.601+0000 7fad821c4640 1 -- 172.21.15.113:0/1282620385 shutdown_connections 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.601+0000 7fad821c4640 1 -- 172.21.15.113:0/1282620385 >> 172.21.15.113:0/1282620385 conn(0x7fad7c071a50 msgr2=0x7fad7c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.601+0000 7fad821c4640 1 -- 172.21.15.113:0/1282620385 shutdown_connections 2023-12-19T13:51:04.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.601+0000 7fad821c4640 1 -- 172.21.15.113:0/1282620385 wait complete. 2023-12-19T13:51:04.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.603+0000 7fad821c4640 1 Processor -- start 2023-12-19T13:51:04.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.603+0000 7fad821c4640 1 -- start start 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad821c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad640039e0 0x7fad7c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad821c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad7c152260 0x7fad7c151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad821c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad7c14bf50 0x7fad7c14dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad821c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c151e50 con 0x7fad7c14bf50 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad821c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c14d4d0 con 0x7fad7c152260 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad821c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c14c8c0 con 0x7fad640039e0 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad7c14bf50 0x7fad7c14dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad7c14bf50 0x7fad7c14dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44808/0 (socket says 172.21.15.113:44808) 2023-12-19T13:51:04.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.604+0000 7fad7bfff640 1 -- 172.21.15.113:0/3138321157 learned_addr learned my addr 172.21.15.113:0/3138321157 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:04.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7affd640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad7c152260 0x7fad7c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad640039e0 0x7fad7c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7bfff640 1 -- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad640039e0 msgr2=0x7fad7c14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7bfff640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad640039e0 0x7fad7c14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7bfff640 1 -- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad7c152260 msgr2=0x7fad7c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7bfff640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad7c152260 0x7fad7c151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7bfff640 1 -- 172.21.15.113:0/3138321157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c14cba0 con 0x7fad7c14bf50 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad7bfff640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad7c14bf50 0x7fad7c14dfe0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0aaae0 tx=0x7fad7400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74010040 con 0x7fad7c14bf50 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400bae0 con 0x7fad7c14bf50 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400be70 con 0x7fad7c14bf50 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.605+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c14ce80 con 0x7fad7c14bf50 2023-12-19T13:51:04.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.606+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c14c3e0 con 0x7fad7c14bf50 2023-12-19T13:51:04.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.607+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c073ec0 con 0x7fad7c14bf50 2023-12-19T13:51:04.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.608+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad7401e410 con 0x7fad7c14bf50 2023-12-19T13:51:04.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.608+0000 7fad63fff640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad6806a430 0x7fad6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:04.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.609+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fad74088c00 con 0x7fad7c14bf50 2023-12-19T13:51:04.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.609+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad6806a430 0x7fad6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:04.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.609+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=81}) v3 -- 0x7fad68072020 con 0x7fad7c14bf50 2023-12-19T13:51:04.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.610+0000 7fad7b7fe640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad6806a430 0x7fad6806c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad6c036000 tx=0x7fad6c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:04.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.613+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad74057ba0 con 0x7fad7c14bf50 2023-12-19T13:51:04.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.674+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(81..81 src has 1..81) v4 ==== 296+0+0 (secure 0 0 0) 0x7fad74006000 con 0x7fad7c14bf50 2023-12-19T13:51:04.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.674+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=82}) v3 -- 0x7fad680728d0 con 0x7fad7c14bf50 2023-12-19T13:51:04.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.806+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad7c0a9fe0 con 0x7fad7c14bf50 2023-12-19T13:51:04.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.807+0000 7fad63fff640 1 -- 172.21.15.113:0/3138321157 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad74057730 con 0x7fad7c14bf50 2023-12-19T13:51:04.806 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:51:04.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.809+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad6806a430 msgr2=0x7fad6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.809+0000 7fad821c4640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad6806a430 0x7fad6806c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad6c036000 tx=0x7fad6c030000 comp rx=0 tx=0).stop 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad7c14bf50 msgr2=0x7fad7c14dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad7c14bf50 0x7fad7c14dfe0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0aaae0 tx=0x7fad7400b480 comp rx=0 tx=0).stop 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 shutdown_connections 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad6806a430 0x7fad6806c8f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad7c14bf50 0x7fad7c14dfe0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad7c152260 0x7fad7c151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 --2- 172.21.15.113:0/3138321157 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad640039e0 0x7fad7c14d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 >> 172.21.15.113:0/3138321157 conn(0x7fad7c071a50 msgr2=0x7fad7c1436f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 shutdown_connections 2023-12-19T13:51:04.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:04.810+0000 7fad821c4640 1 -- 172.21.15.113:0/3138321157 wait complete. 2023-12-19T13:51:04.828 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:51:05.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.044+0000 7f0d9f347640 1 Processor -- start 2023-12-19T13:51:05.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.045+0000 7f0d9f347640 1 -- start start 2023-12-19T13:51:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.046+0000 7f0d9f347640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d98160a60 0x7f0d980cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.046+0000 7f0d9f347640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0d980ac8b0 0x7f0d980acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.046+0000 7f0d9f347640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9806e020 con 0x7f0d980cbe20 2023-12-19T13:51:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.046+0000 7f0d9f347640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9806d4f0 con 0x7f0d98160a60 2023-12-19T13:51:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.046+0000 7f0d9f347640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980ccef0 con 0x7f0d980ac8b0 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9c8e2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0d980cbe20 0x7f0d9806d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39340/0 (socket says 172.21.15.113:39340) 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9d0e3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d98160a60 0x7f0d980cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9c8e2640 1 -- 172.21.15.113:0/2146673124 learned_addr learned my addr 172.21.15.113:0/2146673124 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9d8e4640 1 --2- 172.21.15.113:0/2146673124 >> v2:172.21.15.151:3300/0 conn(0x7f0d980ac8b0 0x7f0d980acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9d0e3640 1 -- 172.21.15.113:0/2146673124 >> v2:172.21.15.151:3300/0 conn(0x7f0d980ac8b0 msgr2=0x7f0d980acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9d0e3640 1 --2- 172.21.15.113:0/2146673124 >> v2:172.21.15.151:3300/0 conn(0x7f0d980ac8b0 0x7f0d980acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9d0e3640 1 -- 172.21.15.113:0/2146673124 >> v1:172.21.15.113:6789/0 conn(0x7f0d980cbe20 legacy=0x7f0d9806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9d0e3640 1 -- 172.21.15.113:0/2146673124 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9806cb90 con 0x7f0d98160a60 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d8ffff640 1 -- 172.21.15.113:0/2146673124 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651354969 0 0) 0x7f0d9806e020 con 0x7f0d980cbe20 2023-12-19T13:51:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.047+0000 7f0d9d8e4640 1 --2- 172.21.15.113:0/2146673124 >> v2:172.21.15.151:3300/0 conn(0x7f0d980ac8b0 0x7f0d980acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:05.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.048+0000 7f0d9d0e3640 1 --2- 172.21.15.113:0/2146673124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d98160a60 0x7f0d980cc310 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0d940097d0 tx=0x7f0d9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b56ba2288533c3b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d8ffff640 1 -- 172.21.15.113:0/2146673124 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94031830 con 0x7f0d98160a60 2023-12-19T13:51:05.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d8ffff640 1 -- 172.21.15.113:0/2146673124 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d94031990 con 0x7f0d98160a60 2023-12-19T13:51:05.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d8ffff640 1 -- 172.21.15.113:0/2146673124 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94031d20 con 0x7f0d98160a60 2023-12-19T13:51:05.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d9f347640 1 -- 172.21.15.113:0/2146673124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d98160a60 msgr2=0x7f0d980cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2146673124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d98160a60 0x7f0d980cc310 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0d940097d0 tx=0x7f0d9402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d9f347640 1 -- 172.21.15.113:0/2146673124 shutdown_connections 2023-12-19T13:51:05.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2146673124 >> v2:172.21.15.151:3300/0 conn(0x7f0d980ac8b0 0x7f0d980acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2146673124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d98160a60 0x7f0d980cc310 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d9f347640 1 -- 172.21.15.113:0/2146673124 >> 172.21.15.113:0/2146673124 conn(0x7f0d980cf900 msgr2=0x7f0d980cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:05.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.049+0000 7f0d9f347640 1 -- 172.21.15.113:0/2146673124 shutdown_connections 2023-12-19T13:51:05.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.050+0000 7f0d9f347640 1 -- 172.21.15.113:0/2146673124 wait complete. 2023-12-19T13:51:05.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.051+0000 7f0d9f347640 1 Processor -- start 2023-12-19T13:51:05.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.051+0000 7f0d9f347640 1 -- start start 2023-12-19T13:51:05.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.052+0000 7f0d9f347640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d980ac8b0 0x7f0d9813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.052+0000 7f0d9f347640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d980cbe20 0x7f0d981553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.052+0000 7f0d9f347640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d98160a60 0x7f0d9806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.052+0000 7f0d9f347640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98157e90 con 0x7f0d980cbe20 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.052+0000 7f0d9f347640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98156fe0 con 0x7f0d98160a60 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.052+0000 7f0d9f347640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98157210 con 0x7f0d980ac8b0 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.052+0000 7f0d9c8e2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d980cbe20 0x7f0d981553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d980cbe20 0x7f0d981553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44816/0 (socket says 172.21.15.113:44816) 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 -- 172.21.15.113:0/2043084366 learned_addr learned my addr 172.21.15.113:0/2043084366 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 -- 172.21.15.113:0/2043084366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d980ac8b0 msgr2=0x7f0d9813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d980ac8b0 0x7f0d9813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 -- 172.21.15.113:0/2043084366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d98160a60 msgr2=0x7f0d9806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d98160a60 0x7f0d9806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 -- 172.21.15.113:0/2043084366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d94009400 con 0x7f0d980cbe20 2023-12-19T13:51:05.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9c8e2640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d980cbe20 0x7f0d981553b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800c4b0 tx=0x7f0d8800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880074e0 con 0x7f0d980cbe20 2023-12-19T13:51:05.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88007660 con 0x7f0d980cbe20 2023-12-19T13:51:05.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88004a20 con 0x7f0d980cbe20 2023-12-19T13:51:05.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.053+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d981574f0 con 0x7f0d980cbe20 2023-12-19T13:51:05.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.054+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d98157ab0 con 0x7f0d980cbe20 2023-12-19T13:51:05.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.055+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98067950 con 0x7f0d980cbe20 2023-12-19T13:51:05.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.056+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d88004b80 con 0x7f0d980cbe20 2023-12-19T13:51:05.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.056+0000 7f0d8dffb640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.057+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0d88087c20 con 0x7f0d980cbe20 2023-12-19T13:51:05.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.057+0000 7f0d9d0e3640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.057+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=82}) v3 -- 0x7f0d7c072020 con 0x7f0d980cbe20 2023-12-19T13:51:05.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.057+0000 7f0d9d0e3640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0d94036000 tx=0x7f0d94030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.061+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d88018020 con 0x7f0d980cbe20 2023-12-19T13:51:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.247+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d98157fd0 con 0x7f0d980cbe20 2023-12-19T13:51:05.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.248+0000 7f0d8dffb640 1 -- 172.21.15.113:0/2043084366 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d98157fd0 con 0x7f0d980cbe20 2023-12-19T13:51:05.249 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:51:05.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0d7c06a430 msgr2=0x7f0d7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0d94036000 tx=0x7f0d94030000 comp rx=0 tx=0).stop 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d980cbe20 msgr2=0x7f0d981553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d980cbe20 0x7f0d981553b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800c4b0 tx=0x7f0d8800c970 comp rx=0 tx=0).stop 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 shutdown_connections 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d98160a60 0x7f0d9806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d980cbe20 0x7f0d981553b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 --2- 172.21.15.113:0/2043084366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d980ac8b0 0x7f0d9813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 >> 172.21.15.113:0/2043084366 conn(0x7f0d980cf900 msgr2=0x7f0d981548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 shutdown_connections 2023-12-19T13:51:05.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.251+0000 7f0d9f347640 1 -- 172.21.15.113:0/2043084366 wait complete. 2023-12-19T13:51:05.268 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:05.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.468+0000 7f8e14d9c640 1 Processor -- start 2023-12-19T13:51:05.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.468+0000 7f8e14d9c640 1 -- start start 2023-12-19T13:51:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e14d9c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e101449e0 0x7f8e100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e14d9c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8e1006c6b0 0x7f8e100b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e14d9c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e100afb10 con 0x7f8e100b0b50 2023-12-19T13:51:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e14d9c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1006bb30 con 0x7f8e1006c6b0 2023-12-19T13:51:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e14d9c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100b0070 con 0x7f8e101449e0 2023-12-19T13:51:05.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e0e59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e101449e0 0x7f8e100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e0e59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e101449e0 0x7f8e100af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:39470/0 (socket says 172.21.15.113:39470) 2023-12-19T13:51:05.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e0e59c640 1 -- 172.21.15.113:0/3898517709 learned_addr learned my addr 172.21.15.113:0/3898517709 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:05.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.470+0000 7f8e0ed9d640 1 --2- 172.21.15.113:0/3898517709 >> v2:172.21.15.151:3300/0 conn(0x7f8e1006c6b0 0x7f8e100b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.471+0000 7f8e0e59c640 1 -- 172.21.15.113:0/3898517709 >> v2:172.21.15.151:3300/0 conn(0x7f8e1006c6b0 msgr2=0x7f8e100b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:05.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.471+0000 7f8e0e59c640 1 --2- 172.21.15.113:0/3898517709 >> v2:172.21.15.151:3300/0 conn(0x7f8e1006c6b0 0x7f8e100b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.471+0000 7f8e0e59c640 1 -- 172.21.15.113:0/3898517709 >> v1:172.21.15.151:6789/0 conn(0x7f8e100b0b50 legacy=0x7f8e1006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.471+0000 7f8e0e59c640 1 -- 172.21.15.113:0/3898517709 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100b0350 con 0x7f8e101449e0 2023-12-19T13:51:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.472+0000 7f8e0e59c640 1 --2- 172.21.15.113:0/3898517709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e101449e0 0x7f8e100af5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009870 tx=0x7f8e0002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b892fb8b9137e357 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.473+0000 7f8e0d59a640 1 -- 172.21.15.113:0/3898517709 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00031640 con 0x7f8e101449e0 2023-12-19T13:51:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.473+0000 7f8e0d59a640 1 -- 172.21.15.113:0/3898517709 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e000317a0 con 0x7f8e101449e0 2023-12-19T13:51:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.473+0000 7f8e0d59a640 1 -- 172.21.15.113:0/3898517709 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00031b30 con 0x7f8e101449e0 2023-12-19T13:51:05.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3898517709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e101449e0 msgr2=0x7f8e100af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3898517709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e101449e0 0x7f8e100af5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009870 tx=0x7f8e0002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3898517709 shutdown_connections 2023-12-19T13:51:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3898517709 >> v2:172.21.15.151:3300/0 conn(0x7f8e1006c6b0 0x7f8e100b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3898517709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e101449e0 0x7f8e100af5d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3898517709 >> 172.21.15.113:0/3898517709 conn(0x7f8e100cbb70 msgr2=0x7f8e100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3898517709 shutdown_connections 2023-12-19T13:51:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.474+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3898517709 wait complete. 2023-12-19T13:51:05.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.476+0000 7f8e14d9c640 1 Processor -- start 2023-12-19T13:51:05.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.476+0000 7f8e14d9c640 1 -- start start 2023-12-19T13:51:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e14d9c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e1006c6b0 0x7f8e1015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e14d9c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b0b50 0x7f8e1006f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e14d9c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8e101449e0 0x7f8e10139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e14d9c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10139660 con 0x7f8e101449e0 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e14d9c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e101525c0 con 0x7f8e1006c6b0 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e14d9c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10151d20 con 0x7f8e100b0b50 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8e101449e0 0x7f8e10139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8e101449e0 0x7f8e10139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44828/0 (socket says 172.21.15.113:44828) 2023-12-19T13:51:05.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.477+0000 7f8e0ed9d640 1 -- 172.21.15.113:0/3077649431 learned_addr learned my addr 172.21.15.113:0/3077649431 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0e59c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e1006c6b0 0x7f8e1015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0dd9b640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b0b50 0x7f8e1006f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0ed9d640 1 -- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b0b50 msgr2=0x7f8e1006f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0ed9d640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b0b50 0x7f8e1006f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0ed9d640 1 -- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e1006c6b0 msgr2=0x7f8e1015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0ed9d640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e1006c6b0 0x7f8e1015b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0ed9d640 1 -- 172.21.15.113:0/3077649431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000094d0 con 0x7f8e101449e0 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0dd9b640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b0b50 0x7f8e1006f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0e59c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e1006c6b0 0x7f8e1015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e0ed9d640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8e101449e0 0x7f8e10139af0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800efc0 tx=0x7f8e0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08014480 con 0x7f8e101449e0 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800f040 con 0x7f8e101449e0 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08014820 con 0x7f8e101449e0 2023-12-19T13:51:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.478+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e10152000 con 0x7f8e101449e0 2023-12-19T13:51:05.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.479+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1006f8d0 con 0x7f8e101449e0 2023-12-19T13:51:05.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.480+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1006cde0 con 0x7f8e101449e0 2023-12-19T13:51:05.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.481+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e08014980 con 0x7f8e101449e0 2023-12-19T13:51:05.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.481+0000 7f8dfeffd640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8df006a430 0x7f8df006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.481+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8e080897e0 con 0x7f8e101449e0 2023-12-19T13:51:05.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.482+0000 7f8e0e59c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8df006a430 0x7f8df006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.482+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=82}) v3 -- 0x7f8df0072020 con 0x7f8e101449e0 2023-12-19T13:51:05.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.482+0000 7f8e0e59c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8df006a430 0x7f8df006c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8e00036000 tx=0x7f8e0003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.486+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8e08018020 con 0x7f8e101449e0 2023-12-19T13:51:05.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.687+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(82..82 src has 1..82) v4 ==== 1468+0+0 (secure 0 0 0) 0x7f8e08059150 con 0x7f8e101449e0 2023-12-19T13:51:05.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.687+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=83}) v3 -- 0x7f8df00731d0 con 0x7f8e101449e0 2023-12-19T13:51:05.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.700+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e1006d0c0 con 0x7f8e101449e0 2023-12-19T13:51:05.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.701+0000 7f8dfeffd640 1 -- 172.21.15.113:0/3077649431 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4660 (secure 0 0 0) 0x7f8e08054d90 con 0x7f8e101449e0 2023-12-19T13:51:05.701 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:05.701 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:49:36.382415+0000","modified":"2023-12-19T13:49:39.476500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6066":{"gid":6066,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/4085417322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4085417322},{"type":"v1","addr":"172.21.15.151:6835","nonce":4085417322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T13:51:05.702 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 33 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8df006a430 msgr2=0x7f8df006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8df006a430 0x7f8df006c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8e00036000 tx=0x7f8e0003c040 comp rx=0 tx=0).stop 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8e101449e0 msgr2=0x7f8e10139af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8e101449e0 0x7f8e10139af0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800efc0 tx=0x7f8e0800c490 comp rx=0 tx=0).stop 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 shutdown_connections 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8df006a430 0x7f8df006c8f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8e101449e0 0x7f8e10139af0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b0b50 0x7f8e1006f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 --2- 172.21.15.113:0/3077649431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e1006c6b0 0x7f8e1015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 >> 172.21.15.113:0/3077649431 conn(0x7f8e100cbb70 msgr2=0x7f8e100ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:05.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 shutdown_connections 2023-12-19T13:51:05.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.704+0000 7f8e14d9c640 1 -- 172.21.15.113:0/3077649431 wait complete. 2023-12-19T13:51:05.721 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:05.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.920+0000 7f56b164c640 1 Processor -- start 2023-12-19T13:51:05.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.920+0000 7f56b164c640 1 -- start start 2023-12-19T13:51:05.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56b164c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 0x7f56ac06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56b164c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac0b2600 con 0x7f56ac157aa0 2023-12-19T13:51:05.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56b164c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac0b1d60 con 0x7f56ac15e040 2023-12-19T13:51:05.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56b164c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0b2040 con 0x7f56ac0b1710 2023-12-19T13:51:05.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56aaffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f56ac157aa0 0x7f56ac161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39342/0 (socket says 172.21.15.113:39342) 2023-12-19T13:51:05.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56aaffd640 1 -- 172.21.15.113:0/2159829733 learned_addr learned my addr 172.21.15.113:0/2159829733 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:05.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954193086 0 0) 0x7f56ac0b2600 con 0x7f56ac157aa0 2023-12-19T13:51:05.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 0x7f56ac06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.922+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5698003520 con 0x7f56ac157aa0 2023-12-19T13:51:05.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883249691 0 0) 0x7f5698003520 con 0x7f56ac157aa0 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 msgr2=0x7f56ac06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 0x7f56ac06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 >> v1:172.21.15.151:6789/0 conn(0x7f56ac15e040 legacy=0x7f56ac15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac0b2320 con 0x7f56ac157aa0 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f569c0019f0 con 0x7f56ac157aa0 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 >> v1:172.21.15.113:6789/0 conn(0x7f56ac157aa0 legacy=0x7f56ac161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 0x7f5698003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5698003fe0 0x7f56980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5698004d00 0x7f5698005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0b2040 con 0x7f5698003fe0 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569800bb40 con 0x7f5698004d00 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569800bd00 con 0x7f56ac0b1710 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.923+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5698003fe0 0x7f56980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56aaffd640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 0x7f5698003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56aa7fc640 1 -- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 msgr2=0x7f5698003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:05.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56ab7fe640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5698004d00 0x7f5698005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56ac0b1710 0x7f5698003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56aa7fc640 1 -- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5698004d00 msgr2=0x7f5698005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:05.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5698004d00 0x7f5698005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56aa7fc640 1 -- 172.21.15.113:0/2159829733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698003520 con 0x7f5698003fe0 2023-12-19T13:51:05.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.924+0000 7f56ab7fe640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5698004d00 0x7f5698005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.925+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5698003fe0 0x7f56980047c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5694009ac0 tx=0x7f56980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14505a667d7ceb9e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.925+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569402c6b0 con 0x7f5698003fe0 2023-12-19T13:51:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.925+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569402c810 con 0x7f5698003fe0 2023-12-19T13:51:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.925+0000 7f56a9ffb640 1 -- 172.21.15.113:0/2159829733 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569402cba0 con 0x7f5698003fe0 2023-12-19T13:51:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.926+0000 7f56b164c640 1 -- 172.21.15.113:0/2159829733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5698003fe0 msgr2=0x7f56980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.926+0000 7f56b164c640 1 --2- 172.21.15.113:0/2159829733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5698003fe0 0x7f56980047c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5694009ac0 tx=0x7f56980057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.926+0000 7f56ab7fe640 1 -- 172.21.15.113:0/2159829733 reap_dead start 2023-12-19T13:51:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.926+0000 7f56b164c640 1 -- 172.21.15.113:0/2159829733 shutdown_connections 2023-12-19T13:51:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.926+0000 7f56b164c640 1 -- 172.21.15.113:0/2159829733 >> 172.21.15.113:0/2159829733 conn(0x7f56ac0cbb70 msgr2=0x7f56ac0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.926+0000 7f56b164c640 1 -- 172.21.15.113:0/2159829733 shutdown_connections 2023-12-19T13:51:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.926+0000 7f56b164c640 1 -- 172.21.15.113:0/2159829733 wait complete. 2023-12-19T13:51:05.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.928+0000 7f56b164c640 1 Processor -- start 2023-12-19T13:51:05.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.928+0000 7f56b164c640 1 -- start start 2023-12-19T13:51:05.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.929+0000 7f56b164c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5698003fe0 0x7f56ac160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.929+0000 7f56b164c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56ac1f65a0 0x7f56ac143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.929+0000 7f56b164c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56ac0ae280 0x7f56ac0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.929+0000 7f56b164c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0aec70 con 0x7f56ac1f65a0 2023-12-19T13:51:05.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.929+0000 7f56b164c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1f6aa0 con 0x7f56ac0ae280 2023-12-19T13:51:05.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.929+0000 7f56b164c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1f6d80 con 0x7f5698003fe0 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.929+0000 7f56aa7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56ac1f65a0 0x7f56ac143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56ac1f65a0 0x7f56ac143b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44848/0 (socket says 172.21.15.113:44848) 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 -- 172.21.15.113:0/3723359481 learned_addr learned my addr 172.21.15.113:0/3723359481 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56ab7fe640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56ac0ae280 0x7f56ac0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 -- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5698003fe0 msgr2=0x7f56ac160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aaffd640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5698003fe0 0x7f56ac160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5698003fe0 0x7f56ac160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 -- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56ac0ae280 msgr2=0x7f56ac0ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56ac0ae280 0x7f56ac0ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 -- 172.21.15.113:0/3723359481 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac1f7060 con 0x7f56ac1f65a0 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56ab7fe640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56ac0ae280 0x7f56ac0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.930+0000 7f56aa7fc640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56ac1f65a0 0x7f56ac143b20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f569402c250 tx=0x7f5694004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.931+0000 7f56a37fe640 1 -- 172.21.15.113:0/3723359481 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694003810 con 0x7f56ac1f65a0 2023-12-19T13:51:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.931+0000 7f56a37fe640 1 -- 172.21.15.113:0/3723359481 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694003970 con 0x7f56ac1f65a0 2023-12-19T13:51:05.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.931+0000 7f56a37fe640 1 -- 172.21.15.113:0/3723359481 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694003ce0 con 0x7f56ac1f65a0 2023-12-19T13:51:05.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.931+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac1f7340 con 0x7f56ac1f65a0 2023-12-19T13:51:05.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.931+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac160a60 con 0x7f56ac1f65a0 2023-12-19T13:51:05.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.932+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac0aec70 con 0x7f56ac1f65a0 2023-12-19T13:51:05.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.933+0000 7f56a37fe640 1 -- 172.21.15.113:0/3723359481 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5694047450 con 0x7f56ac1f65a0 2023-12-19T13:51:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.934+0000 7f56a37fe640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f568c06a460 0x7f568c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.934+0000 7f56a37fe640 1 -- 172.21.15.113:0/3723359481 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f56940aac80 con 0x7f56ac1f65a0 2023-12-19T13:51:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.934+0000 7f56aaffd640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f568c06a460 0x7f568c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.935+0000 7f56aaffd640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f568c06a460 0x7f568c06c920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f569c007c40 tx=0x7f569c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:05.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:05.938+0000 7f56a37fe640 1 -- 172.21.15.113:0/3723359481 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f56ac0aec70 con 0x7f56ac1f65a0 2023-12-19T13:51:06.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.132+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56ac0aec70 con 0x7f56ac1f65a0 2023-12-19T13:51:06.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.135+0000 7f56a37fe640 1 -- 172.21.15.113:0/3723359481 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16241 (secure 0 0 0) 0x7f56ac0aec70 con 0x7f56ac1f65a0 2023-12-19T13:51:06.135 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:06.135 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":82,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:05.674399+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":4}]},{"pgid":"9.3e","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:06.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.137+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f568c06a460 msgr2=0x7f568c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.137+0000 7f56b164c640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f568c06a460 0x7f568c06c920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f569c007c40 tx=0x7f569c009040 comp rx=0 tx=0).stop 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56ac1f65a0 msgr2=0x7f56ac143b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56ac1f65a0 0x7f56ac143b20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f569402c250 tx=0x7f5694004730 comp rx=0 tx=0).stop 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 shutdown_connections 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f568c06a460 0x7f568c06c920 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56ac0ae280 0x7f56ac0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56ac1f65a0 0x7f56ac143b20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 --2- 172.21.15.113:0/3723359481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5698003fe0 0x7f56ac160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 >> 172.21.15.113:0/3723359481 conn(0x7f56ac0cbb70 msgr2=0x7f56ac15c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 shutdown_connections 2023-12-19T13:51:06.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.138+0000 7f56b164c640 1 -- 172.21.15.113:0/3723359481 wait complete. 2023-12-19T13:51:06.155 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:51:06.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:06.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.366+0000 7fc7a17f0640 1 Processor -- start 2023-12-19T13:51:06.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.366+0000 7fc7a17f0640 1 -- start start 2023-12-19T13:51:06.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.368+0000 7fc7a17f0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc79c1449e0 0x7fc79c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.368+0000 7fc7a17f0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0afb10 con 0x7fc79c0b0b50 2023-12-19T13:51:06.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.368+0000 7fc7a17f0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c06bb30 con 0x7fc79c06c6b0 2023-12-19T13:51:06.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.368+0000 7fc7a17f0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c0b0070 con 0x7fc79c1449e0 2023-12-19T13:51:06.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.368+0000 7fc79affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc79c1449e0 0x7fc79c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.368+0000 7fc79a7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc79c0b0b50 0x7fc79c06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39346/0 (socket says 172.21.15.113:39346) 2023-12-19T13:51:06.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.368+0000 7fc79a7fc640 1 -- 172.21.15.113:0/2158073249 learned_addr learned my addr 172.21.15.113:0/2158073249 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:06.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.369+0000 7fc79affd640 1 -- 172.21.15.113:0/2158073249 >> v1:172.21.15.151:6789/0 conn(0x7fc79c06c6b0 legacy=0x7fc79c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:06.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.369+0000 7fc79affd640 1 -- 172.21.15.113:0/2158073249 >> v1:172.21.15.113:6789/0 conn(0x7fc79c0b0b50 legacy=0x7fc79c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.369+0000 7fc79affd640 1 -- 172.21.15.113:0/2158073249 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0b0350 con 0x7fc79c1449e0 2023-12-19T13:51:06.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.369+0000 7fc799ffb640 1 -- 172.21.15.113:0/2158073249 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935204122 0 0) 0x7fc79c0afb10 con 0x7fc79c0b0b50 2023-12-19T13:51:06.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.370+0000 7fc79affd640 1 --2- 172.21.15.113:0/2158073249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c1449e0 0x7fc79c0af5d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097a0 tx=0x7fc78c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17208dc1d7f39974 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:06.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc799ffb640 1 -- 172.21.15.113:0/2158073249 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c031830 con 0x7fc79c1449e0 2023-12-19T13:51:06.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc799ffb640 1 -- 172.21.15.113:0/2158073249 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c031990 con 0x7fc79c1449e0 2023-12-19T13:51:06.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc799ffb640 1 -- 172.21.15.113:0/2158073249 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c031d20 con 0x7fc79c1449e0 2023-12-19T13:51:06.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc7a17f0640 1 -- 172.21.15.113:0/2158073249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c1449e0 msgr2=0x7fc79c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/2158073249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c1449e0 0x7fc79c0af5d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097a0 tx=0x7fc78c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc7a17f0640 1 -- 172.21.15.113:0/2158073249 shutdown_connections 2023-12-19T13:51:06.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/2158073249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c1449e0 0x7fc79c0af5d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc7a17f0640 1 -- 172.21.15.113:0/2158073249 >> 172.21.15.113:0/2158073249 conn(0x7fc79c0cbb70 msgr2=0x7fc79c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:06.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc7a17f0640 1 -- 172.21.15.113:0/2158073249 shutdown_connections 2023-12-19T13:51:06.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.371+0000 7fc7a17f0640 1 -- 172.21.15.113:0/2158073249 wait complete. 2023-12-19T13:51:06.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.373+0000 7fc7a17f0640 1 Processor -- start 2023-12-19T13:51:06.373 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.373+0000 7fc7a17f0640 1 -- start start 2023-12-19T13:51:06.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.374+0000 7fc7a17f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c06c6b0 0x7fc79c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.374+0000 7fc7a17f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c0b0b50 0x7fc79c0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc7a17f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc79c1449e0 0x7fc79c151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc7a17f0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0a89e0 con 0x7fc79c0b0b50 2023-12-19T13:51:06.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc7a17f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c152340 con 0x7fc79c06c6b0 2023-12-19T13:51:06.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc7a17f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0a8c10 con 0x7fc79c1449e0 2023-12-19T13:51:06.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c0b0b50 0x7fc79c0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c0b0b50 0x7fc79c0a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44856/0 (socket says 172.21.15.113:44856) 2023-12-19T13:51:06.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 -- 172.21.15.113:0/209369429 learned_addr learned my addr 172.21.15.113:0/209369429 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79affd640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c06c6b0 0x7fc79c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79b7fe640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc79c1449e0 0x7fc79c151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 -- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc79c1449e0 msgr2=0x7fc79c151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc79c1449e0 0x7fc79c151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 -- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c06c6b0 msgr2=0x7fc79c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c06c6b0 0x7fc79c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79a7fc640 1 -- 172.21.15.113:0/209369429 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c009400 con 0x7fc79c0b0b50 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79affd640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c06c6b0 0x7fc79c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:06.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.375+0000 7fc79b7fe640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc79c1449e0 0x7fc79c151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.376+0000 7fc79a7fc640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c0b0b50 0x7fc79c0a84a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc79000c4d0 tx=0x7fc79000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.376+0000 7fc7837fe640 1 -- 172.21.15.113:0/209369429 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7900074e0 con 0x7fc79c0b0b50 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.376+0000 7fc7837fe640 1 -- 172.21.15.113:0/209369429 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc790007660 con 0x7fc79c0b0b50 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.376+0000 7fc7837fe640 1 -- 172.21.15.113:0/209369429 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790004a20 con 0x7fc79c0b0b50 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.376+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c0a8ef0 con 0x7fc79c0b0b50 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.376+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c0a94b0 con 0x7fc79c0b0b50 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.377+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c061910 con 0x7fc79c0b0b50 2023-12-19T13:51:06.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.378+0000 7fc7837fe640 1 -- 172.21.15.113:0/209369429 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc790004b80 con 0x7fc79c0b0b50 2023-12-19T13:51:06.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.379+0000 7fc7837fe640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc78806a460 0x7fc78806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.379+0000 7fc7837fe640 1 -- 172.21.15.113:0/209369429 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc790087b30 con 0x7fc79c0b0b50 2023-12-19T13:51:06.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.379+0000 7fc79affd640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc78806a460 0x7fc78806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.380+0000 7fc79affd640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc78806a460 0x7fc78806c920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc78c036000 tx=0x7fc78c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:06.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.383+0000 7fc7837fe640 1 -- 172.21.15.113:0/209369429 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc7900530e0 con 0x7fc79c0b0b50 2023-12-19T13:51:06.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.601+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc79c0ae540 con 0x7fc79c0b0b50 2023-12-19T13:51:06.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.601+0000 7fc7837fe640 1 -- 172.21.15.113:0/209369429 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4660 (secure 0 0 0) 0x7fc790018020 con 0x7fc79c0b0b50 2023-12-19T13:51:06.602 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:06.602 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:49:36.382415+0000","modified":"2023-12-19T13:49:39.476500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6066":{"gid":6066,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/4085417322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4085417322},{"type":"v1","addr":"172.21.15.151:6835","nonce":4085417322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T13:51:06.602 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 33 2023-12-19T13:51:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc78806a460 msgr2=0x7fc78806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc78806a460 0x7fc78806c920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc78c036000 tx=0x7fc78c03c040 comp rx=0 tx=0).stop 2023-12-19T13:51:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c0b0b50 msgr2=0x7fc79c0a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c0b0b50 0x7fc79c0a84a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc79000c4d0 tx=0x7fc79000c990 comp rx=0 tx=0).stop 2023-12-19T13:51:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 shutdown_connections 2023-12-19T13:51:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc78806a460 0x7fc78806c920 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc79c1449e0 0x7fc79c151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc79c0b0b50 0x7fc79c0a84a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 --2- 172.21.15.113:0/209369429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c06c6b0 0x7fc79c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 >> 172.21.15.113:0/209369429 conn(0x7fc79c0cbb70 msgr2=0x7fc79c06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 shutdown_connections 2023-12-19T13:51:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.604+0000 7fc7a17f0640 1 -- 172.21.15.113:0/209369429 wait complete. 2023-12-19T13:51:06.623 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:06.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.818+0000 7fe3756c0640 1 Processor -- start 2023-12-19T13:51:06.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.819+0000 7fe3756c0640 1 -- start start 2023-12-19T13:51:06.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.820+0000 7fe3756c0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015e5a0 0x7fe3700b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.820+0000 7fe3756c0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe37015f680 0x7fe3700b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.820+0000 7fe3756c0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37015ec30 con 0x7fe3700cdbf0 2023-12-19T13:51:06.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.820+0000 7fe3756c0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3700b2cc0 con 0x7fe37015f680 2023-12-19T13:51:06.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.820+0000 7fe3756c0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37015e980 con 0x7fe37015e5a0 2023-12-19T13:51:06.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.821+0000 7fe367fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe37015f680 0x7fe3700b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.821+0000 7fe36ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015e5a0 0x7fe3700b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.821+0000 7fe367fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe37015f680 0x7fe3700b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:37230/0 (socket says 172.21.15.113:37230) 2023-12-19T13:51:06.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.821+0000 7fe367fff640 1 -- 172.21.15.113:0/1359192269 learned_addr learned my addr 172.21.15.113:0/1359192269 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:06.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.822+0000 7fe36ffff640 1 -- 172.21.15.113:0/1359192269 >> v2:172.21.15.151:3300/0 conn(0x7fe37015f680 msgr2=0x7fe3700b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:06.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.822+0000 7fe36ffff640 1 --2- 172.21.15.113:0/1359192269 >> v2:172.21.15.151:3300/0 conn(0x7fe37015f680 0x7fe3700b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.822+0000 7fe36ffff640 1 -- 172.21.15.113:0/1359192269 >> v1:172.21.15.151:6789/0 conn(0x7fe3700cdbf0 legacy=0x7fe37006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:06.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.822+0000 7fe36ffff640 1 -- 172.21.15.113:0/1359192269 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700b2f90 con 0x7fe37015e5a0 2023-12-19T13:51:06.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.822+0000 7fe367fff640 1 --2- 172.21.15.113:0/1359192269 >> v2:172.21.15.151:3300/0 conn(0x7fe37015f680 0x7fe3700b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:51:06.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.823+0000 7fe36ffff640 1 --2- 172.21.15.113:0/1359192269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015e5a0 0x7fe3700b2030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097a0 tx=0x7fe36002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2e7533a7677b2b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:06.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.823+0000 7fe36f7fe640 1 -- 172.21.15.113:0/1359192269 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36002d040 con 0x7fe37015e5a0 2023-12-19T13:51:06.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe36f7fe640 1 -- 172.21.15.113:0/1359192269 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe360031810 con 0x7fe37015e5a0 2023-12-19T13:51:06.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe36f7fe640 1 -- 172.21.15.113:0/1359192269 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360031ba0 con 0x7fe37015e5a0 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 -- 172.21.15.113:0/1359192269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015e5a0 msgr2=0x7fe3700b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 --2- 172.21.15.113:0/1359192269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015e5a0 0x7fe3700b2030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097a0 tx=0x7fe36002b8b0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 -- 172.21.15.113:0/1359192269 shutdown_connections 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 --2- 172.21.15.113:0/1359192269 >> v2:172.21.15.151:3300/0 conn(0x7fe37015f680 0x7fe3700b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 --2- 172.21.15.113:0/1359192269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015e5a0 0x7fe3700b2030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 -- 172.21.15.113:0/1359192269 >> 172.21.15.113:0/1359192269 conn(0x7fe3700b0100 msgr2=0x7fe3700b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 -- 172.21.15.113:0/1359192269 shutdown_connections 2023-12-19T13:51:06.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.824+0000 7fe3756c0640 1 -- 172.21.15.113:0/1359192269 wait complete. 2023-12-19T13:51:06.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.826+0000 7fe3756c0640 1 Processor -- start 2023-12-19T13:51:06.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.826+0000 7fe3756c0640 1 -- start start 2023-12-19T13:51:06.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe3756c0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3700cdbf0 0x7fe37014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe3756c0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe37015e5a0 0x7fe3700ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe3756c0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015f680 0x7fe37014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe3756c0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe370157d70 con 0x7fe3700cdbf0 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe3756c0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37014c930 con 0x7fe37015e5a0 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe3756c0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe370149e10 con 0x7fe37015f680 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe36ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3700cdbf0 0x7fe37014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe36ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3700cdbf0 0x7fe37014c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44858/0 (socket says 172.21.15.113:44858) 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.827+0000 7fe36ffff640 1 -- 172.21.15.113:0/3263904744 learned_addr learned my addr 172.21.15.113:0/3263904744 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe367fff640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe37015e5a0 0x7fe3700ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36ffff640 1 -- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015f680 msgr2=0x7fe37014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36ffff640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015f680 0x7fe37014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36ffff640 1 -- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe37015e5a0 msgr2=0x7fe3700ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36ffff640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe37015e5a0 0x7fe3700ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36ffff640 1 -- 172.21.15.113:0/3263904744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580094d0 con 0x7fe3700cdbf0 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe367fff640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe37015e5a0 0x7fe3700ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36ffff640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3700cdbf0 0x7fe37014c3f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe360000c00 tx=0x7fe3600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36d7fa640 1 -- 172.21.15.113:0/3263904744 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360006e10 con 0x7fe3700cdbf0 2023-12-19T13:51:06.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36d7fa640 1 -- 172.21.15.113:0/3263904744 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36003ad60 con 0x7fe3700cdbf0 2023-12-19T13:51:06.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe36d7fa640 1 -- 172.21.15.113:0/3263904744 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360044610 con 0x7fe3700cdbf0 2023-12-19T13:51:06.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.828+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe360009400 con 0x7fe3700cdbf0 2023-12-19T13:51:06.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.829+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37014a3d0 con 0x7fe3700cdbf0 2023-12-19T13:51:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.830+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37006b6c0 con 0x7fe3700cdbf0 2023-12-19T13:51:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.830+0000 7fe36d7fa640 1 -- 172.21.15.113:0/3263904744 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe36004d450 con 0x7fe3700cdbf0 2023-12-19T13:51:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.831+0000 7fe36d7fa640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe35006a430 0x7fe35006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.831+0000 7fe36d7fa640 1 -- 172.21.15.113:0/3263904744 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe3600aac20 con 0x7fe3700cdbf0 2023-12-19T13:51:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.832+0000 7fe367fff640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe35006a430 0x7fe35006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.832+0000 7fe367fff640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe35006a430 0x7fe35006c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe37015a130 tx=0x7fe358008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:06.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:06.836+0000 7fe36d7fa640 1 -- 172.21.15.113:0/3263904744 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe3600761c0 con 0x7fe3700cdbf0 2023-12-19T13:51:07.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.060+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe370061910 con 0x7fe3700cdbf0 2023-12-19T13:51:07.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.062+0000 7fe36d7fa640 1 -- 172.21.15.113:0/3263904744 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4660 (secure 0 0 0) 0x7fe3600797e0 con 0x7fe3700cdbf0 2023-12-19T13:51:07.061 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:07.061 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:49:36.382415+0000","modified":"2023-12-19T13:49:39.476500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6066":{"gid":6066,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/4085417322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4085417322},{"type":"v1","addr":"172.21.15.151:6835","nonce":4085417322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T13:51:07.062 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 33 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe35006a430 msgr2=0x7fe35006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe35006a430 0x7fe35006c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe37015a130 tx=0x7fe358008040 comp rx=0 tx=0).stop 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3700cdbf0 msgr2=0x7fe37014c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3700cdbf0 0x7fe37014c3f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe360000c00 tx=0x7fe3600046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 shutdown_connections 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe35006a430 0x7fe35006c8f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37015f680 0x7fe37014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe37015e5a0 0x7fe3700ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 --2- 172.21.15.113:0/3263904744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3700cdbf0 0x7fe37014c3f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 >> 172.21.15.113:0/3263904744 conn(0x7fe3700b0100 msgr2=0x7fe37006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 shutdown_connections 2023-12-19T13:51:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.064+0000 7fe3756c0640 1 -- 172.21.15.113:0/3263904744 wait complete. 2023-12-19T13:51:07.082 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:07.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.296+0000 7fc29d98b640 1 Processor -- start 2023-12-19T13:51:07.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.297+0000 7fc29d98b640 1 -- start start 2023-12-19T13:51:07.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.298+0000 7fc29d98b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 0x7fc29815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.298+0000 7fc29d98b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29815b740 con 0x7fc2980ae110 2023-12-19T13:51:07.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.298+0000 7fc29d98b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2980ae640 con 0x7fc2980b0810 2023-12-19T13:51:07.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.298+0000 7fc29d98b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29806b8c0 con 0x7fc298157bf0 2023-12-19T13:51:07.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.298+0000 7fc28e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc2980ae110 0x7fc2980b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39360/0 (socket says 172.21.15.113:39360) 2023-12-19T13:51:07.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.298+0000 7fc28e7fc640 1 -- 172.21.15.113:0/4153879165 learned_addr learned my addr 172.21.15.113:0/4153879165 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210232024 0 0) 0x7fc29815b740 con 0x7fc2980ae110 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc284005730 con 0x7fc2980ae110 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc296ffd640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 0x7fc29815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586702586 0 0) 0x7fc284005730 con 0x7fc2980ae110 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 msgr2=0x7fc29815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 0x7fc29815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 >> v1:172.21.15.151:6789/0 conn(0x7fc2980b0810 legacy=0x7fc29806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980ae920 con 0x7fc2980ae110 2023-12-19T13:51:07.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc280001670 con 0x7fc2980ae110 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 >> v1:172.21.15.113:6789/0 conn(0x7fc2980ae110 legacy=0x7fc2980b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc284005c20 0x7fc284006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc284006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 0x7fc28400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29806b8c0 con 0x7fc2840069d0 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840076f0 con 0x7fc284005c20 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.299+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28400e0d0 con 0x7fc298157bf0 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc28e7fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc284006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc28e7fc640 1 -- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 msgr2=0x7fc28400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc296ffd640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc284005c20 0x7fc284006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc2977fe640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 0x7fc28400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc28e7fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc298157bf0 0x7fc28400db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc28e7fc640 1 -- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc284005c20 msgr2=0x7fc284006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:07.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc28e7fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc284005c20 0x7fc284006020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.300+0000 7fc28e7fc640 1 -- 172.21.15.113:0/4153879165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284005730 con 0x7fc2840069d0 2023-12-19T13:51:07.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.301+0000 7fc28e7fc640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc284006e50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c160 tx=0x7fc284007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50586c8f791e28fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.301+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280005ad0 con 0x7fc2840069d0 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.301+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc280005c30 con 0x7fc2840069d0 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.301+0000 7fc2967fc640 1 -- 172.21.15.113:0/4153879165 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28002c7c0 con 0x7fc2840069d0 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.302+0000 7fc29d98b640 1 -- 172.21.15.113:0/4153879165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 msgr2=0x7fc284006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.302+0000 7fc29d98b640 1 --2- 172.21.15.113:0/4153879165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc284006e50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c160 tx=0x7fc284007a00 comp rx=0 tx=0).stop 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.302+0000 7fc2977fe640 1 -- 172.21.15.113:0/4153879165 reap_dead start 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.302+0000 7fc29d98b640 1 -- 172.21.15.113:0/4153879165 shutdown_connections 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.302+0000 7fc29d98b640 1 -- 172.21.15.113:0/4153879165 >> 172.21.15.113:0/4153879165 conn(0x7fc2980cbb70 msgr2=0x7fc2980cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.302+0000 7fc29d98b640 1 -- 172.21.15.113:0/4153879165 shutdown_connections 2023-12-19T13:51:07.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.302+0000 7fc29d98b640 1 -- 172.21.15.113:0/4153879165 wait complete. 2023-12-19T13:51:07.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.304+0000 7fc29d98b640 1 Processor -- start 2023-12-19T13:51:07.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.304+0000 7fc29d98b640 1 -- start start 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc29d98b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc298154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc29d98b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2980cb430 0x7fc2981e4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc29d98b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2981e4a60 0x7fc2981e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc29d98b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2981e6dd0 con 0x7fc2840069d0 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc29d98b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2981e70b0 con 0x7fc2980cb430 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc29d98b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2981e7390 con 0x7fc2981e4a60 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc296ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc298154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc296ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc298154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44872/0 (socket says 172.21.15.113:44872) 2023-12-19T13:51:07.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc296ffd640 1 -- 172.21.15.113:0/3613606234 learned_addr learned my addr 172.21.15.113:0/3613606234 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:07.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc296ffd640 1 -- 172.21.15.113:0/3613606234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2981e4a60 msgr2=0x7fc2981e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc296ffd640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2981e4a60 0x7fc2981e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc296ffd640 1 -- 172.21.15.113:0/3613606234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2980cb430 msgr2=0x7fc2981e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.305+0000 7fc296ffd640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2980cb430 0x7fc2981e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.306+0000 7fc296ffd640 1 -- 172.21.15.113:0/3613606234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2981e7670 con 0x7fc2840069d0 2023-12-19T13:51:07.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.306+0000 7fc296ffd640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc298154dc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc28800e7e0 tx=0x7fc28800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:07.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.306+0000 7fc294ff9640 1 -- 172.21.15.113:0/3613606234 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800c6d0 con 0x7fc2840069d0 2023-12-19T13:51:07.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.306+0000 7fc294ff9640 1 -- 172.21.15.113:0/3613606234 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28800c830 con 0x7fc2840069d0 2023-12-19T13:51:07.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.306+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2981e7950 con 0x7fc2840069d0 2023-12-19T13:51:07.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.306+0000 7fc294ff9640 1 -- 172.21.15.113:0/3613606234 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800cbe0 con 0x7fc2840069d0 2023-12-19T13:51:07.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.306+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2981e6640 con 0x7fc2840069d0 2023-12-19T13:51:07.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.307+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc298061910 con 0x7fc2840069d0 2023-12-19T13:51:07.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.308+0000 7fc294ff9640 1 -- 172.21.15.113:0/3613606234 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc28800cd40 con 0x7fc2840069d0 2023-12-19T13:51:07.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.309+0000 7fc294ff9640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc27806a430 0x7fc27806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.309+0000 7fc294ff9640 1 -- 172.21.15.113:0/3613606234 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc2880888e0 con 0x7fc2840069d0 2023-12-19T13:51:07.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.309+0000 7fc28e7fc640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc27806a430 0x7fc27806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.310+0000 7fc28e7fc640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc27806a430 0x7fc27806c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc280034000 tx=0x7fc280007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:07.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.313+0000 7fc294ff9640 1 -- 172.21.15.113:0/3613606234 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc288053d70 con 0x7fc2840069d0 2023-12-19T13:51:07.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.491+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc29806c7f0 con 0x7fc2840069d0 2023-12-19T13:51:07.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.493+0000 7fc294ff9640 1 -- 172.21.15.113:0/3613606234 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16241 (secure 0 0 0) 0x7fc288009380 con 0x7fc2840069d0 2023-12-19T13:51:07.492 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:07.493 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":82,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:05.674399+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:49:34.219200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T13:49:35.406746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":4}]},{"pgid":"9.3e","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc27806a430 msgr2=0x7fc27806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc27806a430 0x7fc27806c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc280034000 tx=0x7fc280007000 comp rx=0 tx=0).stop 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 msgr2=0x7fc298154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc298154dc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc28800e7e0 tx=0x7fc28800eca0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 shutdown_connections 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc27806a430 0x7fc27806c8f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2981e4a60 0x7fc2981e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2980cb430 0x7fc2981e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 --2- 172.21.15.113:0/3613606234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2840069d0 0x7fc298154dc0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.495+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 >> 172.21.15.113:0/3613606234 conn(0x7fc2980cbb70 msgr2=0x7fc298156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:07.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.496+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 shutdown_connections 2023-12-19T13:51:07.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.496+0000 7fc29d98b640 1 -- 172.21.15.113:0/3613606234 wait complete. 2023-12-19T13:51:07.513 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:51:07.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.727+0000 7f810f217640 1 Processor -- start 2023-12-19T13:51:07.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.728+0000 7f810f217640 1 -- start start 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.729+0000 7f810f217640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8108146e10 0x7f81080d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.729+0000 7f810f217640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080cd840 con 0x7f81080d2b00 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.729+0000 7f810f217640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080b6e90 con 0x7f81080ce110 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.729+0000 7f810f217640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81080d2430 con 0x7f8108146e10 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.729+0000 7f810cfb3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8108146e10 0x7f81080d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.729+0000 7f810cfb3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8108146e10 0x7f81080d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44880/0 (socket says 172.21.15.113:44880) 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.730+0000 7f810cfb3640 1 -- 172.21.15.113:0/3127142724 learned_addr learned my addr 172.21.15.113:0/3127142724 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.730+0000 7f8107fff640 1 --1- 172.21.15.113:0/3127142724 >> v1:172.21.15.113:6789/0 conn(0x7f81080d2b00 0x7f81080b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39372/0 (socket says 172.21.15.113:39372) 2023-12-19T13:51:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.730+0000 7f810cfb3640 1 -- 172.21.15.113:0/3127142724 >> v1:172.21.15.151:6789/0 conn(0x7f81080ce110 legacy=0x7f81080b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.730+0000 7f810cfb3640 1 -- 172.21.15.113:0/3127142724 >> v1:172.21.15.113:6789/0 conn(0x7f81080d2b00 legacy=0x7f81080b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.730+0000 7f810cfb3640 1 -- 172.21.15.113:0/3127142724 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080d2620 con 0x7f8108146e10 2023-12-19T13:51:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.730+0000 7f81077fe640 1 -- 172.21.15.113:0/3127142724 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642547605 0 0) 0x7f81080cd840 con 0x7f81080d2b00 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.731+0000 7f810cfb3640 1 --2- 172.21.15.113:0/3127142724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8108146e10 0x7f81080d1ef0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009870 tx=0x7f80f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1566712f9bc4e2e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.731+0000 7f81077fe640 1 -- 172.21.15.113:0/3127142724 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0031870 con 0x7f8108146e10 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.731+0000 7f81077fe640 1 -- 172.21.15.113:0/3127142724 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f00319d0 con 0x7f8108146e10 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.731+0000 7f81077fe640 1 -- 172.21.15.113:0/3127142724 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0031d60 con 0x7f8108146e10 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.732+0000 7f810f217640 1 -- 172.21.15.113:0/3127142724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8108146e10 msgr2=0x7f81080d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.732+0000 7f810f217640 1 --2- 172.21.15.113:0/3127142724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8108146e10 0x7f81080d1ef0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009870 tx=0x7f80f002b910 comp rx=0 tx=0).stop 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.732+0000 7f810f217640 1 -- 172.21.15.113:0/3127142724 shutdown_connections 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.732+0000 7f810f217640 1 --2- 172.21.15.113:0/3127142724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8108146e10 0x7f81080d1ef0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.732+0000 7f810f217640 1 -- 172.21.15.113:0/3127142724 >> 172.21.15.113:0/3127142724 conn(0x7f81080b29c0 msgr2=0x7f81080b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.732+0000 7f810f217640 1 -- 172.21.15.113:0/3127142724 shutdown_connections 2023-12-19T13:51:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.732+0000 7f810f217640 1 -- 172.21.15.113:0/3127142724 wait complete. 2023-12-19T13:51:07.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.734+0000 7f810f217640 1 Processor -- start 2023-12-19T13:51:07.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.734+0000 7f810f217640 1 -- start start 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f810f217640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080ce110 0x7f81080cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f810f217640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81080d2b00 0x7f810813df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f810f217640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108146e10 0x7f81081f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f810f217640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080cbc70 con 0x7f81080d2b00 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f810f217640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080cbf50 con 0x7f81080ce110 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f810f217640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81080cc230 con 0x7f8108146e10 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f8107fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81080d2b00 0x7f810813df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f8107fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81080d2b00 0x7f810813df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44894/0 (socket says 172.21.15.113:44894) 2023-12-19T13:51:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.735+0000 7f8107fff640 1 -- 172.21.15.113:0/3163310610 learned_addr learned my addr 172.21.15.113:0/3163310610 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f810cfb3640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080ce110 0x7f81080cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f810d7b4640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108146e10 0x7f81081f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f8107fff640 1 -- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108146e10 msgr2=0x7f81081f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f8107fff640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108146e10 0x7f81081f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f8107fff640 1 -- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080ce110 msgr2=0x7f81080cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f8107fff640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080ce110 0x7f81080cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f8107fff640 1 -- 172.21.15.113:0/3163310610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00094d0 con 0x7f81080d2b00 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f8107fff640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81080d2b00 0x7f810813df60 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c890 tx=0x7f80f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f81057fa640 1 -- 172.21.15.113:0/3163310610 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800a640 con 0x7f81080d2b00 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f81057fa640 1 -- 172.21.15.113:0/3163310610 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f800a7c0 con 0x7f81080d2b00 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f81057fa640 1 -- 172.21.15.113:0/3163310610 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800ab70 con 0x7f81080d2b00 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.736+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81080cc510 con 0x7f81080d2b00 2023-12-19T13:51:07.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.737+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810813e4a0 con 0x7f81080d2b00 2023-12-19T13:51:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.738+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81080cca30 con 0x7f81080d2b00 2023-12-19T13:51:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.739+0000 7f81057fa640 1 -- 172.21.15.113:0/3163310610 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80f800acd0 con 0x7f81080d2b00 2023-12-19T13:51:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.739+0000 7f81057fa640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f80e806a430 0x7f80e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.739+0000 7f81057fa640 1 -- 172.21.15.113:0/3163310610 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f80f8087df0 con 0x7f81080d2b00 2023-12-19T13:51:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.740+0000 7f810cfb3640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f80e806a430 0x7f80e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.740+0000 7f810cfb3640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f80e806a430 0x7f80e806c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f80f0036000 tx=0x7f80f003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.744+0000 7f81057fa640 1 -- 172.21.15.113:0/3163310610 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81080cca30 con 0x7f81080d2b00 2023-12-19T13:51:07.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.975+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f81080cca30 con 0x7f81080d2b00 2023-12-19T13:51:07.976 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:51:07.977+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:51:07.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.995+0000 7f81057fa640 1 -- 172.21.15.113:0/3163310610 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f81080cca30 con 0x7f81080d2b00 2023-12-19T13:51:07.995 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:51:07.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f80e806a430 msgr2=0x7f80e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f80e806a430 0x7f80e806c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f80f0036000 tx=0x7f80f003c040 comp rx=0 tx=0).stop 2023-12-19T13:51:07.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81080d2b00 msgr2=0x7f810813df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:07.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81080d2b00 0x7f810813df60 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c890 tx=0x7f80f800cd50 comp rx=0 tx=0).stop 2023-12-19T13:51:07.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 shutdown_connections 2023-12-19T13:51:07.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f80e806a430 0x7f80e806c8f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108146e10 0x7f81081f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81080d2b00 0x7f810813df60 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 --2- 172.21.15.113:0/3163310610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080ce110 0x7f81080cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:07.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.998+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 >> 172.21.15.113:0/3163310610 conn(0x7f81080b29c0 msgr2=0x7f81080b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:07.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.999+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 shutdown_connections 2023-12-19T13:51:07.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:07.999+0000 7f810f217640 1 -- 172.21.15.113:0/3163310610 wait complete. 2023-12-19T13:51:08.017 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:51:08.098 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:51:08.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.233+0000 7fc0d5207640 1 Processor -- start 2023-12-19T13:51:08.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.234+0000 7fc0d5207640 1 -- start start 2023-12-19T13:51:08.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0d5207640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc0d00b7360 0x7fc0d00b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:08.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0d5207640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0d00cf8e0 0x7fc0d00cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:08.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0d5207640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d00b7d00 con 0x7fc0d0146c40 2023-12-19T13:51:08.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0d5207640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00700c0 con 0x7fc0d00b7360 2023-12-19T13:51:08.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0d5207640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d006f160 con 0x7fc0d00cf8e0 2023-12-19T13:51:08.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0cf7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc0d00b7360 0x7fc0d00b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:08.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0cffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc0d0146c40 0x7fc0d0070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59496/0 (socket says 172.21.15.113:59496) 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0cf7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc0d00b7360 0x7fc0d00b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60542/0 (socket says 172.21.15.113:60542) 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.235+0000 7fc0cffff640 1 -- 172.21.15.113:0/1541677764 learned_addr learned my addr 172.21.15.113:0/1541677764 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.236+0000 7fc0d4a06640 1 --2- 172.21.15.113:0/1541677764 >> v2:172.21.15.151:3300/0 conn(0x7fc0d00cf8e0 0x7fc0d00cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.236+0000 7fc0cf7fe640 1 -- 172.21.15.113:0/1541677764 >> v2:172.21.15.151:3300/0 conn(0x7fc0d00cf8e0 msgr2=0x7fc0d00cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.236+0000 7fc0cf7fe640 1 --2- 172.21.15.113:0/1541677764 >> v2:172.21.15.151:3300/0 conn(0x7fc0d00cf8e0 0x7fc0d00cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.236+0000 7fc0cf7fe640 1 -- 172.21.15.113:0/1541677764 >> v1:172.21.15.113:6789/0 conn(0x7fc0d0146c40 legacy=0x7fc0d0070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.236+0000 7fc0cf7fe640 1 -- 172.21.15.113:0/1541677764 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d006f440 con 0x7fc0d00b7360 2023-12-19T13:51:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.236+0000 7fc0d4a06640 1 --2- 172.21.15.113:0/1541677764 >> v2:172.21.15.151:3300/0 conn(0x7fc0d00cf8e0 0x7fc0d00cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.237+0000 7fc0cf7fe640 1 --2- 172.21.15.113:0/1541677764 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d00b77c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00cf490 tx=0x7fc0b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e95c3cffa7f71be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.237+0000 7fc0ceffd640 1 -- 172.21.15.113:0/1541677764 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8031830 con 0x7fc0d00b7360 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.237+0000 7fc0ceffd640 1 -- 172.21.15.113:0/1541677764 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8031990 con 0x7fc0d00b7360 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.237+0000 7fc0ceffd640 1 -- 172.21.15.113:0/1541677764 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8031d20 con 0x7fc0d00b7360 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 -- 172.21.15.113:0/1541677764 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 msgr2=0x7fc0d00b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 --2- 172.21.15.113:0/1541677764 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d00b77c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00cf490 tx=0x7fc0b802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 -- 172.21.15.113:0/1541677764 shutdown_connections 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 --2- 172.21.15.113:0/1541677764 >> v2:172.21.15.151:3300/0 conn(0x7fc0d00cf8e0 0x7fc0d00cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 --2- 172.21.15.113:0/1541677764 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d00b77c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 -- 172.21.15.113:0/1541677764 >> 172.21.15.113:0/1541677764 conn(0x7fc0d00d31b0 msgr2=0x7fc0d00d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 -- 172.21.15.113:0/1541677764 shutdown_connections 2023-12-19T13:51:08.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.238+0000 7fc0d5207640 1 -- 172.21.15.113:0/1541677764 wait complete. 2023-12-19T13:51:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.240+0000 7fc0d5207640 1 Processor -- start 2023-12-19T13:51:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.240+0000 7fc0d5207640 1 -- start start 2023-12-19T13:51:08.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0d5207640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d01354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0d5207640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0d00cf8e0 0x7fc0d015f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0d5207640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0d0146c40 0x7fc0d01340a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0d5207640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0133c80 con 0x7fc0d00b7360 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0d5207640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d01359f0 con 0x7fc0d00cf8e0 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0d5207640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0133000 con 0x7fc0d0146c40 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d01354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d01354b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60548/0 (socket says 172.21.15.113:60548) 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.241+0000 7fc0cffff640 1 -- 172.21.15.113:0/165201093 learned_addr learned my addr 172.21.15.113:0/165201093 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0cffff640 1 -- 172.21.15.113:0/165201093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0d0146c40 msgr2=0x7fc0d01340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0cffff640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0d0146c40 0x7fc0d01340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0cffff640 1 -- 172.21.15.113:0/165201093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0d00cf8e0 msgr2=0x7fc0d015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0cffff640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0d00cf8e0 0x7fc0d015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0cffff640 1 -- 172.21.15.113:0/165201093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b8009400 con 0x7fc0d00b7360 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0cffff640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d01354b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000cbc0 tx=0x7fc0c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0ccff9640 1 -- 172.21.15.113:0/165201093 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c000aca0 con 0x7fc0d00b7360 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0ccff9640 1 -- 172.21.15.113:0/165201093 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c000ae00 con 0x7fc0d00b7360 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0ccff9640 1 -- 172.21.15.113:0/165201093 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0012600 con 0x7fc0d00b7360 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.242+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d01332e0 con 0x7fc0d00b7360 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.243+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d01338a0 con 0x7fc0d00b7360 2023-12-19T13:51:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.244+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d0061910 con 0x7fc0d00b7360 2023-12-19T13:51:08.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.245+0000 7fc0ccff9640 1 -- 172.21.15.113:0/165201093 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0c0007070 con 0x7fc0d00b7360 2023-12-19T13:51:08.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.246+0000 7fc0ccff9640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0b006a460 0x7fc0b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.246+0000 7fc0ccff9640 1 -- 172.21.15.113:0/165201093 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc0c0088760 con 0x7fc0d00b7360 2023-12-19T13:51:08.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.246+0000 7fc0cf7fe640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0b006a460 0x7fc0b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.247+0000 7fc0cf7fe640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0b006a460 0x7fc0b006c920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8036000 tx=0x7fc0b8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:08.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.250+0000 7fc0ccff9640 1 -- 172.21.15.113:0/165201093 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc0c0053e00 con 0x7fc0d00b7360 2023-12-19T13:51:08.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:08.481+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc0d00b8a50 con 0x7fc0d00b7360 2023-12-19T13:51:09.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.005+0000 7fc0ccff9640 1 -- 172.21.15.113:0/165201093 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0c0057420 con 0x7fc0d00b7360 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0b006a460 msgr2=0x7fc0b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0b006a460 0x7fc0b006c920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8036000 tx=0x7fc0b8030000 comp rx=0 tx=0).stop 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 msgr2=0x7fc0d01354b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d01354b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000cbc0 tx=0x7fc0c000a060 comp rx=0 tx=0).stop 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 shutdown_connections 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0b006a460 0x7fc0b006c920 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0d0146c40 0x7fc0d01340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0d00cf8e0 0x7fc0d015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 --2- 172.21.15.113:0/165201093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0d00b7360 0x7fc0d01354b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.009+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 >> 172.21.15.113:0/165201093 conn(0x7fc0d00d31b0 msgr2=0x7fc0d0144710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:09.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.010+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 shutdown_connections 2023-12-19T13:51:09.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.010+0000 7fc0d5207640 1 -- 172.21.15.113:0/165201093 wait complete. 2023-12-19T13:51:09.031 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:51:09.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.252+0000 7fbeb068f640 1 Processor -- start 2023-12-19T13:51:09.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.252+0000 7fbeb068f640 1 -- start start 2023-12-19T13:51:09.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.253+0000 7fbeb068f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbea813e200 0x7fbea80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:09.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeb068f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbea8141660 0x7fbea8140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:09.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeb068f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8140f70 0x7fbea815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:09.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeb068f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea81413c0 con 0x7fbea8141660 2023-12-19T13:51:09.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeb068f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea80b1880 con 0x7fbea813e200 2023-12-19T13:51:09.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeb068f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80b26e0 con 0x7fbea8140f70 2023-12-19T13:51:09.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeadc2a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbea8141660 0x7fbea8140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:09.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeadc2a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbea8141660 0x7fbea8140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60550/0 (socket says 172.21.15.113:60550) 2023-12-19T13:51:09.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeadc2a640 1 -- 172.21.15.113:0/2553937458 learned_addr learned my addr 172.21.15.113:0/2553937458 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:09.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeae42b640 1 --2- 172.21.15.113:0/2553937458 >> v2:172.21.15.151:3300/0 conn(0x7fbea813e200 0x7fbea80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:09.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeaec2c640 1 --2- 172.21.15.113:0/2553937458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8140f70 0x7fbea815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:09.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeadc2a640 1 -- 172.21.15.113:0/2553937458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8140f70 msgr2=0x7fbea815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:09.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeadc2a640 1 --2- 172.21.15.113:0/2553937458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8140f70 0x7fbea815ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeadc2a640 1 -- 172.21.15.113:0/2553937458 >> v2:172.21.15.151:3300/0 conn(0x7fbea813e200 msgr2=0x7fbea80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:09.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.254+0000 7fbeadc2a640 1 --2- 172.21.15.113:0/2553937458 >> v2:172.21.15.151:3300/0 conn(0x7fbea813e200 0x7fbea80ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.255+0000 7fbeadc2a640 1 -- 172.21.15.113:0/2553937458 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80cf020 con 0x7fbea8141660 2023-12-19T13:51:09.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.256+0000 7fbeadc2a640 1 --2- 172.21.15.113:0/2553937458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8141660 0x7fbea8140a30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbea80b1530 tx=0x7fbe9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2a6a42aca6d737 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:09.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.256+0000 7fbead429640 1 -- 172.21.15.113:0/2553937458 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98031870 con 0x7fbea8141660 2023-12-19T13:51:09.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.256+0000 7fbead429640 1 -- 172.21.15.113:0/2553937458 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980319d0 con 0x7fbea8141660 2023-12-19T13:51:09.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.256+0000 7fbead429640 1 -- 172.21.15.113:0/2553937458 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98031d60 con 0x7fbea8141660 2023-12-19T13:51:09.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.256+0000 7fbeb068f640 1 -- 172.21.15.113:0/2553937458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8141660 msgr2=0x7fbea8140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.256+0000 7fbeb068f640 1 --2- 172.21.15.113:0/2553937458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8141660 0x7fbea8140a30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbea80b1530 tx=0x7fbe9802b910 comp rx=0 tx=0).stop 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.257+0000 7fbeb068f640 1 -- 172.21.15.113:0/2553937458 shutdown_connections 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.257+0000 7fbeb068f640 1 --2- 172.21.15.113:0/2553937458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8140f70 0x7fbea815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.257+0000 7fbeb068f640 1 --2- 172.21.15.113:0/2553937458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8141660 0x7fbea8140a30 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.257+0000 7fbeb068f640 1 --2- 172.21.15.113:0/2553937458 >> v2:172.21.15.151:3300/0 conn(0x7fbea813e200 0x7fbea80ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.257+0000 7fbeb068f640 1 -- 172.21.15.113:0/2553937458 >> 172.21.15.113:0/2553937458 conn(0x7fbea80cf230 msgr2=0x7fbea80cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.257+0000 7fbeb068f640 1 -- 172.21.15.113:0/2553937458 shutdown_connections 2023-12-19T13:51:09.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.257+0000 7fbeb068f640 1 -- 172.21.15.113:0/2553937458 wait complete. 2023-12-19T13:51:09.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.258+0000 7fbeb068f640 1 Processor -- start 2023-12-19T13:51:09.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.259+0000 7fbeb068f640 1 -- start start 2023-12-19T13:51:09.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.259+0000 7fbeb068f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbea813e200 0x7fbea8139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:09.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.259+0000 7fbeb068f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8140f70 0x7fbea806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:09.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.259+0000 7fbeb068f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8141660 0x7fbea80b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:09.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.259+0000 7fbeb068f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea806ff50 con 0x7fbea8140f70 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.259+0000 7fbeb068f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80b1050 con 0x7fbea813e200 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.259+0000 7fbeb068f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8070180 con 0x7fbea8141660 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8140f70 0x7fbea806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8140f70 0x7fbea806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60552/0 (socket says 172.21.15.113:60552) 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 -- 172.21.15.113:0/658941399 learned_addr learned my addr 172.21.15.113:0/658941399 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeae42b640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbea813e200 0x7fbea8139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeaec2c640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8141660 0x7fbea80b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 -- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8141660 msgr2=0x7fbea80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8141660 0x7fbea80b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 -- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbea813e200 msgr2=0x7fbea8139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbea813e200 0x7fbea8139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeadc2a640 1 -- 172.21.15.113:0/658941399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe980094d0 con 0x7fbea8140f70 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeae42b640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbea813e200 0x7fbea8139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:09.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.260+0000 7fbeaec2c640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8141660 0x7fbea80b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:09.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.261+0000 7fbeadc2a640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8140f70 0x7fbea806fa10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbe9802b950 tx=0x7fbe980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:09.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.261+0000 7fbe9effd640 1 -- 172.21.15.113:0/658941399 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9803ad30 con 0x7fbea8140f70 2023-12-19T13:51:09.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.261+0000 7fbe9effd640 1 -- 172.21.15.113:0/658941399 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980443f0 con 0x7fbea8140f70 2023-12-19T13:51:09.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.261+0000 7fbe9effd640 1 -- 172.21.15.113:0/658941399 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980447a0 con 0x7fbea8140f70 2023-12-19T13:51:09.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.261+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8070460 con 0x7fbea8140f70 2023-12-19T13:51:09.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.261+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea8070a20 con 0x7fbea8140f70 2023-12-19T13:51:09.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.262+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea8061910 con 0x7fbea8140f70 2023-12-19T13:51:09.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.263+0000 7fbe9effd640 1 -- 172.21.15.113:0/658941399 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe98044900 con 0x7fbea8140f70 2023-12-19T13:51:09.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.264+0000 7fbe9effd640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe8c06a430 0x7fbe8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:09.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.264+0000 7fbe9effd640 1 -- 172.21.15.113:0/658941399 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fbe9802d040 con 0x7fbea8140f70 2023-12-19T13:51:09.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.264+0000 7fbeae42b640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe8c06a430 0x7fbe8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:09.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.265+0000 7fbeae42b640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe8c06a430 0x7fbe8c06c8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbea4006fd0 tx=0x7fbea4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:09.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.268+0000 7fbe9effd640 1 -- 172.21.15.113:0/658941399 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbe98076570 con 0x7fbea8140f70 2023-12-19T13:51:09.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:09.456+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbea80cd5d0 con 0x7fbea8140f70 2023-12-19T13:51:10.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.016+0000 7fbe9effd640 1 -- 172.21.15.113:0/658941399 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbe98035020 con 0x7fbea8140f70 2023-12-19T13:51:10.017 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:51:10.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.020+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe8c06a430 msgr2=0x7fbe8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:10.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.020+0000 7fbeb068f640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe8c06a430 0x7fbe8c06c8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbea4006fd0 tx=0x7fbea4008040 comp rx=0 tx=0).stop 2023-12-19T13:51:10.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.020+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8140f70 msgr2=0x7fbea806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:10.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.020+0000 7fbeb068f640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8140f70 0x7fbea806fa10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbe9802b950 tx=0x7fbe980046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 shutdown_connections 2023-12-19T13:51:10.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe8c06a430 0x7fbe8c06c8f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbea8141660 0x7fbea80b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbea8140f70 0x7fbea806fa10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 --2- 172.21.15.113:0/658941399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbea813e200 0x7fbea8139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 >> 172.21.15.113:0/658941399 conn(0x7fbea80cf230 msgr2=0x7fbea80cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:10.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 shutdown_connections 2023-12-19T13:51:10.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.021+0000 7fbeb068f640 1 -- 172.21.15.113:0/658941399 wait complete. 2023-12-19T13:51:10.041 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:51:10.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.258+0000 7f0c26177640 1 Processor -- start 2023-12-19T13:51:10.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.259+0000 7f0c26177640 1 -- start start 2023-12-19T13:51:10.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.260+0000 7f0c26177640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c200acb20 0x7f0c20145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.260+0000 7f0c26177640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0c200acf00 0x7f0c20146200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.260+0000 7f0c26177640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0c2006db50 0x7f0c2006dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.260+0000 7f0c26177640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2006e8c0 con 0x7f0c2006db50 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.260+0000 7f0c26177640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c20146740 con 0x7f0c200acf00 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.260+0000 7f0c26177640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20161cc0 con 0x7f0c200acb20 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0c2006db50 0x7f0c2006dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0c2006db50 0x7f0c2006dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60556/0 (socket says 172.21.15.113:60556) 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 -- 172.21.15.113:0/1509951183 learned_addr learned my addr 172.21.15.113:0/1509951183 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1f7fe640 1 --2- 172.21.15.113:0/1509951183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c200acb20 0x7f0c20145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c17fff640 1 --2- 172.21.15.113:0/1509951183 >> v2:172.21.15.151:3300/0 conn(0x7f0c200acf00 0x7f0c20146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 -- 172.21.15.113:0/1509951183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c200acb20 msgr2=0x7f0c20145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 --2- 172.21.15.113:0/1509951183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c200acb20 0x7f0c20145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 -- 172.21.15.113:0/1509951183 >> v2:172.21.15.151:3300/0 conn(0x7f0c200acf00 msgr2=0x7f0c20146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 --2- 172.21.15.113:0/1509951183 >> v2:172.21.15.151:3300/0 conn(0x7f0c200acf00 0x7f0c20146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.261+0000 7f0c1ffff640 1 -- 172.21.15.113:0/1509951183 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c20162150 con 0x7f0c2006db50 2023-12-19T13:51:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.262+0000 7f0c1ffff640 1 --2- 172.21.15.113:0/1509951183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c2006db50 0x7f0c2006dfe0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0c20071af0 tx=0x7f0c1802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10e0c0c3e3d5874 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.262+0000 7f0c1effd640 1 -- 172.21.15.113:0/1509951183 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1802ca70 con 0x7f0c2006db50 2023-12-19T13:51:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.262+0000 7f0c1effd640 1 -- 172.21.15.113:0/1509951183 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1802cbd0 con 0x7f0c2006db50 2023-12-19T13:51:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.262+0000 7f0c1effd640 1 -- 172.21.15.113:0/1509951183 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180343f0 con 0x7f0c2006db50 2023-12-19T13:51:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 -- 172.21.15.113:0/1509951183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c2006db50 msgr2=0x7f0c2006dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 --2- 172.21.15.113:0/1509951183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c2006db50 0x7f0c2006dfe0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0c20071af0 tx=0x7f0c1802bed0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 -- 172.21.15.113:0/1509951183 shutdown_connections 2023-12-19T13:51:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 --2- 172.21.15.113:0/1509951183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c2006db50 0x7f0c2006dfe0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 --2- 172.21.15.113:0/1509951183 >> v2:172.21.15.151:3300/0 conn(0x7f0c200acf00 0x7f0c20146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 --2- 172.21.15.113:0/1509951183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c200acb20 0x7f0c20145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 -- 172.21.15.113:0/1509951183 >> 172.21.15.113:0/1509951183 conn(0x7f0c200cf2f0 msgr2=0x7f0c200cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 -- 172.21.15.113:0/1509951183 shutdown_connections 2023-12-19T13:51:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.263+0000 7f0c26177640 1 -- 172.21.15.113:0/1509951183 wait complete. 2023-12-19T13:51:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.265+0000 7f0c26177640 1 Processor -- start 2023-12-19T13:51:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.265+0000 7f0c26177640 1 -- start start 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c26177640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c2006db50 0x7f0c200b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c26177640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c200acb20 0x7f0c201f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c26177640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c200acf00 0x7f0c20144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c26177640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c201f7010 con 0x7f0c200acf00 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c26177640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c201f6080 con 0x7f0c200acb20 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c26177640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c201450b0 con 0x7f0c2006db50 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c200acf00 0x7f0c20144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c200acf00 0x7f0c20144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60570/0 (socket says 172.21.15.113:60570) 2023-12-19T13:51:10.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.266+0000 7f0c1ffff640 1 -- 172.21.15.113:0/2950387534 learned_addr learned my addr 172.21.15.113:0/2950387534 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1f7fe640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c2006db50 0x7f0c200b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1ffff640 1 -- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c2006db50 msgr2=0x7f0c200b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1ffff640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c2006db50 0x7f0c200b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1ffff640 1 -- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c200acb20 msgr2=0x7f0c201f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1ffff640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c200acb20 0x7f0c201f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1ffff640 1 -- 172.21.15.113:0/2950387534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c18009b30 con 0x7f0c200acf00 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1f7fe640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c2006db50 0x7f0c200b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1ffff640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c200acf00 0x7f0c20144b70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0c18036040 tx=0x7f0c18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1cff9640 1 -- 172.21.15.113:0/2950387534 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18009510 con 0x7f0c200acf00 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1cff9640 1 -- 172.21.15.113:0/2950387534 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1803e450 con 0x7f0c200acf00 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c1cff9640 1 -- 172.21.15.113:0/2950387534 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1803e800 con 0x7f0c200acf00 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.267+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c20145330 con 0x7f0c200acf00 2023-12-19T13:51:10.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.268+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c201f62d0 con 0x7f0c200acf00 2023-12-19T13:51:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.269+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c20074770 con 0x7f0c200acf00 2023-12-19T13:51:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.270+0000 7f0c1cff9640 1 -- 172.21.15.113:0/2950387534 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c1803e960 con 0x7f0c200acf00 2023-12-19T13:51:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.270+0000 7f0c1cff9640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c0006a460 0x7f0c0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.271+0000 7f0c1cff9640 1 -- 172.21.15.113:0/2950387534 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f0c180ab3d0 con 0x7f0c200acf00 2023-12-19T13:51:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.271+0000 7f0c1f7fe640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c0006a460 0x7f0c0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.271+0000 7f0c1f7fe640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c0006a460 0x7f0c0006c920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c10006fd0 tx=0x7f0c10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.275+0000 7f0c1cff9640 1 -- 172.21.15.113:0/2950387534 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c18076a40 con 0x7f0c200acf00 2023-12-19T13:51:10.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:10.464+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c20061910 con 0x7f0c200acf00 2023-12-19T13:51:11.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.026+0000 7f0c1cff9640 1 -- 172.21.15.113:0/2950387534 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0c1807a060 con 0x7f0c200acf00 2023-12-19T13:51:11.025 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:51:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.029+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c0006a460 msgr2=0x7f0c0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.029+0000 7f0c26177640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c0006a460 0x7f0c0006c920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c10006fd0 tx=0x7f0c10008040 comp rx=0 tx=0).stop 2023-12-19T13:51:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.029+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c200acf00 msgr2=0x7f0c20144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.029+0000 7f0c26177640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c200acf00 0x7f0c20144b70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0c18036040 tx=0x7f0c18004a40 comp rx=0 tx=0).stop 2023-12-19T13:51:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.030+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 shutdown_connections 2023-12-19T13:51:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.030+0000 7f0c26177640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c0006a460 0x7f0c0006c920 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.030+0000 7f0c26177640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c200acf00 0x7f0c20144b70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.030+0000 7f0c26177640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c200acb20 0x7f0c201f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.030+0000 7f0c26177640 1 --2- 172.21.15.113:0/2950387534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c2006db50 0x7f0c200b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.030+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 >> 172.21.15.113:0/2950387534 conn(0x7f0c200cf2f0 msgr2=0x7f0c200cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.030+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 shutdown_connections 2023-12-19T13:51:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.031+0000 7f0c26177640 1 -- 172.21.15.113:0/2950387534 wait complete. 2023-12-19T13:51:11.053 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:51:11.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.261+0000 7fcc09fd0640 1 Processor -- start 2023-12-19T13:51:11.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.261+0000 7fcc09fd0640 1 -- start start 2023-12-19T13:51:11.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc09fd0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcc0415a190 0x7fcc040aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc09fd0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc040aef40 0x7fcc040b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc09fd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc040b07f0 0x7fcc040ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc09fd0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc040b0c40 con 0x7fcc0415a190 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc09fd0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc040ad960 con 0x7fcc040aef40 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc09fd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040adc40 con 0x7fcc040b07f0 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc037fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcc0415a190 0x7fcc040aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc037fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcc0415a190 0x7fcc040aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60580/0 (socket says 172.21.15.113:60580) 2023-12-19T13:51:11.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.262+0000 7fcc037fe640 1 -- 172.21.15.113:0/2152001597 learned_addr learned my addr 172.21.15.113:0/2152001597 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:11.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcc037fe640 1 -- 172.21.15.113:0/2152001597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc040b07f0 msgr2=0x7fcc040ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:11.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcc03fff640 1 --2- 172.21.15.113:0/2152001597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc040b07f0 0x7fcc040ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcc037fe640 1 --2- 172.21.15.113:0/2152001597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc040b07f0 0x7fcc040ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcc037fe640 1 -- 172.21.15.113:0/2152001597 >> v2:172.21.15.151:3300/0 conn(0x7fcc040aef40 msgr2=0x7fcc040b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:11.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcbfbfff640 1 --2- 172.21.15.113:0/2152001597 >> v2:172.21.15.151:3300/0 conn(0x7fcc040aef40 0x7fcc040b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcc037fe640 1 --2- 172.21.15.113:0/2152001597 >> v2:172.21.15.151:3300/0 conn(0x7fcc040aef40 0x7fcc040b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcc037fe640 1 -- 172.21.15.113:0/2152001597 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc040adf20 con 0x7fcc0415a190 2023-12-19T13:51:11.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.263+0000 7fcbfbfff640 1 --2- 172.21.15.113:0/2152001597 >> v2:172.21.15.151:3300/0 conn(0x7fcc040aef40 0x7fcc040b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:11.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.264+0000 7fcc037fe640 1 --2- 172.21.15.113:0/2152001597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc0415a190 0x7fcc040aea00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fcc040cbaa0 tx=0x7fcbf402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd01ce7f2f3c454 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:11.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.264+0000 7fcc02ffd640 1 -- 172.21.15.113:0/2152001597 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40317e0 con 0x7fcc0415a190 2023-12-19T13:51:11.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.264+0000 7fcc02ffd640 1 -- 172.21.15.113:0/2152001597 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf4031940 con 0x7fcc0415a190 2023-12-19T13:51:11.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.264+0000 7fcc02ffd640 1 -- 172.21.15.113:0/2152001597 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4031cd0 con 0x7fcc0415a190 2023-12-19T13:51:11.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 -- 172.21.15.113:0/2152001597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc0415a190 msgr2=0x7fcc040aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/2152001597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc0415a190 0x7fcc040aea00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fcc040cbaa0 tx=0x7fcbf402b880 comp rx=0 tx=0).stop 2023-12-19T13:51:11.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 -- 172.21.15.113:0/2152001597 shutdown_connections 2023-12-19T13:51:11.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/2152001597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc040b07f0 0x7fcc040ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/2152001597 >> v2:172.21.15.151:3300/0 conn(0x7fcc040aef40 0x7fcc040b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/2152001597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc0415a190 0x7fcc040aea00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 -- 172.21.15.113:0/2152001597 >> 172.21.15.113:0/2152001597 conn(0x7fcc04066160 msgr2=0x7fcc040cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:11.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 -- 172.21.15.113:0/2152001597 shutdown_connections 2023-12-19T13:51:11.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.265+0000 7fcc09fd0640 1 -- 172.21.15.113:0/2152001597 wait complete. 2023-12-19T13:51:11.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.267+0000 7fcc09fd0640 1 Processor -- start 2023-12-19T13:51:11.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.267+0000 7fcc09fd0640 1 -- start start 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc09fd0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc040b07f0 0x7fcc040acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc09fd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc0415a190 0x7fcc0406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc09fd0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc0406f660 0x7fcc0414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc09fd0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0406fb10 con 0x7fcc040b07f0 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc09fd0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040ad480 con 0x7fcc0406f660 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc09fd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04149900 con 0x7fcc0415a190 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc040b07f0 0x7fcc040acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc040b07f0 0x7fcc040acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60590/0 (socket says 172.21.15.113:60590) 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.268+0000 7fcc037fe640 1 -- 172.21.15.113:0/1190136310 learned_addr learned my addr 172.21.15.113:0/1190136310 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:11.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc037fe640 1 -- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc0415a190 msgr2=0x7fcc0406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcbfbfff640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc0415a190 0x7fcc0406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc03fff640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc0406f660 0x7fcc0414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc037fe640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc0415a190 0x7fcc0406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc037fe640 1 -- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc0406f660 msgr2=0x7fcc0414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc037fe640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc0406f660 0x7fcc0414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc037fe640 1 -- 172.21.15.113:0/1190136310 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40094d0 con 0x7fcc040b07f0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcbfbfff640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc0415a190 0x7fcc0406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc037fe640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc040b07f0 0x7fcc040acf40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4000c00 tx=0x7fcbf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc00ff9640 1 -- 172.21.15.113:0/1190136310 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4032900 con 0x7fcc040b07f0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc00ff9640 1 -- 172.21.15.113:0/1190136310 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf4032a60 con 0x7fcc040b07f0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc00ff9640 1 -- 172.21.15.113:0/1190136310 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4032e10 con 0x7fcc040b07f0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc04149be0 con 0x7fcc040b07f0 2023-12-19T13:51:11.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.269+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0414a1a0 con 0x7fcc040b07f0 2023-12-19T13:51:11.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.270+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0414a390 con 0x7fcc040b07f0 2023-12-19T13:51:11.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.271+0000 7fcc00ff9640 1 -- 172.21.15.113:0/1190136310 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbf404e450 con 0x7fcc040b07f0 2023-12-19T13:51:11.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.272+0000 7fcc00ff9640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbe406a460 0x7fcbe406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.272+0000 7fcc00ff9640 1 -- 172.21.15.113:0/1190136310 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcbf40aa960 con 0x7fcc040b07f0 2023-12-19T13:51:11.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.273+0000 7fcbfbfff640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbe406a460 0x7fcbe406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.273+0000 7fcbfbfff640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbe406a460 0x7fcbe406c920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406dac0 tx=0x7fcbec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.276+0000 7fcc00ff9640 1 -- 172.21.15.113:0/1190136310 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbf4076260 con 0x7fcc040b07f0 2023-12-19T13:51:11.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.471+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcc04061910 con 0x7fcc040b07f0 2023-12-19T13:51:11.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.477+0000 7fcc00ff9640 1 -- 172.21.15.113:0/1190136310 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcbf4079880 con 0x7fcc040b07f0 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbe406a460 msgr2=0x7fcbe406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbe406a460 0x7fcbe406c920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406dac0 tx=0x7fcbec008040 comp rx=0 tx=0).stop 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc040b07f0 msgr2=0x7fcc040acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc040b07f0 0x7fcc040acf40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4000c00 tx=0x7fcbf40046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 shutdown_connections 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbe406a460 0x7fcbe406c920 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc0406f660 0x7fcc0414b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc0415a190 0x7fcc0406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 --2- 172.21.15.113:0/1190136310 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc040b07f0 0x7fcc040acf40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 >> 172.21.15.113:0/1190136310 conn(0x7fcc04066160 msgr2=0x7fcc0406fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 shutdown_connections 2023-12-19T13:51:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.480+0000 7fcc09fd0640 1 -- 172.21.15.113:0/1190136310 wait complete. 2023-12-19T13:51:11.498 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-19T13:51:11.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.715+0000 7f38ddfc4640 1 Processor -- start 2023-12-19T13:51:11.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.715+0000 7f38ddfc4640 1 -- start start 2023-12-19T13:51:11.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.716+0000 7f38ddfc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d80b2030 0x7f38d815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.716+0000 7f38ddfc4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d815ec30 con 0x7f38d80cdbf0 2023-12-19T13:51:11.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.716+0000 7f38ddfc4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d815fbc0 con 0x7f38d815e5a0 2023-12-19T13:51:11.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.716+0000 7f38ddfc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d815e980 con 0x7f38d80b2030 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38dd7c3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f38d80cdbf0 0x7f38d806c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59506/0 (socket says 172.21.15.113:59506) 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38dd7c3640 1 -- 172.21.15.113:0/3623766822 learned_addr learned my addr 172.21.15.113:0/3623766822 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d7fff640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d80b2030 0x7f38d815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408635757 0 0) 0x7f38d815ec30 con 0x7f38d80cdbf0 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c8003520 con 0x7f38d80cdbf0 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 826767128 0 0) 0x7f38c8003520 con 0x7f38d80cdbf0 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d80b2030 msgr2=0x7f38d815f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d80b2030 0x7f38d815f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 >> v1:172.21.15.151:6789/0 conn(0x7f38d815e5a0 legacy=0x7f38d80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80b2f90 con 0x7f38d80cdbf0 2023-12-19T13:51:11.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f38d00019f0 con 0x7f38d80cdbf0 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 >> v1:172.21.15.113:6789/0 conn(0x7f38d80cdbf0 legacy=0x7f38d806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.717+0000 7f38d77fe640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38c80039a0 0x7f38c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d77fe640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38c80047c0 0x7f38c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d77fe640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c8005180 0x7f38c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d815e980 con 0x7f38c80047c0 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c800c050 con 0x7f38c8005180 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c800c1e0 con 0x7f38c80039a0 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d7fff640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38c80047c0 0x7f38c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38dcfc2640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38c80039a0 0x7f38c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d7fff640 1 -- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38c80039a0 msgr2=0x7f38c8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d7fff640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38c80039a0 0x7f38c8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d7fff640 1 -- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c8005180 msgr2=0x7f38c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:11.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d7fff640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c8005180 0x7f38c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.718+0000 7f38d7fff640 1 -- 172.21.15.113:0/3623766822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c8003520 con 0x7f38c80047c0 2023-12-19T13:51:11.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.719+0000 7f38d7fff640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38c80047c0 0x7f38c8004c40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f38c400b900 tx=0x7f38c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854a31abfedfb3fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4034610 con 0x7f38c80047c0 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c402e070 con 0x7f38c80047c0 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38d77fe640 1 -- 172.21.15.113:0/3623766822 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4034990 con 0x7f38c80047c0 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38ddfc4640 1 -- 172.21.15.113:0/3623766822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38c80047c0 msgr2=0x7f38c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38ddfc4640 1 --2- 172.21.15.113:0/3623766822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38c80047c0 0x7f38c8004c40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f38c400b900 tx=0x7f38c80057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38dd7c3640 1 -- 172.21.15.113:0/3623766822 reap_dead start 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38ddfc4640 1 -- 172.21.15.113:0/3623766822 shutdown_connections 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38ddfc4640 1 -- 172.21.15.113:0/3623766822 >> 172.21.15.113:0/3623766822 conn(0x7f38d80b0100 msgr2=0x7f38d80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.720+0000 7f38ddfc4640 1 -- 172.21.15.113:0/3623766822 shutdown_connections 2023-12-19T13:51:11.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.721+0000 7f38ddfc4640 1 -- 172.21.15.113:0/3623766822 wait complete. 2023-12-19T13:51:11.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.722+0000 7f38ddfc4640 1 Processor -- start 2023-12-19T13:51:11.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.722+0000 7f38ddfc4640 1 -- start start 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.723+0000 7f38ddfc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c80047c0 0x7f38d8152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.723+0000 7f38ddfc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d806cd30 0x7f38d81f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.723+0000 7f38ddfc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d80cb9e0 0x7f38d815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.723+0000 7f38ddfc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d81f3c10 con 0x7f38d80cb9e0 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.723+0000 7f38ddfc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8159a30 con 0x7f38c80047c0 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.723+0000 7f38ddfc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8159d10 con 0x7f38d806cd30 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d80cb9e0 0x7f38d815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d80cb9e0 0x7f38d815aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60602/0 (socket says 172.21.15.113:60602) 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 -- 172.21.15.113:0/2259451399 learned_addr learned my addr 172.21.15.113:0/2259451399 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:11.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dcfc2640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c80047c0 0x7f38d8152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38d7fff640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d806cd30 0x7f38d81f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 -- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d806cd30 msgr2=0x7f38d81f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d806cd30 0x7f38d81f36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 -- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c80047c0 msgr2=0x7f38d8152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c80047c0 0x7f38d8152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 -- 172.21.15.113:0/2259451399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d8159ff0 con 0x7f38d80cb9e0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dcfc2640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c80047c0 0x7f38d8152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.724+0000 7f38dd7c3640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d80cb9e0 0x7f38d815aad0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f38d0001370 tx=0x7f38d000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.725+0000 7f38d57fa640 1 -- 172.21.15.113:0/2259451399 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000a610 con 0x7f38d80cb9e0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.725+0000 7f38d57fa640 1 -- 172.21.15.113:0/2259451399 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d000a770 con 0x7f38d80cb9e0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.725+0000 7f38d57fa640 1 -- 172.21.15.113:0/2259451399 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000ab20 con 0x7f38d80cb9e0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.725+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d815a2d0 con 0x7f38d80cb9e0 2023-12-19T13:51:11.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.725+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d8159650 con 0x7f38d80cb9e0 2023-12-19T13:51:11.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.726+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d815a7f0 con 0x7f38d80cb9e0 2023-12-19T13:51:11.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.727+0000 7f38d57fa640 1 -- 172.21.15.113:0/2259451399 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f38d000ac80 con 0x7f38d80cb9e0 2023-12-19T13:51:11.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.728+0000 7f38d57fa640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38bc06a430 0x7f38bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:11.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.728+0000 7f38d57fa640 1 -- 172.21.15.113:0/2259451399 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f38d0087e90 con 0x7f38d80cb9e0 2023-12-19T13:51:11.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.728+0000 7f38dcfc2640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38bc06a430 0x7f38bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:11.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.729+0000 7f38dcfc2640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38bc06a430 0x7f38bc06c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f38cc004be0 tx=0x7f38cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:11.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.732+0000 7f38d57fa640 1 -- 172.21.15.113:0/2259451399 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f38d815a7f0 con 0x7f38d80cb9e0 2023-12-19T13:51:11.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:11.992+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f38d815a7f0 con 0x7f38d80cb9e0 2023-12-19T13:51:12.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.024+0000 7f38d57fa640 1 -- 172.21.15.113:0/2259451399 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v249) v1 ==== 134+0+0 (secure 0 0 0) 0x7f38d815a7f0 con 0x7f38d80cb9e0 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38bc06a430 msgr2=0x7f38bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38bc06a430 0x7f38bc06c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f38cc004be0 tx=0x7f38cc009040 comp rx=0 tx=0).stop 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d80cb9e0 msgr2=0x7f38d815aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d80cb9e0 0x7f38d815aad0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f38d0001370 tx=0x7f38d000cf00 comp rx=0 tx=0).stop 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 shutdown_connections 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38bc06a430 0x7f38bc06c8f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d80cb9e0 0x7f38d815aad0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38d806cd30 0x7f38d81f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 --2- 172.21.15.113:0/2259451399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38c80047c0 0x7f38d8152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 >> 172.21.15.113:0/2259451399 conn(0x7f38d80b0100 msgr2=0x7f38d80707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 shutdown_connections 2023-12-19T13:51:12.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.027+0000 7f38ddfc4640 1 -- 172.21.15.113:0/2259451399 wait complete. 2023-12-19T13:51:12.047 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-19T13:51:12.047 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-12-19T13:51:12.047 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T13:51:12.047 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:12.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.259+0000 7efe3f167640 1 Processor -- start 2023-12-19T13:51:12.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.260+0000 7efe3f167640 1 -- start start 2023-12-19T13:51:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3f167640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efe38161810 0x7efe380cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3f167640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe3806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3f167640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe380b22b0 con 0x7efe380cc8a0 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3f167640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe38161bf0 con 0x7efe38161810 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3f167640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe380b2830 con 0x7efe380ce660 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3e165640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efe38161810 0x7efe380cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3e165640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efe38161810 0x7efe380cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60610/0 (socket says 172.21.15.113:60610) 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3e165640 1 -- 172.21.15.113:0/1243125433 learned_addr learned my addr 172.21.15.113:0/1243125433 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.261+0000 7efe3d964640 1 --1- 172.21.15.113:0/1243125433 >> v1:172.21.15.113:6789/0 conn(0x7efe380cc8a0 0x7efe380cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59518/0 (socket says 172.21.15.113:59518) 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.262+0000 7efe3e966640 1 --2- 172.21.15.113:0/1243125433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe3806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.262+0000 7efe3e165640 1 -- 172.21.15.113:0/1243125433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 msgr2=0x7efe3806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.262+0000 7efe3e165640 1 --2- 172.21.15.113:0/1243125433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe3806f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.262+0000 7efe3e165640 1 -- 172.21.15.113:0/1243125433 >> v1:172.21.15.113:6789/0 conn(0x7efe380cc8a0 legacy=0x7efe380cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.262+0000 7efe3d163640 1 -- 172.21.15.113:0/1243125433 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989192957 0 0) 0x7efe380b22b0 con 0x7efe380cc8a0 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.262+0000 7efe3e165640 1 -- 172.21.15.113:0/1243125433 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380b2550 con 0x7efe38161810 2023-12-19T13:51:12.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.262+0000 7efe3e966640 1 --2- 172.21.15.113:0/1243125433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe3806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.263+0000 7efe3e165640 1 --2- 172.21.15.113:0/1243125433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe380cc360 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efe34009870 tx=0x7efe3402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f52dd7515489d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.263+0000 7efe3d163640 1 -- 172.21.15.113:0/1243125433 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340317c0 con 0x7efe38161810 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.263+0000 7efe3d163640 1 -- 172.21.15.113:0/1243125433 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34031920 con 0x7efe38161810 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.263+0000 7efe3d163640 1 -- 172.21.15.113:0/1243125433 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34031cb0 con 0x7efe38161810 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 -- 172.21.15.113:0/1243125433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 msgr2=0x7efe380cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 --2- 172.21.15.113:0/1243125433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe380cc360 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efe34009870 tx=0x7efe3402b860 comp rx=0 tx=0).stop 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 -- 172.21.15.113:0/1243125433 shutdown_connections 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 --2- 172.21.15.113:0/1243125433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe3806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 --2- 172.21.15.113:0/1243125433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe380cc360 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 -- 172.21.15.113:0/1243125433 >> 172.21.15.113:0/1243125433 conn(0x7efe380b0100 msgr2=0x7efe380b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 -- 172.21.15.113:0/1243125433 shutdown_connections 2023-12-19T13:51:12.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.264+0000 7efe3f167640 1 -- 172.21.15.113:0/1243125433 wait complete. 2023-12-19T13:51:12.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.266+0000 7efe3f167640 1 Processor -- start 2023-12-19T13:51:12.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.266+0000 7efe3f167640 1 -- start start 2023-12-19T13:51:12.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3f167640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe380cc8a0 0x7efe38160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3f167640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe380acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3f167640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe38158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3f167640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38160740 con 0x7efe38161810 2023-12-19T13:51:12.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3f167640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3815fe50 con 0x7efe380cc8a0 2023-12-19T13:51:12.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3f167640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe381610a0 con 0x7efe380ce660 2023-12-19T13:51:12.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3e966640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe38158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3e966640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe38158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60612/0 (socket says 172.21.15.113:60612) 2023-12-19T13:51:12.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.267+0000 7efe3e966640 1 -- 172.21.15.113:0/2236750116 learned_addr learned my addr 172.21.15.113:0/2236750116 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3e966640 1 -- 172.21.15.113:0/2236750116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 msgr2=0x7efe380acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3e966640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe380acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3e966640 1 -- 172.21.15.113:0/2236750116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe380cc8a0 msgr2=0x7efe38160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3e165640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe380cc8a0 0x7efe38160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3e966640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe380cc8a0 0x7efe38160b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3e966640 1 -- 172.21.15.113:0/2236750116 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340094d0 con 0x7efe38161810 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3e966640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe38158560 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7efe3000cd80 tx=0x7efe3000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:12.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe2effd640 1 -- 172.21.15.113:0/2236750116 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000f680 con 0x7efe38161810 2023-12-19T13:51:12.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe2effd640 1 -- 172.21.15.113:0/2236750116 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3000f800 con 0x7efe38161810 2023-12-19T13:51:12.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3806c290 con 0x7efe38161810 2023-12-19T13:51:12.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe2effd640 1 -- 172.21.15.113:0/2236750116 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000fbb0 con 0x7efe38161810 2023-12-19T13:51:12.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.268+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe38160080 con 0x7efe38161810 2023-12-19T13:51:12.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.270+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe38061910 con 0x7efe38161810 2023-12-19T13:51:12.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.270+0000 7efe2effd640 1 -- 172.21.15.113:0/2236750116 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe3000b040 con 0x7efe38161810 2023-12-19T13:51:12.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.271+0000 7efe2effd640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe1c06a430 0x7efe1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.271+0000 7efe2effd640 1 -- 172.21.15.113:0/2236750116 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efe30088ff0 con 0x7efe38161810 2023-12-19T13:51:12.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.272+0000 7efe3e165640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe1c06a430 0x7efe1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.272+0000 7efe3e165640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe1c06a430 0x7efe1c06c8f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe3403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:12.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.276+0000 7efe2effd640 1 -- 172.21.15.113:0/2236750116 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe300548d0 con 0x7efe38161810 2023-12-19T13:51:12.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.466+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe38070bb0 con 0x7efe38161810 2023-12-19T13:51:12.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.467+0000 7efe2effd640 1 -- 172.21.15.113:0/2236750116 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+12568 (secure 0 0 0) 0x7efe30057ef0 con 0x7efe38161810 2023-12-19T13:51:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:12.467 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":85,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:11.007272+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:6835/4085417322":"2023-12-20T13:51:07.976903+0000","172.21.15.151:6833/4085417322":"2023-12-20T13:51:07.976903+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:12.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.470+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe1c06a430 msgr2=0x7efe1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.470+0000 7efe3f167640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe1c06a430 0x7efe1c06c8f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe3403d040 comp rx=0 tx=0).stop 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.470+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 msgr2=0x7efe38158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.470+0000 7efe3f167640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe38158560 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7efe3000cd80 tx=0x7efe3000a650 comp rx=0 tx=0).stop 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 shutdown_connections 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe1c06a430 0x7efe1c06c8f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe38161810 0x7efe38158560 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe380ce660 0x7efe380acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 --2- 172.21.15.113:0/2236750116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe380cc8a0 0x7efe38160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 >> 172.21.15.113:0/2236750116 conn(0x7efe380b0100 msgr2=0x7efe380b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 shutdown_connections 2023-12-19T13:51:12.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.471+0000 7efe3f167640 1 -- 172.21.15.113:0/2236750116 wait complete. 2023-12-19T13:51:12.491 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:51:12.491 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:51:12.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.700+0000 7f3838ad5640 1 Processor -- start 2023-12-19T13:51:12.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.700+0000 7f3838ad5640 1 -- start start 2023-12-19T13:51:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.702+0000 7f3838ad5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 0x7f38340b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.702+0000 7f3838ad5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383415fde0 con 0x7f383415b1d0 2023-12-19T13:51:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.702+0000 7f3838ad5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38340b2bc0 con 0x7f38340ceea0 2023-12-19T13:51:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.702+0000 7f3838ad5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38340b2400 con 0x7f38340b2760 2023-12-19T13:51:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.702+0000 7f383259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f383415b1d0 0x7f383415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59522/0 (socket says 172.21.15.113:59522) 2023-12-19T13:51:12.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.702+0000 7f383259c640 1 -- 172.21.15.113:0/3243656900 learned_addr learned my addr 172.21.15.113:0/3243656900 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:12.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696556344 0 0) 0x7f383415fde0 con 0x7f383415b1d0 2023-12-19T13:51:12.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3820003520 con 0x7f383415b1d0 2023-12-19T13:51:12.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f382bfff640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 0x7f38340b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389700262 0 0) 0x7f3820003520 con 0x7f383415b1d0 2023-12-19T13:51:12.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 msgr2=0x7f38340b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 0x7f38340b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 >> v1:172.21.15.151:6789/0 conn(0x7f38340ceea0 legacy=0x7f383406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383415ef10 con 0x7f383415b1d0 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3824001670 con 0x7f383415b1d0 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f382bfff640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 0x7f38340b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 >> v1:172.21.15.113:6789/0 conn(0x7f383415b1d0 legacy=0x7f383415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 0x7f3820003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3820004050 0x7f38200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820004d50 0x7f38200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382000bb90 con 0x7f3820004050 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382000bd00 con 0x7f3820004d50 2023-12-19T13:51:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.703+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382000bec0 con 0x7f38340b2760 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f382bfff640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3820004050 0x7f38200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f383259c640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 0x7f3820003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f3832d9d640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820004d50 0x7f38200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f382bfff640 1 -- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 msgr2=0x7f3820003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f382bfff640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38340b2760 0x7f3820003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f382bfff640 1 -- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820004d50 msgr2=0x7f38200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f382bfff640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820004d50 0x7f38200051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.704+0000 7f382bfff640 1 -- 172.21.15.113:0/3243656900 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820003520 con 0x7f3820004050 2023-12-19T13:51:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.705+0000 7f382bfff640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3820004050 0x7f38200047c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f381c0098a0 tx=0x7f38200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f583362d1cb377b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c004230 con 0x7f3820004050 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c004390 con 0x7f3820004050 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3831d9b640 1 -- 172.21.15.113:0/3243656900 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c003830 con 0x7f3820004050 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3838ad5640 1 -- 172.21.15.113:0/3243656900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3820004050 msgr2=0x7f38200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3838ad5640 1 --2- 172.21.15.113:0/3243656900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3820004050 0x7f38200047c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f381c0098a0 tx=0x7f38200057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3832d9d640 1 -- 172.21.15.113:0/3243656900 reap_dead start 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3838ad5640 1 -- 172.21.15.113:0/3243656900 shutdown_connections 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3838ad5640 1 -- 172.21.15.113:0/3243656900 >> 172.21.15.113:0/3243656900 conn(0x7f3834073150 msgr2=0x7f38340659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3838ad5640 1 -- 172.21.15.113:0/3243656900 shutdown_connections 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.706+0000 7f3838ad5640 1 -- 172.21.15.113:0/3243656900 wait complete. 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.708+0000 7f3838ad5640 1 Processor -- start 2023-12-19T13:51:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.708+0000 7f3838ad5640 1 -- start start 2023-12-19T13:51:12.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.709+0000 7f3838ad5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820004050 0x7f383414f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.709+0000 7f3838ad5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38340c85b0 0x7f38340c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.709+0000 7f3838ad5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38340c9310 0x7f38340c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.709+0000 7f3838ad5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38341513b0 con 0x7f38340c85b0 2023-12-19T13:51:12.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.709+0000 7f3838ad5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3834150520 con 0x7f38340c9310 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.709+0000 7f3838ad5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38340c8f70 con 0x7f3820004050 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38340c85b0 0x7f38340c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38340c85b0 0x7f38340c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60628/0 (socket says 172.21.15.113:60628) 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 -- 172.21.15.113:0/1423046127 learned_addr learned my addr 172.21.15.113:0/1423046127 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f3832d9d640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38340c9310 0x7f38340c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f383259c640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820004050 0x7f383414f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 -- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820004050 msgr2=0x7f383414f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820004050 0x7f383414f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 -- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38340c9310 msgr2=0x7f38340c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38340c9310 0x7f38340c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.710+0000 7f382bfff640 1 -- 172.21.15.113:0/1423046127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834150730 con 0x7f38340c85b0 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.711+0000 7f382bfff640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38340c85b0 0x7f38340c8a30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f381c0098a0 tx=0x7f381c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:12.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.711+0000 7f382affd640 1 -- 172.21.15.113:0/1423046127 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c030630 con 0x7f38340c85b0 2023-12-19T13:51:12.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.711+0000 7f382affd640 1 -- 172.21.15.113:0/1423046127 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c030790 con 0x7f38340c85b0 2023-12-19T13:51:12.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.711+0000 7f382affd640 1 -- 172.21.15.113:0/1423046127 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c030b00 con 0x7f38340c85b0 2023-12-19T13:51:12.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.711+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834150a10 con 0x7f38340c85b0 2023-12-19T13:51:12.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.711+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3834150fd0 con 0x7f38340c85b0 2023-12-19T13:51:12.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.712+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3834151190 con 0x7f38340c85b0 2023-12-19T13:51:12.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.713+0000 7f382affd640 1 -- 172.21.15.113:0/1423046127 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f381c030c60 con 0x7f38340c85b0 2023-12-19T13:51:12.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.714+0000 7f382affd640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f381406a460 0x7f381406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:12.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.714+0000 7f382affd640 1 -- 172.21.15.113:0/1423046127 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f381c0aa4a0 con 0x7f38340c85b0 2023-12-19T13:51:12.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.714+0000 7f383259c640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f381406a460 0x7f381406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:12.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.715+0000 7f383259c640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f381406a460 0x7f381406c920 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3824001050 tx=0x7f3824009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:12.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.719+0000 7f382affd640 1 -- 172.21.15.113:0/1423046127 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f381c075d10 con 0x7f38340c85b0 2023-12-19T13:51:12.907 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.908+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3834061910 con 0x7f38340c85b0 2023-12-19T13:51:12.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.909+0000 7f382affd640 1 -- 172.21.15.113:0/1423046127 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f381c048020 con 0x7f38340c85b0 2023-12-19T13:51:12.908 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f381406a460 msgr2=0x7f381406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f381406a460 0x7f381406c920 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3824001050 tx=0x7f3824009040 comp rx=0 tx=0).stop 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38340c85b0 msgr2=0x7f38340c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38340c85b0 0x7f38340c8a30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f381c0098a0 tx=0x7f381c004730 comp rx=0 tx=0).stop 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 shutdown_connections 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f381406a460 0x7f381406c920 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38340c9310 0x7f38340c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38340c85b0 0x7f38340c8a30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 --2- 172.21.15.113:0/1423046127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820004050 0x7f383414f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:12.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 >> 172.21.15.113:0/1423046127 conn(0x7f3834073150 msgr2=0x7f38340b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:12.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 shutdown_connections 2023-12-19T13:51:12.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:12.912+0000 7f3838ad5640 1 -- 172.21.15.113:0/1423046127 wait complete. 2023-12-19T13:51:12.930 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-19T13:51:13.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.145+0000 7f8b26177640 1 Processor -- start 2023-12-19T13:51:13.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.145+0000 7f8b26177640 1 -- start start 2023-12-19T13:51:13.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b26177640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8b2015b1e0 0x7f8b2015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:13.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b26177640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8b2015a8a0 0x7f8b2015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:13.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b26177640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2006b520 con 0x7f8b20159f80 2023-12-19T13:51:13.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b26177640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b200b2b20 con 0x7f8b2015b1e0 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b26177640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b200b2fb0 con 0x7f8b2015a8a0 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b24974640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8b2015b1e0 0x7f8b2015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b24974640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8b2015b1e0 0x7f8b2015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60636/0 (socket says 172.21.15.113:60636) 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b24974640 1 -- 172.21.15.113:0/3569523538 learned_addr learned my addr 172.21.15.113:0/3569523538 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b25976640 1 --2- 172.21.15.113:0/3569523538 >> v2:172.21.15.151:3300/0 conn(0x7f8b2015a8a0 0x7f8b2015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b24974640 1 -- 172.21.15.113:0/3569523538 >> v2:172.21.15.151:3300/0 conn(0x7f8b2015a8a0 msgr2=0x7f8b2015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b24974640 1 --2- 172.21.15.113:0/3569523538 >> v2:172.21.15.151:3300/0 conn(0x7f8b2015a8a0 0x7f8b2015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b24974640 1 -- 172.21.15.113:0/3569523538 >> v1:172.21.15.151:6789/0 conn(0x7f8b20159f80 legacy=0x7f8b2006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:13.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.147+0000 7f8b24974640 1 -- 172.21.15.113:0/3569523538 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b200b1f10 con 0x7f8b2015b1e0 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.149+0000 7f8b24974640 1 --2- 172.21.15.113:0/3569523538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015b1e0 0x7f8b2015a360 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8b200ae020 tx=0x7f8b1002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b864cbbe61682ae6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.149+0000 7f8b17fff640 1 -- 172.21.15.113:0/3569523538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10030860 con 0x7f8b2015b1e0 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.149+0000 7f8b17fff640 1 -- 172.21.15.113:0/3569523538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b100309c0 con 0x7f8b2015b1e0 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.149+0000 7f8b17fff640 1 -- 172.21.15.113:0/3569523538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10030d50 con 0x7f8b2015b1e0 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.149+0000 7f8b26177640 1 -- 172.21.15.113:0/3569523538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015b1e0 msgr2=0x7f8b2015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.149+0000 7f8b26177640 1 --2- 172.21.15.113:0/3569523538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015b1e0 0x7f8b2015a360 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8b200ae020 tx=0x7f8b1002b9a0 comp rx=0 tx=0).stop 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.150+0000 7f8b26177640 1 -- 172.21.15.113:0/3569523538 shutdown_connections 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.150+0000 7f8b26177640 1 --2- 172.21.15.113:0/3569523538 >> v2:172.21.15.151:3300/0 conn(0x7f8b2015a8a0 0x7f8b2015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.150+0000 7f8b26177640 1 --2- 172.21.15.113:0/3569523538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015b1e0 0x7f8b2015a360 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.150+0000 7f8b26177640 1 -- 172.21.15.113:0/3569523538 >> 172.21.15.113:0/3569523538 conn(0x7f8b200b0100 msgr2=0x7f8b200b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:13.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.150+0000 7f8b26177640 1 -- 172.21.15.113:0/3569523538 shutdown_connections 2023-12-19T13:51:13.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.150+0000 7f8b26177640 1 -- 172.21.15.113:0/3569523538 wait complete. 2023-12-19T13:51:13.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.151+0000 7f8b26177640 1 Processor -- start 2023-12-19T13:51:13.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.151+0000 7f8b26177640 1 -- start start 2023-12-19T13:51:13.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.152+0000 7f8b26177640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b20159f80 0x7f8b2013a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:13.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.152+0000 7f8b26177640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015a8a0 0x7f8b2014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:13.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.152+0000 7f8b26177640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b2015b1e0 0x7f8b2006b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:13.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.152+0000 7f8b26177640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2014d760 con 0x7f8b2015a8a0 2023-12-19T13:51:13.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.152+0000 7f8b26177640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2014cb50 con 0x7f8b20159f80 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.152+0000 7f8b26177640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2014ce30 con 0x7f8b2015b1e0 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015a8a0 0x7f8b2014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015a8a0 0x7f8b2014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60640/0 (socket says 172.21.15.113:60640) 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 -- 172.21.15.113:0/2915279132 learned_addr learned my addr 172.21.15.113:0/2915279132 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b25175640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b20159f80 0x7f8b2013a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b25976640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b2015b1e0 0x7f8b2006b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 -- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b2015b1e0 msgr2=0x7f8b2006b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b2015b1e0 0x7f8b2006b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 -- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b20159f80 msgr2=0x7f8b2013a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b20159f80 0x7f8b2013a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 -- 172.21.15.113:0/2915279132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100094d0 con 0x7f8b2015a8a0 2023-12-19T13:51:13.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.153+0000 7f8b24974640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015a8a0 0x7f8b2014c170 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8b1002b9e0 tx=0x7f8b100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:13.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.154+0000 7f8b15ffb640 1 -- 172.21.15.113:0/2915279132 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1003e070 con 0x7f8b2015a8a0 2023-12-19T13:51:13.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.154+0000 7f8b15ffb640 1 -- 172.21.15.113:0/2915279132 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b10039800 con 0x7f8b2015a8a0 2023-12-19T13:51:13.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.154+0000 7f8b15ffb640 1 -- 172.21.15.113:0/2915279132 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10039b90 con 0x7f8b2015a8a0 2023-12-19T13:51:13.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.154+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2014d110 con 0x7f8b2015a8a0 2023-12-19T13:51:13.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.154+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2013af20 con 0x7f8b2015a8a0 2023-12-19T13:51:13.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.155+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b20061910 con 0x7f8b2015a8a0 2023-12-19T13:51:13.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.156+0000 7f8b15ffb640 1 -- 172.21.15.113:0/2915279132 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b10042070 con 0x7f8b2015a8a0 2023-12-19T13:51:13.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.156+0000 7f8b15ffb640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b0406a430 0x7f8b0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:13.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.157+0000 7f8b15ffb640 1 -- 172.21.15.113:0/2915279132 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b100aa480 con 0x7f8b2015a8a0 2023-12-19T13:51:13.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.157+0000 7f8b25175640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b0406a430 0x7f8b0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:13.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.157+0000 7f8b25175640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b0406a430 0x7f8b0406c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007fd0 tx=0x7f8b1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:13.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.161+0000 7f8b15ffb640 1 -- 172.21.15.113:0/2915279132 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b10075df0 con 0x7f8b2015a8a0 2023-12-19T13:51:13.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:13.422+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f8b200b2780 con 0x7f8b2015a8a0 2023-12-19T13:51:14.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.038+0000 7f8b15ffb640 1 -- 172.21.15.113:0/2915279132 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v251) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8b10079410 con 0x7f8b2015a8a0 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b0406a430 msgr2=0x7f8b0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b0406a430 0x7f8b0406c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007fd0 tx=0x7f8b1c009040 comp rx=0 tx=0).stop 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015a8a0 msgr2=0x7f8b2014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015a8a0 0x7f8b2014c170 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8b1002b9e0 tx=0x7f8b100046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 shutdown_connections 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b0406a430 0x7f8b0406c8f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b2015b1e0 0x7f8b2006b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b2015a8a0 0x7f8b2014c170 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 --2- 172.21.15.113:0/2915279132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b20159f80 0x7f8b2013a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 >> 172.21.15.113:0/2915279132 conn(0x7f8b200b0100 msgr2=0x7f8b200cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:14.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 shutdown_connections 2023-12-19T13:51:14.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.042+0000 7f8b26177640 1 -- 172.21.15.113:0/2915279132 wait complete. 2023-12-19T13:51:14.061 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T13:51:14.284 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_objectstore":"memstore"} 2023-12-19T13:51:14.285 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T13:51:14.285 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:51:14.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.504+0000 7feb2af9f640 1 Processor -- start 2023-12-19T13:51:14.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.505+0000 7feb2af9f640 1 -- start start 2023-12-19T13:51:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb2af9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb240b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb2af9f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb240ccbd0 con 0x7feb2415b290 2023-12-19T13:51:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb2af9f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb24154b40 con 0x7feb24154760 2023-12-19T13:51:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb2af9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb240ccf20 con 0x7feb240b0070 2023-12-19T13:51:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb23fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7feb2415b290 0x7feb240b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59530/0 (socket says 172.21.15.113:59530) 2023-12-19T13:51:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb23fff640 1 -- 172.21.15.113:0/2401350976 learned_addr learned my addr 172.21.15.113:0/2401350976 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:14.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266099983 0 0) 0x7feb240ccbd0 con 0x7feb2415b290 2023-12-19T13:51:14.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.507+0000 7feb2953c640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb240b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb0c003520 con 0x7feb2415b290 2023-12-19T13:51:14.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1328735303 0 0) 0x7feb0c003520 con 0x7feb2415b290 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 msgr2=0x7feb240b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb240b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 >> v1:172.21.15.151:6789/0 conn(0x7feb24154760 legacy=0x7feb240cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240cc060 con 0x7feb2415b290 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7feb18001670 con 0x7feb2415b290 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb2953c640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb240b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 >> v1:172.21.15.113:6789/0 conn(0x7feb2415b290 legacy=0x7feb240b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb0c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004000 0x7feb0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb0c004d00 0x7feb0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240ccf20 con 0x7feb0c004000 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c00bbe0 con 0x7feb0c004d00 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c00bda0 con 0x7feb240b0070 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.508+0000 7feb23fff640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004000 0x7feb0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb28d3b640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb0c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb23fff640 1 -- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 msgr2=0x7feb0c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb23fff640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb0c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb23fff640 1 -- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb0c004d00 msgr2=0x7feb0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb2953c640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb0c004d00 0x7feb0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb23fff640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb0c004d00 0x7feb0c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb23fff640 1 -- 172.21.15.113:0/2401350976 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c003520 con 0x7feb0c004000 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.509+0000 7feb28d3b640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb240b0070 0x7feb0c003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:14.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.510+0000 7feb23fff640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004000 0x7feb0c0047c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c210 tx=0x7feb0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b1ee2dea511992 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.510+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18005ad0 con 0x7feb0c004000 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.510+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb18005c30 con 0x7feb0c004000 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.510+0000 7feb237fe640 1 -- 172.21.15.113:0/2401350976 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1802cad0 con 0x7feb0c004000 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.511+0000 7feb2af9f640 1 -- 172.21.15.113:0/2401350976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004000 msgr2=0x7feb0c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.511+0000 7feb2af9f640 1 --2- 172.21.15.113:0/2401350976 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004000 0x7feb0c0047c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c210 tx=0x7feb0c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.511+0000 7feb2953c640 1 -- 172.21.15.113:0/2401350976 reap_dead start 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.511+0000 7feb2af9f640 1 -- 172.21.15.113:0/2401350976 shutdown_connections 2023-12-19T13:51:14.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.511+0000 7feb2af9f640 1 -- 172.21.15.113:0/2401350976 >> 172.21.15.113:0/2401350976 conn(0x7feb24073150 msgr2=0x7feb240659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.511+0000 7feb2af9f640 1 -- 172.21.15.113:0/2401350976 shutdown_connections 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.511+0000 7feb2af9f640 1 -- 172.21.15.113:0/2401350976 wait complete. 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.513+0000 7feb2af9f640 1 Processor -- start 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.513+0000 7feb2af9f640 1 -- start start 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2af9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb0c004000 0x7feb2415d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2af9f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb241f3a90 0x7feb2415df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2af9f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb241f0940 0x7feb2415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2af9f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b0a60 con 0x7feb241f0940 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2af9f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2406b820 con 0x7feb241f3a90 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2af9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb241f0ee0 con 0x7feb0c004000 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2953c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb241f0940 0x7feb2415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2953c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb241f0940 0x7feb2415e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60670/0 (socket says 172.21.15.113:60670) 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.514+0000 7feb2953c640 1 -- 172.21.15.113:0/3418268969 learned_addr learned my addr 172.21.15.113:0/3418268969 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:14.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb23fff640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb241f3a90 0x7feb2415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb28d3b640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb0c004000 0x7feb2415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2953c640 1 -- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb0c004000 msgr2=0x7feb2415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2953c640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb0c004000 0x7feb2415d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2953c640 1 -- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb241f3a90 msgr2=0x7feb2415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2953c640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb241f3a90 0x7feb2415df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2953c640 1 -- 172.21.15.113:0/3418268969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb241f11c0 con 0x7feb241f0940 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb28d3b640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb0c004000 0x7feb2415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2953c640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb241f0940 0x7feb2415e450 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7feb2406b650 tx=0x7feb1c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb217fa640 1 -- 172.21.15.113:0/3418268969 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c004230 con 0x7feb241f0940 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb217fa640 1 -- 172.21.15.113:0/3418268969 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c00c070 con 0x7feb241f0940 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb217fa640 1 -- 172.21.15.113:0/3418268969 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c003610 con 0x7feb241f0940 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb241f14a0 con 0x7feb241f0940 2023-12-19T13:51:14.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.515+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2415d640 con 0x7feb241f0940 2023-12-19T13:51:14.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.516+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2406b9b0 con 0x7feb241f0940 2023-12-19T13:51:14.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.517+0000 7feb217fa640 1 -- 172.21.15.113:0/3418268969 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb1c003770 con 0x7feb241f0940 2023-12-19T13:51:14.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.518+0000 7feb217fa640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb1006a430 0x7feb1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:14.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.518+0000 7feb217fa640 1 -- 172.21.15.113:0/3418268969 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb1c088690 con 0x7feb241f0940 2023-12-19T13:51:14.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.519+0000 7feb28d3b640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb1006a430 0x7feb1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:14.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.519+0000 7feb28d3b640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb1006a430 0x7feb1006c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb14007fd0 tx=0x7feb14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:14.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.523+0000 7feb217fa640 1 -- 172.21.15.113:0/3418268969 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feb1c053f70 con 0x7feb241f0940 2023-12-19T13:51:14.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.711+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feb24061910 con 0x7feb241f0940 2023-12-19T13:51:14.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.717+0000 7feb217fa640 1 -- 172.21.15.113:0/3418268969 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7feb1c057590 con 0x7feb241f0940 2023-12-19T13:51:14.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb1006a430 msgr2=0x7feb1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb1006a430 0x7feb1006c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb14007fd0 tx=0x7feb14009040 comp rx=0 tx=0).stop 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb241f0940 msgr2=0x7feb2415e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb241f0940 0x7feb2415e450 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7feb2406b650 tx=0x7feb1c00f670 comp rx=0 tx=0).stop 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 shutdown_connections 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feb1006a430 0x7feb1006c8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb241f0940 0x7feb2415e450 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb241f3a90 0x7feb2415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 --2- 172.21.15.113:0/3418268969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb0c004000 0x7feb2415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 >> 172.21.15.113:0/3418268969 conn(0x7feb24073150 msgr2=0x7feb240b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 shutdown_connections 2023-12-19T13:51:14.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:14.720+0000 7feb2af9f640 1 -- 172.21.15.113:0/3418268969 wait complete. 2023-12-19T13:51:14.738 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:51:14.739 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:51:14.847 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:51:14.969 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:51:14.969 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:51:14.969 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:15.028 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:51:15.028 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:51:15.028 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:15.088 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:51:15.089 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:51:15.089 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:15.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:51:15.147 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:51:15.147 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:15.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:51:15.207 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:51:15.207 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:15.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.430+0000 7fe07ae8f640 1 Processor -- start 2023-12-19T13:51:15.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.431+0000 7fe07ae8f640 1 -- start start 2023-12-19T13:51:15.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.432+0000 7fe07ae8f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe0741449e0 0x7fe0740af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.432+0000 7fe07ae8f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe07406c6b0 0x7fe0740b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.432+0000 7fe07ae8f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0740afb10 con 0x7fe0740b0b50 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.432+0000 7fe07ae8f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07406bb30 con 0x7fe0741449e0 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.432+0000 7fe07ae8f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0740b0070 con 0x7fe07406c6b0 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.432+0000 7fe078c2b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe0741449e0 0x7fe0740af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe078c2b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe0741449e0 0x7fe0740af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60686/0 (socket says 172.21.15.113:60686) 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe078c2b640 1 -- 172.21.15.113:0/3700554919 learned_addr learned my addr 172.21.15.113:0/3700554919 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe073fff640 1 --1- 172.21.15.113:0/3700554919 >> v1:172.21.15.113:6789/0 conn(0x7fe0740b0b50 0x7fe07406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59540/0 (socket says 172.21.15.113:59540) 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe078c2b640 1 -- 172.21.15.113:0/3700554919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe07406c6b0 msgr2=0x7fe0740b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe078c2b640 1 --2- 172.21.15.113:0/3700554919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe07406c6b0 0x7fe0740b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe078c2b640 1 -- 172.21.15.113:0/3700554919 >> v1:172.21.15.113:6789/0 conn(0x7fe0740b0b50 legacy=0x7fe07406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe078c2b640 1 -- 172.21.15.113:0/3700554919 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740b0350 con 0x7fe0741449e0 2023-12-19T13:51:15.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.433+0000 7fe0737fe640 1 -- 172.21.15.113:0/3700554919 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081170324 0 0) 0x7fe0740afb10 con 0x7fe0740b0b50 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.434+0000 7fe078c2b640 1 --2- 172.21.15.113:0/3700554919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0741449e0 0x7fe0740af5d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe064009e50 tx=0x7fe06402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34a35162ca362e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.434+0000 7fe0737fe640 1 -- 172.21.15.113:0/3700554919 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06402cb00 con 0x7fe0741449e0 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.434+0000 7fe0737fe640 1 -- 172.21.15.113:0/3700554919 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06402cc60 con 0x7fe0741449e0 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.434+0000 7fe0737fe640 1 -- 172.21.15.113:0/3700554919 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640343f0 con 0x7fe0741449e0 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3700554919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0741449e0 msgr2=0x7fe0740af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3700554919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0741449e0 0x7fe0740af5d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe064009e50 tx=0x7fe06402bf60 comp rx=0 tx=0).stop 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3700554919 shutdown_connections 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3700554919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe07406c6b0 0x7fe0740b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3700554919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0741449e0 0x7fe0740af5d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3700554919 >> 172.21.15.113:0/3700554919 conn(0x7fe0740cbb70 msgr2=0x7fe0740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3700554919 shutdown_connections 2023-12-19T13:51:15.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.435+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3700554919 wait complete. 2023-12-19T13:51:15.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.437+0000 7fe07ae8f640 1 Processor -- start 2023-12-19T13:51:15.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.437+0000 7fe07ae8f640 1 -- start start 2023-12-19T13:51:15.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe07ae8f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe07406c6b0 0x7fe07413eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe07ae8f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0740b0b50 0x7fe0740b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe07ae8f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0741449e0 0x7fe0740add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe07ae8f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0740b25e0 con 0x7fe07406c6b0 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe07ae8f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07413b570 con 0x7fe0741449e0 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe07ae8f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07413b810 con 0x7fe0740b0b50 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe078c2b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe07406c6b0 0x7fe07413eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe078c2b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe07406c6b0 0x7fe07413eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60700/0 (socket says 172.21.15.113:60700) 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.438+0000 7fe078c2b640 1 -- 172.21.15.113:0/3922523858 learned_addr learned my addr 172.21.15.113:0/3922523858 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe073fff640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0740b0b50 0x7fe0740b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe078c2b640 1 -- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0740b0b50 msgr2=0x7fe0740b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe078c2b640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0740b0b50 0x7fe0740b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe07942c640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0741449e0 0x7fe0740add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe078c2b640 1 -- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0741449e0 msgr2=0x7fe0740add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe078c2b640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0741449e0 0x7fe0740add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe078c2b640 1 -- 172.21.15.113:0/3922523858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064009b30 con 0x7fe07406c6b0 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe07942c640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0741449e0 0x7fe0740add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:15.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe078c2b640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe07406c6b0 0x7fe07413eae0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe064009e50 tx=0x7fe064004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.439+0000 7fe0717fa640 1 -- 172.21.15.113:0/3922523858 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06403e450 con 0x7fe07406c6b0 2023-12-19T13:51:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.440+0000 7fe0717fa640 1 -- 172.21.15.113:0/3922523858 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06403e5b0 con 0x7fe07406c6b0 2023-12-19T13:51:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.440+0000 7fe0717fa640 1 -- 172.21.15.113:0/3922523858 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06403e960 con 0x7fe07406c6b0 2023-12-19T13:51:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.440+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07413baf0 con 0x7fe07406c6b0 2023-12-19T13:51:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.440+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07413f1e0 con 0x7fe07406c6b0 2023-12-19T13:51:15.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.441+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07413f370 con 0x7fe07406c6b0 2023-12-19T13:51:15.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.441+0000 7fe0717fa640 1 -- 172.21.15.113:0/3922523858 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe06403eac0 con 0x7fe07406c6b0 2023-12-19T13:51:15.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.442+0000 7fe0717fa640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe05406a430 0x7fe05406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.442+0000 7fe0717fa640 1 -- 172.21.15.113:0/3922523858 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe0640ab600 con 0x7fe07406c6b0 2023-12-19T13:51:15.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.443+0000 7fe073fff640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe05406a430 0x7fe05406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.443+0000 7fe073fff640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe05406a430 0x7fe05406c8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe05c007fd0 tx=0x7fe05c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:15.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.447+0000 7fe0717fa640 1 -- 172.21.15.113:0/3922523858 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe064076e50 con 0x7fe07406c6b0 2023-12-19T13:51:15.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.675+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe074061910 con 0x7fe07406c6b0 2023-12-19T13:51:15.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.676+0000 7fe0717fa640 1 -- 172.21.15.113:0/3922523858 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fe064043df0 con 0x7fe07406c6b0 2023-12-19T13:51:15.676 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:15.676 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2316611345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2316611345},{"type":"v1","addr":"172.21.15.151:6835","nonce":2316611345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1836284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1836284457},{"type":"v1","addr":"172.21.15.151:6834","nonce":1836284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1469315848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1469315848},{"type":"v1","addr":"172.21.15.113:6837","nonce":1469315848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/1907023175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1907023175},{"type":"v1","addr":"172.21.15.113:6836","nonce":1907023175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-12-19T13:51:15.676 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 35 2023-12-19T13:51:15.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe05406a430 msgr2=0x7fe05406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe05406a430 0x7fe05406c8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe05c007fd0 tx=0x7fe05c009040 comp rx=0 tx=0).stop 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe07406c6b0 msgr2=0x7fe07413eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe07406c6b0 0x7fe07413eae0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe064009e50 tx=0x7fe064004a40 comp rx=0 tx=0).stop 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 shutdown_connections 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe05406a430 0x7fe05406c8f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0741449e0 0x7fe0740add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0740b0b50 0x7fe0740b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 --2- 172.21.15.113:0/3922523858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe07406c6b0 0x7fe07413eae0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 >> 172.21.15.113:0/3922523858 conn(0x7fe0740cbb70 msgr2=0x7fe07415e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 shutdown_connections 2023-12-19T13:51:15.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.679+0000 7fe07ae8f640 1 -- 172.21.15.113:0/3922523858 wait complete. 2023-12-19T13:51:15.696 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:51:15.696 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:51:15.696 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:51:15.696 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:51:15.697 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:51:15.697 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:51:15.697 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:51:15.697 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:51:15.697 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:51:15.697 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:51:15.698 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:51:15.698 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:51:15.698 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:51:15.698 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:51:15.698 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:51:15.698 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:51:15.714 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:51:15.714 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:51:15.720 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:51:15.720 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:51:15.721 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:51:15.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:51:15.726 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:51:15.726 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:51:15.769 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:51:15.770 DEBUG:teuthology.parallel:result is None 2023-12-19T13:51:15.774 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:51:15.775 DEBUG:teuthology.parallel:result is None 2023-12-19T13:51:15.777 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:51:15.777 DEBUG:teuthology.parallel:result is None 2023-12-19T13:51:15.782 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:51:15.782 DEBUG:teuthology.parallel:result is None 2023-12-19T13:51:15.782 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:51:15.935 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:51:15.935 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:51:15.937 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:51:15.942 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:51:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.974+0000 7f3ec25ce640 1 Processor -- start 2023-12-19T13:51:15.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.974+0000 7f3ec25ce640 1 -- start start 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.975+0000 7f3ec25ce640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3ebc146ef0 0x7f3ebc0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.975+0000 7f3ec25ce640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc0b6710 0x7f3ebc161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.975+0000 7f3ec25ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc1616d0 0x7f3ebc0d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.975+0000 7f3ec25ce640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc161b60 con 0x7f3ebc0b6710 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.975+0000 7f3ec25ce640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc0cda90 con 0x7f3ebc146ef0 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.975+0000 7f3ec25ce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0d2a50 con 0x7f3ebc1616d0 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc0b6710 0x7f3ebc161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ec0b6b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc1616d0 0x7f3ebc0d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ebc0b6710 0x7f3ebc161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60748/0 (socket says 172.21.15.113:60748) 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/618321573 learned_addr learned my addr 172.21.15.113:0/618321573 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/618321573 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc146ef0 0x7f3ebc0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/618321573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc1616d0 msgr2=0x7f3ebc0d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:15.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/618321573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc1616d0 0x7f3ebc0d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/618321573 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc146ef0 msgr2=0x7f3ebc0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:15.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/618321573 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc146ef0 0x7f3ebc0ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/618321573 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0cdca0 con 0x7f3ebc0b6710 2023-12-19T13:51:15.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ec0b6b640 1 --2- 172.21.15.113:0/618321573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc1616d0 0x7f3ebc0d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:51:15.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.976+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/618321573 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc146ef0 0x7f3ebc0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:51:15.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.978+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/618321573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0b6710 0x7f3ebc161190 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0d0c00 tx=0x7f3eb002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d184839bdfaa467f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:15.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.978+0000 7f3ebaffd640 1 -- 172.21.15.113:0/618321573 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0031750 con 0x7f3ebc0b6710 2023-12-19T13:51:15.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.978+0000 7f3ebaffd640 1 -- 172.21.15.113:0/618321573 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb00318b0 con 0x7f3ebc0b6710 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.978+0000 7f3ebaffd640 1 -- 172.21.15.113:0/618321573 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0031c40 con 0x7f3ebc0b6710 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 -- 172.21.15.113:0/618321573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0b6710 msgr2=0x7f3ebc161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/618321573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0b6710 0x7f3ebc161190 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0d0c00 tx=0x7f3eb002b7f0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 -- 172.21.15.113:0/618321573 shutdown_connections 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/618321573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc1616d0 0x7f3ebc0d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/618321573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc0b6710 0x7f3ebc161190 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/618321573 >> v2:172.21.15.151:3300/0 conn(0x7f3ebc146ef0 0x7f3ebc0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 -- 172.21.15.113:0/618321573 >> 172.21.15.113:0/618321573 conn(0x7f3ebc0b29c0 msgr2=0x7f3ebc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 -- 172.21.15.113:0/618321573 shutdown_connections 2023-12-19T13:51:15.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.979+0000 7f3ec25ce640 1 -- 172.21.15.113:0/618321573 wait complete. 2023-12-19T13:51:15.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.981+0000 7f3ec25ce640 1 Processor -- start 2023-12-19T13:51:15.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.981+0000 7f3ec25ce640 1 -- start start 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ec25ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b6710 0x7f3ebc140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ec25ce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc146ef0 0x7f3ebc15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ec25ce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc1616d0 0x7f3ebc160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ec25ce640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc15e9a0 con 0x7f3ebc146ef0 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ec25ce640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc1586b0 con 0x7f3ebc1616d0 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ec25ce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc15dd90 con 0x7f3ebc0b6710 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc146ef0 0x7f3ebc15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc146ef0 0x7f3ebc15ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60764/0 (socket says 172.21.15.113:60764) 2023-12-19T13:51:15.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/852929755 learned_addr learned my addr 172.21.15.113:0/852929755 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ec0b6b640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc1616d0 0x7f3ebc160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b6710 0x7f3ebc140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b6710 msgr2=0x7f3ebc140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b6710 0x7f3ebc140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc1616d0 msgr2=0x7f3ebc160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc1616d0 0x7f3ebc160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebb7fe640 1 -- 172.21.15.113:0/852929755 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac009400 con 0x7f3ebc146ef0 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.982+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b6710 0x7f3ebc140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:15.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.983+0000 7f3ebb7fe640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc146ef0 0x7f3ebc15ee30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0000c00 tx=0x7f3eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:15.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.983+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/852929755 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00338d0 con 0x7f3ebc146ef0 2023-12-19T13:51:15.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.983+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/852929755 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0033a30 con 0x7f3ebc146ef0 2023-12-19T13:51:15.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.983+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/852929755 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0033dc0 con 0x7f3ebc146ef0 2023-12-19T13:51:15.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.983+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb4009a70 con 0x7f3ebc146ef0 2023-12-19T13:51:15.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.983+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb00094d0 con 0x7f3ebc146ef0 2023-12-19T13:51:15.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.985+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc15eb10 con 0x7f3ebc146ef0 2023-12-19T13:51:15.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.985+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/852929755 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3eb003a040 con 0x7f3ebc146ef0 2023-12-19T13:51:15.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.986+0000 7f3eb8ff9640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:15.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.986+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/852929755 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3eb00aa5a0 con 0x7f3ebc146ef0 2023-12-19T13:51:15.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.986+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:15.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.987+0000 7f3ebbfff640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009b30 tx=0x7f3eac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:15.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:15.990+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/852929755 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3eb0075fb0 con 0x7f3ebc146ef0 2023-12-19T13:51:16.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:16.195+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3ebc061910 con 0x7f3ebc146ef0 2023-12-19T13:51:17.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.069+0000 7f3eb8ff9640 1 -- 172.21.15.113:0/852929755 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3eb00795d0 con 0x7f3ebc146ef0 2023-12-19T13:51:17.069 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:51:17.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 msgr2=0x7f3ea806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009b30 tx=0x7f3eac008040 comp rx=0 tx=0).stop 2023-12-19T13:51:17.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc146ef0 msgr2=0x7f3ebc15ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc146ef0 0x7f3ebc15ee30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0000c00 tx=0x7f3eb00046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 shutdown_connections 2023-12-19T13:51:17.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ea806a430 0x7f3ea806c8f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ebc1616d0 0x7f3ebc160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ebc146ef0 0x7f3ebc15ee30 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 --2- 172.21.15.113:0/852929755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ebc0b6710 0x7f3ebc140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 >> 172.21.15.113:0/852929755 conn(0x7f3ebc0b29c0 msgr2=0x7f3ebc0b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:17.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 shutdown_connections 2023-12-19T13:51:17.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.073+0000 7f3ec25ce640 1 -- 172.21.15.113:0/852929755 wait complete. 2023-12-19T13:51:17.092 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:51:17.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.294+0000 7f9f8104c640 1 Processor -- start 2023-12-19T13:51:17.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.294+0000 7f9f8104c640 1 -- start start 2023-12-19T13:51:17.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.295+0000 7f9f8104c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9f7c1449e0 0x7f9f7c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.295+0000 7f9f8104c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9f7c06c6b0 0x7f9f7c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.295+0000 7f9f8104c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c0afb10 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.295+0000 7f9f8104c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c06bb30 con 0x7f9f7c06c6b0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.295+0000 7f9f8104c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0b0070 con 0x7f9f7c1449e0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7b59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9f7c06c6b0 0x7f9f7c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7b59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9f7c06c6b0 0x7f9f7c0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60768/0 (socket says 172.21.15.113:60768) 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7b59e640 1 -- 172.21.15.113:0/1984532472 learned_addr learned my addr 172.21.15.113:0/1984532472 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7ad9d640 1 --2- 172.21.15.113:0/1984532472 >> v2:172.21.15.151:3300/0 conn(0x7f9f7c1449e0 0x7f9f7c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7b59e640 1 -- 172.21.15.113:0/1984532472 >> v2:172.21.15.151:3300/0 conn(0x7f9f7c1449e0 msgr2=0x7f9f7c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7b59e640 1 --2- 172.21.15.113:0/1984532472 >> v2:172.21.15.151:3300/0 conn(0x7f9f7c1449e0 0x7f9f7c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7b59e640 1 -- 172.21.15.113:0/1984532472 >> v1:172.21.15.151:6789/0 conn(0x7f9f7c0b0b50 legacy=0x7f9f7c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.296+0000 7f9f7b59e640 1 -- 172.21.15.113:0/1984532472 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0b0350 con 0x7f9f7c06c6b0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.298+0000 7f9f7b59e640 1 --2- 172.21.15.113:0/1984532472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c06c6b0 0x7f9f7c0b1710 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c071cd0 tx=0x7f9f7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2075286355c3721 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.298+0000 7f9f7a59c640 1 -- 172.21.15.113:0/1984532472 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74031870 con 0x7f9f7c06c6b0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.298+0000 7f9f7a59c640 1 -- 172.21.15.113:0/1984532472 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f740319d0 con 0x7f9f7c06c6b0 2023-12-19T13:51:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.298+0000 7f9f7a59c640 1 -- 172.21.15.113:0/1984532472 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74031d60 con 0x7f9f7c06c6b0 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.298+0000 7f9f8104c640 1 -- 172.21.15.113:0/1984532472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c06c6b0 msgr2=0x7f9f7c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.298+0000 7f9f8104c640 1 --2- 172.21.15.113:0/1984532472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c06c6b0 0x7f9f7c0b1710 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c071cd0 tx=0x7f9f7402b910 comp rx=0 tx=0).stop 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.299+0000 7f9f8104c640 1 -- 172.21.15.113:0/1984532472 shutdown_connections 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.299+0000 7f9f8104c640 1 --2- 172.21.15.113:0/1984532472 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c06c6b0 0x7f9f7c0b1710 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.299+0000 7f9f8104c640 1 --2- 172.21.15.113:0/1984532472 >> v2:172.21.15.151:3300/0 conn(0x7f9f7c1449e0 0x7f9f7c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.299+0000 7f9f8104c640 1 -- 172.21.15.113:0/1984532472 >> 172.21.15.113:0/1984532472 conn(0x7f9f7c0cbb70 msgr2=0x7f9f7c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.299+0000 7f9f8104c640 1 -- 172.21.15.113:0/1984532472 shutdown_connections 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.299+0000 7f9f8104c640 1 -- 172.21.15.113:0/1984532472 wait complete. 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.300+0000 7f9f8104c640 1 Processor -- start 2023-12-19T13:51:17.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.300+0000 7f9f8104c640 1 -- start start 2023-12-19T13:51:17.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.301+0000 7f9f8104c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7c06c6b0 0x7f9f7c159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.301+0000 7f9f8104c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c0b0b50 0x7f9f7c13da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.301+0000 7f9f8104c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f7c1449e0 0x7f9f7c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.301+0000 7f9f8104c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c13d610 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.301+0000 7f9f8104c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c15a350 con 0x7f9f7c1449e0 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.301+0000 7f9f8104c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c13df70 con 0x7f9f7c06c6b0 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c0b0b50 0x7f9f7c13da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c0b0b50 0x7f9f7c13da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60778/0 (socket says 172.21.15.113:60778) 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 -- 172.21.15.113:0/3008313448 learned_addr learned my addr 172.21.15.113:0/3008313448 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7ad9d640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7c06c6b0 0x7f9f7c159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 -- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7c06c6b0 msgr2=0x7f9f7c159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7b59e640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f7c1449e0 0x7f9f7c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7c06c6b0 0x7f9f7c159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 -- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f7c1449e0 msgr2=0x7f9f7c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f7c1449e0 0x7f9f7c0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 -- 172.21.15.113:0/3008313448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740094d0 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.302+0000 7f9f7259c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c0b0b50 0x7f9f7c13da30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c7c0 tx=0x7f9f6400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:17.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.303+0000 7f9f73fff640 1 -- 172.21.15.113:0/3008313448 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400aa50 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.303+0000 7f9f73fff640 1 -- 172.21.15.113:0/3008313448 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400abb0 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.303+0000 7f9f73fff640 1 -- 172.21.15.113:0/3008313448 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64012420 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.303+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c13c990 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.303+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c13cf50 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.304+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c061910 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.305+0000 7f9f73fff640 1 -- 172.21.15.113:0/3008313448 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f64012580 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.306+0000 7f9f73fff640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5c06a430 0x7f9f5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.306+0000 7f9f73fff640 1 -- 172.21.15.113:0/3008313448 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f64088520 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.306+0000 7f9f7ad9d640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5c06a430 0x7f9f5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.307+0000 7f9f7ad9d640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5c06a430 0x7f9f5c06c8f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c006fd0 tx=0x7f9f6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:17.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.310+0000 7f9f73fff640 1 -- 172.21.15.113:0/3008313448 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f64053e60 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.558+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9f7c0ae560 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.559+0000 7f9f73fff640 1 -- 172.21.15.113:0/3008313448 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9f64057480 con 0x7f9f7c0b0b50 2023-12-19T13:51:17.559 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:17.559 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:51:17.559 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:51:17.559 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.559 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:51:17.559 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:51:17.560 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.562 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.563 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.564 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.565 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.566 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:51:17.567 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.570 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.572 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:51:17.573 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:51:17.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5c06a430 msgr2=0x7f9f5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5c06a430 0x7f9f5c06c8f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c006fd0 tx=0x7f9f6c008040 comp rx=0 tx=0).stop 2023-12-19T13:51:17.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c0b0b50 msgr2=0x7f9f7c13da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c0b0b50 0x7f9f7c13da30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c7c0 tx=0x7f9f6400cc80 comp rx=0 tx=0).stop 2023-12-19T13:51:17.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 shutdown_connections 2023-12-19T13:51:17.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f5c06a430 0x7f9f5c06c8f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f7c1449e0 0x7f9f7c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f7c0b0b50 0x7f9f7c13da30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 --2- 172.21.15.113:0/3008313448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f7c06c6b0 0x7f9f7c159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 >> 172.21.15.113:0/3008313448 conn(0x7f9f7c0cbb70 msgr2=0x7f9f7c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:17.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 shutdown_connections 2023-12-19T13:51:17.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.562+0000 7f9f8104c640 1 -- 172.21.15.113:0/3008313448 wait complete. 2023-12-19T13:51:17.578 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:17.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.787+0000 7fc06c426640 1 Processor -- start 2023-12-19T13:51:17.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.787+0000 7fc06c426640 1 -- start start 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc06c426640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc0641449e0 0x7fc0640af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc06c426640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc06406c6b0 0x7fc0640b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc06c426640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640afb10 con 0x7fc0640b0b50 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc06c426640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06406bb30 con 0x7fc0641449e0 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc06c426640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640b0070 con 0x7fc06406c6b0 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc0699c1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc0640b0b50 0x7fc06406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59552/0 (socket says 172.21.15.113:59552) 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc0699c1640 1 -- 172.21.15.113:0/2457133089 learned_addr learned my addr 172.21.15.113:0/2457133089 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.789+0000 7fc06a1c2640 1 --2- 172.21.15.113:0/2457133089 >> v2:172.21.15.113:3300/0 conn(0x7fc0641449e0 0x7fc0640af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.790+0000 7fc06a9c3640 1 --2- 172.21.15.113:0/2457133089 >> v2:172.21.15.151:3300/0 conn(0x7fc06406c6b0 0x7fc0640b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.790+0000 7fc0691c0640 1 -- 172.21.15.113:0/2457133089 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436567525 0 0) 0x7fc0640afb10 con 0x7fc0640b0b50 2023-12-19T13:51:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.790+0000 7fc0691c0640 1 -- 172.21.15.113:0/2457133089 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc050003520 con 0x7fc0640b0b50 2023-12-19T13:51:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.790+0000 7fc06a1c2640 1 -- 172.21.15.113:0/2457133089 >> v2:172.21.15.151:3300/0 conn(0x7fc06406c6b0 msgr2=0x7fc0640b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.790+0000 7fc06a1c2640 1 --2- 172.21.15.113:0/2457133089 >> v2:172.21.15.151:3300/0 conn(0x7fc06406c6b0 0x7fc0640b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.790+0000 7fc06a1c2640 1 -- 172.21.15.113:0/2457133089 >> v1:172.21.15.113:6789/0 conn(0x7fc0640b0b50 legacy=0x7fc06406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.790+0000 7fc06a1c2640 1 -- 172.21.15.113:0/2457133089 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640b0350 con 0x7fc0641449e0 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.791+0000 7fc06a1c2640 1 --2- 172.21.15.113:0/2457133089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0641449e0 0x7fc0640af5d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b1270 tx=0x7fc06002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8109ee8b621f459 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.791+0000 7fc0691c0640 1 -- 172.21.15.113:0/2457133089 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060031830 con 0x7fc0641449e0 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.791+0000 7fc0691c0640 1 -- 172.21.15.113:0/2457133089 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060031990 con 0x7fc0641449e0 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.791+0000 7fc0691c0640 1 -- 172.21.15.113:0/2457133089 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060031d20 con 0x7fc0641449e0 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 -- 172.21.15.113:0/2457133089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0641449e0 msgr2=0x7fc0640af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 --2- 172.21.15.113:0/2457133089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0641449e0 0x7fc0640af5d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b1270 tx=0x7fc06002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 -- 172.21.15.113:0/2457133089 shutdown_connections 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 --2- 172.21.15.113:0/2457133089 >> v2:172.21.15.151:3300/0 conn(0x7fc06406c6b0 0x7fc0640b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 --2- 172.21.15.113:0/2457133089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0641449e0 0x7fc0640af5d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 -- 172.21.15.113:0/2457133089 >> 172.21.15.113:0/2457133089 conn(0x7fc0640cbb70 msgr2=0x7fc0640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 -- 172.21.15.113:0/2457133089 shutdown_connections 2023-12-19T13:51:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.792+0000 7fc06c426640 1 -- 172.21.15.113:0/2457133089 wait complete. 2023-12-19T13:51:17.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.794+0000 7fc06c426640 1 Processor -- start 2023-12-19T13:51:17.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.794+0000 7fc06c426640 1 -- start start 2023-12-19T13:51:17.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06c426640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc06406c6b0 0x7fc0640adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06c426640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0640b0b50 0x7fc0640a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06c426640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0641449e0 0x7fc064159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06c426640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415a0f0 con 0x7fc06406c6b0 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06c426640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415ba50 con 0x7fc0641449e0 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06c426640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415bd30 con 0x7fc0640b0b50 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06a1c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc06406c6b0 0x7fc0640adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06a1c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc06406c6b0 0x7fc0640adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60792/0 (socket says 172.21.15.113:60792) 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.795+0000 7fc06a1c2640 1 -- 172.21.15.113:0/2538879747 learned_addr learned my addr 172.21.15.113:0/2538879747 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc0699c1640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0640b0b50 0x7fc0640a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc06a9c3640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0641449e0 0x7fc064159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc06a1c2640 1 -- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0640b0b50 msgr2=0x7fc0640a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc06a1c2640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0640b0b50 0x7fc0640a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc06a1c2640 1 -- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0641449e0 msgr2=0x7fc064159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc06a1c2640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0641449e0 0x7fc064159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc06a1c2640 1 -- 172.21.15.113:0/2538879747 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc060009400 con 0x7fc06406c6b0 2023-12-19T13:51:17.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.796+0000 7fc06a1c2640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc06406c6b0 0x7fc0640adfa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc060000c00 tx=0x7fc0600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:17.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.797+0000 7fc05affd640 1 -- 172.21.15.113:0/2538879747 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06003a830 con 0x7fc06406c6b0 2023-12-19T13:51:17.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.797+0000 7fc05affd640 1 -- 172.21.15.113:0/2538879747 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06003a9b0 con 0x7fc06406c6b0 2023-12-19T13:51:17.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.797+0000 7fc05affd640 1 -- 172.21.15.113:0/2538879747 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06003ad60 con 0x7fc06406c6b0 2023-12-19T13:51:17.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.797+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06415c010 con 0x7fc06406c6b0 2023-12-19T13:51:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.797+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc064159b40 con 0x7fc06406c6b0 2023-12-19T13:51:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.798+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc064061910 con 0x7fc06406c6b0 2023-12-19T13:51:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.799+0000 7fc05affd640 1 -- 172.21.15.113:0/2538879747 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc06004d450 con 0x7fc06406c6b0 2023-12-19T13:51:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.800+0000 7fc05affd640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04806a430 0x7fc04806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.800+0000 7fc05affd640 1 -- 172.21.15.113:0/2538879747 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc0600aa5f0 con 0x7fc06406c6b0 2023-12-19T13:51:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.800+0000 7fc0699c1640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04806a430 0x7fc04806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.800+0000 7fc0699c1640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04806a430 0x7fc04806c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc064070f70 tx=0x7fc054009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.804+0000 7fc05affd640 1 -- 172.21.15.113:0/2538879747 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc060075fc0 con 0x7fc06406c6b0 2023-12-19T13:51:17.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.995+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0640ae540 con 0x7fc06406c6b0 2023-12-19T13:51:17.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:17.997+0000 7fc05affd640 1 -- 172.21.15.113:0/2538879747 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+12437 (secure 0 0 0) 0x7fc060035020 con 0x7fc06406c6b0 2023-12-19T13:51:17.997 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:17.997 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":90,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:17.053707+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:18.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.000+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04806a430 msgr2=0x7fc04806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.000+0000 7fc06c426640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04806a430 0x7fc04806c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc064070f70 tx=0x7fc054009040 comp rx=0 tx=0).stop 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.000+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc06406c6b0 msgr2=0x7fc0640adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.000+0000 7fc06c426640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc06406c6b0 0x7fc0640adfa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc060000c00 tx=0x7fc0600046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 shutdown_connections 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc04806a430 0x7fc04806c8f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0641449e0 0x7fc064159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0640b0b50 0x7fc0640a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 --2- 172.21.15.113:0/2538879747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc06406c6b0 0x7fc0640adfa0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 >> 172.21.15.113:0/2538879747 conn(0x7fc0640cbb70 msgr2=0x7fc06406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 shutdown_connections 2023-12-19T13:51:18.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.001+0000 7fc06c426640 1 -- 172.21.15.113:0/2538879747 wait complete. 2023-12-19T13:51:18.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:51:18.019 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:51:18.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.232+0000 7fe3b6ee5640 1 Processor -- start 2023-12-19T13:51:18.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.232+0000 7fe3b6ee5640 1 -- start start 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b6ee5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b006f490 0x7fe3b006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b6ee5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe3b00d1670 0x7fe3b00d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b6ee5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b006fe30 con 0x7fe3b0146cd0 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b6ee5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b01470b0 con 0x7fe3b00d1670 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b6ee5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0070260 con 0x7fe3b006f490 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b66e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe3b00d1670 0x7fe3b00d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b66e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe3b00d1670 0x7fe3b00d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53840/0 (socket says 172.21.15.113:53840) 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b66e4640 1 -- 172.21.15.113:0/771516852 learned_addr learned my addr 172.21.15.113:0/771516852 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:18.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b66e4640 1 -- 172.21.15.113:0/771516852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b006f490 msgr2=0x7fe3b006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:18.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b66e4640 1 --2- 172.21.15.113:0/771516852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b006f490 0x7fe3b006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.234+0000 7fe3b66e4640 1 -- 172.21.15.113:0/771516852 >> v1:172.21.15.151:6789/0 conn(0x7fe3b0146cd0 legacy=0x7fe3b00b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:18.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.235+0000 7fe3b66e4640 1 -- 172.21.15.113:0/771516852 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b00b6ea0 con 0x7fe3b00d1670 2023-12-19T13:51:18.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.236+0000 7fe3b66e4640 1 --2- 172.21.15.113:0/771516852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b00d1670 0x7fe3b00d1ad0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009e50 tx=0x7fe3a802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9f208487a53f93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:18.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.236+0000 7fe3b4ee1640 1 -- 172.21.15.113:0/771516852 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a802c9e0 con 0x7fe3b00d1670 2023-12-19T13:51:18.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.236+0000 7fe3b4ee1640 1 -- 172.21.15.113:0/771516852 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a802cb40 con 0x7fe3b00d1670 2023-12-19T13:51:18.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.236+0000 7fe3b4ee1640 1 -- 172.21.15.113:0/771516852 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80343f0 con 0x7fe3b00d1670 2023-12-19T13:51:18.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.236+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/771516852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b00d1670 msgr2=0x7fe3b00d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.236+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/771516852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b00d1670 0x7fe3b00d1ad0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009e50 tx=0x7fe3a802be40 comp rx=0 tx=0).stop 2023-12-19T13:51:18.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.237+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/771516852 shutdown_connections 2023-12-19T13:51:18.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.237+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/771516852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b00d1670 0x7fe3b00d1ad0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.237+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/771516852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b006f490 0x7fe3b006f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.237+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/771516852 >> 172.21.15.113:0/771516852 conn(0x7fe3b00d3200 msgr2=0x7fe3b00d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:18.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.237+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/771516852 shutdown_connections 2023-12-19T13:51:18.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.237+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/771516852 wait complete. 2023-12-19T13:51:18.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.238+0000 7fe3b6ee5640 1 Processor -- start 2023-12-19T13:51:18.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.238+0000 7fe3b6ee5640 1 -- start start 2023-12-19T13:51:18.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.239+0000 7fe3b6ee5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3b006f490 0x7fe3b015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.239+0000 7fe3b6ee5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b00d1670 0x7fe3b013f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.239+0000 7fe3b6ee5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b0146cd0 0x7fe3b015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.239+0000 7fe3b6ee5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b015dd70 con 0x7fe3b0146cd0 2023-12-19T13:51:18.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.239+0000 7fe3b6ee5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b013fc70 con 0x7fe3b006f490 2023-12-19T13:51:18.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.239+0000 7fe3b6ee5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b013ff50 con 0x7fe3b00d1670 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b0146cd0 0x7fe3b015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b0146cd0 0x7fe3b015b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53848/0 (socket says 172.21.15.113:53848) 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 -- 172.21.15.113:0/1527910094 learned_addr learned my addr 172.21.15.113:0/1527910094 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b5ee3640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3b006f490 0x7fe3b015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b56e2640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b00d1670 0x7fe3b013f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 -- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b00d1670 msgr2=0x7fe3b013f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b00d1670 0x7fe3b013f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 -- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3b006f490 msgr2=0x7fe3b015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3b006f490 0x7fe3b015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 -- 172.21.15.113:0/1527910094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009b30 con 0x7fe3b0146cd0 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b5ee3640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3b006f490 0x7fe3b015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.240+0000 7fe3b66e4640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b0146cd0 0x7fe3b015b9f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8036040 tx=0x7fe3a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:18.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.241+0000 7fe3a67fc640 1 -- 172.21.15.113:0/1527910094 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8009510 con 0x7fe3b0146cd0 2023-12-19T13:51:18.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.241+0000 7fe3a67fc640 1 -- 172.21.15.113:0/1527910094 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a803e450 con 0x7fe3b0146cd0 2023-12-19T13:51:18.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.241+0000 7fe3a67fc640 1 -- 172.21.15.113:0/1527910094 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a803e7e0 con 0x7fe3b0146cd0 2023-12-19T13:51:18.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.241+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b0140230 con 0x7fe3b0146cd0 2023-12-19T13:51:18.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.241+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b00cef40 con 0x7fe3b0146cd0 2023-12-19T13:51:18.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.242+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b00cf0d0 con 0x7fe3b0146cd0 2023-12-19T13:51:18.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.243+0000 7fe3a67fc640 1 -- 172.21.15.113:0/1527910094 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe3a803e940 con 0x7fe3b0146cd0 2023-12-19T13:51:18.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.244+0000 7fe3a67fc640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe39406a430 0x7fe39406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.244+0000 7fe3a67fc640 1 -- 172.21.15.113:0/1527910094 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe3a80ab3a0 con 0x7fe3b0146cd0 2023-12-19T13:51:18.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.244+0000 7fe3b5ee3640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe39406a430 0x7fe39406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.244+0000 7fe3b5ee3640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe39406a430 0x7fe39406c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac007fd0 tx=0x7fe3ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:18.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.248+0000 7fe3a67fc640 1 -- 172.21.15.113:0/1527910094 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe3a8076d70 con 0x7fe3b0146cd0 2023-12-19T13:51:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.420+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3b015deb0 con 0x7fe3b0146cd0 2023-12-19T13:51:18.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.421+0000 7fe3a67fc640 1 -- 172.21.15.113:0/1527910094 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3a807a390 con 0x7fe3b0146cd0 2023-12-19T13:51:18.421 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:51:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.423+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe39406a430 msgr2=0x7fe39406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.423+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe39406a430 0x7fe39406c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac007fd0 tx=0x7fe3ac009040 comp rx=0 tx=0).stop 2023-12-19T13:51:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.423+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b0146cd0 msgr2=0x7fe3b015b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.423+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b0146cd0 0x7fe3b015b9f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8036040 tx=0x7fe3a8004a40 comp rx=0 tx=0).stop 2023-12-19T13:51:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 shutdown_connections 2023-12-19T13:51:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe39406a430 0x7fe39406c8f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3b0146cd0 0x7fe3b015b9f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3b00d1670 0x7fe3b013f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 --2- 172.21.15.113:0/1527910094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3b006f490 0x7fe3b015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 >> 172.21.15.113:0/1527910094 conn(0x7fe3b00d3200 msgr2=0x7fe3b01414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:18.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 shutdown_connections 2023-12-19T13:51:18.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.424+0000 7fe3b6ee5640 1 -- 172.21.15.113:0/1527910094 wait complete. 2023-12-19T13:51:18.441 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:51:18.545 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:18.554 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:18.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.650+0000 7f005f9c4640 1 Processor -- start 2023-12-19T13:51:18.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.650+0000 7f005f9c4640 1 -- start start 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.651+0000 7f005f9c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00580b5130 0x7f00580b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.651+0000 7f005f9c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f00580b9060 0x7f0058142c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005f9c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00580b5a50 con 0x7f0058140cd0 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005f9c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005815da30 con 0x7f00580b5130 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005f9c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580b9490 con 0x7f00580b9060 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005d760640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00580b5130 0x7f00580b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005d760640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00580b5130 0x7f00580b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53858/0 (socket says 172.21.15.113:53858) 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005d760640 1 -- 172.21.15.113:0/437527336 learned_addr learned my addr 172.21.15.113:0/437527336 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005df61640 1 --2- 172.21.15.113:0/437527336 >> v2:172.21.15.151:3300/0 conn(0x7f00580b9060 0x7f0058142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005d760640 1 -- 172.21.15.113:0/437527336 >> v2:172.21.15.151:3300/0 conn(0x7f00580b9060 msgr2=0x7f0058142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:18.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005d760640 1 --2- 172.21.15.113:0/437527336 >> v2:172.21.15.151:3300/0 conn(0x7f00580b9060 0x7f0058142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005d760640 1 -- 172.21.15.113:0/437527336 >> v1:172.21.15.151:6789/0 conn(0x7f0058140cd0 legacy=0x7f00580b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:18.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.652+0000 7f005d760640 1 -- 172.21.15.113:0/437527336 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005815dc20 con 0x7f00580b5130 2023-12-19T13:51:18.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.653+0000 7f005d760640 1 --2- 172.21.15.113:0/437527336 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00580b5130 0x7f00580b5510 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f00580b3580 tx=0x7f005402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fff775039f1f75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:18.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f004ffff640 1 -- 172.21.15.113:0/437527336 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054031750 con 0x7f00580b5130 2023-12-19T13:51:18.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f004ffff640 1 -- 172.21.15.113:0/437527336 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00540318b0 con 0x7f00580b5130 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f004ffff640 1 -- 172.21.15.113:0/437527336 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054031c40 con 0x7f00580b5130 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 -- 172.21.15.113:0/437527336 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00580b5130 msgr2=0x7f00580b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 --2- 172.21.15.113:0/437527336 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00580b5130 0x7f00580b5510 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f00580b3580 tx=0x7f005402b7f0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 -- 172.21.15.113:0/437527336 shutdown_connections 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 --2- 172.21.15.113:0/437527336 >> v2:172.21.15.151:3300/0 conn(0x7f00580b9060 0x7f0058142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 --2- 172.21.15.113:0/437527336 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00580b5130 0x7f00580b5510 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 -- 172.21.15.113:0/437527336 >> 172.21.15.113:0/437527336 conn(0x7f00580d3370 msgr2=0x7f00580d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 -- 172.21.15.113:0/437527336 shutdown_connections 2023-12-19T13:51:18.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.654+0000 7f005f9c4640 1 -- 172.21.15.113:0/437527336 wait complete. 2023-12-19T13:51:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.656+0000 7f005f9c4640 1 Processor -- start 2023-12-19T13:51:18.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.656+0000 7f005f9c4640 1 -- start start 2023-12-19T13:51:18.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005f9c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00580b5130 0x7f00581f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005f9c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00580b9060 0x7f0058154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005f9c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0058140cd0 0x7f00581549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005f9c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0058156a90 con 0x7f0058140cd0 2023-12-19T13:51:18.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005f9c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00581591c0 con 0x7f00580b9060 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005f9c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00581567b0 con 0x7f00580b5130 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005df61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0058140cd0 0x7f00581549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005df61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0058140cd0 0x7f00581549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53864/0 (socket says 172.21.15.113:53864) 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.657+0000 7f005df61640 1 -- 172.21.15.113:0/2477729327 learned_addr learned my addr 172.21.15.113:0/2477729327 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005d760640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00580b5130 0x7f00581f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005cf5f640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00580b9060 0x7f0058154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005df61640 1 -- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00580b5130 msgr2=0x7f00581f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005df61640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00580b5130 0x7f00581f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005df61640 1 -- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00580b9060 msgr2=0x7f0058154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005df61640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00580b9060 0x7f0058154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005df61640 1 -- 172.21.15.113:0/2477729327 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540094d0 con 0x7f0058140cd0 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005d760640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00580b5130 0x7f00581f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:51:18.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005df61640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0058140cd0 0x7f00581549b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f0050007e70 tx=0x7f005000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:18.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f004dffb640 1 -- 172.21.15.113:0/2477729327 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050014620 con 0x7f0058140cd0 2023-12-19T13:51:18.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f004dffb640 1 -- 172.21.15.113:0/2477729327 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00500147a0 con 0x7f0058140cd0 2023-12-19T13:51:18.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f004dffb640 1 -- 172.21.15.113:0/2477729327 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050014b50 con 0x7f0058140cd0 2023-12-19T13:51:18.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0058158b70 con 0x7f0058140cd0 2023-12-19T13:51:18.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.658+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0058156480 con 0x7f0058140cd0 2023-12-19T13:51:18.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.660+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0058159350 con 0x7f0058140cd0 2023-12-19T13:51:18.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.661+0000 7f004dffb640 1 -- 172.21.15.113:0/2477729327 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0050014cb0 con 0x7f0058140cd0 2023-12-19T13:51:18.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.661+0000 7f004dffb640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003c06a430 0x7f003c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:18.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.661+0000 7f004dffb640 1 -- 172.21.15.113:0/2477729327 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0050088ec0 con 0x7f0058140cd0 2023-12-19T13:51:18.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.662+0000 7f005d760640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003c06a430 0x7f003c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:18.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.662+0000 7f005d760640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003c06a430 0x7f003c06c8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0054035000 tx=0x7f0054008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:18.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.666+0000 7f004dffb640 1 -- 172.21.15.113:0/2477729327 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0050054890 con 0x7f0058140cd0 2023-12-19T13:51:18.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.840+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f005815ded0 con 0x7f0058140cd0 2023-12-19T13:51:18.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.841+0000 7f004dffb640 1 -- 172.21.15.113:0/2477729327 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0050057eb0 con 0x7f0058140cd0 2023-12-19T13:51:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:18.841 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:51:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:51:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:51:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:51:18.841 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:51:18.841 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:51:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.843+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003c06a430 msgr2=0x7f003c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.843+0000 7f005f9c4640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003c06a430 0x7f003c06c8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0054035000 tx=0x7f0054008030 comp rx=0 tx=0).stop 2023-12-19T13:51:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0058140cd0 msgr2=0x7f00581549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0058140cd0 0x7f00581549b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f0050007e70 tx=0x7f005000e4b0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 shutdown_connections 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003c06a430 0x7f003c06c8f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0058140cd0 0x7f00581549b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00580b9060 0x7f0058154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 --2- 172.21.15.113:0/2477729327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00580b5130 0x7f00581f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 >> 172.21.15.113:0/2477729327 conn(0x7f00580d3370 msgr2=0x7f005815eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 shutdown_connections 2023-12-19T13:51:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:18.844+0000 7f005f9c4640 1 -- 172.21.15.113:0/2477729327 wait complete. 2023-12-19T13:51:18.862 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:51:18.862 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:51:19.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.067+0000 7f8a7f59e640 1 Processor -- start 2023-12-19T13:51:19.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.068+0000 7f8a7f59e640 1 -- start start 2023-12-19T13:51:19.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.069+0000 7f8a7f59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a8006cf60 0x7f8a800ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:19.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.069+0000 7f8a7f59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8a800cef30 0x7f8a8015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.069+0000 7f8a7f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a8015ac20 0x7f8a8015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7f59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a800cf370 con 0x7f8a800cef30 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7f59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8006d340 con 0x7f8a8006cf60 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8015b4a0 con 0x7f8a8015ac20 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8a800cef30 0x7f8a8015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8a800cef30 0x7f8a8015a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53874/0 (socket says 172.21.15.113:53874) 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 -- 172.21.15.113:0/2220724019 learned_addr learned my addr 172.21.15.113:0/2220724019 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 -- 172.21.15.113:0/2220724019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a8015ac20 msgr2=0x7f8a8015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 --2- 172.21.15.113:0/2220724019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a8015ac20 0x7f8a8015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 -- 172.21.15.113:0/2220724019 >> v2:172.21.15.151:3300/0 conn(0x7f8a8006cf60 msgr2=0x7f8a800ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 --2- 172.21.15.113:0/2220724019 >> v2:172.21.15.151:3300/0 conn(0x7f8a8006cf60 0x7f8a800ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.070+0000 7f8a7dd9b640 1 -- 172.21.15.113:0/2220724019 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800b25b0 con 0x7f8a800cef30 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.071+0000 7f8a7dd9b640 1 --2- 172.21.15.113:0/2220724019 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a800cef30 0x7f8a8015a6e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8a800b50d0 tx=0x7f8a7402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff992c4743f5cc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:19.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7d59a640 1 -- 172.21.15.113:0/2220724019 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74030860 con 0x7f8a800cef30 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7d59a640 1 -- 172.21.15.113:0/2220724019 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a740309c0 con 0x7f8a800cef30 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7d59a640 1 -- 172.21.15.113:0/2220724019 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74030d50 con 0x7f8a800cef30 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7f59e640 1 -- 172.21.15.113:0/2220724019 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a800cef30 msgr2=0x7f8a8015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/2220724019 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a800cef30 0x7f8a8015a6e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8a800b50d0 tx=0x7f8a7402b9a0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7f59e640 1 -- 172.21.15.113:0/2220724019 shutdown_connections 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/2220724019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a8015ac20 0x7f8a8015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/2220724019 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a800cef30 0x7f8a8015a6e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/2220724019 >> v2:172.21.15.151:3300/0 conn(0x7f8a8006cf60 0x7f8a800ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.072+0000 7f8a7f59e640 1 -- 172.21.15.113:0/2220724019 >> 172.21.15.113:0/2220724019 conn(0x7f8a800b4750 msgr2=0x7f8a800659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.073+0000 7f8a7f59e640 1 -- 172.21.15.113:0/2220724019 shutdown_connections 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.073+0000 7f8a7f59e640 1 -- 172.21.15.113:0/2220724019 wait complete. 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.074+0000 7f8a7f59e640 1 Processor -- start 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.074+0000 7f8a7f59e640 1 -- start start 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.075+0000 7f8a7f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a8006cf60 0x7f8a80145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:19.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.075+0000 7f8a7f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a800cef30 0x7f8a801f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.075+0000 7f8a7f59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a8015ac20 0x7f8a80154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.075+0000 7f8a7f59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80145b60 con 0x7f8a8015ac20 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.075+0000 7f8a7f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a801f2820 con 0x7f8a8006cf60 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.075+0000 7f8a7f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a801582a0 con 0x7f8a800cef30 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a8015ac20 0x7f8a80154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a8015ac20 0x7f8a80154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53886/0 (socket says 172.21.15.113:53886) 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 -- 172.21.15.113:0/1178247530 learned_addr learned my addr 172.21.15.113:0/1178247530 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7e59c640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a8006cf60 0x7f8a80145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 -- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a800cef30 msgr2=0x7f8a801f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a800cef30 0x7f8a801f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 -- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a8006cf60 msgr2=0x7f8a80145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a8006cf60 0x7f8a80145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 -- 172.21.15.113:0/1178247530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740094d0 con 0x7f8a8015ac20 2023-12-19T13:51:19.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7e59c640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a8006cf60 0x7f8a80145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.076+0000 7f8a7ed9d640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a8015ac20 0x7f8a80154c10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800ba10 tx=0x7f8a7800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.077+0000 7f8a6effd640 1 -- 172.21.15.113:0/1178247530 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7800ca60 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.077+0000 7f8a6effd640 1 -- 172.21.15.113:0/1178247530 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7800cbe0 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.077+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a80158580 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.077+0000 7f8a6effd640 1 -- 172.21.15.113:0/1178247530 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78014440 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.077+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a80158b40 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.078+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a801577f0 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.078+0000 7f8a6effd640 1 -- 172.21.15.113:0/1178247530 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a78007370 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.080+0000 7f8a6effd640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a6006a430 0x7f8a6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.080+0000 7f8a6effd640 1 -- 172.21.15.113:0/1178247530 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8a78088450 con 0x7f8a8015ac20 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.080+0000 7f8a7e59c640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a6006a430 0x7f8a6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.081+0000 7f8a7e59c640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a6006a430 0x7f8a6006c8f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8a70006fd0 tx=0x7f8a70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:19.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.084+0000 7f8a6effd640 1 -- 172.21.15.113:0/1178247530 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a78053d80 con 0x7f8a8015ac20 2023-12-19T13:51:19.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:19.258+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8a80158d30 con 0x7f8a8015ac20 2023-12-19T13:51:20.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.094+0000 7f8a6effd640 1 -- 172.21.15.113:0/1178247530 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8a780190b0 con 0x7f8a8015ac20 2023-12-19T13:51:20.094 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:51:20.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.100+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a6006a430 msgr2=0x7f8a6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:20.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.100+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a6006a430 0x7f8a6006c8f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8a70006fd0 tx=0x7f8a70008040 comp rx=0 tx=0).stop 2023-12-19T13:51:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.100+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a8015ac20 msgr2=0x7f8a80154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.100+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a8015ac20 0x7f8a80154c10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800ba10 tx=0x7f8a7800bed0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.102+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 shutdown_connections 2023-12-19T13:51:20.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.102+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8a6006a430 0x7f8a6006c8f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.102+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8a8015ac20 0x7f8a80154c10 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.102+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a800cef30 0x7f8a801f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.102+0000 7f8a7f59e640 1 --2- 172.21.15.113:0/1178247530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a8006cf60 0x7f8a80145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.102+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 >> 172.21.15.113:0/1178247530 conn(0x7f8a800b4750 msgr2=0x7f8a800ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:20.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.103+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 shutdown_connections 2023-12-19T13:51:20.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.103+0000 7f8a7f59e640 1 -- 172.21.15.113:0/1178247530 wait complete. 2023-12-19T13:51:20.122 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:51:20.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.335+0000 7f57b2c26640 1 Processor -- start 2023-12-19T13:51:20.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.336+0000 7f57b2c26640 1 -- start start 2023-12-19T13:51:20.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.337+0000 7f57b2c26640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57ac0b9060 0x7f57ac168400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57b2c26640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0b94b0 con 0x7f57ac140cd0 2023-12-19T13:51:20.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57b2c26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac15dc20 con 0x7f57ac0b5130 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57b2c26640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac15da30 con 0x7f57ac0b9060 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57abfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f57ac140cd0 0x7f57ac0b8950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43420/0 (socket says 172.21.15.113:43420) 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57abfff640 1 -- 172.21.15.113:0/3935437997 learned_addr learned my addr 172.21.15.113:0/3935437997 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57b11c3640 1 --2- 172.21.15.113:0/3935437997 >> v2:172.21.15.151:3300/0 conn(0x7f57ac0b9060 0x7f57ac168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531258043 0 0) 0x7f57ac0b94b0 con 0x7f57ac140cd0 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.338+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c003520 con 0x7f57ac140cd0 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3314205473 0 0) 0x7f579c003520 con 0x7f57ac140cd0 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 >> v2:172.21.15.151:3300/0 conn(0x7f57ac0b9060 msgr2=0x7f57ac168400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 --2- 172.21.15.113:0/3935437997 >> v2:172.21.15.151:3300/0 conn(0x7f57ac0b9060 0x7f57ac168400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 >> v1:172.21.15.151:6789/0 conn(0x7f57ac0b5130 legacy=0x7f57ac0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac15df00 con 0x7f57ac140cd0 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5798001670 con 0x7f57ac140cd0 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 >> v1:172.21.15.113:6789/0 conn(0x7f57ac140cd0 legacy=0x7f57ac0b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:20.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f579c003970 0x7f579c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f579c0047c0 0x7f579c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f579c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00c140 con 0x7f579c0052a0 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00c2b0 con 0x7f579c003970 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00c470 con 0x7f579c0047c0 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.339+0000 7f57b11c3640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f579c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57b09c2640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f579c003970 0x7f579c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57b11c3640 1 -- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f579c0047c0 msgr2=0x7f579c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57abfff640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f579c0047c0 0x7f579c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57b11c3640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f579c0047c0 0x7f579c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57b11c3640 1 -- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f579c003970 msgr2=0x7f579c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57b11c3640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f579c003970 0x7f579c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57b11c3640 1 -- 172.21.15.113:0/3935437997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c003520 con 0x7f579c0052a0 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.340+0000 7f57b09c2640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f579c003970 0x7f579c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.341+0000 7f57b11c3640 1 -- 172.21.15.113:0/3935437997 reap_dead start 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.341+0000 7f57b11c3640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f579c00b980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009f90 tx=0x7f579c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0630185069f11f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.341+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a402cc20 con 0x7f579c0052a0 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.341+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400f040 con 0x7f579c0052a0 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.341+0000 7f57ab7fe640 1 -- 172.21.15.113:0/3935437997 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4003990 con 0x7f579c0052a0 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.341+0000 7f57b2c26640 1 -- 172.21.15.113:0/3935437997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 msgr2=0x7f579c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.341+0000 7f57b2c26640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f579c00b980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009f90 tx=0x7f579c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.342+0000 7f57b2c26640 1 -- 172.21.15.113:0/3935437997 shutdown_connections 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.342+0000 7f57b2c26640 1 --2- 172.21.15.113:0/3935437997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f579c00b980 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.342+0000 7f57b2c26640 1 -- 172.21.15.113:0/3935437997 >> 172.21.15.113:0/3935437997 conn(0x7f57ac0d3370 msgr2=0x7f57ac0d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:20.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.342+0000 7f57b2c26640 1 -- 172.21.15.113:0/3935437997 shutdown_connections 2023-12-19T13:51:20.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.342+0000 7f57b2c26640 1 -- 172.21.15.113:0/3935437997 wait complete. 2023-12-19T13:51:20.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.343+0000 7f57b2c26640 1 Processor -- start 2023-12-19T13:51:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.343+0000 7f57b2c26640 1 -- start start 2023-12-19T13:51:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.344+0000 7f57b2c26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f57ac0c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.344+0000 7f57b2c26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57ac0c8ff0 0x7f57ac1f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.344+0000 7f57b2c26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57ac1f6af0 0x7f57ac161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.344+0000 7f57b2c26640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac15a130 con 0x7f579c0052a0 2023-12-19T13:51:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.344+0000 7f57b2c26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac159790 con 0x7f57ac1f6af0 2023-12-19T13:51:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.344+0000 7f57b2c26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac159a70 con 0x7f57ac0c8ff0 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f57ac0c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f57ac0c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53912/0 (socket says 172.21.15.113:53912) 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 -- 172.21.15.113:0/2937073401 learned_addr learned my addr 172.21.15.113:0/2937073401 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b11c3640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57ac1f6af0 0x7f57ac161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 -- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57ac0c8ff0 msgr2=0x7f57ac1f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57abfff640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57ac0c8ff0 0x7f57ac1f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57ac0c8ff0 0x7f57ac1f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 -- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57ac1f6af0 msgr2=0x7f57ac161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:20.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57ac1f6af0 0x7f57ac161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:20.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 -- 172.21.15.113:0/2937073401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac159d50 con 0x7f579c0052a0 2023-12-19T13:51:20.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b11c3640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57ac1f6af0 0x7f57ac161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:20.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.345+0000 7f57b09c2640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f57ac0c8ab0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f57a000d770 tx=0x7f57a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:20.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.346+0000 7f57a97fa640 1 -- 172.21.15.113:0/2937073401 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0005270 con 0x7f579c0052a0 2023-12-19T13:51:20.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.346+0000 7f57a97fa640 1 -- 172.21.15.113:0/2937073401 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a00053d0 con 0x7f579c0052a0 2023-12-19T13:51:20.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.346+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0c9570 con 0x7f579c0052a0 2023-12-19T13:51:20.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.346+0000 7f57a97fa640 1 -- 172.21.15.113:0/2937073401 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000b8f0 con 0x7f579c0052a0 2023-12-19T13:51:20.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.346+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac161590 con 0x7f579c0052a0 2023-12-19T13:51:20.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.347+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac15a3a0 con 0x7f579c0052a0 2023-12-19T13:51:20.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.348+0000 7f57a97fa640 1 -- 172.21.15.113:0/2937073401 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f57a000ba50 con 0x7f579c0052a0 2023-12-19T13:51:20.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.349+0000 7f57a97fa640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f579006a460 0x7f579006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:20.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.349+0000 7f57a97fa640 1 -- 172.21.15.113:0/2937073401 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f57a0088580 con 0x7f579c0052a0 2023-12-19T13:51:20.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.349+0000 7f57abfff640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f579006a460 0x7f579006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:20.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.350+0000 7f57abfff640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f579006a460 0x7f579006c920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5798001200 tx=0x7f5798009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:20.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.354+0000 7f57a97fa640 1 -- 172.21.15.113:0/2937073401 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f57a0053de0 con 0x7f579c0052a0 2023-12-19T13:51:20.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:20.546+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f57ac061910 con 0x7f579c0052a0 2023-12-19T13:51:21.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.113+0000 7f57a97fa640 1 -- 172.21.15.113:0/2937073401 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7f57a0019310 con 0x7f579c0052a0 2023-12-19T13:51:21.114 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:51:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.119+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f579006a460 msgr2=0x7f579006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.119+0000 7f57b2c26640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f579006a460 0x7f579006c920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5798001200 tx=0x7f5798009040 comp rx=0 tx=0).stop 2023-12-19T13:51:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.119+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 msgr2=0x7f57ac0c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.119+0000 7f57b2c26640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f57ac0c8ab0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f57a000d770 tx=0x7f57a000dc30 comp rx=0 tx=0).stop 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.120+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 shutdown_connections 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.120+0000 7f57b2c26640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f579006a460 0x7f579006c920 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.120+0000 7f57b2c26640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57ac1f6af0 0x7f57ac161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.120+0000 7f57b2c26640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57ac0c8ff0 0x7f57ac1f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.120+0000 7f57b2c26640 1 --2- 172.21.15.113:0/2937073401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f579c0052a0 0x7f57ac0c8ab0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.120+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 >> 172.21.15.113:0/2937073401 conn(0x7f57ac0d3370 msgr2=0x7f57ac15cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.121+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 shutdown_connections 2023-12-19T13:51:21.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.121+0000 7f57b2c26640 1 -- 172.21.15.113:0/2937073401 wait complete. 2023-12-19T13:51:21.151 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:51:21.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.343+0000 7fea60d51640 1 Processor -- start 2023-12-19T13:51:21.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.343+0000 7fea60d51640 1 -- start start 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.344+0000 7fea60d51640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea5c15b1d0 0x7fea5c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.344+0000 7fea60d51640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fea5c0b1ec0 0x7fea5c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.344+0000 7fea60d51640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0ceea0 0x7fea5c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.344+0000 7fea60d51640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c0cf870 con 0x7fea5c0b1ec0 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.344+0000 7fea60d51640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c15ef10 con 0x7fea5c15b1d0 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.344+0000 7fea60d51640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0b2320 con 0x7fea5c0ceea0 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fea5c0b1ec0 0x7fea5c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fea5c0b1ec0 0x7fea5c15f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53914/0 (socket says 172.21.15.113:53914) 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 -- 172.21.15.113:0/2641250420 learned_addr learned my addr 172.21.15.113:0/2641250420 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea5a59c640 1 --2- 172.21.15.113:0/2641250420 >> v2:172.21.15.151:3300/0 conn(0x7fea5c15b1d0 0x7fea5c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea5ad9d640 1 --2- 172.21.15.113:0/2641250420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0ceea0 0x7fea5c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 -- 172.21.15.113:0/2641250420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0ceea0 msgr2=0x7fea5c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:21.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 --2- 172.21.15.113:0/2641250420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0ceea0 0x7fea5c0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 -- 172.21.15.113:0/2641250420 >> v2:172.21.15.151:3300/0 conn(0x7fea5c15b1d0 msgr2=0x7fea5c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:21.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 --2- 172.21.15.113:0/2641250420 >> v2:172.21.15.151:3300/0 conn(0x7fea5c15b1d0 0x7fea5c0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.345+0000 7fea53fff640 1 -- 172.21.15.113:0/2641250420 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0b2e40 con 0x7fea5c0b1ec0 2023-12-19T13:51:21.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.347+0000 7fea53fff640 1 --2- 172.21.15.113:0/2641250420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0b1ec0 0x7fea5c15f6d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0ae020 tx=0x7fea4402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f914b23f97593a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:21.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.347+0000 7fea59d9b640 1 -- 172.21.15.113:0/2641250420 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44031860 con 0x7fea5c0b1ec0 2023-12-19T13:51:21.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.347+0000 7fea59d9b640 1 -- 172.21.15.113:0/2641250420 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea440319c0 con 0x7fea5c0b1ec0 2023-12-19T13:51:21.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.347+0000 7fea59d9b640 1 -- 172.21.15.113:0/2641250420 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44031d50 con 0x7fea5c0b1ec0 2023-12-19T13:51:21.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 -- 172.21.15.113:0/2641250420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0b1ec0 msgr2=0x7fea5c15f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 --2- 172.21.15.113:0/2641250420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0b1ec0 0x7fea5c15f6d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0ae020 tx=0x7fea4402b900 comp rx=0 tx=0).stop 2023-12-19T13:51:21.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 -- 172.21.15.113:0/2641250420 shutdown_connections 2023-12-19T13:51:21.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 --2- 172.21.15.113:0/2641250420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0ceea0 0x7fea5c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 --2- 172.21.15.113:0/2641250420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0b1ec0 0x7fea5c15f6d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 --2- 172.21.15.113:0/2641250420 >> v2:172.21.15.151:3300/0 conn(0x7fea5c15b1d0 0x7fea5c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 -- 172.21.15.113:0/2641250420 >> 172.21.15.113:0/2641250420 conn(0x7fea5c073150 msgr2=0x7fea5c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:21.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 -- 172.21.15.113:0/2641250420 shutdown_connections 2023-12-19T13:51:21.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.348+0000 7fea60d51640 1 -- 172.21.15.113:0/2641250420 wait complete. 2023-12-19T13:51:21.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.350+0000 7fea60d51640 1 Processor -- start 2023-12-19T13:51:21.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.350+0000 7fea60d51640 1 -- start start 2023-12-19T13:51:21.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea60d51640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0b1ec0 0x7fea5c0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea60d51640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0ceea0 0x7fea5c153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea60d51640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea5c15b1d0 0x7fea5c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea60d51640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c15ce80 con 0x7fea5c0ceea0 2023-12-19T13:51:21.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea60d51640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c15db40 con 0x7fea5c15b1d0 2023-12-19T13:51:21.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea60d51640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1f61f0 con 0x7fea5c0b1ec0 2023-12-19T13:51:21.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0ceea0 0x7fea5c153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0ceea0 0x7fea5c153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53916/0 (socket says 172.21.15.113:53916) 2023-12-19T13:51:21.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 -- 172.21.15.113:0/2294016986 learned_addr learned my addr 172.21.15.113:0/2294016986 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:21.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea5ad9d640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea5c15b1d0 0x7fea5c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea5a59c640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0b1ec0 0x7fea5c0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 -- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0b1ec0 msgr2=0x7fea5c0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0b1ec0 0x7fea5c0cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 -- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea5c15b1d0 msgr2=0x7fea5c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea5c15b1d0 0x7fea5c15d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea53fff640 1 -- 172.21.15.113:0/2294016986 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440094d0 con 0x7fea5c0ceea0 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.351+0000 7fea5a59c640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0b1ec0 0x7fea5c0cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.352+0000 7fea53fff640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0ceea0 0x7fea5c153630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fea4402b940 tx=0x7fea440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.352+0000 7fea52ffd640 1 -- 172.21.15.113:0/2294016986 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4403ad30 con 0x7fea5c0ceea0 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.352+0000 7fea52ffd640 1 -- 172.21.15.113:0/2294016986 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea440443f0 con 0x7fea5c0ceea0 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.352+0000 7fea52ffd640 1 -- 172.21.15.113:0/2294016986 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea440447a0 con 0x7fea5c0ceea0 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.352+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c15e390 con 0x7fea5c0ceea0 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.352+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c15e0b0 con 0x7fea5c0ceea0 2023-12-19T13:51:21.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.353+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c1f6050 con 0x7fea5c0ceea0 2023-12-19T13:51:21.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.354+0000 7fea52ffd640 1 -- 172.21.15.113:0/2294016986 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea4404d450 con 0x7fea5c0ceea0 2023-12-19T13:51:21.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.356+0000 7fea52ffd640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea3c06a430 0x7fea3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.356+0000 7fea52ffd640 1 -- 172.21.15.113:0/2294016986 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fea440aaf50 con 0x7fea5c0ceea0 2023-12-19T13:51:21.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.356+0000 7fea5a59c640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea3c06a430 0x7fea3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.357+0000 7fea5a59c640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea3c06a430 0x7fea3c06c8f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:21.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.361+0000 7fea52ffd640 1 -- 172.21.15.113:0/2294016986 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea5c1f6050 con 0x7fea5c0ceea0 2023-12-19T13:51:21.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.590+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fea5c1f6050 con 0x7fea5c0ceea0 2023-12-19T13:51:21.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.603+0000 7fea52ffd640 1 -- 172.21.15.113:0/2294016986 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7fea5c1f6050 con 0x7fea5c0ceea0 2023-12-19T13:51:21.604 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 10 and data pool 11 2023-12-19T13:51:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.610+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea3c06a430 msgr2=0x7fea3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.610+0000 7fea60d51640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea3c06a430 0x7fea3c06c8f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c008040 comp rx=0 tx=0).stop 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.610+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0ceea0 msgr2=0x7fea5c153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.610+0000 7fea60d51640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0ceea0 0x7fea5c153630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fea4402b940 tx=0x7fea440046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.611+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 shutdown_connections 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.611+0000 7fea60d51640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fea3c06a430 0x7fea3c06c8f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.611+0000 7fea60d51640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea5c15b1d0 0x7fea5c15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.611+0000 7fea60d51640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea5c0ceea0 0x7fea5c153630 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.611+0000 7fea60d51640 1 --2- 172.21.15.113:0/2294016986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea5c0b1ec0 0x7fea5c0cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.611+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 >> 172.21.15.113:0/2294016986 conn(0x7fea5c073150 msgr2=0x7fea5c157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.612+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 shutdown_connections 2023-12-19T13:51:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.612+0000 7fea60d51640 1 -- 172.21.15.113:0/2294016986 wait complete. 2023-12-19T13:51:21.641 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:21.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.823+0000 7f845b966640 1 Processor -- start 2023-12-19T13:51:21.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.823+0000 7f845b966640 1 -- start start 2023-12-19T13:51:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.824+0000 7f845b966640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8454157bf0 0x7f845415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.824+0000 7f845b966640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 0x7f84540b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.824+0000 7f845b966640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540b0a90 con 0x7f84540b0640 2023-12-19T13:51:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.824+0000 7f845b966640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845406b8c0 con 0x7f8454157bf0 2023-12-19T13:51:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.824+0000 7f845b966640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845415b740 con 0x7f84540ae110 2023-12-19T13:51:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.825+0000 7f8459f03640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f84540b0640 0x7f845415dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43432/0 (socket says 172.21.15.113:43432) 2023-12-19T13:51:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.825+0000 7f8459f03640 1 -- 172.21.15.113:0/1024338979 learned_addr learned my addr 172.21.15.113:0/1024338979 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.825+0000 7f8459702640 1 --2- 172.21.15.113:0/1024338979 >> v2:172.21.15.151:3300/0 conn(0x7f8454157bf0 0x7f845415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.825+0000 7f8458f01640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 0x7f84540b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.825+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088941257 0 0) 0x7f844c001490 con 0x7f84540b0640 2023-12-19T13:51:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.825+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8440003520 con 0x7f84540b0640 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4084850307 0 0) 0x7f8440003520 con 0x7f84540b0640 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 msgr2=0x7f84540b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 0x7f84540b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 >> v2:172.21.15.151:3300/0 conn(0x7f8454157bf0 msgr2=0x7f845415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 --2- 172.21.15.113:0/1024338979 >> v2:172.21.15.151:3300/0 conn(0x7f8454157bf0 0x7f845415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540ae640 con 0x7f84540b0640 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f844c001b80 con 0x7f84540b0640 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 >> v1:172.21.15.113:6789/0 conn(0x7f84540b0640 legacy=0x7f845415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84400039e0 0x7f8440003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 0x7f84400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8440004d00 0x7f8440005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845406b8c0 con 0x7f84400039e0 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845415b740 con 0x7f8440004d00 2023-12-19T13:51:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844000b980 con 0x7f84540ae110 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.826+0000 7f8459702640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84400039e0 0x7f8440003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.827+0000 7f8458f01640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 0x7f84400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.827+0000 7f8459f03640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8440004d00 0x7f8440005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.827+0000 7f8459702640 1 -- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 msgr2=0x7f84400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.827+0000 7f8459702640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84540ae110 0x7f84400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.827+0000 7f8459702640 1 -- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8440004d00 msgr2=0x7f8440005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.827+0000 7f8459702640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8440004d00 0x7f8440005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.827+0000 7f8459702640 1 -- 172.21.15.113:0/1024338979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440003520 con 0x7f84400039e0 2023-12-19T13:51:21.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.828+0000 7f8459702640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84400039e0 0x7f8440003e00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8450009ac0 tx=0x7f84400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a06f79916b8402b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.828+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845002c710 con 0x7f84400039e0 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.828+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845002c870 con 0x7f84400039e0 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.828+0000 7f844bfff640 1 -- 172.21.15.113:0/1024338979 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845002cc00 con 0x7f84400039e0 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.829+0000 7f845b966640 1 -- 172.21.15.113:0/1024338979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84400039e0 msgr2=0x7f8440003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.829+0000 7f845b966640 1 --2- 172.21.15.113:0/1024338979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84400039e0 0x7f8440003e00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8450009ac0 tx=0x7f84400057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.829+0000 7f8459f03640 1 -- 172.21.15.113:0/1024338979 reap_dead start 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.829+0000 7f845b966640 1 -- 172.21.15.113:0/1024338979 shutdown_connections 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.829+0000 7f845b966640 1 -- 172.21.15.113:0/1024338979 >> 172.21.15.113:0/1024338979 conn(0x7f84540cbb70 msgr2=0x7f84540cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.829+0000 7f845b966640 1 -- 172.21.15.113:0/1024338979 shutdown_connections 2023-12-19T13:51:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.829+0000 7f845b966640 1 -- 172.21.15.113:0/1024338979 wait complete. 2023-12-19T13:51:21.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.831+0000 7f845b966640 1 Processor -- start 2023-12-19T13:51:21.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.831+0000 7f845b966640 1 -- start start 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f845b966640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84400039e0 0x7f84540cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f845b966640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f845415d370 0x7f845415c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f845b966640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415c940 0x7f845414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f845b966640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845415bf70 con 0x7f845415c940 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f845b966640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8454070f50 con 0x7f845415d370 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f845b966640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8454070990 con 0x7f84400039e0 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f8459f03640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415c940 0x7f845414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f8459f03640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415c940 0x7f845414a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53940/0 (socket says 172.21.15.113:53940) 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.832+0000 7f8459f03640 1 -- 172.21.15.113:0/3239739056 learned_addr learned my addr 172.21.15.113:0/3239739056 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:21.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8458f01640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f845415d370 0x7f845415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8459702640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84400039e0 0x7f84540cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8459f03640 1 -- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84400039e0 msgr2=0x7f84540cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8459f03640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84400039e0 0x7f84540cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8459f03640 1 -- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f845415d370 msgr2=0x7f845415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8459f03640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f845415d370 0x7f845415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8459f03640 1 -- 172.21.15.113:0/3239739056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454070c70 con 0x7f845415c940 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8459f03640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415c940 0x7f845414a840 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f844c007c40 tx=0x7f844c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8449ffb640 1 -- 172.21.15.113:0/3239739056 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c004d60 con 0x7f845415c940 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8449ffb640 1 -- 172.21.15.113:0/3239739056 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00bb80 con 0x7f845415c940 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f8449ffb640 1 -- 172.21.15.113:0/3239739056 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c007110 con 0x7f845415c940 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.833+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845415b920 con 0x7f845415c940 2023-12-19T13:51:21.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.834+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845414bf80 con 0x7f845415c940 2023-12-19T13:51:21.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.835+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845415c0e0 con 0x7f845415c940 2023-12-19T13:51:21.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.836+0000 7f8449ffb640 1 -- 172.21.15.113:0/3239739056 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f844c007480 con 0x7f845415c940 2023-12-19T13:51:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.837+0000 7f8449ffb640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f843806a460 0x7f843806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.837+0000 7f8449ffb640 1 -- 172.21.15.113:0/3239739056 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f844c088b10 con 0x7f845415c940 2023-12-19T13:51:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.837+0000 7f8459702640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f843806a460 0x7f843806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.838+0000 7f8459702640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f843806a460 0x7f843806c920 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8450036000 tx=0x7f8450030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:21.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:21.842+0000 7f8449ffb640 1 -- 172.21.15.113:0/3239739056 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f844c054250 con 0x7f845415c940 2023-12-19T13:51:22.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.032+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84540b0a90 con 0x7f845415c940 2023-12-19T13:51:22.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.035+0000 7f8449ffb640 1 -- 172.21.15.113:0/3239739056 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f84540b0a90 con 0x7f845415c940 2023-12-19T13:51:22.036 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:22.036 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":93,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:21.593428+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:22.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.038+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f843806a460 msgr2=0x7f843806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.038+0000 7f845b966640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f843806a460 0x7f843806c920 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8450036000 tx=0x7f8450030000 comp rx=0 tx=0).stop 2023-12-19T13:51:22.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.038+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415c940 msgr2=0x7f845414a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.038+0000 7f845b966640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415c940 0x7f845414a840 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f844c007c40 tx=0x7f844c00b4a0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.038+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 shutdown_connections 2023-12-19T13:51:22.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.038+0000 7f845b966640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f843806a460 0x7f843806c920 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.039+0000 7f845b966640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415c940 0x7f845414a840 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.039+0000 7f845b966640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f845415d370 0x7f845415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.039+0000 7f845b966640 1 --2- 172.21.15.113:0/3239739056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84400039e0 0x7f84540cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.039+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 >> 172.21.15.113:0/3239739056 conn(0x7f84540cbb70 msgr2=0x7f84540cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:22.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.039+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 shutdown_connections 2023-12-19T13:51:22.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.039+0000 7f845b966640 1 -- 172.21.15.113:0/3239739056 wait complete. 2023-12-19T13:51:22.057 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:22.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.260+0000 7ff4c20ad640 1 Processor -- start 2023-12-19T13:51:22.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.260+0000 7ff4c20ad640 1 -- start start 2023-12-19T13:51:22.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.261+0000 7ff4c20ad640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff4bc1449e0 0x7ff4bc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.261+0000 7ff4c20ad640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc0afb10 con 0x7ff4bc0b0b50 2023-12-19T13:51:22.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.261+0000 7ff4c20ad640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc06bb30 con 0x7ff4bc06c6b0 2023-12-19T13:51:22.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.261+0000 7ff4c20ad640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b0070 con 0x7ff4bc1449e0 2023-12-19T13:51:22.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4b3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff4bc0b0b50 0x7ff4bc06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43448/0 (socket says 172.21.15.113:43448) 2023-12-19T13:51:22.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4b3fff640 1 -- 172.21.15.113:0/2550019129 learned_addr learned my addr 172.21.15.113:0/2550019129 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4bb7fe640 1 --2- 172.21.15.113:0/2550019129 >> v2:172.21.15.151:3300/0 conn(0x7ff4bc1449e0 0x7ff4bc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074135045 0 0) 0x7ff4bc0afb10 con 0x7ff4bc0b0b50 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a8003520 con 0x7ff4bc0b0b50 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3975084566 0 0) 0x7ff4a8003520 con 0x7ff4bc0b0b50 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 >> v2:172.21.15.151:3300/0 conn(0x7ff4bc1449e0 msgr2=0x7ff4bc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 --2- 172.21.15.113:0/2550019129 >> v2:172.21.15.151:3300/0 conn(0x7ff4bc1449e0 0x7ff4bc0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 >> v1:172.21.15.151:6789/0 conn(0x7ff4bc06c6b0 legacy=0x7ff4bc0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0b0350 con 0x7ff4bc0b0b50 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff4a4001670 con 0x7ff4bc0b0b50 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.262+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 >> v1:172.21.15.113:6789/0 conn(0x7ff4bc0b0b50 legacy=0x7ff4bc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4baffd640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4a80039e0 0x7ff4a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4baffd640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4a80047c0 0x7ff4a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4baffd640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b0070 con 0x7ff4a80051f0 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a800c150 con 0x7ff4a80047c0 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a800c310 con 0x7ff4a80039e0 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bb7fe640 1 --2- 172.21.15.113:0/2550019129 >> v2:172.21.15.151:3300/0 conn(0x7ff4bc1449e0 0x7ff4bc0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bbfff640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4b3fff640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4a80047c0 0x7ff4a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bb7fe640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4a80039e0 0x7ff4a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bbfff640 1 -- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4a80039e0 msgr2=0x7ff4a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:22.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bbfff640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4a80039e0 0x7ff4a8003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bbfff640 1 -- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4a80047c0 msgr2=0x7ff4a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:22.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bbfff640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4a80047c0 0x7ff4a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.263+0000 7ff4bbfff640 1 -- 172.21.15.113:0/2550019129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8003520 con 0x7ff4a80051f0 2023-12-19T13:51:22.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.264+0000 7ff4bbfff640 1 -- 172.21.15.113:0/2550019129 reap_dead start 2023-12-19T13:51:22.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.264+0000 7ff4bbfff640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4a800b980 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4001e50 tx=0x7ff4a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e229db50cee52a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:22.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4003b70 con 0x7ff4a80051f0 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4003d10 con 0x7ff4a80051f0 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4baffd640 1 -- 172.21.15.113:0/2550019129 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4005310 con 0x7ff4a80051f0 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2550019129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 msgr2=0x7ff4a800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4a800b980 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4001e50 tx=0x7ff4a80057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2550019129 shutdown_connections 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2550019129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4a800b980 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2550019129 >> 172.21.15.113:0/2550019129 conn(0x7ff4bc0cbb70 msgr2=0x7ff4bc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2550019129 shutdown_connections 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.265+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2550019129 wait complete. 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.267+0000 7ff4c20ad640 1 Processor -- start 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.267+0000 7ff4c20ad640 1 -- start start 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.268+0000 7ff4c20ad640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4bc15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.268+0000 7ff4c20ad640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4bc0702a0 0x7ff4bc070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.268+0000 7ff4c20ad640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4bc141ae0 0x7ff4bc141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.268+0000 7ff4c20ad640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc1434b0 con 0x7ff4a80051f0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.268+0000 7ff4c20ad640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc070c60 con 0x7ff4bc0702a0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.268+0000 7ff4c20ad640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc142830 con 0x7ff4bc141ae0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4bc15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4bc15a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53964/0 (socket says 172.21.15.113:53964) 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 -- 172.21.15.113:0/2753730627 learned_addr learned my addr 172.21.15.113:0/2753730627 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4b3fff640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4bc0702a0 0x7ff4bc070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 -- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4bc141ae0 msgr2=0x7ff4bc141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bbfff640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4bc141ae0 0x7ff4bc141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4bc141ae0 0x7ff4bc141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 -- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4bc0702a0 msgr2=0x7ff4bc070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4bc0702a0 0x7ff4bc070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 -- 172.21.15.113:0/2753730627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc142b10 con 0x7ff4a80051f0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.269+0000 7ff4bb7fe640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4bc15a820 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00f4e0 tx=0x7ff4ac00f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:22.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.270+0000 7ff4b8ff9640 1 -- 172.21.15.113:0/2753730627 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac014890 con 0x7ff4a80051f0 2023-12-19T13:51:22.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.270+0000 7ff4b8ff9640 1 -- 172.21.15.113:0/2753730627 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00c030 con 0x7ff4a80051f0 2023-12-19T13:51:22.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.270+0000 7ff4b8ff9640 1 -- 172.21.15.113:0/2753730627 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac014c30 con 0x7ff4a80051f0 2023-12-19T13:51:22.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.270+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc142df0 con 0x7ff4a80051f0 2023-12-19T13:51:22.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.270+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc15ad60 con 0x7ff4a80051f0 2023-12-19T13:51:22.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.271+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc061910 con 0x7ff4a80051f0 2023-12-19T13:51:22.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.272+0000 7ff4b8ff9640 1 -- 172.21.15.113:0/2753730627 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4ac0133e0 con 0x7ff4a80051f0 2023-12-19T13:51:22.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.273+0000 7ff4b8ff9640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff49c06a430 0x7ff49c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.273+0000 7ff4b8ff9640 1 -- 172.21.15.113:0/2753730627 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ac088be0 con 0x7ff4a80051f0 2023-12-19T13:51:22.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.273+0000 7ff4b3fff640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff49c06a430 0x7ff49c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.274+0000 7ff4b3fff640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff49c06a430 0x7ff49c06c8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40018e0 tx=0x7ff4a4000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:22.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.277+0000 7ff4b8ff9640 1 -- 172.21.15.113:0/2753730627 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4ac0541d0 con 0x7ff4a80051f0 2023-12-19T13:51:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.467+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4bc070f60 con 0x7ff4a80051f0 2023-12-19T13:51:22.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.469+0000 7ff4b8ff9640 1 -- 172.21.15.113:0/2753730627 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16101 (secure 0 0 0) 0x7ff4ac022090 con 0x7ff4a80051f0 2023-12-19T13:51:22.470 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:22.470 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":93,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:21.593428+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff49c06a430 msgr2=0x7ff49c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff49c06a430 0x7ff49c06c8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40018e0 tx=0x7ff4a4000ed0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 msgr2=0x7ff4bc15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4bc15a820 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00f4e0 tx=0x7ff4ac00f9a0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 shutdown_connections 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff49c06a430 0x7ff49c06c8f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4bc141ae0 0x7ff4bc141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4bc0702a0 0x7ff4bc070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 --2- 172.21.15.113:0/2753730627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4a80051f0 0x7ff4bc15a820 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 >> 172.21.15.113:0/2753730627 conn(0x7ff4bc0cbb70 msgr2=0x7ff4bc0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 shutdown_connections 2023-12-19T13:51:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.472+0000 7ff4c20ad640 1 -- 172.21.15.113:0/2753730627 wait complete. 2023-12-19T13:51:22.491 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:51:22.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.712+0000 7f5cf2c5f640 1 Processor -- start 2023-12-19T13:51:22.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.712+0000 7f5cf2c5f640 1 -- start start 2023-12-19T13:51:22.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cf2c5f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5cec1449e0 0x7f5cec0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cf2c5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cec0b0b50 0x7f5cec06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cf2c5f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cec0afb10 con 0x7f5cec06b590 2023-12-19T13:51:22.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cf2c5f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cec06bb30 con 0x7f5cec1449e0 2023-12-19T13:51:22.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cf2c5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0b0070 con 0x7f5cec0b0b50 2023-12-19T13:51:22.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cf11fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5cec06b590 0x7f5cec15eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43454/0 (socket says 172.21.15.113:43454) 2023-12-19T13:51:22.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2828348476 learned_addr learned my addr 172.21.15.113:0/2828348476 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.714+0000 7f5cebfff640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cec0b0b50 0x7f5cec06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5cf09fb640 1 --2- 172.21.15.113:0/2828348476 >> v2:172.21.15.151:3300/0 conn(0x7f5cec1449e0 0x7f5cec0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455037961 0 0) 0x7f5cec0afb10 con 0x7f5cec06b590 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cdc003520 con 0x7f5cec06b590 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914634851 0 0) 0x7f5cdc003520 con 0x7f5cec06b590 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cec0b0b50 msgr2=0x7f5cec06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cec0b0b50 0x7f5cec06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 >> v2:172.21.15.151:3300/0 conn(0x7f5cec1449e0 msgr2=0x7f5cec0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 --2- 172.21.15.113:0/2828348476 >> v2:172.21.15.151:3300/0 conn(0x7f5cec1449e0 0x7f5cec0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec0b0350 con 0x7f5cec06b590 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5ce40019f0 con 0x7f5cec06b590 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 >> v1:172.21.15.113:6789/0 conn(0x7f5cec06b590 legacy=0x7f5cec15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cec0b0b50 0x7f5cdc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cdc003f60 0x7f5cdc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc004d00 0x7f5cdc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec06bb30 con 0x7f5cdc004d00 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0b0070 con 0x7f5cdc003f60 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc00ba60 con 0x7f5cec0b0b50 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.715+0000 7f5cf09fb640 1 --2- 172.21.15.113:0/2828348476 >> v2:172.21.15.151:3300/0 conn(0x7f5cec1449e0 0x7f5cec0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.716+0000 7f5cf11fc640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc004d00 0x7f5cdc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.716+0000 7f5cebfff640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cdc003f60 0x7f5cdc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.716+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cec0b0b50 msgr2=0x7f5cdc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.716+0000 7f5cf11fc640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cec0b0b50 0x7f5cdc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.716+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cdc003f60 msgr2=0x7f5cdc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.716+0000 7f5cf11fc640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cdc003f60 0x7f5cdc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.716+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2828348476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc003520 con 0x7f5cdc004d00 2023-12-19T13:51:22.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.717+0000 7f5cf11fc640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc004d00 0x7f5cdc005180 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400a860 tx=0x7f5cdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a411e8ae9741436d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:22.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.717+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4034630 con 0x7f5cdc004d00 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.717+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce402f070 con 0x7f5cdc004d00 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.717+0000 7f5ceb7fe640 1 -- 172.21.15.113:0/2828348476 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40349d0 con 0x7f5cdc004d00 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.718+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2828348476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc004d00 msgr2=0x7f5cdc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.718+0000 7f5cf2c5f640 1 --2- 172.21.15.113:0/2828348476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc004d00 0x7f5cdc005180 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400a860 tx=0x7f5cdc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.718+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2828348476 reap_dead start 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.718+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2828348476 shutdown_connections 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.718+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2828348476 >> 172.21.15.113:0/2828348476 conn(0x7f5cec0cbb70 msgr2=0x7f5cec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.718+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2828348476 shutdown_connections 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.718+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2828348476 wait complete. 2023-12-19T13:51:22.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.720+0000 7f5cf2c5f640 1 Processor -- start 2023-12-19T13:51:22.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.720+0000 7f5cf2c5f640 1 -- start start 2023-12-19T13:51:22.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf2c5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cdc004d00 0x7f5cec15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf2c5f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cec0cd8f0 0x7f5cec0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf2c5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cec0ad450 0x7f5cec0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf2c5f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0ce2b0 con 0x7f5cec0ad450 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf2c5f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec15b240 con 0x7f5cec0cd8f0 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf2c5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0ae1b0 con 0x7f5cdc004d00 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf11fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cec0ad450 0x7f5cec0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf11fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cec0ad450 0x7f5cec0ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53972/0 (socket says 172.21.15.113:53972) 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.721+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2622067306 learned_addr learned my addr 172.21.15.113:0/2622067306 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf09fb640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cdc004d00 0x7f5cec15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cdc004d00 msgr2=0x7f5cec15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf11fc640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cdc004d00 0x7f5cec15ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cebfff640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cec0cd8f0 0x7f5cec0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cec0cd8f0 msgr2=0x7f5cec0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf11fc640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cec0cd8f0 0x7f5cec0cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf11fc640 1 -- 172.21.15.113:0/2622067306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec140760 con 0x7f5cec0ad450 2023-12-19T13:51:22.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf11fc640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cec0ad450 0x7f5cec0ad900 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400a860 tx=0x7f5cec0b1270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:22.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5ce97fa640 1 -- 172.21.15.113:0/2622067306 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40019c0 con 0x7f5cec0ad450 2023-12-19T13:51:22.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5ce97fa640 1 -- 172.21.15.113:0/2622067306 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce4034640 con 0x7f5cec0ad450 2023-12-19T13:51:22.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5ce97fa640 1 -- 172.21.15.113:0/2622067306 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40349b0 con 0x7f5cec0ad450 2023-12-19T13:51:22.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cec140a40 con 0x7f5cec0ad450 2023-12-19T13:51:22.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.722+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec141000 con 0x7f5cec0ad450 2023-12-19T13:51:22.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.723+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cec061910 con 0x7f5cec0ad450 2023-12-19T13:51:22.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.724+0000 7f5ce97fa640 1 -- 172.21.15.113:0/2622067306 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ce4031030 con 0x7f5cec0ad450 2023-12-19T13:51:22.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.725+0000 7f5ce97fa640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd006a460 0x7f5cd006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:22.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.725+0000 7f5ce97fa640 1 -- 172.21.15.113:0/2622067306 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ce40aab20 con 0x7f5cec0ad450 2023-12-19T13:51:22.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.726+0000 7f5cf09fb640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd006a460 0x7f5cd006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:22.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.726+0000 7f5cf09fb640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd006a460 0x7f5cd006c920 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0caf90 tx=0x7f5ce0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:22.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.729+0000 7f5ce97fa640 1 -- 172.21.15.113:0/2622067306 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5ce4076070 con 0x7f5cec0ad450 2023-12-19T13:51:22.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:22.958+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5cec061910 con 0x7f5cec0ad450 2023-12-19T13:51:23.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.613+0000 7f5ce97fa640 1 -- 172.21.15.113:0/2622067306 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5ce4079690 con 0x7f5cec0ad450 2023-12-19T13:51:23.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.616+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd006a460 msgr2=0x7f5cd006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:23.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.616+0000 7f5cf2c5f640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd006a460 0x7f5cd006c920 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0caf90 tx=0x7f5ce0008040 comp rx=0 tx=0).stop 2023-12-19T13:51:23.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.616+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cec0ad450 msgr2=0x7f5cec0ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:23.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.616+0000 7f5cf2c5f640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cec0ad450 0x7f5cec0ad900 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400a860 tx=0x7f5cec0b1270 comp rx=0 tx=0).stop 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 shutdown_connections 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd006a460 0x7f5cd006c920 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cec0ad450 0x7f5cec0ad900 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cec0cd8f0 0x7f5cec0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 --2- 172.21.15.113:0/2622067306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cdc004d00 0x7f5cec15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 >> 172.21.15.113:0/2622067306 conn(0x7f5cec0cbb70 msgr2=0x7f5cec143900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 shutdown_connections 2023-12-19T13:51:23.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.617+0000 7f5cf2c5f640 1 -- 172.21.15.113:0/2622067306 wait complete. 2023-12-19T13:51:23.639 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:51:23.639 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:51:23.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.853+0000 7fefae45e640 1 Processor -- start 2023-12-19T13:51:23.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.853+0000 7fefae45e640 1 -- start start 2023-12-19T13:51:23.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.854+0000 7fefae45e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefa8146c40 0x7fefa8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:23.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.854+0000 7fefae45e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa8161d00 con 0x7fefa80b7360 2023-12-19T13:51:23.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.854+0000 7fefae45e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa806f160 con 0x7fefa80d08f0 2023-12-19T13:51:23.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.854+0000 7fefae45e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80700c0 con 0x7fefa8146c40 2023-12-19T13:51:23.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.855+0000 7fefacc5b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fefa80b7360 0x7fefa8160ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43460/0 (socket says 172.21.15.113:43460) 2023-12-19T13:51:23.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.855+0000 7fefad45c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefa8146c40 0x7fefa8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:23.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.855+0000 7fefacc5b640 1 -- 172.21.15.113:0/1733544891 learned_addr learned my addr 172.21.15.113:0/1733544891 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:23.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.855+0000 7fefad45c640 1 -- 172.21.15.113:0/1733544891 >> v1:172.21.15.151:6789/0 conn(0x7fefa80d08f0 legacy=0x7fefa81615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:23.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.855+0000 7fefad45c640 1 -- 172.21.15.113:0/1733544891 >> v1:172.21.15.113:6789/0 conn(0x7fefa80b7360 legacy=0x7fefa8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:23.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.855+0000 7fefa7fff640 1 -- 172.21.15.113:0/1733544891 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234425674 0 0) 0x7fefa8161d00 con 0x7fefa80b7360 2023-12-19T13:51:23.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.855+0000 7fefad45c640 1 -- 172.21.15.113:0/1733544891 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa806f440 con 0x7fefa8146c40 2023-12-19T13:51:23.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.856+0000 7fefad45c640 1 --2- 172.21.15.113:0/1733544891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa8146c40 0x7fefa8070e70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009d90 tx=0x7fef9c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73ee43b86fc2b09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:23.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefa7fff640 1 -- 172.21.15.113:0/1733544891 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c02cc60 con 0x7fefa8146c40 2023-12-19T13:51:23.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefa7fff640 1 -- 172.21.15.113:0/1733544891 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c02cdc0 con 0x7fefa8146c40 2023-12-19T13:51:23.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefa7fff640 1 -- 172.21.15.113:0/1733544891 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c034660 con 0x7fefa8146c40 2023-12-19T13:51:23.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefae45e640 1 -- 172.21.15.113:0/1733544891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa8146c40 msgr2=0x7fefa8070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:23.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefae45e640 1 --2- 172.21.15.113:0/1733544891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa8146c40 0x7fefa8070e70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009d90 tx=0x7fef9c02beb0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefae45e640 1 -- 172.21.15.113:0/1733544891 shutdown_connections 2023-12-19T13:51:23.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefae45e640 1 --2- 172.21.15.113:0/1733544891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa8146c40 0x7fefa8070e70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefae45e640 1 -- 172.21.15.113:0/1733544891 >> 172.21.15.113:0/1733544891 conn(0x7fefa80d31b0 msgr2=0x7fefa80d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:23.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefae45e640 1 -- 172.21.15.113:0/1733544891 shutdown_connections 2023-12-19T13:51:23.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.857+0000 7fefae45e640 1 -- 172.21.15.113:0/1733544891 wait complete. 2023-12-19T13:51:23.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.859+0000 7fefae45e640 1 Processor -- start 2023-12-19T13:51:23.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.859+0000 7fefae45e640 1 -- start start 2023-12-19T13:51:23.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefae45e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefa80b7360 0x7fefa813b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:23.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefae45e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa80d08f0 0x7fefa813a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:23.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefae45e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefa8146c40 0x7fefa813cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:23.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefae45e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80b6b30 con 0x7fefa80d08f0 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefae45e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8141910 con 0x7fefa8146c40 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefae45e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa813b970 con 0x7fefa80b7360 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefacc5b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa80d08f0 0x7fefa813a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefacc5b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa80d08f0 0x7fefa813a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54004/0 (socket says 172.21.15.113:54004) 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.860+0000 7fefacc5b640 1 -- 172.21.15.113:0/2845704129 learned_addr learned my addr 172.21.15.113:0/2845704129 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefad45c640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefa80b7360 0x7fefa813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefacc5b640 1 -- 172.21.15.113:0/2845704129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefa80b7360 msgr2=0x7fefa813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefacc5b640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefa80b7360 0x7fefa813b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefacc5b640 1 -- 172.21.15.113:0/2845704129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefa8146c40 msgr2=0x7fefa813cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefacc5b640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefa8146c40 0x7fefa813cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefacc5b640 1 -- 172.21.15.113:0/2845704129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c009a70 con 0x7fefa80d08f0 2023-12-19T13:51:23.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefacc5b640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa80d08f0 0x7fefa813a6e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c500 tx=0x7fef9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:23.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefa5ffb640 1 -- 172.21.15.113:0/2845704129 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94007560 con 0x7fefa80d08f0 2023-12-19T13:51:23.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefa5ffb640 1 -- 172.21.15.113:0/2845704129 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef940047e0 con 0x7fefa80d08f0 2023-12-19T13:51:23.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa814f790 con 0x7fefa80d08f0 2023-12-19T13:51:23.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.861+0000 7fefa5ffb640 1 -- 172.21.15.113:0/2845704129 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94004b90 con 0x7fefa80d08f0 2023-12-19T13:51:23.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.862+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa814fd50 con 0x7fefa80d08f0 2023-12-19T13:51:23.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.863+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa814ff70 con 0x7fefa80d08f0 2023-12-19T13:51:23.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.864+0000 7fefa5ffb640 1 -- 172.21.15.113:0/2845704129 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef94004cf0 con 0x7fefa80d08f0 2023-12-19T13:51:23.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.865+0000 7fefa5ffb640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef8c06a430 0x7fef8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:23.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.865+0000 7fefa5ffb640 1 -- 172.21.15.113:0/2845704129 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef940879f0 con 0x7fefa80d08f0 2023-12-19T13:51:23.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.865+0000 7fefad45c640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef8c06a430 0x7fef8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:23.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.866+0000 7fefad45c640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef8c06a430 0x7fef8c06c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef9c036000 tx=0x7fef9c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:23.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:23.870+0000 7fefa5ffb640 1 -- 172.21.15.113:0/2845704129 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef94053070 con 0x7fefa80d08f0 2023-12-19T13:51:24.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.084+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fefa8061910 con 0x7fefa80d08f0 2023-12-19T13:51:24.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.617+0000 7fefa5ffb640 1 -- 172.21.15.113:0/2845704129 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef94056690 con 0x7fefa80d08f0 2023-12-19T13:51:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.620+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef8c06a430 msgr2=0x7fef8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.620+0000 7fefae45e640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef8c06a430 0x7fef8c06c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef9c036000 tx=0x7fef9c030000 comp rx=0 tx=0).stop 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.620+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa80d08f0 msgr2=0x7fefa813a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.620+0000 7fefae45e640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa80d08f0 0x7fefa813a6e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c500 tx=0x7fef9400c9c0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 shutdown_connections 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef8c06a430 0x7fef8c06c8f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefa8146c40 0x7fefa813cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefa80d08f0 0x7fefa813a6e0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 --2- 172.21.15.113:0/2845704129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefa80b7360 0x7fefa813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 >> 172.21.15.113:0/2845704129 conn(0x7fefa80d31b0 msgr2=0x7fefa80d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 shutdown_connections 2023-12-19T13:51:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.621+0000 7fefae45e640 1 -- 172.21.15.113:0/2845704129 wait complete. 2023-12-19T13:51:24.643 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:51:24.643 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:24.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.856+0000 7ff86cf73640 1 Processor -- start 2023-12-19T13:51:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.856+0000 7ff86cf73640 1 -- start start 2023-12-19T13:51:24.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86cf73640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff868146e10 0x7ff8680d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:24.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86cf73640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8680ce110 0x7ff8680ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:24.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86cf73640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8680cd840 con 0x7ff8680d2b00 2023-12-19T13:51:24.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86cf73640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680d2430 con 0x7ff868146e10 2023-12-19T13:51:24.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86cf73640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680ceac0 con 0x7ff8680ce110 2023-12-19T13:51:24.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff868146e10 0x7ff8680d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:24.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff868146e10 0x7ff8680d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54020/0 (socket says 172.21.15.113:54020) 2023-12-19T13:51:24.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.858+0000 7ff86659c640 1 -- 172.21.15.113:0/648989877 learned_addr learned my addr 172.21.15.113:0/648989877 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:24.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.859+0000 7ff866d9d640 1 --2- 172.21.15.113:0/648989877 >> v2:172.21.15.151:3300/0 conn(0x7ff8680ce110 0x7ff8680ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.859+0000 7ff86659c640 1 -- 172.21.15.113:0/648989877 >> v2:172.21.15.151:3300/0 conn(0x7ff8680ce110 msgr2=0x7ff8680ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.859+0000 7ff86659c640 1 --2- 172.21.15.113:0/648989877 >> v2:172.21.15.151:3300/0 conn(0x7ff8680ce110 0x7ff8680ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.859+0000 7ff86659c640 1 -- 172.21.15.113:0/648989877 >> v1:172.21.15.151:6789/0 conn(0x7ff8680d2b00 legacy=0x7ff8680b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.859+0000 7ff86659c640 1 -- 172.21.15.113:0/648989877 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680b6e90 con 0x7ff868146e10 2023-12-19T13:51:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.859+0000 7ff866d9d640 1 --2- 172.21.15.113:0/648989877 >> v2:172.21.15.151:3300/0 conn(0x7ff8680ce110 0x7ff8680ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.860+0000 7ff86659c640 1 --2- 172.21.15.113:0/648989877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8680d1ef0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff8680cedb0 tx=0x7ff85802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd092b76d61c59c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.860+0000 7ff86559a640 1 -- 172.21.15.113:0/648989877 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580317d0 con 0x7ff868146e10 2023-12-19T13:51:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.860+0000 7ff86559a640 1 -- 172.21.15.113:0/648989877 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858031930 con 0x7ff868146e10 2023-12-19T13:51:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.860+0000 7ff86559a640 1 -- 172.21.15.113:0/648989877 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858031cc0 con 0x7ff868146e10 2023-12-19T13:51:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.860+0000 7ff86cf73640 1 -- 172.21.15.113:0/648989877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 msgr2=0x7ff8680d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.860+0000 7ff86cf73640 1 --2- 172.21.15.113:0/648989877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8680d1ef0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff8680cedb0 tx=0x7ff85802b870 comp rx=0 tx=0).stop 2023-12-19T13:51:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.861+0000 7ff86cf73640 1 -- 172.21.15.113:0/648989877 shutdown_connections 2023-12-19T13:51:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.861+0000 7ff86cf73640 1 --2- 172.21.15.113:0/648989877 >> v2:172.21.15.151:3300/0 conn(0x7ff8680ce110 0x7ff8680ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.861+0000 7ff86cf73640 1 --2- 172.21.15.113:0/648989877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8680d1ef0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.861+0000 7ff86cf73640 1 -- 172.21.15.113:0/648989877 >> 172.21.15.113:0/648989877 conn(0x7ff8680b29c0 msgr2=0x7ff8680b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.861+0000 7ff86cf73640 1 -- 172.21.15.113:0/648989877 shutdown_connections 2023-12-19T13:51:24.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.861+0000 7ff86cf73640 1 -- 172.21.15.113:0/648989877 wait complete. 2023-12-19T13:51:24.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.862+0000 7ff86cf73640 1 Processor -- start 2023-12-19T13:51:24.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.862+0000 7ff86cf73640 1 -- start start 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.863+0000 7ff86cf73640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680ce110 0x7ff8680c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.863+0000 7ff86cf73640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680d2b00 0x7ff868145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.863+0000 7ff86cf73640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8681f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.863+0000 7ff86cf73640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681454a0 con 0x7ff868146e10 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.863+0000 7ff86cf73640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868145100 con 0x7ff8680ce110 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.863+0000 7ff86cf73640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680cc870 con 0x7ff8680d2b00 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8681f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8681f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54028/0 (socket says 172.21.15.113:54028) 2023-12-19T13:51:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 -- 172.21.15.113:0/620688908 learned_addr learned my addr 172.21.15.113:0/620688908 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff86659c640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680ce110 0x7ff8680c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 -- 172.21.15.113:0/620688908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680d2b00 msgr2=0x7ff868145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680d2b00 0x7ff868145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 -- 172.21.15.113:0/620688908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680ce110 msgr2=0x7ff8680c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680ce110 0x7ff8680c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.864+0000 7ff866d9d640 1 -- 172.21.15.113:0/620688908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580094d0 con 0x7ff868146e10 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.865+0000 7ff866d9d640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8681f5de0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff86000cd50 tx=0x7ff86000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.865+0000 7ff856ffd640 1 -- 172.21.15.113:0/620688908 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000f680 con 0x7ff868146e10 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.865+0000 7ff856ffd640 1 -- 172.21.15.113:0/620688908 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86000f800 con 0x7ff868146e10 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.865+0000 7ff856ffd640 1 -- 172.21.15.113:0/620688908 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000fbb0 con 0x7ff868146e10 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.865+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8680ccb50 con 0x7ff868146e10 2023-12-19T13:51:24.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.865+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8680ca020 con 0x7ff868146e10 2023-12-19T13:51:24.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.866+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8681455e0 con 0x7ff868146e10 2023-12-19T13:51:24.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.867+0000 7ff856ffd640 1 -- 172.21.15.113:0/620688908 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff86000b040 con 0x7ff868146e10 2023-12-19T13:51:24.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.868+0000 7ff856ffd640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff84806a430 0x7ff84806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:24.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.868+0000 7ff856ffd640 1 -- 172.21.15.113:0/620688908 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8600892c0 con 0x7ff868146e10 2023-12-19T13:51:24.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.868+0000 7ff86659c640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff84806a430 0x7ff84806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:24.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.869+0000 7ff86659c640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff84806a430 0x7ff84806c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff858036000 tx=0x7ff85803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:24.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:24.872+0000 7ff856ffd640 1 -- 172.21.15.113:0/620688908 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff8681455e0 con 0x7ff868146e10 2023-12-19T13:51:25.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.100+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8681455e0 con 0x7ff868146e10 2023-12-19T13:51:25.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.101+0000 7ff856ffd640 1 -- 172.21.15.113:0/620688908 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4662 (secure 0 0 0) 0x7ff8681455e0 con 0x7ff868146e10 2023-12-19T13:51:25.102 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:25.102 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:51:21.594253+0000","modified":"2023-12-19T13:51:24.611657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2704300841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2704300841},{"type":"v1","addr":"172.21.15.151:6835","nonce":2704300841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T13:51:25.102 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 41 2023-12-19T13:51:25.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.103+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff84806a430 msgr2=0x7ff84806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.103+0000 7ff86cf73640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff84806a430 0x7ff84806c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff858036000 tx=0x7ff85803d040 comp rx=0 tx=0).stop 2023-12-19T13:51:25.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.103+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 msgr2=0x7ff8681f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.103+0000 7ff86cf73640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8681f5de0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff86000cd50 tx=0x7ff86000a650 comp rx=0 tx=0).stop 2023-12-19T13:51:25.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 shutdown_connections 2023-12-19T13:51:25.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff84806a430 0x7ff84806c8f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff868146e10 0x7ff8681f5de0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680d2b00 0x7ff868145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 --2- 172.21.15.113:0/620688908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680ce110 0x7ff8680c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 >> 172.21.15.113:0/620688908 conn(0x7ff8680b29c0 msgr2=0x7ff8680b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 shutdown_connections 2023-12-19T13:51:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.104+0000 7ff86cf73640 1 -- 172.21.15.113:0/620688908 wait complete. 2023-12-19T13:51:25.123 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:51:25.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.332+0000 7f5a93fff640 1 Processor -- start 2023-12-19T13:51:25.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.332+0000 7f5a93fff640 1 -- start start 2023-12-19T13:51:25.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.334+0000 7f5a93fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a94159f80 0x7f5a9406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.334+0000 7f5a93fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a9415b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.334+0000 7f5a93fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9406b520 con 0x7f5a9415b1e0 2023-12-19T13:51:25.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.334+0000 7f5a93fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a940b2b20 con 0x7f5a94159f80 2023-12-19T13:51:25.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.334+0000 7f5a93fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940b2fb0 con 0x7f5a9415aa70 2023-12-19T13:51:25.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.334+0000 7f5a92ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a94159f80 0x7f5a9406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.335+0000 7f5a937fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a9415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.335+0000 7f5a92ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a94159f80 0x7f5a9406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:35240/0 (socket says 172.21.15.113:35240) 2023-12-19T13:51:25.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.335+0000 7f5a92ffd640 1 -- 172.21.15.113:0/482889196 learned_addr learned my addr 172.21.15.113:0/482889196 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:25.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.335+0000 7f5a92ffd640 1 -- 172.21.15.113:0/482889196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 msgr2=0x7f5a9415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:25.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.335+0000 7f5a92ffd640 1 --2- 172.21.15.113:0/482889196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a9415b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.335+0000 7f5a92ffd640 1 -- 172.21.15.113:0/482889196 >> v1:172.21.15.151:6789/0 conn(0x7f5a9415b1e0 legacy=0x7f5a9415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.335+0000 7f5a92ffd640 1 -- 172.21.15.113:0/482889196 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a940b1f10 con 0x7f5a94159f80 2023-12-19T13:51:25.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.337+0000 7f5a92ffd640 1 --2- 172.21.15.113:0/482889196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 0x7f5a9406f160 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009870 tx=0x7f5a8402ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2672b12a4dd05ee0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:25.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a927fc640 1 -- 172.21.15.113:0/482889196 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8402f830 con 0x7f5a94159f80 2023-12-19T13:51:25.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a927fc640 1 -- 172.21.15.113:0/482889196 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8402f990 con 0x7f5a94159f80 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a927fc640 1 -- 172.21.15.113:0/482889196 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8402fd20 con 0x7f5a94159f80 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a93fff640 1 -- 172.21.15.113:0/482889196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 msgr2=0x7f5a9406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a93fff640 1 --2- 172.21.15.113:0/482889196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 0x7f5a9406f160 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009870 tx=0x7f5a8402ba10 comp rx=0 tx=0).stop 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a93fff640 1 -- 172.21.15.113:0/482889196 shutdown_connections 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a93fff640 1 --2- 172.21.15.113:0/482889196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a9415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a93fff640 1 --2- 172.21.15.113:0/482889196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 0x7f5a9406f160 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.338+0000 7f5a93fff640 1 -- 172.21.15.113:0/482889196 >> 172.21.15.113:0/482889196 conn(0x7f5a940b0100 msgr2=0x7f5a940b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.339+0000 7f5a93fff640 1 -- 172.21.15.113:0/482889196 shutdown_connections 2023-12-19T13:51:25.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.339+0000 7f5a93fff640 1 -- 172.21.15.113:0/482889196 wait complete. 2023-12-19T13:51:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.340+0000 7f5a93fff640 1 Processor -- start 2023-12-19T13:51:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.340+0000 7f5a93fff640 1 -- start start 2023-12-19T13:51:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.341+0000 7f5a93fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 0x7f5a941f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.341+0000 7f5a93fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a94156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.341+0000 7f5a93fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a9415b1e0 0x7f5a941573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.341+0000 7f5a93fff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a941f6660 con 0x7f5a9415b1e0 2023-12-19T13:51:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.341+0000 7f5a93fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94157900 con 0x7f5a94159f80 2023-12-19T13:51:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.341+0000 7f5a93fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9406c490 con 0x7f5a9415aa70 2023-12-19T13:51:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a9415b1e0 0x7f5a941573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a9415b1e0 0x7f5a941573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54036/0 (socket says 172.21.15.113:54036) 2023-12-19T13:51:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 -- 172.21.15.113:0/1562579220 learned_addr learned my addr 172.21.15.113:0/1562579220 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a92ffd640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 0x7f5a941f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a8a7fc640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a94156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 -- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 msgr2=0x7f5a94156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a94156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 -- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 msgr2=0x7f5a941f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 0x7f5a941f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.342+0000 7f5a937fe640 1 -- 172.21.15.113:0/1562579220 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840094d0 con 0x7f5a9415b1e0 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.343+0000 7f5a937fe640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a9415b1e0 0x7f5a941573c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00efc0 tx=0x7f5a8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.343+0000 7f5a90ff9640 1 -- 172.21.15.113:0/1562579220 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c014480 con 0x7f5a9415b1e0 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.343+0000 7f5a90ff9640 1 -- 172.21.15.113:0/1562579220 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c00f040 con 0x7f5a9415b1e0 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.343+0000 7f5a90ff9640 1 -- 172.21.15.113:0/1562579220 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c014820 con 0x7f5a9415b1e0 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.343+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9406c770 con 0x7f5a9415b1e0 2023-12-19T13:51:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.343+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9406cd30 con 0x7f5a9415b1e0 2023-12-19T13:51:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.344+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a94061910 con 0x7f5a9415b1e0 2023-12-19T13:51:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.345+0000 7f5a90ff9640 1 -- 172.21.15.113:0/1562579220 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a8c014980 con 0x7f5a9415b1e0 2023-12-19T13:51:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.346+0000 7f5a90ff9640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a7806a430 0x7f5a7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.346+0000 7f5a90ff9640 1 -- 172.21.15.113:0/1562579220 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a8c089420 con 0x7f5a9415b1e0 2023-12-19T13:51:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.346+0000 7f5a92ffd640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a7806a430 0x7f5a7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.347+0000 7f5a92ffd640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a7806a430 0x7f5a7806c8f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a84036000 tx=0x7f5a84008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.350+0000 7f5a90ff9640 1 -- 172.21.15.113:0/1562579220 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a8c054aa0 con 0x7f5a9415b1e0 2023-12-19T13:51:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.541+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a941f4470 con 0x7f5a9415b1e0 2023-12-19T13:51:25.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.544+0000 7f5a90ff9640 1 -- 172.21.15.113:0/1562579220 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f5a8c0580c0 con 0x7f5a9415b1e0 2023-12-19T13:51:25.545 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:25.545 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":94,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:22.599062+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:51:25.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a7806a430 msgr2=0x7f5a7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a7806a430 0x7f5a7806c8f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a84036000 tx=0x7f5a84008030 comp rx=0 tx=0).stop 2023-12-19T13:51:25.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a9415b1e0 msgr2=0x7f5a941573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a9415b1e0 0x7f5a941573c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00efc0 tx=0x7f5a8c00c490 comp rx=0 tx=0).stop 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 shutdown_connections 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a7806a430 0x7f5a7806c8f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a9415b1e0 0x7f5a941573c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a9415aa70 0x7f5a94156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 --2- 172.21.15.113:0/1562579220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a94159f80 0x7f5a941f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.547+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 >> 172.21.15.113:0/1562579220 conn(0x7f5a940b0100 msgr2=0x7f5a940b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.548+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 shutdown_connections 2023-12-19T13:51:25.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.548+0000 7f5a93fff640 1 -- 172.21.15.113:0/1562579220 wait complete. 2023-12-19T13:51:25.567 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:51:25.567 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:51:25.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.775+0000 7f40f3157640 1 Processor -- start 2023-12-19T13:51:25.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.776+0000 7f40f3157640 1 -- start start 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.777+0000 7f40f3157640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40ec15e5a0 0x7f40ec0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.777+0000 7f40f3157640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec15f680 0x7f40ec0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.777+0000 7f40f3157640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f40ec0cdbf0 0x7f40ec0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.777+0000 7f40f3157640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec0ce5c0 con 0x7f40ec0cdbf0 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.777+0000 7f40f3157640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec15ec30 con 0x7f40ec15e5a0 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.777+0000 7f40f3157640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0b2cc0 con 0x7f40ec15f680 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f40ec0cdbf0 0x7f40ec0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f40ec0cdbf0 0x7f40ec0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54040/0 (socket says 172.21.15.113:54040) 2023-12-19T13:51:25.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 -- 172.21.15.113:0/2923409964 learned_addr learned my addr 172.21.15.113:0/2923409964 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:25.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f1954640 1 --2- 172.21.15.113:0/2923409964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec15f680 0x7f40ec0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2155640 1 --2- 172.21.15.113:0/2923409964 >> v2:172.21.15.151:3300/0 conn(0x7f40ec15e5a0 0x7f40ec0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 -- 172.21.15.113:0/2923409964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec15f680 msgr2=0x7f40ec0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:25.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 --2- 172.21.15.113:0/2923409964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec15f680 0x7f40ec0b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 -- 172.21.15.113:0/2923409964 >> v2:172.21.15.151:3300/0 conn(0x7f40ec15e5a0 msgr2=0x7f40ec0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:25.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 --2- 172.21.15.113:0/2923409964 >> v2:172.21.15.151:3300/0 conn(0x7f40ec15e5a0 0x7f40ec0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2956640 1 -- 172.21.15.113:0/2923409964 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec15e980 con 0x7f40ec0cdbf0 2023-12-19T13:51:25.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.778+0000 7f40f2155640 1 --2- 172.21.15.113:0/2923409964 >> v2:172.21.15.151:3300/0 conn(0x7f40ec15e5a0 0x7f40ec0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:25.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.779+0000 7f40f2956640 1 --2- 172.21.15.113:0/2923409964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec0cdbf0 0x7f40ec0ce080 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0b5200 tx=0x7f40e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693141629cb58c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:25.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f1153640 1 -- 172.21.15.113:0/2923409964 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e402ca70 con 0x7f40ec0cdbf0 2023-12-19T13:51:25.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f1153640 1 -- 172.21.15.113:0/2923409964 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e402cbd0 con 0x7f40ec0cdbf0 2023-12-19T13:51:25.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f1153640 1 -- 172.21.15.113:0/2923409964 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40343f0 con 0x7f40ec0cdbf0 2023-12-19T13:51:25.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f3157640 1 -- 172.21.15.113:0/2923409964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec0cdbf0 msgr2=0x7f40ec0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f3157640 1 --2- 172.21.15.113:0/2923409964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec0cdbf0 0x7f40ec0ce080 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0b5200 tx=0x7f40e402bed0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f3157640 1 -- 172.21.15.113:0/2923409964 shutdown_connections 2023-12-19T13:51:25.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f3157640 1 --2- 172.21.15.113:0/2923409964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec0cdbf0 0x7f40ec0ce080 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f3157640 1 --2- 172.21.15.113:0/2923409964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec15f680 0x7f40ec0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f3157640 1 --2- 172.21.15.113:0/2923409964 >> v2:172.21.15.151:3300/0 conn(0x7f40ec15e5a0 0x7f40ec0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.780+0000 7f40f3157640 1 -- 172.21.15.113:0/2923409964 >> 172.21.15.113:0/2923409964 conn(0x7f40ec0b0100 msgr2=0x7f40ec0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:25.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.781+0000 7f40f3157640 1 -- 172.21.15.113:0/2923409964 shutdown_connections 2023-12-19T13:51:25.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.781+0000 7f40f3157640 1 -- 172.21.15.113:0/2923409964 wait complete. 2023-12-19T13:51:25.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.782+0000 7f40f3157640 1 Processor -- start 2023-12-19T13:51:25.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.783+0000 7f40f3157640 1 -- start start 2023-12-19T13:51:25.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.783+0000 7f40f3157640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec0cdbf0 0x7f40ec14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.783+0000 7f40f3157640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec15e5a0 0x7f40ec0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.783+0000 7f40f3157640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ec15f680 0x7f40ec0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.783+0000 7f40f3157640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec150b90 con 0x7f40ec15e5a0 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f3157640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0cb9e0 con 0x7f40ec15f680 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f3157640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0cbcc0 con 0x7f40ec0cdbf0 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec15e5a0 0x7f40ec0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec15e5a0 0x7f40ec0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54056/0 (socket says 172.21.15.113:54056) 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 -- 172.21.15.113:0/3184824480 learned_addr learned my addr 172.21.15.113:0/3184824480 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f2155640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec0cdbf0 0x7f40ec14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f2956640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ec15f680 0x7f40ec0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 -- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec0cdbf0 msgr2=0x7f40ec14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec0cdbf0 0x7f40ec14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 -- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ec15f680 msgr2=0x7f40ec0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ec15f680 0x7f40ec0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f1954640 1 -- 172.21.15.113:0/3184824480 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4009b30 con 0x7f40ec15e5a0 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f2155640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec0cdbf0 0x7f40ec14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.784+0000 7f40f2956640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ec15f680 0x7f40ec0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.785+0000 7f40f1954640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec15e5a0 0x7f40ec0ccba0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00c7f0 tx=0x7f40dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.785+0000 7f40e2ffd640 1 -- 172.21.15.113:0/3184824480 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc004220 con 0x7f40ec15e5a0 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.785+0000 7f40e2ffd640 1 -- 172.21.15.113:0/3184824480 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc004380 con 0x7f40ec15e5a0 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.785+0000 7f40e2ffd640 1 -- 172.21.15.113:0/3184824480 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc007840 con 0x7f40ec15e5a0 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.785+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec0cbfa0 con 0x7f40ec15e5a0 2023-12-19T13:51:25.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.785+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec0cc560 con 0x7f40ec15e5a0 2023-12-19T13:51:25.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.786+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec061910 con 0x7f40ec15e5a0 2023-12-19T13:51:25.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.787+0000 7f40e2ffd640 1 -- 172.21.15.113:0/3184824480 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f40dc007bb0 con 0x7f40ec15e5a0 2023-12-19T13:51:25.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.788+0000 7f40e2ffd640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40d006a460 0x7f40d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:25.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.788+0000 7f40e2ffd640 1 -- 172.21.15.113:0/3184824480 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40dc088780 con 0x7f40ec15e5a0 2023-12-19T13:51:25.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.788+0000 7f40f2155640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40d006a460 0x7f40d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:25.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.789+0000 7f40f2155640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40d006a460 0x7f40d006c920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0ccb30 tx=0x7f40e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:25.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.792+0000 7f40e2ffd640 1 -- 172.21.15.113:0/3184824480 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f40dc053d70 con 0x7f40ec15e5a0 2023-12-19T13:51:25.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.977+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40ec0b3270 con 0x7f40d006a460 2023-12-19T13:51:25.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.987+0000 7f40e2ffd640 1 -- 172.21.15.113:0/3184824480 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273460 (secure 0 0 0) 0x7f40e800c040 con 0x7f40d006a460 2023-12-19T13:51:25.991 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:25.992 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:51:25.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40d006a460 msgr2=0x7f40d006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40d006a460 0x7f40d006c920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0ccb30 tx=0x7f40e8008040 comp rx=0 tx=0).stop 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec15e5a0 msgr2=0x7f40ec0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec15e5a0 0x7f40ec0ccba0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00c7f0 tx=0x7f40dc00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 shutdown_connections 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f40d006a460 0x7f40d006c920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ec15f680 0x7f40ec0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40ec15e5a0 0x7f40ec0ccba0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 --2- 172.21.15.113:0/3184824480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40ec0cdbf0 0x7f40ec14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 >> 172.21.15.113:0/3184824480 conn(0x7f40ec0b0100 msgr2=0x7f40ec159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 shutdown_connections 2023-12-19T13:51:25.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:25.992+0000 7f40f3157640 1 -- 172.21.15.113:0/3184824480 wait complete. 2023-12-19T13:51:26.010 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2023-12-19T13:51:24.506705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557568,"statfs":{"total":1600000000,"available":1594949878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.414436"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100879+0000","last_change":"2023-12-19T13:51:20.100879+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100879+0000","last_undegraded":"2023-12-19T13:51:20.100879+0000","last_fullsized":"2023-12-19T13:51:20.100879+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100798+0000","last_change":"2023-12-19T13:51:20.100798+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100798+0000","last_undegraded":"2023-12-19T13:51:20.100798+0000","last_fullsized":"2023-12-19T13:51:20.100798+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:10.691217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099800+0000","last_change":"2023-12-19T13:51:20.099800+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099800+0000","last_undegraded":"2023-12-19T13:51:20.099800+0000","last_fullsized":"2023-12-19T13:51:20.099800+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:49.970103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102267+0000","last_change":"2023-12-19T13:51:20.102267+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102267+0000","last_undegraded":"2023-12-19T13:51:20.102267+0000","last_fullsized":"2023-12-19T13:51:20.102267+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099567+0000","last_change":"2023-12-19T13:51:20.099567+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099567+0000","last_undegraded":"2023-12-19T13:51:20.099567+0000","last_fullsized":"2023-12-19T13:51:20.099567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099332+0000","last_change":"2023-12-19T13:51:20.099332+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099332+0000","last_undegraded":"2023-12-19T13:51:20.099332+0000","last_fullsized":"2023-12-19T13:51:20.099332+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:44:02.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.103881+0000","last_change":"2023-12-19T13:51:20.103881+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.103881+0000","last_undegraded":"2023-12-19T13:51:20.103881+0000","last_fullsized":"2023-12-19T13:51:20.103881+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100714+0000","last_change":"2023-12-19T13:51:20.100714+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100714+0000","last_undegraded":"2023-12-19T13:51:20.100714+0000","last_fullsized":"2023-12-19T13:51:20.100714+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099130+0000","last_change":"2023-12-19T13:51:20.099130+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099130+0000","last_undegraded":"2023-12-19T13:51:20.099130+0000","last_fullsized":"2023-12-19T13:51:20.099130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:04.947835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096531+0000","last_change":"2023-12-19T13:51:20.096531+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096531+0000","last_undegraded":"2023-12-19T13:51:20.096531+0000","last_fullsized":"2023-12-19T13:51:20.096531+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:57.935372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099533+0000","last_change":"2023-12-19T13:51:20.099533+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099533+0000","last_undegraded":"2023-12-19T13:51:20.099533+0000","last_fullsized":"2023-12-19T13:51:20.099533+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102847+0000","last_change":"2023-12-19T13:51:20.102847+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102847+0000","last_undegraded":"2023-12-19T13:51:20.102847+0000","last_fullsized":"2023-12-19T13:51:20.102847+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102822+0000","last_change":"2023-12-19T13:51:20.102822+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102822+0000","last_undegraded":"2023-12-19T13:51:20.102822+0000","last_fullsized":"2023-12-19T13:51:20.102822+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097595+0000","last_change":"2023-12-19T13:51:20.097595+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097595+0000","last_undegraded":"2023-12-19T13:51:20.097595+0000","last_fullsized":"2023-12-19T13:51:20.097595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.505599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.098696+0000","last_change":"2023-12-19T13:51:20.098696+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.098696+0000","last_undegraded":"2023-12-19T13:51:20.098696+0000","last_fullsized":"2023-12-19T13:51:20.098696+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:21.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097738+0000","last_change":"2023-12-19T13:51:20.097738+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097738+0000","last_undegraded":"2023-12-19T13:51:20.097738+0000","last_fullsized":"2023-12-19T13:51:20.097738+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:18.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100410+0000","last_change":"2023-12-19T13:51:20.100410+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100410+0000","last_undegraded":"2023-12-19T13:51:20.100410+0000","last_fullsized":"2023-12-19T13:51:20.100410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:58.943405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097466+0000","last_change":"2023-12-19T13:51:20.097466+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097466+0000","last_undegraded":"2023-12-19T13:51:20.097466+0000","last_fullsized":"2023-12-19T13:51:20.097466+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096440+0000","last_change":"2023-12-19T13:51:20.096440+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096440+0000","last_undegraded":"2023-12-19T13:51:20.096440+0000","last_fullsized":"2023-12-19T13:51:20.096440+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.103129+0000","last_change":"2023-12-19T13:51:20.103129+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.103129+0000","last_undegraded":"2023-12-19T13:51:20.103129+0000","last_fullsized":"2023-12-19T13:51:20.103129+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102394+0000","last_change":"2023-12-19T13:51:20.102394+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102394+0000","last_undegraded":"2023-12-19T13:51:20.102394+0000","last_fullsized":"2023-12-19T13:51:20.102394+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096511+0000","last_change":"2023-12-19T13:51:20.096511+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096511+0000","last_undegraded":"2023-12-19T13:51:20.096511+0000","last_fullsized":"2023-12-19T13:51:20.096511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:25.807837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102872+0000","last_change":"2023-12-19T13:51:20.102872+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102872+0000","last_undegraded":"2023-12-19T13:51:20.102872+0000","last_fullsized":"2023-12-19T13:51:20.102872+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:45:17.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100101+0000","last_change":"2023-12-19T13:51:20.100101+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100101+0000","last_undegraded":"2023-12-19T13:51:20.100101+0000","last_fullsized":"2023-12-19T13:51:20.100101+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:56.831505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099835+0000","last_change":"2023-12-19T13:51:20.099835+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099835+0000","last_undegraded":"2023-12-19T13:51:20.099835+0000","last_fullsized":"2023-12-19T13:51:20.099835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:10.952331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099665+0000","last_change":"2023-12-19T13:51:20.099665+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099665+0000","last_undegraded":"2023-12-19T13:51:20.099665+0000","last_fullsized":"2023-12-19T13:51:20.099665+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:40.451591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099436+0000","last_change":"2023-12-19T13:51:20.099436+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099436+0000","last_undegraded":"2023-12-19T13:51:20.099436+0000","last_fullsized":"2023-12-19T13:51:20.099436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099529+0000","last_change":"2023-12-19T13:51:20.099529+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099529+0000","last_undegraded":"2023-12-19T13:51:20.099529+0000","last_fullsized":"2023-12-19T13:51:20.099529+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100835+0000","last_change":"2023-12-19T13:51:20.100835+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100835+0000","last_undegraded":"2023-12-19T13:51:20.100835+0000","last_fullsized":"2023-12-19T13:51:20.100835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:00.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096815+0000","last_change":"2023-12-19T13:51:20.096815+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096815+0000","last_undegraded":"2023-12-19T13:51:20.096815+0000","last_fullsized":"2023-12-19T13:51:20.096815+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.101534+0000","last_change":"2023-12-19T13:51:20.101534+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.101534+0000","last_undegraded":"2023-12-19T13:51:20.101534+0000","last_fullsized":"2023-12-19T13:51:20.101534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097272+0000","last_change":"2023-12-19T13:51:20.097272+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097272+0000","last_undegraded":"2023-12-19T13:51:20.097272+0000","last_fullsized":"2023-12-19T13:51:20.097272+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:33.558661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T13:51:18.430206+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:51:18.430206+0000","last_peered":"2023-12-19T13:51:18.430206+0000","last_clean":"2023-12-19T13:51:18.430206+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:51:18.430206+0000","last_undegraded":"2023-12-19T13:51:18.430206+0000","last_fullsized":"2023-12-19T13:51:18.430206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.048,"15min":1.0129999999999999},"min":{"1min":0.68600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6950000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.087},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0389999999999999,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7190000000000001,"5min":2.008,"15min":2.008},"last":1.3220000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.117,"15min":1.0820000000000001},"min":{"1min":0.94799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.6459999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.401},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.071,"15min":1.038},"min":{"1min":0.78700000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.9870000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0600000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1359999999999999},"min":{"1min":0.98099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.653,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.171,"15min":1.147},"min":{"1min":0.77400000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6859999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1870000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1930000000000001,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7070000000000001,"5min":1.931,"15min":1.931},"last":1.115},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":0.85499999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.49}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.274,"15min":1.284},"min":{"1min":0.88400000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.609,"5min":2.181,"15min":2.181},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.377,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.86499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8400000000000001,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.5449999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2470000000000001,"15min":1.2250000000000001},"min":{"1min":0.82499999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8660000000000001,"5min":1.956,"15min":1.956},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.81999999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.76,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.2689999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3120000000000001,"15min":1.268},"min":{"1min":0.97399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.927,"5min":2.024,"15min":2.024},"last":1.232},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.506,"15min":1.488},"min":{"1min":1.1399999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8180000000000001,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.367}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.552,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.747},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0840000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.157}]},{"osd":1,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0680000000000001,"15min":1.036},"min":{"1min":0.71899999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.962,"15min":1.962},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.099,"15min":1.044},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.466,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.877}]},{"osd":2,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.252,"15min":1.224},"min":{"1min":0.84899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.702,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.486}]},{"osd":3,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3440000000000001},"min":{"1min":0.91100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7030000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.363},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2569999999999999,"15min":1.2689999999999999},"min":{"1min":0.85199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5840000000000001,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.79800000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2430000000000001,"15min":1.2090000000000001},"min":{"1min":0.94299999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7350000000000001,"5min":1.865,"15min":1.865},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3300000000000001,"15min":1.298},"min":{"1min":0.98099999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.5680000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2869999999999999,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.827,"15min":1.827},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3919999999999999,"15min":1.369},"min":{"1min":0.95399999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.629,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.141}]},{"osd":7,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0820000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9870000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.387,"15min":1.3580000000000001},"min":{"1min":1.026,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.756,"5min":1.766,"15min":1.766},"last":1.4399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194265,"statfs":{"total":200000000,"available":198927413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.01,"15min":0.98799999999999999},"min":{"1min":0.63900000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.738,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.1160000000000001,"15min":1.0820000000000001},"min":{"1min":0.68400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4219999999999997,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.94699999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.802,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.0720000000000001,"15min":1.02},"min":{"1min":0.65600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.2589999999999999,"15min":1.2649999999999999},"min":{"1min":0.81799999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.2470000000000001,"15min":1.268},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0720000000000001,"5min":2.863,"15min":2.863},"last":1.137}]},{"osd":3,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.284,"15min":1.2290000000000001},"min":{"1min":1.103,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":5.6189999999999998,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.248,"15min":1.2430000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7110000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.0009999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1639999999999999,"15min":1.141},"min":{"1min":0.80800000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6679999999999999,"5min":1.982,"15min":1.982},"last":0.874},{"interface":"front","average":{"1min":1.571,"5min":1.337,"15min":1.2969999999999999},"min":{"1min":0.92900000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":5.6970000000000001,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.353,"15min":1.3200000000000001},"min":{"1min":1.0509999999999999,"5min":0.623,"15min":0.623},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.347,"15min":1.3660000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8759999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.4630000000000001,"15min":1.423},"min":{"1min":1.1419999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.175},{"interface":"front","average":{"1min":1.496,"5min":1.448,"15min":1.4099999999999999},"min":{"1min":0.96099999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.3460000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194835,"statfs":{"total":200000000,"available":199511964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.004,"15min":0.99199999999999999},"min":{"1min":0.70999999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.548,"5min":1.657,"15min":1.657},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.85099999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":2.016,"15min":2.016},"last":1.456}]},{"osd":1,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.0660000000000001},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3580000000000001,"5min":1.621,"15min":1.621},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.115,"15min":1.119},"min":{"1min":0.82399999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0960000000000001,"15min":1.03},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.591,"5min":1.611,"15min":1.611},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.127,"15min":1.1100000000000001},"min":{"1min":0.97599999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.3799999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.218,"15min":1.214},"min":{"1min":0.73299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.796,"5min":1.952,"15min":1.952},"last":1.056},{"interface":"front","average":{"1min":1.274,"5min":1.256,"15min":1.274},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.585,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5009999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2190000000000001,"15min":1.2490000000000001},"min":{"1min":0.84099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.75,"5min":2.165,"15min":2.165},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.3280000000000001,"15min":1.3440000000000001},"min":{"1min":0.69299999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.863,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.73}]},{"osd":6,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3500000000000001,"15min":1.397},"min":{"1min":0.78800000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6419999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.613},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":1.2,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.7869999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.45,"15min":1.46},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.9550000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4950000000000001,"15min":1.52},"min":{"1min":1.091,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7989999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.7090000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194835,"statfs":{"total":200000000,"available":199511964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84299999999999997,"15min":0.93899999999999995},"min":{"1min":0.35399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.175,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.92600000000000005,"15min":0.97199999999999998},"min":{"1min":0.40899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.502,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91700000000000004,"15min":1.0189999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.508,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.93700000000000006,"15min":0.98499999999999999},"min":{"1min":0.39900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2589999999999999,"5min":2.387,"15min":2.387},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.004,"15min":1.0389999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5149999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.056,"15min":1.1299999999999999},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.526,"5min":2.657,"15min":2.657},"last":0.68999999999999995}]},{"osd":4,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.212,"15min":1.264},"min":{"1min":0.64000000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6359999999999999,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.075},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.202,"15min":1.228},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5229999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.26,"15min":1.3080000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5820000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.234,"15min":1.268},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.492,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2649999999999999,"15min":1.3049999999999999},"min":{"1min":0.71099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7090000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.272},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3149999999999999,"15min":1.347},"min":{"1min":0.92600000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6279999999999999,"5min":2.698,"15min":2.698},"last":0.99099999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3149999999999999,"15min":1.369},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.524,"5min":3.609,"15min":3.609},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3799999999999999,"15min":1.3979999999999999},"min":{"1min":0.73799999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.768,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.2050000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.544,"5min":2.258,"15min":2.258},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.94199999999999995,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3560000000000001,"5min":11.85,"15min":11.85},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.5880000000000001,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.048,"15min":0.93500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5349999999999999,"5min":11.788,"15min":11.788},"last":0.64900000000000002}]},{"osd":3,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.93400000000000005,"15min":0.93899999999999995},"min":{"1min":0.621,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6599999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0720000000000001,"15min":1.032},"min":{"1min":0.66200000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4950000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2789999999999999,"15min":1.1659999999999999},"min":{"1min":0.90100000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.6639999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2230000000000001,"15min":1.2250000000000001},"min":{"1min":0.84499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7210000000000001,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.355,"15min":1.2310000000000001},"min":{"1min":0.92400000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.726,"5min":11.888,"15min":11.888},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.94799999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7589999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.649}]},{"osd":6,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":0.93899999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.843,"5min":2.964,"15min":2.964},"last":1.504},{"interface":"front","average":{"1min":1.351,"5min":1.284,"15min":1.256},"min":{"1min":0.92900000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.929,"5min":2.286,"15min":2.286},"last":0.748}]},{"osd":7,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.321,"15min":1.3109999999999999},"min":{"1min":1.099,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":2.351,"15min":2.351},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.395,"15min":1.2889999999999999},"min":{"1min":0.81399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8200000000000001,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.47}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194265,"statfs":{"total":200000000,"available":198927413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.40500000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.873,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58099999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.5629999999999999,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.093},"min":{"1min":0.56599999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.454,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1619999999999999,"15min":1.1899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5309999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.71799999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0669999999999999,"15min":1.073},"min":{"1min":0.65600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.4079999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.501},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.198},"min":{"1min":0.69699999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6990000000000001,"5min":7.157,"15min":7.157},"last":1.2230000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1890000000000001,"15min":1.2310000000000001},"min":{"1min":0.86199999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4319999999999999,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.345},{"interface":"front","average":{"1min":1.3,"5min":1.2789999999999999,"15min":1.3029999999999999},"min":{"1min":0.79100000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.881,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.014}]},{"osd":5,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2729999999999999,"15min":1.3300000000000001},"min":{"1min":0.92000000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5900000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.508},{"interface":"front","average":{"1min":1.244,"5min":1.444,"15min":1.3899999999999999},"min":{"1min":0.89000000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5920000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3380000000000001,"15min":1.3520000000000001},"min":{"1min":0.93400000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8600000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.353,"5min":1.357,"15min":1.427},"min":{"1min":1.0149999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.659,"5min":3.786,"15min":3.786},"last":1.2689999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4019999999999999,"15min":1.456},"min":{"1min":1.0700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8160000000000001,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.714},{"interface":"front","average":{"1min":1.355,"5min":1.391,"15min":1.466},"min":{"1min":1.0629999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.647,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.1910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.5820000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.874,"5min":1.018,"15min":0.95499999999999996},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.272,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.625}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.2509999999999999,"15min":0.995},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.25,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.4239999999999999,"15min":1.0820000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.617,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.92400000000000004,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.0569999999999999,"15min":1.099},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4390000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.878,"5min":0.746,"15min":0.746},"max":{"1min":1.5609999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.48},{"interface":"front","average":{"1min":1.292,"5min":1.353,"15min":1.2130000000000001},"min":{"1min":1.016,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8140000000000001,"5min":15.766,"15min":15.766},"last":1.3420000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3420000000000001,"15min":1.218},"min":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5189999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.296},{"interface":"front","average":{"1min":1.306,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6279999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.3999999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3140000000000001,"15min":1.258},"min":{"1min":1.0089999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8939999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.524},{"interface":"front","average":{"1min":1.389,"5min":1.468,"15min":1.3220000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.774,"5min":17.161000000000001,"15min":17.161000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.4510000000000001,"15min":1.3300000000000001},"min":{"1min":0.86799999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6160000000000001,"5min":14.381,"15min":14.381},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.409},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.3169999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:51:26.016 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:51:26.056 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-12-19T13:51:26.057+0000 7f2a4717d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:51:26.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.268+0000 7f2751d38640 1 Processor -- start 2023-12-19T13:51:26.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.268+0000 7f2751d38640 1 -- start start 2023-12-19T13:51:26.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.270+0000 7f2751d38640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f274c0b0b50 0x7f274c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.270+0000 7f2751d38640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c06bb30 con 0x7f274c06b590 2023-12-19T13:51:26.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.270+0000 7f2751d38640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0b0070 con 0x7f274c1449e0 2023-12-19T13:51:26.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.270+0000 7f2751d38640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c0b0350 con 0x7f274c0b0b50 2023-12-19T13:51:26.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f274c0b0b50 0x7f274c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f274c06b590 0x7f274c0b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43470/0 (socket says 172.21.15.113:43470) 2023-12-19T13:51:26.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274bfff640 1 -- 172.21.15.113:0/2734920916 learned_addr learned my addr 172.21.15.113:0/2734920916 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:26.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274a7fc640 1 -- 172.21.15.113:0/2734920916 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996291218 0 0) 0x7f274c06bb30 con 0x7f274c06b590 2023-12-19T13:51:26.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274a7fc640 1 -- 172.21.15.113:0/2734920916 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2734003520 con 0x7f274c06b590 2023-12-19T13:51:26.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274affd640 1 -- 172.21.15.113:0/2734920916 >> v1:172.21.15.151:6789/0 conn(0x7f274c1449e0 legacy=0x7f274c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274affd640 1 -- 172.21.15.113:0/2734920916 >> v1:172.21.15.113:6789/0 conn(0x7f274c06b590 legacy=0x7f274c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.271+0000 7f274affd640 1 -- 172.21.15.113:0/2734920916 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0b0630 con 0x7f274c0b0b50 2023-12-19T13:51:26.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.273+0000 7f274affd640 1 --2- 172.21.15.113:0/2734920916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c06bfa0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f973a2ce488ba7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:26.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.273+0000 7f274a7fc640 1 -- 172.21.15.113:0/2734920916 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740030610 con 0x7f274c0b0b50 2023-12-19T13:51:26.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.273+0000 7f274a7fc640 1 -- 172.21.15.113:0/2734920916 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740030770 con 0x7f274c0b0b50 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.273+0000 7f274a7fc640 1 -- 172.21.15.113:0/2734920916 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740030b00 con 0x7f274c0b0b50 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.273+0000 7f2751d38640 1 -- 172.21.15.113:0/2734920916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 msgr2=0x7f274c06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.273+0000 7f2751d38640 1 --2- 172.21.15.113:0/2734920916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c06bfa0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002b960 comp rx=0 tx=0).stop 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.274+0000 7f2751d38640 1 -- 172.21.15.113:0/2734920916 shutdown_connections 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.274+0000 7f2751d38640 1 --2- 172.21.15.113:0/2734920916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c06bfa0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.274+0000 7f2751d38640 1 -- 172.21.15.113:0/2734920916 >> 172.21.15.113:0/2734920916 conn(0x7f274c0cbb70 msgr2=0x7f274c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.274+0000 7f2751d38640 1 -- 172.21.15.113:0/2734920916 shutdown_connections 2023-12-19T13:51:26.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.274+0000 7f2751d38640 1 -- 172.21.15.113:0/2734920916 wait complete. 2023-12-19T13:51:26.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.276+0000 7f2751d38640 1 Processor -- start 2023-12-19T13:51:26.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.276+0000 7f2751d38640 1 -- start start 2023-12-19T13:51:26.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f2751d38640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f274c06b590 0x7f274c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f2751d38640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c13dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f2751d38640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f274c1449e0 0x7f274c15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f2751d38640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c13d300 con 0x7f274c0b0b50 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f2751d38640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c15a1c0 con 0x7f274c06b590 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f2751d38640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c15e790 con 0x7f274c1449e0 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f274affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c13dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f274affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c13dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54070/0 (socket says 172.21.15.113:54070) 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.277+0000 7f274affd640 1 -- 172.21.15.113:0/3642006471 learned_addr learned my addr 172.21.15.113:0/3642006471 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274b7fe640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f274c06b590 0x7f274c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274bfff640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f274c1449e0 0x7f274c15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274affd640 1 -- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f274c1449e0 msgr2=0x7f274c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274affd640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f274c1449e0 0x7f274c15cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274affd640 1 -- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f274c06b590 msgr2=0x7f274c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274affd640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f274c06b590 0x7f274c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274affd640 1 -- 172.21.15.113:0/3642006471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740009400 con 0x7f274c0b0b50 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274b7fe640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f274c06b590 0x7f274c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f274affd640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c13dfb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2740039700 tx=0x7f2740004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.278+0000 7f2733fff640 1 -- 172.21.15.113:0/3642006471 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274003e040 con 0x7f274c0b0b50 2023-12-19T13:51:26.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.279+0000 7f2733fff640 1 -- 172.21.15.113:0/3642006471 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740039d10 con 0x7f274c0b0b50 2023-12-19T13:51:26.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.279+0000 7f2733fff640 1 -- 172.21.15.113:0/3642006471 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740043680 con 0x7f274c0b0b50 2023-12-19T13:51:26.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.279+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c13c680 con 0x7f274c0b0b50 2023-12-19T13:51:26.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.279+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c13cc40 con 0x7f274c0b0b50 2023-12-19T13:51:26.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.280+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c061910 con 0x7f274c0b0b50 2023-12-19T13:51:26.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.281+0000 7f2733fff640 1 -- 172.21.15.113:0/3642006471 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27400423e0 con 0x7f274c0b0b50 2023-12-19T13:51:26.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.282+0000 7f2733fff640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f273806a430 0x7f273806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.282+0000 7f2733fff640 1 -- 172.21.15.113:0/3642006471 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27400aac40 con 0x7f274c0b0b50 2023-12-19T13:51:26.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.282+0000 7f274b7fe640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f273806a430 0x7f273806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.283+0000 7f274b7fe640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f273806a430 0x7f273806c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f273c000f60 tx=0x7f273c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:26.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.287+0000 7f2733fff640 1 -- 172.21.15.113:0/3642006471 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2740076230 con 0x7f274c0b0b50 2023-12-19T13:51:26.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.471+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f274c06c4e0 con 0x7f273806a430 2023-12-19T13:51:26.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.492+0000 7f2733fff640 1 -- 172.21.15.113:0/3642006471 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273460 (secure 0 0 0) 0x7f273c001c90 con 0x7f273806a430 2023-12-19T13:51:26.496 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:26.498 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f273806a430 msgr2=0x7f273806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f273806a430 0x7f273806c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f273c000f60 tx=0x7f273c009040 comp rx=0 tx=0).stop 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 msgr2=0x7f274c13dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c13dfb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2740039700 tx=0x7f2740004730 comp rx=0 tx=0).stop 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 shutdown_connections 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f273806a430 0x7f273806c8f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f274c1449e0 0x7f274c15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f274c0b0b50 0x7f274c13dfb0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 --2- 172.21.15.113:0/3642006471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f274c06b590 0x7f274c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 >> 172.21.15.113:0/3642006471 conn(0x7f274c0cbb70 msgr2=0x7f274c0ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:26.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 shutdown_connections 2023-12-19T13:51:26.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.498+0000 7f2751d38640 1 -- 172.21.15.113:0/3642006471 wait complete. 2023-12-19T13:51:26.519 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2023-12-19T13:51:24.506705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557568,"statfs":{"total":1600000000,"available":1594949878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.414436"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100879+0000","last_change":"2023-12-19T13:51:20.100879+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100879+0000","last_undegraded":"2023-12-19T13:51:20.100879+0000","last_fullsized":"2023-12-19T13:51:20.100879+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100798+0000","last_change":"2023-12-19T13:51:20.100798+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100798+0000","last_undegraded":"2023-12-19T13:51:20.100798+0000","last_fullsized":"2023-12-19T13:51:20.100798+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:10.691217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099800+0000","last_change":"2023-12-19T13:51:20.099800+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099800+0000","last_undegraded":"2023-12-19T13:51:20.099800+0000","last_fullsized":"2023-12-19T13:51:20.099800+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:49.970103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102267+0000","last_change":"2023-12-19T13:51:20.102267+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102267+0000","last_undegraded":"2023-12-19T13:51:20.102267+0000","last_fullsized":"2023-12-19T13:51:20.102267+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099567+0000","last_change":"2023-12-19T13:51:20.099567+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099567+0000","last_undegraded":"2023-12-19T13:51:20.099567+0000","last_fullsized":"2023-12-19T13:51:20.099567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099332+0000","last_change":"2023-12-19T13:51:20.099332+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099332+0000","last_undegraded":"2023-12-19T13:51:20.099332+0000","last_fullsized":"2023-12-19T13:51:20.099332+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:44:02.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.103881+0000","last_change":"2023-12-19T13:51:20.103881+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.103881+0000","last_undegraded":"2023-12-19T13:51:20.103881+0000","last_fullsized":"2023-12-19T13:51:20.103881+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100714+0000","last_change":"2023-12-19T13:51:20.100714+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100714+0000","last_undegraded":"2023-12-19T13:51:20.100714+0000","last_fullsized":"2023-12-19T13:51:20.100714+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099130+0000","last_change":"2023-12-19T13:51:20.099130+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099130+0000","last_undegraded":"2023-12-19T13:51:20.099130+0000","last_fullsized":"2023-12-19T13:51:20.099130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:04.947835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096531+0000","last_change":"2023-12-19T13:51:20.096531+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096531+0000","last_undegraded":"2023-12-19T13:51:20.096531+0000","last_fullsized":"2023-12-19T13:51:20.096531+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:57.935372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099533+0000","last_change":"2023-12-19T13:51:20.099533+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099533+0000","last_undegraded":"2023-12-19T13:51:20.099533+0000","last_fullsized":"2023-12-19T13:51:20.099533+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102847+0000","last_change":"2023-12-19T13:51:20.102847+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102847+0000","last_undegraded":"2023-12-19T13:51:20.102847+0000","last_fullsized":"2023-12-19T13:51:20.102847+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102822+0000","last_change":"2023-12-19T13:51:20.102822+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102822+0000","last_undegraded":"2023-12-19T13:51:20.102822+0000","last_fullsized":"2023-12-19T13:51:20.102822+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097595+0000","last_change":"2023-12-19T13:51:20.097595+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097595+0000","last_undegraded":"2023-12-19T13:51:20.097595+0000","last_fullsized":"2023-12-19T13:51:20.097595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.505599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.098696+0000","last_change":"2023-12-19T13:51:20.098696+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.098696+0000","last_undegraded":"2023-12-19T13:51:20.098696+0000","last_fullsized":"2023-12-19T13:51:20.098696+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:21.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097738+0000","last_change":"2023-12-19T13:51:20.097738+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097738+0000","last_undegraded":"2023-12-19T13:51:20.097738+0000","last_fullsized":"2023-12-19T13:51:20.097738+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:18.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100410+0000","last_change":"2023-12-19T13:51:20.100410+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100410+0000","last_undegraded":"2023-12-19T13:51:20.100410+0000","last_fullsized":"2023-12-19T13:51:20.100410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:58.943405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097466+0000","last_change":"2023-12-19T13:51:20.097466+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097466+0000","last_undegraded":"2023-12-19T13:51:20.097466+0000","last_fullsized":"2023-12-19T13:51:20.097466+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096440+0000","last_change":"2023-12-19T13:51:20.096440+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096440+0000","last_undegraded":"2023-12-19T13:51:20.096440+0000","last_fullsized":"2023-12-19T13:51:20.096440+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.103129+0000","last_change":"2023-12-19T13:51:20.103129+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.103129+0000","last_undegraded":"2023-12-19T13:51:20.103129+0000","last_fullsized":"2023-12-19T13:51:20.103129+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102394+0000","last_change":"2023-12-19T13:51:20.102394+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102394+0000","last_undegraded":"2023-12-19T13:51:20.102394+0000","last_fullsized":"2023-12-19T13:51:20.102394+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096511+0000","last_change":"2023-12-19T13:51:20.096511+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096511+0000","last_undegraded":"2023-12-19T13:51:20.096511+0000","last_fullsized":"2023-12-19T13:51:20.096511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:25.807837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.102872+0000","last_change":"2023-12-19T13:51:20.102872+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.102872+0000","last_undegraded":"2023-12-19T13:51:20.102872+0000","last_fullsized":"2023-12-19T13:51:20.102872+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:45:17.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100101+0000","last_change":"2023-12-19T13:51:20.100101+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100101+0000","last_undegraded":"2023-12-19T13:51:20.100101+0000","last_fullsized":"2023-12-19T13:51:20.100101+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:56.831505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099835+0000","last_change":"2023-12-19T13:51:20.099835+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099835+0000","last_undegraded":"2023-12-19T13:51:20.099835+0000","last_fullsized":"2023-12-19T13:51:20.099835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:10.952331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099665+0000","last_change":"2023-12-19T13:51:20.099665+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099665+0000","last_undegraded":"2023-12-19T13:51:20.099665+0000","last_fullsized":"2023-12-19T13:51:20.099665+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:40.451591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099436+0000","last_change":"2023-12-19T13:51:20.099436+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099436+0000","last_undegraded":"2023-12-19T13:51:20.099436+0000","last_fullsized":"2023-12-19T13:51:20.099436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.099529+0000","last_change":"2023-12-19T13:51:20.099529+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.099529+0000","last_undegraded":"2023-12-19T13:51:20.099529+0000","last_fullsized":"2023-12-19T13:51:20.099529+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.100835+0000","last_change":"2023-12-19T13:51:20.100835+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.100835+0000","last_undegraded":"2023-12-19T13:51:20.100835+0000","last_fullsized":"2023-12-19T13:51:20.100835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:00.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.096815+0000","last_change":"2023-12-19T13:51:20.096815+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.096815+0000","last_undegraded":"2023-12-19T13:51:20.096815+0000","last_fullsized":"2023-12-19T13:51:20.096815+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.101534+0000","last_change":"2023-12-19T13:51:20.101534+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.101534+0000","last_undegraded":"2023-12-19T13:51:20.101534+0000","last_fullsized":"2023-12-19T13:51:20.101534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:51:21.091154+0000","last_change":"2023-12-19T13:51:21.091154+0000","last_active":"2023-12-19T13:51:21.091154+0000","last_peered":"2023-12-19T13:51:21.091154+0000","last_clean":"2023-12-19T13:51:21.091154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:21.091154+0000","last_undegraded":"2023-12-19T13:51:21.091154+0000","last_fullsized":"2023-12-19T13:51:21.091154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-12-19T13:51:20.097272+0000","last_change":"2023-12-19T13:51:20.097272+0000","last_active":"2023-12-19T13:51:20.075210+0000","last_peered":"2023-12-19T13:51:20.075210+0000","last_clean":"2023-12-19T13:51:20.075210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:51:20.097272+0000","last_undegraded":"2023-12-19T13:51:20.097272+0000","last_fullsized":"2023-12-19T13:51:20.097272+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:33.558661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T13:51:18.430206+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:51:18.430206+0000","last_peered":"2023-12-19T13:51:18.430206+0000","last_clean":"2023-12-19T13:51:18.430206+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:51:18.430206+0000","last_undegraded":"2023-12-19T13:51:18.430206+0000","last_fullsized":"2023-12-19T13:51:18.430206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.048,"15min":1.0129999999999999},"min":{"1min":0.68600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6950000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.087},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0389999999999999,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7190000000000001,"5min":2.008,"15min":2.008},"last":1.3220000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.117,"15min":1.0820000000000001},"min":{"1min":0.94799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.6459999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.401},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.071,"15min":1.038},"min":{"1min":0.78700000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.9870000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0600000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1359999999999999},"min":{"1min":0.98099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.653,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.171,"15min":1.147},"min":{"1min":0.77400000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6859999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1870000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1930000000000001,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7070000000000001,"5min":1.931,"15min":1.931},"last":1.115},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":0.85499999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.49}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.274,"15min":1.284},"min":{"1min":0.88400000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.609,"5min":2.181,"15min":2.181},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.377,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.86499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8400000000000001,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.5449999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2470000000000001,"15min":1.2250000000000001},"min":{"1min":0.82499999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8660000000000001,"5min":1.956,"15min":1.956},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.81999999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.76,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.2689999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3120000000000001,"15min":1.268},"min":{"1min":0.97399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.927,"5min":2.024,"15min":2.024},"last":1.232},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.506,"15min":1.488},"min":{"1min":1.1399999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8180000000000001,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.367}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.552,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.747},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0840000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.157}]},{"osd":1,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0680000000000001,"15min":1.036},"min":{"1min":0.71899999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.962,"15min":1.962},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.099,"15min":1.044},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.466,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.877}]},{"osd":2,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.252,"15min":1.224},"min":{"1min":0.84899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.702,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.486}]},{"osd":3,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3440000000000001},"min":{"1min":0.91100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7030000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.363},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2569999999999999,"15min":1.2689999999999999},"min":{"1min":0.85199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5840000000000001,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.79800000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2430000000000001,"15min":1.2090000000000001},"min":{"1min":0.94299999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7350000000000001,"5min":1.865,"15min":1.865},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3300000000000001,"15min":1.298},"min":{"1min":0.98099999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.5680000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2869999999999999,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.827,"15min":1.827},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3919999999999999,"15min":1.369},"min":{"1min":0.95399999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.629,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.141}]},{"osd":7,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0820000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9870000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.387,"15min":1.3580000000000001},"min":{"1min":1.026,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.756,"5min":1.766,"15min":1.766},"last":1.4399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194265,"statfs":{"total":200000000,"available":198927413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.01,"15min":0.98799999999999999},"min":{"1min":0.63900000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.738,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.1160000000000001,"15min":1.0820000000000001},"min":{"1min":0.68400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4219999999999997,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.94699999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.802,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.0720000000000001,"15min":1.02},"min":{"1min":0.65600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.2589999999999999,"15min":1.2649999999999999},"min":{"1min":0.81799999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.2470000000000001,"15min":1.268},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0720000000000001,"5min":2.863,"15min":2.863},"last":1.137}]},{"osd":3,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.284,"15min":1.2290000000000001},"min":{"1min":1.103,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":5.6189999999999998,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.248,"15min":1.2430000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7110000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.0009999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1639999999999999,"15min":1.141},"min":{"1min":0.80800000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6679999999999999,"5min":1.982,"15min":1.982},"last":0.874},{"interface":"front","average":{"1min":1.571,"5min":1.337,"15min":1.2969999999999999},"min":{"1min":0.92900000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":5.6970000000000001,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.353,"15min":1.3200000000000001},"min":{"1min":1.0509999999999999,"5min":0.623,"15min":0.623},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.347,"15min":1.3660000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8759999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.4630000000000001,"15min":1.423},"min":{"1min":1.1419999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.175},{"interface":"front","average":{"1min":1.496,"5min":1.448,"15min":1.4099999999999999},"min":{"1min":0.96099999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.3460000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194835,"statfs":{"total":200000000,"available":199511964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.004,"15min":0.99199999999999999},"min":{"1min":0.70999999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.548,"5min":1.657,"15min":1.657},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.85099999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":2.016,"15min":2.016},"last":1.456}]},{"osd":1,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.0660000000000001},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3580000000000001,"5min":1.621,"15min":1.621},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.115,"15min":1.119},"min":{"1min":0.82399999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0960000000000001,"15min":1.03},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.591,"5min":1.611,"15min":1.611},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.127,"15min":1.1100000000000001},"min":{"1min":0.97599999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.3799999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.218,"15min":1.214},"min":{"1min":0.73299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.796,"5min":1.952,"15min":1.952},"last":1.056},{"interface":"front","average":{"1min":1.274,"5min":1.256,"15min":1.274},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.585,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5009999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2190000000000001,"15min":1.2490000000000001},"min":{"1min":0.84099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.75,"5min":2.165,"15min":2.165},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.3280000000000001,"15min":1.3440000000000001},"min":{"1min":0.69299999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.863,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.73}]},{"osd":6,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3500000000000001,"15min":1.397},"min":{"1min":0.78800000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6419999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.613},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":1.2,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.7869999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.45,"15min":1.46},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.9550000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4950000000000001,"15min":1.52},"min":{"1min":1.091,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7989999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.7090000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194835,"statfs":{"total":200000000,"available":199511964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84299999999999997,"15min":0.93899999999999995},"min":{"1min":0.35399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.175,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.92600000000000005,"15min":0.97199999999999998},"min":{"1min":0.40899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.502,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91700000000000004,"15min":1.0189999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.508,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.93700000000000006,"15min":0.98499999999999999},"min":{"1min":0.39900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2589999999999999,"5min":2.387,"15min":2.387},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.004,"15min":1.0389999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5149999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.056,"15min":1.1299999999999999},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.526,"5min":2.657,"15min":2.657},"last":0.68999999999999995}]},{"osd":4,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.212,"15min":1.264},"min":{"1min":0.64000000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6359999999999999,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.075},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.202,"15min":1.228},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5229999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.26,"15min":1.3080000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5820000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.234,"15min":1.268},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.492,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2649999999999999,"15min":1.3049999999999999},"min":{"1min":0.71099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.7090000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.272},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3149999999999999,"15min":1.347},"min":{"1min":0.92600000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6279999999999999,"5min":2.698,"15min":2.698},"last":0.99099999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3149999999999999,"15min":1.369},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.524,"5min":3.609,"15min":3.609},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3799999999999999,"15min":1.3979999999999999},"min":{"1min":0.73799999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.768,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.2050000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.544,"5min":2.258,"15min":2.258},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.94199999999999995,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3560000000000001,"5min":11.85,"15min":11.85},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.5880000000000001,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.048,"15min":0.93500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5349999999999999,"5min":11.788,"15min":11.788},"last":0.64900000000000002}]},{"osd":3,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.93400000000000005,"15min":0.93899999999999995},"min":{"1min":0.621,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6599999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0720000000000001,"15min":1.032},"min":{"1min":0.66200000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4950000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2789999999999999,"15min":1.1659999999999999},"min":{"1min":0.90100000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.6639999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2230000000000001,"15min":1.2250000000000001},"min":{"1min":0.84499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7210000000000001,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.355,"15min":1.2310000000000001},"min":{"1min":0.92400000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.726,"5min":11.888,"15min":11.888},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.94799999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7589999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.649}]},{"osd":6,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":0.93899999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.843,"5min":2.964,"15min":2.964},"last":1.504},{"interface":"front","average":{"1min":1.351,"5min":1.284,"15min":1.256},"min":{"1min":0.92900000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.929,"5min":2.286,"15min":2.286},"last":0.748}]},{"osd":7,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.321,"15min":1.3109999999999999},"min":{"1min":1.099,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":2.351,"15min":2.351},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.395,"15min":1.2889999999999999},"min":{"1min":0.81399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8200000000000001,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.47}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194265,"statfs":{"total":200000000,"available":198927413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.40500000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.873,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58099999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.5629999999999999,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.093},"min":{"1min":0.56599999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.454,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1619999999999999,"15min":1.1899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5309999999999999,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.71799999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0669999999999999,"15min":1.073},"min":{"1min":0.65600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.4079999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.501},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.198},"min":{"1min":0.69699999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6990000000000001,"5min":7.157,"15min":7.157},"last":1.2230000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1890000000000001,"15min":1.2310000000000001},"min":{"1min":0.86199999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4319999999999999,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.345},{"interface":"front","average":{"1min":1.3,"5min":1.2789999999999999,"15min":1.3029999999999999},"min":{"1min":0.79100000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.881,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.014}]},{"osd":5,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2729999999999999,"15min":1.3300000000000001},"min":{"1min":0.92000000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5900000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.508},{"interface":"front","average":{"1min":1.244,"5min":1.444,"15min":1.3899999999999999},"min":{"1min":0.89000000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5920000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3380000000000001,"15min":1.3520000000000001},"min":{"1min":0.93400000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8600000000000001,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.353,"5min":1.357,"15min":1.427},"min":{"1min":1.0149999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.659,"5min":3.786,"15min":3.786},"last":1.2689999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4019999999999999,"15min":1.456},"min":{"1min":1.0700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8160000000000001,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.714},{"interface":"front","average":{"1min":1.355,"5min":1.391,"15min":1.466},"min":{"1min":1.0629999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.647,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.1910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517781,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.5820000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.874,"5min":1.018,"15min":0.95499999999999996},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.272,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.625}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.2509999999999999,"15min":0.995},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.25,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.4239999999999999,"15min":1.0820000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.617,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.92400000000000004,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.0569999999999999,"15min":1.099},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4390000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.878,"5min":0.746,"15min":0.746},"max":{"1min":1.5609999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.48},{"interface":"front","average":{"1min":1.292,"5min":1.353,"15min":1.2130000000000001},"min":{"1min":1.016,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8140000000000001,"5min":15.766,"15min":15.766},"last":1.3420000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3420000000000001,"15min":1.218},"min":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5189999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.296},{"interface":"front","average":{"1min":1.306,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6279999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.3999999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3140000000000001,"15min":1.258},"min":{"1min":1.0089999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8939999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.524},{"interface":"front","average":{"1min":1.389,"5min":1.468,"15min":1.3220000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.774,"5min":17.161000000000001,"15min":17.161000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.4510000000000001,"15min":1.3300000000000001},"min":{"1min":0.86799999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6160000000000001,"5min":14.381,"15min":14.381},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.409},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.3169999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:51:26.524 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:51:26.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.780+0000 7f8871dd0640 1 Processor -- start 2023-12-19T13:51:26.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.780+0000 7f8871dd0640 1 -- start start 2023-12-19T13:51:26.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.782+0000 7f8871dd0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f886c161660 0x7f886c166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.782+0000 7f8871dd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.782+0000 7f8871dd0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c165bc0 con 0x7f886c0afa50 2023-12-19T13:51:26.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.782+0000 7f8871dd0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c06e520 con 0x7f886c161660 2023-12-19T13:51:26.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.782+0000 7f8871dd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0afef0 con 0x7f886c161a40 2023-12-19T13:51:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.782+0000 7f886b7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f886c161660 0x7f886c166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.783+0000 7f886bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.783+0000 7f886bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:39330/0 (socket says 172.21.15.113:39330) 2023-12-19T13:51:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.783+0000 7f886bfff640 1 -- 172.21.15.113:0/3735583877 learned_addr learned my addr 172.21.15.113:0/3735583877 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.783+0000 7f886bfff640 1 -- 172.21.15.113:0/3735583877 >> v2:172.21.15.151:3300/0 conn(0x7f886c161660 msgr2=0x7f886c166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.783+0000 7f886bfff640 1 --2- 172.21.15.113:0/3735583877 >> v2:172.21.15.151:3300/0 conn(0x7f886c161660 0x7f886c166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.783+0000 7f886bfff640 1 -- 172.21.15.113:0/3735583877 >> v1:172.21.15.151:6789/0 conn(0x7f886c0afa50 legacy=0x7f886c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.783+0000 7f886bfff640 1 -- 172.21.15.113:0/3735583877 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c165570 con 0x7f886c161a40 2023-12-19T13:51:26.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.785+0000 7f886bfff640 1 --2- 172.21.15.113:0/3735583877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c0b08c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8864009e50 tx=0x7f886402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eacf0a0fd21ab4f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:26.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.785+0000 7f886affd640 1 -- 172.21.15.113:0/3735583877 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886402cb00 con 0x7f886c161a40 2023-12-19T13:51:26.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.785+0000 7f886affd640 1 -- 172.21.15.113:0/3735583877 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886402cc60 con 0x7f886c161a40 2023-12-19T13:51:26.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f886affd640 1 -- 172.21.15.113:0/3735583877 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640343f0 con 0x7f886c161a40 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 -- 172.21.15.113:0/3735583877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 msgr2=0x7f886c0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 --2- 172.21.15.113:0/3735583877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c0b08c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8864009e50 tx=0x7f886402bf60 comp rx=0 tx=0).stop 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 -- 172.21.15.113:0/3735583877 shutdown_connections 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 --2- 172.21.15.113:0/3735583877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c0b08c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 --2- 172.21.15.113:0/3735583877 >> v2:172.21.15.151:3300/0 conn(0x7f886c161660 0x7f886c166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 -- 172.21.15.113:0/3735583877 >> 172.21.15.113:0/3735583877 conn(0x7f886c0cbb70 msgr2=0x7f886c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 -- 172.21.15.113:0/3735583877 shutdown_connections 2023-12-19T13:51:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.786+0000 7f8871dd0640 1 -- 172.21.15.113:0/3735583877 wait complete. 2023-12-19T13:51:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.788+0000 7f8871dd0640 1 Processor -- start 2023-12-19T13:51:26.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.788+0000 7f8871dd0640 1 -- start start 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.789+0000 7f8871dd0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f886c0afa50 0x7f886c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.789+0000 7f8871dd0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f886c161660 0x7f886c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.789+0000 7f8871dd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.789+0000 7f8871dd0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c163b80 con 0x7f886c0afa50 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.789+0000 7f8871dd0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c162f90 con 0x7f886c161660 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.789+0000 7f8871dd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c1631e0 con 0x7f886c161a40 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f886c0afa50 0x7f886c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f886c0afa50 0x7f886c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54086/0 (socket says 172.21.15.113:54086) 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 -- 172.21.15.113:0/1076264772 learned_addr learned my addr 172.21.15.113:0/1076264772 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 -- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 msgr2=0x7f886c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886bfff640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f8863fff640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f886c161660 0x7f886c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c15d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 -- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f886c161660 msgr2=0x7f886c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f886c161660 0x7f886c15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 -- 172.21.15.113:0/1076264772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864009b30 con 0x7f886c0afa50 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.790+0000 7f886b7fe640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f886c0afa50 0x7f886c158c00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9b0 tx=0x7f885c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.791+0000 7f8868ff9640 1 -- 172.21.15.113:0/1076264772 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c009670 con 0x7f886c0afa50 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.791+0000 7f8868ff9640 1 -- 172.21.15.113:0/1076264772 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00c9a0 con 0x7f886c0afa50 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.791+0000 7f8868ff9640 1 -- 172.21.15.113:0/1076264772 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00cd50 con 0x7f886c0afa50 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.791+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c1634c0 con 0x7f886c0afa50 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.791+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c159140 con 0x7f886c0afa50 2023-12-19T13:51:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.792+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c061910 con 0x7f886c0afa50 2023-12-19T13:51:26.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.793+0000 7f8868ff9640 1 -- 172.21.15.113:0/1076264772 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f885c013470 con 0x7f886c0afa50 2023-12-19T13:51:26.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.794+0000 7f8868ff9640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f884c06a430 0x7f884c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:26.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.794+0000 7f8868ff9640 1 -- 172.21.15.113:0/1076264772 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f885c088bf0 con 0x7f886c0afa50 2023-12-19T13:51:26.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.794+0000 7f8863fff640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f884c06a430 0x7f884c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:26.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.795+0000 7f8863fff640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f884c06a430 0x7f884c06c8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f886c0cd650 tx=0x7f8854009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:26.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.799+0000 7f8868ff9640 1 -- 172.21.15.113:0/1076264772 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f885c0541d0 con 0x7f886c0afa50 2023-12-19T13:51:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.985+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f886c165850 con 0x7f884c06a430 2023-12-19T13:51:26.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:26.998+0000 7f8868ff9640 1 -- 172.21.15.113:0/1076264772 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282206 (secure 0 0 0) 0x7f8854001390 con 0x7f884c06a430 2023-12-19T13:51:27.002 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:27.004 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:51:27.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f884c06a430 msgr2=0x7f884c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f884c06a430 0x7f884c06c8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f886c0cd650 tx=0x7f8854009040 comp rx=0 tx=0).stop 2023-12-19T13:51:27.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f886c0afa50 msgr2=0x7f886c158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f886c0afa50 0x7f886c158c00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9b0 tx=0x7f885c00ee70 comp rx=0 tx=0).stop 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 shutdown_connections 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f884c06a430 0x7f884c06c8f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f886c161a40 0x7f886c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f886c161660 0x7f886c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 --2- 172.21.15.113:0/1076264772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f886c0afa50 0x7f886c158c00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 >> 172.21.15.113:0/1076264772 conn(0x7f886c0cbb70 msgr2=0x7f886c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 shutdown_connections 2023-12-19T13:51:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.005+0000 7f8871dd0640 1 -- 172.21.15.113:0/1076264772 wait complete. 2023-12-19T13:51:27.026 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-12-19T13:51:26.507227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5121,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557378,"statfs":{"total":1600000000,"available":1594755516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001558"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837299+0000","last_change":"2023-12-19T13:51:21.608902+0000","last_active":"2023-12-19T13:51:22.837299+0000","last_peered":"2023-12-19T13:51:22.837299+0000","last_clean":"2023-12-19T13:51:22.837299+0000","last_became_active":"2023-12-19T13:51:21.608103+0000","last_became_peered":"2023-12-19T13:51:21.608103+0000","last_unstale":"2023-12-19T13:51:22.837299+0000","last_undegraded":"2023-12-19T13:51:22.837299+0000","last_fullsized":"2023-12-19T13:51:22.837299+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:44.785458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835980+0000","last_change":"2023-12-19T13:51:21.622676+0000","last_active":"2023-12-19T13:51:22.835980+0000","last_peered":"2023-12-19T13:51:22.835980+0000","last_clean":"2023-12-19T13:51:22.835980+0000","last_became_active":"2023-12-19T13:51:21.622443+0000","last_became_peered":"2023-12-19T13:51:21.622443+0000","last_unstale":"2023-12-19T13:51:22.835980+0000","last_undegraded":"2023-12-19T13:51:22.835980+0000","last_fullsized":"2023-12-19T13:51:22.835980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:46.765004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613299+0000","last_change":"2023-12-19T13:51:21.622409+0000","last_active":"2023-12-19T13:51:22.613299+0000","last_peered":"2023-12-19T13:51:22.613299+0000","last_clean":"2023-12-19T13:51:22.613299+0000","last_became_active":"2023-12-19T13:51:21.621671+0000","last_became_peered":"2023-12-19T13:51:21.621671+0000","last_unstale":"2023-12-19T13:51:22.613299+0000","last_undegraded":"2023-12-19T13:51:22.613299+0000","last_fullsized":"2023-12-19T13:51:22.613299+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:26.823781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612256+0000","last_change":"2023-12-19T13:51:21.624872+0000","last_active":"2023-12-19T13:51:22.612256+0000","last_peered":"2023-12-19T13:51:22.612256+0000","last_clean":"2023-12-19T13:51:22.612256+0000","last_became_active":"2023-12-19T13:51:21.624501+0000","last_became_peered":"2023-12-19T13:51:21.624501+0000","last_unstale":"2023-12-19T13:51:22.612256+0000","last_undegraded":"2023-12-19T13:51:22.612256+0000","last_fullsized":"2023-12-19T13:51:22.612256+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:36:56.674396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614698+0000","last_change":"2023-12-19T13:51:21.616795+0000","last_active":"2023-12-19T13:51:22.614698+0000","last_peered":"2023-12-19T13:51:22.614698+0000","last_clean":"2023-12-19T13:51:22.614698+0000","last_became_active":"2023-12-19T13:51:21.615742+0000","last_became_peered":"2023-12-19T13:51:21.615742+0000","last_unstale":"2023-12-19T13:51:22.614698+0000","last_undegraded":"2023-12-19T13:51:22.614698+0000","last_fullsized":"2023-12-19T13:51:22.614698+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:11.675596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835237+0000","last_change":"2023-12-19T13:51:21.615834+0000","last_active":"2023-12-19T13:51:22.835237+0000","last_peered":"2023-12-19T13:51:22.835237+0000","last_clean":"2023-12-19T13:51:22.835237+0000","last_became_active":"2023-12-19T13:51:21.615106+0000","last_became_peered":"2023-12-19T13:51:21.615106+0000","last_unstale":"2023-12-19T13:51:22.835237+0000","last_undegraded":"2023-12-19T13:51:22.835237+0000","last_fullsized":"2023-12-19T13:51:22.835237+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:49.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610040+0000","last_change":"2023-12-19T13:51:21.626485+0000","last_active":"2023-12-19T13:51:22.610040+0000","last_peered":"2023-12-19T13:51:22.610040+0000","last_clean":"2023-12-19T13:51:22.610040+0000","last_became_active":"2023-12-19T13:51:21.626097+0000","last_became_peered":"2023-12-19T13:51:21.626097+0000","last_unstale":"2023-12-19T13:51:22.610040+0000","last_undegraded":"2023-12-19T13:51:22.610040+0000","last_fullsized":"2023-12-19T13:51:22.610040+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:06.035963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837258+0000","last_change":"2023-12-19T13:51:21.618177+0000","last_active":"2023-12-19T13:51:22.837258+0000","last_peered":"2023-12-19T13:51:22.837258+0000","last_clean":"2023-12-19T13:51:22.837258+0000","last_became_active":"2023-12-19T13:51:21.617813+0000","last_became_peered":"2023-12-19T13:51:21.617813+0000","last_unstale":"2023-12-19T13:51:22.837258+0000","last_undegraded":"2023-12-19T13:51:22.837258+0000","last_fullsized":"2023-12-19T13:51:22.837258+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:28:40.177381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612390+0000","last_change":"2023-12-19T13:51:21.615856+0000","last_active":"2023-12-19T13:51:22.612390+0000","last_peered":"2023-12-19T13:51:22.612390+0000","last_clean":"2023-12-19T13:51:22.612390+0000","last_became_active":"2023-12-19T13:51:21.615606+0000","last_became_peered":"2023-12-19T13:51:21.615606+0000","last_unstale":"2023-12-19T13:51:22.612390+0000","last_undegraded":"2023-12-19T13:51:22.612390+0000","last_fullsized":"2023-12-19T13:51:22.612390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:45.769026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610789+0000","last_change":"2023-12-19T13:51:21.627852+0000","last_active":"2023-12-19T13:51:22.610789+0000","last_peered":"2023-12-19T13:51:22.610789+0000","last_clean":"2023-12-19T13:51:22.610789+0000","last_became_active":"2023-12-19T13:51:21.625350+0000","last_became_peered":"2023-12-19T13:51:21.625350+0000","last_unstale":"2023-12-19T13:51:22.610789+0000","last_undegraded":"2023-12-19T13:51:22.610789+0000","last_fullsized":"2023-12-19T13:51:22.610789+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:55:27.380130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837520+0000","last_change":"2023-12-19T13:51:21.615408+0000","last_active":"2023-12-19T13:51:22.837520+0000","last_peered":"2023-12-19T13:51:22.837520+0000","last_clean":"2023-12-19T13:51:22.837520+0000","last_became_active":"2023-12-19T13:51:21.615203+0000","last_became_peered":"2023-12-19T13:51:21.615203+0000","last_unstale":"2023-12-19T13:51:22.837520+0000","last_undegraded":"2023-12-19T13:51:22.837520+0000","last_fullsized":"2023-12-19T13:51:22.837520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:20.623213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827738+0000","last_change":"2023-12-19T13:51:21.620310+0000","last_active":"2023-12-19T13:51:22.827738+0000","last_peered":"2023-12-19T13:51:22.827738+0000","last_clean":"2023-12-19T13:51:22.827738+0000","last_became_active":"2023-12-19T13:51:21.620063+0000","last_became_peered":"2023-12-19T13:51:21.620063+0000","last_unstale":"2023-12-19T13:51:22.827738+0000","last_undegraded":"2023-12-19T13:51:22.827738+0000","last_fullsized":"2023-12-19T13:51:22.827738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:11.707161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613420+0000","last_change":"2023-12-19T13:51:21.622614+0000","last_active":"2023-12-19T13:51:22.613420+0000","last_peered":"2023-12-19T13:51:22.613420+0000","last_clean":"2023-12-19T13:51:22.613420+0000","last_became_active":"2023-12-19T13:51:21.621961+0000","last_became_peered":"2023-12-19T13:51:21.621961+0000","last_unstale":"2023-12-19T13:51:22.613420+0000","last_undegraded":"2023-12-19T13:51:22.613420+0000","last_fullsized":"2023-12-19T13:51:22.613420+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:50.137324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827696+0000","last_change":"2023-12-19T13:51:21.624819+0000","last_active":"2023-12-19T13:51:22.827696+0000","last_peered":"2023-12-19T13:51:22.827696+0000","last_clean":"2023-12-19T13:51:22.827696+0000","last_became_active":"2023-12-19T13:51:21.624414+0000","last_became_peered":"2023-12-19T13:51:21.624414+0000","last_unstale":"2023-12-19T13:51:22.827696+0000","last_undegraded":"2023-12-19T13:51:22.827696+0000","last_fullsized":"2023-12-19T13:51:22.827696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:49.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827738+0000","last_change":"2023-12-19T13:51:21.620162+0000","last_active":"2023-12-19T13:51:22.827738+0000","last_peered":"2023-12-19T13:51:22.827738+0000","last_clean":"2023-12-19T13:51:22.827738+0000","last_became_active":"2023-12-19T13:51:21.619707+0000","last_became_peered":"2023-12-19T13:51:21.619707+0000","last_unstale":"2023-12-19T13:51:22.827738+0000","last_undegraded":"2023-12-19T13:51:22.827738+0000","last_fullsized":"2023-12-19T13:51:22.827738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837874+0000","last_change":"2023-12-19T13:51:21.614821+0000","last_active":"2023-12-19T13:51:22.837874+0000","last_peered":"2023-12-19T13:51:22.837874+0000","last_clean":"2023-12-19T13:51:22.837874+0000","last_became_active":"2023-12-19T13:51:21.614268+0000","last_became_peered":"2023-12-19T13:51:21.614268+0000","last_unstale":"2023-12-19T13:51:22.837874+0000","last_undegraded":"2023-12-19T13:51:22.837874+0000","last_fullsized":"2023-12-19T13:51:22.837874+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:24:33.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613598+0000","last_change":"2023-12-19T13:51:21.619099+0000","last_active":"2023-12-19T13:51:22.613598+0000","last_peered":"2023-12-19T13:51:22.613598+0000","last_clean":"2023-12-19T13:51:22.613598+0000","last_became_active":"2023-12-19T13:51:21.618016+0000","last_became_peered":"2023-12-19T13:51:21.618016+0000","last_unstale":"2023-12-19T13:51:22.613598+0000","last_undegraded":"2023-12-19T13:51:22.613598+0000","last_fullsized":"2023-12-19T13:51:22.613598+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:18.124551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612911+0000","last_change":"2023-12-19T13:51:21.621912+0000","last_active":"2023-12-19T13:51:22.612911+0000","last_peered":"2023-12-19T13:51:22.612911+0000","last_clean":"2023-12-19T13:51:22.612911+0000","last_became_active":"2023-12-19T13:51:21.621689+0000","last_became_peered":"2023-12-19T13:51:21.621689+0000","last_unstale":"2023-12-19T13:51:22.612911+0000","last_undegraded":"2023-12-19T13:51:22.612911+0000","last_fullsized":"2023-12-19T13:51:22.612911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:05.161037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836546+0000","last_change":"2023-12-19T13:51:21.626192+0000","last_active":"2023-12-19T13:51:22.836546+0000","last_peered":"2023-12-19T13:51:22.836546+0000","last_clean":"2023-12-19T13:51:22.836546+0000","last_became_active":"2023-12-19T13:51:21.625953+0000","last_became_peered":"2023-12-19T13:51:21.625953+0000","last_unstale":"2023-12-19T13:51:22.836546+0000","last_undegraded":"2023-12-19T13:51:22.836546+0000","last_fullsized":"2023-12-19T13:51:22.836546+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:18:30.621730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614996+0000","last_change":"2023-12-19T13:51:21.610607+0000","last_active":"2023-12-19T13:51:22.614996+0000","last_peered":"2023-12-19T13:51:22.614996+0000","last_clean":"2023-12-19T13:51:22.614996+0000","last_became_active":"2023-12-19T13:51:21.610346+0000","last_became_peered":"2023-12-19T13:51:21.610346+0000","last_unstale":"2023-12-19T13:51:22.614996+0000","last_undegraded":"2023-12-19T13:51:22.614996+0000","last_fullsized":"2023-12-19T13:51:22.614996+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:41.896416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836620+0000","last_change":"2023-12-19T13:51:21.618014+0000","last_active":"2023-12-19T13:51:22.836620+0000","last_peered":"2023-12-19T13:51:22.836620+0000","last_clean":"2023-12-19T13:51:22.836620+0000","last_became_active":"2023-12-19T13:51:21.617730+0000","last_became_peered":"2023-12-19T13:51:21.617730+0000","last_unstale":"2023-12-19T13:51:22.836620+0000","last_undegraded":"2023-12-19T13:51:22.836620+0000","last_fullsized":"2023-12-19T13:51:22.836620+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836667+0000","last_change":"2023-12-19T13:51:21.612481+0000","last_active":"2023-12-19T13:51:22.836667+0000","last_peered":"2023-12-19T13:51:22.836667+0000","last_clean":"2023-12-19T13:51:22.836667+0000","last_became_active":"2023-12-19T13:51:21.611901+0000","last_became_peered":"2023-12-19T13:51:21.611901+0000","last_unstale":"2023-12-19T13:51:22.836667+0000","last_undegraded":"2023-12-19T13:51:22.836667+0000","last_fullsized":"2023-12-19T13:51:22.836667+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610265+0000","last_change":"2023-12-19T13:51:21.620489+0000","last_active":"2023-12-19T13:51:22.610265+0000","last_peered":"2023-12-19T13:51:22.610265+0000","last_clean":"2023-12-19T13:51:22.610265+0000","last_became_active":"2023-12-19T13:51:21.620252+0000","last_became_peered":"2023-12-19T13:51:21.620252+0000","last_unstale":"2023-12-19T13:51:22.610265+0000","last_undegraded":"2023-12-19T13:51:22.610265+0000","last_fullsized":"2023-12-19T13:51:22.610265+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:36.068907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836658+0000","last_change":"2023-12-19T13:51:21.610724+0000","last_active":"2023-12-19T13:51:22.836658+0000","last_peered":"2023-12-19T13:51:22.836658+0000","last_clean":"2023-12-19T13:51:22.836658+0000","last_became_active":"2023-12-19T13:51:21.610323+0000","last_became_peered":"2023-12-19T13:51:21.610323+0000","last_unstale":"2023-12-19T13:51:22.836658+0000","last_undegraded":"2023-12-19T13:51:22.836658+0000","last_fullsized":"2023-12-19T13:51:22.836658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:55.687744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610520+0000","last_change":"2023-12-19T13:51:21.627337+0000","last_active":"2023-12-19T13:51:22.610520+0000","last_peered":"2023-12-19T13:51:22.610520+0000","last_clean":"2023-12-19T13:51:22.610520+0000","last_became_active":"2023-12-19T13:51:21.624684+0000","last_became_peered":"2023-12-19T13:51:21.624684+0000","last_unstale":"2023-12-19T13:51:22.610520+0000","last_undegraded":"2023-12-19T13:51:22.610520+0000","last_fullsized":"2023-12-19T13:51:22.610520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:09.082207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837696+0000","last_change":"2023-12-19T13:51:21.619129+0000","last_active":"2023-12-19T13:51:22.837696+0000","last_peered":"2023-12-19T13:51:22.837696+0000","last_clean":"2023-12-19T13:51:22.837696+0000","last_became_active":"2023-12-19T13:51:21.618633+0000","last_became_peered":"2023-12-19T13:51:21.618633+0000","last_unstale":"2023-12-19T13:51:22.837696+0000","last_undegraded":"2023-12-19T13:51:22.837696+0000","last_fullsized":"2023-12-19T13:51:22.837696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:56.791611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614028+0000","last_change":"2023-12-19T13:51:21.621324+0000","last_active":"2023-12-19T13:51:22.614028+0000","last_peered":"2023-12-19T13:51:22.614028+0000","last_clean":"2023-12-19T13:51:22.614028+0000","last_became_active":"2023-12-19T13:51:21.619401+0000","last_became_peered":"2023-12-19T13:51:21.619401+0000","last_unstale":"2023-12-19T13:51:22.614028+0000","last_undegraded":"2023-12-19T13:51:22.614028+0000","last_fullsized":"2023-12-19T13:51:22.614028+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:01.407540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835235+0000","last_change":"2023-12-19T13:51:21.626741+0000","last_active":"2023-12-19T13:51:22.835235+0000","last_peered":"2023-12-19T13:51:22.835235+0000","last_clean":"2023-12-19T13:51:22.835235+0000","last_became_active":"2023-12-19T13:51:21.626514+0000","last_became_peered":"2023-12-19T13:51:21.626514+0000","last_unstale":"2023-12-19T13:51:22.835235+0000","last_undegraded":"2023-12-19T13:51:22.835235+0000","last_fullsized":"2023-12-19T13:51:22.835235+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:42.837995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612535+0000","last_change":"2023-12-19T13:51:21.624723+0000","last_active":"2023-12-19T13:51:22.612535+0000","last_peered":"2023-12-19T13:51:22.612535+0000","last_clean":"2023-12-19T13:51:22.612535+0000","last_became_active":"2023-12-19T13:51:21.624172+0000","last_became_peered":"2023-12-19T13:51:21.624172+0000","last_unstale":"2023-12-19T13:51:22.612535+0000","last_undegraded":"2023-12-19T13:51:22.612535+0000","last_fullsized":"2023-12-19T13:51:22.612535+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:36.068907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837975+0000","last_change":"2023-12-19T13:51:21.620538+0000","last_active":"2023-12-19T13:51:22.837975+0000","last_peered":"2023-12-19T13:51:22.837975+0000","last_clean":"2023-12-19T13:51:22.837975+0000","last_became_active":"2023-12-19T13:51:21.620294+0000","last_became_peered":"2023-12-19T13:51:21.620294+0000","last_unstale":"2023-12-19T13:51:22.837975+0000","last_undegraded":"2023-12-19T13:51:22.837975+0000","last_fullsized":"2023-12-19T13:51:22.837975+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:22.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836854+0000","last_change":"2023-12-19T13:51:21.629804+0000","last_active":"2023-12-19T13:51:22.836854+0000","last_peered":"2023-12-19T13:51:22.836854+0000","last_clean":"2023-12-19T13:51:22.836854+0000","last_became_active":"2023-12-19T13:51:21.629528+0000","last_became_peered":"2023-12-19T13:51:21.629528+0000","last_unstale":"2023-12-19T13:51:22.836854+0000","last_undegraded":"2023-12-19T13:51:22.836854+0000","last_fullsized":"2023-12-19T13:51:22.836854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:03.268384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836072+0000","last_change":"2023-12-19T13:51:21.626946+0000","last_active":"2023-12-19T13:51:22.836072+0000","last_peered":"2023-12-19T13:51:22.836072+0000","last_clean":"2023-12-19T13:51:22.836072+0000","last_became_active":"2023-12-19T13:51:21.626737+0000","last_became_peered":"2023-12-19T13:51:21.626737+0000","last_unstale":"2023-12-19T13:51:22.836072+0000","last_undegraded":"2023-12-19T13:51:22.836072+0000","last_fullsized":"2023-12-19T13:51:22.836072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:38.328102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836747+0000","last_change":"2023-12-19T13:51:21.619400+0000","last_active":"2023-12-19T13:51:22.836747+0000","last_peered":"2023-12-19T13:51:22.836747+0000","last_clean":"2023-12-19T13:51:22.836747+0000","last_became_active":"2023-12-19T13:51:21.619201+0000","last_became_peered":"2023-12-19T13:51:21.619201+0000","last_unstale":"2023-12-19T13:51:22.836747+0000","last_undegraded":"2023-12-19T13:51:22.836747+0000","last_fullsized":"2023-12-19T13:51:22.836747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:59.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"93'4","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.628117+0000","last_change":"2023-12-19T13:51:21.130097+0000","last_active":"2023-12-19T13:51:21.628117+0000","last_peered":"2023-12-19T13:51:21.628117+0000","last_clean":"2023-12-19T13:51:21.628117+0000","last_became_active":"2023-12-19T13:51:21.129872+0000","last_became_peered":"2023-12-19T13:51:21.129872+0000","last_unstale":"2023-12-19T13:51:21.628117+0000","last_undegraded":"2023-12-19T13:51:21.628117+0000","last_fullsized":"2023-12-19T13:51:21.628117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613552+0000","last_change":"2023-12-19T13:51:21.621393+0000","last_active":"2023-12-19T13:51:22.613552+0000","last_peered":"2023-12-19T13:51:22.613552+0000","last_clean":"2023-12-19T13:51:22.613552+0000","last_became_active":"2023-12-19T13:51:21.620982+0000","last_became_peered":"2023-12-19T13:51:21.620982+0000","last_unstale":"2023-12-19T13:51:22.613552+0000","last_undegraded":"2023-12-19T13:51:22.613552+0000","last_fullsized":"2023-12-19T13:51:22.613552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:04.807608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.617732+0000","last_change":"2023-12-19T13:51:21.135356+0000","last_active":"2023-12-19T13:51:21.617732+0000","last_peered":"2023-12-19T13:51:21.617732+0000","last_clean":"2023-12-19T13:51:21.617732+0000","last_became_active":"2023-12-19T13:51:21.135121+0000","last_became_peered":"2023-12-19T13:51:21.135121+0000","last_unstale":"2023-12-19T13:51:21.617732+0000","last_undegraded":"2023-12-19T13:51:21.617732+0000","last_fullsized":"2023-12-19T13:51:21.617732+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:10.691217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835490+0000","last_change":"2023-12-19T13:51:21.615697+0000","last_active":"2023-12-19T13:51:22.835490+0000","last_peered":"2023-12-19T13:51:22.835490+0000","last_clean":"2023-12-19T13:51:22.835490+0000","last_became_active":"2023-12-19T13:51:21.614826+0000","last_became_peered":"2023-12-19T13:51:21.614826+0000","last_unstale":"2023-12-19T13:51:22.835490+0000","last_undegraded":"2023-12-19T13:51:22.835490+0000","last_fullsized":"2023-12-19T13:51:22.835490+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.623538+0000","last_change":"2023-12-19T13:51:21.131167+0000","last_active":"2023-12-19T13:51:21.623538+0000","last_peered":"2023-12-19T13:51:21.623538+0000","last_clean":"2023-12-19T13:51:21.623538+0000","last_became_active":"2023-12-19T13:51:21.130582+0000","last_became_peered":"2023-12-19T13:51:21.130582+0000","last_unstale":"2023-12-19T13:51:21.623538+0000","last_undegraded":"2023-12-19T13:51:21.623538+0000","last_fullsized":"2023-12-19T13:51:21.623538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:49.970103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610854+0000","last_change":"2023-12-19T13:51:21.627486+0000","last_active":"2023-12-19T13:51:22.610854+0000","last_peered":"2023-12-19T13:51:22.610854+0000","last_clean":"2023-12-19T13:51:22.610854+0000","last_became_active":"2023-12-19T13:51:21.625008+0000","last_became_peered":"2023-12-19T13:51:21.625008+0000","last_unstale":"2023-12-19T13:51:22.610854+0000","last_undegraded":"2023-12-19T13:51:22.610854+0000","last_fullsized":"2023-12-19T13:51:22.610854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:53.765998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.628839+0000","last_change":"2023-12-19T13:51:21.131543+0000","last_active":"2023-12-19T13:51:21.628839+0000","last_peered":"2023-12-19T13:51:21.628839+0000","last_clean":"2023-12-19T13:51:21.628839+0000","last_became_active":"2023-12-19T13:51:21.131245+0000","last_became_peered":"2023-12-19T13:51:21.131245+0000","last_unstale":"2023-12-19T13:51:21.628839+0000","last_undegraded":"2023-12-19T13:51:21.628839+0000","last_fullsized":"2023-12-19T13:51:21.628839+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837004+0000","last_change":"2023-12-19T13:51:21.618047+0000","last_active":"2023-12-19T13:51:22.837004+0000","last_peered":"2023-12-19T13:51:22.837004+0000","last_clean":"2023-12-19T13:51:22.837004+0000","last_became_active":"2023-12-19T13:51:21.616984+0000","last_became_peered":"2023-12-19T13:51:21.616984+0000","last_unstale":"2023-12-19T13:51:22.837004+0000","last_undegraded":"2023-12-19T13:51:22.837004+0000","last_fullsized":"2023-12-19T13:51:22.837004+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:42.686812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.618054+0000","last_change":"2023-12-19T13:51:21.132384+0000","last_active":"2023-12-19T13:51:21.618054+0000","last_peered":"2023-12-19T13:51:21.618054+0000","last_clean":"2023-12-19T13:51:21.618054+0000","last_became_active":"2023-12-19T13:51:21.131538+0000","last_became_peered":"2023-12-19T13:51:21.131538+0000","last_unstale":"2023-12-19T13:51:21.618054+0000","last_undegraded":"2023-12-19T13:51:21.618054+0000","last_fullsized":"2023-12-19T13:51:21.618054+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836888+0000","last_change":"2023-12-19T13:51:21.614026+0000","last_active":"2023-12-19T13:51:22.836888+0000","last_peered":"2023-12-19T13:51:22.836888+0000","last_clean":"2023-12-19T13:51:22.836888+0000","last_became_active":"2023-12-19T13:51:21.613773+0000","last_became_peered":"2023-12-19T13:51:21.613773+0000","last_unstale":"2023-12-19T13:51:22.836888+0000","last_undegraded":"2023-12-19T13:51:22.836888+0000","last_fullsized":"2023-12-19T13:51:22.836888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.630092+0000","last_change":"2023-12-19T13:51:21.132182+0000","last_active":"2023-12-19T13:51:21.630092+0000","last_peered":"2023-12-19T13:51:21.630092+0000","last_clean":"2023-12-19T13:51:21.630092+0000","last_became_active":"2023-12-19T13:51:21.131507+0000","last_became_peered":"2023-12-19T13:51:21.131507+0000","last_unstale":"2023-12-19T13:51:21.630092+0000","last_undegraded":"2023-12-19T13:51:21.630092+0000","last_fullsized":"2023-12-19T13:51:21.630092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:44:02.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835678+0000","last_change":"2023-12-19T13:51:21.626756+0000","last_active":"2023-12-19T13:51:22.835678+0000","last_peered":"2023-12-19T13:51:22.835678+0000","last_clean":"2023-12-19T13:51:22.835678+0000","last_became_active":"2023-12-19T13:51:21.626514+0000","last_became_peered":"2023-12-19T13:51:21.626514+0000","last_unstale":"2023-12-19T13:51:22.835678+0000","last_undegraded":"2023-12-19T13:51:22.835678+0000","last_fullsized":"2023-12-19T13:51:22.835678+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:29.374283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.624374+0000","last_change":"2023-12-19T13:51:21.137694+0000","last_active":"2023-12-19T13:51:21.624374+0000","last_peered":"2023-12-19T13:51:21.624374+0000","last_clean":"2023-12-19T13:51:21.624374+0000","last_became_active":"2023-12-19T13:51:21.136904+0000","last_became_peered":"2023-12-19T13:51:21.136904+0000","last_unstale":"2023-12-19T13:51:21.624374+0000","last_undegraded":"2023-12-19T13:51:21.624374+0000","last_fullsized":"2023-12-19T13:51:21.624374+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827947+0000","last_change":"2023-12-19T13:51:21.624653+0000","last_active":"2023-12-19T13:51:22.827947+0000","last_peered":"2023-12-19T13:51:22.827947+0000","last_clean":"2023-12-19T13:51:22.827947+0000","last_became_active":"2023-12-19T13:51:21.624093+0000","last_became_peered":"2023-12-19T13:51:21.624093+0000","last_unstale":"2023-12-19T13:51:22.827947+0000","last_undegraded":"2023-12-19T13:51:22.827947+0000","last_fullsized":"2023-12-19T13:51:22.827947+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609952+0000","last_change":"2023-12-19T13:51:21.131030+0000","last_active":"2023-12-19T13:51:21.609952+0000","last_peered":"2023-12-19T13:51:21.609952+0000","last_clean":"2023-12-19T13:51:21.609952+0000","last_became_active":"2023-12-19T13:51:21.130702+0000","last_became_peered":"2023-12-19T13:51:21.130702+0000","last_unstale":"2023-12-19T13:51:21.609952+0000","last_undegraded":"2023-12-19T13:51:21.609952+0000","last_fullsized":"2023-12-19T13:51:21.609952+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610170+0000","last_change":"2023-12-19T13:51:21.622953+0000","last_active":"2023-12-19T13:51:22.610170+0000","last_peered":"2023-12-19T13:51:22.610170+0000","last_clean":"2023-12-19T13:51:22.610170+0000","last_became_active":"2023-12-19T13:51:21.621806+0000","last_became_peered":"2023-12-19T13:51:21.621806+0000","last_unstale":"2023-12-19T13:51:22.610170+0000","last_undegraded":"2023-12-19T13:51:22.610170+0000","last_fullsized":"2023-12-19T13:51:22.610170+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:58.951316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.605393+0000","last_change":"2023-12-19T13:51:21.133910+0000","last_active":"2023-12-19T13:51:21.605393+0000","last_peered":"2023-12-19T13:51:21.605393+0000","last_clean":"2023-12-19T13:51:21.605393+0000","last_became_active":"2023-12-19T13:51:21.125262+0000","last_became_peered":"2023-12-19T13:51:21.125262+0000","last_unstale":"2023-12-19T13:51:21.605393+0000","last_undegraded":"2023-12-19T13:51:21.605393+0000","last_fullsized":"2023-12-19T13:51:21.605393+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:04.947835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837254+0000","last_change":"2023-12-19T13:51:21.621169+0000","last_active":"2023-12-19T13:51:22.837254+0000","last_peered":"2023-12-19T13:51:22.837254+0000","last_clean":"2023-12-19T13:51:22.837254+0000","last_became_active":"2023-12-19T13:51:21.620952+0000","last_became_peered":"2023-12-19T13:51:21.620952+0000","last_unstale":"2023-12-19T13:51:22.837254+0000","last_undegraded":"2023-12-19T13:51:22.837254+0000","last_fullsized":"2023-12-19T13:51:22.837254+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:20.785199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613111+0000","last_change":"2023-12-19T13:51:21.131727+0000","last_active":"2023-12-19T13:51:21.613111+0000","last_peered":"2023-12-19T13:51:21.613111+0000","last_clean":"2023-12-19T13:51:21.613111+0000","last_became_active":"2023-12-19T13:51:21.131432+0000","last_became_peered":"2023-12-19T13:51:21.131432+0000","last_unstale":"2023-12-19T13:51:21.613111+0000","last_undegraded":"2023-12-19T13:51:21.613111+0000","last_fullsized":"2023-12-19T13:51:21.613111+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:57.935372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836833+0000","last_change":"2023-12-19T13:51:21.616055+0000","last_active":"2023-12-19T13:51:22.836833+0000","last_peered":"2023-12-19T13:51:22.836833+0000","last_clean":"2023-12-19T13:51:22.836833+0000","last_became_active":"2023-12-19T13:51:21.615795+0000","last_became_peered":"2023-12-19T13:51:21.615795+0000","last_unstale":"2023-12-19T13:51:22.836833+0000","last_undegraded":"2023-12-19T13:51:22.836833+0000","last_fullsized":"2023-12-19T13:51:22.836833+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:15.599647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"93'3","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.622842+0000","last_change":"2023-12-19T13:51:21.135986+0000","last_active":"2023-12-19T13:51:21.622842+0000","last_peered":"2023-12-19T13:51:21.622842+0000","last_clean":"2023-12-19T13:51:21.622842+0000","last_became_active":"2023-12-19T13:51:21.135713+0000","last_became_peered":"2023-12-19T13:51:21.135713+0000","last_unstale":"2023-12-19T13:51:21.622842+0000","last_undegraded":"2023-12-19T13:51:21.622842+0000","last_fullsized":"2023-12-19T13:51:21.622842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613134+0000","last_change":"2023-12-19T13:51:21.623324+0000","last_active":"2023-12-19T13:51:22.613134+0000","last_peered":"2023-12-19T13:51:22.613134+0000","last_clean":"2023-12-19T13:51:22.613134+0000","last_became_active":"2023-12-19T13:51:21.623042+0000","last_became_peered":"2023-12-19T13:51:21.623042+0000","last_unstale":"2023-12-19T13:51:22.613134+0000","last_undegraded":"2023-12-19T13:51:22.613134+0000","last_fullsized":"2023-12-19T13:51:22.613134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:52.450701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.631043+0000","last_change":"2023-12-19T13:51:21.137800+0000","last_active":"2023-12-19T13:51:21.631043+0000","last_peered":"2023-12-19T13:51:21.631043+0000","last_clean":"2023-12-19T13:51:21.631043+0000","last_became_active":"2023-12-19T13:51:21.137360+0000","last_became_peered":"2023-12-19T13:51:21.137360+0000","last_unstale":"2023-12-19T13:51:21.631043+0000","last_undegraded":"2023-12-19T13:51:21.631043+0000","last_fullsized":"2023-12-19T13:51:21.631043+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835757+0000","last_change":"2023-12-19T13:51:21.615969+0000","last_active":"2023-12-19T13:51:22.835757+0000","last_peered":"2023-12-19T13:51:22.835757+0000","last_clean":"2023-12-19T13:51:22.835757+0000","last_became_active":"2023-12-19T13:51:21.615477+0000","last_became_peered":"2023-12-19T13:51:21.615477+0000","last_unstale":"2023-12-19T13:51:22.835757+0000","last_undegraded":"2023-12-19T13:51:22.835757+0000","last_fullsized":"2023-12-19T13:51:22.835757+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:03.268384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.619861+0000","last_change":"2023-12-19T13:51:21.132662+0000","last_active":"2023-12-19T13:51:21.619861+0000","last_peered":"2023-12-19T13:51:21.619861+0000","last_clean":"2023-12-19T13:51:21.619861+0000","last_became_active":"2023-12-19T13:51:21.132358+0000","last_became_peered":"2023-12-19T13:51:21.132358+0000","last_unstale":"2023-12-19T13:51:21.619861+0000","last_undegraded":"2023-12-19T13:51:21.619861+0000","last_fullsized":"2023-12-19T13:51:21.619861+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610953+0000","last_change":"2023-12-19T13:51:21.625560+0000","last_active":"2023-12-19T13:51:22.610953+0000","last_peered":"2023-12-19T13:51:22.610953+0000","last_clean":"2023-12-19T13:51:22.610953+0000","last_became_active":"2023-12-19T13:51:21.621547+0000","last_became_peered":"2023-12-19T13:51:21.621547+0000","last_unstale":"2023-12-19T13:51:22.610953+0000","last_undegraded":"2023-12-19T13:51:22.610953+0000","last_fullsized":"2023-12-19T13:51:22.610953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:29.374283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609059+0000","last_change":"2023-12-19T13:51:21.134006+0000","last_active":"2023-12-19T13:51:21.609059+0000","last_peered":"2023-12-19T13:51:21.609059+0000","last_clean":"2023-12-19T13:51:21.609059+0000","last_became_active":"2023-12-19T13:51:21.133703+0000","last_became_peered":"2023-12-19T13:51:21.133703+0000","last_unstale":"2023-12-19T13:51:21.609059+0000","last_undegraded":"2023-12-19T13:51:21.609059+0000","last_fullsized":"2023-12-19T13:51:21.609059+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.505599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613356+0000","last_change":"2023-12-19T13:51:21.611420+0000","last_active":"2023-12-19T13:51:22.613356+0000","last_peered":"2023-12-19T13:51:22.613356+0000","last_clean":"2023-12-19T13:51:22.613356+0000","last_became_active":"2023-12-19T13:51:21.611175+0000","last_became_peered":"2023-12-19T13:51:21.611175+0000","last_unstale":"2023-12-19T13:51:22.613356+0000","last_undegraded":"2023-12-19T13:51:22.613356+0000","last_fullsized":"2023-12-19T13:51:22.613356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:33.422417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.615241+0000","last_change":"2023-12-19T13:51:21.130998+0000","last_active":"2023-12-19T13:51:21.615241+0000","last_peered":"2023-12-19T13:51:21.615241+0000","last_clean":"2023-12-19T13:51:21.615241+0000","last_became_active":"2023-12-19T13:51:21.130665+0000","last_became_peered":"2023-12-19T13:51:21.130665+0000","last_unstale":"2023-12-19T13:51:21.615241+0000","last_undegraded":"2023-12-19T13:51:21.615241+0000","last_fullsized":"2023-12-19T13:51:21.615241+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:21.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612836+0000","last_change":"2023-12-19T13:51:21.621714+0000","last_active":"2023-12-19T13:51:22.612836+0000","last_peered":"2023-12-19T13:51:22.612836+0000","last_clean":"2023-12-19T13:51:22.612836+0000","last_became_active":"2023-12-19T13:51:21.621113+0000","last_became_peered":"2023-12-19T13:51:21.621113+0000","last_unstale":"2023-12-19T13:51:22.612836+0000","last_undegraded":"2023-12-19T13:51:22.612836+0000","last_fullsized":"2023-12-19T13:51:22.612836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:22.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"93'8","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629662+0000","last_change":"2023-12-19T13:51:21.132417+0000","last_active":"2023-12-19T13:51:21.629662+0000","last_peered":"2023-12-19T13:51:21.629662+0000","last_clean":"2023-12-19T13:51:21.629662+0000","last_became_active":"2023-12-19T13:51:21.131929+0000","last_became_peered":"2023-12-19T13:51:21.131929+0000","last_unstale":"2023-12-19T13:51:21.629662+0000","last_undegraded":"2023-12-19T13:51:21.629662+0000","last_fullsized":"2023-12-19T13:51:21.629662+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:18.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836662+0000","last_change":"2023-12-19T13:51:21.614546+0000","last_active":"2023-12-19T13:51:22.836662+0000","last_peered":"2023-12-19T13:51:22.836662+0000","last_clean":"2023-12-19T13:51:22.836662+0000","last_became_active":"2023-12-19T13:51:21.613967+0000","last_became_peered":"2023-12-19T13:51:21.613967+0000","last_unstale":"2023-12-19T13:51:22.836662+0000","last_undegraded":"2023-12-19T13:51:22.836662+0000","last_fullsized":"2023-12-19T13:51:22.836662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.623277+0000","last_change":"2023-12-19T13:51:21.131983+0000","last_active":"2023-12-19T13:51:21.623277+0000","last_peered":"2023-12-19T13:51:21.623277+0000","last_clean":"2023-12-19T13:51:21.623277+0000","last_became_active":"2023-12-19T13:51:21.129090+0000","last_became_peered":"2023-12-19T13:51:21.129090+0000","last_unstale":"2023-12-19T13:51:21.623277+0000","last_undegraded":"2023-12-19T13:51:21.623277+0000","last_fullsized":"2023-12-19T13:51:21.623277+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:58.943405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.834953+0000","last_change":"2023-12-19T13:51:21.619897+0000","last_active":"2023-12-19T13:51:22.834953+0000","last_peered":"2023-12-19T13:51:22.834953+0000","last_clean":"2023-12-19T13:51:22.834953+0000","last_became_active":"2023-12-19T13:51:21.619635+0000","last_became_peered":"2023-12-19T13:51:21.619635+0000","last_unstale":"2023-12-19T13:51:22.834953+0000","last_undegraded":"2023-12-19T13:51:22.834953+0000","last_fullsized":"2023-12-19T13:51:22.834953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:44.863019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629193+0000","last_change":"2023-12-19T13:51:21.125390+0000","last_active":"2023-12-19T13:51:21.629193+0000","last_peered":"2023-12-19T13:51:21.629193+0000","last_clean":"2023-12-19T13:51:21.629193+0000","last_became_active":"2023-12-19T13:51:21.124784+0000","last_became_peered":"2023-12-19T13:51:21.124784+0000","last_unstale":"2023-12-19T13:51:21.629193+0000","last_undegraded":"2023-12-19T13:51:21.629193+0000","last_fullsized":"2023-12-19T13:51:21.629193+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613077+0000","last_change":"2023-12-19T13:51:21.617669+0000","last_active":"2023-12-19T13:51:22.613077+0000","last_peered":"2023-12-19T13:51:22.613077+0000","last_clean":"2023-12-19T13:51:22.613077+0000","last_became_active":"2023-12-19T13:51:21.617426+0000","last_became_peered":"2023-12-19T13:51:21.617426+0000","last_unstale":"2023-12-19T13:51:22.613077+0000","last_undegraded":"2023-12-19T13:51:22.613077+0000","last_fullsized":"2023-12-19T13:51:22.613077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:58.951316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.625960+0000","last_change":"2023-12-19T13:51:21.118045+0000","last_active":"2023-12-19T13:51:21.625960+0000","last_peered":"2023-12-19T13:51:21.625960+0000","last_clean":"2023-12-19T13:51:21.625960+0000","last_became_active":"2023-12-19T13:51:21.116479+0000","last_became_peered":"2023-12-19T13:51:21.116479+0000","last_unstale":"2023-12-19T13:51:21.625960+0000","last_undegraded":"2023-12-19T13:51:21.625960+0000","last_fullsized":"2023-12-19T13:51:21.625960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613156+0000","last_change":"2023-12-19T13:51:21.624990+0000","last_active":"2023-12-19T13:51:22.613156+0000","last_peered":"2023-12-19T13:51:22.613156+0000","last_clean":"2023-12-19T13:51:22.613156+0000","last_became_active":"2023-12-19T13:51:21.623985+0000","last_became_peered":"2023-12-19T13:51:21.623985+0000","last_unstale":"2023-12-19T13:51:22.613156+0000","last_undegraded":"2023-12-19T13:51:22.613156+0000","last_fullsized":"2023-12-19T13:51:22.613156+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:09.082207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609844+0000","last_change":"2023-12-19T13:51:21.136844+0000","last_active":"2023-12-19T13:51:21.609844+0000","last_peered":"2023-12-19T13:51:21.609844+0000","last_clean":"2023-12-19T13:51:21.609844+0000","last_became_active":"2023-12-19T13:51:21.136289+0000","last_became_peered":"2023-12-19T13:51:21.136289+0000","last_unstale":"2023-12-19T13:51:21.609844+0000","last_undegraded":"2023-12-19T13:51:21.609844+0000","last_fullsized":"2023-12-19T13:51:21.609844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836045+0000","last_change":"2023-12-19T13:51:21.618732+0000","last_active":"2023-12-19T13:51:22.836045+0000","last_peered":"2023-12-19T13:51:22.836045+0000","last_clean":"2023-12-19T13:51:22.836045+0000","last_became_active":"2023-12-19T13:51:21.618463+0000","last_became_peered":"2023-12-19T13:51:21.618463+0000","last_unstale":"2023-12-19T13:51:22.836045+0000","last_undegraded":"2023-12-19T13:51:22.836045+0000","last_fullsized":"2023-12-19T13:51:22.836045+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:06.035963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.608659+0000","last_change":"2023-12-19T13:51:21.133241+0000","last_active":"2023-12-19T13:51:21.608659+0000","last_peered":"2023-12-19T13:51:21.608659+0000","last_clean":"2023-12-19T13:51:21.608659+0000","last_became_active":"2023-12-19T13:51:21.132972+0000","last_became_peered":"2023-12-19T13:51:21.132972+0000","last_unstale":"2023-12-19T13:51:21.608659+0000","last_undegraded":"2023-12-19T13:51:21.608659+0000","last_fullsized":"2023-12-19T13:51:21.608659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835905+0000","last_change":"2023-12-19T13:51:21.626864+0000","last_active":"2023-12-19T13:51:22.835905+0000","last_peered":"2023-12-19T13:51:22.835905+0000","last_clean":"2023-12-19T13:51:22.835905+0000","last_became_active":"2023-12-19T13:51:21.626596+0000","last_became_peered":"2023-12-19T13:51:21.626596+0000","last_unstale":"2023-12-19T13:51:22.835905+0000","last_undegraded":"2023-12-19T13:51:22.835905+0000","last_fullsized":"2023-12-19T13:51:22.835905+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:08.251827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613650+0000","last_change":"2023-12-19T13:51:21.132021+0000","last_active":"2023-12-19T13:51:21.613650+0000","last_peered":"2023-12-19T13:51:21.613650+0000","last_clean":"2023-12-19T13:51:21.613650+0000","last_became_active":"2023-12-19T13:51:21.131440+0000","last_became_peered":"2023-12-19T13:51:21.131440+0000","last_unstale":"2023-12-19T13:51:21.613650+0000","last_undegraded":"2023-12-19T13:51:21.613650+0000","last_fullsized":"2023-12-19T13:51:21.613650+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:25.807837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827997+0000","last_change":"2023-12-19T13:51:21.619998+0000","last_active":"2023-12-19T13:51:22.827997+0000","last_peered":"2023-12-19T13:51:22.827997+0000","last_clean":"2023-12-19T13:51:22.827997+0000","last_became_active":"2023-12-19T13:51:21.619313+0000","last_became_peered":"2023-12-19T13:51:21.619313+0000","last_unstale":"2023-12-19T13:51:22.827997+0000","last_undegraded":"2023-12-19T13:51:22.827997+0000","last_fullsized":"2023-12-19T13:51:22.827997+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.606198+0000","last_change":"2023-12-19T13:51:21.133757+0000","last_active":"2023-12-19T13:51:21.606198+0000","last_peered":"2023-12-19T13:51:21.606198+0000","last_clean":"2023-12-19T13:51:21.606198+0000","last_became_active":"2023-12-19T13:51:21.133496+0000","last_became_peered":"2023-12-19T13:51:21.133496+0000","last_unstale":"2023-12-19T13:51:21.606198+0000","last_undegraded":"2023-12-19T13:51:21.606198+0000","last_fullsized":"2023-12-19T13:51:21.606198+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:45:17.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613608+0000","last_change":"2023-12-19T13:51:21.619584+0000","last_active":"2023-12-19T13:51:22.613608+0000","last_peered":"2023-12-19T13:51:22.613608+0000","last_clean":"2023-12-19T13:51:22.613608+0000","last_became_active":"2023-12-19T13:51:21.619253+0000","last_became_peered":"2023-12-19T13:51:21.619253+0000","last_unstale":"2023-12-19T13:51:22.613608+0000","last_undegraded":"2023-12-19T13:51:22.613608+0000","last_fullsized":"2023-12-19T13:51:22.613608+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:51.299215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.622980+0000","last_change":"2023-12-19T13:51:21.130747+0000","last_active":"2023-12-19T13:51:21.622980+0000","last_peered":"2023-12-19T13:51:21.622980+0000","last_clean":"2023-12-19T13:51:21.622980+0000","last_became_active":"2023-12-19T13:51:21.130351+0000","last_became_peered":"2023-12-19T13:51:21.130351+0000","last_unstale":"2023-12-19T13:51:21.622980+0000","last_undegraded":"2023-12-19T13:51:21.622980+0000","last_fullsized":"2023-12-19T13:51:21.622980+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:56.831505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610292+0000","last_change":"2023-12-19T13:51:21.623162+0000","last_active":"2023-12-19T13:51:22.610292+0000","last_peered":"2023-12-19T13:51:22.610292+0000","last_clean":"2023-12-19T13:51:22.610292+0000","last_became_active":"2023-12-19T13:51:21.622164+0000","last_became_peered":"2023-12-19T13:51:21.622164+0000","last_unstale":"2023-12-19T13:51:22.610292+0000","last_undegraded":"2023-12-19T13:51:22.610292+0000","last_fullsized":"2023-12-19T13:51:22.610292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:43:25.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.601067+0000","last_change":"2023-12-19T13:51:21.133834+0000","last_active":"2023-12-19T13:51:21.601067+0000","last_peered":"2023-12-19T13:51:21.601067+0000","last_clean":"2023-12-19T13:51:21.601067+0000","last_became_active":"2023-12-19T13:51:21.132246+0000","last_became_peered":"2023-12-19T13:51:21.132246+0000","last_unstale":"2023-12-19T13:51:21.601067+0000","last_undegraded":"2023-12-19T13:51:21.601067+0000","last_fullsized":"2023-12-19T13:51:21.601067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:10.952331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836902+0000","last_change":"2023-12-19T13:51:21.618736+0000","last_active":"2023-12-19T13:51:22.836902+0000","last_peered":"2023-12-19T13:51:22.836902+0000","last_clean":"2023-12-19T13:51:22.836902+0000","last_became_active":"2023-12-19T13:51:21.618234+0000","last_became_peered":"2023-12-19T13:51:21.618234+0000","last_unstale":"2023-12-19T13:51:22.836902+0000","last_undegraded":"2023-12-19T13:51:22.836902+0000","last_fullsized":"2023-12-19T13:51:22.836902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.611878+0000","last_change":"2023-12-19T13:51:21.132015+0000","last_active":"2023-12-19T13:51:21.611878+0000","last_peered":"2023-12-19T13:51:21.611878+0000","last_clean":"2023-12-19T13:51:21.611878+0000","last_became_active":"2023-12-19T13:51:21.131690+0000","last_became_peered":"2023-12-19T13:51:21.131690+0000","last_unstale":"2023-12-19T13:51:21.611878+0000","last_undegraded":"2023-12-19T13:51:21.611878+0000","last_fullsized":"2023-12-19T13:51:21.611878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:40.451591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610186+0000","last_change":"2023-12-19T13:51:21.618492+0000","last_active":"2023-12-19T13:51:22.610186+0000","last_peered":"2023-12-19T13:51:22.610186+0000","last_clean":"2023-12-19T13:51:22.610186+0000","last_became_active":"2023-12-19T13:51:21.617417+0000","last_became_peered":"2023-12-19T13:51:21.617417+0000","last_unstale":"2023-12-19T13:51:22.610186+0000","last_undegraded":"2023-12-19T13:51:22.610186+0000","last_fullsized":"2023-12-19T13:51:22.610186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:22.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.610036+0000","last_change":"2023-12-19T13:51:21.135208+0000","last_active":"2023-12-19T13:51:21.610036+0000","last_peered":"2023-12-19T13:51:21.610036+0000","last_clean":"2023-12-19T13:51:21.610036+0000","last_became_active":"2023-12-19T13:51:21.134819+0000","last_became_peered":"2023-12-19T13:51:21.134819+0000","last_unstale":"2023-12-19T13:51:21.610036+0000","last_undegraded":"2023-12-19T13:51:21.610036+0000","last_fullsized":"2023-12-19T13:51:21.610036+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614255+0000","last_change":"2023-12-19T13:51:21.621039+0000","last_active":"2023-12-19T13:51:22.614255+0000","last_peered":"2023-12-19T13:51:22.614255+0000","last_clean":"2023-12-19T13:51:22.614255+0000","last_became_active":"2023-12-19T13:51:21.618835+0000","last_became_peered":"2023-12-19T13:51:21.618835+0000","last_unstale":"2023-12-19T13:51:22.614255+0000","last_undegraded":"2023-12-19T13:51:22.614255+0000","last_fullsized":"2023-12-19T13:51:22.614255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:38.923169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.612956+0000","last_change":"2023-12-19T13:51:21.133119+0000","last_active":"2023-12-19T13:51:21.612956+0000","last_peered":"2023-12-19T13:51:21.612956+0000","last_clean":"2023-12-19T13:51:21.612956+0000","last_became_active":"2023-12-19T13:51:21.132840+0000","last_became_peered":"2023-12-19T13:51:21.132840+0000","last_unstale":"2023-12-19T13:51:21.612956+0000","last_undegraded":"2023-12-19T13:51:21.612956+0000","last_fullsized":"2023-12-19T13:51:21.612956+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837785+0000","last_change":"2023-12-19T13:51:21.614966+0000","last_active":"2023-12-19T13:51:22.837785+0000","last_peered":"2023-12-19T13:51:22.837785+0000","last_clean":"2023-12-19T13:51:22.837785+0000","last_became_active":"2023-12-19T13:51:21.614610+0000","last_became_peered":"2023-12-19T13:51:21.614610+0000","last_unstale":"2023-12-19T13:51:22.837785+0000","last_undegraded":"2023-12-19T13:51:22.837785+0000","last_fullsized":"2023-12-19T13:51:22.837785+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:59.183585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.605419+0000","last_change":"2023-12-19T13:51:21.136671+0000","last_active":"2023-12-19T13:51:21.605419+0000","last_peered":"2023-12-19T13:51:21.605419+0000","last_clean":"2023-12-19T13:51:21.605419+0000","last_became_active":"2023-12-19T13:51:21.136215+0000","last_became_peered":"2023-12-19T13:51:21.136215+0000","last_unstale":"2023-12-19T13:51:21.605419+0000","last_undegraded":"2023-12-19T13:51:21.605419+0000","last_fullsized":"2023-12-19T13:51:21.605419+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:00.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835383+0000","last_change":"2023-12-19T13:51:21.630170+0000","last_active":"2023-12-19T13:51:22.835383+0000","last_peered":"2023-12-19T13:51:22.835383+0000","last_clean":"2023-12-19T13:51:22.835383+0000","last_became_active":"2023-12-19T13:51:21.628999+0000","last_became_peered":"2023-12-19T13:51:21.628999+0000","last_unstale":"2023-12-19T13:51:22.835383+0000","last_undegraded":"2023-12-19T13:51:22.835383+0000","last_fullsized":"2023-12-19T13:51:22.835383+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:53.765998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613359+0000","last_change":"2023-12-19T13:51:21.128127+0000","last_active":"2023-12-19T13:51:21.613359+0000","last_peered":"2023-12-19T13:51:21.613359+0000","last_clean":"2023-12-19T13:51:21.613359+0000","last_became_active":"2023-12-19T13:51:21.127723+0000","last_became_peered":"2023-12-19T13:51:21.127723+0000","last_unstale":"2023-12-19T13:51:21.613359+0000","last_undegraded":"2023-12-19T13:51:21.613359+0000","last_fullsized":"2023-12-19T13:51:21.613359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835463+0000","last_change":"2023-12-19T13:51:21.619961+0000","last_active":"2023-12-19T13:51:22.835463+0000","last_peered":"2023-12-19T13:51:22.835463+0000","last_clean":"2023-12-19T13:51:22.835463+0000","last_became_active":"2023-12-19T13:51:21.619754+0000","last_became_peered":"2023-12-19T13:51:21.619754+0000","last_unstale":"2023-12-19T13:51:22.835463+0000","last_undegraded":"2023-12-19T13:51:22.835463+0000","last_fullsized":"2023-12-19T13:51:22.835463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:41.467535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.608758+0000","last_change":"2023-12-19T13:51:21.137585+0000","last_active":"2023-12-19T13:51:21.608758+0000","last_peered":"2023-12-19T13:51:21.608758+0000","last_clean":"2023-12-19T13:51:21.608758+0000","last_became_active":"2023-12-19T13:51:21.137411+0000","last_became_peered":"2023-12-19T13:51:21.137411+0000","last_unstale":"2023-12-19T13:51:21.608758+0000","last_undegraded":"2023-12-19T13:51:21.608758+0000","last_fullsized":"2023-12-19T13:51:21.608758+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613898+0000","last_change":"2023-12-19T13:51:21.610199+0000","last_active":"2023-12-19T13:51:22.613898+0000","last_peered":"2023-12-19T13:51:22.613898+0000","last_clean":"2023-12-19T13:51:22.613898+0000","last_became_active":"2023-12-19T13:51:21.609353+0000","last_became_peered":"2023-12-19T13:51:21.609353+0000","last_unstale":"2023-12-19T13:51:22.613898+0000","last_undegraded":"2023-12-19T13:51:22.613898+0000","last_fullsized":"2023-12-19T13:51:22.613898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:22.398005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629828+0000","last_change":"2023-12-19T13:51:21.134430+0000","last_active":"2023-12-19T13:51:21.629828+0000","last_peered":"2023-12-19T13:51:21.629828+0000","last_clean":"2023-12-19T13:51:21.629828+0000","last_became_active":"2023-12-19T13:51:21.134119+0000","last_became_peered":"2023-12-19T13:51:21.134119+0000","last_unstale":"2023-12-19T13:51:21.629828+0000","last_undegraded":"2023-12-19T13:51:21.629828+0000","last_fullsized":"2023-12-19T13:51:21.629828+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:33.558661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":234,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.606881+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:51:21.606881+0000","last_peered":"2023-12-19T13:51:21.606881+0000","last_clean":"2023-12-19T13:51:21.606881+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:51:21.606881+0000","last_undegraded":"2023-12-19T13:51:21.606881+0000","last_fullsized":"2023-12-19T13:51:21.606881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.048,"15min":1.0129999999999999},"min":{"1min":0.68600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6950000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0389999999999999,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7190000000000001,"5min":2.008,"15min":2.008},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.117,"15min":1.0820000000000001},"min":{"1min":0.94799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.6459999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.071,"15min":1.038},"min":{"1min":0.78700000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.9870000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1359999999999999},"min":{"1min":0.98099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.653,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.351},{"interface":"front","average":{"1min":1.137,"5min":1.171,"15min":1.147},"min":{"1min":0.77400000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6859999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3069999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1930000000000001,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7070000000000001,"5min":1.931,"15min":1.931},"last":1.204},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":0.85499999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.0980000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.274,"15min":1.284},"min":{"1min":0.88400000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.609,"5min":2.181,"15min":2.181},"last":1.417},{"interface":"front","average":{"1min":1.377,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.86499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8400000000000001,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.397}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2470000000000001,"15min":1.2250000000000001},"min":{"1min":0.82499999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8660000000000001,"5min":1.956,"15min":1.956},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.81999999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.76,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3120000000000001,"15min":1.268},"min":{"1min":0.97399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.927,"5min":2.024,"15min":2.024},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.506,"15min":1.488},"min":{"1min":1.1399999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8180000000000001,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.571}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491024,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.552,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0840000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.97899999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0680000000000001,"15min":1.036},"min":{"1min":0.71899999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.962,"15min":1.962},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.099,"15min":1.044},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.466,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1719999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.252,"15min":1.224},"min":{"1min":0.84899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.702,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.3460000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3440000000000001},"min":{"1min":0.91100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7030000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2569999999999999,"15min":1.2689999999999999},"min":{"1min":0.85199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5840000000000001,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.706}]},{"osd":4,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2430000000000001,"15min":1.2090000000000001},"min":{"1min":0.94299999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7350000000000001,"5min":1.865,"15min":1.865},"last":1.411},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3300000000000001,"15min":1.298},"min":{"1min":0.98099999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.5580000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2869999999999999,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.827,"15min":1.827},"last":1.962},{"interface":"front","average":{"1min":1.323,"5min":1.3919999999999999,"15min":1.369},"min":{"1min":0.95399999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.629,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0820000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9870000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.387,"15min":1.3580000000000001},"min":{"1min":1.026,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.756,"5min":1.766,"15min":1.766},"last":1.8300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194240,"statfs":{"total":200000000,"available":198902164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0209999999999999,"15min":0.99099999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7669999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.1259999999999999,"15min":1.0860000000000001},"min":{"1min":0.67500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.478,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.86099999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0840000000000001,"15min":1.0940000000000001},"min":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5840000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1080000000000001,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6399999999999999,"5min":2.077,"15min":2.077},"last":1.129}]},{"osd":2,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2490000000000001,"15min":1.2609999999999999},"min":{"1min":0.88200000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2469999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2529999999999999,"15min":1.27},"min":{"1min":0.90100000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.2730000000000001,"5min":2.863,"15min":2.863},"last":0.94199999999999995}]},{"osd":3,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3009999999999999,"15min":1.2350000000000001},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5780000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.256,"15min":1.246},"min":{"1min":1.0009999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.522,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1879999999999999,"15min":1.149},"min":{"1min":0.874,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.857,"5min":1.982,"15min":1.982},"last":1.319},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.353,"15min":1.302},"min":{"1min":1.0269999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6699999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.091}]},{"osd":6,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3680000000000001,"15min":1.325},"min":{"1min":0.94099999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.843,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.05},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3520000000000001,"15min":1.3680000000000001},"min":{"1min":0.81100000000000005,"5min":0.748,"15min":0.748},"max":{"1min":1.9039999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.4119999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.474,"15min":1.427},"min":{"1min":1.131,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7430000000000001,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.204},{"interface":"front","average":{"1min":1.496,"5min":1.4690000000000001,"15min":1.417},"min":{"1min":1.2509999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9059999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.369}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199491928,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.004,"15min":0.99199999999999999},"min":{"1min":0.70999999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.548,"5min":1.657,"15min":1.657},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.85099999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":2.016,"15min":2.016},"last":0.94299999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.0660000000000001},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3580000000000001,"5min":1.621,"15min":1.621},"last":1.02},{"interface":"front","average":{"1min":1.194,"5min":1.115,"15min":1.119},"min":{"1min":0.82399999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.2470000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0960000000000001,"15min":1.03},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.591,"5min":1.611,"15min":1.611},"last":1.22},{"interface":"front","average":{"1min":1.179,"5min":1.127,"15min":1.1100000000000001},"min":{"1min":0.97599999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.218,"15min":1.214},"min":{"1min":0.73299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.796,"5min":1.952,"15min":1.952},"last":1.337},{"interface":"front","average":{"1min":1.274,"5min":1.256,"15min":1.274},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.585,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.508}]},{"osd":5,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2190000000000001,"15min":1.2490000000000001},"min":{"1min":0.84099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.75,"5min":2.165,"15min":2.165},"last":1.369},{"interface":"front","average":{"1min":1.369,"5min":1.3280000000000001,"15min":1.3440000000000001},"min":{"1min":0.69299999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.863,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.581}]},{"osd":6,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3500000000000001,"15min":1.397},"min":{"1min":0.78800000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6419999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.653},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":1.2,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.4590000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.45,"15min":1.46},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.9550000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.72},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4950000000000001,"15min":1.52},"min":{"1min":1.091,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7989999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.804}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.92900000000000005},"min":{"1min":0.48899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.5069999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89600000000000002,"15min":0.96199999999999997},"min":{"1min":0.45300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3360000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.94199999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0920000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.433},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93200000000000005,"15min":0.98299999999999998},"min":{"1min":0.52500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.387,"15min":2.387},"last":0.60999999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.996,"15min":1.036},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0169999999999999,"15min":1.117},"min":{"1min":0.42999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4450000000000001,"5min":2.657,"15min":2.657},"last":1.093}]},{"osd":4,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.204,"15min":1.262},"min":{"1min":0.82599999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.718,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.208,"15min":1.23},"min":{"1min":0.77200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.681,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2410000000000001,"15min":1.3009999999999999},"min":{"1min":0.71199999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.548,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.70699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.528,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.073}]},{"osd":6,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2609999999999999,"15min":1.304},"min":{"1min":0.82799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5920000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3420000000000001},"min":{"1min":0.878,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7490000000000001,"5min":2.698,"15min":2.698},"last":1.2150000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.319,"15min":1.3700000000000001},"min":{"1min":1.0529999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6879999999999999,"5min":3.609,"15min":3.609},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.363,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.655,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.1359999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492040,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.544,"5min":2.258,"15min":2.258},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.94199999999999995,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3560000000000001,"5min":11.85,"15min":11.85},"last":0.96999999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.5880000000000001,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.048,"15min":0.93500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5349999999999999,"5min":11.788,"15min":11.788},"last":1.034}]},{"osd":3,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.93400000000000005,"15min":0.93899999999999995},"min":{"1min":0.621,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6599999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.997},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0720000000000001,"15min":1.032},"min":{"1min":0.66200000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4950000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.95199999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2789999999999999,"15min":1.1659999999999999},"min":{"1min":0.90100000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.6639999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.155},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2230000000000001,"15min":1.2250000000000001},"min":{"1min":0.84499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7210000000000001,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.677}]},{"osd":5,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.355,"15min":1.2310000000000001},"min":{"1min":0.92400000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.726,"5min":11.888,"15min":11.888},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.94799999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7589999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.3759999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":0.93899999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.843,"5min":2.964,"15min":2.964},"last":1.135},{"interface":"front","average":{"1min":1.351,"5min":1.284,"15min":1.256},"min":{"1min":0.92900000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.929,"5min":2.286,"15min":2.286},"last":1.575}]},{"osd":7,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.321,"15min":1.3109999999999999},"min":{"1min":1.099,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":2.351,"15min":2.351},"last":1.319},{"interface":"front","average":{"1min":1.333,"5min":1.395,"15min":1.2889999999999999},"min":{"1min":0.81399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8200000000000001,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.456}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194240,"statfs":{"total":200000000,"available":198902254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78500000000000003,"15min":0.81899999999999995},"min":{"1min":0.33700000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1990000000000001,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.62,"5min":0.435,"15min":0.435},"max":{"1min":1.4590000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.752}]},{"osd":2,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":1.077},"min":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.383,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1830000000000001},"min":{"1min":0.60299999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.452,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.022}]},{"osd":3,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.075,"15min":1.075},"min":{"1min":0.501,"5min":0.5,"15min":0.5},"max":{"1min":1.502,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.1830000000000001},"min":{"1min":0.52700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.357,"5min":7.157,"15min":7.157},"last":1.0600000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1679999999999999,"15min":1.224},"min":{"1min":0.73399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.542,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.171},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2669999999999999,"15min":1.2989999999999999},"min":{"1min":0.996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5129999999999999,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.3939999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2589999999999999,"15min":1.325},"min":{"1min":0.97299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.623,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.411,"15min":1.379},"min":{"1min":0.79400000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6799999999999999,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.0009999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.335,"15min":1.351},"min":{"1min":0.91500000000000004,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6359999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3320000000000001,"15min":1.4179999999999999},"min":{"1min":0.93899999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6899999999999999,"5min":3.786,"15min":3.786},"last":1.1459999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3859999999999999,"15min":1.45},"min":{"1min":0.88900000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.744,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3500000000000001,"15min":1.452},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7809999999999999,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.3220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.5820000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.874,"5min":1.018,"15min":0.95499999999999996},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.272,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.2509999999999999,"15min":0.995},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.25,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.4239999999999999,"15min":1.0820000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.617,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.92400000000000004,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.0569999999999999,"15min":1.099},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.0700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.878,"5min":0.746,"15min":0.746},"max":{"1min":1.5609999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.45},{"interface":"front","average":{"1min":1.292,"5min":1.353,"15min":1.2130000000000001},"min":{"1min":1.016,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8140000000000001,"5min":15.766,"15min":15.766},"last":0.93000000000000005}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3420000000000001,"15min":1.218},"min":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5189999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.306,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6279999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.512}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3140000000000001,"15min":1.258},"min":{"1min":1.0089999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8939999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.468,"15min":1.3220000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.774,"5min":17.161000000000001,"15min":17.161000000000001},"last":0.97499999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.4510000000000001,"15min":1.3300000000000001},"min":{"1min":0.86799999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6160000000000001,"5min":14.381,"15min":14.381},"last":1.25},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.409},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.5649999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:51:27.031 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T13:51:27.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.282+0000 7f91e273c640 1 Processor -- start 2023-12-19T13:51:27.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.282+0000 7f91e273c640 1 -- start start 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91e273c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f91dc1449e0 0x7f91dc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91e273c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc0b0b50 0x7f91dc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91e273c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f91dc06b590 0x7f91dc06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91e273c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc0afb10 con 0x7f91dc1449e0 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91e273c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc06bb30 con 0x7f91dc06b590 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91e273c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0b0070 con 0x7f91dc0b0b50 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f91dc1449e0 0x7f91dc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f91dc1449e0 0x7f91dc0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54092/0 (socket says 172.21.15.113:54092) 2023-12-19T13:51:27.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.284+0000 7f91dbfff640 1 -- 172.21.15.113:0/3968995893 learned_addr learned my addr 172.21.15.113:0/3968995893 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:27.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91d3fff640 1 --2- 172.21.15.113:0/3968995893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc0b0b50 0x7f91dc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91e0cd9640 1 --2- 172.21.15.113:0/3968995893 >> v2:172.21.15.151:3300/0 conn(0x7f91dc06b590 0x7f91dc06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91dbfff640 1 -- 172.21.15.113:0/3968995893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc0b0b50 msgr2=0x7f91dc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:27.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91dbfff640 1 --2- 172.21.15.113:0/3968995893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc0b0b50 0x7f91dc06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91dbfff640 1 -- 172.21.15.113:0/3968995893 >> v2:172.21.15.151:3300/0 conn(0x7f91dc06b590 msgr2=0x7f91dc06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:27.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91dbfff640 1 --2- 172.21.15.113:0/3968995893 >> v2:172.21.15.151:3300/0 conn(0x7f91dc06b590 0x7f91dc06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91dbfff640 1 -- 172.21.15.113:0/3968995893 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0b0350 con 0x7f91dc1449e0 2023-12-19T13:51:27.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91d3fff640 1 --2- 172.21.15.113:0/3968995893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc0b0b50 0x7f91dc06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:27.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.285+0000 7f91e0cd9640 1 --2- 172.21.15.113:0/3968995893 >> v2:172.21.15.151:3300/0 conn(0x7f91dc06b590 0x7f91dc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.286+0000 7f91dbfff640 1 --2- 172.21.15.113:0/3968995893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc1449e0 0x7f91dc0af5d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0b2960 tx=0x7f91cc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528713bb7a2601f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.287+0000 7f91db7fe640 1 -- 172.21.15.113:0/3968995893 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc031860 con 0x7f91dc1449e0 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.287+0000 7f91db7fe640 1 -- 172.21.15.113:0/3968995893 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc0319c0 con 0x7f91dc1449e0 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.287+0000 7f91db7fe640 1 -- 172.21.15.113:0/3968995893 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc031d50 con 0x7f91dc1449e0 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.287+0000 7f91e273c640 1 -- 172.21.15.113:0/3968995893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc1449e0 msgr2=0x7f91dc0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.287+0000 7f91e273c640 1 --2- 172.21.15.113:0/3968995893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc1449e0 0x7f91dc0af5d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0b2960 tx=0x7f91cc02b900 comp rx=0 tx=0).stop 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.288+0000 7f91e273c640 1 -- 172.21.15.113:0/3968995893 shutdown_connections 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.288+0000 7f91e273c640 1 --2- 172.21.15.113:0/3968995893 >> v2:172.21.15.151:3300/0 conn(0x7f91dc06b590 0x7f91dc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.288+0000 7f91e273c640 1 --2- 172.21.15.113:0/3968995893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc0b0b50 0x7f91dc06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.288+0000 7f91e273c640 1 --2- 172.21.15.113:0/3968995893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc1449e0 0x7f91dc0af5d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.288+0000 7f91e273c640 1 -- 172.21.15.113:0/3968995893 >> 172.21.15.113:0/3968995893 conn(0x7f91dc0cbb70 msgr2=0x7f91dc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.288+0000 7f91e273c640 1 -- 172.21.15.113:0/3968995893 shutdown_connections 2023-12-19T13:51:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.288+0000 7f91e273c640 1 -- 172.21.15.113:0/3968995893 wait complete. 2023-12-19T13:51:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.289+0000 7f91e273c640 1 Processor -- start 2023-12-19T13:51:27.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.290+0000 7f91e273c640 1 -- start start 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.290+0000 7f91e273c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc06b590 0x7f91dc156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.290+0000 7f91e273c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91dc0b0b50 0x7f91dc140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.290+0000 7f91e273c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc1449e0 0x7f91dc158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.290+0000 7f91e273c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc13fa10 con 0x7f91dc06b590 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.290+0000 7f91e273c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc13fcf0 con 0x7f91dc0b0b50 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.290+0000 7f91e273c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc13ffd0 con 0x7f91dc1449e0 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc06b590 0x7f91dc156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc06b590 0x7f91dc156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54100/0 (socket says 172.21.15.113:54100) 2023-12-19T13:51:27.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 -- 172.21.15.113:0/1022601748 learned_addr learned my addr 172.21.15.113:0/1022601748 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91d3fff640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91dc0b0b50 0x7f91dc140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91e0cd9640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc1449e0 0x7f91dc158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 -- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc1449e0 msgr2=0x7f91dc158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc1449e0 0x7f91dc158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 -- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91dc0b0b50 msgr2=0x7f91dc140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91dc0b0b50 0x7f91dc140ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.291+0000 7f91dbfff640 1 -- 172.21.15.113:0/1022601748 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0094d0 con 0x7f91dc06b590 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.292+0000 7f91dbfff640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc06b590 0x7f91dc156e50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f91cc000c00 tx=0x7f91cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.292+0000 7f91d97fa640 1 -- 172.21.15.113:0/1022601748 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc03adf0 con 0x7f91dc06b590 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.292+0000 7f91d97fa640 1 -- 172.21.15.113:0/1022601748 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc0443f0 con 0x7f91dc06b590 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.292+0000 7f91d97fa640 1 -- 172.21.15.113:0/1022601748 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0447a0 con 0x7f91dc06b590 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.292+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc1402b0 con 0x7f91dc06b590 2023-12-19T13:51:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.292+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc140ff0 con 0x7f91dc06b590 2023-12-19T13:51:27.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.293+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc1411b0 con 0x7f91dc06b590 2023-12-19T13:51:27.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.294+0000 7f91d97fa640 1 -- 172.21.15.113:0/1022601748 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91cc04d450 con 0x7f91dc06b590 2023-12-19T13:51:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.295+0000 7f91d97fa640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f91bc06a430 0x7f91bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.296+0000 7f91d97fa640 1 -- 172.21.15.113:0/1022601748 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91cc0aaf80 con 0x7f91dc06b590 2023-12-19T13:51:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.296+0000 7f91d3fff640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f91bc06a430 0x7f91bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.296+0000 7f91d3fff640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f91bc06a430 0x7f91bc06c8f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0710f0 tx=0x7f91c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:27.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.300+0000 7f91d97fa640 1 -- 172.21.15.113:0/1022601748 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f91cc076560 con 0x7f91dc06b590 2023-12-19T13:51:27.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.559+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f91dc061910 con 0x7f91dc06b590 2023-12-19T13:51:27.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.559+0000 7f91d97fa640 1 -- 172.21.15.113:0/1022601748 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1006 (secure 0 0 0) 0x7f91cc035400 con 0x7f91dc06b590 2023-12-19T13:51:27.560 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:27.560 INFO:teuthology.orchestra.run.smithi113.stdout:{"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":313,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1702993580,"num_in_osds":8,"osd_in_since":1702993577,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":5244484,"bytes_avail":1594755516,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":41,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6501}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-12-19T13:50:42.492764+0000","services":{}},"progress_events":{}} 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f91bc06a430 msgr2=0x7f91bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f91bc06a430 0x7f91bc06c8f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0710f0 tx=0x7f91c4008040 comp rx=0 tx=0).stop 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc06b590 msgr2=0x7f91dc156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc06b590 0x7f91dc156e50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f91cc000c00 tx=0x7f91cc0046c0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 shutdown_connections 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f91bc06a430 0x7f91bc06c8f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91dc1449e0 0x7f91dc158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91dc0b0b50 0x7f91dc140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 --2- 172.21.15.113:0/1022601748 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91dc06b590 0x7f91dc156e50 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.562+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 >> 172.21.15.113:0/1022601748 conn(0x7f91dc0cbb70 msgr2=0x7f91dc0b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:27.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.563+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 shutdown_connections 2023-12-19T13:51:27.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.563+0000 7f91e273c640 1 -- 172.21.15.113:0/1022601748 wait complete. 2023-12-19T13:51:27.583 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T13:51:27.584 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:51:27.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.795+0000 7f2d72f18640 1 Processor -- start 2023-12-19T13:51:27.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.795+0000 7f2d72f18640 1 -- start start 2023-12-19T13:51:27.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d72f18640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2d6c0b0b50 0x7f2d6c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d72f18640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c06b590 0x7f2d6c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d72f18640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c06bb30 con 0x7f2d6c1449e0 2023-12-19T13:51:27.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d72f18640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b0070 con 0x7f2d6c0b0b50 2023-12-19T13:51:27.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d72f18640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b0350 con 0x7f2d6c06b590 2023-12-19T13:51:27.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d70cb4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2d6c1449e0 0x7f2d6c0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43486/0 (socket says 172.21.15.113:43486) 2023-12-19T13:51:27.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d70cb4640 1 -- 172.21.15.113:0/598925037 learned_addr learned my addr 172.21.15.113:0/598925037 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:27.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/598925037 >> v2:172.21.15.151:3300/0 conn(0x7f2d6c0b0b50 0x7f2d6c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.797+0000 7f2d714b5640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c06b590 0x7f2d6c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504417024 0 0) 0x7f2d6c06bb30 con 0x7f2d6c1449e0 2023-12-19T13:51:27.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d5c003520 con 0x7f2d6c1449e0 2023-12-19T13:51:27.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221264513 0 0) 0x7f2d5c003520 con 0x7f2d6c1449e0 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c06b590 msgr2=0x7f2d6c06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c06b590 0x7f2d6c06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 >> v2:172.21.15.151:3300/0 conn(0x7f2d6c0b0b50 msgr2=0x7f2d6c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 --2- 172.21.15.113:0/598925037 >> v2:172.21.15.151:3300/0 conn(0x7f2d6c0b0b50 0x7f2d6c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c0b0630 con 0x7f2d6c1449e0 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f2d60001670 con 0x7f2d6c1449e0 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 >> v1:172.21.15.113:6789/0 conn(0x7f2d6c1449e0 legacy=0x7f2d6c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c06b590 0x7f2d5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c004d00 0x7f2d5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b0070 con 0x7f2d5c003f60 2023-12-19T13:51:27.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b0350 con 0x7f2d5c004d00 2023-12-19T13:51:27.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c00b9b0 con 0x7f2d6c06b590 2023-12-19T13:51:27.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.798+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.799+0000 7f2d6bfff640 1 -- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c06b590 msgr2=0x7f2d5c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:27.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.799+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c06b590 0x7f2d5c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.799+0000 7f2d6bfff640 1 -- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c004d00 msgr2=0x7f2d5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:27.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.799+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c004d00 0x7f2d5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.799+0000 7f2d6bfff640 1 -- 172.21.15.113:0/598925037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c003520 con 0x7f2d5c003f60 2023-12-19T13:51:27.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.800+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d5c0047c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009ac0 tx=0x7f2d5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2216e247923e30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:27.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.800+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5802c6f0 con 0x7f2d5c003f60 2023-12-19T13:51:27.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.800+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5802c850 con 0x7f2d5c003f60 2023-12-19T13:51:27.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.800+0000 7f2d6b7fe640 1 -- 172.21.15.113:0/598925037 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5802cbe0 con 0x7f2d5c003f60 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.801+0000 7f2d72f18640 1 -- 172.21.15.113:0/598925037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 msgr2=0x7f2d5c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.801+0000 7f2d72f18640 1 --2- 172.21.15.113:0/598925037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d5c0047c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009ac0 tx=0x7f2d5c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.801+0000 7f2d714b5640 1 -- 172.21.15.113:0/598925037 reap_dead start 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.801+0000 7f2d72f18640 1 -- 172.21.15.113:0/598925037 shutdown_connections 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.801+0000 7f2d72f18640 1 -- 172.21.15.113:0/598925037 >> 172.21.15.113:0/598925037 conn(0x7f2d6c0cbb70 msgr2=0x7f2d6c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.801+0000 7f2d72f18640 1 -- 172.21.15.113:0/598925037 shutdown_connections 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.801+0000 7f2d72f18640 1 -- 172.21.15.113:0/598925037 wait complete. 2023-12-19T13:51:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.803+0000 7f2d72f18640 1 Processor -- start 2023-12-19T13:51:27.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.803+0000 7f2d72f18640 1 -- start start 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d72f18640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d6c134b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d72f18640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c15b150 0x7f2d6c1f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d72f18640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c1f66e0 0x7f2d6c1351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d72f18640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c1f6b60 con 0x7f2d5c003f60 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d72f18640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c13a7b0 con 0x7f2d6c1f66e0 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d72f18640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0cd970 con 0x7f2d6c15b150 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d6c134b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d6c134b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54128/0 (socket says 172.21.15.113:54128) 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 -- 172.21.15.113:0/2189199094 learned_addr learned my addr 172.21.15.113:0/2189199094 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d714b5640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c1f66e0 0x7f2d6c1351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c15b150 0x7f2d6c1f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 -- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c15b150 msgr2=0x7f2d6c1f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c15b150 0x7f2d6c1f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 -- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c1f66e0 msgr2=0x7f2d6c1351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c1f66e0 0x7f2d6c1351f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.804+0000 7f2d70cb4640 1 -- 172.21.15.113:0/2189199094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c0cdc50 con 0x7f2d5c003f60 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.805+0000 7f2d70cb4640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d6c134b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000c770 tx=0x7f2d6000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.805+0000 7f2d697fa640 1 -- 172.21.15.113:0/2189199094 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600074e0 con 0x7f2d5c003f60 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.805+0000 7f2d697fa640 1 -- 172.21.15.113:0/2189199094 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60007660 con 0x7f2d5c003f60 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.805+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c0cdf30 con 0x7f2d5c003f60 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.805+0000 7f2d697fa640 1 -- 172.21.15.113:0/2189199094 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60004a20 con 0x7f2d5c003f60 2023-12-19T13:51:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.805+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c1f6f00 con 0x7f2d5c003f60 2023-12-19T13:51:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.806+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c061910 con 0x7f2d5c003f60 2023-12-19T13:51:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.807+0000 7f2d697fa640 1 -- 172.21.15.113:0/2189199094 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d60004b80 con 0x7f2d5c003f60 2023-12-19T13:51:27.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.808+0000 7f2d697fa640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d5006a460 0x7f2d5006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:27.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.809+0000 7f2d697fa640 1 -- 172.21.15.113:0/2189199094 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d60087ca0 con 0x7f2d5c003f60 2023-12-19T13:51:27.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.809+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d5006a460 0x7f2d5006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:27.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.809+0000 7f2d6bfff640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d5006a460 0x7f2d5006c920 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d58036000 tx=0x7f2d58030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:27.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.813+0000 7f2d697fa640 1 -- 172.21.15.113:0/2189199094 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d60053320 con 0x7f2d5c003f60 2023-12-19T13:51:28.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:27.999+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d6c13a920 con 0x7f2d5006a460 2023-12-19T13:51:28.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.008+0000 7f2d697fa640 1 -- 172.21.15.113:0/2189199094 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282206 (secure 0 0 0) 0x7f2d58004040 con 0x7f2d5006a460 2023-12-19T13:51:28.013 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:28.015 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:51:28.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d5006a460 msgr2=0x7f2d5006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d5006a460 0x7f2d5006c920 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d58036000 tx=0x7f2d58030000 comp rx=0 tx=0).stop 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 msgr2=0x7f2d6c134b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d6c134b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000c770 tx=0x7f2d6000cc30 comp rx=0 tx=0).stop 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 shutdown_connections 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d5006a460 0x7f2d5006c920 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c1f66e0 0x7f2d6c1351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d6c15b150 0x7f2d6c1f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 --2- 172.21.15.113:0/2189199094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d5c003f60 0x7f2d6c134b70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:28.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 >> 172.21.15.113:0/2189199094 conn(0x7f2d6c0cbb70 msgr2=0x7f2d6c0ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:28.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 shutdown_connections 2023-12-19T13:51:28.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:28.015+0000 7f2d72f18640 1 -- 172.21.15.113:0/2189199094 wait complete. 2023-12-19T13:51:28.034 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-12-19T13:51:26.507227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5121,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557378,"statfs":{"total":1600000000,"available":1594755516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001558"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837299+0000","last_change":"2023-12-19T13:51:21.608902+0000","last_active":"2023-12-19T13:51:22.837299+0000","last_peered":"2023-12-19T13:51:22.837299+0000","last_clean":"2023-12-19T13:51:22.837299+0000","last_became_active":"2023-12-19T13:51:21.608103+0000","last_became_peered":"2023-12-19T13:51:21.608103+0000","last_unstale":"2023-12-19T13:51:22.837299+0000","last_undegraded":"2023-12-19T13:51:22.837299+0000","last_fullsized":"2023-12-19T13:51:22.837299+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:44.785458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835980+0000","last_change":"2023-12-19T13:51:21.622676+0000","last_active":"2023-12-19T13:51:22.835980+0000","last_peered":"2023-12-19T13:51:22.835980+0000","last_clean":"2023-12-19T13:51:22.835980+0000","last_became_active":"2023-12-19T13:51:21.622443+0000","last_became_peered":"2023-12-19T13:51:21.622443+0000","last_unstale":"2023-12-19T13:51:22.835980+0000","last_undegraded":"2023-12-19T13:51:22.835980+0000","last_fullsized":"2023-12-19T13:51:22.835980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:46.765004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613299+0000","last_change":"2023-12-19T13:51:21.622409+0000","last_active":"2023-12-19T13:51:22.613299+0000","last_peered":"2023-12-19T13:51:22.613299+0000","last_clean":"2023-12-19T13:51:22.613299+0000","last_became_active":"2023-12-19T13:51:21.621671+0000","last_became_peered":"2023-12-19T13:51:21.621671+0000","last_unstale":"2023-12-19T13:51:22.613299+0000","last_undegraded":"2023-12-19T13:51:22.613299+0000","last_fullsized":"2023-12-19T13:51:22.613299+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:26.823781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612256+0000","last_change":"2023-12-19T13:51:21.624872+0000","last_active":"2023-12-19T13:51:22.612256+0000","last_peered":"2023-12-19T13:51:22.612256+0000","last_clean":"2023-12-19T13:51:22.612256+0000","last_became_active":"2023-12-19T13:51:21.624501+0000","last_became_peered":"2023-12-19T13:51:21.624501+0000","last_unstale":"2023-12-19T13:51:22.612256+0000","last_undegraded":"2023-12-19T13:51:22.612256+0000","last_fullsized":"2023-12-19T13:51:22.612256+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:36:56.674396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614698+0000","last_change":"2023-12-19T13:51:21.616795+0000","last_active":"2023-12-19T13:51:22.614698+0000","last_peered":"2023-12-19T13:51:22.614698+0000","last_clean":"2023-12-19T13:51:22.614698+0000","last_became_active":"2023-12-19T13:51:21.615742+0000","last_became_peered":"2023-12-19T13:51:21.615742+0000","last_unstale":"2023-12-19T13:51:22.614698+0000","last_undegraded":"2023-12-19T13:51:22.614698+0000","last_fullsized":"2023-12-19T13:51:22.614698+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:11.675596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835237+0000","last_change":"2023-12-19T13:51:21.615834+0000","last_active":"2023-12-19T13:51:22.835237+0000","last_peered":"2023-12-19T13:51:22.835237+0000","last_clean":"2023-12-19T13:51:22.835237+0000","last_became_active":"2023-12-19T13:51:21.615106+0000","last_became_peered":"2023-12-19T13:51:21.615106+0000","last_unstale":"2023-12-19T13:51:22.835237+0000","last_undegraded":"2023-12-19T13:51:22.835237+0000","last_fullsized":"2023-12-19T13:51:22.835237+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:49.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610040+0000","last_change":"2023-12-19T13:51:21.626485+0000","last_active":"2023-12-19T13:51:22.610040+0000","last_peered":"2023-12-19T13:51:22.610040+0000","last_clean":"2023-12-19T13:51:22.610040+0000","last_became_active":"2023-12-19T13:51:21.626097+0000","last_became_peered":"2023-12-19T13:51:21.626097+0000","last_unstale":"2023-12-19T13:51:22.610040+0000","last_undegraded":"2023-12-19T13:51:22.610040+0000","last_fullsized":"2023-12-19T13:51:22.610040+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:06.035963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837258+0000","last_change":"2023-12-19T13:51:21.618177+0000","last_active":"2023-12-19T13:51:22.837258+0000","last_peered":"2023-12-19T13:51:22.837258+0000","last_clean":"2023-12-19T13:51:22.837258+0000","last_became_active":"2023-12-19T13:51:21.617813+0000","last_became_peered":"2023-12-19T13:51:21.617813+0000","last_unstale":"2023-12-19T13:51:22.837258+0000","last_undegraded":"2023-12-19T13:51:22.837258+0000","last_fullsized":"2023-12-19T13:51:22.837258+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:28:40.177381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612390+0000","last_change":"2023-12-19T13:51:21.615856+0000","last_active":"2023-12-19T13:51:22.612390+0000","last_peered":"2023-12-19T13:51:22.612390+0000","last_clean":"2023-12-19T13:51:22.612390+0000","last_became_active":"2023-12-19T13:51:21.615606+0000","last_became_peered":"2023-12-19T13:51:21.615606+0000","last_unstale":"2023-12-19T13:51:22.612390+0000","last_undegraded":"2023-12-19T13:51:22.612390+0000","last_fullsized":"2023-12-19T13:51:22.612390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:45.769026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610789+0000","last_change":"2023-12-19T13:51:21.627852+0000","last_active":"2023-12-19T13:51:22.610789+0000","last_peered":"2023-12-19T13:51:22.610789+0000","last_clean":"2023-12-19T13:51:22.610789+0000","last_became_active":"2023-12-19T13:51:21.625350+0000","last_became_peered":"2023-12-19T13:51:21.625350+0000","last_unstale":"2023-12-19T13:51:22.610789+0000","last_undegraded":"2023-12-19T13:51:22.610789+0000","last_fullsized":"2023-12-19T13:51:22.610789+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:55:27.380130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837520+0000","last_change":"2023-12-19T13:51:21.615408+0000","last_active":"2023-12-19T13:51:22.837520+0000","last_peered":"2023-12-19T13:51:22.837520+0000","last_clean":"2023-12-19T13:51:22.837520+0000","last_became_active":"2023-12-19T13:51:21.615203+0000","last_became_peered":"2023-12-19T13:51:21.615203+0000","last_unstale":"2023-12-19T13:51:22.837520+0000","last_undegraded":"2023-12-19T13:51:22.837520+0000","last_fullsized":"2023-12-19T13:51:22.837520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:20.623213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827738+0000","last_change":"2023-12-19T13:51:21.620310+0000","last_active":"2023-12-19T13:51:22.827738+0000","last_peered":"2023-12-19T13:51:22.827738+0000","last_clean":"2023-12-19T13:51:22.827738+0000","last_became_active":"2023-12-19T13:51:21.620063+0000","last_became_peered":"2023-12-19T13:51:21.620063+0000","last_unstale":"2023-12-19T13:51:22.827738+0000","last_undegraded":"2023-12-19T13:51:22.827738+0000","last_fullsized":"2023-12-19T13:51:22.827738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:11.707161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613420+0000","last_change":"2023-12-19T13:51:21.622614+0000","last_active":"2023-12-19T13:51:22.613420+0000","last_peered":"2023-12-19T13:51:22.613420+0000","last_clean":"2023-12-19T13:51:22.613420+0000","last_became_active":"2023-12-19T13:51:21.621961+0000","last_became_peered":"2023-12-19T13:51:21.621961+0000","last_unstale":"2023-12-19T13:51:22.613420+0000","last_undegraded":"2023-12-19T13:51:22.613420+0000","last_fullsized":"2023-12-19T13:51:22.613420+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:50.137324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827696+0000","last_change":"2023-12-19T13:51:21.624819+0000","last_active":"2023-12-19T13:51:22.827696+0000","last_peered":"2023-12-19T13:51:22.827696+0000","last_clean":"2023-12-19T13:51:22.827696+0000","last_became_active":"2023-12-19T13:51:21.624414+0000","last_became_peered":"2023-12-19T13:51:21.624414+0000","last_unstale":"2023-12-19T13:51:22.827696+0000","last_undegraded":"2023-12-19T13:51:22.827696+0000","last_fullsized":"2023-12-19T13:51:22.827696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:49.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827738+0000","last_change":"2023-12-19T13:51:21.620162+0000","last_active":"2023-12-19T13:51:22.827738+0000","last_peered":"2023-12-19T13:51:22.827738+0000","last_clean":"2023-12-19T13:51:22.827738+0000","last_became_active":"2023-12-19T13:51:21.619707+0000","last_became_peered":"2023-12-19T13:51:21.619707+0000","last_unstale":"2023-12-19T13:51:22.827738+0000","last_undegraded":"2023-12-19T13:51:22.827738+0000","last_fullsized":"2023-12-19T13:51:22.827738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837874+0000","last_change":"2023-12-19T13:51:21.614821+0000","last_active":"2023-12-19T13:51:22.837874+0000","last_peered":"2023-12-19T13:51:22.837874+0000","last_clean":"2023-12-19T13:51:22.837874+0000","last_became_active":"2023-12-19T13:51:21.614268+0000","last_became_peered":"2023-12-19T13:51:21.614268+0000","last_unstale":"2023-12-19T13:51:22.837874+0000","last_undegraded":"2023-12-19T13:51:22.837874+0000","last_fullsized":"2023-12-19T13:51:22.837874+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:24:33.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613598+0000","last_change":"2023-12-19T13:51:21.619099+0000","last_active":"2023-12-19T13:51:22.613598+0000","last_peered":"2023-12-19T13:51:22.613598+0000","last_clean":"2023-12-19T13:51:22.613598+0000","last_became_active":"2023-12-19T13:51:21.618016+0000","last_became_peered":"2023-12-19T13:51:21.618016+0000","last_unstale":"2023-12-19T13:51:22.613598+0000","last_undegraded":"2023-12-19T13:51:22.613598+0000","last_fullsized":"2023-12-19T13:51:22.613598+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:18.124551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612911+0000","last_change":"2023-12-19T13:51:21.621912+0000","last_active":"2023-12-19T13:51:22.612911+0000","last_peered":"2023-12-19T13:51:22.612911+0000","last_clean":"2023-12-19T13:51:22.612911+0000","last_became_active":"2023-12-19T13:51:21.621689+0000","last_became_peered":"2023-12-19T13:51:21.621689+0000","last_unstale":"2023-12-19T13:51:22.612911+0000","last_undegraded":"2023-12-19T13:51:22.612911+0000","last_fullsized":"2023-12-19T13:51:22.612911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:05.161037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836546+0000","last_change":"2023-12-19T13:51:21.626192+0000","last_active":"2023-12-19T13:51:22.836546+0000","last_peered":"2023-12-19T13:51:22.836546+0000","last_clean":"2023-12-19T13:51:22.836546+0000","last_became_active":"2023-12-19T13:51:21.625953+0000","last_became_peered":"2023-12-19T13:51:21.625953+0000","last_unstale":"2023-12-19T13:51:22.836546+0000","last_undegraded":"2023-12-19T13:51:22.836546+0000","last_fullsized":"2023-12-19T13:51:22.836546+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:18:30.621730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614996+0000","last_change":"2023-12-19T13:51:21.610607+0000","last_active":"2023-12-19T13:51:22.614996+0000","last_peered":"2023-12-19T13:51:22.614996+0000","last_clean":"2023-12-19T13:51:22.614996+0000","last_became_active":"2023-12-19T13:51:21.610346+0000","last_became_peered":"2023-12-19T13:51:21.610346+0000","last_unstale":"2023-12-19T13:51:22.614996+0000","last_undegraded":"2023-12-19T13:51:22.614996+0000","last_fullsized":"2023-12-19T13:51:22.614996+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:41.896416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836620+0000","last_change":"2023-12-19T13:51:21.618014+0000","last_active":"2023-12-19T13:51:22.836620+0000","last_peered":"2023-12-19T13:51:22.836620+0000","last_clean":"2023-12-19T13:51:22.836620+0000","last_became_active":"2023-12-19T13:51:21.617730+0000","last_became_peered":"2023-12-19T13:51:21.617730+0000","last_unstale":"2023-12-19T13:51:22.836620+0000","last_undegraded":"2023-12-19T13:51:22.836620+0000","last_fullsized":"2023-12-19T13:51:22.836620+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836667+0000","last_change":"2023-12-19T13:51:21.612481+0000","last_active":"2023-12-19T13:51:22.836667+0000","last_peered":"2023-12-19T13:51:22.836667+0000","last_clean":"2023-12-19T13:51:22.836667+0000","last_became_active":"2023-12-19T13:51:21.611901+0000","last_became_peered":"2023-12-19T13:51:21.611901+0000","last_unstale":"2023-12-19T13:51:22.836667+0000","last_undegraded":"2023-12-19T13:51:22.836667+0000","last_fullsized":"2023-12-19T13:51:22.836667+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610265+0000","last_change":"2023-12-19T13:51:21.620489+0000","last_active":"2023-12-19T13:51:22.610265+0000","last_peered":"2023-12-19T13:51:22.610265+0000","last_clean":"2023-12-19T13:51:22.610265+0000","last_became_active":"2023-12-19T13:51:21.620252+0000","last_became_peered":"2023-12-19T13:51:21.620252+0000","last_unstale":"2023-12-19T13:51:22.610265+0000","last_undegraded":"2023-12-19T13:51:22.610265+0000","last_fullsized":"2023-12-19T13:51:22.610265+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:36.068907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836658+0000","last_change":"2023-12-19T13:51:21.610724+0000","last_active":"2023-12-19T13:51:22.836658+0000","last_peered":"2023-12-19T13:51:22.836658+0000","last_clean":"2023-12-19T13:51:22.836658+0000","last_became_active":"2023-12-19T13:51:21.610323+0000","last_became_peered":"2023-12-19T13:51:21.610323+0000","last_unstale":"2023-12-19T13:51:22.836658+0000","last_undegraded":"2023-12-19T13:51:22.836658+0000","last_fullsized":"2023-12-19T13:51:22.836658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:55.687744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610520+0000","last_change":"2023-12-19T13:51:21.627337+0000","last_active":"2023-12-19T13:51:22.610520+0000","last_peered":"2023-12-19T13:51:22.610520+0000","last_clean":"2023-12-19T13:51:22.610520+0000","last_became_active":"2023-12-19T13:51:21.624684+0000","last_became_peered":"2023-12-19T13:51:21.624684+0000","last_unstale":"2023-12-19T13:51:22.610520+0000","last_undegraded":"2023-12-19T13:51:22.610520+0000","last_fullsized":"2023-12-19T13:51:22.610520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:09.082207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837696+0000","last_change":"2023-12-19T13:51:21.619129+0000","last_active":"2023-12-19T13:51:22.837696+0000","last_peered":"2023-12-19T13:51:22.837696+0000","last_clean":"2023-12-19T13:51:22.837696+0000","last_became_active":"2023-12-19T13:51:21.618633+0000","last_became_peered":"2023-12-19T13:51:21.618633+0000","last_unstale":"2023-12-19T13:51:22.837696+0000","last_undegraded":"2023-12-19T13:51:22.837696+0000","last_fullsized":"2023-12-19T13:51:22.837696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:56.791611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614028+0000","last_change":"2023-12-19T13:51:21.621324+0000","last_active":"2023-12-19T13:51:22.614028+0000","last_peered":"2023-12-19T13:51:22.614028+0000","last_clean":"2023-12-19T13:51:22.614028+0000","last_became_active":"2023-12-19T13:51:21.619401+0000","last_became_peered":"2023-12-19T13:51:21.619401+0000","last_unstale":"2023-12-19T13:51:22.614028+0000","last_undegraded":"2023-12-19T13:51:22.614028+0000","last_fullsized":"2023-12-19T13:51:22.614028+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:01.407540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835235+0000","last_change":"2023-12-19T13:51:21.626741+0000","last_active":"2023-12-19T13:51:22.835235+0000","last_peered":"2023-12-19T13:51:22.835235+0000","last_clean":"2023-12-19T13:51:22.835235+0000","last_became_active":"2023-12-19T13:51:21.626514+0000","last_became_peered":"2023-12-19T13:51:21.626514+0000","last_unstale":"2023-12-19T13:51:22.835235+0000","last_undegraded":"2023-12-19T13:51:22.835235+0000","last_fullsized":"2023-12-19T13:51:22.835235+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:42.837995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612535+0000","last_change":"2023-12-19T13:51:21.624723+0000","last_active":"2023-12-19T13:51:22.612535+0000","last_peered":"2023-12-19T13:51:22.612535+0000","last_clean":"2023-12-19T13:51:22.612535+0000","last_became_active":"2023-12-19T13:51:21.624172+0000","last_became_peered":"2023-12-19T13:51:21.624172+0000","last_unstale":"2023-12-19T13:51:22.612535+0000","last_undegraded":"2023-12-19T13:51:22.612535+0000","last_fullsized":"2023-12-19T13:51:22.612535+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:36.068907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837975+0000","last_change":"2023-12-19T13:51:21.620538+0000","last_active":"2023-12-19T13:51:22.837975+0000","last_peered":"2023-12-19T13:51:22.837975+0000","last_clean":"2023-12-19T13:51:22.837975+0000","last_became_active":"2023-12-19T13:51:21.620294+0000","last_became_peered":"2023-12-19T13:51:21.620294+0000","last_unstale":"2023-12-19T13:51:22.837975+0000","last_undegraded":"2023-12-19T13:51:22.837975+0000","last_fullsized":"2023-12-19T13:51:22.837975+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:22.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836854+0000","last_change":"2023-12-19T13:51:21.629804+0000","last_active":"2023-12-19T13:51:22.836854+0000","last_peered":"2023-12-19T13:51:22.836854+0000","last_clean":"2023-12-19T13:51:22.836854+0000","last_became_active":"2023-12-19T13:51:21.629528+0000","last_became_peered":"2023-12-19T13:51:21.629528+0000","last_unstale":"2023-12-19T13:51:22.836854+0000","last_undegraded":"2023-12-19T13:51:22.836854+0000","last_fullsized":"2023-12-19T13:51:22.836854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:03.268384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836072+0000","last_change":"2023-12-19T13:51:21.626946+0000","last_active":"2023-12-19T13:51:22.836072+0000","last_peered":"2023-12-19T13:51:22.836072+0000","last_clean":"2023-12-19T13:51:22.836072+0000","last_became_active":"2023-12-19T13:51:21.626737+0000","last_became_peered":"2023-12-19T13:51:21.626737+0000","last_unstale":"2023-12-19T13:51:22.836072+0000","last_undegraded":"2023-12-19T13:51:22.836072+0000","last_fullsized":"2023-12-19T13:51:22.836072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:38.328102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836747+0000","last_change":"2023-12-19T13:51:21.619400+0000","last_active":"2023-12-19T13:51:22.836747+0000","last_peered":"2023-12-19T13:51:22.836747+0000","last_clean":"2023-12-19T13:51:22.836747+0000","last_became_active":"2023-12-19T13:51:21.619201+0000","last_became_peered":"2023-12-19T13:51:21.619201+0000","last_unstale":"2023-12-19T13:51:22.836747+0000","last_undegraded":"2023-12-19T13:51:22.836747+0000","last_fullsized":"2023-12-19T13:51:22.836747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:59.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"93'4","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.628117+0000","last_change":"2023-12-19T13:51:21.130097+0000","last_active":"2023-12-19T13:51:21.628117+0000","last_peered":"2023-12-19T13:51:21.628117+0000","last_clean":"2023-12-19T13:51:21.628117+0000","last_became_active":"2023-12-19T13:51:21.129872+0000","last_became_peered":"2023-12-19T13:51:21.129872+0000","last_unstale":"2023-12-19T13:51:21.628117+0000","last_undegraded":"2023-12-19T13:51:21.628117+0000","last_fullsized":"2023-12-19T13:51:21.628117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613552+0000","last_change":"2023-12-19T13:51:21.621393+0000","last_active":"2023-12-19T13:51:22.613552+0000","last_peered":"2023-12-19T13:51:22.613552+0000","last_clean":"2023-12-19T13:51:22.613552+0000","last_became_active":"2023-12-19T13:51:21.620982+0000","last_became_peered":"2023-12-19T13:51:21.620982+0000","last_unstale":"2023-12-19T13:51:22.613552+0000","last_undegraded":"2023-12-19T13:51:22.613552+0000","last_fullsized":"2023-12-19T13:51:22.613552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:04.807608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.617732+0000","last_change":"2023-12-19T13:51:21.135356+0000","last_active":"2023-12-19T13:51:21.617732+0000","last_peered":"2023-12-19T13:51:21.617732+0000","last_clean":"2023-12-19T13:51:21.617732+0000","last_became_active":"2023-12-19T13:51:21.135121+0000","last_became_peered":"2023-12-19T13:51:21.135121+0000","last_unstale":"2023-12-19T13:51:21.617732+0000","last_undegraded":"2023-12-19T13:51:21.617732+0000","last_fullsized":"2023-12-19T13:51:21.617732+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:10.691217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835490+0000","last_change":"2023-12-19T13:51:21.615697+0000","last_active":"2023-12-19T13:51:22.835490+0000","last_peered":"2023-12-19T13:51:22.835490+0000","last_clean":"2023-12-19T13:51:22.835490+0000","last_became_active":"2023-12-19T13:51:21.614826+0000","last_became_peered":"2023-12-19T13:51:21.614826+0000","last_unstale":"2023-12-19T13:51:22.835490+0000","last_undegraded":"2023-12-19T13:51:22.835490+0000","last_fullsized":"2023-12-19T13:51:22.835490+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.623538+0000","last_change":"2023-12-19T13:51:21.131167+0000","last_active":"2023-12-19T13:51:21.623538+0000","last_peered":"2023-12-19T13:51:21.623538+0000","last_clean":"2023-12-19T13:51:21.623538+0000","last_became_active":"2023-12-19T13:51:21.130582+0000","last_became_peered":"2023-12-19T13:51:21.130582+0000","last_unstale":"2023-12-19T13:51:21.623538+0000","last_undegraded":"2023-12-19T13:51:21.623538+0000","last_fullsized":"2023-12-19T13:51:21.623538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:49.970103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610854+0000","last_change":"2023-12-19T13:51:21.627486+0000","last_active":"2023-12-19T13:51:22.610854+0000","last_peered":"2023-12-19T13:51:22.610854+0000","last_clean":"2023-12-19T13:51:22.610854+0000","last_became_active":"2023-12-19T13:51:21.625008+0000","last_became_peered":"2023-12-19T13:51:21.625008+0000","last_unstale":"2023-12-19T13:51:22.610854+0000","last_undegraded":"2023-12-19T13:51:22.610854+0000","last_fullsized":"2023-12-19T13:51:22.610854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:53.765998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.628839+0000","last_change":"2023-12-19T13:51:21.131543+0000","last_active":"2023-12-19T13:51:21.628839+0000","last_peered":"2023-12-19T13:51:21.628839+0000","last_clean":"2023-12-19T13:51:21.628839+0000","last_became_active":"2023-12-19T13:51:21.131245+0000","last_became_peered":"2023-12-19T13:51:21.131245+0000","last_unstale":"2023-12-19T13:51:21.628839+0000","last_undegraded":"2023-12-19T13:51:21.628839+0000","last_fullsized":"2023-12-19T13:51:21.628839+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837004+0000","last_change":"2023-12-19T13:51:21.618047+0000","last_active":"2023-12-19T13:51:22.837004+0000","last_peered":"2023-12-19T13:51:22.837004+0000","last_clean":"2023-12-19T13:51:22.837004+0000","last_became_active":"2023-12-19T13:51:21.616984+0000","last_became_peered":"2023-12-19T13:51:21.616984+0000","last_unstale":"2023-12-19T13:51:22.837004+0000","last_undegraded":"2023-12-19T13:51:22.837004+0000","last_fullsized":"2023-12-19T13:51:22.837004+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:42.686812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.618054+0000","last_change":"2023-12-19T13:51:21.132384+0000","last_active":"2023-12-19T13:51:21.618054+0000","last_peered":"2023-12-19T13:51:21.618054+0000","last_clean":"2023-12-19T13:51:21.618054+0000","last_became_active":"2023-12-19T13:51:21.131538+0000","last_became_peered":"2023-12-19T13:51:21.131538+0000","last_unstale":"2023-12-19T13:51:21.618054+0000","last_undegraded":"2023-12-19T13:51:21.618054+0000","last_fullsized":"2023-12-19T13:51:21.618054+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836888+0000","last_change":"2023-12-19T13:51:21.614026+0000","last_active":"2023-12-19T13:51:22.836888+0000","last_peered":"2023-12-19T13:51:22.836888+0000","last_clean":"2023-12-19T13:51:22.836888+0000","last_became_active":"2023-12-19T13:51:21.613773+0000","last_became_peered":"2023-12-19T13:51:21.613773+0000","last_unstale":"2023-12-19T13:51:22.836888+0000","last_undegraded":"2023-12-19T13:51:22.836888+0000","last_fullsized":"2023-12-19T13:51:22.836888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.630092+0000","last_change":"2023-12-19T13:51:21.132182+0000","last_active":"2023-12-19T13:51:21.630092+0000","last_peered":"2023-12-19T13:51:21.630092+0000","last_clean":"2023-12-19T13:51:21.630092+0000","last_became_active":"2023-12-19T13:51:21.131507+0000","last_became_peered":"2023-12-19T13:51:21.131507+0000","last_unstale":"2023-12-19T13:51:21.630092+0000","last_undegraded":"2023-12-19T13:51:21.630092+0000","last_fullsized":"2023-12-19T13:51:21.630092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:44:02.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835678+0000","last_change":"2023-12-19T13:51:21.626756+0000","last_active":"2023-12-19T13:51:22.835678+0000","last_peered":"2023-12-19T13:51:22.835678+0000","last_clean":"2023-12-19T13:51:22.835678+0000","last_became_active":"2023-12-19T13:51:21.626514+0000","last_became_peered":"2023-12-19T13:51:21.626514+0000","last_unstale":"2023-12-19T13:51:22.835678+0000","last_undegraded":"2023-12-19T13:51:22.835678+0000","last_fullsized":"2023-12-19T13:51:22.835678+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:29.374283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.624374+0000","last_change":"2023-12-19T13:51:21.137694+0000","last_active":"2023-12-19T13:51:21.624374+0000","last_peered":"2023-12-19T13:51:21.624374+0000","last_clean":"2023-12-19T13:51:21.624374+0000","last_became_active":"2023-12-19T13:51:21.136904+0000","last_became_peered":"2023-12-19T13:51:21.136904+0000","last_unstale":"2023-12-19T13:51:21.624374+0000","last_undegraded":"2023-12-19T13:51:21.624374+0000","last_fullsized":"2023-12-19T13:51:21.624374+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827947+0000","last_change":"2023-12-19T13:51:21.624653+0000","last_active":"2023-12-19T13:51:22.827947+0000","last_peered":"2023-12-19T13:51:22.827947+0000","last_clean":"2023-12-19T13:51:22.827947+0000","last_became_active":"2023-12-19T13:51:21.624093+0000","last_became_peered":"2023-12-19T13:51:21.624093+0000","last_unstale":"2023-12-19T13:51:22.827947+0000","last_undegraded":"2023-12-19T13:51:22.827947+0000","last_fullsized":"2023-12-19T13:51:22.827947+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609952+0000","last_change":"2023-12-19T13:51:21.131030+0000","last_active":"2023-12-19T13:51:21.609952+0000","last_peered":"2023-12-19T13:51:21.609952+0000","last_clean":"2023-12-19T13:51:21.609952+0000","last_became_active":"2023-12-19T13:51:21.130702+0000","last_became_peered":"2023-12-19T13:51:21.130702+0000","last_unstale":"2023-12-19T13:51:21.609952+0000","last_undegraded":"2023-12-19T13:51:21.609952+0000","last_fullsized":"2023-12-19T13:51:21.609952+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610170+0000","last_change":"2023-12-19T13:51:21.622953+0000","last_active":"2023-12-19T13:51:22.610170+0000","last_peered":"2023-12-19T13:51:22.610170+0000","last_clean":"2023-12-19T13:51:22.610170+0000","last_became_active":"2023-12-19T13:51:21.621806+0000","last_became_peered":"2023-12-19T13:51:21.621806+0000","last_unstale":"2023-12-19T13:51:22.610170+0000","last_undegraded":"2023-12-19T13:51:22.610170+0000","last_fullsized":"2023-12-19T13:51:22.610170+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:58.951316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.605393+0000","last_change":"2023-12-19T13:51:21.133910+0000","last_active":"2023-12-19T13:51:21.605393+0000","last_peered":"2023-12-19T13:51:21.605393+0000","last_clean":"2023-12-19T13:51:21.605393+0000","last_became_active":"2023-12-19T13:51:21.125262+0000","last_became_peered":"2023-12-19T13:51:21.125262+0000","last_unstale":"2023-12-19T13:51:21.605393+0000","last_undegraded":"2023-12-19T13:51:21.605393+0000","last_fullsized":"2023-12-19T13:51:21.605393+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:04.947835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837254+0000","last_change":"2023-12-19T13:51:21.621169+0000","last_active":"2023-12-19T13:51:22.837254+0000","last_peered":"2023-12-19T13:51:22.837254+0000","last_clean":"2023-12-19T13:51:22.837254+0000","last_became_active":"2023-12-19T13:51:21.620952+0000","last_became_peered":"2023-12-19T13:51:21.620952+0000","last_unstale":"2023-12-19T13:51:22.837254+0000","last_undegraded":"2023-12-19T13:51:22.837254+0000","last_fullsized":"2023-12-19T13:51:22.837254+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:20.785199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613111+0000","last_change":"2023-12-19T13:51:21.131727+0000","last_active":"2023-12-19T13:51:21.613111+0000","last_peered":"2023-12-19T13:51:21.613111+0000","last_clean":"2023-12-19T13:51:21.613111+0000","last_became_active":"2023-12-19T13:51:21.131432+0000","last_became_peered":"2023-12-19T13:51:21.131432+0000","last_unstale":"2023-12-19T13:51:21.613111+0000","last_undegraded":"2023-12-19T13:51:21.613111+0000","last_fullsized":"2023-12-19T13:51:21.613111+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:57.935372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836833+0000","last_change":"2023-12-19T13:51:21.616055+0000","last_active":"2023-12-19T13:51:22.836833+0000","last_peered":"2023-12-19T13:51:22.836833+0000","last_clean":"2023-12-19T13:51:22.836833+0000","last_became_active":"2023-12-19T13:51:21.615795+0000","last_became_peered":"2023-12-19T13:51:21.615795+0000","last_unstale":"2023-12-19T13:51:22.836833+0000","last_undegraded":"2023-12-19T13:51:22.836833+0000","last_fullsized":"2023-12-19T13:51:22.836833+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:15.599647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"93'3","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.622842+0000","last_change":"2023-12-19T13:51:21.135986+0000","last_active":"2023-12-19T13:51:21.622842+0000","last_peered":"2023-12-19T13:51:21.622842+0000","last_clean":"2023-12-19T13:51:21.622842+0000","last_became_active":"2023-12-19T13:51:21.135713+0000","last_became_peered":"2023-12-19T13:51:21.135713+0000","last_unstale":"2023-12-19T13:51:21.622842+0000","last_undegraded":"2023-12-19T13:51:21.622842+0000","last_fullsized":"2023-12-19T13:51:21.622842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613134+0000","last_change":"2023-12-19T13:51:21.623324+0000","last_active":"2023-12-19T13:51:22.613134+0000","last_peered":"2023-12-19T13:51:22.613134+0000","last_clean":"2023-12-19T13:51:22.613134+0000","last_became_active":"2023-12-19T13:51:21.623042+0000","last_became_peered":"2023-12-19T13:51:21.623042+0000","last_unstale":"2023-12-19T13:51:22.613134+0000","last_undegraded":"2023-12-19T13:51:22.613134+0000","last_fullsized":"2023-12-19T13:51:22.613134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:52.450701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.631043+0000","last_change":"2023-12-19T13:51:21.137800+0000","last_active":"2023-12-19T13:51:21.631043+0000","last_peered":"2023-12-19T13:51:21.631043+0000","last_clean":"2023-12-19T13:51:21.631043+0000","last_became_active":"2023-12-19T13:51:21.137360+0000","last_became_peered":"2023-12-19T13:51:21.137360+0000","last_unstale":"2023-12-19T13:51:21.631043+0000","last_undegraded":"2023-12-19T13:51:21.631043+0000","last_fullsized":"2023-12-19T13:51:21.631043+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835757+0000","last_change":"2023-12-19T13:51:21.615969+0000","last_active":"2023-12-19T13:51:22.835757+0000","last_peered":"2023-12-19T13:51:22.835757+0000","last_clean":"2023-12-19T13:51:22.835757+0000","last_became_active":"2023-12-19T13:51:21.615477+0000","last_became_peered":"2023-12-19T13:51:21.615477+0000","last_unstale":"2023-12-19T13:51:22.835757+0000","last_undegraded":"2023-12-19T13:51:22.835757+0000","last_fullsized":"2023-12-19T13:51:22.835757+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:03.268384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.619861+0000","last_change":"2023-12-19T13:51:21.132662+0000","last_active":"2023-12-19T13:51:21.619861+0000","last_peered":"2023-12-19T13:51:21.619861+0000","last_clean":"2023-12-19T13:51:21.619861+0000","last_became_active":"2023-12-19T13:51:21.132358+0000","last_became_peered":"2023-12-19T13:51:21.132358+0000","last_unstale":"2023-12-19T13:51:21.619861+0000","last_undegraded":"2023-12-19T13:51:21.619861+0000","last_fullsized":"2023-12-19T13:51:21.619861+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610953+0000","last_change":"2023-12-19T13:51:21.625560+0000","last_active":"2023-12-19T13:51:22.610953+0000","last_peered":"2023-12-19T13:51:22.610953+0000","last_clean":"2023-12-19T13:51:22.610953+0000","last_became_active":"2023-12-19T13:51:21.621547+0000","last_became_peered":"2023-12-19T13:51:21.621547+0000","last_unstale":"2023-12-19T13:51:22.610953+0000","last_undegraded":"2023-12-19T13:51:22.610953+0000","last_fullsized":"2023-12-19T13:51:22.610953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:29.374283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609059+0000","last_change":"2023-12-19T13:51:21.134006+0000","last_active":"2023-12-19T13:51:21.609059+0000","last_peered":"2023-12-19T13:51:21.609059+0000","last_clean":"2023-12-19T13:51:21.609059+0000","last_became_active":"2023-12-19T13:51:21.133703+0000","last_became_peered":"2023-12-19T13:51:21.133703+0000","last_unstale":"2023-12-19T13:51:21.609059+0000","last_undegraded":"2023-12-19T13:51:21.609059+0000","last_fullsized":"2023-12-19T13:51:21.609059+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.505599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613356+0000","last_change":"2023-12-19T13:51:21.611420+0000","last_active":"2023-12-19T13:51:22.613356+0000","last_peered":"2023-12-19T13:51:22.613356+0000","last_clean":"2023-12-19T13:51:22.613356+0000","last_became_active":"2023-12-19T13:51:21.611175+0000","last_became_peered":"2023-12-19T13:51:21.611175+0000","last_unstale":"2023-12-19T13:51:22.613356+0000","last_undegraded":"2023-12-19T13:51:22.613356+0000","last_fullsized":"2023-12-19T13:51:22.613356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:33.422417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.615241+0000","last_change":"2023-12-19T13:51:21.130998+0000","last_active":"2023-12-19T13:51:21.615241+0000","last_peered":"2023-12-19T13:51:21.615241+0000","last_clean":"2023-12-19T13:51:21.615241+0000","last_became_active":"2023-12-19T13:51:21.130665+0000","last_became_peered":"2023-12-19T13:51:21.130665+0000","last_unstale":"2023-12-19T13:51:21.615241+0000","last_undegraded":"2023-12-19T13:51:21.615241+0000","last_fullsized":"2023-12-19T13:51:21.615241+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:21.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612836+0000","last_change":"2023-12-19T13:51:21.621714+0000","last_active":"2023-12-19T13:51:22.612836+0000","last_peered":"2023-12-19T13:51:22.612836+0000","last_clean":"2023-12-19T13:51:22.612836+0000","last_became_active":"2023-12-19T13:51:21.621113+0000","last_became_peered":"2023-12-19T13:51:21.621113+0000","last_unstale":"2023-12-19T13:51:22.612836+0000","last_undegraded":"2023-12-19T13:51:22.612836+0000","last_fullsized":"2023-12-19T13:51:22.612836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:22.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"93'8","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629662+0000","last_change":"2023-12-19T13:51:21.132417+0000","last_active":"2023-12-19T13:51:21.629662+0000","last_peered":"2023-12-19T13:51:21.629662+0000","last_clean":"2023-12-19T13:51:21.629662+0000","last_became_active":"2023-12-19T13:51:21.131929+0000","last_became_peered":"2023-12-19T13:51:21.131929+0000","last_unstale":"2023-12-19T13:51:21.629662+0000","last_undegraded":"2023-12-19T13:51:21.629662+0000","last_fullsized":"2023-12-19T13:51:21.629662+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:18.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836662+0000","last_change":"2023-12-19T13:51:21.614546+0000","last_active":"2023-12-19T13:51:22.836662+0000","last_peered":"2023-12-19T13:51:22.836662+0000","last_clean":"2023-12-19T13:51:22.836662+0000","last_became_active":"2023-12-19T13:51:21.613967+0000","last_became_peered":"2023-12-19T13:51:21.613967+0000","last_unstale":"2023-12-19T13:51:22.836662+0000","last_undegraded":"2023-12-19T13:51:22.836662+0000","last_fullsized":"2023-12-19T13:51:22.836662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.623277+0000","last_change":"2023-12-19T13:51:21.131983+0000","last_active":"2023-12-19T13:51:21.623277+0000","last_peered":"2023-12-19T13:51:21.623277+0000","last_clean":"2023-12-19T13:51:21.623277+0000","last_became_active":"2023-12-19T13:51:21.129090+0000","last_became_peered":"2023-12-19T13:51:21.129090+0000","last_unstale":"2023-12-19T13:51:21.623277+0000","last_undegraded":"2023-12-19T13:51:21.623277+0000","last_fullsized":"2023-12-19T13:51:21.623277+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:58.943405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.834953+0000","last_change":"2023-12-19T13:51:21.619897+0000","last_active":"2023-12-19T13:51:22.834953+0000","last_peered":"2023-12-19T13:51:22.834953+0000","last_clean":"2023-12-19T13:51:22.834953+0000","last_became_active":"2023-12-19T13:51:21.619635+0000","last_became_peered":"2023-12-19T13:51:21.619635+0000","last_unstale":"2023-12-19T13:51:22.834953+0000","last_undegraded":"2023-12-19T13:51:22.834953+0000","last_fullsized":"2023-12-19T13:51:22.834953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:44.863019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629193+0000","last_change":"2023-12-19T13:51:21.125390+0000","last_active":"2023-12-19T13:51:21.629193+0000","last_peered":"2023-12-19T13:51:21.629193+0000","last_clean":"2023-12-19T13:51:21.629193+0000","last_became_active":"2023-12-19T13:51:21.124784+0000","last_became_peered":"2023-12-19T13:51:21.124784+0000","last_unstale":"2023-12-19T13:51:21.629193+0000","last_undegraded":"2023-12-19T13:51:21.629193+0000","last_fullsized":"2023-12-19T13:51:21.629193+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613077+0000","last_change":"2023-12-19T13:51:21.617669+0000","last_active":"2023-12-19T13:51:22.613077+0000","last_peered":"2023-12-19T13:51:22.613077+0000","last_clean":"2023-12-19T13:51:22.613077+0000","last_became_active":"2023-12-19T13:51:21.617426+0000","last_became_peered":"2023-12-19T13:51:21.617426+0000","last_unstale":"2023-12-19T13:51:22.613077+0000","last_undegraded":"2023-12-19T13:51:22.613077+0000","last_fullsized":"2023-12-19T13:51:22.613077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:58.951316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.625960+0000","last_change":"2023-12-19T13:51:21.118045+0000","last_active":"2023-12-19T13:51:21.625960+0000","last_peered":"2023-12-19T13:51:21.625960+0000","last_clean":"2023-12-19T13:51:21.625960+0000","last_became_active":"2023-12-19T13:51:21.116479+0000","last_became_peered":"2023-12-19T13:51:21.116479+0000","last_unstale":"2023-12-19T13:51:21.625960+0000","last_undegraded":"2023-12-19T13:51:21.625960+0000","last_fullsized":"2023-12-19T13:51:21.625960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613156+0000","last_change":"2023-12-19T13:51:21.624990+0000","last_active":"2023-12-19T13:51:22.613156+0000","last_peered":"2023-12-19T13:51:22.613156+0000","last_clean":"2023-12-19T13:51:22.613156+0000","last_became_active":"2023-12-19T13:51:21.623985+0000","last_became_peered":"2023-12-19T13:51:21.623985+0000","last_unstale":"2023-12-19T13:51:22.613156+0000","last_undegraded":"2023-12-19T13:51:22.613156+0000","last_fullsized":"2023-12-19T13:51:22.613156+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:09.082207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609844+0000","last_change":"2023-12-19T13:51:21.136844+0000","last_active":"2023-12-19T13:51:21.609844+0000","last_peered":"2023-12-19T13:51:21.609844+0000","last_clean":"2023-12-19T13:51:21.609844+0000","last_became_active":"2023-12-19T13:51:21.136289+0000","last_became_peered":"2023-12-19T13:51:21.136289+0000","last_unstale":"2023-12-19T13:51:21.609844+0000","last_undegraded":"2023-12-19T13:51:21.609844+0000","last_fullsized":"2023-12-19T13:51:21.609844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836045+0000","last_change":"2023-12-19T13:51:21.618732+0000","last_active":"2023-12-19T13:51:22.836045+0000","last_peered":"2023-12-19T13:51:22.836045+0000","last_clean":"2023-12-19T13:51:22.836045+0000","last_became_active":"2023-12-19T13:51:21.618463+0000","last_became_peered":"2023-12-19T13:51:21.618463+0000","last_unstale":"2023-12-19T13:51:22.836045+0000","last_undegraded":"2023-12-19T13:51:22.836045+0000","last_fullsized":"2023-12-19T13:51:22.836045+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:06.035963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.608659+0000","last_change":"2023-12-19T13:51:21.133241+0000","last_active":"2023-12-19T13:51:21.608659+0000","last_peered":"2023-12-19T13:51:21.608659+0000","last_clean":"2023-12-19T13:51:21.608659+0000","last_became_active":"2023-12-19T13:51:21.132972+0000","last_became_peered":"2023-12-19T13:51:21.132972+0000","last_unstale":"2023-12-19T13:51:21.608659+0000","last_undegraded":"2023-12-19T13:51:21.608659+0000","last_fullsized":"2023-12-19T13:51:21.608659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835905+0000","last_change":"2023-12-19T13:51:21.626864+0000","last_active":"2023-12-19T13:51:22.835905+0000","last_peered":"2023-12-19T13:51:22.835905+0000","last_clean":"2023-12-19T13:51:22.835905+0000","last_became_active":"2023-12-19T13:51:21.626596+0000","last_became_peered":"2023-12-19T13:51:21.626596+0000","last_unstale":"2023-12-19T13:51:22.835905+0000","last_undegraded":"2023-12-19T13:51:22.835905+0000","last_fullsized":"2023-12-19T13:51:22.835905+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:08.251827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613650+0000","last_change":"2023-12-19T13:51:21.132021+0000","last_active":"2023-12-19T13:51:21.613650+0000","last_peered":"2023-12-19T13:51:21.613650+0000","last_clean":"2023-12-19T13:51:21.613650+0000","last_became_active":"2023-12-19T13:51:21.131440+0000","last_became_peered":"2023-12-19T13:51:21.131440+0000","last_unstale":"2023-12-19T13:51:21.613650+0000","last_undegraded":"2023-12-19T13:51:21.613650+0000","last_fullsized":"2023-12-19T13:51:21.613650+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:25.807837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827997+0000","last_change":"2023-12-19T13:51:21.619998+0000","last_active":"2023-12-19T13:51:22.827997+0000","last_peered":"2023-12-19T13:51:22.827997+0000","last_clean":"2023-12-19T13:51:22.827997+0000","last_became_active":"2023-12-19T13:51:21.619313+0000","last_became_peered":"2023-12-19T13:51:21.619313+0000","last_unstale":"2023-12-19T13:51:22.827997+0000","last_undegraded":"2023-12-19T13:51:22.827997+0000","last_fullsized":"2023-12-19T13:51:22.827997+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.606198+0000","last_change":"2023-12-19T13:51:21.133757+0000","last_active":"2023-12-19T13:51:21.606198+0000","last_peered":"2023-12-19T13:51:21.606198+0000","last_clean":"2023-12-19T13:51:21.606198+0000","last_became_active":"2023-12-19T13:51:21.133496+0000","last_became_peered":"2023-12-19T13:51:21.133496+0000","last_unstale":"2023-12-19T13:51:21.606198+0000","last_undegraded":"2023-12-19T13:51:21.606198+0000","last_fullsized":"2023-12-19T13:51:21.606198+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:45:17.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613608+0000","last_change":"2023-12-19T13:51:21.619584+0000","last_active":"2023-12-19T13:51:22.613608+0000","last_peered":"2023-12-19T13:51:22.613608+0000","last_clean":"2023-12-19T13:51:22.613608+0000","last_became_active":"2023-12-19T13:51:21.619253+0000","last_became_peered":"2023-12-19T13:51:21.619253+0000","last_unstale":"2023-12-19T13:51:22.613608+0000","last_undegraded":"2023-12-19T13:51:22.613608+0000","last_fullsized":"2023-12-19T13:51:22.613608+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:51.299215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.622980+0000","last_change":"2023-12-19T13:51:21.130747+0000","last_active":"2023-12-19T13:51:21.622980+0000","last_peered":"2023-12-19T13:51:21.622980+0000","last_clean":"2023-12-19T13:51:21.622980+0000","last_became_active":"2023-12-19T13:51:21.130351+0000","last_became_peered":"2023-12-19T13:51:21.130351+0000","last_unstale":"2023-12-19T13:51:21.622980+0000","last_undegraded":"2023-12-19T13:51:21.622980+0000","last_fullsized":"2023-12-19T13:51:21.622980+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:56.831505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610292+0000","last_change":"2023-12-19T13:51:21.623162+0000","last_active":"2023-12-19T13:51:22.610292+0000","last_peered":"2023-12-19T13:51:22.610292+0000","last_clean":"2023-12-19T13:51:22.610292+0000","last_became_active":"2023-12-19T13:51:21.622164+0000","last_became_peered":"2023-12-19T13:51:21.622164+0000","last_unstale":"2023-12-19T13:51:22.610292+0000","last_undegraded":"2023-12-19T13:51:22.610292+0000","last_fullsized":"2023-12-19T13:51:22.610292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:43:25.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.601067+0000","last_change":"2023-12-19T13:51:21.133834+0000","last_active":"2023-12-19T13:51:21.601067+0000","last_peered":"2023-12-19T13:51:21.601067+0000","last_clean":"2023-12-19T13:51:21.601067+0000","last_became_active":"2023-12-19T13:51:21.132246+0000","last_became_peered":"2023-12-19T13:51:21.132246+0000","last_unstale":"2023-12-19T13:51:21.601067+0000","last_undegraded":"2023-12-19T13:51:21.601067+0000","last_fullsized":"2023-12-19T13:51:21.601067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:10.952331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836902+0000","last_change":"2023-12-19T13:51:21.618736+0000","last_active":"2023-12-19T13:51:22.836902+0000","last_peered":"2023-12-19T13:51:22.836902+0000","last_clean":"2023-12-19T13:51:22.836902+0000","last_became_active":"2023-12-19T13:51:21.618234+0000","last_became_peered":"2023-12-19T13:51:21.618234+0000","last_unstale":"2023-12-19T13:51:22.836902+0000","last_undegraded":"2023-12-19T13:51:22.836902+0000","last_fullsized":"2023-12-19T13:51:22.836902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.611878+0000","last_change":"2023-12-19T13:51:21.132015+0000","last_active":"2023-12-19T13:51:21.611878+0000","last_peered":"2023-12-19T13:51:21.611878+0000","last_clean":"2023-12-19T13:51:21.611878+0000","last_became_active":"2023-12-19T13:51:21.131690+0000","last_became_peered":"2023-12-19T13:51:21.131690+0000","last_unstale":"2023-12-19T13:51:21.611878+0000","last_undegraded":"2023-12-19T13:51:21.611878+0000","last_fullsized":"2023-12-19T13:51:21.611878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:40.451591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610186+0000","last_change":"2023-12-19T13:51:21.618492+0000","last_active":"2023-12-19T13:51:22.610186+0000","last_peered":"2023-12-19T13:51:22.610186+0000","last_clean":"2023-12-19T13:51:22.610186+0000","last_became_active":"2023-12-19T13:51:21.617417+0000","last_became_peered":"2023-12-19T13:51:21.617417+0000","last_unstale":"2023-12-19T13:51:22.610186+0000","last_undegraded":"2023-12-19T13:51:22.610186+0000","last_fullsized":"2023-12-19T13:51:22.610186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:22.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.610036+0000","last_change":"2023-12-19T13:51:21.135208+0000","last_active":"2023-12-19T13:51:21.610036+0000","last_peered":"2023-12-19T13:51:21.610036+0000","last_clean":"2023-12-19T13:51:21.610036+0000","last_became_active":"2023-12-19T13:51:21.134819+0000","last_became_peered":"2023-12-19T13:51:21.134819+0000","last_unstale":"2023-12-19T13:51:21.610036+0000","last_undegraded":"2023-12-19T13:51:21.610036+0000","last_fullsized":"2023-12-19T13:51:21.610036+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614255+0000","last_change":"2023-12-19T13:51:21.621039+0000","last_active":"2023-12-19T13:51:22.614255+0000","last_peered":"2023-12-19T13:51:22.614255+0000","last_clean":"2023-12-19T13:51:22.614255+0000","last_became_active":"2023-12-19T13:51:21.618835+0000","last_became_peered":"2023-12-19T13:51:21.618835+0000","last_unstale":"2023-12-19T13:51:22.614255+0000","last_undegraded":"2023-12-19T13:51:22.614255+0000","last_fullsized":"2023-12-19T13:51:22.614255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:38.923169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.612956+0000","last_change":"2023-12-19T13:51:21.133119+0000","last_active":"2023-12-19T13:51:21.612956+0000","last_peered":"2023-12-19T13:51:21.612956+0000","last_clean":"2023-12-19T13:51:21.612956+0000","last_became_active":"2023-12-19T13:51:21.132840+0000","last_became_peered":"2023-12-19T13:51:21.132840+0000","last_unstale":"2023-12-19T13:51:21.612956+0000","last_undegraded":"2023-12-19T13:51:21.612956+0000","last_fullsized":"2023-12-19T13:51:21.612956+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837785+0000","last_change":"2023-12-19T13:51:21.614966+0000","last_active":"2023-12-19T13:51:22.837785+0000","last_peered":"2023-12-19T13:51:22.837785+0000","last_clean":"2023-12-19T13:51:22.837785+0000","last_became_active":"2023-12-19T13:51:21.614610+0000","last_became_peered":"2023-12-19T13:51:21.614610+0000","last_unstale":"2023-12-19T13:51:22.837785+0000","last_undegraded":"2023-12-19T13:51:22.837785+0000","last_fullsized":"2023-12-19T13:51:22.837785+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:59.183585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.605419+0000","last_change":"2023-12-19T13:51:21.136671+0000","last_active":"2023-12-19T13:51:21.605419+0000","last_peered":"2023-12-19T13:51:21.605419+0000","last_clean":"2023-12-19T13:51:21.605419+0000","last_became_active":"2023-12-19T13:51:21.136215+0000","last_became_peered":"2023-12-19T13:51:21.136215+0000","last_unstale":"2023-12-19T13:51:21.605419+0000","last_undegraded":"2023-12-19T13:51:21.605419+0000","last_fullsized":"2023-12-19T13:51:21.605419+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:00.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835383+0000","last_change":"2023-12-19T13:51:21.630170+0000","last_active":"2023-12-19T13:51:22.835383+0000","last_peered":"2023-12-19T13:51:22.835383+0000","last_clean":"2023-12-19T13:51:22.835383+0000","last_became_active":"2023-12-19T13:51:21.628999+0000","last_became_peered":"2023-12-19T13:51:21.628999+0000","last_unstale":"2023-12-19T13:51:22.835383+0000","last_undegraded":"2023-12-19T13:51:22.835383+0000","last_fullsized":"2023-12-19T13:51:22.835383+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:53.765998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613359+0000","last_change":"2023-12-19T13:51:21.128127+0000","last_active":"2023-12-19T13:51:21.613359+0000","last_peered":"2023-12-19T13:51:21.613359+0000","last_clean":"2023-12-19T13:51:21.613359+0000","last_became_active":"2023-12-19T13:51:21.127723+0000","last_became_peered":"2023-12-19T13:51:21.127723+0000","last_unstale":"2023-12-19T13:51:21.613359+0000","last_undegraded":"2023-12-19T13:51:21.613359+0000","last_fullsized":"2023-12-19T13:51:21.613359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835463+0000","last_change":"2023-12-19T13:51:21.619961+0000","last_active":"2023-12-19T13:51:22.835463+0000","last_peered":"2023-12-19T13:51:22.835463+0000","last_clean":"2023-12-19T13:51:22.835463+0000","last_became_active":"2023-12-19T13:51:21.619754+0000","last_became_peered":"2023-12-19T13:51:21.619754+0000","last_unstale":"2023-12-19T13:51:22.835463+0000","last_undegraded":"2023-12-19T13:51:22.835463+0000","last_fullsized":"2023-12-19T13:51:22.835463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:41.467535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.608758+0000","last_change":"2023-12-19T13:51:21.137585+0000","last_active":"2023-12-19T13:51:21.608758+0000","last_peered":"2023-12-19T13:51:21.608758+0000","last_clean":"2023-12-19T13:51:21.608758+0000","last_became_active":"2023-12-19T13:51:21.137411+0000","last_became_peered":"2023-12-19T13:51:21.137411+0000","last_unstale":"2023-12-19T13:51:21.608758+0000","last_undegraded":"2023-12-19T13:51:21.608758+0000","last_fullsized":"2023-12-19T13:51:21.608758+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613898+0000","last_change":"2023-12-19T13:51:21.610199+0000","last_active":"2023-12-19T13:51:22.613898+0000","last_peered":"2023-12-19T13:51:22.613898+0000","last_clean":"2023-12-19T13:51:22.613898+0000","last_became_active":"2023-12-19T13:51:21.609353+0000","last_became_peered":"2023-12-19T13:51:21.609353+0000","last_unstale":"2023-12-19T13:51:22.613898+0000","last_undegraded":"2023-12-19T13:51:22.613898+0000","last_fullsized":"2023-12-19T13:51:22.613898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:22.398005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629828+0000","last_change":"2023-12-19T13:51:21.134430+0000","last_active":"2023-12-19T13:51:21.629828+0000","last_peered":"2023-12-19T13:51:21.629828+0000","last_clean":"2023-12-19T13:51:21.629828+0000","last_became_active":"2023-12-19T13:51:21.134119+0000","last_became_peered":"2023-12-19T13:51:21.134119+0000","last_unstale":"2023-12-19T13:51:21.629828+0000","last_undegraded":"2023-12-19T13:51:21.629828+0000","last_fullsized":"2023-12-19T13:51:21.629828+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:33.558661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":234,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.606881+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:51:21.606881+0000","last_peered":"2023-12-19T13:51:21.606881+0000","last_clean":"2023-12-19T13:51:21.606881+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:51:21.606881+0000","last_undegraded":"2023-12-19T13:51:21.606881+0000","last_fullsized":"2023-12-19T13:51:21.606881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.048,"15min":1.0129999999999999},"min":{"1min":0.68600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6950000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0389999999999999,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7190000000000001,"5min":2.008,"15min":2.008},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.117,"15min":1.0820000000000001},"min":{"1min":0.94799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.6459999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.071,"15min":1.038},"min":{"1min":0.78700000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.9870000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1359999999999999},"min":{"1min":0.98099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.653,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.351},{"interface":"front","average":{"1min":1.137,"5min":1.171,"15min":1.147},"min":{"1min":0.77400000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6859999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3069999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1930000000000001,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7070000000000001,"5min":1.931,"15min":1.931},"last":1.204},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":0.85499999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.0980000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.274,"15min":1.284},"min":{"1min":0.88400000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.609,"5min":2.181,"15min":2.181},"last":1.417},{"interface":"front","average":{"1min":1.377,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.86499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8400000000000001,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.397}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2470000000000001,"15min":1.2250000000000001},"min":{"1min":0.82499999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8660000000000001,"5min":1.956,"15min":1.956},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.81999999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.76,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3120000000000001,"15min":1.268},"min":{"1min":0.97399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.927,"5min":2.024,"15min":2.024},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.506,"15min":1.488},"min":{"1min":1.1399999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8180000000000001,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.571}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491024,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.552,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0840000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.97899999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0680000000000001,"15min":1.036},"min":{"1min":0.71899999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.962,"15min":1.962},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.099,"15min":1.044},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.466,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1719999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.252,"15min":1.224},"min":{"1min":0.84899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.702,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.3460000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3440000000000001},"min":{"1min":0.91100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7030000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2569999999999999,"15min":1.2689999999999999},"min":{"1min":0.85199999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5840000000000001,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.706}]},{"osd":4,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2430000000000001,"15min":1.2090000000000001},"min":{"1min":0.94299999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7350000000000001,"5min":1.865,"15min":1.865},"last":1.411},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3300000000000001,"15min":1.298},"min":{"1min":0.98099999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.5580000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2869999999999999,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.827,"15min":1.827},"last":1.962},{"interface":"front","average":{"1min":1.323,"5min":1.3919999999999999,"15min":1.369},"min":{"1min":0.95399999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.629,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0820000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9870000000000001,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.387,"15min":1.3580000000000001},"min":{"1min":1.026,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.756,"5min":1.766,"15min":1.766},"last":1.8300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194240,"statfs":{"total":200000000,"available":198902164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0209999999999999,"15min":0.99099999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7669999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.1259999999999999,"15min":1.0860000000000001},"min":{"1min":0.67500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.478,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.86099999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0840000000000001,"15min":1.0940000000000001},"min":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5840000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1080000000000001,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6399999999999999,"5min":2.077,"15min":2.077},"last":1.129}]},{"osd":2,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2490000000000001,"15min":1.2609999999999999},"min":{"1min":0.88200000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2469999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2529999999999999,"15min":1.27},"min":{"1min":0.90100000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.2730000000000001,"5min":2.863,"15min":2.863},"last":0.94199999999999995}]},{"osd":3,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3009999999999999,"15min":1.2350000000000001},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5780000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.256,"15min":1.246},"min":{"1min":1.0009999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.522,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1879999999999999,"15min":1.149},"min":{"1min":0.874,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.857,"5min":1.982,"15min":1.982},"last":1.319},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.353,"15min":1.302},"min":{"1min":1.0269999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6699999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.091}]},{"osd":6,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3680000000000001,"15min":1.325},"min":{"1min":0.94099999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.843,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.05},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3520000000000001,"15min":1.3680000000000001},"min":{"1min":0.81100000000000005,"5min":0.748,"15min":0.748},"max":{"1min":1.9039999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.4119999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.474,"15min":1.427},"min":{"1min":1.131,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7430000000000001,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.204},{"interface":"front","average":{"1min":1.496,"5min":1.4690000000000001,"15min":1.417},"min":{"1min":1.2509999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9059999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.369}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199491928,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.004,"15min":0.99199999999999999},"min":{"1min":0.70999999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.548,"5min":1.657,"15min":1.657},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.85099999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":2.016,"15min":2.016},"last":0.94299999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.0660000000000001},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3580000000000001,"5min":1.621,"15min":1.621},"last":1.02},{"interface":"front","average":{"1min":1.194,"5min":1.115,"15min":1.119},"min":{"1min":0.82399999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.2470000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0960000000000001,"15min":1.03},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.591,"5min":1.611,"15min":1.611},"last":1.22},{"interface":"front","average":{"1min":1.179,"5min":1.127,"15min":1.1100000000000001},"min":{"1min":0.97599999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.218,"15min":1.214},"min":{"1min":0.73299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.796,"5min":1.952,"15min":1.952},"last":1.337},{"interface":"front","average":{"1min":1.274,"5min":1.256,"15min":1.274},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.585,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.508}]},{"osd":5,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2190000000000001,"15min":1.2490000000000001},"min":{"1min":0.84099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.75,"5min":2.165,"15min":2.165},"last":1.369},{"interface":"front","average":{"1min":1.369,"5min":1.3280000000000001,"15min":1.3440000000000001},"min":{"1min":0.69299999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.863,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.581}]},{"osd":6,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3500000000000001,"15min":1.397},"min":{"1min":0.78800000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6419999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.653},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":1.2,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.4590000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.45,"15min":1.46},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.9550000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.72},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4950000000000001,"15min":1.52},"min":{"1min":1.091,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7989999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.804}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.92900000000000005},"min":{"1min":0.48899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.5069999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89600000000000002,"15min":0.96199999999999997},"min":{"1min":0.45300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3360000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.94199999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0920000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.433},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93200000000000005,"15min":0.98299999999999998},"min":{"1min":0.52500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.387,"15min":2.387},"last":0.60999999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.996,"15min":1.036},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0169999999999999,"15min":1.117},"min":{"1min":0.42999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4450000000000001,"5min":2.657,"15min":2.657},"last":1.093}]},{"osd":4,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.204,"15min":1.262},"min":{"1min":0.82599999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.718,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.208,"15min":1.23},"min":{"1min":0.77200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.681,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2410000000000001,"15min":1.3009999999999999},"min":{"1min":0.71199999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.548,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.70699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.528,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.073}]},{"osd":6,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2609999999999999,"15min":1.304},"min":{"1min":0.82799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5920000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3420000000000001},"min":{"1min":0.878,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7490000000000001,"5min":2.698,"15min":2.698},"last":1.2150000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.319,"15min":1.3700000000000001},"min":{"1min":1.0529999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6879999999999999,"5min":3.609,"15min":3.609},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.363,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.655,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.1359999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492040,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.544,"5min":2.258,"15min":2.258},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.94199999999999995,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3560000000000001,"5min":11.85,"15min":11.85},"last":0.96999999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.5880000000000001,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.048,"15min":0.93500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5349999999999999,"5min":11.788,"15min":11.788},"last":1.034}]},{"osd":3,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.93400000000000005,"15min":0.93899999999999995},"min":{"1min":0.621,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6599999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.997},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0720000000000001,"15min":1.032},"min":{"1min":0.66200000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4950000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.95199999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2789999999999999,"15min":1.1659999999999999},"min":{"1min":0.90100000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.6639999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.155},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2230000000000001,"15min":1.2250000000000001},"min":{"1min":0.84499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7210000000000001,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.677}]},{"osd":5,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.355,"15min":1.2310000000000001},"min":{"1min":0.92400000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.726,"5min":11.888,"15min":11.888},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.94799999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7589999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.3759999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":0.93899999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.843,"5min":2.964,"15min":2.964},"last":1.135},{"interface":"front","average":{"1min":1.351,"5min":1.284,"15min":1.256},"min":{"1min":0.92900000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.929,"5min":2.286,"15min":2.286},"last":1.575}]},{"osd":7,"last update":"Tue Dec 19 13:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.321,"15min":1.3109999999999999},"min":{"1min":1.099,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":2.351,"15min":2.351},"last":1.319},{"interface":"front","average":{"1min":1.333,"5min":1.395,"15min":1.2889999999999999},"min":{"1min":0.81399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8200000000000001,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.456}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194240,"statfs":{"total":200000000,"available":198902254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78500000000000003,"15min":0.81899999999999995},"min":{"1min":0.33700000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1990000000000001,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.62,"5min":0.435,"15min":0.435},"max":{"1min":1.4590000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.752}]},{"osd":2,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":1.077},"min":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.383,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1830000000000001},"min":{"1min":0.60299999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.452,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.022}]},{"osd":3,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.075,"15min":1.075},"min":{"1min":0.501,"5min":0.5,"15min":0.5},"max":{"1min":1.502,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.1830000000000001},"min":{"1min":0.52700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.357,"5min":7.157,"15min":7.157},"last":1.0600000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1679999999999999,"15min":1.224},"min":{"1min":0.73399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.542,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.171},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2669999999999999,"15min":1.2989999999999999},"min":{"1min":0.996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5129999999999999,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.3939999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2589999999999999,"15min":1.325},"min":{"1min":0.97299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.623,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.411,"15min":1.379},"min":{"1min":0.79400000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6799999999999999,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.0009999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.335,"15min":1.351},"min":{"1min":0.91500000000000004,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6359999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3320000000000001,"15min":1.4179999999999999},"min":{"1min":0.93899999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6899999999999999,"5min":3.786,"15min":3.786},"last":1.1459999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3859999999999999,"15min":1.45},"min":{"1min":0.88900000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.744,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3500000000000001,"15min":1.452},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7809999999999999,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.3220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.5820000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.874,"5min":1.018,"15min":0.95499999999999996},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.272,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.2509999999999999,"15min":0.995},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.25,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.4239999999999999,"15min":1.0820000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.617,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.92400000000000004,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.0569999999999999,"15min":1.099},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.0700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.878,"5min":0.746,"15min":0.746},"max":{"1min":1.5609999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.45},{"interface":"front","average":{"1min":1.292,"5min":1.353,"15min":1.2130000000000001},"min":{"1min":1.016,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8140000000000001,"5min":15.766,"15min":15.766},"last":0.93000000000000005}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3420000000000001,"15min":1.218},"min":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5189999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.306,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6279999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.512}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3140000000000001,"15min":1.258},"min":{"1min":1.0089999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8939999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.468,"15min":1.3220000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.774,"5min":17.161000000000001,"15min":17.161000000000001},"last":0.97499999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.4510000000000001,"15min":1.3300000000000001},"min":{"1min":0.86799999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6160000000000001,"5min":14.381,"15min":14.381},"last":1.25},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.409},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.5649999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:51:31.039 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:51:31.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.259+0000 7f707b273640 1 Processor -- start 2023-12-19T13:51:31.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.259+0000 7f707b273640 1 -- start start 2023-12-19T13:51:31.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.261+0000 7f707b273640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f70740ce300 0x7f707415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.261+0000 7f707b273640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707415ec30 con 0x7f707415e5a0 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.261+0000 7f707b273640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707415fbc0 con 0x7f70740b2030 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.261+0000 7f707b273640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707415e980 con 0x7f70740ce300 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.261+0000 7f707aa72640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f70740ce300 0x7f707415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.261+0000 7f707a271640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f707415e5a0 0x7f70740b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53284/0 (socket says 172.21.15.113:53284) 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.261+0000 7f707a271640 1 -- 172.21.15.113:0/1427832841 learned_addr learned my addr 172.21.15.113:0/1427832841 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.262+0000 7f707aa72640 1 -- 172.21.15.113:0/1427832841 >> v1:172.21.15.151:6789/0 conn(0x7f70740b2030 legacy=0x7f70740cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.262+0000 7f707aa72640 1 -- 172.21.15.113:0/1427832841 >> v1:172.21.15.113:6789/0 conn(0x7f707415e5a0 legacy=0x7f70740b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.262+0000 7f707aa72640 1 -- 172.21.15.113:0/1427832841 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70740b2f90 con 0x7f70740ce300 2023-12-19T13:51:31.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.263+0000 7f707aa72640 1 --2- 172.21.15.113:0/1427832841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740ce300 0x7f707415f680 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f706c009dc0 tx=0x7f706c02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398fec2dc9768da4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:31.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.263+0000 7f707926f640 1 -- 172.21.15.113:0/1427832841 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c02cc40 con 0x7f70740ce300 2023-12-19T13:51:31.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.263+0000 7f707926f640 1 -- 172.21.15.113:0/1427832841 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c02cda0 con 0x7f70740ce300 2023-12-19T13:51:31.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.263+0000 7f707926f640 1 -- 172.21.15.113:0/1427832841 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c034660 con 0x7f70740ce300 2023-12-19T13:51:31.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.264+0000 7f707b273640 1 -- 172.21.15.113:0/1427832841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740ce300 msgr2=0x7f707415f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.264+0000 7f707b273640 1 --2- 172.21.15.113:0/1427832841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740ce300 0x7f707415f680 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f706c009dc0 tx=0x7f706c02be90 comp rx=0 tx=0).stop 2023-12-19T13:51:31.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.264+0000 7f707b273640 1 -- 172.21.15.113:0/1427832841 shutdown_connections 2023-12-19T13:51:31.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.264+0000 7f707b273640 1 --2- 172.21.15.113:0/1427832841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740ce300 0x7f707415f680 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.264+0000 7f707b273640 1 -- 172.21.15.113:0/1427832841 >> 172.21.15.113:0/1427832841 conn(0x7f70740b0100 msgr2=0x7f70740b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:31.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.264+0000 7f707b273640 1 -- 172.21.15.113:0/1427832841 shutdown_connections 2023-12-19T13:51:31.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.264+0000 7f707b273640 1 -- 172.21.15.113:0/1427832841 wait complete. 2023-12-19T13:51:31.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.266+0000 7f707b273640 1 Processor -- start 2023-12-19T13:51:31.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.266+0000 7f707b273640 1 -- start start 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707b273640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740b2030 0x7f70740c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707b273640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70740ce300 0x7f70740ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707b273640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f707415e5a0 0x7f707415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707b273640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70740ca180 con 0x7f70740b2030 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707b273640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70740c9570 con 0x7f707415e5a0 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707b273640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70740c9850 con 0x7f70740ce300 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707a271640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740b2030 0x7f70740c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707a271640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740b2030 0x7f70740c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47186/0 (socket says 172.21.15.113:47186) 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.267+0000 7f707a271640 1 -- 172.21.15.113:0/2809770671 learned_addr learned my addr 172.21.15.113:0/2809770671 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707a271640 1 -- 172.21.15.113:0/2809770671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70740ce300 msgr2=0x7f70740ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707a271640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70740ce300 0x7f70740ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707aa72640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f707415e5a0 0x7f707415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707a271640 1 -- 172.21.15.113:0/2809770671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f707415e5a0 msgr2=0x7f707415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707a271640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f707415e5a0 0x7f707415b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707a271640 1 -- 172.21.15.113:0/2809770671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c009a70 con 0x7f70740b2030 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707a271640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740b2030 0x7f70740c8f00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f707000c480 tx=0x7f707000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f706affd640 1 -- 172.21.15.113:0/2809770671 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070005ce0 con 0x7f70740b2030 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f706affd640 1 -- 172.21.15.113:0/2809770671 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070005e40 con 0x7f70740b2030 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f706affd640 1 -- 172.21.15.113:0/2809770671 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70700072f0 con 0x7f70740b2030 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70740c9b30 con 0x7f70740b2030 2023-12-19T13:51:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.268+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70740cab50 con 0x7f70740b2030 2023-12-19T13:51:31.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.270+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7074061910 con 0x7f70740b2030 2023-12-19T13:51:31.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.271+0000 7f706affd640 1 -- 172.21.15.113:0/2809770671 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7070007510 con 0x7f70740b2030 2023-12-19T13:51:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.271+0000 7f706affd640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f705806a430 0x7f705806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.272+0000 7f706affd640 1 -- 172.21.15.113:0/2809770671 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7070087da0 con 0x7f70740b2030 2023-12-19T13:51:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.272+0000 7f7079a70640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f705806a430 0x7f705806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.272+0000 7f7079a70640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f705806a430 0x7f705806c8f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f70740c6520 tx=0x7f70640079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:31.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.276+0000 7f706affd640 1 -- 172.21.15.113:0/2809770671 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70700534d0 con 0x7f70740b2030 2023-12-19T13:51:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.462+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f707415ee80 con 0x7f705806a430 2023-12-19T13:51:31.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.484+0000 7f706affd640 1 -- 172.21.15.113:0/2809770671 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282384 (secure 0 0 0) 0x7f7064014400 con 0x7f705806a430 2023-12-19T13:51:31.489 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:31.491 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:51:31.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.490+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f705806a430 msgr2=0x7f705806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f705806a430 0x7f705806c8f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f70740c6520 tx=0x7f70640079b0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740b2030 msgr2=0x7f70740c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740b2030 0x7f70740c8f00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f707000c480 tx=0x7f707000c940 comp rx=0 tx=0).stop 2023-12-19T13:51:31.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 shutdown_connections 2023-12-19T13:51:31.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f705806a430 0x7f705806c8f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f707415e5a0 0x7f707415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70740ce300 0x7f70740ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 --2- 172.21.15.113:0/2809770671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70740b2030 0x7f70740c8f00 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 >> 172.21.15.113:0/2809770671 conn(0x7f70740b0100 msgr2=0x7f70740cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:31.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 shutdown_connections 2023-12-19T13:51:31.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.491+0000 7f707b273640 1 -- 172.21.15.113:0/2809770671 wait complete. 2023-12-19T13:51:31.512 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2023-12-19T13:51:30.508425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5121,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557378,"statfs":{"total":1600000000,"available":1594755516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.906546"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837299+0000","last_change":"2023-12-19T13:51:21.608902+0000","last_active":"2023-12-19T13:51:22.837299+0000","last_peered":"2023-12-19T13:51:22.837299+0000","last_clean":"2023-12-19T13:51:22.837299+0000","last_became_active":"2023-12-19T13:51:21.608103+0000","last_became_peered":"2023-12-19T13:51:21.608103+0000","last_unstale":"2023-12-19T13:51:22.837299+0000","last_undegraded":"2023-12-19T13:51:22.837299+0000","last_fullsized":"2023-12-19T13:51:22.837299+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:44.785458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835980+0000","last_change":"2023-12-19T13:51:21.622676+0000","last_active":"2023-12-19T13:51:22.835980+0000","last_peered":"2023-12-19T13:51:22.835980+0000","last_clean":"2023-12-19T13:51:22.835980+0000","last_became_active":"2023-12-19T13:51:21.622443+0000","last_became_peered":"2023-12-19T13:51:21.622443+0000","last_unstale":"2023-12-19T13:51:22.835980+0000","last_undegraded":"2023-12-19T13:51:22.835980+0000","last_fullsized":"2023-12-19T13:51:22.835980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:46.765004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613299+0000","last_change":"2023-12-19T13:51:21.622409+0000","last_active":"2023-12-19T13:51:22.613299+0000","last_peered":"2023-12-19T13:51:22.613299+0000","last_clean":"2023-12-19T13:51:22.613299+0000","last_became_active":"2023-12-19T13:51:21.621671+0000","last_became_peered":"2023-12-19T13:51:21.621671+0000","last_unstale":"2023-12-19T13:51:22.613299+0000","last_undegraded":"2023-12-19T13:51:22.613299+0000","last_fullsized":"2023-12-19T13:51:22.613299+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:26.823781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612256+0000","last_change":"2023-12-19T13:51:21.624872+0000","last_active":"2023-12-19T13:51:22.612256+0000","last_peered":"2023-12-19T13:51:22.612256+0000","last_clean":"2023-12-19T13:51:22.612256+0000","last_became_active":"2023-12-19T13:51:21.624501+0000","last_became_peered":"2023-12-19T13:51:21.624501+0000","last_unstale":"2023-12-19T13:51:22.612256+0000","last_undegraded":"2023-12-19T13:51:22.612256+0000","last_fullsized":"2023-12-19T13:51:22.612256+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:36:56.674396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614698+0000","last_change":"2023-12-19T13:51:21.616795+0000","last_active":"2023-12-19T13:51:22.614698+0000","last_peered":"2023-12-19T13:51:22.614698+0000","last_clean":"2023-12-19T13:51:22.614698+0000","last_became_active":"2023-12-19T13:51:21.615742+0000","last_became_peered":"2023-12-19T13:51:21.615742+0000","last_unstale":"2023-12-19T13:51:22.614698+0000","last_undegraded":"2023-12-19T13:51:22.614698+0000","last_fullsized":"2023-12-19T13:51:22.614698+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:11.675596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835237+0000","last_change":"2023-12-19T13:51:21.615834+0000","last_active":"2023-12-19T13:51:22.835237+0000","last_peered":"2023-12-19T13:51:22.835237+0000","last_clean":"2023-12-19T13:51:22.835237+0000","last_became_active":"2023-12-19T13:51:21.615106+0000","last_became_peered":"2023-12-19T13:51:21.615106+0000","last_unstale":"2023-12-19T13:51:22.835237+0000","last_undegraded":"2023-12-19T13:51:22.835237+0000","last_fullsized":"2023-12-19T13:51:22.835237+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:49.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610040+0000","last_change":"2023-12-19T13:51:21.626485+0000","last_active":"2023-12-19T13:51:22.610040+0000","last_peered":"2023-12-19T13:51:22.610040+0000","last_clean":"2023-12-19T13:51:22.610040+0000","last_became_active":"2023-12-19T13:51:21.626097+0000","last_became_peered":"2023-12-19T13:51:21.626097+0000","last_unstale":"2023-12-19T13:51:22.610040+0000","last_undegraded":"2023-12-19T13:51:22.610040+0000","last_fullsized":"2023-12-19T13:51:22.610040+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:06.035963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837258+0000","last_change":"2023-12-19T13:51:21.618177+0000","last_active":"2023-12-19T13:51:22.837258+0000","last_peered":"2023-12-19T13:51:22.837258+0000","last_clean":"2023-12-19T13:51:22.837258+0000","last_became_active":"2023-12-19T13:51:21.617813+0000","last_became_peered":"2023-12-19T13:51:21.617813+0000","last_unstale":"2023-12-19T13:51:22.837258+0000","last_undegraded":"2023-12-19T13:51:22.837258+0000","last_fullsized":"2023-12-19T13:51:22.837258+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:28:40.177381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612390+0000","last_change":"2023-12-19T13:51:21.615856+0000","last_active":"2023-12-19T13:51:22.612390+0000","last_peered":"2023-12-19T13:51:22.612390+0000","last_clean":"2023-12-19T13:51:22.612390+0000","last_became_active":"2023-12-19T13:51:21.615606+0000","last_became_peered":"2023-12-19T13:51:21.615606+0000","last_unstale":"2023-12-19T13:51:22.612390+0000","last_undegraded":"2023-12-19T13:51:22.612390+0000","last_fullsized":"2023-12-19T13:51:22.612390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:45.769026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610789+0000","last_change":"2023-12-19T13:51:21.627852+0000","last_active":"2023-12-19T13:51:22.610789+0000","last_peered":"2023-12-19T13:51:22.610789+0000","last_clean":"2023-12-19T13:51:22.610789+0000","last_became_active":"2023-12-19T13:51:21.625350+0000","last_became_peered":"2023-12-19T13:51:21.625350+0000","last_unstale":"2023-12-19T13:51:22.610789+0000","last_undegraded":"2023-12-19T13:51:22.610789+0000","last_fullsized":"2023-12-19T13:51:22.610789+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:55:27.380130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837520+0000","last_change":"2023-12-19T13:51:21.615408+0000","last_active":"2023-12-19T13:51:22.837520+0000","last_peered":"2023-12-19T13:51:22.837520+0000","last_clean":"2023-12-19T13:51:22.837520+0000","last_became_active":"2023-12-19T13:51:21.615203+0000","last_became_peered":"2023-12-19T13:51:21.615203+0000","last_unstale":"2023-12-19T13:51:22.837520+0000","last_undegraded":"2023-12-19T13:51:22.837520+0000","last_fullsized":"2023-12-19T13:51:22.837520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:20.623213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827738+0000","last_change":"2023-12-19T13:51:21.620310+0000","last_active":"2023-12-19T13:51:22.827738+0000","last_peered":"2023-12-19T13:51:22.827738+0000","last_clean":"2023-12-19T13:51:22.827738+0000","last_became_active":"2023-12-19T13:51:21.620063+0000","last_became_peered":"2023-12-19T13:51:21.620063+0000","last_unstale":"2023-12-19T13:51:22.827738+0000","last_undegraded":"2023-12-19T13:51:22.827738+0000","last_fullsized":"2023-12-19T13:51:22.827738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:11.707161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613420+0000","last_change":"2023-12-19T13:51:21.622614+0000","last_active":"2023-12-19T13:51:22.613420+0000","last_peered":"2023-12-19T13:51:22.613420+0000","last_clean":"2023-12-19T13:51:22.613420+0000","last_became_active":"2023-12-19T13:51:21.621961+0000","last_became_peered":"2023-12-19T13:51:21.621961+0000","last_unstale":"2023-12-19T13:51:22.613420+0000","last_undegraded":"2023-12-19T13:51:22.613420+0000","last_fullsized":"2023-12-19T13:51:22.613420+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:50.137324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827696+0000","last_change":"2023-12-19T13:51:21.624819+0000","last_active":"2023-12-19T13:51:22.827696+0000","last_peered":"2023-12-19T13:51:22.827696+0000","last_clean":"2023-12-19T13:51:22.827696+0000","last_became_active":"2023-12-19T13:51:21.624414+0000","last_became_peered":"2023-12-19T13:51:21.624414+0000","last_unstale":"2023-12-19T13:51:22.827696+0000","last_undegraded":"2023-12-19T13:51:22.827696+0000","last_fullsized":"2023-12-19T13:51:22.827696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:49.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827738+0000","last_change":"2023-12-19T13:51:21.620162+0000","last_active":"2023-12-19T13:51:22.827738+0000","last_peered":"2023-12-19T13:51:22.827738+0000","last_clean":"2023-12-19T13:51:22.827738+0000","last_became_active":"2023-12-19T13:51:21.619707+0000","last_became_peered":"2023-12-19T13:51:21.619707+0000","last_unstale":"2023-12-19T13:51:22.827738+0000","last_undegraded":"2023-12-19T13:51:22.827738+0000","last_fullsized":"2023-12-19T13:51:22.827738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837874+0000","last_change":"2023-12-19T13:51:21.614821+0000","last_active":"2023-12-19T13:51:22.837874+0000","last_peered":"2023-12-19T13:51:22.837874+0000","last_clean":"2023-12-19T13:51:22.837874+0000","last_became_active":"2023-12-19T13:51:21.614268+0000","last_became_peered":"2023-12-19T13:51:21.614268+0000","last_unstale":"2023-12-19T13:51:22.837874+0000","last_undegraded":"2023-12-19T13:51:22.837874+0000","last_fullsized":"2023-12-19T13:51:22.837874+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:24:33.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613598+0000","last_change":"2023-12-19T13:51:21.619099+0000","last_active":"2023-12-19T13:51:22.613598+0000","last_peered":"2023-12-19T13:51:22.613598+0000","last_clean":"2023-12-19T13:51:22.613598+0000","last_became_active":"2023-12-19T13:51:21.618016+0000","last_became_peered":"2023-12-19T13:51:21.618016+0000","last_unstale":"2023-12-19T13:51:22.613598+0000","last_undegraded":"2023-12-19T13:51:22.613598+0000","last_fullsized":"2023-12-19T13:51:22.613598+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:18.124551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612911+0000","last_change":"2023-12-19T13:51:21.621912+0000","last_active":"2023-12-19T13:51:22.612911+0000","last_peered":"2023-12-19T13:51:22.612911+0000","last_clean":"2023-12-19T13:51:22.612911+0000","last_became_active":"2023-12-19T13:51:21.621689+0000","last_became_peered":"2023-12-19T13:51:21.621689+0000","last_unstale":"2023-12-19T13:51:22.612911+0000","last_undegraded":"2023-12-19T13:51:22.612911+0000","last_fullsized":"2023-12-19T13:51:22.612911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:05.161037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836546+0000","last_change":"2023-12-19T13:51:21.626192+0000","last_active":"2023-12-19T13:51:22.836546+0000","last_peered":"2023-12-19T13:51:22.836546+0000","last_clean":"2023-12-19T13:51:22.836546+0000","last_became_active":"2023-12-19T13:51:21.625953+0000","last_became_peered":"2023-12-19T13:51:21.625953+0000","last_unstale":"2023-12-19T13:51:22.836546+0000","last_undegraded":"2023-12-19T13:51:22.836546+0000","last_fullsized":"2023-12-19T13:51:22.836546+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:18:30.621730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614996+0000","last_change":"2023-12-19T13:51:21.610607+0000","last_active":"2023-12-19T13:51:22.614996+0000","last_peered":"2023-12-19T13:51:22.614996+0000","last_clean":"2023-12-19T13:51:22.614996+0000","last_became_active":"2023-12-19T13:51:21.610346+0000","last_became_peered":"2023-12-19T13:51:21.610346+0000","last_unstale":"2023-12-19T13:51:22.614996+0000","last_undegraded":"2023-12-19T13:51:22.614996+0000","last_fullsized":"2023-12-19T13:51:22.614996+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:41.896416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836620+0000","last_change":"2023-12-19T13:51:21.618014+0000","last_active":"2023-12-19T13:51:22.836620+0000","last_peered":"2023-12-19T13:51:22.836620+0000","last_clean":"2023-12-19T13:51:22.836620+0000","last_became_active":"2023-12-19T13:51:21.617730+0000","last_became_peered":"2023-12-19T13:51:21.617730+0000","last_unstale":"2023-12-19T13:51:22.836620+0000","last_undegraded":"2023-12-19T13:51:22.836620+0000","last_fullsized":"2023-12-19T13:51:22.836620+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836667+0000","last_change":"2023-12-19T13:51:21.612481+0000","last_active":"2023-12-19T13:51:22.836667+0000","last_peered":"2023-12-19T13:51:22.836667+0000","last_clean":"2023-12-19T13:51:22.836667+0000","last_became_active":"2023-12-19T13:51:21.611901+0000","last_became_peered":"2023-12-19T13:51:21.611901+0000","last_unstale":"2023-12-19T13:51:22.836667+0000","last_undegraded":"2023-12-19T13:51:22.836667+0000","last_fullsized":"2023-12-19T13:51:22.836667+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610265+0000","last_change":"2023-12-19T13:51:21.620489+0000","last_active":"2023-12-19T13:51:22.610265+0000","last_peered":"2023-12-19T13:51:22.610265+0000","last_clean":"2023-12-19T13:51:22.610265+0000","last_became_active":"2023-12-19T13:51:21.620252+0000","last_became_peered":"2023-12-19T13:51:21.620252+0000","last_unstale":"2023-12-19T13:51:22.610265+0000","last_undegraded":"2023-12-19T13:51:22.610265+0000","last_fullsized":"2023-12-19T13:51:22.610265+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:36.068907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836658+0000","last_change":"2023-12-19T13:51:21.610724+0000","last_active":"2023-12-19T13:51:22.836658+0000","last_peered":"2023-12-19T13:51:22.836658+0000","last_clean":"2023-12-19T13:51:22.836658+0000","last_became_active":"2023-12-19T13:51:21.610323+0000","last_became_peered":"2023-12-19T13:51:21.610323+0000","last_unstale":"2023-12-19T13:51:22.836658+0000","last_undegraded":"2023-12-19T13:51:22.836658+0000","last_fullsized":"2023-12-19T13:51:22.836658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:55.687744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610520+0000","last_change":"2023-12-19T13:51:21.627337+0000","last_active":"2023-12-19T13:51:22.610520+0000","last_peered":"2023-12-19T13:51:22.610520+0000","last_clean":"2023-12-19T13:51:22.610520+0000","last_became_active":"2023-12-19T13:51:21.624684+0000","last_became_peered":"2023-12-19T13:51:21.624684+0000","last_unstale":"2023-12-19T13:51:22.610520+0000","last_undegraded":"2023-12-19T13:51:22.610520+0000","last_fullsized":"2023-12-19T13:51:22.610520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:09.082207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837696+0000","last_change":"2023-12-19T13:51:21.619129+0000","last_active":"2023-12-19T13:51:22.837696+0000","last_peered":"2023-12-19T13:51:22.837696+0000","last_clean":"2023-12-19T13:51:22.837696+0000","last_became_active":"2023-12-19T13:51:21.618633+0000","last_became_peered":"2023-12-19T13:51:21.618633+0000","last_unstale":"2023-12-19T13:51:22.837696+0000","last_undegraded":"2023-12-19T13:51:22.837696+0000","last_fullsized":"2023-12-19T13:51:22.837696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:56.791611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614028+0000","last_change":"2023-12-19T13:51:21.621324+0000","last_active":"2023-12-19T13:51:22.614028+0000","last_peered":"2023-12-19T13:51:22.614028+0000","last_clean":"2023-12-19T13:51:22.614028+0000","last_became_active":"2023-12-19T13:51:21.619401+0000","last_became_peered":"2023-12-19T13:51:21.619401+0000","last_unstale":"2023-12-19T13:51:22.614028+0000","last_undegraded":"2023-12-19T13:51:22.614028+0000","last_fullsized":"2023-12-19T13:51:22.614028+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:01.407540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835235+0000","last_change":"2023-12-19T13:51:21.626741+0000","last_active":"2023-12-19T13:51:22.835235+0000","last_peered":"2023-12-19T13:51:22.835235+0000","last_clean":"2023-12-19T13:51:22.835235+0000","last_became_active":"2023-12-19T13:51:21.626514+0000","last_became_peered":"2023-12-19T13:51:21.626514+0000","last_unstale":"2023-12-19T13:51:22.835235+0000","last_undegraded":"2023-12-19T13:51:22.835235+0000","last_fullsized":"2023-12-19T13:51:22.835235+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:42.837995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612535+0000","last_change":"2023-12-19T13:51:21.624723+0000","last_active":"2023-12-19T13:51:22.612535+0000","last_peered":"2023-12-19T13:51:22.612535+0000","last_clean":"2023-12-19T13:51:22.612535+0000","last_became_active":"2023-12-19T13:51:21.624172+0000","last_became_peered":"2023-12-19T13:51:21.624172+0000","last_unstale":"2023-12-19T13:51:22.612535+0000","last_undegraded":"2023-12-19T13:51:22.612535+0000","last_fullsized":"2023-12-19T13:51:22.612535+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:36.068907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837975+0000","last_change":"2023-12-19T13:51:21.620538+0000","last_active":"2023-12-19T13:51:22.837975+0000","last_peered":"2023-12-19T13:51:22.837975+0000","last_clean":"2023-12-19T13:51:22.837975+0000","last_became_active":"2023-12-19T13:51:21.620294+0000","last_became_peered":"2023-12-19T13:51:21.620294+0000","last_unstale":"2023-12-19T13:51:22.837975+0000","last_undegraded":"2023-12-19T13:51:22.837975+0000","last_fullsized":"2023-12-19T13:51:22.837975+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:22.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836854+0000","last_change":"2023-12-19T13:51:21.629804+0000","last_active":"2023-12-19T13:51:22.836854+0000","last_peered":"2023-12-19T13:51:22.836854+0000","last_clean":"2023-12-19T13:51:22.836854+0000","last_became_active":"2023-12-19T13:51:21.629528+0000","last_became_peered":"2023-12-19T13:51:21.629528+0000","last_unstale":"2023-12-19T13:51:22.836854+0000","last_undegraded":"2023-12-19T13:51:22.836854+0000","last_fullsized":"2023-12-19T13:51:22.836854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:03.268384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836072+0000","last_change":"2023-12-19T13:51:21.626946+0000","last_active":"2023-12-19T13:51:22.836072+0000","last_peered":"2023-12-19T13:51:22.836072+0000","last_clean":"2023-12-19T13:51:22.836072+0000","last_became_active":"2023-12-19T13:51:21.626737+0000","last_became_peered":"2023-12-19T13:51:21.626737+0000","last_unstale":"2023-12-19T13:51:22.836072+0000","last_undegraded":"2023-12-19T13:51:22.836072+0000","last_fullsized":"2023-12-19T13:51:22.836072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:38.328102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836747+0000","last_change":"2023-12-19T13:51:21.619400+0000","last_active":"2023-12-19T13:51:22.836747+0000","last_peered":"2023-12-19T13:51:22.836747+0000","last_clean":"2023-12-19T13:51:22.836747+0000","last_became_active":"2023-12-19T13:51:21.619201+0000","last_became_peered":"2023-12-19T13:51:21.619201+0000","last_unstale":"2023-12-19T13:51:22.836747+0000","last_undegraded":"2023-12-19T13:51:22.836747+0000","last_fullsized":"2023-12-19T13:51:22.836747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:59.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"93'4","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.628117+0000","last_change":"2023-12-19T13:51:21.130097+0000","last_active":"2023-12-19T13:51:21.628117+0000","last_peered":"2023-12-19T13:51:21.628117+0000","last_clean":"2023-12-19T13:51:21.628117+0000","last_became_active":"2023-12-19T13:51:21.129872+0000","last_became_peered":"2023-12-19T13:51:21.129872+0000","last_unstale":"2023-12-19T13:51:21.628117+0000","last_undegraded":"2023-12-19T13:51:21.628117+0000","last_fullsized":"2023-12-19T13:51:21.628117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613552+0000","last_change":"2023-12-19T13:51:21.621393+0000","last_active":"2023-12-19T13:51:22.613552+0000","last_peered":"2023-12-19T13:51:22.613552+0000","last_clean":"2023-12-19T13:51:22.613552+0000","last_became_active":"2023-12-19T13:51:21.620982+0000","last_became_peered":"2023-12-19T13:51:21.620982+0000","last_unstale":"2023-12-19T13:51:22.613552+0000","last_undegraded":"2023-12-19T13:51:22.613552+0000","last_fullsized":"2023-12-19T13:51:22.613552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:04.807608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.617732+0000","last_change":"2023-12-19T13:51:21.135356+0000","last_active":"2023-12-19T13:51:21.617732+0000","last_peered":"2023-12-19T13:51:21.617732+0000","last_clean":"2023-12-19T13:51:21.617732+0000","last_became_active":"2023-12-19T13:51:21.135121+0000","last_became_peered":"2023-12-19T13:51:21.135121+0000","last_unstale":"2023-12-19T13:51:21.617732+0000","last_undegraded":"2023-12-19T13:51:21.617732+0000","last_fullsized":"2023-12-19T13:51:21.617732+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:15:10.691217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835490+0000","last_change":"2023-12-19T13:51:21.615697+0000","last_active":"2023-12-19T13:51:22.835490+0000","last_peered":"2023-12-19T13:51:22.835490+0000","last_clean":"2023-12-19T13:51:22.835490+0000","last_became_active":"2023-12-19T13:51:21.614826+0000","last_became_peered":"2023-12-19T13:51:21.614826+0000","last_unstale":"2023-12-19T13:51:22.835490+0000","last_undegraded":"2023-12-19T13:51:22.835490+0000","last_fullsized":"2023-12-19T13:51:22.835490+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.623538+0000","last_change":"2023-12-19T13:51:21.131167+0000","last_active":"2023-12-19T13:51:21.623538+0000","last_peered":"2023-12-19T13:51:21.623538+0000","last_clean":"2023-12-19T13:51:21.623538+0000","last_became_active":"2023-12-19T13:51:21.130582+0000","last_became_peered":"2023-12-19T13:51:21.130582+0000","last_unstale":"2023-12-19T13:51:21.623538+0000","last_undegraded":"2023-12-19T13:51:21.623538+0000","last_fullsized":"2023-12-19T13:51:21.623538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:49.970103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610854+0000","last_change":"2023-12-19T13:51:21.627486+0000","last_active":"2023-12-19T13:51:22.610854+0000","last_peered":"2023-12-19T13:51:22.610854+0000","last_clean":"2023-12-19T13:51:22.610854+0000","last_became_active":"2023-12-19T13:51:21.625008+0000","last_became_peered":"2023-12-19T13:51:21.625008+0000","last_unstale":"2023-12-19T13:51:22.610854+0000","last_undegraded":"2023-12-19T13:51:22.610854+0000","last_fullsized":"2023-12-19T13:51:22.610854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:53.765998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.628839+0000","last_change":"2023-12-19T13:51:21.131543+0000","last_active":"2023-12-19T13:51:21.628839+0000","last_peered":"2023-12-19T13:51:21.628839+0000","last_clean":"2023-12-19T13:51:21.628839+0000","last_became_active":"2023-12-19T13:51:21.131245+0000","last_became_peered":"2023-12-19T13:51:21.131245+0000","last_unstale":"2023-12-19T13:51:21.628839+0000","last_undegraded":"2023-12-19T13:51:21.628839+0000","last_fullsized":"2023-12-19T13:51:21.628839+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837004+0000","last_change":"2023-12-19T13:51:21.618047+0000","last_active":"2023-12-19T13:51:22.837004+0000","last_peered":"2023-12-19T13:51:22.837004+0000","last_clean":"2023-12-19T13:51:22.837004+0000","last_became_active":"2023-12-19T13:51:21.616984+0000","last_became_peered":"2023-12-19T13:51:21.616984+0000","last_unstale":"2023-12-19T13:51:22.837004+0000","last_undegraded":"2023-12-19T13:51:22.837004+0000","last_fullsized":"2023-12-19T13:51:22.837004+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:42.686812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.618054+0000","last_change":"2023-12-19T13:51:21.132384+0000","last_active":"2023-12-19T13:51:21.618054+0000","last_peered":"2023-12-19T13:51:21.618054+0000","last_clean":"2023-12-19T13:51:21.618054+0000","last_became_active":"2023-12-19T13:51:21.131538+0000","last_became_peered":"2023-12-19T13:51:21.131538+0000","last_unstale":"2023-12-19T13:51:21.618054+0000","last_undegraded":"2023-12-19T13:51:21.618054+0000","last_fullsized":"2023-12-19T13:51:21.618054+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836888+0000","last_change":"2023-12-19T13:51:21.614026+0000","last_active":"2023-12-19T13:51:22.836888+0000","last_peered":"2023-12-19T13:51:22.836888+0000","last_clean":"2023-12-19T13:51:22.836888+0000","last_became_active":"2023-12-19T13:51:21.613773+0000","last_became_peered":"2023-12-19T13:51:21.613773+0000","last_unstale":"2023-12-19T13:51:22.836888+0000","last_undegraded":"2023-12-19T13:51:22.836888+0000","last_fullsized":"2023-12-19T13:51:22.836888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.630092+0000","last_change":"2023-12-19T13:51:21.132182+0000","last_active":"2023-12-19T13:51:21.630092+0000","last_peered":"2023-12-19T13:51:21.630092+0000","last_clean":"2023-12-19T13:51:21.630092+0000","last_became_active":"2023-12-19T13:51:21.131507+0000","last_became_peered":"2023-12-19T13:51:21.131507+0000","last_unstale":"2023-12-19T13:51:21.630092+0000","last_undegraded":"2023-12-19T13:51:21.630092+0000","last_fullsized":"2023-12-19T13:51:21.630092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:44:02.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835678+0000","last_change":"2023-12-19T13:51:21.626756+0000","last_active":"2023-12-19T13:51:22.835678+0000","last_peered":"2023-12-19T13:51:22.835678+0000","last_clean":"2023-12-19T13:51:22.835678+0000","last_became_active":"2023-12-19T13:51:21.626514+0000","last_became_peered":"2023-12-19T13:51:21.626514+0000","last_unstale":"2023-12-19T13:51:22.835678+0000","last_undegraded":"2023-12-19T13:51:22.835678+0000","last_fullsized":"2023-12-19T13:51:22.835678+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:29.374283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.624374+0000","last_change":"2023-12-19T13:51:21.137694+0000","last_active":"2023-12-19T13:51:21.624374+0000","last_peered":"2023-12-19T13:51:21.624374+0000","last_clean":"2023-12-19T13:51:21.624374+0000","last_became_active":"2023-12-19T13:51:21.136904+0000","last_became_peered":"2023-12-19T13:51:21.136904+0000","last_unstale":"2023-12-19T13:51:21.624374+0000","last_undegraded":"2023-12-19T13:51:21.624374+0000","last_fullsized":"2023-12-19T13:51:21.624374+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827947+0000","last_change":"2023-12-19T13:51:21.624653+0000","last_active":"2023-12-19T13:51:22.827947+0000","last_peered":"2023-12-19T13:51:22.827947+0000","last_clean":"2023-12-19T13:51:22.827947+0000","last_became_active":"2023-12-19T13:51:21.624093+0000","last_became_peered":"2023-12-19T13:51:21.624093+0000","last_unstale":"2023-12-19T13:51:22.827947+0000","last_undegraded":"2023-12-19T13:51:22.827947+0000","last_fullsized":"2023-12-19T13:51:22.827947+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:41.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609952+0000","last_change":"2023-12-19T13:51:21.131030+0000","last_active":"2023-12-19T13:51:21.609952+0000","last_peered":"2023-12-19T13:51:21.609952+0000","last_clean":"2023-12-19T13:51:21.609952+0000","last_became_active":"2023-12-19T13:51:21.130702+0000","last_became_peered":"2023-12-19T13:51:21.130702+0000","last_unstale":"2023-12-19T13:51:21.609952+0000","last_undegraded":"2023-12-19T13:51:21.609952+0000","last_fullsized":"2023-12-19T13:51:21.609952+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610170+0000","last_change":"2023-12-19T13:51:21.622953+0000","last_active":"2023-12-19T13:51:22.610170+0000","last_peered":"2023-12-19T13:51:22.610170+0000","last_clean":"2023-12-19T13:51:22.610170+0000","last_became_active":"2023-12-19T13:51:21.621806+0000","last_became_peered":"2023-12-19T13:51:21.621806+0000","last_unstale":"2023-12-19T13:51:22.610170+0000","last_undegraded":"2023-12-19T13:51:22.610170+0000","last_fullsized":"2023-12-19T13:51:22.610170+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:58.951316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.605393+0000","last_change":"2023-12-19T13:51:21.133910+0000","last_active":"2023-12-19T13:51:21.605393+0000","last_peered":"2023-12-19T13:51:21.605393+0000","last_clean":"2023-12-19T13:51:21.605393+0000","last_became_active":"2023-12-19T13:51:21.125262+0000","last_became_peered":"2023-12-19T13:51:21.125262+0000","last_unstale":"2023-12-19T13:51:21.605393+0000","last_undegraded":"2023-12-19T13:51:21.605393+0000","last_fullsized":"2023-12-19T13:51:21.605393+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:04.947835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837254+0000","last_change":"2023-12-19T13:51:21.621169+0000","last_active":"2023-12-19T13:51:22.837254+0000","last_peered":"2023-12-19T13:51:22.837254+0000","last_clean":"2023-12-19T13:51:22.837254+0000","last_became_active":"2023-12-19T13:51:21.620952+0000","last_became_peered":"2023-12-19T13:51:21.620952+0000","last_unstale":"2023-12-19T13:51:22.837254+0000","last_undegraded":"2023-12-19T13:51:22.837254+0000","last_fullsized":"2023-12-19T13:51:22.837254+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:20.785199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613111+0000","last_change":"2023-12-19T13:51:21.131727+0000","last_active":"2023-12-19T13:51:21.613111+0000","last_peered":"2023-12-19T13:51:21.613111+0000","last_clean":"2023-12-19T13:51:21.613111+0000","last_became_active":"2023-12-19T13:51:21.131432+0000","last_became_peered":"2023-12-19T13:51:21.131432+0000","last_unstale":"2023-12-19T13:51:21.613111+0000","last_undegraded":"2023-12-19T13:51:21.613111+0000","last_fullsized":"2023-12-19T13:51:21.613111+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:57.935372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836833+0000","last_change":"2023-12-19T13:51:21.616055+0000","last_active":"2023-12-19T13:51:22.836833+0000","last_peered":"2023-12-19T13:51:22.836833+0000","last_clean":"2023-12-19T13:51:22.836833+0000","last_became_active":"2023-12-19T13:51:21.615795+0000","last_became_peered":"2023-12-19T13:51:21.615795+0000","last_unstale":"2023-12-19T13:51:22.836833+0000","last_undegraded":"2023-12-19T13:51:22.836833+0000","last_fullsized":"2023-12-19T13:51:22.836833+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:15.599647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"93'3","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.622842+0000","last_change":"2023-12-19T13:51:21.135986+0000","last_active":"2023-12-19T13:51:21.622842+0000","last_peered":"2023-12-19T13:51:21.622842+0000","last_clean":"2023-12-19T13:51:21.622842+0000","last_became_active":"2023-12-19T13:51:21.135713+0000","last_became_peered":"2023-12-19T13:51:21.135713+0000","last_unstale":"2023-12-19T13:51:21.622842+0000","last_undegraded":"2023-12-19T13:51:21.622842+0000","last_fullsized":"2023-12-19T13:51:21.622842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613134+0000","last_change":"2023-12-19T13:51:21.623324+0000","last_active":"2023-12-19T13:51:22.613134+0000","last_peered":"2023-12-19T13:51:22.613134+0000","last_clean":"2023-12-19T13:51:22.613134+0000","last_became_active":"2023-12-19T13:51:21.623042+0000","last_became_peered":"2023-12-19T13:51:21.623042+0000","last_unstale":"2023-12-19T13:51:22.613134+0000","last_undegraded":"2023-12-19T13:51:22.613134+0000","last_fullsized":"2023-12-19T13:51:22.613134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:52.450701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.631043+0000","last_change":"2023-12-19T13:51:21.137800+0000","last_active":"2023-12-19T13:51:21.631043+0000","last_peered":"2023-12-19T13:51:21.631043+0000","last_clean":"2023-12-19T13:51:21.631043+0000","last_became_active":"2023-12-19T13:51:21.137360+0000","last_became_peered":"2023-12-19T13:51:21.137360+0000","last_unstale":"2023-12-19T13:51:21.631043+0000","last_undegraded":"2023-12-19T13:51:21.631043+0000","last_fullsized":"2023-12-19T13:51:21.631043+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835757+0000","last_change":"2023-12-19T13:51:21.615969+0000","last_active":"2023-12-19T13:51:22.835757+0000","last_peered":"2023-12-19T13:51:22.835757+0000","last_clean":"2023-12-19T13:51:22.835757+0000","last_became_active":"2023-12-19T13:51:21.615477+0000","last_became_peered":"2023-12-19T13:51:21.615477+0000","last_unstale":"2023-12-19T13:51:22.835757+0000","last_undegraded":"2023-12-19T13:51:22.835757+0000","last_fullsized":"2023-12-19T13:51:22.835757+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:03.268384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.619861+0000","last_change":"2023-12-19T13:51:21.132662+0000","last_active":"2023-12-19T13:51:21.619861+0000","last_peered":"2023-12-19T13:51:21.619861+0000","last_clean":"2023-12-19T13:51:21.619861+0000","last_became_active":"2023-12-19T13:51:21.132358+0000","last_became_peered":"2023-12-19T13:51:21.132358+0000","last_unstale":"2023-12-19T13:51:21.619861+0000","last_undegraded":"2023-12-19T13:51:21.619861+0000","last_fullsized":"2023-12-19T13:51:21.619861+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610953+0000","last_change":"2023-12-19T13:51:21.625560+0000","last_active":"2023-12-19T13:51:22.610953+0000","last_peered":"2023-12-19T13:51:22.610953+0000","last_clean":"2023-12-19T13:51:22.610953+0000","last_became_active":"2023-12-19T13:51:21.621547+0000","last_became_peered":"2023-12-19T13:51:21.621547+0000","last_unstale":"2023-12-19T13:51:22.610953+0000","last_undegraded":"2023-12-19T13:51:22.610953+0000","last_fullsized":"2023-12-19T13:51:22.610953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:29.374283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609059+0000","last_change":"2023-12-19T13:51:21.134006+0000","last_active":"2023-12-19T13:51:21.609059+0000","last_peered":"2023-12-19T13:51:21.609059+0000","last_clean":"2023-12-19T13:51:21.609059+0000","last_became_active":"2023-12-19T13:51:21.133703+0000","last_became_peered":"2023-12-19T13:51:21.133703+0000","last_unstale":"2023-12-19T13:51:21.609059+0000","last_undegraded":"2023-12-19T13:51:21.609059+0000","last_fullsized":"2023-12-19T13:51:21.609059+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:40.505599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613356+0000","last_change":"2023-12-19T13:51:21.611420+0000","last_active":"2023-12-19T13:51:22.613356+0000","last_peered":"2023-12-19T13:51:22.613356+0000","last_clean":"2023-12-19T13:51:22.613356+0000","last_became_active":"2023-12-19T13:51:21.611175+0000","last_became_peered":"2023-12-19T13:51:21.611175+0000","last_unstale":"2023-12-19T13:51:22.613356+0000","last_undegraded":"2023-12-19T13:51:22.613356+0000","last_fullsized":"2023-12-19T13:51:22.613356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:33.422417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.615241+0000","last_change":"2023-12-19T13:51:21.130998+0000","last_active":"2023-12-19T13:51:21.615241+0000","last_peered":"2023-12-19T13:51:21.615241+0000","last_clean":"2023-12-19T13:51:21.615241+0000","last_became_active":"2023-12-19T13:51:21.130665+0000","last_became_peered":"2023-12-19T13:51:21.130665+0000","last_unstale":"2023-12-19T13:51:21.615241+0000","last_undegraded":"2023-12-19T13:51:21.615241+0000","last_fullsized":"2023-12-19T13:51:21.615241+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:21.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.612836+0000","last_change":"2023-12-19T13:51:21.621714+0000","last_active":"2023-12-19T13:51:22.612836+0000","last_peered":"2023-12-19T13:51:22.612836+0000","last_clean":"2023-12-19T13:51:22.612836+0000","last_became_active":"2023-12-19T13:51:21.621113+0000","last_became_peered":"2023-12-19T13:51:21.621113+0000","last_unstale":"2023-12-19T13:51:22.612836+0000","last_undegraded":"2023-12-19T13:51:22.612836+0000","last_fullsized":"2023-12-19T13:51:22.612836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:22.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"93'8","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629662+0000","last_change":"2023-12-19T13:51:21.132417+0000","last_active":"2023-12-19T13:51:21.629662+0000","last_peered":"2023-12-19T13:51:21.629662+0000","last_clean":"2023-12-19T13:51:21.629662+0000","last_became_active":"2023-12-19T13:51:21.131929+0000","last_became_peered":"2023-12-19T13:51:21.131929+0000","last_unstale":"2023-12-19T13:51:21.629662+0000","last_undegraded":"2023-12-19T13:51:21.629662+0000","last_fullsized":"2023-12-19T13:51:21.629662+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:18.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836662+0000","last_change":"2023-12-19T13:51:21.614546+0000","last_active":"2023-12-19T13:51:22.836662+0000","last_peered":"2023-12-19T13:51:22.836662+0000","last_clean":"2023-12-19T13:51:22.836662+0000","last_became_active":"2023-12-19T13:51:21.613967+0000","last_became_peered":"2023-12-19T13:51:21.613967+0000","last_unstale":"2023-12-19T13:51:22.836662+0000","last_undegraded":"2023-12-19T13:51:22.836662+0000","last_fullsized":"2023-12-19T13:51:22.836662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:45.668908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.623277+0000","last_change":"2023-12-19T13:51:21.131983+0000","last_active":"2023-12-19T13:51:21.623277+0000","last_peered":"2023-12-19T13:51:21.623277+0000","last_clean":"2023-12-19T13:51:21.623277+0000","last_became_active":"2023-12-19T13:51:21.129090+0000","last_became_peered":"2023-12-19T13:51:21.129090+0000","last_unstale":"2023-12-19T13:51:21.623277+0000","last_undegraded":"2023-12-19T13:51:21.623277+0000","last_fullsized":"2023-12-19T13:51:21.623277+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:58.943405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.834953+0000","last_change":"2023-12-19T13:51:21.619897+0000","last_active":"2023-12-19T13:51:22.834953+0000","last_peered":"2023-12-19T13:51:22.834953+0000","last_clean":"2023-12-19T13:51:22.834953+0000","last_became_active":"2023-12-19T13:51:21.619635+0000","last_became_peered":"2023-12-19T13:51:21.619635+0000","last_unstale":"2023-12-19T13:51:22.834953+0000","last_undegraded":"2023-12-19T13:51:22.834953+0000","last_fullsized":"2023-12-19T13:51:22.834953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:44.863019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629193+0000","last_change":"2023-12-19T13:51:21.125390+0000","last_active":"2023-12-19T13:51:21.629193+0000","last_peered":"2023-12-19T13:51:21.629193+0000","last_clean":"2023-12-19T13:51:21.629193+0000","last_became_active":"2023-12-19T13:51:21.124784+0000","last_became_peered":"2023-12-19T13:51:21.124784+0000","last_unstale":"2023-12-19T13:51:21.629193+0000","last_undegraded":"2023-12-19T13:51:21.629193+0000","last_fullsized":"2023-12-19T13:51:21.629193+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:03.791664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613077+0000","last_change":"2023-12-19T13:51:21.617669+0000","last_active":"2023-12-19T13:51:22.613077+0000","last_peered":"2023-12-19T13:51:22.613077+0000","last_clean":"2023-12-19T13:51:22.613077+0000","last_became_active":"2023-12-19T13:51:21.617426+0000","last_became_peered":"2023-12-19T13:51:21.617426+0000","last_unstale":"2023-12-19T13:51:22.613077+0000","last_undegraded":"2023-12-19T13:51:22.613077+0000","last_fullsized":"2023-12-19T13:51:22.613077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:58.951316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.625960+0000","last_change":"2023-12-19T13:51:21.118045+0000","last_active":"2023-12-19T13:51:21.625960+0000","last_peered":"2023-12-19T13:51:21.625960+0000","last_clean":"2023-12-19T13:51:21.625960+0000","last_became_active":"2023-12-19T13:51:21.116479+0000","last_became_peered":"2023-12-19T13:51:21.116479+0000","last_unstale":"2023-12-19T13:51:21.625960+0000","last_undegraded":"2023-12-19T13:51:21.625960+0000","last_fullsized":"2023-12-19T13:51:21.625960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:44.753082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613156+0000","last_change":"2023-12-19T13:51:21.624990+0000","last_active":"2023-12-19T13:51:22.613156+0000","last_peered":"2023-12-19T13:51:22.613156+0000","last_clean":"2023-12-19T13:51:22.613156+0000","last_became_active":"2023-12-19T13:51:21.623985+0000","last_became_peered":"2023-12-19T13:51:21.623985+0000","last_unstale":"2023-12-19T13:51:22.613156+0000","last_undegraded":"2023-12-19T13:51:22.613156+0000","last_fullsized":"2023-12-19T13:51:22.613156+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:09.082207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.609844+0000","last_change":"2023-12-19T13:51:21.136844+0000","last_active":"2023-12-19T13:51:21.609844+0000","last_peered":"2023-12-19T13:51:21.609844+0000","last_clean":"2023-12-19T13:51:21.609844+0000","last_became_active":"2023-12-19T13:51:21.136289+0000","last_became_peered":"2023-12-19T13:51:21.136289+0000","last_unstale":"2023-12-19T13:51:21.609844+0000","last_undegraded":"2023-12-19T13:51:21.609844+0000","last_fullsized":"2023-12-19T13:51:21.609844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:52.750054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836045+0000","last_change":"2023-12-19T13:51:21.618732+0000","last_active":"2023-12-19T13:51:22.836045+0000","last_peered":"2023-12-19T13:51:22.836045+0000","last_clean":"2023-12-19T13:51:22.836045+0000","last_became_active":"2023-12-19T13:51:21.618463+0000","last_became_peered":"2023-12-19T13:51:21.618463+0000","last_unstale":"2023-12-19T13:51:22.836045+0000","last_undegraded":"2023-12-19T13:51:22.836045+0000","last_fullsized":"2023-12-19T13:51:22.836045+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:06.035963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.608659+0000","last_change":"2023-12-19T13:51:21.133241+0000","last_active":"2023-12-19T13:51:21.608659+0000","last_peered":"2023-12-19T13:51:21.608659+0000","last_clean":"2023-12-19T13:51:21.608659+0000","last_became_active":"2023-12-19T13:51:21.132972+0000","last_became_peered":"2023-12-19T13:51:21.132972+0000","last_unstale":"2023-12-19T13:51:21.608659+0000","last_undegraded":"2023-12-19T13:51:21.608659+0000","last_fullsized":"2023-12-19T13:51:21.608659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:22:33.602743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835905+0000","last_change":"2023-12-19T13:51:21.626864+0000","last_active":"2023-12-19T13:51:22.835905+0000","last_peered":"2023-12-19T13:51:22.835905+0000","last_clean":"2023-12-19T13:51:22.835905+0000","last_became_active":"2023-12-19T13:51:21.626596+0000","last_became_peered":"2023-12-19T13:51:21.626596+0000","last_unstale":"2023-12-19T13:51:22.835905+0000","last_undegraded":"2023-12-19T13:51:22.835905+0000","last_fullsized":"2023-12-19T13:51:22.835905+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:08.251827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613650+0000","last_change":"2023-12-19T13:51:21.132021+0000","last_active":"2023-12-19T13:51:21.613650+0000","last_peered":"2023-12-19T13:51:21.613650+0000","last_clean":"2023-12-19T13:51:21.613650+0000","last_became_active":"2023-12-19T13:51:21.131440+0000","last_became_peered":"2023-12-19T13:51:21.131440+0000","last_unstale":"2023-12-19T13:51:21.613650+0000","last_undegraded":"2023-12-19T13:51:21.613650+0000","last_fullsized":"2023-12-19T13:51:21.613650+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:25.807837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.827997+0000","last_change":"2023-12-19T13:51:21.619998+0000","last_active":"2023-12-19T13:51:22.827997+0000","last_peered":"2023-12-19T13:51:22.827997+0000","last_clean":"2023-12-19T13:51:22.827997+0000","last_became_active":"2023-12-19T13:51:21.619313+0000","last_became_peered":"2023-12-19T13:51:21.619313+0000","last_unstale":"2023-12-19T13:51:22.827997+0000","last_undegraded":"2023-12-19T13:51:22.827997+0000","last_fullsized":"2023-12-19T13:51:22.827997+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.606198+0000","last_change":"2023-12-19T13:51:21.133757+0000","last_active":"2023-12-19T13:51:21.606198+0000","last_peered":"2023-12-19T13:51:21.606198+0000","last_clean":"2023-12-19T13:51:21.606198+0000","last_became_active":"2023-12-19T13:51:21.133496+0000","last_became_peered":"2023-12-19T13:51:21.133496+0000","last_unstale":"2023-12-19T13:51:21.606198+0000","last_undegraded":"2023-12-19T13:51:21.606198+0000","last_fullsized":"2023-12-19T13:51:21.606198+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:45:17.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613608+0000","last_change":"2023-12-19T13:51:21.619584+0000","last_active":"2023-12-19T13:51:22.613608+0000","last_peered":"2023-12-19T13:51:22.613608+0000","last_clean":"2023-12-19T13:51:22.613608+0000","last_became_active":"2023-12-19T13:51:21.619253+0000","last_became_peered":"2023-12-19T13:51:21.619253+0000","last_unstale":"2023-12-19T13:51:22.613608+0000","last_undegraded":"2023-12-19T13:51:22.613608+0000","last_fullsized":"2023-12-19T13:51:22.613608+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:07:51.299215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.622980+0000","last_change":"2023-12-19T13:51:21.130747+0000","last_active":"2023-12-19T13:51:21.622980+0000","last_peered":"2023-12-19T13:51:21.622980+0000","last_clean":"2023-12-19T13:51:21.622980+0000","last_became_active":"2023-12-19T13:51:21.130351+0000","last_became_peered":"2023-12-19T13:51:21.130351+0000","last_unstale":"2023-12-19T13:51:21.622980+0000","last_undegraded":"2023-12-19T13:51:21.622980+0000","last_fullsized":"2023-12-19T13:51:21.622980+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:56.831505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610292+0000","last_change":"2023-12-19T13:51:21.623162+0000","last_active":"2023-12-19T13:51:22.610292+0000","last_peered":"2023-12-19T13:51:22.610292+0000","last_clean":"2023-12-19T13:51:22.610292+0000","last_became_active":"2023-12-19T13:51:21.622164+0000","last_became_peered":"2023-12-19T13:51:21.622164+0000","last_unstale":"2023-12-19T13:51:22.610292+0000","last_undegraded":"2023-12-19T13:51:22.610292+0000","last_fullsized":"2023-12-19T13:51:22.610292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:43:25.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837470+0000","last_change":"2023-12-19T13:51:21.133834+0000","last_active":"2023-12-19T13:51:22.837470+0000","last_peered":"2023-12-19T13:51:22.837470+0000","last_clean":"2023-12-19T13:51:22.837470+0000","last_became_active":"2023-12-19T13:51:21.132246+0000","last_became_peered":"2023-12-19T13:51:21.132246+0000","last_unstale":"2023-12-19T13:51:22.837470+0000","last_undegraded":"2023-12-19T13:51:22.837470+0000","last_fullsized":"2023-12-19T13:51:22.837470+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:10.952331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.836902+0000","last_change":"2023-12-19T13:51:21.618736+0000","last_active":"2023-12-19T13:51:22.836902+0000","last_peered":"2023-12-19T13:51:22.836902+0000","last_clean":"2023-12-19T13:51:22.836902+0000","last_became_active":"2023-12-19T13:51:21.618234+0000","last_became_peered":"2023-12-19T13:51:21.618234+0000","last_unstale":"2023-12-19T13:51:22.836902+0000","last_undegraded":"2023-12-19T13:51:22.836902+0000","last_fullsized":"2023-12-19T13:51:22.836902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:09.816488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.611878+0000","last_change":"2023-12-19T13:51:21.132015+0000","last_active":"2023-12-19T13:51:21.611878+0000","last_peered":"2023-12-19T13:51:21.611878+0000","last_clean":"2023-12-19T13:51:21.611878+0000","last_became_active":"2023-12-19T13:51:21.131690+0000","last_became_peered":"2023-12-19T13:51:21.131690+0000","last_unstale":"2023-12-19T13:51:21.611878+0000","last_undegraded":"2023-12-19T13:51:21.611878+0000","last_fullsized":"2023-12-19T13:51:21.611878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:40.451591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.610186+0000","last_change":"2023-12-19T13:51:21.618492+0000","last_active":"2023-12-19T13:51:22.610186+0000","last_peered":"2023-12-19T13:51:22.610186+0000","last_clean":"2023-12-19T13:51:22.610186+0000","last_became_active":"2023-12-19T13:51:21.617417+0000","last_became_peered":"2023-12-19T13:51:21.617417+0000","last_unstale":"2023-12-19T13:51:22.610186+0000","last_undegraded":"2023-12-19T13:51:22.610186+0000","last_fullsized":"2023-12-19T13:51:22.610186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:22.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.610036+0000","last_change":"2023-12-19T13:51:21.135208+0000","last_active":"2023-12-19T13:51:21.610036+0000","last_peered":"2023-12-19T13:51:21.610036+0000","last_clean":"2023-12-19T13:51:21.610036+0000","last_became_active":"2023-12-19T13:51:21.134819+0000","last_became_peered":"2023-12-19T13:51:21.134819+0000","last_unstale":"2023-12-19T13:51:21.610036+0000","last_undegraded":"2023-12-19T13:51:21.610036+0000","last_fullsized":"2023-12-19T13:51:21.610036+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:07.235883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.614255+0000","last_change":"2023-12-19T13:51:21.621039+0000","last_active":"2023-12-19T13:51:22.614255+0000","last_peered":"2023-12-19T13:51:22.614255+0000","last_clean":"2023-12-19T13:51:22.614255+0000","last_became_active":"2023-12-19T13:51:21.618835+0000","last_became_peered":"2023-12-19T13:51:21.618835+0000","last_unstale":"2023-12-19T13:51:22.614255+0000","last_undegraded":"2023-12-19T13:51:22.614255+0000","last_fullsized":"2023-12-19T13:51:22.614255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:38.923169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.612956+0000","last_change":"2023-12-19T13:51:21.133119+0000","last_active":"2023-12-19T13:51:21.612956+0000","last_peered":"2023-12-19T13:51:21.612956+0000","last_clean":"2023-12-19T13:51:21.612956+0000","last_became_active":"2023-12-19T13:51:21.132840+0000","last_became_peered":"2023-12-19T13:51:21.132840+0000","last_unstale":"2023-12-19T13:51:21.612956+0000","last_undegraded":"2023-12-19T13:51:21.612956+0000","last_fullsized":"2023-12-19T13:51:21.612956+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:24.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.837785+0000","last_change":"2023-12-19T13:51:21.614966+0000","last_active":"2023-12-19T13:51:22.837785+0000","last_peered":"2023-12-19T13:51:22.837785+0000","last_clean":"2023-12-19T13:51:22.837785+0000","last_became_active":"2023-12-19T13:51:21.614610+0000","last_became_peered":"2023-12-19T13:51:21.614610+0000","last_unstale":"2023-12-19T13:51:22.837785+0000","last_undegraded":"2023-12-19T13:51:22.837785+0000","last_fullsized":"2023-12-19T13:51:22.837785+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:59.183585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.605419+0000","last_change":"2023-12-19T13:51:21.136671+0000","last_active":"2023-12-19T13:51:21.605419+0000","last_peered":"2023-12-19T13:51:21.605419+0000","last_clean":"2023-12-19T13:51:21.605419+0000","last_became_active":"2023-12-19T13:51:21.136215+0000","last_became_peered":"2023-12-19T13:51:21.136215+0000","last_unstale":"2023-12-19T13:51:21.605419+0000","last_undegraded":"2023-12-19T13:51:21.605419+0000","last_fullsized":"2023-12-19T13:51:21.605419+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:00.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835383+0000","last_change":"2023-12-19T13:51:21.630170+0000","last_active":"2023-12-19T13:51:22.835383+0000","last_peered":"2023-12-19T13:51:22.835383+0000","last_clean":"2023-12-19T13:51:22.835383+0000","last_became_active":"2023-12-19T13:51:21.628999+0000","last_became_peered":"2023-12-19T13:51:21.628999+0000","last_unstale":"2023-12-19T13:51:22.835383+0000","last_undegraded":"2023-12-19T13:51:22.835383+0000","last_fullsized":"2023-12-19T13:51:22.835383+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:53.765998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.613359+0000","last_change":"2023-12-19T13:51:21.128127+0000","last_active":"2023-12-19T13:51:21.613359+0000","last_peered":"2023-12-19T13:51:21.613359+0000","last_clean":"2023-12-19T13:51:21.613359+0000","last_became_active":"2023-12-19T13:51:21.127723+0000","last_became_peered":"2023-12-19T13:51:21.127723+0000","last_unstale":"2023-12-19T13:51:21.613359+0000","last_undegraded":"2023-12-19T13:51:21.613359+0000","last_fullsized":"2023-12-19T13:51:21.613359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:35:21.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.835463+0000","last_change":"2023-12-19T13:51:21.619961+0000","last_active":"2023-12-19T13:51:22.835463+0000","last_peered":"2023-12-19T13:51:22.835463+0000","last_clean":"2023-12-19T13:51:22.835463+0000","last_became_active":"2023-12-19T13:51:21.619754+0000","last_became_peered":"2023-12-19T13:51:21.619754+0000","last_unstale":"2023-12-19T13:51:22.835463+0000","last_undegraded":"2023-12-19T13:51:22.835463+0000","last_fullsized":"2023-12-19T13:51:22.835463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:55:41.467535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.608758+0000","last_change":"2023-12-19T13:51:21.137585+0000","last_active":"2023-12-19T13:51:21.608758+0000","last_peered":"2023-12-19T13:51:21.608758+0000","last_clean":"2023-12-19T13:51:21.608758+0000","last_became_active":"2023-12-19T13:51:21.137411+0000","last_became_peered":"2023-12-19T13:51:21.137411+0000","last_unstale":"2023-12-19T13:51:21.608758+0000","last_undegraded":"2023-12-19T13:51:21.608758+0000","last_fullsized":"2023-12-19T13:51:21.608758+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:23.828727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-12-19T13:51:22.613898+0000","last_change":"2023-12-19T13:51:21.610199+0000","last_active":"2023-12-19T13:51:22.613898+0000","last_peered":"2023-12-19T13:51:22.613898+0000","last_clean":"2023-12-19T13:51:22.613898+0000","last_became_active":"2023-12-19T13:51:21.609353+0000","last_became_peered":"2023-12-19T13:51:21.609353+0000","last_unstale":"2023-12-19T13:51:22.613898+0000","last_undegraded":"2023-12-19T13:51:22.613898+0000","last_fullsized":"2023-12-19T13:51:22.613898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:21.091154+0000","last_clean_scrub_stamp":"2023-12-19T13:51:21.091154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:22.398005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.629828+0000","last_change":"2023-12-19T13:51:21.134430+0000","last_active":"2023-12-19T13:51:21.629828+0000","last_peered":"2023-12-19T13:51:21.629828+0000","last_clean":"2023-12-19T13:51:21.629828+0000","last_became_active":"2023-12-19T13:51:21.134119+0000","last_became_peered":"2023-12-19T13:51:21.134119+0000","last_unstale":"2023-12-19T13:51:21.629828+0000","last_undegraded":"2023-12-19T13:51:21.629828+0000","last_fullsized":"2023-12-19T13:51:21.629828+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:51:20.075210+0000","last_clean_scrub_stamp":"2023-12-19T13:51:20.075210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:33.558661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":234,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-12-19T13:51:21.606881+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:51:21.606881+0000","last_peered":"2023-12-19T13:51:21.606881+0000","last_clean":"2023-12-19T13:51:21.606881+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:51:21.606881+0000","last_undegraded":"2023-12-19T13:51:21.606881+0000","last_fullsized":"2023-12-19T13:51:21.606881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.048,"15min":1.0129999999999999},"min":{"1min":0.68600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6950000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0389999999999999,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7190000000000001,"5min":2.008,"15min":2.008},"last":1.0169999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.117,"15min":1.0820000000000001},"min":{"1min":0.94799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.6459999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.591},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.071,"15min":1.038},"min":{"1min":0.78700000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.9870000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3660000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1359999999999999},"min":{"1min":0.98099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.653,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.171,"15min":1.147},"min":{"1min":0.77400000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6859999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1819999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1930000000000001,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7070000000000001,"5min":1.931,"15min":1.931},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":0.85499999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.5069999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.274,"15min":1.284},"min":{"1min":0.88400000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.609,"5min":2.181,"15min":2.181},"last":1.093},{"interface":"front","average":{"1min":1.377,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.86499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8400000000000001,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.276}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2470000000000001,"15min":1.2250000000000001},"min":{"1min":0.82499999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8660000000000001,"5min":1.956,"15min":1.956},"last":1.228},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.81999999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.76,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.5289999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3120000000000001,"15min":1.268},"min":{"1min":0.97399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.927,"5min":2.024,"15min":2.024},"last":1.47},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.506,"15min":1.488},"min":{"1min":1.1399999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8180000000000001,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.6299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491024,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.036,"15min":1.026},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5409999999999999,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.256},{"interface":"front","average":{"1min":1.087,"5min":1.073,"15min":1.1160000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.514,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.1719999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0640000000000001,"15min":1.0349999999999999},"min":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4950000000000001,"5min":1.962,"15min":1.962},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1140000000000001,"15min":1.0489999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.544,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.92400000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2410000000000001,"15min":1.2210000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.228,"15min":1.1699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.613,"5min":1.802,"15min":1.802},"last":1.456}]},{"osd":3,"last update":"Tue Dec 19 13:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.264,"15min":1.3340000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.496,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.2370000000000001,"15min":1.262},"min":{"1min":0.77000000000000002,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.706,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":1.2929999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.27,"15min":1.218},"min":{"1min":0.97999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.647,"5min":1.865,"15min":1.865},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.397,"5min":1.353,"15min":1.306},"min":{"1min":1.087,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.772,"5min":1.895,"15min":1.895},"last":1.4019999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3009999999999999,"15min":1.2569999999999999},"min":{"1min":0.90800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.401,"15min":1.3720000000000001},"min":{"1min":1.036,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.8819999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.369}]},{"osd":7,"last update":"Tue Dec 19 13:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.4419999999999999,"15min":1.4239999999999999},"min":{"1min":1.028,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.968,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3959999999999999,"15min":1.361},"min":{"1min":0.98099999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.4350000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194240,"statfs":{"total":200000000,"available":198902164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0209999999999999,"15min":0.99099999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7669999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.1259999999999999,"15min":1.0860000000000001},"min":{"1min":0.67500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.478,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.379}]},{"osd":1,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0840000000000001,"15min":1.0940000000000001},"min":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5840000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.45},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1080000000000001,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6399999999999999,"5min":2.077,"15min":2.077},"last":1.536}]},{"osd":2,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2490000000000001,"15min":1.2609999999999999},"min":{"1min":0.88200000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2469999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.157},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2529999999999999,"15min":1.27},"min":{"1min":0.90100000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.2730000000000001,"5min":2.863,"15min":2.863},"last":0.98099999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3009999999999999,"15min":1.2350000000000001},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5780000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.256,"15min":1.246},"min":{"1min":1.0009999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.522,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.099}]},{"osd":4,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1879999999999999,"15min":1.149},"min":{"1min":0.874,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.857,"5min":1.982,"15min":1.982},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.353,"15min":1.302},"min":{"1min":1.0269999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6699999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.484}]},{"osd":6,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3680000000000001,"15min":1.325},"min":{"1min":0.94099999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.843,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.325},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3520000000000001,"15min":1.3680000000000001},"min":{"1min":0.81100000000000005,"5min":0.748,"15min":0.748},"max":{"1min":1.9039999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.196}]},{"osd":7,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.474,"15min":1.427},"min":{"1min":1.131,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7430000000000001,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.4690000000000001,"15min":1.417},"min":{"1min":1.2509999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9059999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.514}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199491928,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.004,"15min":0.99199999999999999},"min":{"1min":0.70999999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.548,"5min":1.657,"15min":1.657},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.85099999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":2.016,"15min":2.016},"last":1.232}]},{"osd":1,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.0660000000000001},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3580000000000001,"5min":1.621,"15min":1.621},"last":1.115},{"interface":"front","average":{"1min":1.194,"5min":1.115,"15min":1.119},"min":{"1min":0.82399999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.93500000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0960000000000001,"15min":1.03},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.591,"5min":1.611,"15min":1.611},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.179,"5min":1.127,"15min":1.1100000000000001},"min":{"1min":0.97599999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":0.99099999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.218,"15min":1.214},"min":{"1min":0.73299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.796,"5min":1.952,"15min":1.952},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.256,"15min":1.274},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.585,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.302}]},{"osd":5,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2190000000000001,"15min":1.2490000000000001},"min":{"1min":0.84099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.75,"5min":2.165,"15min":2.165},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.3280000000000001,"15min":1.3440000000000001},"min":{"1min":0.69299999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.863,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.151}]},{"osd":6,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3500000000000001,"15min":1.397},"min":{"1min":0.78800000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6419999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.417,"15min":1.4690000000000001},"min":{"1min":1.2,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.45,"15min":1.46},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.9550000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4950000000000001,"15min":1.52},"min":{"1min":1.091,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7989999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.617}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.92900000000000005},"min":{"1min":0.48899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.5069999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89600000000000002,"15min":0.96199999999999997},"min":{"1min":0.45300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3360000000000001,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.97199999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0920000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93200000000000005,"15min":0.98299999999999998},"min":{"1min":0.52500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.387,"15min":2.387},"last":1.012}]},{"osd":2,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.996,"15min":1.036},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0169999999999999,"15min":1.117},"min":{"1min":0.42999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4450000000000001,"5min":2.657,"15min":2.657},"last":1.228}]},{"osd":4,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.204,"15min":1.262},"min":{"1min":0.82599999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.718,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.208,"15min":1.23},"min":{"1min":0.77200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.681,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.429}]},{"osd":5,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2410000000000001,"15min":1.3009999999999999},"min":{"1min":0.71199999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.548,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.323},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.70699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.528,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.403}]},{"osd":6,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2609999999999999,"15min":1.304},"min":{"1min":0.82799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5920000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3420000000000001},"min":{"1min":0.878,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7490000000000001,"5min":2.698,"15min":2.698},"last":1.6020000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.319,"15min":1.3700000000000001},"min":{"1min":1.0529999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6879999999999999,"5min":3.609,"15min":3.609},"last":1.502},{"interface":"front","average":{"1min":1.325,"5min":1.363,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.655,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.635}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492040,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81299999999999994,"15min":0.83299999999999996},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4410000000000001,"5min":2.258,"15min":2.258},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.96399999999999997,"15min":0.83199999999999996},"min":{"1min":0.42199999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5329999999999999,"5min":11.85,"15min":11.85},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.85699999999999998,"15min":0.83299999999999996},"min":{"1min":0.49399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.5920000000000001,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0600000000000001,"15min":0.93899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4099999999999999,"5min":11.788,"15min":11.788},"last":1.3500000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.53100000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4670000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.071,"15min":1.032},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5629999999999999,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.91000000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:51:29 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.296,"15min":1.1719999999999999},"min":{"1min":0.81799999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.6379999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.149},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.22,"15min":1.224},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.677,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.101}]},{"osd":5,"last update":"Tue Dec 19 13:51:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.379,"15min":1.2390000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.675,"5min":11.888,"15min":11.888},"last":1.478},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3029999999999999,"15min":1.3069999999999999},"min":{"1min":0.98199999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.649,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.2509999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:51:29 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2909999999999999,"15min":1.3109999999999999},"min":{"1min":0.85899999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6930000000000001,"5min":2.964,"15min":2.964},"last":1.446},{"interface":"front","average":{"1min":1.278,"5min":1.292,"15min":1.258},"min":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.7130000000000001,"5min":2.286,"15min":2.286},"last":1.2030000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:51:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3280000000000001,"15min":1.3140000000000001},"min":{"1min":0.84299999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.7529999999999999,"5min":2.351,"15min":2.351},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.409,"15min":1.2929999999999999},"min":{"1min":0.83799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.7749999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.4279999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194240,"statfs":{"total":200000000,"available":198902254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78500000000000003,"15min":0.81899999999999995},"min":{"1min":0.33700000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1990000000000001,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.62,"5min":0.435,"15min":0.435},"max":{"1min":1.4590000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":1.077},"min":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.383,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1830000000000001},"min":{"1min":0.60299999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.452,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.753}]},{"osd":3,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.075,"15min":1.075},"min":{"1min":0.501,"5min":0.5,"15min":0.5},"max":{"1min":1.502,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.1830000000000001},"min":{"1min":0.52700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.357,"5min":7.157,"15min":7.157},"last":0.86699999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1679999999999999,"15min":1.224},"min":{"1min":0.73399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.542,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2669999999999999,"15min":1.2989999999999999},"min":{"1min":0.996,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5129999999999999,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.88700000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2589999999999999,"15min":1.325},"min":{"1min":0.97299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.623,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.411,"15min":1.379},"min":{"1min":0.79400000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6799999999999999,"5min":15.576000000000001,"15min":15.576000000000001},"last":0.93100000000000005}]},{"osd":6,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.335,"15min":1.351},"min":{"1min":0.91500000000000004,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6359999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.3320000000000001,"15min":1.4179999999999999},"min":{"1min":0.93899999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6899999999999999,"5min":3.786,"15min":3.786},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Dec 19 13:51:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3859999999999999,"15min":1.45},"min":{"1min":0.88900000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.744,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3500000000000001,"15min":1.452},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7809999999999999,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":1.103}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199492552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.5820000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.874,"5min":1.018,"15min":0.95499999999999996},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.272,"5min":14.010999999999999,"15min":14.010999999999999},"last":1.0249999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.2509999999999999,"15min":0.995},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.25,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.4239999999999999,"15min":1.0820000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.617,"5min":41.758000000000003,"15min":41.758000000000003},"last":1.2589999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.92400000000000004,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":1.143},{"interface":"front","average":{"1min":1.167,"5min":1.0569999999999999,"15min":1.099},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.496,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.5369999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1819999999999999,"15min":1.216},"min":{"1min":0.878,"5min":0.746,"15min":0.746},"max":{"1min":1.5609999999999999,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.353,"15min":1.2130000000000001},"min":{"1min":1.016,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8140000000000001,"5min":15.766,"15min":15.766},"last":1.4490000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.3420000000000001,"15min":1.218},"min":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5189999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.355},{"interface":"front","average":{"1min":1.306,"5min":1.262,"15min":1.2889999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6279999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.3200000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3140000000000001,"15min":1.258},"min":{"1min":1.0089999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8939999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.468,"15min":1.3220000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.774,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.427}]},{"osd":7,"last update":"Tue Dec 19 13:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.4510000000000001,"15min":1.3300000000000001},"min":{"1min":0.86799999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6160000000000001,"5min":14.381,"15min":14.381},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.409},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.216}]}]}],"pool_statfs":[]}} 2023-12-19T13:51:31.516 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:51:31.517 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:51:31.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.777+0000 7f152d58e640 1 Processor -- start 2023-12-19T13:51:31.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.777+0000 7f152d58e640 1 -- start start 2023-12-19T13:51:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.779+0000 7f152d58e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f15280d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.779+0000 7f152d58e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f15280659d0 0x7f1528065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.779+0000 7f152d58e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152806fc40 con 0x7f152815da00 2023-12-19T13:51:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.779+0000 7f152d58e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15280663c0 con 0x7f15280659d0 2023-12-19T13:51:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.779+0000 7f152d58e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15280b88e0 con 0x7f15280b8500 2023-12-19T13:51:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.780+0000 7f1526ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f15280d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.780+0000 7f15277fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f15280659d0 0x7f1528065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.780+0000 7f1526ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f15280d4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:41162/0 (socket says 172.21.15.113:41162) 2023-12-19T13:51:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.780+0000 7f15267fc640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f152815da00 0x7f152806f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:53148/0 (socket says 172.21.15.113:53148) 2023-12-19T13:51:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.780+0000 7f1526ffd640 1 -- 172.21.15.113:0/2133202356 learned_addr learned my addr 172.21.15.113:0/2133202356 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:31.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.781+0000 7f1526ffd640 1 -- 172.21.15.113:0/2133202356 >> v2:172.21.15.151:3300/0 conn(0x7f15280659d0 msgr2=0x7f1528065e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:31.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.781+0000 7f1526ffd640 1 --2- 172.21.15.113:0/2133202356 >> v2:172.21.15.151:3300/0 conn(0x7f15280659d0 0x7f1528065e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.781+0000 7f1526ffd640 1 -- 172.21.15.113:0/2133202356 >> v1:172.21.15.151:6789/0 conn(0x7f152815da00 legacy=0x7f152806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.781+0000 7f1526ffd640 1 -- 172.21.15.113:0/2133202356 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152815df50 con 0x7f15280b8500 2023-12-19T13:51:31.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.782+0000 7f1526ffd640 1 --2- 172.21.15.113:0/2133202356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f15280d4050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1518009e50 tx=0x7f151802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9af243f6c305839 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.782+0000 7f1525ffb640 1 -- 172.21.15.113:0/2133202356 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151802ca80 con 0x7f15280b8500 2023-12-19T13:51:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.782+0000 7f1525ffb640 1 -- 172.21.15.113:0/2133202356 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151802cbe0 con 0x7f15280b8500 2023-12-19T13:51:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.782+0000 7f1525ffb640 1 -- 172.21.15.113:0/2133202356 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180343f0 con 0x7f15280b8500 2023-12-19T13:51:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 -- 172.21.15.113:0/2133202356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 msgr2=0x7f15280d4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 --2- 172.21.15.113:0/2133202356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f15280d4050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1518009e50 tx=0x7f151802bee0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 -- 172.21.15.113:0/2133202356 shutdown_connections 2023-12-19T13:51:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 --2- 172.21.15.113:0/2133202356 >> v2:172.21.15.151:3300/0 conn(0x7f15280659d0 0x7f1528065e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 --2- 172.21.15.113:0/2133202356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f15280d4050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 -- 172.21.15.113:0/2133202356 >> 172.21.15.113:0/2133202356 conn(0x7f15280b4120 msgr2=0x7f15280b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 -- 172.21.15.113:0/2133202356 shutdown_connections 2023-12-19T13:51:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.783+0000 7f152d58e640 1 -- 172.21.15.113:0/2133202356 wait complete. 2023-12-19T13:51:31.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.785+0000 7f152d58e640 1 Processor -- start 2023-12-19T13:51:31.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.786+0000 7f152d58e640 1 -- start start 2023-12-19T13:51:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f152d58e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15280659d0 0x7f15280a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f152d58e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f152815fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f152d58e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f152815da00 0x7f1528160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f152d58e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15281447e0 con 0x7f15280659d0 2023-12-19T13:51:31.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f152d58e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1528159ed0 con 0x7f152815da00 2023-12-19T13:51:31.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f152d58e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1528144a80 con 0x7f15280b8500 2023-12-19T13:51:31.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f1526ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15280659d0 0x7f15280a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f1526ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15280659d0 0x7f15280a9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47198/0 (socket says 172.21.15.113:47198) 2023-12-19T13:51:31.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f1526ffd640 1 -- 172.21.15.113:0/431484071 learned_addr learned my addr 172.21.15.113:0/431484071 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:31.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f1526ffd640 1 -- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 msgr2=0x7f152815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.787+0000 7f15267fc640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f152815fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f15277fe640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f152815da00 0x7f1528160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f1526ffd640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f152815fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f1526ffd640 1 -- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f152815da00 msgr2=0x7f1528160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f1526ffd640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f152815da00 0x7f1528160210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f1526ffd640 1 -- 172.21.15.113:0/431484071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009b30 con 0x7f15280659d0 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f1526ffd640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15280659d0 0x7f15280a9950 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1518036040 tx=0x7f1518004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f151f7fe640 1 -- 172.21.15.113:0/431484071 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518009510 con 0x7f15280659d0 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f151f7fe640 1 -- 172.21.15.113:0/431484071 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151803e450 con 0x7f15280659d0 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1528144d60 con 0x7f15280659d0 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.788+0000 7f151f7fe640 1 -- 172.21.15.113:0/431484071 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151803e820 con 0x7f15280659d0 2023-12-19T13:51:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.789+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15280a9e90 con 0x7f15280659d0 2023-12-19T13:51:31.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.790+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528061910 con 0x7f15280659d0 2023-12-19T13:51:31.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.791+0000 7f151f7fe640 1 -- 172.21.15.113:0/431484071 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f151802cd50 con 0x7f15280659d0 2023-12-19T13:51:31.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.791+0000 7f151f7fe640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f150806a460 0x7f150806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:31.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.791+0000 7f151f7fe640 1 -- 172.21.15.113:0/431484071 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15180ab370 con 0x7f15280659d0 2023-12-19T13:51:31.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.792+0000 7f15267fc640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f150806a460 0x7f150806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:31.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.792+0000 7f15267fc640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f150806a460 0x7f150806c920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1528160950 tx=0x7f1510009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:31.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:31.796+0000 7f151f7fe640 1 -- 172.21.15.113:0/431484071 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1518076950 con 0x7f15280659d0 2023-12-19T13:51:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.059+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f15280d3910 con 0x7f15280659d0 2023-12-19T13:51:32.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.065+0000 7f151f7fe640 1 -- 172.21.15.113:0/431484071 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1518079f70 con 0x7f15280659d0 2023-12-19T13:51:32.066 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:51:32.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f150806a460 msgr2=0x7f150806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:32.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f150806a460 0x7f150806c920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1528160950 tx=0x7f1510009040 comp rx=0 tx=0).stop 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15280659d0 msgr2=0x7f15280a9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15280659d0 0x7f15280a9950 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1518036040 tx=0x7f1518004a40 comp rx=0 tx=0).stop 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 shutdown_connections 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f150806a460 0x7f150806c920 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f152815da00 0x7f1528160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15280b8500 0x7f152815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 --2- 172.21.15.113:0/431484071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15280659d0 0x7f15280a9950 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 >> 172.21.15.113:0/431484071 conn(0x7f15280b4120 msgr2=0x7f15281e61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 shutdown_connections 2023-12-19T13:51:32.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.068+0000 7f152d58e640 1 -- 172.21.15.113:0/431484071 wait complete. 2023-12-19T13:51:32.087 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:32.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.296+0000 7fba0f90a640 1 Processor -- start 2023-12-19T13:51:32.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.296+0000 7fba0f90a640 1 -- start start 2023-12-19T13:51:32.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0f90a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba08157aa0 0x7fba080b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:32.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0f90a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba0806e410 0x7fba08161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:32.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0f90a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0806e8c0 con 0x7fba08161540 2023-12-19T13:51:32.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0f90a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba080b2600 con 0x7fba0806e410 2023-12-19T13:51:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0f90a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba080b1d60 con 0x7fba08157aa0 2023-12-19T13:51:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0cea5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba0806e410 0x7fba08161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0cea5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba0806e410 0x7fba08161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47204/0 (socket says 172.21.15.113:47204) 2023-12-19T13:51:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0cea5640 1 -- 172.21.15.113:0/1113059293 learned_addr learned my addr 172.21.15.113:0/1113059293 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0d6a6640 1 --2- 172.21.15.113:0/1113059293 >> v2:172.21.15.151:3300/0 conn(0x7fba08157aa0 0x7fba080b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0cea5640 1 -- 172.21.15.113:0/1113059293 >> v2:172.21.15.151:3300/0 conn(0x7fba08157aa0 msgr2=0x7fba080b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0cea5640 1 --2- 172.21.15.113:0/1113059293 >> v2:172.21.15.151:3300/0 conn(0x7fba08157aa0 0x7fba080b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0cea5640 1 -- 172.21.15.113:0/1113059293 >> v1:172.21.15.151:6789/0 conn(0x7fba08161540 legacy=0x7fba0815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:32.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.298+0000 7fba0cea5640 1 -- 172.21.15.113:0/1113059293 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba080b2040 con 0x7fba0806e410 2023-12-19T13:51:32.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.299+0000 7fba0cea5640 1 --2- 172.21.15.113:0/1113059293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba08161000 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fba0806db00 tx=0x7fb9f802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7b32f124b1c409 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:32.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.300+0000 7fb9fffff640 1 -- 172.21.15.113:0/1113059293 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8031860 con 0x7fba0806e410 2023-12-19T13:51:32.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.300+0000 7fb9fffff640 1 -- 172.21.15.113:0/1113059293 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f80319c0 con 0x7fba0806e410 2023-12-19T13:51:32.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.300+0000 7fb9fffff640 1 -- 172.21.15.113:0/1113059293 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8031d50 con 0x7fba0806e410 2023-12-19T13:51:32.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.300+0000 7fba0f90a640 1 -- 172.21.15.113:0/1113059293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 msgr2=0x7fba08161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:32.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.300+0000 7fba0f90a640 1 --2- 172.21.15.113:0/1113059293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba08161000 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fba0806db00 tx=0x7fb9f802b900 comp rx=0 tx=0).stop 2023-12-19T13:51:32.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.301+0000 7fba0f90a640 1 -- 172.21.15.113:0/1113059293 shutdown_connections 2023-12-19T13:51:32.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.301+0000 7fba0f90a640 1 --2- 172.21.15.113:0/1113059293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba08161000 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.301+0000 7fba0f90a640 1 --2- 172.21.15.113:0/1113059293 >> v2:172.21.15.151:3300/0 conn(0x7fba08157aa0 0x7fba080b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.301+0000 7fba0f90a640 1 -- 172.21.15.113:0/1113059293 >> 172.21.15.113:0/1113059293 conn(0x7fba080cbb70 msgr2=0x7fba080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.301+0000 7fba0f90a640 1 -- 172.21.15.113:0/1113059293 shutdown_connections 2023-12-19T13:51:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.301+0000 7fba0f90a640 1 -- 172.21.15.113:0/1113059293 wait complete. 2023-12-19T13:51:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.303+0000 7fba0f90a640 1 Processor -- start 2023-12-19T13:51:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.303+0000 7fba0f90a640 1 -- start start 2023-12-19T13:51:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0f90a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba0814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0f90a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba08157aa0 0x7fba081546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0f90a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08161540 0x7fba08154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0f90a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba081f48b0 con 0x7fba0806e410 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0f90a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba081f3970 con 0x7fba08157aa0 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0f90a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba081f3c30 con 0x7fba08161540 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba0814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba0814ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47216/0 (socket says 172.21.15.113:47216) 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 -- 172.21.15.113:0/3049864089 learned_addr learned my addr 172.21.15.113:0/3049864089 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 -- 172.21.15.113:0/3049864089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08161540 msgr2=0x7fba08154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08161540 0x7fba08154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 -- 172.21.15.113:0/3049864089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba08157aa0 msgr2=0x7fba081546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0cea5640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba08157aa0 0x7fba081546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba08157aa0 0x7fba081546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.304+0000 7fba0d6a6640 1 -- 172.21.15.113:0/3049864089 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80094d0 con 0x7fba0806e410 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.305+0000 7fba0d6a6640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba0814ef80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fba0400c7f0 tx=0x7fba0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.305+0000 7fb9fdffb640 1 -- 172.21.15.113:0/3049864089 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04004220 con 0x7fba0806e410 2023-12-19T13:51:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.305+0000 7fb9fdffb640 1 -- 172.21.15.113:0/3049864089 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba040043a0 con 0x7fba0806e410 2023-12-19T13:51:32.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.305+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba081f3f10 con 0x7fba0806e410 2023-12-19T13:51:32.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.305+0000 7fb9fdffb640 1 -- 172.21.15.113:0/3049864089 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04007860 con 0x7fba0806e410 2023-12-19T13:51:32.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.305+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba081f44d0 con 0x7fba0806e410 2023-12-19T13:51:32.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.306+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba08061910 con 0x7fba0806e410 2023-12-19T13:51:32.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.307+0000 7fb9fdffb640 1 -- 172.21.15.113:0/3049864089 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba040079c0 con 0x7fba0806e410 2023-12-19T13:51:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.308+0000 7fb9fdffb640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9ec06a430 0x7fb9ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.308+0000 7fb9fdffb640 1 -- 172.21.15.113:0/3049864089 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba04088650 con 0x7fba0806e410 2023-12-19T13:51:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.308+0000 7fba0cea5640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9ec06a430 0x7fb9ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.309+0000 7fba0cea5640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9ec06a430 0x7fb9ec06c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8036000 tx=0x7fb9f803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:32.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.312+0000 7fb9fdffb640 1 -- 172.21.15.113:0/3049864089 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fba04053cd0 con 0x7fba0806e410 2023-12-19T13:51:32.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.537+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba0815b410 con 0x7fba0806e410 2023-12-19T13:51:32.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.538+0000 7fb9fdffb640 1 -- 172.21.15.113:0/3049864089 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fba0401e090 con 0x7fba0806e410 2023-12-19T13:51:32.539 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:32.539 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:51:21.594253+0000","modified":"2023-12-19T13:51:24.611657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2704300841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2704300841},{"type":"v1","addr":"172.21.15.151:6835","nonce":2704300841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T13:51:32.539 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 41 2023-12-19T13:51:32.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9ec06a430 msgr2=0x7fb9ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:32.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9ec06a430 0x7fb9ec06c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8036000 tx=0x7fb9f803c040 comp rx=0 tx=0).stop 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 msgr2=0x7fba0814ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba0814ef80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fba0400c7f0 tx=0x7fba0400ccb0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 shutdown_connections 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9ec06a430 0x7fb9ec06c8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08161540 0x7fba08154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba08157aa0 0x7fba081546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 --2- 172.21.15.113:0/3049864089 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba0806e410 0x7fba0814ef80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 >> 172.21.15.113:0/3049864089 conn(0x7fba080cbb70 msgr2=0x7fba080cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 shutdown_connections 2023-12-19T13:51:32.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:32.541+0000 7fba0f90a640 1 -- 172.21.15.113:0/3049864089 wait complete. 2023-12-19T13:51:32.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:51:21.594253+0000', 'modified': '2023-12-19T13:51:24.611657+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6501}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6501': {'gid': 6501, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/2704300841', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 2704300841}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 2704300841}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:51:32.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:51:32.962 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T13:51:33.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.181+0000 7f512b59f640 1 Processor -- start 2023-12-19T13:51:33.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.182+0000 7f512b59f640 1 -- start start 2023-12-19T13:51:33.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f512b59f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5124157b60 0x7f51240d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f512b59f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51240ce640 0x7f51241611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f512b59f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240d2920 con 0x7f51241616f0 2023-12-19T13:51:33.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f512b59f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51240d31c0 con 0x7f51240ce640 2023-12-19T13:51:33.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f512b59f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5124161b60 con 0x7f5124157b60 2023-12-19T13:51:33.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f5129b3c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f51241616f0 0x7f512415dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53298/0 (socket says 172.21.15.113:53298) 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f5128b3a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51240ce640 0x7f51241611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.183+0000 7f5129b3c640 1 -- 172.21.15.113:0/2002868466 learned_addr learned my addr 172.21.15.113:0/2002868466 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.184+0000 7f512933b640 1 --2- 172.21.15.113:0/2002868466 >> v2:172.21.15.151:3300/0 conn(0x7f5124157b60 0x7f51240d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.184+0000 7f5128b3a640 1 -- 172.21.15.113:0/2002868466 >> v2:172.21.15.151:3300/0 conn(0x7f5124157b60 msgr2=0x7f51240d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.184+0000 7f5128b3a640 1 --2- 172.21.15.113:0/2002868466 >> v2:172.21.15.151:3300/0 conn(0x7f5124157b60 0x7f51240d2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.184+0000 7f5128b3a640 1 -- 172.21.15.113:0/2002868466 >> v1:172.21.15.113:6789/0 conn(0x7f51241616f0 legacy=0x7f512415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.184+0000 7f5128b3a640 1 -- 172.21.15.113:0/2002868466 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240d2c00 con 0x7f51240ce640 2023-12-19T13:51:33.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.184+0000 7f512933b640 1 --2- 172.21.15.113:0/2002868466 >> v2:172.21.15.151:3300/0 conn(0x7f5124157b60 0x7f51240d2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:33.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.185+0000 7f5128b3a640 1 --2- 172.21.15.113:0/2002868466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51240ce640 0x7f51241611b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f51180097d0 tx=0x7f511802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6aeb77a168f724 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.185+0000 7f5123fff640 1 -- 172.21.15.113:0/2002868466 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511802d040 con 0x7f51240ce640 2023-12-19T13:51:33.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.185+0000 7f5123fff640 1 -- 172.21.15.113:0/2002868466 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118031810 con 0x7f51240ce640 2023-12-19T13:51:33.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.185+0000 7f5123fff640 1 -- 172.21.15.113:0/2002868466 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118031ba0 con 0x7f51240ce640 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 -- 172.21.15.113:0/2002868466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51240ce640 msgr2=0x7f51241611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 --2- 172.21.15.113:0/2002868466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51240ce640 0x7f51241611b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f51180097d0 tx=0x7f511802b8b0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 -- 172.21.15.113:0/2002868466 shutdown_connections 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 --2- 172.21.15.113:0/2002868466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51240ce640 0x7f51241611b0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 --2- 172.21.15.113:0/2002868466 >> v2:172.21.15.151:3300/0 conn(0x7f5124157b60 0x7f51240d2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 -- 172.21.15.113:0/2002868466 >> 172.21.15.113:0/2002868466 conn(0x7f51240b29c0 msgr2=0x7f51240b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 -- 172.21.15.113:0/2002868466 shutdown_connections 2023-12-19T13:51:33.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.186+0000 7f512b59f640 1 -- 172.21.15.113:0/2002868466 wait complete. 2023-12-19T13:51:33.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.188+0000 7f512b59f640 1 Processor -- start 2023-12-19T13:51:33.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.188+0000 7f512b59f640 1 -- start start 2023-12-19T13:51:33.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f512b59f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51240ce640 0x7f512414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f512b59f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5124157b60 0x7f51241496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f512b59f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51241616f0 0x7f5124155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f512b59f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b6740 con 0x7f51241616f0 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f512b59f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b6a20 con 0x7f51240ce640 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f512b59f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b6d00 con 0x7f5124157b60 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f5129b3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51241616f0 0x7f5124155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f5129b3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51241616f0 0x7f5124155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47244/0 (socket says 172.21.15.113:47244) 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.189+0000 7f5129b3c640 1 -- 172.21.15.113:0/546627817 learned_addr learned my addr 172.21.15.113:0/546627817 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5129b3c640 1 -- 172.21.15.113:0/546627817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5124157b60 msgr2=0x7f51241496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5129b3c640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5124157b60 0x7f51241496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5129b3c640 1 -- 172.21.15.113:0/546627817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51240ce640 msgr2=0x7f512414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5129b3c640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51240ce640 0x7f512414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5129b3c640 1 -- 172.21.15.113:0/546627817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118009400 con 0x7f51241616f0 2023-12-19T13:51:33.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5129b3c640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51241616f0 0x7f5124155f20 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c370 tx=0x7f511c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5121ffb640 1 -- 172.21.15.113:0/546627817 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c005ce0 con 0x7f51241616f0 2023-12-19T13:51:33.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5121ffb640 1 -- 172.21.15.113:0/546627817 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c005e40 con 0x7f51241616f0 2023-12-19T13:51:33.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f5121ffb640 1 -- 172.21.15.113:0/546627817 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0072d0 con 0x7f51241616f0 2023-12-19T13:51:33.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240b6fe0 con 0x7f51241616f0 2023-12-19T13:51:33.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.190+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51240b75a0 con 0x7f51241616f0 2023-12-19T13:51:33.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.192+0000 7f5121ffb640 1 -- 172.21.15.113:0/546627817 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f511c0074f0 con 0x7f51241616f0 2023-12-19T13:51:33.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.193+0000 7f5121ffb640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511006a430 0x7f511006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.193+0000 7f5121ffb640 1 -- 172.21.15.113:0/546627817 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f511c087d60 con 0x7f51241616f0 2023-12-19T13:51:33.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.194+0000 7f512933b640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511006a430 0x7f511006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.194+0000 7f512933b640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511006a430 0x7f511006c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f51240d2660 tx=0x7f51140083d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.194+0000 7f512e1e6740 1 Processor -- start 2023-12-19T13:51:33.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.194+0000 7f512e1e6740 1 -- start start 2023-12-19T13:51:33.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.195+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd015a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.195+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0129cb0 0x55bdd0156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.195+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.195+0000 7f512e1e6740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd0099f80 con 0x55bdd012d8b0 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.195+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd0097710 con 0x55bdd0159d30 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.195+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bdd0093000 con 0x55bdd0129cb0 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47246/0 (socket says 172.21.15.113:47246) 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 -- 172.21.15.113:0/2024037158 learned_addr learned my addr 172.21.15.113:0/2024037158 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 -- 172.21.15.113:0/2024037158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0129cb0 msgr2=0x55bdd0156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 --2- 172.21.15.113:0/2024037158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0129cb0 0x55bdd0156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 -- 172.21.15.113:0/2024037158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 msgr2=0x55bdd015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 --2- 172.21.15.113:0/2024037158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 -- 172.21.15.113:0/2024037158 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdd005a690 con 0x55bdd012d8b0 2023-12-19T13:51:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f5129b3c640 1 --2- 172.21.15.113:0/2024037158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01574e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f511c0535c0 tx=0x7f511c056ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae66f3fb989ef948 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f510affd640 1 -- 172.21.15.113:0/2024037158 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c05eff0 con 0x55bdd012d8b0 2023-12-19T13:51:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f510affd640 1 -- 172.21.15.113:0/2024037158 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c055460 con 0x55bdd012d8b0 2023-12-19T13:51:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.196+0000 7f510affd640 1 -- 172.21.15.113:0/2024037158 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c05eb60 con 0x55bdd012d8b0 2023-12-19T13:51:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 -- 172.21.15.113:0/2024037158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 msgr2=0x55bdd01574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2024037158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01574e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f511c0535c0 tx=0x7f511c056ae0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 -- 172.21.15.113:0/2024037158 shutdown_connections 2023-12-19T13:51:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2024037158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01574e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2024037158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0129cb0 0x55bdd0156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2024037158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 -- 172.21.15.113:0/2024037158 >> 172.21.15.113:0/2024037158 conn(0x55bdd012bfc0 msgr2=0x55bdd0174b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 -- 172.21.15.113:0/2024037158 shutdown_connections 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.197+0000 7f512e1e6740 1 -- 172.21.15.113:0/2024037158 wait complete. 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.198+0000 7f512e1e6740 1 -- start start 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.198+0000 7f512e1e6740 1 Processor -- start 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd014ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd0151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0152380 0x55bdd0153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512e1e6740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd00347d0 con 0x55bdd012d8b0 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd0034470 con 0x55bdd0159d30 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bdcfdfaf20 con 0x55bdd0152380 2023-12-19T13:51:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512e1e6740 10 client.0 _ll_register_callbacks cb 0x55bdd00831b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512933b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd014ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512933b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd014ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47252/0 (socket says 172.21.15.113:47252) 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.199+0000 7f512933b640 1 -- 172.21.15.113:0/1785682172 learned_addr learned my addr 172.21.15.113:0/1785682172 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f5128b3a640 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd0151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f512933b640 1 -- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0152380 msgr2=0x55bdd0153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f5129b3c640 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0152380 0x55bdd0153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f512933b640 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0152380 0x55bdd0153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f512933b640 1 -- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 msgr2=0x55bdd0151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f512933b640 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd0151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f512933b640 1 -- 172.21.15.113:0/1785682172 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51240b75a0 con 0x55bdd012d8b0 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f512933b640 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd014ff20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f511400ee10 tx=0x7f5114004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bf69459c355353 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f50fffff640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f50fffff640 1 -- 172.21.15.113:0/1785682172 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511401b620 con 0x55bdd012d8b0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f50fffff640 1 -- 172.21.15.113:0/1785682172 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5114014070 con 0x55bdd012d8b0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.200+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdd00bd550 con 0x55bdd012d8b0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f50fffff640 1 -- 172.21.15.113:0/1785682172 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f511401b780 con 0x55bdd012d8b0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 10 client.6651 fetch_fsmap learned FSMap version 41 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55bdd0091680 con 0x55bdd012d8b0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f50fffff640 1 -- 172.21.15.113:0/1785682172 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bdd00bd550 con 0x55bdd012d8b0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f50fffff640 1 -- 172.21.15.113:0/1785682172 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 41) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5114021020 con 0x55bdd012d8b0 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 10 client.6651 fetch_fsmap finished waiting for FSMap version 41 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 10 client.6651 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 20 client.6651 populate_metadata read hostname 'smithi113' 2023-12-19T13:51:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd018f8c0 0x55bdd0191cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 4 client.6651 mds_command: new command op to 6501 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:51:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.201+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 --> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdd0085b50 con 0x55bdd018f8c0 2023-12-19T13:51:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.202+0000 7f5128b3a640 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd018f8c0 0x55bdd0191cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.203+0000 7f5128b3a640 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd018f8c0 0x55bdd0191cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57eb8eae741beab9 server_cookie=742129d68a009ade in_seq=0 out_seq=0 2023-12-19T13:51:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.203+0000 7f50fffff640 10 client.6651 ms_handle_connect on v2:172.21.15.151:6834/2704300841 2023-12-19T13:51:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.204+0000 7f50fffff640 1 -- 172.21.15.113:0/1785682172 <== mds.0 v2:172.21.15.151:6834/2704300841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55bdd0085b50 con 0x55bdd018f8c0 2023-12-19T13:51:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.204+0000 7f50fffff640 10 client.6651 handle_command_reply: tid=0 2023-12-19T13:51:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.204+0000 7f512e1e6740 1 client.6651 shutdown 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 msgr2=0x55bdd014ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd014ff20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f511400ee10 tx=0x7f5114004a40 comp rx=0 tx=0).stop 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 shutdown_connections 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd018f8c0 0x55bdd0191cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0152380 0x55bdd0153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd0151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 --2- 172.21.15.113:0/1785682172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd014ff20 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f50fffff640 0 client.6651 ms_handle_reset on v2:172.21.15.151:6834/2704300841 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 >> 172.21.15.113:0/1785682172 conn(0x55bdd0129cb0 msgr2=0x55bdd012e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 shutdown_connections 2023-12-19T13:51:33.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 1 -- 172.21.15.113:0/1785682172 wait complete. 2023-12-19T13:51:33.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.205+0000 7f512e1e6740 20 client.6651 trim_cache size 0 max 16384 2023-12-19T13:51:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.221+0000 7f512e1e6740 1 Processor -- start 2023-12-19T13:51:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.221+0000 7f512e1e6740 1 -- start start 2023-12-19T13:51:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01781d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0152380 0x55bdd014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0159d30 0x55bdd0128e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512e1e6740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd01578e0 con 0x55bdd012d8b0 2023-12-19T13:51:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd012bc50 con 0x55bdd0152380 2023-12-19T13:51:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bdd0150990 con 0x55bdd0159d30 2023-12-19T13:51:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512933b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512933b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01781d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47254/0 (socket says 172.21.15.113:47254) 2023-12-19T13:51:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.222+0000 7f512933b640 1 -- 172.21.15.113:0/740730730 learned_addr learned my addr 172.21.15.113:0/740730730 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:33.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f512933b640 1 -- 172.21.15.113:0/740730730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0159d30 msgr2=0x55bdd0128e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f512933b640 1 --2- 172.21.15.113:0/740730730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0159d30 0x55bdd0128e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f512933b640 1 -- 172.21.15.113:0/740730730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0152380 msgr2=0x55bdd014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f512933b640 1 --2- 172.21.15.113:0/740730730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0152380 0x55bdd014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f512933b640 1 -- 172.21.15.113:0/740730730 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdd00339e0 con 0x55bdd012d8b0 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f512933b640 1 --2- 172.21.15.113:0/740730730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01781d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f511400bca0 tx=0x7f511401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3173a1687867fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f510b7fe640 1 -- 172.21.15.113:0/740730730 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511401b620 con 0x55bdd012d8b0 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f510b7fe640 1 -- 172.21.15.113:0/740730730 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5114012070 con 0x55bdd012d8b0 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.223+0000 7f510b7fe640 1 -- 172.21.15.113:0/740730730 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114008bb0 con 0x55bdd012d8b0 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 -- 172.21.15.113:0/740730730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 msgr2=0x55bdd01781d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 --2- 172.21.15.113:0/740730730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01781d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f511400bca0 tx=0x7f511401d000 comp rx=0 tx=0).stop 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 -- 172.21.15.113:0/740730730 shutdown_connections 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 --2- 172.21.15.113:0/740730730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd0159d30 0x55bdd0128e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 --2- 172.21.15.113:0/740730730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0152380 0x55bdd014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 --2- 172.21.15.113:0/740730730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd012d8b0 0x55bdd01781d0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 -- 172.21.15.113:0/740730730 >> 172.21.15.113:0/740730730 conn(0x55bdd0129cb0 msgr2=0x55bdd01546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 -- 172.21.15.113:0/740730730 shutdown_connections 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.224+0000 7f512e1e6740 1 -- 172.21.15.113:0/740730730 wait complete. 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.225+0000 7f512e1e6740 1 -- start start 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.225+0000 7f512e1e6740 1 Processor -- start 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd012d8b0 0x55bdd0192140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd0152380 0x55bdd012fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f512e1e6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f512e1e6740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd0192960 con 0x55bdd0152380 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdd0183e00 con 0x55bdd0159d30 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f512e1e6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bdd018fd40 con 0x55bdd012d8b0 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f512e1e6740 10 client.0 _ll_register_callbacks cb 0x7f511c0077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd0152380 0x55bdd012fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd0152380 0x55bdd012fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47266/0 (socket says 172.21.15.113:47266) 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 -- 172.21.15.113:0/2689726541 learned_addr learned my addr 172.21.15.113:0/2689726541 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 -- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd012d8b0 msgr2=0x55bdd0192140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd012d8b0 0x55bdd0192140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 -- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 msgr2=0x55bdd0150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.226+0000 7f5128b3a640 1 -- 172.21.15.113:0/2689726541 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bdd0091680 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f5128b3a640 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd0152380 0x55bdd012fd70 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5118009720 tx=0x7f5118006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5885178c31871583 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f50fffff640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f50fffff640 1 -- 172.21.15.113:0/2689726541 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118043400 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f50fffff640 1 -- 172.21.15.113:0/2689726541 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f511803f040 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f511c055460 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f50fffff640 1 -- 172.21.15.113:0/2689726541 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5118043770 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f512e1e6740 10 client.6657 fetch_fsmap learned FSMap version 41 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55bdd0058ef0 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f50fffff640 1 -- 172.21.15.113:0/2689726541 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c055460 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f50fffff640 1 -- 172.21.15.113:0/2689726541 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 41) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f51180438d0 con 0x55bdd0152380 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.227+0000 7f512e1e6740 10 client.6657 fetch_fsmap finished waiting for FSMap version 41 2023-12-19T13:51:33.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.228+0000 7f512e1e6740 10 client.6657 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:51:33.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.228+0000 7f512e1e6740 20 client.6657 populate_metadata read hostname 'smithi113' 2023-12-19T13:51:33.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.228+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd0151320 0x55bdd0176450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.228+0000 7f512e1e6740 4 client.6657 mds_command: new command op to 6501 tid=0[{"prefix": "status"}] 2023-12-19T13:51:33.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.228+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 --> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bdd008c080 con 0x55bdd0151320 2023-12-19T13:51:33.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.228+0000 7f512933b640 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd0151320 0x55bdd0176450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.229+0000 7f50fffff640 10 client.6657 ms_handle_connect on v2:172.21.15.151:6834/2704300841 2023-12-19T13:51:33.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.229+0000 7f512933b640 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd0151320 0x55bdd0176450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48babdfc1534300b server_cookie=da18c888b9cb82ce in_seq=0 out_seq=0 2023-12-19T13:51:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f50fffff640 1 -- 172.21.15.113:0/2689726541 <== mds.0 v2:172.21.15.151:6834/2704300841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55bdd008c080 con 0x55bdd0151320 2023-12-19T13:51:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f50fffff640 10 client.6657 handle_command_reply: tid=0 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 client.6657 shutdown 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd0152380 msgr2=0x55bdd012fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd0152380 0x55bdd012fd70 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5118009720 tx=0x7f5118006ca0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 shutdown_connections 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:6834/2704300841,v1:172.21.15.151:6835/2704300841] conn(0x55bdd0151320 0x55bdd0176450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdd0159d30 0x55bdd0150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f50fffff640 0 client.6657 ms_handle_reset on v2:172.21.15.151:6834/2704300841 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55bdd0152380 0x55bdd012fd70 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 --2- 172.21.15.113:0/2689726541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bdd012d8b0 0x55bdd0192140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 >> 172.21.15.113:0/2689726541 conn(0x55bdd0129cb0 msgr2=0x55bdd0128e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 shutdown_connections 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.230+0000 7f512e1e6740 1 -- 172.21.15.113:0/2689726541 wait complete. 2023-12-19T13:51:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512e1e6740 20 client.6657 trim_cache size 0 max 16384 2023-12-19T13:51:33.236 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 6501, 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 11.630709648, 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 41, 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 94, 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 94, 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 17.280970659000001 2023-12-19T13:51:33.237 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511006a430 msgr2=0x7f511006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511006a430 0x7f511006c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f51240d2660 tx=0x7f51140083d0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51241616f0 msgr2=0x7f5124155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51241616f0 0x7f5124155f20 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c370 tx=0x7f511c00c830 comp rx=0 tx=0).stop 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 shutdown_connections 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f511006a430 0x7f511006c8f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51241616f0 0x7f5124155f20 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5124157b60 0x7f51241496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 --2- 172.21.15.113:0/546627817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51240ce640 0x7f512414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 >> 172.21.15.113:0/546627817 conn(0x7f51240b29c0 msgr2=0x7f51240b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 shutdown_connections 2023-12-19T13:51:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.231+0000 7f512b59f640 1 -- 172.21.15.113:0/546627817 wait complete. 2023-12-19T13:51:33.250 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:51:33.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.456+0000 7f6d7348b640 1 Processor -- start 2023-12-19T13:51:33.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.456+0000 7f6d7348b640 1 -- start start 2023-12-19T13:51:33.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.458+0000 7f6d7348b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 0x7f6d6c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.458+0000 7f6d7348b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c06bb30 con 0x7f6d6c06b590 2023-12-19T13:51:33.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.458+0000 7f6d7348b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c0b0070 con 0x7f6d6c1449e0 2023-12-19T13:51:33.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.458+0000 7f6d7348b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0b0350 con 0x7f6d6c0b0b50 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.458+0000 7f6d71a28640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6d6c06b590 0x7f6d6c0b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53314/0 (socket says 172.21.15.113:53314) 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.458+0000 7f6d71a28640 1 -- 172.21.15.113:0/2618508601 learned_addr learned my addr 172.21.15.113:0/2618508601 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d70a26640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 0x7f6d6c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738189576 0 0) 0x7f6d6c06bb30 con 0x7f6d6c06b590 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d58003520 con 0x7f6d6c06b590 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1844574427 0 0) 0x7f6d58003520 con 0x7f6d6c06b590 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 msgr2=0x7f6d6c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 0x7f6d6c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 >> v1:172.21.15.151:6789/0 conn(0x7f6d6c1449e0 legacy=0x7f6d6c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0b0630 con 0x7f6d6c06b590 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6d640019f0 con 0x7f6d6c06b590 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 >> v1:172.21.15.113:6789/0 conn(0x7f6d6c06b590 legacy=0x7f6d6c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d58003a10 0x7f6d58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 0x7f6d580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d58004d00 0x7f6d58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0b0350 con 0x7f6d58004d00 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800bac0 con 0x7f6d58003a10 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.459+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800bc80 con 0x7f6d6c0b0b50 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71a28640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d58004d00 0x7f6d58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d70a26640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 0x7f6d580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71227640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d58003a10 0x7f6d58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71a28640 1 -- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 msgr2=0x7f6d580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71a28640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d6c0b0b50 0x7f6d580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71a28640 1 -- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d58003a10 msgr2=0x7f6d58003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71a28640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d58003a10 0x7f6d58003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71a28640 1 -- 172.21.15.113:0/2618508601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58003520 con 0x7f6d58004d00 2023-12-19T13:51:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.460+0000 7f6d71227640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d58003a10 0x7f6d58003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.461+0000 7f6d71a28640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d58004d00 0x7f6d58005180 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400a800 tx=0x7f6d580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa880f82eb84495 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.461+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d640072d0 con 0x7f6d58004d00 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6402f070 con 0x7f6d58004d00 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d63fff640 1 -- 172.21.15.113:0/2618508601 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d640076b0 con 0x7f6d58004d00 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d7348b640 1 -- 172.21.15.113:0/2618508601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d58004d00 msgr2=0x7f6d58005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d7348b640 1 --2- 172.21.15.113:0/2618508601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d58004d00 0x7f6d58005180 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400a800 tx=0x7f6d580057f0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d71a28640 1 -- 172.21.15.113:0/2618508601 reap_dead start 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d7348b640 1 -- 172.21.15.113:0/2618508601 shutdown_connections 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d7348b640 1 -- 172.21.15.113:0/2618508601 >> 172.21.15.113:0/2618508601 conn(0x7f6d6c0cbb70 msgr2=0x7f6d6c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d7348b640 1 -- 172.21.15.113:0/2618508601 shutdown_connections 2023-12-19T13:51:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.462+0000 7f6d7348b640 1 -- 172.21.15.113:0/2618508601 wait complete. 2023-12-19T13:51:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.464+0000 7f6d7348b640 1 Processor -- start 2023-12-19T13:51:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.464+0000 7f6d7348b640 1 -- start start 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d7348b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d58004d00 0x7f6d6c1f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d7348b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d6c151fa0 0x7f6d6c1f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d7348b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d6c15da70 0x7f6d6c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d7348b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c142660 con 0x7f6d6c151fa0 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d7348b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c15e430 con 0x7f6d6c15da70 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d7348b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0a94a0 con 0x7f6d58004d00 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d70a26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d6c151fa0 0x7f6d6c1f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d70a26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d6c151fa0 0x7f6d6c1f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47288/0 (socket says 172.21.15.113:47288) 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.465+0000 7f6d70a26640 1 -- 172.21.15.113:0/1755379250 learned_addr learned my addr 172.21.15.113:0/1755379250 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d71a28640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d6c15da70 0x7f6d6c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d71227640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d58004d00 0x7f6d6c1f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d70a26640 1 -- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d58004d00 msgr2=0x7f6d6c1f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d70a26640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d58004d00 0x7f6d6c1f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d70a26640 1 -- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d6c15da70 msgr2=0x7f6d6c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d70a26640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d6c15da70 0x7f6d6c15def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d70a26640 1 -- 172.21.15.113:0/1755379250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c1f6d30 con 0x7f6d6c151fa0 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d70a26640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d6c151fa0 0x7f6d6c1f2130 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c011600 tx=0x7f6d5c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d61ffb640 1 -- 172.21.15.113:0/1755379250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00f920 con 0x7f6d6c151fa0 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d61ffb640 1 -- 172.21.15.113:0/1755379250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c00fa80 con 0x7f6d6c151fa0 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d61ffb640 1 -- 172.21.15.113:0/1755379250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00fdf0 con 0x7f6d6c151fa0 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.466+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0a8ee0 con 0x7f6d6c151fa0 2023-12-19T13:51:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.467+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c142280 con 0x7f6d6c151fa0 2023-12-19T13:51:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.468+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c1428d0 con 0x7f6d6c151fa0 2023-12-19T13:51:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.468+0000 7f6d61ffb640 1 -- 172.21.15.113:0/1755379250 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d5c015460 con 0x7f6d6c151fa0 2023-12-19T13:51:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.469+0000 7f6d61ffb640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d5006a430 0x7f6d5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.469+0000 7f6d61ffb640 1 -- 172.21.15.113:0/1755379250 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d5c088de0 con 0x7f6d6c151fa0 2023-12-19T13:51:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.470+0000 7f6d71227640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d5006a430 0x7f6d5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.470+0000 7f6d71227640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d5006a430 0x7f6d5006c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d68001630 tx=0x7f6d68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:33.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.474+0000 7f6d61ffb640 1 -- 172.21.15.113:0/1755379250 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d5c054460 con 0x7f6d6c151fa0 2023-12-19T13:51:33.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.699+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d6c061910 con 0x7f6d6c151fa0 2023-12-19T13:51:33.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.700+0000 7f6d61ffb640 1 -- 172.21.15.113:0/1755379250 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6d5c057a80 con 0x7f6d6c151fa0 2023-12-19T13:51:33.700 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.702+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d5006a430 msgr2=0x7f6d5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.702+0000 7f6d7348b640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d5006a430 0x7f6d5006c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d68001630 tx=0x7f6d68009040 comp rx=0 tx=0).stop 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.702+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d6c151fa0 msgr2=0x7f6d6c1f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.702+0000 7f6d7348b640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d6c151fa0 0x7f6d6c1f2130 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c011600 tx=0x7f6d5c011ac0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 shutdown_connections 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6d5006a430 0x7f6d5006c8f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d6c15da70 0x7f6d6c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d6c151fa0 0x7f6d6c1f2130 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 --2- 172.21.15.113:0/1755379250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d58004d00 0x7f6d6c1f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:33.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 >> 172.21.15.113:0/1755379250 conn(0x7f6d6c0cbb70 msgr2=0x7f6d6c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:33.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 shutdown_connections 2023-12-19T13:51:33.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:33.703+0000 7f6d7348b640 1 -- 172.21.15.113:0/1755379250 wait complete. 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:51:33.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:51:33.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:33.723 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:51:33.771 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:51:33.772 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42126sec preferred_lft 42126sec 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:33.773 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:51:33.774 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:51:33.774 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:51:33.774 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:33.774 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:51:33.774 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:51:33.774 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:51:33.774 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:33.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:33.775 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:51:33.856 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:51:33.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:33.860 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:51:33.911 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:51:33.911 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:51:33.911 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:51:33.911 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:51:33.911 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:51:33.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:33.912 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:51:33.912 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:51:33.912 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:51:33.912 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:51:33.912 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:51:33.912 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:51:34.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:34.089 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:51:34.138 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:51:34.138 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:51:34.139 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:51:34.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:34.139 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:51:34.229 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:51:34.229 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:51:34.284 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:51:34.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:51:34.285 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:51:34.333 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:51:34.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:34.333 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:51:34.470 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:51:34.470 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:51:34.505 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:51:34.505 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:51:34.505 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:51:34.506 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:51:34.506 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:51:34.509 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:51:34.509 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:51:34.509 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:51:34.509 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:51:34.509 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:51:34.512 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:51:34.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:34.513 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:51:34.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:34.594 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:51:34.666 INFO:teuthology.orchestra.run.smithi113.stdout:client5024 2023-12-19T13:51:34.667 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:51:34.667 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:34.722 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:51:34.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.916+0000 7fdc1aa29640 1 Processor -- start 2023-12-19T13:51:34.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.916+0000 7fdc1aa29640 1 -- start start 2023-12-19T13:51:34.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.918+0000 7fdc1aa29640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdc14159f80 0x7fdc1406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:34.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.918+0000 7fdc1aa29640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1406b520 con 0x7fdc1415b1e0 2023-12-19T13:51:34.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.918+0000 7fdc1aa29640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140b2b20 con 0x7fdc1415aa70 2023-12-19T13:51:34.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.918+0000 7fdc1aa29640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc140b2fb0 con 0x7fdc14159f80 2023-12-19T13:51:34.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.918+0000 7fdc19a27640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdc14159f80 0x7fdc1406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:34.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.918+0000 7fdc19226640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdc1415b1e0 0x7fdc1415a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53326/0 (socket says 172.21.15.113:53326) 2023-12-19T13:51:34.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.918+0000 7fdc19226640 1 -- 172.21.15.113:0/2613146386 learned_addr learned my addr 172.21.15.113:0/2613146386 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.919+0000 7fdc19a27640 1 -- 172.21.15.113:0/2613146386 >> v1:172.21.15.151:6789/0 conn(0x7fdc1415aa70 legacy=0x7fdc1415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.919+0000 7fdc19a27640 1 -- 172.21.15.113:0/2613146386 >> v1:172.21.15.113:6789/0 conn(0x7fdc1415b1e0 legacy=0x7fdc1415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.919+0000 7fdc19a27640 1 -- 172.21.15.113:0/2613146386 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140b1f10 con 0x7fdc14159f80 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.920+0000 7fdc19a27640 1 --2- 172.21.15.113:0/2613146386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc14159f80 0x7fdc1406f160 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fdc100097a0 tx=0x7fdc1002db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f616582f11995925 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.920+0000 7fdc18a25640 1 -- 172.21.15.113:0/2613146386 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1002e920 con 0x7fdc14159f80 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.920+0000 7fdc18a25640 1 -- 172.21.15.113:0/2613146386 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1002ea80 con 0x7fdc14159f80 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.920+0000 7fdc18a25640 1 -- 172.21.15.113:0/2613146386 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1002ee10 con 0x7fdc14159f80 2023-12-19T13:51:34.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.921+0000 7fdc1aa29640 1 -- 172.21.15.113:0/2613146386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc14159f80 msgr2=0x7fdc1406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.921+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/2613146386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc14159f80 0x7fdc1406f160 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fdc100097a0 tx=0x7fdc1002db70 comp rx=0 tx=0).stop 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.921+0000 7fdc1aa29640 1 -- 172.21.15.113:0/2613146386 shutdown_connections 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.921+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/2613146386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc14159f80 0x7fdc1406f160 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.921+0000 7fdc1aa29640 1 -- 172.21.15.113:0/2613146386 >> 172.21.15.113:0/2613146386 conn(0x7fdc140b0100 msgr2=0x7fdc140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.921+0000 7fdc1aa29640 1 -- 172.21.15.113:0/2613146386 shutdown_connections 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.921+0000 7fdc1aa29640 1 -- 172.21.15.113:0/2613146386 wait complete. 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.923+0000 7fdc1aa29640 1 Processor -- start 2023-12-19T13:51:34.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.923+0000 7fdc1aa29640 1 -- start start 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1aa29640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc14159f80 0x7fdc1414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1aa29640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc1415aa70 0x7fdc140cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1aa29640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc1415b1e0 0x7fdc140ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1aa29640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c6000 con 0x7fdc1415b1e0 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1aa29640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c62e0 con 0x7fdc14159f80 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1aa29640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c65c0 con 0x7fdc1415aa70 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1a228640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc1415b1e0 0x7fdc140ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1a228640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc1415b1e0 0x7fdc140ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47312/0 (socket says 172.21.15.113:47312) 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1a228640 1 -- 172.21.15.113:0/67227912 learned_addr learned my addr 172.21.15.113:0/67227912 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:34.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1a228640 1 -- 172.21.15.113:0/67227912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc1415aa70 msgr2=0x7fdc140cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1a228640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc1415aa70 0x7fdc140cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc1a228640 1 -- 172.21.15.113:0/67227912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc14159f80 msgr2=0x7fdc1414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.924+0000 7fdc19a27640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc14159f80 0x7fdc1414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc1a228640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc14159f80 0x7fdc1414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc1a228640 1 -- 172.21.15.113:0/67227912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10009400 con 0x7fdc1415b1e0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc1a228640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc1415b1e0 0x7fdc140ccd70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c780 tx=0x7fdc0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc0a7fc640 1 -- 172.21.15.113:0/67227912 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c003d80 con 0x7fdc1415b1e0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc0a7fc640 1 -- 172.21.15.113:0/67227912 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c00ce90 con 0x7fdc1415b1e0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc0a7fc640 1 -- 172.21.15.113:0/67227912 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0052b0 con 0x7fdc1415b1e0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc140c68a0 con 0x7fdc1415b1e0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.925+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1414fa40 con 0x7fdc1415b1e0 2023-12-19T13:51:34.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.926+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc140c6dc0 con 0x7fdc1415b1e0 2023-12-19T13:51:34.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.927+0000 7fdc0a7fc640 1 -- 172.21.15.113:0/67227912 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc0c005410 con 0x7fdc1415b1e0 2023-12-19T13:51:34.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.928+0000 7fdc0a7fc640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdbf806a430 0x7fdbf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:34.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.928+0000 7fdc0a7fc640 1 -- 172.21.15.113:0/67227912 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc0c087ea0 con 0x7fdc1415b1e0 2023-12-19T13:51:34.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.928+0000 7fdc19a27640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdbf806a430 0x7fdbf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:34.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.929+0000 7fdc19a27640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdbf806a430 0x7fdbf806c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdc10038000 tx=0x7fdc10032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:34.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:34.933+0000 7fdc0a7fc640 1 -- 172.21.15.113:0/67227912 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc140c6dc0 con 0x7fdc1415b1e0 2023-12-19T13:51:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.160+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc140c6dc0 con 0x7fdc1415b1e0 2023-12-19T13:51:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.161+0000 7fdc0a7fc640 1 -- 172.21.15.113:0/67227912 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdc140c6dc0 con 0x7fdc1415b1e0 2023-12-19T13:51:35.162 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:51:35.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdbf806a430 msgr2=0x7fdbf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdbf806a430 0x7fdbf806c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdc10038000 tx=0x7fdc10032000 comp rx=0 tx=0).stop 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc1415b1e0 msgr2=0x7fdc140ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc1415b1e0 0x7fdc140ccd70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c780 tx=0x7fdc0c00cc40 comp rx=0 tx=0).stop 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 shutdown_connections 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdbf806a430 0x7fdbf806c8f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc1415b1e0 0x7fdc140ccd70 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc1415aa70 0x7fdc140cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 --2- 172.21.15.113:0/67227912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc14159f80 0x7fdc1414f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 >> 172.21.15.113:0/67227912 conn(0x7fdc140b0100 msgr2=0x7fdc1415d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 shutdown_connections 2023-12-19T13:51:35.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:35.164+0000 7fdc1aa29640 1 -- 172.21.15.113:0/67227912 wait complete. 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:51:35.182 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:51:35.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:35.183 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:51:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:51:35.243 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:51:35.243 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:51:35.243 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:35.243 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:51:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42100sec preferred_lft 42100sec 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:51:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:51:35.246 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:51:35.246 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:51:35.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:35.247 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:51:35.335 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:51:35.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:35.339 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:51:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:51:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:51:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:51:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:51:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:51:35.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:35.395 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:51:35.395 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:51:35.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:51:35.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:51:35.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:51:35.395 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:51:35.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:35.570 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:51:35.621 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:51:35.621 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:51:35.622 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:51:35.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:35.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:51:35.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:51:35.718 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:51:35.775 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:51:35.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:51:35.776 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:51:35.826 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:51:35.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:35.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:51:35.968 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:51:35.968 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:51:35.999 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:51:35.999 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:51:35.999 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:51:35.999 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:51:35.999 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:51:36.001 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:51:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:51:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:51:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:51:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:51:36.005 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:51:36.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:36.005 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:51:36.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:51:36.090 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:51:36.146 INFO:teuthology.orchestra.run.smithi151.stdout:client6675 2023-12-19T13:51:36.146 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:51:36.146 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:51:36.198 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:51:36.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.415+0000 7f2c08877640 1 Processor -- start 2023-12-19T13:51:36.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.415+0000 7f2c08877640 1 -- start start 2023-12-19T13:51:36.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.416+0000 7f2c08877640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2c04141a70 0x7f2c0406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:36.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.416+0000 7f2c08877640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040b1560 0x7f2c040b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:36.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.416+0000 7f2c08877640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c040b1ef0 con 0x7f2c040af7d0 2023-12-19T13:51:36.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.416+0000 7f2c08877640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c04141e50 con 0x7f2c04141a70 2023-12-19T13:51:36.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.416+0000 7f2c08877640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0406b480 con 0x7f2c040b1560 2023-12-19T13:51:36.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.417+0000 7f2c0259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2c04141a70 0x7f2c0406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:36.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.417+0000 7f2c0259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2c04141a70 0x7f2c0406c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47320/0 (socket says 172.21.15.113:47320) 2023-12-19T13:51:36.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.417+0000 7f2c0259c640 1 -- 172.21.15.113:0/3698508178 learned_addr learned my addr 172.21.15.113:0/3698508178 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:36.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.417+0000 7f2c0259c640 1 -- 172.21.15.113:0/3698508178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040b1560 msgr2=0x7f2c040b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:36.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.417+0000 7f2c0259c640 1 --2- 172.21.15.113:0/3698508178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040b1560 0x7f2c040b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.417+0000 7f2c0259c640 1 -- 172.21.15.113:0/3698508178 >> v1:172.21.15.151:6789/0 conn(0x7f2c040af7d0 legacy=0x7f2c0406df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:51:36.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.417+0000 7f2c0259c640 1 -- 172.21.15.113:0/3698508178 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0406b760 con 0x7f2c04141a70 2023-12-19T13:51:36.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.418+0000 7f2c0259c640 1 --2- 172.21.15.113:0/3698508178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c04141a70 0x7f2c0406c520 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2c040cedf0 tx=0x7f2bf402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9304e017fe4c034 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:36.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c01d9b640 1 -- 172.21.15.113:0/3698508178 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4031640 con 0x7f2c04141a70 2023-12-19T13:51:36.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c01d9b640 1 -- 172.21.15.113:0/3698508178 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf40317a0 con 0x7f2c04141a70 2023-12-19T13:51:36.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c01d9b640 1 -- 172.21.15.113:0/3698508178 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4031b30 con 0x7f2c04141a70 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 -- 172.21.15.113:0/3698508178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c04141a70 msgr2=0x7f2c0406c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 --2- 172.21.15.113:0/3698508178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c04141a70 0x7f2c0406c520 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2c040cedf0 tx=0x7f2bf402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 -- 172.21.15.113:0/3698508178 shutdown_connections 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 --2- 172.21.15.113:0/3698508178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040b1560 0x7f2c040b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 --2- 172.21.15.113:0/3698508178 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c04141a70 0x7f2c0406c520 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 -- 172.21.15.113:0/3698508178 >> 172.21.15.113:0/3698508178 conn(0x7f2c040cef20 msgr2=0x7f2c040cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 -- 172.21.15.113:0/3698508178 shutdown_connections 2023-12-19T13:51:36.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.419+0000 7f2c08877640 1 -- 172.21.15.113:0/3698508178 wait complete. 2023-12-19T13:51:36.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.421+0000 7f2c08877640 1 Processor -- start 2023-12-19T13:51:36.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.422+0000 7f2c08877640 1 -- start start 2023-12-19T13:51:36.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c08877640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040af7d0 0x7f2c040cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:36.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c08877640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c040b1560 0x7f2c0415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:36.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c08877640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c04141a70 0x7f2c0415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:36.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c08877640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415c380 con 0x7f2c040b1560 2023-12-19T13:51:36.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c08877640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415ba70 con 0x7f2c04141a70 2023-12-19T13:51:36.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c08877640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cb3d0 con 0x7f2c040af7d0 2023-12-19T13:51:36.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c040b1560 0x7f2c0415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:36.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c040b1560 0x7f2c0415a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47334/0 (socket says 172.21.15.113:47334) 2023-12-19T13:51:36.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 -- 172.21.15.113:0/3079089380 learned_addr learned my addr 172.21.15.113:0/3079089380 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c02d9d640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c04141a70 0x7f2c0415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c0259c640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040af7d0 0x7f2c040cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 -- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040af7d0 msgr2=0x7f2c040cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040af7d0 0x7f2c040cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 -- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c04141a70 msgr2=0x7f2c0415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c04141a70 0x7f2c0415c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2bfbfff640 1 -- 172.21.15.113:0/3079089380 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40094d0 con 0x7f2c040b1560 2023-12-19T13:51:36.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.423+0000 7f2c02d9d640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c04141a70 0x7f2c0415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.424+0000 7f2bfbfff640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c040b1560 0x7f2c0415a690 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c400 tx=0x7f2bec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.424+0000 7f2bfaffd640 1 -- 172.21.15.113:0/3079089380 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0035f0 con 0x7f2c040b1560 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.424+0000 7f2bfaffd640 1 -- 172.21.15.113:0/3079089380 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec003750 con 0x7f2c040b1560 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.424+0000 7f2bfaffd640 1 -- 172.21.15.113:0/3079089380 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec003b40 con 0x7f2c040b1560 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.424+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c041f3a50 con 0x7f2c040b1560 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.424+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0415bfa0 con 0x7f2c040b1560 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.425+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0415c4c0 con 0x7f2c040b1560 2023-12-19T13:51:36.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.426+0000 7f2bfaffd640 1 -- 172.21.15.113:0/3079089380 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2bec003ca0 con 0x7f2c040b1560 2023-12-19T13:51:36.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.428+0000 7f2bfaffd640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2be406a430 0x7f2be406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:51:36.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.428+0000 7f2bfaffd640 1 -- 172.21.15.113:0/3079089380 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bec087b00 con 0x7f2c040b1560 2023-12-19T13:51:36.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.428+0000 7f2c0259c640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2be406a430 0x7f2be406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:51:36.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.429+0000 7f2c0259c640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2be406a430 0x7f2be406c8f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4036000 tx=0x7f2bf403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:51:36.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.433+0000 7f2bfaffd640 1 -- 172.21.15.113:0/3079089380 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2c0415c4c0 con 0x7f2c040b1560 2023-12-19T13:51:36.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.657+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c0415c4c0 con 0x7f2c040b1560 2023-12-19T13:51:36.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.659+0000 7f2bfaffd640 1 -- 172.21.15.113:0/3079089380 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f2c0415c4c0 con 0x7f2c040b1560 2023-12-19T13:51:36.659 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:51:36.659 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:51:21.594253+0000","modified":"2023-12-19T13:51:24.611657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2704300841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2704300841},{"type":"v1","addr":"172.21.15.151:6835","nonce":2704300841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T13:51:36.660 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 41 2023-12-19T13:51:36.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.661+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2be406a430 msgr2=0x7f2be406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:36.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.661+0000 7f2c08877640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2be406a430 0x7f2be406c8f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4036000 tx=0x7f2bf403c040 comp rx=0 tx=0).stop 2023-12-19T13:51:36.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.661+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c040b1560 msgr2=0x7f2c0415a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.661+0000 7f2c08877640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c040b1560 0x7f2c0415a690 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c400 tx=0x7f2bec00c8c0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 shutdown_connections 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2be406a430 0x7f2be406c8f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c04141a70 0x7f2c0415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c040b1560 0x7f2c0415a690 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 --2- 172.21.15.113:0/3079089380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c040af7d0 0x7f2c040cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 >> 172.21.15.113:0/3079089380 conn(0x7f2c040cef20 msgr2=0x7f2c04070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 shutdown_connections 2023-12-19T13:51:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:51:36.662+0000 7f2c08877640 1 -- 172.21.15.113:0/3079089380 wait complete. 2023-12-19T13:51:36.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-19T13:51:36.924 INFO:teuthology.orchestra.run.smithi151.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":6501,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.308943766000001,"mdsmap_epoch":41,"osdmap_epoch":94,"osdmap_epoch_barrier":94,"uptime":20.959202977} 2023-12-19T13:51:36.924 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 6501, "mdsmap_epoch": 41, "osdmap_epoch": 94, "osdmap_epoch_barrier": 94, "rank_uptime": 15.308943766, "state": "up:active", "uptime": 20.959202977, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:51:36.925 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:51:37.158 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:51:37.159 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:51:37.159 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T13:51:37.372 INFO:teuthology.orchestra.run.smithi113.stdout:{"mon_tick_interval":"5"} 2023-12-19T13:51:37.372 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T13:51:37.373 INFO:tasks.cephfs.test_full:pool capacity 557028928, 531MB should be enough to fill it 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> import time 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> import datetime 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> # Write some buffered data through before going full, all should be well 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> print("writing some data through which we expect to succeed") 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> bytes = 0 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T13:51:37.373 DEBUG:teuthology.orchestra.run.smithi113:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> # from write 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> full = False 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> for n in range(0, int(531 * 1.1)): 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> except OSError as e: 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> if False: 2023-12-19T13:51:37.374 DEBUG:teuthology.orchestra.run.smithi113:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> raise 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> full = True 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> break 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> print("fsync'"'"'ed successfully") 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> except OSError as e: 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> full = True 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> break 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.375 DEBUG:teuthology.orchestra.run.smithi113:> if n > 531 * 0.9: 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> # Be cautious in the last region where we expect to hit 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> time.sleep(15.0) 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> if not full: 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> # close() should not raise an error because we already caught it in 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> # since then because all IOs got cancelled on the full flag. 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> print("calling close") 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> os.close(f) 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> print("close() did not raise error") 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T13:51:37.376 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:writing some data through which we expect to succeed 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 1.00 MB 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.866 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 2.00 MB 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 3.00 MB 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 4.00 MB 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 5.00 MB 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 6.00 MB 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.867 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 7.00 MB 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 8.00 MB 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 9.00 MB 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 10.00 MB 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 11.00 MB 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.868 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 12.00 MB 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 13.00 MB 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 14.00 MB 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 15.00 MB 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 16.00 MB 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.869 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 17.00 MB 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 18.00 MB 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 19.00 MB 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 20.00 MB 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 21.00 MB 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.870 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 22.00 MB 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 23.00 MB 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 24.00 MB 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 25.00 MB 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 26.00 MB 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.871 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 27.00 MB 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 28.00 MB 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 29.00 MB 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 30.00 MB 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 31.00 MB 2023-12-19T13:51:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 32.00 MB 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 33.00 MB 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 34.00 MB 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 35.00 MB 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 36.00 MB 2023-12-19T13:51:41.873 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 37.00 MB 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 38.00 MB 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 39.00 MB 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 40.00 MB 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.874 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 41.00 MB 2023-12-19T13:51:41.875 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 42.00 MB 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 43.00 MB 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 44.00 MB 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 45.00 MB 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 46.00 MB 2023-12-19T13:51:41.876 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 47.00 MB 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 48.00 MB 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 49.00 MB 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 50.00 MB 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.877 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 51.00 MB 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 52.00 MB 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 53.00 MB 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 54.00 MB 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 55.00 MB 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.878 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 56.00 MB 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 57.00 MB 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 58.00 MB 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 59.00 MB 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 60.00 MB 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.879 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 61.00 MB 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 62.00 MB 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 63.00 MB 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 64.00 MB 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 65.00 MB 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.880 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 66.00 MB 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 67.00 MB 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 68.00 MB 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 69.00 MB 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 70.00 MB 2023-12-19T13:51:41.881 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 71.00 MB 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 72.00 MB 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 73.00 MB 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 74.00 MB 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 75.00 MB 2023-12-19T13:51:41.882 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 76.00 MB 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 77.00 MB 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 78.00 MB 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 79.00 MB 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:41.883 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 80.00 MB 2023-12-19T13:51:42.724 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.724 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.724 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 81.00 MB 2023-12-19T13:51:42.724 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 82.00 MB 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 83.00 MB 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 84.00 MB 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 85.00 MB 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.725 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 86.00 MB 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 87.00 MB 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 88.00 MB 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 89.00 MB 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 90.00 MB 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.726 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 91.00 MB 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 92.00 MB 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 93.00 MB 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 94.00 MB 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.727 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 95.00 MB 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 96.00 MB 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 97.00 MB 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 98.00 MB 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 99.00 MB 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.728 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 100.00 MB 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 101.00 MB 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 102.00 MB 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 103.00 MB 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.729 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 104.00 MB 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 105.00 MB 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 106.00 MB 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.730 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 107.00 MB 2023-12-19T13:51:42.731 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.731 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.731 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 108.00 MB 2023-12-19T13:51:42.731 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.731 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 109.00 MB 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 110.00 MB 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 111.00 MB 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.732 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.733 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 112.00 MB 2023-12-19T13:51:42.733 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.733 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.733 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 113.00 MB 2023-12-19T13:51:42.733 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.733 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.733 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 114.00 MB 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 115.00 MB 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 116.00 MB 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 117.00 MB 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 118.00 MB 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.734 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 119.00 MB 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 120.00 MB 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 121.00 MB 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 122.00 MB 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 123.00 MB 2023-12-19T13:51:42.735 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 124.00 MB 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 125.00 MB 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 126.00 MB 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 127.00 MB 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.736 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 128.00 MB 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 129.00 MB 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 130.00 MB 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.737 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 131.00 MB 2023-12-19T13:51:42.738 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.738 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.738 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 132.00 MB 2023-12-19T13:51:42.738 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.738 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.738 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 133.00 MB 2023-12-19T13:51:42.738 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.739 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 134.00 MB 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 135.00 MB 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 136.00 MB 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 137.00 MB 2023-12-19T13:51:42.740 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 138.00 MB 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 139.00 MB 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 140.00 MB 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 141.00 MB 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 142.00 MB 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 143.00 MB 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 144.00 MB 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 145.00 MB 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 146.00 MB 2023-12-19T13:51:42.742 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 147.00 MB 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 148.00 MB 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 149.00 MB 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.743 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 150.00 MB 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 151.00 MB 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 152.00 MB 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 153.00 MB 2023-12-19T13:51:42.744 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 154.00 MB 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 155.00 MB 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 156.00 MB 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.745 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 157.00 MB 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 158.00 MB 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 159.00 MB 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 160.00 MB 2023-12-19T13:51:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.581 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.581 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 161.00 MB 2023-12-19T13:51:43.581 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.581 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.581 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 162.00 MB 2023-12-19T13:51:43.581 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 163.00 MB 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 164.00 MB 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 165.00 MB 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 166.00 MB 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.582 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 167.00 MB 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 168.00 MB 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 169.00 MB 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 170.00 MB 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 171.00 MB 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.583 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 172.00 MB 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 173.00 MB 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 174.00 MB 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 175.00 MB 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 176.00 MB 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.584 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 177.00 MB 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 178.00 MB 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 179.00 MB 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 180.00 MB 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 181.00 MB 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.585 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 182.00 MB 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 183.00 MB 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 184.00 MB 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 185.00 MB 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 186.00 MB 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.586 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 187.00 MB 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 188.00 MB 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 189.00 MB 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 190.00 MB 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 191.00 MB 2023-12-19T13:51:43.587 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 192.00 MB 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 193.00 MB 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 194.00 MB 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.588 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 195.00 MB 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 196.00 MB 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 197.00 MB 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.589 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 198.00 MB 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 199.00 MB 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 200.00 MB 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 201.00 MB 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 202.00 MB 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.590 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 203.00 MB 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 204.00 MB 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 205.00 MB 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 206.00 MB 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 207.00 MB 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.591 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 208.00 MB 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 209.00 MB 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 210.00 MB 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 211.00 MB 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 212.00 MB 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.592 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 213.00 MB 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 214.00 MB 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 215.00 MB 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 216.00 MB 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 217.00 MB 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.593 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 218.00 MB 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 219.00 MB 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 220.00 MB 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 221.00 MB 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 222.00 MB 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.594 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 223.00 MB 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 224.00 MB 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 225.00 MB 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 226.00 MB 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 227.00 MB 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.595 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 228.00 MB 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 229.00 MB 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 230.00 MB 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 231.00 MB 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 232.00 MB 2023-12-19T13:51:43.596 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 233.00 MB 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 234.00 MB 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 235.00 MB 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 236.00 MB 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 237.00 MB 2023-12-19T13:51:43.597 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 238.00 MB 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 239.00 MB 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 240.00 MB 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:43.598 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 241.00 MB 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 242.00 MB 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 243.00 MB 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.458 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 244.00 MB 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 245.00 MB 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 246.00 MB 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 247.00 MB 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.459 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 248.00 MB 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 249.00 MB 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 250.00 MB 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 251.00 MB 2023-12-19T13:51:44.460 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 252.00 MB 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 253.00 MB 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 254.00 MB 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 255.00 MB 2023-12-19T13:51:44.461 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 256.00 MB 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 257.00 MB 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 258.00 MB 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 259.00 MB 2023-12-19T13:51:44.462 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 260.00 MB 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 261.00 MB 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 262.00 MB 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 263.00 MB 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 264.00 MB 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 265.00 MB 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 266.00 MB 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 267.00 MB 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.464 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 268.00 MB 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 269.00 MB 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 270.00 MB 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 271.00 MB 2023-12-19T13:51:44.465 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 272.00 MB 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 273.00 MB 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 274.00 MB 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 275.00 MB 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.466 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 276.00 MB 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 277.00 MB 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 278.00 MB 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 279.00 MB 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.467 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 280.00 MB 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 281.00 MB 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 282.00 MB 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 283.00 MB 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.468 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 284.00 MB 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 285.00 MB 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 286.00 MB 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 287.00 MB 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.469 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 288.00 MB 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 289.00 MB 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 290.00 MB 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.470 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 291.00 MB 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 292.00 MB 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 293.00 MB 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 294.00 MB 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 295.00 MB 2023-12-19T13:51:44.471 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 296.00 MB 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 297.00 MB 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 298.00 MB 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 299.00 MB 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.472 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 300.00 MB 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 301.00 MB 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 302.00 MB 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 303.00 MB 2023-12-19T13:51:44.473 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 304.00 MB 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 305.00 MB 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 306.00 MB 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 307.00 MB 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.474 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 308.00 MB 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 309.00 MB 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 310.00 MB 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 311.00 MB 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.475 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 312.00 MB 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 313.00 MB 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 314.00 MB 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 315.00 MB 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 316.00 MB 2023-12-19T13:51:44.476 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 317.00 MB 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 318.00 MB 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 319.00 MB 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 320.00 MB 2023-12-19T13:51:44.477 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:44.478 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:44.478 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 321.00 MB 2023-12-19T13:51:45.295 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.295 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.295 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 322.00 MB 2023-12-19T13:51:45.295 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.295 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.295 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 323.00 MB 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 324.00 MB 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 325.00 MB 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 326.00 MB 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 327.00 MB 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 328.00 MB 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 329.00 MB 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 330.00 MB 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 331.00 MB 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 332.00 MB 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 333.00 MB 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 334.00 MB 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 335.00 MB 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 336.00 MB 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.298 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 337.00 MB 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 338.00 MB 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 339.00 MB 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 340.00 MB 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 341.00 MB 2023-12-19T13:51:45.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.300 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 342.00 MB 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 343.00 MB 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 344.00 MB 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.301 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 345.00 MB 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 346.00 MB 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 347.00 MB 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 348.00 MB 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 349.00 MB 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 350.00 MB 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 351.00 MB 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 352.00 MB 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 353.00 MB 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 354.00 MB 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.303 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 355.00 MB 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 356.00 MB 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 357.00 MB 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 358.00 MB 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 359.00 MB 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.304 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 360.00 MB 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 361.00 MB 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 362.00 MB 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 363.00 MB 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 364.00 MB 2023-12-19T13:51:45.305 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 365.00 MB 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 366.00 MB 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 367.00 MB 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 368.00 MB 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.306 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 369.00 MB 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 370.00 MB 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 371.00 MB 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 372.00 MB 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 373.00 MB 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.307 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 374.00 MB 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 375.00 MB 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 376.00 MB 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 377.00 MB 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 378.00 MB 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.308 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 379.00 MB 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 380.00 MB 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 381.00 MB 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 382.00 MB 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 383.00 MB 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.309 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 384.00 MB 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 385.00 MB 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 386.00 MB 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 387.00 MB 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.310 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 388.00 MB 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 389.00 MB 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 390.00 MB 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 391.00 MB 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 392.00 MB 2023-12-19T13:51:45.311 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 393.00 MB 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 394.00 MB 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 395.00 MB 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 396.00 MB 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 397.00 MB 2023-12-19T13:51:45.312 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 398.00 MB 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 399.00 MB 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 400.00 MB 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:51:45.313 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 401.00 MB 2023-12-19T13:51:48.715 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:48.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:48.757 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:51:48.758+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-19T13:52:16.283 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.283 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.283 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 402.00 MB 2023-12-19T13:52:16.283 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.283 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 403.00 MB 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 404.00 MB 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 405.00 MB 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 406.00 MB 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.284 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 407.00 MB 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 408.00 MB 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 409.00 MB 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 410.00 MB 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 411.00 MB 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.285 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 412.00 MB 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 413.00 MB 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 414.00 MB 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 415.00 MB 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 416.00 MB 2023-12-19T13:52:16.286 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 417.00 MB 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 418.00 MB 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 419.00 MB 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 420.00 MB 2023-12-19T13:52:16.287 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 421.00 MB 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 422.00 MB 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.288 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 423.00 MB 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 424.00 MB 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 425.00 MB 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 426.00 MB 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.289 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 427.00 MB 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 428.00 MB 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 429.00 MB 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 430.00 MB 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 431.00 MB 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.290 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.291 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 432.00 MB 2023-12-19T13:52:16.291 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.291 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.291 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 433.00 MB 2023-12-19T13:52:16.291 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.291 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.291 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 434.00 MB 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 435.00 MB 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 436.00 MB 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 437.00 MB 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 438.00 MB 2023-12-19T13:52:16.292 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 439.00 MB 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 440.00 MB 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 441.00 MB 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 442.00 MB 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.293 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 443.00 MB 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 444.00 MB 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 445.00 MB 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 446.00 MB 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.294 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 447.00 MB 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 448.00 MB 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 449.00 MB 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 450.00 MB 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.295 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 451.00 MB 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 452.00 MB 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 453.00 MB 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 454.00 MB 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 455.00 MB 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.296 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 456.00 MB 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 457.00 MB 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 458.00 MB 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 459.00 MB 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.297 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 460.00 MB 2023-12-19T13:52:16.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.298 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.298 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 461.00 MB 2023-12-19T13:52:16.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.298 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.298 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 462.00 MB 2023-12-19T13:52:16.298 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 463.00 MB 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 464.00 MB 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 465.00 MB 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 466.00 MB 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.299 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 467.00 MB 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 468.00 MB 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 469.00 MB 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 470.00 MB 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 471.00 MB 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.300 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.301 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 472.00 MB 2023-12-19T13:52:16.301 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.301 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.301 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 473.00 MB 2023-12-19T13:52:16.301 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.301 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.301 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 474.00 MB 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 475.00 MB 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 476.00 MB 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 477.00 MB 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 478.00 MB 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.302 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.303 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 479.00 MB 2023-12-19T13:52:16.303 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:52:16.303 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:52:16.303 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:52:16.303 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 480.00 MB 2023-12-19T13:52:16.303 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:52:16.415 INFO:teuthology.orchestra.run.smithi113.stdout:Reached fullness after 480.00 MB 2023-12-19T13:52:16.416 INFO:teuthology.orchestra.run.smithi113.stdout:calling close 2023-12-19T13:52:16.416 INFO:teuthology.orchestra.run.smithi113.stdout:close() did not raise error 2023-12-19T13:52:16.560 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:52:16.561 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:52:16.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:52:16.816 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:52:16.817 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:16.817 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:16.878 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:16.878 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:16.932 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:17.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.140+0000 7fe8ea2b9640 1 Processor -- start 2023-12-19T13:52:17.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.141+0000 7fe8ea2b9640 1 -- start start 2023-12-19T13:52:17.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.142+0000 7fe8ea2b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe8e4146e30 0x7fe8e40b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.142+0000 7fe8ea2b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e40d1070 con 0x7fe8e40b7ea0 2023-12-19T13:52:17.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.142+0000 7fe8ea2b9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e40d12d0 con 0x7fe8e40d0c60 2023-12-19T13:52:17.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.142+0000 7fe8ea2b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e4147210 con 0x7fe8e4146e30 2023-12-19T13:52:17.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.142+0000 7fe8e8ab6640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe8e40b7ea0 0x7fe8e40d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44978/0 (socket says 172.21.15.113:44978) 2023-12-19T13:52:17.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8e8ab6640 1 -- 172.21.15.113:0/2092297746 learned_addr learned my addr 172.21.15.113:0/2092297746 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8e92b7640 1 --2- 172.21.15.113:0/2092297746 >> v2:172.21.15.151:3300/0 conn(0x7fe8e4146e30 0x7fe8e40b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679799737 0 0) 0x7fe8e40d1070 con 0x7fe8e40b7ea0 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d0003520 con 0x7fe8e40b7ea0 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 875896507 0 0) 0x7fe8d0003520 con 0x7fe8e40b7ea0 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 >> v2:172.21.15.151:3300/0 conn(0x7fe8e4146e30 msgr2=0x7fe8e40b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 --2- 172.21.15.113:0/2092297746 >> v2:172.21.15.151:3300/0 conn(0x7fe8e4146e30 0x7fe8e40b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 >> v1:172.21.15.151:6789/0 conn(0x7fe8e40d0c60 legacy=0x7fe8e415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e40d15b0 con 0x7fe8e40b7ea0 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe8d4001670 con 0x7fe8e40b7ea0 2023-12-19T13:52:17.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 >> v1:172.21.15.113:6789/0 conn(0x7fe8e40b7ea0 legacy=0x7fe8e40d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.143+0000 7fe8dbfff640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003970 0x7fe8d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8dbfff640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d00047c0 0x7fe8d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8dbfff640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d0005180 0x7fe8d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4147210 con 0x7fe8d0005180 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000c120 con 0x7fe8d00047c0 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000c2e0 con 0x7fe8d0003970 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e9ab8640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d0005180 0x7fe8d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e92b7640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003970 0x7fe8d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e8ab6640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d00047c0 0x7fe8d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e9ab8640 1 -- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003970 msgr2=0x7fe8d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e9ab8640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003970 0x7fe8d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e9ab8640 1 -- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d00047c0 msgr2=0x7fe8d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e9ab8640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d00047c0 0x7fe8d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.144+0000 7fe8e9ab8640 1 -- 172.21.15.113:0/2092297746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0003520 con 0x7fe8d0005180 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.145+0000 7fe8e9ab8640 1 -- 172.21.15.113:0/2092297746 reap_dead start 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.145+0000 7fe8e9ab8640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d0005180 0x7fe8d000b980 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc001e50 tx=0x7fe8d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0f025a968c5039 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc003b70 con 0x7fe8d0005180 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc003d10 con 0x7fe8d0005180 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8dbfff640 1 -- 172.21.15.113:0/2092297746 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc005310 con 0x7fe8d0005180 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/2092297746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d0005180 msgr2=0x7fe8d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d0005180 0x7fe8d000b980 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc001e50 tx=0x7fe8d00057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/2092297746 shutdown_connections 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/2092297746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d0005180 0x7fe8d000b980 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/2092297746 >> 172.21.15.113:0/2092297746 conn(0x7fe8e40b2990 msgr2=0x7fe8e40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.146+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/2092297746 shutdown_connections 2023-12-19T13:52:17.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.147+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/2092297746 wait complete. 2023-12-19T13:52:17.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.148+0000 7fe8ea2b9640 1 Processor -- start 2023-12-19T13:52:17.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.148+0000 7fe8ea2b9640 1 -- start start 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.149+0000 7fe8ea2b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0005180 0x7fe8e40c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.149+0000 7fe8ea2b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8e4145ba0 0x7fe8e4146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.149+0000 7fe8ea2b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8e41e21c0 0x7fe8e41e2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.149+0000 7fe8ea2b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4146560 con 0x7fe8e4145ba0 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.149+0000 7fe8ea2b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41e39c0 con 0x7fe8d0005180 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.149+0000 7fe8ea2b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e40ca2e0 con 0x7fe8e41e21c0 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8e4145ba0 0x7fe8e4146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8e4145ba0 0x7fe8e4146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40668/0 (socket says 172.21.15.113:40668) 2023-12-19T13:52:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 -- 172.21.15.113:0/1119670520 learned_addr learned my addr 172.21.15.113:0/1119670520 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e92b7640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0005180 0x7fe8e40c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e9ab8640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8e41e21c0 0x7fe8e41e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 -- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8e41e21c0 msgr2=0x7fe8e41e2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8e41e21c0 0x7fe8e41e2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 -- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0005180 msgr2=0x7fe8e40c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0005180 0x7fe8e40c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 -- 172.21.15.113:0/1119670520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e41e2bb0 con 0x7fe8e4145ba0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e9ab8640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8e41e21c0 0x7fe8e41e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.150+0000 7fe8e8ab6640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8e4145ba0 0x7fe8e4146020 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400e820 tx=0x7fe8d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.151+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400c870 con 0x7fe8e4145ba0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.151+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400c9d0 con 0x7fe8e4145ba0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.151+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e41e2e40 con 0x7fe8e4145ba0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.151+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400cd80 con 0x7fe8e4145ba0 2023-12-19T13:52:17.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.151+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e41e3400 con 0x7fe8e4145ba0 2023-12-19T13:52:17.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.152+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e4061910 con 0x7fe8e4145ba0 2023-12-19T13:52:17.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.153+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe8d401d460 con 0x7fe8e4145ba0 2023-12-19T13:52:17.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.154+0000 7fe8d9ffb640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe8c806a460 0x7fe8c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.154+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8d40888d0 con 0x7fe8e4145ba0 2023-12-19T13:52:17.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.154+0000 7fe8e92b7640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe8c806a460 0x7fe8c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.155+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7fe8c8071f90 con 0x7fe8e4145ba0 2023-12-19T13:52:17.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.155+0000 7fe8e92b7640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe8c806a460 0x7fe8c806c920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe8e41e16b0 tx=0x7fe8e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:17.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.158+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe8d4053eb0 con 0x7fe8e4145ba0 2023-12-19T13:52:17.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.347+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8e40b5320 con 0x7fe8e4145ba0 2023-12-19T13:52:17.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.349+0000 7fe8d9ffb640 1 -- 172.21.15.113:0/1119670520 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16177 (secure 0 0 0) 0x7fe8d40574d0 con 0x7fe8e4145ba0 2023-12-19T13:52:17.350 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:17.350 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":97,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:48.758545+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:17.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe8c806a460 msgr2=0x7fe8c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe8c806a460 0x7fe8c806c920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe8e41e16b0 tx=0x7fe8e0008040 comp rx=0 tx=0).stop 2023-12-19T13:52:17.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8e4145ba0 msgr2=0x7fe8e4146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8e4145ba0 0x7fe8e4146020 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400e820 tx=0x7fe8d400ece0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 shutdown_connections 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe8c806a460 0x7fe8c806c920 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8e41e21c0 0x7fe8e41e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8e4145ba0 0x7fe8e4146020 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 --2- 172.21.15.113:0/1119670520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0005180 0x7fe8e40c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 >> 172.21.15.113:0/1119670520 conn(0x7fe8e40b2990 msgr2=0x7fe8e4144760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 shutdown_connections 2023-12-19T13:52:17.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.352+0000 7fe8ea2b9640 1 -- 172.21.15.113:0/1119670520 wait complete. 2023-12-19T13:52:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:51:19.312025+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:51:20.596942+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:52:17.374 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:52:17.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.589+0000 7f4ba8a10640 1 Processor -- start 2023-12-19T13:52:17.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.590+0000 7f4ba8a10640 1 -- start start 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.591+0000 7f4ba8a10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 0x7f4ba40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.591+0000 7f4ba8a10640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4ba40b6430 0x7f4ba406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.591+0000 7f4ba8a10640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba406fed0 con 0x7f4ba406fa70 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.591+0000 7f4ba8a10640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba4161080 con 0x7f4ba40b6430 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.591+0000 7f4ba8a10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4161e70 con 0x7f4ba4146ff0 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba1d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4ba40b6430 0x7f4ba406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba1d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4ba40b6430 0x7f4ba406f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40682/0 (socket says 172.21.15.113:40682) 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba2d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4ba406fa70 0x7f4ba415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44990/0 (socket says 172.21.15.113:44990) 2023-12-19T13:52:17.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1881102802 learned_addr learned my addr 172.21.15.113:0/1881102802 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:17.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba259c640 1 --2- 172.21.15.113:0/1881102802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 0x7f4ba40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1881102802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 msgr2=0x7f4ba40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:17.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba1d9b640 1 --2- 172.21.15.113:0/1881102802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 0x7f4ba40d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1881102802 >> v1:172.21.15.113:6789/0 conn(0x7f4ba406fa70 legacy=0x7f4ba415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.592+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1881102802 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4161260 con 0x7f4ba40b6430 2023-12-19T13:52:17.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.593+0000 7f4ba1d9b640 1 --2- 172.21.15.113:0/1881102802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba406f530 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009870 tx=0x7f4b8c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a53848078f2bd5c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:17.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.594+0000 7f4ba159a640 1 -- 172.21.15.113:0/1881102802 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c030840 con 0x7f4ba40b6430 2023-12-19T13:52:17.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.594+0000 7f4ba159a640 1 -- 172.21.15.113:0/1881102802 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0309a0 con 0x7f4ba40b6430 2023-12-19T13:52:17.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.594+0000 7f4ba159a640 1 -- 172.21.15.113:0/1881102802 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c030d30 con 0x7f4ba40b6430 2023-12-19T13:52:17.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.594+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1881102802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 msgr2=0x7f4ba406f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.594+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1881102802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba406f530 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009870 tx=0x7f4b8c02b980 comp rx=0 tx=0).stop 2023-12-19T13:52:17.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.595+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1881102802 shutdown_connections 2023-12-19T13:52:17.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.595+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1881102802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba406f530 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.595+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1881102802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 0x7f4ba40d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.595+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1881102802 >> 172.21.15.113:0/1881102802 conn(0x7f4ba40d3520 msgr2=0x7f4ba40d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:17.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.595+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1881102802 shutdown_connections 2023-12-19T13:52:17.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.595+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1881102802 wait complete. 2023-12-19T13:52:17.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.596+0000 7f4ba8a10640 1 Processor -- start 2023-12-19T13:52:17.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.597+0000 7f4ba8a10640 1 -- start start 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba8a10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba406fa70 0x7f4ba4152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba8a10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba4144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba8a10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 0x7f4ba41450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba8a10640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40c83a0 con 0x7f4ba40b6430 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba8a10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40c9200 con 0x7f4ba406fa70 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba8a10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4141860 con 0x7f4ba4146ff0 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba4144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba4144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40686/0 (socket says 172.21.15.113:40686) 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1021195590 learned_addr learned my addr 172.21.15.113:0/1021195590 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba259c640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba406fa70 0x7f4ba4152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 msgr2=0x7f4ba41450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 0x7f4ba41450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba406fa70 msgr2=0x7f4ba4152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba406fa70 0x7f4ba4152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba1d9b640 1 -- 172.21.15.113:0/1021195590 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0094d0 con 0x7f4ba40b6430 2023-12-19T13:52:17.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.598+0000 7f4ba259c640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba406fa70 0x7f4ba4152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:17.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.599+0000 7f4ba1d9b640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba4144b80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c000c00 tx=0x7f4b8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:17.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.599+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c039c90 con 0x7f4ba40b6430 2023-12-19T13:52:17.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.599+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c039df0 con 0x7f4ba40b6430 2023-12-19T13:52:17.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.599+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c043640 con 0x7f4ba40b6430 2023-12-19T13:52:17.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.599+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba40c8580 con 0x7f4ba40b6430 2023-12-19T13:52:17.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.599+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba40c8b40 con 0x7f4ba40b6430 2023-12-19T13:52:17.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.600+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba40c9340 con 0x7f4ba40b6430 2023-12-19T13:52:17.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.601+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b8c0437a0 con 0x7f4ba40b6430 2023-12-19T13:52:17.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.602+0000 7f4b9affd640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b8406a430 0x7f4b8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:17.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.603+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b8c03e070 con 0x7f4ba40b6430 2023-12-19T13:52:17.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.603+0000 7f4ba259c640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b8406a430 0x7f4b8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:17.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.603+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f4b84071f60 con 0x7f4ba40b6430 2023-12-19T13:52:17.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.603+0000 7f4ba259c640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b8406a430 0x7f4b8406c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4b94007330 tx=0x7f4b9400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:17.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.607+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b8c034060 con 0x7f4ba40b6430 2023-12-19T13:52:17.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.804+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ba4061910 con 0x7f4ba40b6430 2023-12-19T13:52:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.805+0000 7f4b9affd640 1 -- 172.21.15.113:0/1021195590 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b8c034030 con 0x7f4ba40b6430 2023-12-19T13:52:17.805 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:52:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b8406a430 msgr2=0x7f4b8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b8406a430 0x7f4b8406c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4b94007330 tx=0x7f4b9400b040 comp rx=0 tx=0).stop 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 msgr2=0x7f4ba4144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba4144b80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c000c00 tx=0x7f4b8c004730 comp rx=0 tx=0).stop 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 shutdown_connections 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b8406a430 0x7f4b8406c8f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ba4146ff0 0x7f4ba41450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ba40b6430 0x7f4ba4144b80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 --2- 172.21.15.113:0/1021195590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba406fa70 0x7f4ba4152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 >> 172.21.15.113:0/1021195590 conn(0x7f4ba40d3520 msgr2=0x7f4ba40b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 shutdown_connections 2023-12-19T13:52:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:17.808+0000 7f4ba8a10640 1 -- 172.21.15.113:0/1021195590 wait complete. 2023-12-19T13:52:17.826 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:52:18.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.040+0000 7fcd9f1a4640 1 Processor -- start 2023-12-19T13:52:18.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.040+0000 7fcd9f1a4640 1 -- start start 2023-12-19T13:52:18.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.041+0000 7fcd9f1a4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd9815ddf0 0x7fcd9806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.041+0000 7fcd9f1a4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9806f6a0 0x7fcd9806c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.041+0000 7fcd9f1a4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9815e2a0 con 0x7fcd9815b3c0 2023-12-19T13:52:18.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.041+0000 7fcd9f1a4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd98161510 con 0x7fcd9815ddf0 2023-12-19T13:52:18.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.041+0000 7fcd9f1a4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9815ed70 con 0x7fcd9806f6a0 2023-12-19T13:52:18.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.042+0000 7fcd9cf40640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcd9815b3c0 0x7fcd980cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44408/0 (socket says 172.21.15.113:44408) 2023-12-19T13:52:18.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.042+0000 7fcd9cf40640 1 -- 172.21.15.113:0/4225341901 learned_addr learned my addr 172.21.15.113:0/4225341901 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:18.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.042+0000 7fcd97fff640 1 --2- 172.21.15.113:0/4225341901 >> v2:172.21.15.151:3300/0 conn(0x7fcd9815ddf0 0x7fcd9806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.042+0000 7fcd9d741640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9806f6a0 0x7fcd9806c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.042+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137481918 0 0) 0x7fcd9815e2a0 con 0x7fcd9815b3c0 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.042+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd88003520 con 0x7fcd9815b3c0 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809191353 0 0) 0x7fcd88003520 con 0x7fcd9815b3c0 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9806f6a0 msgr2=0x7fcd9806c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9806f6a0 0x7fcd9806c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 >> v2:172.21.15.151:3300/0 conn(0x7fcd9815ddf0 msgr2=0x7fcd9806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 --2- 172.21.15.113:0/4225341901 >> v2:172.21.15.151:3300/0 conn(0x7fcd9815ddf0 0x7fcd9806f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9815e4d0 con 0x7fcd9815b3c0 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fcd8c001670 con 0x7fcd9815b3c0 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd97fff640 1 --2- 172.21.15.113:0/4225341901 >> v2:172.21.15.151:3300/0 conn(0x7fcd9815ddf0 0x7fcd9806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 >> v1:172.21.15.113:6789/0 conn(0x7fcd9815b3c0 legacy=0x7fcd980cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd880039e0 0x7fcd88003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9806f6a0 0x7fcd880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd88004d00 0x7fcd88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd98161510 con 0x7fcd880039e0 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9815ed70 con 0x7fcd88004d00 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8800ba60 con 0x7fcd9806f6a0 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.043+0000 7fcd9cf40640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd880039e0 0x7fcd88003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.044+0000 7fcd9cf40640 1 -- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9806f6a0 msgr2=0x7fcd880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.044+0000 7fcd9cf40640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9806f6a0 0x7fcd880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.044+0000 7fcd9cf40640 1 -- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd88004d00 msgr2=0x7fcd88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.044+0000 7fcd9cf40640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd88004d00 0x7fcd88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.044+0000 7fcd9cf40640 1 -- 172.21.15.113:0/4225341901 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88003520 con 0x7fcd880039e0 2023-12-19T13:52:18.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd9cf40640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd880039e0 0x7fcd88003e00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c110 tx=0x7fcd880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd99b37af548a23a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c005ad0 con 0x7fcd880039e0 2023-12-19T13:52:18.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c005c50 con 0x7fcd880039e0 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd977fe640 1 -- 172.21.15.113:0/4225341901 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c02c830 con 0x7fcd880039e0 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/4225341901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd880039e0 msgr2=0x7fcd88003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd9f1a4640 1 --2- 172.21.15.113:0/4225341901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd880039e0 0x7fcd88003e00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c110 tx=0x7fcd880057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd9d741640 1 -- 172.21.15.113:0/4225341901 reap_dead start 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/4225341901 shutdown_connections 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.045+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/4225341901 >> 172.21.15.113:0/4225341901 conn(0x7fcd980d01a0 msgr2=0x7fcd980d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.046+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/4225341901 shutdown_connections 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.046+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/4225341901 wait complete. 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.047+0000 7fcd9f1a4640 1 Processor -- start 2023-12-19T13:52:18.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.047+0000 7fcd9f1a4640 1 -- start start 2023-12-19T13:52:18.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.048+0000 7fcd9f1a4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd880039e0 0x7fcd98147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.048+0000 7fcd9f1a4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd980ca780 0x7fcd980cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.048+0000 7fcd9f1a4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd98158180 0x7fcd98158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.048+0000 7fcd9f1a4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981599e0 con 0x7fcd980ca780 2023-12-19T13:52:18.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.048+0000 7fcd9f1a4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980cb140 con 0x7fcd98158180 2023-12-19T13:52:18.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.048+0000 7fcd9f1a4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd98158b40 con 0x7fcd880039e0 2023-12-19T13:52:18.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd980ca780 0x7fcd980cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd980ca780 0x7fcd980cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47408/0 (socket says 172.21.15.113:47408) 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 -- 172.21.15.113:0/2122321058 learned_addr learned my addr 172.21.15.113:0/2122321058 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd9cf40640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd880039e0 0x7fcd98147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd9d741640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd98158180 0x7fcd98158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 -- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd880039e0 msgr2=0x7fcd98147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd880039e0 0x7fcd98147310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 -- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd98158180 msgr2=0x7fcd98158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd98158180 0x7fcd98158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 -- 172.21.15.113:0/2122321058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd980cf870 con 0x7fcd980ca780 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.049+0000 7fcd97fff640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd980ca780 0x7fcd980cac00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400e810 tx=0x7fcd8400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.050+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84004030 con 0x7fcd980ca780 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.050+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84004190 con 0x7fcd980ca780 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.050+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd98158d60 con 0x7fcd980ca780 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.050+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400c670 con 0x7fcd980ca780 2023-12-19T13:52:18.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.050+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd98159320 con 0x7fcd980ca780 2023-12-19T13:52:18.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.051+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd98159b20 con 0x7fcd980ca780 2023-12-19T13:52:18.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.052+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd8400c7d0 con 0x7fcd980ca780 2023-12-19T13:52:18.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.053+0000 7fcd957fa640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd7c06a460 0x7fcd7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.053+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd84088420 con 0x7fcd980ca780 2023-12-19T13:52:18.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.053+0000 7fcd9cf40640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd7c06a460 0x7fcd7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.053+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7fcd7c071f90 con 0x7fcd980ca780 2023-12-19T13:52:18.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.054+0000 7fcd9cf40640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd7c06a460 0x7fcd7c06c920 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c034000 tx=0x7fcd8c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.057+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcd98159b20 con 0x7fcd980ca780 2023-12-19T13:52:18.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.245+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd98159b20 con 0x7fcd980ca780 2023-12-19T13:52:18.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.246+0000 7fcd957fa640 1 -- 172.21.15.113:0/2122321058 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd98159b20 con 0x7fcd980ca780 2023-12-19T13:52:18.247 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd7c06a460 msgr2=0x7fcd7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd7c06a460 0x7fcd7c06c920 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c034000 tx=0x7fcd8c007000 comp rx=0 tx=0).stop 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd980ca780 msgr2=0x7fcd980cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd980ca780 0x7fcd980cac00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400e810 tx=0x7fcd8400ecd0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 shutdown_connections 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd7c06a460 0x7fcd7c06c920 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd98158180 0x7fcd98158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd980ca780 0x7fcd980cac00 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 --2- 172.21.15.113:0/2122321058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd880039e0 0x7fcd98147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 >> 172.21.15.113:0/2122321058 conn(0x7fcd980d01a0 msgr2=0x7fcd9815eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:18.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 shutdown_connections 2023-12-19T13:52:18.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.249+0000 7fcd9f1a4640 1 -- 172.21.15.113:0/2122321058 wait complete. 2023-12-19T13:52:18.267 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:52:18.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.481+0000 7faf48bdc640 1 Processor -- start 2023-12-19T13:52:18.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.482+0000 7faf48bdc640 1 -- start start 2023-12-19T13:52:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.483+0000 7faf48bdc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 0x7faf4415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.483+0000 7faf48bdc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4415c610 con 0x7faf440cee30 2023-12-19T13:52:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.483+0000 7faf48bdc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440cf910 con 0x7faf440660e0 2023-12-19T13:52:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.483+0000 7faf48bdc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf440cfbf0 con 0x7faf44155530 2023-12-19T13:52:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.483+0000 7faf42ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7faf440cee30 0x7faf440659d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44418/0 (socket says 172.21.15.113:44418) 2023-12-19T13:52:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.483+0000 7faf42ffd640 1 -- 172.21.15.113:0/1333511890 learned_addr learned my addr 172.21.15.113:0/1333511890 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf437fe640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 0x7faf4415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313423041 0 0) 0x7faf38001110 con 0x7faf440cee30 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf2c003520 con 0x7faf440cee30 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605118755 0 0) 0x7faf2c003520 con 0x7faf440cee30 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 msgr2=0x7faf4415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 0x7faf4415c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 >> v1:172.21.15.151:6789/0 conn(0x7faf440660e0 legacy=0x7faf4415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4415b8d0 con 0x7faf440cee30 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7faf38001800 con 0x7faf440cee30 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 >> v1:172.21.15.113:6789/0 conn(0x7faf440cee30 legacy=0x7faf440659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2c0039a0 0x7faf2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf2c0047c0 0x7faf2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 0x7faf2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440cfbf0 con 0x7faf2c0047c0 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c00bab0 con 0x7faf2c0039a0 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.484+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c00bc70 con 0x7faf44155530 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf42ffd640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf2c0047c0 0x7faf2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf437fe640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2c0039a0 0x7faf2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf42ffd640 1 -- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 msgr2=0x7faf2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf43fff640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 0x7faf2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf42ffd640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 0x7faf2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf42ffd640 1 -- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2c0039a0 msgr2=0x7faf2c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf42ffd640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2c0039a0 0x7faf2c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf42ffd640 1 -- 172.21.15.113:0/1333511890 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c003520 con 0x7faf2c0047c0 2023-12-19T13:52:18.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf437fe640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2c0039a0 0x7faf2c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:18.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.485+0000 7faf43fff640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf44155530 0x7faf2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.486+0000 7faf42ffd640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf2c0047c0 0x7faf2c004c40 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c240 tx=0x7faf2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c795e1136383675a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38005ad0 con 0x7faf2c0047c0 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38005c50 con 0x7faf2c0047c0 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf427fc640 1 -- 172.21.15.113:0/1333511890 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3802c8b0 con 0x7faf2c0047c0 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf48bdc640 1 -- 172.21.15.113:0/1333511890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf2c0047c0 msgr2=0x7faf2c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf48bdc640 1 --2- 172.21.15.113:0/1333511890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf2c0047c0 0x7faf2c004c40 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c240 tx=0x7faf2c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf43fff640 1 -- 172.21.15.113:0/1333511890 reap_dead start 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf48bdc640 1 -- 172.21.15.113:0/1333511890 shutdown_connections 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf48bdc640 1 -- 172.21.15.113:0/1333511890 >> 172.21.15.113:0/1333511890 conn(0x7faf440735a0 msgr2=0x7faf440b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf48bdc640 1 -- 172.21.15.113:0/1333511890 shutdown_connections 2023-12-19T13:52:18.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.487+0000 7faf48bdc640 1 -- 172.21.15.113:0/1333511890 wait complete. 2023-12-19T13:52:18.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.489+0000 7faf48bdc640 1 Processor -- start 2023-12-19T13:52:18.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.489+0000 7faf48bdc640 1 -- start start 2023-12-19T13:52:18.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.490+0000 7faf48bdc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2c0047c0 0x7faf44150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.490+0000 7faf48bdc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf4414ef30 0x7faf44153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.490+0000 7faf48bdc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf440ca6b0 0x7faf44145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.490+0000 7faf48bdc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4406c460 con 0x7faf440ca6b0 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.490+0000 7faf48bdc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4414f710 con 0x7faf4414ef30 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.490+0000 7faf48bdc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4406c700 con 0x7faf2c0047c0 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf440ca6b0 0x7faf44145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf440ca6b0 0x7faf44145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47426/0 (socket says 172.21.15.113:47426) 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 -- 172.21.15.113:0/3732980466 learned_addr learned my addr 172.21.15.113:0/3732980466 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf437fe640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2c0047c0 0x7faf44150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 -- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2c0047c0 msgr2=0x7faf44150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2c0047c0 0x7faf44150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf42ffd640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf4414ef30 0x7faf44153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 -- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf4414ef30 msgr2=0x7faf44153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf4414ef30 0x7faf44153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 -- 172.21.15.113:0/3732980466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4406c9e0 con 0x7faf440ca6b0 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.491+0000 7faf43fff640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf440ca6b0 0x7faf44145400 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7faf440ce970 tx=0x7faf3c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.492+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c006d50 con 0x7faf440ca6b0 2023-12-19T13:52:18.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.492+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c003970 con 0x7faf440ca6b0 2023-12-19T13:52:18.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.492+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c003d60 con 0x7faf440ca6b0 2023-12-19T13:52:18.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.492+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4406ccc0 con 0x7faf440ca6b0 2023-12-19T13:52:18.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.492+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf44153d90 con 0x7faf440ca6b0 2023-12-19T13:52:18.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.493+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4406ceb0 con 0x7faf440ca6b0 2023-12-19T13:52:18.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.494+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf3c005070 con 0x7faf440ca6b0 2023-12-19T13:52:18.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.495+0000 7faf2bfff640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf3006a430 0x7faf3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.495+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf3c0886e0 con 0x7faf440ca6b0 2023-12-19T13:52:18.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.495+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7faf30071f60 con 0x7faf440ca6b0 2023-12-19T13:52:18.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.495+0000 7faf437fe640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf3006a430 0x7faf3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.496+0000 7faf437fe640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf3006a430 0x7faf3006c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faf34009aa0 tx=0x7faf34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.499+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faf3c053c30 con 0x7faf440ca6b0 2023-12-19T13:52:18.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.695+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf44061910 con 0x7faf440ca6b0 2023-12-19T13:52:18.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.696+0000 7faf2bfff640 1 -- 172.21.15.113:0/3732980466 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf3c01ce80 con 0x7faf440ca6b0 2023-12-19T13:52:18.697 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf3006a430 msgr2=0x7faf3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf3006a430 0x7faf3006c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faf34009aa0 tx=0x7faf34008040 comp rx=0 tx=0).stop 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf440ca6b0 msgr2=0x7faf44145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf440ca6b0 0x7faf44145400 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7faf440ce970 tx=0x7faf3c00dc00 comp rx=0 tx=0).stop 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 shutdown_connections 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf3006a430 0x7faf3006c8f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf440ca6b0 0x7faf44145400 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf4414ef30 0x7faf44153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 --2- 172.21.15.113:0/3732980466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2c0047c0 0x7faf44150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.699+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 >> 172.21.15.113:0/3732980466 conn(0x7faf440735a0 msgr2=0x7faf4415e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.700+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 shutdown_connections 2023-12-19T13:52:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.700+0000 7faf48bdc640 1 -- 172.21.15.113:0/3732980466 wait complete. 2023-12-19T13:52:18.720 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:52:18.866 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:18.874 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:18.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.936+0000 7f405964c640 1 Processor -- start 2023-12-19T13:52:18.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.936+0000 7f405964c640 1 -- start start 2023-12-19T13:52:18.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f405964c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40540d2d00 0x7f40540b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f405964c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f40540b6e50 0x7f405406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f405964c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4054142bf0 con 0x7f40540b8d60 2023-12-19T13:52:18.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f405964c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540b7260 con 0x7f40540b6e50 2023-12-19T13:52:18.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f405964c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4054142e40 con 0x7f40540d2d00 2023-12-19T13:52:18.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f40537fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f40540b6e50 0x7f405406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f40537fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f40540b6e50 0x7f405406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47442/0 (socket says 172.21.15.113:47442) 2023-12-19T13:52:18.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f40537fe640 1 -- 172.21.15.113:0/1339490732 learned_addr learned my addr 172.21.15.113:0/1339490732 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:18.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.938+0000 7f4052ffd640 1 --2- 172.21.15.113:0/1339490732 >> v2:172.21.15.151:3300/0 conn(0x7f40540d2d00 0x7f40540b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.939+0000 7f40537fe640 1 -- 172.21.15.113:0/1339490732 >> v2:172.21.15.151:3300/0 conn(0x7f40540d2d00 msgr2=0x7f40540b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:18.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.939+0000 7f40537fe640 1 --2- 172.21.15.113:0/1339490732 >> v2:172.21.15.151:3300/0 conn(0x7f40540d2d00 0x7f40540b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.939+0000 7f40537fe640 1 -- 172.21.15.113:0/1339490732 >> v1:172.21.15.151:6789/0 conn(0x7f40540b8d60 legacy=0x7f40540b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.939+0000 7f40537fe640 1 -- 172.21.15.113:0/1339490732 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054143120 con 0x7f40540b6e50 2023-12-19T13:52:18.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.941+0000 7f40537fe640 1 --2- 172.21.15.113:0/1339490732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405406f160 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f4054066bc0 tx=0x7f404c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0212f0fe4c82ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.941+0000 7f40527fc640 1 -- 172.21.15.113:0/1339490732 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c030860 con 0x7f40540b6e50 2023-12-19T13:52:18.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.941+0000 7f40527fc640 1 -- 172.21.15.113:0/1339490732 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0309c0 con 0x7f40540b6e50 2023-12-19T13:52:18.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.941+0000 7f40527fc640 1 -- 172.21.15.113:0/1339490732 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c030d50 con 0x7f40540b6e50 2023-12-19T13:52:18.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 -- 172.21.15.113:0/1339490732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 msgr2=0x7f405406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 --2- 172.21.15.113:0/1339490732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405406f160 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f4054066bc0 tx=0x7f404c02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 -- 172.21.15.113:0/1339490732 shutdown_connections 2023-12-19T13:52:18.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 --2- 172.21.15.113:0/1339490732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405406f160 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 --2- 172.21.15.113:0/1339490732 >> v2:172.21.15.151:3300/0 conn(0x7f40540d2d00 0x7f40540b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 -- 172.21.15.113:0/1339490732 >> 172.21.15.113:0/1339490732 conn(0x7f40540cfe10 msgr2=0x7f40540d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:18.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 -- 172.21.15.113:0/1339490732 shutdown_connections 2023-12-19T13:52:18.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.942+0000 7f405964c640 1 -- 172.21.15.113:0/1339490732 wait complete. 2023-12-19T13:52:18.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.944+0000 7f405964c640 1 Processor -- start 2023-12-19T13:52:18.944 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.944+0000 7f405964c640 1 -- start start 2023-12-19T13:52:18.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f405964c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405415eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f405964c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40540b8d60 0x7f405413f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f405964c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40540d2d00 0x7f4054140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f405964c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054141ee0 con 0x7f40540b6e50 2023-12-19T13:52:18.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f405964c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405415bd20 con 0x7f40540b8d60 2023-12-19T13:52:18.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f405964c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405415b110 con 0x7f40540d2d00 2023-12-19T13:52:18.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405415eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405415eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47452/0 (socket says 172.21.15.113:47452) 2023-12-19T13:52:18.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f4052ffd640 1 -- 172.21.15.113:0/1853933247 learned_addr learned my addr 172.21.15.113:0/1853933247 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:18.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f404a7fc640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40540b8d60 0x7f405413f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.945+0000 7f40537fe640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40540d2d00 0x7f4054140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f4052ffd640 1 -- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40540d2d00 msgr2=0x7f4054140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f4052ffd640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40540d2d00 0x7f4054140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f4052ffd640 1 -- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40540b8d60 msgr2=0x7f405413f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:18.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f4052ffd640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40540b8d60 0x7f405413f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f4052ffd640 1 -- 172.21.15.113:0/1853933247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0094d0 con 0x7f40540b6e50 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f404a7fc640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40540b8d60 0x7f405413f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f4052ffd640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405415eb00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f404400efc0 tx=0x7f404400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044009b80 con 0x7f40540b6e50 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404400f040 con 0x7f40540b6e50 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440146a0 con 0x7f40540b6e50 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405415b3f0 con 0x7f40540b6e50 2023-12-19T13:52:18.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.946+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405415b9b0 con 0x7f40540b6e50 2023-12-19T13:52:18.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.948+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4054061910 con 0x7f40540b6e50 2023-12-19T13:52:18.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.949+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4044014800 con 0x7f40540b6e50 2023-12-19T13:52:18.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.950+0000 7f404bfff640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f403406a460 0x7f403406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:18.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.950+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4044089660 con 0x7f40540b6e50 2023-12-19T13:52:18.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.950+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f4034071f90 con 0x7f40540b6e50 2023-12-19T13:52:18.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.950+0000 7f404a7fc640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f403406a460 0x7f403406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:18.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.951+0000 7f404a7fc640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f403406a460 0x7f403406c920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f403c007fd0 tx=0x7f403c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:18.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:18.955+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4044054ce0 con 0x7f40540b6e50 2023-12-19T13:52:19.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.159+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f40540b5ff0 con 0x7f40540b6e50 2023-12-19T13:52:19.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.160+0000 7f404bfff640 1 -- 172.21.15.113:0/1853933247 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v97) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4044058300 con 0x7f40540b6e50 2023-12-19T13:52:19.160 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:52:19.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.162+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f403406a460 msgr2=0x7f403406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.162+0000 7f405964c640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f403406a460 0x7f403406c920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f403c007fd0 tx=0x7f403c009040 comp rx=0 tx=0).stop 2023-12-19T13:52:19.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.162+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 msgr2=0x7f405415eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.162+0000 7f405964c640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405415eb00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f404400efc0 tx=0x7f404400c490 comp rx=0 tx=0).stop 2023-12-19T13:52:19.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 shutdown_connections 2023-12-19T13:52:19.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f403406a460 0x7f403406c920 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40540d2d00 0x7f4054140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40540b8d60 0x7f405413f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 --2- 172.21.15.113:0/1853933247 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40540b6e50 0x7f405415eb00 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 >> 172.21.15.113:0/1853933247 conn(0x7f40540cfe10 msgr2=0x7f405413fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:19.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 shutdown_connections 2023-12-19T13:52:19.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.163+0000 7f405964c640 1 -- 172.21.15.113:0/1853933247 wait complete. 2023-12-19T13:52:19.182 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:52:19.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:19.183 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:52:19.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:52:19.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:19.298 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:52:19.355 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:52:19.355 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:19.416 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:52:19.417 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:19.472 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:19.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.691+0000 7fd89d900640 1 Processor -- start 2023-12-19T13:52:19.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.691+0000 7fd89d900640 1 -- start start 2023-12-19T13:52:19.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd89d900640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd898146e10 0x7fd8980d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd89d900640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8980ce110 0x7fd8980ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd89d900640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8980cd840 con 0x7fd8980d2b00 2023-12-19T13:52:19.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd89d900640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980d2430 con 0x7fd898146e10 2023-12-19T13:52:19.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd89d900640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980ceac0 con 0x7fd8980ce110 2023-12-19T13:52:19.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd8967fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd8980d2b00 0x7fd8980b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44424/0 (socket says 172.21.15.113:44424) 2023-12-19T13:52:19.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd8967fc640 1 -- 172.21.15.113:0/1427916746 learned_addr learned my addr 172.21.15.113:0/1427916746 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd8977fe640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8980ce110 0x7fd8980ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd896ffd640 1 --2- 172.21.15.113:0/1427916746 >> v2:172.21.15.151:3300/0 conn(0x7fd898146e10 0x7fd8980d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.693+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077651200 0 0) 0x7fd8980cd840 con 0x7fd8980d2b00 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd880003520 con 0x7fd8980d2b00 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419419108 0 0) 0x7fd880003520 con 0x7fd8980d2b00 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8980ce110 msgr2=0x7fd8980ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8980ce110 0x7fd8980ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 >> v2:172.21.15.151:3300/0 conn(0x7fd898146e10 msgr2=0x7fd8980d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 --2- 172.21.15.113:0/1427916746 >> v2:172.21.15.151:3300/0 conn(0x7fd898146e10 0x7fd8980d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8980b6e90 con 0x7fd8980d2b00 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fd88c001670 con 0x7fd8980d2b00 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 >> v1:172.21.15.113:6789/0 conn(0x7fd8980d2b00 legacy=0x7fd8980b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8980ce110 0x7fd880003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd880003f90 0x7fd8800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd880004d00 0x7fd880005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980ceac0 con 0x7fd880003f90 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88000b980 con 0x7fd880004d00 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88000bb10 con 0x7fd8980ce110 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.694+0000 7fd8967fc640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd880003f90 0x7fd8800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.695+0000 7fd8977fe640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd880004d00 0x7fd880005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.695+0000 7fd8967fc640 1 -- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8980ce110 msgr2=0x7fd880003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.695+0000 7fd8967fc640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8980ce110 0x7fd880003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.695+0000 7fd8967fc640 1 -- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd880004d00 msgr2=0x7fd880005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:19.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.695+0000 7fd8967fc640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd880004d00 0x7fd880005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.695+0000 7fd8967fc640 1 -- 172.21.15.113:0/1427916746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880003520 con 0x7fd880003f90 2023-12-19T13:52:19.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.695+0000 7fd8977fe640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd880004d00 0x7fd880005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:19.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.696+0000 7fd8967fc640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd880003f90 0x7fd8800047c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00c270 tx=0x7fd8800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636c9b3cd0d68337 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:19.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.696+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c005ad0 con 0x7fd880003f90 2023-12-19T13:52:19.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.696+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c005c50 con 0x7fd880003f90 2023-12-19T13:52:19.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.696+0000 7fd895ffb640 1 -- 172.21.15.113:0/1427916746 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c02c8a0 con 0x7fd880003f90 2023-12-19T13:52:19.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.697+0000 7fd89d900640 1 -- 172.21.15.113:0/1427916746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd880003f90 msgr2=0x7fd8800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.697+0000 7fd89d900640 1 --2- 172.21.15.113:0/1427916746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd880003f90 0x7fd8800047c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00c270 tx=0x7fd8800057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.697+0000 7fd8977fe640 1 -- 172.21.15.113:0/1427916746 reap_dead start 2023-12-19T13:52:19.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.697+0000 7fd89d900640 1 -- 172.21.15.113:0/1427916746 shutdown_connections 2023-12-19T13:52:19.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.697+0000 7fd89d900640 1 -- 172.21.15.113:0/1427916746 >> 172.21.15.113:0/1427916746 conn(0x7fd8980b29c0 msgr2=0x7fd8980b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:19.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.697+0000 7fd89d900640 1 -- 172.21.15.113:0/1427916746 shutdown_connections 2023-12-19T13:52:19.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.697+0000 7fd89d900640 1 -- 172.21.15.113:0/1427916746 wait complete. 2023-12-19T13:52:19.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.699+0000 7fd89d900640 1 Processor -- start 2023-12-19T13:52:19.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.699+0000 7fd89d900640 1 -- start start 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd89d900640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd880003f90 0x7fd89813e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd89d900640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd89815cbb0 0x7fd89815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd89d900640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8980d1300 0x7fd8980d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd89d900640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980d1cd0 con 0x7fd89815cbb0 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd89d900640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89813e940 con 0x7fd8980d1300 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd89d900640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89813ec20 con 0x7fd880003f90 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd89815cbb0 0x7fd89815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd89815cbb0 0x7fd89815c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47460/0 (socket says 172.21.15.113:47460) 2023-12-19T13:52:19.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 -- 172.21.15.113:0/3521392513 learned_addr learned my addr 172.21.15.113:0/3521392513 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd896ffd640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd880003f90 0x7fd89813e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8977fe640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8980d1300 0x7fd8980d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 -- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd880003f90 msgr2=0x7fd89813e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd880003f90 0x7fd89813e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 -- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8980d1300 msgr2=0x7fd8980d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8980d1300 0x7fd8980d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.700+0000 7fd8967fc640 1 -- 172.21.15.113:0/3521392513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89813ef00 con 0x7fd89815cbb0 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.701+0000 7fd8967fc640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd89815cbb0 0x7fd89815c5b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd88c02c440 tx=0x7fd88c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.701+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c039070 con 0x7fd89815cbb0 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.701+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c02ccb0 con 0x7fd89815cbb0 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.701+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c03c040 con 0x7fd89815cbb0 2023-12-19T13:52:19.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.701+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89813f1e0 con 0x7fd89815cbb0 2023-12-19T13:52:19.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.701+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd898160790 con 0x7fd89815cbb0 2023-12-19T13:52:19.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.703+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd898160920 con 0x7fd89815cbb0 2023-12-19T13:52:19.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.704+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd88c032070 con 0x7fd89815cbb0 2023-12-19T13:52:19.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.705+0000 7fd87ffff640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd88406a460 0x7fd88406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:19.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.705+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd88c0a9bc0 con 0x7fd89815cbb0 2023-12-19T13:52:19.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.705+0000 7fd896ffd640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd88406a460 0x7fd88406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:19.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.705+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7fd884071f90 con 0x7fd89815cbb0 2023-12-19T13:52:19.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.706+0000 7fd896ffd640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd88406a460 0x7fd88406c920 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd888009ad0 tx=0x7fd888008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:19.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.711+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd88c075360 con 0x7fd89815cbb0 2023-12-19T13:52:19.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.977+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd898061910 con 0x7fd89815cbb0 2023-12-19T13:52:19.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.980+0000 7fd87ffff640 1 -- 172.21.15.113:0/3521392513 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16177 (secure 0 0 0) 0x7fd88c078980 con 0x7fd89815cbb0 2023-12-19T13:52:19.980 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:19.981 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":97,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:51:48.758545+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:19.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd88406a460 msgr2=0x7fd88406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd88406a460 0x7fd88406c920 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd888009ad0 tx=0x7fd888008040 comp rx=0 tx=0).stop 2023-12-19T13:52:19.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd89815cbb0 msgr2=0x7fd89815c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:19.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd89815cbb0 0x7fd89815c5b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd88c02c440 tx=0x7fd88c001a00 comp rx=0 tx=0).stop 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 shutdown_connections 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd88406a460 0x7fd88406c920 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8980d1300 0x7fd8980d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd89815cbb0 0x7fd89815c5b0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 --2- 172.21.15.113:0/3521392513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd880003f90 0x7fd89813e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 >> 172.21.15.113:0/3521392513 conn(0x7fd8980b29c0 msgr2=0x7fd8980b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 shutdown_connections 2023-12-19T13:52:19.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:19.983+0000 7fd89d900640 1 -- 172.21.15.113:0/3521392513 wait complete. 2023-12-19T13:52:20.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:51:19.312025+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:51:20.596942+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:52:20.004 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:52:20.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.206+0000 7ff7c8f5c640 1 Processor -- start 2023-12-19T13:52:20.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.207+0000 7ff7c8f5c640 1 -- start start 2023-12-19T13:52:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.208+0000 7ff7c8f5c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff7c40b2760 0x7ff7c40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.208+0000 7ff7c8f5c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c415fde0 con 0x7ff7c415b1d0 2023-12-19T13:52:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.208+0000 7ff7c8f5c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c40b2bc0 con 0x7ff7c40ceea0 2023-12-19T13:52:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.208+0000 7ff7c8f5c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40b2400 con 0x7ff7c40b2760 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff7c415b1d0 0x7ff7c415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44434/0 (socket says 172.21.15.113:44434) 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c259c640 1 -- 172.21.15.113:0/2529147184 learned_addr learned my addr 172.21.15.113:0/2529147184 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441839902 0 0) 0x7ff7c415fde0 con 0x7ff7c415b1d0 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b0003520 con 0x7ff7c415b1d0 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7bbfff640 1 --2- 172.21.15.113:0/2529147184 >> v2:172.21.15.151:3300/0 conn(0x7ff7c40b2760 0x7ff7c40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208647188 0 0) 0x7ff7b0003520 con 0x7ff7c415b1d0 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 >> v2:172.21.15.151:3300/0 conn(0x7ff7c40b2760 msgr2=0x7ff7c40b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 --2- 172.21.15.113:0/2529147184 >> v2:172.21.15.151:3300/0 conn(0x7ff7c40b2760 0x7ff7c40b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 >> v1:172.21.15.151:6789/0 conn(0x7ff7c40ceea0 legacy=0x7ff7c406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c415ef10 con 0x7ff7c415b1d0 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff7b4001670 con 0x7ff7c415b1d0 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.209+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 >> v1:172.21.15.113:6789/0 conn(0x7ff7c415b1d0 legacy=0x7ff7c415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c1d9b640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00039e0 0x7ff7b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c1d9b640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7b00047c0 0x7ff7b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c1d9b640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00051d0 0x7ff7b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b000c0f0 con 0x7ff7b00047c0 2023-12-19T13:52:20.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b000c260 con 0x7ff7b00051d0 2023-12-19T13:52:20.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b000c420 con 0x7ff7b00039e0 2023-12-19T13:52:20.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7bbfff640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7b00047c0 0x7ff7b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c259c640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00039e0 0x7ff7b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c2d9d640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00051d0 0x7ff7b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7bbfff640 1 -- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00039e0 msgr2=0x7ff7b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:20.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7bbfff640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00039e0 0x7ff7b0003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7bbfff640 1 -- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00051d0 msgr2=0x7ff7b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:20.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7bbfff640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00051d0 0x7ff7b000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7c2d9d640 1 -- 172.21.15.113:0/2529147184 reap_dead start 2023-12-19T13:52:20.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.210+0000 7ff7bbfff640 1 -- 172.21.15.113:0/2529147184 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0003520 con 0x7ff7b00047c0 2023-12-19T13:52:20.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.211+0000 7ff7bbfff640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7b00047c0 0x7ff7b0004c40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00ba30 tx=0x7ff7b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762a5e725695a60d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:20.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac032640 con 0x7ff7b00047c0 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0327a0 con 0x7ff7b00047c0 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c1d9b640 1 -- 172.21.15.113:0/2529147184 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac032b30 con 0x7ff7b00047c0 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/2529147184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7b00047c0 msgr2=0x7ff7b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7b00047c0 0x7ff7b0004c40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00ba30 tx=0x7ff7b00057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/2529147184 shutdown_connections 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/2529147184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7b00047c0 0x7ff7b0004c40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/2529147184 >> 172.21.15.113:0/2529147184 conn(0x7ff7c4073150 msgr2=0x7ff7c40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/2529147184 shutdown_connections 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.212+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/2529147184 wait complete. 2023-12-19T13:52:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.214+0000 7ff7c8f5c640 1 Processor -- start 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.214+0000 7ff7c8f5c640 1 -- start start 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.215+0000 7ff7c8f5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00047c0 0x7ff7c414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.215+0000 7ff7c8f5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c41e6830 0x7ff7c40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.215+0000 7ff7c8f5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c40add20 0x7ff7c40acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.215+0000 7ff7c8f5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40b08f0 con 0x7ff7c40add20 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.215+0000 7ff7c8f5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40cd990 con 0x7ff7c41e6830 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.215+0000 7ff7c8f5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41501a0 con 0x7ff7b00047c0 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c40add20 0x7ff7c40acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c40add20 0x7ff7c40acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47482/0 (socket says 172.21.15.113:47482) 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 -- 172.21.15.113:0/572318311 learned_addr learned my addr 172.21.15.113:0/572318311 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c259c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00047c0 0x7ff7c414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7bbfff640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c41e6830 0x7ff7c40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 -- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00047c0 msgr2=0x7ff7c414fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00047c0 0x7ff7c414fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 -- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c41e6830 msgr2=0x7ff7c40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c41e6830 0x7ff7c40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 -- 172.21.15.113:0/572318311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40afc70 con 0x7ff7c40add20 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c259c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00047c0 0x7ff7c414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7bbfff640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c41e6830 0x7ff7c40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.216+0000 7ff7c2d9d640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c40add20 0x7ff7c40acdf0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40b1180 tx=0x7ff7bc00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.217+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc012800 con 0x7ff7c40add20 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.217+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc012960 con 0x7ff7c40add20 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.217+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc012d10 con 0x7ff7c40add20 2023-12-19T13:52:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.217+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c40aff50 con 0x7ff7c40add20 2023-12-19T13:52:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.217+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c40b0510 con 0x7ff7c40add20 2023-12-19T13:52:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.218+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c4061910 con 0x7ff7c40add20 2023-12-19T13:52:20.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.219+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff7bc023350 con 0x7ff7c40add20 2023-12-19T13:52:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.220+0000 7ff7baffd640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7a406a460 0x7ff7a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.220+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7bc0887b0 con 0x7ff7c40add20 2023-12-19T13:52:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.220+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7ff7a4071f90 con 0x7ff7c40add20 2023-12-19T13:52:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.220+0000 7ff7c259c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7a406a460 0x7ff7a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.221+0000 7ff7c259c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7a406a460 0x7ff7a406c920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001eb0 tx=0x7ff7b40014e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.224+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff7bc020060 con 0x7ff7c40add20 2023-12-19T13:52:20.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.415+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7c40cdc90 con 0x7ff7c40add20 2023-12-19T13:52:20.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.417+0000 7ff7baffd640 1 -- 172.21.15.113:0/572318311 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7bc057980 con 0x7ff7c40add20 2023-12-19T13:52:20.417 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:52:20.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.419+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7a406a460 msgr2=0x7ff7a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.419+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7a406a460 0x7ff7a406c920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001eb0 tx=0x7ff7b40014e0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.419+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c40add20 msgr2=0x7ff7c40acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.419+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c40add20 0x7ff7c40acdf0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40b1180 tx=0x7ff7bc00d960 comp rx=0 tx=0).stop 2023-12-19T13:52:20.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 shutdown_connections 2023-12-19T13:52:20.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff7a406a460 0x7ff7a406c920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7c40add20 0x7ff7c40acdf0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7c41e6830 0x7ff7c40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 --2- 172.21.15.113:0/572318311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00047c0 0x7ff7c414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 >> 172.21.15.113:0/572318311 conn(0x7ff7c4073150 msgr2=0x7ff7c415a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:20.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 shutdown_connections 2023-12-19T13:52:20.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.420+0000 7ff7c8f5c640 1 -- 172.21.15.113:0/572318311 wait complete. 2023-12-19T13:52:20.439 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:52:20.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.646+0000 7fbe69ea8640 1 Processor -- start 2023-12-19T13:52:20.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.647+0000 7fbe69ea8640 1 -- start start 2023-12-19T13:52:20.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe69ea8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbe64159e40 0x7fbe640b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe69ea8640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6406b3a0 con 0x7fbe640cd430 2023-12-19T13:52:20.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe69ea8640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640cd8a0 con 0x7fbe640b0a00 2023-12-19T13:52:20.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe69ea8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe640b23e0 con 0x7fbe64159e40 2023-12-19T13:52:20.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe68ea6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbe64159e40 0x7fbe640b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe63fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbe640cd430 0x7fbe640b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44448/0 (socket says 172.21.15.113:44448) 2023-12-19T13:52:20.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe63fff640 1 -- 172.21.15.113:0/3963006575 learned_addr learned my addr 172.21.15.113:0/3963006575 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:20.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.648+0000 7fbe68ea6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbe64159e40 0x7fbe640b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47488/0 (socket says 172.21.15.113:47488) 2023-12-19T13:52:20.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.649+0000 7fbe68ea6640 1 -- 172.21.15.113:0/3963006575 >> v1:172.21.15.151:6789/0 conn(0x7fbe640b0a00 legacy=0x7fbe6406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:20.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.649+0000 7fbe637fe640 1 -- 172.21.15.113:0/3963006575 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045789944 0 0) 0x7fbe6406b3a0 con 0x7fbe640cd430 2023-12-19T13:52:20.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.649+0000 7fbe68ea6640 1 -- 172.21.15.113:0/3963006575 >> v1:172.21.15.113:6789/0 conn(0x7fbe640cd430 legacy=0x7fbe640b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.649+0000 7fbe68ea6640 1 -- 172.21.15.113:0/3963006575 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640b1860 con 0x7fbe64159e40 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.650+0000 7fbe68ea6640 1 --2- 172.21.15.113:0/3963006575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe64159e40 0x7fbe640b1230 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fbe580097a0 tx=0x7fbe5802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5dace0008c012b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.650+0000 7fbe637fe640 1 -- 172.21.15.113:0/3963006575 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58030610 con 0x7fbe64159e40 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.650+0000 7fbe637fe640 1 -- 172.21.15.113:0/3963006575 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58030770 con 0x7fbe64159e40 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.650+0000 7fbe637fe640 1 -- 172.21.15.113:0/3963006575 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58030b00 con 0x7fbe64159e40 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.651+0000 7fbe69ea8640 1 -- 172.21.15.113:0/3963006575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe64159e40 msgr2=0x7fbe640b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.651+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/3963006575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe64159e40 0x7fbe640b1230 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fbe580097a0 tx=0x7fbe5802b960 comp rx=0 tx=0).stop 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.651+0000 7fbe69ea8640 1 -- 172.21.15.113:0/3963006575 shutdown_connections 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.651+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/3963006575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe64159e40 0x7fbe640b1230 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.651+0000 7fbe69ea8640 1 -- 172.21.15.113:0/3963006575 >> 172.21.15.113:0/3963006575 conn(0x7fbe640659a0 msgr2=0x7fbe64065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.651+0000 7fbe69ea8640 1 -- 172.21.15.113:0/3963006575 shutdown_connections 2023-12-19T13:52:20.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.651+0000 7fbe69ea8640 1 -- 172.21.15.113:0/3963006575 wait complete. 2023-12-19T13:52:20.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.653+0000 7fbe69ea8640 1 Processor -- start 2023-12-19T13:52:20.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.653+0000 7fbe69ea8640 1 -- start start 2023-12-19T13:52:20.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe69ea8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe640b0a00 0x7fbe64144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe69ea8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe640cd430 0x7fbe640a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe69ea8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe64159e40 0x7fbe640a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe69ea8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64144f90 con 0x7fbe640cd430 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe69ea8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6414b600 con 0x7fbe64159e40 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe69ea8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe641451f0 con 0x7fbe640b0a00 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe63fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe640cd430 0x7fbe640a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe63fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe640cd430 0x7fbe640a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47504/0 (socket says 172.21.15.113:47504) 2023-12-19T13:52:20.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.654+0000 7fbe63fff640 1 -- 172.21.15.113:0/4024867453 learned_addr learned my addr 172.21.15.113:0/4024867453 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:20.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe63fff640 1 -- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe640b0a00 msgr2=0x7fbe64144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe696a7640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe64159e40 0x7fbe640a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe68ea6640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe640b0a00 0x7fbe64144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe63fff640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe640b0a00 0x7fbe64144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe63fff640 1 -- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe64159e40 msgr2=0x7fbe640a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe63fff640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe64159e40 0x7fbe640a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe63fff640 1 -- 172.21.15.113:0/4024867453 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58009400 con 0x7fbe640cd430 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe696a7640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe64159e40 0x7fbe640a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe63fff640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe640cd430 0x7fbe640a84a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000c4d0 tx=0x7fbe5000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500074e0 con 0x7fbe640cd430 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe50007660 con 0x7fbe640cd430 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe640a9060 con 0x7fbe640cd430 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50004a20 con 0x7fbe640cd430 2023-12-19T13:52:20.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.655+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64145440 con 0x7fbe640cd430 2023-12-19T13:52:20.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.656+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe64061910 con 0x7fbe640cd430 2023-12-19T13:52:20.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.657+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe50004b80 con 0x7fbe640cd430 2023-12-19T13:52:20.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.658+0000 7fbe617fa640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4806a430 0x7fbe4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:20.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.658+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe50087e30 con 0x7fbe640cd430 2023-12-19T13:52:20.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.659+0000 7fbe68ea6640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4806a430 0x7fbe4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:20.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.659+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7fbe48071f60 con 0x7fbe640cd430 2023-12-19T13:52:20.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.659+0000 7fbe68ea6640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4806a430 0x7fbe4806c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe58036000 tx=0x7fbe5803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:20.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.662+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbe50018060 con 0x7fbe640cd430 2023-12-19T13:52:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.852+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe640ce350 con 0x7fbe640cd430 2023-12-19T13:52:20.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.853+0000 7fbe617fa640 1 -- 172.21.15.113:0/4024867453 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe50053410 con 0x7fbe640cd430 2023-12-19T13:52:20.854 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:52:20.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4806a430 msgr2=0x7fbe4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4806a430 0x7fbe4806c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe58036000 tx=0x7fbe5803b040 comp rx=0 tx=0).stop 2023-12-19T13:52:20.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe640cd430 msgr2=0x7fbe640a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe640cd430 0x7fbe640a84a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000c4d0 tx=0x7fbe5000c990 comp rx=0 tx=0).stop 2023-12-19T13:52:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 shutdown_connections 2023-12-19T13:52:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4806a430 0x7fbe4806c8f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe64159e40 0x7fbe640a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe640cd430 0x7fbe640a84a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 --2- 172.21.15.113:0/4024867453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe640b0a00 0x7fbe64144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 >> 172.21.15.113:0/4024867453 conn(0x7fbe640659a0 msgr2=0x7fbe6415cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 shutdown_connections 2023-12-19T13:52:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:20.856+0000 7fbe69ea8640 1 -- 172.21.15.113:0/4024867453 wait complete. 2023-12-19T13:52:20.874 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:52:21.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.079+0000 7f5f246e5640 1 Processor -- start 2023-12-19T13:52:21.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.079+0000 7f5f246e5640 1 -- start start 2023-12-19T13:52:21.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f246e5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5f1c146ff0 0x7f5f1c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f246e5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c06fc40 0x7f5f1c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f246e5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c161e70 con 0x7f5f1c0b6430 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f246e5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c161080 con 0x7f5f1c146ff0 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f246e5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c161260 con 0x7f5f1c06fc40 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f22481640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5f1c146ff0 0x7f5f1c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f22481640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5f1c146ff0 0x7f5f1c0d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47510/0 (socket says 172.21.15.113:47510) 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.081+0000 7f5f22481640 1 -- 172.21.15.113:0/840430143 learned_addr learned my addr 172.21.15.113:0/840430143 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.082+0000 7f5f22c82640 1 --2- 172.21.15.113:0/840430143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c06fc40 0x7f5f1c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.082+0000 7f5f22481640 1 -- 172.21.15.113:0/840430143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c06fc40 msgr2=0x7f5f1c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.082+0000 7f5f22481640 1 --2- 172.21.15.113:0/840430143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c06fc40 0x7f5f1c15dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.082+0000 7f5f22481640 1 -- 172.21.15.113:0/840430143 >> v1:172.21.15.151:6789/0 conn(0x7f5f1c0b6430 legacy=0x7f5f1c06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:21.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.082+0000 7f5f22481640 1 -- 172.21.15.113:0/840430143 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c161540 con 0x7f5f1c146ff0 2023-12-19T13:52:21.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.083+0000 7f5f22481640 1 --2- 172.21.15.113:0/840430143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c146ff0 0x7f5f1c0d10f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009e50 tx=0x7f5f0c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb894be2178879f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.083+0000 7f5f2147f640 1 -- 172.21.15.113:0/840430143 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c02ca70 con 0x7f5f1c146ff0 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.083+0000 7f5f2147f640 1 -- 172.21.15.113:0/840430143 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c02cbd0 con 0x7f5f1c146ff0 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.083+0000 7f5f2147f640 1 -- 172.21.15.113:0/840430143 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0343f0 con 0x7f5f1c146ff0 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 -- 172.21.15.113:0/840430143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c146ff0 msgr2=0x7f5f1c0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 --2- 172.21.15.113:0/840430143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c146ff0 0x7f5f1c0d10f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009e50 tx=0x7f5f0c02bed0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 -- 172.21.15.113:0/840430143 shutdown_connections 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 --2- 172.21.15.113:0/840430143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c06fc40 0x7f5f1c15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 --2- 172.21.15.113:0/840430143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c146ff0 0x7f5f1c0d10f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 -- 172.21.15.113:0/840430143 >> 172.21.15.113:0/840430143 conn(0x7f5f1c0d3520 msgr2=0x7f5f1c0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 -- 172.21.15.113:0/840430143 shutdown_connections 2023-12-19T13:52:21.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.084+0000 7f5f246e5640 1 -- 172.21.15.113:0/840430143 wait complete. 2023-12-19T13:52:21.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.086+0000 7f5f246e5640 1 Processor -- start 2023-12-19T13:52:21.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.086+0000 7f5f246e5640 1 -- start start 2023-12-19T13:52:21.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.087+0000 7f5f246e5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f1c06fc40 0x7f5f1c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.087+0000 7f5f246e5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c0b6430 0x7f5f1c0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.087+0000 7f5f246e5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c146ff0 0x7f5f1c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.087+0000 7f5f246e5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0cd4e0 con 0x7f5f1c0b6430 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.087+0000 7f5f246e5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1392d0 con 0x7f5f1c06fc40 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.087+0000 7f5f246e5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0ccc40 con 0x7f5f1c146ff0 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.087+0000 7f5f21c80640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c0b6430 0x7f5f1c0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c0b6430 0x7f5f1c0ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47520/0 (socket says 172.21.15.113:47520) 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 -- 172.21.15.113:0/490329633 learned_addr learned my addr 172.21.15.113:0/490329633 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f22c82640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c146ff0 0x7f5f1c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f22481640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f1c06fc40 0x7f5f1c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 -- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c146ff0 msgr2=0x7f5f1c070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c146ff0 0x7f5f1c070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 -- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f1c06fc40 msgr2=0x7f5f1c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f1c06fc40 0x7f5f1c0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 -- 172.21.15.113:0/490329633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c009b30 con 0x7f5f1c0b6430 2023-12-19T13:52:21.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f21c80640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c0b6430 0x7f5f1c0ca960 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c400 tx=0x7f5f1000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:21.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.088+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011790 con 0x7f5f1c0b6430 2023-12-19T13:52:21.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.089+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10011930 con 0x7f5f1c0b6430 2023-12-19T13:52:21.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.089+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011ce0 con 0x7f5f1c0b6430 2023-12-19T13:52:21.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.089+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c0ccf20 con 0x7f5f1c0b6430 2023-12-19T13:52:21.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.089+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0c8540 con 0x7f5f1c0b6430 2023-12-19T13:52:21.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.090+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c0c83a0 con 0x7f5f1c0b6430 2023-12-19T13:52:21.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.091+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f1001c460 con 0x7f5f1c0b6430 2023-12-19T13:52:21.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.092+0000 7f5f1affd640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f0806a430 0x7f5f0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.092+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f10088810 con 0x7f5f1c0b6430 2023-12-19T13:52:21.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.092+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f5f08071f60 con 0x7f5f1c0b6430 2023-12-19T13:52:21.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.092+0000 7f5f22481640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f0806a430 0x7f5f0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.093+0000 7f5f22481640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f0806a430 0x7f5f0806c8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c035000 tx=0x7f5f0c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:21.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.096+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f1c0c83a0 con 0x7f5f1c0b6430 2023-12-19T13:52:21.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.268+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f1c0c83a0 con 0x7f5f1c0b6430 2023-12-19T13:52:21.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.269+0000 7f5f1affd640 1 -- 172.21.15.113:0/490329633 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f1c0c83a0 con 0x7f5f1c0b6430 2023-12-19T13:52:21.270 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f0806a430 msgr2=0x7f5f0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f0806a430 0x7f5f0806c8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c035000 tx=0x7f5f0c030000 comp rx=0 tx=0).stop 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c0b6430 msgr2=0x7f5f1c0ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c0b6430 0x7f5f1c0ca960 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c400 tx=0x7f5f1000c8c0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 shutdown_connections 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f0806a430 0x7f5f0806c8f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f1c146ff0 0x7f5f1c070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f1c0b6430 0x7f5f1c0ca960 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 --2- 172.21.15.113:0/490329633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f1c06fc40 0x7f5f1c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 >> 172.21.15.113:0/490329633 conn(0x7f5f1c0d3520 msgr2=0x7f5f1c0b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 shutdown_connections 2023-12-19T13:52:21.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.272+0000 7f5f246e5640 1 -- 172.21.15.113:0/490329633 wait complete. 2023-12-19T13:52:21.289 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:52:21.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.477+0000 7f9ea7dd9640 1 Processor -- start 2023-12-19T13:52:21.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.478+0000 7f9ea7dd9640 1 -- start start 2023-12-19T13:52:21.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.479+0000 7f9ea7dd9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ea0157bf0 0x7f9ea015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.479+0000 7f9ea7dd9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00ae110 0x7f9ea00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.479+0000 7f9ea7dd9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ea00b0640 0x7f9ea015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.479+0000 7f9ea7dd9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea006b8c0 con 0x7f9ea00b0640 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.479+0000 7f9ea7dd9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea00b0a90 con 0x7f9ea0157bf0 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.479+0000 7f9ea7dd9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea015b740 con 0x7f9ea00ae110 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ea00b0640 0x7f9ea015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ea00b0640 0x7f9ea015dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47532/0 (socket says 172.21.15.113:47532) 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 -- 172.21.15.113:0/2304760221 learned_addr learned my addr 172.21.15.113:0/2304760221 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea5b75640 1 --2- 172.21.15.113:0/2304760221 >> v2:172.21.15.151:3300/0 conn(0x7f9ea0157bf0 0x7f9ea015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea5374640 1 --2- 172.21.15.113:0/2304760221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00ae110 0x7f9ea00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 -- 172.21.15.113:0/2304760221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00ae110 msgr2=0x7f9ea00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:21.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 --2- 172.21.15.113:0/2304760221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00ae110 0x7f9ea00b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 -- 172.21.15.113:0/2304760221 >> v2:172.21.15.151:3300/0 conn(0x7f9ea0157bf0 msgr2=0x7f9ea015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:21.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 --2- 172.21.15.113:0/2304760221 >> v2:172.21.15.151:3300/0 conn(0x7f9ea0157bf0 0x7f9ea015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea6376640 1 -- 172.21.15.113:0/2304760221 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00ae640 con 0x7f9ea00b0640 2023-12-19T13:52:21.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea5b75640 1 --2- 172.21.15.113:0/2304760221 >> v2:172.21.15.151:3300/0 conn(0x7f9ea0157bf0 0x7f9ea015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:21.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.480+0000 7f9ea5374640 1 --2- 172.21.15.113:0/2304760221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00ae110 0x7f9ea00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.481+0000 7f9ea6376640 1 --2- 172.21.15.113:0/2304760221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00b0640 0x7f9ea015dd70 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00ccbc0 tx=0x7f9e9802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0752e9a18bb9c6b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea4b73640 1 -- 172.21.15.113:0/2304760221 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9802ca70 con 0x7f9ea00b0640 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea4b73640 1 -- 172.21.15.113:0/2304760221 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9802cbd0 con 0x7f9ea00b0640 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea4b73640 1 -- 172.21.15.113:0/2304760221 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980343f0 con 0x7f9ea00b0640 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/2304760221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00b0640 msgr2=0x7f9ea015dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/2304760221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00b0640 0x7f9ea015dd70 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00ccbc0 tx=0x7f9e9802bed0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/2304760221 shutdown_connections 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/2304760221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00b0640 0x7f9ea015dd70 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/2304760221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00ae110 0x7f9ea00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/2304760221 >> v2:172.21.15.151:3300/0 conn(0x7f9ea0157bf0 0x7f9ea015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/2304760221 >> 172.21.15.113:0/2304760221 conn(0x7f9ea00cbb70 msgr2=0x7f9ea00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/2304760221 shutdown_connections 2023-12-19T13:52:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.482+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/2304760221 wait complete. 2023-12-19T13:52:21.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.484+0000 7f9ea7dd9640 1 Processor -- start 2023-12-19T13:52:21.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.484+0000 7f9ea7dd9640 1 -- start start 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea7dd9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00ae110 0x7f9ea00cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea7dd9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00b0640 0x7f9ea00acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea7dd9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea0157bf0 0x7f9ea01f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea7dd9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00cd940 con 0x7f9ea00ae110 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea7dd9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00cccc0 con 0x7f9ea0157bf0 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea7dd9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00ccfa0 con 0x7f9ea00b0640 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea5b75640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00ae110 0x7f9ea00cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea5b75640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00ae110 0x7f9ea00cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47536/0 (socket says 172.21.15.113:47536) 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.485+0000 7f9ea5b75640 1 -- 172.21.15.113:0/3897570646 learned_addr learned my addr 172.21.15.113:0/3897570646 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea5b75640 1 -- 172.21.15.113:0/3897570646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00b0640 msgr2=0x7f9ea00acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea5b75640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00b0640 0x7f9ea00acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea5b75640 1 -- 172.21.15.113:0/3897570646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea0157bf0 msgr2=0x7f9ea01f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea5b75640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea0157bf0 0x7f9ea01f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea5b75640 1 -- 172.21.15.113:0/3897570646 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009b30 con 0x7f9ea00ae110 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea5b75640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00ae110 0x7f9ea00cf300 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c7f0 tx=0x7f9e9c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c007a30 con 0x7f9ea00ae110 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c007b90 con 0x7f9ea00ae110 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea00cd280 con 0x7f9ea00ae110 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c00ce40 con 0x7f9ea00ae110 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.486+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea01542b0 con 0x7f9ea00ae110 2023-12-19T13:52:21.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.487+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea0061910 con 0x7f9ea00ae110 2023-12-19T13:52:21.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.488+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e9c0113f0 con 0x7f9ea00ae110 2023-12-19T13:52:21.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.490+0000 7f9e967fc640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e8406a430 0x7f9e8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:21.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.490+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e9c088ab0 con 0x7f9ea00ae110 2023-12-19T13:52:21.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.490+0000 7f9ea5374640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e8406a430 0x7f9e8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:21.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.490+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f9e84071f60 con 0x7f9ea00ae110 2023-12-19T13:52:21.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.491+0000 7f9ea5374640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e8406a430 0x7f9e8406c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9e90006fd0 tx=0x7f9e90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:21.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.494+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e9c01f060 con 0x7f9ea00ae110 2023-12-19T13:52:21.671 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:52:21.671+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-12-19T13:52:21.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.683+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(98..98 src has 1..98) v4 ==== 391+0+0 (secure 0 0 0) 0x7f9e9c058450 con 0x7f9ea00ae110 2023-12-19T13:52:21.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.683+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f9e84072870 con 0x7f9ea00ae110 2023-12-19T13:52:21.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.702+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ea00b1c20 con 0x7f9ea00ae110 2023-12-19T13:52:21.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.703+0000 7f9e967fc640 1 -- 172.21.15.113:0/3897570646 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9e9c01f020 con 0x7f9ea00ae110 2023-12-19T13:52:21.703 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e8406a430 msgr2=0x7f9e8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e8406a430 0x7f9e8406c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9e90006fd0 tx=0x7f9e90008040 comp rx=0 tx=0).stop 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00ae110 msgr2=0x7f9ea00cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00ae110 0x7f9ea00cf300 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c7f0 tx=0x7f9e9c00cbf0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 shutdown_connections 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e8406a430 0x7f9e8406c8f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea0157bf0 0x7f9ea01f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea00b0640 0x7f9ea00acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 --2- 172.21.15.113:0/3897570646 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ea00ae110 0x7f9ea00cf300 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 >> 172.21.15.113:0/3897570646 conn(0x7f9ea00cbb70 msgr2=0x7f9ea00b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 shutdown_connections 2023-12-19T13:52:21.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:21.706+0000 7f9ea7dd9640 1 -- 172.21.15.113:0/3897570646 wait complete. 2023-12-19T13:52:21.724 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:52:21.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:21.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:52:21.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:52:21.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:21.832 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:52:21.883 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:21.884 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:21.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:52:21.943 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:52:21.943 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:22.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:52:22.004 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:22.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.225+0000 7f72d0d77640 1 Processor -- start 2023-12-19T13:52:22.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.226+0000 7f72d0d77640 1 -- start start 2023-12-19T13:52:22.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.227+0000 7f72d0d77640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f72cc146e10 0x7f72cc0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.227+0000 7f72d0d77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc0ce110 0x7f72cc0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.227+0000 7f72d0d77640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0cd840 con 0x7f72cc0d2b00 2023-12-19T13:52:22.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.227+0000 7f72d0d77640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0d2430 con 0x7f72cc146e10 2023-12-19T13:52:22.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.227+0000 7f72d0d77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0ceac0 con 0x7f72cc0ce110 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c9d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f72cc0d2b00 0x7f72cc0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44460/0 (socket says 172.21.15.113:44460) 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c9d9b640 1 -- 172.21.15.113:0/3010708073 learned_addr learned my addr 172.21.15.113:0/3010708073 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72ca59c640 1 --2- 172.21.15.113:0/3010708073 >> v2:172.21.15.151:3300/0 conn(0x7f72cc146e10 0x7f72cc0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150316058 0 0) 0x7f72cc0cd840 con 0x7f72cc0d2b00 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72cad9d640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc0ce110 0x7f72cc0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b8003520 con 0x7f72cc0d2b00 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 31812592 0 0) 0x7f72b8003520 con 0x7f72cc0d2b00 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc0ce110 msgr2=0x7f72cc0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c959a640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc0ce110 0x7f72cc0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 >> v2:172.21.15.151:3300/0 conn(0x7f72cc146e10 msgr2=0x7f72cc0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:22.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.228+0000 7f72c959a640 1 --2- 172.21.15.113:0/3010708073 >> v2:172.21.15.151:3300/0 conn(0x7f72cc146e10 0x7f72cc0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0b6e90 con 0x7f72cc0d2b00 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f72b4001670 con 0x7f72cc0d2b00 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 >> v1:172.21.15.113:6789/0 conn(0x7f72cc0d2b00 legacy=0x7f72cc0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b8003a10 0x7f72b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72b80047c0 0x7f72b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc0ce110 0x7f72b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0ceac0 con 0x7f72b80047c0 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b800b980 con 0x7f72b8003a10 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b800bb10 con 0x7f72cc0ce110 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c9d9b640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72b80047c0 0x7f72b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72ca59c640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b8003a10 0x7f72b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c9d9b640 1 -- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc0ce110 msgr2=0x7f72b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:22.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c9d9b640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc0ce110 0x7f72b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c9d9b640 1 -- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b8003a10 msgr2=0x7f72b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:22.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c9d9b640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b8003a10 0x7f72b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.229+0000 7f72c9d9b640 1 -- 172.21.15.113:0/3010708073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b8003520 con 0x7f72b80047c0 2023-12-19T13:52:22.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.230+0000 7f72c9d9b640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72b80047c0 0x7f72b8004c40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c110 tx=0x7f72b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820e04334435a0b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4005ad0 con 0x7f72b80047c0 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4005c30 con 0x7f72b80047c0 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72c959a640 1 -- 172.21.15.113:0/3010708073 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b402c7e0 con 0x7f72b80047c0 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72d0d77640 1 -- 172.21.15.113:0/3010708073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72b80047c0 msgr2=0x7f72b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72d0d77640 1 --2- 172.21.15.113:0/3010708073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72b80047c0 0x7f72b8004c40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c110 tx=0x7f72b80057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72cad9d640 1 -- 172.21.15.113:0/3010708073 reap_dead start 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72d0d77640 1 -- 172.21.15.113:0/3010708073 shutdown_connections 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72d0d77640 1 -- 172.21.15.113:0/3010708073 >> 172.21.15.113:0/3010708073 conn(0x7f72cc0b29c0 msgr2=0x7f72cc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72d0d77640 1 -- 172.21.15.113:0/3010708073 shutdown_connections 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.231+0000 7f72d0d77640 1 -- 172.21.15.113:0/3010708073 wait complete. 2023-12-19T13:52:22.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.233+0000 7f72d0d77640 1 Processor -- start 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.233+0000 7f72d0d77640 1 -- start start 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.234+0000 7f72d0d77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b80047c0 0x7f72cc142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.234+0000 7f72d0d77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc15fcb0 0x7f72cc13f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.234+0000 7f72d0d77640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72cc0d1300 0x7f72cc0d1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.234+0000 7f72d0d77640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0d1cc0 con 0x7f72cc0d1300 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.234+0000 7f72d0d77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc140880 con 0x7f72b80047c0 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.234+0000 7f72d0d77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc13ff70 con 0x7f72cc15fcb0 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.234+0000 7f72cad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72cc0d1300 0x7f72cc0d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72cc0d1300 0x7f72cc0d1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47552/0 (socket says 172.21.15.113:47552) 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 -- 172.21.15.113:0/2625715538 learned_addr learned my addr 172.21.15.113:0/2625715538 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72ca59c640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b80047c0 0x7f72cc142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 -- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc15fcb0 msgr2=0x7f72cc13f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72c9d9b640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc15fcb0 0x7f72cc13f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc15fcb0 0x7f72cc13f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 -- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b80047c0 msgr2=0x7f72cc142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b80047c0 0x7f72cc142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 -- 172.21.15.113:0/2625715538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc13fc00 con 0x7f72cc0d1300 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72cad9d640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72cc0d1300 0x7f72cc0d1780 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f72cc08baa0 tx=0x7f72c400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400c680 con 0x7f72cc0d1300 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c400c7e0 con 0x7f72cc0d1300 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc140230 con 0x7f72cc0d1300 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.235+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400cb90 con 0x7f72cc0d1300 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.236+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc142e70 con 0x7f72cc0d1300 2023-12-19T13:52:22.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.237+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc061910 con 0x7f72cc0d1300 2023-12-19T13:52:22.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.238+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72c400ccf0 con 0x7f72cc0d1300 2023-12-19T13:52:22.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.238+0000 7f72c2ffd640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ac06a430 0x7f72ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.239+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f72c4088640 con 0x7f72cc0d1300 2023-12-19T13:52:22.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.239+0000 7f72ca59c640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ac06a430 0x7f72ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.239+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f72ac072080 con 0x7f72cc0d1300 2023-12-19T13:52:22.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.239+0000 7f72ca59c640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ac06a430 0x7f72ac06c8f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009fc0 tx=0x7f72bc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:22.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.243+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f72c4053b30 con 0x7f72cc0d1300 2023-12-19T13:52:22.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.452+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72cc06fb30 con 0x7f72cc0d1300 2023-12-19T13:52:22.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.454+0000 7f72c2ffd640 1 -- 172.21.15.113:0/2625715538 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f72c4057150 con 0x7f72cc0d1300 2023-12-19T13:52:22.454 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:22.454 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:51:21.594253+0000","modified":"2023-12-19T13:51:24.611657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2704300841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2704300841},{"type":"v1","addr":"172.21.15.151:6835","nonce":2704300841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T13:52:22.454 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 41 2023-12-19T13:52:22.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ac06a430 msgr2=0x7f72ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ac06a430 0x7f72ac06c8f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009fc0 tx=0x7f72bc00b040 comp rx=0 tx=0).stop 2023-12-19T13:52:22.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72cc0d1300 msgr2=0x7f72cc0d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72cc0d1300 0x7f72cc0d1780 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f72cc08baa0 tx=0x7f72c400ec00 comp rx=0 tx=0).stop 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 shutdown_connections 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ac06a430 0x7f72ac06c8f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72cc0d1300 0x7f72cc0d1780 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72cc15fcb0 0x7f72cc13f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 --2- 172.21.15.113:0/2625715538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72b80047c0 0x7f72cc142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 >> 172.21.15.113:0/2625715538 conn(0x7f72cc0b29c0 msgr2=0x7f72cc0b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 shutdown_connections 2023-12-19T13:52:22.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.456+0000 7f72d0d77640 1 -- 172.21.15.113:0/2625715538 wait complete. 2023-12-19T13:52:22.473 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:22.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.688+0000 7fee3741b640 1 Processor -- start 2023-12-19T13:52:22.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.688+0000 7fee3741b640 1 -- start start 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.690+0000 7fee3741b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fee3006e4d0 0x7fee30070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.690+0000 7fee3741b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fee300b2270 0x7fee3015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.690+0000 7fee3741b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee300ce6e0 con 0x7fee3015a720 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.690+0000 7fee3741b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3006e8b0 con 0x7fee300b2270 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.690+0000 7fee3741b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee30070c60 con 0x7fee3006e4d0 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36c1a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fee300b2270 0x7fee3015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36c1a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fee300b2270 0x7fee3015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47568/0 (socket says 172.21.15.113:47568) 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36c1a640 1 -- 172.21.15.113:0/720498604 learned_addr learned my addr 172.21.15.113:0/720498604 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:22.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36419640 1 --2- 172.21.15.113:0/720498604 >> v2:172.21.15.151:3300/0 conn(0x7fee3006e4d0 0x7fee30070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36c1a640 1 -- 172.21.15.113:0/720498604 >> v2:172.21.15.151:3300/0 conn(0x7fee3006e4d0 msgr2=0x7fee30070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:22.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36c1a640 1 --2- 172.21.15.113:0/720498604 >> v2:172.21.15.151:3300/0 conn(0x7fee3006e4d0 0x7fee30070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36c1a640 1 -- 172.21.15.113:0/720498604 >> v1:172.21.15.151:6789/0 conn(0x7fee3015a720 legacy=0x7fee300b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:22.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.691+0000 7fee36c1a640 1 -- 172.21.15.113:0/720498604 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30070f40 con 0x7fee300b2270 2023-12-19T13:52:22.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.692+0000 7fee36c1a640 1 --2- 172.21.15.113:0/720498604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee300b2270 0x7fee3015ae70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fee300b2870 tx=0x7fee2802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9469ba630130376 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:22.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.698+0000 7fee35417640 1 -- 172.21.15.113:0/720498604 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2802ca80 con 0x7fee300b2270 2023-12-19T13:52:22.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.698+0000 7fee35417640 1 -- 172.21.15.113:0/720498604 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2802cbe0 con 0x7fee300b2270 2023-12-19T13:52:22.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.698+0000 7fee35417640 1 -- 172.21.15.113:0/720498604 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280343f0 con 0x7fee300b2270 2023-12-19T13:52:22.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.699+0000 7fee3741b640 1 -- 172.21.15.113:0/720498604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee300b2270 msgr2=0x7fee3015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.699+0000 7fee3741b640 1 --2- 172.21.15.113:0/720498604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee300b2270 0x7fee3015ae70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fee300b2870 tx=0x7fee2802bee0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.700+0000 7fee3741b640 1 -- 172.21.15.113:0/720498604 shutdown_connections 2023-12-19T13:52:22.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.700+0000 7fee3741b640 1 --2- 172.21.15.113:0/720498604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee300b2270 0x7fee3015ae70 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.700+0000 7fee3741b640 1 --2- 172.21.15.113:0/720498604 >> v2:172.21.15.151:3300/0 conn(0x7fee3006e4d0 0x7fee30070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.700+0000 7fee3741b640 1 -- 172.21.15.113:0/720498604 >> 172.21.15.113:0/720498604 conn(0x7fee300cfd80 msgr2=0x7fee300cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:22.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.700+0000 7fee3741b640 1 -- 172.21.15.113:0/720498604 shutdown_connections 2023-12-19T13:52:22.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.700+0000 7fee3741b640 1 -- 172.21.15.113:0/720498604 wait complete. 2023-12-19T13:52:22.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.702+0000 7fee3741b640 1 Processor -- start 2023-12-19T13:52:22.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.702+0000 7fee3741b640 1 -- start start 2023-12-19T13:52:22.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee3741b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3006e4d0 0x7fee300ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee3741b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee300b2270 0x7fee3014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee3741b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee3015a720 0x7fee3014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee3741b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3014cf10 con 0x7fee3006e4d0 2023-12-19T13:52:22.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee3741b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee300cb0e0 con 0x7fee300b2270 2023-12-19T13:52:22.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee3741b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee300cb3c0 con 0x7fee3015a720 2023-12-19T13:52:22.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee36419640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3006e4d0 0x7fee300ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee36419640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3006e4d0 0x7fee300ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47578/0 (socket says 172.21.15.113:47578) 2023-12-19T13:52:22.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.703+0000 7fee36419640 1 -- 172.21.15.113:0/2230086712 learned_addr learned my addr 172.21.15.113:0/2230086712 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:22.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee36419640 1 -- 172.21.15.113:0/2230086712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee3015a720 msgr2=0x7fee3014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee36419640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee3015a720 0x7fee3014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee36419640 1 -- 172.21.15.113:0/2230086712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee300b2270 msgr2=0x7fee3014c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee36419640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee300b2270 0x7fee3014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee36419640 1 -- 172.21.15.113:0/2230086712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009b30 con 0x7fee3006e4d0 2023-12-19T13:52:22.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee36419640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3006e4d0 0x7fee300ca600 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00d800 tx=0x7fee2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:22.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c00b6c0 con 0x7fee3006e4d0 2023-12-19T13:52:22.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c00b820 con 0x7fee3006e4d0 2023-12-19T13:52:22.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c00bbb0 con 0x7fee3006e4d0 2023-12-19T13:52:22.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.704+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee300cb6a0 con 0x7fee3006e4d0 2023-12-19T13:52:22.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.705+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee301464f0 con 0x7fee3006e4d0 2023-12-19T13:52:22.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.706+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee30061910 con 0x7fee3006e4d0 2023-12-19T13:52:22.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.707+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee2c00bd10 con 0x7fee3006e4d0 2023-12-19T13:52:22.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.708+0000 7fee26ffd640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1406a430 0x7fee1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:22.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.708+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fee2c088f60 con 0x7fee3006e4d0 2023-12-19T13:52:22.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.708+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x7fee14072080 con 0x7fee3006e4d0 2023-12-19T13:52:22.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.708+0000 7fee35c18640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1406a430 0x7fee1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:22.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.709+0000 7fee35c18640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1406a430 0x7fee1406c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee20006fd0 tx=0x7fee20006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:22.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.713+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee2c054450 con 0x7fee3006e4d0 2023-12-19T13:52:22.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.905+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee300c5bc0 con 0x7fee3006e4d0 2023-12-19T13:52:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.908+0000 7fee26ffd640 1 -- 172.21.15.113:0/2230086712 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16269 (secure 0 0 0) 0x7fee2c057a70 con 0x7fee3006e4d0 2023-12-19T13:52:22.909 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:22.909 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":99,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:22.684596+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.3d","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1406a430 msgr2=0x7fee1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1406a430 0x7fee1406c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee20006fd0 tx=0x7fee20006bc0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3006e4d0 msgr2=0x7fee300ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3006e4d0 0x7fee300ca600 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00d800 tx=0x7fee2c00dcc0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 shutdown_connections 2023-12-19T13:52:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1406a430 0x7fee1406c8f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee3015a720 0x7fee3014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee300b2270 0x7fee3014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 --2- 172.21.15.113:0/2230086712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3006e4d0 0x7fee300ca600 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:22.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.911+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 >> 172.21.15.113:0/2230086712 conn(0x7fee300cfd80 msgr2=0x7fee30159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:22.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.912+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 shutdown_connections 2023-12-19T13:52:22.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:22.912+0000 7fee3741b640 1 -- 172.21.15.113:0/2230086712 wait complete. 2023-12-19T13:52:22.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:51:19.312025+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:51:20.596942+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:52:22.934 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:52:23.147 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.147+0000 7fbe0bea1640 1 Processor -- start 2023-12-19T13:52:23.148 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.147+0000 7fbe0bea1640 1 -- start start 2023-12-19T13:52:23.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe0bea1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbe040cc1a0 0x7fbe0415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe0bea1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe040b2580 con 0x7fbe040cf580 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe0bea1640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe040b33e0 con 0x7fbe040cc880 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe0bea1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe040b1ea0 con 0x7fbe040cc1a0 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe0943c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbe040cf580 0x7fbe0415a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44464/0 (socket says 172.21.15.113:44464) 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe0943c640 1 -- 172.21.15.113:0/761781053 learned_addr learned my addr 172.21.15.113:0/761781053 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe0a43e640 1 --2- 172.21.15.113:0/761781053 >> v2:172.21.15.113:3300/0 conn(0x7fbe040cc1a0 0x7fbe0415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe08c3b640 1 -- 172.21.15.113:0/761781053 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077464588 0 0) 0x7fbe040b2580 con 0x7fbe040cf580 2023-12-19T13:52:23.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.149+0000 7fbe08c3b640 1 -- 172.21.15.113:0/761781053 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf0003520 con 0x7fbe040cf580 2023-12-19T13:52:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.150+0000 7fbe0a43e640 1 -- 172.21.15.113:0/761781053 >> v1:172.21.15.151:6789/0 conn(0x7fbe040cc880 legacy=0x7fbe040ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.150+0000 7fbe0a43e640 1 -- 172.21.15.113:0/761781053 >> v1:172.21.15.113:6789/0 conn(0x7fbe040cf580 legacy=0x7fbe0415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.150+0000 7fbe0a43e640 1 -- 172.21.15.113:0/761781053 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe040b27d0 con 0x7fbe040cc1a0 2023-12-19T13:52:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.151+0000 7fbe0a43e640 1 --2- 172.21.15.113:0/761781053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe0415af20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00aea0 tx=0x7fbdfc02d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a57a5aed75b014 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:23.152 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.151+0000 7fbe08c3b640 1 -- 172.21.15.113:0/761781053 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc02dbe0 con 0x7fbe040cc1a0 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.151+0000 7fbe08c3b640 1 -- 172.21.15.113:0/761781053 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc02dd40 con 0x7fbe040cc1a0 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.151+0000 7fbe08c3b640 1 -- 172.21.15.113:0/761781053 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc008660 con 0x7fbe040cc1a0 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.152+0000 7fbe0bea1640 1 -- 172.21.15.113:0/761781053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 msgr2=0x7fbe0415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.152+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/761781053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe0415af20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00aea0 tx=0x7fbdfc02d040 comp rx=0 tx=0).stop 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.152+0000 7fbe0bea1640 1 -- 172.21.15.113:0/761781053 shutdown_connections 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.152+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/761781053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe0415af20 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.152+0000 7fbe0bea1640 1 -- 172.21.15.113:0/761781053 >> 172.21.15.113:0/761781053 conn(0x7fbe04073150 msgr2=0x7fbe040659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.152+0000 7fbe0bea1640 1 -- 172.21.15.113:0/761781053 shutdown_connections 2023-12-19T13:52:23.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.152+0000 7fbe0bea1640 1 -- 172.21.15.113:0/761781053 wait complete. 2023-12-19T13:52:23.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.154+0000 7fbe0bea1640 1 Processor -- start 2023-12-19T13:52:23.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.154+0000 7fbe0bea1640 1 -- start start 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe0bea1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe04143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe0bea1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe040cc880 0x7fbe041443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe0bea1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe040cf580 0x7fbe040b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe0bea1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0406cc20 con 0x7fbe040cc1a0 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe0bea1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040aeb20 con 0x7fbe040cf580 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe0bea1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040ae1f0 con 0x7fbe040cc880 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe04143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe04143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47584/0 (socket says 172.21.15.113:47584) 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 -- 172.21.15.113:0/988926421 learned_addr learned my addr 172.21.15.113:0/988926421 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe0943c640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe040cc880 0x7fbe041443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 -- 172.21.15.113:0/988926421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe040cc880 msgr2=0x7fbe041443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe040cc880 0x7fbe041443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 -- 172.21.15.113:0/988926421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe040cf580 msgr2=0x7fbe040b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe040cf580 0x7fbe040b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.155+0000 7fbe09c3d640 1 -- 172.21.15.113:0/988926421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc00ab80 con 0x7fbe040cc1a0 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.156+0000 7fbe09c3d640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe04143910 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c400 tx=0x7fbe0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.156+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000052d0 con 0x7fbe040cc1a0 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.156+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00005430 con 0x7fbe040cc1a0 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.156+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00003830 con 0x7fbe040cc1a0 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.156+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe040ae4d0 con 0x7fbe040cc1a0 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.156+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe04143e50 con 0x7fbe040cc1a0 2023-12-19T13:52:23.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.157+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe04061910 con 0x7fbe040cc1a0 2023-12-19T13:52:23.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.158+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe00003990 con 0x7fbe040cc1a0 2023-12-19T13:52:23.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.159+0000 7fbdfa7fc640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.159+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fbe00087fb0 con 0x7fbe040cc1a0 2023-12-19T13:52:23.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.160+0000 7fbe0943c640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.160+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x7fbde8072080 con 0x7fbe040cc1a0 2023-12-19T13:52:23.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.160+0000 7fbe0943c640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbde806a430 0x7fbde806c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe04147560 tx=0x7fbdf4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:23.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.164+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbe000534a0 con 0x7fbe040cc1a0 2023-12-19T13:52:23.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.350+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe040b3040 con 0x7fbe040cc1a0 2023-12-19T13:52:23.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.350+0000 7fbdfa7fc640 1 -- 172.21.15.113:0/988926421 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe00017020 con 0x7fbe040cc1a0 2023-12-19T13:52:23.351 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:52:23.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbde806a430 msgr2=0x7fbde806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbde806a430 0x7fbde806c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe04147560 tx=0x7fbdf4009040 comp rx=0 tx=0).stop 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 msgr2=0x7fbe04143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe04143910 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c400 tx=0x7fbe0000c8c0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 shutdown_connections 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe040cf580 0x7fbe040b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe040cc880 0x7fbe041443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 --2- 172.21.15.113:0/988926421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe040cc1a0 0x7fbe04143910 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 >> 172.21.15.113:0/988926421 conn(0x7fbe04073150 msgr2=0x7fbe04159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 shutdown_connections 2023-12-19T13:52:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.353+0000 7fbe0bea1640 1 -- 172.21.15.113:0/988926421 wait complete. 2023-12-19T13:52:23.374 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:52:23.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.589+0000 7f4399f57640 1 Processor -- start 2023-12-19T13:52:23.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.590+0000 7f4399f57640 1 -- start start 2023-12-19T13:52:23.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.591+0000 7f4399f57640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43940b0a00 0x7f439406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.591+0000 7f4399f57640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f439406ca80 0x7f43940cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.591+0000 7f4399f57640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439415c9c0 con 0x7f4394155460 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.591+0000 7f4399f57640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439406d270 con 0x7f439406ca80 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.591+0000 7f4399f57640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439406d550 con 0x7f43940b0a00 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4398f55640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4394155460 0x7f43940b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44470/0 (socket says 172.21.15.113:44470) 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4398f55640 1 -- 172.21.15.113:0/125214332 learned_addr learned my addr 172.21.15.113:0/125214332 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4399756640 1 --2- 172.21.15.113:0/125214332 >> v2:172.21.15.113:3300/0 conn(0x7f439406ca80 0x7f43940cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4393fff640 1 --2- 172.21.15.113:0/125214332 >> v2:172.21.15.151:3300/0 conn(0x7f43940b0a00 0x7f439406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f43937fe640 1 -- 172.21.15.113:0/125214332 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698196891 0 0) 0x7f439415c9c0 con 0x7f4394155460 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f43937fe640 1 -- 172.21.15.113:0/125214332 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4384003520 con 0x7f4394155460 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4399756640 1 -- 172.21.15.113:0/125214332 >> v2:172.21.15.151:3300/0 conn(0x7f43940b0a00 msgr2=0x7f439406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4399756640 1 --2- 172.21.15.113:0/125214332 >> v2:172.21.15.151:3300/0 conn(0x7f43940b0a00 0x7f439406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4399756640 1 -- 172.21.15.113:0/125214332 >> v1:172.21.15.113:6789/0 conn(0x7f4394155460 legacy=0x7f43940b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.592+0000 7f4399756640 1 -- 172.21.15.113:0/125214332 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439406d830 con 0x7f439406ca80 2023-12-19T13:52:23.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.593+0000 7f4399756640 1 --2- 172.21.15.113:0/125214332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f439406ca80 0x7f43940cdcf0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f43940afea0 tx=0x7f438c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9165f82bb57a5fc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f43937fe640 1 -- 172.21.15.113:0/125214332 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c02cc80 con 0x7f439406ca80 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f43937fe640 1 -- 172.21.15.113:0/125214332 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c02cde0 con 0x7f439406ca80 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f43937fe640 1 -- 172.21.15.113:0/125214332 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c034660 con 0x7f439406ca80 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 -- 172.21.15.113:0/125214332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f439406ca80 msgr2=0x7f43940cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 --2- 172.21.15.113:0/125214332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f439406ca80 0x7f43940cdcf0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f43940afea0 tx=0x7f438c02bed0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 -- 172.21.15.113:0/125214332 shutdown_connections 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 --2- 172.21.15.113:0/125214332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f439406ca80 0x7f43940cdcf0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 --2- 172.21.15.113:0/125214332 >> v2:172.21.15.151:3300/0 conn(0x7f43940b0a00 0x7f439406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 -- 172.21.15.113:0/125214332 >> 172.21.15.113:0/125214332 conn(0x7f43940659a0 msgr2=0x7f4394065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 -- 172.21.15.113:0/125214332 shutdown_connections 2023-12-19T13:52:23.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.594+0000 7f4399f57640 1 -- 172.21.15.113:0/125214332 wait complete. 2023-12-19T13:52:23.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.596+0000 7f4399f57640 1 Processor -- start 2023-12-19T13:52:23.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.596+0000 7f4399f57640 1 -- start start 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399f57640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f439406ca80 0x7f43940ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399f57640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43940b0a00 0x7f439414f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399f57640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4394155460 0x7f43941f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399f57640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439414cab0 con 0x7f4394155460 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399f57640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43941482d0 con 0x7f43940b0a00 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399f57640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439414fcd0 con 0x7f439406ca80 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399756640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4394155460 0x7f43941f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399756640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4394155460 0x7f43941f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47600/0 (socket says 172.21.15.113:47600) 2023-12-19T13:52:23.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.597+0000 7f4399756640 1 -- 172.21.15.113:0/253924131 learned_addr learned my addr 172.21.15.113:0/253924131 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:23.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4398f55640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f439406ca80 0x7f43940ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4393fff640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43940b0a00 0x7f439414f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4399756640 1 -- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f439406ca80 msgr2=0x7f43940ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4399756640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f439406ca80 0x7f43940ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4399756640 1 -- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43940b0a00 msgr2=0x7f439414f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4399756640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43940b0a00 0x7f439414f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4399756640 1 -- 172.21.15.113:0/253924131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c009a70 con 0x7f4394155460 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4399756640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4394155460 0x7f43941f5fe0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f438c009e80 tx=0x7f438c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c040650 con 0x7f4394155460 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c0407b0 con 0x7f4394155460 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c040b60 con 0x7f4394155460 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.598+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439414bea0 con 0x7f4394155460 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.599+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439414c460 con 0x7f4394155460 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.600+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439414cc20 con 0x7f4394155460 2023-12-19T13:52:23.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.600+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f438c040cc0 con 0x7f4394155460 2023-12-19T13:52:23.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.601+0000 7f43917fa640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f437806a400 0x7f437806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:23.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.601+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f438c0ab6f0 con 0x7f4394155460 2023-12-19T13:52:23.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.602+0000 7f4398f55640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f437806a400 0x7f437806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:23.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.602+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x7f4378072050 con 0x7f4394155460 2023-12-19T13:52:23.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.602+0000 7f4398f55640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f437806a400 0x7f437806c8c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f43880011e0 tx=0x7f4388009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:23.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.606+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f438c076be0 con 0x7f4394155460 2023-12-19T13:52:23.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.699+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(100..100 src has 1..100) v4 ==== 296+0+0 (secure 0 0 0) 0x7f438c07afa0 con 0x7f4394155460 2023-12-19T13:52:23.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.699+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7f4378072900 con 0x7f4394155460 2023-12-19T13:52:23.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.799+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4394061910 con 0x7f4394155460 2023-12-19T13:52:23.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.800+0000 7f43917fa640 1 -- 172.21.15.113:0/253924131 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7f438c039020 con 0x7f4394155460 2023-12-19T13:52:23.801 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:52:23.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f437806a400 msgr2=0x7f437806c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f437806a400 0x7f437806c8c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f43880011e0 tx=0x7f4388009040 comp rx=0 tx=0).stop 2023-12-19T13:52:23.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4394155460 msgr2=0x7f43941f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:23.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4394155460 0x7f43941f5fe0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f438c009e80 tx=0x7f438c004a40 comp rx=0 tx=0).stop 2023-12-19T13:52:23.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 shutdown_connections 2023-12-19T13:52:23.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f437806a400 0x7f437806c8c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4394155460 0x7f43941f5fe0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43940b0a00 0x7f439414f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 --2- 172.21.15.113:0/253924131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f439406ca80 0x7f43940ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:23.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 >> 172.21.15.113:0/253924131 conn(0x7f43940659a0 msgr2=0x7f439415aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:23.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 shutdown_connections 2023-12-19T13:52:23.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:23.802+0000 7f4399f57640 1 -- 172.21.15.113:0/253924131 wait complete. 2023-12-19T13:52:23.820 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:52:24.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.028+0000 7fbfd93f0640 1 Processor -- start 2023-12-19T13:52:24.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.028+0000 7fbfd93f0640 1 -- start start 2023-12-19T13:52:24.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.030+0000 7fbfd93f0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbfd415b1d0 0x7fbfd40b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.030+0000 7fbfd93f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40ceea0 0x7fbfd40cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.030+0000 7fbfd93f0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd415fde0 con 0x7fbfd40b1ec0 2023-12-19T13:52:24.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.030+0000 7fbfd93f0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40cf870 con 0x7fbfd415b1d0 2023-12-19T13:52:24.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.030+0000 7fbfd93f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415ef10 con 0x7fbfd40ceea0 2023-12-19T13:52:24.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfd2ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbfd415b1d0 0x7fbfd40b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfca7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbfd40b1ec0 0x7fbfd415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44484/0 (socket says 172.21.15.113:44484) 2023-12-19T13:52:24.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfca7fc640 1 -- 172.21.15.113:0/866542354 learned_addr learned my addr 172.21.15.113:0/866542354 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfd2ffd640 1 -- 172.21.15.113:0/866542354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40ceea0 msgr2=0x7fbfd40cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfd2ffd640 1 --2- 172.21.15.113:0/866542354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40ceea0 0x7fbfd40cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfd2ffd640 1 -- 172.21.15.113:0/866542354 >> v1:172.21.15.113:6789/0 conn(0x7fbfd40b1ec0 legacy=0x7fbfd415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfd2ffd640 1 -- 172.21.15.113:0/866542354 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40b2320 con 0x7fbfd415b1d0 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.031+0000 7fbfd27fc640 1 -- 172.21.15.113:0/866542354 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246324991 0 0) 0x7fbfd415fde0 con 0x7fbfd40b1ec0 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.032+0000 7fbfd2ffd640 1 --2- 172.21.15.113:0/866542354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd415b1d0 0x7fbfd40b2760 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40097a0 tx=0x7fbfc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8283081ec70d599 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd27fc640 1 -- 172.21.15.113:0/866542354 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4031830 con 0x7fbfd415b1d0 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd27fc640 1 -- 172.21.15.113:0/866542354 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4031990 con 0x7fbfd415b1d0 2023-12-19T13:52:24.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd27fc640 1 -- 172.21.15.113:0/866542354 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4031d20 con 0x7fbfd415b1d0 2023-12-19T13:52:24.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 -- 172.21.15.113:0/866542354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd415b1d0 msgr2=0x7fbfd40b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/866542354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd415b1d0 0x7fbfd40b2760 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40097a0 tx=0x7fbfc402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 -- 172.21.15.113:0/866542354 shutdown_connections 2023-12-19T13:52:24.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/866542354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40ceea0 0x7fbfd40cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/866542354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd415b1d0 0x7fbfd40b2760 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 -- 172.21.15.113:0/866542354 >> 172.21.15.113:0/866542354 conn(0x7fbfd4073150 msgr2=0x7fbfd40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:24.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 -- 172.21.15.113:0/866542354 shutdown_connections 2023-12-19T13:52:24.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.033+0000 7fbfd93f0640 1 -- 172.21.15.113:0/866542354 wait complete. 2023-12-19T13:52:24.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.035+0000 7fbfd93f0640 1 Processor -- start 2023-12-19T13:52:24.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.035+0000 7fbfd93f0640 1 -- start start 2023-12-19T13:52:24.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfd93f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40b1ec0 0x7fbfd41f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfd93f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd40ceea0 0x7fbfd40b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfd93f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd415b1d0 0x7fbfd40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfd93f0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41f3b20 con 0x7fbfd40ceea0 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfd93f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40a9050 con 0x7fbfd415b1d0 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfd93f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41f3d30 con 0x7fbfd40b1ec0 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd40ceea0 0x7fbfd40b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd40ceea0 0x7fbfd40b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47614/0 (socket says 172.21.15.113:47614) 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.036+0000 7fbfca7fc640 1 -- 172.21.15.113:0/120646940 learned_addr learned my addr 172.21.15.113:0/120646940 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfca7fc640 1 -- 172.21.15.113:0/120646940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40b1ec0 msgr2=0x7fbfd41f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfca7fc640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40b1ec0 0x7fbfd41f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfca7fc640 1 -- 172.21.15.113:0/120646940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd415b1d0 msgr2=0x7fbfd40b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfca7fc640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd415b1d0 0x7fbfd40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfca7fc640 1 -- 172.21.15.113:0/120646940 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009400 con 0x7fbfd40ceea0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfca7fc640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd40ceea0 0x7fbfd40b00a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c4d0 tx=0x7fbfbc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0074e0 con 0x7fbfd40ceea0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc007660 con 0x7fbfd40ceea0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc004a20 con 0x7fbfd40ceea0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd41f66f0 con 0x7fbfd40ceea0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.037+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd41f6cb0 con 0x7fbfd40ceea0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.039+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd41f3f30 con 0x7fbfd40ceea0 2023-12-19T13:52:24.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.039+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfbc004b80 con 0x7fbfd40ceea0 2023-12-19T13:52:24.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.040+0000 7fbfcbfff640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb406a430 0x7fbfb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.040+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fbfbc087b70 con 0x7fbfd40ceea0 2023-12-19T13:52:24.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.041+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7fbfb4072080 con 0x7fbfd40ceea0 2023-12-19T13:52:24.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.041+0000 7fbfd2ffd640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb406a430 0x7fbfb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.041+0000 7fbfd2ffd640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb406a430 0x7fbfb406c8f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4036000 tx=0x7fbfc4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.045+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbfbc018020 con 0x7fbfd40ceea0 2023-12-19T13:52:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.220+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfd4061910 con 0x7fbfd40ceea0 2023-12-19T13:52:24.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.221+0000 7fbfcbfff640 1 -- 172.21.15.113:0/120646940 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbfd41f3f30 con 0x7fbfd40ceea0 2023-12-19T13:52:24.221 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:52:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb406a430 msgr2=0x7fbfb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb406a430 0x7fbfb406c8f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4036000 tx=0x7fbfc4030000 comp rx=0 tx=0).stop 2023-12-19T13:52:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd40ceea0 msgr2=0x7fbfd40b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd40ceea0 0x7fbfd40b00a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c4d0 tx=0x7fbfbc00c990 comp rx=0 tx=0).stop 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 shutdown_connections 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfb406a430 0x7fbfb406c8f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfd415b1d0 0x7fbfd40b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfd40ceea0 0x7fbfd40b00a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.223+0000 7fbfd93f0640 1 --2- 172.21.15.113:0/120646940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfd40b1ec0 0x7fbfd41f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.224+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 >> 172.21.15.113:0/120646940 conn(0x7fbfd4073150 msgr2=0x7fbfd40cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.224+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 shutdown_connections 2023-12-19T13:52:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.224+0000 7fbfd93f0640 1 -- 172.21.15.113:0/120646940 wait complete. 2023-12-19T13:52:24.242 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:24.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.451+0000 7f701070a640 1 Processor -- start 2023-12-19T13:52:24.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.451+0000 7f701070a640 1 -- start start 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f701070a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7008157bf0 0x7f700815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f701070a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70080ae110 0x7f70080b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f701070a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70080b0a90 con 0x7f70080b0640 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f701070a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700806b8c0 con 0x7f7008157bf0 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f701070a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700815b740 con 0x7f70080ae110 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f700eca7640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f70080b0640 0x7f700815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44498/0 (socket says 172.21.15.113:44498) 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f700eca7640 1 -- 172.21.15.113:0/718298421 learned_addr learned my addr 172.21.15.113:0/718298421 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.453+0000 7f700e4a6640 1 --2- 172.21.15.113:0/718298421 >> v2:172.21.15.113:3300/0 conn(0x7f7008157bf0 0x7f700815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700dca5640 1 --2- 172.21.15.113:0/718298421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70080ae110 0x7f70080b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700d4a4640 1 -- 172.21.15.113:0/718298421 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183019819 0 0) 0x7f7000001490 con 0x7f70080b0640 2023-12-19T13:52:24.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700d4a4640 1 -- 172.21.15.113:0/718298421 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff4003520 con 0x7f70080b0640 2023-12-19T13:52:24.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700e4a6640 1 -- 172.21.15.113:0/718298421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70080ae110 msgr2=0x7f70080b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:24.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700e4a6640 1 --2- 172.21.15.113:0/718298421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70080ae110 0x7f70080b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700e4a6640 1 -- 172.21.15.113:0/718298421 >> v1:172.21.15.113:6789/0 conn(0x7f70080b0640 legacy=0x7f700815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700e4a6640 1 -- 172.21.15.113:0/718298421 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080ae640 con 0x7f7008157bf0 2023-12-19T13:52:24.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.454+0000 7f700dca5640 1 --2- 172.21.15.113:0/718298421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70080ae110 0x7f70080b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:24.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f700e4a6640 1 --2- 172.21.15.113:0/718298421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7008157bf0 0x7f700815b200 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f70040097d0 tx=0x7f700402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93255384a2c5d95 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f700d4a4640 1 -- 172.21.15.113:0/718298421 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004031800 con 0x7f7008157bf0 2023-12-19T13:52:24.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f700d4a4640 1 -- 172.21.15.113:0/718298421 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004031960 con 0x7f7008157bf0 2023-12-19T13:52:24.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f700d4a4640 1 -- 172.21.15.113:0/718298421 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004031cd0 con 0x7f7008157bf0 2023-12-19T13:52:24.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f701070a640 1 -- 172.21.15.113:0/718298421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7008157bf0 msgr2=0x7f700815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f701070a640 1 --2- 172.21.15.113:0/718298421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7008157bf0 0x7f700815b200 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f70040097d0 tx=0x7f700402b8a0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f701070a640 1 -- 172.21.15.113:0/718298421 shutdown_connections 2023-12-19T13:52:24.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f701070a640 1 --2- 172.21.15.113:0/718298421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70080ae110 0x7f70080b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f701070a640 1 --2- 172.21.15.113:0/718298421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7008157bf0 0x7f700815b200 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.456+0000 7f701070a640 1 -- 172.21.15.113:0/718298421 >> 172.21.15.113:0/718298421 conn(0x7f70080cbb70 msgr2=0x7f70080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:24.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.457+0000 7f701070a640 1 -- 172.21.15.113:0/718298421 shutdown_connections 2023-12-19T13:52:24.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.457+0000 7f701070a640 1 -- 172.21.15.113:0/718298421 wait complete. 2023-12-19T13:52:24.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.458+0000 7f701070a640 1 Processor -- start 2023-12-19T13:52:24.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.458+0000 7f701070a640 1 -- start start 2023-12-19T13:52:24.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.459+0000 7f701070a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70080ae110 0x7f700814ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.459+0000 7f701070a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70080b0640 0x7f700806d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.459+0000 7f701070a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7008157bf0 0x7f700815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.459+0000 7f701070a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700814d9d0 con 0x7f70080b0640 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.459+0000 7f701070a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700814dcb0 con 0x7f70080ae110 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.459+0000 7f701070a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700814df90 con 0x7f7008157bf0 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70080b0640 0x7f700806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70080b0640 0x7f700806d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47632/0 (socket says 172.21.15.113:47632) 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 -- 172.21.15.113:0/544202663 learned_addr learned my addr 172.21.15.113:0/544202663 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700eca7640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7008157bf0 0x7f700815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700e4a6640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70080ae110 0x7f700814ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 -- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7008157bf0 msgr2=0x7f700815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7008157bf0 0x7f700815b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 -- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70080ae110 msgr2=0x7f700814ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70080ae110 0x7f700814ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 -- 172.21.15.113:0/544202663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004009400 con 0x7f70080b0640 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700eca7640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7008157bf0 0x7f700815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.460+0000 7f700dca5640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70080b0640 0x7f700806d860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800d800 tx=0x7f6ff800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.461+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8004030 con 0x7f70080b0640 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.461+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8004190 con 0x7f70080b0640 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.461+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800b6c0 con 0x7f70080b0640 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.461+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700814e270 con 0x7f70080b0640 2023-12-19T13:52:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.461+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700814f2d0 con 0x7f70080b0640 2023-12-19T13:52:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.462+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7008061910 con 0x7f70080b0640 2023-12-19T13:52:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.463+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ff800b820 con 0x7f70080b0640 2023-12-19T13:52:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.464+0000 7f6ffeffd640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6fec06a430 0x7f6fec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.464+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f6ff8088ae0 con 0x7f70080b0640 2023-12-19T13:52:24.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.464+0000 7f700e4a6640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6fec06a430 0x7f6fec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.465+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7f6fec072080 con 0x7f70080b0640 2023-12-19T13:52:24.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.465+0000 7f700e4a6640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6fec06a430 0x7f6fec06c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7004036000 tx=0x7f7004008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.469+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ff8054060 con 0x7f70080b0640 2023-12-19T13:52:24.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.681+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70080ceda0 con 0x7f70080b0640 2023-12-19T13:52:24.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.682+0000 7f6ffeffd640 1 -- 172.21.15.113:0/544202663 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f6ff8057680 con 0x7f70080b0640 2023-12-19T13:52:24.683 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:24.683 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:51:21.594253+0000","modified":"2023-12-19T13:51:24.611657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2704300841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2704300841},{"type":"v1","addr":"172.21.15.151:6835","nonce":2704300841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T13:52:24.683 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 41 2023-12-19T13:52:24.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6fec06a430 msgr2=0x7f6fec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6fec06a430 0x7f6fec06c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7004036000 tx=0x7f7004008030 comp rx=0 tx=0).stop 2023-12-19T13:52:24.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70080b0640 msgr2=0x7f700806d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70080b0640 0x7f700806d860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800d800 tx=0x7f6ff800dcc0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 shutdown_connections 2023-12-19T13:52:24.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6fec06a430 0x7f6fec06c8f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7008157bf0 0x7f700815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70080b0640 0x7f700806d860 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 --2- 172.21.15.113:0/544202663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70080ae110 0x7f700814ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 >> 172.21.15.113:0/544202663 conn(0x7f70080cbb70 msgr2=0x7f700814fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:24.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.684+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 shutdown_connections 2023-12-19T13:52:24.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.685+0000 7f701070a640 1 -- 172.21.15.113:0/544202663 wait complete. 2023-12-19T13:52:24.702 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.902+0000 7fb00f39b640 1 Processor -- start 2023-12-19T13:52:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.903+0000 7fb00f39b640 1 -- start start 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.904+0000 7fb00f39b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0080acd40 0x7fb0080701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.904+0000 7fb00f39b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0080b2fa0 con 0x7fb0080ac8b0 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.904+0000 7fb00f39b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00806f600 con 0x7fb00815e3f0 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.904+0000 7fb00f39b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00815e7d0 con 0x7fb0080acd40 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.905+0000 7fb00eb9a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0080acd40 0x7fb0080701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.905+0000 7fb00db98640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb0080ac8b0 0x7fb00806fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44506/0 (socket says 172.21.15.113:44506) 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.905+0000 7fb00db98640 1 -- 172.21.15.113:0/4028246013 learned_addr learned my addr 172.21.15.113:0/4028246013 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.905+0000 7fb00eb9a640 1 -- 172.21.15.113:0/4028246013 >> v1:172.21.15.151:6789/0 conn(0x7fb00815e3f0 legacy=0x7fb0080b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.905+0000 7fb00eb9a640 1 -- 172.21.15.113:0/4028246013 >> v1:172.21.15.113:6789/0 conn(0x7fb0080ac8b0 legacy=0x7fb00806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.905+0000 7fb00eb9a640 1 -- 172.21.15.113:0/4028246013 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080b29e0 con 0x7fb0080acd40 2023-12-19T13:52:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.905+0000 7fb00d397640 1 -- 172.21.15.113:0/4028246013 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958917749 0 0) 0x7fb0080b2fa0 con 0x7fb0080ac8b0 2023-12-19T13:52:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.906+0000 7fb00eb9a640 1 --2- 172.21.15.113:0/4028246013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0080acd40 0x7fb0080701a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d90 tx=0x7fb00002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06413e4131f2436 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.906+0000 7fb00d397640 1 -- 172.21.15.113:0/4028246013 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00002cbd0 con 0x7fb0080acd40 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.906+0000 7fb00d397640 1 -- 172.21.15.113:0/4028246013 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00002cd30 con 0x7fb0080acd40 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.906+0000 7fb00d397640 1 -- 172.21.15.113:0/4028246013 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00002cea0 con 0x7fb0080acd40 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.907+0000 7fb00f39b640 1 -- 172.21.15.113:0/4028246013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0080acd40 msgr2=0x7fb0080701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.907+0000 7fb00f39b640 1 --2- 172.21.15.113:0/4028246013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0080acd40 0x7fb0080701a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d90 tx=0x7fb00002be20 comp rx=0 tx=0).stop 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.907+0000 7fb00f39b640 1 -- 172.21.15.113:0/4028246013 shutdown_connections 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.907+0000 7fb00f39b640 1 --2- 172.21.15.113:0/4028246013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0080acd40 0x7fb0080701a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.907+0000 7fb00f39b640 1 -- 172.21.15.113:0/4028246013 >> 172.21.15.113:0/4028246013 conn(0x7fb0080b0100 msgr2=0x7fb0080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.907+0000 7fb00f39b640 1 -- 172.21.15.113:0/4028246013 shutdown_connections 2023-12-19T13:52:24.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.907+0000 7fb00f39b640 1 -- 172.21.15.113:0/4028246013 wait complete. 2023-12-19T13:52:24.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.909+0000 7fb00f39b640 1 Processor -- start 2023-12-19T13:52:24.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.909+0000 7fb00f39b640 1 -- start start 2023-12-19T13:52:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00f39b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0080ac8b0 0x7fb0081f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00f39b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0080acd40 0x7fb0081f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00f39b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb00815e3f0 0x7fb00815fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00f39b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081f6f50 con 0x7fb00815e3f0 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00f39b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081507c0 con 0x7fb0080ac8b0 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00f39b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00806dbd0 con 0x7fb0080acd40 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00eb9a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb00815e3f0 0x7fb00815fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00eb9a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb00815e3f0 0x7fb00815fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47642/0 (socket says 172.21.15.113:47642) 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.910+0000 7fb00eb9a640 1 -- 172.21.15.113:0/2624363450 learned_addr learned my addr 172.21.15.113:0/2624363450 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7fb00eb9a640 1 -- 172.21.15.113:0/2624363450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0080acd40 msgr2=0x7fb0081f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7fb00eb9a640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0080acd40 0x7fb0081f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7fb00eb9a640 1 -- 172.21.15.113:0/2624363450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0080ac8b0 msgr2=0x7fb0081f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7fb00e399640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0080ac8b0 0x7fb0081f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7fb00eb9a640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0080ac8b0 0x7fb0081f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7fb00eb9a640 1 -- 172.21.15.113:0/2624363450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000009a70 con 0x7fb00815e3f0 2023-12-19T13:52:24.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7fb00eb9a640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb00815e3f0 0x7fb00815fc30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d90 tx=0x7fb000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.911+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00002cea0 con 0x7fb00815e3f0 2023-12-19T13:52:24.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.912+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00003e630 con 0x7fb00815e3f0 2023-12-19T13:52:24.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.912+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00003e9e0 con 0x7fb00815e3f0 2023-12-19T13:52:24.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.912+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00806deb0 con 0x7fb00815e3f0 2023-12-19T13:52:24.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.912+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00806b320 con 0x7fb00815e3f0 2023-12-19T13:52:24.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.913+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb008061910 con 0x7fb00815e3f0 2023-12-19T13:52:24.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.914+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb00003b050 con 0x7fb00815e3f0 2023-12-19T13:52:24.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.914+0000 7faffeffd640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fafec06a430 0x7fafec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:24.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.915+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fb0000ab4b0 con 0x7fb00815e3f0 2023-12-19T13:52:24.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.915+0000 7fb00e399640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fafec06a430 0x7fafec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:24.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.915+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7fafec072080 con 0x7fb00815e3f0 2023-12-19T13:52:24.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.916+0000 7fb00e399640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fafec06a430 0x7fafec06c8f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb004003d90 tx=0x7fb004009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:24.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:24.919+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb000039060 con 0x7fb00815e3f0 2023-12-19T13:52:25.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.112+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0080ad640 con 0x7fb00815e3f0 2023-12-19T13:52:25.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.115+0000 7faffeffd640 1 -- 172.21.15.113:0/2624363450 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16255 (secure 0 0 0) 0x7fb00004e070 con 0x7fb00815e3f0 2023-12-19T13:52:25.115 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:25.115 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":100,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:23.694753+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.3d","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.117+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fafec06a430 msgr2=0x7fafec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.117+0000 7fb00f39b640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fafec06a430 0x7fafec06c8f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb004003d90 tx=0x7fb004009040 comp rx=0 tx=0).stop 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.117+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb00815e3f0 msgr2=0x7fb00815fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.117+0000 7fb00f39b640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb00815e3f0 0x7fb00815fc30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d90 tx=0x7fb000004a40 comp rx=0 tx=0).stop 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 shutdown_connections 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fafec06a430 0x7fafec06c8f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb00815e3f0 0x7fb00815fc30 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0080acd40 0x7fb0081f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 --2- 172.21.15.113:0/2624363450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0080ac8b0 0x7fb0081f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 >> 172.21.15.113:0/2624363450 conn(0x7fb0080b0100 msgr2=0x7fb0080af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 shutdown_connections 2023-12-19T13:52:25.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.118+0000 7fb00f39b640 1 -- 172.21.15.113:0/2624363450 wait complete. 2023-12-19T13:52:25.137 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:52:25.137 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.344+0000 7fbcd091b640 1 Processor -- start 2023-12-19T13:52:25.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.345+0000 7fbcd091b640 1 -- start start 2023-12-19T13:52:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.346+0000 7fbcd091b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbccc15e750 0x7fbccc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.346+0000 7fbcd091b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc0b2600 con 0x7fbccc0b1710 2023-12-19T13:52:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.346+0000 7fbcd091b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc0b1d60 con 0x7fbccc157aa0 2023-12-19T13:52:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.346+0000 7fbcd091b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0b2040 con 0x7fbccc15e750 2023-12-19T13:52:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.346+0000 7fbccad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbccc15e750 0x7fbccc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.346+0000 7fbcc1d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbccc0b1710 0x7fbccc15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44518/0 (socket says 172.21.15.113:44518) 2023-12-19T13:52:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.346+0000 7fbcc1d9b640 1 -- 172.21.15.113:0/1859153293 learned_addr learned my addr 172.21.15.113:0/1859153293 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.347+0000 7fbccad9d640 1 -- 172.21.15.113:0/1859153293 >> v1:172.21.15.151:6789/0 conn(0x7fbccc157aa0 legacy=0x7fbccc161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:25.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.347+0000 7fbccad9d640 1 -- 172.21.15.113:0/1859153293 >> v1:172.21.15.113:6789/0 conn(0x7fbccc0b1710 legacy=0x7fbccc15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.347+0000 7fbccad9d640 1 -- 172.21.15.113:0/1859153293 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0b2320 con 0x7fbccc15e750 2023-12-19T13:52:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.347+0000 7fbcc9d9b640 1 -- 172.21.15.113:0/1859153293 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900209653 0 0) 0x7fbccc0b2600 con 0x7fbccc0b1710 2023-12-19T13:52:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.348+0000 7fbccad9d640 1 --2- 172.21.15.113:0/1859153293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc06e410 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009d90 tx=0x7fbcc402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321ea868ad0ade6a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.348+0000 7fbcc9d9b640 1 -- 172.21.15.113:0/1859153293 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc402cc60 con 0x7fbccc15e750 2023-12-19T13:52:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.348+0000 7fbcc9d9b640 1 -- 172.21.15.113:0/1859153293 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc402cdc0 con 0x7fbccc15e750 2023-12-19T13:52:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.348+0000 7fbcc9d9b640 1 -- 172.21.15.113:0/1859153293 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4034660 con 0x7fbccc15e750 2023-12-19T13:52:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.349+0000 7fbcd091b640 1 -- 172.21.15.113:0/1859153293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 msgr2=0x7fbccc06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.349+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1859153293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc06e410 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009d90 tx=0x7fbcc402beb0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.349+0000 7fbcd091b640 1 -- 172.21.15.113:0/1859153293 shutdown_connections 2023-12-19T13:52:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.349+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1859153293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc06e410 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.349+0000 7fbcd091b640 1 -- 172.21.15.113:0/1859153293 >> 172.21.15.113:0/1859153293 conn(0x7fbccc0cbb70 msgr2=0x7fbccc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.349+0000 7fbcd091b640 1 -- 172.21.15.113:0/1859153293 shutdown_connections 2023-12-19T13:52:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.349+0000 7fbcd091b640 1 -- 172.21.15.113:0/1859153293 wait complete. 2023-12-19T13:52:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.350+0000 7fbcd091b640 1 Processor -- start 2023-12-19T13:52:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.351+0000 7fbcd091b640 1 -- start start 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcd091b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbccc0b1710 0x7fbccc1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcd091b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbccc157aa0 0x7fbccc155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcd091b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc14d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcd091b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc155a70 con 0x7fbccc15e750 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcd091b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc155cf0 con 0x7fbccc157aa0 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcd091b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc1e8040 con 0x7fbccc0b1710 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc14d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc14d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47658/0 (socket says 172.21.15.113:47658) 2023-12-19T13:52:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 -- 172.21.15.113:0/1710068563 learned_addr learned my addr 172.21.15.113:0/1710068563 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcca59c640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbccc0b1710 0x7fbccc1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcc1d9b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbccc157aa0 0x7fbccc155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 -- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbccc0b1710 msgr2=0x7fbccc1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbccc0b1710 0x7fbccc1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 -- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbccc157aa0 msgr2=0x7fbccc155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbccc157aa0 0x7fbccc155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbccad9d640 1 -- 172.21.15.113:0/1710068563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc4009a70 con 0x7fbccc15e750 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcca59c640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbccc0b1710 0x7fbccc1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.352+0000 7fbcc1d9b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbccc157aa0 0x7fbccc155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.353+0000 7fbccad9d640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc14d6e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009eb0 tx=0x7fbcc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.353+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc403f420 con 0x7fbccc15e750 2023-12-19T13:52:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.353+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc403f580 con 0x7fbccc15e750 2023-12-19T13:52:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.353+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc1e8320 con 0x7fbccc15e750 2023-12-19T13:52:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.353+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc403f910 con 0x7fbccc15e750 2023-12-19T13:52:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.353+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc1e7d30 con 0x7fbccc15e750 2023-12-19T13:52:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.354+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc1e8840 con 0x7fbccc15e750 2023-12-19T13:52:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.355+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbcc403fa70 con 0x7fbccc15e750 2023-12-19T13:52:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.356+0000 7fbcc37fe640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcac06a430 0x7fbcac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.356+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fbcc40ab480 con 0x7fbccc15e750 2023-12-19T13:52:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.356+0000 7fbcca59c640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcac06a430 0x7fbcac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.356+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7fbcac072080 con 0x7fbccc15e750 2023-12-19T13:52:25.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.357+0000 7fbcca59c640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcac06a430 0x7fbcac06c8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbccc1f6e10 tx=0x7fbcbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:25.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.360+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbccc1e8840 con 0x7fbccc15e750 2023-12-19T13:52:25.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.573+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbccc1e8840 con 0x7fbccc15e750 2023-12-19T13:52:25.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.574+0000 7fbcc37fe640 1 -- 172.21.15.113:0/1710068563 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fbccc1e8840 con 0x7fbccc15e750 2023-12-19T13:52:25.574 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:25.574 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:51:21.594253+0000","modified":"2023-12-19T13:51:24.611657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2704300841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2704300841},{"type":"v1","addr":"172.21.15.151:6835","nonce":2704300841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T13:52:25.575 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 41 2023-12-19T13:52:25.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcac06a430 msgr2=0x7fbcac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcac06a430 0x7fbcac06c8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbccc1f6e10 tx=0x7fbcbc009040 comp rx=0 tx=0).stop 2023-12-19T13:52:25.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 msgr2=0x7fbccc14d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc14d6e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009eb0 tx=0x7fbcc4004a40 comp rx=0 tx=0).stop 2023-12-19T13:52:25.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 shutdown_connections 2023-12-19T13:52:25.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcac06a430 0x7fbcac06c8f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbccc15e750 0x7fbccc14d6e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbccc157aa0 0x7fbccc155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 --2- 172.21.15.113:0/1710068563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbccc0b1710 0x7fbccc1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 >> 172.21.15.113:0/1710068563 conn(0x7fbccc0cbb70 msgr2=0x7fbccc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:25.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 shutdown_connections 2023-12-19T13:52:25.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.576+0000 7fbcd091b640 1 -- 172.21.15.113:0/1710068563 wait complete. 2023-12-19T13:52:25.595 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:25.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.799+0000 7feccb8f7640 1 Processor -- start 2023-12-19T13:52:25.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.800+0000 7feccb8f7640 1 -- start start 2023-12-19T13:52:25.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.801+0000 7feccb8f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc41449e0 0x7fecc40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.801+0000 7feccb8f7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fecc406c6b0 0x7fecc40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.801+0000 7feccb8f7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40afb10 con 0x7fecc40b0b50 2023-12-19T13:52:25.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.801+0000 7feccb8f7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc406bb30 con 0x7fecc406c6b0 2023-12-19T13:52:25.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.801+0000 7feccb8f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40b0070 con 0x7fecc41449e0 2023-12-19T13:52:25.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.802+0000 7fecc9e94640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fecc406c6b0 0x7fecc40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.802+0000 7fecc9693640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc41449e0 0x7fecc40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.802+0000 7fecc8e92640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fecc40b0b50 0x7fecc406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:56816/0 (socket says 172.21.15.113:56816) 2023-12-19T13:52:25.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.802+0000 7fecc8e92640 1 -- 172.21.15.113:0/3005900562 learned_addr learned my addr 172.21.15.113:0/3005900562 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:25.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.802+0000 7fecc9e94640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fecc406c6b0 0x7fecc40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:57778/0 (socket says 172.21.15.113:57778) 2023-12-19T13:52:25.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.803+0000 7fecc9e94640 1 -- 172.21.15.113:0/3005900562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc41449e0 msgr2=0x7fecc40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:25.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.803+0000 7fecc9e94640 1 --2- 172.21.15.113:0/3005900562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc41449e0 0x7fecc40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.803+0000 7fecc9e94640 1 -- 172.21.15.113:0/3005900562 >> v1:172.21.15.151:6789/0 conn(0x7fecc40b0b50 legacy=0x7fecc406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.803+0000 7fecc9e94640 1 -- 172.21.15.113:0/3005900562 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40b0350 con 0x7fecc406c6b0 2023-12-19T13:52:25.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.805+0000 7fecc9e94640 1 --2- 172.21.15.113:0/3005900562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc406c6b0 0x7fecc40b1710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d90 tx=0x7fecbc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a440fe1abcdfc65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:25.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.805+0000 7fecbbfff640 1 -- 172.21.15.113:0/3005900562 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc02cc50 con 0x7fecc406c6b0 2023-12-19T13:52:25.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7fecbbfff640 1 -- 172.21.15.113:0/3005900562 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc02cdb0 con 0x7fecc406c6b0 2023-12-19T13:52:25.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7fecbbfff640 1 -- 172.21.15.113:0/3005900562 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc034660 con 0x7fecc406c6b0 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 -- 172.21.15.113:0/3005900562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc406c6b0 msgr2=0x7fecc40b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 --2- 172.21.15.113:0/3005900562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc406c6b0 0x7fecc40b1710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d90 tx=0x7fecbc02bea0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 -- 172.21.15.113:0/3005900562 shutdown_connections 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 --2- 172.21.15.113:0/3005900562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc406c6b0 0x7fecc40b1710 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 --2- 172.21.15.113:0/3005900562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc41449e0 0x7fecc40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 -- 172.21.15.113:0/3005900562 >> 172.21.15.113:0/3005900562 conn(0x7fecc40cbb70 msgr2=0x7fecc40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 -- 172.21.15.113:0/3005900562 shutdown_connections 2023-12-19T13:52:25.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.806+0000 7feccb8f7640 1 -- 172.21.15.113:0/3005900562 wait complete. 2023-12-19T13:52:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.808+0000 7feccb8f7640 1 Processor -- start 2023-12-19T13:52:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.808+0000 7feccb8f7640 1 -- start start 2023-12-19T13:52:25.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7feccb8f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecc406c6b0 0x7fecc41f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7feccb8f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b0b50 0x7fecc415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7feccb8f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc41449e0 0x7fecc415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7feccb8f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40a8ce0 con 0x7fecc406c6b0 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7feccb8f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc415c890 con 0x7fecc41449e0 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7feccb8f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc415cb10 con 0x7fecc40b0b50 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7fecc9693640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecc406c6b0 0x7fecc41f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7fecc9693640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecc406c6b0 0x7fecc41f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47668/0 (socket says 172.21.15.113:47668) 2023-12-19T13:52:25.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.809+0000 7fecc9693640 1 -- 172.21.15.113:0/268501627 learned_addr learned my addr 172.21.15.113:0/268501627 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:25.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc8e92640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b0b50 0x7fecc415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9e94640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc41449e0 0x7fecc415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9693640 1 -- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b0b50 msgr2=0x7fecc415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9693640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b0b50 0x7fecc415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9693640 1 -- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc41449e0 msgr2=0x7fecc415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9693640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc41449e0 0x7fecc415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9693640 1 -- 172.21.15.113:0/268501627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009a70 con 0x7fecc406c6b0 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9e94640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc41449e0 0x7fecc415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc8e92640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b0b50 0x7fecc415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecc9693640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecc406c6b0 0x7fecc41f0ad0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fecc000e870 tx=0x7fecc000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.810+0000 7fecb9ffb640 1 -- 172.21.15.113:0/268501627 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00094f0 con 0x7fecc406c6b0 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.811+0000 7fecb9ffb640 1 -- 172.21.15.113:0/268501627 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc000c940 con 0x7fecc406c6b0 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.811+0000 7fecb9ffb640 1 -- 172.21.15.113:0/268501627 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000ccf0 con 0x7fecc406c6b0 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.811+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc415d100 con 0x7fecc406c6b0 2023-12-19T13:52:25.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.811+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc415d6c0 con 0x7fecc406c6b0 2023-12-19T13:52:25.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.812+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc4061910 con 0x7fecc406c6b0 2023-12-19T13:52:25.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.813+0000 7fecb9ffb640 1 -- 172.21.15.113:0/268501627 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fecc0013470 con 0x7fecc406c6b0 2023-12-19T13:52:25.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.814+0000 7fecb9ffb640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feca806a460 0x7feca806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:25.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.814+0000 7fecb9ffb640 1 -- 172.21.15.113:0/268501627 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fecc0088940 con 0x7fecc406c6b0 2023-12-19T13:52:25.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.814+0000 7fecc8e92640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feca806a460 0x7feca806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:25.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.815+0000 7fecc8e92640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feca806a460 0x7feca806c920 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ae530 tx=0x7fecb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:25.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:25.818+0000 7fecb9ffb640 1 -- 172.21.15.113:0/268501627 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fecc0053f60 con 0x7fecc406c6b0 2023-12-19T13:52:26.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.051+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecc40ae560 con 0x7fecc406c6b0 2023-12-19T13:52:26.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.052+0000 7fecb9ffb640 1 -- 172.21.15.113:0/268501627 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fecc0017090 con 0x7fecc406c6b0 2023-12-19T13:52:26.053 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:26.053 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:51:21.594253+0000","modified":"2023-12-19T13:51:24.611657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2704300841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2704300841},{"type":"v1","addr":"172.21.15.151:6835","nonce":2704300841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T13:52:26.053 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 41 2023-12-19T13:52:26.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.054+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feca806a460 msgr2=0x7feca806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.054+0000 7feccb8f7640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feca806a460 0x7feca806c920 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ae530 tx=0x7fecb4009040 comp rx=0 tx=0).stop 2023-12-19T13:52:26.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.054+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecc406c6b0 msgr2=0x7fecc41f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.054+0000 7feccb8f7640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecc406c6b0 0x7fecc41f0ad0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fecc000e870 tx=0x7fecc000ed30 comp rx=0 tx=0).stop 2023-12-19T13:52:26.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 shutdown_connections 2023-12-19T13:52:26.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feca806a460 0x7feca806c920 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc41449e0 0x7fecc415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b0b50 0x7fecc415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 --2- 172.21.15.113:0/268501627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fecc406c6b0 0x7fecc41f0ad0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 >> 172.21.15.113:0/268501627 conn(0x7fecc40cbb70 msgr2=0x7fecc406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:26.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 shutdown_connections 2023-12-19T13:52:26.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.055+0000 7feccb8f7640 1 -- 172.21.15.113:0/268501627 wait complete. 2023-12-19T13:52:26.074 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:26.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.283+0000 7f6438c42640 1 Processor -- start 2023-12-19T13:52:26.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.284+0000 7f6438c42640 1 -- start start 2023-12-19T13:52:26.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.285+0000 7f6438c42640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340d1d20 0x7f6434144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.285+0000 7f6438c42640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6434144f60 0x7f643406d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.285+0000 7f6438c42640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64340cf280 con 0x7f64341444b0 2023-12-19T13:52:26.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.285+0000 7f6438c42640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64340d21b0 con 0x7f6434144f60 2023-12-19T13:52:26.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.285+0000 7f6438c42640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643415f9e0 con 0x7f64340d1d20 2023-12-19T13:52:26.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.286+0000 7f6432d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6434144f60 0x7f643406d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.286+0000 7f6431d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340d1d20 0x7f6434144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.286+0000 7f6431d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340d1d20 0x7f6434144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:32946/0 (socket says 172.21.15.113:32946) 2023-12-19T13:52:26.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.286+0000 7f6431d9b640 1 -- 172.21.15.113:0/2885507282 learned_addr learned my addr 172.21.15.113:0/2885507282 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:26.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.287+0000 7f6431d9b640 1 -- 172.21.15.113:0/2885507282 >> v2:172.21.15.151:3300/0 conn(0x7f6434144f60 msgr2=0x7f643406d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:26.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.287+0000 7f6431d9b640 1 --2- 172.21.15.113:0/2885507282 >> v2:172.21.15.151:3300/0 conn(0x7f6434144f60 0x7f643406d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.287+0000 7f6431d9b640 1 -- 172.21.15.113:0/2885507282 >> v1:172.21.15.151:6789/0 conn(0x7f64341444b0 legacy=0x7f64340cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.287+0000 7f6431d9b640 1 -- 172.21.15.113:0/2885507282 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643415fe70 con 0x7f64340d1d20 2023-12-19T13:52:26.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.287+0000 7f6432d9d640 1 --2- 172.21.15.113:0/2885507282 >> v2:172.21.15.151:3300/0 conn(0x7f6434144f60 0x7f643406d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:52:26.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.288+0000 7f6431d9b640 1 --2- 172.21.15.113:0/2885507282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340d1d20 0x7f6434144890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64280098a0 tx=0x7f642802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d76c7ff6ce9bec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:26.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f643159a640 1 -- 172.21.15.113:0/2885507282 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428031640 con 0x7f64340d1d20 2023-12-19T13:52:26.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f643159a640 1 -- 172.21.15.113:0/2885507282 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64280317a0 con 0x7f64340d1d20 2023-12-19T13:52:26.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f643159a640 1 -- 172.21.15.113:0/2885507282 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428031b30 con 0x7f64340d1d20 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 -- 172.21.15.113:0/2885507282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340d1d20 msgr2=0x7f6434144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 --2- 172.21.15.113:0/2885507282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340d1d20 0x7f6434144890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64280098a0 tx=0x7f642802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 -- 172.21.15.113:0/2885507282 shutdown_connections 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 --2- 172.21.15.113:0/2885507282 >> v2:172.21.15.151:3300/0 conn(0x7f6434144f60 0x7f643406d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 --2- 172.21.15.113:0/2885507282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340d1d20 0x7f6434144890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 -- 172.21.15.113:0/2885507282 >> 172.21.15.113:0/2885507282 conn(0x7f643406a2e0 msgr2=0x7f643406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 -- 172.21.15.113:0/2885507282 shutdown_connections 2023-12-19T13:52:26.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.289+0000 7f6438c42640 1 -- 172.21.15.113:0/2885507282 wait complete. 2023-12-19T13:52:26.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.291+0000 7f6438c42640 1 Processor -- start 2023-12-19T13:52:26.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.291+0000 7f6438c42640 1 -- start start 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.292+0000 7f6438c42640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64341444b0 0x7f64341427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.292+0000 7f6438c42640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6434144f60 0x7f64340b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.292+0000 7f6438c42640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64340b19e0 0x7f64340b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.292+0000 7f6438c42640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b1e70 con 0x7f64340b19e0 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.292+0000 7f6438c42640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64341f38c0 con 0x7f6434144f60 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.292+0000 7f6438c42640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6434142cf0 con 0x7f64341444b0 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64340b19e0 0x7f64340b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64340b19e0 0x7f64340b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47670/0 (socket says 172.21.15.113:47670) 2023-12-19T13:52:26.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 -- 172.21.15.113:0/2673420937 learned_addr learned my addr 172.21.15.113:0/2673420937 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f643259c640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64341444b0 0x7f64341427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6431d9b640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6434144f60 0x7f64340b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 -- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64341444b0 msgr2=0x7f64341427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64341444b0 0x7f64341427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 -- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6434144f60 msgr2=0x7f64340b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6434144f60 0x7f64340b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 -- 172.21.15.113:0/2673420937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c009a70 con 0x7f64340b19e0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.293+0000 7f6432d9d640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64340b19e0 0x7f64340b4b80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f642c00efc0 tx=0x7f642c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.294+0000 7f6422ffd640 1 -- 172.21.15.113:0/2673420937 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c014480 con 0x7f64340b19e0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.294+0000 7f6422ffd640 1 -- 172.21.15.113:0/2673420937 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c00f040 con 0x7f64340b19e0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.294+0000 7f6422ffd640 1 -- 172.21.15.113:0/2673420937 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c014840 con 0x7f64340b19e0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.294+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64280094d0 con 0x7f64340b19e0 2023-12-19T13:52:26.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.294+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64341f3270 con 0x7f64340b19e0 2023-12-19T13:52:26.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.295+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64341f3a30 con 0x7f64340b19e0 2023-12-19T13:52:26.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.296+0000 7f6422ffd640 1 -- 172.21.15.113:0/2673420937 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f642c0149a0 con 0x7f64340b19e0 2023-12-19T13:52:26.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.297+0000 7f6422ffd640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f641406a460 0x7f641406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.297+0000 7f6422ffd640 1 -- 172.21.15.113:0/2673420937 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f642c0898b0 con 0x7f64340b19e0 2023-12-19T13:52:26.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.297+0000 7f643259c640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f641406a460 0x7f641406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.298+0000 7f643259c640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f641406a460 0x7f641406c920 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f64340caad0 tx=0x7f6424009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:26.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.302+0000 7f6422ffd640 1 -- 172.21.15.113:0/2673420937 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f642c054da0 con 0x7f64340b19e0 2023-12-19T13:52:26.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.492+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6434061910 con 0x7f64340b19e0 2023-12-19T13:52:26.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.495+0000 7f6422ffd640 1 -- 172.21.15.113:0/2673420937 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16236 (secure 0 0 0) 0x7f642c018020 con 0x7f64340b19e0 2023-12-19T13:52:26.495 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:26.495 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":101,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:25.717926+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:51:19.312025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T13:51:20.596942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.3d","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:26.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.497+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f641406a460 msgr2=0x7f641406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.497+0000 7f6438c42640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f641406a460 0x7f641406c920 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f64340caad0 tx=0x7f6424009040 comp rx=0 tx=0).stop 2023-12-19T13:52:26.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.497+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64340b19e0 msgr2=0x7f64340b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.497+0000 7f6438c42640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64340b19e0 0x7f64340b4b80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f642c00efc0 tx=0x7f642c00c490 comp rx=0 tx=0).stop 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 shutdown_connections 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f641406a460 0x7f641406c920 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64340b19e0 0x7f64340b4b80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6434144f60 0x7f64340b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 --2- 172.21.15.113:0/2673420937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64341444b0 0x7f64341427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 >> 172.21.15.113:0/2673420937 conn(0x7f643406a2e0 msgr2=0x7f64340cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 shutdown_connections 2023-12-19T13:52:26.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.498+0000 7f6438c42640 1 -- 172.21.15.113:0/2673420937 wait complete. 2023-12-19T13:52:26.518 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:52:26.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.724+0000 7f204180e640 1 Processor -- start 2023-12-19T13:52:26.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.724+0000 7f204180e640 1 -- start start 2023-12-19T13:52:26.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.726+0000 7f204180e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f203c1449e0 0x7f203c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.726+0000 7f204180e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c06c6b0 0x7f203c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.726+0000 7f204180e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0afb10 con 0x7f203c0b0b50 2023-12-19T13:52:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.726+0000 7f204180e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c06bb30 con 0x7f203c1449e0 2023-12-19T13:52:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.726+0000 7f204180e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b0070 con 0x7f203c06c6b0 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.727+0000 7f203affd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f203c1449e0 0x7f203c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.727+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c06c6b0 0x7f203c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.727+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c06c6b0 0x7f203c0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:32966/0 (socket says 172.21.15.113:32966) 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.727+0000 7f203affd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f203c1449e0 0x7f203c0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:57798/0 (socket says 172.21.15.113:57798) 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.727+0000 7f203b7fe640 1 -- 172.21.15.113:0/2837816906 learned_addr learned my addr 172.21.15.113:0/2837816906 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.728+0000 7f203b7fe640 1 -- 172.21.15.113:0/2837816906 >> v2:172.21.15.151:3300/0 conn(0x7f203c1449e0 msgr2=0x7f203c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.728+0000 7f203b7fe640 1 --2- 172.21.15.113:0/2837816906 >> v2:172.21.15.151:3300/0 conn(0x7f203c1449e0 0x7f203c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.728+0000 7f203b7fe640 1 -- 172.21.15.113:0/2837816906 >> v1:172.21.15.151:6789/0 conn(0x7f203c0b0b50 legacy=0x7f203c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.728+0000 7f203b7fe640 1 -- 172.21.15.113:0/2837816906 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0b0350 con 0x7f203c06c6b0 2023-12-19T13:52:26.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.728+0000 7f203affd640 1 --2- 172.21.15.113:0/2837816906 >> v2:172.21.15.151:3300/0 conn(0x7f203c1449e0 0x7f203c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:52:26.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.729+0000 7f203b7fe640 1 --2- 172.21.15.113:0/2837816906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c06c6b0 0x7f203c0b1710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2034009e50 tx=0x7f203402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf49fde428676bd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:26.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.730+0000 7f2039ffb640 1 -- 172.21.15.113:0/2837816906 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203402cb00 con 0x7f203c06c6b0 2023-12-19T13:52:26.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.730+0000 7f2039ffb640 1 -- 172.21.15.113:0/2837816906 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203402cc60 con 0x7f203c06c6b0 2023-12-19T13:52:26.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.730+0000 7f2039ffb640 1 -- 172.21.15.113:0/2837816906 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340343f0 con 0x7f203c06c6b0 2023-12-19T13:52:26.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 -- 172.21.15.113:0/2837816906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c06c6b0 msgr2=0x7f203c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 --2- 172.21.15.113:0/2837816906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c06c6b0 0x7f203c0b1710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2034009e50 tx=0x7f203402bf60 comp rx=0 tx=0).stop 2023-12-19T13:52:26.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 -- 172.21.15.113:0/2837816906 shutdown_connections 2023-12-19T13:52:26.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 --2- 172.21.15.113:0/2837816906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c06c6b0 0x7f203c0b1710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 --2- 172.21.15.113:0/2837816906 >> v2:172.21.15.151:3300/0 conn(0x7f203c1449e0 0x7f203c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 -- 172.21.15.113:0/2837816906 >> 172.21.15.113:0/2837816906 conn(0x7f203c0cbb70 msgr2=0x7f203c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 -- 172.21.15.113:0/2837816906 shutdown_connections 2023-12-19T13:52:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.731+0000 7f204180e640 1 -- 172.21.15.113:0/2837816906 wait complete. 2023-12-19T13:52:26.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.733+0000 7f204180e640 1 Processor -- start 2023-12-19T13:52:26.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.733+0000 7f204180e640 1 -- start start 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f204180e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203c06c6b0 0x7f203c13b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f204180e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c0b0b50 0x7f203c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f204180e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f203c1449e0 0x7f203c15d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f204180e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c13c960 con 0x7f203c1449e0 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f204180e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c13ba10 con 0x7f203c06c6b0 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f204180e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c13bce0 con 0x7f203c0b0b50 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f203c1449e0 0x7f203c15d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f203c1449e0 0x7f203c15d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47680/0 (socket says 172.21.15.113:47680) 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.734+0000 7f203b7fe640 1 -- 172.21.15.113:0/642967497 learned_addr learned my addr 172.21.15.113:0/642967497 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203affd640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203c06c6b0 0x7f203c13b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203a7fc640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c0b0b50 0x7f203c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203b7fe640 1 -- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c0b0b50 msgr2=0x7f203c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203b7fe640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c0b0b50 0x7f203c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203b7fe640 1 -- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203c06c6b0 msgr2=0x7f203c13b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203b7fe640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203c06c6b0 0x7f203c13b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203b7fe640 1 -- 172.21.15.113:0/642967497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c009400 con 0x7f203c1449e0 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.735+0000 7f203b7fe640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f203c1449e0 0x7f203c15d100 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2034009e50 tx=0x7f2034004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.736+0000 7f2033fff640 1 -- 172.21.15.113:0/642967497 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203403e450 con 0x7f203c1449e0 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.736+0000 7f2033fff640 1 -- 172.21.15.113:0/642967497 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203403e5b0 con 0x7f203c1449e0 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.736+0000 7f2033fff640 1 -- 172.21.15.113:0/642967497 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203403e960 con 0x7f203c1449e0 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.736+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2034009b30 con 0x7f203c1449e0 2023-12-19T13:52:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.736+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c13c2a0 con 0x7f203c1449e0 2023-12-19T13:52:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.737+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c13caa0 con 0x7f203c1449e0 2023-12-19T13:52:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.738+0000 7f2033fff640 1 -- 172.21.15.113:0/642967497 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f203403eac0 con 0x7f203c1449e0 2023-12-19T13:52:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.739+0000 7f2033fff640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f201c06a430 0x7f201c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.739+0000 7f2033fff640 1 -- 172.21.15.113:0/642967497 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f20340ab600 con 0x7f203c1449e0 2023-12-19T13:52:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.739+0000 7f203affd640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f201c06a430 0x7f201c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.740+0000 7f203affd640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f201c06a430 0x7f201c06c8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f202c009bc0 tx=0x7f202c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:26.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.744+0000 7f2033fff640 1 -- 172.21.15.113:0/642967497 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f203c13caa0 con 0x7f203c1449e0 2023-12-19T13:52:26.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.972+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f203c13caa0 con 0x7f203c1449e0 2023-12-19T13:52:26.974 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:52:26.974+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:52:26.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.992+0000 7f2033fff640 1 -- 172.21.15.113:0/642967497 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f203c13caa0 con 0x7f203c1449e0 2023-12-19T13:52:26.993 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:52:26.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f201c06a430 msgr2=0x7f201c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f201c06a430 0x7f201c06c8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f202c009bc0 tx=0x7f202c008040 comp rx=0 tx=0).stop 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f203c1449e0 msgr2=0x7f203c15d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f203c1449e0 0x7f203c15d100 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2034009e50 tx=0x7f2034004a40 comp rx=0 tx=0).stop 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 shutdown_connections 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f201c06a430 0x7f201c06c8f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f203c1449e0 0x7f203c15d100 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203c0b0b50 0x7f203c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 --2- 172.21.15.113:0/642967497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203c06c6b0 0x7f203c13b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.995+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 >> 172.21.15.113:0/642967497 conn(0x7f203c0cbb70 msgr2=0x7f203c15add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.996+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 shutdown_connections 2023-12-19T13:52:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:26.996+0000 7f204180e640 1 -- 172.21.15.113:0/642967497 wait complete. 2023-12-19T13:52:27.013 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:52:27.108 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:52:27.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.221+0000 7f878e953640 1 Processor -- start 2023-12-19T13:52:27.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.222+0000 7f878e953640 1 -- start start 2023-12-19T13:52:27.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.223+0000 7f878e953640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8788155460 0x7f87880b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.223+0000 7f878e953640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 0x7f87880cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.223+0000 7f878e953640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878815c9c0 con 0x7f87880b0830 2023-12-19T13:52:27.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.223+0000 7f878e953640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87880b0ce0 con 0x7f8788155460 2023-12-19T13:52:27.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.223+0000 7f878e953640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878806d270 con 0x7f878806cc50 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.224+0000 7f878d150640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f87880b0830 0x7f878806c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44528/0 (socket says 172.21.15.113:44528) 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.224+0000 7f878d150640 1 -- 172.21.15.113:0/2872320760 learned_addr learned my addr 172.21.15.113:0/2872320760 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.224+0000 7f878e152640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 0x7f87880cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.224+0000 7f878d951640 1 --2- 172.21.15.113:0/2872320760 >> v2:172.21.15.151:3300/0 conn(0x7f8788155460 0x7f87880b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.224+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542942925 0 0) 0x7f878815c9c0 con 0x7f87880b0830 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.224+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8774003520 con 0x7f87880b0830 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3754573801 0 0) 0x7f8774003520 con 0x7f87880b0830 2023-12-19T13:52:27.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 msgr2=0x7f87880cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 0x7f87880cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 >> v2:172.21.15.151:3300/0 conn(0x7f8788155460 msgr2=0x7f87880b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 --2- 172.21.15.113:0/2872320760 >> v2:172.21.15.151:3300/0 conn(0x7f8788155460 0x7f87880b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878806d550 con 0x7f87880b0830 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8778001670 con 0x7f87880b0830 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 >> v1:172.21.15.113:6789/0 conn(0x7f87880b0830 legacy=0x7f878806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 0x7f87740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8774003fb0 0x7f87740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8774004d00 0x7f8774005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880b0ce0 con 0x7f8774004d00 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878806d270 con 0x7f8774003fb0 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877400ba00 con 0x7f878806cc50 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878e152640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8774004d00 0x7f8774005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878d951640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 0x7f87740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.225+0000 7f878d150640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8774003fb0 0x7f87740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.226+0000 7f878e152640 1 -- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 msgr2=0x7f87740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.226+0000 7f878e152640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 0x7f87740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.226+0000 7f878e152640 1 -- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8774003fb0 msgr2=0x7f87740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.226+0000 7f878e152640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8774003fb0 0x7f87740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.226+0000 7f878e152640 1 -- 172.21.15.113:0/2872320760 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774003520 con 0x7f8774004d00 2023-12-19T13:52:27.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.226+0000 7f878d951640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f878806cc50 0x7f87740039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:27.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.227+0000 7f878e152640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8774004d00 0x7f8774005180 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8780009fc0 tx=0x7f87740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3198139fa80100c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:27.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.227+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878002cbf0 con 0x7f8774004d00 2023-12-19T13:52:27.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.227+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878000f040 con 0x7f8774004d00 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.227+0000 7f878c94f640 1 -- 172.21.15.113:0/2872320760 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780034440 con 0x7f8774004d00 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.227+0000 7f878e953640 1 -- 172.21.15.113:0/2872320760 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8774004d00 msgr2=0x7f8774005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.227+0000 7f878e953640 1 --2- 172.21.15.113:0/2872320760 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8774004d00 0x7f8774005180 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8780009fc0 tx=0x7f87740057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.227+0000 7f878e152640 1 -- 172.21.15.113:0/2872320760 reap_dead start 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.228+0000 7f878e953640 1 -- 172.21.15.113:0/2872320760 shutdown_connections 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.228+0000 7f878e953640 1 -- 172.21.15.113:0/2872320760 >> 172.21.15.113:0/2872320760 conn(0x7f87880659a0 msgr2=0x7f8788065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.228+0000 7f878e953640 1 -- 172.21.15.113:0/2872320760 shutdown_connections 2023-12-19T13:52:27.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.228+0000 7f878e953640 1 -- 172.21.15.113:0/2872320760 wait complete. 2023-12-19T13:52:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.229+0000 7f878e953640 1 Processor -- start 2023-12-19T13:52:27.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.230+0000 7f878e953640 1 -- start start 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878e953640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774004d00 0x7f87881528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878e953640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87880ac8b0 0x7f878815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878e953640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f878815eaf0 0x7f8788156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878e953640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878815d110 con 0x7f87880ac8b0 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878e953640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8788152e10 con 0x7f878815eaf0 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878e953640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878815efa0 con 0x7f8774004d00 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87880ac8b0 0x7f878815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87880ac8b0 0x7f878815e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47706/0 (socket says 172.21.15.113:47706) 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 -- 172.21.15.113:0/563585889 learned_addr learned my addr 172.21.15.113:0/563585889 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d951640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774004d00 0x7f87881528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878e152640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f878815eaf0 0x7f8788156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 -- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774004d00 msgr2=0x7f87881528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774004d00 0x7f87881528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 -- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f878815eaf0 msgr2=0x7f8788156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f878815eaf0 0x7f8788156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.231+0000 7f878d150640 1 -- 172.21.15.113:0/563585889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880b2920 con 0x7f87880ac8b0 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.232+0000 7f878d150640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87880ac8b0 0x7f878815e5b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8778001200 tx=0x7f877800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.232+0000 7f877e7fc640 1 -- 172.21.15.113:0/563585889 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800c640 con 0x7f87880ac8b0 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.232+0000 7f877e7fc640 1 -- 172.21.15.113:0/563585889 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800c7a0 con 0x7f87880ac8b0 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.232+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878815cd50 con 0x7f87880ac8b0 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.232+0000 7f877e7fc640 1 -- 172.21.15.113:0/563585889 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800cb50 con 0x7f87880ac8b0 2023-12-19T13:52:27.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.232+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8788157b30 con 0x7f87880ac8b0 2023-12-19T13:52:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.233+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878815d250 con 0x7f87880ac8b0 2023-12-19T13:52:27.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.234+0000 7f877e7fc640 1 -- 172.21.15.113:0/563585889 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f877801d460 con 0x7f87880ac8b0 2023-12-19T13:52:27.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.236+0000 7f877e7fc640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876c06a430 0x7f876c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:27.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.236+0000 7f877e7fc640 1 -- 172.21.15.113:0/563585889 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f8778088b20 con 0x7f87880ac8b0 2023-12-19T13:52:27.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.236+0000 7f878d951640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876c06a430 0x7f876c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:27.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.236+0000 7f878d951640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876c06a430 0x7f876c06c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8784009a30 tx=0x7f8784008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:27.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.240+0000 7f877e7fc640 1 -- 172.21.15.113:0/563585889 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f878815d250 con 0x7f87880ac8b0 2023-12-19T13:52:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.448+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f878815d250 con 0x7f87880ac8b0 2023-12-19T13:52:27.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:27.998+0000 7f877e7fc640 1 -- 172.21.15.113:0/563585889 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f878815d250 con 0x7f87880ac8b0 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876c06a430 msgr2=0x7f876c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876c06a430 0x7f876c06c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8784009a30 tx=0x7f8784008040 comp rx=0 tx=0).stop 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87880ac8b0 msgr2=0x7f878815e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87880ac8b0 0x7f878815e5b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8778001200 tx=0x7f877800eb90 comp rx=0 tx=0).stop 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 shutdown_connections 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876c06a430 0x7f876c06c8f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f878815eaf0 0x7f8788156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87880ac8b0 0x7f878815e5b0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 --2- 172.21.15.113:0/563585889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774004d00 0x7f87881528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 >> 172.21.15.113:0/563585889 conn(0x7f87880659a0 msgr2=0x7f878806f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:28.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.002+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 shutdown_connections 2023-12-19T13:52:28.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.003+0000 7f878e953640 1 -- 172.21.15.113:0/563585889 wait complete. 2023-12-19T13:52:28.024 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:52:28.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.233+0000 7f77e5657640 1 Processor -- start 2023-12-19T13:52:28.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.233+0000 7f77e5657640 1 -- start start 2023-12-19T13:52:28.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77e5657640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77e0146800 0x7f77e00a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:28.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77e5657640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f77e00ac7b0 0x7f77e00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:28.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77e5657640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e0147060 con 0x7f77e00ab150 2023-12-19T13:52:28.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77e5657640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e0146be0 con 0x7f77e0146800 2023-12-19T13:52:28.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77e5657640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00ab710 con 0x7f77e00ac7b0 2023-12-19T13:52:28.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77deffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77e0146800 0x7f77e00a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:28.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77deffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77e0146800 0x7f77e00a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38820/0 (socket says 172.21.15.113:38820) 2023-12-19T13:52:28.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77deffd640 1 -- 172.21.15.113:0/2799858477 learned_addr learned my addr 172.21.15.113:0/2799858477 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:28.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.235+0000 7f77df7fe640 1 --2- 172.21.15.113:0/2799858477 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ac7b0 0x7f77e00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:28.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.236+0000 7f77deffd640 1 -- 172.21.15.113:0/2799858477 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ac7b0 msgr2=0x7f77e00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:28.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.236+0000 7f77deffd640 1 --2- 172.21.15.113:0/2799858477 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ac7b0 0x7f77e00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.236+0000 7f77deffd640 1 -- 172.21.15.113:0/2799858477 >> v1:172.21.15.151:6789/0 conn(0x7f77e00ab150 legacy=0x7f77e00a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:28.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.236+0000 7f77deffd640 1 -- 172.21.15.113:0/2799858477 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00ab9f0 con 0x7f77e0146800 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.237+0000 7f77deffd640 1 --2- 172.21.15.113:0/2799858477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e0146800 0x7f77e00a9400 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f77e0071ff0 tx=0x7f77d002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9b88bec5f0bb3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.237+0000 7f77ddffb640 1 -- 172.21.15.113:0/2799858477 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0031750 con 0x7f77e0146800 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.237+0000 7f77ddffb640 1 -- 172.21.15.113:0/2799858477 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00318b0 con 0x7f77e0146800 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.237+0000 7f77ddffb640 1 -- 172.21.15.113:0/2799858477 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0031c40 con 0x7f77e0146800 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 -- 172.21.15.113:0/2799858477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e0146800 msgr2=0x7f77e00a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 --2- 172.21.15.113:0/2799858477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e0146800 0x7f77e00a9400 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f77e0071ff0 tx=0x7f77d002b7f0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 -- 172.21.15.113:0/2799858477 shutdown_connections 2023-12-19T13:52:28.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 --2- 172.21.15.113:0/2799858477 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ac7b0 0x7f77e00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 --2- 172.21.15.113:0/2799858477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e0146800 0x7f77e00a9400 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 -- 172.21.15.113:0/2799858477 >> 172.21.15.113:0/2799858477 conn(0x7f77e006f5a0 msgr2=0x7f77e006f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 -- 172.21.15.113:0/2799858477 shutdown_connections 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.238+0000 7f77e5657640 1 -- 172.21.15.113:0/2799858477 wait complete. 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.240+0000 7f77e5657640 1 Processor -- start 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.240+0000 7f77e5657640 1 -- start start 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77e5657640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e00ab150 0x7f77e01f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77e5657640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ac7b0 0x7f77e013b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77e5657640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e0146800 0x7f77e015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:28.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77e5657640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01f40b0 con 0x7f77e00ab150 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77e5657640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01f3810 con 0x7f77e0146800 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77e5657640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01f3af0 con 0x7f77e00ac7b0 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77deffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e00ab150 0x7f77e01f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77deffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e00ab150 0x7f77e01f3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38824/0 (socket says 172.21.15.113:38824) 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77deffd640 1 -- 172.21.15.113:0/697594545 learned_addr learned my addr 172.21.15.113:0/697594545 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.241+0000 7f77deffd640 1 -- 172.21.15.113:0/697594545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ac7b0 msgr2=0x7f77e013b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77deffd640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ac7b0 0x7f77e013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77deffd640 1 -- 172.21.15.113:0/697594545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e0146800 msgr2=0x7f77e015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77df7fe640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e0146800 0x7f77e015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77deffd640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e0146800 0x7f77e015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:28.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77deffd640 1 -- 172.21.15.113:0/697594545 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094d0 con 0x7f77e00ab150 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77deffd640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e00ab150 0x7f77e01f3110 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000c00 tx=0x7f77d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77c77fe640 1 -- 172.21.15.113:0/697594545 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0033c80 con 0x7f77e00ab150 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77c77fe640 1 -- 172.21.15.113:0/697594545 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0033de0 con 0x7f77e00ab150 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77c77fe640 1 -- 172.21.15.113:0/697594545 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d003c640 con 0x7f77e00ab150 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.242+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e01f3dd0 con 0x7f77e00ab150 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.243+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e013be90 con 0x7f77e00ab150 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.243+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e013b290 con 0x7f77e00ab150 2023-12-19T13:52:28.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.244+0000 7f77c77fe640 1 -- 172.21.15.113:0/697594545 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77d003a040 con 0x7f77e00ab150 2023-12-19T13:52:28.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.245+0000 7f77c77fe640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77cc06a430 0x7f77cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:28.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.245+0000 7f77c77fe640 1 -- 172.21.15.113:0/697594545 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f77d00aa610 con 0x7f77e00ab150 2023-12-19T13:52:28.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.245+0000 7f77de7fc640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77cc06a430 0x7f77cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:28.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.246+0000 7f77de7fc640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77cc06a430 0x7f77cc06c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77e013c600 tx=0x7f77d4006ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:28.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.250+0000 7f77c77fe640 1 -- 172.21.15.113:0/697594545 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f77e013b290 con 0x7f77e00ab150 2023-12-19T13:52:28.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:28.436+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77e013b290 con 0x7f77e00ab150 2023-12-19T13:52:29.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.003+0000 7f77c77fe640 1 -- 172.21.15.113:0/697594545 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7f77e013b290 con 0x7f77e00ab150 2023-12-19T13:52:29.004 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:52:29.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.007+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77cc06a430 msgr2=0x7f77cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:29.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.007+0000 7f77e5657640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77cc06a430 0x7f77cc06c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77e013c600 tx=0x7f77d4006ba0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.007+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e00ab150 msgr2=0x7f77e01f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:29.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.007+0000 7f77e5657640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e00ab150 0x7f77e01f3110 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000c00 tx=0x7f77d00046c0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 shutdown_connections 2023-12-19T13:52:29.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f77cc06a430 0x7f77cc06c8f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e0146800 0x7f77e015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ac7b0 0x7f77e013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 --2- 172.21.15.113:0/697594545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e00ab150 0x7f77e01f3110 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 >> 172.21.15.113:0/697594545 conn(0x7f77e006f5a0 msgr2=0x7f77e00aa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:29.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 shutdown_connections 2023-12-19T13:52:29.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.008+0000 7f77e5657640 1 -- 172.21.15.113:0/697594545 wait complete. 2023-12-19T13:52:29.029 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:52:29.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.238+0000 7fc2c440b640 1 Processor -- start 2023-12-19T13:52:29.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.238+0000 7fc2c440b640 1 -- start start 2023-12-19T13:52:29.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.240+0000 7fc2c440b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2bc161130 0x7fc2bc143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.240+0000 7fc2c440b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1406a0 0x7fc2bc0b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.240+0000 7fc2c440b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2bc143c50 con 0x7fc2bc1402c0 2023-12-19T13:52:29.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.240+0000 7fc2c440b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2bc0b6760 con 0x7fc2bc161130 2023-12-19T13:52:29.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.240+0000 7fc2c440b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc141380 con 0x7fc2bc1406a0 2023-12-19T13:52:29.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.240+0000 7fc2c21a7640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc2bc1402c0 0x7fc2bc140c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54112/0 (socket says 172.21.15.113:54112) 2023-12-19T13:52:29.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.240+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2560692695 learned_addr learned my addr 172.21.15.113:0/2560692695 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:29.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053405957 0 0) 0x7fc2b8001110 con 0x7fc2bc1402c0 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a8003520 con 0x7fc2bc1402c0 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c19a6640 1 --2- 172.21.15.113:0/2560692695 >> v2:172.21.15.151:3300/0 conn(0x7fc2bc161130 0x7fc2bc143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c29a8640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1406a0 0x7fc2bc0b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986908884 0 0) 0x7fc2a8003520 con 0x7fc2bc1402c0 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1406a0 msgr2=0x7fc2bc0b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1406a0 0x7fc2bc0b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 >> v2:172.21.15.151:3300/0 conn(0x7fc2bc161130 msgr2=0x7fc2bc143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 --2- 172.21.15.113:0/2560692695 >> v2:172.21.15.151:3300/0 conn(0x7fc2bc161130 0x7fc2bc143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc15db40 con 0x7fc2bc1402c0 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc2b8001800 con 0x7fc2bc1402c0 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 >> v1:172.21.15.113:6789/0 conn(0x7fc2bc1402c0 legacy=0x7fc2bc140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1406a0 0x7fc2a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8004d00 0x7fc2a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc0b6760 con 0x7fc2a80039a0 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc141380 con 0x7fc2a8004d00 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a800bae0 con 0x7fc2bc1406a0 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.241+0000 7fc2c21a7640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.242+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1406a0 msgr2=0x7fc2a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.242+0000 7fc2c21a7640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1406a0 0x7fc2a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.242+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8004d00 msgr2=0x7fc2a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.242+0000 7fc2c29a8640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8004d00 0x7fc2a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.242+0000 7fc2c21a7640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8004d00 0x7fc2a8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.242+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2560692695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8003520 con 0x7fc2a80039a0 2023-12-19T13:52:29.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.243+0000 7fc2c21a7640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8007fa0 tx=0x7fc2a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb84e88737843b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.243+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8005ad0 con 0x7fc2a80039a0 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.243+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8005c30 con 0x7fc2a80039a0 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.243+0000 7fc2c11a5640 1 -- 172.21.15.113:0/2560692695 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b802c790 con 0x7fc2a80039a0 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.244+0000 7fc2c440b640 1 -- 172.21.15.113:0/2560692695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 msgr2=0x7fc2a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.244+0000 7fc2c440b640 1 --2- 172.21.15.113:0/2560692695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8007fa0 tx=0x7fc2a80057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.244+0000 7fc2c29a8640 1 -- 172.21.15.113:0/2560692695 reap_dead start 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.244+0000 7fc2c440b640 1 -- 172.21.15.113:0/2560692695 shutdown_connections 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.244+0000 7fc2c440b640 1 -- 172.21.15.113:0/2560692695 >> 172.21.15.113:0/2560692695 conn(0x7fc2bc065dc0 msgr2=0x7fc2bc0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.244+0000 7fc2c440b640 1 -- 172.21.15.113:0/2560692695 shutdown_connections 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.244+0000 7fc2c440b640 1 -- 172.21.15.113:0/2560692695 wait complete. 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.245+0000 7fc2c440b640 1 Processor -- start 2023-12-19T13:52:29.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.246+0000 7fc2c440b640 1 -- start start 2023-12-19T13:52:29.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.246+0000 7fc2c440b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2bc1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.246+0000 7fc2c440b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2bc1f37a0 0x7fc2bc1f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c440b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1f6810 0x7fc2bc06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c440b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc1f3380 con 0x7fc2a80039a0 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c440b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc1f2d00 con 0x7fc2bc1f37a0 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c440b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc1f6db0 con 0x7fc2bc1f6810 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2bc1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2bc1557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38846/0 (socket says 172.21.15.113:38846) 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2726162725 learned_addr learned my addr 172.21.15.113:0/2726162725 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c19a6640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2bc1f37a0 0x7fc2bc1f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2726162725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1f6810 msgr2=0x7fc2bc06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1f6810 0x7fc2bc06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2726162725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2bc1f37a0 msgr2=0x7fc2bc1f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2bc1f37a0 0x7fc2bc1f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.247+0000 7fc2c21a7640 1 -- 172.21.15.113:0/2726162725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc1f7090 con 0x7fc2a80039a0 2023-12-19T13:52:29.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.248+0000 7fc2c21a7640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2bc1557f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802c330 tx=0x7fc2bc15dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:29.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.248+0000 7fc2b2ffd640 1 -- 172.21.15.113:0/2726162725 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8039070 con 0x7fc2a80039a0 2023-12-19T13:52:29.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.248+0000 7fc2b2ffd640 1 -- 172.21.15.113:0/2726162725 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b802cba0 con 0x7fc2a80039a0 2023-12-19T13:52:29.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.248+0000 7fc2b2ffd640 1 -- 172.21.15.113:0/2726162725 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b803c040 con 0x7fc2a80039a0 2023-12-19T13:52:29.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.248+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc1f2fa0 con 0x7fc2a80039a0 2023-12-19T13:52:29.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.248+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc13f730 con 0x7fc2a80039a0 2023-12-19T13:52:29.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.249+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc1f35f0 con 0x7fc2a80039a0 2023-12-19T13:52:29.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.250+0000 7fc2b2ffd640 1 -- 172.21.15.113:0/2726162725 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc2b8032070 con 0x7fc2a80039a0 2023-12-19T13:52:29.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.251+0000 7fc2b2ffd640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2a006a430 0x7fc2a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:29.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.251+0000 7fc2b2ffd640 1 -- 172.21.15.113:0/2726162725 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fc2b80a99e0 con 0x7fc2a80039a0 2023-12-19T13:52:29.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.251+0000 7fc2c19a6640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2a006a430 0x7fc2a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:29.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.252+0000 7fc2c19a6640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2a006a430 0x7fc2a006c8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac006a90 tx=0x7fc2ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:29.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.256+0000 7fc2b2ffd640 1 -- 172.21.15.113:0/2726162725 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc2b80750e0 con 0x7fc2a80039a0 2023-12-19T13:52:29.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:29.445+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2bc143c50 con 0x7fc2a80039a0 2023-12-19T13:52:30.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.016+0000 7fc2b2ffd640 1 -- 172.21.15.113:0/2726162725 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc2bc143c50 con 0x7fc2a80039a0 2023-12-19T13:52:30.017 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:52:30.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2a006a430 msgr2=0x7fc2a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2a006a430 0x7fc2a006c8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac006a90 tx=0x7fc2ac008040 comp rx=0 tx=0).stop 2023-12-19T13:52:30.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 msgr2=0x7fc2bc1557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2bc1557f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802c330 tx=0x7fc2bc15dcd0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 shutdown_connections 2023-12-19T13:52:30.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2a006a430 0x7fc2a006c8f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2bc1f6810 0x7fc2bc06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2bc1f37a0 0x7fc2bc1f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 --2- 172.21.15.113:0/2726162725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2a80039a0 0x7fc2bc1557f0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.021+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 >> 172.21.15.113:0/2726162725 conn(0x7fc2bc065dc0 msgr2=0x7fc2bc15d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:30.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.022+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 shutdown_connections 2023-12-19T13:52:30.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.022+0000 7fc2c440b640 1 -- 172.21.15.113:0/2726162725 wait complete. 2023-12-19T13:52:30.041 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:52:30.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.249+0000 7efedabb9640 1 Processor -- start 2023-12-19T13:52:30.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.249+0000 7efedabb9640 1 -- start start 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efedabb9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed406e030 0x7efed40caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efedabb9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efed40ca120 0x7efed40cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efedabb9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efed40cdc50 0x7efed40b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efedabb9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed406e410 con 0x7efed40ca120 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efedabb9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40af760 con 0x7efed40cdc50 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efedabb9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40cb8e0 con 0x7efed406e030 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efed3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efed40ca120 0x7efed40cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efed3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efed40ca120 0x7efed40cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38856/0 (socket says 172.21.15.113:38856) 2023-12-19T13:52:30.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.251+0000 7efed3fff640 1 -- 172.21.15.113:0/2719023127 learned_addr learned my addr 172.21.15.113:0/2719023127 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:30.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.252+0000 7efed8955640 1 --2- 172.21.15.113:0/2719023127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed406e030 0x7efed40caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.252+0000 7efed3fff640 1 -- 172.21.15.113:0/2719023127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed406e030 msgr2=0x7efed40caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:30.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.252+0000 7efed3fff640 1 --2- 172.21.15.113:0/2719023127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed406e030 0x7efed40caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.252+0000 7efed3fff640 1 -- 172.21.15.113:0/2719023127 >> v2:172.21.15.151:3300/0 conn(0x7efed40cdc50 msgr2=0x7efed40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:30.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.252+0000 7efed3fff640 1 --2- 172.21.15.113:0/2719023127 >> v2:172.21.15.151:3300/0 conn(0x7efed40cdc50 0x7efed40b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.252+0000 7efed3fff640 1 -- 172.21.15.113:0/2719023127 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40aedc0 con 0x7efed40ca120 2023-12-19T13:52:30.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.253+0000 7efed3fff640 1 --2- 172.21.15.113:0/2719023127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed40cd710 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7efed40ae720 tx=0x7efecc02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36487ab6c7bfd8f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:30.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.254+0000 7efed37fe640 1 -- 172.21.15.113:0/2719023127 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0317d0 con 0x7efed40ca120 2023-12-19T13:52:30.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.254+0000 7efed37fe640 1 -- 172.21.15.113:0/2719023127 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc031930 con 0x7efed40ca120 2023-12-19T13:52:30.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.254+0000 7efed37fe640 1 -- 172.21.15.113:0/2719023127 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc031cc0 con 0x7efed40ca120 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.254+0000 7efedabb9640 1 -- 172.21.15.113:0/2719023127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 msgr2=0x7efed40cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.254+0000 7efedabb9640 1 --2- 172.21.15.113:0/2719023127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed40cd710 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7efed40ae720 tx=0x7efecc02b870 comp rx=0 tx=0).stop 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.254+0000 7efedabb9640 1 -- 172.21.15.113:0/2719023127 shutdown_connections 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.255+0000 7efedabb9640 1 --2- 172.21.15.113:0/2719023127 >> v2:172.21.15.151:3300/0 conn(0x7efed40cdc50 0x7efed40b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.255+0000 7efedabb9640 1 --2- 172.21.15.113:0/2719023127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed40cd710 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.255+0000 7efedabb9640 1 --2- 172.21.15.113:0/2719023127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed406e030 0x7efed40caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.255+0000 7efedabb9640 1 -- 172.21.15.113:0/2719023127 >> 172.21.15.113:0/2719023127 conn(0x7efed4066160 msgr2=0x7efed40cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:30.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.255+0000 7efedabb9640 1 -- 172.21.15.113:0/2719023127 shutdown_connections 2023-12-19T13:52:30.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.255+0000 7efedabb9640 1 -- 172.21.15.113:0/2719023127 wait complete. 2023-12-19T13:52:30.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.256+0000 7efedabb9640 1 Processor -- start 2023-12-19T13:52:30.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.257+0000 7efedabb9640 1 -- start start 2023-12-19T13:52:30.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.257+0000 7efedabb9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efed406e030 0x7efed40ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.257+0000 7efedabb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed41645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efedabb9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed40cdc50 0x7efed415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efedabb9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40ade60 con 0x7efed40ca120 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efedabb9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40aaa80 con 0x7efed406e030 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efedabb9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed4164330 con 0x7efed40cdc50 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed41645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed41645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38866/0 (socket says 172.21.15.113:38866) 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 -- 172.21.15.113:0/3432756740 learned_addr learned my addr 172.21.15.113:0/3432756740 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed8955640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efed406e030 0x7efed40ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed9156640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed40cdc50 0x7efed415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 -- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed40cdc50 msgr2=0x7efed415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed40cdc50 0x7efed415f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 -- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efed406e030 msgr2=0x7efed40ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efed406e030 0x7efed40ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.258+0000 7efed3fff640 1 -- 172.21.15.113:0/3432756740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0094d0 con 0x7efed40ca120 2023-12-19T13:52:30.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.259+0000 7efed3fff640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed41645a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.259+0000 7efed17fa640 1 -- 172.21.15.113:0/3432756740 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0328f0 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.259+0000 7efed17fa640 1 -- 172.21.15.113:0/3432756740 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc032a70 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.259+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed40ac890 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.259+0000 7efed17fa640 1 -- 172.21.15.113:0/3432756740 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc032e20 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.259+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4164050 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.260+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed40aca20 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.261+0000 7efed17fa640 1 -- 172.21.15.113:0/3432756740 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efecc030070 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.262+0000 7efed17fa640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efeb406a430 0x7efeb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.262+0000 7efed17fa640 1 -- 172.21.15.113:0/3432756740 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efecc0aa260 con 0x7efed40ca120 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.262+0000 7efed8955640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efeb406a430 0x7efeb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.263+0000 7efed8955640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efeb406a430 0x7efeb406c8f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efed406d130 tx=0x7efebc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:30.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.267+0000 7efed17fa640 1 -- 172.21.15.113:0/3432756740 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efecc075bf0 con 0x7efed40ca120 2023-12-19T13:52:30.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.454+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efed4061910 con 0x7efed40ca120 2023-12-19T13:52:30.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.463+0000 7efed17fa640 1 -- 172.21.15.113:0/3432756740 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7efecc079210 con 0x7efed40ca120 2023-12-19T13:52:30.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efeb406a430 msgr2=0x7efeb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efeb406a430 0x7efeb406c8f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efed406d130 tx=0x7efebc008040 comp rx=0 tx=0).stop 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 msgr2=0x7efed41645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed41645a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc0046c0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 shutdown_connections 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efeb406a430 0x7efeb406c8f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efed40cdc50 0x7efed415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efed40ca120 0x7efed41645a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 --2- 172.21.15.113:0/3432756740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efed406e030 0x7efed40ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 >> 172.21.15.113:0/3432756740 conn(0x7efed4066160 msgr2=0x7efed406f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 shutdown_connections 2023-12-19T13:52:30.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.466+0000 7efedabb9640 1 -- 172.21.15.113:0/3432756740 wait complete. 2023-12-19T13:52:30.486 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-19T13:52:30.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.703+0000 7f9e28118640 1 Processor -- start 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.703+0000 7f9e28118640 1 -- start start 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e28118640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e20157bf0 0x7f9e2015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e28118640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2015b740 con 0x7f9e200ae110 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e28118640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e200ae640 con 0x7f9e200b0810 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e28118640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2006b8c0 con 0x7f9e20157bf0 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e256b3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9e200ae110 0x7f9e200b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54124/0 (socket says 172.21.15.113:54124) 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e256b3640 1 -- 172.21.15.113:0/1940996146 learned_addr learned my addr 172.21.15.113:0/1940996146 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e25eb4640 1 --2- 172.21.15.113:0/1940996146 >> v2:172.21.15.151:3300/0 conn(0x7f9e20157bf0 0x7f9e2015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004326084 0 0) 0x7f9e2015b740 con 0x7f9e200ae110 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e0c003520 con 0x7f9e200ae110 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2414391911 0 0) 0x7f9e0c003520 con 0x7f9e200ae110 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 >> v2:172.21.15.151:3300/0 conn(0x7f9e20157bf0 msgr2=0x7f9e2015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 --2- 172.21.15.113:0/1940996146 >> v2:172.21.15.151:3300/0 conn(0x7f9e20157bf0 0x7f9e2015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 >> v1:172.21.15.151:6789/0 conn(0x7f9e200b0810 legacy=0x7f9e2006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200ae920 con 0x7f9e200ae110 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9e1c0019f0 con 0x7f9e200ae110 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 >> v1:172.21.15.113:6789/0 conn(0x7f9e200ae110 legacy=0x7f9e200b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0c0039e0 0x7f9e0c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c0047c0 0x7f9e0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c005180 0x7f9e0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2006b8c0 con 0x7f9e0c005180 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c00c0b0 con 0x7f9e0c0039e0 2023-12-19T13:52:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.705+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c00c270 con 0x7f9e0c0047c0 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e266b5640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c005180 0x7f9e0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e256b3640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c0047c0 0x7f9e0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e25eb4640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0c0039e0 0x7f9e0c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e266b5640 1 -- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c0047c0 msgr2=0x7f9e0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e266b5640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c0047c0 0x7f9e0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e266b5640 1 -- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0c0039e0 msgr2=0x7f9e0c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e266b5640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0c0039e0 0x7f9e0c003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e266b5640 1 -- 172.21.15.113:0/1940996146 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c003520 con 0x7f9e0c005180 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.706+0000 7f9e256b3640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c0047c0 0x7f9e0c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.707+0000 7f9e266b5640 1 -- 172.21.15.113:0/1940996146 reap_dead start 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.707+0000 7f9e266b5640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c005180 0x7f9e0c00b980 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f9e18001750 tx=0x7f9e0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cceac70b5fbbce82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.707+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e180052d0 con 0x7f9e0c005180 2023-12-19T13:52:30.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.707+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1802e050 con 0x7f9e0c005180 2023-12-19T13:52:30.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.707+0000 7f9e24eb2640 1 -- 172.21.15.113:0/1940996146 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18003830 con 0x7f9e0c005180 2023-12-19T13:52:30.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.708+0000 7f9e28118640 1 -- 172.21.15.113:0/1940996146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c005180 msgr2=0x7f9e0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.708+0000 7f9e28118640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c005180 0x7f9e0c00b980 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f9e18001750 tx=0x7f9e0c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.708+0000 7f9e28118640 1 -- 172.21.15.113:0/1940996146 shutdown_connections 2023-12-19T13:52:30.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.708+0000 7f9e28118640 1 --2- 172.21.15.113:0/1940996146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c005180 0x7f9e0c00b980 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.708+0000 7f9e28118640 1 -- 172.21.15.113:0/1940996146 >> 172.21.15.113:0/1940996146 conn(0x7f9e200cbb70 msgr2=0x7f9e200cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:30.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.708+0000 7f9e28118640 1 -- 172.21.15.113:0/1940996146 shutdown_connections 2023-12-19T13:52:30.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.708+0000 7f9e28118640 1 -- 172.21.15.113:0/1940996146 wait complete. 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.710+0000 7f9e28118640 1 Processor -- start 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.710+0000 7f9e28118640 1 -- start start 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e28118640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c005180 0x7f9e200cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e28118640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e20142370 0x7f9e2006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e28118640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e20143c60 0x7f9e2006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e28118640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20143840 con 0x7f9e20143c60 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e28118640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20142bc0 con 0x7f9e20142370 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e28118640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20142ea0 con 0x7f9e0c005180 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e266b5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e20143c60 0x7f9e2006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e266b5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e20143c60 0x7f9e2006e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38876/0 (socket says 172.21.15.113:38876) 2023-12-19T13:52:30.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e266b5640 1 -- 172.21.15.113:0/3871304883 learned_addr learned my addr 172.21.15.113:0/3871304883 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e266b5640 1 -- 172.21.15.113:0/3871304883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c005180 msgr2=0x7f9e200cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e266b5640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c005180 0x7f9e200cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e266b5640 1 -- 172.21.15.113:0/3871304883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e20142370 msgr2=0x7f9e2006dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.711+0000 7f9e266b5640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e20142370 0x7f9e2006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.712+0000 7f9e266b5640 1 -- 172.21.15.113:0/3871304883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20143180 con 0x7f9e20143c60 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.712+0000 7f9e266b5640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e20143c60 0x7f9e2006e130 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9e18005040 tx=0x7f9e18001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.712+0000 7f9e127fc640 1 -- 172.21.15.113:0/3871304883 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18039070 con 0x7f9e20143c60 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.712+0000 7f9e127fc640 1 -- 172.21.15.113:0/3871304883 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e18000ed0 con 0x7f9e20143c60 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.712+0000 7f9e127fc640 1 -- 172.21.15.113:0/3871304883 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1803e420 con 0x7f9e20143c60 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.712+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e20143460 con 0x7f9e20143c60 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.712+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2015d130 con 0x7f9e20143c60 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.714+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2015d320 con 0x7f9e20143c60 2023-12-19T13:52:30.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.714+0000 7f9e127fc640 1 -- 172.21.15.113:0/3871304883 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e1803e580 con 0x7f9e20143c60 2023-12-19T13:52:30.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.715+0000 7f9e127fc640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e0406a430 0x7f9e0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:30.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.715+0000 7f9e127fc640 1 -- 172.21.15.113:0/3871304883 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9e180a8850 con 0x7f9e20143c60 2023-12-19T13:52:30.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.715+0000 7f9e25eb4640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e0406a430 0x7f9e0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:30.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.716+0000 7f9e25eb4640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e0406a430 0x7f9e0406c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009950 tx=0x7f9e14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:30.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.720+0000 7f9e127fc640 1 -- 172.21.15.113:0/3871304883 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e18074140 con 0x7f9e20143c60 2023-12-19T13:52:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:30.975+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f9e20061910 con 0x7f9e20143c60 2023-12-19T13:52:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.018+0000 7f9e127fc640 1 -- 172.21.15.113:0/3871304883 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v306) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9e18077760 con 0x7f9e20143c60 2023-12-19T13:52:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e0406a430 msgr2=0x7f9e0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e0406a430 0x7f9e0406c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009950 tx=0x7f9e14008040 comp rx=0 tx=0).stop 2023-12-19T13:52:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e20143c60 msgr2=0x7f9e2006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e20143c60 0x7f9e2006e130 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9e18005040 tx=0x7f9e18001120 comp rx=0 tx=0).stop 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 shutdown_connections 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e0406a430 0x7f9e0406c8f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e20143c60 0x7f9e2006e130 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e20142370 0x7f9e2006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 --2- 172.21.15.113:0/3871304883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0c005180 0x7f9e200cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 >> 172.21.15.113:0/3871304883 conn(0x7f9e200cbb70 msgr2=0x7f9e200b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 shutdown_connections 2023-12-19T13:52:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.021+0000 7f9e28118640 1 -- 172.21.15.113:0/3871304883 wait complete. 2023-12-19T13:52:31.037 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-19T13:52:31.037 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T13:52:31.038 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:31.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.241+0000 7f3be7fff640 1 Processor -- start 2023-12-19T13:52:31.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.242+0000 7f3be7fff640 1 -- start start 2023-12-19T13:52:31.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.243+0000 7f3be7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3be815d280 0x7f3be80afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.243+0000 7f3be7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3be80b2970 0x7f3be8160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.243+0000 7f3be7fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be806e7f0 con 0x7f3be815d660 2023-12-19T13:52:31.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.243+0000 7f3be7fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80d02c0 con 0x7f3be80b2970 2023-12-19T13:52:31.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.243+0000 7f3be7fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be806e510 con 0x7f3be815d280 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3be80b2970 0x7f3be8160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be67fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3be815d660 0x7f3be80b2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54140/0 (socket says 172.21.15.113:54140) 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3be80b2970 0x7f3be8160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38884/0 (socket says 172.21.15.113:38884) 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be67fc640 1 -- 172.21.15.113:0/2450416841 learned_addr learned my addr 172.21.15.113:0/2450416841 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be6ffd640 1 --2- 172.21.15.113:0/2450416841 >> v2:172.21.15.151:3300/0 conn(0x7f3be815d280 0x7f3be80afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be77fe640 1 -- 172.21.15.113:0/2450416841 >> v2:172.21.15.151:3300/0 conn(0x7f3be815d280 msgr2=0x7f3be80afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be77fe640 1 --2- 172.21.15.113:0/2450416841 >> v2:172.21.15.151:3300/0 conn(0x7f3be815d280 0x7f3be80afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be77fe640 1 -- 172.21.15.113:0/2450416841 >> v1:172.21.15.113:6789/0 conn(0x7f3be815d660 legacy=0x7f3be80b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.244+0000 7f3be77fe640 1 -- 172.21.15.113:0/2450416841 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80d0560 con 0x7f3be80b2970 2023-12-19T13:52:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.245+0000 7f3be77fe640 1 --2- 172.21.15.113:0/2450416841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be80b2970 0x7f3be8160fc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f3be8072450 tx=0x7f3be002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4987a051a868a78 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.245+0000 7f3be5ffb640 1 -- 172.21.15.113:0/2450416841 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be002cbf0 con 0x7f3be80b2970 2023-12-19T13:52:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.245+0000 7f3be5ffb640 1 -- 172.21.15.113:0/2450416841 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be002cd50 con 0x7f3be80b2970 2023-12-19T13:52:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.245+0000 7f3be5ffb640 1 -- 172.21.15.113:0/2450416841 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0034660 con 0x7f3be80b2970 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 -- 172.21.15.113:0/2450416841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be80b2970 msgr2=0x7f3be8160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 --2- 172.21.15.113:0/2450416841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be80b2970 0x7f3be8160fc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f3be8072450 tx=0x7f3be002be40 comp rx=0 tx=0).stop 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 -- 172.21.15.113:0/2450416841 shutdown_connections 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 --2- 172.21.15.113:0/2450416841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be80b2970 0x7f3be8160fc0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 --2- 172.21.15.113:0/2450416841 >> v2:172.21.15.151:3300/0 conn(0x7f3be815d280 0x7f3be80afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 -- 172.21.15.113:0/2450416841 >> 172.21.15.113:0/2450416841 conn(0x7f3be806b8f0 msgr2=0x7f3be806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 -- 172.21.15.113:0/2450416841 shutdown_connections 2023-12-19T13:52:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.246+0000 7f3be7fff640 1 -- 172.21.15.113:0/2450416841 wait complete. 2023-12-19T13:52:31.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.248+0000 7f3be7fff640 1 Processor -- start 2023-12-19T13:52:31.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.248+0000 7f3be7fff640 1 -- start start 2023-12-19T13:52:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.249+0000 7f3be7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3be80b2970 0x7f3be8150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.249+0000 7f3be7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3be815d280 0x7f3be815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be815d660 0x7f3be80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be7fff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81f6f10 con 0x7f3be815d660 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be7fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81f6040 con 0x7f3be815d280 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be7fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be815cae0 con 0x7f3be80b2970 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be815d660 0x7f3be80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be815d660 0x7f3be80b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38900/0 (socket says 172.21.15.113:38900) 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 -- 172.21.15.113:0/714827937 learned_addr learned my addr 172.21.15.113:0/714827937 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 -- 172.21.15.113:0/714827937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3be80b2970 msgr2=0x7f3be8150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3be80b2970 0x7f3be8150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 -- 172.21.15.113:0/714827937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3be815d280 msgr2=0x7f3be815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3be815d280 0x7f3be815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 -- 172.21.15.113:0/714827937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0009a70 con 0x7f3be815d660 2023-12-19T13:52:31.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.250+0000 7f3be77fe640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be815d660 0x7f3be80b1630 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009e80 tx=0x7f3be0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.251+0000 7f3bdffff640 1 -- 172.21.15.113:0/714827937 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0040650 con 0x7f3be815d660 2023-12-19T13:52:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.251+0000 7f3bdffff640 1 -- 172.21.15.113:0/714827937 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00407d0 con 0x7f3be815d660 2023-12-19T13:52:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.251+0000 7f3bdffff640 1 -- 172.21.15.113:0/714827937 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0040b80 con 0x7f3be815d660 2023-12-19T13:52:31.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.251+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be81f6290 con 0x7f3be815d660 2023-12-19T13:52:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.251+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be81f6850 con 0x7f3be815d660 2023-12-19T13:52:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.252+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be80700e0 con 0x7f3be815d660 2023-12-19T13:52:31.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.253+0000 7f3bdffff640 1 -- 172.21.15.113:0/714827937 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3be0040ce0 con 0x7f3be815d660 2023-12-19T13:52:31.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.254+0000 7f3bdffff640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3bc806a430 0x7f3bc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.254+0000 7f3bdffff640 1 -- 172.21.15.113:0/714827937 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3be00ab4e0 con 0x7f3be815d660 2023-12-19T13:52:31.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.254+0000 7f3be6ffd640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3bc806a430 0x7f3bc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.255+0000 7f3be6ffd640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3bc806a430 0x7f3bc806c8f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80098f0 tx=0x7f3bd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:31.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.258+0000 7f3bdffff640 1 -- 172.21.15.113:0/714827937 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3be0076d30 con 0x7f3be815d660 2023-12-19T13:52:31.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.448+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3be8061910 con 0x7f3be815d660 2023-12-19T13:52:31.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.450+0000 7f3bdffff640 1 -- 172.21.15.113:0/714827937 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+12571 (secure 0 0 0) 0x7f3be007a350 con 0x7f3be815d660 2023-12-19T13:52:31.450 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:31.450 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":104,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:30.008910+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:6835/2704300841":"2023-12-20T13:52:26.974476+0000","172.21.15.151:6834/2704300841":"2023-12-20T13:52:26.974476+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3bc806a430 msgr2=0x7f3bc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3bc806a430 0x7f3bc806c8f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80098f0 tx=0x7f3bd8008040 comp rx=0 tx=0).stop 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be815d660 msgr2=0x7f3be80b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be815d660 0x7f3be80b1630 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009e80 tx=0x7f3be0004a40 comp rx=0 tx=0).stop 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 shutdown_connections 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3bc806a430 0x7f3bc806c8f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3be815d660 0x7f3be80b1630 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3be815d280 0x7f3be815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 --2- 172.21.15.113:0/714827937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3be80b2970 0x7f3be8150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.453+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 >> 172.21.15.113:0/714827937 conn(0x7f3be806b8f0 msgr2=0x7f3be80b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.454+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 shutdown_connections 2023-12-19T13:52:31.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.454+0000 7f3be7fff640 1 -- 172.21.15.113:0/714827937 wait complete. 2023-12-19T13:52:31.473 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:52:31.473 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:52:31.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.678+0000 7f5bd57d3640 1 Processor -- start 2023-12-19T13:52:31.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.679+0000 7f5bd57d3640 1 -- start start 2023-12-19T13:52:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.680+0000 7f5bd57d3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5bd015b1d0 0x7f5bd00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.680+0000 7f5bd57d3640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd015fde0 con 0x7f5bd00b1ec0 2023-12-19T13:52:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.680+0000 7f5bd57d3640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd015ef10 con 0x7f5bd00ceea0 2023-12-19T13:52:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.680+0000 7f5bd57d3640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd00b2320 con 0x7f5bd015b1d0 2023-12-19T13:52:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.680+0000 7f5bceffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5bd015b1d0 0x7f5bd00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.681+0000 7f5bceffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5bd015b1d0 0x7f5bd00b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38914/0 (socket says 172.21.15.113:38914) 2023-12-19T13:52:31.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.681+0000 7f5bceffd640 1 -- 172.21.15.113:0/434786155 learned_addr learned my addr 172.21.15.113:0/434786155 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.681+0000 7f5bceffd640 1 -- 172.21.15.113:0/434786155 >> v1:172.21.15.151:6789/0 conn(0x7f5bd00ceea0 legacy=0x7f5bd006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.681+0000 7f5bceffd640 1 -- 172.21.15.113:0/434786155 >> v1:172.21.15.113:6789/0 conn(0x7f5bd00b1ec0 legacy=0x7f5bd015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.681+0000 7f5bceffd640 1 -- 172.21.15.113:0/434786155 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd00b2e40 con 0x7f5bd015b1d0 2023-12-19T13:52:31.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.682+0000 7f5bceffd640 1 --2- 172.21.15.113:0/434786155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd015b1d0 0x7f5bd00b2760 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009870 tx=0x7f5bc002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba54a75f2e235b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.682+0000 7f5bce7fc640 1 -- 172.21.15.113:0/434786155 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0030860 con 0x7f5bd015b1d0 2023-12-19T13:52:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.682+0000 7f5bce7fc640 1 -- 172.21.15.113:0/434786155 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc00309c0 con 0x7f5bd015b1d0 2023-12-19T13:52:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.682+0000 7f5bce7fc640 1 -- 172.21.15.113:0/434786155 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0030d50 con 0x7f5bd015b1d0 2023-12-19T13:52:31.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.683+0000 7f5bd57d3640 1 -- 172.21.15.113:0/434786155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd015b1d0 msgr2=0x7f5bd00b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.683+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/434786155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd015b1d0 0x7f5bd00b2760 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009870 tx=0x7f5bc002b9a0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.683+0000 7f5bd57d3640 1 -- 172.21.15.113:0/434786155 shutdown_connections 2023-12-19T13:52:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.683+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/434786155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd015b1d0 0x7f5bd00b2760 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.683+0000 7f5bd57d3640 1 -- 172.21.15.113:0/434786155 >> 172.21.15.113:0/434786155 conn(0x7f5bd0073150 msgr2=0x7f5bd00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.683+0000 7f5bd57d3640 1 -- 172.21.15.113:0/434786155 shutdown_connections 2023-12-19T13:52:31.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.683+0000 7f5bd57d3640 1 -- 172.21.15.113:0/434786155 wait complete. 2023-12-19T13:52:31.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.685+0000 7f5bd57d3640 1 Processor -- start 2023-12-19T13:52:31.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.685+0000 7f5bd57d3640 1 -- start start 2023-12-19T13:52:31.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bd57d3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bd00b1ec0 0x7f5bd01f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bd57d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd00ceea0 0x7f5bd00c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bd57d3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bd015b1d0 0x7f5bd00c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bd57d3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd01f1700 con 0x7f5bd00ceea0 2023-12-19T13:52:31.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bd57d3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd00c42b0 con 0x7f5bd015b1d0 2023-12-19T13:52:31.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bd57d3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd00c4570 con 0x7f5bd00b1ec0 2023-12-19T13:52:31.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bc7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd00ceea0 0x7f5bd00c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bc7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd00ceea0 0x7f5bd00c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38924/0 (socket says 172.21.15.113:38924) 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.686+0000 7f5bc7fff640 1 -- 172.21.15.113:0/431821868 learned_addr learned my addr 172.21.15.113:0/431821868 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc7fff640 1 -- 172.21.15.113:0/431821868 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bd00b1ec0 msgr2=0x7f5bd01f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc7fff640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bd00b1ec0 0x7f5bd01f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc7fff640 1 -- 172.21.15.113:0/431821868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bd015b1d0 msgr2=0x7f5bd00c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bcf7fe640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bd015b1d0 0x7f5bd00c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc7fff640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bd015b1d0 0x7f5bd00c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc7fff640 1 -- 172.21.15.113:0/431821868 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00094d0 con 0x7f5bd00ceea0 2023-12-19T13:52:31.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc7fff640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd00ceea0 0x7f5bd00c5610 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c450 tx=0x7f5bb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:31.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc77fe640 1 -- 172.21.15.113:0/431821868 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80052d0 con 0x7f5bd00ceea0 2023-12-19T13:52:31.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc77fe640 1 -- 172.21.15.113:0/431821868 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8005430 con 0x7f5bd00ceea0 2023-12-19T13:52:31.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bc77fe640 1 -- 172.21.15.113:0/431821868 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8012870 con 0x7f5bd00ceea0 2023-12-19T13:52:31.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.687+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd00c4850 con 0x7f5bd00ceea0 2023-12-19T13:52:31.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.688+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd00c4e10 con 0x7f5bd00ceea0 2023-12-19T13:52:31.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.689+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd0061910 con 0x7f5bd00ceea0 2023-12-19T13:52:31.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.690+0000 7f5bc77fe640 1 -- 172.21.15.113:0/431821868 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5bb80129d0 con 0x7f5bd00ceea0 2023-12-19T13:52:31.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.691+0000 7f5bc77fe640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5bb006a430 0x7f5bb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:31.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.691+0000 7f5bc77fe640 1 -- 172.21.15.113:0/431821868 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5bb8088190 con 0x7f5bd00ceea0 2023-12-19T13:52:31.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.691+0000 7f5bceffd640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5bb006a430 0x7f5bb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:31.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.692+0000 7f5bceffd640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5bb006a430 0x7f5bb006c8f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0036000 tx=0x7f5bc003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:31.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.695+0000 7f5bc77fe640 1 -- 172.21.15.113:0/431821868 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5bb8053a70 con 0x7f5bd00ceea0 2023-12-19T13:52:31.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.883+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bd00cdc90 con 0x7f5bd00ceea0 2023-12-19T13:52:31.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.884+0000 7f5bc77fe640 1 -- 172.21.15.113:0/431821868 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bb8057090 con 0x7f5bd00ceea0 2023-12-19T13:52:31.884 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:52:31.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5bb006a430 msgr2=0x7f5bb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5bb006a430 0x7f5bb006c8f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0036000 tx=0x7f5bc003b040 comp rx=0 tx=0).stop 2023-12-19T13:52:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd00ceea0 msgr2=0x7f5bd00c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd00ceea0 0x7f5bd00c5610 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c450 tx=0x7f5bb800c910 comp rx=0 tx=0).stop 2023-12-19T13:52:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 shutdown_connections 2023-12-19T13:52:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5bb006a430 0x7f5bb006c8f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bd015b1d0 0x7f5bd00c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5bd00ceea0 0x7f5bd00c5610 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 --2- 172.21.15.113:0/431821868 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bd00b1ec0 0x7f5bd01f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:31.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 >> 172.21.15.113:0/431821868 conn(0x7f5bd0073150 msgr2=0x7f5bd01591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:31.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 shutdown_connections 2023-12-19T13:52:31.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:31.887+0000 7f5bd57d3640 1 -- 172.21.15.113:0/431821868 wait complete. 2023-12-19T13:52:31.906 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-19T13:52:32.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.106+0000 7fa8f89d2640 1 Processor -- start 2023-12-19T13:52:32.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.106+0000 7fa8f89d2640 1 -- start start 2023-12-19T13:52:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.108+0000 7fa8f89d2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b1710 0x7fa8f406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.108+0000 7fa8f89d2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f415e040 0x7fa8f415e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.108+0000 7fa8f89d2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f415e9c0 con 0x7fa8f4157aa0 2023-12-19T13:52:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.108+0000 7fa8f89d2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40b2600 con 0x7fa8f40b1710 2023-12-19T13:52:32.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.108+0000 7fa8f89d2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40b1d60 con 0x7fa8f415e040 2023-12-19T13:52:32.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.108+0000 7fa8f1d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b1710 0x7fa8f406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:32.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.108+0000 7fa8f2d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f415e040 0x7fa8f415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:32.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f1d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8f40b1710 0x7fa8f406e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:48022/0 (socket says 172.21.15.113:48022) 2023-12-19T13:52:32.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f1d9b640 1 -- 172.21.15.113:0/492841414 learned_addr learned my addr 172.21.15.113:0/492841414 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:32.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f2d9d640 1 --2- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f415e040 0x7fa8f415e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:54786/0 (socket says 172.21.15.113:54786) 2023-12-19T13:52:32.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f1d9b640 1 -- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f415e040 msgr2=0x7fa8f415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:32.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f1d9b640 1 --2- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f415e040 0x7fa8f415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:32.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f1d9b640 1 -- 172.21.15.113:0/492841414 >> v1:172.21.15.151:6789/0 conn(0x7fa8f4157aa0 legacy=0x7fa8f4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:32.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f1d9b640 1 -- 172.21.15.113:0/492841414 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40b2040 con 0x7fa8f40b1710 2023-12-19T13:52:32.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.109+0000 7fa8f2d9d640 1 --2- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f415e040 0x7fa8f415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:52:32.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.111+0000 7fa8f1d9b640 1 --2- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40b1710 0x7fa8f406e410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009e50 tx=0x7fa8dc02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d045992651805ec1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:32.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.111+0000 7fa8f159a640 1 -- 172.21.15.113:0/492841414 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc02cb00 con 0x7fa8f40b1710 2023-12-19T13:52:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.111+0000 7fa8f159a640 1 -- 172.21.15.113:0/492841414 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc02cc60 con 0x7fa8f40b1710 2023-12-19T13:52:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.111+0000 7fa8f159a640 1 -- 172.21.15.113:0/492841414 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0343f0 con 0x7fa8f40b1710 2023-12-19T13:52:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 -- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40b1710 msgr2=0x7fa8f406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40b1710 0x7fa8f406e410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009e50 tx=0x7fa8dc02bf60 comp rx=0 tx=0).stop 2023-12-19T13:52:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 -- 172.21.15.113:0/492841414 shutdown_connections 2023-12-19T13:52:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f415e040 0x7fa8f415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/492841414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f40b1710 0x7fa8f406e410 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 -- 172.21.15.113:0/492841414 >> 172.21.15.113:0/492841414 conn(0x7fa8f40cbb70 msgr2=0x7fa8f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 -- 172.21.15.113:0/492841414 shutdown_connections 2023-12-19T13:52:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.112+0000 7fa8f89d2640 1 -- 172.21.15.113:0/492841414 wait complete. 2023-12-19T13:52:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.114+0000 7fa8f89d2640 1 Processor -- start 2023-12-19T13:52:32.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.114+0000 7fa8f89d2640 1 -- start start 2023-12-19T13:52:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f89d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b1710 0x7fa8f4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f89d2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4157aa0 0x7fa8f415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f89d2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f415e040 0x7fa8f415a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:32.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f89d2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4159480 con 0x7fa8f40b1710 2023-12-19T13:52:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f89d2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f415ac80 con 0x7fa8f415e040 2023-12-19T13:52:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f89d2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f415f640 con 0x7fa8f4157aa0 2023-12-19T13:52:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b1710 0x7fa8f4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b1710 0x7fa8f4156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38938/0 (socket says 172.21.15.113:38938) 2023-12-19T13:52:32.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.115+0000 7fa8f259c640 1 -- 172.21.15.113:0/1616696832 learned_addr learned my addr 172.21.15.113:0/1616696832 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:32.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f259c640 1 -- 172.21.15.113:0/1616696832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4157aa0 msgr2=0x7fa8f415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:32.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f259c640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4157aa0 0x7fa8f415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:32.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f259c640 1 -- 172.21.15.113:0/1616696832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f415e040 msgr2=0x7fa8f415a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:32.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f259c640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f415e040 0x7fa8f415a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:32.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f259c640 1 -- 172.21.15.113:0/1616696832 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec009400 con 0x7fa8f40b1710 2023-12-19T13:52:32.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f259c640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b1710 0x7fa8f4156440 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c400 tx=0x7fa8e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:32.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8eaffd640 1 -- 172.21.15.113:0/1616696832 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40052d0 con 0x7fa8f40b1710 2023-12-19T13:52:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8eaffd640 1 -- 172.21.15.113:0/1616696832 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4005450 con 0x7fa8f40b1710 2023-12-19T13:52:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8eaffd640 1 -- 172.21.15.113:0/1616696832 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4007260 con 0x7fa8f40b1710 2023-12-19T13:52:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc009b30 con 0x7fa8f40b1710 2023-12-19T13:52:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.116+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f415af60 con 0x7fa8f40b1710 2023-12-19T13:52:32.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.117+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f415fb60 con 0x7fa8f40b1710 2023-12-19T13:52:32.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.118+0000 7fa8eaffd640 1 -- 172.21.15.113:0/1616696832 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa8e40073c0 con 0x7fa8f40b1710 2023-12-19T13:52:32.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.119+0000 7fa8eaffd640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:32.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.119+0000 7fa8eaffd640 1 -- 172.21.15.113:0/1616696832 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8e4087b00 con 0x7fa8f40b1710 2023-12-19T13:52:32.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.120+0000 7fa8f1d9b640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:32.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.120+0000 7fa8f1d9b640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc035000 tx=0x7fa8dc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:32.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.124+0000 7fa8eaffd640 1 -- 172.21.15.113:0/1616696832 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa8f415fb60 con 0x7fa8f40b1710 2023-12-19T13:52:32.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:32.381+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fa8f415fb60 con 0x7fa8f40b1710 2023-12-19T13:52:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.033+0000 7fa8eaffd640 1 -- 172.21.15.113:0/1616696832 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v308) v1 ==== 140+0+0 (secure 0 0 0) 0x7fa8f415fb60 con 0x7fa8f40b1710 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 msgr2=0x7fa8d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc035000 tx=0x7fa8dc02e000 comp rx=0 tx=0).stop 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b1710 msgr2=0x7fa8f4156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b1710 0x7fa8f4156440 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c400 tx=0x7fa8e400c8c0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 shutdown_connections 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa8d406a430 0x7fa8d406c8f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8f415e040 0x7fa8f415a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8f4157aa0 0x7fa8f415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 --2- 172.21.15.113:0/1616696832 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa8f40b1710 0x7fa8f4156440 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.036+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 >> 172.21.15.113:0/1616696832 conn(0x7fa8f40cbb70 msgr2=0x7fa8f415c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.037+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 shutdown_connections 2023-12-19T13:52:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.037+0000 7fa8f89d2640 1 -- 172.21.15.113:0/1616696832 wait complete. 2023-12-19T13:52:33.057 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T13:52:33.284 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_objectstore":"memstore"} 2023-12-19T13:52:33.284 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T13:52:33.284 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:52:33.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.506+0000 7f183eee5640 1 Processor -- start 2023-12-19T13:52:33.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.507+0000 7f183eee5640 1 -- start start 2023-12-19T13:52:33.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.508+0000 7f183eee5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f183815b040 0x7f18380ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.508+0000 7f183eee5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18380b2020 0x7f18380b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.508+0000 7f183eee5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18380cfc90 con 0x7f183815ebc0 2023-12-19T13:52:33.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.508+0000 7f183eee5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380b29f0 con 0x7f183815b040 2023-12-19T13:52:33.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.508+0000 7f183eee5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183815b420 con 0x7f18380b2020 2023-12-19T13:52:33.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.508+0000 7f183d6e2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f183815ebc0 0x7f18380b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54154/0 (socket says 172.21.15.113:54154) 2023-12-19T13:52:33.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.508+0000 7f183d6e2640 1 -- 172.21.15.113:0/1735044013 learned_addr learned my addr 172.21.15.113:0/1735044013 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:33.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183e6e4640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18380b2020 0x7f18380b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779908114 0 0) 0x7f18380cfc90 con 0x7f183815ebc0 2023-12-19T13:52:33.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1828003520 con 0x7f183815ebc0 2023-12-19T13:52:33.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183dee3640 1 --2- 172.21.15.113:0/1735044013 >> v2:172.21.15.151:3300/0 conn(0x7f183815b040 0x7f18380ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2608016897 0 0) 0x7f1828003520 con 0x7f183815ebc0 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18380b2020 msgr2=0x7f18380b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18380b2020 0x7f18380b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 >> v2:172.21.15.151:3300/0 conn(0x7f183815b040 msgr2=0x7f18380ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 --2- 172.21.15.113:0/1735044013 >> v2:172.21.15.151:3300/0 conn(0x7f183815b040 0x7f18380ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380cf080 con 0x7f183815ebc0 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1824001670 con 0x7f183815ebc0 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 >> v1:172.21.15.113:6789/0 conn(0x7f183815ebc0 legacy=0x7f18380b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.509+0000 7f183cee1640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1828003970 0x7f1828003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183cee1640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18280047c0 0x7f1828004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183cee1640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f182800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380b29f0 con 0x7f1828005180 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183815b420 con 0x7f18280047c0 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182800bfc0 con 0x7f1828003970 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183e6e4640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18380b2020 0x7f18380b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:33.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183e6e4640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f182800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183dee3640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1828003970 0x7f1828003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183d6e2640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18280047c0 0x7f1828004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183e6e4640 1 -- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1828003970 msgr2=0x7f1828003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:33.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183e6e4640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1828003970 0x7f1828003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183e6e4640 1 -- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18280047c0 msgr2=0x7f1828004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:33.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183e6e4640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18280047c0 0x7f1828004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.510+0000 7f183e6e4640 1 -- 172.21.15.113:0/1735044013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828003520 con 0x7f1828005180 2023-12-19T13:52:33.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.512+0000 7f183e6e4640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f182800b980 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f183806d220 tx=0x7f18280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8039543d66afdfb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:33.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.512+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830033600 con 0x7f1828005180 2023-12-19T13:52:33.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.512+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183002f050 con 0x7f1828005180 2023-12-19T13:52:33.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.512+0000 7f183cee1640 1 -- 172.21.15.113:0/1735044013 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830033980 con 0x7f1828005180 2023-12-19T13:52:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.512+0000 7f183eee5640 1 -- 172.21.15.113:0/1735044013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 msgr2=0x7f182800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.512+0000 7f183eee5640 1 --2- 172.21.15.113:0/1735044013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f182800b980 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f183806d220 tx=0x7f18280057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.512+0000 7f183e6e4640 1 -- 172.21.15.113:0/1735044013 reap_dead start 2023-12-19T13:52:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.513+0000 7f183eee5640 1 -- 172.21.15.113:0/1735044013 shutdown_connections 2023-12-19T13:52:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.513+0000 7f183eee5640 1 -- 172.21.15.113:0/1735044013 >> 172.21.15.113:0/1735044013 conn(0x7f1838071370 msgr2=0x7f1838071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.513+0000 7f183eee5640 1 -- 172.21.15.113:0/1735044013 shutdown_connections 2023-12-19T13:52:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.513+0000 7f183eee5640 1 -- 172.21.15.113:0/1735044013 wait complete. 2023-12-19T13:52:33.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.514+0000 7f183eee5640 1 Processor -- start 2023-12-19T13:52:33.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.515+0000 7f183eee5640 1 -- start start 2023-12-19T13:52:33.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183eee5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f18381f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183eee5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f183814e660 0x7f18380b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183eee5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18381f12f0 0x7f18381f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183eee5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381f0be0 con 0x7f1828005180 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183eee5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381f4710 con 0x7f183814e660 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183eee5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18381f4940 con 0x7f18381f12f0 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f18381f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f18381f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38954/0 (socket says 172.21.15.113:38954) 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 -- 172.21.15.113:0/854549021 learned_addr learned my addr 172.21.15.113:0/854549021 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183d6e2640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f183814e660 0x7f18380b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 -- 172.21.15.113:0/854549021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18381f12f0 msgr2=0x7f18381f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18381f12f0 0x7f18381f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 -- 172.21.15.113:0/854549021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f183814e660 msgr2=0x7f18380b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f183814e660 0x7f18380b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.516+0000 7f183dee3640 1 -- 172.21.15.113:0/854549021 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18381f4c20 con 0x7f1828005180 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.517+0000 7f183dee3640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f18381f41d0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f182c009cb0 tx=0x7f182c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.517+0000 7f18367fc640 1 -- 172.21.15.113:0/854549021 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c014610 con 0x7f1828005180 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.517+0000 7f18367fc640 1 -- 172.21.15.113:0/854549021 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c00f050 con 0x7f1828005180 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.517+0000 7f18367fc640 1 -- 172.21.15.113:0/854549021 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c014990 con 0x7f1828005180 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.517+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18381f4f00 con 0x7f1828005180 2023-12-19T13:52:33.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.517+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18380b5af0 con 0x7f1828005180 2023-12-19T13:52:33.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.518+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18380b5cb0 con 0x7f1828005180 2023-12-19T13:52:33.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.519+0000 7f18367fc640 1 -- 172.21.15.113:0/854549021 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f182c014af0 con 0x7f1828005180 2023-12-19T13:52:33.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.520+0000 7f18367fc640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f181c06a430 0x7f181c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.520+0000 7f18367fc640 1 -- 172.21.15.113:0/854549021 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f182c088df0 con 0x7f1828005180 2023-12-19T13:52:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.520+0000 7f183d6e2640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f181c06a430 0x7f181c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.521+0000 7f183d6e2640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f181c06a430 0x7f181c06c8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f183815c9e0 tx=0x7f1824001d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.526+0000 7f18367fc640 1 -- 172.21.15.113:0/854549021 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f182c054770 con 0x7f1828005180 2023-12-19T13:52:33.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.716+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f18381f50f0 con 0x7f1828005180 2023-12-19T13:52:33.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.722+0000 7f18367fc640 1 -- 172.21.15.113:0/854549021 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f182c003e40 con 0x7f1828005180 2023-12-19T13:52:33.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f181c06a430 msgr2=0x7f181c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f181c06a430 0x7f181c06c8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f183815c9e0 tx=0x7f1824001d70 comp rx=0 tx=0).stop 2023-12-19T13:52:33.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 msgr2=0x7f18381f41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:33.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f18381f41d0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f182c009cb0 tx=0x7f182c007700 comp rx=0 tx=0).stop 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 shutdown_connections 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f181c06a430 0x7f181c06c8f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18381f12f0 0x7f18381f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f183814e660 0x7f18380b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.724+0000 7f183eee5640 1 --2- 172.21.15.113:0/854549021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1828005180 0x7f18381f41d0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.725+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 >> 172.21.15.113:0/854549021 conn(0x7f1838071370 msgr2=0x7f18380cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.725+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 shutdown_connections 2023-12-19T13:52:33.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:33.725+0000 7f183eee5640 1 -- 172.21.15.113:0/854549021 wait complete. 2023-12-19T13:52:33.741 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:52:33.741 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:52:33.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:52:33.969 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:52:33.970 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:33.970 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:34.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:52:34.032 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:52:34.033 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:34.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:52:34.091 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:34.092 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:34.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:52:34.153 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:52:34.153 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:34.211 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:52:34.211 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:52:34.211 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:34.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.434+0000 7f8008134640 1 Processor -- start 2023-12-19T13:52:34.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.434+0000 7f8008134640 1 -- start start 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f8008134640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f80000b0b50 0x7f800006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f8008134640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f800006b590 0x7f800006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f8008134640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800006bb30 con 0x7f80001449e0 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f8008134640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000b0070 con 0x7f80000b0b50 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f8008134640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000b0350 con 0x7f800006b590 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f80056cf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f80000b0b50 0x7f800006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f80056cf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f80000b0b50 0x7f800006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38958/0 (socket says 172.21.15.113:38958) 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f80056cf640 1 -- 172.21.15.113:0/1608551425 learned_addr learned my addr 172.21.15.113:0/1608551425 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f80056cf640 1 -- 172.21.15.113:0/1608551425 >> v2:172.21.15.151:3300/0 conn(0x7f800006b590 msgr2=0x7f800006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f80056cf640 1 --2- 172.21.15.113:0/1608551425 >> v2:172.21.15.151:3300/0 conn(0x7f800006b590 0x7f800006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f80056cf640 1 -- 172.21.15.113:0/1608551425 >> v1:172.21.15.151:6789/0 conn(0x7f80001449e0 legacy=0x7f80000af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:34.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.436+0000 7f80056cf640 1 -- 172.21.15.113:0/1608551425 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000b0630 con 0x7f80000b0b50 2023-12-19T13:52:34.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.438+0000 7f80056cf640 1 --2- 172.21.15.113:0/1608551425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80000b0b50 0x7f800006bfa0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f80000b1270 tx=0x7f7ff002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80f5ff1f28d4b88 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:34.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.438+0000 7f8004ece640 1 -- 172.21.15.113:0/1608551425 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0031870 con 0x7f80000b0b50 2023-12-19T13:52:34.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.438+0000 7f8004ece640 1 -- 172.21.15.113:0/1608551425 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00319d0 con 0x7f80000b0b50 2023-12-19T13:52:34.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.438+0000 7f8004ece640 1 -- 172.21.15.113:0/1608551425 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0031d60 con 0x7f80000b0b50 2023-12-19T13:52:34.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.438+0000 7f8008134640 1 -- 172.21.15.113:0/1608551425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80000b0b50 msgr2=0x7f800006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.438+0000 7f8008134640 1 --2- 172.21.15.113:0/1608551425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80000b0b50 0x7f800006bfa0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f80000b1270 tx=0x7f7ff002b910 comp rx=0 tx=0).stop 2023-12-19T13:52:34.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.439+0000 7f8008134640 1 -- 172.21.15.113:0/1608551425 shutdown_connections 2023-12-19T13:52:34.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.439+0000 7f8008134640 1 --2- 172.21.15.113:0/1608551425 >> v2:172.21.15.151:3300/0 conn(0x7f800006b590 0x7f800006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.439+0000 7f8008134640 1 --2- 172.21.15.113:0/1608551425 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80000b0b50 0x7f800006bfa0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.439+0000 7f8008134640 1 -- 172.21.15.113:0/1608551425 >> 172.21.15.113:0/1608551425 conn(0x7f80000cbb70 msgr2=0x7f80000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:34.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.439+0000 7f8008134640 1 -- 172.21.15.113:0/1608551425 shutdown_connections 2023-12-19T13:52:34.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.439+0000 7f8008134640 1 -- 172.21.15.113:0/1608551425 wait complete. 2023-12-19T13:52:34.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.440+0000 7f8008134640 1 Processor -- start 2023-12-19T13:52:34.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.441+0000 7f8008134640 1 -- start start 2023-12-19T13:52:34.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8008134640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800006b590 0x7f80001f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8008134640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80000b0b50 0x7f80001413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8008134640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80001449e0 0x7f8000141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8008134640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80001408c0 con 0x7f80001449e0 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8008134640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000140d50 con 0x7f800006b590 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8008134640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800013fcb0 con 0x7f80000b0b50 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80001449e0 0x7f8000141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80001449e0 0x7f8000141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38974/0 (socket says 172.21.15.113:38974) 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 -- 172.21.15.113:0/1047089110 learned_addr learned my addr 172.21.15.113:0/1047089110 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8005ed0640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800006b590 0x7f80001f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 -- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80000b0b50 msgr2=0x7f80001413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80056cf640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80000b0b50 0x7f80001413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80000b0b50 0x7f80001413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 -- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800006b590 msgr2=0x7f80001f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800006b590 0x7f80001f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f80066d1640 1 -- 172.21.15.113:0/1047089110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00094d0 con 0x7f80001449e0 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.442+0000 7f8005ed0640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800006b590 0x7f80001f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.443+0000 7f80066d1640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80001449e0 0x7f8000141910 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800b9a0 tx=0x7f7ff800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.443+0000 7f7ff67fc640 1 -- 172.21.15.113:0/1047089110 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800cba0 con 0x7f80001449e0 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.443+0000 7f7ff67fc640 1 -- 172.21.15.113:0/1047089110 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800cd20 con 0x7f80001449e0 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.443+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800013ff90 con 0x7f80001449e0 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.443+0000 7f7ff67fc640 1 -- 172.21.15.113:0/1047089110 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8014680 con 0x7f80001449e0 2023-12-19T13:52:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.443+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000140550 con 0x7f80001449e0 2023-12-19T13:52:34.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.444+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000140a70 con 0x7f80001449e0 2023-12-19T13:52:34.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.445+0000 7f7ff67fc640 1 -- 172.21.15.113:0/1047089110 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ff801d3b0 con 0x7f80001449e0 2023-12-19T13:52:34.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.446+0000 7f7ff67fc640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7fe406a430 0x7f7fe406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.446+0000 7f7ff67fc640 1 -- 172.21.15.113:0/1047089110 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ff80885f0 con 0x7f80001449e0 2023-12-19T13:52:34.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.446+0000 7f8005ed0640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7fe406a430 0x7f7fe406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.447+0000 7f8005ed0640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7fe406a430 0x7f7fe406c8f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a810 tx=0x7f7ffc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:34.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.451+0000 7f7ff67fc640 1 -- 172.21.15.113:0/1047089110 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8000140a70 con 0x7f80001449e0 2023-12-19T13:52:34.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.677+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8000140a70 con 0x7f80001449e0 2023-12-19T13:52:34.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.677+0000 7f7ff67fc640 1 -- 172.21.15.113:0/1047089110 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f8000140a70 con 0x7f80001449e0 2023-12-19T13:52:34.677 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:34.677 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2702553498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2702553498},{"type":"v1","addr":"172.21.15.151:6833","nonce":2702553498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3306040109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3306040109},{"type":"v1","addr":"172.21.15.151:6835","nonce":3306040109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3041054708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3041054708},{"type":"v1","addr":"172.21.15.113:6836","nonce":3041054708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/2090100463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":2090100463},{"type":"v1","addr":"172.21.15.113:6837","nonce":2090100463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-12-19T13:52:34.677 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 43 2023-12-19T13:52:34.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7fe406a430 msgr2=0x7f7fe406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7fe406a430 0x7f7fe406c8f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a810 tx=0x7f7ffc008040 comp rx=0 tx=0).stop 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80001449e0 msgr2=0x7f8000141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80001449e0 0x7f8000141910 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800b9a0 tx=0x7f7ff800be60 comp rx=0 tx=0).stop 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 shutdown_connections 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7fe406a430 0x7f7fe406c8f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80001449e0 0x7f8000141910 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80000b0b50 0x7f80001413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 --2- 172.21.15.113:0/1047089110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800006b590 0x7f80001f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 >> 172.21.15.113:0/1047089110 conn(0x7f80000cbb70 msgr2=0x7f80000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 shutdown_connections 2023-12-19T13:52:34.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.680+0000 7f8008134640 1 -- 172.21.15.113:0/1047089110 wait complete. 2023-12-19T13:52:34.697 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:52:34.697 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:52:34.697 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:52:34.697 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:52:34.697 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:52:34.697 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:52:34.698 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:52:34.698 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:52:34.698 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:52:34.698 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:52:34.698 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:52:34.698 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:52:34.698 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:52:34.699 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:52:34.699 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:52:34.699 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:52:34.715 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:52:34.716 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:52:34.716 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:52:34.716 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:52:34.717 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:52:34.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:52:34.722 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:52:34.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:52:34.765 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:52:34.766 DEBUG:teuthology.parallel:result is None 2023-12-19T13:52:34.770 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:52:34.770 DEBUG:teuthology.parallel:result is None 2023-12-19T13:52:34.772 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:52:34.772 DEBUG:teuthology.parallel:result is None 2023-12-19T13:52:34.778 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:52:34.778 DEBUG:teuthology.parallel:result is None 2023-12-19T13:52:34.778 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:52:34.920 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:52:34.923 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:52:34.937 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:52:34.938 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:52:34.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.973+0000 7fc7d47d2640 1 Processor -- start 2023-12-19T13:52:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.973+0000 7fc7d47d2640 1 -- start start 2023-12-19T13:52:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.974+0000 7fc7d47d2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7cc15ddf0 0x7fc7cc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.974+0000 7fc7d47d2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 0x7fc7cc06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.974+0000 7fc7d47d2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc15e2a0 con 0x7fc7cc15b3c0 2023-12-19T13:52:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.974+0000 7fc7d47d2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc161510 con 0x7fc7cc15ddf0 2023-12-19T13:52:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.974+0000 7fc7d47d2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc15ed70 con 0x7fc7cc06f6a0 2023-12-19T13:52:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d256e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc7cc15b3c0 0x7fc7cc0cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54160/0 (socket says 172.21.15.113:54160) 2023-12-19T13:52:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d256e640 1 -- 172.21.15.113:0/3597807841 learned_addr learned my addr 172.21.15.113:0/3597807841 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568977099 0 0) 0x7fc7cc15e2a0 con 0x7fc7cc15b3c0 2023-12-19T13:52:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d1d6d640 1 --2- 172.21.15.113:0/3597807841 >> v2:172.21.15.151:3300/0 conn(0x7fc7cc15ddf0 0x7fc7cc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b8003520 con 0x7fc7cc15b3c0 2023-12-19T13:52:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d2d6f640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 0x7fc7cc06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2073475891 0 0) 0x7fc7b8003520 con 0x7fc7cc15b3c0 2023-12-19T13:52:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 msgr2=0x7fc7cc06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 0x7fc7cc06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 >> v2:172.21.15.151:3300/0 conn(0x7fc7cc15ddf0 msgr2=0x7fc7cc06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 --2- 172.21.15.113:0/3597807841 >> v2:172.21.15.151:3300/0 conn(0x7fc7cc15ddf0 0x7fc7cc06f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc15e4d0 con 0x7fc7cc15b3c0 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.975+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc7c8001670 con 0x7fc7cc15b3c0 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 >> v1:172.21.15.113:6789/0 conn(0x7fc7cc15b3c0 legacy=0x7fc7cc0cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d156c640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d156c640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b80047c0 0x7fc7b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d156c640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 0x7fc7b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc161510 con 0x7fc7b80039e0 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc15ed70 con 0x7fc7b80047c0 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b800b9d0 con 0x7fc7cc06f6a0 2023-12-19T13:52:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d256e640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d1d6d640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b80047c0 0x7fc7b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d2d6f640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 0x7fc7b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d256e640 1 -- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 msgr2=0x7fc7b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d256e640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc06f6a0 0x7fc7b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d256e640 1 -- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b80047c0 msgr2=0x7fc7b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d256e640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7b80047c0 0x7fc7b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.976+0000 7fc7d256e640 1 -- 172.21.15.113:0/3597807841 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8003520 con 0x7fc7b80039e0 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.977+0000 7fc7d256e640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7b8003e00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c140 tx=0x7fc7b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b41d7b8b26d7b18 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8005ad0 con 0x7fc7b80039e0 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8005c50 con 0x7fc7b80039e0 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d156c640 1 -- 172.21.15.113:0/3597807841 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c802c810 con 0x7fc7b80039e0 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d47d2640 1 -- 172.21.15.113:0/3597807841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 msgr2=0x7fc7b8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d47d2640 1 --2- 172.21.15.113:0/3597807841 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7b8003e00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c140 tx=0x7fc7b80057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d2d6f640 1 -- 172.21.15.113:0/3597807841 reap_dead start 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d47d2640 1 -- 172.21.15.113:0/3597807841 shutdown_connections 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d47d2640 1 -- 172.21.15.113:0/3597807841 >> 172.21.15.113:0/3597807841 conn(0x7fc7cc0d01a0 msgr2=0x7fc7cc0d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d47d2640 1 -- 172.21.15.113:0/3597807841 shutdown_connections 2023-12-19T13:52:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.978+0000 7fc7d47d2640 1 -- 172.21.15.113:0/3597807841 wait complete. 2023-12-19T13:52:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.980+0000 7fc7d47d2640 1 Processor -- start 2023-12-19T13:52:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.980+0000 7fc7d47d2640 1 -- start start 2023-12-19T13:52:34.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d47d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7cc155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d47d2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc0ccc80 0x7fc7cc157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d47d2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7cc150a80 0x7fc7cc06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d47d2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0cdce0 con 0x7fc7b80039e0 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d47d2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc1514f0 con 0x7fc7cc150a80 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d47d2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc1580f0 con 0x7fc7cc0ccc80 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d256e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7cc155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d256e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7cc155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39036/0 (socket says 172.21.15.113:39036) 2023-12-19T13:52:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.981+0000 7fc7d256e640 1 -- 172.21.15.113:0/1709835341 learned_addr learned my addr 172.21.15.113:0/1709835341 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d1d6d640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc0ccc80 0x7fc7cc157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d2d6f640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7cc150a80 0x7fc7cc06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d256e640 1 -- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc0ccc80 msgr2=0x7fc7cc157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d256e640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc0ccc80 0x7fc7cc157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d256e640 1 -- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7cc150a80 msgr2=0x7fc7cc06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d256e640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7cc150a80 0x7fc7cc06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d256e640 1 -- 172.21.15.113:0/1709835341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0cd160 con 0x7fc7b80039e0 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d1d6d640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc0ccc80 0x7fc7cc157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d2d6f640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7cc150a80 0x7fc7cc06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d256e640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7cc155000 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c0e0 tx=0x7fc7c8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7c2ffd640 1 -- 172.21.15.113:0/1709835341 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c803c040 con 0x7fc7b80039e0 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7c2ffd640 1 -- 172.21.15.113:0/1709835341 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c802cc20 con 0x7fc7b80039e0 2023-12-19T13:52:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7c2ffd640 1 -- 172.21.15.113:0/1709835341 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8007070 con 0x7fc7b80039e0 2023-12-19T13:52:34.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.982+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0cd440 con 0x7fc7b80039e0 2023-12-19T13:52:34.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.983+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc0cda00 con 0x7fc7b80039e0 2023-12-19T13:52:34.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.984+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc061910 con 0x7fc7b80039e0 2023-12-19T13:52:34.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.985+0000 7fc7c2ffd640 1 -- 172.21.15.113:0/1709835341 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc7c8032070 con 0x7fc7b80039e0 2023-12-19T13:52:34.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.985+0000 7fc7c2ffd640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc7b006a460 0x7fc7b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:34.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.986+0000 7fc7c2ffd640 1 -- 172.21.15.113:0/1709835341 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc7c80a9c50 con 0x7fc7b80039e0 2023-12-19T13:52:34.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.986+0000 7fc7d1d6d640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc7b006a460 0x7fc7b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:34.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.986+0000 7fc7d1d6d640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc7b006a460 0x7fc7b006c920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0cbf40 tx=0x7fc7bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:34.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:34.990+0000 7fc7c2ffd640 1 -- 172.21.15.113:0/1709835341 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc7c8075410 con 0x7fc7b80039e0 2023-12-19T13:52:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:35.185+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc7cc1e66b0 con 0x7fc7b80039e0 2023-12-19T13:52:36.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.058+0000 7fc7c2ffd640 1 -- 172.21.15.113:0/1709835341 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc7c8046030 con 0x7fc7b80039e0 2023-12-19T13:52:36.057 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:52:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.061+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc7b006a460 msgr2=0x7fc7b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.061+0000 7fc7d47d2640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc7b006a460 0x7fc7b006c920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0cbf40 tx=0x7fc7bc008040 comp rx=0 tx=0).stop 2023-12-19T13:52:36.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.061+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 msgr2=0x7fc7cc155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.061+0000 7fc7d47d2640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7cc155000 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c0e0 tx=0x7fc7c8001930 comp rx=0 tx=0).stop 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 shutdown_connections 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc7b006a460 0x7fc7b006c920 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7cc150a80 0x7fc7cc06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7cc0ccc80 0x7fc7cc157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 --2- 172.21.15.113:0/1709835341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b80039e0 0x7fc7cc155000 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 >> 172.21.15.113:0/1709835341 conn(0x7fc7cc0d01a0 msgr2=0x7fc7cc15c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 shutdown_connections 2023-12-19T13:52:36.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.062+0000 7fc7d47d2640 1 -- 172.21.15.113:0/1709835341 wait complete. 2023-12-19T13:52:36.083 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:52:36.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.291+0000 7f87eba7d640 1 Processor -- start 2023-12-19T13:52:36.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.291+0000 7f87eba7d640 1 -- start start 2023-12-19T13:52:36.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.292+0000 7f87eba7d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f87e41449e0 0x7f87e40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87eba7d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e406c6b0 0x7f87e40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87eba7d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e40afb10 con 0x7f87e40b0b50 2023-12-19T13:52:36.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87eba7d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e406bb30 con 0x7f87e41449e0 2023-12-19T13:52:36.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87eba7d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40b0070 con 0x7f87e406c6b0 2023-12-19T13:52:36.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87ea01a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e406c6b0 0x7f87e40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87e9819640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f87e41449e0 0x7f87e40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87ea01a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e406c6b0 0x7f87e40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:54900/0 (socket says 172.21.15.113:54900) 2023-12-19T13:52:36.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.293+0000 7f87ea01a640 1 -- 172.21.15.113:0/2209971579 learned_addr learned my addr 172.21.15.113:0/2209971579 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:36.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.294+0000 7f87ea01a640 1 -- 172.21.15.113:0/2209971579 >> v2:172.21.15.151:3300/0 conn(0x7f87e41449e0 msgr2=0x7f87e40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:36.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.294+0000 7f87ea01a640 1 --2- 172.21.15.113:0/2209971579 >> v2:172.21.15.151:3300/0 conn(0x7f87e41449e0 0x7f87e40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.294+0000 7f87ea01a640 1 -- 172.21.15.113:0/2209971579 >> v1:172.21.15.151:6789/0 conn(0x7f87e40b0b50 legacy=0x7f87e406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.294+0000 7f87ea01a640 1 -- 172.21.15.113:0/2209971579 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40b0350 con 0x7f87e406c6b0 2023-12-19T13:52:36.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.295+0000 7f87ea01a640 1 --2- 172.21.15.113:0/2209971579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e406c6b0 0x7f87e40b1710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009870 tx=0x7f87dc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eddc651089a8da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:36.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.296+0000 7f87e8817640 1 -- 172.21.15.113:0/2209971579 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc030840 con 0x7f87e406c6b0 2023-12-19T13:52:36.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.296+0000 7f87e8817640 1 -- 172.21.15.113:0/2209971579 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc0309a0 con 0x7f87e406c6b0 2023-12-19T13:52:36.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.296+0000 7f87e8817640 1 -- 172.21.15.113:0/2209971579 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc030d30 con 0x7f87e406c6b0 2023-12-19T13:52:36.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.296+0000 7f87eba7d640 1 -- 172.21.15.113:0/2209971579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e406c6b0 msgr2=0x7f87e40b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.296+0000 7f87eba7d640 1 --2- 172.21.15.113:0/2209971579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e406c6b0 0x7f87e40b1710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009870 tx=0x7f87dc02b980 comp rx=0 tx=0).stop 2023-12-19T13:52:36.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.297+0000 7f87eba7d640 1 -- 172.21.15.113:0/2209971579 shutdown_connections 2023-12-19T13:52:36.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.297+0000 7f87eba7d640 1 --2- 172.21.15.113:0/2209971579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e406c6b0 0x7f87e40b1710 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.297+0000 7f87eba7d640 1 --2- 172.21.15.113:0/2209971579 >> v2:172.21.15.151:3300/0 conn(0x7f87e41449e0 0x7f87e40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.297+0000 7f87eba7d640 1 -- 172.21.15.113:0/2209971579 >> 172.21.15.113:0/2209971579 conn(0x7f87e40cbb70 msgr2=0x7f87e40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:36.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.297+0000 7f87eba7d640 1 -- 172.21.15.113:0/2209971579 shutdown_connections 2023-12-19T13:52:36.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.297+0000 7f87eba7d640 1 -- 172.21.15.113:0/2209971579 wait complete. 2023-12-19T13:52:36.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.298+0000 7f87eba7d640 1 Processor -- start 2023-12-19T13:52:36.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.299+0000 7f87eba7d640 1 -- start start 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.299+0000 7f87eba7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87e406c6b0 0x7f87e4159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87eba7d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e40b0b50 0x7f87e413a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87eba7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41449e0 0x7f87e4143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87eba7d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4159990 con 0x7f87e406c6b0 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87eba7d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e41577c0 con 0x7f87e41449e0 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87eba7d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4157aa0 con 0x7f87e40b0b50 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87e406c6b0 0x7f87e4159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87e406c6b0 0x7f87e4159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39050/0 (socket says 172.21.15.113:39050) 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 -- 172.21.15.113:0/3035869331 learned_addr learned my addr 172.21.15.113:0/3035869331 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:36.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9018640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e40b0b50 0x7f87e413a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87ea01a640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41449e0 0x7f87e4143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 -- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e40b0b50 msgr2=0x7f87e413a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e40b0b50 0x7f87e413a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 -- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41449e0 msgr2=0x7f87e4143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41449e0 0x7f87e4143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87e9819640 1 -- 172.21.15.113:0/3035869331 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0094d0 con 0x7f87e406c6b0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.300+0000 7f87ea01a640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41449e0 0x7f87e4143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.301+0000 7f87e9819640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87e406c6b0 0x7f87e4159450 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f87e000efc0 tx=0x7f87e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.301+0000 7f87da7fc640 1 -- 172.21.15.113:0/3035869331 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0009b80 con 0x7f87e406c6b0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.301+0000 7f87da7fc640 1 -- 172.21.15.113:0/3035869331 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000f040 con 0x7f87e406c6b0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.301+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e4157d80 con 0x7f87e406c6b0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.301+0000 7f87da7fc640 1 -- 172.21.15.113:0/3035869331 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00146a0 con 0x7f87e406c6b0 2023-12-19T13:52:36.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.301+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e4158340 con 0x7f87e406c6b0 2023-12-19T13:52:36.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.302+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e4061910 con 0x7f87e406c6b0 2023-12-19T13:52:36.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.303+0000 7f87da7fc640 1 -- 172.21.15.113:0/3035869331 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87e0014800 con 0x7f87e406c6b0 2023-12-19T13:52:36.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.304+0000 7f87da7fc640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87c806a430 0x7f87c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.304+0000 7f87da7fc640 1 -- 172.21.15.113:0/3035869331 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f87e0089490 con 0x7f87e406c6b0 2023-12-19T13:52:36.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.304+0000 7f87e9018640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87c806a430 0x7f87c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.305+0000 7f87e9018640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87c806a430 0x7f87c806c8f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f87e406b6b0 tx=0x7f87d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:36.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.308+0000 7f87da7fc640 1 -- 172.21.15.113:0/3035869331 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87e0054d30 con 0x7f87e406c6b0 2023-12-19T13:52:36.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.565+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f87e40ae560 con 0x7f87e406c6b0 2023-12-19T13:52:36.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.566+0000 7f87da7fc640 1 -- 172.21.15.113:0/3035869331 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f87e0058350 con 0x7f87e406c6b0 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.566 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.568 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.569 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:52:36.571 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.572 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.573 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.574 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:52:36.575 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:52:36.576 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:52:36.578 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:52:36.579 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.580 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:36.581 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:52:36.581 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:52:36.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.568+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87c806a430 msgr2=0x7f87c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.568+0000 7f87eba7d640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87c806a430 0x7f87c806c8f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f87e406b6b0 tx=0x7f87d4009040 comp rx=0 tx=0).stop 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.568+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87e406c6b0 msgr2=0x7f87e4159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.568+0000 7f87eba7d640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87e406c6b0 0x7f87e4159450 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f87e000efc0 tx=0x7f87e000c490 comp rx=0 tx=0).stop 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 shutdown_connections 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87c806a430 0x7f87c806c8f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41449e0 0x7f87e4143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e40b0b50 0x7f87e413a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 --2- 172.21.15.113:0/3035869331 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87e406c6b0 0x7f87e4159450 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 >> 172.21.15.113:0/3035869331 conn(0x7f87e40cbb70 msgr2=0x7f87e40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 shutdown_connections 2023-12-19T13:52:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.569+0000 7f87eba7d640 1 -- 172.21.15.113:0/3035869331 wait complete. 2023-12-19T13:52:36.586 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:36.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.788+0000 7fd701b9f640 1 Processor -- start 2023-12-19T13:52:36.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.788+0000 7fd701b9f640 1 -- start start 2023-12-19T13:52:36.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd701b9f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd6fc0d2b00 0x7fd6fc0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd701b9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd701b9f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc0cd840 con 0x7fd6fc146e10 2023-12-19T13:52:36.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd701b9f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0d2430 con 0x7fd6fc0d2b00 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd701b9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0ceac0 con 0x7fd6fc0ce110 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd6f3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd6fc0d2b00 0x7fd6fc0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd6f3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd6fc0d2b00 0x7fd6fc0d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39058/0 (socket says 172.21.15.113:39058) 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.790+0000 7fd6f3fff640 1 -- 172.21.15.113:0/3413354579 learned_addr learned my addr 172.21.15.113:0/3413354579 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.791+0000 7fd6f3fff640 1 -- 172.21.15.113:0/3413354579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 msgr2=0x7fd6fc0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.791+0000 7fd6f3fff640 1 --2- 172.21.15.113:0/3413354579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.791+0000 7fd6f3fff640 1 -- 172.21.15.113:0/3413354579 >> v1:172.21.15.113:6789/0 conn(0x7fd6fc146e10 legacy=0x7fd6fc0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.791+0000 7fd6f3fff640 1 -- 172.21.15.113:0/3413354579 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0b6e90 con 0x7fd6fc0d2b00 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.792+0000 7fd6f3fff640 1 --2- 172.21.15.113:0/3413354579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc0d1ef0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40098a0 tx=0x7fd6e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334e5f09ef4a4ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.792+0000 7fd6faffd640 1 -- 172.21.15.113:0/3413354579 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4030840 con 0x7fd6fc0d2b00 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.792+0000 7fd6faffd640 1 -- 172.21.15.113:0/3413354579 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40309a0 con 0x7fd6fc0d2b00 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.792+0000 7fd6faffd640 1 -- 172.21.15.113:0/3413354579 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4030d30 con 0x7fd6fc0d2b00 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 -- 172.21.15.113:0/3413354579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc0d2b00 msgr2=0x7fd6fc0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 --2- 172.21.15.113:0/3413354579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc0d1ef0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40098a0 tx=0x7fd6e402b980 comp rx=0 tx=0).stop 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 -- 172.21.15.113:0/3413354579 shutdown_connections 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 --2- 172.21.15.113:0/3413354579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 --2- 172.21.15.113:0/3413354579 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc0d1ef0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 -- 172.21.15.113:0/3413354579 >> 172.21.15.113:0/3413354579 conn(0x7fd6fc0b29c0 msgr2=0x7fd6fc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:36.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 -- 172.21.15.113:0/3413354579 shutdown_connections 2023-12-19T13:52:36.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.793+0000 7fd701b9f640 1 -- 172.21.15.113:0/3413354579 wait complete. 2023-12-19T13:52:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.794+0000 7fd701b9f640 1 Processor -- start 2023-12-19T13:52:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.795+0000 7fd701b9f640 1 -- start start 2023-12-19T13:52:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.795+0000 7fd701b9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc13e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.795+0000 7fd701b9f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc15c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.795+0000 7fd701b9f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc146e10 0x7fd6fc141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.795+0000 7fd701b9f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc140e80 con 0x7fd6fc146e10 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.795+0000 7fd701b9f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc15cc30 con 0x7fd6fc0d2b00 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.795+0000 7fd701b9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc13e9a0 con 0x7fd6fc0ce110 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc146e10 0x7fd6fc141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc146e10 0x7fd6fc141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39074/0 (socket says 172.21.15.113:39074) 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 -- 172.21.15.113:0/208536061 learned_addr learned my addr 172.21.15.113:0/208536061 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6f3fff640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc15c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 -- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 msgr2=0x7fd6fc13e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fb7fe640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc13e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc13e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 -- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0d2b00 msgr2=0x7fd6fc15c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc15c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fbfff640 1 -- 172.21.15.113:0/208536061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40094d0 con 0x7fd6fc146e10 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6fb7fe640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc13e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.796+0000 7fd6f3fff640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc15c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.797+0000 7fd6fbfff640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc146e10 0x7fd6fc141310 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400b970 tx=0x7fd6f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.797+0000 7fd6f8ff9640 1 -- 172.21.15.113:0/208536061 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400cb40 con 0x7fd6fc146e10 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.797+0000 7fd6f8ff9640 1 -- 172.21.15.113:0/208536061 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f400ccc0 con 0x7fd6fc146e10 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.797+0000 7fd6f8ff9640 1 -- 172.21.15.113:0/208536061 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4014680 con 0x7fd6fc146e10 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.797+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc13ec80 con 0x7fd6fc146e10 2023-12-19T13:52:36.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.797+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc13f240 con 0x7fd6fc146e10 2023-12-19T13:52:36.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.798+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc140ff0 con 0x7fd6fc146e10 2023-12-19T13:52:36.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.799+0000 7fd6f8ff9640 1 -- 172.21.15.113:0/208536061 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6f401d3b0 con 0x7fd6fc146e10 2023-12-19T13:52:36.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.800+0000 7fd6f8ff9640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6dc06a430 0x7fd6dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:36.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.800+0000 7fd6f8ff9640 1 -- 172.21.15.113:0/208536061 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6f4088600 con 0x7fd6fc146e10 2023-12-19T13:52:36.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.800+0000 7fd6fb7fe640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6dc06a430 0x7fd6dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:36.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.801+0000 7fd6fb7fe640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6dc06a430 0x7fd6dc06c8f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec000f60 tx=0x7fd6ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:36.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.804+0000 7fd6f8ff9640 1 -- 172.21.15.113:0/208536061 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6f4053ea0 con 0x7fd6fc146e10 2023-12-19T13:52:36.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.994+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6fc0d2620 con 0x7fd6fc146e10 2023-12-19T13:52:36.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.996+0000 7fd6f8ff9640 1 -- 172.21.15.113:0/208536061 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+12440 (secure 0 0 0) 0x7fd6f4019090 con 0x7fd6fc146e10 2023-12-19T13:52:36.996 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":109,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:36.041539+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:36.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6dc06a430 msgr2=0x7fd6dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6dc06a430 0x7fd6dc06c8f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec000f60 tx=0x7fd6ec009040 comp rx=0 tx=0).stop 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc146e10 msgr2=0x7fd6fc141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc146e10 0x7fd6fc141310 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400b970 tx=0x7fd6f400be30 comp rx=0 tx=0).stop 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 shutdown_connections 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd6dc06a430 0x7fd6dc06c8f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd6fc146e10 0x7fd6fc141310 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0d2b00 0x7fd6fc15c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 --2- 172.21.15.113:0/208536061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc0ce110 0x7fd6fc13e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 >> 172.21.15.113:0/208536061 conn(0x7fd6fc0b29c0 msgr2=0x7fd6fc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 shutdown_connections 2023-12-19T13:52:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:36.999+0000 7fd701b9f640 1 -- 172.21.15.113:0/208536061 wait complete. 2023-12-19T13:52:37.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:52:37.017 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:52:37.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.236+0000 7f38ed8fa640 1 Processor -- start 2023-12-19T13:52:37.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.236+0000 7f38ed8fa640 1 -- start start 2023-12-19T13:52:37.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38ed8fa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e80afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38ed8fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38e80b02a0 0x7f38e806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38ed8fa640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f38e806da30 0x7f38e80ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38ed8fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e806e220 con 0x7f38e80b02a0 2023-12-19T13:52:37.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38ed8fa640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e80b0700 con 0x7f38e806da30 2023-12-19T13:52:37.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38ed8fa640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80cbea0 con 0x7f38e8141900 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38e7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38e80b02a0 0x7f38e806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38e7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38e80b02a0 0x7f38e806d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39090/0 (socket says 172.21.15.113:39090) 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.238+0000 7f38e7fff640 1 -- 172.21.15.113:0/3921640815 learned_addr learned my addr 172.21.15.113:0/3921640815 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.239+0000 7f38ec8f8640 1 --2- 172.21.15.113:0/3921640815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e80afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.239+0000 7f38ed0f9640 1 --2- 172.21.15.113:0/3921640815 >> v2:172.21.15.151:3300/0 conn(0x7f38e806da30 0x7f38e80ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.239+0000 7f38e7fff640 1 -- 172.21.15.113:0/3921640815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 msgr2=0x7f38e80afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.239+0000 7f38e7fff640 1 --2- 172.21.15.113:0/3921640815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e80afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.239+0000 7f38e7fff640 1 -- 172.21.15.113:0/3921640815 >> v2:172.21.15.151:3300/0 conn(0x7f38e806da30 msgr2=0x7f38e80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:37.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.239+0000 7f38e7fff640 1 --2- 172.21.15.113:0/3921640815 >> v2:172.21.15.151:3300/0 conn(0x7f38e806da30 0x7f38e80ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.239+0000 7f38e7fff640 1 -- 172.21.15.113:0/3921640815 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80cc180 con 0x7f38e80b02a0 2023-12-19T13:52:37.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.240+0000 7f38e7fff640 1 --2- 172.21.15.113:0/3921640815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e806d4f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f38e80747c0 tx=0x7f38d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e59888a56c11aca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:37.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.240+0000 7f38e77fe640 1 -- 172.21.15.113:0/3921640815 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4031870 con 0x7f38e80b02a0 2023-12-19T13:52:37.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.240+0000 7f38e77fe640 1 -- 172.21.15.113:0/3921640815 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d40319d0 con 0x7f38e80b02a0 2023-12-19T13:52:37.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.240+0000 7f38e77fe640 1 -- 172.21.15.113:0/3921640815 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4031d60 con 0x7f38e80b02a0 2023-12-19T13:52:37.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 -- 172.21.15.113:0/3921640815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 msgr2=0x7f38e806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/3921640815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e806d4f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f38e80747c0 tx=0x7f38d402b910 comp rx=0 tx=0).stop 2023-12-19T13:52:37.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 -- 172.21.15.113:0/3921640815 shutdown_connections 2023-12-19T13:52:37.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/3921640815 >> v2:172.21.15.151:3300/0 conn(0x7f38e806da30 0x7f38e80ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/3921640815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e806d4f0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/3921640815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e80afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 -- 172.21.15.113:0/3921640815 >> 172.21.15.113:0/3921640815 conn(0x7f38e806f630 msgr2=0x7f38e806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:37.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 -- 172.21.15.113:0/3921640815 shutdown_connections 2023-12-19T13:52:37.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.241+0000 7f38ed8fa640 1 -- 172.21.15.113:0/3921640815 wait complete. 2023-12-19T13:52:37.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.243+0000 7f38ed8fa640 1 Processor -- start 2023-12-19T13:52:37.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.243+0000 7f38ed8fa640 1 -- start start 2023-12-19T13:52:37.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38ed8fa640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38ed8fa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e8153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38ed8fa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e81f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38ed8fa640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80af800 con 0x7f38e80b02a0 2023-12-19T13:52:37.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38ed8fa640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e81559b0 con 0x7f38e806da30 2023-12-19T13:52:37.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38ed8fa640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e8155c90 con 0x7f38e8141900 2023-12-19T13:52:37.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38e7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e8153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38e7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e8153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39106/0 (socket says 172.21.15.113:39106) 2023-12-19T13:52:37.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.244+0000 7f38e7fff640 1 -- 172.21.15.113:0/1583019601 learned_addr learned my addr 172.21.15.113:0/1583019601 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:37.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38ed0f9640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e81f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38ec8f8640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e7fff640 1 -- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 msgr2=0x7f38e81f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e7fff640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e81f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e7fff640 1 -- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 msgr2=0x7f38e80af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e7fff640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e7fff640 1 -- 172.21.15.113:0/1583019601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40094d0 con 0x7f38e80b02a0 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38ec8f8640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e7fff640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e8153650 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f38d4000c00 tx=0x7f38d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e57fa640 1 -- 172.21.15.113:0/1583019601 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d403abe0 con 0x7f38e80b02a0 2023-12-19T13:52:37.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e57fa640 1 -- 172.21.15.113:0/1583019601 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d403ad40 con 0x7f38e80b02a0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38e57fa640 1 -- 172.21.15.113:0/1583019601 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4044610 con 0x7f38e80b02a0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e8155f70 con 0x7f38e80b02a0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.245+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e8156530 con 0x7f38e80b02a0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.246+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e8156720 con 0x7f38e80b02a0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.247+0000 7f38e57fa640 1 -- 172.21.15.113:0/1583019601 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f38d404d450 con 0x7f38e80b02a0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.248+0000 7f38e57fa640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38cc06a430 0x7f38cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.248+0000 7f38e57fa640 1 -- 172.21.15.113:0/1583019601 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f38d402d040 con 0x7f38e80b02a0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.248+0000 7f38ec8f8640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38cc06a430 0x7f38cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.249+0000 7f38ec8f8640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38cc06a430 0x7f38cc06c8f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f38dc006fd0 tx=0x7f38dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:37.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.253+0000 7f38e57fa640 1 -- 172.21.15.113:0/1583019601 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f38d40765c0 con 0x7f38e80b02a0 2023-12-19T13:52:37.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.440+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38e8061910 con 0x7f38e80b02a0 2023-12-19T13:52:37.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.441+0000 7f38e57fa640 1 -- 172.21.15.113:0/1583019601 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38d40aae60 con 0x7f38e80b02a0 2023-12-19T13:52:37.440 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:52:37.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.443+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38cc06a430 msgr2=0x7f38cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.443+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38cc06a430 0x7f38cc06c8f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f38dc006fd0 tx=0x7f38dc008040 comp rx=0 tx=0).stop 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.443+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 msgr2=0x7f38e8153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.443+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e8153650 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f38d4000c00 tx=0x7f38d40046c0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 shutdown_connections 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f38cc06a430 0x7f38cc06c8f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e8141900 0x7f38e81f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38e80b02a0 0x7f38e8153650 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 --2- 172.21.15.113:0/1583019601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 >> 172.21.15.113:0/1583019601 conn(0x7f38e806f630 msgr2=0x7f38e81e53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 shutdown_connections 2023-12-19T13:52:37.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.444+0000 7f38ed8fa640 1 -- 172.21.15.113:0/1583019601 wait complete. 2023-12-19T13:52:37.463 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:52:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.660+0000 7f5d5a98e640 1 Processor -- start 2023-12-19T13:52:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.660+0000 7f5d5a98e640 1 -- start start 2023-12-19T13:52:37.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.661+0000 7f5d5a98e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d540b05a0 0x7f5d540af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.661+0000 7f5d5a98e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5d5415b0d0 0x7f5d540cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.661+0000 7f5d5a98e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d54161b90 con 0x7f5d540af8e0 2023-12-19T13:52:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.661+0000 7f5d5a98e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d54160f80 con 0x7f5d5415b0d0 2023-12-19T13:52:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.661+0000 7f5d5a98e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54161260 con 0x7f5d540b05a0 2023-12-19T13:52:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.661+0000 7f5d5918b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5d540af8e0 0x7f5d5415a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54172/0 (socket says 172.21.15.113:54172) 2023-12-19T13:52:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.661+0000 7f5d5918b640 1 -- 172.21.15.113:0/491354120 learned_addr learned my addr 172.21.15.113:0/491354120 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5998c640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d540b05a0 0x7f5d540af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230320465 0 0) 0x7f5d54161b90 con 0x7f5d540af8e0 2023-12-19T13:52:37.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d40003520 con 0x7f5d540af8e0 2023-12-19T13:52:37.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5a18d640 1 --2- 172.21.15.113:0/491354120 >> v2:172.21.15.151:3300/0 conn(0x7f5d5415b0d0 0x7f5d540cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145963814 0 0) 0x7f5d40003520 con 0x7f5d540af8e0 2023-12-19T13:52:37.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d540b05a0 msgr2=0x7f5d540af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:37.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d540b05a0 0x7f5d540af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 >> v2:172.21.15.151:3300/0 conn(0x7f5d5415b0d0 msgr2=0x7f5d540cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:37.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 --2- 172.21.15.113:0/491354120 >> v2:172.21.15.151:3300/0 conn(0x7f5d5415b0d0 0x7f5d540cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54161540 con 0x7f5d540af8e0 2023-12-19T13:52:37.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5d48001670 con 0x7f5d540af8e0 2023-12-19T13:52:37.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 >> v1:172.21.15.113:6789/0 conn(0x7f5d540af8e0 legacy=0x7f5d5415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d540b05a0 0x7f5d40003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d40004d00 0x7f5d40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54160f80 con 0x7f5d40003ef0 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54161260 con 0x7f5d40004d00 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.662+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4000ba80 con 0x7f5d540b05a0 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5918b640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5918b640 1 -- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d540b05a0 msgr2=0x7f5d40003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:37.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5a18d640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d40004d00 0x7f5d40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5918b640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d540b05a0 0x7f5d40003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5918b640 1 -- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d40004d00 msgr2=0x7f5d40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5918b640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d40004d00 0x7f5d40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5918b640 1 -- 172.21.15.113:0/491354120 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40003520 con 0x7f5d40003ef0 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.663+0000 7f5d5a18d640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d40004d00 0x7f5d40005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.664+0000 7f5d5918b640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d400047c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800c270 tx=0x7f5d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640f7db659d0277d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.664+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4802cae0 con 0x7f5d40003ef0 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.664+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4802cc40 con 0x7f5d40003ef0 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.664+0000 7f5d5898a640 1 -- 172.21.15.113:0/491354120 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48005af0 con 0x7f5d40003ef0 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.665+0000 7f5d5a98e640 1 -- 172.21.15.113:0/491354120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 msgr2=0x7f5d400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.665+0000 7f5d5a98e640 1 --2- 172.21.15.113:0/491354120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d400047c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800c270 tx=0x7f5d400057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.665+0000 7f5d5a18d640 1 -- 172.21.15.113:0/491354120 reap_dead start 2023-12-19T13:52:37.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.665+0000 7f5d5a98e640 1 -- 172.21.15.113:0/491354120 shutdown_connections 2023-12-19T13:52:37.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.665+0000 7f5d5a98e640 1 -- 172.21.15.113:0/491354120 >> 172.21.15.113:0/491354120 conn(0x7f5d540659a0 msgr2=0x7f5d54065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:37.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.665+0000 7f5d5a98e640 1 -- 172.21.15.113:0/491354120 shutdown_connections 2023-12-19T13:52:37.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.665+0000 7f5d5a98e640 1 -- 172.21.15.113:0/491354120 wait complete. 2023-12-19T13:52:37.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.667+0000 7f5d5a98e640 1 Processor -- start 2023-12-19T13:52:37.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.667+0000 7f5d5a98e640 1 -- start start 2023-12-19T13:52:37.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5a98e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d5406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5a98e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5414b0c0 0x7f5d5414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5a98e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d5415ec00 0x7f5d5406b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5a98e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5415f0e0 con 0x7f5d40003ef0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5a98e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5415f3c0 con 0x7f5d5414b0c0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5a98e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5415f6a0 con 0x7f5d5415ec00 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d5406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d5406d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39134/0 (socket says 172.21.15.113:39134) 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 -- 172.21.15.113:0/3528844731 learned_addr learned my addr 172.21.15.113:0/3528844731 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 -- 172.21.15.113:0/3528844731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d5415ec00 msgr2=0x7f5d5406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d5415ec00 0x7f5d5406b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 -- 172.21.15.113:0/3528844731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5414b0c0 msgr2=0x7f5d5414f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5414b0c0 0x7f5d5414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.668+0000 7f5d5998c640 1 -- 172.21.15.113:0/3528844731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5415f980 con 0x7f5d40003ef0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.669+0000 7f5d5998c640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d5406d9c0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000e7c0 tx=0x7f5d5000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.669+0000 7f5d467fc640 1 -- 172.21.15.113:0/3528844731 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000eed0 con 0x7f5d40003ef0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.669+0000 7f5d467fc640 1 -- 172.21.15.113:0/3528844731 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5000c940 con 0x7f5d40003ef0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.669+0000 7f5d467fc640 1 -- 172.21.15.113:0/3528844731 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000ccd0 con 0x7f5d40003ef0 2023-12-19T13:52:37.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.669+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5415fc60 con 0x7f5d40003ef0 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.669+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5406bed0 con 0x7f5d40003ef0 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.670+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d54061910 con 0x7f5d40003ef0 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.671+0000 7f5d467fc640 1 -- 172.21.15.113:0/3528844731 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d50013470 con 0x7f5d40003ef0 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.673+0000 7f5d467fc640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d3806a430 0x7f5d3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.673+0000 7f5d467fc640 1 -- 172.21.15.113:0/3528844731 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d50088770 con 0x7f5d40003ef0 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.673+0000 7f5d5918b640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d3806a430 0x7f5d3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.674+0000 7f5d5918b640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d3806a430 0x7f5d3806c8f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d48034000 tx=0x7f5d4802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:37.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.677+0000 7f5d467fc640 1 -- 172.21.15.113:0/3528844731 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5d50053f80 con 0x7f5d40003ef0 2023-12-19T13:52:37.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.852+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5d540ae890 con 0x7f5d40003ef0 2023-12-19T13:52:37.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.853+0000 7f5d467fc640 1 -- 172.21.15.113:0/3528844731 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5d50017090 con 0x7f5d40003ef0 2023-12-19T13:52:37.853 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:37.853 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:52:37.853 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:52:37.853 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:52:37.853 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:52:37.853 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:52:37.854 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:52:37.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.855+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d3806a430 msgr2=0x7f5d3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.855+0000 7f5d5a98e640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d3806a430 0x7f5d3806c8f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d48034000 tx=0x7f5d4802e000 comp rx=0 tx=0).stop 2023-12-19T13:52:37.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.855+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 msgr2=0x7f5d5406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:37.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.855+0000 7f5d5a98e640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d5406d9c0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000e7c0 tx=0x7f5d5000ec80 comp rx=0 tx=0).stop 2023-12-19T13:52:37.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.855+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 shutdown_connections 2023-12-19T13:52:37.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.856+0000 7f5d5a98e640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5d3806a430 0x7f5d3806c8f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.856+0000 7f5d5a98e640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d5415ec00 0x7f5d5406b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.856+0000 7f5d5a98e640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5414b0c0 0x7f5d5414f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.856+0000 7f5d5a98e640 1 --2- 172.21.15.113:0/3528844731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d40003ef0 0x7f5d5406d9c0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:37.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.856+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 >> 172.21.15.113:0/3528844731 conn(0x7f5d540659a0 msgr2=0x7f5d540cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:37.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.856+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 shutdown_connections 2023-12-19T13:52:37.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:37.856+0000 7f5d5a98e640 1 -- 172.21.15.113:0/3528844731 wait complete. 2023-12-19T13:52:37.874 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:52:37.874 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:52:38.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.077+0000 7f3e95407640 1 Processor -- start 2023-12-19T13:52:38.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.078+0000 7f3e95407640 1 -- start start 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.079+0000 7f3e95407640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 0x7f3e900d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.079+0000 7f3e95407640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e900d3650 0x7f3e900d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.079+0000 7f3e95407640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e900d07c0 con 0x7f3e9015d4e0 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.079+0000 7f3e95407640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e900ce7b0 con 0x7f3e900d3650 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.079+0000 7f3e95407640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900d3b00 con 0x7f3e900b1d90 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.079+0000 7f3e8ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3e9015d4e0 0x7f3e900b8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42958/0 (socket says 172.21.15.113:42958) 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.079+0000 7f3e8ffff640 1 -- 172.21.15.113:0/4170887274 learned_addr learned my addr 172.21.15.113:0/4170887274 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8f7fe640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 0x7f3e900d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151878481 0 0) 0x7f3e900d07c0 con 0x7f3e9015d4e0 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e7c003520 con 0x7f3e9015d4e0 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e94c06640 1 --2- 172.21.15.113:0/4170887274 >> v2:172.21.15.151:3300/0 conn(0x7f3e900d3650 0x7f3e900d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:38.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827433006 0 0) 0x7f3e7c003520 con 0x7f3e9015d4e0 2023-12-19T13:52:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 msgr2=0x7f3e900d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 0x7f3e900d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 >> v2:172.21.15.151:3300/0 conn(0x7f3e900d3650 msgr2=0x7f3e900d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 --2- 172.21.15.113:0/4170887274 >> v2:172.21.15.151:3300/0 conn(0x7f3e900d3650 0x7f3e900d15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9015d8c0 con 0x7f3e9015d4e0 2023-12-19T13:52:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3e800019f0 con 0x7f3e9015d4e0 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 >> v1:172.21.15.113:6789/0 conn(0x7f3e9015d4e0 legacy=0x7f3e900b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 0x7f3e7c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c003f40 0x7f3e7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900ce7b0 con 0x7f3e7c004d00 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900d3b00 con 0x7f3e7c003f40 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.080+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c00ba30 con 0x7f3e900b1d90 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e94c06640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e8f7fe640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c003f40 0x7f3e7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e8ffff640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 0x7f3e7c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e94c06640 1 -- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 msgr2=0x7f3e7c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e94c06640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 0x7f3e7c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e94c06640 1 -- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c003f40 msgr2=0x7f3e7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:38.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e94c06640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c003f40 0x7f3e7c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:38.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e94c06640 1 -- 172.21.15.113:0/4170887274 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c003520 con 0x7f3e7c004d00 2023-12-19T13:52:38.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.081+0000 7f3e8ffff640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b1d90 0x7f3e7c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:38.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.082+0000 7f3e94c06640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800ba30 tx=0x7f3e7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67544cef01be3c52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:38.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.082+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88032680 con 0x7f3e7c004d00 2023-12-19T13:52:38.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.082+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e880327e0 con 0x7f3e7c004d00 2023-12-19T13:52:38.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.082+0000 7f3e8effd640 1 -- 172.21.15.113:0/4170887274 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88032b70 con 0x7f3e7c004d00 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.083+0000 7f3e95407640 1 -- 172.21.15.113:0/4170887274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e7c004d00 msgr2=0x7f3e7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.083+0000 7f3e95407640 1 --2- 172.21.15.113:0/4170887274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800ba30 tx=0x7f3e7c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.083+0000 7f3e94c06640 1 -- 172.21.15.113:0/4170887274 reap_dead start 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.083+0000 7f3e95407640 1 -- 172.21.15.113:0/4170887274 shutdown_connections 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.083+0000 7f3e95407640 1 -- 172.21.15.113:0/4170887274 >> 172.21.15.113:0/4170887274 conn(0x7f3e90072f40 msgr2=0x7f3e90073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.083+0000 7f3e95407640 1 -- 172.21.15.113:0/4170887274 shutdown_connections 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.083+0000 7f3e95407640 1 -- 172.21.15.113:0/4170887274 wait complete. 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.085+0000 7f3e95407640 1 Processor -- start 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.085+0000 7f3e95407640 1 -- start start 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e95407640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c004d00 0x7f3e900b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e95407640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e900b8970 0x7f3e901f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e95407640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b8df0 0x7f3e900b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e95407640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b52f0 con 0x7f3e900b8970 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e95407640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b55d0 con 0x7f3e7c004d00 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e95407640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b58b0 con 0x7f3e900b8df0 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e900b8970 0x7f3e901f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e900b8970 0x7f3e901f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38162/0 (socket says 172.21.15.113:38162) 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 -- 172.21.15.113:0/2525127243 learned_addr learned my addr 172.21.15.113:0/2525127243 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 -- 172.21.15.113:0/2525127243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b8df0 msgr2=0x7f3e900b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b8df0 0x7f3e900b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 -- 172.21.15.113:0/2525127243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c004d00 msgr2=0x7f3e900b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c004d00 0x7f3e900b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.086+0000 7f3e8f7fe640 1 -- 172.21.15.113:0/2525127243 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900b5b90 con 0x7f3e900b8970 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.087+0000 7f3e8f7fe640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e900b8970 0x7f3e901f2b40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f3e78010890 tx=0x7f3e78010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.087+0000 7f3e8cff9640 1 -- 172.21.15.113:0/2525127243 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780095b0 con 0x7f3e900b8970 2023-12-19T13:52:38.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.087+0000 7f3e8cff9640 1 -- 172.21.15.113:0/2525127243 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7800eb00 con 0x7f3e900b8970 2023-12-19T13:52:38.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.087+0000 7f3e8cff9640 1 -- 172.21.15.113:0/2525127243 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800eeb0 con 0x7f3e900b8970 2023-12-19T13:52:38.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.087+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e900b5e70 con 0x7f3e900b8970 2023-12-19T13:52:38.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.087+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e900b7be0 con 0x7f3e900b8970 2023-12-19T13:52:38.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.088+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e90061910 con 0x7f3e900b8970 2023-12-19T13:52:38.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.089+0000 7f3e8cff9640 1 -- 172.21.15.113:0/2525127243 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e780143f0 con 0x7f3e900b8970 2023-12-19T13:52:38.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.090+0000 7f3e8cff9640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e7006a430 0x7f3e7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:38.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.090+0000 7f3e8cff9640 1 -- 172.21.15.113:0/2525127243 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e78088b20 con 0x7f3e900b8970 2023-12-19T13:52:38.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.091+0000 7f3e8ffff640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e7006a430 0x7f3e7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:38.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.091+0000 7f3e8ffff640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e7006a430 0x7f3e7006c8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3e80001b20 tx=0x7f3e80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:38.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.094+0000 7f3e8cff9640 1 -- 172.21.15.113:0/2525127243 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e78054460 con 0x7f3e900b8970 2023-12-19T13:52:38.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:38.282+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3e900d3e50 con 0x7f3e900b8970 2023-12-19T13:52:39.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.079+0000 7f3e8cff9640 1 -- 172.21.15.113:0/2525127243 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3e78057a80 con 0x7f3e900b8970 2023-12-19T13:52:39.079 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:52:39.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.084+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e7006a430 msgr2=0x7f3e7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:39.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.084+0000 7f3e95407640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e7006a430 0x7f3e7006c8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3e80001b20 tx=0x7f3e80009040 comp rx=0 tx=0).stop 2023-12-19T13:52:39.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.084+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e900b8970 msgr2=0x7f3e901f2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:39.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.084+0000 7f3e95407640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e900b8970 0x7f3e901f2b40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f3e78010890 tx=0x7f3e78010d50 comp rx=0 tx=0).stop 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.086+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 shutdown_connections 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.086+0000 7f3e95407640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e7006a430 0x7f3e7006c8f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.086+0000 7f3e95407640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e900b8df0 0x7f3e900b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.086+0000 7f3e95407640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e900b8970 0x7f3e901f2b40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.086+0000 7f3e95407640 1 --2- 172.21.15.113:0/2525127243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e7c004d00 0x7f3e900b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.086+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 >> 172.21.15.113:0/2525127243 conn(0x7f3e90072f40 msgr2=0x7f3e9015f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.087+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 shutdown_connections 2023-12-19T13:52:39.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.087+0000 7f3e95407640 1 -- 172.21.15.113:0/2525127243 wait complete. 2023-12-19T13:52:39.106 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:52:39.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.325+0000 7f7147d0a640 1 Processor -- start 2023-12-19T13:52:39.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.325+0000 7f7147d0a640 1 -- start start 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.326+0000 7f7147d0a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f714015a2d0 0x7f71400cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.326+0000 7f7147d0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7140071210 0x7f714006b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.326+0000 7f7147d0a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71400cc1f0 con 0x7f71400ce830 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.326+0000 7f7147d0a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714006e840 con 0x7f714015a2d0 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.326+0000 7f7147d0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400cbc30 con 0x7f7140071210 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f7145aa6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f714015a2d0 0x7f71400cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f7145aa6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f714015a2d0 0x7f71400cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38170/0 (socket says 172.21.15.113:38170) 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f7145aa6640 1 -- 172.21.15.113:0/3699903887 learned_addr learned my addr 172.21.15.113:0/3699903887 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:39.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f71462a7640 1 --2- 172.21.15.113:0/3699903887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7140071210 0x7f714006b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:39.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f7145aa6640 1 -- 172.21.15.113:0/3699903887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7140071210 msgr2=0x7f714006b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:39.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f7145aa6640 1 --2- 172.21.15.113:0/3699903887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7140071210 0x7f714006b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f7145aa6640 1 -- 172.21.15.113:0/3699903887 >> v1:172.21.15.151:6789/0 conn(0x7f71400ce830 legacy=0x7f7140070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:39.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.327+0000 7f7145aa6640 1 -- 172.21.15.113:0/3699903887 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400cbf10 con 0x7f714015a2d0 2023-12-19T13:52:39.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.329+0000 7f7145aa6640 1 --2- 172.21.15.113:0/3699903887 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714015a2d0 0x7f71400cae20 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f713c00bb10 tx=0x7f713c02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e11afc17e0e9bfe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:39.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.329+0000 7f7144aa4640 1 -- 172.21.15.113:0/3699903887 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c02ee70 con 0x7f714015a2d0 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.329+0000 7f7144aa4640 1 -- 172.21.15.113:0/3699903887 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c036440 con 0x7f714015a2d0 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.329+0000 7f7144aa4640 1 -- 172.21.15.113:0/3699903887 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0367d0 con 0x7f714015a2d0 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.329+0000 7f7147d0a640 1 -- 172.21.15.113:0/3699903887 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714015a2d0 msgr2=0x7f71400cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.329+0000 7f7147d0a640 1 --2- 172.21.15.113:0/3699903887 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714015a2d0 0x7f71400cae20 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f713c00bb10 tx=0x7f713c02e0c0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.330+0000 7f7147d0a640 1 -- 172.21.15.113:0/3699903887 shutdown_connections 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.330+0000 7f7147d0a640 1 --2- 172.21.15.113:0/3699903887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7140071210 0x7f714006b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.330+0000 7f7147d0a640 1 --2- 172.21.15.113:0/3699903887 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714015a2d0 0x7f71400cae20 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.330+0000 7f7147d0a640 1 -- 172.21.15.113:0/3699903887 >> 172.21.15.113:0/3699903887 conn(0x7f71400cf0b0 msgr2=0x7f71400cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.330+0000 7f7147d0a640 1 -- 172.21.15.113:0/3699903887 shutdown_connections 2023-12-19T13:52:39.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.330+0000 7f7147d0a640 1 -- 172.21.15.113:0/3699903887 wait complete. 2023-12-19T13:52:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.331+0000 7f7147d0a640 1 Processor -- start 2023-12-19T13:52:39.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.332+0000 7f7147d0a640 1 -- start start 2023-12-19T13:52:39.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.332+0000 7f7147d0a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140071210 0x7f71400a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:39.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.332+0000 7f7147d0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71400ce830 0x7f71400ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:39.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.332+0000 7f7147d0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714015a2d0 0x7f71400ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:39.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.332+0000 7f7147d0a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400a98f0 con 0x7f7140071210 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.332+0000 7f7147d0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400abe30 con 0x7f714015a2d0 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.332+0000 7f7147d0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400ac070 con 0x7f71400ce830 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140071210 0x7f71400a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140071210 0x7f71400a8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38178/0 (socket says 172.21.15.113:38178) 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 -- 172.21.15.113:0/2777149430 learned_addr learned my addr 172.21.15.113:0/2777149430 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 -- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71400ce830 msgr2=0x7f71400ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f71452a5640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71400ce830 0x7f71400ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:39.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f71462a7640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714015a2d0 0x7f71400ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71400ce830 0x7f71400ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 -- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714015a2d0 msgr2=0x7f71400ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714015a2d0 0x7f71400ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f7145aa6640 1 -- 172.21.15.113:0/2777149430 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c00b770 con 0x7f7140071210 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.333+0000 7f71452a5640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71400ce830 0x7f71400ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.334+0000 7f7145aa6640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140071210 0x7f71400a8ce0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f713c02e100 tx=0x7f713c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.334+0000 7f71367fc640 1 -- 172.21.15.113:0/2777149430 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0348d0 con 0x7f7140071210 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.334+0000 7f71367fc640 1 -- 172.21.15.113:0/2777149430 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c034a50 con 0x7f7140071210 2023-12-19T13:52:39.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.334+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71400ac350 con 0x7f7140071210 2023-12-19T13:52:39.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.334+0000 7f71367fc640 1 -- 172.21.15.113:0/2777149430 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c034e00 con 0x7f7140071210 2023-12-19T13:52:39.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.334+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71400ac910 con 0x7f7140071210 2023-12-19T13:52:39.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.335+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7140074770 con 0x7f7140071210 2023-12-19T13:52:39.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.336+0000 7f71367fc640 1 -- 172.21.15.113:0/2777149430 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f713c04c460 con 0x7f7140071210 2023-12-19T13:52:39.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.337+0000 7f71367fc640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f712406a430 0x7f712406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:39.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.337+0000 7f71367fc640 1 -- 172.21.15.113:0/2777149430 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f713c0ad940 con 0x7f7140071210 2023-12-19T13:52:39.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.338+0000 7f71452a5640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f712406a430 0x7f712406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:39.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.338+0000 7f71452a5640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f712406a430 0x7f712406c8f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7140155ca0 tx=0x7f7130009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:39.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.343+0000 7f71367fc640 1 -- 172.21.15.113:0/2777149430 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f713c079100 con 0x7f7140071210 2023-12-19T13:52:39.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:39.533+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f71400ace30 con 0x7f7140071210 2023-12-19T13:52:40.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.093+0000 7f71367fc640 1 -- 172.21.15.113:0/2777149430 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) v1 ==== 170+0+0 (secure 0 0 0) 0x7f71400ace30 con 0x7f7140071210 2023-12-19T13:52:40.095 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.101+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f712406a430 msgr2=0x7f712406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.101+0000 7f7147d0a640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f712406a430 0x7f712406c8f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7140155ca0 tx=0x7f7130009040 comp rx=0 tx=0).stop 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.101+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140071210 msgr2=0x7f71400a8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.101+0000 7f7147d0a640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140071210 0x7f71400a8ce0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f713c02e100 tx=0x7f713c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.102+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 shutdown_connections 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.102+0000 7f7147d0a640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f712406a430 0x7f712406c8f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.102+0000 7f7147d0a640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714015a2d0 0x7f71400ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.102+0000 7f7147d0a640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71400ce830 0x7f71400ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.102+0000 7f7147d0a640 1 --2- 172.21.15.113:0/2777149430 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140071210 0x7f71400a8ce0 secure :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f713c02e100 tx=0x7f713c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.102+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 >> 172.21.15.113:0/2777149430 conn(0x7f71400cf0b0 msgr2=0x7f714006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:40.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.104+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 shutdown_connections 2023-12-19T13:52:40.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.104+0000 7f7147d0a640 1 -- 172.21.15.113:0/2777149430 wait complete. 2023-12-19T13:52:40.133 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:52:40.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.320+0000 7f61d74ce640 1 Processor -- start 2023-12-19T13:52:40.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.321+0000 7f61d74ce640 1 -- start start 2023-12-19T13:52:40.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.322+0000 7f61d74ce640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f61d0157c30 0x7f61d00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.322+0000 7f61d74ce640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f61d00cde40 0x7f61d00ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.322+0000 7f61d74ce640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d015da00 con 0x7f61d00ad300 2023-12-19T13:52:40.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.322+0000 7f61d74ce640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d015e940 con 0x7f61d0157c30 2023-12-19T13:52:40.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.322+0000 7f61d74ce640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00adcc0 con 0x7f61d00cde40 2023-12-19T13:52:40.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d526a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f61d0157c30 0x7f61d00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d526a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f61d0157c30 0x7f61d00cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38192/0 (socket says 172.21.15.113:38192) 2023-12-19T13:52:40.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d526a640 1 -- 172.21.15.113:0/2971344371 learned_addr learned my addr 172.21.15.113:0/2971344371 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:40.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d5a6b640 1 --2- 172.21.15.113:0/2971344371 >> v2:172.21.15.151:3300/0 conn(0x7f61d00cde40 0x7f61d00ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d526a640 1 -- 172.21.15.113:0/2971344371 >> v2:172.21.15.151:3300/0 conn(0x7f61d00cde40 msgr2=0x7f61d00ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:40.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d526a640 1 --2- 172.21.15.113:0/2971344371 >> v2:172.21.15.151:3300/0 conn(0x7f61d00cde40 0x7f61d00ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d526a640 1 -- 172.21.15.113:0/2971344371 >> v1:172.21.15.151:6789/0 conn(0x7f61d00ad300 legacy=0x7f61d00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:40.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.323+0000 7f61d526a640 1 -- 172.21.15.113:0/2971344371 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00cf860 con 0x7f61d0157c30 2023-12-19T13:52:40.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.325+0000 7f61d526a640 1 --2- 172.21.15.113:0/2971344371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d00cf320 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f61d0066760 tx=0x7f61cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0638cbc4dcd940d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:40.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.325+0000 7f61c7fff640 1 -- 172.21.15.113:0/2971344371 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc031870 con 0x7f61d0157c30 2023-12-19T13:52:40.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.325+0000 7f61c7fff640 1 -- 172.21.15.113:0/2971344371 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0319d0 con 0x7f61d0157c30 2023-12-19T13:52:40.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.325+0000 7f61c7fff640 1 -- 172.21.15.113:0/2971344371 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc031d60 con 0x7f61d0157c30 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 -- 172.21.15.113:0/2971344371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 msgr2=0x7f61d00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 --2- 172.21.15.113:0/2971344371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d00cf320 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f61d0066760 tx=0x7f61cc02b910 comp rx=0 tx=0).stop 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 -- 172.21.15.113:0/2971344371 shutdown_connections 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 --2- 172.21.15.113:0/2971344371 >> v2:172.21.15.151:3300/0 conn(0x7f61d00cde40 0x7f61d00ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 --2- 172.21.15.113:0/2971344371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d00cf320 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 -- 172.21.15.113:0/2971344371 >> 172.21.15.113:0/2971344371 conn(0x7f61d0073150 msgr2=0x7f61d00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 -- 172.21.15.113:0/2971344371 shutdown_connections 2023-12-19T13:52:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.326+0000 7f61d74ce640 1 -- 172.21.15.113:0/2971344371 wait complete. 2023-12-19T13:52:40.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.328+0000 7f61d74ce640 1 Processor -- start 2023-12-19T13:52:40.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.329+0000 7f61d74ce640 1 -- start start 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d74ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61d00ad300 0x7f61d0156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d74ce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61d00cde40 0x7f61d0155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d74ce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d74ce640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d006c4b0 con 0x7f61d0157c30 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d74ce640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01574c0 con 0x7f61d00cde40 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d74ce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d006e050 con 0x7f61d00ad300 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d5a6b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d5a6b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d014cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38202/0 (socket says 172.21.15.113:38202) 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d5a6b640 1 -- 172.21.15.113:0/1004535980 learned_addr learned my addr 172.21.15.113:0/1004535980 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d5a6b640 1 -- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61d00ad300 msgr2=0x7f61d0156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d5a6b640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61d00ad300 0x7f61d0156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.330+0000 7f61d4a69640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61d00cde40 0x7f61d0155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d5a6b640 1 -- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61d00cde40 msgr2=0x7f61d0155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d5a6b640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61d00cde40 0x7f61d0155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d5a6b640 1 -- 172.21.15.113:0/1004535980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0094d0 con 0x7f61d0157c30 2023-12-19T13:52:40.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d4a69640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61d00cde40 0x7f61d0155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d5a6b640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d014cfa0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f61c8007e40 tx=0x7f61c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61c5ffb640 1 -- 172.21.15.113:0/1004535980 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8014620 con 0x7f61d0157c30 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61c5ffb640 1 -- 172.21.15.113:0/1004535980 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c800ee90 con 0x7f61d0157c30 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d006b830 con 0x7f61d0157c30 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61c5ffb640 1 -- 172.21.15.113:0/1004535980 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80149e0 con 0x7f61d0157c30 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.331+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d006bdf0 con 0x7f61d0157c30 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.333+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d006cac0 con 0x7f61d0157c30 2023-12-19T13:52:40.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.334+0000 7f61c5ffb640 1 -- 172.21.15.113:0/1004535980 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61c8014b40 con 0x7f61d0157c30 2023-12-19T13:52:40.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.335+0000 7f61c5ffb640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f61b406a430 0x7f61b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.335+0000 7f61c5ffb640 1 -- 172.21.15.113:0/1004535980 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f61c8089270 con 0x7f61d0157c30 2023-12-19T13:52:40.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.335+0000 7f61d526a640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f61b406a430 0x7f61b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.336+0000 7f61d526a640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f61b406a430 0x7f61b406c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:40.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.340+0000 7f61c5ffb640 1 -- 172.21.15.113:0/1004535980 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61d006cac0 con 0x7f61d0157c30 2023-12-19T13:52:40.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.566+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f61d006cac0 con 0x7f61d0157c30 2023-12-19T13:52:40.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.576+0000 7f61c5ffb640 1 -- 172.21.15.113:0/1004535980 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7f61d006cac0 con 0x7f61d0157c30 2023-12-19T13:52:40.575 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 12 and data pool 13 2023-12-19T13:52:40.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.580+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f61b406a430 msgr2=0x7f61b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.580+0000 7f61d74ce640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f61b406a430 0x7f61b406c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc030000 comp rx=0 tx=0).stop 2023-12-19T13:52:40.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.580+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 msgr2=0x7f61d014cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.580+0000 7f61d74ce640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d014cfa0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f61c8007e40 tx=0x7f61c800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.580+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 shutdown_connections 2023-12-19T13:52:40.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.581+0000 7f61d74ce640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f61b406a430 0x7f61b406c8f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.581+0000 7f61d74ce640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f61d0157c30 0x7f61d014cfa0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.581+0000 7f61d74ce640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61d00cde40 0x7f61d0155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.581+0000 7f61d74ce640 1 --2- 172.21.15.113:0/1004535980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61d00ad300 0x7f61d0156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.581+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 >> 172.21.15.113:0/1004535980 conn(0x7f61d0073150 msgr2=0x7f61d00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:40.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.581+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 shutdown_connections 2023-12-19T13:52:40.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.581+0000 7f61d74ce640 1 -- 172.21.15.113:0/1004535980 wait complete. 2023-12-19T13:52:40.606 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:40.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.784+0000 7f147b347640 1 Processor -- start 2023-12-19T13:52:40.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.785+0000 7f147b347640 1 -- start start 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.786+0000 7f147b347640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f147406c6b0 0x7f1474166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.786+0000 7f147b347640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147406bb30 con 0x7f14740b0b50 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.786+0000 7f147b347640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14740b0070 con 0x7f14741449e0 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.786+0000 7f147b347640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14740b0350 con 0x7f147406c6b0 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.786+0000 7f14788e2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f14740b0b50 0x7f147406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42966/0 (socket says 172.21.15.113:42966) 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.786+0000 7f14788e2640 1 -- 172.21.15.113:0/2889323406 learned_addr learned my addr 172.21.15.113:0/2889323406 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.787+0000 7f14798e4640 1 --2- 172.21.15.113:0/2889323406 >> v2:172.21.15.113:3300/0 conn(0x7f147406c6b0 0x7f1474166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.787+0000 7f14798e4640 1 -- 172.21.15.113:0/2889323406 >> v1:172.21.15.151:6789/0 conn(0x7f14741449e0 legacy=0x7f14740af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:40.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.787+0000 7f14798e4640 1 -- 172.21.15.113:0/2889323406 >> v1:172.21.15.113:6789/0 conn(0x7f14740b0b50 legacy=0x7f147406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.787+0000 7f14798e4640 1 -- 172.21.15.113:0/2889323406 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740b0630 con 0x7f147406c6b0 2023-12-19T13:52:40.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.787+0000 7f1467fff640 1 -- 172.21.15.113:0/2889323406 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112688575 0 0) 0x7f147406bb30 con 0x7f14740b0b50 2023-12-19T13:52:40.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.788+0000 7f14798e4640 1 --2- 172.21.15.113:0/2889323406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f1474166200 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f146c009d90 tx=0x7f146c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55a2bbc10749f8e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:40.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.788+0000 7f1467fff640 1 -- 172.21.15.113:0/2889323406 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c02cc60 con 0x7f147406c6b0 2023-12-19T13:52:40.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f1467fff640 1 -- 172.21.15.113:0/2889323406 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c02cdc0 con 0x7f147406c6b0 2023-12-19T13:52:40.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f1467fff640 1 -- 172.21.15.113:0/2889323406 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c034660 con 0x7f147406c6b0 2023-12-19T13:52:40.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f147b347640 1 -- 172.21.15.113:0/2889323406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 msgr2=0x7f1474166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f147b347640 1 --2- 172.21.15.113:0/2889323406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f1474166200 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f146c009d90 tx=0x7f146c02beb0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f147b347640 1 -- 172.21.15.113:0/2889323406 shutdown_connections 2023-12-19T13:52:40.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f147b347640 1 --2- 172.21.15.113:0/2889323406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f1474166200 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f147b347640 1 -- 172.21.15.113:0/2889323406 >> 172.21.15.113:0/2889323406 conn(0x7f14740cbb70 msgr2=0x7f14740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:40.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f147b347640 1 -- 172.21.15.113:0/2889323406 shutdown_connections 2023-12-19T13:52:40.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.789+0000 7f147b347640 1 -- 172.21.15.113:0/2889323406 wait complete. 2023-12-19T13:52:40.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.791+0000 7f147b347640 1 Processor -- start 2023-12-19T13:52:40.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.791+0000 7f147b347640 1 -- start start 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f147b347640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f147413cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f147b347640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14740b0b50 0x7f147415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f147b347640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14741449e0 0x7f147413a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f147b347640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147413e370 con 0x7f147406c6b0 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f147b347640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147413d470 con 0x7f14741449e0 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f147b347640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147413f390 con 0x7f14740b0b50 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f14790e3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f147413cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f14790e3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f147413cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38224/0 (socket says 172.21.15.113:38224) 2023-12-19T13:52:40.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.792+0000 7f14790e3640 1 -- 172.21.15.113:0/1735888300 learned_addr learned my addr 172.21.15.113:0/1735888300 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:40.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.793+0000 7f14790e3640 1 -- 172.21.15.113:0/1735888300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14740b0b50 msgr2=0x7f147415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.793+0000 7f14790e3640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14740b0b50 0x7f147415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.793+0000 7f14790e3640 1 -- 172.21.15.113:0/1735888300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14741449e0 msgr2=0x7f147413a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:40.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.793+0000 7f14790e3640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14741449e0 0x7f147413a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:40.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.793+0000 7f14790e3640 1 -- 172.21.15.113:0/1735888300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c009a70 con 0x7f147406c6b0 2023-12-19T13:52:40.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.793+0000 7f14790e3640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f147413cf30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f147000b3f0 tx=0x7f147000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:40.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.793+0000 7f1465ffb640 1 -- 172.21.15.113:0/1735888300 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470011830 con 0x7f147406c6b0 2023-12-19T13:52:40.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.794+0000 7f1465ffb640 1 -- 172.21.15.113:0/1735888300 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470011990 con 0x7f147406c6b0 2023-12-19T13:52:40.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.794+0000 7f1465ffb640 1 -- 172.21.15.113:0/1735888300 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470011d40 con 0x7f147406c6b0 2023-12-19T13:52:40.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.794+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147413f670 con 0x7f147406c6b0 2023-12-19T13:52:40.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.794+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147413fc30 con 0x7f147406c6b0 2023-12-19T13:52:40.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.795+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1474061910 con 0x7f147406c6b0 2023-12-19T13:52:40.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.796+0000 7f1465ffb640 1 -- 172.21.15.113:0/1735888300 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f147001a400 con 0x7f147406c6b0 2023-12-19T13:52:40.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.797+0000 7f1465ffb640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145806a430 0x7f145806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:40.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.797+0000 7f1465ffb640 1 -- 172.21.15.113:0/1735888300 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1470088840 con 0x7f147406c6b0 2023-12-19T13:52:40.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.797+0000 7f14788e2640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145806a430 0x7f145806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:40.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.798+0000 7f14788e2640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145806a430 0x7f145806c8f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1468007fd0 tx=0x7f1468007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:40.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.801+0000 7f1465ffb640 1 -- 172.21.15.113:0/1735888300 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1470053d90 con 0x7f147406c6b0 2023-12-19T13:52:40.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.981+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14741403a0 con 0x7f147406c6b0 2023-12-19T13:52:40.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.984+0000 7f1465ffb640 1 -- 172.21.15.113:0/1735888300 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16177 (secure 0 0 0) 0x7f14700573b0 con 0x7f147406c6b0 2023-12-19T13:52:41.038 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:41.038 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":112,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:40.567888+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:41.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145806a430 msgr2=0x7f145806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145806a430 0x7f145806c8f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1468007fd0 tx=0x7f1468007920 comp rx=0 tx=0).stop 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 msgr2=0x7f147413cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f147413cf30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f147000b3f0 tx=0x7f147000b8b0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 shutdown_connections 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145806a430 0x7f145806c8f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14741449e0 0x7f147413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14740b0b50 0x7f147415dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 --2- 172.21.15.113:0/1735888300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f147406c6b0 0x7f147413cf30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 >> 172.21.15.113:0/1735888300 conn(0x7f14740cbb70 msgr2=0x7f147415adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 shutdown_connections 2023-12-19T13:52:41.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:40.987+0000 7f147b347640 1 -- 172.21.15.113:0/1735888300 wait complete. 2023-12-19T13:52:41.041 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:41.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.249+0000 7f0029bf1640 1 Processor -- start 2023-12-19T13:52:41.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.249+0000 7f0029bf1640 1 -- start start 2023-12-19T13:52:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.250+0000 7f0029bf1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0024157bf0 0x7f002415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.250+0000 7f0029bf1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002415b740 con 0x7f00240b0810 2023-12-19T13:52:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.250+0000 7f0029bf1640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00240ae640 con 0x7f00240ae110 2023-12-19T13:52:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.250+0000 7f0029bf1640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002406b8c0 con 0x7f0024157bf0 2023-12-19T13:52:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.251+0000 7f0023fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f00240b0810 0x7f002406d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42978/0 (socket says 172.21.15.113:42978) 2023-12-19T13:52:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.251+0000 7f0023fff640 1 -- 172.21.15.113:0/1384981538 learned_addr learned my addr 172.21.15.113:0/1384981538 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.251+0000 7f00237fe640 1 --2- 172.21.15.113:0/1384981538 >> v2:172.21.15.151:3300/0 conn(0x7f0024157bf0 0x7f002415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.251+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876347508 0 0) 0x7f002415b740 con 0x7f00240b0810 2023-12-19T13:52:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.251+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c003520 con 0x7f00240b0810 2023-12-19T13:52:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.251+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119496691 0 0) 0x7f000c003520 con 0x7f00240b0810 2023-12-19T13:52:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 >> v2:172.21.15.151:3300/0 conn(0x7f0024157bf0 msgr2=0x7f002415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 --2- 172.21.15.113:0/1384981538 >> v2:172.21.15.151:3300/0 conn(0x7f0024157bf0 0x7f002415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 >> v1:172.21.15.151:6789/0 conn(0x7f00240ae110 legacy=0x7f00240b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240ae920 con 0x7f00240b0810 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f001c0019f0 con 0x7f00240b0810 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00237fe640 1 --2- 172.21.15.113:0/1384981538 >> v2:172.21.15.151:3300/0 conn(0x7f0024157bf0 0x7f002415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 >> v1:172.21.15.113:6789/0 conn(0x7f00240b0810 legacy=0x7f002406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c003a30 0x7f000c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f000c0047c0 0x7f000c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f000c0052a0 0x7f000c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002406b8c0 con 0x7f000c0047c0 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c00c1a0 con 0x7f000c003a30 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c00c360 con 0x7f000c0052a0 2023-12-19T13:52:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f0022ffd640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f000c0047c0 0x7f000c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f00237fe640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c003a30 0x7f000c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f0022ffd640 1 -- 172.21.15.113:0/1384981538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f000c0052a0 msgr2=0x7f000c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:41.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f0022ffd640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f000c0052a0 0x7f000c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f0022ffd640 1 -- 172.21.15.113:0/1384981538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c003a30 msgr2=0x7f000c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:41.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f0022ffd640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c003a30 0x7f000c003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f0022ffd640 1 -- 172.21.15.113:0/1384981538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c003520 con 0x7f000c0047c0 2023-12-19T13:52:41.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.252+0000 7f0023fff640 1 -- 172.21.15.113:0/1384981538 reap_dead start 2023-12-19T13:52:41.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.254+0000 7f0022ffd640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f000c0047c0 0x7f000c004c40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0018001720 tx=0x7f000c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdf30b2ae701c6c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:41.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.254+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180052d0 con 0x7f000c0047c0 2023-12-19T13:52:41.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.254+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001802e050 con 0x7f000c0047c0 2023-12-19T13:52:41.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.254+0000 7f00227fc640 1 -- 172.21.15.113:0/1384981538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018003830 con 0x7f000c0047c0 2023-12-19T13:52:41.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.255+0000 7f0029bf1640 1 -- 172.21.15.113:0/1384981538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f000c0047c0 msgr2=0x7f000c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.255+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f000c0047c0 0x7f000c004c40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0018001720 tx=0x7f000c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.255+0000 7f0029bf1640 1 -- 172.21.15.113:0/1384981538 shutdown_connections 2023-12-19T13:52:41.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.255+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1384981538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f000c0047c0 0x7f000c004c40 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.255+0000 7f0029bf1640 1 -- 172.21.15.113:0/1384981538 >> 172.21.15.113:0/1384981538 conn(0x7f00240cbb70 msgr2=0x7f00240cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:41.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.255+0000 7f0029bf1640 1 -- 172.21.15.113:0/1384981538 shutdown_connections 2023-12-19T13:52:41.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.255+0000 7f0029bf1640 1 -- 172.21.15.113:0/1384981538 wait complete. 2023-12-19T13:52:41.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.256+0000 7f0029bf1640 1 Processor -- start 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.257+0000 7f0029bf1640 1 -- start start 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.257+0000 7f0029bf1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c0047c0 0x7f002406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.257+0000 7f0029bf1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f002414a250 0x7f00240ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.257+0000 7f0029bf1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00240aa6d0 0x7f00240aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.257+0000 7f0029bf1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240ad540 con 0x7f00240aa6d0 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.257+0000 7f0029bf1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240ac930 con 0x7f000c0047c0 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.257+0000 7f0029bf1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240acc10 con 0x7f002414a250 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00240aa6d0 0x7f00240aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00240aa6d0 0x7f00240aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38236/0 (socket says 172.21.15.113:38236) 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 -- 172.21.15.113:0/1500252344 learned_addr learned my addr 172.21.15.113:0/1500252344 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f00237fe640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c0047c0 0x7f002406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 -- 172.21.15.113:0/1500252344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f002414a250 msgr2=0x7f00240ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f002414a250 0x7f00240ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 -- 172.21.15.113:0/1500252344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c0047c0 msgr2=0x7f002406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c0047c0 0x7f002406dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 -- 172.21.15.113:0/1500252344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240acef0 con 0x7f00240aa6d0 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.258+0000 7f0023fff640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00240aa6d0 0x7f00240aab50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f00240b29b0 tx=0x7f001c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.259+0000 7f000bfff640 1 -- 172.21.15.113:0/1500252344 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c004d70 con 0x7f00240aa6d0 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.259+0000 7f000bfff640 1 -- 172.21.15.113:0/1500252344 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c00a610 con 0x7f00240aa6d0 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.259+0000 7f000bfff640 1 -- 172.21.15.113:0/1500252344 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c00a9c0 con 0x7f00240aa6d0 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.259+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00240ad1d0 con 0x7f00240aa6d0 2023-12-19T13:52:41.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.259+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00240cd470 con 0x7f00240aa6d0 2023-12-19T13:52:41.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.260+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0024061910 con 0x7f00240aa6d0 2023-12-19T13:52:41.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.261+0000 7f000bfff640 1 -- 172.21.15.113:0/1500252344 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f001c00ab20 con 0x7f00240aa6d0 2023-12-19T13:52:41.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.262+0000 7f000bfff640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f001006a430 0x7f001006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.262+0000 7f000bfff640 1 -- 172.21.15.113:0/1500252344 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f001c088100 con 0x7f00240aa6d0 2023-12-19T13:52:41.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.262+0000 7f00237fe640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f001006a430 0x7f001006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.263+0000 7f00237fe640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f001006a430 0x7f001006c8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0014006fd0 tx=0x7f0014008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:41.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.266+0000 7f000bfff640 1 -- 172.21.15.113:0/1500252344 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f001c0536f0 con 0x7f00240aa6d0 2023-12-19T13:52:41.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.454+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00240cc0d0 con 0x7f00240aa6d0 2023-12-19T13:52:41.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.456+0000 7f000bfff640 1 -- 172.21.15.113:0/1500252344 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16177 (secure 0 0 0) 0x7f001c056d10 con 0x7f00240aa6d0 2023-12-19T13:52:41.456 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:41.456 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":112,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:40.567888+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f001006a430 msgr2=0x7f001006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f001006a430 0x7f001006c8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0014006fd0 tx=0x7f0014008040 comp rx=0 tx=0).stop 2023-12-19T13:52:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00240aa6d0 msgr2=0x7f00240aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00240aa6d0 0x7f00240aab50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f00240b29b0 tx=0x7f001c00cc50 comp rx=0 tx=0).stop 2023-12-19T13:52:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 shutdown_connections 2023-12-19T13:52:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f001006a430 0x7f001006c8f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00240aa6d0 0x7f00240aab50 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f002414a250 0x7f00240ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.458+0000 7f0029bf1640 1 --2- 172.21.15.113:0/1500252344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f000c0047c0 0x7f002406dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.459+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 >> 172.21.15.113:0/1500252344 conn(0x7f00240cbb70 msgr2=0x7f00240ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.459+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 shutdown_connections 2023-12-19T13:52:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.459+0000 7f0029bf1640 1 -- 172.21.15.113:0/1500252344 wait complete. 2023-12-19T13:52:41.477 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:52:41.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.679+0000 7f16b1b5c640 1 Processor -- start 2023-12-19T13:52:41.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.679+0000 7f16b1b5c640 1 -- start start 2023-12-19T13:52:41.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16b1b5c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f16ac157bf0 0x7f16ac15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16b1b5c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16ac0ae110 0x7f16ac0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16b1b5c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac0b0a60 con 0x7f16ac0b0640 2023-12-19T13:52:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16b1b5c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac06b8c0 con 0x7f16ac157bf0 2023-12-19T13:52:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16b1b5c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac15b740 con 0x7f16ac0ae110 2023-12-19T13:52:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16ab7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f16ac157bf0 0x7f16ac15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16ab7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f16ac157bf0 0x7f16ac15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38244/0 (socket says 172.21.15.113:38244) 2023-12-19T13:52:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16ab7fe640 1 -- 172.21.15.113:0/2242860994 learned_addr learned my addr 172.21.15.113:0/2242860994 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.681+0000 7f16aaffd640 1 --2- 172.21.15.113:0/2242860994 >> v2:172.21.15.151:3300/0 conn(0x7f16ac0ae110 0x7f16ac0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.682+0000 7f16ab7fe640 1 -- 172.21.15.113:0/2242860994 >> v2:172.21.15.151:3300/0 conn(0x7f16ac0ae110 msgr2=0x7f16ac0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:41.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.682+0000 7f16ab7fe640 1 --2- 172.21.15.113:0/2242860994 >> v2:172.21.15.151:3300/0 conn(0x7f16ac0ae110 0x7f16ac0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.682+0000 7f16ab7fe640 1 -- 172.21.15.113:0/2242860994 >> v1:172.21.15.113:6789/0 conn(0x7f16ac0b0640 legacy=0x7f16ac15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.682+0000 7f16ab7fe640 1 -- 172.21.15.113:0/2242860994 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0ae640 con 0x7f16ac157bf0 2023-12-19T13:52:41.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.682+0000 7f16aa7fc640 1 -- 172.21.15.113:0/2242860994 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38290307 0 0) 0x7f16ac0b0a60 con 0x7f16ac0b0640 2023-12-19T13:52:41.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.683+0000 7f16ab7fe640 1 --2- 172.21.15.113:0/2242860994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac15b200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0af4b0 tx=0x7f169c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c4c20f123088df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:41.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.683+0000 7f16aa7fc640 1 -- 172.21.15.113:0/2242860994 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c036440 con 0x7f16ac157bf0 2023-12-19T13:52:41.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.683+0000 7f16aa7fc640 1 -- 172.21.15.113:0/2242860994 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c0365a0 con 0x7f16ac157bf0 2023-12-19T13:52:41.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.683+0000 7f16aa7fc640 1 -- 172.21.15.113:0/2242860994 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c036930 con 0x7f16ac157bf0 2023-12-19T13:52:41.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 -- 172.21.15.113:0/2242860994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 msgr2=0x7f16ac15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/2242860994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac15b200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0af4b0 tx=0x7f169c02e170 comp rx=0 tx=0).stop 2023-12-19T13:52:41.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 -- 172.21.15.113:0/2242860994 shutdown_connections 2023-12-19T13:52:41.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/2242860994 >> v2:172.21.15.151:3300/0 conn(0x7f16ac0ae110 0x7f16ac0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/2242860994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac15b200 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 -- 172.21.15.113:0/2242860994 >> 172.21.15.113:0/2242860994 conn(0x7f16ac0cbb70 msgr2=0x7f16ac0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:41.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 -- 172.21.15.113:0/2242860994 shutdown_connections 2023-12-19T13:52:41.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.684+0000 7f16b1b5c640 1 -- 172.21.15.113:0/2242860994 wait complete. 2023-12-19T13:52:41.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.685+0000 7f16b1b5c640 1 Processor -- start 2023-12-19T13:52:41.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.686+0000 7f16b1b5c640 1 -- start start 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.686+0000 7f16b1b5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ac0ae110 0x7f16ac154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.686+0000 7f16b1b5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ac0b0640 0x7f16ac06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.686+0000 7f16b1b5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac06e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.686+0000 7f16b1b5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac159e00 con 0x7f16ac157bf0 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.686+0000 7f16b1b5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0cab10 con 0x7f16ac0b0640 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.686+0000 7f16b1b5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac154ad0 con 0x7f16ac0ae110 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac06e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac06e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38246/0 (socket says 172.21.15.113:38246) 2023-12-19T13:52:41.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 -- 172.21.15.113:0/4123935975 learned_addr learned my addr 172.21.15.113:0/4123935975 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:41.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16aaffd640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ac0b0640 0x7f16ac06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 -- 172.21.15.113:0/4123935975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ac0ae110 msgr2=0x7f16ac154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ac0ae110 0x7f16ac154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 -- 172.21.15.113:0/4123935975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ac0b0640 msgr2=0x7f16ac06db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ac0b0640 0x7f16ac06db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 -- 172.21.15.113:0/4123935975 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c00b770 con 0x7f16ac157bf0 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.687+0000 7f16abfff640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac06e080 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f16a400c7e0 tx=0x7f16a400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.688+0000 7f1693fff640 1 -- 172.21.15.113:0/4123935975 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4003da0 con 0x7f16ac157bf0 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.688+0000 7f1693fff640 1 -- 172.21.15.113:0/4123935975 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4005070 con 0x7f16ac157bf0 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.688+0000 7f1693fff640 1 -- 172.21.15.113:0/4123935975 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4005420 con 0x7f16ac157bf0 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.688+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac158150 con 0x7f16ac157bf0 2023-12-19T13:52:41.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.688+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac158710 con 0x7f16ac157bf0 2023-12-19T13:52:41.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.689+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac061910 con 0x7f16ac157bf0 2023-12-19T13:52:41.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.690+0000 7f1693fff640 1 -- 172.21.15.113:0/4123935975 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f16a4005580 con 0x7f16ac157bf0 2023-12-19T13:52:41.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.691+0000 7f1693fff640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f169806a430 0x7f169806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:41.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.691+0000 7f1693fff640 1 -- 172.21.15.113:0/4123935975 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16a40881e0 con 0x7f16ac157bf0 2023-12-19T13:52:41.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.691+0000 7f16ab7fe640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f169806a430 0x7f169806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:41.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.691+0000 7f16ab7fe640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f169806a430 0x7f169806c8f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f169c038000 tx=0x7f169c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:41.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.695+0000 7f1693fff640 1 -- 172.21.15.113:0/4123935975 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f16a40537c0 con 0x7f16ac157bf0 2023-12-19T13:52:41.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:41.905+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f16ac06cad0 con 0x7f16ac157bf0 2023-12-19T13:52:42.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.589+0000 7f1693fff640 1 -- 172.21.15.113:0/4123935975 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7f16a40170b0 con 0x7f16ac157bf0 2023-12-19T13:52:42.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.592+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f169806a430 msgr2=0x7f169806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:42.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.592+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f169806a430 0x7f169806c8f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f169c038000 tx=0x7f169c030000 comp rx=0 tx=0).stop 2023-12-19T13:52:42.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.592+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 msgr2=0x7f16ac06e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:42.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.592+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac06e080 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f16a400c7e0 tx=0x7f16a400cca0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 shutdown_connections 2023-12-19T13:52:42.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f169806a430 0x7f169806c8f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16ac157bf0 0x7f16ac06e080 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ac0b0640 0x7f16ac06db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 --2- 172.21.15.113:0/4123935975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ac0ae110 0x7f16ac154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 >> 172.21.15.113:0/4123935975 conn(0x7f16ac0cbb70 msgr2=0x7f16ac0cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:42.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 shutdown_connections 2023-12-19T13:52:42.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.593+0000 7f16b1b5c640 1 -- 172.21.15.113:0/4123935975 wait complete. 2023-12-19T13:52:42.613 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:52:42.613 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:52:42.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.832+0000 7f6a17fff640 1 Processor -- start 2023-12-19T13:52:42.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.832+0000 7f6a17fff640 1 -- start start 2023-12-19T13:52:42.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.834+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 0x7f6a180b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:42.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.834+0000 7f6a17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a180b0a00 0x7f6a1806b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:42.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.834+0000 7f6a17fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1806b3a0 con 0x7f6a180cd430 2023-12-19T13:52:42.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.834+0000 7f6a17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180b23e0 con 0x7f6a180b0a00 2023-12-19T13:52:42.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.834+0000 7f6a17fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180b1860 con 0x7f6a18159e40 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a177fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a180b0a00 0x7f6a1806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a177fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a180b0a00 0x7f6a1806b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38260/0 (socket says 172.21.15.113:38260) 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a177fe640 1 -- 172.21.15.113:0/370747817 learned_addr learned my addr 172.21.15.113:0/370747817 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a16ffd640 1 --2- 172.21.15.113:0/370747817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 0x7f6a180b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a177fe640 1 -- 172.21.15.113:0/370747817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 msgr2=0x7f6a180b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a177fe640 1 --2- 172.21.15.113:0/370747817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 0x7f6a180b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a177fe640 1 -- 172.21.15.113:0/370747817 >> v1:172.21.15.151:6789/0 conn(0x7f6a180cd430 legacy=0x7f6a180b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.835+0000 7f6a177fe640 1 -- 172.21.15.113:0/370747817 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180b1b40 con 0x7f6a180b0a00 2023-12-19T13:52:42.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.836+0000 7f6a177fe640 1 --2- 172.21.15.113:0/370747817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180b0a00 0x7f6a1806b810 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009e50 tx=0x7f6a1002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b60edc5c3e8ae4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a15ffb640 1 -- 172.21.15.113:0/370747817 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1002cb00 con 0x7f6a180b0a00 2023-12-19T13:52:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a15ffb640 1 -- 172.21.15.113:0/370747817 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1002cc60 con 0x7f6a180b0a00 2023-12-19T13:52:42.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a15ffb640 1 -- 172.21.15.113:0/370747817 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a100343f0 con 0x7f6a180b0a00 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a17fff640 1 -- 172.21.15.113:0/370747817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180b0a00 msgr2=0x7f6a1806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a17fff640 1 --2- 172.21.15.113:0/370747817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180b0a00 0x7f6a1806b810 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009e50 tx=0x7f6a1002bf60 comp rx=0 tx=0).stop 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a17fff640 1 -- 172.21.15.113:0/370747817 shutdown_connections 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a17fff640 1 --2- 172.21.15.113:0/370747817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180b0a00 0x7f6a1806b810 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a17fff640 1 --2- 172.21.15.113:0/370747817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 0x7f6a180b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.837+0000 7f6a17fff640 1 -- 172.21.15.113:0/370747817 >> 172.21.15.113:0/370747817 conn(0x7f6a180659a0 msgr2=0x7f6a18065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.838+0000 7f6a17fff640 1 -- 172.21.15.113:0/370747817 shutdown_connections 2023-12-19T13:52:42.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.838+0000 7f6a17fff640 1 -- 172.21.15.113:0/370747817 wait complete. 2023-12-19T13:52:42.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.839+0000 7f6a17fff640 1 Processor -- start 2023-12-19T13:52:42.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.839+0000 7f6a17fff640 1 -- start start 2023-12-19T13:52:42.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.840+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a180b0a00 0x7f6a1814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.840+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180cd430 0x7f6a1815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.840+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 0x7f6a181f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.840+0000 7f6a17fff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1815a220 con 0x7f6a180cd430 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.840+0000 7f6a17fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1815d060 con 0x7f6a180b0a00 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.840+0000 7f6a17fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1814d790 con 0x7f6a18159e40 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180cd430 0x7f6a1815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180cd430 0x7f6a1815cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38272/0 (socket says 172.21.15.113:38272) 2023-12-19T13:52:42.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 -- 172.21.15.113:0/4212900997 learned_addr learned my addr 172.21.15.113:0/4212900997 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a16ffd640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a180b0a00 0x7f6a1814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 -- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 msgr2=0x7f6a181f0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 0x7f6a181f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 -- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a180b0a00 msgr2=0x7f6a1814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a180b0a00 0x7f6a1814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 -- 172.21.15.113:0/4212900997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10009b30 con 0x7f6a180cd430 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a16ffd640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a180b0a00 0x7f6a1814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:42.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.841+0000 7f6a167fc640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180cd430 0x7f6a1815cb20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c430 tx=0x7f6a0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:42.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.842+0000 7f6a0f7fe640 1 -- 172.21.15.113:0/4212900997 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00011790 con 0x7f6a180cd430 2023-12-19T13:52:42.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.842+0000 7f6a0f7fe640 1 -- 172.21.15.113:0/4212900997 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000118f0 con 0x7f6a180cd430 2023-12-19T13:52:42.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.842+0000 7f6a0f7fe640 1 -- 172.21.15.113:0/4212900997 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00011ce0 con 0x7f6a180cd430 2023-12-19T13:52:42.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.842+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1814da70 con 0x7f6a180cd430 2023-12-19T13:52:42.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.842+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1814e030 con 0x7f6a180cd430 2023-12-19T13:52:42.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.843+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1815a3d0 con 0x7f6a180cd430 2023-12-19T13:52:42.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.844+0000 7f6a0f7fe640 1 -- 172.21.15.113:0/4212900997 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6a0001c460 con 0x7f6a180cd430 2023-12-19T13:52:42.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.845+0000 7f6a0f7fe640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69f806a430 0x7f69f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:42.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.845+0000 7f6a0f7fe640 1 -- 172.21.15.113:0/4212900997 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a000888f0 con 0x7f6a180cd430 2023-12-19T13:52:42.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.845+0000 7f6a16ffd640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69f806a430 0x7f69f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:42.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.846+0000 7f6a16ffd640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69f806a430 0x7f69f806c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800b820 tx=0x7f6a08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:42.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:42.849+0000 7f6a0f7fe640 1 -- 172.21.15.113:0/4212900997 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6a1815a3d0 con 0x7f6a180cd430 2023-12-19T13:52:43.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.079+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6a1815a3d0 con 0x7f6a180cd430 2023-12-19T13:52:43.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.591+0000 7f6a0f7fe640 1 -- 172.21.15.113:0/4212900997 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6a00053ed0 con 0x7f6a180cd430 2023-12-19T13:52:43.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.594+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69f806a430 msgr2=0x7f69f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.594+0000 7f6a17fff640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69f806a430 0x7f69f806c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800b820 tx=0x7f6a08008040 comp rx=0 tx=0).stop 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.594+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180cd430 msgr2=0x7f6a1815cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.594+0000 7f6a17fff640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180cd430 0x7f6a1815cb20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c430 tx=0x7f6a0000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.594+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 shutdown_connections 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.594+0000 7f6a17fff640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69f806a430 0x7f69f806c8f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.594+0000 7f6a17fff640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a18159e40 0x7f6a181f0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.595+0000 7f6a17fff640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a180cd430 0x7f6a1815cb20 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.595+0000 7f6a17fff640 1 --2- 172.21.15.113:0/4212900997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a180b0a00 0x7f6a1814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.595+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 >> 172.21.15.113:0/4212900997 conn(0x7f6a180659a0 msgr2=0x7f6a18157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.595+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 shutdown_connections 2023-12-19T13:52:43.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.595+0000 7f6a17fff640 1 -- 172.21.15.113:0/4212900997 wait complete. 2023-12-19T13:52:43.615 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:52:43.616 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:43.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.823+0000 7f2c25234640 1 Processor -- start 2023-12-19T13:52:43.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.823+0000 7f2c25234640 1 -- start start 2023-12-19T13:52:43.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.825+0000 7f2c25234640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2c200b8070 0x7f2c200d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:43.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.825+0000 7f2c25234640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c2015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:43.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.825+0000 7f2c25234640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c200d12d0 con 0x7f2c20146e30 2023-12-19T13:52:43.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.825+0000 7f2c25234640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c20147210 con 0x7f2c200b8070 2023-12-19T13:52:43.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.825+0000 7f2c25234640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200d2370 con 0x7f2c200d0a90 2023-12-19T13:52:43.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c1f7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2c200b8070 0x7f2c200d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:43.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c24a33640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c2015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:43.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c1f7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2c200b8070 0x7f2c200d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49460/0 (socket says 172.21.15.113:49460) 2023-12-19T13:52:43.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c1f7fe640 1 -- 172.21.15.113:0/2183784094 learned_addr learned my addr 172.21.15.113:0/2183784094 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:43.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c1f7fe640 1 -- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 msgr2=0x7f2c2015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:43.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c1f7fe640 1 --2- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c2015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c1f7fe640 1 -- 172.21.15.113:0/2183784094 >> v1:172.21.15.151:6789/0 conn(0x7f2c20146e30 legacy=0x7f2c200b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:43.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c1f7fe640 1 -- 172.21.15.113:0/2183784094 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c200d15b0 con 0x7f2c200b8070 2023-12-19T13:52:43.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.826+0000 7f2c24a33640 1 --2- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c2015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:52:43.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.828+0000 7f2c1f7fe640 1 --2- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c200b8070 0x7f2c200d0550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009870 tx=0x7f2c0802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627eff4af55a984f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:43.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.828+0000 7f2c1effd640 1 -- 172.21.15.113:0/2183784094 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08031640 con 0x7f2c200b8070 2023-12-19T13:52:43.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.828+0000 7f2c1effd640 1 -- 172.21.15.113:0/2183784094 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080317a0 con 0x7f2c200b8070 2023-12-19T13:52:43.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.828+0000 7f2c1effd640 1 -- 172.21.15.113:0/2183784094 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08031b30 con 0x7f2c200b8070 2023-12-19T13:52:43.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 -- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c200b8070 msgr2=0x7f2c200d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:43.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 --2- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c200b8070 0x7f2c200d0550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009870 tx=0x7f2c0802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 -- 172.21.15.113:0/2183784094 shutdown_connections 2023-12-19T13:52:43.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 --2- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c2015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 --2- 172.21.15.113:0/2183784094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c200b8070 0x7f2c200d0550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 -- 172.21.15.113:0/2183784094 >> 172.21.15.113:0/2183784094 conn(0x7f2c200b2990 msgr2=0x7f2c200b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:43.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 -- 172.21.15.113:0/2183784094 shutdown_connections 2023-12-19T13:52:43.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.829+0000 7f2c25234640 1 -- 172.21.15.113:0/2183784094 wait complete. 2023-12-19T13:52:43.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.831+0000 7f2c25234640 1 Processor -- start 2023-12-19T13:52:43.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.831+0000 7f2c25234640 1 -- start start 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c25234640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c200b8070 0x7f2c201e4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c25234640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c201e2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c25234640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20146e30 0x7f2c201e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c25234640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2013f270 con 0x7f2c200b8070 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c25234640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200b5550 con 0x7f2c20146e30 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c25234640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2013e9d0 con 0x7f2c200d0a90 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c200b8070 0x7f2c201e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c200b8070 0x7f2c201e4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38288/0 (socket says 172.21.15.113:38288) 2023-12-19T13:52:43.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.832+0000 7f2c1ffff640 1 -- 172.21.15.113:0/1421680288 learned_addr learned my addr 172.21.15.113:0/1421680288 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:43.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1f7fe640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c201e2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:43.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c24a33640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20146e30 0x7f2c201e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:43.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1ffff640 1 -- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 msgr2=0x7f2c201e2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:43.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1ffff640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c201e2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1ffff640 1 -- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20146e30 msgr2=0x7f2c201e2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:43.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1ffff640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20146e30 0x7f2c201e2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:43.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1ffff640 1 -- 172.21.15.113:0/1421680288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18009400 con 0x7f2c200b8070 2023-12-19T13:52:43.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1ffff640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c200b8070 0x7f2c201e4270 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c730 tx=0x7f2c1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1cff9640 1 -- 172.21.15.113:0/1421680288 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10003b70 con 0x7f2c200b8070 2023-12-19T13:52:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1cff9640 1 -- 172.21.15.113:0/1421680288 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c10003cf0 con 0x7f2c200b8070 2023-12-19T13:52:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c080094d0 con 0x7f2c200b8070 2023-12-19T13:52:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c1cff9640 1 -- 172.21.15.113:0/1421680288 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10003ea0 con 0x7f2c200b8070 2023-12-19T13:52:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.833+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2013ef90 con 0x7f2c200b8070 2023-12-19T13:52:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.834+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c20061910 con 0x7f2c200b8070 2023-12-19T13:52:43.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.835+0000 7f2c1cff9640 1 -- 172.21.15.113:0/1421680288 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c1000aa90 con 0x7f2c200b8070 2023-12-19T13:52:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.837+0000 7f2c1cff9640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c0006a430 0x7f2c0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.837+0000 7f2c1cff9640 1 -- 172.21.15.113:0/1421680288 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c10088730 con 0x7f2c200b8070 2023-12-19T13:52:43.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.837+0000 7f2c1f7fe640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c0006a430 0x7f2c0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:43.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.838+0000 7f2c1f7fe640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c0006a430 0x7f2c0006c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2c08036000 tx=0x7f2c0803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:43.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:43.842+0000 7f2c1cff9640 1 -- 172.21.15.113:0/1421680288 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2c10053d20 con 0x7f2c200b8070 2023-12-19T13:52:44.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.066+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c200b5080 con 0x7f2c200b8070 2023-12-19T13:52:44.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.067+0000 7f2c1cff9640 1 -- 172.21.15.113:0/1421680288 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f2c10057340 con 0x7f2c200b8070 2023-12-19T13:52:44.067 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:44.067 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:52:44.067 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:52:44.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c0006a430 msgr2=0x7f2c0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c0006a430 0x7f2c0006c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2c08036000 tx=0x7f2c0803c040 comp rx=0 tx=0).stop 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c200b8070 msgr2=0x7f2c201e4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c200b8070 0x7f2c201e4270 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c730 tx=0x7f2c1000cbf0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 shutdown_connections 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c0006a430 0x7f2c0006c8f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20146e30 0x7f2c201e2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c200d0a90 0x7f2c201e2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 --2- 172.21.15.113:0/1421680288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c200b8070 0x7f2c201e4270 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 >> 172.21.15.113:0/1421680288 conn(0x7f2c200b2990 msgr2=0x7f2c201e7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 shutdown_connections 2023-12-19T13:52:44.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.070+0000 7f2c25234640 1 -- 172.21.15.113:0/1421680288 wait complete. 2023-12-19T13:52:44.089 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:52:44.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.300+0000 7f4405e95640 1 Processor -- start 2023-12-19T13:52:44.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.301+0000 7f4405e95640 1 -- start start 2023-12-19T13:52:44.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.302+0000 7f4405e95640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.302+0000 7f4405e95640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f440015f680 0x7f44000b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.302+0000 7f4405e95640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440015ec30 con 0x7f44000cdbf0 2023-12-19T13:52:44.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.302+0000 7f4405e95640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44000b2cc0 con 0x7f440015f680 2023-12-19T13:52:44.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.302+0000 7f4405e95640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440015e980 con 0x7f440015e5a0 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f4405694640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f44000cdbf0 0x7f440006c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42984/0 (socket says 172.21.15.113:42984) 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f4405694640 1 -- 172.21.15.113:0/376657270 learned_addr learned my addr 172.21.15.113:0/376657270 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f43fffff640 1 --2- 172.21.15.113:0/376657270 >> v2:172.21.15.113:3300/0 conn(0x7f440015f680 0x7f44000b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f4404e93640 1 --2- 172.21.15.113:0/376657270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f43ff7fe640 1 -- 172.21.15.113:0/376657270 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650057800 0 0) 0x7f440015ec30 con 0x7f44000cdbf0 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f43ff7fe640 1 -- 172.21.15.113:0/376657270 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ec003520 con 0x7f44000cdbf0 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f43fffff640 1 -- 172.21.15.113:0/376657270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 msgr2=0x7f44000b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.303+0000 7f43fffff640 1 --2- 172.21.15.113:0/376657270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.304+0000 7f43ff7fe640 1 -- 172.21.15.113:0/376657270 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1029772937 0 0) 0x7f43ec003520 con 0x7f44000cdbf0 2023-12-19T13:52:44.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.304+0000 7f43fffff640 1 -- 172.21.15.113:0/376657270 >> v1:172.21.15.113:6789/0 conn(0x7f44000cdbf0 legacy=0x7f440006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.304+0000 7f43fffff640 1 -- 172.21.15.113:0/376657270 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000b2f90 con 0x7f440015f680 2023-12-19T13:52:44.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.305+0000 7f43fffff640 1 --2- 172.21.15.113:0/376657270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f44000b2780 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009d90 tx=0x7f43f002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da4a1c4f0604aa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:44.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.305+0000 7f43ff7fe640 1 -- 172.21.15.113:0/376657270 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8001670 con 0x7f440015f680 2023-12-19T13:52:44.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.305+0000 7f43ff7fe640 1 -- 172.21.15.113:0/376657270 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f002c8a0 con 0x7f440015f680 2023-12-19T13:52:44.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.305+0000 7f43ff7fe640 1 -- 172.21.15.113:0/376657270 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f002cc30 con 0x7f440015f680 2023-12-19T13:52:44.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.305+0000 7f4405e95640 1 -- 172.21.15.113:0/376657270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 msgr2=0x7f44000b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.305+0000 7f4405e95640 1 --2- 172.21.15.113:0/376657270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f44000b2780 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009d90 tx=0x7f43f002bd70 comp rx=0 tx=0).stop 2023-12-19T13:52:44.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.306+0000 7f4405e95640 1 -- 172.21.15.113:0/376657270 shutdown_connections 2023-12-19T13:52:44.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.306+0000 7f4405e95640 1 --2- 172.21.15.113:0/376657270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f44000b2780 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.306+0000 7f4405e95640 1 --2- 172.21.15.113:0/376657270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.306+0000 7f4405e95640 1 -- 172.21.15.113:0/376657270 >> 172.21.15.113:0/376657270 conn(0x7f44000b0100 msgr2=0x7f44000b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:44.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.306+0000 7f4405e95640 1 -- 172.21.15.113:0/376657270 shutdown_connections 2023-12-19T13:52:44.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.306+0000 7f4405e95640 1 -- 172.21.15.113:0/376657270 wait complete. 2023-12-19T13:52:44.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.307+0000 7f4405e95640 1 Processor -- start 2023-12-19T13:52:44.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.308+0000 7f4405e95640 1 -- start start 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.308+0000 7f4405e95640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44000cdbf0 0x7f44000a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405e95640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405e95640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f4400148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405e95640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44000cc300 con 0x7f440015f680 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405e95640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44000cc550 con 0x7f44000cdbf0 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405e95640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44000cc830 con 0x7f440015e5a0 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f4400148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f4400148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38304/0 (socket says 172.21.15.113:38304) 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 -- 172.21.15.113:0/2217453902 learned_addr learned my addr 172.21.15.113:0/2217453902 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:44.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4404e93640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44000cdbf0 0x7f44000a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f43fffff640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 -- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 msgr2=0x7f44000cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 -- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44000cdbf0 msgr2=0x7f44000a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44000cdbf0 0x7f44000a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4405694640 1 -- 172.21.15.113:0/2217453902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009a70 con 0x7f440015f680 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.309+0000 7f4404e93640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44000cdbf0 0x7f44000a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:44.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.310+0000 7f4405694640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f4400148260 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c750 tx=0x7f43f800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:44.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.310+0000 7f43fd7fa640 1 -- 172.21.15.113:0/2217453902 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8005ad0 con 0x7f440015f680 2023-12-19T13:52:44.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.310+0000 7f43fd7fa640 1 -- 172.21.15.113:0/2217453902 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f8005c30 con 0x7f440015f680 2023-12-19T13:52:44.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.310+0000 7f43fd7fa640 1 -- 172.21.15.113:0/2217453902 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8007070 con 0x7f440015f680 2023-12-19T13:52:44.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.310+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44000ccb10 con 0x7f440015f680 2023-12-19T13:52:44.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.310+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44000a9d00 con 0x7f440015f680 2023-12-19T13:52:44.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.312+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44000cd030 con 0x7f440015f680 2023-12-19T13:52:44.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.312+0000 7f43fd7fa640 1 -- 172.21.15.113:0/2217453902 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43f80071d0 con 0x7f440015f680 2023-12-19T13:52:44.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.313+0000 7f43fd7fa640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f43e006a480 0x7f43e006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.313+0000 7f43fd7fa640 1 -- 172.21.15.113:0/2217453902 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43f8088540 con 0x7f440015f680 2023-12-19T13:52:44.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.314+0000 7f4404e93640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f43e006a480 0x7f43e006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.314+0000 7f4404e93640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f43e006a480 0x7f43e006c940 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009ac0 tx=0x7f43e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:44.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.318+0000 7f43fd7fa640 1 -- 172.21.15.113:0/2217453902 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f44000cd030 con 0x7f440015f680 2023-12-19T13:52:44.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.509+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44000cd030 con 0x7f440015f680 2023-12-19T13:52:44.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.512+0000 7f43fd7fa640 1 -- 172.21.15.113:0/2217453902 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16164 (secure 0 0 0) 0x7f44000cd030 con 0x7f440015f680 2023-12-19T13:52:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:44.512 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":113,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:52:41.572548+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:52:44.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f43e006a480 msgr2=0x7f43e006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f43e006a480 0x7f43e006c940 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009ac0 tx=0x7f43e8008040 comp rx=0 tx=0).stop 2023-12-19T13:52:44.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 msgr2=0x7f4400148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f4400148260 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c750 tx=0x7f43f800cc10 comp rx=0 tx=0).stop 2023-12-19T13:52:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 shutdown_connections 2023-12-19T13:52:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f43e006a480 0x7f43e006c940 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f440015f680 0x7f4400148260 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f440015e5a0 0x7f44000cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 --2- 172.21.15.113:0/2217453902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44000cdbf0 0x7f44000a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 >> 172.21.15.113:0/2217453902 conn(0x7f44000b0100 msgr2=0x7f44000b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:44.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 shutdown_connections 2023-12-19T13:52:44.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.515+0000 7f4405e95640 1 -- 172.21.15.113:0/2217453902 wait complete. 2023-12-19T13:52:44.535 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:52:44.535 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:52:44.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.747+0000 7f35cccca640 1 Processor -- start 2023-12-19T13:52:44.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.747+0000 7f35cccca640 1 -- start start 2023-12-19T13:52:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.748+0000 7f35cccca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35c80ae110 0x7f35c80b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35cccca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f35c80b0640 0x7f35c806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35cccca640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c80b0a90 con 0x7f35c8157bf0 2023-12-19T13:52:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35cccca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c806b8c0 con 0x7f35c80b0640 2023-12-19T13:52:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35cccca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80ae640 con 0x7f35c80ae110 2023-12-19T13:52:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35c659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f35c8157bf0 0x7f35c815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42990/0 (socket says 172.21.15.113:42990) 2023-12-19T13:52:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35c659c640 1 -- 172.21.15.113:0/726700008 learned_addr learned my addr 172.21.15.113:0/726700008 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:44.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978269781 0 0) 0x7f35b8001110 con 0x7f35c8157bf0 2023-12-19T13:52:44.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b0005730 con 0x7f35c8157bf0 2023-12-19T13:52:44.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35c5d9b640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35c80ae110 0x7f35c80b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.749+0000 7f35c6d9d640 1 --2- 172.21.15.113:0/726700008 >> v2:172.21.15.151:3300/0 conn(0x7f35c80b0640 0x7f35c806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124776190 0 0) 0x7f35b0005730 con 0x7f35c8157bf0 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35c80ae110 msgr2=0x7f35c80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35c80ae110 0x7f35c80b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 >> v2:172.21.15.151:3300/0 conn(0x7f35c80b0640 msgr2=0x7f35c806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 --2- 172.21.15.113:0/726700008 >> v2:172.21.15.151:3300/0 conn(0x7f35c80b0640 0x7f35c806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c80ae920 con 0x7f35c8157bf0 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f35b8001800 con 0x7f35c8157bf0 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 >> v1:172.21.15.113:6789/0 conn(0x7f35c8157bf0 legacy=0x7f35c815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35b0005bf0 0x7f35b0006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35b00069d0 0x7f35b0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35c80ae110 0x7f35b0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c806b8c0 con 0x7f35b00069d0 2023-12-19T13:52:44.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80ae640 con 0x7f35b0005bf0 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b000dcc0 con 0x7f35c80ae110 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c5d9b640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35b00069d0 0x7f35b0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c659c640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35b0005bf0 0x7f35b0006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c5d9b640 1 -- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35c80ae110 msgr2=0x7f35b0007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c5d9b640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35c80ae110 0x7f35b0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c5d9b640 1 -- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35b0005bf0 msgr2=0x7f35b0006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c5d9b640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35b0005bf0 0x7f35b0006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c5d9b640 1 -- 172.21.15.113:0/726700008 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0005730 con 0x7f35b00069d0 2023-12-19T13:52:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.750+0000 7f35c659c640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35b0005bf0 0x7f35b0006010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:44.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35c5d9b640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35b00069d0 0x7f35b0006e50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f35c80ae570 tx=0x7f35b0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e634a91f7e611a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:44.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc0325f0 con 0x7f35b00069d0 2023-12-19T13:52:44.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc032750 con 0x7f35b00069d0 2023-12-19T13:52:44.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35c559a640 1 -- 172.21.15.113:0/726700008 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc032ae0 con 0x7f35b00069d0 2023-12-19T13:52:44.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35cccca640 1 -- 172.21.15.113:0/726700008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35b00069d0 msgr2=0x7f35b0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35cccca640 1 --2- 172.21.15.113:0/726700008 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35b00069d0 0x7f35b0006e50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f35c80ae570 tx=0x7f35b0007a00 comp rx=0 tx=0).stop 2023-12-19T13:52:44.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35c6d9d640 1 -- 172.21.15.113:0/726700008 reap_dead start 2023-12-19T13:52:44.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35cccca640 1 -- 172.21.15.113:0/726700008 shutdown_connections 2023-12-19T13:52:44.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.752+0000 7f35cccca640 1 -- 172.21.15.113:0/726700008 >> 172.21.15.113:0/726700008 conn(0x7f35c80cbb70 msgr2=0x7f35c80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:44.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.753+0000 7f35cccca640 1 -- 172.21.15.113:0/726700008 shutdown_connections 2023-12-19T13:52:44.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.753+0000 7f35cccca640 1 -- 172.21.15.113:0/726700008 wait complete. 2023-12-19T13:52:44.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.754+0000 7f35cccca640 1 Processor -- start 2023-12-19T13:52:44.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.754+0000 7f35cccca640 1 -- start start 2023-12-19T13:52:44.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.755+0000 7f35cccca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35b00069d0 0x7f35c814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.755+0000 7f35cccca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c815c260 0x7f35c815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.755+0000 7f35cccca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35c80ac8b0 0x7f35c80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.755+0000 7f35cccca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c814ed80 con 0x7f35c80ac8b0 2023-12-19T13:52:44.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.755+0000 7f35cccca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80ad270 con 0x7f35c815c260 2023-12-19T13:52:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.755+0000 7f35cccca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80c2b90 con 0x7f35b00069d0 2023-12-19T13:52:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35c80ac8b0 0x7f35c80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35c80ac8b0 0x7f35c80acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38320/0 (socket says 172.21.15.113:38320) 2023-12-19T13:52:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 -- 172.21.15.113:0/226556767 learned_addr learned my addr 172.21.15.113:0/226556767 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c659c640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35b00069d0 0x7f35c814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c5d9b640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c815c260 0x7f35c815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 -- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35b00069d0 msgr2=0x7f35c814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35b00069d0 0x7f35c814e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 -- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c815c260 msgr2=0x7f35c815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c815c260 0x7f35c815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 -- 172.21.15.113:0/226556767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c815cdd0 con 0x7f35c80ac8b0 2023-12-19T13:52:44.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c5d9b640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c815c260 0x7f35c815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:44.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.756+0000 7f35c6d9d640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35c80ac8b0 0x7f35c80acd30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f35c80b29b0 tx=0x7f35c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:44.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.757+0000 7f35b6ffd640 1 -- 172.21.15.113:0/226556767 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c000ed30 con 0x7f35c80ac8b0 2023-12-19T13:52:44.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.757+0000 7f35b6ffd640 1 -- 172.21.15.113:0/226556767 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c000eeb0 con 0x7f35c80ac8b0 2023-12-19T13:52:44.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.757+0000 7f35b6ffd640 1 -- 172.21.15.113:0/226556767 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0014620 con 0x7f35c80ac8b0 2023-12-19T13:52:44.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.757+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c815d0b0 con 0x7f35c80ac8b0 2023-12-19T13:52:44.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.757+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c815d670 con 0x7f35c80ac8b0 2023-12-19T13:52:44.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.758+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c815d830 con 0x7f35c80ac8b0 2023-12-19T13:52:44.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.759+0000 7f35b6ffd640 1 -- 172.21.15.113:0/226556767 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f35c0014780 con 0x7f35c80ac8b0 2023-12-19T13:52:44.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.760+0000 7f35b6ffd640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35a806a430 0x7f35a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:44.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.760+0000 7f35b6ffd640 1 -- 172.21.15.113:0/226556767 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35c0088e60 con 0x7f35c80ac8b0 2023-12-19T13:52:44.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.760+0000 7f35c659c640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35a806a430 0x7f35a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:44.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.760+0000 7f35c659c640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35a806a430 0x7f35a806c8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f35b8005bb0 tx=0x7f35b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:44.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.764+0000 7f35b6ffd640 1 -- 172.21.15.113:0/226556767 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f35c00543b0 con 0x7f35c80ac8b0 2023-12-19T13:52:44.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.949+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35c80aeee0 con 0x7f35a806a430 2023-12-19T13:52:44.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.960+0000 7f35b6ffd640 1 -- 172.21.15.113:0/226556767 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279953 (secure 0 0 0) 0x7f35b800d050 con 0x7f35a806a430 2023-12-19T13:52:44.961 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:44.965 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:52:44.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35a806a430 msgr2=0x7f35a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35a806a430 0x7f35a806c8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f35b8005bb0 tx=0x7f35b8009040 comp rx=0 tx=0).stop 2023-12-19T13:52:44.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35c80ac8b0 msgr2=0x7f35c80acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35c80ac8b0 0x7f35c80acd30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f35c80b29b0 tx=0x7f35c000e4b0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 shutdown_connections 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f35a806a430 0x7f35a806c8f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35c80ac8b0 0x7f35c80acd30 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c815c260 0x7f35c815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 --2- 172.21.15.113:0/226556767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35b00069d0 0x7f35c814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.966+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 >> 172.21.15.113:0/226556767 conn(0x7f35c80cbb70 msgr2=0x7f35c80705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.967+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 shutdown_connections 2023-12-19T13:52:44.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:44.967+0000 7f35cccca640 1 -- 172.21.15.113:0/226556767 wait complete. 2023-12-19T13:52:44.984 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2023-12-19T13:52:44.534650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5863,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556636,"statfs":{"total":1600000000,"available":1593995605,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457382"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102075+0000","last_change":"2023-12-19T13:52:40.102075+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102075+0000","last_undegraded":"2023-12-19T13:52:40.102075+0000","last_fullsized":"2023-12-19T13:52:40.102075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.242518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102727+0000","last_change":"2023-12-19T13:52:40.102727+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102727+0000","last_undegraded":"2023-12-19T13:52:40.102727+0000","last_fullsized":"2023-12-19T13:52:40.102727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100869+0000","last_change":"2023-12-19T13:52:40.100869+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100869+0000","last_undegraded":"2023-12-19T13:52:40.100869+0000","last_fullsized":"2023-12-19T13:52:40.100869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:39.296028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.097247+0000","last_change":"2023-12-19T13:52:40.097247+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.097247+0000","last_undegraded":"2023-12-19T13:52:40.097247+0000","last_fullsized":"2023-12-19T13:52:40.097247+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:20.603655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105469+0000","last_change":"2023-12-19T13:52:40.105469+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105469+0000","last_undegraded":"2023-12-19T13:52:40.105469+0000","last_fullsized":"2023-12-19T13:52:40.105469+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:03:00.686839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106621+0000","last_change":"2023-12-19T13:52:40.106621+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106621+0000","last_undegraded":"2023-12-19T13:52:40.106621+0000","last_fullsized":"2023-12-19T13:52:40.106621+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101931+0000","last_change":"2023-12-19T13:52:40.101931+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101931+0000","last_undegraded":"2023-12-19T13:52:40.101931+0000","last_fullsized":"2023-12-19T13:52:40.101931+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.091020+0000","last_change":"2023-12-19T13:52:40.091020+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.091020+0000","last_undegraded":"2023-12-19T13:52:40.091020+0000","last_fullsized":"2023-12-19T13:52:40.091020+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106095+0000","last_change":"2023-12-19T13:52:40.106095+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106095+0000","last_undegraded":"2023-12-19T13:52:40.106095+0000","last_fullsized":"2023-12-19T13:52:40.106095+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105250+0000","last_change":"2023-12-19T13:52:40.105250+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105250+0000","last_undegraded":"2023-12-19T13:52:40.105250+0000","last_fullsized":"2023-12-19T13:52:40.105250+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104854+0000","last_change":"2023-12-19T13:52:40.104854+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104854+0000","last_undegraded":"2023-12-19T13:52:40.104854+0000","last_fullsized":"2023-12-19T13:52:40.104854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090353+0000","last_change":"2023-12-19T13:52:40.090353+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090353+0000","last_undegraded":"2023-12-19T13:52:40.090353+0000","last_fullsized":"2023-12-19T13:52:40.090353+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.110356+0000","last_change":"2023-12-19T13:52:40.110356+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.110356+0000","last_undegraded":"2023-12-19T13:52:40.110356+0000","last_fullsized":"2023-12-19T13:52:40.110356+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:49.109631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101822+0000","last_change":"2023-12-19T13:52:40.101822+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101822+0000","last_undegraded":"2023-12-19T13:52:40.101822+0000","last_fullsized":"2023-12-19T13:52:40.101822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100836+0000","last_change":"2023-12-19T13:52:40.100836+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100836+0000","last_undegraded":"2023-12-19T13:52:40.100836+0000","last_fullsized":"2023-12-19T13:52:40.100836+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:23.909006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102898+0000","last_change":"2023-12-19T13:52:40.102898+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102898+0000","last_undegraded":"2023-12-19T13:52:40.102898+0000","last_fullsized":"2023-12-19T13:52:40.102898+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089439+0000","last_change":"2023-12-19T13:52:40.089439+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089439+0000","last_undegraded":"2023-12-19T13:52:40.089439+0000","last_fullsized":"2023-12-19T13:52:40.089439+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102164+0000","last_change":"2023-12-19T13:52:40.102164+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102164+0000","last_undegraded":"2023-12-19T13:52:40.102164+0000","last_fullsized":"2023-12-19T13:52:40.102164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101138+0000","last_change":"2023-12-19T13:52:40.101138+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101138+0000","last_undegraded":"2023-12-19T13:52:40.101138+0000","last_fullsized":"2023-12-19T13:52:40.101138+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:01.263392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.096498+0000","last_change":"2023-12-19T13:52:40.096498+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.096498+0000","last_undegraded":"2023-12-19T13:52:40.096498+0000","last_fullsized":"2023-12-19T13:52:40.096498+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:13:09.860701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093578+0000","last_change":"2023-12-19T13:52:40.093578+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093578+0000","last_undegraded":"2023-12-19T13:52:40.093578+0000","last_fullsized":"2023-12-19T13:52:40.093578+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:28.900515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.094315+0000","last_change":"2023-12-19T13:52:40.094315+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.094315+0000","last_undegraded":"2023-12-19T13:52:40.094315+0000","last_fullsized":"2023-12-19T13:52:40.094315+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090054+0000","last_change":"2023-12-19T13:52:40.090054+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090054+0000","last_undegraded":"2023-12-19T13:52:40.090054+0000","last_fullsized":"2023-12-19T13:52:40.090054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.103051+0000","last_change":"2023-12-19T13:52:40.103051+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.103051+0000","last_undegraded":"2023-12-19T13:52:40.103051+0000","last_fullsized":"2023-12-19T13:52:40.103051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099148+0000","last_change":"2023-12-19T13:52:40.099148+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099148+0000","last_undegraded":"2023-12-19T13:52:40.099148+0000","last_fullsized":"2023-12-19T13:52:40.099148+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104023+0000","last_change":"2023-12-19T13:52:40.104023+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104023+0000","last_undegraded":"2023-12-19T13:52:40.104023+0000","last_fullsized":"2023-12-19T13:52:40.104023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:50.782063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.107242+0000","last_change":"2023-12-19T13:52:40.107242+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.107242+0000","last_undegraded":"2023-12-19T13:52:40.107242+0000","last_fullsized":"2023-12-19T13:52:40.107242+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:12.123080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105021+0000","last_change":"2023-12-19T13:52:40.105021+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105021+0000","last_undegraded":"2023-12-19T13:52:40.105021+0000","last_fullsized":"2023-12-19T13:52:40.105021+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.094767+0000","last_change":"2023-12-19T13:52:40.094767+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.094767+0000","last_undegraded":"2023-12-19T13:52:40.094767+0000","last_fullsized":"2023-12-19T13:52:40.094767+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:04.663189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093259+0000","last_change":"2023-12-19T13:52:40.093259+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093259+0000","last_undegraded":"2023-12-19T13:52:40.093259+0000","last_fullsized":"2023-12-19T13:52:40.093259+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102554+0000","last_change":"2023-12-19T13:52:40.102554+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102554+0000","last_undegraded":"2023-12-19T13:52:40.102554+0000","last_fullsized":"2023-12-19T13:52:40.102554+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104032+0000","last_change":"2023-12-19T13:52:40.104032+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104032+0000","last_undegraded":"2023-12-19T13:52:40.104032+0000","last_fullsized":"2023-12-19T13:52:40.104032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090413+0000","last_change":"2023-12-19T13:52:40.090413+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090413+0000","last_undegraded":"2023-12-19T13:52:40.090413+0000","last_fullsized":"2023-12-19T13:52:40.090413+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.113683+0000","last_change":"2023-12-19T13:52:40.112901+0000","last_active":"2023-12-19T13:52:40.113683+0000","last_peered":"2023-12-19T13:52:40.113683+0000","last_clean":"2023-12-19T13:52:40.113683+0000","last_became_active":"2023-12-19T13:52:40.112699+0000","last_became_peered":"2023-12-19T13:52:40.112699+0000","last_unstale":"2023-12-19T13:52:40.113683+0000","last_undegraded":"2023-12-19T13:52:40.113683+0000","last_fullsized":"2023-12-19T13:52:40.113683+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:54:07.231697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104620+0000","last_change":"2023-12-19T13:52:40.104620+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104620+0000","last_undegraded":"2023-12-19T13:52:40.104620+0000","last_fullsized":"2023-12-19T13:52:40.104620+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111153+0000","last_change":"2023-12-19T13:52:40.108400+0000","last_active":"2023-12-19T13:52:40.111153+0000","last_peered":"2023-12-19T13:52:40.111153+0000","last_clean":"2023-12-19T13:52:40.111153+0000","last_became_active":"2023-12-19T13:52:40.108172+0000","last_became_peered":"2023-12-19T13:52:40.108172+0000","last_unstale":"2023-12-19T13:52:40.111153+0000","last_undegraded":"2023-12-19T13:52:40.111153+0000","last_fullsized":"2023-12-19T13:52:40.111153+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089205+0000","last_change":"2023-12-19T13:52:40.089205+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089205+0000","last_undegraded":"2023-12-19T13:52:40.089205+0000","last_fullsized":"2023-12-19T13:52:40.089205+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110136+0000","last_change":"2023-12-19T13:52:40.109163+0000","last_active":"2023-12-19T13:52:40.110136+0000","last_peered":"2023-12-19T13:52:40.110136+0000","last_clean":"2023-12-19T13:52:40.110136+0000","last_became_active":"2023-12-19T13:52:40.108736+0000","last_became_peered":"2023-12-19T13:52:40.108736+0000","last_unstale":"2023-12-19T13:52:40.110136+0000","last_undegraded":"2023-12-19T13:52:40.110136+0000","last_fullsized":"2023-12-19T13:52:40.110136+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:17.154193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100273+0000","last_change":"2023-12-19T13:52:40.100273+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100273+0000","last_undegraded":"2023-12-19T13:52:40.100273+0000","last_fullsized":"2023-12-19T13:52:40.100273+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.104077+0000","last_change":"2023-12-19T13:52:40.101417+0000","last_active":"2023-12-19T13:52:40.104077+0000","last_peered":"2023-12-19T13:52:40.104077+0000","last_clean":"2023-12-19T13:52:40.104077+0000","last_became_active":"2023-12-19T13:52:40.100811+0000","last_became_peered":"2023-12-19T13:52:40.100811+0000","last_unstale":"2023-12-19T13:52:40.104077+0000","last_undegraded":"2023-12-19T13:52:40.104077+0000","last_fullsized":"2023-12-19T13:52:40.104077+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:22.638411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093265+0000","last_change":"2023-12-19T13:52:40.093265+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093265+0000","last_undegraded":"2023-12-19T13:52:40.093265+0000","last_fullsized":"2023-12-19T13:52:40.093265+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:06.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.100436+0000","last_change":"2023-12-19T13:52:40.100131+0000","last_active":"2023-12-19T13:52:40.100436+0000","last_peered":"2023-12-19T13:52:40.100436+0000","last_clean":"2023-12-19T13:52:40.100436+0000","last_became_active":"2023-12-19T13:52:40.098016+0000","last_became_peered":"2023-12-19T13:52:40.098016+0000","last_unstale":"2023-12-19T13:52:40.100436+0000","last_undegraded":"2023-12-19T13:52:40.100436+0000","last_fullsized":"2023-12-19T13:52:40.100436+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100717+0000","last_change":"2023-12-19T13:52:40.100717+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100717+0000","last_undegraded":"2023-12-19T13:52:40.100717+0000","last_fullsized":"2023-12-19T13:52:40.100717+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.113148+0000","last_change":"2023-12-19T13:52:40.112976+0000","last_active":"2023-12-19T13:52:40.113148+0000","last_peered":"2023-12-19T13:52:40.113148+0000","last_clean":"2023-12-19T13:52:40.113148+0000","last_became_active":"2023-12-19T13:52:40.112742+0000","last_became_peered":"2023-12-19T13:52:40.112742+0000","last_unstale":"2023-12-19T13:52:40.113148+0000","last_undegraded":"2023-12-19T13:52:40.113148+0000","last_fullsized":"2023-12-19T13:52:40.113148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099783+0000","last_change":"2023-12-19T13:52:40.099783+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099783+0000","last_undegraded":"2023-12-19T13:52:40.099783+0000","last_fullsized":"2023-12-19T13:52:40.099783+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:46.642976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.102958+0000","last_change":"2023-12-19T13:52:40.102794+0000","last_active":"2023-12-19T13:52:40.102958+0000","last_peered":"2023-12-19T13:52:40.102958+0000","last_clean":"2023-12-19T13:52:40.102958+0000","last_became_active":"2023-12-19T13:52:40.102320+0000","last_became_peered":"2023-12-19T13:52:40.102320+0000","last_unstale":"2023-12-19T13:52:40.102958+0000","last_undegraded":"2023-12-19T13:52:40.102958+0000","last_fullsized":"2023-12-19T13:52:40.102958+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:25.273423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.098638+0000","last_change":"2023-12-19T13:52:40.098638+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.098638+0000","last_undegraded":"2023-12-19T13:52:40.098638+0000","last_fullsized":"2023-12-19T13:52:40.098638+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:48.602895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.115278+0000","last_change":"2023-12-19T13:52:40.115190+0000","last_active":"2023-12-19T13:52:40.115278+0000","last_peered":"2023-12-19T13:52:40.115278+0000","last_clean":"2023-12-19T13:52:40.115278+0000","last_became_active":"2023-12-19T13:52:40.114825+0000","last_became_peered":"2023-12-19T13:52:40.114825+0000","last_unstale":"2023-12-19T13:52:40.115278+0000","last_undegraded":"2023-12-19T13:52:40.115278+0000","last_fullsized":"2023-12-19T13:52:40.115278+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:36.838331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.091632+0000","last_change":"2023-12-19T13:52:40.091632+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.091632+0000","last_undegraded":"2023-12-19T13:52:40.091632+0000","last_fullsized":"2023-12-19T13:52:40.091632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.108909+0000","last_change":"2023-12-19T13:52:40.107384+0000","last_active":"2023-12-19T13:52:40.108909+0000","last_peered":"2023-12-19T13:52:40.108909+0000","last_clean":"2023-12-19T13:52:40.108909+0000","last_became_active":"2023-12-19T13:52:40.107084+0000","last_became_peered":"2023-12-19T13:52:40.107084+0000","last_unstale":"2023-12-19T13:52:40.108909+0000","last_undegraded":"2023-12-19T13:52:40.108909+0000","last_fullsized":"2023-12-19T13:52:40.108909+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.505632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101222+0000","last_change":"2023-12-19T13:52:40.101222+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101222+0000","last_undegraded":"2023-12-19T13:52:40.101222+0000","last_fullsized":"2023-12-19T13:52:40.101222+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111182+0000","last_change":"2023-12-19T13:52:40.110437+0000","last_active":"2023-12-19T13:52:40.111182+0000","last_peered":"2023-12-19T13:52:40.111182+0000","last_clean":"2023-12-19T13:52:40.111182+0000","last_became_active":"2023-12-19T13:52:40.110207+0000","last_became_peered":"2023-12-19T13:52:40.110207+0000","last_unstale":"2023-12-19T13:52:40.111182+0000","last_undegraded":"2023-12-19T13:52:40.111182+0000","last_fullsized":"2023-12-19T13:52:40.111182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099065+0000","last_change":"2023-12-19T13:52:40.099065+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099065+0000","last_undegraded":"2023-12-19T13:52:40.099065+0000","last_fullsized":"2023-12-19T13:52:40.099065+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114436+0000","last_change":"2023-12-19T13:52:40.112843+0000","last_active":"2023-12-19T13:52:40.114436+0000","last_peered":"2023-12-19T13:52:40.114436+0000","last_clean":"2023-12-19T13:52:40.114436+0000","last_became_active":"2023-12-19T13:52:40.112277+0000","last_became_peered":"2023-12-19T13:52:40.112277+0000","last_unstale":"2023-12-19T13:52:40.114436+0000","last_undegraded":"2023-12-19T13:52:40.114436+0000","last_fullsized":"2023-12-19T13:52:40.114436+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:31:51.725811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.109246+0000","last_change":"2023-12-19T13:52:40.109246+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.109246+0000","last_undegraded":"2023-12-19T13:52:40.109246+0000","last_fullsized":"2023-12-19T13:52:40.109246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:55.696157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105688+0000","last_change":"2023-12-19T13:52:40.103470+0000","last_active":"2023-12-19T13:52:40.105688+0000","last_peered":"2023-12-19T13:52:40.105688+0000","last_clean":"2023-12-19T13:52:40.105688+0000","last_became_active":"2023-12-19T13:52:40.102994+0000","last_became_peered":"2023-12-19T13:52:40.102994+0000","last_unstale":"2023-12-19T13:52:40.105688+0000","last_undegraded":"2023-12-19T13:52:40.105688+0000","last_fullsized":"2023-12-19T13:52:40.105688+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106794+0000","last_change":"2023-12-19T13:52:40.106794+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106794+0000","last_undegraded":"2023-12-19T13:52:40.106794+0000","last_fullsized":"2023-12-19T13:52:40.106794+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105613+0000","last_change":"2023-12-19T13:52:40.104935+0000","last_active":"2023-12-19T13:52:40.105613+0000","last_peered":"2023-12-19T13:52:40.105613+0000","last_clean":"2023-12-19T13:52:40.105613+0000","last_became_active":"2023-12-19T13:52:40.104463+0000","last_became_peered":"2023-12-19T13:52:40.104463+0000","last_unstale":"2023-12-19T13:52:40.105613+0000","last_undegraded":"2023-12-19T13:52:40.105613+0000","last_fullsized":"2023-12-19T13:52:40.105613+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:32.406240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.098991+0000","last_change":"2023-12-19T13:52:40.098991+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.098991+0000","last_undegraded":"2023-12-19T13:52:40.098991+0000","last_fullsized":"2023-12-19T13:52:40.098991+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:37.847464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.089686+0000","last_change":"2023-12-19T13:52:40.088998+0000","last_active":"2023-12-19T13:52:40.089686+0000","last_peered":"2023-12-19T13:52:40.089686+0000","last_clean":"2023-12-19T13:52:40.089686+0000","last_became_active":"2023-12-19T13:52:40.088437+0000","last_became_peered":"2023-12-19T13:52:40.088437+0000","last_unstale":"2023-12-19T13:52:40.089686+0000","last_undegraded":"2023-12-19T13:52:40.089686+0000","last_fullsized":"2023-12-19T13:52:40.089686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.092206+0000","last_change":"2023-12-19T13:52:40.092206+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.092206+0000","last_undegraded":"2023-12-19T13:52:40.092206+0000","last_fullsized":"2023-12-19T13:52:40.092206+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:19.408026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.115430+0000","last_change":"2023-12-19T13:52:40.115336+0000","last_active":"2023-12-19T13:52:40.115430+0000","last_peered":"2023-12-19T13:52:40.115430+0000","last_clean":"2023-12-19T13:52:40.115430+0000","last_became_active":"2023-12-19T13:52:40.115102+0000","last_became_peered":"2023-12-19T13:52:40.115102+0000","last_unstale":"2023-12-19T13:52:40.115430+0000","last_undegraded":"2023-12-19T13:52:40.115430+0000","last_fullsized":"2023-12-19T13:52:40.115430+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105444+0000","last_change":"2023-12-19T13:52:40.105444+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105444+0000","last_undegraded":"2023-12-19T13:52:40.105444+0000","last_fullsized":"2023-12-19T13:52:40.105444+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114689+0000","last_change":"2023-12-19T13:52:40.114613+0000","last_active":"2023-12-19T13:52:40.114689+0000","last_peered":"2023-12-19T13:52:40.114689+0000","last_clean":"2023-12-19T13:52:40.114689+0000","last_became_active":"2023-12-19T13:52:40.114053+0000","last_became_peered":"2023-12-19T13:52:40.114053+0000","last_unstale":"2023-12-19T13:52:40.114689+0000","last_undegraded":"2023-12-19T13:52:40.114689+0000","last_fullsized":"2023-12-19T13:52:40.114689+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:14.310685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089131+0000","last_change":"2023-12-19T13:52:40.089131+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089131+0000","last_undegraded":"2023-12-19T13:52:40.089131+0000","last_fullsized":"2023-12-19T13:52:40.089131+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105323+0000","last_change":"2023-12-19T13:52:40.103948+0000","last_active":"2023-12-19T13:52:40.105323+0000","last_peered":"2023-12-19T13:52:40.105323+0000","last_clean":"2023-12-19T13:52:40.105323+0000","last_became_active":"2023-12-19T13:52:40.103624+0000","last_became_peered":"2023-12-19T13:52:40.103624+0000","last_unstale":"2023-12-19T13:52:40.105323+0000","last_undegraded":"2023-12-19T13:52:40.105323+0000","last_fullsized":"2023-12-19T13:52:40.105323+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:19.594522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105051+0000","last_change":"2023-12-19T13:52:40.105051+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105051+0000","last_undegraded":"2023-12-19T13:52:40.105051+0000","last_fullsized":"2023-12-19T13:52:40.105051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.099911+0000","last_change":"2023-12-19T13:52:40.099292+0000","last_active":"2023-12-19T13:52:40.099911+0000","last_peered":"2023-12-19T13:52:40.099911+0000","last_clean":"2023-12-19T13:52:40.099911+0000","last_became_active":"2023-12-19T13:52:40.098816+0000","last_became_peered":"2023-12-19T13:52:40.098816+0000","last_unstale":"2023-12-19T13:52:40.099911+0000","last_undegraded":"2023-12-19T13:52:40.099911+0000","last_fullsized":"2023-12-19T13:52:40.099911+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:26.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.088075+0000","last_change":"2023-12-19T13:52:40.088075+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.088075+0000","last_undegraded":"2023-12-19T13:52:40.088075+0000","last_fullsized":"2023-12-19T13:52:40.088075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.104427+0000","last_change":"2023-12-19T13:52:40.103821+0000","last_active":"2023-12-19T13:52:40.104427+0000","last_peered":"2023-12-19T13:52:40.104427+0000","last_clean":"2023-12-19T13:52:40.104427+0000","last_became_active":"2023-12-19T13:52:40.103362+0000","last_became_peered":"2023-12-19T13:52:40.103362+0000","last_unstale":"2023-12-19T13:52:40.104427+0000","last_undegraded":"2023-12-19T13:52:40.104427+0000","last_fullsized":"2023-12-19T13:52:40.104427+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:23.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105969+0000","last_change":"2023-12-19T13:52:40.105969+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105969+0000","last_undegraded":"2023-12-19T13:52:40.105969+0000","last_fullsized":"2023-12-19T13:52:40.105969+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:52:14.420403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.096984+0000","last_change":"2023-12-19T13:52:40.093874+0000","last_active":"2023-12-19T13:52:40.096984+0000","last_peered":"2023-12-19T13:52:40.096984+0000","last_clean":"2023-12-19T13:52:40.096984+0000","last_became_active":"2023-12-19T13:52:40.093143+0000","last_became_peered":"2023-12-19T13:52:40.093143+0000","last_unstale":"2023-12-19T13:52:40.096984+0000","last_undegraded":"2023-12-19T13:52:40.096984+0000","last_fullsized":"2023-12-19T13:52:40.096984+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:45.633843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.108853+0000","last_change":"2023-12-19T13:52:40.108853+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.108853+0000","last_undegraded":"2023-12-19T13:52:40.108853+0000","last_fullsized":"2023-12-19T13:52:40.108853+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:19.557252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.107186+0000","last_change":"2023-12-19T13:52:40.106763+0000","last_active":"2023-12-19T13:52:40.107186+0000","last_peered":"2023-12-19T13:52:40.107186+0000","last_clean":"2023-12-19T13:52:40.107186+0000","last_became_active":"2023-12-19T13:52:40.106379+0000","last_became_peered":"2023-12-19T13:52:40.106379+0000","last_unstale":"2023-12-19T13:52:40.107186+0000","last_undegraded":"2023-12-19T13:52:40.107186+0000","last_fullsized":"2023-12-19T13:52:40.107186+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.092653+0000","last_change":"2023-12-19T13:52:40.092653+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.092653+0000","last_undegraded":"2023-12-19T13:52:40.092653+0000","last_fullsized":"2023-12-19T13:52:40.092653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:49.166277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.112419+0000","last_change":"2023-12-19T13:52:40.112335+0000","last_active":"2023-12-19T13:52:40.112419+0000","last_peered":"2023-12-19T13:52:40.112419+0000","last_clean":"2023-12-19T13:52:40.112419+0000","last_became_active":"2023-12-19T13:52:40.112142+0000","last_became_peered":"2023-12-19T13:52:40.112142+0000","last_unstale":"2023-12-19T13:52:40.112419+0000","last_undegraded":"2023-12-19T13:52:40.112419+0000","last_fullsized":"2023-12-19T13:52:40.112419+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:15.392835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.087992+0000","last_change":"2023-12-19T13:52:40.087992+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.087992+0000","last_undegraded":"2023-12-19T13:52:40.087992+0000","last_fullsized":"2023-12-19T13:52:40.087992+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110399+0000","last_change":"2023-12-19T13:52:40.109967+0000","last_active":"2023-12-19T13:52:40.110399+0000","last_peered":"2023-12-19T13:52:40.110399+0000","last_clean":"2023-12-19T13:52:40.110399+0000","last_became_active":"2023-12-19T13:52:40.109672+0000","last_became_peered":"2023-12-19T13:52:40.109672+0000","last_unstale":"2023-12-19T13:52:40.110399+0000","last_undegraded":"2023-12-19T13:52:40.110399+0000","last_fullsized":"2023-12-19T13:52:40.110399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:44:44.945990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104549+0000","last_change":"2023-12-19T13:52:40.104549+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104549+0000","last_undegraded":"2023-12-19T13:52:40.104549+0000","last_fullsized":"2023-12-19T13:52:40.104549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:32.794419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.108337+0000","last_change":"2023-12-19T13:52:40.107596+0000","last_active":"2023-12-19T13:52:40.108337+0000","last_peered":"2023-12-19T13:52:40.108337+0000","last_clean":"2023-12-19T13:52:40.108337+0000","last_became_active":"2023-12-19T13:52:40.106859+0000","last_became_peered":"2023-12-19T13:52:40.106859+0000","last_unstale":"2023-12-19T13:52:40.108337+0000","last_undegraded":"2023-12-19T13:52:40.108337+0000","last_fullsized":"2023-12-19T13:52:40.108337+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:04.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106834+0000","last_change":"2023-12-19T13:52:40.106834+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106834+0000","last_undegraded":"2023-12-19T13:52:40.106834+0000","last_fullsized":"2023-12-19T13:52:40.106834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:26.216347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110725+0000","last_change":"2023-12-19T13:52:40.110640+0000","last_active":"2023-12-19T13:52:40.110725+0000","last_peered":"2023-12-19T13:52:40.110725+0000","last_clean":"2023-12-19T13:52:40.110725+0000","last_became_active":"2023-12-19T13:52:40.109548+0000","last_became_peered":"2023-12-19T13:52:40.109548+0000","last_unstale":"2023-12-19T13:52:40.110725+0000","last_undegraded":"2023-12-19T13:52:40.110725+0000","last_fullsized":"2023-12-19T13:52:40.110725+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:42.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105045+0000","last_change":"2023-12-19T13:52:40.105045+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105045+0000","last_undegraded":"2023-12-19T13:52:40.105045+0000","last_fullsized":"2023-12-19T13:52:40.105045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:01:53.994030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.112012+0000","last_change":"2023-12-19T13:52:40.111068+0000","last_active":"2023-12-19T13:52:40.112012+0000","last_peered":"2023-12-19T13:52:40.112012+0000","last_clean":"2023-12-19T13:52:40.112012+0000","last_became_active":"2023-12-19T13:52:40.110835+0000","last_became_peered":"2023-12-19T13:52:40.110835+0000","last_unstale":"2023-12-19T13:52:40.112012+0000","last_undegraded":"2023-12-19T13:52:40.112012+0000","last_fullsized":"2023-12-19T13:52:40.112012+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104731+0000","last_change":"2023-12-19T13:52:40.104731+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104731+0000","last_undegraded":"2023-12-19T13:52:40.104731+0000","last_fullsized":"2023-12-19T13:52:40.104731+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111457+0000","last_change":"2023-12-19T13:52:40.111351+0000","last_active":"2023-12-19T13:52:40.111457+0000","last_peered":"2023-12-19T13:52:40.111457+0000","last_clean":"2023-12-19T13:52:40.111457+0000","last_became_active":"2023-12-19T13:52:40.111135+0000","last_became_peered":"2023-12-19T13:52:40.111135+0000","last_unstale":"2023-12-19T13:52:40.111457+0000","last_undegraded":"2023-12-19T13:52:40.111457+0000","last_fullsized":"2023-12-19T13:52:40.111457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:08.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099230+0000","last_change":"2023-12-19T13:52:40.099230+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099230+0000","last_undegraded":"2023-12-19T13:52:40.099230+0000","last_fullsized":"2023-12-19T13:52:40.099230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.109623+0000","last_change":"2023-12-19T13:52:40.108868+0000","last_active":"2023-12-19T13:52:40.109623+0000","last_peered":"2023-12-19T13:52:40.109623+0000","last_clean":"2023-12-19T13:52:40.109623+0000","last_became_active":"2023-12-19T13:52:40.108635+0000","last_became_peered":"2023-12-19T13:52:40.108635+0000","last_unstale":"2023-12-19T13:52:40.109623+0000","last_undegraded":"2023-12-19T13:52:40.109623+0000","last_fullsized":"2023-12-19T13:52:40.109623+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:18.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105379+0000","last_change":"2023-12-19T13:52:40.105379+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105379+0000","last_undegraded":"2023-12-19T13:52:40.105379+0000","last_fullsized":"2023-12-19T13:52:40.105379+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114787+0000","last_change":"2023-12-19T13:52:40.114680+0000","last_active":"2023-12-19T13:52:40.114787+0000","last_peered":"2023-12-19T13:52:40.114787+0000","last_clean":"2023-12-19T13:52:40.114787+0000","last_became_active":"2023-12-19T13:52:40.113789+0000","last_became_peered":"2023-12-19T13:52:40.113789+0000","last_unstale":"2023-12-19T13:52:40.114787+0000","last_undegraded":"2023-12-19T13:52:40.114787+0000","last_fullsized":"2023-12-19T13:52:40.114787+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105737+0000","last_change":"2023-12-19T13:52:40.105737+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105737+0000","last_undegraded":"2023-12-19T13:52:40.105737+0000","last_fullsized":"2023-12-19T13:52:40.105737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114457+0000","last_change":"2023-12-19T13:52:40.113228+0000","last_active":"2023-12-19T13:52:40.114457+0000","last_peered":"2023-12-19T13:52:40.114457+0000","last_clean":"2023-12-19T13:52:40.114457+0000","last_became_active":"2023-12-19T13:52:40.112593+0000","last_became_peered":"2023-12-19T13:52:40.112593+0000","last_unstale":"2023-12-19T13:52:40.114457+0000","last_undegraded":"2023-12-19T13:52:40.114457+0000","last_fullsized":"2023-12-19T13:52:40.114457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:09.700259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.103622+0000","last_change":"2023-12-19T13:52:40.103622+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.103622+0000","last_undegraded":"2023-12-19T13:52:40.103622+0000","last_fullsized":"2023-12-19T13:52:40.103622+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.102918+0000","last_change":"2023-12-19T13:52:40.102645+0000","last_active":"2023-12-19T13:52:40.102918+0000","last_peered":"2023-12-19T13:52:40.102918+0000","last_clean":"2023-12-19T13:52:40.102918+0000","last_became_active":"2023-12-19T13:52:40.097556+0000","last_became_peered":"2023-12-19T13:52:40.097556+0000","last_unstale":"2023-12-19T13:52:40.102918+0000","last_undegraded":"2023-12-19T13:52:40.102918+0000","last_fullsized":"2023-12-19T13:52:40.102918+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101601+0000","last_change":"2023-12-19T13:52:40.101601+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101601+0000","last_undegraded":"2023-12-19T13:52:40.101601+0000","last_fullsized":"2023-12-19T13:52:40.101601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.101369+0000","last_change":"2023-12-19T13:52:40.101203+0000","last_active":"2023-12-19T13:52:40.101369+0000","last_peered":"2023-12-19T13:52:40.101369+0000","last_clean":"2023-12-19T13:52:40.101369+0000","last_became_active":"2023-12-19T13:52:40.100476+0000","last_became_peered":"2023-12-19T13:52:40.100476+0000","last_unstale":"2023-12-19T13:52:40.101369+0000","last_undegraded":"2023-12-19T13:52:40.101369+0000","last_fullsized":"2023-12-19T13:52:40.101369+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:49.482529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T13:52:39.085675+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:52:39.085675+0000","last_peered":"2023-12-19T13:52:39.085675+0000","last_clean":"2023-12-19T13:52:39.085675+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:52:39.085675+0000","last_undegraded":"2023-12-19T13:52:39.085675+0000","last_fullsized":"2023-12-19T13:52:39.085675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0920000000000001,"15min":1.028},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6279999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.079},{"interface":"front","average":{"1min":1.127,"5min":1.0860000000000001,"15min":1.01},"min":{"1min":0.77600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4059999999999999,"5min":1.7190000000000001,"15min":2.008},"last":1.244}]},{"osd":1,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.153,"15min":1.0940000000000001},"min":{"1min":0.66000000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5960000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1200000000000001,"15min":1.054},"min":{"1min":0.751,"5min":0.497,"15min":0.497},"max":{"1min":1.5409999999999999,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.008}]},{"osd":2,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.149,"15min":1.1359999999999999},"min":{"1min":0.76400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5569999999999999,"5min":1.7330000000000001,"15min":1.7929999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.2050000000000001,"15min":1.159},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6499999999999999,"5min":1.871,"15min":1.8720000000000001},"last":0.92400000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2310000000000001,"15min":1.1679999999999999},"min":{"1min":0.96199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.399,"5min":1.931,"15min":1.931},"last":1.117},{"interface":"front","average":{"1min":1.425,"5min":1.3180000000000001,"15min":1.252},"min":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.6150000000000002,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.1870000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.26,"15min":1.2789999999999999},"min":{"1min":0.98699999999999999,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":1.506,"5min":1.6739999999999999,"15min":2.181},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3460000000000001,"15min":1.3839999999999999},"min":{"1min":0.86199999999999999,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":1.7070000000000001,"5min":2.2109999999999999,"15min":2.6909999999999998},"last":1.6100000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.258,"15min":1.228},"min":{"1min":0.86299999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5289999999999999,"5min":1.956,"15min":1.956},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.415,"15min":1.423},"min":{"1min":1.2250000000000001,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":1.841,"5min":2.024,"15min":2.2629999999999999},"last":1.4330000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.369,"15min":1.2869999999999999},"min":{"1min":1.012,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6739999999999999,"5min":2.024,"15min":2.024},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.5109999999999999,"15min":1.4890000000000001},"min":{"1min":1.3720000000000001,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":1.6759999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.631}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.66100000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6220000000000001,"5min":1.679,"15min":2.0640000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.079,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.631,"5min":1.631,"15min":3.2069999999999999},"last":1.357}]},{"osd":1,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.071,"15min":1.0369999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.405,"5min":1.619,"15min":1.962},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.139,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5029999999999999,"5min":1.5860000000000001,"15min":1.6279999999999999},"last":1.262}]},{"osd":2,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2609999999999999,"15min":1.2270000000000001},"min":{"1min":0.93600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7310000000000001,"5min":1.798,"15min":1.8180000000000001},"last":1.806},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2569999999999999,"15min":1.179},"min":{"1min":0.80200000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6319999999999999,"5min":1.802,"15min":1.802},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.331},"min":{"1min":0.84699999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2410000000000001,"15min":1.2629999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.67900000000000005},"max":{"1min":1.819,"5min":1.8799999999999999,"15min":4.3899999999999997},"last":1.0700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2969999999999999,"15min":1.2270000000000001},"min":{"1min":0.64500000000000002,"5min":0.56100000000000005,"15min":0.47899999999999998},"max":{"1min":1.798,"5min":1.865,"15min":1.865},"last":1.905},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.367,"15min":1.3109999999999999},"min":{"1min":0.96399999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7170000000000001,"5min":1.895,"15min":1.895},"last":1.512}]},{"osd":5,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.2609999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.865,"5min":1.962,"15min":1.962},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.423,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.865,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":2.169}]},{"osd":7,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.454,"15min":1.4279999999999999},"min":{"1min":0.91500000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.944,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4299999999999999,"15min":1.3720000000000001},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.57999999999999996},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.8540000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194147,"statfs":{"total":200000000,"available":198807459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.038,"15min":0.997},"min":{"1min":0.71999999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6839999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.155,"15min":1.095},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6669999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.5089999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.155,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.23,"5min":1.155,"15min":1.0469999999999999},"min":{"1min":0.95899999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5980000000000001,"5min":2.077,"15min":2.077},"last":1.694}]},{"osd":2,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2370000000000001,"15min":1.2569999999999999},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5609999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.373},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.268},"min":{"1min":0.88700000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7849999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.2769999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3240000000000001,"15min":1.242},"min":{"1min":1.0149999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8360000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.595},{"interface":"front","average":{"1min":1.375,"5min":1.2829999999999999,"15min":1.2549999999999999},"min":{"1min":1.099,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.75}]},{"osd":4,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.1519999999999999},"min":{"1min":0.91000000000000003,"5min":0.79400000000000004,"15min":0.77600000000000002},"max":{"1min":1.484,"5min":1.982,"15min":1.982},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.3799999999999999,"15min":1.3109999999999999},"min":{"1min":0.71399999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7969999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.79}]},{"osd":6,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3779999999999999,"15min":1.3280000000000001},"min":{"1min":0.97499999999999998,"5min":0.94099999999999995,"15min":0.623},"max":{"1min":1.853,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3500000000000001,"15min":1.367},"min":{"1min":0.84599999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6970000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0779999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4330000000000001},"min":{"1min":1.1399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.891,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":2.1219999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5029999999999999,"15min":1.429},"min":{"1min":1.2729999999999999,"5min":0.96099999999999997,"15min":0.82099999999999995},"max":{"1min":1.968,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.931}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194718,"statfs":{"total":200000000,"available":199391552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0369999999999999,"15min":1.0029999999999999},"min":{"1min":0.66200000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5569999999999999,"5min":1.657,"15min":1.657},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.121},"min":{"1min":0.73599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4850000000000001,"5min":1.6020000000000001,"15min":2.016},"last":0.88500000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.85099999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6060000000000001,"5min":1.621,"15min":1.621},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7969999999999999,"5min":1.887,"15min":1.887},"last":1.333}]},{"osd":2,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.145,"15min":1.046},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.629},"max":{"1min":1.4730000000000001,"5min":1.704,"15min":1.704},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.75,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2230000000000001,"15min":1.2150000000000001},"min":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6779999999999999,"5min":1.8360000000000001,"15min":1.952},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.284,"15min":1.2829999999999999},"min":{"1min":0.91200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.395}]},{"osd":5,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2170000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.474},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3420000000000001},"min":{"1min":0.90100000000000002,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":2.306,"5min":2.306,"15min":2.3570000000000002},"last":1.4370000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.343,"15min":1.395},"min":{"1min":0.94999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3839999999999999,"15min":1.458},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.76200000000000001},"max":{"1min":2.278,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.5680000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4670000000000001,"15min":1.466},"min":{"1min":0.872,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.677,"5min":1.52,"15min":1.528},"min":{"1min":0.998,"5min":0.68600000000000005,"15min":0.59999999999999998},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.518}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54200000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.272,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.89200000000000002,"15min":0.95999999999999996},"min":{"1min":0.63,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.365,"5min":1.502,"15min":3.0670000000000002},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.98499999999999999},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3320000000000001,"5min":1.508,"15min":5.3769999999999998},"last":0.753},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92500000000000004,"15min":0.98099999999999998},"min":{"1min":0.60999999999999999,"5min":0.39900000000000002,"15min":0.36499999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":2.387},"last":0.89200000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98599999999999999,"15min":1.0329999999999999},"min":{"1min":0.59999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.4770000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.002,"15min":1.1120000000000001},"min":{"1min":0.57399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4770000000000001,"5min":1.8620000000000001,"15min":2.657},"last":0.84899999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2030000000000001,"15min":1.2609999999999999},"min":{"1min":1.0389999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.718,"15min":3.0070000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2170000000000001,"15min":1.2330000000000001},"min":{"1min":0.998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.835,"5min":1.835,"15min":2.7690000000000001},"last":1.196}]},{"osd":5,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.2350000000000001,"15min":1.2989999999999999},"min":{"1min":0.97499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.679,"5min":1.7030000000000001,"15min":2.7309999999999999},"last":1.512},{"interface":"front","average":{"1min":1.21,"5min":1.214,"15min":1.262},"min":{"1min":0.96599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4630000000000001,"5min":1.671,"15min":3.5249999999999999},"last":1.284}]},{"osd":6,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.248,"15min":1.3},"min":{"1min":0.91900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5649999999999999,"5min":1.899,"15min":2.9769999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.3049999999999999,"15min":1.343},"min":{"1min":1.1599999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":1.9730000000000001,"15min":2.698},"last":1.3049999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.302,"15min":1.3640000000000001},"min":{"1min":0.88100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":1.8,"15min":3.609},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.369,"15min":1.3939999999999999},"min":{"1min":1.081,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7829999999999999,"5min":2.0910000000000002,"15min":3.0379999999999998},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.254,"5min":1.544,"15min":2.258},"last":1.153},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.999,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6539999999999999,"5min":11.85,"15min":11.85},"last":0.99299999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.5469999999999999,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0860000000000001,"15min":0.94799999999999995},"min":{"1min":0.50700000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3160000000000001,"5min":11.788,"15min":11.788},"last":1.206}]},{"osd":3,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.96299999999999997,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.413,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":1.081},{"interface":"front","average":{"1min":1.069,"5min":1.083,"15min":1.036},"min":{"1min":0.67600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.53,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.1180000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.335,"15min":1.1850000000000001},"min":{"1min":0.93100000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.6839999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.341},{"interface":"front","average":{"1min":1.214,"5min":1.2170000000000001,"15min":1.2230000000000001},"min":{"1min":0.89400000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":2.2189999999999999},"last":1.262}]},{"osd":5,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.421,"15min":1.2529999999999999},"min":{"1min":1.1040000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.748,"5min":11.888,"15min":11.888},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3109999999999999,"15min":1.3089999999999999},"min":{"1min":0.85199999999999998,"5min":0.76700000000000002,"15min":0.68899999999999995},"max":{"1min":1.738,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.3899999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2889999999999999,"15min":1.3100000000000001},"min":{"1min":0.97399999999999998,"5min":0.754,"15min":0.72399999999999998},"max":{"1min":1.6739999999999999,"5min":2.0640000000000001,"15min":2.964},"last":1.298},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3089999999999999,"15min":1.264},"min":{"1min":0.98599999999999999,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.6479999999999999,"5min":1.944,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8009999999999999,"5min":2.0369999999999999,"15min":2.351},"last":1.518},{"interface":"front","average":{"1min":1.383,"5min":1.4379999999999999,"15min":1.3029999999999999},"min":{"1min":1.0289999999999999,"5min":0.77100000000000002,"15min":0.75600000000000001},"max":{"1min":1.7729999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.419}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194147,"statfs":{"total":200000000,"available":198807459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95399999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5369999999999999,"5min":2.351,"15min":3.3500000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":1.0649999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4570000000000001,"5min":1.466,"15min":5.2999999999999998},"last":1.046},{"interface":"front","average":{"1min":1.137,"5min":1.1259999999999999,"15min":1.1779999999999999},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.764,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":1.2689999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.6759999999999999,"5min":1.6899999999999999,"15min":3.4300000000000002},"last":1.099},{"interface":"front","average":{"1min":1.03,"5min":1.014,"15min":1.169},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.706,"5min":1.706,"15min":7.157},"last":1.1930000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.163,"15min":1.2230000000000001},"min":{"1min":0.77800000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.266,"15min":1.2989999999999999},"min":{"1min":0.88700000000000001,"5min":0.79100000000000004,"15min":0.72799999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.1519999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2509999999999999,"15min":1.323},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.3},{"interface":"front","average":{"1min":1.321,"5min":1.4019999999999999,"15min":1.3759999999999999},"min":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9870000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2410000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.339,"15min":1.353},"min":{"1min":0.74199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3220000000000001,"15min":1.415},"min":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.77300000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":3.786},"last":1.4330000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.3819999999999999,"15min":1.4490000000000001},"min":{"1min":0.872,"5min":0.84799999999999998,"15min":0.78400000000000003},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.337,"15min":1.448},"min":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.63700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4390000000000001,"5min":1.5820000000000001,"15min":1.6399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.03,"15min":0.95899999999999996},"min":{"1min":0.57699999999999996,"5min":0.373,"15min":0.373},"max":{"1min":1.766,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2769999999999999,"15min":1.004},"min":{"1min":0.80200000000000005,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.845,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.478,"15min":1.1000000000000001},"min":{"1min":0.63400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.056,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.86199999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.88300000000000001,"15min":1.006},"min":{"1min":0.75800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.619,"5min":1.619,"15min":4.4530000000000003},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.071,"15min":1.103},"min":{"1min":0.77900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.254}]},{"osd":4,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.1659999999999999,"15min":1.2110000000000001},"min":{"1min":0.97899999999999998,"5min":0.746,"15min":0.746},"max":{"1min":1.917,"5min":1.917,"15min":4.4269999999999996},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.403,"15min":1.23},"min":{"1min":1.0429999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1099999999999999,"5min":15.766,"15min":15.766},"last":1.339}]},{"osd":5,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3879999999999999,"15min":1.234},"min":{"1min":0.93500000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4569999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2549999999999999,"15min":1.2869999999999999},"min":{"1min":0.98699999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3119999999999998,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.0169999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.3799999999999999,"15min":1.28},"min":{"1min":1.2150000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.242,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.522,"15min":1.3400000000000001},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.5489999999999999,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.2969999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4950000000000001,"15min":1.345},"min":{"1min":1.002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3530000000000002,"5min":14.381,"15min":14.381},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.4079999999999999,"15min":1.4059999999999999},"min":{"1min":1.1160000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3879999999999999,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.1160000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:52:44.990 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:52:45.042 INFO:tasks.ceph.mds.a.smithi113.stderr:2023-12-19T13:52:45.043+0000 7fda1a396640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:52:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.247+0000 7f2d589ac640 1 Processor -- start 2023-12-19T13:52:45.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.247+0000 7f2d589ac640 1 -- start start 2023-12-19T13:52:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d589ac640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 0x7f2d5415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d589ac640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5406b520 con 0x7f2d5415a8a0 2023-12-19T13:52:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d589ac640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d540b2b20 con 0x7f2d54159f80 2023-12-19T13:52:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d589ac640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d540b2fb0 con 0x7f2d5415b1e0 2023-12-19T13:52:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d53fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2d5415a8a0 0x7f2d5415b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42996/0 (socket says 172.21.15.113:42996) 2023-12-19T13:52:45.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d53fff640 1 -- 172.21.15.113:0/1834281743 learned_addr learned my addr 172.21.15.113:0/1834281743 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d52ffd640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 0x7f2d5415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040703365 0 0) 0x7f2d5406b520 con 0x7f2d5415a8a0 2023-12-19T13:52:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.249+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d3c003520 con 0x7f2d5415a8a0 2023-12-19T13:52:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3471377227 0 0) 0x7f2d3c003520 con 0x7f2d5415a8a0 2023-12-19T13:52:45.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 msgr2=0x7f2d5415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 0x7f2d5415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 >> v1:172.21.15.151:6789/0 conn(0x7f2d54159f80 legacy=0x7f2d5406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d540b1f10 con 0x7f2d5415a8a0 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f2d4c0019f0 con 0x7f2d5415a8a0 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 >> v1:172.21.15.113:6789/0 conn(0x7f2d5415a8a0 legacy=0x7f2d5415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d3c0039a0 0x7f2d3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 0x7f2d3c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d540b2fb0 con 0x7f2d3c0047c0 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c00ddb0 con 0x7f2d3c0039a0 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c00df70 con 0x7f2d5415b1e0 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.250+0000 7f2d52ffd640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.251+0000 7f2d537fe640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d3c0039a0 0x7f2d3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.251+0000 7f2d52ffd640 1 -- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 msgr2=0x7f2d3c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.251+0000 7f2d53fff640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 0x7f2d3c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.251+0000 7f2d52ffd640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d5415b1e0 0x7f2d3c005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.251+0000 7f2d52ffd640 1 -- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d3c0039a0 msgr2=0x7f2d3c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.251+0000 7f2d52ffd640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d3c0039a0 0x7f2d3c003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.251+0000 7f2d52ffd640 1 -- 172.21.15.113:0/1834281743 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c003520 con 0x7f2d3c0047c0 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.252+0000 7f2d52ffd640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800ba30 tx=0x7f2d3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4d7bc31ebb30b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.252+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48032640 con 0x7f2d3c0047c0 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.252+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480327a0 con 0x7f2d3c0047c0 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.252+0000 7f2d527fc640 1 -- 172.21.15.113:0/1834281743 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48032b30 con 0x7f2d3c0047c0 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.253+0000 7f2d589ac640 1 -- 172.21.15.113:0/1834281743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 msgr2=0x7f2d3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.253+0000 7f2d589ac640 1 --2- 172.21.15.113:0/1834281743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800ba30 tx=0x7f2d3c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.253+0000 7f2d53fff640 1 -- 172.21.15.113:0/1834281743 reap_dead start 2023-12-19T13:52:45.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.253+0000 7f2d589ac640 1 -- 172.21.15.113:0/1834281743 shutdown_connections 2023-12-19T13:52:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.253+0000 7f2d589ac640 1 -- 172.21.15.113:0/1834281743 >> 172.21.15.113:0/1834281743 conn(0x7f2d540b0100 msgr2=0x7f2d540b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.253+0000 7f2d589ac640 1 -- 172.21.15.113:0/1834281743 shutdown_connections 2023-12-19T13:52:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.253+0000 7f2d589ac640 1 -- 172.21.15.113:0/1834281743 wait complete. 2023-12-19T13:52:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.255+0000 7f2d589ac640 1 Processor -- start 2023-12-19T13:52:45.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.255+0000 7f2d589ac640 1 -- start start 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d589ac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d54148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d589ac640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d541574d0 0x7f2d540acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d589ac640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d54158850 0x7f2d54158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d589ac640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54159210 con 0x7f2d3c0047c0 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d589ac640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5406c5a0 con 0x7f2d54158850 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d589ac640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54157a70 con 0x7f2d541574d0 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d537fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d54148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d537fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d54148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38336/0 (socket says 172.21.15.113:38336) 2023-12-19T13:52:45.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.256+0000 7f2d537fe640 1 -- 172.21.15.113:0/2467815566 learned_addr learned my addr 172.21.15.113:0/2467815566 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d537fe640 1 -- 172.21.15.113:0/2467815566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d541574d0 msgr2=0x7f2d540acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d537fe640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d541574d0 0x7f2d540acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d537fe640 1 -- 172.21.15.113:0/2467815566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d54158850 msgr2=0x7f2d54158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d537fe640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d54158850 0x7f2d54158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d537fe640 1 -- 172.21.15.113:0/2467815566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54157d50 con 0x7f2d3c0047c0 2023-12-19T13:52:45.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d537fe640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d54148c30 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400d570 tx=0x7f2d4400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d3bfff640 1 -- 172.21.15.113:0/2467815566 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44005480 con 0x7f2d3c0047c0 2023-12-19T13:52:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d3bfff640 1 -- 172.21.15.113:0/2467815566 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d44003610 con 0x7f2d3c0047c0 2023-12-19T13:52:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5406c840 con 0x7f2d3c0047c0 2023-12-19T13:52:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d3bfff640 1 -- 172.21.15.113:0/2467815566 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44003980 con 0x7f2d3c0047c0 2023-12-19T13:52:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.257+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d54158030 con 0x7f2d3c0047c0 2023-12-19T13:52:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.258+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d54061910 con 0x7f2d3c0047c0 2023-12-19T13:52:45.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.259+0000 7f2d3bfff640 1 -- 172.21.15.113:0/2467815566 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d44003ae0 con 0x7f2d3c0047c0 2023-12-19T13:52:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.260+0000 7f2d3bfff640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d4006a460 0x7f2d4006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.260+0000 7f2d3bfff640 1 -- 172.21.15.113:0/2467815566 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d44088850 con 0x7f2d3c0047c0 2023-12-19T13:52:45.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.261+0000 7f2d52ffd640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d4006a460 0x7f2d4006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.261+0000 7f2d52ffd640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d4006a460 0x7f2d4006c920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2d48037000 tx=0x7f2d48032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:45.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.265+0000 7f2d3bfff640 1 -- 172.21.15.113:0/2467815566 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d44053e30 con 0x7f2d3c0047c0 2023-12-19T13:52:45.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.449+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d540b24d0 con 0x7f2d4006a460 2023-12-19T13:52:45.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.461+0000 7f2d3bfff640 1 -- 172.21.15.113:0/2467815566 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279953 (secure 0 0 0) 0x7f2d48032990 con 0x7f2d4006a460 2023-12-19T13:52:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:45.465 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:52:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.466+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d4006a460 msgr2=0x7f2d4006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.466+0000 7f2d589ac640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d4006a460 0x7f2d4006c920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2d48037000 tx=0x7f2d48032000 comp rx=0 tx=0).stop 2023-12-19T13:52:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 msgr2=0x7f2d54148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d54148c30 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400d570 tx=0x7f2d4400da30 comp rx=0 tx=0).stop 2023-12-19T13:52:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 shutdown_connections 2023-12-19T13:52:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2d4006a460 0x7f2d4006c920 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d54158850 0x7f2d54158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d541574d0 0x7f2d540acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 --2- 172.21.15.113:0/2467815566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d3c0047c0 0x7f2d54148c30 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 >> 172.21.15.113:0/2467815566 conn(0x7f2d540b0100 msgr2=0x7f2d540b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 shutdown_connections 2023-12-19T13:52:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.467+0000 7f2d589ac640 1 -- 172.21.15.113:0/2467815566 wait complete. 2023-12-19T13:52:45.485 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2023-12-19T13:52:44.534650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5863,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556636,"statfs":{"total":1600000000,"available":1593995605,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457382"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102075+0000","last_change":"2023-12-19T13:52:40.102075+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102075+0000","last_undegraded":"2023-12-19T13:52:40.102075+0000","last_fullsized":"2023-12-19T13:52:40.102075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.242518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102727+0000","last_change":"2023-12-19T13:52:40.102727+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102727+0000","last_undegraded":"2023-12-19T13:52:40.102727+0000","last_fullsized":"2023-12-19T13:52:40.102727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100869+0000","last_change":"2023-12-19T13:52:40.100869+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100869+0000","last_undegraded":"2023-12-19T13:52:40.100869+0000","last_fullsized":"2023-12-19T13:52:40.100869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:39.296028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.097247+0000","last_change":"2023-12-19T13:52:40.097247+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.097247+0000","last_undegraded":"2023-12-19T13:52:40.097247+0000","last_fullsized":"2023-12-19T13:52:40.097247+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:20.603655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105469+0000","last_change":"2023-12-19T13:52:40.105469+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105469+0000","last_undegraded":"2023-12-19T13:52:40.105469+0000","last_fullsized":"2023-12-19T13:52:40.105469+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:03:00.686839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106621+0000","last_change":"2023-12-19T13:52:40.106621+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106621+0000","last_undegraded":"2023-12-19T13:52:40.106621+0000","last_fullsized":"2023-12-19T13:52:40.106621+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101931+0000","last_change":"2023-12-19T13:52:40.101931+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101931+0000","last_undegraded":"2023-12-19T13:52:40.101931+0000","last_fullsized":"2023-12-19T13:52:40.101931+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.091020+0000","last_change":"2023-12-19T13:52:40.091020+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.091020+0000","last_undegraded":"2023-12-19T13:52:40.091020+0000","last_fullsized":"2023-12-19T13:52:40.091020+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106095+0000","last_change":"2023-12-19T13:52:40.106095+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106095+0000","last_undegraded":"2023-12-19T13:52:40.106095+0000","last_fullsized":"2023-12-19T13:52:40.106095+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105250+0000","last_change":"2023-12-19T13:52:40.105250+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105250+0000","last_undegraded":"2023-12-19T13:52:40.105250+0000","last_fullsized":"2023-12-19T13:52:40.105250+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104854+0000","last_change":"2023-12-19T13:52:40.104854+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104854+0000","last_undegraded":"2023-12-19T13:52:40.104854+0000","last_fullsized":"2023-12-19T13:52:40.104854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090353+0000","last_change":"2023-12-19T13:52:40.090353+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090353+0000","last_undegraded":"2023-12-19T13:52:40.090353+0000","last_fullsized":"2023-12-19T13:52:40.090353+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.110356+0000","last_change":"2023-12-19T13:52:40.110356+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.110356+0000","last_undegraded":"2023-12-19T13:52:40.110356+0000","last_fullsized":"2023-12-19T13:52:40.110356+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:49.109631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101822+0000","last_change":"2023-12-19T13:52:40.101822+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101822+0000","last_undegraded":"2023-12-19T13:52:40.101822+0000","last_fullsized":"2023-12-19T13:52:40.101822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100836+0000","last_change":"2023-12-19T13:52:40.100836+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100836+0000","last_undegraded":"2023-12-19T13:52:40.100836+0000","last_fullsized":"2023-12-19T13:52:40.100836+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:23.909006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102898+0000","last_change":"2023-12-19T13:52:40.102898+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102898+0000","last_undegraded":"2023-12-19T13:52:40.102898+0000","last_fullsized":"2023-12-19T13:52:40.102898+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089439+0000","last_change":"2023-12-19T13:52:40.089439+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089439+0000","last_undegraded":"2023-12-19T13:52:40.089439+0000","last_fullsized":"2023-12-19T13:52:40.089439+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102164+0000","last_change":"2023-12-19T13:52:40.102164+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102164+0000","last_undegraded":"2023-12-19T13:52:40.102164+0000","last_fullsized":"2023-12-19T13:52:40.102164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101138+0000","last_change":"2023-12-19T13:52:40.101138+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101138+0000","last_undegraded":"2023-12-19T13:52:40.101138+0000","last_fullsized":"2023-12-19T13:52:40.101138+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:01.263392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.096498+0000","last_change":"2023-12-19T13:52:40.096498+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.096498+0000","last_undegraded":"2023-12-19T13:52:40.096498+0000","last_fullsized":"2023-12-19T13:52:40.096498+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:13:09.860701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093578+0000","last_change":"2023-12-19T13:52:40.093578+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093578+0000","last_undegraded":"2023-12-19T13:52:40.093578+0000","last_fullsized":"2023-12-19T13:52:40.093578+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:28.900515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.094315+0000","last_change":"2023-12-19T13:52:40.094315+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.094315+0000","last_undegraded":"2023-12-19T13:52:40.094315+0000","last_fullsized":"2023-12-19T13:52:40.094315+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090054+0000","last_change":"2023-12-19T13:52:40.090054+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090054+0000","last_undegraded":"2023-12-19T13:52:40.090054+0000","last_fullsized":"2023-12-19T13:52:40.090054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.103051+0000","last_change":"2023-12-19T13:52:40.103051+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.103051+0000","last_undegraded":"2023-12-19T13:52:40.103051+0000","last_fullsized":"2023-12-19T13:52:40.103051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099148+0000","last_change":"2023-12-19T13:52:40.099148+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099148+0000","last_undegraded":"2023-12-19T13:52:40.099148+0000","last_fullsized":"2023-12-19T13:52:40.099148+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104023+0000","last_change":"2023-12-19T13:52:40.104023+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104023+0000","last_undegraded":"2023-12-19T13:52:40.104023+0000","last_fullsized":"2023-12-19T13:52:40.104023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:50.782063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.107242+0000","last_change":"2023-12-19T13:52:40.107242+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.107242+0000","last_undegraded":"2023-12-19T13:52:40.107242+0000","last_fullsized":"2023-12-19T13:52:40.107242+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:12.123080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105021+0000","last_change":"2023-12-19T13:52:40.105021+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105021+0000","last_undegraded":"2023-12-19T13:52:40.105021+0000","last_fullsized":"2023-12-19T13:52:40.105021+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.094767+0000","last_change":"2023-12-19T13:52:40.094767+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.094767+0000","last_undegraded":"2023-12-19T13:52:40.094767+0000","last_fullsized":"2023-12-19T13:52:40.094767+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:04.663189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093259+0000","last_change":"2023-12-19T13:52:40.093259+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093259+0000","last_undegraded":"2023-12-19T13:52:40.093259+0000","last_fullsized":"2023-12-19T13:52:40.093259+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102554+0000","last_change":"2023-12-19T13:52:40.102554+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102554+0000","last_undegraded":"2023-12-19T13:52:40.102554+0000","last_fullsized":"2023-12-19T13:52:40.102554+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104032+0000","last_change":"2023-12-19T13:52:40.104032+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104032+0000","last_undegraded":"2023-12-19T13:52:40.104032+0000","last_fullsized":"2023-12-19T13:52:40.104032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090413+0000","last_change":"2023-12-19T13:52:40.090413+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090413+0000","last_undegraded":"2023-12-19T13:52:40.090413+0000","last_fullsized":"2023-12-19T13:52:40.090413+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.113683+0000","last_change":"2023-12-19T13:52:40.112901+0000","last_active":"2023-12-19T13:52:40.113683+0000","last_peered":"2023-12-19T13:52:40.113683+0000","last_clean":"2023-12-19T13:52:40.113683+0000","last_became_active":"2023-12-19T13:52:40.112699+0000","last_became_peered":"2023-12-19T13:52:40.112699+0000","last_unstale":"2023-12-19T13:52:40.113683+0000","last_undegraded":"2023-12-19T13:52:40.113683+0000","last_fullsized":"2023-12-19T13:52:40.113683+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:54:07.231697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104620+0000","last_change":"2023-12-19T13:52:40.104620+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104620+0000","last_undegraded":"2023-12-19T13:52:40.104620+0000","last_fullsized":"2023-12-19T13:52:40.104620+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111153+0000","last_change":"2023-12-19T13:52:40.108400+0000","last_active":"2023-12-19T13:52:40.111153+0000","last_peered":"2023-12-19T13:52:40.111153+0000","last_clean":"2023-12-19T13:52:40.111153+0000","last_became_active":"2023-12-19T13:52:40.108172+0000","last_became_peered":"2023-12-19T13:52:40.108172+0000","last_unstale":"2023-12-19T13:52:40.111153+0000","last_undegraded":"2023-12-19T13:52:40.111153+0000","last_fullsized":"2023-12-19T13:52:40.111153+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089205+0000","last_change":"2023-12-19T13:52:40.089205+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089205+0000","last_undegraded":"2023-12-19T13:52:40.089205+0000","last_fullsized":"2023-12-19T13:52:40.089205+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110136+0000","last_change":"2023-12-19T13:52:40.109163+0000","last_active":"2023-12-19T13:52:40.110136+0000","last_peered":"2023-12-19T13:52:40.110136+0000","last_clean":"2023-12-19T13:52:40.110136+0000","last_became_active":"2023-12-19T13:52:40.108736+0000","last_became_peered":"2023-12-19T13:52:40.108736+0000","last_unstale":"2023-12-19T13:52:40.110136+0000","last_undegraded":"2023-12-19T13:52:40.110136+0000","last_fullsized":"2023-12-19T13:52:40.110136+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:17.154193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100273+0000","last_change":"2023-12-19T13:52:40.100273+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100273+0000","last_undegraded":"2023-12-19T13:52:40.100273+0000","last_fullsized":"2023-12-19T13:52:40.100273+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.104077+0000","last_change":"2023-12-19T13:52:40.101417+0000","last_active":"2023-12-19T13:52:40.104077+0000","last_peered":"2023-12-19T13:52:40.104077+0000","last_clean":"2023-12-19T13:52:40.104077+0000","last_became_active":"2023-12-19T13:52:40.100811+0000","last_became_peered":"2023-12-19T13:52:40.100811+0000","last_unstale":"2023-12-19T13:52:40.104077+0000","last_undegraded":"2023-12-19T13:52:40.104077+0000","last_fullsized":"2023-12-19T13:52:40.104077+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:22.638411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093265+0000","last_change":"2023-12-19T13:52:40.093265+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093265+0000","last_undegraded":"2023-12-19T13:52:40.093265+0000","last_fullsized":"2023-12-19T13:52:40.093265+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:06.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.100436+0000","last_change":"2023-12-19T13:52:40.100131+0000","last_active":"2023-12-19T13:52:40.100436+0000","last_peered":"2023-12-19T13:52:40.100436+0000","last_clean":"2023-12-19T13:52:40.100436+0000","last_became_active":"2023-12-19T13:52:40.098016+0000","last_became_peered":"2023-12-19T13:52:40.098016+0000","last_unstale":"2023-12-19T13:52:40.100436+0000","last_undegraded":"2023-12-19T13:52:40.100436+0000","last_fullsized":"2023-12-19T13:52:40.100436+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100717+0000","last_change":"2023-12-19T13:52:40.100717+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100717+0000","last_undegraded":"2023-12-19T13:52:40.100717+0000","last_fullsized":"2023-12-19T13:52:40.100717+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.113148+0000","last_change":"2023-12-19T13:52:40.112976+0000","last_active":"2023-12-19T13:52:40.113148+0000","last_peered":"2023-12-19T13:52:40.113148+0000","last_clean":"2023-12-19T13:52:40.113148+0000","last_became_active":"2023-12-19T13:52:40.112742+0000","last_became_peered":"2023-12-19T13:52:40.112742+0000","last_unstale":"2023-12-19T13:52:40.113148+0000","last_undegraded":"2023-12-19T13:52:40.113148+0000","last_fullsized":"2023-12-19T13:52:40.113148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099783+0000","last_change":"2023-12-19T13:52:40.099783+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099783+0000","last_undegraded":"2023-12-19T13:52:40.099783+0000","last_fullsized":"2023-12-19T13:52:40.099783+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:46.642976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.102958+0000","last_change":"2023-12-19T13:52:40.102794+0000","last_active":"2023-12-19T13:52:40.102958+0000","last_peered":"2023-12-19T13:52:40.102958+0000","last_clean":"2023-12-19T13:52:40.102958+0000","last_became_active":"2023-12-19T13:52:40.102320+0000","last_became_peered":"2023-12-19T13:52:40.102320+0000","last_unstale":"2023-12-19T13:52:40.102958+0000","last_undegraded":"2023-12-19T13:52:40.102958+0000","last_fullsized":"2023-12-19T13:52:40.102958+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:25.273423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.098638+0000","last_change":"2023-12-19T13:52:40.098638+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.098638+0000","last_undegraded":"2023-12-19T13:52:40.098638+0000","last_fullsized":"2023-12-19T13:52:40.098638+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:48.602895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.115278+0000","last_change":"2023-12-19T13:52:40.115190+0000","last_active":"2023-12-19T13:52:40.115278+0000","last_peered":"2023-12-19T13:52:40.115278+0000","last_clean":"2023-12-19T13:52:40.115278+0000","last_became_active":"2023-12-19T13:52:40.114825+0000","last_became_peered":"2023-12-19T13:52:40.114825+0000","last_unstale":"2023-12-19T13:52:40.115278+0000","last_undegraded":"2023-12-19T13:52:40.115278+0000","last_fullsized":"2023-12-19T13:52:40.115278+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:36.838331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.091632+0000","last_change":"2023-12-19T13:52:40.091632+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.091632+0000","last_undegraded":"2023-12-19T13:52:40.091632+0000","last_fullsized":"2023-12-19T13:52:40.091632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.108909+0000","last_change":"2023-12-19T13:52:40.107384+0000","last_active":"2023-12-19T13:52:40.108909+0000","last_peered":"2023-12-19T13:52:40.108909+0000","last_clean":"2023-12-19T13:52:40.108909+0000","last_became_active":"2023-12-19T13:52:40.107084+0000","last_became_peered":"2023-12-19T13:52:40.107084+0000","last_unstale":"2023-12-19T13:52:40.108909+0000","last_undegraded":"2023-12-19T13:52:40.108909+0000","last_fullsized":"2023-12-19T13:52:40.108909+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.505632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101222+0000","last_change":"2023-12-19T13:52:40.101222+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101222+0000","last_undegraded":"2023-12-19T13:52:40.101222+0000","last_fullsized":"2023-12-19T13:52:40.101222+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111182+0000","last_change":"2023-12-19T13:52:40.110437+0000","last_active":"2023-12-19T13:52:40.111182+0000","last_peered":"2023-12-19T13:52:40.111182+0000","last_clean":"2023-12-19T13:52:40.111182+0000","last_became_active":"2023-12-19T13:52:40.110207+0000","last_became_peered":"2023-12-19T13:52:40.110207+0000","last_unstale":"2023-12-19T13:52:40.111182+0000","last_undegraded":"2023-12-19T13:52:40.111182+0000","last_fullsized":"2023-12-19T13:52:40.111182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099065+0000","last_change":"2023-12-19T13:52:40.099065+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099065+0000","last_undegraded":"2023-12-19T13:52:40.099065+0000","last_fullsized":"2023-12-19T13:52:40.099065+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114436+0000","last_change":"2023-12-19T13:52:40.112843+0000","last_active":"2023-12-19T13:52:40.114436+0000","last_peered":"2023-12-19T13:52:40.114436+0000","last_clean":"2023-12-19T13:52:40.114436+0000","last_became_active":"2023-12-19T13:52:40.112277+0000","last_became_peered":"2023-12-19T13:52:40.112277+0000","last_unstale":"2023-12-19T13:52:40.114436+0000","last_undegraded":"2023-12-19T13:52:40.114436+0000","last_fullsized":"2023-12-19T13:52:40.114436+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:31:51.725811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.109246+0000","last_change":"2023-12-19T13:52:40.109246+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.109246+0000","last_undegraded":"2023-12-19T13:52:40.109246+0000","last_fullsized":"2023-12-19T13:52:40.109246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:55.696157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105688+0000","last_change":"2023-12-19T13:52:40.103470+0000","last_active":"2023-12-19T13:52:40.105688+0000","last_peered":"2023-12-19T13:52:40.105688+0000","last_clean":"2023-12-19T13:52:40.105688+0000","last_became_active":"2023-12-19T13:52:40.102994+0000","last_became_peered":"2023-12-19T13:52:40.102994+0000","last_unstale":"2023-12-19T13:52:40.105688+0000","last_undegraded":"2023-12-19T13:52:40.105688+0000","last_fullsized":"2023-12-19T13:52:40.105688+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106794+0000","last_change":"2023-12-19T13:52:40.106794+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106794+0000","last_undegraded":"2023-12-19T13:52:40.106794+0000","last_fullsized":"2023-12-19T13:52:40.106794+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105613+0000","last_change":"2023-12-19T13:52:40.104935+0000","last_active":"2023-12-19T13:52:40.105613+0000","last_peered":"2023-12-19T13:52:40.105613+0000","last_clean":"2023-12-19T13:52:40.105613+0000","last_became_active":"2023-12-19T13:52:40.104463+0000","last_became_peered":"2023-12-19T13:52:40.104463+0000","last_unstale":"2023-12-19T13:52:40.105613+0000","last_undegraded":"2023-12-19T13:52:40.105613+0000","last_fullsized":"2023-12-19T13:52:40.105613+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:32.406240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.098991+0000","last_change":"2023-12-19T13:52:40.098991+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.098991+0000","last_undegraded":"2023-12-19T13:52:40.098991+0000","last_fullsized":"2023-12-19T13:52:40.098991+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:37.847464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.089686+0000","last_change":"2023-12-19T13:52:40.088998+0000","last_active":"2023-12-19T13:52:40.089686+0000","last_peered":"2023-12-19T13:52:40.089686+0000","last_clean":"2023-12-19T13:52:40.089686+0000","last_became_active":"2023-12-19T13:52:40.088437+0000","last_became_peered":"2023-12-19T13:52:40.088437+0000","last_unstale":"2023-12-19T13:52:40.089686+0000","last_undegraded":"2023-12-19T13:52:40.089686+0000","last_fullsized":"2023-12-19T13:52:40.089686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.092206+0000","last_change":"2023-12-19T13:52:40.092206+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.092206+0000","last_undegraded":"2023-12-19T13:52:40.092206+0000","last_fullsized":"2023-12-19T13:52:40.092206+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:19.408026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.115430+0000","last_change":"2023-12-19T13:52:40.115336+0000","last_active":"2023-12-19T13:52:40.115430+0000","last_peered":"2023-12-19T13:52:40.115430+0000","last_clean":"2023-12-19T13:52:40.115430+0000","last_became_active":"2023-12-19T13:52:40.115102+0000","last_became_peered":"2023-12-19T13:52:40.115102+0000","last_unstale":"2023-12-19T13:52:40.115430+0000","last_undegraded":"2023-12-19T13:52:40.115430+0000","last_fullsized":"2023-12-19T13:52:40.115430+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105444+0000","last_change":"2023-12-19T13:52:40.105444+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105444+0000","last_undegraded":"2023-12-19T13:52:40.105444+0000","last_fullsized":"2023-12-19T13:52:40.105444+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114689+0000","last_change":"2023-12-19T13:52:40.114613+0000","last_active":"2023-12-19T13:52:40.114689+0000","last_peered":"2023-12-19T13:52:40.114689+0000","last_clean":"2023-12-19T13:52:40.114689+0000","last_became_active":"2023-12-19T13:52:40.114053+0000","last_became_peered":"2023-12-19T13:52:40.114053+0000","last_unstale":"2023-12-19T13:52:40.114689+0000","last_undegraded":"2023-12-19T13:52:40.114689+0000","last_fullsized":"2023-12-19T13:52:40.114689+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:14.310685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089131+0000","last_change":"2023-12-19T13:52:40.089131+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089131+0000","last_undegraded":"2023-12-19T13:52:40.089131+0000","last_fullsized":"2023-12-19T13:52:40.089131+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105323+0000","last_change":"2023-12-19T13:52:40.103948+0000","last_active":"2023-12-19T13:52:40.105323+0000","last_peered":"2023-12-19T13:52:40.105323+0000","last_clean":"2023-12-19T13:52:40.105323+0000","last_became_active":"2023-12-19T13:52:40.103624+0000","last_became_peered":"2023-12-19T13:52:40.103624+0000","last_unstale":"2023-12-19T13:52:40.105323+0000","last_undegraded":"2023-12-19T13:52:40.105323+0000","last_fullsized":"2023-12-19T13:52:40.105323+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:19.594522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105051+0000","last_change":"2023-12-19T13:52:40.105051+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105051+0000","last_undegraded":"2023-12-19T13:52:40.105051+0000","last_fullsized":"2023-12-19T13:52:40.105051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.099911+0000","last_change":"2023-12-19T13:52:40.099292+0000","last_active":"2023-12-19T13:52:40.099911+0000","last_peered":"2023-12-19T13:52:40.099911+0000","last_clean":"2023-12-19T13:52:40.099911+0000","last_became_active":"2023-12-19T13:52:40.098816+0000","last_became_peered":"2023-12-19T13:52:40.098816+0000","last_unstale":"2023-12-19T13:52:40.099911+0000","last_undegraded":"2023-12-19T13:52:40.099911+0000","last_fullsized":"2023-12-19T13:52:40.099911+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:26.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.088075+0000","last_change":"2023-12-19T13:52:40.088075+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.088075+0000","last_undegraded":"2023-12-19T13:52:40.088075+0000","last_fullsized":"2023-12-19T13:52:40.088075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.104427+0000","last_change":"2023-12-19T13:52:40.103821+0000","last_active":"2023-12-19T13:52:40.104427+0000","last_peered":"2023-12-19T13:52:40.104427+0000","last_clean":"2023-12-19T13:52:40.104427+0000","last_became_active":"2023-12-19T13:52:40.103362+0000","last_became_peered":"2023-12-19T13:52:40.103362+0000","last_unstale":"2023-12-19T13:52:40.104427+0000","last_undegraded":"2023-12-19T13:52:40.104427+0000","last_fullsized":"2023-12-19T13:52:40.104427+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:23.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105969+0000","last_change":"2023-12-19T13:52:40.105969+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105969+0000","last_undegraded":"2023-12-19T13:52:40.105969+0000","last_fullsized":"2023-12-19T13:52:40.105969+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:52:14.420403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.096984+0000","last_change":"2023-12-19T13:52:40.093874+0000","last_active":"2023-12-19T13:52:40.096984+0000","last_peered":"2023-12-19T13:52:40.096984+0000","last_clean":"2023-12-19T13:52:40.096984+0000","last_became_active":"2023-12-19T13:52:40.093143+0000","last_became_peered":"2023-12-19T13:52:40.093143+0000","last_unstale":"2023-12-19T13:52:40.096984+0000","last_undegraded":"2023-12-19T13:52:40.096984+0000","last_fullsized":"2023-12-19T13:52:40.096984+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:45.633843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.108853+0000","last_change":"2023-12-19T13:52:40.108853+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.108853+0000","last_undegraded":"2023-12-19T13:52:40.108853+0000","last_fullsized":"2023-12-19T13:52:40.108853+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:19.557252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.107186+0000","last_change":"2023-12-19T13:52:40.106763+0000","last_active":"2023-12-19T13:52:40.107186+0000","last_peered":"2023-12-19T13:52:40.107186+0000","last_clean":"2023-12-19T13:52:40.107186+0000","last_became_active":"2023-12-19T13:52:40.106379+0000","last_became_peered":"2023-12-19T13:52:40.106379+0000","last_unstale":"2023-12-19T13:52:40.107186+0000","last_undegraded":"2023-12-19T13:52:40.107186+0000","last_fullsized":"2023-12-19T13:52:40.107186+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.092653+0000","last_change":"2023-12-19T13:52:40.092653+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.092653+0000","last_undegraded":"2023-12-19T13:52:40.092653+0000","last_fullsized":"2023-12-19T13:52:40.092653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:49.166277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.112419+0000","last_change":"2023-12-19T13:52:40.112335+0000","last_active":"2023-12-19T13:52:40.112419+0000","last_peered":"2023-12-19T13:52:40.112419+0000","last_clean":"2023-12-19T13:52:40.112419+0000","last_became_active":"2023-12-19T13:52:40.112142+0000","last_became_peered":"2023-12-19T13:52:40.112142+0000","last_unstale":"2023-12-19T13:52:40.112419+0000","last_undegraded":"2023-12-19T13:52:40.112419+0000","last_fullsized":"2023-12-19T13:52:40.112419+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:15.392835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.087992+0000","last_change":"2023-12-19T13:52:40.087992+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.087992+0000","last_undegraded":"2023-12-19T13:52:40.087992+0000","last_fullsized":"2023-12-19T13:52:40.087992+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110399+0000","last_change":"2023-12-19T13:52:40.109967+0000","last_active":"2023-12-19T13:52:40.110399+0000","last_peered":"2023-12-19T13:52:40.110399+0000","last_clean":"2023-12-19T13:52:40.110399+0000","last_became_active":"2023-12-19T13:52:40.109672+0000","last_became_peered":"2023-12-19T13:52:40.109672+0000","last_unstale":"2023-12-19T13:52:40.110399+0000","last_undegraded":"2023-12-19T13:52:40.110399+0000","last_fullsized":"2023-12-19T13:52:40.110399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:44:44.945990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104549+0000","last_change":"2023-12-19T13:52:40.104549+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104549+0000","last_undegraded":"2023-12-19T13:52:40.104549+0000","last_fullsized":"2023-12-19T13:52:40.104549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:32.794419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.108337+0000","last_change":"2023-12-19T13:52:40.107596+0000","last_active":"2023-12-19T13:52:40.108337+0000","last_peered":"2023-12-19T13:52:40.108337+0000","last_clean":"2023-12-19T13:52:40.108337+0000","last_became_active":"2023-12-19T13:52:40.106859+0000","last_became_peered":"2023-12-19T13:52:40.106859+0000","last_unstale":"2023-12-19T13:52:40.108337+0000","last_undegraded":"2023-12-19T13:52:40.108337+0000","last_fullsized":"2023-12-19T13:52:40.108337+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:04.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106834+0000","last_change":"2023-12-19T13:52:40.106834+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106834+0000","last_undegraded":"2023-12-19T13:52:40.106834+0000","last_fullsized":"2023-12-19T13:52:40.106834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:26.216347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110725+0000","last_change":"2023-12-19T13:52:40.110640+0000","last_active":"2023-12-19T13:52:40.110725+0000","last_peered":"2023-12-19T13:52:40.110725+0000","last_clean":"2023-12-19T13:52:40.110725+0000","last_became_active":"2023-12-19T13:52:40.109548+0000","last_became_peered":"2023-12-19T13:52:40.109548+0000","last_unstale":"2023-12-19T13:52:40.110725+0000","last_undegraded":"2023-12-19T13:52:40.110725+0000","last_fullsized":"2023-12-19T13:52:40.110725+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:42.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105045+0000","last_change":"2023-12-19T13:52:40.105045+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105045+0000","last_undegraded":"2023-12-19T13:52:40.105045+0000","last_fullsized":"2023-12-19T13:52:40.105045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:01:53.994030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.112012+0000","last_change":"2023-12-19T13:52:40.111068+0000","last_active":"2023-12-19T13:52:40.112012+0000","last_peered":"2023-12-19T13:52:40.112012+0000","last_clean":"2023-12-19T13:52:40.112012+0000","last_became_active":"2023-12-19T13:52:40.110835+0000","last_became_peered":"2023-12-19T13:52:40.110835+0000","last_unstale":"2023-12-19T13:52:40.112012+0000","last_undegraded":"2023-12-19T13:52:40.112012+0000","last_fullsized":"2023-12-19T13:52:40.112012+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104731+0000","last_change":"2023-12-19T13:52:40.104731+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104731+0000","last_undegraded":"2023-12-19T13:52:40.104731+0000","last_fullsized":"2023-12-19T13:52:40.104731+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111457+0000","last_change":"2023-12-19T13:52:40.111351+0000","last_active":"2023-12-19T13:52:40.111457+0000","last_peered":"2023-12-19T13:52:40.111457+0000","last_clean":"2023-12-19T13:52:40.111457+0000","last_became_active":"2023-12-19T13:52:40.111135+0000","last_became_peered":"2023-12-19T13:52:40.111135+0000","last_unstale":"2023-12-19T13:52:40.111457+0000","last_undegraded":"2023-12-19T13:52:40.111457+0000","last_fullsized":"2023-12-19T13:52:40.111457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:08.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099230+0000","last_change":"2023-12-19T13:52:40.099230+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099230+0000","last_undegraded":"2023-12-19T13:52:40.099230+0000","last_fullsized":"2023-12-19T13:52:40.099230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.109623+0000","last_change":"2023-12-19T13:52:40.108868+0000","last_active":"2023-12-19T13:52:40.109623+0000","last_peered":"2023-12-19T13:52:40.109623+0000","last_clean":"2023-12-19T13:52:40.109623+0000","last_became_active":"2023-12-19T13:52:40.108635+0000","last_became_peered":"2023-12-19T13:52:40.108635+0000","last_unstale":"2023-12-19T13:52:40.109623+0000","last_undegraded":"2023-12-19T13:52:40.109623+0000","last_fullsized":"2023-12-19T13:52:40.109623+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:18.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105379+0000","last_change":"2023-12-19T13:52:40.105379+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105379+0000","last_undegraded":"2023-12-19T13:52:40.105379+0000","last_fullsized":"2023-12-19T13:52:40.105379+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114787+0000","last_change":"2023-12-19T13:52:40.114680+0000","last_active":"2023-12-19T13:52:40.114787+0000","last_peered":"2023-12-19T13:52:40.114787+0000","last_clean":"2023-12-19T13:52:40.114787+0000","last_became_active":"2023-12-19T13:52:40.113789+0000","last_became_peered":"2023-12-19T13:52:40.113789+0000","last_unstale":"2023-12-19T13:52:40.114787+0000","last_undegraded":"2023-12-19T13:52:40.114787+0000","last_fullsized":"2023-12-19T13:52:40.114787+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105737+0000","last_change":"2023-12-19T13:52:40.105737+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105737+0000","last_undegraded":"2023-12-19T13:52:40.105737+0000","last_fullsized":"2023-12-19T13:52:40.105737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114457+0000","last_change":"2023-12-19T13:52:40.113228+0000","last_active":"2023-12-19T13:52:40.114457+0000","last_peered":"2023-12-19T13:52:40.114457+0000","last_clean":"2023-12-19T13:52:40.114457+0000","last_became_active":"2023-12-19T13:52:40.112593+0000","last_became_peered":"2023-12-19T13:52:40.112593+0000","last_unstale":"2023-12-19T13:52:40.114457+0000","last_undegraded":"2023-12-19T13:52:40.114457+0000","last_fullsized":"2023-12-19T13:52:40.114457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:09.700259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.103622+0000","last_change":"2023-12-19T13:52:40.103622+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.103622+0000","last_undegraded":"2023-12-19T13:52:40.103622+0000","last_fullsized":"2023-12-19T13:52:40.103622+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.102918+0000","last_change":"2023-12-19T13:52:40.102645+0000","last_active":"2023-12-19T13:52:40.102918+0000","last_peered":"2023-12-19T13:52:40.102918+0000","last_clean":"2023-12-19T13:52:40.102918+0000","last_became_active":"2023-12-19T13:52:40.097556+0000","last_became_peered":"2023-12-19T13:52:40.097556+0000","last_unstale":"2023-12-19T13:52:40.102918+0000","last_undegraded":"2023-12-19T13:52:40.102918+0000","last_fullsized":"2023-12-19T13:52:40.102918+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101601+0000","last_change":"2023-12-19T13:52:40.101601+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101601+0000","last_undegraded":"2023-12-19T13:52:40.101601+0000","last_fullsized":"2023-12-19T13:52:40.101601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.101369+0000","last_change":"2023-12-19T13:52:40.101203+0000","last_active":"2023-12-19T13:52:40.101369+0000","last_peered":"2023-12-19T13:52:40.101369+0000","last_clean":"2023-12-19T13:52:40.101369+0000","last_became_active":"2023-12-19T13:52:40.100476+0000","last_became_peered":"2023-12-19T13:52:40.100476+0000","last_unstale":"2023-12-19T13:52:40.101369+0000","last_undegraded":"2023-12-19T13:52:40.101369+0000","last_fullsized":"2023-12-19T13:52:40.101369+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:49.482529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T13:52:39.085675+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:52:39.085675+0000","last_peered":"2023-12-19T13:52:39.085675+0000","last_clean":"2023-12-19T13:52:39.085675+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:52:39.085675+0000","last_undegraded":"2023-12-19T13:52:39.085675+0000","last_fullsized":"2023-12-19T13:52:39.085675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0920000000000001,"15min":1.028},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6279999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.079},{"interface":"front","average":{"1min":1.127,"5min":1.0860000000000001,"15min":1.01},"min":{"1min":0.77600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4059999999999999,"5min":1.7190000000000001,"15min":2.008},"last":1.244}]},{"osd":1,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.153,"15min":1.0940000000000001},"min":{"1min":0.66000000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5960000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1200000000000001,"15min":1.054},"min":{"1min":0.751,"5min":0.497,"15min":0.497},"max":{"1min":1.5409999999999999,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.008}]},{"osd":2,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.149,"15min":1.1359999999999999},"min":{"1min":0.76400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5569999999999999,"5min":1.7330000000000001,"15min":1.7929999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.2050000000000001,"15min":1.159},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6499999999999999,"5min":1.871,"15min":1.8720000000000001},"last":0.92400000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2310000000000001,"15min":1.1679999999999999},"min":{"1min":0.96199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.399,"5min":1.931,"15min":1.931},"last":1.117},{"interface":"front","average":{"1min":1.425,"5min":1.3180000000000001,"15min":1.252},"min":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.6150000000000002,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.1870000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.26,"15min":1.2789999999999999},"min":{"1min":0.98699999999999999,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":1.506,"5min":1.6739999999999999,"15min":2.181},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3460000000000001,"15min":1.3839999999999999},"min":{"1min":0.86199999999999999,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":1.7070000000000001,"5min":2.2109999999999999,"15min":2.6909999999999998},"last":1.6100000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.258,"15min":1.228},"min":{"1min":0.86299999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5289999999999999,"5min":1.956,"15min":1.956},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.415,"15min":1.423},"min":{"1min":1.2250000000000001,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":1.841,"5min":2.024,"15min":2.2629999999999999},"last":1.4330000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.369,"15min":1.2869999999999999},"min":{"1min":1.012,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6739999999999999,"5min":2.024,"15min":2.024},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.5109999999999999,"15min":1.4890000000000001},"min":{"1min":1.3720000000000001,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":1.6759999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.631}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.66100000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6220000000000001,"5min":1.679,"15min":2.0640000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.079,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.631,"5min":1.631,"15min":3.2069999999999999},"last":1.357}]},{"osd":1,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.071,"15min":1.0369999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.405,"5min":1.619,"15min":1.962},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.139,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5029999999999999,"5min":1.5860000000000001,"15min":1.6279999999999999},"last":1.262}]},{"osd":2,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2609999999999999,"15min":1.2270000000000001},"min":{"1min":0.93600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7310000000000001,"5min":1.798,"15min":1.8180000000000001},"last":1.806},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2569999999999999,"15min":1.179},"min":{"1min":0.80200000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6319999999999999,"5min":1.802,"15min":1.802},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.331},"min":{"1min":0.84699999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2410000000000001,"15min":1.2629999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.67900000000000005},"max":{"1min":1.819,"5min":1.8799999999999999,"15min":4.3899999999999997},"last":1.0700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2969999999999999,"15min":1.2270000000000001},"min":{"1min":0.64500000000000002,"5min":0.56100000000000005,"15min":0.47899999999999998},"max":{"1min":1.798,"5min":1.865,"15min":1.865},"last":1.905},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.367,"15min":1.3109999999999999},"min":{"1min":0.96399999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7170000000000001,"5min":1.895,"15min":1.895},"last":1.512}]},{"osd":5,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.2609999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.865,"5min":1.962,"15min":1.962},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.423,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.865,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":2.169}]},{"osd":7,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.454,"15min":1.4279999999999999},"min":{"1min":0.91500000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.944,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4299999999999999,"15min":1.3720000000000001},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.57999999999999996},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.8540000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194147,"statfs":{"total":200000000,"available":198807459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.038,"15min":0.997},"min":{"1min":0.71999999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6839999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.155,"15min":1.095},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6669999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.5089999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.155,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.23,"5min":1.155,"15min":1.0469999999999999},"min":{"1min":0.95899999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5980000000000001,"5min":2.077,"15min":2.077},"last":1.694}]},{"osd":2,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2370000000000001,"15min":1.2569999999999999},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5609999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.373},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.268},"min":{"1min":0.88700000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7849999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.2769999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3240000000000001,"15min":1.242},"min":{"1min":1.0149999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8360000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.595},{"interface":"front","average":{"1min":1.375,"5min":1.2829999999999999,"15min":1.2549999999999999},"min":{"1min":1.099,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.75}]},{"osd":4,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.1519999999999999},"min":{"1min":0.91000000000000003,"5min":0.79400000000000004,"15min":0.77600000000000002},"max":{"1min":1.484,"5min":1.982,"15min":1.982},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.3799999999999999,"15min":1.3109999999999999},"min":{"1min":0.71399999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7969999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.79}]},{"osd":6,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3779999999999999,"15min":1.3280000000000001},"min":{"1min":0.97499999999999998,"5min":0.94099999999999995,"15min":0.623},"max":{"1min":1.853,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3500000000000001,"15min":1.367},"min":{"1min":0.84599999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6970000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0779999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4330000000000001},"min":{"1min":1.1399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.891,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":2.1219999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5029999999999999,"15min":1.429},"min":{"1min":1.2729999999999999,"5min":0.96099999999999997,"15min":0.82099999999999995},"max":{"1min":1.968,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.931}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194718,"statfs":{"total":200000000,"available":199391552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0369999999999999,"15min":1.0029999999999999},"min":{"1min":0.66200000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5569999999999999,"5min":1.657,"15min":1.657},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.121},"min":{"1min":0.73599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4850000000000001,"5min":1.6020000000000001,"15min":2.016},"last":0.88500000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.85099999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6060000000000001,"5min":1.621,"15min":1.621},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7969999999999999,"5min":1.887,"15min":1.887},"last":1.333}]},{"osd":2,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.145,"15min":1.046},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.629},"max":{"1min":1.4730000000000001,"5min":1.704,"15min":1.704},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.75,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2230000000000001,"15min":1.2150000000000001},"min":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6779999999999999,"5min":1.8360000000000001,"15min":1.952},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.284,"15min":1.2829999999999999},"min":{"1min":0.91200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.395}]},{"osd":5,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2170000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.474},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3420000000000001},"min":{"1min":0.90100000000000002,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":2.306,"5min":2.306,"15min":2.3570000000000002},"last":1.4370000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.343,"15min":1.395},"min":{"1min":0.94999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3839999999999999,"15min":1.458},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.76200000000000001},"max":{"1min":2.278,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.5680000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4670000000000001,"15min":1.466},"min":{"1min":0.872,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.677,"5min":1.52,"15min":1.528},"min":{"1min":0.998,"5min":0.68600000000000005,"15min":0.59999999999999998},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.518}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54200000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.272,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.89200000000000002,"15min":0.95999999999999996},"min":{"1min":0.63,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.365,"5min":1.502,"15min":3.0670000000000002},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.98499999999999999},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3320000000000001,"5min":1.508,"15min":5.3769999999999998},"last":0.753},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92500000000000004,"15min":0.98099999999999998},"min":{"1min":0.60999999999999999,"5min":0.39900000000000002,"15min":0.36499999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":2.387},"last":0.89200000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98599999999999999,"15min":1.0329999999999999},"min":{"1min":0.59999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.4770000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.002,"15min":1.1120000000000001},"min":{"1min":0.57399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4770000000000001,"5min":1.8620000000000001,"15min":2.657},"last":0.84899999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2030000000000001,"15min":1.2609999999999999},"min":{"1min":1.0389999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.718,"15min":3.0070000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2170000000000001,"15min":1.2330000000000001},"min":{"1min":0.998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.835,"5min":1.835,"15min":2.7690000000000001},"last":1.196}]},{"osd":5,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.2350000000000001,"15min":1.2989999999999999},"min":{"1min":0.97499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.679,"5min":1.7030000000000001,"15min":2.7309999999999999},"last":1.512},{"interface":"front","average":{"1min":1.21,"5min":1.214,"15min":1.262},"min":{"1min":0.96599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4630000000000001,"5min":1.671,"15min":3.5249999999999999},"last":1.284}]},{"osd":6,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.248,"15min":1.3},"min":{"1min":0.91900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5649999999999999,"5min":1.899,"15min":2.9769999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.3049999999999999,"15min":1.343},"min":{"1min":1.1599999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":1.9730000000000001,"15min":2.698},"last":1.3049999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.302,"15min":1.3640000000000001},"min":{"1min":0.88100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":1.8,"15min":3.609},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.369,"15min":1.3939999999999999},"min":{"1min":1.081,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7829999999999999,"5min":2.0910000000000002,"15min":3.0379999999999998},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.254,"5min":1.544,"15min":2.258},"last":1.153},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.999,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6539999999999999,"5min":11.85,"15min":11.85},"last":0.99299999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.5469999999999999,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0860000000000001,"15min":0.94799999999999995},"min":{"1min":0.50700000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3160000000000001,"5min":11.788,"15min":11.788},"last":1.206}]},{"osd":3,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.96299999999999997,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.413,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":1.081},{"interface":"front","average":{"1min":1.069,"5min":1.083,"15min":1.036},"min":{"1min":0.67600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.53,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.1180000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.335,"15min":1.1850000000000001},"min":{"1min":0.93100000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.6839999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.341},{"interface":"front","average":{"1min":1.214,"5min":1.2170000000000001,"15min":1.2230000000000001},"min":{"1min":0.89400000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":2.2189999999999999},"last":1.262}]},{"osd":5,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.421,"15min":1.2529999999999999},"min":{"1min":1.1040000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.748,"5min":11.888,"15min":11.888},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3109999999999999,"15min":1.3089999999999999},"min":{"1min":0.85199999999999998,"5min":0.76700000000000002,"15min":0.68899999999999995},"max":{"1min":1.738,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.3899999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2889999999999999,"15min":1.3100000000000001},"min":{"1min":0.97399999999999998,"5min":0.754,"15min":0.72399999999999998},"max":{"1min":1.6739999999999999,"5min":2.0640000000000001,"15min":2.964},"last":1.298},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3089999999999999,"15min":1.264},"min":{"1min":0.98599999999999999,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.6479999999999999,"5min":1.944,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8009999999999999,"5min":2.0369999999999999,"15min":2.351},"last":1.518},{"interface":"front","average":{"1min":1.383,"5min":1.4379999999999999,"15min":1.3029999999999999},"min":{"1min":1.0289999999999999,"5min":0.77100000000000002,"15min":0.75600000000000001},"max":{"1min":1.7729999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.419}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194147,"statfs":{"total":200000000,"available":198807459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95399999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5369999999999999,"5min":2.351,"15min":3.3500000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":1.0649999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4570000000000001,"5min":1.466,"15min":5.2999999999999998},"last":1.046},{"interface":"front","average":{"1min":1.137,"5min":1.1259999999999999,"15min":1.1779999999999999},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.764,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":1.2689999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.6759999999999999,"5min":1.6899999999999999,"15min":3.4300000000000002},"last":1.099},{"interface":"front","average":{"1min":1.03,"5min":1.014,"15min":1.169},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.706,"5min":1.706,"15min":7.157},"last":1.1930000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.163,"15min":1.2230000000000001},"min":{"1min":0.77800000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.266,"15min":1.2989999999999999},"min":{"1min":0.88700000000000001,"5min":0.79100000000000004,"15min":0.72799999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.1519999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2509999999999999,"15min":1.323},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.3},{"interface":"front","average":{"1min":1.321,"5min":1.4019999999999999,"15min":1.3759999999999999},"min":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9870000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2410000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.339,"15min":1.353},"min":{"1min":0.74199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3220000000000001,"15min":1.415},"min":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.77300000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":3.786},"last":1.4330000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.3819999999999999,"15min":1.4490000000000001},"min":{"1min":0.872,"5min":0.84799999999999998,"15min":0.78400000000000003},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.337,"15min":1.448},"min":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.63700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4390000000000001,"5min":1.5820000000000001,"15min":1.6399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.03,"15min":0.95899999999999996},"min":{"1min":0.57699999999999996,"5min":0.373,"15min":0.373},"max":{"1min":1.766,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2769999999999999,"15min":1.004},"min":{"1min":0.80200000000000005,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.845,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.478,"15min":1.1000000000000001},"min":{"1min":0.63400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.056,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.86199999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.88300000000000001,"15min":1.006},"min":{"1min":0.75800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.619,"5min":1.619,"15min":4.4530000000000003},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.071,"15min":1.103},"min":{"1min":0.77900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.254}]},{"osd":4,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.1659999999999999,"15min":1.2110000000000001},"min":{"1min":0.97899999999999998,"5min":0.746,"15min":0.746},"max":{"1min":1.917,"5min":1.917,"15min":4.4269999999999996},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.403,"15min":1.23},"min":{"1min":1.0429999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1099999999999999,"5min":15.766,"15min":15.766},"last":1.339}]},{"osd":5,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3879999999999999,"15min":1.234},"min":{"1min":0.93500000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4569999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2549999999999999,"15min":1.2869999999999999},"min":{"1min":0.98699999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3119999999999998,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.0169999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.3799999999999999,"15min":1.28},"min":{"1min":1.2150000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.242,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.522,"15min":1.3400000000000001},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.5489999999999999,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.2969999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4950000000000001,"15min":1.345},"min":{"1min":1.002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3530000000000002,"5min":14.381,"15min":14.381},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.4079999999999999,"15min":1.4059999999999999},"min":{"1min":1.1160000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3879999999999999,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.1160000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:52:45.489 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:52:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.742+0000 7f8d6f9c4640 1 Processor -- start 2023-12-19T13:52:45.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.742+0000 7f8d6f9c4640 1 -- start start 2023-12-19T13:52:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.744+0000 7f8d6f9c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8d680afa50 0x7f8d68166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.744+0000 7f8d6f9c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68165bc0 con 0x7f8d68161a40 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.744+0000 7f8d6f9c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6806e520 con 0x7f8d68161660 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.744+0000 7f8d6f9c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680afef0 con 0x7f8d680afa50 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.744+0000 7f8d6cf5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8d680afa50 0x7f8d68166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.744+0000 7f8d6cf5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8d680afa50 0x7f8d68166050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38338/0 (socket says 172.21.15.113:38338) 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.744+0000 7f8d6cf5f640 1 -- 172.21.15.113:0/2388493641 learned_addr learned my addr 172.21.15.113:0/2388493641 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.745+0000 7f8d6cf5f640 1 -- 172.21.15.113:0/2388493641 >> v1:172.21.15.151:6789/0 conn(0x7f8d68161660 legacy=0x7f8d680b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.745+0000 7f8d6cf5f640 1 -- 172.21.15.113:0/2388493641 >> v1:172.21.15.113:6789/0 conn(0x7f8d68161a40 legacy=0x7f8d680ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.745+0000 7f8d6cf5f640 1 -- 172.21.15.113:0/2388493641 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68165570 con 0x7f8d680afa50 2023-12-19T13:52:45.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.746+0000 7f8d6cf5f640 1 --2- 172.21.15.113:0/2388493641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d680afa50 0x7f8d68166050 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009870 tx=0x7f8d5c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7709a38057afbb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:45.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.746+0000 7f8d67fff640 1 -- 172.21.15.113:0/2388493641 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c030860 con 0x7f8d680afa50 2023-12-19T13:52:45.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.746+0000 7f8d67fff640 1 -- 172.21.15.113:0/2388493641 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c0309c0 con 0x7f8d680afa50 2023-12-19T13:52:45.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.746+0000 7f8d67fff640 1 -- 172.21.15.113:0/2388493641 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c030d50 con 0x7f8d680afa50 2023-12-19T13:52:45.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.747+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/2388493641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d680afa50 msgr2=0x7f8d68166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.747+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/2388493641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d680afa50 0x7f8d68166050 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009870 tx=0x7f8d5c02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.747+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/2388493641 shutdown_connections 2023-12-19T13:52:45.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.747+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/2388493641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d680afa50 0x7f8d68166050 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.747+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/2388493641 >> 172.21.15.113:0/2388493641 conn(0x7f8d680cbb70 msgr2=0x7f8d680cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:45.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.747+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/2388493641 shutdown_connections 2023-12-19T13:52:45.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.747+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/2388493641 wait complete. 2023-12-19T13:52:45.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.749+0000 7f8d6f9c4640 1 Processor -- start 2023-12-19T13:52:45.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.749+0000 7f8d6f9c4640 1 -- start start 2023-12-19T13:52:45.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6f9c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d680afa50 0x7f8d68150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6f9c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d68161660 0x7f8d680a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6f9c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d68161a40 0x7f8d68163440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6f9c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6815fe50 con 0x7f8d68161a40 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6f9c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68151110 con 0x7f8d680afa50 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6f9c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6815f5b0 con 0x7f8d68161660 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6df61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d68161a40 0x7f8d68163440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6df61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d68161a40 0x7f8d68163440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38346/0 (socket says 172.21.15.113:38346) 2023-12-19T13:52:45.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.750+0000 7f8d6df61640 1 -- 172.21.15.113:0/3939587094 learned_addr learned my addr 172.21.15.113:0/3939587094 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:45.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6cf5f640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d68161660 0x7f8d680a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6d760640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d680afa50 0x7f8d68150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6df61640 1 -- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d68161660 msgr2=0x7f8d680a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6df61640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d68161660 0x7f8d680a8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6df61640 1 -- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d680afa50 msgr2=0x7f8d68150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6df61640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d680afa50 0x7f8d68150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6df61640 1 -- 172.21.15.113:0/3939587094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0094d0 con 0x7f8d68161a40 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6d760640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d680afa50 0x7f8d68150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6df61640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d68161a40 0x7f8d68163440 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000c680 tx=0x7f8d6000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d65ffb640 1 -- 172.21.15.113:0/3939587094 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60003b70 con 0x7f8d68161a40 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d65ffb640 1 -- 172.21.15.113:0/3939587094 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60003cd0 con 0x7f8d68161a40 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d65ffb640 1 -- 172.21.15.113:0/3939587094 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60005310 con 0x7f8d68161a40 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.751+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6815f890 con 0x7f8d68161a40 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.752+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d681641a0 con 0x7f8d68161a40 2023-12-19T13:52:45.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.753+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d680aa8a0 con 0x7f8d68161a40 2023-12-19T13:52:45.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.754+0000 7f8d65ffb640 1 -- 172.21.15.113:0/3939587094 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d60005470 con 0x7f8d68161a40 2023-12-19T13:52:45.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.755+0000 7f8d65ffb640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d5406a430 0x7f8d5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:45.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.755+0000 7f8d65ffb640 1 -- 172.21.15.113:0/3939587094 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d60088630 con 0x7f8d68161a40 2023-12-19T13:52:45.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.755+0000 7f8d6d760640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d5406a430 0x7f8d5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:45.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.756+0000 7f8d6d760640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d5406a430 0x7f8d5406c8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8d58003eb0 tx=0x7f8d58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:45.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.759+0000 7f8d65ffb640 1 -- 172.21.15.113:0/3939587094 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d680aa8a0 con 0x7f8d68161a40 2023-12-19T13:52:45.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.947+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d68165850 con 0x7f8d5406a430 2023-12-19T13:52:45.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.956+0000 7f8d65ffb640 1 -- 172.21.15.113:0/3939587094 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279953 (secure 0 0 0) 0x7f8d58005030 con 0x7f8d5406a430 2023-12-19T13:52:45.958 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:45.961 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d5406a430 msgr2=0x7f8d5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d5406a430 0x7f8d5406c8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8d58003eb0 tx=0x7f8d58009040 comp rx=0 tx=0).stop 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d68161a40 msgr2=0x7f8d68163440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d68161a40 0x7f8d68163440 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000c680 tx=0x7f8d6000cb40 comp rx=0 tx=0).stop 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 shutdown_connections 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8d5406a430 0x7f8d5406c8f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8d68161a40 0x7f8d68163440 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d68161660 0x7f8d680a8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 --2- 172.21.15.113:0/3939587094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d680afa50 0x7f8d68150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:45.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.963+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 >> 172.21.15.113:0/3939587094 conn(0x7f8d680cbb70 msgr2=0x7f8d6815c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:45.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.964+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 shutdown_connections 2023-12-19T13:52:45.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:45.964+0000 7f8d6f9c4640 1 -- 172.21.15.113:0/3939587094 wait complete. 2023-12-19T13:52:45.983 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2023-12-19T13:52:44.534650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5863,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556636,"statfs":{"total":1600000000,"available":1593995605,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457382"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102075+0000","last_change":"2023-12-19T13:52:40.102075+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102075+0000","last_undegraded":"2023-12-19T13:52:40.102075+0000","last_fullsized":"2023-12-19T13:52:40.102075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.242518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102727+0000","last_change":"2023-12-19T13:52:40.102727+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102727+0000","last_undegraded":"2023-12-19T13:52:40.102727+0000","last_fullsized":"2023-12-19T13:52:40.102727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100869+0000","last_change":"2023-12-19T13:52:40.100869+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100869+0000","last_undegraded":"2023-12-19T13:52:40.100869+0000","last_fullsized":"2023-12-19T13:52:40.100869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:39.296028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.097247+0000","last_change":"2023-12-19T13:52:40.097247+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.097247+0000","last_undegraded":"2023-12-19T13:52:40.097247+0000","last_fullsized":"2023-12-19T13:52:40.097247+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:20.603655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105469+0000","last_change":"2023-12-19T13:52:40.105469+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105469+0000","last_undegraded":"2023-12-19T13:52:40.105469+0000","last_fullsized":"2023-12-19T13:52:40.105469+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:03:00.686839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106621+0000","last_change":"2023-12-19T13:52:40.106621+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106621+0000","last_undegraded":"2023-12-19T13:52:40.106621+0000","last_fullsized":"2023-12-19T13:52:40.106621+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101931+0000","last_change":"2023-12-19T13:52:40.101931+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101931+0000","last_undegraded":"2023-12-19T13:52:40.101931+0000","last_fullsized":"2023-12-19T13:52:40.101931+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.091020+0000","last_change":"2023-12-19T13:52:40.091020+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.091020+0000","last_undegraded":"2023-12-19T13:52:40.091020+0000","last_fullsized":"2023-12-19T13:52:40.091020+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106095+0000","last_change":"2023-12-19T13:52:40.106095+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106095+0000","last_undegraded":"2023-12-19T13:52:40.106095+0000","last_fullsized":"2023-12-19T13:52:40.106095+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105250+0000","last_change":"2023-12-19T13:52:40.105250+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105250+0000","last_undegraded":"2023-12-19T13:52:40.105250+0000","last_fullsized":"2023-12-19T13:52:40.105250+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104854+0000","last_change":"2023-12-19T13:52:40.104854+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104854+0000","last_undegraded":"2023-12-19T13:52:40.104854+0000","last_fullsized":"2023-12-19T13:52:40.104854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090353+0000","last_change":"2023-12-19T13:52:40.090353+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090353+0000","last_undegraded":"2023-12-19T13:52:40.090353+0000","last_fullsized":"2023-12-19T13:52:40.090353+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.110356+0000","last_change":"2023-12-19T13:52:40.110356+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.110356+0000","last_undegraded":"2023-12-19T13:52:40.110356+0000","last_fullsized":"2023-12-19T13:52:40.110356+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:49.109631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101822+0000","last_change":"2023-12-19T13:52:40.101822+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101822+0000","last_undegraded":"2023-12-19T13:52:40.101822+0000","last_fullsized":"2023-12-19T13:52:40.101822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100836+0000","last_change":"2023-12-19T13:52:40.100836+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100836+0000","last_undegraded":"2023-12-19T13:52:40.100836+0000","last_fullsized":"2023-12-19T13:52:40.100836+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:23.909006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102898+0000","last_change":"2023-12-19T13:52:40.102898+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102898+0000","last_undegraded":"2023-12-19T13:52:40.102898+0000","last_fullsized":"2023-12-19T13:52:40.102898+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089439+0000","last_change":"2023-12-19T13:52:40.089439+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089439+0000","last_undegraded":"2023-12-19T13:52:40.089439+0000","last_fullsized":"2023-12-19T13:52:40.089439+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102164+0000","last_change":"2023-12-19T13:52:40.102164+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102164+0000","last_undegraded":"2023-12-19T13:52:40.102164+0000","last_fullsized":"2023-12-19T13:52:40.102164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101138+0000","last_change":"2023-12-19T13:52:40.101138+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101138+0000","last_undegraded":"2023-12-19T13:52:40.101138+0000","last_fullsized":"2023-12-19T13:52:40.101138+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:01.263392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.096498+0000","last_change":"2023-12-19T13:52:40.096498+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.096498+0000","last_undegraded":"2023-12-19T13:52:40.096498+0000","last_fullsized":"2023-12-19T13:52:40.096498+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:13:09.860701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093578+0000","last_change":"2023-12-19T13:52:40.093578+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093578+0000","last_undegraded":"2023-12-19T13:52:40.093578+0000","last_fullsized":"2023-12-19T13:52:40.093578+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:28.900515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.094315+0000","last_change":"2023-12-19T13:52:40.094315+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.094315+0000","last_undegraded":"2023-12-19T13:52:40.094315+0000","last_fullsized":"2023-12-19T13:52:40.094315+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090054+0000","last_change":"2023-12-19T13:52:40.090054+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090054+0000","last_undegraded":"2023-12-19T13:52:40.090054+0000","last_fullsized":"2023-12-19T13:52:40.090054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.103051+0000","last_change":"2023-12-19T13:52:40.103051+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.103051+0000","last_undegraded":"2023-12-19T13:52:40.103051+0000","last_fullsized":"2023-12-19T13:52:40.103051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099148+0000","last_change":"2023-12-19T13:52:40.099148+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099148+0000","last_undegraded":"2023-12-19T13:52:40.099148+0000","last_fullsized":"2023-12-19T13:52:40.099148+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104023+0000","last_change":"2023-12-19T13:52:40.104023+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104023+0000","last_undegraded":"2023-12-19T13:52:40.104023+0000","last_fullsized":"2023-12-19T13:52:40.104023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:50.782063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.107242+0000","last_change":"2023-12-19T13:52:40.107242+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.107242+0000","last_undegraded":"2023-12-19T13:52:40.107242+0000","last_fullsized":"2023-12-19T13:52:40.107242+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:12.123080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105021+0000","last_change":"2023-12-19T13:52:40.105021+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105021+0000","last_undegraded":"2023-12-19T13:52:40.105021+0000","last_fullsized":"2023-12-19T13:52:40.105021+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.094767+0000","last_change":"2023-12-19T13:52:40.094767+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.094767+0000","last_undegraded":"2023-12-19T13:52:40.094767+0000","last_fullsized":"2023-12-19T13:52:40.094767+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:04.663189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093259+0000","last_change":"2023-12-19T13:52:40.093259+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093259+0000","last_undegraded":"2023-12-19T13:52:40.093259+0000","last_fullsized":"2023-12-19T13:52:40.093259+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.102554+0000","last_change":"2023-12-19T13:52:40.102554+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.102554+0000","last_undegraded":"2023-12-19T13:52:40.102554+0000","last_fullsized":"2023-12-19T13:52:40.102554+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104032+0000","last_change":"2023-12-19T13:52:40.104032+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104032+0000","last_undegraded":"2023-12-19T13:52:40.104032+0000","last_fullsized":"2023-12-19T13:52:40.104032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.090413+0000","last_change":"2023-12-19T13:52:40.090413+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.090413+0000","last_undegraded":"2023-12-19T13:52:40.090413+0000","last_fullsized":"2023-12-19T13:52:40.090413+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.113683+0000","last_change":"2023-12-19T13:52:40.112901+0000","last_active":"2023-12-19T13:52:40.113683+0000","last_peered":"2023-12-19T13:52:40.113683+0000","last_clean":"2023-12-19T13:52:40.113683+0000","last_became_active":"2023-12-19T13:52:40.112699+0000","last_became_peered":"2023-12-19T13:52:40.112699+0000","last_unstale":"2023-12-19T13:52:40.113683+0000","last_undegraded":"2023-12-19T13:52:40.113683+0000","last_fullsized":"2023-12-19T13:52:40.113683+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:54:07.231697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104620+0000","last_change":"2023-12-19T13:52:40.104620+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104620+0000","last_undegraded":"2023-12-19T13:52:40.104620+0000","last_fullsized":"2023-12-19T13:52:40.104620+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111153+0000","last_change":"2023-12-19T13:52:40.108400+0000","last_active":"2023-12-19T13:52:40.111153+0000","last_peered":"2023-12-19T13:52:40.111153+0000","last_clean":"2023-12-19T13:52:40.111153+0000","last_became_active":"2023-12-19T13:52:40.108172+0000","last_became_peered":"2023-12-19T13:52:40.108172+0000","last_unstale":"2023-12-19T13:52:40.111153+0000","last_undegraded":"2023-12-19T13:52:40.111153+0000","last_fullsized":"2023-12-19T13:52:40.111153+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089205+0000","last_change":"2023-12-19T13:52:40.089205+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089205+0000","last_undegraded":"2023-12-19T13:52:40.089205+0000","last_fullsized":"2023-12-19T13:52:40.089205+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110136+0000","last_change":"2023-12-19T13:52:40.109163+0000","last_active":"2023-12-19T13:52:40.110136+0000","last_peered":"2023-12-19T13:52:40.110136+0000","last_clean":"2023-12-19T13:52:40.110136+0000","last_became_active":"2023-12-19T13:52:40.108736+0000","last_became_peered":"2023-12-19T13:52:40.108736+0000","last_unstale":"2023-12-19T13:52:40.110136+0000","last_undegraded":"2023-12-19T13:52:40.110136+0000","last_fullsized":"2023-12-19T13:52:40.110136+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:17.154193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100273+0000","last_change":"2023-12-19T13:52:40.100273+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100273+0000","last_undegraded":"2023-12-19T13:52:40.100273+0000","last_fullsized":"2023-12-19T13:52:40.100273+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.104077+0000","last_change":"2023-12-19T13:52:40.101417+0000","last_active":"2023-12-19T13:52:40.104077+0000","last_peered":"2023-12-19T13:52:40.104077+0000","last_clean":"2023-12-19T13:52:40.104077+0000","last_became_active":"2023-12-19T13:52:40.100811+0000","last_became_peered":"2023-12-19T13:52:40.100811+0000","last_unstale":"2023-12-19T13:52:40.104077+0000","last_undegraded":"2023-12-19T13:52:40.104077+0000","last_fullsized":"2023-12-19T13:52:40.104077+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:22.638411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.093265+0000","last_change":"2023-12-19T13:52:40.093265+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.093265+0000","last_undegraded":"2023-12-19T13:52:40.093265+0000","last_fullsized":"2023-12-19T13:52:40.093265+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:06.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.100436+0000","last_change":"2023-12-19T13:52:40.100131+0000","last_active":"2023-12-19T13:52:40.100436+0000","last_peered":"2023-12-19T13:52:40.100436+0000","last_clean":"2023-12-19T13:52:40.100436+0000","last_became_active":"2023-12-19T13:52:40.098016+0000","last_became_peered":"2023-12-19T13:52:40.098016+0000","last_unstale":"2023-12-19T13:52:40.100436+0000","last_undegraded":"2023-12-19T13:52:40.100436+0000","last_fullsized":"2023-12-19T13:52:40.100436+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.100717+0000","last_change":"2023-12-19T13:52:40.100717+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.100717+0000","last_undegraded":"2023-12-19T13:52:40.100717+0000","last_fullsized":"2023-12-19T13:52:40.100717+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.113148+0000","last_change":"2023-12-19T13:52:40.112976+0000","last_active":"2023-12-19T13:52:40.113148+0000","last_peered":"2023-12-19T13:52:40.113148+0000","last_clean":"2023-12-19T13:52:40.113148+0000","last_became_active":"2023-12-19T13:52:40.112742+0000","last_became_peered":"2023-12-19T13:52:40.112742+0000","last_unstale":"2023-12-19T13:52:40.113148+0000","last_undegraded":"2023-12-19T13:52:40.113148+0000","last_fullsized":"2023-12-19T13:52:40.113148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099783+0000","last_change":"2023-12-19T13:52:40.099783+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099783+0000","last_undegraded":"2023-12-19T13:52:40.099783+0000","last_fullsized":"2023-12-19T13:52:40.099783+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:46.642976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.102958+0000","last_change":"2023-12-19T13:52:40.102794+0000","last_active":"2023-12-19T13:52:40.102958+0000","last_peered":"2023-12-19T13:52:40.102958+0000","last_clean":"2023-12-19T13:52:40.102958+0000","last_became_active":"2023-12-19T13:52:40.102320+0000","last_became_peered":"2023-12-19T13:52:40.102320+0000","last_unstale":"2023-12-19T13:52:40.102958+0000","last_undegraded":"2023-12-19T13:52:40.102958+0000","last_fullsized":"2023-12-19T13:52:40.102958+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:25.273423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.098638+0000","last_change":"2023-12-19T13:52:40.098638+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.098638+0000","last_undegraded":"2023-12-19T13:52:40.098638+0000","last_fullsized":"2023-12-19T13:52:40.098638+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:48.602895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.115278+0000","last_change":"2023-12-19T13:52:40.115190+0000","last_active":"2023-12-19T13:52:40.115278+0000","last_peered":"2023-12-19T13:52:40.115278+0000","last_clean":"2023-12-19T13:52:40.115278+0000","last_became_active":"2023-12-19T13:52:40.114825+0000","last_became_peered":"2023-12-19T13:52:40.114825+0000","last_unstale":"2023-12-19T13:52:40.115278+0000","last_undegraded":"2023-12-19T13:52:40.115278+0000","last_fullsized":"2023-12-19T13:52:40.115278+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:36.838331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.091632+0000","last_change":"2023-12-19T13:52:40.091632+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.091632+0000","last_undegraded":"2023-12-19T13:52:40.091632+0000","last_fullsized":"2023-12-19T13:52:40.091632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.108909+0000","last_change":"2023-12-19T13:52:40.107384+0000","last_active":"2023-12-19T13:52:40.108909+0000","last_peered":"2023-12-19T13:52:40.108909+0000","last_clean":"2023-12-19T13:52:40.108909+0000","last_became_active":"2023-12-19T13:52:40.107084+0000","last_became_peered":"2023-12-19T13:52:40.107084+0000","last_unstale":"2023-12-19T13:52:40.108909+0000","last_undegraded":"2023-12-19T13:52:40.108909+0000","last_fullsized":"2023-12-19T13:52:40.108909+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.505632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101222+0000","last_change":"2023-12-19T13:52:40.101222+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101222+0000","last_undegraded":"2023-12-19T13:52:40.101222+0000","last_fullsized":"2023-12-19T13:52:40.101222+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111182+0000","last_change":"2023-12-19T13:52:40.110437+0000","last_active":"2023-12-19T13:52:40.111182+0000","last_peered":"2023-12-19T13:52:40.111182+0000","last_clean":"2023-12-19T13:52:40.111182+0000","last_became_active":"2023-12-19T13:52:40.110207+0000","last_became_peered":"2023-12-19T13:52:40.110207+0000","last_unstale":"2023-12-19T13:52:40.111182+0000","last_undegraded":"2023-12-19T13:52:40.111182+0000","last_fullsized":"2023-12-19T13:52:40.111182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099065+0000","last_change":"2023-12-19T13:52:40.099065+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099065+0000","last_undegraded":"2023-12-19T13:52:40.099065+0000","last_fullsized":"2023-12-19T13:52:40.099065+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114436+0000","last_change":"2023-12-19T13:52:40.112843+0000","last_active":"2023-12-19T13:52:40.114436+0000","last_peered":"2023-12-19T13:52:40.114436+0000","last_clean":"2023-12-19T13:52:40.114436+0000","last_became_active":"2023-12-19T13:52:40.112277+0000","last_became_peered":"2023-12-19T13:52:40.112277+0000","last_unstale":"2023-12-19T13:52:40.114436+0000","last_undegraded":"2023-12-19T13:52:40.114436+0000","last_fullsized":"2023-12-19T13:52:40.114436+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:31:51.725811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.109246+0000","last_change":"2023-12-19T13:52:40.109246+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.109246+0000","last_undegraded":"2023-12-19T13:52:40.109246+0000","last_fullsized":"2023-12-19T13:52:40.109246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:55.696157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105688+0000","last_change":"2023-12-19T13:52:40.103470+0000","last_active":"2023-12-19T13:52:40.105688+0000","last_peered":"2023-12-19T13:52:40.105688+0000","last_clean":"2023-12-19T13:52:40.105688+0000","last_became_active":"2023-12-19T13:52:40.102994+0000","last_became_peered":"2023-12-19T13:52:40.102994+0000","last_unstale":"2023-12-19T13:52:40.105688+0000","last_undegraded":"2023-12-19T13:52:40.105688+0000","last_fullsized":"2023-12-19T13:52:40.105688+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106794+0000","last_change":"2023-12-19T13:52:40.106794+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106794+0000","last_undegraded":"2023-12-19T13:52:40.106794+0000","last_fullsized":"2023-12-19T13:52:40.106794+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105613+0000","last_change":"2023-12-19T13:52:40.104935+0000","last_active":"2023-12-19T13:52:40.105613+0000","last_peered":"2023-12-19T13:52:40.105613+0000","last_clean":"2023-12-19T13:52:40.105613+0000","last_became_active":"2023-12-19T13:52:40.104463+0000","last_became_peered":"2023-12-19T13:52:40.104463+0000","last_unstale":"2023-12-19T13:52:40.105613+0000","last_undegraded":"2023-12-19T13:52:40.105613+0000","last_fullsized":"2023-12-19T13:52:40.105613+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:32.406240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.098991+0000","last_change":"2023-12-19T13:52:40.098991+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.098991+0000","last_undegraded":"2023-12-19T13:52:40.098991+0000","last_fullsized":"2023-12-19T13:52:40.098991+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:37.847464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.089686+0000","last_change":"2023-12-19T13:52:40.088998+0000","last_active":"2023-12-19T13:52:40.089686+0000","last_peered":"2023-12-19T13:52:40.089686+0000","last_clean":"2023-12-19T13:52:40.089686+0000","last_became_active":"2023-12-19T13:52:40.088437+0000","last_became_peered":"2023-12-19T13:52:40.088437+0000","last_unstale":"2023-12-19T13:52:40.089686+0000","last_undegraded":"2023-12-19T13:52:40.089686+0000","last_fullsized":"2023-12-19T13:52:40.089686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.092206+0000","last_change":"2023-12-19T13:52:40.092206+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.092206+0000","last_undegraded":"2023-12-19T13:52:40.092206+0000","last_fullsized":"2023-12-19T13:52:40.092206+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:19.408026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.115430+0000","last_change":"2023-12-19T13:52:40.115336+0000","last_active":"2023-12-19T13:52:40.115430+0000","last_peered":"2023-12-19T13:52:40.115430+0000","last_clean":"2023-12-19T13:52:40.115430+0000","last_became_active":"2023-12-19T13:52:40.115102+0000","last_became_peered":"2023-12-19T13:52:40.115102+0000","last_unstale":"2023-12-19T13:52:40.115430+0000","last_undegraded":"2023-12-19T13:52:40.115430+0000","last_fullsized":"2023-12-19T13:52:40.115430+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105444+0000","last_change":"2023-12-19T13:52:40.105444+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105444+0000","last_undegraded":"2023-12-19T13:52:40.105444+0000","last_fullsized":"2023-12-19T13:52:40.105444+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114689+0000","last_change":"2023-12-19T13:52:40.114613+0000","last_active":"2023-12-19T13:52:40.114689+0000","last_peered":"2023-12-19T13:52:40.114689+0000","last_clean":"2023-12-19T13:52:40.114689+0000","last_became_active":"2023-12-19T13:52:40.114053+0000","last_became_peered":"2023-12-19T13:52:40.114053+0000","last_unstale":"2023-12-19T13:52:40.114689+0000","last_undegraded":"2023-12-19T13:52:40.114689+0000","last_fullsized":"2023-12-19T13:52:40.114689+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:14.310685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.089131+0000","last_change":"2023-12-19T13:52:40.089131+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.089131+0000","last_undegraded":"2023-12-19T13:52:40.089131+0000","last_fullsized":"2023-12-19T13:52:40.089131+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.105323+0000","last_change":"2023-12-19T13:52:40.103948+0000","last_active":"2023-12-19T13:52:40.105323+0000","last_peered":"2023-12-19T13:52:40.105323+0000","last_clean":"2023-12-19T13:52:40.105323+0000","last_became_active":"2023-12-19T13:52:40.103624+0000","last_became_peered":"2023-12-19T13:52:40.103624+0000","last_unstale":"2023-12-19T13:52:40.105323+0000","last_undegraded":"2023-12-19T13:52:40.105323+0000","last_fullsized":"2023-12-19T13:52:40.105323+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:19.594522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105051+0000","last_change":"2023-12-19T13:52:40.105051+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105051+0000","last_undegraded":"2023-12-19T13:52:40.105051+0000","last_fullsized":"2023-12-19T13:52:40.105051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.099911+0000","last_change":"2023-12-19T13:52:40.099292+0000","last_active":"2023-12-19T13:52:40.099911+0000","last_peered":"2023-12-19T13:52:40.099911+0000","last_clean":"2023-12-19T13:52:40.099911+0000","last_became_active":"2023-12-19T13:52:40.098816+0000","last_became_peered":"2023-12-19T13:52:40.098816+0000","last_unstale":"2023-12-19T13:52:40.099911+0000","last_undegraded":"2023-12-19T13:52:40.099911+0000","last_fullsized":"2023-12-19T13:52:40.099911+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:26.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.088075+0000","last_change":"2023-12-19T13:52:40.088075+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.088075+0000","last_undegraded":"2023-12-19T13:52:40.088075+0000","last_fullsized":"2023-12-19T13:52:40.088075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.104427+0000","last_change":"2023-12-19T13:52:40.103821+0000","last_active":"2023-12-19T13:52:40.104427+0000","last_peered":"2023-12-19T13:52:40.104427+0000","last_clean":"2023-12-19T13:52:40.104427+0000","last_became_active":"2023-12-19T13:52:40.103362+0000","last_became_peered":"2023-12-19T13:52:40.103362+0000","last_unstale":"2023-12-19T13:52:40.104427+0000","last_undegraded":"2023-12-19T13:52:40.104427+0000","last_fullsized":"2023-12-19T13:52:40.104427+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:23.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105969+0000","last_change":"2023-12-19T13:52:40.105969+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105969+0000","last_undegraded":"2023-12-19T13:52:40.105969+0000","last_fullsized":"2023-12-19T13:52:40.105969+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:52:14.420403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.096984+0000","last_change":"2023-12-19T13:52:40.093874+0000","last_active":"2023-12-19T13:52:40.096984+0000","last_peered":"2023-12-19T13:52:40.096984+0000","last_clean":"2023-12-19T13:52:40.096984+0000","last_became_active":"2023-12-19T13:52:40.093143+0000","last_became_peered":"2023-12-19T13:52:40.093143+0000","last_unstale":"2023-12-19T13:52:40.096984+0000","last_undegraded":"2023-12-19T13:52:40.096984+0000","last_fullsized":"2023-12-19T13:52:40.096984+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:45.633843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.108853+0000","last_change":"2023-12-19T13:52:40.108853+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.108853+0000","last_undegraded":"2023-12-19T13:52:40.108853+0000","last_fullsized":"2023-12-19T13:52:40.108853+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:19.557252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.107186+0000","last_change":"2023-12-19T13:52:40.106763+0000","last_active":"2023-12-19T13:52:40.107186+0000","last_peered":"2023-12-19T13:52:40.107186+0000","last_clean":"2023-12-19T13:52:40.107186+0000","last_became_active":"2023-12-19T13:52:40.106379+0000","last_became_peered":"2023-12-19T13:52:40.106379+0000","last_unstale":"2023-12-19T13:52:40.107186+0000","last_undegraded":"2023-12-19T13:52:40.107186+0000","last_fullsized":"2023-12-19T13:52:40.107186+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.092653+0000","last_change":"2023-12-19T13:52:40.092653+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.092653+0000","last_undegraded":"2023-12-19T13:52:40.092653+0000","last_fullsized":"2023-12-19T13:52:40.092653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:49.166277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.112419+0000","last_change":"2023-12-19T13:52:40.112335+0000","last_active":"2023-12-19T13:52:40.112419+0000","last_peered":"2023-12-19T13:52:40.112419+0000","last_clean":"2023-12-19T13:52:40.112419+0000","last_became_active":"2023-12-19T13:52:40.112142+0000","last_became_peered":"2023-12-19T13:52:40.112142+0000","last_unstale":"2023-12-19T13:52:40.112419+0000","last_undegraded":"2023-12-19T13:52:40.112419+0000","last_fullsized":"2023-12-19T13:52:40.112419+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:15.392835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.087992+0000","last_change":"2023-12-19T13:52:40.087992+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.087992+0000","last_undegraded":"2023-12-19T13:52:40.087992+0000","last_fullsized":"2023-12-19T13:52:40.087992+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110399+0000","last_change":"2023-12-19T13:52:40.109967+0000","last_active":"2023-12-19T13:52:40.110399+0000","last_peered":"2023-12-19T13:52:40.110399+0000","last_clean":"2023-12-19T13:52:40.110399+0000","last_became_active":"2023-12-19T13:52:40.109672+0000","last_became_peered":"2023-12-19T13:52:40.109672+0000","last_unstale":"2023-12-19T13:52:40.110399+0000","last_undegraded":"2023-12-19T13:52:40.110399+0000","last_fullsized":"2023-12-19T13:52:40.110399+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:44:44.945990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104549+0000","last_change":"2023-12-19T13:52:40.104549+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104549+0000","last_undegraded":"2023-12-19T13:52:40.104549+0000","last_fullsized":"2023-12-19T13:52:40.104549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:32.794419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.108337+0000","last_change":"2023-12-19T13:52:40.107596+0000","last_active":"2023-12-19T13:52:40.108337+0000","last_peered":"2023-12-19T13:52:40.108337+0000","last_clean":"2023-12-19T13:52:40.108337+0000","last_became_active":"2023-12-19T13:52:40.106859+0000","last_became_peered":"2023-12-19T13:52:40.106859+0000","last_unstale":"2023-12-19T13:52:40.108337+0000","last_undegraded":"2023-12-19T13:52:40.108337+0000","last_fullsized":"2023-12-19T13:52:40.108337+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:04.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.106834+0000","last_change":"2023-12-19T13:52:40.106834+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.106834+0000","last_undegraded":"2023-12-19T13:52:40.106834+0000","last_fullsized":"2023-12-19T13:52:40.106834+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:26.216347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.110725+0000","last_change":"2023-12-19T13:52:40.110640+0000","last_active":"2023-12-19T13:52:40.110725+0000","last_peered":"2023-12-19T13:52:40.110725+0000","last_clean":"2023-12-19T13:52:40.110725+0000","last_became_active":"2023-12-19T13:52:40.109548+0000","last_became_peered":"2023-12-19T13:52:40.109548+0000","last_unstale":"2023-12-19T13:52:40.110725+0000","last_undegraded":"2023-12-19T13:52:40.110725+0000","last_fullsized":"2023-12-19T13:52:40.110725+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:42.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105045+0000","last_change":"2023-12-19T13:52:40.105045+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105045+0000","last_undegraded":"2023-12-19T13:52:40.105045+0000","last_fullsized":"2023-12-19T13:52:40.105045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:01:53.994030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.112012+0000","last_change":"2023-12-19T13:52:40.111068+0000","last_active":"2023-12-19T13:52:40.112012+0000","last_peered":"2023-12-19T13:52:40.112012+0000","last_clean":"2023-12-19T13:52:40.112012+0000","last_became_active":"2023-12-19T13:52:40.110835+0000","last_became_peered":"2023-12-19T13:52:40.110835+0000","last_unstale":"2023-12-19T13:52:40.112012+0000","last_undegraded":"2023-12-19T13:52:40.112012+0000","last_fullsized":"2023-12-19T13:52:40.112012+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.104731+0000","last_change":"2023-12-19T13:52:40.104731+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.104731+0000","last_undegraded":"2023-12-19T13:52:40.104731+0000","last_fullsized":"2023-12-19T13:52:40.104731+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.111457+0000","last_change":"2023-12-19T13:52:40.111351+0000","last_active":"2023-12-19T13:52:40.111457+0000","last_peered":"2023-12-19T13:52:40.111457+0000","last_clean":"2023-12-19T13:52:40.111457+0000","last_became_active":"2023-12-19T13:52:40.111135+0000","last_became_peered":"2023-12-19T13:52:40.111135+0000","last_unstale":"2023-12-19T13:52:40.111457+0000","last_undegraded":"2023-12-19T13:52:40.111457+0000","last_fullsized":"2023-12-19T13:52:40.111457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:08.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.099230+0000","last_change":"2023-12-19T13:52:40.099230+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.099230+0000","last_undegraded":"2023-12-19T13:52:40.099230+0000","last_fullsized":"2023-12-19T13:52:40.099230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.109623+0000","last_change":"2023-12-19T13:52:40.108868+0000","last_active":"2023-12-19T13:52:40.109623+0000","last_peered":"2023-12-19T13:52:40.109623+0000","last_clean":"2023-12-19T13:52:40.109623+0000","last_became_active":"2023-12-19T13:52:40.108635+0000","last_became_peered":"2023-12-19T13:52:40.108635+0000","last_unstale":"2023-12-19T13:52:40.109623+0000","last_undegraded":"2023-12-19T13:52:40.109623+0000","last_fullsized":"2023-12-19T13:52:40.109623+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:18.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105379+0000","last_change":"2023-12-19T13:52:40.105379+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105379+0000","last_undegraded":"2023-12-19T13:52:40.105379+0000","last_fullsized":"2023-12-19T13:52:40.105379+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114787+0000","last_change":"2023-12-19T13:52:40.114680+0000","last_active":"2023-12-19T13:52:40.114787+0000","last_peered":"2023-12-19T13:52:40.114787+0000","last_clean":"2023-12-19T13:52:40.114787+0000","last_became_active":"2023-12-19T13:52:40.113789+0000","last_became_peered":"2023-12-19T13:52:40.113789+0000","last_unstale":"2023-12-19T13:52:40.114787+0000","last_undegraded":"2023-12-19T13:52:40.114787+0000","last_fullsized":"2023-12-19T13:52:40.114787+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.105737+0000","last_change":"2023-12-19T13:52:40.105737+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.105737+0000","last_undegraded":"2023-12-19T13:52:40.105737+0000","last_fullsized":"2023-12-19T13:52:40.105737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.114457+0000","last_change":"2023-12-19T13:52:40.113228+0000","last_active":"2023-12-19T13:52:40.114457+0000","last_peered":"2023-12-19T13:52:40.114457+0000","last_clean":"2023-12-19T13:52:40.114457+0000","last_became_active":"2023-12-19T13:52:40.112593+0000","last_became_peered":"2023-12-19T13:52:40.112593+0000","last_unstale":"2023-12-19T13:52:40.114457+0000","last_undegraded":"2023-12-19T13:52:40.114457+0000","last_fullsized":"2023-12-19T13:52:40.114457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:09.700259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.103622+0000","last_change":"2023-12-19T13:52:40.103622+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.103622+0000","last_undegraded":"2023-12-19T13:52:40.103622+0000","last_fullsized":"2023-12-19T13:52:40.103622+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.102918+0000","last_change":"2023-12-19T13:52:40.102645+0000","last_active":"2023-12-19T13:52:40.102918+0000","last_peered":"2023-12-19T13:52:40.102918+0000","last_clean":"2023-12-19T13:52:40.102918+0000","last_became_active":"2023-12-19T13:52:40.097556+0000","last_became_peered":"2023-12-19T13:52:40.097556+0000","last_unstale":"2023-12-19T13:52:40.102918+0000","last_undegraded":"2023-12-19T13:52:40.102918+0000","last_fullsized":"2023-12-19T13:52:40.102918+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-12-19T13:52:40.101601+0000","last_change":"2023-12-19T13:52:40.101601+0000","last_active":"2023-12-19T13:52:40.074447+0000","last_peered":"2023-12-19T13:52:40.074447+0000","last_clean":"2023-12-19T13:52:40.074447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:52:40.101601+0000","last_undegraded":"2023-12-19T13:52:40.101601+0000","last_fullsized":"2023-12-19T13:52:40.101601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.101369+0000","last_change":"2023-12-19T13:52:40.101203+0000","last_active":"2023-12-19T13:52:40.101369+0000","last_peered":"2023-12-19T13:52:40.101369+0000","last_clean":"2023-12-19T13:52:40.101369+0000","last_became_active":"2023-12-19T13:52:40.100476+0000","last_became_peered":"2023-12-19T13:52:40.100476+0000","last_unstale":"2023-12-19T13:52:40.101369+0000","last_undegraded":"2023-12-19T13:52:40.101369+0000","last_fullsized":"2023-12-19T13:52:40.101369+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:49.482529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T13:52:39.085675+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:52:39.085675+0000","last_peered":"2023-12-19T13:52:39.085675+0000","last_clean":"2023-12-19T13:52:39.085675+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:52:39.085675+0000","last_undegraded":"2023-12-19T13:52:39.085675+0000","last_fullsized":"2023-12-19T13:52:39.085675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0920000000000001,"15min":1.028},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6279999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.079},{"interface":"front","average":{"1min":1.127,"5min":1.0860000000000001,"15min":1.01},"min":{"1min":0.77600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4059999999999999,"5min":1.7190000000000001,"15min":2.008},"last":1.244}]},{"osd":1,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.153,"15min":1.0940000000000001},"min":{"1min":0.66000000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5960000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1200000000000001,"15min":1.054},"min":{"1min":0.751,"5min":0.497,"15min":0.497},"max":{"1min":1.5409999999999999,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.008}]},{"osd":2,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.149,"15min":1.1359999999999999},"min":{"1min":0.76400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5569999999999999,"5min":1.7330000000000001,"15min":1.7929999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.2050000000000001,"15min":1.159},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6499999999999999,"5min":1.871,"15min":1.8720000000000001},"last":0.92400000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2310000000000001,"15min":1.1679999999999999},"min":{"1min":0.96199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.399,"5min":1.931,"15min":1.931},"last":1.117},{"interface":"front","average":{"1min":1.425,"5min":1.3180000000000001,"15min":1.252},"min":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.6150000000000002,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.1870000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.26,"15min":1.2789999999999999},"min":{"1min":0.98699999999999999,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":1.506,"5min":1.6739999999999999,"15min":2.181},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3460000000000001,"15min":1.3839999999999999},"min":{"1min":0.86199999999999999,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":1.7070000000000001,"5min":2.2109999999999999,"15min":2.6909999999999998},"last":1.6100000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.258,"15min":1.228},"min":{"1min":0.86299999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5289999999999999,"5min":1.956,"15min":1.956},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.415,"15min":1.423},"min":{"1min":1.2250000000000001,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":1.841,"5min":2.024,"15min":2.2629999999999999},"last":1.4330000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.369,"15min":1.2869999999999999},"min":{"1min":1.012,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6739999999999999,"5min":2.024,"15min":2.024},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.5109999999999999,"15min":1.4890000000000001},"min":{"1min":1.3720000000000001,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":1.6759999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.631}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.66100000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6220000000000001,"5min":1.679,"15min":2.0640000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.079,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.631,"5min":1.631,"15min":3.2069999999999999},"last":1.357}]},{"osd":1,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.071,"15min":1.0369999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.405,"5min":1.619,"15min":1.962},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.139,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5029999999999999,"5min":1.5860000000000001,"15min":1.6279999999999999},"last":1.262}]},{"osd":2,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2609999999999999,"15min":1.2270000000000001},"min":{"1min":0.93600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7310000000000001,"5min":1.798,"15min":1.8180000000000001},"last":1.806},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2569999999999999,"15min":1.179},"min":{"1min":0.80200000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6319999999999999,"5min":1.802,"15min":1.802},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.331},"min":{"1min":0.84699999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2410000000000001,"15min":1.2629999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.67900000000000005},"max":{"1min":1.819,"5min":1.8799999999999999,"15min":4.3899999999999997},"last":1.0700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2969999999999999,"15min":1.2270000000000001},"min":{"1min":0.64500000000000002,"5min":0.56100000000000005,"15min":0.47899999999999998},"max":{"1min":1.798,"5min":1.865,"15min":1.865},"last":1.905},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.367,"15min":1.3109999999999999},"min":{"1min":0.96399999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7170000000000001,"5min":1.895,"15min":1.895},"last":1.512}]},{"osd":5,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.2609999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.865,"5min":1.962,"15min":1.962},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.423,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.865,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":2.169}]},{"osd":7,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.454,"15min":1.4279999999999999},"min":{"1min":0.91500000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.944,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4299999999999999,"15min":1.3720000000000001},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.57999999999999996},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.8540000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194147,"statfs":{"total":200000000,"available":198807459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.038,"15min":0.997},"min":{"1min":0.71999999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6839999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.155,"15min":1.095},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6669999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.5089999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.155,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.23,"5min":1.155,"15min":1.0469999999999999},"min":{"1min":0.95899999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5980000000000001,"5min":2.077,"15min":2.077},"last":1.694}]},{"osd":2,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2370000000000001,"15min":1.2569999999999999},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5609999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.373},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.268},"min":{"1min":0.88700000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7849999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.2769999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3240000000000001,"15min":1.242},"min":{"1min":1.0149999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8360000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.595},{"interface":"front","average":{"1min":1.375,"5min":1.2829999999999999,"15min":1.2549999999999999},"min":{"1min":1.099,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.75}]},{"osd":4,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.1519999999999999},"min":{"1min":0.91000000000000003,"5min":0.79400000000000004,"15min":0.77600000000000002},"max":{"1min":1.484,"5min":1.982,"15min":1.982},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.3799999999999999,"15min":1.3109999999999999},"min":{"1min":0.71399999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7969999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.79}]},{"osd":6,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3779999999999999,"15min":1.3280000000000001},"min":{"1min":0.97499999999999998,"5min":0.94099999999999995,"15min":0.623},"max":{"1min":1.853,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3500000000000001,"15min":1.367},"min":{"1min":0.84599999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6970000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0779999999999998}]},{"osd":7,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4330000000000001},"min":{"1min":1.1399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.891,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":2.1219999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5029999999999999,"15min":1.429},"min":{"1min":1.2729999999999999,"5min":0.96099999999999997,"15min":0.82099999999999995},"max":{"1min":1.968,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.931}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194718,"statfs":{"total":200000000,"available":199391552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0369999999999999,"15min":1.0029999999999999},"min":{"1min":0.66200000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5569999999999999,"5min":1.657,"15min":1.657},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.121},"min":{"1min":0.73599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4850000000000001,"5min":1.6020000000000001,"15min":2.016},"last":0.88500000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.85099999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6060000000000001,"5min":1.621,"15min":1.621},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7969999999999999,"5min":1.887,"15min":1.887},"last":1.333}]},{"osd":2,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.145,"15min":1.046},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.629},"max":{"1min":1.4730000000000001,"5min":1.704,"15min":1.704},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.75,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2230000000000001,"15min":1.2150000000000001},"min":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6779999999999999,"5min":1.8360000000000001,"15min":1.952},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.284,"15min":1.2829999999999999},"min":{"1min":0.91200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.395}]},{"osd":5,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2170000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.474},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3420000000000001},"min":{"1min":0.90100000000000002,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":2.306,"5min":2.306,"15min":2.3570000000000002},"last":1.4370000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.343,"15min":1.395},"min":{"1min":0.94999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3839999999999999,"15min":1.458},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.76200000000000001},"max":{"1min":2.278,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.5680000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4670000000000001,"15min":1.466},"min":{"1min":0.872,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.677,"5min":1.52,"15min":1.528},"min":{"1min":0.998,"5min":0.68600000000000005,"15min":0.59999999999999998},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.518}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54200000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.272,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.89200000000000002,"15min":0.95999999999999996},"min":{"1min":0.63,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.365,"5min":1.502,"15min":3.0670000000000002},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.98499999999999999},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3320000000000001,"5min":1.508,"15min":5.3769999999999998},"last":0.753},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92500000000000004,"15min":0.98099999999999998},"min":{"1min":0.60999999999999999,"5min":0.39900000000000002,"15min":0.36499999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":2.387},"last":0.89200000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98599999999999999,"15min":1.0329999999999999},"min":{"1min":0.59999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.4770000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.002,"15min":1.1120000000000001},"min":{"1min":0.57399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4770000000000001,"5min":1.8620000000000001,"15min":2.657},"last":0.84899999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2030000000000001,"15min":1.2609999999999999},"min":{"1min":1.0389999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.718,"15min":3.0070000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2170000000000001,"15min":1.2330000000000001},"min":{"1min":0.998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.835,"5min":1.835,"15min":2.7690000000000001},"last":1.196}]},{"osd":5,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.2350000000000001,"15min":1.2989999999999999},"min":{"1min":0.97499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.679,"5min":1.7030000000000001,"15min":2.7309999999999999},"last":1.512},{"interface":"front","average":{"1min":1.21,"5min":1.214,"15min":1.262},"min":{"1min":0.96599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4630000000000001,"5min":1.671,"15min":3.5249999999999999},"last":1.284}]},{"osd":6,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.248,"15min":1.3},"min":{"1min":0.91900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5649999999999999,"5min":1.899,"15min":2.9769999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.3049999999999999,"15min":1.343},"min":{"1min":1.1599999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":1.9730000000000001,"15min":2.698},"last":1.3049999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.302,"15min":1.3640000000000001},"min":{"1min":0.88100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":1.8,"15min":3.609},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.369,"15min":1.3939999999999999},"min":{"1min":1.081,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7829999999999999,"5min":2.0910000000000002,"15min":3.0379999999999998},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.254,"5min":1.544,"15min":2.258},"last":1.153},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.999,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6539999999999999,"5min":11.85,"15min":11.85},"last":0.99299999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.5469999999999999,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0860000000000001,"15min":0.94799999999999995},"min":{"1min":0.50700000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3160000000000001,"5min":11.788,"15min":11.788},"last":1.206}]},{"osd":3,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.96299999999999997,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.413,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":1.081},{"interface":"front","average":{"1min":1.069,"5min":1.083,"15min":1.036},"min":{"1min":0.67600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.53,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.1180000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.335,"15min":1.1850000000000001},"min":{"1min":0.93100000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.6839999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.341},{"interface":"front","average":{"1min":1.214,"5min":1.2170000000000001,"15min":1.2230000000000001},"min":{"1min":0.89400000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":2.2189999999999999},"last":1.262}]},{"osd":5,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.421,"15min":1.2529999999999999},"min":{"1min":1.1040000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.748,"5min":11.888,"15min":11.888},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3109999999999999,"15min":1.3089999999999999},"min":{"1min":0.85199999999999998,"5min":0.76700000000000002,"15min":0.68899999999999995},"max":{"1min":1.738,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.3899999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2889999999999999,"15min":1.3100000000000001},"min":{"1min":0.97399999999999998,"5min":0.754,"15min":0.72399999999999998},"max":{"1min":1.6739999999999999,"5min":2.0640000000000001,"15min":2.964},"last":1.298},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3089999999999999,"15min":1.264},"min":{"1min":0.98599999999999999,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.6479999999999999,"5min":1.944,"15min":2.286},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8009999999999999,"5min":2.0369999999999999,"15min":2.351},"last":1.518},{"interface":"front","average":{"1min":1.383,"5min":1.4379999999999999,"15min":1.3029999999999999},"min":{"1min":1.0289999999999999,"5min":0.77100000000000002,"15min":0.75600000000000001},"max":{"1min":1.7729999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.419}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194147,"statfs":{"total":200000000,"available":198807459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95399999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5369999999999999,"5min":2.351,"15min":3.3500000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":1.0649999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4570000000000001,"5min":1.466,"15min":5.2999999999999998},"last":1.046},{"interface":"front","average":{"1min":1.137,"5min":1.1259999999999999,"15min":1.1779999999999999},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.764,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":1.2689999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.6759999999999999,"5min":1.6899999999999999,"15min":3.4300000000000002},"last":1.099},{"interface":"front","average":{"1min":1.03,"5min":1.014,"15min":1.169},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.706,"5min":1.706,"15min":7.157},"last":1.1930000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.163,"15min":1.2230000000000001},"min":{"1min":0.77800000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.266,"15min":1.2989999999999999},"min":{"1min":0.88700000000000001,"5min":0.79100000000000004,"15min":0.72799999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.1519999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2509999999999999,"15min":1.323},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.3},{"interface":"front","average":{"1min":1.321,"5min":1.4019999999999999,"15min":1.3759999999999999},"min":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9870000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.2410000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.339,"15min":1.353},"min":{"1min":0.74199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3220000000000001,"15min":1.415},"min":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.77300000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":3.786},"last":1.4330000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.3819999999999999,"15min":1.4490000000000001},"min":{"1min":0.872,"5min":0.84799999999999998,"15min":0.78400000000000003},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.337,"15min":1.448},"min":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":588,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194724,"statfs":{"total":200000000,"available":199397827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.63700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4390000000000001,"5min":1.5820000000000001,"15min":1.6399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.03,"15min":0.95899999999999996},"min":{"1min":0.57699999999999996,"5min":0.373,"15min":0.373},"max":{"1min":1.766,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2769999999999999,"15min":1.004},"min":{"1min":0.80200000000000005,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.845,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.478,"15min":1.1000000000000001},"min":{"1min":0.63400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.056,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.86199999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.88300000000000001,"15min":1.006},"min":{"1min":0.75800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.619,"5min":1.619,"15min":4.4530000000000003},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.071,"15min":1.103},"min":{"1min":0.77900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.254}]},{"osd":4,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.1659999999999999,"15min":1.2110000000000001},"min":{"1min":0.97899999999999998,"5min":0.746,"15min":0.746},"max":{"1min":1.917,"5min":1.917,"15min":4.4269999999999996},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.403,"15min":1.23},"min":{"1min":1.0429999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1099999999999999,"5min":15.766,"15min":15.766},"last":1.339}]},{"osd":5,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3879999999999999,"15min":1.234},"min":{"1min":0.93500000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4569999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2549999999999999,"15min":1.2869999999999999},"min":{"1min":0.98699999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3119999999999998,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.0169999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.3799999999999999,"15min":1.28},"min":{"1min":1.2150000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.242,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.522,"15min":1.3400000000000001},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.5489999999999999,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.2969999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4950000000000001,"15min":1.345},"min":{"1min":1.002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3530000000000002,"5min":14.381,"15min":14.381},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.4079999999999999,"15min":1.4059999999999999},"min":{"1min":1.1160000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3879999999999999,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.1160000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:52:45.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-12-19T13:52:45.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.102075+0000', 'last_change': '2023-12-19T13:52:40.102075+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.102075+0000', 'last_undegraded': '2023-12-19T13:52:40.102075+0000', 'last_fullsized': '2023-12-19T13:52:40.102075+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:42:27.242518+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.102727+0000', 'last_change': '2023-12-19T13:52:40.102727+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.102727+0000', 'last_undegraded': '2023-12-19T13:52:40.102727+0000', 'last_fullsized': '2023-12-19T13:52:40.102727+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.100869+0000', 'last_change': '2023-12-19T13:52:40.100869+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.100869+0000', 'last_undegraded': '2023-12-19T13:52:40.100869+0000', 'last_fullsized': '2023-12-19T13:52:40.100869+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:59:39.296028+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.097247+0000', 'last_change': '2023-12-19T13:52:40.097247+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.097247+0000', 'last_undegraded': '2023-12-19T13:52:40.097247+0000', 'last_fullsized': '2023-12-19T13:52:40.097247+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:34:20.603655+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105469+0000', 'last_change': '2023-12-19T13:52:40.105469+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105469+0000', 'last_undegraded': '2023-12-19T13:52:40.105469+0000', 'last_fullsized': '2023-12-19T13:52:40.105469+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:03:00.686839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.106621+0000', 'last_change': '2023-12-19T13:52:40.106621+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.106621+0000', 'last_undegraded': '2023-12-19T13:52:40.106621+0000', 'last_fullsized': '2023-12-19T13:52:40.106621+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-12-19T13:52:45.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.101931+0000', 'last_change': '2023-12-19T13:52:40.101931+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.101931+0000', 'last_undegraded': '2023-12-19T13:52:40.101931+0000', 'last_fullsized': '2023-12-19T13:52:40.101931+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.091020+0000', 'last_change': '2023-12-19T13:52:40.091020+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.091020+0000', 'last_undegraded': '2023-12-19T13:52:40.091020+0000', 'last_fullsized': '2023-12-19T13:52:40.091020+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.106095+0000', 'last_change': '2023-12-19T13:52:40.106095+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.106095+0000', 'last_undegraded': '2023-12-19T13:52:40.106095+0000', 'last_fullsized': '2023-12-19T13:52:40.106095+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105250+0000', 'last_change': '2023-12-19T13:52:40.105250+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105250+0000', 'last_undegraded': '2023-12-19T13:52:40.105250+0000', 'last_fullsized': '2023-12-19T13:52:40.105250+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.104854+0000', 'last_change': '2023-12-19T13:52:40.104854+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.104854+0000', 'last_undegraded': '2023-12-19T13:52:40.104854+0000', 'last_fullsized': '2023-12-19T13:52:40.104854+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.090353+0000', 'last_change': '2023-12-19T13:52:40.090353+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.090353+0000', 'last_undegraded': '2023-12-19T13:52:40.090353+0000', 'last_fullsized': '2023-12-19T13:52:40.090353+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-12-19T13:52:45.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.110356+0000', 'last_change': '2023-12-19T13:52:40.110356+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.110356+0000', 'last_undegraded': '2023-12-19T13:52:40.110356+0000', 'last_fullsized': '2023-12-19T13:52:40.110356+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:13:49.109631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-12-19T13:52:45.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.101822+0000', 'last_change': '2023-12-19T13:52:40.101822+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.101822+0000', 'last_undegraded': '2023-12-19T13:52:40.101822+0000', 'last_fullsized': '2023-12-19T13:52:40.101822+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-12-19T13:52:45.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.100836+0000', 'last_change': '2023-12-19T13:52:40.100836+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.100836+0000', 'last_undegraded': '2023-12-19T13:52:40.100836+0000', 'last_fullsized': '2023-12-19T13:52:40.100836+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:44:23.909006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T13:52:45.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-12-19T13:52:45.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.102898+0000', 'last_change': '2023-12-19T13:52:40.102898+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.102898+0000', 'last_undegraded': '2023-12-19T13:52:40.102898+0000', 'last_fullsized': '2023-12-19T13:52:40.102898+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.089439+0000', 'last_change': '2023-12-19T13:52:40.089439+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.089439+0000', 'last_undegraded': '2023-12-19T13:52:40.089439+0000', 'last_fullsized': '2023-12-19T13:52:40.089439+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.102164+0000', 'last_change': '2023-12-19T13:52:40.102164+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.102164+0000', 'last_undegraded': '2023-12-19T13:52:40.102164+0000', 'last_fullsized': '2023-12-19T13:52:40.102164+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.101138+0000', 'last_change': '2023-12-19T13:52:40.101138+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.101138+0000', 'last_undegraded': '2023-12-19T13:52:40.101138+0000', 'last_fullsized': '2023-12-19T13:52:40.101138+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:53:01.263392+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.096498+0000', 'last_change': '2023-12-19T13:52:40.096498+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.096498+0000', 'last_undegraded': '2023-12-19T13:52:40.096498+0000', 'last_fullsized': '2023-12-19T13:52:40.096498+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:13:09.860701+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-12-19T13:52:45.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.093578+0000', 'last_change': '2023-12-19T13:52:40.093578+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.093578+0000', 'last_undegraded': '2023-12-19T13:52:40.093578+0000', 'last_fullsized': '2023-12-19T13:52:40.093578+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:41:28.900515+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.094315+0000', 'last_change': '2023-12-19T13:52:40.094315+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.094315+0000', 'last_undegraded': '2023-12-19T13:52:40.094315+0000', 'last_fullsized': '2023-12-19T13:52:40.094315+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.090054+0000', 'last_change': '2023-12-19T13:52:40.090054+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.090054+0000', 'last_undegraded': '2023-12-19T13:52:40.090054+0000', 'last_fullsized': '2023-12-19T13:52:40.090054+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.103051+0000', 'last_change': '2023-12-19T13:52:40.103051+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.103051+0000', 'last_undegraded': '2023-12-19T13:52:40.103051+0000', 'last_fullsized': '2023-12-19T13:52:40.103051+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.099148+0000', 'last_change': '2023-12-19T13:52:40.099148+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.099148+0000', 'last_undegraded': '2023-12-19T13:52:40.099148+0000', 'last_fullsized': '2023-12-19T13:52:40.099148+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-12-19T13:52:45.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.104023+0000', 'last_change': '2023-12-19T13:52:40.104023+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.104023+0000', 'last_undegraded': '2023-12-19T13:52:40.104023+0000', 'last_fullsized': '2023-12-19T13:52:40.104023+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:09:50.782063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.107242+0000', 'last_change': '2023-12-19T13:52:40.107242+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.107242+0000', 'last_undegraded': '2023-12-19T13:52:40.107242+0000', 'last_fullsized': '2023-12-19T13:52:40.107242+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:23:12.123080+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105021+0000', 'last_change': '2023-12-19T13:52:40.105021+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105021+0000', 'last_undegraded': '2023-12-19T13:52:40.105021+0000', 'last_fullsized': '2023-12-19T13:52:40.105021+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.094767+0000', 'last_change': '2023-12-19T13:52:40.094767+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.094767+0000', 'last_undegraded': '2023-12-19T13:52:40.094767+0000', 'last_fullsized': '2023-12-19T13:52:40.094767+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:36:04.663189+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.093259+0000', 'last_change': '2023-12-19T13:52:40.093259+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.093259+0000', 'last_undegraded': '2023-12-19T13:52:40.093259+0000', 'last_fullsized': '2023-12-19T13:52:40.093259+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.102554+0000', 'last_change': '2023-12-19T13:52:40.102554+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.102554+0000', 'last_undegraded': '2023-12-19T13:52:40.102554+0000', 'last_fullsized': '2023-12-19T13:52:40.102554+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.104032+0000', 'last_change': '2023-12-19T13:52:40.104032+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.104032+0000', 'last_undegraded': '2023-12-19T13:52:40.104032+0000', 'last_fullsized': '2023-12-19T13:52:40.104032+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.090413+0000', 'last_change': '2023-12-19T13:52:40.090413+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.090413+0000', 'last_undegraded': '2023-12-19T13:52:40.090413+0000', 'last_fullsized': '2023-12-19T13:52:40.090413+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.104620+0000', 'last_change': '2023-12-19T13:52:40.104620+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.104620+0000', 'last_undegraded': '2023-12-19T13:52:40.104620+0000', 'last_fullsized': '2023-12-19T13:52:40.104620+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.089205+0000', 'last_change': '2023-12-19T13:52:40.089205+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.089205+0000', 'last_undegraded': '2023-12-19T13:52:40.089205+0000', 'last_fullsized': '2023-12-19T13:52:40.089205+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.100273+0000', 'last_change': '2023-12-19T13:52:40.100273+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.100273+0000', 'last_undegraded': '2023-12-19T13:52:40.100273+0000', 'last_fullsized': '2023-12-19T13:52:40.100273+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.093265+0000', 'last_change': '2023-12-19T13:52:40.093265+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.093265+0000', 'last_undegraded': '2023-12-19T13:52:40.093265+0000', 'last_fullsized': '2023-12-19T13:52:40.093265+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:17:06.064980+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:52:45.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.100717+0000', 'last_change': '2023-12-19T13:52:40.100717+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.100717+0000', 'last_undegraded': '2023-12-19T13:52:40.100717+0000', 'last_fullsized': '2023-12-19T13:52:40.100717+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.099783+0000', 'last_change': '2023-12-19T13:52:40.099783+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.099783+0000', 'last_undegraded': '2023-12-19T13:52:40.099783+0000', 'last_fullsized': '2023-12-19T13:52:40.099783+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:52:46.642976+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.098638+0000', 'last_change': '2023-12-19T13:52:40.098638+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.098638+0000', 'last_undegraded': '2023-12-19T13:52:40.098638+0000', 'last_fullsized': '2023-12-19T13:52:40.098638+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:13:48.602895+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.091632+0000', 'last_change': '2023-12-19T13:52:40.091632+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.091632+0000', 'last_undegraded': '2023-12-19T13:52:40.091632+0000', 'last_fullsized': '2023-12-19T13:52:40.091632+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.101222+0000', 'last_change': '2023-12-19T13:52:40.101222+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.101222+0000', 'last_undegraded': '2023-12-19T13:52:40.101222+0000', 'last_fullsized': '2023-12-19T13:52:40.101222+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-12-19T13:52:45.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.099065+0000', 'last_change': '2023-12-19T13:52:40.099065+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.099065+0000', 'last_undegraded': '2023-12-19T13:52:40.099065+0000', 'last_fullsized': '2023-12-19T13:52:40.099065+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.109246+0000', 'last_change': '2023-12-19T13:52:40.109246+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.109246+0000', 'last_undegraded': '2023-12-19T13:52:40.109246+0000', 'last_fullsized': '2023-12-19T13:52:40.109246+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:33:55.696157+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.106794+0000', 'last_change': '2023-12-19T13:52:40.106794+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.106794+0000', 'last_undegraded': '2023-12-19T13:52:40.106794+0000', 'last_fullsized': '2023-12-19T13:52:40.106794+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.098991+0000', 'last_change': '2023-12-19T13:52:40.098991+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.098991+0000', 'last_undegraded': '2023-12-19T13:52:40.098991+0000', 'last_fullsized': '2023-12-19T13:52:40.098991+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:10:37.847464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.092206+0000', 'last_change': '2023-12-19T13:52:40.092206+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.092206+0000', 'last_undegraded': '2023-12-19T13:52:40.092206+0000', 'last_fullsized': '2023-12-19T13:52:40.092206+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:37:19.408026+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105444+0000', 'last_change': '2023-12-19T13:52:40.105444+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105444+0000', 'last_undegraded': '2023-12-19T13:52:40.105444+0000', 'last_fullsized': '2023-12-19T13:52:40.105444+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-12-19T13:52:45.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.089131+0000', 'last_change': '2023-12-19T13:52:40.089131+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.089131+0000', 'last_undegraded': '2023-12-19T13:52:40.089131+0000', 'last_fullsized': '2023-12-19T13:52:40.089131+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105051+0000', 'last_change': '2023-12-19T13:52:40.105051+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105051+0000', 'last_undegraded': '2023-12-19T13:52:40.105051+0000', 'last_fullsized': '2023-12-19T13:52:40.105051+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.088075+0000', 'last_change': '2023-12-19T13:52:40.088075+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.088075+0000', 'last_undegraded': '2023-12-19T13:52:40.088075+0000', 'last_fullsized': '2023-12-19T13:52:40.088075+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105969+0000', 'last_change': '2023-12-19T13:52:40.105969+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105969+0000', 'last_undegraded': '2023-12-19T13:52:40.105969+0000', 'last_fullsized': '2023-12-19T13:52:40.105969+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:52:14.420403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.108853+0000', 'last_change': '2023-12-19T13:52:40.108853+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.108853+0000', 'last_undegraded': '2023-12-19T13:52:40.108853+0000', 'last_fullsized': '2023-12-19T13:52:40.108853+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T14:05:19.557252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.092653+0000', 'last_change': '2023-12-19T13:52:40.092653+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.092653+0000', 'last_undegraded': '2023-12-19T13:52:40.092653+0000', 'last_fullsized': '2023-12-19T13:52:40.092653+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:29:49.166277+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-12-19T13:52:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.087992+0000', 'last_change': '2023-12-19T13:52:40.087992+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.087992+0000', 'last_undegraded': '2023-12-19T13:52:40.087992+0000', 'last_fullsized': '2023-12-19T13:52:40.087992+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.104549+0000', 'last_change': '2023-12-19T13:52:40.104549+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.104549+0000', 'last_undegraded': '2023-12-19T13:52:40.104549+0000', 'last_fullsized': '2023-12-19T13:52:40.104549+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:15:32.794419+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.106834+0000', 'last_change': '2023-12-19T13:52:40.106834+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.106834+0000', 'last_undegraded': '2023-12-19T13:52:40.106834+0000', 'last_fullsized': '2023-12-19T13:52:40.106834+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:50:26.216347+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105045+0000', 'last_change': '2023-12-19T13:52:40.105045+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105045+0000', 'last_undegraded': '2023-12-19T13:52:40.105045+0000', 'last_fullsized': '2023-12-19T13:52:40.105045+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:01:53.994030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.104731+0000', 'last_change': '2023-12-19T13:52:40.104731+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.104731+0000', 'last_undegraded': '2023-12-19T13:52:40.104731+0000', 'last_fullsized': '2023-12-19T13:52:40.104731+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.099230+0000', 'last_change': '2023-12-19T13:52:40.099230+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.099230+0000', 'last_undegraded': '2023-12-19T13:52:40.099230+0000', 'last_fullsized': '2023-12-19T13:52:40.099230+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-12-19T13:52:45.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105379+0000', 'last_change': '2023-12-19T13:52:40.105379+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105379+0000', 'last_undegraded': '2023-12-19T13:52:40.105379+0000', 'last_fullsized': '2023-12-19T13:52:40.105379+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:45.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-12-19T13:52:45.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.105737+0000', 'last_change': '2023-12-19T13:52:40.105737+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.105737+0000', 'last_undegraded': '2023-12-19T13:52:40.105737+0000', 'last_fullsized': '2023-12-19T13:52:40.105737+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-12-19T13:52:45.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.103622+0000', 'last_change': '2023-12-19T13:52:40.103622+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.103622+0000', 'last_undegraded': '2023-12-19T13:52:40.103622+0000', 'last_fullsized': '2023-12-19T13:52:40.103622+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T13:52:45.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-12-19T13:52:45.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-12-19T13:52:40.101601+0000', 'last_change': '2023-12-19T13:52:40.101601+0000', 'last_active': '2023-12-19T13:52:40.074447+0000', 'last_peered': '2023-12-19T13:52:40.074447+0000', 'last_clean': '2023-12-19T13:52:40.074447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T13:52:40.101601+0000', 'last_undegraded': '2023-12-19T13:52:40.101601+0000', 'last_fullsized': '2023-12-19T13:52:40.101601+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'last_clean_scrub_stamp': '2023-12-19T13:52:40.074447+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T13:52:46.000 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T13:52:46.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.243+0000 7fa261c4d640 1 Processor -- start 2023-12-19T13:52:46.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.243+0000 7fa261c4d640 1 -- start start 2023-12-19T13:52:46.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.244+0000 7fa261c4d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c146e30 0x7fa25c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa261c4d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa25c0b7ea0 0x7fa25c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa261c4d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c0b8300 con 0x7fa25c0d0a90 2023-12-19T13:52:46.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa261c4d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c147210 con 0x7fa25c0b7ea0 2023-12-19T13:52:46.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa261c4d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0d2370 con 0x7fa25c146e30 2023-12-19T13:52:46.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa260c4b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c146e30 0x7fa25c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa253fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa25c0b7ea0 0x7fa25c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa260c4b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c146e30 0x7fa25c0b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:39094/0 (socket says 172.21.15.113:39094) 2023-12-19T13:52:46.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.245+0000 7fa260c4b640 1 -- 172.21.15.113:0/639302676 learned_addr learned my addr 172.21.15.113:0/639302676 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:46.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.246+0000 7fa260c4b640 1 -- 172.21.15.113:0/639302676 >> v2:172.21.15.151:3300/0 conn(0x7fa25c0b7ea0 msgr2=0x7fa25c0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:46.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.246+0000 7fa260c4b640 1 --2- 172.21.15.113:0/639302676 >> v2:172.21.15.151:3300/0 conn(0x7fa25c0b7ea0 0x7fa25c0d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.246+0000 7fa260c4b640 1 -- 172.21.15.113:0/639302676 >> v1:172.21.15.151:6789/0 conn(0x7fa25c0d0a90 legacy=0x7fa25c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.246+0000 7fa260c4b640 1 -- 172.21.15.113:0/639302676 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c0d12d0 con 0x7fa25c146e30 2023-12-19T13:52:46.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.248+0000 7fa260c4b640 1 --2- 172.21.15.113:0/639302676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c146e30 0x7fa25c0b7960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa258009870 tx=0x7fa25802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21fd3470e507602e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:46.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.248+0000 7fa2537fe640 1 -- 172.21.15.113:0/639302676 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258031640 con 0x7fa25c146e30 2023-12-19T13:52:46.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.248+0000 7fa2537fe640 1 -- 172.21.15.113:0/639302676 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580317a0 con 0x7fa25c146e30 2023-12-19T13:52:46.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.248+0000 7fa2537fe640 1 -- 172.21.15.113:0/639302676 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258031b30 con 0x7fa25c146e30 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 -- 172.21.15.113:0/639302676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c146e30 msgr2=0x7fa25c0b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 --2- 172.21.15.113:0/639302676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c146e30 0x7fa25c0b7960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa258009870 tx=0x7fa25802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 -- 172.21.15.113:0/639302676 shutdown_connections 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 --2- 172.21.15.113:0/639302676 >> v2:172.21.15.151:3300/0 conn(0x7fa25c0b7ea0 0x7fa25c0d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 --2- 172.21.15.113:0/639302676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c146e30 0x7fa25c0b7960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 -- 172.21.15.113:0/639302676 >> 172.21.15.113:0/639302676 conn(0x7fa25c0b2990 msgr2=0x7fa25c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 -- 172.21.15.113:0/639302676 shutdown_connections 2023-12-19T13:52:46.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.249+0000 7fa261c4d640 1 -- 172.21.15.113:0/639302676 wait complete. 2023-12-19T13:52:46.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.251+0000 7fa261c4d640 1 Processor -- start 2023-12-19T13:52:46.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.251+0000 7fa261c4d640 1 -- start start 2023-12-19T13:52:46.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa261c4d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa25c0b7ea0 0x7fa25c145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa261c4d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c0d0a90 0x7fa25c0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa261c4d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa25c146e30 0x7fa25c13d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa261c4d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0b5080 con 0x7fa25c146e30 2023-12-19T13:52:46.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa261c4d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0b4470 con 0x7fa25c0b7ea0 2023-12-19T13:52:46.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa261c4d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0b4750 con 0x7fa25c0d0a90 2023-12-19T13:52:46.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa25c146e30 0x7fa25c13d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa25c146e30 0x7fa25c13d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38348/0 (socket says 172.21.15.113:38348) 2023-12-19T13:52:46.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 -- 172.21.15.113:0/2603417993 learned_addr learned my addr 172.21.15.113:0/2603417993 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa253fff640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c0d0a90 0x7fa25c0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa260c4b640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa25c0b7ea0 0x7fa25c145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 -- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c0d0a90 msgr2=0x7fa25c0b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c0d0a90 0x7fa25c0b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 -- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa25c0b7ea0 msgr2=0x7fa25c145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa25c0b7ea0 0x7fa25c145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.252+0000 7fa26144c640 1 -- 172.21.15.113:0/2603417993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580094d0 con 0x7fa25c146e30 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.253+0000 7fa260c4b640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa25c0b7ea0 0x7fa25c145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.253+0000 7fa26144c640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa25c146e30 0x7fa25c13d800 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c7a0 tx=0x7fa25400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.253+0000 7fa2517fa640 1 -- 172.21.15.113:0/2603417993 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254003b70 con 0x7fa25c146e30 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.253+0000 7fa2517fa640 1 -- 172.21.15.113:0/2603417993 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254003cf0 con 0x7fa25c146e30 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.253+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c0b4a30 con 0x7fa25c146e30 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.253+0000 7fa2517fa640 1 -- 172.21.15.113:0/2603417993 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254003ea0 con 0x7fa25c146e30 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.253+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c0b4100 con 0x7fa25c146e30 2023-12-19T13:52:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.255+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c061910 con 0x7fa25c146e30 2023-12-19T13:52:46.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.255+0000 7fa2517fa640 1 -- 172.21.15.113:0/2603417993 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa25400aa90 con 0x7fa25c146e30 2023-12-19T13:52:46.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.256+0000 7fa2517fa640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa24806a430 0x7fa24806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.256+0000 7fa2517fa640 1 -- 172.21.15.113:0/2603417993 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa254088760 con 0x7fa25c146e30 2023-12-19T13:52:46.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.257+0000 7fa260c4b640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa24806a430 0x7fa24806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.257+0000 7fa260c4b640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa24806a430 0x7fa24806c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa258009870 tx=0x7fa258008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.260+0000 7fa2517fa640 1 -- 172.21.15.113:0/2603417993 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa254053d50 con 0x7fa25c146e30 2023-12-19T13:52:46.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.513+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa25c0b51c0 con 0x7fa25c146e30 2023-12-19T13:52:46.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.514+0000 7fa2517fa640 1 -- 172.21.15.113:0/2603417993 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1029 (secure 0 0 0) 0x7fa25c0b51c0 con 0x7fa25c146e30 2023-12-19T13:52:46.514 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:46.514 INFO:teuthology.orchestra.run.smithi113.stdout:{"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":392,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1702993580,"num_in_osds":8,"osd_in_since":1702993577,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":6004395,"bytes_avail":1593995605,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":49,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6900}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-12-19T13:52:26.529556+0000","services":{}},"progress_events":{}} 2023-12-19T13:52:46.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa24806a430 msgr2=0x7fa24806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa24806a430 0x7fa24806c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa258009870 tx=0x7fa258008030 comp rx=0 tx=0).stop 2023-12-19T13:52:46.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa25c146e30 msgr2=0x7fa25c13d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa25c146e30 0x7fa25c13d800 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c7a0 tx=0x7fa25400cc60 comp rx=0 tx=0).stop 2023-12-19T13:52:46.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 shutdown_connections 2023-12-19T13:52:46.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa24806a430 0x7fa24806c8f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa25c146e30 0x7fa25c13d800 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa25c0d0a90 0x7fa25c0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 --2- 172.21.15.113:0/2603417993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa25c0b7ea0 0x7fa25c145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 >> 172.21.15.113:0/2603417993 conn(0x7fa25c0b2990 msgr2=0x7fa25c13e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:46.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 shutdown_connections 2023-12-19T13:52:46.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.517+0000 7fa261c4d640 1 -- 172.21.15.113:0/2603417993 wait complete. 2023-12-19T13:52:46.535 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T13:52:46.535 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:52:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.746+0000 7f23a2615640 1 Processor -- start 2023-12-19T13:52:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.747+0000 7f23a2615640 1 -- start start 2023-12-19T13:52:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.748+0000 7f23a2615640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.748+0000 7f23a2615640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f239c15b1e0 0x7f239c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.748+0000 7f23a2615640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c06b520 con 0x7f239c15a8a0 2023-12-19T13:52:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.748+0000 7f23a2615640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c0b2b20 con 0x7f239c15b1e0 2023-12-19T13:52:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.748+0000 7f23a2615640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0b2fb0 con 0x7f239c159f80 2023-12-19T13:52:46.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.749+0000 7f23a0e12640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f239c15b1e0 0x7f239c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.749+0000 7f23a1613640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.749+0000 7f23a0e12640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f239c15b1e0 0x7f239c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49534/0 (socket says 172.21.15.113:49534) 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.749+0000 7f23a0e12640 1 -- 172.21.15.113:0/2295033372 learned_addr learned my addr 172.21.15.113:0/2295033372 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.750+0000 7f2393fff640 1 -- 172.21.15.113:0/2295033372 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980196752 0 0) 0x7f239c06b520 con 0x7f239c15a8a0 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.750+0000 7f2393fff640 1 -- 172.21.15.113:0/2295033372 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2388003520 con 0x7f239c15a8a0 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.750+0000 7f23a1613640 1 -- 172.21.15.113:0/2295033372 >> v2:172.21.15.151:3300/0 conn(0x7f239c15b1e0 msgr2=0x7f239c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.750+0000 7f23a1613640 1 --2- 172.21.15.113:0/2295033372 >> v2:172.21.15.151:3300/0 conn(0x7f239c15b1e0 0x7f239c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.750+0000 7f23a1613640 1 -- 172.21.15.113:0/2295033372 >> v1:172.21.15.151:6789/0 conn(0x7f239c15a8a0 legacy=0x7f239c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.750+0000 7f23a1613640 1 -- 172.21.15.113:0/2295033372 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0b1f10 con 0x7f239c159f80 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.750+0000 7f23a0e12640 1 --2- 172.21.15.113:0/2295033372 >> v2:172.21.15.151:3300/0 conn(0x7f239c15b1e0 0x7f239c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:52:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.751+0000 7f23a1613640 1 --2- 172.21.15.113:0/2295033372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c06f160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23980097a0 tx=0x7f239802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f663a24334d940e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f2393fff640 1 -- 172.21.15.113:0/2295033372 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398030800 con 0x7f239c159f80 2023-12-19T13:52:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f2393fff640 1 -- 172.21.15.113:0/2295033372 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398030960 con 0x7f239c159f80 2023-12-19T13:52:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f2393fff640 1 -- 172.21.15.113:0/2295033372 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398030cd0 con 0x7f239c159f80 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f23a2615640 1 -- 172.21.15.113:0/2295033372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 msgr2=0x7f239c06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f23a2615640 1 --2- 172.21.15.113:0/2295033372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c06f160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23980097a0 tx=0x7f239802b940 comp rx=0 tx=0).stop 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f23a2615640 1 -- 172.21.15.113:0/2295033372 shutdown_connections 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f23a2615640 1 --2- 172.21.15.113:0/2295033372 >> v2:172.21.15.151:3300/0 conn(0x7f239c15b1e0 0x7f239c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f23a2615640 1 --2- 172.21.15.113:0/2295033372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c06f160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f23a2615640 1 -- 172.21.15.113:0/2295033372 >> 172.21.15.113:0/2295033372 conn(0x7f239c0b0100 msgr2=0x7f239c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.752+0000 7f23a2615640 1 -- 172.21.15.113:0/2295033372 shutdown_connections 2023-12-19T13:52:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.753+0000 7f23a2615640 1 -- 172.21.15.113:0/2295033372 wait complete. 2023-12-19T13:52:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.754+0000 7f23a2615640 1 Processor -- start 2023-12-19T13:52:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.754+0000 7f23a2615640 1 -- start start 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.755+0000 7f23a2615640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.755+0000 7f23a2615640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f239c15a8a0 0x7f239c1e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.755+0000 7f23a2615640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f239c15b1e0 0x7f239c1e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.755+0000 7f23a2615640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c06bd10 con 0x7f239c15a8a0 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.755+0000 7f23a2615640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c06c290 con 0x7f239c15b1e0 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.755+0000 7f23a2615640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c1e7540 con 0x7f239c159f80 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.755+0000 7f23a0e12640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f239c15a8a0 0x7f239c1e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f239c15a8a0 0x7f239c1e6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38358/0 (socket says 172.21.15.113:38358) 2023-12-19T13:52:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 -- 172.21.15.113:0/2071852754 learned_addr learned my addr 172.21.15.113:0/2071852754 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:46.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a1e14640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f239c15b1e0 0x7f239c1e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 -- 172.21.15.113:0/2071852754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 msgr2=0x7f239c153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 -- 172.21.15.113:0/2071852754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f239c15b1e0 msgr2=0x7f239c1e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f239c15b1e0 0x7f239c1e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 -- 172.21.15.113:0/2071852754 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0094d0 con 0x7f239c15a8a0 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.756+0000 7f23a0e12640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f239c15a8a0 0x7f239c1e6bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e9e0 tx=0x7f238c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.757+0000 7f2391ffb640 1 -- 172.21.15.113:0/2071852754 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00c9d0 con 0x7f239c15a8a0 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.757+0000 7f2391ffb640 1 -- 172.21.15.113:0/2071852754 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00cb30 con 0x7f239c15a8a0 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.757+0000 7f2391ffb640 1 -- 172.21.15.113:0/2071852754 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00cea0 con 0x7f239c15a8a0 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.757+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2398009400 con 0x7f239c15a8a0 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.757+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c06bf20 con 0x7f239c15a8a0 2023-12-19T13:52:46.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.758+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c061910 con 0x7f239c15a8a0 2023-12-19T13:52:46.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.759+0000 7f2391ffb640 1 -- 172.21.15.113:0/2071852754 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f238c013470 con 0x7f239c15a8a0 2023-12-19T13:52:46.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.760+0000 7f2391ffb640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f238006a430 0x7f238006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:46.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.760+0000 7f2391ffb640 1 -- 172.21.15.113:0/2071852754 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f238c088b50 con 0x7f239c15a8a0 2023-12-19T13:52:46.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.760+0000 7f23a1613640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f238006a430 0x7f238006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:46.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.761+0000 7f23a1613640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f238006a430 0x7f238006c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2398036000 tx=0x7f239803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:46.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.764+0000 7f2391ffb640 1 -- 172.21.15.113:0/2071852754 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f238c054140 con 0x7f239c15a8a0 2023-12-19T13:52:46.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.953+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f239c0b24d0 con 0x7f238006a430 2023-12-19T13:52:46.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.962+0000 7f2391ffb640 1 -- 172.21.15.113:0/2071852754 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282979 (secure 0 0 0) 0x7f2398030ad0 con 0x7f238006a430 2023-12-19T13:52:46.965 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:46.967 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:52:46.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f238006a430 msgr2=0x7f238006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f238006a430 0x7f238006c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2398036000 tx=0x7f239803b040 comp rx=0 tx=0).stop 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f239c15a8a0 msgr2=0x7f239c1e6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f239c15a8a0 0x7f239c1e6bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e9e0 tx=0x7f238c00eea0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 shutdown_connections 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f238006a430 0x7f238006c8f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f239c15b1e0 0x7f239c1e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f239c15a8a0 0x7f239c1e6bf0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 --2- 172.21.15.113:0/2071852754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f239c159f80 0x7f239c153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.967+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 >> 172.21.15.113:0/2071852754 conn(0x7f239c0b0100 msgr2=0x7f239c0af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.968+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 shutdown_connections 2023-12-19T13:52:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:46.968+0000 7f23a2615640 1 -- 172.21.15.113:0/2071852754 wait complete. 2023-12-19T13:52:46.985 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-12-19T13:52:46.535062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556486,"statfs":{"total":1600000000,"available":1593842356,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.449909"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593011+0000","last_change":"2023-12-19T13:52:40.592436+0000","last_active":"2023-12-19T13:52:40.593011+0000","last_peered":"2023-12-19T13:52:40.593011+0000","last_clean":"2023-12-19T13:52:40.593011+0000","last_became_active":"2023-12-19T13:52:40.592231+0000","last_became_peered":"2023-12-19T13:52:40.592231+0000","last_unstale":"2023-12-19T13:52:40.593011+0000","last_undegraded":"2023-12-19T13:52:40.593011+0000","last_fullsized":"2023-12-19T13:52:40.593011+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.242518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600675+0000","last_change":"2023-12-19T13:52:40.600579+0000","last_active":"2023-12-19T13:52:40.600675+0000","last_peered":"2023-12-19T13:52:40.600675+0000","last_clean":"2023-12-19T13:52:40.600675+0000","last_became_active":"2023-12-19T13:52:40.600085+0000","last_became_peered":"2023-12-19T13:52:40.600085+0000","last_unstale":"2023-12-19T13:52:40.600675+0000","last_undegraded":"2023-12-19T13:52:40.600675+0000","last_fullsized":"2023-12-19T13:52:40.600675+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591018+0000","last_change":"2023-12-19T13:52:40.589911+0000","last_active":"2023-12-19T13:52:40.591018+0000","last_peered":"2023-12-19T13:52:40.591018+0000","last_clean":"2023-12-19T13:52:40.591018+0000","last_became_active":"2023-12-19T13:52:40.589672+0000","last_became_peered":"2023-12-19T13:52:40.589672+0000","last_unstale":"2023-12-19T13:52:40.591018+0000","last_undegraded":"2023-12-19T13:52:40.591018+0000","last_fullsized":"2023-12-19T13:52:40.591018+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:39.296028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601306+0000","last_change":"2023-12-19T13:52:40.601153+0000","last_active":"2023-12-19T13:52:40.601306+0000","last_peered":"2023-12-19T13:52:40.601306+0000","last_clean":"2023-12-19T13:52:40.601306+0000","last_became_active":"2023-12-19T13:52:40.595970+0000","last_became_peered":"2023-12-19T13:52:40.595970+0000","last_unstale":"2023-12-19T13:52:40.601306+0000","last_undegraded":"2023-12-19T13:52:40.601306+0000","last_fullsized":"2023-12-19T13:52:40.601306+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:20.603655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590297+0000","last_change":"2023-12-19T13:52:40.589375+0000","last_active":"2023-12-19T13:52:40.590297+0000","last_peered":"2023-12-19T13:52:40.590297+0000","last_clean":"2023-12-19T13:52:40.590297+0000","last_became_active":"2023-12-19T13:52:40.589164+0000","last_became_peered":"2023-12-19T13:52:40.589164+0000","last_unstale":"2023-12-19T13:52:40.590297+0000","last_undegraded":"2023-12-19T13:52:40.590297+0000","last_fullsized":"2023-12-19T13:52:40.590297+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:03:00.686839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597549+0000","last_change":"2023-12-19T13:52:40.597221+0000","last_active":"2023-12-19T13:52:40.597549+0000","last_peered":"2023-12-19T13:52:40.597549+0000","last_clean":"2023-12-19T13:52:40.597549+0000","last_became_active":"2023-12-19T13:52:40.596845+0000","last_became_peered":"2023-12-19T13:52:40.596845+0000","last_unstale":"2023-12-19T13:52:40.597549+0000","last_undegraded":"2023-12-19T13:52:40.597549+0000","last_fullsized":"2023-12-19T13:52:40.597549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593565+0000","last_change":"2023-12-19T13:52:40.593287+0000","last_active":"2023-12-19T13:52:40.593565+0000","last_peered":"2023-12-19T13:52:40.593565+0000","last_clean":"2023-12-19T13:52:40.593565+0000","last_became_active":"2023-12-19T13:52:40.592940+0000","last_became_peered":"2023-12-19T13:52:40.592940+0000","last_unstale":"2023-12-19T13:52:40.593565+0000","last_undegraded":"2023-12-19T13:52:40.593565+0000","last_fullsized":"2023-12-19T13:52:40.593565+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601891+0000","last_change":"2023-12-19T13:52:40.601329+0000","last_active":"2023-12-19T13:52:40.601891+0000","last_peered":"2023-12-19T13:52:40.601891+0000","last_clean":"2023-12-19T13:52:40.601891+0000","last_became_active":"2023-12-19T13:52:40.601116+0000","last_became_peered":"2023-12-19T13:52:40.601116+0000","last_unstale":"2023-12-19T13:52:40.601891+0000","last_undegraded":"2023-12-19T13:52:40.601891+0000","last_fullsized":"2023-12-19T13:52:40.601891+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596437+0000","last_change":"2023-12-19T13:52:40.596022+0000","last_active":"2023-12-19T13:52:40.596437+0000","last_peered":"2023-12-19T13:52:40.596437+0000","last_clean":"2023-12-19T13:52:40.596437+0000","last_became_active":"2023-12-19T13:52:40.595819+0000","last_became_peered":"2023-12-19T13:52:40.595819+0000","last_unstale":"2023-12-19T13:52:40.596437+0000","last_undegraded":"2023-12-19T13:52:40.596437+0000","last_fullsized":"2023-12-19T13:52:40.596437+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597853+0000","last_change":"2023-12-19T13:52:40.597789+0000","last_active":"2023-12-19T13:52:40.597853+0000","last_peered":"2023-12-19T13:52:40.597853+0000","last_clean":"2023-12-19T13:52:40.597853+0000","last_became_active":"2023-12-19T13:52:40.597354+0000","last_became_peered":"2023-12-19T13:52:40.597354+0000","last_unstale":"2023-12-19T13:52:40.597853+0000","last_undegraded":"2023-12-19T13:52:40.597853+0000","last_fullsized":"2023-12-19T13:52:40.597853+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604350+0000","last_change":"2023-12-19T13:52:40.603708+0000","last_active":"2023-12-19T13:52:40.604350+0000","last_peered":"2023-12-19T13:52:40.604350+0000","last_clean":"2023-12-19T13:52:40.604350+0000","last_became_active":"2023-12-19T13:52:40.602904+0000","last_became_peered":"2023-12-19T13:52:40.602904+0000","last_unstale":"2023-12-19T13:52:40.604350+0000","last_undegraded":"2023-12-19T13:52:40.604350+0000","last_fullsized":"2023-12-19T13:52:40.604350+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598838+0000","last_change":"2023-12-19T13:52:40.598750+0000","last_active":"2023-12-19T13:52:40.598838+0000","last_peered":"2023-12-19T13:52:40.598838+0000","last_clean":"2023-12-19T13:52:40.598838+0000","last_became_active":"2023-12-19T13:52:40.597715+0000","last_became_peered":"2023-12-19T13:52:40.597715+0000","last_unstale":"2023-12-19T13:52:40.598838+0000","last_undegraded":"2023-12-19T13:52:40.598838+0000","last_fullsized":"2023-12-19T13:52:40.598838+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593446+0000","last_change":"2023-12-19T13:52:40.592732+0000","last_active":"2023-12-19T13:52:40.593446+0000","last_peered":"2023-12-19T13:52:40.593446+0000","last_clean":"2023-12-19T13:52:40.593446+0000","last_became_active":"2023-12-19T13:52:40.592473+0000","last_became_peered":"2023-12-19T13:52:40.592473+0000","last_unstale":"2023-12-19T13:52:40.593446+0000","last_undegraded":"2023-12-19T13:52:40.593446+0000","last_fullsized":"2023-12-19T13:52:40.593446+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:49.109631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603608+0000","last_change":"2023-12-19T13:52:40.601411+0000","last_active":"2023-12-19T13:52:40.603608+0000","last_peered":"2023-12-19T13:52:40.603608+0000","last_clean":"2023-12-19T13:52:40.603608+0000","last_became_active":"2023-12-19T13:52:40.598633+0000","last_became_peered":"2023-12-19T13:52:40.598633+0000","last_unstale":"2023-12-19T13:52:40.603608+0000","last_undegraded":"2023-12-19T13:52:40.603608+0000","last_fullsized":"2023-12-19T13:52:40.603608+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596734+0000","last_change":"2023-12-19T13:52:40.596233+0000","last_active":"2023-12-19T13:52:40.596734+0000","last_peered":"2023-12-19T13:52:40.596734+0000","last_clean":"2023-12-19T13:52:40.596734+0000","last_became_active":"2023-12-19T13:52:40.594355+0000","last_became_peered":"2023-12-19T13:52:40.594355+0000","last_unstale":"2023-12-19T13:52:40.596734+0000","last_undegraded":"2023-12-19T13:52:40.596734+0000","last_fullsized":"2023-12-19T13:52:40.596734+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:23.909006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597515+0000","last_change":"2023-12-19T13:52:40.596313+0000","last_active":"2023-12-19T13:52:40.597515+0000","last_peered":"2023-12-19T13:52:40.597515+0000","last_clean":"2023-12-19T13:52:40.597515+0000","last_became_active":"2023-12-19T13:52:40.595250+0000","last_became_peered":"2023-12-19T13:52:40.595250+0000","last_unstale":"2023-12-19T13:52:40.597515+0000","last_undegraded":"2023-12-19T13:52:40.597515+0000","last_fullsized":"2023-12-19T13:52:40.597515+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598230+0000","last_change":"2023-12-19T13:52:40.597986+0000","last_active":"2023-12-19T13:52:40.598230+0000","last_peered":"2023-12-19T13:52:40.598230+0000","last_clean":"2023-12-19T13:52:40.598230+0000","last_became_active":"2023-12-19T13:52:40.596988+0000","last_became_peered":"2023-12-19T13:52:40.596988+0000","last_unstale":"2023-12-19T13:52:40.598230+0000","last_undegraded":"2023-12-19T13:52:40.598230+0000","last_fullsized":"2023-12-19T13:52:40.598230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600913+0000","last_change":"2023-12-19T13:52:40.600835+0000","last_active":"2023-12-19T13:52:40.600913+0000","last_peered":"2023-12-19T13:52:40.600913+0000","last_clean":"2023-12-19T13:52:40.600913+0000","last_became_active":"2023-12-19T13:52:40.600397+0000","last_became_peered":"2023-12-19T13:52:40.600397+0000","last_unstale":"2023-12-19T13:52:40.600913+0000","last_undegraded":"2023-12-19T13:52:40.600913+0000","last_fullsized":"2023-12-19T13:52:40.600913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603629+0000","last_change":"2023-12-19T13:52:40.603104+0000","last_active":"2023-12-19T13:52:40.603629+0000","last_peered":"2023-12-19T13:52:40.603629+0000","last_clean":"2023-12-19T13:52:40.603629+0000","last_became_active":"2023-12-19T13:52:40.601178+0000","last_became_peered":"2023-12-19T13:52:40.601178+0000","last_unstale":"2023-12-19T13:52:40.603629+0000","last_undegraded":"2023-12-19T13:52:40.603629+0000","last_fullsized":"2023-12-19T13:52:40.603629+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:01.263392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605797+0000","last_change":"2023-12-19T13:52:40.605720+0000","last_active":"2023-12-19T13:52:40.605797+0000","last_peered":"2023-12-19T13:52:40.605797+0000","last_clean":"2023-12-19T13:52:40.605797+0000","last_became_active":"2023-12-19T13:52:40.605430+0000","last_became_peered":"2023-12-19T13:52:40.605430+0000","last_unstale":"2023-12-19T13:52:40.605797+0000","last_undegraded":"2023-12-19T13:52:40.605797+0000","last_fullsized":"2023-12-19T13:52:40.605797+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:13:09.860701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603912+0000","last_change":"2023-12-19T13:52:40.603538+0000","last_active":"2023-12-19T13:52:40.603912+0000","last_peered":"2023-12-19T13:52:40.603912+0000","last_clean":"2023-12-19T13:52:40.603912+0000","last_became_active":"2023-12-19T13:52:40.601968+0000","last_became_peered":"2023-12-19T13:52:40.601968+0000","last_unstale":"2023-12-19T13:52:40.603912+0000","last_undegraded":"2023-12-19T13:52:40.603912+0000","last_fullsized":"2023-12-19T13:52:40.603912+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:28.900515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596665+0000","last_change":"2023-12-19T13:52:40.595842+0000","last_active":"2023-12-19T13:52:40.596665+0000","last_peered":"2023-12-19T13:52:40.596665+0000","last_clean":"2023-12-19T13:52:40.596665+0000","last_became_active":"2023-12-19T13:52:40.595597+0000","last_became_peered":"2023-12-19T13:52:40.595597+0000","last_unstale":"2023-12-19T13:52:40.596665+0000","last_undegraded":"2023-12-19T13:52:40.596665+0000","last_fullsized":"2023-12-19T13:52:40.596665+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591922+0000","last_change":"2023-12-19T13:52:40.591291+0000","last_active":"2023-12-19T13:52:40.591922+0000","last_peered":"2023-12-19T13:52:40.591922+0000","last_clean":"2023-12-19T13:52:40.591922+0000","last_became_active":"2023-12-19T13:52:40.590982+0000","last_became_peered":"2023-12-19T13:52:40.590982+0000","last_unstale":"2023-12-19T13:52:40.591922+0000","last_undegraded":"2023-12-19T13:52:40.591922+0000","last_fullsized":"2023-12-19T13:52:40.591922+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605036+0000","last_change":"2023-12-19T13:52:40.604740+0000","last_active":"2023-12-19T13:52:40.605036+0000","last_peered":"2023-12-19T13:52:40.605036+0000","last_clean":"2023-12-19T13:52:40.605036+0000","last_became_active":"2023-12-19T13:52:40.604512+0000","last_became_peered":"2023-12-19T13:52:40.604512+0000","last_unstale":"2023-12-19T13:52:40.605036+0000","last_undegraded":"2023-12-19T13:52:40.605036+0000","last_fullsized":"2023-12-19T13:52:40.605036+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598813+0000","last_change":"2023-12-19T13:52:40.598675+0000","last_active":"2023-12-19T13:52:40.598813+0000","last_peered":"2023-12-19T13:52:40.598813+0000","last_clean":"2023-12-19T13:52:40.598813+0000","last_became_active":"2023-12-19T13:52:40.598342+0000","last_became_peered":"2023-12-19T13:52:40.598342+0000","last_unstale":"2023-12-19T13:52:40.598813+0000","last_undegraded":"2023-12-19T13:52:40.598813+0000","last_fullsized":"2023-12-19T13:52:40.598813+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598559+0000","last_change":"2023-12-19T13:52:40.598177+0000","last_active":"2023-12-19T13:52:40.598559+0000","last_peered":"2023-12-19T13:52:40.598559+0000","last_clean":"2023-12-19T13:52:40.598559+0000","last_became_active":"2023-12-19T13:52:40.597963+0000","last_became_peered":"2023-12-19T13:52:40.597963+0000","last_unstale":"2023-12-19T13:52:40.598559+0000","last_undegraded":"2023-12-19T13:52:40.598559+0000","last_fullsized":"2023-12-19T13:52:40.598559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:50.782063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594479+0000","last_change":"2023-12-19T13:52:40.594423+0000","last_active":"2023-12-19T13:52:40.594479+0000","last_peered":"2023-12-19T13:52:40.594479+0000","last_clean":"2023-12-19T13:52:40.594479+0000","last_became_active":"2023-12-19T13:52:40.593913+0000","last_became_peered":"2023-12-19T13:52:40.593913+0000","last_unstale":"2023-12-19T13:52:40.594479+0000","last_undegraded":"2023-12-19T13:52:40.594479+0000","last_fullsized":"2023-12-19T13:52:40.594479+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:12.123080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.579811+0000","last_change":"2023-12-19T13:52:40.579736+0000","last_active":"2023-12-19T13:52:40.579811+0000","last_peered":"2023-12-19T13:52:40.579811+0000","last_clean":"2023-12-19T13:52:40.579811+0000","last_became_active":"2023-12-19T13:52:40.579367+0000","last_became_peered":"2023-12-19T13:52:40.579367+0000","last_unstale":"2023-12-19T13:52:40.579811+0000","last_undegraded":"2023-12-19T13:52:40.579811+0000","last_fullsized":"2023-12-19T13:52:40.579811+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.606672+0000","last_change":"2023-12-19T13:52:40.606600+0000","last_active":"2023-12-19T13:52:40.606672+0000","last_peered":"2023-12-19T13:52:40.606672+0000","last_clean":"2023-12-19T13:52:40.606672+0000","last_became_active":"2023-12-19T13:52:40.603275+0000","last_became_peered":"2023-12-19T13:52:40.603275+0000","last_unstale":"2023-12-19T13:52:40.606672+0000","last_undegraded":"2023-12-19T13:52:40.606672+0000","last_fullsized":"2023-12-19T13:52:40.606672+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:04.663189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599557+0000","last_change":"2023-12-19T13:52:40.599345+0000","last_active":"2023-12-19T13:52:40.599557+0000","last_peered":"2023-12-19T13:52:40.599557+0000","last_clean":"2023-12-19T13:52:40.599557+0000","last_became_active":"2023-12-19T13:52:40.598945+0000","last_became_peered":"2023-12-19T13:52:40.598945+0000","last_unstale":"2023-12-19T13:52:40.599557+0000","last_undegraded":"2023-12-19T13:52:40.599557+0000","last_fullsized":"2023-12-19T13:52:40.599557+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597534+0000","last_change":"2023-12-19T13:52:40.597093+0000","last_active":"2023-12-19T13:52:40.597534+0000","last_peered":"2023-12-19T13:52:40.597534+0000","last_clean":"2023-12-19T13:52:40.597534+0000","last_became_active":"2023-12-19T13:52:40.596557+0000","last_became_peered":"2023-12-19T13:52:40.596557+0000","last_unstale":"2023-12-19T13:52:40.597534+0000","last_undegraded":"2023-12-19T13:52:40.597534+0000","last_fullsized":"2023-12-19T13:52:40.597534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598508+0000","last_change":"2023-12-19T13:52:40.598261+0000","last_active":"2023-12-19T13:52:40.598508+0000","last_peered":"2023-12-19T13:52:40.598508+0000","last_clean":"2023-12-19T13:52:40.598508+0000","last_became_active":"2023-12-19T13:52:40.598035+0000","last_became_peered":"2023-12-19T13:52:40.598035+0000","last_unstale":"2023-12-19T13:52:40.598508+0000","last_undegraded":"2023-12-19T13:52:40.598508+0000","last_fullsized":"2023-12-19T13:52:40.598508+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588518+0000","last_change":"2023-12-19T13:52:40.588261+0000","last_active":"2023-12-19T13:52:40.588518+0000","last_peered":"2023-12-19T13:52:40.588518+0000","last_clean":"2023-12-19T13:52:40.588518+0000","last_became_active":"2023-12-19T13:52:40.587905+0000","last_became_peered":"2023-12-19T13:52:40.587905+0000","last_unstale":"2023-12-19T13:52:40.588518+0000","last_undegraded":"2023-12-19T13:52:40.588518+0000","last_fullsized":"2023-12-19T13:52:40.588518+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"112'4","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594348+0000","last_change":"2023-12-19T13:52:40.112901+0000","last_active":"2023-12-19T13:52:40.594348+0000","last_peered":"2023-12-19T13:52:40.594348+0000","last_clean":"2023-12-19T13:52:40.594348+0000","last_became_active":"2023-12-19T13:52:40.112699+0000","last_became_peered":"2023-12-19T13:52:40.112699+0000","last_unstale":"2023-12-19T13:52:40.594348+0000","last_undegraded":"2023-12-19T13:52:40.594348+0000","last_fullsized":"2023-12-19T13:52:40.594348+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:54:07.231697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591007+0000","last_change":"2023-12-19T13:52:40.590949+0000","last_active":"2023-12-19T13:52:40.591007+0000","last_peered":"2023-12-19T13:52:40.591007+0000","last_clean":"2023-12-19T13:52:40.591007+0000","last_became_active":"2023-12-19T13:52:40.590743+0000","last_became_peered":"2023-12-19T13:52:40.590743+0000","last_unstale":"2023-12-19T13:52:40.591007+0000","last_undegraded":"2023-12-19T13:52:40.591007+0000","last_fullsized":"2023-12-19T13:52:40.591007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598521+0000","last_change":"2023-12-19T13:52:40.108400+0000","last_active":"2023-12-19T13:52:40.598521+0000","last_peered":"2023-12-19T13:52:40.598521+0000","last_clean":"2023-12-19T13:52:40.598521+0000","last_became_active":"2023-12-19T13:52:40.108172+0000","last_became_peered":"2023-12-19T13:52:40.108172+0000","last_unstale":"2023-12-19T13:52:40.598521+0000","last_undegraded":"2023-12-19T13:52:40.598521+0000","last_fullsized":"2023-12-19T13:52:40.598521+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593649+0000","last_change":"2023-12-19T13:52:40.593316+0000","last_active":"2023-12-19T13:52:40.593649+0000","last_peered":"2023-12-19T13:52:40.593649+0000","last_clean":"2023-12-19T13:52:40.593649+0000","last_became_active":"2023-12-19T13:52:40.593081+0000","last_became_peered":"2023-12-19T13:52:40.593081+0000","last_unstale":"2023-12-19T13:52:40.593649+0000","last_undegraded":"2023-12-19T13:52:40.593649+0000","last_fullsized":"2023-12-19T13:52:40.593649+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600277+0000","last_change":"2023-12-19T13:52:40.109163+0000","last_active":"2023-12-19T13:52:40.600277+0000","last_peered":"2023-12-19T13:52:40.600277+0000","last_clean":"2023-12-19T13:52:40.600277+0000","last_became_active":"2023-12-19T13:52:40.108736+0000","last_became_peered":"2023-12-19T13:52:40.108736+0000","last_unstale":"2023-12-19T13:52:40.600277+0000","last_undegraded":"2023-12-19T13:52:40.600277+0000","last_fullsized":"2023-12-19T13:52:40.600277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:17.154193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601786+0000","last_change":"2023-12-19T13:52:40.601326+0000","last_active":"2023-12-19T13:52:40.601786+0000","last_peered":"2023-12-19T13:52:40.601786+0000","last_clean":"2023-12-19T13:52:40.601786+0000","last_became_active":"2023-12-19T13:52:40.600453+0000","last_became_peered":"2023-12-19T13:52:40.600453+0000","last_unstale":"2023-12-19T13:52:40.601786+0000","last_undegraded":"2023-12-19T13:52:40.601786+0000","last_fullsized":"2023-12-19T13:52:40.601786+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.607335+0000","last_change":"2023-12-19T13:52:40.101417+0000","last_active":"2023-12-19T13:52:40.607335+0000","last_peered":"2023-12-19T13:52:40.607335+0000","last_clean":"2023-12-19T13:52:40.607335+0000","last_became_active":"2023-12-19T13:52:40.100811+0000","last_became_peered":"2023-12-19T13:52:40.100811+0000","last_unstale":"2023-12-19T13:52:40.607335+0000","last_undegraded":"2023-12-19T13:52:40.607335+0000","last_fullsized":"2023-12-19T13:52:40.607335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:22.638411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605289+0000","last_change":"2023-12-19T13:52:40.605193+0000","last_active":"2023-12-19T13:52:40.605289+0000","last_peered":"2023-12-19T13:52:40.605289+0000","last_clean":"2023-12-19T13:52:40.605289+0000","last_became_active":"2023-12-19T13:52:40.604554+0000","last_became_peered":"2023-12-19T13:52:40.604554+0000","last_unstale":"2023-12-19T13:52:40.605289+0000","last_undegraded":"2023-12-19T13:52:40.605289+0000","last_fullsized":"2023-12-19T13:52:40.605289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:06.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590234+0000","last_change":"2023-12-19T13:52:40.100131+0000","last_active":"2023-12-19T13:52:40.590234+0000","last_peered":"2023-12-19T13:52:40.590234+0000","last_clean":"2023-12-19T13:52:40.590234+0000","last_became_active":"2023-12-19T13:52:40.098016+0000","last_became_peered":"2023-12-19T13:52:40.098016+0000","last_unstale":"2023-12-19T13:52:40.590234+0000","last_undegraded":"2023-12-19T13:52:40.590234+0000","last_fullsized":"2023-12-19T13:52:40.590234+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599047+0000","last_change":"2023-12-19T13:52:40.598982+0000","last_active":"2023-12-19T13:52:40.599047+0000","last_peered":"2023-12-19T13:52:40.599047+0000","last_clean":"2023-12-19T13:52:40.599047+0000","last_became_active":"2023-12-19T13:52:40.598802+0000","last_became_peered":"2023-12-19T13:52:40.598802+0000","last_unstale":"2023-12-19T13:52:40.599047+0000","last_undegraded":"2023-12-19T13:52:40.599047+0000","last_fullsized":"2023-12-19T13:52:40.599047+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597855+0000","last_change":"2023-12-19T13:52:40.112976+0000","last_active":"2023-12-19T13:52:40.597855+0000","last_peered":"2023-12-19T13:52:40.597855+0000","last_clean":"2023-12-19T13:52:40.597855+0000","last_became_active":"2023-12-19T13:52:40.112742+0000","last_became_peered":"2023-12-19T13:52:40.112742+0000","last_unstale":"2023-12-19T13:52:40.597855+0000","last_undegraded":"2023-12-19T13:52:40.597855+0000","last_fullsized":"2023-12-19T13:52:40.597855+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601802+0000","last_change":"2023-12-19T13:52:40.601458+0000","last_active":"2023-12-19T13:52:40.601802+0000","last_peered":"2023-12-19T13:52:40.601802+0000","last_clean":"2023-12-19T13:52:40.601802+0000","last_became_active":"2023-12-19T13:52:40.601097+0000","last_became_peered":"2023-12-19T13:52:40.601097+0000","last_unstale":"2023-12-19T13:52:40.601802+0000","last_undegraded":"2023-12-19T13:52:40.601802+0000","last_fullsized":"2023-12-19T13:52:40.601802+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:46.642976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.584744+0000","last_change":"2023-12-19T13:52:40.102794+0000","last_active":"2023-12-19T13:52:40.584744+0000","last_peered":"2023-12-19T13:52:40.584744+0000","last_clean":"2023-12-19T13:52:40.584744+0000","last_became_active":"2023-12-19T13:52:40.102320+0000","last_became_peered":"2023-12-19T13:52:40.102320+0000","last_unstale":"2023-12-19T13:52:40.584744+0000","last_undegraded":"2023-12-19T13:52:40.584744+0000","last_fullsized":"2023-12-19T13:52:40.584744+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:25.273423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589811+0000","last_change":"2023-12-19T13:52:40.588395+0000","last_active":"2023-12-19T13:52:40.589811+0000","last_peered":"2023-12-19T13:52:40.589811+0000","last_clean":"2023-12-19T13:52:40.589811+0000","last_became_active":"2023-12-19T13:52:40.587940+0000","last_became_peered":"2023-12-19T13:52:40.587940+0000","last_unstale":"2023-12-19T13:52:40.589811+0000","last_undegraded":"2023-12-19T13:52:40.589811+0000","last_fullsized":"2023-12-19T13:52:40.589811+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:48.602895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.585302+0000","last_change":"2023-12-19T13:52:40.115190+0000","last_active":"2023-12-19T13:52:40.585302+0000","last_peered":"2023-12-19T13:52:40.585302+0000","last_clean":"2023-12-19T13:52:40.585302+0000","last_became_active":"2023-12-19T13:52:40.114825+0000","last_became_peered":"2023-12-19T13:52:40.114825+0000","last_unstale":"2023-12-19T13:52:40.585302+0000","last_undegraded":"2023-12-19T13:52:40.585302+0000","last_fullsized":"2023-12-19T13:52:40.585302+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:36.838331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589840+0000","last_change":"2023-12-19T13:52:40.589236+0000","last_active":"2023-12-19T13:52:40.589840+0000","last_peered":"2023-12-19T13:52:40.589840+0000","last_clean":"2023-12-19T13:52:40.589840+0000","last_became_active":"2023-12-19T13:52:40.586199+0000","last_became_peered":"2023-12-19T13:52:40.586199+0000","last_unstale":"2023-12-19T13:52:40.589840+0000","last_undegraded":"2023-12-19T13:52:40.589840+0000","last_fullsized":"2023-12-19T13:52:40.589840+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.575060+0000","last_change":"2023-12-19T13:52:40.107384+0000","last_active":"2023-12-19T13:52:40.575060+0000","last_peered":"2023-12-19T13:52:40.575060+0000","last_clean":"2023-12-19T13:52:40.575060+0000","last_became_active":"2023-12-19T13:52:40.107084+0000","last_became_peered":"2023-12-19T13:52:40.107084+0000","last_unstale":"2023-12-19T13:52:40.575060+0000","last_undegraded":"2023-12-19T13:52:40.575060+0000","last_fullsized":"2023-12-19T13:52:40.575060+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.505632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603132+0000","last_change":"2023-12-19T13:52:40.603065+0000","last_active":"2023-12-19T13:52:40.603132+0000","last_peered":"2023-12-19T13:52:40.603132+0000","last_clean":"2023-12-19T13:52:40.603132+0000","last_became_active":"2023-12-19T13:52:40.602830+0000","last_became_peered":"2023-12-19T13:52:40.602830+0000","last_unstale":"2023-12-19T13:52:40.603132+0000","last_undegraded":"2023-12-19T13:52:40.603132+0000","last_fullsized":"2023-12-19T13:52:40.603132+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.587970+0000","last_change":"2023-12-19T13:52:40.110437+0000","last_active":"2023-12-19T13:52:40.587970+0000","last_peered":"2023-12-19T13:52:40.587970+0000","last_clean":"2023-12-19T13:52:40.587970+0000","last_became_active":"2023-12-19T13:52:40.110207+0000","last_became_peered":"2023-12-19T13:52:40.110207+0000","last_unstale":"2023-12-19T13:52:40.587970+0000","last_undegraded":"2023-12-19T13:52:40.587970+0000","last_fullsized":"2023-12-19T13:52:40.587970+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597854+0000","last_change":"2023-12-19T13:52:40.594998+0000","last_active":"2023-12-19T13:52:40.597854+0000","last_peered":"2023-12-19T13:52:40.597854+0000","last_clean":"2023-12-19T13:52:40.597854+0000","last_became_active":"2023-12-19T13:52:40.594692+0000","last_became_peered":"2023-12-19T13:52:40.594692+0000","last_unstale":"2023-12-19T13:52:40.597854+0000","last_undegraded":"2023-12-19T13:52:40.597854+0000","last_fullsized":"2023-12-19T13:52:40.597854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"112'3","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600719+0000","last_change":"2023-12-19T13:52:40.112843+0000","last_active":"2023-12-19T13:52:40.600719+0000","last_peered":"2023-12-19T13:52:40.600719+0000","last_clean":"2023-12-19T13:52:40.600719+0000","last_became_active":"2023-12-19T13:52:40.112277+0000","last_became_peered":"2023-12-19T13:52:40.112277+0000","last_unstale":"2023-12-19T13:52:40.600719+0000","last_undegraded":"2023-12-19T13:52:40.600719+0000","last_fullsized":"2023-12-19T13:52:40.600719+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:31:51.725811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.602907+0000","last_change":"2023-12-19T13:52:40.602254+0000","last_active":"2023-12-19T13:52:40.602907+0000","last_peered":"2023-12-19T13:52:40.602907+0000","last_clean":"2023-12-19T13:52:40.602907+0000","last_became_active":"2023-12-19T13:52:40.601892+0000","last_became_peered":"2023-12-19T13:52:40.601892+0000","last_unstale":"2023-12-19T13:52:40.602907+0000","last_undegraded":"2023-12-19T13:52:40.602907+0000","last_fullsized":"2023-12-19T13:52:40.602907+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:55.696157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"112'6","reported_seq":17,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.606596+0000","last_change":"2023-12-19T13:52:40.103470+0000","last_active":"2023-12-19T13:52:40.606596+0000","last_peered":"2023-12-19T13:52:40.606596+0000","last_clean":"2023-12-19T13:52:40.606596+0000","last_became_active":"2023-12-19T13:52:40.102994+0000","last_became_peered":"2023-12-19T13:52:40.102994+0000","last_unstale":"2023-12-19T13:52:40.606596+0000","last_undegraded":"2023-12-19T13:52:40.606596+0000","last_fullsized":"2023-12-19T13:52:40.606596+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604394+0000","last_change":"2023-12-19T13:52:40.603850+0000","last_active":"2023-12-19T13:52:40.604394+0000","last_peered":"2023-12-19T13:52:40.604394+0000","last_clean":"2023-12-19T13:52:40.604394+0000","last_became_active":"2023-12-19T13:52:40.603191+0000","last_became_peered":"2023-12-19T13:52:40.603191+0000","last_unstale":"2023-12-19T13:52:40.604394+0000","last_undegraded":"2023-12-19T13:52:40.604394+0000","last_fullsized":"2023-12-19T13:52:40.604394+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.606814+0000","last_change":"2023-12-19T13:52:40.104935+0000","last_active":"2023-12-19T13:52:40.606814+0000","last_peered":"2023-12-19T13:52:40.606814+0000","last_clean":"2023-12-19T13:52:40.606814+0000","last_became_active":"2023-12-19T13:52:40.104463+0000","last_became_peered":"2023-12-19T13:52:40.104463+0000","last_unstale":"2023-12-19T13:52:40.606814+0000","last_undegraded":"2023-12-19T13:52:40.606814+0000","last_fullsized":"2023-12-19T13:52:40.606814+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:32.406240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599037+0000","last_change":"2023-12-19T13:52:40.598103+0000","last_active":"2023-12-19T13:52:40.599037+0000","last_peered":"2023-12-19T13:52:40.599037+0000","last_clean":"2023-12-19T13:52:40.599037+0000","last_became_active":"2023-12-19T13:52:40.597617+0000","last_became_peered":"2023-12-19T13:52:40.597617+0000","last_unstale":"2023-12-19T13:52:40.599037+0000","last_undegraded":"2023-12-19T13:52:40.599037+0000","last_fullsized":"2023-12-19T13:52:40.599037+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:37.847464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589163+0000","last_change":"2023-12-19T13:52:40.088998+0000","last_active":"2023-12-19T13:52:40.589163+0000","last_peered":"2023-12-19T13:52:40.589163+0000","last_clean":"2023-12-19T13:52:40.589163+0000","last_became_active":"2023-12-19T13:52:40.088437+0000","last_became_peered":"2023-12-19T13:52:40.088437+0000","last_unstale":"2023-12-19T13:52:40.589163+0000","last_undegraded":"2023-12-19T13:52:40.589163+0000","last_fullsized":"2023-12-19T13:52:40.589163+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604580+0000","last_change":"2023-12-19T13:52:40.602727+0000","last_active":"2023-12-19T13:52:40.604580+0000","last_peered":"2023-12-19T13:52:40.604580+0000","last_clean":"2023-12-19T13:52:40.604580+0000","last_became_active":"2023-12-19T13:52:40.602441+0000","last_became_peered":"2023-12-19T13:52:40.602441+0000","last_unstale":"2023-12-19T13:52:40.604580+0000","last_undegraded":"2023-12-19T13:52:40.604580+0000","last_fullsized":"2023-12-19T13:52:40.604580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:19.408026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588054+0000","last_change":"2023-12-19T13:52:40.115336+0000","last_active":"2023-12-19T13:52:40.588054+0000","last_peered":"2023-12-19T13:52:40.588054+0000","last_clean":"2023-12-19T13:52:40.588054+0000","last_became_active":"2023-12-19T13:52:40.115102+0000","last_became_peered":"2023-12-19T13:52:40.115102+0000","last_unstale":"2023-12-19T13:52:40.588054+0000","last_undegraded":"2023-12-19T13:52:40.588054+0000","last_fullsized":"2023-12-19T13:52:40.588054+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605879+0000","last_change":"2023-12-19T13:52:40.605813+0000","last_active":"2023-12-19T13:52:40.605879+0000","last_peered":"2023-12-19T13:52:40.605879+0000","last_clean":"2023-12-19T13:52:40.605879+0000","last_became_active":"2023-12-19T13:52:40.605576+0000","last_became_peered":"2023-12-19T13:52:40.605576+0000","last_unstale":"2023-12-19T13:52:40.605879+0000","last_undegraded":"2023-12-19T13:52:40.605879+0000","last_fullsized":"2023-12-19T13:52:40.605879+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"112'8","reported_seq":19,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.609719+0000","last_change":"2023-12-19T13:52:40.114613+0000","last_active":"2023-12-19T13:52:40.609719+0000","last_peered":"2023-12-19T13:52:40.609719+0000","last_clean":"2023-12-19T13:52:40.609719+0000","last_became_active":"2023-12-19T13:52:40.114053+0000","last_became_peered":"2023-12-19T13:52:40.114053+0000","last_unstale":"2023-12-19T13:52:40.609719+0000","last_undegraded":"2023-12-19T13:52:40.609719+0000","last_fullsized":"2023-12-19T13:52:40.609719+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:14.310685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586727+0000","last_change":"2023-12-19T13:52:40.586660+0000","last_active":"2023-12-19T13:52:40.586727+0000","last_peered":"2023-12-19T13:52:40.586727+0000","last_clean":"2023-12-19T13:52:40.586727+0000","last_became_active":"2023-12-19T13:52:40.586370+0000","last_became_peered":"2023-12-19T13:52:40.586370+0000","last_unstale":"2023-12-19T13:52:40.586727+0000","last_undegraded":"2023-12-19T13:52:40.586727+0000","last_fullsized":"2023-12-19T13:52:40.586727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586901+0000","last_change":"2023-12-19T13:52:40.103948+0000","last_active":"2023-12-19T13:52:40.586901+0000","last_peered":"2023-12-19T13:52:40.586901+0000","last_clean":"2023-12-19T13:52:40.586901+0000","last_became_active":"2023-12-19T13:52:40.103624+0000","last_became_peered":"2023-12-19T13:52:40.103624+0000","last_unstale":"2023-12-19T13:52:40.586901+0000","last_undegraded":"2023-12-19T13:52:40.586901+0000","last_fullsized":"2023-12-19T13:52:40.586901+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:19.594522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591036+0000","last_change":"2023-12-19T13:52:40.590113+0000","last_active":"2023-12-19T13:52:40.591036+0000","last_peered":"2023-12-19T13:52:40.591036+0000","last_clean":"2023-12-19T13:52:40.591036+0000","last_became_active":"2023-12-19T13:52:40.589862+0000","last_became_peered":"2023-12-19T13:52:40.589862+0000","last_unstale":"2023-12-19T13:52:40.591036+0000","last_undegraded":"2023-12-19T13:52:40.591036+0000","last_fullsized":"2023-12-19T13:52:40.591036+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599164+0000","last_change":"2023-12-19T13:52:40.099292+0000","last_active":"2023-12-19T13:52:40.599164+0000","last_peered":"2023-12-19T13:52:40.599164+0000","last_clean":"2023-12-19T13:52:40.599164+0000","last_became_active":"2023-12-19T13:52:40.098816+0000","last_became_peered":"2023-12-19T13:52:40.098816+0000","last_unstale":"2023-12-19T13:52:40.599164+0000","last_undegraded":"2023-12-19T13:52:40.599164+0000","last_fullsized":"2023-12-19T13:52:40.599164+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:26.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588099+0000","last_change":"2023-12-19T13:52:40.588010+0000","last_active":"2023-12-19T13:52:40.588099+0000","last_peered":"2023-12-19T13:52:40.588099+0000","last_clean":"2023-12-19T13:52:40.588099+0000","last_became_active":"2023-12-19T13:52:40.587798+0000","last_became_peered":"2023-12-19T13:52:40.587798+0000","last_unstale":"2023-12-19T13:52:40.588099+0000","last_undegraded":"2023-12-19T13:52:40.588099+0000","last_fullsized":"2023-12-19T13:52:40.588099+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.581240+0000","last_change":"2023-12-19T13:52:40.103821+0000","last_active":"2023-12-19T13:52:40.581240+0000","last_peered":"2023-12-19T13:52:40.581240+0000","last_clean":"2023-12-19T13:52:40.581240+0000","last_became_active":"2023-12-19T13:52:40.103362+0000","last_became_peered":"2023-12-19T13:52:40.103362+0000","last_unstale":"2023-12-19T13:52:40.581240+0000","last_undegraded":"2023-12-19T13:52:40.581240+0000","last_fullsized":"2023-12-19T13:52:40.581240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:23.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603409+0000","last_change":"2023-12-19T13:52:40.603087+0000","last_active":"2023-12-19T13:52:40.603409+0000","last_peered":"2023-12-19T13:52:40.603409+0000","last_clean":"2023-12-19T13:52:40.603409+0000","last_became_active":"2023-12-19T13:52:40.602862+0000","last_became_peered":"2023-12-19T13:52:40.602862+0000","last_unstale":"2023-12-19T13:52:40.603409+0000","last_undegraded":"2023-12-19T13:52:40.603409+0000","last_fullsized":"2023-12-19T13:52:40.603409+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:52:14.420403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599108+0000","last_change":"2023-12-19T13:52:40.093874+0000","last_active":"2023-12-19T13:52:40.599108+0000","last_peered":"2023-12-19T13:52:40.599108+0000","last_clean":"2023-12-19T13:52:40.599108+0000","last_became_active":"2023-12-19T13:52:40.093143+0000","last_became_peered":"2023-12-19T13:52:40.093143+0000","last_unstale":"2023-12-19T13:52:40.599108+0000","last_undegraded":"2023-12-19T13:52:40.599108+0000","last_fullsized":"2023-12-19T13:52:40.599108+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:45.633843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601276+0000","last_change":"2023-12-19T13:52:40.600985+0000","last_active":"2023-12-19T13:52:40.601276+0000","last_peered":"2023-12-19T13:52:40.601276+0000","last_clean":"2023-12-19T13:52:40.601276+0000","last_became_active":"2023-12-19T13:52:40.600777+0000","last_became_peered":"2023-12-19T13:52:40.600777+0000","last_unstale":"2023-12-19T13:52:40.601276+0000","last_undegraded":"2023-12-19T13:52:40.601276+0000","last_fullsized":"2023-12-19T13:52:40.601276+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:19.557252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594149+0000","last_change":"2023-12-19T13:52:40.106763+0000","last_active":"2023-12-19T13:52:40.594149+0000","last_peered":"2023-12-19T13:52:40.594149+0000","last_clean":"2023-12-19T13:52:40.594149+0000","last_became_active":"2023-12-19T13:52:40.106379+0000","last_became_peered":"2023-12-19T13:52:40.106379+0000","last_unstale":"2023-12-19T13:52:40.594149+0000","last_undegraded":"2023-12-19T13:52:40.594149+0000","last_fullsized":"2023-12-19T13:52:40.594149+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603406+0000","last_change":"2023-12-19T13:52:40.602901+0000","last_active":"2023-12-19T13:52:40.603406+0000","last_peered":"2023-12-19T13:52:40.603406+0000","last_clean":"2023-12-19T13:52:40.603406+0000","last_became_active":"2023-12-19T13:52:40.599880+0000","last_became_peered":"2023-12-19T13:52:40.599880+0000","last_unstale":"2023-12-19T13:52:40.603406+0000","last_undegraded":"2023-12-19T13:52:40.603406+0000","last_fullsized":"2023-12-19T13:52:40.603406+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:49.166277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596213+0000","last_change":"2023-12-19T13:52:40.112335+0000","last_active":"2023-12-19T13:52:40.596213+0000","last_peered":"2023-12-19T13:52:40.596213+0000","last_clean":"2023-12-19T13:52:40.596213+0000","last_became_active":"2023-12-19T13:52:40.112142+0000","last_became_peered":"2023-12-19T13:52:40.112142+0000","last_unstale":"2023-12-19T13:52:40.596213+0000","last_undegraded":"2023-12-19T13:52:40.596213+0000","last_fullsized":"2023-12-19T13:52:40.596213+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:15.392835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597010+0000","last_change":"2023-12-19T13:52:40.596943+0000","last_active":"2023-12-19T13:52:40.597010+0000","last_peered":"2023-12-19T13:52:40.597010+0000","last_clean":"2023-12-19T13:52:40.597010+0000","last_became_active":"2023-12-19T13:52:40.596703+0000","last_became_peered":"2023-12-19T13:52:40.596703+0000","last_unstale":"2023-12-19T13:52:40.597010+0000","last_undegraded":"2023-12-19T13:52:40.597010+0000","last_fullsized":"2023-12-19T13:52:40.597010+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.581549+0000","last_change":"2023-12-19T13:52:40.109967+0000","last_active":"2023-12-19T13:52:40.581549+0000","last_peered":"2023-12-19T13:52:40.581549+0000","last_clean":"2023-12-19T13:52:40.581549+0000","last_became_active":"2023-12-19T13:52:40.109672+0000","last_became_peered":"2023-12-19T13:52:40.109672+0000","last_unstale":"2023-12-19T13:52:40.581549+0000","last_undegraded":"2023-12-19T13:52:40.581549+0000","last_fullsized":"2023-12-19T13:52:40.581549+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:44:44.945990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.580833+0000","last_change":"2023-12-19T13:52:40.580761+0000","last_active":"2023-12-19T13:52:40.580833+0000","last_peered":"2023-12-19T13:52:40.580833+0000","last_clean":"2023-12-19T13:52:40.580833+0000","last_became_active":"2023-12-19T13:52:40.580406+0000","last_became_peered":"2023-12-19T13:52:40.580406+0000","last_unstale":"2023-12-19T13:52:40.580833+0000","last_undegraded":"2023-12-19T13:52:40.580833+0000","last_fullsized":"2023-12-19T13:52:40.580833+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:32.794419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604077+0000","last_change":"2023-12-19T13:52:40.107596+0000","last_active":"2023-12-19T13:52:40.604077+0000","last_peered":"2023-12-19T13:52:40.604077+0000","last_clean":"2023-12-19T13:52:40.604077+0000","last_became_active":"2023-12-19T13:52:40.106859+0000","last_became_peered":"2023-12-19T13:52:40.106859+0000","last_unstale":"2023-12-19T13:52:40.604077+0000","last_undegraded":"2023-12-19T13:52:40.604077+0000","last_fullsized":"2023-12-19T13:52:40.604077+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:04.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588449+0000","last_change":"2023-12-19T13:52:40.587557+0000","last_active":"2023-12-19T13:52:40.588449+0000","last_peered":"2023-12-19T13:52:40.588449+0000","last_clean":"2023-12-19T13:52:40.588449+0000","last_became_active":"2023-12-19T13:52:40.587422+0000","last_became_peered":"2023-12-19T13:52:40.587422+0000","last_unstale":"2023-12-19T13:52:40.588449+0000","last_undegraded":"2023-12-19T13:52:40.588449+0000","last_fullsized":"2023-12-19T13:52:40.588449+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:26.216347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"113'1","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-12-19T13:52:42.471327+0000","last_change":"2023-12-19T13:52:40.110640+0000","last_active":"2023-12-19T13:52:42.471327+0000","last_peered":"2023-12-19T13:52:42.471327+0000","last_clean":"2023-12-19T13:52:42.471327+0000","last_became_active":"2023-12-19T13:52:40.109548+0000","last_became_peered":"2023-12-19T13:52:40.109548+0000","last_unstale":"2023-12-19T13:52:42.471327+0000","last_undegraded":"2023-12-19T13:52:42.471327+0000","last_fullsized":"2023-12-19T13:52:42.471327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:42.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597476+0000","last_change":"2023-12-19T13:52:40.597241+0000","last_active":"2023-12-19T13:52:40.597476+0000","last_peered":"2023-12-19T13:52:40.597476+0000","last_clean":"2023-12-19T13:52:40.597476+0000","last_became_active":"2023-12-19T13:52:40.596892+0000","last_became_peered":"2023-12-19T13:52:40.596892+0000","last_unstale":"2023-12-19T13:52:40.597476+0000","last_undegraded":"2023-12-19T13:52:40.597476+0000","last_fullsized":"2023-12-19T13:52:40.597476+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:01:53.994030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586327+0000","last_change":"2023-12-19T13:52:40.111068+0000","last_active":"2023-12-19T13:52:40.586327+0000","last_peered":"2023-12-19T13:52:40.586327+0000","last_clean":"2023-12-19T13:52:40.586327+0000","last_became_active":"2023-12-19T13:52:40.110835+0000","last_became_peered":"2023-12-19T13:52:40.110835+0000","last_unstale":"2023-12-19T13:52:40.586327+0000","last_undegraded":"2023-12-19T13:52:40.586327+0000","last_fullsized":"2023-12-19T13:52:40.586327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600403+0000","last_change":"2023-12-19T13:52:40.600336+0000","last_active":"2023-12-19T13:52:40.600403+0000","last_peered":"2023-12-19T13:52:40.600403+0000","last_clean":"2023-12-19T13:52:40.600403+0000","last_became_active":"2023-12-19T13:52:40.599947+0000","last_became_peered":"2023-12-19T13:52:40.599947+0000","last_unstale":"2023-12-19T13:52:40.600403+0000","last_undegraded":"2023-12-19T13:52:40.600403+0000","last_fullsized":"2023-12-19T13:52:40.600403+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.592749+0000","last_change":"2023-12-19T13:52:40.111351+0000","last_active":"2023-12-19T13:52:40.592749+0000","last_peered":"2023-12-19T13:52:40.592749+0000","last_clean":"2023-12-19T13:52:40.592749+0000","last_became_active":"2023-12-19T13:52:40.111135+0000","last_became_peered":"2023-12-19T13:52:40.111135+0000","last_unstale":"2023-12-19T13:52:40.592749+0000","last_undegraded":"2023-12-19T13:52:40.592749+0000","last_fullsized":"2023-12-19T13:52:40.592749+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:08.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590641+0000","last_change":"2023-12-19T13:52:40.589913+0000","last_active":"2023-12-19T13:52:40.590641+0000","last_peered":"2023-12-19T13:52:40.590641+0000","last_clean":"2023-12-19T13:52:40.590641+0000","last_became_active":"2023-12-19T13:52:40.589696+0000","last_became_peered":"2023-12-19T13:52:40.589696+0000","last_unstale":"2023-12-19T13:52:40.590641+0000","last_undegraded":"2023-12-19T13:52:40.590641+0000","last_fullsized":"2023-12-19T13:52:40.590641+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589334+0000","last_change":"2023-12-19T13:52:40.108868+0000","last_active":"2023-12-19T13:52:40.589334+0000","last_peered":"2023-12-19T13:52:40.589334+0000","last_clean":"2023-12-19T13:52:40.589334+0000","last_became_active":"2023-12-19T13:52:40.108635+0000","last_became_peered":"2023-12-19T13:52:40.108635+0000","last_unstale":"2023-12-19T13:52:40.589334+0000","last_undegraded":"2023-12-19T13:52:40.589334+0000","last_fullsized":"2023-12-19T13:52:40.589334+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:18.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604413+0000","last_change":"2023-12-19T13:52:40.603992+0000","last_active":"2023-12-19T13:52:40.604413+0000","last_peered":"2023-12-19T13:52:40.604413+0000","last_clean":"2023-12-19T13:52:40.604413+0000","last_became_active":"2023-12-19T13:52:40.603482+0000","last_became_peered":"2023-12-19T13:52:40.603482+0000","last_unstale":"2023-12-19T13:52:40.604413+0000","last_undegraded":"2023-12-19T13:52:40.604413+0000","last_fullsized":"2023-12-19T13:52:40.604413+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588138+0000","last_change":"2023-12-19T13:52:40.114680+0000","last_active":"2023-12-19T13:52:40.588138+0000","last_peered":"2023-12-19T13:52:40.588138+0000","last_clean":"2023-12-19T13:52:40.588138+0000","last_became_active":"2023-12-19T13:52:40.113789+0000","last_became_peered":"2023-12-19T13:52:40.113789+0000","last_unstale":"2023-12-19T13:52:40.588138+0000","last_undegraded":"2023-12-19T13:52:40.588138+0000","last_fullsized":"2023-12-19T13:52:40.588138+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590498+0000","last_change":"2023-12-19T13:52:40.589398+0000","last_active":"2023-12-19T13:52:40.590498+0000","last_peered":"2023-12-19T13:52:40.590498+0000","last_clean":"2023-12-19T13:52:40.590498+0000","last_became_active":"2023-12-19T13:52:40.589194+0000","last_became_peered":"2023-12-19T13:52:40.589194+0000","last_unstale":"2023-12-19T13:52:40.590498+0000","last_undegraded":"2023-12-19T13:52:40.590498+0000","last_fullsized":"2023-12-19T13:52:40.590498+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.574502+0000","last_change":"2023-12-19T13:52:40.113228+0000","last_active":"2023-12-19T13:52:40.574502+0000","last_peered":"2023-12-19T13:52:40.574502+0000","last_clean":"2023-12-19T13:52:40.574502+0000","last_became_active":"2023-12-19T13:52:40.112593+0000","last_became_peered":"2023-12-19T13:52:40.112593+0000","last_unstale":"2023-12-19T13:52:40.574502+0000","last_undegraded":"2023-12-19T13:52:40.574502+0000","last_fullsized":"2023-12-19T13:52:40.574502+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:09.700259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594932+0000","last_change":"2023-12-19T13:52:40.594866+0000","last_active":"2023-12-19T13:52:40.594932+0000","last_peered":"2023-12-19T13:52:40.594932+0000","last_clean":"2023-12-19T13:52:40.594932+0000","last_became_active":"2023-12-19T13:52:40.594652+0000","last_became_peered":"2023-12-19T13:52:40.594652+0000","last_unstale":"2023-12-19T13:52:40.594932+0000","last_undegraded":"2023-12-19T13:52:40.594932+0000","last_fullsized":"2023-12-19T13:52:40.594932+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586411+0000","last_change":"2023-12-19T13:52:40.102645+0000","last_active":"2023-12-19T13:52:40.586411+0000","last_peered":"2023-12-19T13:52:40.586411+0000","last_clean":"2023-12-19T13:52:40.586411+0000","last_became_active":"2023-12-19T13:52:40.097556+0000","last_became_peered":"2023-12-19T13:52:40.097556+0000","last_unstale":"2023-12-19T13:52:40.586411+0000","last_undegraded":"2023-12-19T13:52:40.586411+0000","last_fullsized":"2023-12-19T13:52:40.586411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599829+0000","last_change":"2023-12-19T13:52:40.599549+0000","last_active":"2023-12-19T13:52:40.599829+0000","last_peered":"2023-12-19T13:52:40.599829+0000","last_clean":"2023-12-19T13:52:40.599829+0000","last_became_active":"2023-12-19T13:52:40.599318+0000","last_became_peered":"2023-12-19T13:52:40.599318+0000","last_unstale":"2023-12-19T13:52:40.599829+0000","last_undegraded":"2023-12-19T13:52:40.599829+0000","last_fullsized":"2023-12-19T13:52:40.599829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586985+0000","last_change":"2023-12-19T13:52:40.101203+0000","last_active":"2023-12-19T13:52:40.586985+0000","last_peered":"2023-12-19T13:52:40.586985+0000","last_clean":"2023-12-19T13:52:40.586985+0000","last_became_active":"2023-12-19T13:52:40.100476+0000","last_became_peered":"2023-12-19T13:52:40.100476+0000","last_unstale":"2023-12-19T13:52:40.586985+0000","last_undegraded":"2023-12-19T13:52:40.586985+0000","last_fullsized":"2023-12-19T13:52:40.586985+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:49.482529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":252,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.574076+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:52:40.574076+0000","last_peered":"2023-12-19T13:52:40.574076+0000","last_clean":"2023-12-19T13:52:40.574076+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:52:40.574076+0000","last_undegraded":"2023-12-19T13:52:40.574076+0000","last_fullsized":"2023-12-19T13:52:40.574076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":607,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194705,"statfs":{"total":200000000,"available":199378407,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0920000000000001,"15min":1.028},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6279999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.0860000000000001,"15min":1.01},"min":{"1min":0.77600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4059999999999999,"5min":1.7190000000000001,"15min":2.008},"last":1.3899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.153,"15min":1.0940000000000001},"min":{"1min":0.66000000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5960000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.296},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1200000000000001,"15min":1.054},"min":{"1min":0.751,"5min":0.497,"15min":0.497},"max":{"1min":1.5409999999999999,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.728}]},{"osd":2,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.149,"15min":1.1359999999999999},"min":{"1min":0.76400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5569999999999999,"5min":1.7330000000000001,"15min":1.7929999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.244,"5min":1.2050000000000001,"15min":1.159},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6499999999999999,"5min":1.871,"15min":1.8720000000000001},"last":1.421}]},{"osd":3,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2310000000000001,"15min":1.1679999999999999},"min":{"1min":0.96199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.399,"5min":1.931,"15min":1.931},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.3180000000000001,"15min":1.252},"min":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.6150000000000002,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.603}]},{"osd":4,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.26,"15min":1.2789999999999999},"min":{"1min":0.98699999999999999,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":1.506,"5min":1.6739999999999999,"15min":2.181},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3460000000000001,"15min":1.3839999999999999},"min":{"1min":0.86199999999999999,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":1.7070000000000001,"5min":2.2109999999999999,"15min":2.6909999999999998},"last":1.3460000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.258,"15min":1.228},"min":{"1min":0.86299999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5289999999999999,"5min":1.956,"15min":1.956},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.415,"15min":1.423},"min":{"1min":1.2250000000000001,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":1.841,"5min":2.024,"15min":2.2629999999999999},"last":1.4510000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.369,"15min":1.2869999999999999},"min":{"1min":1.012,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6739999999999999,"5min":2.024,"15min":2.024},"last":1.647},{"interface":"front","average":{"1min":1.506,"5min":1.5109999999999999,"15min":1.4890000000000001},"min":{"1min":1.3720000000000001,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":1.6759999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.7749999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":607,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194704,"statfs":{"total":200000000,"available":199377805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.66100000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6220000000000001,"5min":1.679,"15min":2.0640000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.079,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.631,"5min":1.631,"15min":3.2069999999999999},"last":1.286}]},{"osd":1,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.071,"15min":1.0369999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.405,"5min":1.619,"15min":1.962},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.143,"5min":1.139,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5029999999999999,"5min":1.5860000000000001,"15min":1.6279999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2609999999999999,"15min":1.2270000000000001},"min":{"1min":0.93600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7310000000000001,"5min":1.798,"15min":1.8180000000000001},"last":1.012},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2569999999999999,"15min":1.179},"min":{"1min":0.80200000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6319999999999999,"5min":1.802,"15min":1.802},"last":1.5649999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.331},"min":{"1min":0.84699999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2410000000000001,"15min":1.2629999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.67900000000000005},"max":{"1min":1.819,"5min":1.8799999999999999,"15min":4.3899999999999997},"last":0.95899999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2969999999999999,"15min":1.2270000000000001},"min":{"1min":0.64500000000000002,"5min":0.56100000000000005,"15min":0.47899999999999998},"max":{"1min":1.798,"5min":1.865,"15min":1.865},"last":1.101},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.367,"15min":1.3109999999999999},"min":{"1min":0.96399999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7170000000000001,"5min":1.895,"15min":1.895},"last":1.611}]},{"osd":5,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.2609999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.865,"5min":1.962,"15min":1.962},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.423,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.865,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.454,"15min":1.4279999999999999},"min":{"1min":0.91500000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.944,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.736},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4299999999999999,"15min":1.3720000000000001},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.57999999999999996},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.161}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1185,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194127,"statfs":{"total":200000000,"available":198786511,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.038,"15min":0.997},"min":{"1min":0.71999999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6839999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.155,"15min":1.095},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6669999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.72}]},{"osd":1,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.155,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.23,"5min":1.155,"15min":1.0469999999999999},"min":{"1min":0.95899999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5980000000000001,"5min":2.077,"15min":2.077},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2370000000000001,"15min":1.2569999999999999},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5609999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.268},"min":{"1min":0.88700000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7849999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.5569999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3240000000000001,"15min":1.242},"min":{"1min":1.0149999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8360000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.2829999999999999,"15min":1.2549999999999999},"min":{"1min":1.099,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.94799999999999995}]},{"osd":4,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.1519999999999999},"min":{"1min":0.91000000000000003,"5min":0.79400000000000004,"15min":0.77600000000000002},"max":{"1min":1.484,"5min":1.982,"15min":1.982},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.3799999999999999,"15min":1.3109999999999999},"min":{"1min":0.71399999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7969999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.804}]},{"osd":6,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3779999999999999,"15min":1.3280000000000001},"min":{"1min":0.97499999999999998,"5min":0.94099999999999995,"15min":0.623},"max":{"1min":1.853,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.821},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3500000000000001,"15min":1.367},"min":{"1min":0.84599999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6970000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.7689999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4330000000000001},"min":{"1min":1.1399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.891,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.956},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5029999999999999,"15min":1.429},"min":{"1min":1.2729999999999999,"5min":0.96099999999999997,"15min":0.82099999999999995},"max":{"1min":1.968,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":2.1070000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":606,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194705,"statfs":{"total":200000000,"available":199378443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0369999999999999,"15min":1.0029999999999999},"min":{"1min":0.66200000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5569999999999999,"5min":1.657,"15min":1.657},"last":1.022},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.121},"min":{"1min":0.73599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4850000000000001,"5min":1.6020000000000001,"15min":2.016},"last":1.5529999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.85099999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6060000000000001,"5min":1.621,"15min":1.621},"last":1.661},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7969999999999999,"5min":1.887,"15min":1.887},"last":1.1419999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.145,"15min":1.046},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.629},"max":{"1min":1.4730000000000001,"5min":1.704,"15min":1.704},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.75,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.4199999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2230000000000001,"15min":1.2150000000000001},"min":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6779999999999999,"5min":1.8360000000000001,"15min":1.952},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.284,"15min":1.2829999999999999},"min":{"1min":0.91200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.5089999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2170000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3420000000000001},"min":{"1min":0.90100000000000002,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":2.306,"5min":2.306,"15min":2.3570000000000002},"last":1.379}]},{"osd":6,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.343,"15min":1.395},"min":{"1min":0.94999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.3839999999999999,"15min":1.458},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.76200000000000001},"max":{"1min":2.278,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.5920000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4670000000000001,"15min":1.466},"min":{"1min":0.872,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.677,"5min":1.52,"15min":1.528},"min":{"1min":0.998,"5min":0.68600000000000005,"15min":0.59999999999999998},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.8169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":607,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194704,"statfs":{"total":200000000,"available":199377803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54200000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.272,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.89200000000000002,"15min":0.95999999999999996},"min":{"1min":0.63,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.365,"5min":1.502,"15min":3.0670000000000002},"last":1.486}]},{"osd":1,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.98499999999999999},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3320000000000001,"5min":1.508,"15min":5.3769999999999998},"last":1.048},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92500000000000004,"15min":0.98099999999999998},"min":{"1min":0.60999999999999999,"5min":0.39900000000000002,"15min":0.36499999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":2.387},"last":1.1879999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98599999999999999,"15min":1.0329999999999999},"min":{"1min":0.59999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.4770000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.002,"15min":1.1120000000000001},"min":{"1min":0.57399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4770000000000001,"5min":1.8620000000000001,"15min":2.657},"last":1.3700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2030000000000001,"15min":1.2609999999999999},"min":{"1min":1.0389999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.718,"15min":3.0070000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2170000000000001,"15min":1.2330000000000001},"min":{"1min":0.998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.835,"5min":1.835,"15min":2.7690000000000001},"last":1.4550000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.2350000000000001,"15min":1.2989999999999999},"min":{"1min":0.97499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.679,"5min":1.7030000000000001,"15min":2.7309999999999999},"last":1.518},{"interface":"front","average":{"1min":1.21,"5min":1.214,"15min":1.262},"min":{"1min":0.96599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4630000000000001,"5min":1.671,"15min":3.5249999999999999},"last":1.534}]},{"osd":6,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.248,"15min":1.3},"min":{"1min":0.91900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5649999999999999,"5min":1.899,"15min":2.9769999999999999},"last":1.647},{"interface":"front","average":{"1min":1.389,"5min":1.3049999999999999,"15min":1.343},"min":{"1min":1.1599999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":1.9730000000000001,"15min":2.698},"last":1.593}]},{"osd":7,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.302,"15min":1.3640000000000001},"min":{"1min":0.88100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":1.8,"15min":3.609},"last":1.421},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.369,"15min":1.3939999999999999},"min":{"1min":1.081,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7829999999999999,"5min":2.0910000000000002,"15min":3.0379999999999998},"last":1.8500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":606,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194705,"statfs":{"total":200000000,"available":199378477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.254,"5min":1.544,"15min":2.258},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.999,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6539999999999999,"5min":11.85,"15min":11.85},"last":1.087}]},{"osd":1,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.5469999999999999,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0860000000000001,"15min":0.94799999999999995},"min":{"1min":0.50700000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3160000000000001,"5min":11.788,"15min":11.788},"last":0.93400000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.96299999999999997,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.413,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":0.872},{"interface":"front","average":{"1min":1.069,"5min":1.083,"15min":1.036},"min":{"1min":0.67600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.53,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.119}]},{"osd":4,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.335,"15min":1.1850000000000001},"min":{"1min":0.93100000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.6839999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.2170000000000001,"15min":1.2230000000000001},"min":{"1min":0.89400000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":2.2189999999999999},"last":0.99299999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.421,"15min":1.2529999999999999},"min":{"1min":1.1040000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.748,"5min":11.888,"15min":11.888},"last":1.579},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3109999999999999,"15min":1.3089999999999999},"min":{"1min":0.85199999999999998,"5min":0.76700000000000002,"15min":0.68899999999999995},"max":{"1min":1.738,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2889999999999999,"15min":1.3100000000000001},"min":{"1min":0.97399999999999998,"5min":0.754,"15min":0.72399999999999998},"max":{"1min":1.6739999999999999,"5min":2.0640000000000001,"15min":2.964},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3089999999999999,"15min":1.264},"min":{"1min":0.98599999999999999,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.6479999999999999,"5min":1.944,"15min":2.286},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8009999999999999,"5min":2.0369999999999999,"15min":2.351},"last":1.266},{"interface":"front","average":{"1min":1.383,"5min":1.4379999999999999,"15min":1.3029999999999999},"min":{"1min":1.0289999999999999,"5min":0.77100000000000002,"15min":0.75600000000000001},"max":{"1min":1.7729999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.6739999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1183,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194128,"statfs":{"total":200000000,"available":198788019,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95399999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5369999999999999,"5min":2.351,"15min":3.3500000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":1.0649999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4570000000000001,"5min":1.466,"15min":5.2999999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.137,"5min":1.1259999999999999,"15min":1.1779999999999999},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.764,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.6759999999999999,"5min":1.6899999999999999,"15min":3.4300000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.014,"15min":1.169},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.706,"5min":1.706,"15min":7.157},"last":0.66900000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.163,"15min":1.2230000000000001},"min":{"1min":0.77800000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.266,"15min":1.2989999999999999},"min":{"1min":0.88700000000000001,"5min":0.79100000000000004,"15min":0.72799999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":0.92100000000000004}]},{"osd":5,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2509999999999999,"15min":1.323},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.4019999999999999,"15min":1.3759999999999999},"min":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9870000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.1379999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.339,"15min":1.353},"min":{"1min":0.74199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3220000000000001,"15min":1.415},"min":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.77300000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":3.786},"last":0.93799999999999994}]},{"osd":7,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.3819999999999999,"15min":1.4490000000000001},"min":{"1min":0.872,"5min":0.84799999999999998,"15min":0.78400000000000003},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.337,"15min":1.448},"min":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.095}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":608,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194703,"statfs":{"total":200000000,"available":199376891,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.63700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4390000000000001,"5min":1.5820000000000001,"15min":1.6399999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.03,"15min":0.95899999999999996},"min":{"1min":0.57699999999999996,"5min":0.373,"15min":0.373},"max":{"1min":1.766,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2769999999999999,"15min":1.004},"min":{"1min":0.80200000000000005,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.845,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.478,"15min":1.1000000000000001},"min":{"1min":0.63400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.056,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.80600000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.88300000000000001,"15min":1.006},"min":{"1min":0.75800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.619,"5min":1.619,"15min":4.4530000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.071,"15min":1.103},"min":{"1min":0.77900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.77800000000000002}]},{"osd":4,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.1659999999999999,"15min":1.2110000000000001},"min":{"1min":0.97899999999999998,"5min":0.746,"15min":0.746},"max":{"1min":1.917,"5min":1.917,"15min":4.4269999999999996},"last":1.052},{"interface":"front","average":{"1min":1.393,"5min":1.403,"15min":1.23},"min":{"1min":1.0429999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1099999999999999,"5min":15.766,"15min":15.766},"last":1.256}]},{"osd":5,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3879999999999999,"15min":1.234},"min":{"1min":0.93500000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4569999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.484},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2549999999999999,"15min":1.2869999999999999},"min":{"1min":0.98699999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3119999999999998,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.6499999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.3799999999999999,"15min":1.28},"min":{"1min":1.2150000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.242,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.625},{"interface":"front","average":{"1min":1.504,"5min":1.522,"15min":1.3400000000000001},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.5489999999999999,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.5109999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4950000000000001,"15min":1.345},"min":{"1min":1.002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3530000000000002,"5min":14.381,"15min":14.381},"last":1.069},{"interface":"front","average":{"1min":1.53,"5min":1.4079999999999999,"15min":1.4059999999999999},"min":{"1min":1.1160000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3879999999999999,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":0.89900000000000002}]}]}],"pool_statfs":[]}} 2023-12-19T13:52:49.043 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:49.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:49.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:52:50.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.217+0000 7f0391ee7640 1 Processor -- start 2023-12-19T13:52:50.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.217+0000 7f0391ee7640 1 -- start start 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.218+0000 7f0391ee7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c157aa0 0x7f038c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.218+0000 7f0391ee7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f038c06e410 0x7f038c161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.218+0000 7f0391ee7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c06e890 con 0x7f038c161540 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.218+0000 7f0391ee7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c0b2600 con 0x7f038c06e410 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.218+0000 7f0391ee7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0b1d60 con 0x7f038c157aa0 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f038bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f038c161540 0x7f038c15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48146/0 (socket says 172.21.15.113:48146) 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f038bfff640 1 -- 172.21.15.113:0/1740931146 learned_addr learned my addr 172.21.15.113:0/1740931146 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:52:50.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f0382ffd640 1 --2- 172.21.15.113:0/1740931146 >> v2:172.21.15.113:3300/0 conn(0x7f038c06e410 0x7f038c161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f038b7fe640 1 --2- 172.21.15.113:0/1740931146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c157aa0 0x7f038c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f038affd640 1 -- 172.21.15.113:0/1740931146 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306740185 0 0) 0x7f038c06e890 con 0x7f038c161540 2023-12-19T13:52:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f0382ffd640 1 -- 172.21.15.113:0/1740931146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c157aa0 msgr2=0x7f038c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f0382ffd640 1 --2- 172.21.15.113:0/1740931146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c157aa0 0x7f038c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f0382ffd640 1 -- 172.21.15.113:0/1740931146 >> v1:172.21.15.113:6789/0 conn(0x7f038c161540 legacy=0x7f038c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.219+0000 7f0382ffd640 1 -- 172.21.15.113:0/1740931146 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0b2040 con 0x7f038c06e410 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f0382ffd640 1 --2- 172.21.15.113:0/1740931146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c06e410 0x7f038c161000 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f03740097a0 tx=0x7f037402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2ae007730c0e12 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f038affd640 1 -- 172.21.15.113:0/1740931146 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374031830 con 0x7f038c06e410 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f038affd640 1 -- 172.21.15.113:0/1740931146 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0374031990 con 0x7f038c06e410 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f038affd640 1 -- 172.21.15.113:0/1740931146 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374031d20 con 0x7f038c06e410 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f0391ee7640 1 -- 172.21.15.113:0/1740931146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c06e410 msgr2=0x7f038c161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f0391ee7640 1 --2- 172.21.15.113:0/1740931146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c06e410 0x7f038c161000 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f03740097a0 tx=0x7f037402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f0391ee7640 1 -- 172.21.15.113:0/1740931146 shutdown_connections 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f0391ee7640 1 --2- 172.21.15.113:0/1740931146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c06e410 0x7f038c161000 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f0391ee7640 1 --2- 172.21.15.113:0/1740931146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c157aa0 0x7f038c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.221+0000 7f0391ee7640 1 -- 172.21.15.113:0/1740931146 >> 172.21.15.113:0/1740931146 conn(0x7f038c0cbb70 msgr2=0x7f038c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.222+0000 7f0391ee7640 1 -- 172.21.15.113:0/1740931146 shutdown_connections 2023-12-19T13:52:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.222+0000 7f0391ee7640 1 -- 172.21.15.113:0/1740931146 wait complete. 2023-12-19T13:52:50.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.223+0000 7f0391ee7640 1 Processor -- start 2023-12-19T13:52:50.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.223+0000 7f0391ee7640 1 -- start start 2023-12-19T13:52:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.224+0000 7f0391ee7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f038c06e410 0x7f038c145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.224+0000 7f0391ee7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c157aa0 0x7f038c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.224+0000 7f0391ee7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c161540 0x7f038c1e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.224+0000 7f0391ee7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c1e7020 con 0x7f038c157aa0 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.224+0000 7f0391ee7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c1e6a40 con 0x7f038c06e410 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.224+0000 7f0391ee7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0aef10 con 0x7f038c161540 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c157aa0 0x7f038c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c157aa0 0x7f038c0ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36402/0 (socket says 172.21.15.113:36402) 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 -- 172.21.15.113:0/2632562554 learned_addr learned my addr 172.21.15.113:0/2632562554 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f038b7fe640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f038c06e410 0x7f038c145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f038bfff640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c161540 0x7f038c1e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 -- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c161540 msgr2=0x7f038c1e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c161540 0x7f038c1e74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 -- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f038c06e410 msgr2=0x7f038c145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f038c06e410 0x7f038c145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f0382ffd640 1 -- 172.21.15.113:0/2632562554 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374009400 con 0x7f038c157aa0 2023-12-19T13:52:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.225+0000 7f038bfff640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c161540 0x7f038c1e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:50.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.226+0000 7f0382ffd640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c157aa0 0x7f038c0ae530 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f037402bee0 tx=0x7f03740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:50.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.226+0000 7f0388ff9640 1 -- 172.21.15.113:0/2632562554 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037403a6f0 con 0x7f038c157aa0 2023-12-19T13:52:50.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.226+0000 7f0388ff9640 1 -- 172.21.15.113:0/2632562554 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037403a870 con 0x7f038c157aa0 2023-12-19T13:52:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.226+0000 7f0388ff9640 1 -- 172.21.15.113:0/2632562554 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037403ac20 con 0x7f038c157aa0 2023-12-19T13:52:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.226+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c1e6cb0 con 0x7f038c157aa0 2023-12-19T13:52:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.226+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c145f50 con 0x7f038c157aa0 2023-12-19T13:52:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.227+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c1e71d0 con 0x7f038c157aa0 2023-12-19T13:52:50.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.228+0000 7f0388ff9640 1 -- 172.21.15.113:0/2632562554 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f037404c3b0 con 0x7f038c157aa0 2023-12-19T13:52:50.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.229+0000 7f0388ff9640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f036c06a430 0x7f036c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.229+0000 7f0388ff9640 1 -- 172.21.15.113:0/2632562554 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03740aa6c0 con 0x7f038c157aa0 2023-12-19T13:52:50.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.230+0000 7f038b7fe640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f036c06a430 0x7f036c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.230+0000 7f038b7fe640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f036c06a430 0x7f036c06c8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f037c009ad0 tx=0x7f037c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:50.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.234+0000 7f0388ff9640 1 -- 172.21.15.113:0/2632562554 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f038c1e71d0 con 0x7f038c157aa0 2023-12-19T13:52:50.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.422+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f038c15db20 con 0x7f036c06a430 2023-12-19T13:52:50.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.443+0000 7f0388ff9640 1 -- 172.21.15.113:0/2632562554 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282979 (secure 0 0 0) 0x7f037c0119a0 con 0x7f036c06a430 2023-12-19T13:52:50.447 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:50.448 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f036c06a430 msgr2=0x7f036c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f036c06a430 0x7f036c06c8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f037c009ad0 tx=0x7f037c008040 comp rx=0 tx=0).stop 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c157aa0 msgr2=0x7f038c0ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c157aa0 0x7f038c0ae530 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f037402bee0 tx=0x7f03740046c0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 shutdown_connections 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f036c06a430 0x7f036c06c8f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f038c161540 0x7f038c1e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f038c157aa0 0x7f038c0ae530 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 --2- 172.21.15.113:0/2632562554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f038c06e410 0x7f038c145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 >> 172.21.15.113:0/2632562554 conn(0x7f038c0cbb70 msgr2=0x7f038c0cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 shutdown_connections 2023-12-19T13:52:50.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.449+0000 7f0391ee7640 1 -- 172.21.15.113:0/2632562554 wait complete. 2023-12-19T13:52:50.469 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2023-12-19T13:52:48.535641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556486,"statfs":{"total":1600000000,"available":1593842356,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002527"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593011+0000","last_change":"2023-12-19T13:52:40.592436+0000","last_active":"2023-12-19T13:52:40.593011+0000","last_peered":"2023-12-19T13:52:40.593011+0000","last_clean":"2023-12-19T13:52:40.593011+0000","last_became_active":"2023-12-19T13:52:40.592231+0000","last_became_peered":"2023-12-19T13:52:40.592231+0000","last_unstale":"2023-12-19T13:52:40.593011+0000","last_undegraded":"2023-12-19T13:52:40.593011+0000","last_fullsized":"2023-12-19T13:52:40.593011+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.242518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600675+0000","last_change":"2023-12-19T13:52:40.600579+0000","last_active":"2023-12-19T13:52:40.600675+0000","last_peered":"2023-12-19T13:52:40.600675+0000","last_clean":"2023-12-19T13:52:40.600675+0000","last_became_active":"2023-12-19T13:52:40.600085+0000","last_became_peered":"2023-12-19T13:52:40.600085+0000","last_unstale":"2023-12-19T13:52:40.600675+0000","last_undegraded":"2023-12-19T13:52:40.600675+0000","last_fullsized":"2023-12-19T13:52:40.600675+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591018+0000","last_change":"2023-12-19T13:52:40.589911+0000","last_active":"2023-12-19T13:52:40.591018+0000","last_peered":"2023-12-19T13:52:40.591018+0000","last_clean":"2023-12-19T13:52:40.591018+0000","last_became_active":"2023-12-19T13:52:40.589672+0000","last_became_peered":"2023-12-19T13:52:40.589672+0000","last_unstale":"2023-12-19T13:52:40.591018+0000","last_undegraded":"2023-12-19T13:52:40.591018+0000","last_fullsized":"2023-12-19T13:52:40.591018+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:39.296028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601306+0000","last_change":"2023-12-19T13:52:40.601153+0000","last_active":"2023-12-19T13:52:40.601306+0000","last_peered":"2023-12-19T13:52:40.601306+0000","last_clean":"2023-12-19T13:52:40.601306+0000","last_became_active":"2023-12-19T13:52:40.595970+0000","last_became_peered":"2023-12-19T13:52:40.595970+0000","last_unstale":"2023-12-19T13:52:40.601306+0000","last_undegraded":"2023-12-19T13:52:40.601306+0000","last_fullsized":"2023-12-19T13:52:40.601306+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:20.603655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590297+0000","last_change":"2023-12-19T13:52:40.589375+0000","last_active":"2023-12-19T13:52:40.590297+0000","last_peered":"2023-12-19T13:52:40.590297+0000","last_clean":"2023-12-19T13:52:40.590297+0000","last_became_active":"2023-12-19T13:52:40.589164+0000","last_became_peered":"2023-12-19T13:52:40.589164+0000","last_unstale":"2023-12-19T13:52:40.590297+0000","last_undegraded":"2023-12-19T13:52:40.590297+0000","last_fullsized":"2023-12-19T13:52:40.590297+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:03:00.686839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597549+0000","last_change":"2023-12-19T13:52:40.597221+0000","last_active":"2023-12-19T13:52:40.597549+0000","last_peered":"2023-12-19T13:52:40.597549+0000","last_clean":"2023-12-19T13:52:40.597549+0000","last_became_active":"2023-12-19T13:52:40.596845+0000","last_became_peered":"2023-12-19T13:52:40.596845+0000","last_unstale":"2023-12-19T13:52:40.597549+0000","last_undegraded":"2023-12-19T13:52:40.597549+0000","last_fullsized":"2023-12-19T13:52:40.597549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593565+0000","last_change":"2023-12-19T13:52:40.593287+0000","last_active":"2023-12-19T13:52:40.593565+0000","last_peered":"2023-12-19T13:52:40.593565+0000","last_clean":"2023-12-19T13:52:40.593565+0000","last_became_active":"2023-12-19T13:52:40.592940+0000","last_became_peered":"2023-12-19T13:52:40.592940+0000","last_unstale":"2023-12-19T13:52:40.593565+0000","last_undegraded":"2023-12-19T13:52:40.593565+0000","last_fullsized":"2023-12-19T13:52:40.593565+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601891+0000","last_change":"2023-12-19T13:52:40.601329+0000","last_active":"2023-12-19T13:52:40.601891+0000","last_peered":"2023-12-19T13:52:40.601891+0000","last_clean":"2023-12-19T13:52:40.601891+0000","last_became_active":"2023-12-19T13:52:40.601116+0000","last_became_peered":"2023-12-19T13:52:40.601116+0000","last_unstale":"2023-12-19T13:52:40.601891+0000","last_undegraded":"2023-12-19T13:52:40.601891+0000","last_fullsized":"2023-12-19T13:52:40.601891+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596437+0000","last_change":"2023-12-19T13:52:40.596022+0000","last_active":"2023-12-19T13:52:40.596437+0000","last_peered":"2023-12-19T13:52:40.596437+0000","last_clean":"2023-12-19T13:52:40.596437+0000","last_became_active":"2023-12-19T13:52:40.595819+0000","last_became_peered":"2023-12-19T13:52:40.595819+0000","last_unstale":"2023-12-19T13:52:40.596437+0000","last_undegraded":"2023-12-19T13:52:40.596437+0000","last_fullsized":"2023-12-19T13:52:40.596437+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597853+0000","last_change":"2023-12-19T13:52:40.597789+0000","last_active":"2023-12-19T13:52:40.597853+0000","last_peered":"2023-12-19T13:52:40.597853+0000","last_clean":"2023-12-19T13:52:40.597853+0000","last_became_active":"2023-12-19T13:52:40.597354+0000","last_became_peered":"2023-12-19T13:52:40.597354+0000","last_unstale":"2023-12-19T13:52:40.597853+0000","last_undegraded":"2023-12-19T13:52:40.597853+0000","last_fullsized":"2023-12-19T13:52:40.597853+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604350+0000","last_change":"2023-12-19T13:52:40.603708+0000","last_active":"2023-12-19T13:52:40.604350+0000","last_peered":"2023-12-19T13:52:40.604350+0000","last_clean":"2023-12-19T13:52:40.604350+0000","last_became_active":"2023-12-19T13:52:40.602904+0000","last_became_peered":"2023-12-19T13:52:40.602904+0000","last_unstale":"2023-12-19T13:52:40.604350+0000","last_undegraded":"2023-12-19T13:52:40.604350+0000","last_fullsized":"2023-12-19T13:52:40.604350+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598838+0000","last_change":"2023-12-19T13:52:40.598750+0000","last_active":"2023-12-19T13:52:40.598838+0000","last_peered":"2023-12-19T13:52:40.598838+0000","last_clean":"2023-12-19T13:52:40.598838+0000","last_became_active":"2023-12-19T13:52:40.597715+0000","last_became_peered":"2023-12-19T13:52:40.597715+0000","last_unstale":"2023-12-19T13:52:40.598838+0000","last_undegraded":"2023-12-19T13:52:40.598838+0000","last_fullsized":"2023-12-19T13:52:40.598838+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593446+0000","last_change":"2023-12-19T13:52:40.592732+0000","last_active":"2023-12-19T13:52:40.593446+0000","last_peered":"2023-12-19T13:52:40.593446+0000","last_clean":"2023-12-19T13:52:40.593446+0000","last_became_active":"2023-12-19T13:52:40.592473+0000","last_became_peered":"2023-12-19T13:52:40.592473+0000","last_unstale":"2023-12-19T13:52:40.593446+0000","last_undegraded":"2023-12-19T13:52:40.593446+0000","last_fullsized":"2023-12-19T13:52:40.593446+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:49.109631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603608+0000","last_change":"2023-12-19T13:52:40.601411+0000","last_active":"2023-12-19T13:52:40.603608+0000","last_peered":"2023-12-19T13:52:40.603608+0000","last_clean":"2023-12-19T13:52:40.603608+0000","last_became_active":"2023-12-19T13:52:40.598633+0000","last_became_peered":"2023-12-19T13:52:40.598633+0000","last_unstale":"2023-12-19T13:52:40.603608+0000","last_undegraded":"2023-12-19T13:52:40.603608+0000","last_fullsized":"2023-12-19T13:52:40.603608+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596734+0000","last_change":"2023-12-19T13:52:40.596233+0000","last_active":"2023-12-19T13:52:40.596734+0000","last_peered":"2023-12-19T13:52:40.596734+0000","last_clean":"2023-12-19T13:52:40.596734+0000","last_became_active":"2023-12-19T13:52:40.594355+0000","last_became_peered":"2023-12-19T13:52:40.594355+0000","last_unstale":"2023-12-19T13:52:40.596734+0000","last_undegraded":"2023-12-19T13:52:40.596734+0000","last_fullsized":"2023-12-19T13:52:40.596734+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:23.909006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597515+0000","last_change":"2023-12-19T13:52:40.596313+0000","last_active":"2023-12-19T13:52:40.597515+0000","last_peered":"2023-12-19T13:52:40.597515+0000","last_clean":"2023-12-19T13:52:40.597515+0000","last_became_active":"2023-12-19T13:52:40.595250+0000","last_became_peered":"2023-12-19T13:52:40.595250+0000","last_unstale":"2023-12-19T13:52:40.597515+0000","last_undegraded":"2023-12-19T13:52:40.597515+0000","last_fullsized":"2023-12-19T13:52:40.597515+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598230+0000","last_change":"2023-12-19T13:52:40.597986+0000","last_active":"2023-12-19T13:52:40.598230+0000","last_peered":"2023-12-19T13:52:40.598230+0000","last_clean":"2023-12-19T13:52:40.598230+0000","last_became_active":"2023-12-19T13:52:40.596988+0000","last_became_peered":"2023-12-19T13:52:40.596988+0000","last_unstale":"2023-12-19T13:52:40.598230+0000","last_undegraded":"2023-12-19T13:52:40.598230+0000","last_fullsized":"2023-12-19T13:52:40.598230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:12.182047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600913+0000","last_change":"2023-12-19T13:52:40.600835+0000","last_active":"2023-12-19T13:52:40.600913+0000","last_peered":"2023-12-19T13:52:40.600913+0000","last_clean":"2023-12-19T13:52:40.600913+0000","last_became_active":"2023-12-19T13:52:40.600397+0000","last_became_peered":"2023-12-19T13:52:40.600397+0000","last_unstale":"2023-12-19T13:52:40.600913+0000","last_undegraded":"2023-12-19T13:52:40.600913+0000","last_fullsized":"2023-12-19T13:52:40.600913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603629+0000","last_change":"2023-12-19T13:52:40.603104+0000","last_active":"2023-12-19T13:52:40.603629+0000","last_peered":"2023-12-19T13:52:40.603629+0000","last_clean":"2023-12-19T13:52:40.603629+0000","last_became_active":"2023-12-19T13:52:40.601178+0000","last_became_peered":"2023-12-19T13:52:40.601178+0000","last_unstale":"2023-12-19T13:52:40.603629+0000","last_undegraded":"2023-12-19T13:52:40.603629+0000","last_fullsized":"2023-12-19T13:52:40.603629+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:01.263392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605797+0000","last_change":"2023-12-19T13:52:40.605720+0000","last_active":"2023-12-19T13:52:40.605797+0000","last_peered":"2023-12-19T13:52:40.605797+0000","last_clean":"2023-12-19T13:52:40.605797+0000","last_became_active":"2023-12-19T13:52:40.605430+0000","last_became_peered":"2023-12-19T13:52:40.605430+0000","last_unstale":"2023-12-19T13:52:40.605797+0000","last_undegraded":"2023-12-19T13:52:40.605797+0000","last_fullsized":"2023-12-19T13:52:40.605797+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:13:09.860701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603912+0000","last_change":"2023-12-19T13:52:40.603538+0000","last_active":"2023-12-19T13:52:40.603912+0000","last_peered":"2023-12-19T13:52:40.603912+0000","last_clean":"2023-12-19T13:52:40.603912+0000","last_became_active":"2023-12-19T13:52:40.601968+0000","last_became_peered":"2023-12-19T13:52:40.601968+0000","last_unstale":"2023-12-19T13:52:40.603912+0000","last_undegraded":"2023-12-19T13:52:40.603912+0000","last_fullsized":"2023-12-19T13:52:40.603912+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:28.900515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596665+0000","last_change":"2023-12-19T13:52:40.595842+0000","last_active":"2023-12-19T13:52:40.596665+0000","last_peered":"2023-12-19T13:52:40.596665+0000","last_clean":"2023-12-19T13:52:40.596665+0000","last_became_active":"2023-12-19T13:52:40.595597+0000","last_became_peered":"2023-12-19T13:52:40.595597+0000","last_unstale":"2023-12-19T13:52:40.596665+0000","last_undegraded":"2023-12-19T13:52:40.596665+0000","last_fullsized":"2023-12-19T13:52:40.596665+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:48.773081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591922+0000","last_change":"2023-12-19T13:52:40.591291+0000","last_active":"2023-12-19T13:52:40.591922+0000","last_peered":"2023-12-19T13:52:40.591922+0000","last_clean":"2023-12-19T13:52:40.591922+0000","last_became_active":"2023-12-19T13:52:40.590982+0000","last_became_peered":"2023-12-19T13:52:40.590982+0000","last_unstale":"2023-12-19T13:52:40.591922+0000","last_undegraded":"2023-12-19T13:52:40.591922+0000","last_fullsized":"2023-12-19T13:52:40.591922+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:23.647544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605036+0000","last_change":"2023-12-19T13:52:40.604740+0000","last_active":"2023-12-19T13:52:40.605036+0000","last_peered":"2023-12-19T13:52:40.605036+0000","last_clean":"2023-12-19T13:52:40.605036+0000","last_became_active":"2023-12-19T13:52:40.604512+0000","last_became_peered":"2023-12-19T13:52:40.604512+0000","last_unstale":"2023-12-19T13:52:40.605036+0000","last_undegraded":"2023-12-19T13:52:40.605036+0000","last_fullsized":"2023-12-19T13:52:40.605036+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:01.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598813+0000","last_change":"2023-12-19T13:52:40.598675+0000","last_active":"2023-12-19T13:52:40.598813+0000","last_peered":"2023-12-19T13:52:40.598813+0000","last_clean":"2023-12-19T13:52:40.598813+0000","last_became_active":"2023-12-19T13:52:40.598342+0000","last_became_peered":"2023-12-19T13:52:40.598342+0000","last_unstale":"2023-12-19T13:52:40.598813+0000","last_undegraded":"2023-12-19T13:52:40.598813+0000","last_fullsized":"2023-12-19T13:52:40.598813+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598559+0000","last_change":"2023-12-19T13:52:40.598177+0000","last_active":"2023-12-19T13:52:40.598559+0000","last_peered":"2023-12-19T13:52:40.598559+0000","last_clean":"2023-12-19T13:52:40.598559+0000","last_became_active":"2023-12-19T13:52:40.597963+0000","last_became_peered":"2023-12-19T13:52:40.597963+0000","last_unstale":"2023-12-19T13:52:40.598559+0000","last_undegraded":"2023-12-19T13:52:40.598559+0000","last_fullsized":"2023-12-19T13:52:40.598559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:50.782063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594479+0000","last_change":"2023-12-19T13:52:40.594423+0000","last_active":"2023-12-19T13:52:40.594479+0000","last_peered":"2023-12-19T13:52:40.594479+0000","last_clean":"2023-12-19T13:52:40.594479+0000","last_became_active":"2023-12-19T13:52:40.593913+0000","last_became_peered":"2023-12-19T13:52:40.593913+0000","last_unstale":"2023-12-19T13:52:40.594479+0000","last_undegraded":"2023-12-19T13:52:40.594479+0000","last_fullsized":"2023-12-19T13:52:40.594479+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:12.123080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.579811+0000","last_change":"2023-12-19T13:52:40.579736+0000","last_active":"2023-12-19T13:52:40.579811+0000","last_peered":"2023-12-19T13:52:40.579811+0000","last_clean":"2023-12-19T13:52:40.579811+0000","last_became_active":"2023-12-19T13:52:40.579367+0000","last_became_peered":"2023-12-19T13:52:40.579367+0000","last_unstale":"2023-12-19T13:52:40.579811+0000","last_undegraded":"2023-12-19T13:52:40.579811+0000","last_fullsized":"2023-12-19T13:52:40.579811+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:56:38.887233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.606672+0000","last_change":"2023-12-19T13:52:40.606600+0000","last_active":"2023-12-19T13:52:40.606672+0000","last_peered":"2023-12-19T13:52:40.606672+0000","last_clean":"2023-12-19T13:52:40.606672+0000","last_became_active":"2023-12-19T13:52:40.603275+0000","last_became_peered":"2023-12-19T13:52:40.603275+0000","last_unstale":"2023-12-19T13:52:40.606672+0000","last_undegraded":"2023-12-19T13:52:40.606672+0000","last_fullsized":"2023-12-19T13:52:40.606672+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:36:04.663189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599557+0000","last_change":"2023-12-19T13:52:40.599345+0000","last_active":"2023-12-19T13:52:40.599557+0000","last_peered":"2023-12-19T13:52:40.599557+0000","last_clean":"2023-12-19T13:52:40.599557+0000","last_became_active":"2023-12-19T13:52:40.598945+0000","last_became_peered":"2023-12-19T13:52:40.598945+0000","last_unstale":"2023-12-19T13:52:40.599557+0000","last_undegraded":"2023-12-19T13:52:40.599557+0000","last_fullsized":"2023-12-19T13:52:40.599557+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597534+0000","last_change":"2023-12-19T13:52:40.597093+0000","last_active":"2023-12-19T13:52:40.597534+0000","last_peered":"2023-12-19T13:52:40.597534+0000","last_clean":"2023-12-19T13:52:40.597534+0000","last_became_active":"2023-12-19T13:52:40.596557+0000","last_became_peered":"2023-12-19T13:52:40.596557+0000","last_unstale":"2023-12-19T13:52:40.597534+0000","last_undegraded":"2023-12-19T13:52:40.597534+0000","last_fullsized":"2023-12-19T13:52:40.597534+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598508+0000","last_change":"2023-12-19T13:52:40.598261+0000","last_active":"2023-12-19T13:52:40.598508+0000","last_peered":"2023-12-19T13:52:40.598508+0000","last_clean":"2023-12-19T13:52:40.598508+0000","last_became_active":"2023-12-19T13:52:40.598035+0000","last_became_peered":"2023-12-19T13:52:40.598035+0000","last_unstale":"2023-12-19T13:52:40.598508+0000","last_undegraded":"2023-12-19T13:52:40.598508+0000","last_fullsized":"2023-12-19T13:52:40.598508+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588518+0000","last_change":"2023-12-19T13:52:40.588261+0000","last_active":"2023-12-19T13:52:40.588518+0000","last_peered":"2023-12-19T13:52:40.588518+0000","last_clean":"2023-12-19T13:52:40.588518+0000","last_became_active":"2023-12-19T13:52:40.587905+0000","last_became_peered":"2023-12-19T13:52:40.587905+0000","last_unstale":"2023-12-19T13:52:40.588518+0000","last_undegraded":"2023-12-19T13:52:40.588518+0000","last_fullsized":"2023-12-19T13:52:40.588518+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:58.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"112'4","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594348+0000","last_change":"2023-12-19T13:52:40.112901+0000","last_active":"2023-12-19T13:52:40.594348+0000","last_peered":"2023-12-19T13:52:40.594348+0000","last_clean":"2023-12-19T13:52:40.594348+0000","last_became_active":"2023-12-19T13:52:40.112699+0000","last_became_peered":"2023-12-19T13:52:40.112699+0000","last_unstale":"2023-12-19T13:52:40.594348+0000","last_undegraded":"2023-12-19T13:52:40.594348+0000","last_fullsized":"2023-12-19T13:52:40.594348+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:54:07.231697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591007+0000","last_change":"2023-12-19T13:52:40.590949+0000","last_active":"2023-12-19T13:52:40.591007+0000","last_peered":"2023-12-19T13:52:40.591007+0000","last_clean":"2023-12-19T13:52:40.591007+0000","last_became_active":"2023-12-19T13:52:40.590743+0000","last_became_peered":"2023-12-19T13:52:40.590743+0000","last_unstale":"2023-12-19T13:52:40.591007+0000","last_undegraded":"2023-12-19T13:52:40.591007+0000","last_fullsized":"2023-12-19T13:52:40.591007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.598521+0000","last_change":"2023-12-19T13:52:40.108400+0000","last_active":"2023-12-19T13:52:40.598521+0000","last_peered":"2023-12-19T13:52:40.598521+0000","last_clean":"2023-12-19T13:52:40.598521+0000","last_became_active":"2023-12-19T13:52:40.108172+0000","last_became_peered":"2023-12-19T13:52:40.108172+0000","last_unstale":"2023-12-19T13:52:40.598521+0000","last_undegraded":"2023-12-19T13:52:40.598521+0000","last_fullsized":"2023-12-19T13:52:40.598521+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.593649+0000","last_change":"2023-12-19T13:52:40.593316+0000","last_active":"2023-12-19T13:52:40.593649+0000","last_peered":"2023-12-19T13:52:40.593649+0000","last_clean":"2023-12-19T13:52:40.593649+0000","last_became_active":"2023-12-19T13:52:40.593081+0000","last_became_peered":"2023-12-19T13:52:40.593081+0000","last_unstale":"2023-12-19T13:52:40.593649+0000","last_undegraded":"2023-12-19T13:52:40.593649+0000","last_fullsized":"2023-12-19T13:52:40.593649+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600277+0000","last_change":"2023-12-19T13:52:40.109163+0000","last_active":"2023-12-19T13:52:40.600277+0000","last_peered":"2023-12-19T13:52:40.600277+0000","last_clean":"2023-12-19T13:52:40.600277+0000","last_became_active":"2023-12-19T13:52:40.108736+0000","last_became_peered":"2023-12-19T13:52:40.108736+0000","last_unstale":"2023-12-19T13:52:40.600277+0000","last_undegraded":"2023-12-19T13:52:40.600277+0000","last_fullsized":"2023-12-19T13:52:40.600277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:17.154193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601786+0000","last_change":"2023-12-19T13:52:40.601326+0000","last_active":"2023-12-19T13:52:40.601786+0000","last_peered":"2023-12-19T13:52:40.601786+0000","last_clean":"2023-12-19T13:52:40.601786+0000","last_became_active":"2023-12-19T13:52:40.600453+0000","last_became_peered":"2023-12-19T13:52:40.600453+0000","last_unstale":"2023-12-19T13:52:40.601786+0000","last_undegraded":"2023-12-19T13:52:40.601786+0000","last_fullsized":"2023-12-19T13:52:40.601786+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:19.675328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.607335+0000","last_change":"2023-12-19T13:52:40.101417+0000","last_active":"2023-12-19T13:52:40.607335+0000","last_peered":"2023-12-19T13:52:40.607335+0000","last_clean":"2023-12-19T13:52:40.607335+0000","last_became_active":"2023-12-19T13:52:40.100811+0000","last_became_peered":"2023-12-19T13:52:40.100811+0000","last_unstale":"2023-12-19T13:52:40.607335+0000","last_undegraded":"2023-12-19T13:52:40.607335+0000","last_fullsized":"2023-12-19T13:52:40.607335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:22.638411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605289+0000","last_change":"2023-12-19T13:52:40.605193+0000","last_active":"2023-12-19T13:52:40.605289+0000","last_peered":"2023-12-19T13:52:40.605289+0000","last_clean":"2023-12-19T13:52:40.605289+0000","last_became_active":"2023-12-19T13:52:40.604554+0000","last_became_peered":"2023-12-19T13:52:40.604554+0000","last_unstale":"2023-12-19T13:52:40.605289+0000","last_undegraded":"2023-12-19T13:52:40.605289+0000","last_fullsized":"2023-12-19T13:52:40.605289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:06.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590234+0000","last_change":"2023-12-19T13:52:40.100131+0000","last_active":"2023-12-19T13:52:40.590234+0000","last_peered":"2023-12-19T13:52:40.590234+0000","last_clean":"2023-12-19T13:52:40.590234+0000","last_became_active":"2023-12-19T13:52:40.098016+0000","last_became_peered":"2023-12-19T13:52:40.098016+0000","last_unstale":"2023-12-19T13:52:40.590234+0000","last_undegraded":"2023-12-19T13:52:40.590234+0000","last_fullsized":"2023-12-19T13:52:40.590234+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:00.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599047+0000","last_change":"2023-12-19T13:52:40.598982+0000","last_active":"2023-12-19T13:52:40.599047+0000","last_peered":"2023-12-19T13:52:40.599047+0000","last_clean":"2023-12-19T13:52:40.599047+0000","last_became_active":"2023-12-19T13:52:40.598802+0000","last_became_peered":"2023-12-19T13:52:40.598802+0000","last_unstale":"2023-12-19T13:52:40.599047+0000","last_undegraded":"2023-12-19T13:52:40.599047+0000","last_fullsized":"2023-12-19T13:52:40.599047+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:15.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597855+0000","last_change":"2023-12-19T13:52:40.112976+0000","last_active":"2023-12-19T13:52:40.597855+0000","last_peered":"2023-12-19T13:52:40.597855+0000","last_clean":"2023-12-19T13:52:40.597855+0000","last_became_active":"2023-12-19T13:52:40.112742+0000","last_became_peered":"2023-12-19T13:52:40.112742+0000","last_unstale":"2023-12-19T13:52:40.597855+0000","last_undegraded":"2023-12-19T13:52:40.597855+0000","last_fullsized":"2023-12-19T13:52:40.597855+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601802+0000","last_change":"2023-12-19T13:52:40.601458+0000","last_active":"2023-12-19T13:52:40.601802+0000","last_peered":"2023-12-19T13:52:40.601802+0000","last_clean":"2023-12-19T13:52:40.601802+0000","last_became_active":"2023-12-19T13:52:40.601097+0000","last_became_peered":"2023-12-19T13:52:40.601097+0000","last_unstale":"2023-12-19T13:52:40.601802+0000","last_undegraded":"2023-12-19T13:52:40.601802+0000","last_fullsized":"2023-12-19T13:52:40.601802+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:46.642976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.584744+0000","last_change":"2023-12-19T13:52:40.102794+0000","last_active":"2023-12-19T13:52:40.584744+0000","last_peered":"2023-12-19T13:52:40.584744+0000","last_clean":"2023-12-19T13:52:40.584744+0000","last_became_active":"2023-12-19T13:52:40.102320+0000","last_became_peered":"2023-12-19T13:52:40.102320+0000","last_unstale":"2023-12-19T13:52:40.584744+0000","last_undegraded":"2023-12-19T13:52:40.584744+0000","last_fullsized":"2023-12-19T13:52:40.584744+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:25.273423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589811+0000","last_change":"2023-12-19T13:52:40.588395+0000","last_active":"2023-12-19T13:52:40.589811+0000","last_peered":"2023-12-19T13:52:40.589811+0000","last_clean":"2023-12-19T13:52:40.589811+0000","last_became_active":"2023-12-19T13:52:40.587940+0000","last_became_peered":"2023-12-19T13:52:40.587940+0000","last_unstale":"2023-12-19T13:52:40.589811+0000","last_undegraded":"2023-12-19T13:52:40.589811+0000","last_fullsized":"2023-12-19T13:52:40.589811+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:48.602895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.585302+0000","last_change":"2023-12-19T13:52:40.115190+0000","last_active":"2023-12-19T13:52:40.585302+0000","last_peered":"2023-12-19T13:52:40.585302+0000","last_clean":"2023-12-19T13:52:40.585302+0000","last_became_active":"2023-12-19T13:52:40.114825+0000","last_became_peered":"2023-12-19T13:52:40.114825+0000","last_unstale":"2023-12-19T13:52:40.585302+0000","last_undegraded":"2023-12-19T13:52:40.585302+0000","last_fullsized":"2023-12-19T13:52:40.585302+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:36.838331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589840+0000","last_change":"2023-12-19T13:52:40.589236+0000","last_active":"2023-12-19T13:52:40.589840+0000","last_peered":"2023-12-19T13:52:40.589840+0000","last_clean":"2023-12-19T13:52:40.589840+0000","last_became_active":"2023-12-19T13:52:40.586199+0000","last_became_peered":"2023-12-19T13:52:40.586199+0000","last_unstale":"2023-12-19T13:52:40.589840+0000","last_undegraded":"2023-12-19T13:52:40.589840+0000","last_fullsized":"2023-12-19T13:52:40.589840+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.575060+0000","last_change":"2023-12-19T13:52:40.107384+0000","last_active":"2023-12-19T13:52:40.575060+0000","last_peered":"2023-12-19T13:52:40.575060+0000","last_clean":"2023-12-19T13:52:40.575060+0000","last_became_active":"2023-12-19T13:52:40.107084+0000","last_became_peered":"2023-12-19T13:52:40.107084+0000","last_unstale":"2023-12-19T13:52:40.575060+0000","last_undegraded":"2023-12-19T13:52:40.575060+0000","last_fullsized":"2023-12-19T13:52:40.575060+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.505632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603132+0000","last_change":"2023-12-19T13:52:40.603065+0000","last_active":"2023-12-19T13:52:40.603132+0000","last_peered":"2023-12-19T13:52:40.603132+0000","last_clean":"2023-12-19T13:52:40.603132+0000","last_became_active":"2023-12-19T13:52:40.602830+0000","last_became_peered":"2023-12-19T13:52:40.602830+0000","last_unstale":"2023-12-19T13:52:40.603132+0000","last_undegraded":"2023-12-19T13:52:40.603132+0000","last_fullsized":"2023-12-19T13:52:40.603132+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:21.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.587970+0000","last_change":"2023-12-19T13:52:40.110437+0000","last_active":"2023-12-19T13:52:40.587970+0000","last_peered":"2023-12-19T13:52:40.587970+0000","last_clean":"2023-12-19T13:52:40.587970+0000","last_became_active":"2023-12-19T13:52:40.110207+0000","last_became_peered":"2023-12-19T13:52:40.110207+0000","last_unstale":"2023-12-19T13:52:40.587970+0000","last_undegraded":"2023-12-19T13:52:40.587970+0000","last_fullsized":"2023-12-19T13:52:40.587970+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597854+0000","last_change":"2023-12-19T13:52:40.594998+0000","last_active":"2023-12-19T13:52:40.597854+0000","last_peered":"2023-12-19T13:52:40.597854+0000","last_clean":"2023-12-19T13:52:40.597854+0000","last_became_active":"2023-12-19T13:52:40.594692+0000","last_became_peered":"2023-12-19T13:52:40.594692+0000","last_unstale":"2023-12-19T13:52:40.597854+0000","last_undegraded":"2023-12-19T13:52:40.597854+0000","last_fullsized":"2023-12-19T13:52:40.597854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:09.089253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"112'3","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600719+0000","last_change":"2023-12-19T13:52:40.112843+0000","last_active":"2023-12-19T13:52:40.600719+0000","last_peered":"2023-12-19T13:52:40.600719+0000","last_clean":"2023-12-19T13:52:40.600719+0000","last_became_active":"2023-12-19T13:52:40.112277+0000","last_became_peered":"2023-12-19T13:52:40.112277+0000","last_unstale":"2023-12-19T13:52:40.600719+0000","last_undegraded":"2023-12-19T13:52:40.600719+0000","last_fullsized":"2023-12-19T13:52:40.600719+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:31:51.725811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.602907+0000","last_change":"2023-12-19T13:52:40.602254+0000","last_active":"2023-12-19T13:52:40.602907+0000","last_peered":"2023-12-19T13:52:40.602907+0000","last_clean":"2023-12-19T13:52:40.602907+0000","last_became_active":"2023-12-19T13:52:40.601892+0000","last_became_peered":"2023-12-19T13:52:40.601892+0000","last_unstale":"2023-12-19T13:52:40.602907+0000","last_undegraded":"2023-12-19T13:52:40.602907+0000","last_fullsized":"2023-12-19T13:52:40.602907+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:55.696157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"112'6","reported_seq":17,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.606596+0000","last_change":"2023-12-19T13:52:40.103470+0000","last_active":"2023-12-19T13:52:40.606596+0000","last_peered":"2023-12-19T13:52:40.606596+0000","last_clean":"2023-12-19T13:52:40.606596+0000","last_became_active":"2023-12-19T13:52:40.102994+0000","last_became_peered":"2023-12-19T13:52:40.102994+0000","last_unstale":"2023-12-19T13:52:40.606596+0000","last_undegraded":"2023-12-19T13:52:40.606596+0000","last_fullsized":"2023-12-19T13:52:40.606596+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:42.642975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604394+0000","last_change":"2023-12-19T13:52:40.603850+0000","last_active":"2023-12-19T13:52:40.604394+0000","last_peered":"2023-12-19T13:52:40.604394+0000","last_clean":"2023-12-19T13:52:40.604394+0000","last_became_active":"2023-12-19T13:52:40.603191+0000","last_became_peered":"2023-12-19T13:52:40.603191+0000","last_unstale":"2023-12-19T13:52:40.604394+0000","last_undegraded":"2023-12-19T13:52:40.604394+0000","last_fullsized":"2023-12-19T13:52:40.604394+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.606814+0000","last_change":"2023-12-19T13:52:40.104935+0000","last_active":"2023-12-19T13:52:40.606814+0000","last_peered":"2023-12-19T13:52:40.606814+0000","last_clean":"2023-12-19T13:52:40.606814+0000","last_became_active":"2023-12-19T13:52:40.104463+0000","last_became_peered":"2023-12-19T13:52:40.104463+0000","last_unstale":"2023-12-19T13:52:40.606814+0000","last_undegraded":"2023-12-19T13:52:40.606814+0000","last_fullsized":"2023-12-19T13:52:40.606814+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:32.406240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599037+0000","last_change":"2023-12-19T13:52:40.598103+0000","last_active":"2023-12-19T13:52:40.599037+0000","last_peered":"2023-12-19T13:52:40.599037+0000","last_clean":"2023-12-19T13:52:40.599037+0000","last_became_active":"2023-12-19T13:52:40.597617+0000","last_became_peered":"2023-12-19T13:52:40.597617+0000","last_unstale":"2023-12-19T13:52:40.599037+0000","last_undegraded":"2023-12-19T13:52:40.599037+0000","last_fullsized":"2023-12-19T13:52:40.599037+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:37.847464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589163+0000","last_change":"2023-12-19T13:52:40.088998+0000","last_active":"2023-12-19T13:52:40.589163+0000","last_peered":"2023-12-19T13:52:40.589163+0000","last_clean":"2023-12-19T13:52:40.589163+0000","last_became_active":"2023-12-19T13:52:40.088437+0000","last_became_peered":"2023-12-19T13:52:40.088437+0000","last_unstale":"2023-12-19T13:52:40.589163+0000","last_undegraded":"2023-12-19T13:52:40.589163+0000","last_fullsized":"2023-12-19T13:52:40.589163+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604580+0000","last_change":"2023-12-19T13:52:40.602727+0000","last_active":"2023-12-19T13:52:40.604580+0000","last_peered":"2023-12-19T13:52:40.604580+0000","last_clean":"2023-12-19T13:52:40.604580+0000","last_became_active":"2023-12-19T13:52:40.602441+0000","last_became_peered":"2023-12-19T13:52:40.602441+0000","last_unstale":"2023-12-19T13:52:40.604580+0000","last_undegraded":"2023-12-19T13:52:40.604580+0000","last_fullsized":"2023-12-19T13:52:40.604580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:19.408026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588054+0000","last_change":"2023-12-19T13:52:40.115336+0000","last_active":"2023-12-19T13:52:40.588054+0000","last_peered":"2023-12-19T13:52:40.588054+0000","last_clean":"2023-12-19T13:52:40.588054+0000","last_became_active":"2023-12-19T13:52:40.115102+0000","last_became_peered":"2023-12-19T13:52:40.115102+0000","last_unstale":"2023-12-19T13:52:40.588054+0000","last_undegraded":"2023-12-19T13:52:40.588054+0000","last_fullsized":"2023-12-19T13:52:40.588054+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.605879+0000","last_change":"2023-12-19T13:52:40.605813+0000","last_active":"2023-12-19T13:52:40.605879+0000","last_peered":"2023-12-19T13:52:40.605879+0000","last_clean":"2023-12-19T13:52:40.605879+0000","last_became_active":"2023-12-19T13:52:40.605576+0000","last_became_peered":"2023-12-19T13:52:40.605576+0000","last_unstale":"2023-12-19T13:52:40.605879+0000","last_undegraded":"2023-12-19T13:52:40.605879+0000","last_fullsized":"2023-12-19T13:52:40.605879+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"112'8","reported_seq":19,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.609719+0000","last_change":"2023-12-19T13:52:40.114613+0000","last_active":"2023-12-19T13:52:40.609719+0000","last_peered":"2023-12-19T13:52:40.609719+0000","last_clean":"2023-12-19T13:52:40.609719+0000","last_became_active":"2023-12-19T13:52:40.114053+0000","last_became_peered":"2023-12-19T13:52:40.114053+0000","last_unstale":"2023-12-19T13:52:40.609719+0000","last_undegraded":"2023-12-19T13:52:40.609719+0000","last_fullsized":"2023-12-19T13:52:40.609719+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:14.310685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586727+0000","last_change":"2023-12-19T13:52:40.586660+0000","last_active":"2023-12-19T13:52:40.586727+0000","last_peered":"2023-12-19T13:52:40.586727+0000","last_clean":"2023-12-19T13:52:40.586727+0000","last_became_active":"2023-12-19T13:52:40.586370+0000","last_became_peered":"2023-12-19T13:52:40.586370+0000","last_unstale":"2023-12-19T13:52:40.586727+0000","last_undegraded":"2023-12-19T13:52:40.586727+0000","last_fullsized":"2023-12-19T13:52:40.586727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586901+0000","last_change":"2023-12-19T13:52:40.103948+0000","last_active":"2023-12-19T13:52:40.586901+0000","last_peered":"2023-12-19T13:52:40.586901+0000","last_clean":"2023-12-19T13:52:40.586901+0000","last_became_active":"2023-12-19T13:52:40.103624+0000","last_became_peered":"2023-12-19T13:52:40.103624+0000","last_unstale":"2023-12-19T13:52:40.586901+0000","last_undegraded":"2023-12-19T13:52:40.586901+0000","last_fullsized":"2023-12-19T13:52:40.586901+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:19.594522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.591036+0000","last_change":"2023-12-19T13:52:40.590113+0000","last_active":"2023-12-19T13:52:40.591036+0000","last_peered":"2023-12-19T13:52:40.591036+0000","last_clean":"2023-12-19T13:52:40.591036+0000","last_became_active":"2023-12-19T13:52:40.589862+0000","last_became_peered":"2023-12-19T13:52:40.589862+0000","last_unstale":"2023-12-19T13:52:40.591036+0000","last_undegraded":"2023-12-19T13:52:40.591036+0000","last_fullsized":"2023-12-19T13:52:40.591036+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:50:56.389659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599164+0000","last_change":"2023-12-19T13:52:40.099292+0000","last_active":"2023-12-19T13:52:40.599164+0000","last_peered":"2023-12-19T13:52:40.599164+0000","last_clean":"2023-12-19T13:52:40.599164+0000","last_became_active":"2023-12-19T13:52:40.098816+0000","last_became_peered":"2023-12-19T13:52:40.098816+0000","last_unstale":"2023-12-19T13:52:40.599164+0000","last_undegraded":"2023-12-19T13:52:40.599164+0000","last_fullsized":"2023-12-19T13:52:40.599164+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:26.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588099+0000","last_change":"2023-12-19T13:52:40.588010+0000","last_active":"2023-12-19T13:52:40.588099+0000","last_peered":"2023-12-19T13:52:40.588099+0000","last_clean":"2023-12-19T13:52:40.588099+0000","last_became_active":"2023-12-19T13:52:40.587798+0000","last_became_peered":"2023-12-19T13:52:40.587798+0000","last_unstale":"2023-12-19T13:52:40.588099+0000","last_undegraded":"2023-12-19T13:52:40.588099+0000","last_fullsized":"2023-12-19T13:52:40.588099+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:37.419852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.581240+0000","last_change":"2023-12-19T13:52:40.103821+0000","last_active":"2023-12-19T13:52:40.581240+0000","last_peered":"2023-12-19T13:52:40.581240+0000","last_clean":"2023-12-19T13:52:40.581240+0000","last_became_active":"2023-12-19T13:52:40.103362+0000","last_became_peered":"2023-12-19T13:52:40.103362+0000","last_unstale":"2023-12-19T13:52:40.581240+0000","last_undegraded":"2023-12-19T13:52:40.581240+0000","last_fullsized":"2023-12-19T13:52:40.581240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:23.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603409+0000","last_change":"2023-12-19T13:52:40.603087+0000","last_active":"2023-12-19T13:52:40.603409+0000","last_peered":"2023-12-19T13:52:40.603409+0000","last_clean":"2023-12-19T13:52:40.603409+0000","last_became_active":"2023-12-19T13:52:40.602862+0000","last_became_peered":"2023-12-19T13:52:40.602862+0000","last_unstale":"2023-12-19T13:52:40.603409+0000","last_undegraded":"2023-12-19T13:52:40.603409+0000","last_fullsized":"2023-12-19T13:52:40.603409+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:52:14.420403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599108+0000","last_change":"2023-12-19T13:52:40.093874+0000","last_active":"2023-12-19T13:52:40.599108+0000","last_peered":"2023-12-19T13:52:40.599108+0000","last_clean":"2023-12-19T13:52:40.599108+0000","last_became_active":"2023-12-19T13:52:40.093143+0000","last_became_peered":"2023-12-19T13:52:40.093143+0000","last_unstale":"2023-12-19T13:52:40.599108+0000","last_undegraded":"2023-12-19T13:52:40.599108+0000","last_fullsized":"2023-12-19T13:52:40.599108+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:52:45.633843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.601276+0000","last_change":"2023-12-19T13:52:40.600985+0000","last_active":"2023-12-19T13:52:40.601276+0000","last_peered":"2023-12-19T13:52:40.601276+0000","last_clean":"2023-12-19T13:52:40.601276+0000","last_became_active":"2023-12-19T13:52:40.600777+0000","last_became_peered":"2023-12-19T13:52:40.600777+0000","last_unstale":"2023-12-19T13:52:40.601276+0000","last_undegraded":"2023-12-19T13:52:40.601276+0000","last_fullsized":"2023-12-19T13:52:40.601276+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:19.557252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594149+0000","last_change":"2023-12-19T13:52:40.106763+0000","last_active":"2023-12-19T13:52:40.594149+0000","last_peered":"2023-12-19T13:52:40.594149+0000","last_clean":"2023-12-19T13:52:40.594149+0000","last_became_active":"2023-12-19T13:52:40.106379+0000","last_became_peered":"2023-12-19T13:52:40.106379+0000","last_unstale":"2023-12-19T13:52:40.594149+0000","last_undegraded":"2023-12-19T13:52:40.594149+0000","last_fullsized":"2023-12-19T13:52:40.594149+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.603406+0000","last_change":"2023-12-19T13:52:40.602901+0000","last_active":"2023-12-19T13:52:40.603406+0000","last_peered":"2023-12-19T13:52:40.603406+0000","last_clean":"2023-12-19T13:52:40.603406+0000","last_became_active":"2023-12-19T13:52:40.599880+0000","last_became_peered":"2023-12-19T13:52:40.599880+0000","last_unstale":"2023-12-19T13:52:40.603406+0000","last_undegraded":"2023-12-19T13:52:40.603406+0000","last_fullsized":"2023-12-19T13:52:40.603406+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:49.166277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.596213+0000","last_change":"2023-12-19T13:52:40.112335+0000","last_active":"2023-12-19T13:52:40.596213+0000","last_peered":"2023-12-19T13:52:40.596213+0000","last_clean":"2023-12-19T13:52:40.596213+0000","last_became_active":"2023-12-19T13:52:40.112142+0000","last_became_peered":"2023-12-19T13:52:40.112142+0000","last_unstale":"2023-12-19T13:52:40.596213+0000","last_undegraded":"2023-12-19T13:52:40.596213+0000","last_fullsized":"2023-12-19T13:52:40.596213+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:15.392835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597010+0000","last_change":"2023-12-19T13:52:40.596943+0000","last_active":"2023-12-19T13:52:40.597010+0000","last_peered":"2023-12-19T13:52:40.597010+0000","last_clean":"2023-12-19T13:52:40.597010+0000","last_became_active":"2023-12-19T13:52:40.596703+0000","last_became_peered":"2023-12-19T13:52:40.596703+0000","last_unstale":"2023-12-19T13:52:40.597010+0000","last_undegraded":"2023-12-19T13:52:40.597010+0000","last_fullsized":"2023-12-19T13:52:40.597010+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:37.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.581549+0000","last_change":"2023-12-19T13:52:40.109967+0000","last_active":"2023-12-19T13:52:40.581549+0000","last_peered":"2023-12-19T13:52:40.581549+0000","last_clean":"2023-12-19T13:52:40.581549+0000","last_became_active":"2023-12-19T13:52:40.109672+0000","last_became_peered":"2023-12-19T13:52:40.109672+0000","last_unstale":"2023-12-19T13:52:40.581549+0000","last_undegraded":"2023-12-19T13:52:40.581549+0000","last_fullsized":"2023-12-19T13:52:40.581549+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:44:44.945990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.580833+0000","last_change":"2023-12-19T13:52:40.580761+0000","last_active":"2023-12-19T13:52:40.580833+0000","last_peered":"2023-12-19T13:52:40.580833+0000","last_clean":"2023-12-19T13:52:40.580833+0000","last_became_active":"2023-12-19T13:52:40.580406+0000","last_became_peered":"2023-12-19T13:52:40.580406+0000","last_unstale":"2023-12-19T13:52:40.580833+0000","last_undegraded":"2023-12-19T13:52:40.580833+0000","last_fullsized":"2023-12-19T13:52:40.580833+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:32.794419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"112'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604077+0000","last_change":"2023-12-19T13:52:40.107596+0000","last_active":"2023-12-19T13:52:40.604077+0000","last_peered":"2023-12-19T13:52:40.604077+0000","last_clean":"2023-12-19T13:52:40.604077+0000","last_became_active":"2023-12-19T13:52:40.106859+0000","last_became_peered":"2023-12-19T13:52:40.106859+0000","last_unstale":"2023-12-19T13:52:40.604077+0000","last_undegraded":"2023-12-19T13:52:40.604077+0000","last_fullsized":"2023-12-19T13:52:40.604077+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:04.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588449+0000","last_change":"2023-12-19T13:52:40.587557+0000","last_active":"2023-12-19T13:52:40.588449+0000","last_peered":"2023-12-19T13:52:40.588449+0000","last_clean":"2023-12-19T13:52:40.588449+0000","last_became_active":"2023-12-19T13:52:40.587422+0000","last_became_peered":"2023-12-19T13:52:40.587422+0000","last_unstale":"2023-12-19T13:52:40.588449+0000","last_undegraded":"2023-12-19T13:52:40.588449+0000","last_fullsized":"2023-12-19T13:52:40.588449+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:26.216347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"113'1","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-12-19T13:52:42.471327+0000","last_change":"2023-12-19T13:52:40.110640+0000","last_active":"2023-12-19T13:52:42.471327+0000","last_peered":"2023-12-19T13:52:42.471327+0000","last_clean":"2023-12-19T13:52:42.471327+0000","last_became_active":"2023-12-19T13:52:40.109548+0000","last_became_peered":"2023-12-19T13:52:40.109548+0000","last_unstale":"2023-12-19T13:52:42.471327+0000","last_undegraded":"2023-12-19T13:52:42.471327+0000","last_fullsized":"2023-12-19T13:52:42.471327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:42.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.597476+0000","last_change":"2023-12-19T13:52:40.597241+0000","last_active":"2023-12-19T13:52:40.597476+0000","last_peered":"2023-12-19T13:52:40.597476+0000","last_clean":"2023-12-19T13:52:40.597476+0000","last_became_active":"2023-12-19T13:52:40.596892+0000","last_became_peered":"2023-12-19T13:52:40.596892+0000","last_unstale":"2023-12-19T13:52:40.597476+0000","last_undegraded":"2023-12-19T13:52:40.597476+0000","last_fullsized":"2023-12-19T13:52:40.597476+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:01:53.994030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586327+0000","last_change":"2023-12-19T13:52:40.111068+0000","last_active":"2023-12-19T13:52:40.586327+0000","last_peered":"2023-12-19T13:52:40.586327+0000","last_clean":"2023-12-19T13:52:40.586327+0000","last_became_active":"2023-12-19T13:52:40.110835+0000","last_became_peered":"2023-12-19T13:52:40.110835+0000","last_unstale":"2023-12-19T13:52:40.586327+0000","last_undegraded":"2023-12-19T13:52:40.586327+0000","last_fullsized":"2023-12-19T13:52:40.586327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:53.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.600403+0000","last_change":"2023-12-19T13:52:40.600336+0000","last_active":"2023-12-19T13:52:40.600403+0000","last_peered":"2023-12-19T13:52:40.600403+0000","last_clean":"2023-12-19T13:52:40.600403+0000","last_became_active":"2023-12-19T13:52:40.599947+0000","last_became_peered":"2023-12-19T13:52:40.599947+0000","last_unstale":"2023-12-19T13:52:40.600403+0000","last_undegraded":"2023-12-19T13:52:40.600403+0000","last_fullsized":"2023-12-19T13:52:40.600403+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:54.653396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.592749+0000","last_change":"2023-12-19T13:52:40.111351+0000","last_active":"2023-12-19T13:52:40.592749+0000","last_peered":"2023-12-19T13:52:40.592749+0000","last_clean":"2023-12-19T13:52:40.592749+0000","last_became_active":"2023-12-19T13:52:40.111135+0000","last_became_peered":"2023-12-19T13:52:40.111135+0000","last_unstale":"2023-12-19T13:52:40.592749+0000","last_undegraded":"2023-12-19T13:52:40.592749+0000","last_fullsized":"2023-12-19T13:52:40.592749+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:08.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590641+0000","last_change":"2023-12-19T13:52:40.589913+0000","last_active":"2023-12-19T13:52:40.590641+0000","last_peered":"2023-12-19T13:52:40.590641+0000","last_clean":"2023-12-19T13:52:40.590641+0000","last_became_active":"2023-12-19T13:52:40.589696+0000","last_became_peered":"2023-12-19T13:52:40.589696+0000","last_unstale":"2023-12-19T13:52:40.590641+0000","last_undegraded":"2023-12-19T13:52:40.590641+0000","last_fullsized":"2023-12-19T13:52:40.590641+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.589334+0000","last_change":"2023-12-19T13:52:40.108868+0000","last_active":"2023-12-19T13:52:40.589334+0000","last_peered":"2023-12-19T13:52:40.589334+0000","last_clean":"2023-12-19T13:52:40.589334+0000","last_became_active":"2023-12-19T13:52:40.108635+0000","last_became_peered":"2023-12-19T13:52:40.108635+0000","last_unstale":"2023-12-19T13:52:40.589334+0000","last_undegraded":"2023-12-19T13:52:40.589334+0000","last_fullsized":"2023-12-19T13:52:40.589334+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:18.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.604413+0000","last_change":"2023-12-19T13:52:40.603992+0000","last_active":"2023-12-19T13:52:40.604413+0000","last_peered":"2023-12-19T13:52:40.604413+0000","last_clean":"2023-12-19T13:52:40.604413+0000","last_became_active":"2023-12-19T13:52:40.603482+0000","last_became_peered":"2023-12-19T13:52:40.603482+0000","last_unstale":"2023-12-19T13:52:40.604413+0000","last_undegraded":"2023-12-19T13:52:40.604413+0000","last_fullsized":"2023-12-19T13:52:40.604413+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:55.571339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.588138+0000","last_change":"2023-12-19T13:52:40.114680+0000","last_active":"2023-12-19T13:52:40.588138+0000","last_peered":"2023-12-19T13:52:40.588138+0000","last_clean":"2023-12-19T13:52:40.588138+0000","last_became_active":"2023-12-19T13:52:40.113789+0000","last_became_peered":"2023-12-19T13:52:40.113789+0000","last_unstale":"2023-12-19T13:52:40.588138+0000","last_undegraded":"2023-12-19T13:52:40.588138+0000","last_fullsized":"2023-12-19T13:52:40.588138+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:20.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.590498+0000","last_change":"2023-12-19T13:52:40.589398+0000","last_active":"2023-12-19T13:52:40.590498+0000","last_peered":"2023-12-19T13:52:40.590498+0000","last_clean":"2023-12-19T13:52:40.590498+0000","last_became_active":"2023-12-19T13:52:40.589194+0000","last_became_peered":"2023-12-19T13:52:40.589194+0000","last_unstale":"2023-12-19T13:52:40.590498+0000","last_undegraded":"2023-12-19T13:52:40.590498+0000","last_fullsized":"2023-12-19T13:52:40.590498+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:54.613121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.574502+0000","last_change":"2023-12-19T13:52:40.113228+0000","last_active":"2023-12-19T13:52:40.574502+0000","last_peered":"2023-12-19T13:52:40.574502+0000","last_clean":"2023-12-19T13:52:40.574502+0000","last_became_active":"2023-12-19T13:52:40.112593+0000","last_became_peered":"2023-12-19T13:52:40.112593+0000","last_unstale":"2023-12-19T13:52:40.574502+0000","last_undegraded":"2023-12-19T13:52:40.574502+0000","last_fullsized":"2023-12-19T13:52:40.574502+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:09.700259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.594932+0000","last_change":"2023-12-19T13:52:40.594866+0000","last_active":"2023-12-19T13:52:40.594932+0000","last_peered":"2023-12-19T13:52:40.594932+0000","last_clean":"2023-12-19T13:52:40.594932+0000","last_became_active":"2023-12-19T13:52:40.594652+0000","last_became_peered":"2023-12-19T13:52:40.594652+0000","last_unstale":"2023-12-19T13:52:40.594932+0000","last_undegraded":"2023-12-19T13:52:40.594932+0000","last_fullsized":"2023-12-19T13:52:40.594932+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:43.652108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586411+0000","last_change":"2023-12-19T13:52:40.102645+0000","last_active":"2023-12-19T13:52:40.586411+0000","last_peered":"2023-12-19T13:52:40.586411+0000","last_clean":"2023-12-19T13:52:40.586411+0000","last_became_active":"2023-12-19T13:52:40.097556+0000","last_became_peered":"2023-12-19T13:52:40.097556+0000","last_unstale":"2023-12-19T13:52:40.586411+0000","last_undegraded":"2023-12-19T13:52:40.586411+0000","last_fullsized":"2023-12-19T13:52:40.586411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:54.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.599829+0000","last_change":"2023-12-19T13:52:40.599549+0000","last_active":"2023-12-19T13:52:40.599829+0000","last_peered":"2023-12-19T13:52:40.599829+0000","last_clean":"2023-12-19T13:52:40.599829+0000","last_became_active":"2023-12-19T13:52:40.599318+0000","last_became_peered":"2023-12-19T13:52:40.599318+0000","last_unstale":"2023-12-19T13:52:40.599829+0000","last_undegraded":"2023-12-19T13:52:40.599829+0000","last_fullsized":"2023-12-19T13:52:40.599829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:40.074447+0000","last_clean_scrub_stamp":"2023-12-19T13:52:40.074447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:39:23.216524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"112'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.586985+0000","last_change":"2023-12-19T13:52:40.101203+0000","last_active":"2023-12-19T13:52:40.586985+0000","last_peered":"2023-12-19T13:52:40.586985+0000","last_clean":"2023-12-19T13:52:40.586985+0000","last_became_active":"2023-12-19T13:52:40.100476+0000","last_became_peered":"2023-12-19T13:52:40.100476+0000","last_unstale":"2023-12-19T13:52:40.586985+0000","last_undegraded":"2023-12-19T13:52:40.586985+0000","last_fullsized":"2023-12-19T13:52:40.586985+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:52:39.065314+0000","last_clean_scrub_stamp":"2023-12-19T13:52:39.065314+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:05:49.482529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":252,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-12-19T13:52:40.574076+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:52:40.574076+0000","last_peered":"2023-12-19T13:52:40.574076+0000","last_clean":"2023-12-19T13:52:40.574076+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:52:40.574076+0000","last_undegraded":"2023-12-19T13:52:40.574076+0000","last_fullsized":"2023-12-19T13:52:40.574076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":607,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194705,"statfs":{"total":200000000,"available":199378407,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0920000000000001,"15min":1.028},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6279999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.0860000000000001,"15min":1.01},"min":{"1min":0.77600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4059999999999999,"5min":1.7190000000000001,"15min":2.008},"last":1.3899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.153,"15min":1.0940000000000001},"min":{"1min":0.66000000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5960000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.296},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1200000000000001,"15min":1.054},"min":{"1min":0.751,"5min":0.497,"15min":0.497},"max":{"1min":1.5409999999999999,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.728}]},{"osd":2,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.149,"15min":1.1359999999999999},"min":{"1min":0.76400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5569999999999999,"5min":1.7330000000000001,"15min":1.7929999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.244,"5min":1.2050000000000001,"15min":1.159},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6499999999999999,"5min":1.871,"15min":1.8720000000000001},"last":1.421}]},{"osd":3,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2310000000000001,"15min":1.1679999999999999},"min":{"1min":0.96199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.399,"5min":1.931,"15min":1.931},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.3180000000000001,"15min":1.252},"min":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.6150000000000002,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.603}]},{"osd":4,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.26,"15min":1.2789999999999999},"min":{"1min":0.98699999999999999,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":1.506,"5min":1.6739999999999999,"15min":2.181},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3460000000000001,"15min":1.3839999999999999},"min":{"1min":0.86199999999999999,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":1.7070000000000001,"5min":2.2109999999999999,"15min":2.6909999999999998},"last":1.3460000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.258,"15min":1.228},"min":{"1min":0.86299999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5289999999999999,"5min":1.956,"15min":1.956},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.415,"15min":1.423},"min":{"1min":1.2250000000000001,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":1.841,"5min":2.024,"15min":2.2629999999999999},"last":1.4510000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:52:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.369,"15min":1.2869999999999999},"min":{"1min":1.012,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6739999999999999,"5min":2.024,"15min":2.024},"last":1.647},{"interface":"front","average":{"1min":1.506,"5min":1.5109999999999999,"15min":1.4890000000000001},"min":{"1min":1.3720000000000001,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":1.6759999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.7749999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":607,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194704,"statfs":{"total":200000000,"available":199377805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.66100000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6220000000000001,"5min":1.679,"15min":2.0640000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.079,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.631,"5min":1.631,"15min":3.2069999999999999},"last":1.286}]},{"osd":1,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.071,"15min":1.0369999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.405,"5min":1.619,"15min":1.962},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.143,"5min":1.139,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5029999999999999,"5min":1.5860000000000001,"15min":1.6279999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2609999999999999,"15min":1.2270000000000001},"min":{"1min":0.93600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7310000000000001,"5min":1.798,"15min":1.8180000000000001},"last":1.012},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2569999999999999,"15min":1.179},"min":{"1min":0.80200000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6319999999999999,"5min":1.802,"15min":1.802},"last":1.5649999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.331},"min":{"1min":0.84699999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2410000000000001,"15min":1.2629999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.67900000000000005},"max":{"1min":1.819,"5min":1.8799999999999999,"15min":4.3899999999999997},"last":0.95899999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2969999999999999,"15min":1.2270000000000001},"min":{"1min":0.64500000000000002,"5min":0.56100000000000005,"15min":0.47899999999999998},"max":{"1min":1.798,"5min":1.865,"15min":1.865},"last":1.101},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.367,"15min":1.3109999999999999},"min":{"1min":0.96399999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7170000000000001,"5min":1.895,"15min":1.895},"last":1.611}]},{"osd":5,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3149999999999999,"15min":1.2609999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.865,"5min":1.962,"15min":1.962},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.423,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.865,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.454,"15min":1.4279999999999999},"min":{"1min":0.91500000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.944,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.736},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4299999999999999,"15min":1.3720000000000001},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.57999999999999996},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.161}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1185,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194127,"statfs":{"total":200000000,"available":198786511,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.038,"15min":0.997},"min":{"1min":0.71999999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6839999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.155,"15min":1.095},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6669999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.72}]},{"osd":1,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.155,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.23,"5min":1.155,"15min":1.0469999999999999},"min":{"1min":0.95899999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5980000000000001,"5min":2.077,"15min":2.077},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2370000000000001,"15min":1.2569999999999999},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5609999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.268},"min":{"1min":0.88700000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7849999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.5569999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3240000000000001,"15min":1.242},"min":{"1min":1.0149999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8360000000000001,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.2829999999999999,"15min":1.2549999999999999},"min":{"1min":1.099,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.94799999999999995}]},{"osd":4,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.1519999999999999},"min":{"1min":0.91000000000000003,"5min":0.79400000000000004,"15min":0.77600000000000002},"max":{"1min":1.484,"5min":1.982,"15min":1.982},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.3799999999999999,"15min":1.3109999999999999},"min":{"1min":0.71399999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7969999999999999,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.804}]},{"osd":6,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3779999999999999,"15min":1.3280000000000001},"min":{"1min":0.97499999999999998,"5min":0.94099999999999995,"15min":0.623},"max":{"1min":1.853,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.821},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3500000000000001,"15min":1.367},"min":{"1min":0.84599999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6970000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.7689999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4330000000000001},"min":{"1min":1.1399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.891,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.956},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5029999999999999,"15min":1.429},"min":{"1min":1.2729999999999999,"5min":0.96099999999999997,"15min":0.82099999999999995},"max":{"1min":1.968,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":2.1070000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":606,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194705,"statfs":{"total":200000000,"available":199378443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0369999999999999,"15min":1.0029999999999999},"min":{"1min":0.66200000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5569999999999999,"5min":1.657,"15min":1.657},"last":1.022},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.121},"min":{"1min":0.73599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4850000000000001,"5min":1.6020000000000001,"15min":2.016},"last":1.5529999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.85099999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6060000000000001,"5min":1.621,"15min":1.621},"last":1.661},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7969999999999999,"5min":1.887,"15min":1.887},"last":1.1419999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.145,"15min":1.046},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.629},"max":{"1min":1.4730000000000001,"5min":1.704,"15min":1.704},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.75,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.4199999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2230000000000001,"15min":1.2150000000000001},"min":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6779999999999999,"5min":1.8360000000000001,"15min":1.952},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.284,"15min":1.2829999999999999},"min":{"1min":0.91200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.5089999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2170000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3420000000000001},"min":{"1min":0.90100000000000002,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":2.306,"5min":2.306,"15min":2.3570000000000002},"last":1.379}]},{"osd":6,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.343,"15min":1.395},"min":{"1min":0.94999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.3839999999999999,"15min":1.458},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.76200000000000001},"max":{"1min":2.278,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.5920000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4670000000000001,"15min":1.466},"min":{"1min":0.872,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.677,"5min":1.52,"15min":1.528},"min":{"1min":0.998,"5min":0.68600000000000005,"15min":0.59999999999999998},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.8169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":607,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194704,"statfs":{"total":200000000,"available":199377803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54200000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.272,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.89200000000000002,"15min":0.95999999999999996},"min":{"1min":0.63,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.365,"5min":1.502,"15min":3.0670000000000002},"last":1.486}]},{"osd":1,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.98499999999999999},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3320000000000001,"5min":1.508,"15min":5.3769999999999998},"last":1.048},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92500000000000004,"15min":0.98099999999999998},"min":{"1min":0.60999999999999999,"5min":0.39900000000000002,"15min":0.36499999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":2.387},"last":1.1879999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98599999999999999,"15min":1.0329999999999999},"min":{"1min":0.59999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.4770000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.002,"15min":1.1120000000000001},"min":{"1min":0.57399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4770000000000001,"5min":1.8620000000000001,"15min":2.657},"last":1.3700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2030000000000001,"15min":1.2609999999999999},"min":{"1min":1.0389999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.718,"15min":3.0070000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2170000000000001,"15min":1.2330000000000001},"min":{"1min":0.998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.835,"5min":1.835,"15min":2.7690000000000001},"last":1.4550000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.2350000000000001,"15min":1.2989999999999999},"min":{"1min":0.97499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.679,"5min":1.7030000000000001,"15min":2.7309999999999999},"last":1.518},{"interface":"front","average":{"1min":1.21,"5min":1.214,"15min":1.262},"min":{"1min":0.96599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4630000000000001,"5min":1.671,"15min":3.5249999999999999},"last":1.534}]},{"osd":6,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.248,"15min":1.3},"min":{"1min":0.91900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5649999999999999,"5min":1.899,"15min":2.9769999999999999},"last":1.647},{"interface":"front","average":{"1min":1.389,"5min":1.3049999999999999,"15min":1.343},"min":{"1min":1.1599999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7609999999999999,"5min":1.9730000000000001,"15min":2.698},"last":1.593}]},{"osd":7,"last update":"Tue Dec 19 13:52:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.302,"15min":1.3640000000000001},"min":{"1min":0.88100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":1.8,"15min":3.609},"last":1.421},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.369,"15min":1.3939999999999999},"min":{"1min":1.081,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7829999999999999,"5min":2.0910000000000002,"15min":3.0379999999999998},"last":1.8500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":606,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194705,"statfs":{"total":200000000,"available":199378477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.254,"5min":1.544,"15min":2.258},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.999,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6539999999999999,"5min":11.85,"15min":11.85},"last":1.087}]},{"osd":1,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.5469999999999999,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0860000000000001,"15min":0.94799999999999995},"min":{"1min":0.50700000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3160000000000001,"5min":11.788,"15min":11.788},"last":0.93400000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.96299999999999997,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.413,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":0.872},{"interface":"front","average":{"1min":1.069,"5min":1.083,"15min":1.036},"min":{"1min":0.67600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.53,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.119}]},{"osd":4,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.335,"15min":1.1850000000000001},"min":{"1min":0.93100000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.6839999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.2170000000000001,"15min":1.2230000000000001},"min":{"1min":0.89400000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":2.2189999999999999},"last":0.99299999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.421,"15min":1.2529999999999999},"min":{"1min":1.1040000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.748,"5min":11.888,"15min":11.888},"last":1.579},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3109999999999999,"15min":1.3089999999999999},"min":{"1min":0.85199999999999998,"5min":0.76700000000000002,"15min":0.68899999999999995},"max":{"1min":1.738,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2889999999999999,"15min":1.3100000000000001},"min":{"1min":0.97399999999999998,"5min":0.754,"15min":0.72399999999999998},"max":{"1min":1.6739999999999999,"5min":2.0640000000000001,"15min":2.964},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3089999999999999,"15min":1.264},"min":{"1min":0.98599999999999999,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.6479999999999999,"5min":1.944,"15min":2.286},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8009999999999999,"5min":2.0369999999999999,"15min":2.351},"last":1.266},{"interface":"front","average":{"1min":1.383,"5min":1.4379999999999999,"15min":1.3029999999999999},"min":{"1min":1.0289999999999999,"5min":0.77100000000000002,"15min":0.75600000000000001},"max":{"1min":1.7729999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.6739999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1183,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194128,"statfs":{"total":200000000,"available":198788019,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95399999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5369999999999999,"5min":2.351,"15min":3.3500000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":1.0649999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4570000000000001,"5min":1.466,"15min":5.2999999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.137,"5min":1.1259999999999999,"15min":1.1779999999999999},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.764,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.6759999999999999,"5min":1.6899999999999999,"15min":3.4300000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.014,"15min":1.169},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.706,"5min":1.706,"15min":7.157},"last":0.66900000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.163,"15min":1.2230000000000001},"min":{"1min":0.77800000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.266,"15min":1.2989999999999999},"min":{"1min":0.88700000000000001,"5min":0.79100000000000004,"15min":0.72799999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":0.92100000000000004}]},{"osd":5,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2509999999999999,"15min":1.323},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.4019999999999999,"15min":1.3759999999999999},"min":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9870000000000001,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.1379999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.339,"15min":1.353},"min":{"1min":0.74199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3220000000000001,"15min":1.415},"min":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.77300000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":3.786},"last":0.93799999999999994}]},{"osd":7,"last update":"Tue Dec 19 13:52:28 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.3819999999999999,"15min":1.4490000000000001},"min":{"1min":0.872,"5min":0.84799999999999998,"15min":0.78400000000000003},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.337,"15min":1.448},"min":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.095}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":608,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194703,"statfs":{"total":200000000,"available":199376891,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.63700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4390000000000001,"5min":1.5820000000000001,"15min":1.6399999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.03,"15min":0.95899999999999996},"min":{"1min":0.57699999999999996,"5min":0.373,"15min":0.373},"max":{"1min":1.766,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2769999999999999,"15min":1.004},"min":{"1min":0.80200000000000005,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.845,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.478,"15min":1.1000000000000001},"min":{"1min":0.63400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.056,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.80600000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.88300000000000001,"15min":1.006},"min":{"1min":0.75800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.619,"5min":1.619,"15min":4.4530000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.071,"15min":1.103},"min":{"1min":0.77900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.77800000000000002}]},{"osd":4,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.1659999999999999,"15min":1.2110000000000001},"min":{"1min":0.97899999999999998,"5min":0.746,"15min":0.746},"max":{"1min":1.917,"5min":1.917,"15min":4.4269999999999996},"last":1.052},{"interface":"front","average":{"1min":1.393,"5min":1.403,"15min":1.23},"min":{"1min":1.0429999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1099999999999999,"5min":15.766,"15min":15.766},"last":1.256}]},{"osd":5,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3879999999999999,"15min":1.234},"min":{"1min":0.93500000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4569999999999999,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.484},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2549999999999999,"15min":1.2869999999999999},"min":{"1min":0.98699999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3119999999999998,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.6499999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.3799999999999999,"15min":1.28},"min":{"1min":1.2150000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.242,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.625},{"interface":"front","average":{"1min":1.504,"5min":1.522,"15min":1.3400000000000001},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.5489999999999999,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.5109999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4950000000000001,"15min":1.345},"min":{"1min":1.002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3530000000000002,"5min":14.381,"15min":14.381},"last":1.069},{"interface":"front","average":{"1min":1.53,"5min":1.4079999999999999,"15min":1.4059999999999999},"min":{"1min":1.1160000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3879999999999999,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":0.89900000000000002}]}]}],"pool_statfs":[]}} 2023-12-19T13:52:50.474 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:52:50.474 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:52:50.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.740+0000 7fec963d0640 1 Processor -- start 2023-12-19T13:52:50.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.740+0000 7fec963d0640 1 -- start start 2023-12-19T13:52:50.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.742+0000 7fec963d0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fec9015da00 0x7fec900d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.742+0000 7fec963d0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec900659d0 0x7fec90065df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.742+0000 7fec963d0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec90066330 con 0x7fec900b8500 2023-12-19T13:52:50.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.742+0000 7fec963d0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9006fc40 con 0x7fec900659d0 2023-12-19T13:52:50.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.742+0000 7fec963d0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec900b88e0 con 0x7fec9015da00 2023-12-19T13:52:50.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec9496d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec900659d0 0x7fec90065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec9496d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec900659d0 0x7fec90065df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36416/0 (socket says 172.21.15.113:36416) 2023-12-19T13:52:50.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec9496d640 1 -- 172.21.15.113:0/2320300537 learned_addr learned my addr 172.21.15.113:0/2320300537 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:50.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec8f7fe640 1 --2- 172.21.15.113:0/2320300537 >> v2:172.21.15.151:3300/0 conn(0x7fec9015da00 0x7fec900d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec9496d640 1 -- 172.21.15.113:0/2320300537 >> v2:172.21.15.151:3300/0 conn(0x7fec9015da00 msgr2=0x7fec900d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:50.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec9496d640 1 --2- 172.21.15.113:0/2320300537 >> v2:172.21.15.151:3300/0 conn(0x7fec9015da00 0x7fec900d4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec9496d640 1 -- 172.21.15.113:0/2320300537 >> v1:172.21.15.113:6789/0 conn(0x7fec900b8500 legacy=0x7fec9006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec9496d640 1 -- 172.21.15.113:0/2320300537 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9015df50 con 0x7fec900659d0 2023-12-19T13:52:50.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.743+0000 7fec8effd640 1 -- 172.21.15.113:0/2320300537 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397640573 0 0) 0x7fec90066330 con 0x7fec900b8500 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.744+0000 7fec9496d640 1 --2- 172.21.15.113:0/2320300537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec900659d0 0x7fec90065df0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fec900b1c10 tx=0x7fec8802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286bc5ad554f57c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec8effd640 1 -- 172.21.15.113:0/2320300537 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8802ca80 con 0x7fec900659d0 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec8effd640 1 -- 172.21.15.113:0/2320300537 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8802cbe0 con 0x7fec900659d0 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec8effd640 1 -- 172.21.15.113:0/2320300537 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880343f0 con 0x7fec900659d0 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 -- 172.21.15.113:0/2320300537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec900659d0 msgr2=0x7fec90065df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 --2- 172.21.15.113:0/2320300537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec900659d0 0x7fec90065df0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fec900b1c10 tx=0x7fec8802bee0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 -- 172.21.15.113:0/2320300537 shutdown_connections 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 --2- 172.21.15.113:0/2320300537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec900659d0 0x7fec90065df0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 --2- 172.21.15.113:0/2320300537 >> v2:172.21.15.151:3300/0 conn(0x7fec9015da00 0x7fec900d4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 -- 172.21.15.113:0/2320300537 >> 172.21.15.113:0/2320300537 conn(0x7fec900b4120 msgr2=0x7fec900b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:50.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 -- 172.21.15.113:0/2320300537 shutdown_connections 2023-12-19T13:52:50.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.745+0000 7fec963d0640 1 -- 172.21.15.113:0/2320300537 wait complete. 2023-12-19T13:52:50.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.747+0000 7fec963d0640 1 Processor -- start 2023-12-19T13:52:50.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.747+0000 7fec963d0640 1 -- start start 2023-12-19T13:52:50.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec963d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec900659d0 0x7fec90152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec963d0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec900b8500 0x7fec9015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec963d0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec9015da00 0x7fec90153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec963d0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90153100 con 0x7fec9015da00 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec963d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9015ae60 con 0x7fec900659d0 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec963d0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9015b140 con 0x7fec900b8500 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec9496d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec9015da00 0x7fec90153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec9496d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec9015da00 0x7fec90153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36426/0 (socket says 172.21.15.113:36426) 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.748+0000 7fec9496d640 1 -- 172.21.15.113:0/4009049843 learned_addr learned my addr 172.21.15.113:0/4009049843 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.749+0000 7fec8ffff640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec900659d0 0x7fec90152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.749+0000 7fec9496d640 1 -- 172.21.15.113:0/4009049843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec900b8500 msgr2=0x7fec9015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.749+0000 7fec9496d640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec900b8500 0x7fec9015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.749+0000 7fec9496d640 1 -- 172.21.15.113:0/4009049843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec900659d0 msgr2=0x7fec90152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.749+0000 7fec9496d640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec900659d0 0x7fec90152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:50.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.749+0000 7fec9496d640 1 -- 172.21.15.113:0/4009049843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88009b30 con 0x7fec9015da00 2023-12-19T13:52:50.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.749+0000 7fec9496d640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec9015da00 0x7fec90153af0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fec88036040 tx=0x7fec88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:50.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.750+0000 7fec8cff9640 1 -- 172.21.15.113:0/4009049843 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88009510 con 0x7fec9015da00 2023-12-19T13:52:50.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.750+0000 7fec8cff9640 1 -- 172.21.15.113:0/4009049843 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8803e450 con 0x7fec9015da00 2023-12-19T13:52:50.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.750+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9015b420 con 0x7fec9015da00 2023-12-19T13:52:50.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.750+0000 7fec8cff9640 1 -- 172.21.15.113:0/4009049843 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8803e800 con 0x7fec9015da00 2023-12-19T13:52:50.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.750+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9015b9e0 con 0x7fec9015da00 2023-12-19T13:52:50.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.751+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec90061910 con 0x7fec9015da00 2023-12-19T13:52:50.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.752+0000 7fec8cff9640 1 -- 172.21.15.113:0/4009049843 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fec8802cd50 con 0x7fec9015da00 2023-12-19T13:52:50.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.753+0000 7fec8cff9640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec7c06a430 0x7fec7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:50.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.753+0000 7fec8cff9640 1 -- 172.21.15.113:0/4009049843 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec880ab4d0 con 0x7fec9015da00 2023-12-19T13:52:50.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.753+0000 7fec8ffff640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec7c06a430 0x7fec7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:50.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.754+0000 7fec8ffff640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec7c06a430 0x7fec7c06c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fec80007fd0 tx=0x7fec80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:50.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:50.757+0000 7fec8cff9640 1 -- 172.21.15.113:0/4009049843 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fec88076a20 con 0x7fec9015da00 2023-12-19T13:52:51.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.019+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fec900d3910 con 0x7fec9015da00 2023-12-19T13:52:51.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.027+0000 7fec8cff9640 1 -- 172.21.15.113:0/4009049843 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fec8807a040 con 0x7fec9015da00 2023-12-19T13:52:51.027 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:52:51.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec7c06a430 msgr2=0x7fec7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:51.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec7c06a430 0x7fec7c06c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fec80007fd0 tx=0x7fec80009040 comp rx=0 tx=0).stop 2023-12-19T13:52:51.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec9015da00 msgr2=0x7fec90153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:51.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec9015da00 0x7fec90153af0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fec88036040 tx=0x7fec88004a40 comp rx=0 tx=0).stop 2023-12-19T13:52:51.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 shutdown_connections 2023-12-19T13:52:51.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec7c06a430 0x7fec7c06c8f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec9015da00 0x7fec90153af0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec900b8500 0x7fec9015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 --2- 172.21.15.113:0/4009049843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec900659d0 0x7fec90152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.030+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 >> 172.21.15.113:0/4009049843 conn(0x7fec900b4120 msgr2=0x7fec9015eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:51.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.031+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 shutdown_connections 2023-12-19T13:52:51.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.031+0000 7fec963d0640 1 -- 172.21.15.113:0/4009049843 wait complete. 2023-12-19T13:52:51.049 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:51.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.262+0000 7ff5dee22640 1 Processor -- start 2023-12-19T13:52:51.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.262+0000 7ff5dee22640 1 -- start start 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dee22640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5d8159f80 0x7ff5d806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dee22640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff5d815b1e0 0x7ff5d815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dee22640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d806b520 con 0x7ff5d815a8a0 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dee22640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d80b2b20 con 0x7ff5d815b1e0 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dee22640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d80b2fb0 con 0x7ff5d8159f80 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dd61f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff5d815b1e0 0x7ff5d815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dd61f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff5d815b1e0 0x7ff5d815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36440/0 (socket says 172.21.15.113:36440) 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1851028320 learned_addr learned my addr 172.21.15.113:0/1851028320 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dde20640 1 --2- 172.21.15.113:0/1851028320 >> v2:172.21.15.151:3300/0 conn(0x7ff5d8159f80 0x7ff5d806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1851028320 >> v2:172.21.15.151:3300/0 conn(0x7ff5d8159f80 msgr2=0x7ff5d806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:51.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dd61f640 1 --2- 172.21.15.113:0/1851028320 >> v2:172.21.15.151:3300/0 conn(0x7ff5d8159f80 0x7ff5d806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1851028320 >> v1:172.21.15.151:6789/0 conn(0x7ff5d815a8a0 legacy=0x7ff5d815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:51.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.264+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1851028320 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80b1f10 con 0x7ff5d815b1e0 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dd61f640 1 --2- 172.21.15.113:0/1851028320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815b1e0 0x7ff5d815a360 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80b3230 tx=0x7ff5c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ec8b10a38e65d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dce1e640 1 -- 172.21.15.113:0/1851028320 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8030860 con 0x7ff5d815b1e0 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dce1e640 1 -- 172.21.15.113:0/1851028320 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c80309c0 con 0x7ff5d815b1e0 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dce1e640 1 -- 172.21.15.113:0/1851028320 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8030d50 con 0x7ff5d815b1e0 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dee22640 1 -- 172.21.15.113:0/1851028320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815b1e0 msgr2=0x7ff5d815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1851028320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815b1e0 0x7ff5d815a360 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80b3230 tx=0x7ff5c802b9a0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dee22640 1 -- 172.21.15.113:0/1851028320 shutdown_connections 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1851028320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815b1e0 0x7ff5d815a360 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1851028320 >> v2:172.21.15.151:3300/0 conn(0x7ff5d8159f80 0x7ff5d806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.266+0000 7ff5dee22640 1 -- 172.21.15.113:0/1851028320 >> 172.21.15.113:0/1851028320 conn(0x7ff5d80b0100 msgr2=0x7ff5d80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:51.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.267+0000 7ff5dee22640 1 -- 172.21.15.113:0/1851028320 shutdown_connections 2023-12-19T13:52:51.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.267+0000 7ff5dee22640 1 -- 172.21.15.113:0/1851028320 wait complete. 2023-12-19T13:52:51.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.268+0000 7ff5dee22640 1 Processor -- start 2023-12-19T13:52:51.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.268+0000 7ff5dee22640 1 -- start start 2023-12-19T13:52:51.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.269+0000 7ff5dee22640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5d8159f80 0x7ff5d81f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:51.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.269+0000 7ff5dee22640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815a8a0 0x7ff5d81f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.269+0000 7ff5dee22640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5d815b1e0 0x7ff5d8158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.269+0000 7ff5dee22640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80cc370 con 0x7ff5d815a8a0 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.269+0000 7ff5dee22640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d81f1cf0 con 0x7ff5d815b1e0 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.269+0000 7ff5dee22640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8158c40 con 0x7ff5d8159f80 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815a8a0 0x7ff5d81f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815a8a0 0x7ff5d81f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36454/0 (socket says 172.21.15.113:36454) 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1700058081 learned_addr learned my addr 172.21.15.113:0/1700058081 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1700058081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5d8159f80 msgr2=0x7ff5d81f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5d8159f80 0x7ff5d81f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1700058081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5d815b1e0 msgr2=0x7ff5d8158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5de621640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5d815b1e0 0x7ff5d8158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5d815b1e0 0x7ff5d8158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 -- 172.21.15.113:0/1700058081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80094d0 con 0x7ff5d815a8a0 2023-12-19T13:52:51.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.270+0000 7ff5dd61f640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815a8a0 0x7ff5d81f17b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000c00 tx=0x7ff5c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:51.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.271+0000 7ff5ce7fc640 1 -- 172.21.15.113:0/1700058081 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8030830 con 0x7ff5d815a8a0 2023-12-19T13:52:51.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.271+0000 7ff5ce7fc640 1 -- 172.21.15.113:0/1700058081 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8039d90 con 0x7ff5d815a8a0 2023-12-19T13:52:51.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.271+0000 7ff5ce7fc640 1 -- 172.21.15.113:0/1700058081 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8043630 con 0x7ff5d815a8a0 2023-12-19T13:52:51.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.271+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d8157150 con 0x7ff5d815a8a0 2023-12-19T13:52:51.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.271+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d8157710 con 0x7ff5d815a8a0 2023-12-19T13:52:51.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.272+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d8061910 con 0x7ff5d815a8a0 2023-12-19T13:52:51.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.273+0000 7ff5ce7fc640 1 -- 172.21.15.113:0/1700058081 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff5c804c3b0 con 0x7ff5d815a8a0 2023-12-19T13:52:51.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.274+0000 7ff5ce7fc640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff5bc06a430 0x7ff5bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:51.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.274+0000 7ff5ce7fc640 1 -- 172.21.15.113:0/1700058081 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5c80ab0f0 con 0x7ff5d815a8a0 2023-12-19T13:52:51.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.274+0000 7ff5dde20640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff5bc06a430 0x7ff5bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:51.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.275+0000 7ff5dde20640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff5bc06a430 0x7ff5bc06c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4006fd0 tx=0x7ff5d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:51.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.279+0000 7ff5ce7fc640 1 -- 172.21.15.113:0/1700058081 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5c8076800 con 0x7ff5d815a8a0 2023-12-19T13:52:51.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.507+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d80b0f70 con 0x7ff5d815a8a0 2023-12-19T13:52:51.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.508+0000 7ff5ce7fc640 1 -- 172.21.15.113:0/1700058081 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7ff5c8079e20 con 0x7ff5d815a8a0 2023-12-19T13:52:51.507 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:51.508 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:52:51.508 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:52:51.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff5bc06a430 msgr2=0x7ff5bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:51.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff5bc06a430 0x7ff5bc06c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4006fd0 tx=0x7ff5d4008040 comp rx=0 tx=0).stop 2023-12-19T13:52:51.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815a8a0 msgr2=0x7ff5d81f17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:51.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815a8a0 0x7ff5d81f17b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000c00 tx=0x7ff5c8004730 comp rx=0 tx=0).stop 2023-12-19T13:52:51.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 shutdown_connections 2023-12-19T13:52:51.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff5bc06a430 0x7ff5bc06c8f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5d815b1e0 0x7ff5d8158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5d815a8a0 0x7ff5d81f17b0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 --2- 172.21.15.113:0/1700058081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5d8159f80 0x7ff5d81f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:51.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 >> 172.21.15.113:0/1700058081 conn(0x7ff5d80b0100 msgr2=0x7ff5d80af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:51.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 shutdown_connections 2023-12-19T13:52:51.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:51.511+0000 7ff5dee22640 1 -- 172.21.15.113:0/1700058081 wait complete. 2023-12-19T13:52:51.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:52:40.568364+0000', 'modified': '2023-12-19T13:52:43.584604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6900}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6900': {'gid': 6900, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.113:6837/835415073', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6835', 'nonce': 835415073}, {'type': 'v1', 'addr': '172.21.15.113:6837', 'nonce': 835415073}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:52:51.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:52:51.931 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T13:52:52.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.162+0000 7f7e688e1640 1 Processor -- start 2023-12-19T13:52:52.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.162+0000 7f7e688e1640 1 -- start start 2023-12-19T13:52:52.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.163+0000 7f7e688e1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e64159e40 0x7f7e640b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.163+0000 7f7e688e1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e640cd430 0x7f7e640b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e688e1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e640b0830 0x7f7e6415da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e688e1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e640b23e0 con 0x7f7e640cd430 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e688e1640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6406b3a0 con 0x7f7e640b0830 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e688e1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640b0c80 con 0x7f7e64159e40 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e5bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e640cd430 0x7f7e640b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e5bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e640cd430 0x7f7e640b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36468/0 (socket says 172.21.15.113:36468) 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e5bfff640 1 -- 172.21.15.113:0/477137500 learned_addr learned my addr 172.21.15.113:0/477137500 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/477137500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e64159e40 0x7f7e640b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e6359e640 1 --2- 172.21.15.113:0/477137500 >> v2:172.21.15.151:3300/0 conn(0x7f7e640b0830 0x7f7e6415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e5bfff640 1 -- 172.21.15.113:0/477137500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e64159e40 msgr2=0x7f7e640b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/477137500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e64159e40 0x7f7e640b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e5bfff640 1 -- 172.21.15.113:0/477137500 >> v2:172.21.15.151:3300/0 conn(0x7f7e640b0830 msgr2=0x7f7e6415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.164+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/477137500 >> v2:172.21.15.151:3300/0 conn(0x7f7e640b0830 0x7f7e6415da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.165+0000 7f7e5bfff640 1 -- 172.21.15.113:0/477137500 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640b1860 con 0x7f7e640cd430 2023-12-19T13:52:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.166+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/477137500 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e640cd430 0x7f7e640b02f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7e6406b280 tx=0x7f7e4c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ceaccd222af5c13 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.166+0000 7f7e6259c640 1 -- 172.21.15.113:0/477137500 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c030860 con 0x7f7e640cd430 2023-12-19T13:52:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.166+0000 7f7e6259c640 1 -- 172.21.15.113:0/477137500 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c0309c0 con 0x7f7e640cd430 2023-12-19T13:52:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.166+0000 7f7e6259c640 1 -- 172.21.15.113:0/477137500 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c030d50 con 0x7f7e640cd430 2023-12-19T13:52:52.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 -- 172.21.15.113:0/477137500 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e640cd430 msgr2=0x7f7e640b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 --2- 172.21.15.113:0/477137500 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e640cd430 0x7f7e640b02f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7e6406b280 tx=0x7f7e4c02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 -- 172.21.15.113:0/477137500 shutdown_connections 2023-12-19T13:52:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 --2- 172.21.15.113:0/477137500 >> v2:172.21.15.151:3300/0 conn(0x7f7e640b0830 0x7f7e6415da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 --2- 172.21.15.113:0/477137500 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e640cd430 0x7f7e640b02f0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 --2- 172.21.15.113:0/477137500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e64159e40 0x7f7e640b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 -- 172.21.15.113:0/477137500 >> 172.21.15.113:0/477137500 conn(0x7f7e640659a0 msgr2=0x7f7e64065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 -- 172.21.15.113:0/477137500 shutdown_connections 2023-12-19T13:52:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.167+0000 7f7e688e1640 1 -- 172.21.15.113:0/477137500 wait complete. 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.169+0000 7f7e688e1640 1 Processor -- start 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.169+0000 7f7e688e1640 1 -- start start 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e688e1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e640b0830 0x7f7e6406c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e688e1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e640cd430 0x7f7e6415b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e688e1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e64159e40 0x7f7e64143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e688e1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64144080 con 0x7f7e64159e40 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e688e1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6406c960 con 0x7f7e640b0830 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e688e1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6406cc40 con 0x7f7e640cd430 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e64159e40 0x7f7e64143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e64159e40 0x7f7e64143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36470/0 (socket says 172.21.15.113:36470) 2023-12-19T13:52:52.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e6359e640 1 -- 172.21.15.113:0/1376120535 learned_addr learned my addr 172.21.15.113:0/1376120535 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e640b0830 0x7f7e6406c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e6359e640 1 -- 172.21.15.113:0/1376120535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e640cd430 msgr2=0x7f7e6415b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e6359e640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e640cd430 0x7f7e6415b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e6359e640 1 -- 172.21.15.113:0/1376120535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e640b0830 msgr2=0x7f7e6406c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.170+0000 7f7e6359e640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e640b0830 0x7f7e6406c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.171+0000 7f7e6359e640 1 -- 172.21.15.113:0/1376120535 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0094d0 con 0x7f7e64159e40 2023-12-19T13:52:52.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.171+0000 7f7e6359e640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e64159e40 0x7f7e64143b40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c007e60 tx=0x7f7e5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.171+0000 7f7e5b7fe640 1 -- 172.21.15.113:0/1376120535 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c014420 con 0x7f7e64159e40 2023-12-19T13:52:52.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.171+0000 7f7e5b7fe640 1 -- 172.21.15.113:0/1376120535 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c0145a0 con 0x7f7e64159e40 2023-12-19T13:52:52.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.171+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6406cf20 con 0x7f7e64159e40 2023-12-19T13:52:52.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.171+0000 7f7e5b7fe640 1 -- 172.21.15.113:0/1376120535 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c014950 con 0x7f7e64159e40 2023-12-19T13:52:52.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.171+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6406d4e0 con 0x7f7e64159e40 2023-12-19T13:52:52.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.173+0000 7f7e5b7fe640 1 -- 172.21.15.113:0/1376120535 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e5c014ab0 con 0x7f7e64159e40 2023-12-19T13:52:52.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.174+0000 7f7e5b7fe640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4406a430 0x7f7e4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.174+0000 7f7e5b7fe640 1 -- 172.21.15.113:0/1376120535 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e5c0891f0 con 0x7f7e64159e40 2023-12-19T13:52:52.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.175+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4406a430 0x7f7e4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.175+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4406a430 0x7f7e4406c8f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7e54006fd0 tx=0x7f7e54008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.175+0000 7f7e6bc4f740 1 Processor -- start 2023-12-19T13:52:52.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.176+0000 7f7e6bc4f740 1 -- start start 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.176+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c864a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8619e90 0x5569c8647180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c86476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8589f80 con 0x5569c8649f10 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8587710 con 0x5569c8619e90 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569c8583000 con 0x5569c861da90 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c864a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c864a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36482/0 (socket says 172.21.15.113:36482) 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 -- 172.21.15.113:0/3357093096 learned_addr learned my addr 172.21.15.113:0/3357093096 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8619e90 0x5569c8647180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 -- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 msgr2=0x5569c86476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c86476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 -- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8619e90 msgr2=0x5569c8647180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8619e90 0x5569c8647180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e62d9d640 1 -- 172.21.15.113:0/3357093096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c854a690 con 0x5569c8649f10 2023-12-19T13:52:52.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.177+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8619e90 0x5569c8647180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:52.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.178+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c864a2f0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400e870 tx=0x7f7e54011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856fff1261e8459e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.178+0000 7f7e58ff9640 1 -- 172.21.15.113:0/3357093096 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54015700 con 0x5569c8649f10 2023-12-19T13:52:52.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.178+0000 7f7e58ff9640 1 -- 172.21.15.113:0/3357093096 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54015860 con 0x5569c8649f10 2023-12-19T13:52:52.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.178+0000 7f7e58ff9640 1 -- 172.21.15.113:0/3357093096 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54015bd0 con 0x5569c8649f10 2023-12-19T13:52:52.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.178+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/3357093096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 msgr2=0x5569c864a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.178+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c864a2f0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400e870 tx=0x7f7e54011000 comp rx=0 tx=0).stop 2023-12-19T13:52:52.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/3357093096 shutdown_connections 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c86476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8619e90 0x5569c8647180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/3357093096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c864a2f0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/3357093096 >> 172.21.15.113:0/3357093096 conn(0x5569c861c1a0 msgr2=0x5569c8664d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/3357093096 shutdown_connections 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/3357093096 wait complete. 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.179+0000 7f7e6bc4f740 1 -- start start 2023-12-19T13:52:52.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.180+0000 7f7e6bc4f740 1 Processor -- start 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c8641cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c864aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8640470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c85247d0 con 0x5569c863f930 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8524470 con 0x5569c8649f10 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569c82eaf20 con 0x5569c861da90 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6bc4f740 10 client.0 _ll_register_callbacks cb 0x5569c85731b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8640470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8640470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36492/0 (socket says 172.21.15.113:36492) 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 -- 172.21.15.113:0/804313686 learned_addr learned my addr 172.21.15.113:0/804313686 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 -- 172.21.15.113:0/804313686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 msgr2=0x5569c8641cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c8641cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 -- 172.21.15.113:0/804313686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 msgr2=0x5569c864aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c864aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c864aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 -- 172.21.15.113:0/804313686 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5400e5b0 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e6359e640 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8640470 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c054a30 tx=0x7f7e5c058530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea5ba486a3bb604 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.181+0000 7f7e41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e41ffb640 1 -- 172.21.15.113:0/804313686 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c05c170 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e41ffb640 1 -- 172.21.15.113:0/804313686 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e5c060510 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569c85ad550 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e41ffb640 1 -- 172.21.15.113:0/804313686 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e5c057a20 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 10 client.7065 fetch_fsmap learned FSMap version 49 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5569c8581680 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e41ffb640 1 -- 172.21.15.113:0/804313686 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c85ad550 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e41ffb640 1 -- 172.21.15.113:0/804313686 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 49) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7e5c060080 con 0x5569c863f930 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 10 client.7065 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T13:52:52.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 10 client.7065 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:52:52.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 20 client.7065 populate_metadata read hostname 'smithi113' 2023-12-19T13:52:52.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c867fbc0 0x5569c8681fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 4 client.7065 mds_command: new command op to 6900 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:52:52.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.182+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 --> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569c8575b50 con 0x5569c867fbc0 2023-12-19T13:52:52.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.183+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c867fbc0 0x5569c8681fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.183+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c867fbc0 0x5569c8681fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a883a4d493691cf8 server_cookie=4dd824ec1b60c6aa in_seq=0 out_seq=0 2023-12-19T13:52:52.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.183+0000 7f7e41ffb640 10 client.7065 ms_handle_connect on v2:172.21.15.113:6835/835415073 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e41ffb640 1 -- 172.21.15.113:0/804313686 <== mds.0 v2:172.21.15.113:6835/835415073 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5569c8575b50 con 0x5569c867fbc0 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e41ffb640 10 client.7065 handle_command_reply: tid=0 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 client.7065 shutdown 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 msgr2=0x5569c8640470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8640470 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c054a30 tx=0x7f7e5c058530 comp rx=0 tx=0).stop 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 shutdown_connections 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c867fbc0 0x5569c8681fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8640470 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c864aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e41ffb640 0 client.7065 ms_handle_reset on v2:172.21.15.113:6835/835415073 2023-12-19T13:52:52.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/804313686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c8641cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.184+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 >> 172.21.15.113:0/804313686 conn(0x5569c8619e90 msgr2=0x5569c861e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.185+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 shutdown_connections 2023-12-19T13:52:52.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.185+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/804313686 wait complete. 2023-12-19T13:52:52.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.185+0000 7f7e6bc4f740 20 client.7065 trim_cache size 0 max 16384 2023-12-19T13:52:52.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.201+0000 7f7e6bc4f740 1 Processor -- start 2023-12-19T13:52:52.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.201+0000 7f7e6bc4f740 1 -- start start 2023-12-19T13:52:52.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c861da90 0x5569c863cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c863f930 0x5569c8673440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c8673980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8619d50 con 0x5569c8649f10 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c861fef0 con 0x5569c861da90 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569c8644d20 con 0x5569c863f930 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c8673980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c8673980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36494/0 (socket says 172.21.15.113:36494) 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 -- 172.21.15.113:0/2362875120 learned_addr learned my addr 172.21.15.113:0/2362875120 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 -- 172.21.15.113:0/2362875120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c863f930 msgr2=0x5569c8673440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 --2- 172.21.15.113:0/2362875120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c863f930 0x5569c8673440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 -- 172.21.15.113:0/2362875120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c861da90 msgr2=0x5569c863cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 --2- 172.21.15.113:0/2362875120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c861da90 0x5569c863cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.202+0000 7f7e6359e640 1 -- 172.21.15.113:0/2362875120 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c85239e0 con 0x5569c8649f10 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.203+0000 7f7e6359e640 1 --2- 172.21.15.113:0/2362875120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c8673980 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e9b0 tx=0x7f7e5c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478cbc02b2e4f036 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.203+0000 7f7e597fa640 1 -- 172.21.15.113:0/2362875120 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c058300 con 0x5569c8649f10 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.203+0000 7f7e597fa640 1 -- 172.21.15.113:0/2362875120 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c05c170 con 0x5569c8649f10 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.203+0000 7f7e597fa640 1 -- 172.21.15.113:0/2362875120 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c060510 con 0x5569c8649f10 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.203+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/2362875120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 msgr2=0x5569c8673980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.203+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/2362875120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c8673980 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e9b0 tx=0x7f7e5c020000 comp rx=0 tx=0).stop 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/2362875120 shutdown_connections 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/2362875120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c8649f10 0x5569c8673980 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/2362875120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c863f930 0x5569c8673440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/2362875120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c861da90 0x5569c863cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/2362875120 >> 172.21.15.113:0/2362875120 conn(0x5569c8619e90 msgr2=0x5569c86402a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/2362875120 shutdown_connections 2023-12-19T13:52:52.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/2362875120 wait complete. 2023-12-19T13:52:52.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.204+0000 7f7e6bc4f740 1 -- start start 2023-12-19T13:52:52.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.205+0000 7f7e6bc4f740 1 Processor -- start 2023-12-19T13:52:52.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c8673440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8673980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6bc4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c8676340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8668e70 con 0x5569c863f930 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c864a530 con 0x5569c8649f10 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6bc4f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569c86430c0 con 0x5569c861da90 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6bc4f740 10 client.0 _ll_register_callbacks cb 0x7f7e540094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8673980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8673980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36510/0 (socket says 172.21.15.113:36510) 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 -- 172.21.15.113:0/43267436 learned_addr learned my addr 172.21.15.113:0/43267436 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6359e640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c8676340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c8673440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 -- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 msgr2=0x5569c8673440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c8673440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 -- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 msgr2=0x5569c8676340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c8676340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e5bfff640 1 -- 172.21.15.113:0/43267436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569c8581680 con 0x5569c863f930 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.206+0000 7f7e6359e640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c8676340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:52.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e5bfff640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8673980 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c02b9e0 tx=0x7f7e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b67c5896615ca31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:52:52.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e41ffb640 1 -- 172.21.15.113:0/43267436 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c039920 con 0x5569c863f930 2023-12-19T13:52:52.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e41ffb640 1 -- 172.21.15.113:0/43267436 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e4c03e070 con 0x5569c863f930 2023-12-19T13:52:52.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e54015860 con 0x5569c863f930 2023-12-19T13:52:52.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e41ffb640 1 -- 172.21.15.113:0/43267436 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e4c039a80 con 0x5569c863f930 2023-12-19T13:52:52.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e6bc4f740 10 client.7071 fetch_fsmap learned FSMap version 49 2023-12-19T13:52:52.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.207+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5569c8548ef0 con 0x5569c863f930 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e41ffb640 1 -- 172.21.15.113:0/43267436 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54015860 con 0x5569c863f930 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e41ffb640 1 -- 172.21.15.113:0/43267436 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 49) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7e4c039be0 con 0x5569c863f930 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e6bc4f740 10 client.7071 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e6bc4f740 10 client.7071 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e6bc4f740 20 client.7071 populate_metadata read hostname 'smithi113' 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c8676880 0x5569c8676c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e6bc4f740 4 client.7071 mds_command: new command op to 6900 tid=0[{"prefix": "status"}] 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 --> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5569c857c080 con 0x5569c8676880 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c8676880 0x5569c8676c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e62d9d640 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c8676880 0x5569c8676c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90703ce7af9e711e server_cookie=15fb05934e6a6f56 in_seq=0 out_seq=0 2023-12-19T13:52:52.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.208+0000 7f7e41ffb640 10 client.7071 ms_handle_connect on v2:172.21.15.113:6835/835415073 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e41ffb640 1 -- 172.21.15.113:0/43267436 <== mds.0 v2:172.21.15.113:6835/835415073 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5569c857c080 con 0x5569c8676880 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e41ffb640 10 client.7071 handle_command_reply: tid=0 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 client.7071 shutdown 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 msgr2=0x5569c8673980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8673980 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c02b9e0 tx=0x7f7e4c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 shutdown_connections 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569c8649f10 0x5569c8676340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:6835/835415073,v1:172.21.15.113:6837/835415073] conn(0x5569c8676880 0x5569c8676c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5569c863f930 0x5569c8673980 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 --2- 172.21.15.113:0/43267436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5569c861da90 0x5569c8673440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e41ffb640 0 client.7071 ms_handle_reset on v2:172.21.15.113:6835/835415073 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 >> 172.21.15.113:0/43267436 conn(0x5569c8619e90 msgr2=0x5569c86402a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 shutdown_connections 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 1 -- 172.21.15.113:0/43267436 wait complete. 2023-12-19T13:52:52.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.209+0000 7f7e6bc4f740 20 client.7071 trim_cache size 0 max 16384 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 6900, 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 11.636239253999999, 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 49, 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 113, 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 113, 2023-12-19T13:52:52.212 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 17.280422016999999 2023-12-19T13:52:52.213 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:52:52.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4406a430 msgr2=0x7f7e4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4406a430 0x7f7e4406c8f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7e54006fd0 tx=0x7f7e54008040 comp rx=0 tx=0).stop 2023-12-19T13:52:52.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e64159e40 msgr2=0x7f7e64143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e64159e40 0x7f7e64143b40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c007e60 tx=0x7f7e5c00e4b0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 shutdown_connections 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4406a430 0x7f7e4406c8f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e64159e40 0x7f7e64143b40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e640cd430 0x7f7e6415b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 --2- 172.21.15.113:0/1376120535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e640b0830 0x7f7e6406c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 >> 172.21.15.113:0/1376120535 conn(0x7f7e640659a0 msgr2=0x7f7e64156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 shutdown_connections 2023-12-19T13:52:52.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.210+0000 7f7e688e1640 1 -- 172.21.15.113:0/1376120535 wait complete. 2023-12-19T13:52:52.226 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:52:52.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.429+0000 7f1489900640 1 Processor -- start 2023-12-19T13:52:52.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.429+0000 7f1489900640 1 -- start start 2023-12-19T13:52:52.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f1489900640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 0x7f14840af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f1489900640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f148406c6b0 0x7f14840b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f1489900640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840afb10 con 0x7f14840b0b50 2023-12-19T13:52:52.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f1489900640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148406bb30 con 0x7f148406c6b0 2023-12-19T13:52:52.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f1489900640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840b0070 con 0x7f14841449e0 2023-12-19T13:52:52.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f14837fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f148406c6b0 0x7f14840b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f14837fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f148406c6b0 0x7f14840b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36522/0 (socket says 172.21.15.113:36522) 2023-12-19T13:52:52.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.431+0000 7f14837fe640 1 -- 172.21.15.113:0/304570611 learned_addr learned my addr 172.21.15.113:0/304570611 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.432+0000 7f1482ffd640 1 --2- 172.21.15.113:0/304570611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 0x7f14840af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.432+0000 7f14837fe640 1 -- 172.21.15.113:0/304570611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 msgr2=0x7f14840af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.432+0000 7f14837fe640 1 --2- 172.21.15.113:0/304570611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 0x7f14840af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.432+0000 7f14837fe640 1 -- 172.21.15.113:0/304570611 >> v1:172.21.15.113:6789/0 conn(0x7f14840b0b50 legacy=0x7f148406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.432+0000 7f14837fe640 1 -- 172.21.15.113:0/304570611 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840b0350 con 0x7f148406c6b0 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.432+0000 7f1481ffb640 1 -- 172.21.15.113:0/304570611 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248516448 0 0) 0x7f14840afb10 con 0x7f14840b0b50 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.433+0000 7f14837fe640 1 --2- 172.21.15.113:0/304570611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f148406c6b0 0x7f14840b1710 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f147c009e50 tx=0x7f147c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6963d2a68bdda63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.433+0000 7f1481ffb640 1 -- 172.21.15.113:0/304570611 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c02cb00 con 0x7f148406c6b0 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.433+0000 7f1481ffb640 1 -- 172.21.15.113:0/304570611 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c02cc60 con 0x7f148406c6b0 2023-12-19T13:52:52.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.433+0000 7f1481ffb640 1 -- 172.21.15.113:0/304570611 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c0343f0 con 0x7f148406c6b0 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 -- 172.21.15.113:0/304570611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f148406c6b0 msgr2=0x7f14840b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 --2- 172.21.15.113:0/304570611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f148406c6b0 0x7f14840b1710 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f147c009e50 tx=0x7f147c02bf60 comp rx=0 tx=0).stop 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 -- 172.21.15.113:0/304570611 shutdown_connections 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 --2- 172.21.15.113:0/304570611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f148406c6b0 0x7f14840b1710 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 --2- 172.21.15.113:0/304570611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 0x7f14840af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 -- 172.21.15.113:0/304570611 >> 172.21.15.113:0/304570611 conn(0x7f14840cbb70 msgr2=0x7f14840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 -- 172.21.15.113:0/304570611 shutdown_connections 2023-12-19T13:52:52.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.434+0000 7f1489900640 1 -- 172.21.15.113:0/304570611 wait complete. 2023-12-19T13:52:52.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.436+0000 7f1489900640 1 Processor -- start 2023-12-19T13:52:52.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.436+0000 7f1489900640 1 -- start start 2023-12-19T13:52:52.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f1489900640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f148406c6b0 0x7f148415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f1489900640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14840b0b50 0x7f148415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f1489900640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 0x7f148415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f1489900640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148413f520 con 0x7f14840b0b50 2023-12-19T13:52:52.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f1489900640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148415cec0 con 0x7f148406c6b0 2023-12-19T13:52:52.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f1489900640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148413eb80 con 0x7f14841449e0 2023-12-19T13:52:52.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f14827fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14840b0b50 0x7f148415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f14827fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14840b0b50 0x7f148415ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36528/0 (socket says 172.21.15.113:36528) 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.437+0000 7f14827fc640 1 -- 172.21.15.113:0/4195908102 learned_addr learned my addr 172.21.15.113:0/4195908102 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f14827fc640 1 -- 172.21.15.113:0/4195908102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 msgr2=0x7f148415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f14827fc640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 0x7f148415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f14827fc640 1 -- 172.21.15.113:0/4195908102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f148406c6b0 msgr2=0x7f148415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f14827fc640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f148406c6b0 0x7f148415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f14827fc640 1 -- 172.21.15.113:0/4195908102 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c009b30 con 0x7f14840b0b50 2023-12-19T13:52:52.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f14827fc640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14840b0b50 0x7f148415ab60 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f147800c4b0 tx=0x7f147800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f146bfff640 1 -- 172.21.15.113:0/4195908102 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478005480 con 0x7f14840b0b50 2023-12-19T13:52:52.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f146bfff640 1 -- 172.21.15.113:0/4195908102 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14780035f0 con 0x7f14840b0b50 2023-12-19T13:52:52.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f146bfff640 1 -- 172.21.15.113:0/4195908102 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780039e0 con 0x7f14840b0b50 2023-12-19T13:52:52.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148413ee60 con 0x7f14840b0b50 2023-12-19T13:52:52.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.438+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14840cb2b0 con 0x7f14840b0b50 2023-12-19T13:52:52.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.439+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148413f660 con 0x7f14840b0b50 2023-12-19T13:52:52.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.440+0000 7f146bfff640 1 -- 172.21.15.113:0/4195908102 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1478003b40 con 0x7f14840b0b50 2023-12-19T13:52:52.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.441+0000 7f146bfff640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f147006a430 0x7f147006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:52.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.441+0000 7f146bfff640 1 -- 172.21.15.113:0/4195908102 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1478087f50 con 0x7f14840b0b50 2023-12-19T13:52:52.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.441+0000 7f1482ffd640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f147006a430 0x7f147006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:52.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.442+0000 7f1482ffd640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f147006a430 0x7f147006c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1474006fd0 tx=0x7f1474008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:52.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.445+0000 7f146bfff640 1 -- 172.21.15.113:0/4195908102 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f148413f660 con 0x7f14840b0b50 2023-12-19T13:52:52.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.672+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f148413f660 con 0x7f14840b0b50 2023-12-19T13:52:52.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.673+0000 7f146bfff640 1 -- 172.21.15.113:0/4195908102 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f148413f660 con 0x7f14840b0b50 2023-12-19T13:52:52.673 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:52:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f147006a430 msgr2=0x7f147006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f147006a430 0x7f147006c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1474006fd0 tx=0x7f1474008040 comp rx=0 tx=0).stop 2023-12-19T13:52:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14840b0b50 msgr2=0x7f148415ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14840b0b50 0x7f148415ab60 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f147800c4b0 tx=0x7f147800c970 comp rx=0 tx=0).stop 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 shutdown_connections 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f147006a430 0x7f147006c8f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14841449e0 0x7f148415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14840b0b50 0x7f148415ab60 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 --2- 172.21.15.113:0/4195908102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f148406c6b0 0x7f148415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 >> 172.21.15.113:0/4195908102 conn(0x7f14840cbb70 msgr2=0x7f14840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 shutdown_connections 2023-12-19T13:52:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:52.676+0000 7f1489900640 1 -- 172.21.15.113:0/4195908102 wait complete. 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:52:52.694 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:52:52.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:52.694 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:52:52.744 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:52:52.744 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:52:52.745 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42047sec preferred_lft 42047sec 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:52:52.746 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:52:52.747 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:52:52.747 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:52.747 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:52:52.747 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:52:52.747 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:52:52.747 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:52.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:52.747 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:52:52.874 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:52:52.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:52.878 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:52:52.935 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:52:52.935 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:52:52.935 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:52:52.935 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:52:52.935 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:52:52.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:52.936 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:52:52.936 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:52:52.936 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:52:52.936 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:52:52.936 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:52:52.936 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:52:53.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:53.111 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:52:53.161 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:52:53.161 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:52:53.161 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:52:53.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:53.161 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:52:53.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:52:53.243 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:52:53.294 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:52:53.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:52:53.295 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:52:53.388 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:52:53.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:53.389 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:52:53.532 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:52:53.532 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:52:53.567 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:52:53.567 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:52:53.567 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:52:53.567 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:52:53.567 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:52:53.571 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:52:53.571 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:52:53.571 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:52:53.571 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:52:53.571 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:52:53.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:52:53.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:53.575 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:52:53.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:53.665 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:52:53.730 INFO:teuthology.orchestra.run.smithi113.stdout:client5174 2023-12-19T13:52:53.731 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:53.731 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:53.780 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:52:54.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.039+0000 7f73122a0640 1 Processor -- start 2023-12-19T13:52:54.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.039+0000 7f73122a0640 1 -- start start 2023-12-19T13:52:54.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.041+0000 7f73122a0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f730c157bf0 0x7f730c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:54.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.041+0000 7f73122a0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:54.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.041+0000 7f73122a0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c0b0a90 con 0x7f730c0b0640 2023-12-19T13:52:54.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.041+0000 7f73122a0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730c06b8c0 con 0x7f730c157bf0 2023-12-19T13:52:54.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.041+0000 7f73122a0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c15b740 con 0x7f730c0ae110 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.041+0000 7f730bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f730c157bf0 0x7f730c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.042+0000 7f730bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f730c157bf0 0x7f730c15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36532/0 (socket says 172.21.15.113:36532) 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.042+0000 7f730bfff640 1 -- 172.21.15.113:0/1132712719 learned_addr learned my addr 172.21.15.113:0/1132712719 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.042+0000 7f7303fff640 1 --2- 172.21.15.113:0/1132712719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.042+0000 7f730bfff640 1 -- 172.21.15.113:0/1132712719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 msgr2=0x7f730c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.042+0000 7f730bfff640 1 --2- 172.21.15.113:0/1132712719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.042+0000 7f730bfff640 1 -- 172.21.15.113:0/1132712719 >> v1:172.21.15.151:6789/0 conn(0x7f730c0b0640 legacy=0x7f730c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:54.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.042+0000 7f730bfff640 1 -- 172.21.15.113:0/1132712719 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0ae640 con 0x7f730c157bf0 2023-12-19T13:52:54.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.043+0000 7f730bfff640 1 --2- 172.21.15.113:0/1132712719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c15b200 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009870 tx=0x7f72fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e1a1ee5118f85d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:54.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.043+0000 7f730b7fe640 1 -- 172.21.15.113:0/1132712719 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc031640 con 0x7f730c157bf0 2023-12-19T13:52:54.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f730b7fe640 1 -- 172.21.15.113:0/1132712719 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc0317a0 con 0x7f730c157bf0 2023-12-19T13:52:54.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f730b7fe640 1 -- 172.21.15.113:0/1132712719 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc031b30 con 0x7f730c157bf0 2023-12-19T13:52:54.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 -- 172.21.15.113:0/1132712719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 msgr2=0x7f730c15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:54.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 --2- 172.21.15.113:0/1132712719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c15b200 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009870 tx=0x7f72fc02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 -- 172.21.15.113:0/1132712719 shutdown_connections 2023-12-19T13:52:54.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 --2- 172.21.15.113:0/1132712719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 --2- 172.21.15.113:0/1132712719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c15b200 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 -- 172.21.15.113:0/1132712719 >> 172.21.15.113:0/1132712719 conn(0x7f730c0cbb70 msgr2=0x7f730c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:54.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 -- 172.21.15.113:0/1132712719 shutdown_connections 2023-12-19T13:52:54.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.044+0000 7f73122a0640 1 -- 172.21.15.113:0/1132712719 wait complete. 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.046+0000 7f73122a0640 1 Processor -- start 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.046+0000 7f73122a0640 1 -- start start 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.047+0000 7f73122a0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.047+0000 7f73122a0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730c0b0640 0x7f730c159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.047+0000 7f73122a0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.047+0000 7f73122a0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c14e070 con 0x7f730c157bf0 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.047+0000 7f73122a0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c159060 con 0x7f730c0b0640 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.047+0000 7f73122a0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0c3410 con 0x7f730c0ae110 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36540/0 (socket says 172.21.15.113:36540) 2023-12-19T13:52:54.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 -- 172.21.15.113:0/2344511328 learned_addr learned my addr 172.21.15.113:0/2344511328 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 -- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 msgr2=0x7f730c14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f730bfff640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f7303fff640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730c0b0640 0x7f730c159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 -- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730c0b0640 msgr2=0x7f730c159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730c0b0640 0x7f730c159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 -- 172.21.15.113:0/2344511328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0094d0 con 0x7f730c157bf0 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f730bfff640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.048+0000 7f731083d640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c159aa0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f730400c780 tx=0x7f730400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.049+0000 7f73097fa640 1 -- 172.21.15.113:0/2344511328 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304004b60 con 0x7f730c157bf0 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.049+0000 7f73097fa640 1 -- 172.21.15.113:0/2344511328 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730400ce90 con 0x7f730c157bf0 2023-12-19T13:52:54.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.049+0000 7f73097fa640 1 -- 172.21.15.113:0/2344511328 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400a850 con 0x7f730c157bf0 2023-12-19T13:52:54.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.049+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c0c36f0 con 0x7f730c157bf0 2023-12-19T13:52:54.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.049+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c154ef0 con 0x7f730c157bf0 2023-12-19T13:52:54.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.050+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c061910 con 0x7f730c157bf0 2023-12-19T13:52:54.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.051+0000 7f73097fa640 1 -- 172.21.15.113:0/2344511328 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f730400a9b0 con 0x7f730c157bf0 2023-12-19T13:52:54.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.052+0000 7f73097fa640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ec06a430 0x7f72ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:54.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.052+0000 7f73097fa640 1 -- 172.21.15.113:0/2344511328 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7304088bb0 con 0x7f730c157bf0 2023-12-19T13:52:54.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.052+0000 7f730bfff640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ec06a430 0x7f72ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:54.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.053+0000 7f730bfff640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ec06a430 0x7f72ec06c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f72fc036000 tx=0x7f72fc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:54.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.057+0000 7f73097fa640 1 -- 172.21.15.113:0/2344511328 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7304054100 con 0x7f730c157bf0 2023-12-19T13:52:54.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.287+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f730c159340 con 0x7f730c157bf0 2023-12-19T13:52:54.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.288+0000 7f73097fa640 1 -- 172.21.15.113:0/2344511328 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7304057720 con 0x7f730c157bf0 2023-12-19T13:52:54.288 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ec06a430 msgr2=0x7f72ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ec06a430 0x7f72ec06c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f72fc036000 tx=0x7f72fc03c040 comp rx=0 tx=0).stop 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 msgr2=0x7f730c159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c159aa0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f730400c780 tx=0x7f730400cc40 comp rx=0 tx=0).stop 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 shutdown_connections 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f72ec06a430 0x7f72ec06c8f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f730c157bf0 0x7f730c159aa0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730c0b0640 0x7f730c159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 --2- 172.21.15.113:0/2344511328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f730c0ae110 0x7f730c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 >> 172.21.15.113:0/2344511328 conn(0x7f730c0cbb70 msgr2=0x7f730c0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:54.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 shutdown_connections 2023-12-19T13:52:54.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:54.291+0000 7f73122a0640 1 -- 172.21.15.113:0/2344511328 wait complete. 2023-12-19T13:52:54.310 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:52:54.310 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:52:54.310 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:52:54.310 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:52:54.310 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:52:54.310 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:52:54.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:52:54.311 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:52:54.311 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:52:54.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:54.311 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:52:54.369 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42020sec preferred_lft 42020sec 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:52:54.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:54.371 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:52:54.459 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:52:54.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:54.464 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:52:54.521 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:52:54.521 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:52:54.521 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:52:54.521 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:52:54.521 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:52:54.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:54.522 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:52:54.522 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:52:54.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:52:54.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:52:54.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:52:54.523 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:52:54.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:54.709 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:52:54.759 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:52:54.759 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:52:54.760 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:52:54.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:54.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:52:54.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:52:54.854 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:52:54.908 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:52:54.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:52:54.909 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:52:54.961 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:52:54.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:54.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:52:55.100 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:52:55.101 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:52:55.131 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:52:55.132 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:52:55.132 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:52:55.132 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:52:55.132 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:52:55.133 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:52:55.133 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:52:55.133 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:52:55.133 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:52:55.134 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:52:55.137 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:52:55.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:55.137 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:52:55.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:55.212 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:52:55.261 INFO:teuthology.orchestra.run.smithi151.stdout:client5180 2023-12-19T13:52:55.261 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:52:55.261 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:55.308 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:52:55.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.534+0000 7f59834b9640 1 Processor -- start 2023-12-19T13:52:55.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.534+0000 7f59834b9640 1 -- start start 2023-12-19T13:52:55.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f59834b9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:55.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f59834b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f597c0ce110 0x7f597c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:55.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f59834b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c0cd840 con 0x7f597c0d2b00 2023-12-19T13:52:55.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f59834b9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0d2430 con 0x7f597c146e10 2023-12-19T13:52:55.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f59834b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0ceac0 con 0x7f597c0ce110 2023-12-19T13:52:55.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f5981255640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:55.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f5981255640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36550/0 (socket says 172.21.15.113:36550) 2023-12-19T13:52:55.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.536+0000 7f5981255640 1 -- 172.21.15.113:0/328462263 learned_addr learned my addr 172.21.15.113:0/328462263 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:55.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.537+0000 7f5981a56640 1 --2- 172.21.15.113:0/328462263 >> v2:172.21.15.151:3300/0 conn(0x7f597c0ce110 0x7f597c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:55.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.537+0000 7f5981255640 1 -- 172.21.15.113:0/328462263 >> v2:172.21.15.151:3300/0 conn(0x7f597c0ce110 msgr2=0x7f597c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:52:55.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.537+0000 7f5981255640 1 --2- 172.21.15.113:0/328462263 >> v2:172.21.15.151:3300/0 conn(0x7f597c0ce110 0x7f597c0ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.537+0000 7f5981255640 1 -- 172.21.15.113:0/328462263 >> v1:172.21.15.113:6789/0 conn(0x7f597c0d2b00 legacy=0x7f597c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:55.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.537+0000 7f5981255640 1 -- 172.21.15.113:0/328462263 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0b6e90 con 0x7f597c146e10 2023-12-19T13:52:55.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.537+0000 7f5973fff640 1 -- 172.21.15.113:0/328462263 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165881430 0 0) 0x7f597c0cd840 con 0x7f597c0d2b00 2023-12-19T13:52:55.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.538+0000 7f5981255640 1 --2- 172.21.15.113:0/328462263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c146e10 0x7f597c0d1ef0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f597c0cedb0 tx=0x7f597802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb10e343d730de71 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:55.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.538+0000 7f5973fff640 1 -- 172.21.15.113:0/328462263 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978031860 con 0x7f597c146e10 2023-12-19T13:52:55.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.538+0000 7f5973fff640 1 -- 172.21.15.113:0/328462263 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59780319c0 con 0x7f597c146e10 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.538+0000 7f5973fff640 1 -- 172.21.15.113:0/328462263 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978031d50 con 0x7f597c146e10 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 -- 172.21.15.113:0/328462263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c146e10 msgr2=0x7f597c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 --2- 172.21.15.113:0/328462263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c146e10 0x7f597c0d1ef0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f597c0cedb0 tx=0x7f597802b900 comp rx=0 tx=0).stop 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 -- 172.21.15.113:0/328462263 shutdown_connections 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 --2- 172.21.15.113:0/328462263 >> v2:172.21.15.151:3300/0 conn(0x7f597c0ce110 0x7f597c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 --2- 172.21.15.113:0/328462263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 -- 172.21.15.113:0/328462263 >> 172.21.15.113:0/328462263 conn(0x7f597c0b29c0 msgr2=0x7f597c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 -- 172.21.15.113:0/328462263 shutdown_connections 2023-12-19T13:52:55.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.539+0000 7f59834b9640 1 -- 172.21.15.113:0/328462263 wait complete. 2023-12-19T13:52:55.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.541+0000 7f59834b9640 1 Processor -- start 2023-12-19T13:52:55.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.541+0000 7f59834b9640 1 -- start start 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.542+0000 7f59834b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0ce110 0x7f597c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.542+0000 7f59834b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0d2b00 0x7f597c144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.542+0000 7f59834b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.542+0000 7f59834b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0cb3b0 con 0x7f597c0d2b00 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.542+0000 7f59834b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0cd3e0 con 0x7f597c0ce110 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.542+0000 7f59834b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c144ec0 con 0x7f597c146e10 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0d2b00 0x7f597c144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0d2b00 0x7f597c144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36562/0 (socket says 172.21.15.113:36562) 2023-12-19T13:52:55.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 -- 172.21.15.113:0/3278531680 learned_addr learned my addr 172.21.15.113:0/3278531680 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:52:55.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5981255640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0ce110 0x7f597c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:55.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5981a56640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:55.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 -- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 msgr2=0x7f597c0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:55.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 -- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0ce110 msgr2=0x7f597c15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:55.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0ce110 0x7f597c15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 -- 172.21.15.113:0/3278531680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780094d0 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.543+0000 7f5980a54640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0d2b00 0x7f597c144980 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f596c00c4b0 tx=0x7f596c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.544+0000 7f5971ffb640 1 -- 172.21.15.113:0/3278531680 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c005480 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.544+0000 7f5971ffb640 1 -- 172.21.15.113:0/3278531680 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c0035f0 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.544+0000 7f5971ffb640 1 -- 172.21.15.113:0/3278531680 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c0039a0 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.544+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c0cb010 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.544+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c0cce20 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.545+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c061910 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.546+0000 7f5971ffb640 1 -- 172.21.15.113:0/3278531680 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f596c003b00 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.547+0000 7f5971ffb640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.547+0000 7f5971ffb640 1 -- 172.21.15.113:0/3278531680 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f596c087e70 con 0x7f597c0d2b00 2023-12-19T13:52:55.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.547+0000 7f5981255640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:52:55.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.548+0000 7f5981255640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5978036000 tx=0x7f597803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:52:55.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.551+0000 7f5971ffb640 1 -- 172.21.15.113:0/3278531680 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f596c053460 con 0x7f597c0d2b00 2023-12-19T13:52:55.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.784+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f597c0b58e0 con 0x7f597c0d2b00 2023-12-19T13:52:55.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.785+0000 7f5971ffb640 1 -- 172.21.15.113:0/3278531680 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f596c017020 con 0x7f597c0d2b00 2023-12-19T13:52:55.785 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:52:55.785 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:52:55.785 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:52:55.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 msgr2=0x7f596006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:55.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5978036000 tx=0x7f597803c040 comp rx=0 tx=0).stop 2023-12-19T13:52:55.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0d2b00 msgr2=0x7f597c144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0d2b00 0x7f597c144980 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f596c00c4b0 tx=0x7f596c00c970 comp rx=0 tx=0).stop 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 shutdown_connections 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0d2b00 0x7f597c144980 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 --2- 172.21.15.113:0/3278531680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0ce110 0x7f597c15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 >> 172.21.15.113:0/3278531680 conn(0x7f597c0b29c0 msgr2=0x7f597c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 shutdown_connections 2023-12-19T13:52:55.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:52:55.788+0000 7f59834b9640 1 -- 172.21.15.113:0/3278531680 wait complete. 2023-12-19T13:52:55.807 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:52:56.028 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":6900,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.440043899999999,"mdsmap_epoch":49,"osdmap_epoch":113,"osdmap_epoch_barrier":113,"uptime":21.084237049999999} 2023-12-19T13:52:56.028 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 6900, "mdsmap_epoch": 49, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "rank_uptime": 15.4400439, "state": "up:active", "uptime": 21.08423705, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:52:56.028 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:52:56.249 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:52:56.249 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:52:56.249 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-19T13:52:56.249 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:56.249 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:56.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:56.297 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-19T13:52:58.326 INFO:teuthology.orchestra.run.smithi113.stderr:265+0 records in 2023-12-19T13:52:58.326 INFO:teuthology.orchestra.run.smithi113.stderr:265+0 records out 2023-12-19T13:52:58.326 INFO:teuthology.orchestra.run.smithi113.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.92358 s, 144 MB/s 2023-12-19T13:52:58.328 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:52:58.328 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:52:58.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:52:58.369 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-19T13:53:00.506 INFO:teuthology.orchestra.run.smithi113.stderr:292+0 records in 2023-12-19T13:53:00.506 INFO:teuthology.orchestra.run.smithi113.stderr:292+0 records out 2023-12-19T13:53:00.507 INFO:teuthology.orchestra.run.smithi113.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.04019 s, 150 MB/s 2023-12-19T13:53:00.507 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T13:53:00.508 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:53:00.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.686+0000 7fc2ef30a640 1 Processor -- start 2023-12-19T13:53:00.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.686+0000 7fc2ef30a640 1 -- start start 2023-12-19T13:53:00.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ef30a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8157aa0 0x7fc2e80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:00.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ef30a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2e806e410 0x7fc2e8161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:00.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ef30a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e806e890 con 0x7fc2e8161540 2023-12-19T13:53:00.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ef30a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e80b2600 con 0x7fc2e806e410 2023-12-19T13:53:00.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ef30a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80b1d60 con 0x7fc2e8157aa0 2023-12-19T13:53:00.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ec8a5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2e806e410 0x7fc2e8161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:00.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ed0a6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8157aa0 0x7fc2e80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:00.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ec8a5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2e806e410 0x7fc2e8161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49748/0 (socket says 172.21.15.113:49748) 2023-12-19T13:53:00.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.688+0000 7fc2ec8a5640 1 -- 172.21.15.113:0/518062949 learned_addr learned my addr 172.21.15.113:0/518062949 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.689+0000 7fc2ec8a5640 1 -- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8157aa0 msgr2=0x7fc2e80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.689+0000 7fc2ec8a5640 1 --2- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8157aa0 0x7fc2e80b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.689+0000 7fc2ec8a5640 1 -- 172.21.15.113:0/518062949 >> v1:172.21.15.151:6789/0 conn(0x7fc2e8161540 legacy=0x7fc2e815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.689+0000 7fc2ec8a5640 1 -- 172.21.15.113:0/518062949 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e80b2040 con 0x7fc2e806e410 2023-12-19T13:53:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.689+0000 7fc2ed0a6640 1 --2- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8157aa0 0x7fc2e80b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:53:00.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.690+0000 7fc2ec8a5640 1 --2- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e806e410 0x7fc2e8161000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009870 tx=0x7fc2d802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=264652088c4eba84 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.691+0000 7fc2dffff640 1 -- 172.21.15.113:0/518062949 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8030840 con 0x7fc2e806e410 2023-12-19T13:53:00.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.691+0000 7fc2dffff640 1 -- 172.21.15.113:0/518062949 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d80309a0 con 0x7fc2e806e410 2023-12-19T13:53:00.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.691+0000 7fc2dffff640 1 -- 172.21.15.113:0/518062949 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8030d30 con 0x7fc2e806e410 2023-12-19T13:53:00.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 -- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e806e410 msgr2=0x7fc2e8161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:00.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e806e410 0x7fc2e8161000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009870 tx=0x7fc2d802b980 comp rx=0 tx=0).stop 2023-12-19T13:53:00.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 -- 172.21.15.113:0/518062949 shutdown_connections 2023-12-19T13:53:00.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e806e410 0x7fc2e8161000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/518062949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8157aa0 0x7fc2e80b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 -- 172.21.15.113:0/518062949 >> 172.21.15.113:0/518062949 conn(0x7fc2e80cbb70 msgr2=0x7fc2e80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:00.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 -- 172.21.15.113:0/518062949 shutdown_connections 2023-12-19T13:53:00.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.692+0000 7fc2ef30a640 1 -- 172.21.15.113:0/518062949 wait complete. 2023-12-19T13:53:00.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.694+0000 7fc2ef30a640 1 Processor -- start 2023-12-19T13:53:00.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.694+0000 7fc2ef30a640 1 -- start start 2023-12-19T13:53:00.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ef30a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2e806e410 0x7fc2e815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ef30a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8157aa0 0x7fc2e8153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ef30a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8161540 0x7fc2e815f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ef30a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e81596e0 con 0x7fc2e806e410 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ef30a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e815a220 con 0x7fc2e8157aa0 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ef30a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e815ff90 con 0x7fc2e8161540 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2e806e410 0x7fc2e815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2e806e410 0x7fc2e815a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48710/0 (socket says 172.21.15.113:48710) 2023-12-19T13:53:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 -- 172.21.15.113:0/2115794148 learned_addr learned my addr 172.21.15.113:0/2115794148 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 -- 172.21.15.113:0/2115794148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8161540 msgr2=0x7fc2e815f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8161540 0x7fc2e815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 -- 172.21.15.113:0/2115794148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8157aa0 msgr2=0x7fc2e8153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8157aa0 0x7fc2e8153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.695+0000 7fc2ed0a6640 1 -- 172.21.15.113:0/2115794148 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009400 con 0x7fc2e806e410 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.696+0000 7fc2ed0a6640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2e806e410 0x7fc2e815a6b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400ec40 tx=0x7fc2e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.696+0000 7fc2ddffb640 1 -- 172.21.15.113:0/2115794148 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4009760 con 0x7fc2e806e410 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.696+0000 7fc2ddffb640 1 -- 172.21.15.113:0/2115794148 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e400cc30 con 0x7fc2e806e410 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.696+0000 7fc2ddffb640 1 -- 172.21.15.113:0/2115794148 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4013470 con 0x7fc2e806e410 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.696+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d80094d0 con 0x7fc2e806e410 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.696+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e81598f0 con 0x7fc2e806e410 2023-12-19T13:53:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.697+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e8061910 con 0x7fc2e806e410 2023-12-19T13:53:00.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.698+0000 7fc2ddffb640 1 -- 172.21.15.113:0/2115794148 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc2e40135d0 con 0x7fc2e806e410 2023-12-19T13:53:00.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.699+0000 7fc2ddffb640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:00.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.699+0000 7fc2ddffb640 1 -- 172.21.15.113:0/2115794148 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2e4088c50 con 0x7fc2e806e410 2023-12-19T13:53:00.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.699+0000 7fc2ec8a5640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.700+0000 7fc2ec8a5640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8036000 tx=0x7fc2d803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.703+0000 7fc2ddffb640 1 -- 172.21.15.113:0/2115794148 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc2e4054230 con 0x7fc2e806e410 2023-12-19T13:53:00.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.893+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc2e8071ae0 con 0x7fc2e806e410 2023-12-19T13:53:00.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.897+0000 7fc2ddffb640 1 -- 172.21.15.113:0/2115794148 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+33599 (secure 0 0 0) 0x7fc2e4057850 con 0x7fc2e806e410 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 113, 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:52:41.572548+0000", 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:53:00.898 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:53:00.899 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 13, 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:00.900 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:00.901 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "101", 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:00.902 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:00.903 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:00.904 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:53:00.905 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 12, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:38.334371+0000", 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:00.906 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:53:00.907 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "112", 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:00.908 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:00.909 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:00.910 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:00.911 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:53:00.912 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:00.914 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:00.914 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:00.914 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.914 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.914 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.914 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 13, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:39.588248+0000", 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:00.915 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.916 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "113", 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:00.917 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.918 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.919 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:00.920 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.921 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.922 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.922 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.922 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.923 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.924 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.925 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.926 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.927 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.928 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.929 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.930 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.931 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.932 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.933 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.934 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.935 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:53:00.937 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.938 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.939 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.940 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:53:00.941 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.942 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.943 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.944 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.945 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:53:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:53:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.963 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:53:00.964 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:00.965 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.966 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.967 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.968 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.969 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:53:00.970 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:53:00.971 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:00.972 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:00.973 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2cc06a430 msgr2=0x7fc2cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8036000 tx=0x7fc2d803b040 comp rx=0 tx=0).stop 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2e806e410 msgr2=0x7fc2e815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2e806e410 0x7fc2e815a6b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400ec40 tx=0x7fc2e400c520 comp rx=0 tx=0).stop 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 shutdown_connections 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2e8161540 0x7fc2e815f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8157aa0 0x7fc2e8153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 --2- 172.21.15.113:0/2115794148 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2e806e410 0x7fc2e815a6b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 >> 172.21.15.113:0/2115794148 conn(0x7fc2e80cbb70 msgr2=0x7fc2e806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:00.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.899+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 shutdown_connections 2023-12-19T13:53:00.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:00.900+0000 7fc2ef30a640 1 -- 172.21.15.113:0/2115794148 wait complete. 2023-12-19T13:53:00.976 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:53:01.674 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:53:01.674+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-19T13:53:05.977 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:53:06.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.196+0000 7f5453cdb640 1 Processor -- start 2023-12-19T13:53:06.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.196+0000 7f5453cdb640 1 -- start start 2023-12-19T13:53:06.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.197+0000 7f5453cdb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15b170 0x7f544c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:06.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.197+0000 7f5453cdb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f544c15e640 0x7f544c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:06.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.198+0000 7f5453cdb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c161870 con 0x7f544c15ad90 2023-12-19T13:53:06.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.198+0000 7f5453cdb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c161b50 con 0x7f544c15e640 2023-12-19T13:53:06.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.198+0000 7f5453cdb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c161e30 con 0x7f544c15b170 2023-12-19T13:53:06.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.198+0000 7f5452278640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f544c15e640 0x7f544c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:06.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.198+0000 7f5451276640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15b170 0x7f544c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:06.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.198+0000 7f5452278640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f544c15e640 0x7f544c06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49758/0 (socket says 172.21.15.113:49758) 2023-12-19T13:53:06.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.198+0000 7f5452278640 1 -- 172.21.15.113:0/370860598 learned_addr learned my addr 172.21.15.113:0/370860598 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:06.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.199+0000 7f5450a75640 1 -- 172.21.15.113:0/370860598 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554682031 0 0) 0x7f544c161870 con 0x7f544c15ad90 2023-12-19T13:53:06.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.199+0000 7f5451276640 1 -- 172.21.15.113:0/370860598 >> v2:172.21.15.151:3300/0 conn(0x7f544c15e640 msgr2=0x7f544c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:06.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.199+0000 7f5451276640 1 --2- 172.21.15.113:0/370860598 >> v2:172.21.15.151:3300/0 conn(0x7f544c15e640 0x7f544c06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.199+0000 7f5451276640 1 -- 172.21.15.113:0/370860598 >> v1:172.21.15.151:6789/0 conn(0x7f544c15ad90 legacy=0x7f544c161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:06.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.199+0000 7f5451276640 1 -- 172.21.15.113:0/370860598 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c15ec20 con 0x7f544c15b170 2023-12-19T13:53:06.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.200+0000 7f5451276640 1 --2- 172.21.15.113:0/370860598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15b170 0x7f544c06d7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f543c0097a0 tx=0x7f543c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807d6f14d41be8c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:06.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.201+0000 7f5450a75640 1 -- 172.21.15.113:0/370860598 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c031830 con 0x7f544c15b170 2023-12-19T13:53:06.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.201+0000 7f5450a75640 1 -- 172.21.15.113:0/370860598 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c031990 con 0x7f544c15b170 2023-12-19T13:53:06.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.201+0000 7f5450a75640 1 -- 172.21.15.113:0/370860598 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c031d20 con 0x7f544c15b170 2023-12-19T13:53:06.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 -- 172.21.15.113:0/370860598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15b170 msgr2=0x7f544c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:06.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 --2- 172.21.15.113:0/370860598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15b170 0x7f544c06d7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f543c0097a0 tx=0x7f543c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 -- 172.21.15.113:0/370860598 shutdown_connections 2023-12-19T13:53:06.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 --2- 172.21.15.113:0/370860598 >> v2:172.21.15.151:3300/0 conn(0x7f544c15e640 0x7f544c06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 --2- 172.21.15.113:0/370860598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15b170 0x7f544c06d7f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 -- 172.21.15.113:0/370860598 >> 172.21.15.113:0/370860598 conn(0x7f544c06a2e0 msgr2=0x7f544c06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:06.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 -- 172.21.15.113:0/370860598 shutdown_connections 2023-12-19T13:53:06.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.202+0000 7f5453cdb640 1 -- 172.21.15.113:0/370860598 wait complete. 2023-12-19T13:53:06.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.204+0000 7f5453cdb640 1 Processor -- start 2023-12-19T13:53:06.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.204+0000 7f5453cdb640 1 -- start start 2023-12-19T13:53:06.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.205+0000 7f5453cdb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15ad90 0x7f544c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:06.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.205+0000 7f5453cdb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f544c15b170 0x7f544c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.205+0000 7f5453cdb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f544c15e640 0x7f544c160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.205+0000 7f5453cdb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c1421d0 con 0x7f544c15e640 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.205+0000 7f5453cdb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c1554a0 con 0x7f544c15b170 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.205+0000 7f5453cdb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c156e20 con 0x7f544c15ad90 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f544c15e640 0x7f544c160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f544c15e640 0x7f544c160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48724/0 (socket says 172.21.15.113:48724) 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 -- 172.21.15.113:0/1001972742 learned_addr learned my addr 172.21.15.113:0/1001972742 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5451276640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f544c15b170 0x7f544c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5451a77640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15ad90 0x7f544c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 -- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15ad90 msgr2=0x7f544c141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15ad90 0x7f544c141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 -- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f544c15b170 msgr2=0x7f544c154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f544c15b170 0x7f544c154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 -- 172.21.15.113:0/1001972742 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c009400 con 0x7f544c15e640 2023-12-19T13:53:06.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5451276640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f544c15b170 0x7f544c154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:06.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.206+0000 7f5452278640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f544c15e640 0x7f544c160820 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f544400efc0 tx=0x7f544400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.207+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444009b60 con 0x7f544c15e640 2023-12-19T13:53:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.207+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400f040 con 0x7f544c15e640 2023-12-19T13:53:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.207+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444003990 con 0x7f544c15e640 2023-12-19T13:53:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.207+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c157100 con 0x7f544c15e640 2023-12-19T13:53:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.207+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c157c00 con 0x7f544c15e640 2023-12-19T13:53:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.208+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c061910 con 0x7f544c15e640 2023-12-19T13:53:06.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.209+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5444003af0 con 0x7f544c15e640 2023-12-19T13:53:06.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.210+0000 7f54427fc640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543006a430 0x7f543006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:06.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.210+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5444088ff0 con 0x7f544c15e640 2023-12-19T13:53:06.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.210+0000 7f5451a77640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543006a430 0x7f543006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:06.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.211+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=117}) v3 -- 0x7f5430071f60 con 0x7f544c15e640 2023-12-19T13:53:06.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.211+0000 7f5451a77640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543006a430 0x7f543006c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5448000f60 tx=0x7f5448009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:06.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.215+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f54440544c0 con 0x7f544c15e640 2023-12-19T13:53:06.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.407+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f544c072200 con 0x7f544c15e640 2023-12-19T13:53:06.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.409+0000 7f54427fc640 1 -- 172.21.15.113:0/1001972742 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+33774 (secure 0 0 0) 0x7f5444057ae0 con 0x7f544c15e640 2023-12-19T13:53:06.410 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:06.410 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:06.410 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 116, 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:53:04.553698+0000", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:53:06.411 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 13, 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:53:06.412 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:06.413 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:06.414 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:06.415 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:06.416 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:06.416 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:06.416 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:06.416 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:06.416 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:06.416 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:06.417 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:06.418 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:53:06.419 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 12, 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:53:06.420 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:38.334371+0000", 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:06.421 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:06.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:06.423 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:06.424 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:06.425 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:53:06.426 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.427 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.427 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:06.427 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:53:06.427 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:53:06.427 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:06.427 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:53:06.427 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 13, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:39.588248+0000", 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:06.428 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:53:06.429 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:06.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:06.431 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:06.432 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:53:06.433 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:06.434 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.435 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.436 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.437 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:53:06.437 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.437 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.437 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.437 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.437 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:53:06.437 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.439 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.440 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:53:06.441 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.442 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.443 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:53:06.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.444 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:53:06.445 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.445 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.445 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.445 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.445 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.445 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:53:06.446 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.447 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.448 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.450 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.450 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:53:06.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:06.450 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.450 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.451 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.452 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.453 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.453 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.454 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.454 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.454 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.454 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.454 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:53:06.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.455 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:53:06.456 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.456 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.456 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.456 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.457 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.457 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:53:06.457 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.458 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.458 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.458 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.458 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:53:06.458 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.458 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.459 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.459 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.459 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.459 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.459 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:53:06.460 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.460 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:53:06.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.461 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.461 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.461 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:53:06.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:06.463 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.463 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.463 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.463 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:53:06.463 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:53:06.463 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:53:06.463 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:53:06.464 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.464 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:53:06.464 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.464 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.464 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.464 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.466 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.466 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.466 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.466 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.466 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:53:06.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.468 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.468 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.468 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.468 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.468 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.468 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.469 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:53:06.469 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.469 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.469 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.469 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.469 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:53:06.470 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.470 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.470 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.470 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.470 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.470 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.470 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.471 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.471 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:53:06.471 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.471 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.471 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:53:06.472 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.472 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.472 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.472 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.472 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.473 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.473 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.473 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.473 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:53:06.473 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.473 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.474 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.474 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.474 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:53:06.474 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:06.474 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.474 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.475 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.475 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:53:06.475 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:53:06.475 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:53:06.475 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:53:06.475 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.476 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.476 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:06.476 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.476 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.476 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.476 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.477 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:06.477 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.477 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.477 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.477 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.477 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.477 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.478 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.478 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.478 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.478 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.478 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.478 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.478 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.479 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.479 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.479 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:53:06.479 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.479 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.479 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.479 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:53:06.480 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.480 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.480 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.480 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.480 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.481 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.481 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.481 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:53:06.481 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.481 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.481 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.481 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.482 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.483 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:53:06.483 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.483 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.483 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.483 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.483 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:53:06.483 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.484 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.484 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.484 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.484 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.484 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.484 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.484 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.485 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:53:06.485 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.485 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.485 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.485 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.486 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:53:06.486 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:06.486 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.486 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.486 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.486 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.487 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.488 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.489 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.490 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.491 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.492 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:53:06.493 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.493 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.493 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.493 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.493 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.493 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.493 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:53:06.494 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:06.495 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.495 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.495 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.495 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:53:06.495 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:53:06.495 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:53:06.496 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:53:06.496 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.496 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.496 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.496 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.497 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.497 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:06.497 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.497 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.497 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.497 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.497 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.498 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.499 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:53:06.500 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.500 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.500 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.500 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.500 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.500 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.501 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.501 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.501 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:53:06.501 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.501 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.501 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.502 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.502 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:53:06.502 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.502 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.502 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.502 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.502 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:53:06.503 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:06.504 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.505 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.506 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.508 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.509 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:06.510 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:06.510 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.510 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:06.510 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:53:06.510 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.510 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.511 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.511 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:06.511 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:53:06.511 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:06.511 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.511 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.511 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.512 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:53:06.512 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:53:06.512 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:53:06.512 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:53:06.512 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:06.512 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:06.513 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:06.513 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:06.513 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:06.513 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.513 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:06.513 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:53:06.513 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.514 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:06.514 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.514 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.514 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.514 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.514 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.515 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:53:06.515 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.515 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.515 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.515 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:06.515 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.515 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.516 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.517 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.518 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:53:06.520 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:53:06.521 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:06.522 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543006a430 msgr2=0x7f543006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543006a430 0x7f543006c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5448000f60 tx=0x7f5448009040 comp rx=0 tx=0).stop 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f544c15e640 msgr2=0x7f544c160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f544c15e640 0x7f544c160820 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f544400efc0 tx=0x7f544400c490 comp rx=0 tx=0).stop 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 shutdown_connections 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f543006a430 0x7f543006c8f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f544c15e640 0x7f544c160820 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f544c15b170 0x7f544c154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 --2- 172.21.15.113:0/1001972742 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f544c15ad90 0x7f544c141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:06.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 >> 172.21.15.113:0/1001972742 conn(0x7f544c06a2e0 msgr2=0x7f544c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:06.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 shutdown_connections 2023-12-19T13:53:06.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:06.412+0000 7f5453cdb640 1 -- 172.21.15.113:0/1001972742 wait complete. 2023-12-19T13:53:06.525 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T13:53:06.526 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:06.526 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:06.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:06.583 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-19T13:53:06.973 INFO:teuthology.orchestra.run.smithi113.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T13:53:06.974 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T13:53:06.974 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T13:53:06.974 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.328773 s, 159 MB/s 2023-12-19T13:53:06.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:53:06.975 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:53:07.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.183+0000 7f2e172d7640 1 Processor -- start 2023-12-19T13:53:07.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.184+0000 7f2e172d7640 1 -- start start 2023-12-19T13:53:07.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.185+0000 7f2e172d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e1015e5a0 0x7f2e100b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.185+0000 7f2e172d7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e1015f680 0x7f2e100b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.185+0000 7f2e172d7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1015ec30 con 0x7f2e100cdbf0 2023-12-19T13:53:07.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.185+0000 7f2e172d7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e100b2cc0 con 0x7f2e1015f680 2023-12-19T13:53:07.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.185+0000 7f2e172d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1015e980 con 0x7f2e1015e5a0 2023-12-19T13:53:07.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.186+0000 7f2e15ad4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e1015f680 0x7f2e100b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.186+0000 7f2e16ad6640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f2e100cdbf0 0x7f2e1006c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:35104/0 (socket says 172.21.15.113:35104) 2023-12-19T13:53:07.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.186+0000 7f2e162d5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e1015e5a0 0x7f2e100b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.186+0000 7f2e16ad6640 1 -- 172.21.15.113:0/838090311 learned_addr learned my addr 172.21.15.113:0/838090311 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:07.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.187+0000 7f2e162d5640 1 -- 172.21.15.113:0/838090311 >> v2:172.21.15.151:3300/0 conn(0x7f2e1015f680 msgr2=0x7f2e100b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:07.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.187+0000 7f2e162d5640 1 --2- 172.21.15.113:0/838090311 >> v2:172.21.15.151:3300/0 conn(0x7f2e1015f680 0x7f2e100b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.187+0000 7f2e162d5640 1 -- 172.21.15.113:0/838090311 >> v1:172.21.15.151:6789/0 conn(0x7f2e100cdbf0 legacy=0x7f2e1006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.187+0000 7f2e152d3640 1 -- 172.21.15.113:0/838090311 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900560753 0 0) 0x7f2e1015ec30 con 0x7f2e100cdbf0 2023-12-19T13:53:07.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.187+0000 7f2e162d5640 1 -- 172.21.15.113:0/838090311 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100b2f90 con 0x7f2e1015e5a0 2023-12-19T13:53:07.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.189+0000 7f2e162d5640 1 --2- 172.21.15.113:0/838090311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e1015e5a0 0x7f2e100b2030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0097a0 tx=0x7f2e0c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86526baf00f002e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:07.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.189+0000 7f2e152d3640 1 -- 172.21.15.113:0/838090311 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c031830 con 0x7f2e1015e5a0 2023-12-19T13:53:07.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.189+0000 7f2e152d3640 1 -- 172.21.15.113:0/838090311 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c031990 con 0x7f2e1015e5a0 2023-12-19T13:53:07.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e152d3640 1 -- 172.21.15.113:0/838090311 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c031d20 con 0x7f2e1015e5a0 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 -- 172.21.15.113:0/838090311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e1015e5a0 msgr2=0x7f2e100b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 --2- 172.21.15.113:0/838090311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e1015e5a0 0x7f2e100b2030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0097a0 tx=0x7f2e0c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 -- 172.21.15.113:0/838090311 shutdown_connections 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 --2- 172.21.15.113:0/838090311 >> v2:172.21.15.151:3300/0 conn(0x7f2e1015f680 0x7f2e100b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 --2- 172.21.15.113:0/838090311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e1015e5a0 0x7f2e100b2030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 -- 172.21.15.113:0/838090311 >> 172.21.15.113:0/838090311 conn(0x7f2e100b0100 msgr2=0x7f2e100b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 -- 172.21.15.113:0/838090311 shutdown_connections 2023-12-19T13:53:07.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.190+0000 7f2e172d7640 1 -- 172.21.15.113:0/838090311 wait complete. 2023-12-19T13:53:07.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.192+0000 7f2e172d7640 1 Processor -- start 2023-12-19T13:53:07.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.193+0000 7f2e172d7640 1 -- start start 2023-12-19T13:53:07.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e172d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e100cdbf0 0x7f2e10150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e172d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e1015e5a0 0x7f2e1006f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e172d7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e1015f680 0x7f2e1006f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e172d7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e101f6100 con 0x7f2e1015f680 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e172d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e101512a0 con 0x7f2e1015e5a0 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e172d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e101f63a0 con 0x7f2e100cdbf0 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e16ad6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e1015f680 0x7f2e1006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e16ad6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e1015f680 0x7f2e1006f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48726/0 (socket says 172.21.15.113:48726) 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e16ad6640 1 -- 172.21.15.113:0/2443000525 learned_addr learned my addr 172.21.15.113:0/2443000525 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e15ad4640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e1015e5a0 0x7f2e1006f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.194+0000 7f2e162d5640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e100cdbf0 0x7f2e10150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e16ad6640 1 -- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e100cdbf0 msgr2=0x7f2e10150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e16ad6640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e100cdbf0 0x7f2e10150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e16ad6640 1 -- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e1015e5a0 msgr2=0x7f2e1006f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e16ad6640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e1015e5a0 0x7f2e1006f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e16ad6640 1 -- 172.21.15.113:0/2443000525 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c009400 con 0x7f2e1015f680 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e15ad4640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e1015e5a0 0x7f2e1006f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e16ad6640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e1015f680 0x7f2e1006f730 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c7e0 tx=0x7f2e0800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800a640 con 0x7f2e1015f680 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0800a7c0 con 0x7f2e1015f680 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800ab70 con 0x7f2e1015f680 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.195+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e101f6680 con 0x7f2e1015f680 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.196+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e101f6c40 con 0x7f2e1015f680 2023-12-19T13:53:07.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.197+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e101f6e80 con 0x7f2e1015f680 2023-12-19T13:53:07.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.198+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2e0800acd0 con 0x7f2e1015f680 2023-12-19T13:53:07.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.199+0000 7f2e06ffd640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2df406a430 0x7f2df406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.199+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e08087f70 con 0x7f2e1015f680 2023-12-19T13:53:07.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.199+0000 7f2e162d5640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2df406a430 0x7f2df406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.199+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=117}) v3 -- 0x7f2df4071f60 con 0x7f2e1015f680 2023-12-19T13:53:07.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.200+0000 7f2e162d5640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2df406a430 0x7f2df406c8f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c036000 tx=0x7f2e0c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:07.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.203+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2e08018020 con 0x7f2e1015f680 2023-12-19T13:53:07.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.397+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2e10061910 con 0x7f2e1015f680 2023-12-19T13:53:07.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.400+0000 7f2e06ffd640 1 -- 172.21.15.113:0/2443000525 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+33774 (secure 0 0 0) 0x7f2e101f6e80 con 0x7f2e1015f680 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 116, 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:53:04.553698+0000", 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:53:07.401 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:53:07.402 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 13, 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:07.403 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:53:07.404 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:07.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:07.406 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:07.407 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.408 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 12, 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:38.334371+0000", 2023-12-19T13:53:07.409 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:53:07.410 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:07.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:07.412 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:07.413 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:07.414 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.415 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 13, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:39.588248+0000", 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:07.416 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.417 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:07.418 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:07.419 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:53:07.420 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:07.421 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.422 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:53:07.423 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:53:07.425 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:07.426 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.427 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.427 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.427 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:53:07.427 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.429 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.430 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.431 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.432 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:53:07.433 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:53:07.434 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.435 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.436 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.437 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:53:07.440 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.441 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.442 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:53:07.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:53:07.445 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.446 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.447 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.451 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.452 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:53:07.453 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.454 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:53:07.457 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.458 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.459 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.462 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:07.463 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:07.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.468 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:07.469 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.470 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.471 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.472 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:53:07.473 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:07.474 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:07.475 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:53:07.476 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:53:07.477 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:53:07.478 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:53:07.478 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:53:07.478 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:53:07.478 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:53:07.478 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:53:07.478 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:07.478 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.402+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2df406a430 msgr2=0x7f2df406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.402+0000 7f2e172d7640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2df406a430 0x7f2df406c8f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c036000 tx=0x7f2e0c03c040 comp rx=0 tx=0).stop 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e1015f680 msgr2=0x7f2e1006f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e1015f680 0x7f2e1006f730 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c7e0 tx=0x7f2e0800cca0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 shutdown_connections 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2df406a430 0x7f2df406c8f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e1015f680 0x7f2e1006f730 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e1015e5a0 0x7f2e1006f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 --2- 172.21.15.113:0/2443000525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e100cdbf0 0x7f2e10150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 >> 172.21.15.113:0/2443000525 conn(0x7f2e100b0100 msgr2=0x7f2e1015add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 shutdown_connections 2023-12-19T13:53:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.403+0000 7f2e172d7640 1 -- 172.21.15.113:0/2443000525 wait complete. 2023-12-19T13:53:07.481 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.702+0000 7fc3a010a640 1 Processor -- start 2023-12-19T13:53:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.702+0000 7fc3a010a640 1 -- start start 2023-12-19T13:53:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.703+0000 7fc3a010a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3981449e0 0x7fc3980af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.703+0000 7fc3a010a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3980b0b50 0x7fc39806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.704+0000 7fc3a010a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3980afb10 con 0x7fc39806b590 2023-12-19T13:53:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.704+0000 7fc3a010a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39806bb30 con 0x7fc3981449e0 2023-12-19T13:53:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.704+0000 7fc3a010a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980b0070 con 0x7fc3980b0b50 2023-12-19T13:53:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.704+0000 7fc39dea6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3981449e0 0x7fc3980af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.704+0000 7fc39d6a5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3980b0b50 0x7fc39806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.704+0000 7fc39dea6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3981449e0 0x7fc3980af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:49792/0 (socket says 172.21.15.113:49792) 2023-12-19T13:53:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.704+0000 7fc39dea6640 1 -- 172.21.15.113:0/1769195748 learned_addr learned my addr 172.21.15.113:0/1769195748 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.705+0000 7fc39cea4640 1 -- 172.21.15.113:0/1769195748 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235805374 0 0) 0x7fc3980afb10 con 0x7fc39806b590 2023-12-19T13:53:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.705+0000 7fc39cea4640 1 -- 172.21.15.113:0/1769195748 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc384003520 con 0x7fc39806b590 2023-12-19T13:53:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.705+0000 7fc39d6a5640 1 -- 172.21.15.113:0/1769195748 >> v2:172.21.15.151:3300/0 conn(0x7fc3981449e0 msgr2=0x7fc3980af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.705+0000 7fc39d6a5640 1 --2- 172.21.15.113:0/1769195748 >> v2:172.21.15.151:3300/0 conn(0x7fc3981449e0 0x7fc3980af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.705+0000 7fc39d6a5640 1 -- 172.21.15.113:0/1769195748 >> v1:172.21.15.151:6789/0 conn(0x7fc39806b590 legacy=0x7fc39815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.705+0000 7fc39d6a5640 1 -- 172.21.15.113:0/1769195748 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980b0350 con 0x7fc3980b0b50 2023-12-19T13:53:07.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.707+0000 7fc39d6a5640 1 --2- 172.21.15.113:0/1769195748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3980b0b50 0x7fc39806bfa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3880097a0 tx=0x7fc38802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=551f58c7a582739 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:07.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.707+0000 7fc39cea4640 1 -- 172.21.15.113:0/1769195748 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388031830 con 0x7fc3980b0b50 2023-12-19T13:53:07.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.707+0000 7fc39cea4640 1 -- 172.21.15.113:0/1769195748 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388031990 con 0x7fc3980b0b50 2023-12-19T13:53:07.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.707+0000 7fc39cea4640 1 -- 172.21.15.113:0/1769195748 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388031d00 con 0x7fc3980b0b50 2023-12-19T13:53:07.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 -- 172.21.15.113:0/1769195748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3980b0b50 msgr2=0x7fc39806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 --2- 172.21.15.113:0/1769195748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3980b0b50 0x7fc39806bfa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3880097a0 tx=0x7fc38802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 -- 172.21.15.113:0/1769195748 shutdown_connections 2023-12-19T13:53:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 --2- 172.21.15.113:0/1769195748 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3980b0b50 0x7fc39806bfa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 --2- 172.21.15.113:0/1769195748 >> v2:172.21.15.151:3300/0 conn(0x7fc3981449e0 0x7fc3980af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 -- 172.21.15.113:0/1769195748 >> 172.21.15.113:0/1769195748 conn(0x7fc3980cbb70 msgr2=0x7fc3980cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 -- 172.21.15.113:0/1769195748 shutdown_connections 2023-12-19T13:53:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.708+0000 7fc3a010a640 1 -- 172.21.15.113:0/1769195748 wait complete. 2023-12-19T13:53:07.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.710+0000 7fc3a010a640 1 Processor -- start 2023-12-19T13:53:07.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.710+0000 7fc3a010a640 1 -- start start 2023-12-19T13:53:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc3a010a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc39806b590 0x7fc39813aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc3a010a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3980b0b50 0x7fc398151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc3a010a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3981449e0 0x7fc3981f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc3a010a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc398154410 con 0x7fc3980b0b50 2023-12-19T13:53:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc3a010a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39815d000 con 0x7fc39806b590 2023-12-19T13:53:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc3a010a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39815d2e0 con 0x7fc3981449e0 2023-12-19T13:53:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc39d6a5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3980b0b50 0x7fc398151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc39d6a5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3980b0b50 0x7fc398151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48740/0 (socket says 172.21.15.113:48740) 2023-12-19T13:53:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.711+0000 7fc39d6a5640 1 -- 172.21.15.113:0/3564803278 learned_addr learned my addr 172.21.15.113:0/3564803278 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39dea6640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc39806b590 0x7fc39813aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39e6a7640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3981449e0 0x7fc3981f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39d6a5640 1 -- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3981449e0 msgr2=0x7fc3981f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39d6a5640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3981449e0 0x7fc3981f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39d6a5640 1 -- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc39806b590 msgr2=0x7fc39813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39d6a5640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc39806b590 0x7fc39813aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39d6a5640 1 -- 172.21.15.113:0/3564803278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388009400 con 0x7fc3980b0b50 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39e6a7640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3981449e0 0x7fc3981f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc39d6a5640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3980b0b50 0x7fc398151640 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc3880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38803a630 con 0x7fc3980b0b50 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38803a790 con 0x7fc3980b0b50 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38803ab20 con 0x7fc3980b0b50 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.712+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39815d5c0 con 0x7fc3980b0b50 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.713+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3981540e0 con 0x7fc3980b0b50 2023-12-19T13:53:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.714+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc398061910 con 0x7fc3980b0b50 2023-12-19T13:53:07.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.715+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc38803ac80 con 0x7fc3980b0b50 2023-12-19T13:53:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.715+0000 7fc38e7fc640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc37c06a430 0x7fc37c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.716+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3880aa110 con 0x7fc3980b0b50 2023-12-19T13:53:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.716+0000 7fc39dea6640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc37c06a430 0x7fc37c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.716+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=117}) v3 -- 0x7fc37c071f60 con 0x7fc3980b0b50 2023-12-19T13:53:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.717+0000 7fc39dea6640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc37c06a430 0x7fc37c06c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc394009b60 tx=0x7fc394008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.720+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc388035060 con 0x7fc3980b0b50 2023-12-19T13:53:07.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.946+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3980ae560 con 0x7fc3980b0b50 2023-12-19T13:53:07.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.947+0000 7fc38e7fc640 1 -- 172.21.15.113:0/3564803278 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fc388048020 con 0x7fc3980b0b50 2023-12-19T13:53:07.947 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:07.947 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:53:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:53:07.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.949+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc37c06a430 msgr2=0x7fc37c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.949+0000 7fc3a010a640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc37c06a430 0x7fc37c06c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc394009b60 tx=0x7fc394008040 comp rx=0 tx=0).stop 2023-12-19T13:53:07.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.949+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3980b0b50 msgr2=0x7fc398151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:07.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.949+0000 7fc3a010a640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3980b0b50 0x7fc398151640 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc3880046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 shutdown_connections 2023-12-19T13:53:07.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc37c06a430 0x7fc37c06c8f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3981449e0 0x7fc3981f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3980b0b50 0x7fc398151640 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 --2- 172.21.15.113:0/3564803278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc39806b590 0x7fc39813aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:07.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 >> 172.21.15.113:0/3564803278 conn(0x7fc3980cbb70 msgr2=0x7fc39806f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:07.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 shutdown_connections 2023-12-19T13:53:07.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:07.950+0000 7fc3a010a640 1 -- 172.21.15.113:0/3564803278 wait complete. 2023-12-19T13:53:07.967 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:53:08.195 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":6900,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":27.607311499000001,"mdsmap_epoch":49,"osdmap_epoch":116,"osdmap_epoch_barrier":116,"uptime":33.251507678999999} 2023-12-19T13:53:08.195 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 6900, "mdsmap_epoch": 49, "osdmap_epoch": 116, "osdmap_epoch_barrier": 116, "rank_uptime": 27.607311499, "state": "up:active", "uptime": 33.251507679, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:53:08.195 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:53:08.195 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:08.195 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:08.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:08.248 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-19T13:53:08.348 INFO:teuthology.orchestra.run.smithi113.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-19T13:53:08.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:53:08.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:08.349 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T13:53:08.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:08.405 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T13:53:08.543 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:53:08.550 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:53:08.550+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-19T13:53:08.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.749+0000 7f8f7fd00640 1 Processor -- start 2023-12-19T13:53:08.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.749+0000 7f8f7fd00640 1 -- start start 2023-12-19T13:53:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.750+0000 7f8f7fd00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f780b0b50 0x7f8f7806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.751+0000 7f8f7fd00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f7806b590 0x7f8f7806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.751+0000 7f8f7fd00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7806bb30 con 0x7f8f781449e0 2023-12-19T13:53:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.751+0000 7f8f7fd00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f780b0070 con 0x7f8f780b0b50 2023-12-19T13:53:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.751+0000 7f8f7fd00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780b0350 con 0x7f8f7806b590 2023-12-19T13:53:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.751+0000 7f8f7d29b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f780b0b50 0x7f8f7806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.751+0000 7f8f7e29d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f7806b590 0x7f8f7806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7d29b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f780b0b50 0x7f8f7806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:36778/0 (socket says 172.21.15.113:36778) 2023-12-19T13:53:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7e29d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f7806b590 0x7f8f7806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:33276/0 (socket says 172.21.15.113:33276) 2023-12-19T13:53:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7d29b640 1 -- 172.21.15.113:0/2252060403 learned_addr learned my addr 172.21.15.113:0/2252060403 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7da9c640 1 --1- 172.21.15.113:0/2252060403 >> v1:172.21.15.151:6789/0 conn(0x7f8f781449e0 0x7f8f780af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:48468/0 (socket says 172.21.15.113:48468) 2023-12-19T13:53:08.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7d29b640 1 -- 172.21.15.113:0/2252060403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f7806b590 msgr2=0x7f8f7806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7d29b640 1 --2- 172.21.15.113:0/2252060403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f7806b590 0x7f8f7806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7d29b640 1 -- 172.21.15.113:0/2252060403 >> v1:172.21.15.151:6789/0 conn(0x7f8f781449e0 legacy=0x7f8f780af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:08.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.752+0000 7f8f7d29b640 1 -- 172.21.15.113:0/2252060403 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780b0630 con 0x7f8f780b0b50 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.754+0000 7f8f7d29b640 1 --2- 172.21.15.113:0/2252060403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f780b0b50 0x7f8f7806bfa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009870 tx=0x7f8f6802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=353c9e56e88d040e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.754+0000 7f8f7ca9a640 1 -- 172.21.15.113:0/2252060403 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68030840 con 0x7f8f780b0b50 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7ca9a640 1 -- 172.21.15.113:0/2252060403 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680309a0 con 0x7f8f780b0b50 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7ca9a640 1 -- 172.21.15.113:0/2252060403 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68030d30 con 0x7f8f780b0b50 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7fd00640 1 -- 172.21.15.113:0/2252060403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f780b0b50 msgr2=0x7f8f7806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/2252060403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f780b0b50 0x7f8f7806bfa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009870 tx=0x7f8f6802b980 comp rx=0 tx=0).stop 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7fd00640 1 -- 172.21.15.113:0/2252060403 shutdown_connections 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/2252060403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f7806b590 0x7f8f7806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/2252060403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f780b0b50 0x7f8f7806bfa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:08.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.755+0000 7f8f7fd00640 1 -- 172.21.15.113:0/2252060403 >> 172.21.15.113:0/2252060403 conn(0x7f8f780cbb70 msgr2=0x7f8f780cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:08.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.756+0000 7f8f7fd00640 1 -- 172.21.15.113:0/2252060403 shutdown_connections 2023-12-19T13:53:08.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.756+0000 7f8f7fd00640 1 -- 172.21.15.113:0/2252060403 wait complete. 2023-12-19T13:53:08.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.758+0000 7f8f7fd00640 1 Processor -- start 2023-12-19T13:53:08.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.758+0000 7f8f7fd00640 1 -- start start 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7fd00640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f7806b590 0x7f8f7813ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7fd00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f780b0b50 0x7f8f7813c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7fd00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f781449e0 0x7f8f7813dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7fd00640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7813ca60 con 0x7f8f7806b590 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7fd00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7813d8a0 con 0x7f8f781449e0 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7fd00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7813cc90 con 0x7f8f780b0b50 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7da9c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f7806b590 0x7f8f7813ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7da9c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f7806b590 0x7f8f7813ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56994/0 (socket says 172.21.15.113:56994) 2023-12-19T13:53:08.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.759+0000 7f8f7da9c640 1 -- 172.21.15.113:0/700320237 learned_addr learned my addr 172.21.15.113:0/700320237 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7e29d640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f781449e0 0x7f8f7813dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7d29b640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f780b0b50 0x7f8f7813c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7da9c640 1 -- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f780b0b50 msgr2=0x7f8f7813c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7da9c640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f780b0b50 0x7f8f7813c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7da9c640 1 -- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f781449e0 msgr2=0x7f8f7813dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7da9c640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f781449e0 0x7f8f7813dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7da9c640 1 -- 172.21.15.113:0/700320237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f680094d0 con 0x7f8f7806b590 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7e29d640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f781449e0 0x7f8f7813dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7da9c640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f7806b590 0x7f8f7813ab90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c3e0 tx=0x7f8f7400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740074e0 con 0x7f8f7806b590 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f74007640 con 0x7f8f7806b590 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7813cf70 con 0x7f8f7806b590 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.760+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740049e0 con 0x7f8f7806b590 2023-12-19T13:53:08.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.761+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7813d530 con 0x7f8f7806b590 2023-12-19T13:53:08.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.762+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7813d6c0 con 0x7f8f7806b590 2023-12-19T13:53:08.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.763+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f74004b40 con 0x7f8f7806b590 2023-12-19T13:53:08.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.763+0000 7f8f6e7fc640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:08.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.764+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f740883d0 con 0x7f8f7806b590 2023-12-19T13:53:08.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.764+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=118}) v3 -- 0x7f8f5c071f60 con 0x7f8f7806b590 2023-12-19T13:53:08.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.764+0000 7f8f7d29b640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:08.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.765+0000 7f8f7d29b640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8f68036000 tx=0x7f8f6803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:08.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.769+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f74053920 con 0x7f8f7806b590 2023-12-19T13:53:08.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.965+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8f78061910 con 0x7f8f7806b590 2023-12-19T13:53:08.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.969+0000 7f8f6e7fc640 1 -- 172.21.15.113:0/700320237 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v117) v1 ==== 81+0+33742 (secure 0 0 0) 0x7f8f74056f40 con 0x7f8f7806b590 2023-12-19T13:53:08.969 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 117, 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:53:08.571971+0000", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:53:08.970 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 13, 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:53:08.971 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:08.972 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:08.973 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:08.974 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:08.976 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:53:08.977 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 12, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:38.334371+0000", 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:08.978 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:08.979 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:08.980 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:08.981 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:08.982 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:53:08.983 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 13, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:39.588248+0000", 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:08.984 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:08.985 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:08.986 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:08.987 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:08.988 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:53:08.989 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:08.990 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:08.991 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:08.992 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:53:08.993 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:53:08.994 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.995 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.996 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.997 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:53:08.998 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:08.999 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:09.000 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:09.001 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.002 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.003 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.004 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.005 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:53:09.006 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:09.007 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:53:09.008 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.010 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.011 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.012 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:09.013 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.015 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.016 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:09.017 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:09.018 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.019 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.021 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.022 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:09.023 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.024 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:53:09.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.027 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:09.028 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:09.029 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.031 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:09.032 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:53:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:53:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:53:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.038 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:09.039 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:53:09.040 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:53:09.041 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:53:09.042 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:53:09.042 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:09.042 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:09.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f5c06a430 msgr2=0x7f8f5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8f68036000 tx=0x7f8f6803b040 comp rx=0 tx=0).stop 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f7806b590 msgr2=0x7f8f7813ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f7806b590 0x7f8f7813ab90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c3e0 tx=0x7f8f7400c8a0 comp rx=0 tx=0).stop 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 shutdown_connections 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f781449e0 0x7f8f7813dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f780b0b50 0x7f8f7813c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 --2- 172.21.15.113:0/700320237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8f7806b590 0x7f8f7813ab90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.971+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 >> 172.21.15.113:0/700320237 conn(0x7f8f780cbb70 msgr2=0x7f8f780cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.972+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 shutdown_connections 2023-12-19T13:53:09.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:08.972+0000 7f8f7fd00640 1 -- 172.21.15.113:0/700320237 wait complete. 2023-12-19T13:53:09.045 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:53:13.614 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:53:13.613+0000 7f386b504640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-19T13:53:14.046 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:53:14.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.268+0000 7fa064bc6640 1 Processor -- start 2023-12-19T13:53:14.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.268+0000 7fa064bc6640 1 -- start start 2023-12-19T13:53:14.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.269+0000 7fa064bc6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0601599c0 0x7fa06015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:14.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.269+0000 7fa064bc6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa06006e190 0x7fa0600cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:14.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa064bc6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa0600af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:14.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa064bc6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06015daa0 con 0x7fa06006e190 2023-12-19T13:53:14.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa064bc6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600aff30 con 0x7fa0601599c0 2023-12-19T13:53:14.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa064bc6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015e400 con 0x7fa0600af540 2023-12-19T13:53:14.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa055d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa06006e190 0x7fa0600cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:14.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa055d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa06006e190 0x7fa0600cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57000/0 (socket says 172.21.15.113:57000) 2023-12-19T13:53:14.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa055d9b640 1 -- 172.21.15.113:0/194114909 learned_addr learned my addr 172.21.15.113:0/194114909 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:14.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa05e59c640 1 --2- 172.21.15.113:0/194114909 >> v2:172.21.15.151:3300/0 conn(0x7fa0601599c0 0x7fa06015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:14.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.270+0000 7fa05ed9d640 1 --2- 172.21.15.113:0/194114909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa0600af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:14.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.271+0000 7fa055d9b640 1 -- 172.21.15.113:0/194114909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 msgr2=0x7fa0600af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:14.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.271+0000 7fa055d9b640 1 --2- 172.21.15.113:0/194114909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa0600af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.271+0000 7fa055d9b640 1 -- 172.21.15.113:0/194114909 >> v2:172.21.15.151:3300/0 conn(0x7fa0601599c0 msgr2=0x7fa06015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:14.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.271+0000 7fa055d9b640 1 --2- 172.21.15.113:0/194114909 >> v2:172.21.15.151:3300/0 conn(0x7fa0601599c0 0x7fa06015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.271+0000 7fa055d9b640 1 -- 172.21.15.113:0/194114909 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600ce780 con 0x7fa06006e190 2023-12-19T13:53:14.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.272+0000 7fa055d9b640 1 --2- 172.21.15.113:0/194114909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa06006e190 0x7fa0600cdea0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa0600b0e40 tx=0x7fa04802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911430b244c3cb75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:14.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.272+0000 7fa05dd9b640 1 -- 172.21.15.113:0/194114909 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048031750 con 0x7fa06006e190 2023-12-19T13:53:14.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.272+0000 7fa05dd9b640 1 -- 172.21.15.113:0/194114909 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0480318b0 con 0x7fa06006e190 2023-12-19T13:53:14.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.272+0000 7fa05dd9b640 1 -- 172.21.15.113:0/194114909 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048031c40 con 0x7fa06006e190 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 -- 172.21.15.113:0/194114909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa06006e190 msgr2=0x7fa0600cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 --2- 172.21.15.113:0/194114909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa06006e190 0x7fa0600cdea0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa0600b0e40 tx=0x7fa04802b7f0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 -- 172.21.15.113:0/194114909 shutdown_connections 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 --2- 172.21.15.113:0/194114909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa0600af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 --2- 172.21.15.113:0/194114909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa06006e190 0x7fa0600cdea0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 --2- 172.21.15.113:0/194114909 >> v2:172.21.15.151:3300/0 conn(0x7fa0601599c0 0x7fa06015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 -- 172.21.15.113:0/194114909 >> 172.21.15.113:0/194114909 conn(0x7fa0600cbb70 msgr2=0x7fa0600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 -- 172.21.15.113:0/194114909 shutdown_connections 2023-12-19T13:53:14.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.273+0000 7fa064bc6640 1 -- 172.21.15.113:0/194114909 wait complete. 2023-12-19T13:53:14.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.275+0000 7fa064bc6640 1 Processor -- start 2023-12-19T13:53:14.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.275+0000 7fa064bc6640 1 -- start start 2023-12-19T13:53:14.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa064bc6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa06006e190 0x7fa060147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:14.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa064bc6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa060159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:14.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa064bc6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0601599c0 0x7fa060143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:14.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa064bc6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015b860 con 0x7fa0601599c0 2023-12-19T13:53:14.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa064bc6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015a520 con 0x7fa06006e190 2023-12-19T13:53:14.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa064bc6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015a7c0 con 0x7fa0600af540 2023-12-19T13:53:14.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0601599c0 0x7fa060143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:14.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0601599c0 0x7fa060143230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57002/0 (socket says 172.21.15.113:57002) 2023-12-19T13:53:14.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa05ed9d640 1 -- 172.21.15.113:0/3965530234 learned_addr learned my addr 172.21.15.113:0/3965530234 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:14.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa055d9b640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa060159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:14.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.276+0000 7fa05e59c640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa06006e190 0x7fa060147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:14.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa05ed9d640 1 -- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 msgr2=0x7fa060159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:14.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa05ed9d640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa060159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa05ed9d640 1 -- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa06006e190 msgr2=0x7fa060147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:14.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa05ed9d640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa06006e190 0x7fa060147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa05ed9d640 1 -- 172.21.15.113:0/3965530234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480094d0 con 0x7fa0601599c0 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa055d9b640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa060159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa05ed9d640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0601599c0 0x7fa060143230 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa058007d20 tx=0x7fa05800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058014420 con 0x7fa0601599c0 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0580145a0 con 0x7fa0601599c0 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06015aaa0 con 0x7fa0601599c0 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058014950 con 0x7fa0601599c0 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.277+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06015b060 con 0x7fa0601599c0 2023-12-19T13:53:14.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.278+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa060061910 con 0x7fa0601599c0 2023-12-19T13:53:14.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.280+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa058014ab0 con 0x7fa0601599c0 2023-12-19T13:53:14.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.281+0000 7fa0577fe640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa04006a430 0x7fa04006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:14.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.281+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa058089130 con 0x7fa0601599c0 2023-12-19T13:53:14.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.281+0000 7fa05e59c640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa04006a430 0x7fa04006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:14.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.281+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=120}) v3 -- 0x7fa040071f60 con 0x7fa0601599c0 2023-12-19T13:53:14.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.282+0000 7fa05e59c640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa04006a430 0x7fa04006c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa050006fd0 tx=0x7fa050008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:14.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.288+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa0580547b0 con 0x7fa0601599c0 2023-12-19T13:53:14.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.479+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa0600b1140 con 0x7fa0601599c0 2023-12-19T13:53:14.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.481+0000 7fa0577fe640 1 -- 172.21.15.113:0/3965530234 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v119) v1 ==== 81+0+33662 (secure 0 0 0) 0x7fa058057dd0 con 0x7fa0601599c0 2023-12-19T13:53:14.482 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:14.482 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:14.482 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 119, 2023-12-19T13:53:14.482 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:14.482 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:53:14.482 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:53:13.615214+0000", 2023-12-19T13:53:14.482 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:53:14.483 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 13, 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:14.484 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:53:14.485 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:14.486 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:14.487 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.488 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.489 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.490 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 12, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:38.334371+0000", 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:14.491 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:14.492 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:14.493 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:14.494 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:53:14.496 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 13, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:39.588248+0000", 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 3, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full", 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:14.497 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:14.498 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "114", 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:14.499 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:14.500 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:14.501 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:14.502 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.504 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.505 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:53:14.506 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.508 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.509 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.510 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.511 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.512 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.513 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:53:14.514 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.515 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.516 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.517 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.518 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.519 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.520 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:53:14.521 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.522 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.524 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.525 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.528 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.529 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.530 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.531 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.532 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.533 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:53:14.535 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:14.536 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:14.537 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.538 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.539 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.540 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.541 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.542 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:14.543 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:53:14.544 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.545 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.546 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.546 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.546 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.547 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.548 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "full", 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:14.549 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.550 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.551 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.552 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.553 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:53:14.555 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:14.556 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:14.557 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.483+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa04006a430 msgr2=0x7fa04006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.483+0000 7fa064bc6640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa04006a430 0x7fa04006c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa050006fd0 tx=0x7fa050008040 comp rx=0 tx=0).stop 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.483+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0601599c0 msgr2=0x7fa060143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.483+0000 7fa064bc6640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0601599c0 0x7fa060143230 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa058007d20 tx=0x7fa05800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 shutdown_connections 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa04006a430 0x7fa04006c8f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0601599c0 0x7fa060143230 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0600af540 0x7fa060159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 --2- 172.21.15.113:0/3965530234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa06006e190 0x7fa060147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:14.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 >> 172.21.15.113:0/3965530234 conn(0x7fa0600cbb70 msgr2=0x7fa0600b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:14.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 shutdown_connections 2023-12-19T13:53:14.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:14.484+0000 7fa064bc6640 1 -- 172.21.15.113:0/3965530234 wait complete. 2023-12-19T13:53:14.560 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:53:19.193 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:19.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:19.561 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:53:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.782+0000 7f83555b9640 1 Processor -- start 2023-12-19T13:53:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.782+0000 7f83555b9640 1 -- start start 2023-12-19T13:53:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.783+0000 7f83555b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 0x7f835006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.783+0000 7f83555b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500b2600 con 0x7f8350157aa0 2023-12-19T13:53:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.783+0000 7f83555b9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500b1d60 con 0x7f83500b1710 2023-12-19T13:53:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.783+0000 7f83555b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500b2040 con 0x7f835015e750 2023-12-19T13:53:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.783+0000 7f834effd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8350157aa0 0x7f8350161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57206/0 (socket says 172.21.15.113:57206) 2023-12-19T13:53:19.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.783+0000 7f834effd640 1 -- 172.21.15.113:0/3704672959 learned_addr learned my addr 172.21.15.113:0/3704672959 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834f7fe640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 0x7f835006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383119110 0 0) 0x7f83500b2600 con 0x7f8350157aa0 2023-12-19T13:53:19.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8338003520 con 0x7f8350157aa0 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268272589 0 0) 0x7f8338003520 con 0x7f8350157aa0 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 msgr2=0x7f835006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 0x7f835006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 >> v1:172.21.15.151:6789/0 conn(0x7f83500b1710 legacy=0x7f835015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500b2320 con 0x7f8350157aa0 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8340001670 con 0x7f8350157aa0 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 >> v1:172.21.15.113:6789/0 conn(0x7f8350157aa0 legacy=0x7f8350161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:19.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8338003a10 0x7f8338003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f8338004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 0x7f8338005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500b2040 con 0x7f83380047c0 2023-12-19T13:53:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833800ba80 con 0x7f8338003a10 2023-12-19T13:53:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.784+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833800bc40 con 0x7f835015e750 2023-12-19T13:53:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834e7fc640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f8338004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834effd640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8338003a10 0x7f8338003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:19.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834f7fe640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 0x7f8338005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834e7fc640 1 -- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 msgr2=0x7f8338005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834e7fc640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 0x7f8338005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834e7fc640 1 -- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8338003a10 msgr2=0x7f8338003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834e7fc640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8338003a10 0x7f8338003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834e7fc640 1 -- 172.21.15.113:0/3704672959 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338003520 con 0x7f83380047c0 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.785+0000 7f834f7fe640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835015e750 0x7f8338005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.786+0000 7f834e7fc640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f8338004c40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8344001750 tx=0x7f83380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cf7a3019808bf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.786+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440052d0 con 0x7f83380047c0 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.786+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834402e050 con 0x7f83380047c0 2023-12-19T13:53:19.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.786+0000 7f834dffb640 1 -- 172.21.15.113:0/3704672959 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440035f0 con 0x7f83380047c0 2023-12-19T13:53:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.787+0000 7f83555b9640 1 -- 172.21.15.113:0/3704672959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 msgr2=0x7f8338004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.787+0000 7f83555b9640 1 --2- 172.21.15.113:0/3704672959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f8338004c40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8344001750 tx=0x7f83380057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.787+0000 7f834f7fe640 1 -- 172.21.15.113:0/3704672959 reap_dead start 2023-12-19T13:53:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.787+0000 7f83555b9640 1 -- 172.21.15.113:0/3704672959 shutdown_connections 2023-12-19T13:53:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.787+0000 7f83555b9640 1 -- 172.21.15.113:0/3704672959 >> 172.21.15.113:0/3704672959 conn(0x7f83500cbb70 msgr2=0x7f83500cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.787+0000 7f83555b9640 1 -- 172.21.15.113:0/3704672959 shutdown_connections 2023-12-19T13:53:19.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.787+0000 7f83555b9640 1 -- 172.21.15.113:0/3704672959 wait complete. 2023-12-19T13:53:19.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.789+0000 7f83555b9640 1 Processor -- start 2023-12-19T13:53:19.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.789+0000 7f83555b9640 1 -- start start 2023-12-19T13:53:19.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f83555b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f835006c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f83555b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835013d790 0x7f8350070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f83555b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83500706b0 0x7f835015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f83555b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350070b30 con 0x7f83380047c0 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f83555b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835006be60 con 0x7f83500706b0 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f83555b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835015b070 con 0x7f835013d790 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f834effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f835006c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f834effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f835006c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48478/0 (socket says 172.21.15.113:48478) 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.790+0000 7f834effd640 1 -- 172.21.15.113:0/3222865245 learned_addr learned my addr 172.21.15.113:0/3222865245 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f834effd640 1 -- 172.21.15.113:0/3222865245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835013d790 msgr2=0x7f8350070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f834effd640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835013d790 0x7f8350070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f834effd640 1 -- 172.21.15.113:0/3222865245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83500706b0 msgr2=0x7f835015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f834effd640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83500706b0 0x7f835015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f834effd640 1 -- 172.21.15.113:0/3222865245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835006b530 con 0x7f83380047c0 2023-12-19T13:53:19.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f834effd640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f835006c2f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f834000d750 tx=0x7f834000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f83377fe640 1 -- 172.21.15.113:0/3222865245 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400074e0 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f83377fe640 1 -- 172.21.15.113:0/3222865245 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340007640 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f83377fe640 1 -- 172.21.15.113:0/3222865245 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400049e0 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835006b810 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.791+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835013dc10 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.792+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8350061910 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.794+0000 7f83377fe640 1 -- 172.21.15.113:0/3222865245 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8340004b40 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.794+0000 7f83377fe640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f833c06a430 0x7f833c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.794+0000 7f83377fe640 1 -- 172.21.15.113:0/3222865245 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8340088070 con 0x7f83380047c0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.794+0000 7f834e7fc640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f833c06a430 0x7f833c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:19.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.795+0000 7f834e7fc640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f833c06a430 0x7f833c06c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8344033000 tx=0x7f834402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:19.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.799+0000 7f83377fe640 1 -- 172.21.15.113:0/3222865245 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f83400bac80 con 0x7f83380047c0 2023-12-19T13:53:19.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.991+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f835006db20 con 0x7f83380047c0 2023-12-19T13:53:19.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.993+0000 7f83377fe640 1 -- 172.21.15.113:0/3222865245 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v120) v1 ==== 81+0+33599 (secure 0 0 0) 0x7f8340019090 con 0x7f83380047c0 2023-12-19T13:53:19.994 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:19.994 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:19.994 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 120, 2023-12-19T13:53:19.994 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:19.994 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:53:14.625779+0000", 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:53:19.995 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:53:19.996 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 13, 2023-12-19T13:53:19.997 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:53:19.997 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:53:19.997 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:53:19.997 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:53:19.997 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:53:19.997 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:19.998 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:19.999 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:20.000 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:20.001 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:20.001 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:20.001 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:20.001 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.001 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:53:20.001 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:20.002 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:20.002 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:20.002 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:20.002 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:20.002 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:20.002 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:20.003 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:20.003 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:20.003 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:20.003 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:20.003 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:20.003 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:20.003 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:20.004 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:20.005 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:20.005 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:20.005 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:20.005 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.005 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:20.005 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:20.006 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:20.006 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:20.006 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:20.006 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:20.006 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:20.006 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:20.006 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:20.007 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:20.007 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:20.007 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:20.007 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:53:20.007 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:53:20.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:53:20.008 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 12, 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:38.334371+0000", 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:20.009 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:20.010 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:20.011 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:20.013 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:20.014 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:53:20.015 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 13, 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:39.588248+0000", 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:20.016 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:53:20.017 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:20.018 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:20.019 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:20.020 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:53:20.021 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:20.022 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.023 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.024 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.025 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.026 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.027 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.028 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.029 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.030 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:53:20.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.031 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.031 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.031 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.031 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:53:20.031 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.032 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.033 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.034 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.035 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.036 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.037 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.038 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.039 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:53:20.040 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.040 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.040 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.040 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.040 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:53:20.040 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:53:20.040 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:53:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:53:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.042 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:20.042 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.042 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.042 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.042 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.042 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.042 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.043 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.043 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.043 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.043 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.043 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.043 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.043 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.044 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:53:20.045 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.046 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.047 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:20.048 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.049 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.050 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:53:20.051 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.052 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.053 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.054 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.055 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.056 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.057 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.058 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:53:20.059 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.060 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.061 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.062 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.063 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.064 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.064 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.064 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:53:20.064 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.064 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.064 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.064 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:53:20.065 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.066 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:53:20.067 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.068 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.069 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.070 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.071 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.072 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.073 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:53:20.074 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.075 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:20.076 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.077 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.079 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.080 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.081 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.082 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.083 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:53:20.084 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:53:20.085 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:53:20.085 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:53:20.085 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:53:20.085 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:53:20.085 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:53:20.085 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.086 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.086 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:53:20.086 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:53:20.086 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:53:20.086 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:53:20.086 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:53:20.087 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:53:20.087 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:53:20.087 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:53:20.087 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:53:20.087 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:53:20.087 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:53:20.087 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.088 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.996+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f833c06a430 msgr2=0x7f833c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.996+0000 7f83555b9640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f833c06a430 0x7f833c06c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8344033000 tx=0x7f834402f000 comp rx=0 tx=0).stop 2023-12-19T13:53:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.996+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 msgr2=0x7f835006c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.996+0000 7f83555b9640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f835006c2f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f834000d750 tx=0x7f834000dc10 comp rx=0 tx=0).stop 2023-12-19T13:53:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 shutdown_connections 2023-12-19T13:53:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f833c06a430 0x7f833c06c8f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83500706b0 0x7f835015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f835013d790 0x7f8350070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 --2- 172.21.15.113:0/3222865245 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83380047c0 0x7f835006c2f0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 >> 172.21.15.113:0/3222865245 conn(0x7f83500cbb70 msgr2=0x7f8350156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 shutdown_connections 2023-12-19T13:53:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:19.997+0000 7f83555b9640 1 -- 172.21.15.113:0/3222865245 wait complete. 2023-12-19T13:53:20.093 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T13:53:20.093 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:53:20.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.310+0000 7f98d80c7640 1 Processor -- start 2023-12-19T13:53:20.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.311+0000 7f98d80c7640 1 -- start start 2023-12-19T13:53:20.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.312+0000 7f98d80c7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98d0157bf0 0x7f98d015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.312+0000 7f98d80c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d00b0810 0x7f98d006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.312+0000 7f98d80c7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d015b740 con 0x7f98d00ae110 2023-12-19T13:53:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.312+0000 7f98d80c7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d006b8c0 con 0x7f98d0157bf0 2023-12-19T13:53:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.312+0000 7f98d80c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00ae640 con 0x7f98d00b0810 2023-12-19T13:53:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.313+0000 7f98d5e63640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98d0157bf0 0x7f98d015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.313+0000 7f98d6664640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d00b0810 0x7f98d006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.313+0000 7f98d5e63640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98d0157bf0 0x7f98d015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:42004/0 (socket says 172.21.15.113:42004) 2023-12-19T13:53:20.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.313+0000 7f98d5e63640 1 -- 172.21.15.113:0/3215944611 learned_addr learned my addr 172.21.15.113:0/3215944611 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:20.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.314+0000 7f98d5e63640 1 -- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d00b0810 msgr2=0x7f98d006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:20.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.314+0000 7f98d5e63640 1 --2- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d00b0810 0x7f98d006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.314+0000 7f98d5e63640 1 -- 172.21.15.113:0/3215944611 >> v1:172.21.15.151:6789/0 conn(0x7f98d00ae110 legacy=0x7f98d00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.314+0000 7f98d5e63640 1 -- 172.21.15.113:0/3215944611 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00ae920 con 0x7f98d0157bf0 2023-12-19T13:53:20.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.314+0000 7f98d6664640 1 --2- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d00b0810 0x7f98d006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:53:20.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.316+0000 7f98d5e63640 1 --2- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d0157bf0 0x7f98d015b200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009870 tx=0x7f98cc02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2510c3c04b40809 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:20.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.316+0000 7f98d4e61640 1 -- 172.21.15.113:0/3215944611 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc030840 con 0x7f98d0157bf0 2023-12-19T13:53:20.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.316+0000 7f98d4e61640 1 -- 172.21.15.113:0/3215944611 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc0309a0 con 0x7f98d0157bf0 2023-12-19T13:53:20.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.316+0000 7f98d4e61640 1 -- 172.21.15.113:0/3215944611 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc030d30 con 0x7f98d0157bf0 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 -- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d0157bf0 msgr2=0x7f98d015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d0157bf0 0x7f98d015b200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009870 tx=0x7f98cc02b980 comp rx=0 tx=0).stop 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 -- 172.21.15.113:0/3215944611 shutdown_connections 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d00b0810 0x7f98d006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3215944611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d0157bf0 0x7f98d015b200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 -- 172.21.15.113:0/3215944611 >> 172.21.15.113:0/3215944611 conn(0x7f98d00cbb70 msgr2=0x7f98d00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 -- 172.21.15.113:0/3215944611 shutdown_connections 2023-12-19T13:53:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.317+0000 7f98d80c7640 1 -- 172.21.15.113:0/3215944611 wait complete. 2023-12-19T13:53:20.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.318+0000 7f98d80c7640 1 Processor -- start 2023-12-19T13:53:20.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.319+0000 7f98d80c7640 1 -- start start 2023-12-19T13:53:20.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.319+0000 7f98d80c7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98d00ae110 0x7f98d014a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.319+0000 7f98d80c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d00b0810 0x7f98d0146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.319+0000 7f98d80c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d0157bf0 0x7f98d00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.319+0000 7f98d80c7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d014ae20 con 0x7f98d00ae110 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.319+0000 7f98d80c7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d014b100 con 0x7f98d00b0810 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.319+0000 7f98d80c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d014b3e0 con 0x7f98d0157bf0 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98d00ae110 0x7f98d014a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98d00ae110 0x7f98d014a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48492/0 (socket says 172.21.15.113:48492) 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 -- 172.21.15.113:0/3627571968 learned_addr learned my addr 172.21.15.113:0/3627571968 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5662640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d00b0810 0x7f98d0146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d6664640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d0157bf0 0x7f98d00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 -- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d0157bf0 msgr2=0x7f98d00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d0157bf0 0x7f98d00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 -- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d00b0810 msgr2=0x7f98d0146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d00b0810 0x7f98d0146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.320+0000 7f98d5e63640 1 -- 172.21.15.113:0/3627571968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009a70 con 0x7f98d00ae110 2023-12-19T13:53:20.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.321+0000 7f98d5e63640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98d00ae110 0x7f98d014a840 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f98cc000c00 tx=0x7f98cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:20.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.321+0000 7f98c67fc640 1 -- 172.21.15.113:0/3627571968 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc039a90 con 0x7f98d00ae110 2023-12-19T13:53:20.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.321+0000 7f98c67fc640 1 -- 172.21.15.113:0/3627571968 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc039bf0 con 0x7f98d00ae110 2023-12-19T13:53:20.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.321+0000 7f98c67fc640 1 -- 172.21.15.113:0/3627571968 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc043410 con 0x7f98d00ae110 2023-12-19T13:53:20.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.321+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc0094d0 con 0x7f98d00ae110 2023-12-19T13:53:20.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.321+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d014b9a0 con 0x7f98d00ae110 2023-12-19T13:53:20.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.322+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d014bb90 con 0x7f98d00ae110 2023-12-19T13:53:20.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.323+0000 7f98c67fc640 1 -- 172.21.15.113:0/3627571968 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f98cc02f390 con 0x7f98d00ae110 2023-12-19T13:53:20.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.324+0000 7f98c67fc640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f98b406a430 0x7f98b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.325+0000 7f98c67fc640 1 -- 172.21.15.113:0/3627571968 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98cc0aab70 con 0x7f98d00ae110 2023-12-19T13:53:20.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.325+0000 7f98d5662640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f98b406a430 0x7f98b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.325+0000 7f98d5662640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f98b406a430 0x7f98b406c8f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f98d015b230 tx=0x7f98c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:20.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.329+0000 7f98c67fc640 1 -- 172.21.15.113:0/3627571968 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f98cc076280 con 0x7f98d00ae110 2023-12-19T13:53:20.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.518+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f98d00aebd0 con 0x7f98d00ae110 2023-12-19T13:53:20.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.521+0000 7f98c67fc640 1 -- 172.21.15.113:0/3627571968 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v120) v1 ==== 81+0+33599 (secure 0 0 0) 0x7f98cc08b350 con 0x7f98d00ae110 2023-12-19T13:53:20.521 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:20.521 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 120, 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:53:14.625779+0000", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:20.522 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 13, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:53:20.523 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:53:20.524 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:20.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:20.526 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:20.527 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:20.528 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:20.528 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:20.528 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:53:20.529 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.530 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 12, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:38.334371+0000", 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:20.531 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:53:20.532 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:20.533 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:20.534 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:20.535 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.75, 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.75, 2023-12-19T13:53:20.536 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.75, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.75, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 13, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:52:39.588248+0000", 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:53:20.537 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:53:20.538 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:53:20.539 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:53:20.540 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:53:20.541 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:53:20.542 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:53:20.543 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.544 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.545 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.546 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.547 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.548 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.549 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.550 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.550 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.550 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.550 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.553 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:53:20.554 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.555 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.556 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.557 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.558 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.559 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.560 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.561 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:53:20.562 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.563 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.564 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.565 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.566 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.568 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.569 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.570 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:53:20.571 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:53:20.572 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:53:20.573 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.574 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.575 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.576 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.577 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:53:20.578 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.579 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.580 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.581 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.582 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.583 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.584 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:53:20.586 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 111, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:53:20.588 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:53:20.589 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:53:20.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.591 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:20.592 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.593 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.594 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:53:20.595 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.596 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:53:20.597 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:53:20.598 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:20.599 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:20.600 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f98b406a430 msgr2=0x7f98b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f98b406a430 0x7f98b406c8f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f98d015b230 tx=0x7f98c0009040 comp rx=0 tx=0).stop 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98d00ae110 msgr2=0x7f98d014a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98d00ae110 0x7f98d014a840 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f98cc000c00 tx=0x7f98cc004730 comp rx=0 tx=0).stop 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 shutdown_connections 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f98b406a430 0x7f98b406c8f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98d0157bf0 0x7f98d00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98d00b0810 0x7f98d0146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 --2- 172.21.15.113:0/3627571968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98d00ae110 0x7f98d014a840 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 >> 172.21.15.113:0/3627571968 conn(0x7f98d00cbb70 msgr2=0x7f98d00cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 shutdown_connections 2023-12-19T13:53:20.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.524+0000 7f98d80c7640 1 -- 172.21.15.113:0/3627571968 wait complete. 2023-12-19T13:53:20.603 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:20.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.805+0000 7f2c4f1b9640 1 Processor -- start 2023-12-19T13:53:20.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.805+0000 7f2c4f1b9640 1 -- start start 2023-12-19T13:53:20.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4f1b9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2c481449e0 0x7f2c480af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4f1b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c480b0b50 0x7f2c4806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4f1b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2c4806b590 0x7f2c4806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4f1b9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c480afb10 con 0x7f2c481449e0 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4f1b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4806bb30 con 0x7f2c4806b590 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4f1b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480b0070 con 0x7f2c480b0b50 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4cf55640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2c481449e0 0x7f2c480af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4cf55640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2c481449e0 0x7f2c480af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48502/0 (socket says 172.21.15.113:48502) 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.806+0000 7f2c4cf55640 1 -- 172.21.15.113:0/3688252985 learned_addr learned my addr 172.21.15.113:0/3688252985 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:20.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.807+0000 7f2c4cf55640 1 -- 172.21.15.113:0/3688252985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c480b0b50 msgr2=0x7f2c4806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:20.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.807+0000 7f2c4cf55640 1 --2- 172.21.15.113:0/3688252985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c480b0b50 0x7f2c4806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.807+0000 7f2c4cf55640 1 -- 172.21.15.113:0/3688252985 >> v2:172.21.15.151:3300/0 conn(0x7f2c4806b590 msgr2=0x7f2c4806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:20.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.807+0000 7f2c4cf55640 1 --2- 172.21.15.113:0/3688252985 >> v2:172.21.15.151:3300/0 conn(0x7f2c4806b590 0x7f2c4806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.807+0000 7f2c4cf55640 1 -- 172.21.15.113:0/3688252985 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480b0350 con 0x7f2c481449e0 2023-12-19T13:53:20.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.808+0000 7f2c4cf55640 1 --2- 172.21.15.113:0/3688252985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c481449e0 0x7f2c480af5d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b2960 tx=0x7f2c3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8e223af29ce3a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:20.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.808+0000 7f2c477fe640 1 -- 172.21.15.113:0/3688252985 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c031870 con 0x7f2c481449e0 2023-12-19T13:53:20.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.808+0000 7f2c477fe640 1 -- 172.21.15.113:0/3688252985 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0319d0 con 0x7f2c481449e0 2023-12-19T13:53:20.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.808+0000 7f2c477fe640 1 -- 172.21.15.113:0/3688252985 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c031d60 con 0x7f2c481449e0 2023-12-19T13:53:20.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/3688252985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c481449e0 msgr2=0x7f2c480af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/3688252985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c481449e0 0x7f2c480af5d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b2960 tx=0x7f2c3c02b910 comp rx=0 tx=0).stop 2023-12-19T13:53:20.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/3688252985 shutdown_connections 2023-12-19T13:53:20.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/3688252985 >> v2:172.21.15.151:3300/0 conn(0x7f2c4806b590 0x7f2c4806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/3688252985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c480b0b50 0x7f2c4806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/3688252985 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c481449e0 0x7f2c480af5d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/3688252985 >> 172.21.15.113:0/3688252985 conn(0x7f2c480cbb70 msgr2=0x7f2c480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:20.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/3688252985 shutdown_connections 2023-12-19T13:53:20.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.809+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/3688252985 wait complete. 2023-12-19T13:53:20.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.810+0000 7f2c4f1b9640 1 Processor -- start 2023-12-19T13:53:20.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.811+0000 7f2c4f1b9640 1 -- start start 2023-12-19T13:53:20.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.811+0000 7f2c4f1b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b590 0x7f2c4813e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.811+0000 7f2c4f1b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c480b0b50 0x7f2c480a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.811+0000 7f2c4f1b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c481449e0 0x7f2c4813cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.811+0000 7f2c4f1b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48142840 con 0x7f2c480b0b50 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.811+0000 7f2c4f1b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48142a90 con 0x7f2c4806b590 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.811+0000 7f2c4f1b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48142d70 con 0x7f2c481449e0 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c480b0b50 0x7f2c480a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c480b0b50 0x7f2c480a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48518/0 (socket says 172.21.15.113:48518) 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 -- 172.21.15.113:0/1671774795 learned_addr learned my addr 172.21.15.113:0/1671774795 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c4cf55640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b590 0x7f2c4813e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c4d756640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c481449e0 0x7f2c4813cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 -- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c481449e0 msgr2=0x7f2c4813cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c481449e0 0x7f2c4813cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 -- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b590 msgr2=0x7f2c4813e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:20.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b590 0x7f2c4813e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 -- 172.21.15.113:0/1671774795 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0094d0 con 0x7f2c480b0b50 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c4d756640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c481449e0 0x7f2c4813cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.812+0000 7f2c47fff640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c480b0b50 0x7f2c480a84a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400b410 tx=0x7f2c3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.813+0000 7f2c457fa640 1 -- 172.21.15.113:0/1671774795 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34011830 con 0x7f2c480b0b50 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.813+0000 7f2c457fa640 1 -- 172.21.15.113:0/1671774795 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c340119b0 con 0x7f2c480b0b50 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.813+0000 7f2c457fa640 1 -- 172.21.15.113:0/1671774795 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34011d60 con 0x7f2c480b0b50 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.813+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c48143050 con 0x7f2c480b0b50 2023-12-19T13:53:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.813+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4813edf0 con 0x7f2c480b0b50 2023-12-19T13:53:20.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.814+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c48143570 con 0x7f2c480b0b50 2023-12-19T13:53:20.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.815+0000 7f2c457fa640 1 -- 172.21.15.113:0/1671774795 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c3401a400 con 0x7f2c480b0b50 2023-12-19T13:53:20.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.815+0000 7f2c457fa640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c2c06a430 0x7f2c2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:20.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.816+0000 7f2c457fa640 1 -- 172.21.15.113:0/1671774795 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c340889c0 con 0x7f2c480b0b50 2023-12-19T13:53:20.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.816+0000 7f2c4cf55640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c2c06a430 0x7f2c2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:20.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.816+0000 7f2c4cf55640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c2c06a430 0x7f2c2c06c8f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c036000 tx=0x7f2c3c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:20.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:20.820+0000 7f2c457fa640 1 -- 172.21.15.113:0/1671774795 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2c48143570 con 0x7f2c480b0b50 2023-12-19T13:53:21.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.049+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c48143570 con 0x7f2c480b0b50 2023-12-19T13:53:21.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.050+0000 7f2c457fa640 1 -- 172.21.15.113:0/1671774795 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f2c48143570 con 0x7f2c480b0b50 2023-12-19T13:53:21.049 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:21.050 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:53:21.050 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.052+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c2c06a430 msgr2=0x7f2c2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.052+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c2c06a430 0x7f2c2c06c8f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c036000 tx=0x7f2c3c03c040 comp rx=0 tx=0).stop 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c480b0b50 msgr2=0x7f2c480a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c480b0b50 0x7f2c480a84a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400b410 tx=0x7f2c3400b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 shutdown_connections 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2c2c06a430 0x7f2c2c06c8f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c481449e0 0x7f2c4813cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:21.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c480b0b50 0x7f2c480a84a0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:21.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 --2- 172.21.15.113:0/1671774795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b590 0x7f2c4813e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:21.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 >> 172.21.15.113:0/1671774795 conn(0x7f2c480cbb70 msgr2=0x7f2c480709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:21.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 shutdown_connections 2023-12-19T13:53:21.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:21.053+0000 7f2c4f1b9640 1 -- 172.21.15.113:0/1671774795 wait complete. 2023-12-19T13:53:21.072 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:53:21.302 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":6900,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":40.714624254,"mdsmap_epoch":49,"osdmap_epoch":120,"osdmap_epoch_barrier":116,"uptime":46.358826151000002} 2023-12-19T13:53:21.302 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 6900, "mdsmap_epoch": 49, "osdmap_epoch": 120, "osdmap_epoch_barrier": 116, "rank_uptime": 40.714624254, "state": "up:active", "uptime": 46.358826151, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:53:21.303 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:53:21.303 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:21.303 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:21.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:21.357 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T13:53:21.796 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T13:53:21.797 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T13:53:21.797 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.385669 s, 136 MB/s 2023-12-19T13:53:21.798 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:53:21.798 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:53:21.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:53:22.021 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:53:22.133 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:22.133 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:22.194 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:22.194 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:22.248 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:22.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.462+0000 7f88fa9ab640 1 Processor -- start 2023-12-19T13:53:22.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.463+0000 7f88fa9ab640 1 -- start start 2023-12-19T13:53:22.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.464+0000 7f88fa9ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f88f4161660 0x7f88f4166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.464+0000 7f88fa9ab640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f88f40afa50 0x7f88f4162910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.464+0000 7f88fa9ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f4161a40 0x7f88f40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.464+0000 7f88fa9ab640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f4165bc0 con 0x7f88f40afa50 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.464+0000 7f88fa9ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f4162e50 con 0x7f88f4161660 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.464+0000 7f88fa9ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f406e520 con 0x7f88f4161a40 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.464+0000 7f88eb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f88f40afa50 0x7f88f4162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88eb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f88f40afa50 0x7f88f4162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48526/0 (socket says 172.21.15.113:48526) 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88eb7fe640 1 -- 172.21.15.113:0/444599951 learned_addr learned my addr 172.21.15.113:0/444599951 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88eb7fe640 1 -- 172.21.15.113:0/444599951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f4161a40 msgr2=0x7f88f40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88eb7fe640 1 --2- 172.21.15.113:0/444599951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f4161a40 0x7f88f40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88f3fff640 1 --2- 172.21.15.113:0/444599951 >> v2:172.21.15.151:3300/0 conn(0x7f88f4161660 0x7f88f4166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88eb7fe640 1 -- 172.21.15.113:0/444599951 >> v2:172.21.15.151:3300/0 conn(0x7f88f4161660 msgr2=0x7f88f4166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:22.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88eb7fe640 1 --2- 172.21.15.113:0/444599951 >> v2:172.21.15.151:3300/0 conn(0x7f88f4161660 0x7f88f4166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88eb7fe640 1 -- 172.21.15.113:0/444599951 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40afef0 con 0x7f88f40afa50 2023-12-19T13:53:22.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.465+0000 7f88f3fff640 1 --2- 172.21.15.113:0/444599951 >> v2:172.21.15.151:3300/0 conn(0x7f88f4161660 0x7f88f4166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:22.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.466+0000 7f88eb7fe640 1 --2- 172.21.15.113:0/444599951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f40afa50 0x7f88f4162910 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f88f40cf010 tx=0x7f88dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2fac20a0ddb69d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:22.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88f37fe640 1 -- 172.21.15.113:0/444599951 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc031870 con 0x7f88f40afa50 2023-12-19T13:53:22.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88f37fe640 1 -- 172.21.15.113:0/444599951 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0319d0 con 0x7f88f40afa50 2023-12-19T13:53:22.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88f37fe640 1 -- 172.21.15.113:0/444599951 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc031d60 con 0x7f88f40afa50 2023-12-19T13:53:22.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 -- 172.21.15.113:0/444599951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f40afa50 msgr2=0x7f88f4162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/444599951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f40afa50 0x7f88f4162910 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f88f40cf010 tx=0x7f88dc02b910 comp rx=0 tx=0).stop 2023-12-19T13:53:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 -- 172.21.15.113:0/444599951 shutdown_connections 2023-12-19T13:53:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/444599951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f4161a40 0x7f88f40b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/444599951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f40afa50 0x7f88f4162910 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/444599951 >> v2:172.21.15.151:3300/0 conn(0x7f88f4161660 0x7f88f4166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 -- 172.21.15.113:0/444599951 >> 172.21.15.113:0/444599951 conn(0x7f88f40cbb70 msgr2=0x7f88f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 -- 172.21.15.113:0/444599951 shutdown_connections 2023-12-19T13:53:22.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.467+0000 7f88fa9ab640 1 -- 172.21.15.113:0/444599951 wait complete. 2023-12-19T13:53:22.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.469+0000 7f88fa9ab640 1 Processor -- start 2023-12-19T13:53:22.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.469+0000 7f88fa9ab640 1 -- start start 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88fa9ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f40afa50 0x7f88f414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88fa9ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88f4161660 0x7f88f4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88fa9ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f4161a40 0x7f88f4163600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88fa9ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40acf80 con 0x7f88f4161a40 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88fa9ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4152a60 con 0x7f88f4161660 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88fa9ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4152d40 con 0x7f88f40afa50 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88f8f48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f4161a40 0x7f88f4163600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88f8f48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f4161a40 0x7f88f4163600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48536/0 (socket says 172.21.15.113:48536) 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.470+0000 7f88f8f48640 1 -- 172.21.15.113:0/859813366 learned_addr learned my addr 172.21.15.113:0/859813366 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f3fff640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f40afa50 0x7f88f414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88eb7fe640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88f4161660 0x7f88f4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f8f48640 1 -- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f40afa50 msgr2=0x7f88f414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f8f48640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f40afa50 0x7f88f414f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f8f48640 1 -- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88f4161660 msgr2=0x7f88f4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f8f48640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88f4161660 0x7f88f4151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f8f48640 1 -- 172.21.15.113:0/859813366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0094d0 con 0x7f88f4161a40 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f8f48640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f4161a40 0x7f88f4163600 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b9e0 tx=0x7f88ec00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f17fa640 1 -- 172.21.15.113:0/859813366 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00cb20 con 0x7f88f4161a40 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f17fa640 1 -- 172.21.15.113:0/859813366 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec00cca0 con 0x7f88f4161a40 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f40ac8c0 con 0x7f88f4161a40 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.471+0000 7f88f17fa640 1 -- 172.21.15.113:0/859813366 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec014680 con 0x7f88f4161a40 2023-12-19T13:53:22.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.472+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f414f980 con 0x7f88f4161a40 2023-12-19T13:53:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.473+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f40ad0c0 con 0x7f88f4161a40 2023-12-19T13:53:22.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.474+0000 7f88f17fa640 1 -- 172.21.15.113:0/859813366 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88ec01d3b0 con 0x7f88f4161a40 2023-12-19T13:53:22.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.475+0000 7f88f17fa640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88d406a460 0x7f88d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.475+0000 7f88f17fa640 1 -- 172.21.15.113:0/859813366 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88ec088840 con 0x7f88f4161a40 2023-12-19T13:53:22.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.475+0000 7f88f3fff640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88d406a460 0x7f88d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.476+0000 7f88f3fff640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88d406a460 0x7f88d406c920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f88e4008850 tx=0x7f88e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:22.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.479+0000 7f88f17fa640 1 -- 172.21.15.113:0/859813366 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f88f40ad0c0 con 0x7f88f4161a40 2023-12-19T13:53:22.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.672+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88f40ad0c0 con 0x7f88f4161a40 2023-12-19T13:53:22.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.674+0000 7f88f17fa640 1 -- 172.21.15.113:0/859813366 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16164 (secure 0 0 0) 0x7f88f40ad0c0 con 0x7f88f4161a40 2023-12-19T13:53:22.674 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:22.674 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":120,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:14.625779+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88d406a460 msgr2=0x7f88d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88d406a460 0x7f88d406c920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f88e4008850 tx=0x7f88e4008040 comp rx=0 tx=0).stop 2023-12-19T13:53:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f4161a40 msgr2=0x7f88f4163600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f4161a40 0x7f88f4163600 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b9e0 tx=0x7f88ec00bea0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 shutdown_connections 2023-12-19T13:53:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f88d406a460 0x7f88d406c920 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88f4161a40 0x7f88f4163600 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88f4161660 0x7f88f4151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 --2- 172.21.15.113:0/859813366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88f40afa50 0x7f88f414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 >> 172.21.15.113:0/859813366 conn(0x7f88f40cbb70 msgr2=0x7f88f406d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.677+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 shutdown_connections 2023-12-19T13:53:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.678+0000 7f88fa9ab640 1 -- 172.21.15.113:0/859813366 wait complete. 2023-12-19T13:53:22.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:52:38.334371+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:52:39.588248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:53:22.696 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:53:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.912+0000 7f9c6d188640 1 Processor -- start 2023-12-19T13:53:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.913+0000 7f9c6d188640 1 -- start start 2023-12-19T13:53:22.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.914+0000 7f9c6d188640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c680d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.914+0000 7f9c6d188640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c6806fc40 0x7f9c6815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.914+0000 7f9c6d188640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c68161e70 con 0x7f9c680b6430 2023-12-19T13:53:22.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.914+0000 7f9c6d188640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c68161080 con 0x7f9c6806fc40 2023-12-19T13:53:22.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.914+0000 7f9c6d188640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68161260 con 0x7f9c68146ff0 2023-12-19T13:53:22.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.915+0000 7f9c6759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c6806fc40 0x7f9c6815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.915+0000 7f9c66d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c680d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.915+0000 7f9c6759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c6806fc40 0x7f9c6815dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:42076/0 (socket says 172.21.15.113:42076) 2023-12-19T13:53:22.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.915+0000 7f9c6759e640 1 -- 172.21.15.113:0/827743639 learned_addr learned my addr 172.21.15.113:0/827743639 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:22.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.916+0000 7f9c66d9d640 1 -- 172.21.15.113:0/827743639 >> v2:172.21.15.151:3300/0 conn(0x7f9c6806fc40 msgr2=0x7f9c6815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:22.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.916+0000 7f9c66d9d640 1 --2- 172.21.15.113:0/827743639 >> v2:172.21.15.151:3300/0 conn(0x7f9c6806fc40 0x7f9c6815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.916+0000 7f9c66d9d640 1 -- 172.21.15.113:0/827743639 >> v1:172.21.15.151:6789/0 conn(0x7f9c680b6430 legacy=0x7f9c6806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.916+0000 7f9c66d9d640 1 -- 172.21.15.113:0/827743639 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68161540 con 0x7f9c68146ff0 2023-12-19T13:53:22.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.916+0000 7f9c6759e640 1 --2- 172.21.15.113:0/827743639 >> v2:172.21.15.151:3300/0 conn(0x7f9c6806fc40 0x7f9c6815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:53:22.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.917+0000 7f9c66d9d640 1 --2- 172.21.15.113:0/827743639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c680d10f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c580097a0 tx=0x7f9c5802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d46d5c4d5f51e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:22.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.917+0000 7f9c65d9b640 1 -- 172.21.15.113:0/827743639 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5802d040 con 0x7f9c68146ff0 2023-12-19T13:53:22.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c65d9b640 1 -- 172.21.15.113:0/827743639 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c58031810 con 0x7f9c68146ff0 2023-12-19T13:53:22.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c65d9b640 1 -- 172.21.15.113:0/827743639 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58031ba0 con 0x7f9c68146ff0 2023-12-19T13:53:22.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c6d188640 1 -- 172.21.15.113:0/827743639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 msgr2=0x7f9c680d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c6d188640 1 --2- 172.21.15.113:0/827743639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c680d10f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c580097a0 tx=0x7f9c5802b8b0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c6d188640 1 -- 172.21.15.113:0/827743639 shutdown_connections 2023-12-19T13:53:22.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c6d188640 1 --2- 172.21.15.113:0/827743639 >> v2:172.21.15.151:3300/0 conn(0x7f9c6806fc40 0x7f9c6815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c6d188640 1 --2- 172.21.15.113:0/827743639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c680d10f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.918+0000 7f9c6d188640 1 -- 172.21.15.113:0/827743639 >> 172.21.15.113:0/827743639 conn(0x7f9c680d3520 msgr2=0x7f9c680d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:22.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.919+0000 7f9c6d188640 1 -- 172.21.15.113:0/827743639 shutdown_connections 2023-12-19T13:53:22.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.919+0000 7f9c6d188640 1 -- 172.21.15.113:0/827743639 wait complete. 2023-12-19T13:53:22.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.921+0000 7f9c6d188640 1 Processor -- start 2023-12-19T13:53:22.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.921+0000 7f9c6d188640 1 -- start start 2023-12-19T13:53:22.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.922+0000 7f9c6d188640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6806fc40 0x7f9c681597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.922+0000 7f9c6d188640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c680b6430 0x7f9c681419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.922+0000 7f9c6d188640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c68070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.922+0000 7f9c6d188640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68140a60 con 0x7f9c680b6430 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.922+0000 7f9c6d188640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6813d0f0 con 0x7f9c6806fc40 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.922+0000 7f9c6d188640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6813fee0 con 0x7f9c68146ff0 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.922+0000 7f9c6659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c680b6430 0x7f9c681419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c680b6430 0x7f9c681419a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48544/0 (socket says 172.21.15.113:48544) 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 -- 172.21.15.113:0/613920382 learned_addr learned my addr 172.21.15.113:0/613920382 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6759e640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c68070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c66d9d640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6806fc40 0x7f9c681597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 -- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 msgr2=0x7f9c68070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c68070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 -- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6806fc40 msgr2=0x7f9c681597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6806fc40 0x7f9c681597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 -- 172.21.15.113:0/613920382 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600094d0 con 0x7f9c680b6430 2023-12-19T13:53:22.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c6659c640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c680b6430 0x7f9c681419a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c790 tx=0x7f9c5c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:22.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.923+0000 7f9c4f7fe640 1 -- 172.21.15.113:0/613920382 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00cea0 con 0x7f9c680b6430 2023-12-19T13:53:22.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.924+0000 7f9c4f7fe640 1 -- 172.21.15.113:0/613920382 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c006d50 con 0x7f9c680b6430 2023-12-19T13:53:22.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.924+0000 7f9c4f7fe640 1 -- 172.21.15.113:0/613920382 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c003bb0 con 0x7f9c680b6430 2023-12-19T13:53:22.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.924+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c58009400 con 0x7f9c680b6430 2023-12-19T13:53:22.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.924+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c681404a0 con 0x7f9c680b6430 2023-12-19T13:53:22.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.925+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6815d990 con 0x7f9c680b6430 2023-12-19T13:53:22.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.926+0000 7f9c4f7fe640 1 -- 172.21.15.113:0/613920382 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c5c003d10 con 0x7f9c680b6430 2023-12-19T13:53:22.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.927+0000 7f9c4f7fe640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c5406a430 0x7f9c5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:22.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.927+0000 7f9c4f7fe640 1 -- 172.21.15.113:0/613920382 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c5c088580 con 0x7f9c680b6430 2023-12-19T13:53:22.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.927+0000 7f9c66d9d640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c5406a430 0x7f9c5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:22.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.928+0000 7f9c66d9d640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c5406a430 0x7f9c5406c8f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9c58036000 tx=0x7f9c5803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:22.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:22.932+0000 7f9c4f7fe640 1 -- 172.21.15.113:0/613920382 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c5c0575f0 con 0x7f9c680b6430 2023-12-19T13:53:23.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.119+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c68061910 con 0x7f9c680b6430 2023-12-19T13:53:23.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.120+0000 7f9c4f7fe640 1 -- 172.21.15.113:0/613920382 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c5c057180 con 0x7f9c680b6430 2023-12-19T13:53:23.120 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:53:23.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c5406a430 msgr2=0x7f9c5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c5406a430 0x7f9c5406c8f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9c58036000 tx=0x7f9c5803c040 comp rx=0 tx=0).stop 2023-12-19T13:53:23.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c680b6430 msgr2=0x7f9c681419a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c680b6430 0x7f9c681419a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c790 tx=0x7f9c5c00cc50 comp rx=0 tx=0).stop 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 shutdown_connections 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c5406a430 0x7f9c5406c8f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c68146ff0 0x7f9c68070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c680b6430 0x7f9c681419a0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 --2- 172.21.15.113:0/613920382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6806fc40 0x7f9c681597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 >> 172.21.15.113:0/613920382 conn(0x7f9c680d3520 msgr2=0x7f9c6815f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 shutdown_connections 2023-12-19T13:53:23.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.123+0000 7f9c6d188640 1 -- 172.21.15.113:0/613920382 wait complete. 2023-12-19T13:53:23.141 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:53:23.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.352+0000 7f04223e7640 1 Processor -- start 2023-12-19T13:53:23.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.352+0000 7f04223e7640 1 -- start start 2023-12-19T13:53:23.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.354+0000 7f04223e7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.354+0000 7f04223e7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f041c0ce110 0x7f041c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.354+0000 7f04223e7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0cd840 con 0x7f041c0d2b00 2023-12-19T13:53:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.354+0000 7f04223e7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0d2430 con 0x7f041c0ce110 2023-12-19T13:53:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.354+0000 7f04223e7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0ceae0 con 0x7f041c146e10 2023-12-19T13:53:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.355+0000 7f041bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.355+0000 7f0420984640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f041c0ce110 0x7f041c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.355+0000 7f041bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c0d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:56878/0 (socket says 172.21.15.113:56878) 2023-12-19T13:53:23.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.355+0000 7f0420984640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f041c0ce110 0x7f041c0ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:42102/0 (socket says 172.21.15.113:42102) 2023-12-19T13:53:23.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.355+0000 7f041bfff640 1 -- 172.21.15.113:0/577891913 learned_addr learned my addr 172.21.15.113:0/577891913 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:23.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.356+0000 7f0420984640 1 -- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 msgr2=0x7f041c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:23.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.356+0000 7f0420984640 1 --2- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.356+0000 7f0420984640 1 -- 172.21.15.113:0/577891913 >> v1:172.21.15.151:6789/0 conn(0x7f041c0d2b00 legacy=0x7f041c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.356+0000 7f0420984640 1 -- 172.21.15.113:0/577891913 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0b6e90 con 0x7f041c0ce110 2023-12-19T13:53:23.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.356+0000 7f041bfff640 1 --2- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:53:23.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.357+0000 7f0420984640 1 --2- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c0ce5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f04140097d0 tx=0x7f041402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499f958f71aafc19 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:23.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.358+0000 7f041affd640 1 -- 172.21.15.113:0/577891913 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414031800 con 0x7f041c0ce110 2023-12-19T13:53:23.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.358+0000 7f041affd640 1 -- 172.21.15.113:0/577891913 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414031960 con 0x7f041c0ce110 2023-12-19T13:53:23.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.358+0000 7f041affd640 1 -- 172.21.15.113:0/577891913 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414031cf0 con 0x7f041c0ce110 2023-12-19T13:53:23.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 -- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 msgr2=0x7f041c0ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 --2- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c0ce5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f04140097d0 tx=0x7f041402b8a0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 -- 172.21.15.113:0/577891913 shutdown_connections 2023-12-19T13:53:23.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 --2- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c0ce5a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 --2- 172.21.15.113:0/577891913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 -- 172.21.15.113:0/577891913 >> 172.21.15.113:0/577891913 conn(0x7f041c0b29c0 msgr2=0x7f041c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:23.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 -- 172.21.15.113:0/577891913 shutdown_connections 2023-12-19T13:53:23.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.359+0000 7f04223e7640 1 -- 172.21.15.113:0/577891913 wait complete. 2023-12-19T13:53:23.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.361+0000 7f04223e7640 1 Processor -- start 2023-12-19T13:53:23.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.361+0000 7f04223e7640 1 -- start start 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f04223e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f04223e7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041c0d2b00 0x7f041c070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f04223e7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f04223e7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c140880 con 0x7f041c0d2b00 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f04223e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c070ed0 con 0x7f041c0ce110 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f04223e7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c15b460 con 0x7f041c146e10 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041c0d2b00 0x7f041c070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041c0d2b00 0x7f041c070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48546/0 (socket says 172.21.15.113:48546) 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.362+0000 7f041b7fe640 1 -- 172.21.15.113:0/1679738689 learned_addr learned my addr 172.21.15.113:0/1679738689 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041bfff640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f0420984640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041b7fe640 1 -- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 msgr2=0x7f041c140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041b7fe640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041b7fe640 1 -- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 msgr2=0x7f041c15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041b7fe640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c15c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041b7fe640 1 -- 172.21.15.113:0/1679738689 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c009b30 con 0x7f041c0d2b00 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041bfff640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f041b7fe640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041c0d2b00 0x7f041c070840 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f040400c450 tx=0x7f040400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f0418ff9640 1 -- 172.21.15.113:0/1679738689 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040052d0 con 0x7f041c0d2b00 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f0418ff9640 1 -- 172.21.15.113:0/1679738689 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0404005430 con 0x7f041c0d2b00 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0414009400 con 0x7f041c0d2b00 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.363+0000 7f0418ff9640 1 -- 172.21.15.113:0/1679738689 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404012870 con 0x7f041c0d2b00 2023-12-19T13:53:23.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.364+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c15ba20 con 0x7f041c0d2b00 2023-12-19T13:53:23.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.365+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c061910 con 0x7f041c0d2b00 2023-12-19T13:53:23.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.365+0000 7f0418ff9640 1 -- 172.21.15.113:0/1679738689 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f04040129d0 con 0x7f041c0d2b00 2023-12-19T13:53:23.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.366+0000 7f0418ff9640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03fc06a430 0x7f03fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.366+0000 7f0418ff9640 1 -- 172.21.15.113:0/1679738689 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04040884b0 con 0x7f041c0d2b00 2023-12-19T13:53:23.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.367+0000 7f041bfff640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03fc06a430 0x7f03fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.367+0000 7f041bfff640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03fc06a430 0x7f03fc06c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f040c009fd0 tx=0x7f040c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:23.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.371+0000 7f0418ff9640 1 -- 172.21.15.113:0/1679738689 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0404053a00 con 0x7f041c0d2b00 2023-12-19T13:53:23.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.553+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f041c143ee0 con 0x7f041c0d2b00 2023-12-19T13:53:23.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.554+0000 7f0418ff9640 1 -- 172.21.15.113:0/1679738689 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0404057020 con 0x7f041c0d2b00 2023-12-19T13:53:23.553 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:53:23.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03fc06a430 msgr2=0x7f03fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03fc06a430 0x7f03fc06c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f040c009fd0 tx=0x7f040c00b040 comp rx=0 tx=0).stop 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041c0d2b00 msgr2=0x7f041c070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041c0d2b00 0x7f041c070840 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f040400c450 tx=0x7f040400c910 comp rx=0 tx=0).stop 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 shutdown_connections 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03fc06a430 0x7f03fc06c8f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f041c146e10 0x7f041c140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041c0d2b00 0x7f041c070840 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 --2- 172.21.15.113:0/1679738689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f041c0ce110 0x7f041c15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 >> 172.21.15.113:0/1679738689 conn(0x7f041c0b29c0 msgr2=0x7f041c0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 shutdown_connections 2023-12-19T13:53:23.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.556+0000 7f04223e7640 1 -- 172.21.15.113:0/1679738689 wait complete. 2023-12-19T13:53:23.573 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:53:23.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.784+0000 7f5a3ed5c640 1 Processor -- start 2023-12-19T13:53:23.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.784+0000 7f5a3ed5c640 1 -- start start 2023-12-19T13:53:23.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.785+0000 7f5a3ed5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a380b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.785+0000 7f5a3ed5c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a380ceea0 0x7f5a380cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.785+0000 7f5a3ed5c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3815fde0 con 0x7f5a3815b1d0 2023-12-19T13:53:23.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.785+0000 7f5a3ed5c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a380b2400 con 0x7f5a380ceea0 2023-12-19T13:53:23.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.785+0000 7f5a3ed5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380cf870 con 0x7f5a380b2760 2023-12-19T13:53:23.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.786+0000 7f5a3d2f9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a380ceea0 0x7f5a380cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.786+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a380b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.786+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a380b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:56894/0 (socket says 172.21.15.113:56894) 2023-12-19T13:53:23.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.786+0000 7f5a3d2f9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a380ceea0 0x7f5a380cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:42116/0 (socket says 172.21.15.113:42116) 2023-12-19T13:53:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.786+0000 7f5a37fff640 1 -- 172.21.15.113:0/1132461280 learned_addr learned my addr 172.21.15.113:0/1132461280 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.787+0000 7f5a3d2f9640 1 -- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 msgr2=0x7f5a380b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.787+0000 7f5a3d2f9640 1 --2- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a380b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.787+0000 7f5a3d2f9640 1 -- 172.21.15.113:0/1132461280 >> v1:172.21.15.151:6789/0 conn(0x7f5a3815b1d0 legacy=0x7f5a3815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.787+0000 7f5a3d2f9640 1 -- 172.21.15.113:0/1132461280 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380b2bc0 con 0x7f5a380ceea0 2023-12-19T13:53:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.787+0000 7f5a37fff640 1 --2- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a380b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:53:23.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.788+0000 7f5a3d2f9640 1 --2- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a380cf330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5a300097a0 tx=0x7f5a3002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c9569c7f87e458 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a377fe640 1 -- 172.21.15.113:0/1132461280 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30030710 con 0x7f5a380ceea0 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a377fe640 1 -- 172.21.15.113:0/1132461280 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3002e050 con 0x7f5a380ceea0 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a377fe640 1 -- 172.21.15.113:0/1132461280 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30030a90 con 0x7f5a380ceea0 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 msgr2=0x7f5a380cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a380cf330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5a300097a0 tx=0x7f5a3002b710 comp rx=0 tx=0).stop 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1132461280 shutdown_connections 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a380cf330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1132461280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a380b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1132461280 >> 172.21.15.113:0/1132461280 conn(0x7f5a38073150 msgr2=0x7f5a380659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:23.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.789+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1132461280 shutdown_connections 2023-12-19T13:53:23.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.790+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1132461280 wait complete. 2023-12-19T13:53:23.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.791+0000 7f5a3ed5c640 1 Processor -- start 2023-12-19T13:53:23.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.791+0000 7f5a3ed5c640 1 -- start start 2023-12-19T13:53:23.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.792+0000 7f5a3ed5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a381588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.792+0000 7f5a3ed5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a38158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.792+0000 7f5a3ed5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a3815b1d0 0x7f5a381f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.792+0000 7f5a3ed5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381f32f0 con 0x7f5a3815b1d0 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.792+0000 7f5a3ed5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381f6d00 con 0x7f5a380ceea0 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.792+0000 7f5a3ed5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381f29c0 con 0x7f5a380b2760 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a3815b1d0 0x7f5a381f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a3815b1d0 0x7f5a381f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48552/0 (socket says 172.21.15.113:48552) 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 -- 172.21.15.113:0/1175429132 learned_addr learned my addr 172.21.15.113:0/1175429132 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3caf8640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a381588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a37fff640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a38158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 -- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 msgr2=0x7f5a381588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a381588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 -- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 msgr2=0x7f5a38158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a38158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 -- 172.21.15.113:0/1175429132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20009b30 con 0x7f5a3815b1d0 2023-12-19T13:53:23.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a37fff640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a38158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:23.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.793+0000 7f5a3d2f9640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a3815b1d0 0x7f5a381f5fd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5a300097a0 tx=0x7f5a300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:23.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.794+0000 7f5a357fa640 1 -- 172.21.15.113:0/1175429132 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3003d890 con 0x7f5a3815b1d0 2023-12-19T13:53:23.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.794+0000 7f5a357fa640 1 -- 172.21.15.113:0/1175429132 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3003da10 con 0x7f5a3815b1d0 2023-12-19T13:53:23.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.794+0000 7f5a357fa640 1 -- 172.21.15.113:0/1175429132 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3003ddc0 con 0x7f5a3815b1d0 2023-12-19T13:53:23.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.794+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a30009400 con 0x7f5a3815b1d0 2023-12-19T13:53:23.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.794+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a381f2f80 con 0x7f5a3815b1d0 2023-12-19T13:53:23.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.795+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a381f34a0 con 0x7f5a3815b1d0 2023-12-19T13:53:23.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.796+0000 7f5a357fa640 1 -- 172.21.15.113:0/1175429132 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a30039040 con 0x7f5a3815b1d0 2023-12-19T13:53:23.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.797+0000 7f5a357fa640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a1806a430 0x7f5a1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:23.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.797+0000 7f5a357fa640 1 -- 172.21.15.113:0/1175429132 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a300aa8e0 con 0x7f5a3815b1d0 2023-12-19T13:53:23.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.797+0000 7f5a3caf8640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a1806a430 0x7f5a1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:23.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.797+0000 7f5a3caf8640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a1806a430 0x7f5a1806c8f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5a381f3da0 tx=0x7f5a28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:23.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.801+0000 7f5a357fa640 1 -- 172.21.15.113:0/1175429132 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a381f34a0 con 0x7f5a3815b1d0 2023-12-19T13:53:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.988+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a38061910 con 0x7f5a3815b1d0 2023-12-19T13:53:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.989+0000 7f5a357fa640 1 -- 172.21.15.113:0/1175429132 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a30075ed0 con 0x7f5a3815b1d0 2023-12-19T13:53:23.989 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:53:23.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a1806a430 msgr2=0x7f5a1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a1806a430 0x7f5a1806c8f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5a381f3da0 tx=0x7f5a28009040 comp rx=0 tx=0).stop 2023-12-19T13:53:23.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a3815b1d0 msgr2=0x7f5a381f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:23.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a3815b1d0 0x7f5a381f5fd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5a300097a0 tx=0x7f5a300046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 shutdown_connections 2023-12-19T13:53:23.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a1806a430 0x7f5a1806c8f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a3815b1d0 0x7f5a381f5fd0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a380ceea0 0x7f5a38158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 --2- 172.21.15.113:0/1175429132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a380b2760 0x7f5a381588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:23.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 >> 172.21.15.113:0/1175429132 conn(0x7f5a38073150 msgr2=0x7f5a3815f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:23.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 shutdown_connections 2023-12-19T13:53:23.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:23.992+0000 7f5a3ed5c640 1 -- 172.21.15.113:0/1175429132 wait complete. 2023-12-19T13:53:24.011 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:53:24.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.224+0000 7fcb9b7f0640 1 Processor -- start 2023-12-19T13:53:24.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.224+0000 7fcb9b7f0640 1 -- start start 2023-12-19T13:53:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.225+0000 7fcb9b7f0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb941449e0 0x7fcb940af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.225+0000 7fcb9b7f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9406c6b0 0x7fcb940b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.225+0000 7fcb9b7f0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb940afb10 con 0x7fcb940b0b50 2023-12-19T13:53:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.226+0000 7fcb9b7f0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9406bb30 con 0x7fcb941449e0 2023-12-19T13:53:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.226+0000 7fcb9b7f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940b0070 con 0x7fcb9406c6b0 2023-12-19T13:53:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.226+0000 7fcb99d8d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9406c6b0 0x7fcb940b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.226+0000 7fcb9958c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb941449e0 0x7fcb940af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.226+0000 7fcb9958c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb941449e0 0x7fcb940af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:42138/0 (socket says 172.21.15.113:42138) 2023-12-19T13:53:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.226+0000 7fcb99d8d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9406c6b0 0x7fcb940b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:56924/0 (socket says 172.21.15.113:56924) 2023-12-19T13:53:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.226+0000 7fcb9958c640 1 -- 172.21.15.113:0/702025268 learned_addr learned my addr 172.21.15.113:0/702025268 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:24.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.227+0000 7fcb99d8d640 1 -- 172.21.15.113:0/702025268 >> v2:172.21.15.151:3300/0 conn(0x7fcb941449e0 msgr2=0x7fcb940af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:24.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.227+0000 7fcb99d8d640 1 --2- 172.21.15.113:0/702025268 >> v2:172.21.15.151:3300/0 conn(0x7fcb941449e0 0x7fcb940af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.227+0000 7fcb99d8d640 1 -- 172.21.15.113:0/702025268 >> v1:172.21.15.151:6789/0 conn(0x7fcb940b0b50 legacy=0x7fcb9406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.227+0000 7fcb99d8d640 1 -- 172.21.15.113:0/702025268 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940b0350 con 0x7fcb9406c6b0 2023-12-19T13:53:24.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.227+0000 7fcb9958c640 1 --2- 172.21.15.113:0/702025268 >> v2:172.21.15.151:3300/0 conn(0x7fcb941449e0 0x7fcb940af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:53:24.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.228+0000 7fcb99d8d640 1 --2- 172.21.15.113:0/702025268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9406c6b0 0x7fcb940b1710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009d90 tx=0x7fcb8c02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96677fa3703df595 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:24.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.229+0000 7fcb8bfff640 1 -- 172.21.15.113:0/702025268 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c02cc60 con 0x7fcb9406c6b0 2023-12-19T13:53:24.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.229+0000 7fcb8bfff640 1 -- 172.21.15.113:0/702025268 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c02cdc0 con 0x7fcb9406c6b0 2023-12-19T13:53:24.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.229+0000 7fcb8bfff640 1 -- 172.21.15.113:0/702025268 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c034660 con 0x7fcb9406c6b0 2023-12-19T13:53:24.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/702025268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9406c6b0 msgr2=0x7fcb940b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/702025268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9406c6b0 0x7fcb940b1710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009d90 tx=0x7fcb8c02beb0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/702025268 shutdown_connections 2023-12-19T13:53:24.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/702025268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9406c6b0 0x7fcb940b1710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/702025268 >> v2:172.21.15.151:3300/0 conn(0x7fcb941449e0 0x7fcb940af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/702025268 >> 172.21.15.113:0/702025268 conn(0x7fcb940cbb70 msgr2=0x7fcb940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:24.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/702025268 shutdown_connections 2023-12-19T13:53:24.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.230+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/702025268 wait complete. 2023-12-19T13:53:24.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.232+0000 7fcb9b7f0640 1 Processor -- start 2023-12-19T13:53:24.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.232+0000 7fcb9b7f0640 1 -- start start 2023-12-19T13:53:24.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9b7f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb9406c6b0 0x7fcb9413aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9b7f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb940b0b50 0x7fcb9415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9b7f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb941449e0 0x7fcb941f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9b7f0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94142e90 con 0x7fcb940b0b50 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9b7f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941f6b50 con 0x7fcb9406c6b0 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9b7f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941f6e30 con 0x7fcb941449e0 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb940b0b50 0x7fcb9415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb940b0b50 0x7fcb9415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48558/0 (socket says 172.21.15.113:48558) 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 -- 172.21.15.113:0/3350854567 learned_addr learned my addr 172.21.15.113:0/3350854567 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb99d8d640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb941449e0 0x7fcb941f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9958c640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb9406c6b0 0x7fcb9413aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 -- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb941449e0 msgr2=0x7fcb941f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb941449e0 0x7fcb941f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 -- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb9406c6b0 msgr2=0x7fcb9413aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb9406c6b0 0x7fcb9413aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb98d8b640 1 -- 172.21.15.113:0/3350854567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900094d0 con 0x7fcb940b0b50 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.233+0000 7fcb9958c640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb9406c6b0 0x7fcb9413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:24.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.234+0000 7fcb98d8b640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb940b0b50 0x7fcb9415bc60 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c400 tx=0x7fcb8400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:24.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.234+0000 7fcb89ffb640 1 -- 172.21.15.113:0/3350854567 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb840052d0 con 0x7fcb940b0b50 2023-12-19T13:53:24.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.234+0000 7fcb89ffb640 1 -- 172.21.15.113:0/3350854567 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84005450 con 0x7fcb940b0b50 2023-12-19T13:53:24.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.234+0000 7fcb89ffb640 1 -- 172.21.15.113:0/3350854567 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84007260 con 0x7fcb940b0b50 2023-12-19T13:53:24.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.234+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c009a70 con 0x7fcb940b0b50 2023-12-19T13:53:24.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.234+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb94142b20 con 0x7fcb940b0b50 2023-12-19T13:53:24.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.235+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb94061910 con 0x7fcb940b0b50 2023-12-19T13:53:24.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.236+0000 7fcb89ffb640 1 -- 172.21.15.113:0/3350854567 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb840073c0 con 0x7fcb940b0b50 2023-12-19T13:53:24.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.237+0000 7fcb89ffb640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcb7806a430 0x7fcb7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.237+0000 7fcb89ffb640 1 -- 172.21.15.113:0/3350854567 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb84087e00 con 0x7fcb940b0b50 2023-12-19T13:53:24.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.237+0000 7fcb9958c640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcb7806a430 0x7fcb7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.238+0000 7fcb9958c640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcb7806a430 0x7fcb7806c8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009bb0 tx=0x7fcb90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:24.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.242+0000 7fcb89ffb640 1 -- 172.21.15.113:0/3350854567 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb84053350 con 0x7fcb940b0b50 2023-12-19T13:53:24.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.441+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb9415e9b0 con 0x7fcb940b0b50 2023-12-19T13:53:24.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.442+0000 7fcb89ffb640 1 -- 172.21.15.113:0/3350854567 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v120) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb84056970 con 0x7fcb940b0b50 2023-12-19T13:53:24.445 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.444+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcb7806a430 msgr2=0x7fcb7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.444+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcb7806a430 0x7fcb7806c8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009bb0 tx=0x7fcb90008040 comp rx=0 tx=0).stop 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.444+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb940b0b50 msgr2=0x7fcb9415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.444+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb940b0b50 0x7fcb9415bc60 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c400 tx=0x7fcb8400c8c0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 shutdown_connections 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcb7806a430 0x7fcb7806c8f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb941449e0 0x7fcb941f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb940b0b50 0x7fcb9415bc60 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 --2- 172.21.15.113:0/3350854567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb9406c6b0 0x7fcb9413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 >> 172.21.15.113:0/3350854567 conn(0x7fcb940cbb70 msgr2=0x7fcb941416c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:24.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 shutdown_connections 2023-12-19T13:53:24.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.445+0000 7fcb9b7f0640 1 -- 172.21.15.113:0/3350854567 wait complete. 2023-12-19T13:53:24.461 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:53:24.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:24.462 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:53:24.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:53:24.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:24.588 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:53:24.638 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:53:24.638 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:24.682 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:53:24.683 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:24.777 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:24.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.990+0000 7ff6615d9640 1 Processor -- start 2023-12-19T13:53:24.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.990+0000 7ff6615d9640 1 -- start start 2023-12-19T13:53:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff6615d9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff65c166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff6615d9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c06bb30 con 0x7ff65c1449e0 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff6615d9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c0b0070 con 0x7ff65c0b0b50 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff6615d9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b0350 con 0x7ff65c06c6b0 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff65affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff65c1449e0 0x7ff65c0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57212/0 (socket says 172.21.15.113:57212) 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff65affd640 1 -- 172.21.15.113:0/2738976695 learned_addr learned my addr 172.21.15.113:0/2738976695 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851323945 0 0) 0x7ff65c06bb30 con 0x7ff65c1449e0 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff65b7fe640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff65c166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.992+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff644003520 con 0x7ff65c1449e0 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216276638 0 0) 0x7ff644003520 con 0x7ff65c1449e0 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 msgr2=0x7ff65c166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff65c166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 >> v1:172.21.15.151:6789/0 conn(0x7ff65c0b0b50 legacy=0x7ff65c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0b0630 con 0x7ff65c1449e0 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff64c001670 con 0x7ff65c1449e0 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff65b7fe640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff65c166200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:53:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 >> v1:172.21.15.113:6789/0 conn(0x7ff65c1449e0 legacy=0x7ff65c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff644003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004000 0x7ff6440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff644004d00 0x7ff644005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b0350 con 0x7ff644004d00 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64400bb70 con 0x7ff644004000 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64400bd30 con 0x7ff65c06c6b0 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff65b7fe640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff644004d00 0x7ff644005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff65affd640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff644003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff65b7fe640 1 -- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 msgr2=0x7ff644003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff65b7fe640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff644003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff65b7fe640 1 -- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004000 msgr2=0x7ff6440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.993+0000 7ff65b7fe640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004000 0x7ff6440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.994+0000 7ff65b7fe640 1 -- 172.21.15.113:0/2738976695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644003520 con 0x7ff644004d00 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.994+0000 7ff65affd640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c06c6b0 0x7ff644003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.994+0000 7ff65b7fe640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff644004d00 0x7ff644005180 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff6540073e0 tx=0x7ff6440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f800017630c3e047 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:24.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65402cd30 con 0x7ff644004d00 2023-12-19T13:53:24.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65402ce90 con 0x7ff644004d00 2023-12-19T13:53:24.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff659ffb640 1 -- 172.21.15.113:0/2738976695 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654034640 con 0x7ff644004d00 2023-12-19T13:53:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff6615d9640 1 -- 172.21.15.113:0/2738976695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff644004d00 msgr2=0x7ff644005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff6615d9640 1 --2- 172.21.15.113:0/2738976695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff644004d00 0x7ff644005180 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff6540073e0 tx=0x7ff6440057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff65b7fe640 1 -- 172.21.15.113:0/2738976695 reap_dead start 2023-12-19T13:53:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff6615d9640 1 -- 172.21.15.113:0/2738976695 shutdown_connections 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff6615d9640 1 -- 172.21.15.113:0/2738976695 >> 172.21.15.113:0/2738976695 conn(0x7ff65c0cbb70 msgr2=0x7ff65c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff6615d9640 1 -- 172.21.15.113:0/2738976695 shutdown_connections 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.995+0000 7ff6615d9640 1 -- 172.21.15.113:0/2738976695 wait complete. 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.997+0000 7ff6615d9640 1 Processor -- start 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.997+0000 7ff6615d9640 1 -- start start 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.998+0000 7ff6615d9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004d00 0x7ff65c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.998+0000 7ff6615d9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff65c0ad2c0 0x7ff65c13d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.998+0000 7ff6615d9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c0ad740 0x7ff65c13dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.998+0000 7ff6615d9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c15c580 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.998+0000 7ff6615d9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c15b970 con 0x7ff644004d00 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.998+0000 7ff6615d9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c15bc50 con 0x7ff65c0ad740 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.998+0000 7ff65a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff65c0ad2c0 0x7ff65c13d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff65c0ad2c0 0x7ff65c13d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48570/0 (socket says 172.21.15.113:48570) 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 -- 172.21.15.113:0/1144956452 learned_addr learned my addr 172.21.15.113:0/1144956452 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65affd640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004d00 0x7ff65c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 -- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c0ad740 msgr2=0x7ff65c13dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65b7fe640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c0ad740 0x7ff65c13dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c0ad740 0x7ff65c13dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 -- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004d00 msgr2=0x7ff65c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004d00 0x7ff65c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 -- 172.21.15.113:0/1144956452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c15bf30 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65affd640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004d00 0x7ff65c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff65a7fc640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff65c0ad2c0 0x7ff65c13d6a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff65000c450 tx=0x7ff65000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff6437fe640 1 -- 172.21.15.113:0/1144956452 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500052d0 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff6437fe640 1 -- 172.21.15.113:0/1144956452 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650005430 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff6437fe640 1 -- 172.21.15.113:0/1144956452 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650012870 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:24.999+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c15c210 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.000+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c15ca10 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.001+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c15c730 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.001+0000 7ff6437fe640 1 -- 172.21.15.113:0/1144956452 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6500129d0 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.003+0000 7ff6437fe640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff64806a430 0x7ff64806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.003+0000 7ff6437fe640 1 -- 172.21.15.113:0/1144956452 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff650088430 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.003+0000 7ff65affd640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff64806a430 0x7ff64806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.003+0000 7ff65affd640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff64806a430 0x7ff64806c8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff64c001eb0 tx=0x7ff64c001560 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.007+0000 7ff6437fe640 1 -- 172.21.15.113:0/1144956452 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff650053a00 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.200+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff65c061910 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.203+0000 7ff6437fe640 1 -- 172.21.15.113:0/1144956452 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16164 (secure 0 0 0) 0x7ff650057020 con 0x7ff65c0ad2c0 2023-12-19T13:53:25.202 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:25.202 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":120,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:14.625779+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff64806a430 msgr2=0x7ff64806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff64806a430 0x7ff64806c8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff64c001eb0 tx=0x7ff64c001560 comp rx=0 tx=0).stop 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff65c0ad2c0 msgr2=0x7ff65c13d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff65c0ad2c0 0x7ff65c13d6a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff65000c450 tx=0x7ff65000c910 comp rx=0 tx=0).stop 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 shutdown_connections 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff64806a430 0x7ff64806c8f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff65c0ad740 0x7ff65c13dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff65c0ad2c0 0x7ff65c13d6a0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 --2- 172.21.15.113:0/1144956452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff644004d00 0x7ff65c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.205+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 >> 172.21.15.113:0/1144956452 conn(0x7ff65c0cbb70 msgr2=0x7ff65c070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:25.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.206+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 shutdown_connections 2023-12-19T13:53:25.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.206+0000 7ff6615d9640 1 -- 172.21.15.113:0/1144956452 wait complete. 2023-12-19T13:53:25.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:52:38.334371+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:52:39.588248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:53:25.223 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:53:25.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.440+0000 7fa5147fd640 1 Processor -- start 2023-12-19T13:53:25.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.440+0000 7fa5147fd640 1 -- start start 2023-12-19T13:53:25.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa5147fd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa50c154760 0x7fa50c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa5147fd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c0ccbd0 con 0x7fa50c0b0070 2023-12-19T13:53:25.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa5147fd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c154b40 con 0x7fa50c0cb810 2023-12-19T13:53:25.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa5147fd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c0ccf20 con 0x7fa50c154760 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa512d9a640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa50c0b0070 0x7fa50c0cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57216/0 (socket says 172.21.15.113:57216) 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa512d9a640 1 -- 172.21.15.113:0/45838436 learned_addr learned my addr 172.21.15.113:0/45838436 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa512599640 1 --2- 172.21.15.113:0/45838436 >> v2:172.21.15.151:3300/0 conn(0x7fa50c154760 0x7fa50c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.442+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829648765 0 0) 0x7fa50c0ccbd0 con 0x7fa50c0b0070 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f8005730 con 0x7fa50c0b0070 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687283526 0 0) 0x7fa4f8005730 con 0x7fa50c0b0070 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 >> v2:172.21.15.151:3300/0 conn(0x7fa50c154760 msgr2=0x7fa50c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 --2- 172.21.15.113:0/45838436 >> v2:172.21.15.151:3300/0 conn(0x7fa50c154760 0x7fa50c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 >> v1:172.21.15.151:6789/0 conn(0x7fa50c0cb810 legacy=0x7fa50c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0cc060 con 0x7fa50c0b0070 2023-12-19T13:53:25.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fa5040019f0 con 0x7fa50c0b0070 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 >> v1:172.21.15.113:6789/0 conn(0x7fa50c0b0070 legacy=0x7fa50c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa4f8005c40 0x7fa4f8006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4f80069d0 0x7fa4f8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f80074b0 0x7fa4f800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0ccf20 con 0x7fa4f8005c40 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f800e380 con 0x7fa4f80074b0 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f800e540 con 0x7fa4f80069d0 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.443+0000 7fa512599640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa4f8005c40 0x7fa4f8006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.444+0000 7fa512599640 1 -- 172.21.15.113:0/45838436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4f80069d0 msgr2=0x7fa4f8006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.444+0000 7fa512599640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4f80069d0 0x7fa4f8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.444+0000 7fa512599640 1 -- 172.21.15.113:0/45838436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f80074b0 msgr2=0x7fa4f800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.444+0000 7fa512599640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f80074b0 0x7fa4f800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.444+0000 7fa512599640 1 -- 172.21.15.113:0/45838436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8005730 con 0x7fa4f8005c40 2023-12-19T13:53:25.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.444+0000 7fa512d9a640 1 -- 172.21.15.113:0/45838436 reap_dead start 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.445+0000 7fa512599640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa4f8005c40 0x7fa4f8006060 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa508009ac0 tx=0x7fa4f8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5497fcba3b2751 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.445+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50802c710 con 0x7fa4f8005c40 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.445+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50802c870 con 0x7fa4f8005c40 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.445+0000 7fa511597640 1 -- 172.21.15.113:0/45838436 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50802cc00 con 0x7fa4f8005c40 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.446+0000 7fa5147fd640 1 -- 172.21.15.113:0/45838436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa4f8005c40 msgr2=0x7fa4f8006060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.446+0000 7fa5147fd640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa4f8005c40 0x7fa4f8006060 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa508009ac0 tx=0x7fa4f8007a00 comp rx=0 tx=0).stop 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.446+0000 7fa5147fd640 1 -- 172.21.15.113:0/45838436 shutdown_connections 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.446+0000 7fa5147fd640 1 --2- 172.21.15.113:0/45838436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa4f8005c40 0x7fa4f8006060 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.446+0000 7fa5147fd640 1 -- 172.21.15.113:0/45838436 >> 172.21.15.113:0/45838436 conn(0x7fa50c073150 msgr2=0x7fa50c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.446+0000 7fa5147fd640 1 -- 172.21.15.113:0/45838436 shutdown_connections 2023-12-19T13:53:25.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.446+0000 7fa5147fd640 1 -- 172.21.15.113:0/45838436 wait complete. 2023-12-19T13:53:25.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.448+0000 7fa5147fd640 1 Processor -- start 2023-12-19T13:53:25.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.448+0000 7fa5147fd640 1 -- start start 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa5147fd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f8005c40 0x7fa50c157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa5147fd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa50c14be20 0x7fa50c1f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa5147fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa50c1f2e10 0x7fa50c1f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa5147fd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c154e70 con 0x7fa50c1f2e10 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa5147fd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c06e830 con 0x7fa4f8005c40 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa5147fd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c157b40 con 0x7fa50c14be20 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa512d9a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa50c1f2e10 0x7fa50c1f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa512d9a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa50c1f2e10 0x7fa50c1f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48592/0 (socket says 172.21.15.113:48592) 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa512d9a640 1 -- 172.21.15.113:0/979839239 learned_addr learned my addr 172.21.15.113:0/979839239 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.449+0000 7fa512599640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f8005c40 0x7fa50c157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa511d98640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa50c14be20 0x7fa50c1f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa512d9a640 1 -- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa50c14be20 msgr2=0x7fa50c1f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa512d9a640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa50c14be20 0x7fa50c1f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa512d9a640 1 -- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f8005c40 msgr2=0x7fa50c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa512d9a640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f8005c40 0x7fa50c157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa512d9a640 1 -- 172.21.15.113:0/979839239 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c1f3290 con 0x7fa50c1f2e10 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa512599640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f8005c40 0x7fa50c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa512d9a640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa50c1f2e10 0x7fa50c1f5ef0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa50c071980 tx=0x7fa50400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa502ffd640 1 -- 172.21.15.113:0/979839239 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400cea0 con 0x7fa50c1f2e10 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa502ffd640 1 -- 172.21.15.113:0/979839239 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400a5e0 con 0x7fa50c1f2e10 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c06df90 con 0x7fa50c1f2e10 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa502ffd640 1 -- 172.21.15.113:0/979839239 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400a970 con 0x7fa50c1f2e10 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.450+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c06e550 con 0x7fa50c1f2e10 2023-12-19T13:53:25.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.451+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c061910 con 0x7fa50c1f2e10 2023-12-19T13:53:25.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.453+0000 7fa502ffd640 1 -- 172.21.15.113:0/979839239 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa50400aad0 con 0x7fa50c1f2e10 2023-12-19T13:53:25.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.454+0000 7fa502ffd640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa4f006a460 0x7fa4f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.454+0000 7fa502ffd640 1 -- 172.21.15.113:0/979839239 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5040881e0 con 0x7fa50c1f2e10 2023-12-19T13:53:25.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.454+0000 7fa512599640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa4f006a460 0x7fa4f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.455+0000 7fa512599640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa4f006a460 0x7fa4f006c920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa508036000 tx=0x7fa508030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.458+0000 7fa502ffd640 1 -- 172.21.15.113:0/979839239 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5040536a0 con 0x7fa50c1f2e10 2023-12-19T13:53:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.650+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa50c15aff0 con 0x7fa50c1f2e10 2023-12-19T13:53:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.651+0000 7fa502ffd640 1 -- 172.21.15.113:0/979839239 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa504056cc0 con 0x7fa50c1f2e10 2023-12-19T13:53:25.650 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:53:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa4f006a460 msgr2=0x7fa4f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa4f006a460 0x7fa4f006c920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa508036000 tx=0x7fa508030000 comp rx=0 tx=0).stop 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa50c1f2e10 msgr2=0x7fa50c1f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa50c1f2e10 0x7fa50c1f5ef0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa50c071980 tx=0x7fa50400cc50 comp rx=0 tx=0).stop 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 shutdown_connections 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa4f006a460 0x7fa4f006c920 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa50c1f2e10 0x7fa50c1f5ef0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa50c14be20 0x7fa50c1f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 --2- 172.21.15.113:0/979839239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4f8005c40 0x7fa50c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 >> 172.21.15.113:0/979839239 conn(0x7fa50c073150 msgr2=0x7fa50c0b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 shutdown_connections 2023-12-19T13:53:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.654+0000 7fa5147fd640 1 -- 172.21.15.113:0/979839239 wait complete. 2023-12-19T13:53:25.673 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:53:25.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.884+0000 7f27afcca640 1 Processor -- start 2023-12-19T13:53:25.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.884+0000 7f27afcca640 1 -- start start 2023-12-19T13:53:25.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.885+0000 7f27afcca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f27a8157bf0 0x7f27a815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.885+0000 7f27afcca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f27a80b0810 0x7f27a806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.885+0000 7f27afcca640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a815b740 con 0x7f27a80ae110 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.885+0000 7f27afcca640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a806b8c0 con 0x7f27a80b0810 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.885+0000 7f27afcca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a80ae640 con 0x7f27a8157bf0 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ad265640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f27a80ae110 0x7f27a80b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57226/0 (socket says 172.21.15.113:57226) 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ad265640 1 -- 172.21.15.113:0/1588734903 learned_addr learned my addr 172.21.15.113:0/1588734903 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ae267640 1 --2- 172.21.15.113:0/1588734903 >> v2:172.21.15.113:3300/0 conn(0x7f27a80b0810 0x7f27a806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ada66640 1 --2- 172.21.15.113:0/1588734903 >> v2:172.21.15.151:3300/0 conn(0x7f27a8157bf0 0x7f27a815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27aca64640 1 -- 172.21.15.113:0/1588734903 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408786847 0 0) 0x7f27a815b740 con 0x7f27a80ae110 2023-12-19T13:53:25.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27aca64640 1 -- 172.21.15.113:0/1588734903 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2794003520 con 0x7f27a80ae110 2023-12-19T13:53:25.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ae267640 1 -- 172.21.15.113:0/1588734903 >> v2:172.21.15.151:3300/0 conn(0x7f27a8157bf0 msgr2=0x7f27a815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:25.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ae267640 1 --2- 172.21.15.113:0/1588734903 >> v2:172.21.15.151:3300/0 conn(0x7f27a8157bf0 0x7f27a815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ae267640 1 -- 172.21.15.113:0/1588734903 >> v1:172.21.15.113:6789/0 conn(0x7f27a80ae110 legacy=0x7f27a80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ae267640 1 -- 172.21.15.113:0/1588734903 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a80ae920 con 0x7f27a80b0810 2023-12-19T13:53:25.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.886+0000 7f27ada66640 1 --2- 172.21.15.113:0/1588734903 >> v2:172.21.15.151:3300/0 conn(0x7f27a8157bf0 0x7f27a815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:53:25.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.888+0000 7f27ae267640 1 --2- 172.21.15.113:0/1588734903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a80b0810 0x7f27a806d230 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f27a80ccbc0 tx=0x7f27a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e495690c87f99a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.888+0000 7f27aca64640 1 -- 172.21.15.113:0/1588734903 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a002cc80 con 0x7f27a80b0810 2023-12-19T13:53:25.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.888+0000 7f27aca64640 1 -- 172.21.15.113:0/1588734903 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a002cde0 con 0x7f27a80b0810 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.888+0000 7f27aca64640 1 -- 172.21.15.113:0/1588734903 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0034660 con 0x7f27a80b0810 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 -- 172.21.15.113:0/1588734903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a80b0810 msgr2=0x7f27a806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 --2- 172.21.15.113:0/1588734903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a80b0810 0x7f27a806d230 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f27a80ccbc0 tx=0x7f27a002bed0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 -- 172.21.15.113:0/1588734903 shutdown_connections 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 --2- 172.21.15.113:0/1588734903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a80b0810 0x7f27a806d230 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 --2- 172.21.15.113:0/1588734903 >> v2:172.21.15.151:3300/0 conn(0x7f27a8157bf0 0x7f27a815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 -- 172.21.15.113:0/1588734903 >> 172.21.15.113:0/1588734903 conn(0x7f27a80cbb70 msgr2=0x7f27a80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 -- 172.21.15.113:0/1588734903 shutdown_connections 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.889+0000 7f27afcca640 1 -- 172.21.15.113:0/1588734903 wait complete. 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.891+0000 7f27afcca640 1 Processor -- start 2023-12-19T13:53:25.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.891+0000 7f27afcca640 1 -- start start 2023-12-19T13:53:25.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27afcca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27a80ae110 0x7f27a81f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27afcca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27a80b0810 0x7f27a81436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27afcca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a8157bf0 0x7f27a8070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27afcca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a81f5ab0 con 0x7f27a8157bf0 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27afcca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a8143c10 con 0x7f27a80ae110 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27afcca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a81f6260 con 0x7f27a80b0810 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a8157bf0 0x7f27a8070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a8157bf0 0x7f27a8070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48622/0 (socket says 172.21.15.113:48622) 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 -- 172.21.15.113:0/1471746460 learned_addr learned my addr 172.21.15.113:0/1471746460 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ad265640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27a80b0810 0x7f27a81436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ada66640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27a80ae110 0x7f27a81f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 -- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27a80b0810 msgr2=0x7f27a81436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27a80b0810 0x7f27a81436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 -- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27a80ae110 msgr2=0x7f27a81f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27a80ae110 0x7f27a81f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ae267640 1 -- 172.21.15.113:0/1471746460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0009a70 con 0x7f27a8157bf0 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ada66640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27a80ae110 0x7f27a81f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:25.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.892+0000 7f27ad265640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27a80b0810 0x7f27a81436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:25.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.893+0000 7f27ae267640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a8157bf0 0x7f27a8070980 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f27a002c4e0 tx=0x7f27a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.893+0000 7f279e7fc640 1 -- 172.21.15.113:0/1471746460 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a003e610 con 0x7f27a8157bf0 2023-12-19T13:53:25.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.893+0000 7f279e7fc640 1 -- 172.21.15.113:0/1471746460 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a003e770 con 0x7f27a8157bf0 2023-12-19T13:53:25.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.893+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a81f6540 con 0x7f27a8157bf0 2023-12-19T13:53:25.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.893+0000 7f279e7fc640 1 -- 172.21.15.113:0/1471746460 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a003eb20 con 0x7f27a8157bf0 2023-12-19T13:53:25.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.893+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a81f6b00 con 0x7f27a8157bf0 2023-12-19T13:53:25.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.894+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a81660b0 con 0x7f27a8157bf0 2023-12-19T13:53:25.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.895+0000 7f279e7fc640 1 -- 172.21.15.113:0/1471746460 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27a003b050 con 0x7f27a8157bf0 2023-12-19T13:53:25.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.896+0000 7f279e7fc640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f278c06a460 0x7f278c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:25.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.896+0000 7f279e7fc640 1 -- 172.21.15.113:0/1471746460 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27a00aaa50 con 0x7f27a8157bf0 2023-12-19T13:53:25.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.896+0000 7f27ada66640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f278c06a460 0x7f278c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:25.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.897+0000 7f27ada66640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f278c06a460 0x7f278c06c920 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f27a4006fd0 tx=0x7f27a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:25.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:25.901+0000 7f279e7fc640 1 -- 172.21.15.113:0/1471746460 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f27a0076180 con 0x7f27a8157bf0 2023-12-19T13:53:26.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.093+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27a8061910 con 0x7f27a8157bf0 2023-12-19T13:53:26.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.094+0000 7f279e7fc640 1 -- 172.21.15.113:0/1471746460 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27a0009450 con 0x7f27a8157bf0 2023-12-19T13:53:26.094 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:53:26.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f278c06a460 msgr2=0x7f278c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f278c06a460 0x7f278c06c920 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f27a4006fd0 tx=0x7f27a4008040 comp rx=0 tx=0).stop 2023-12-19T13:53:26.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a8157bf0 msgr2=0x7f27a8070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a8157bf0 0x7f27a8070980 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f27a002c4e0 tx=0x7f27a0004a40 comp rx=0 tx=0).stop 2023-12-19T13:53:26.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 shutdown_connections 2023-12-19T13:53:26.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f278c06a460 0x7f278c06c920 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27a8157bf0 0x7f27a8070980 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27a80b0810 0x7f27a81436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 --2- 172.21.15.113:0/1471746460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27a80ae110 0x7f27a81f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.097+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 >> 172.21.15.113:0/1471746460 conn(0x7f27a80cbb70 msgr2=0x7f27a806d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:26.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.098+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 shutdown_connections 2023-12-19T13:53:26.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.098+0000 7f27afcca640 1 -- 172.21.15.113:0/1471746460 wait complete. 2023-12-19T13:53:26.115 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:53:26.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.330+0000 7f77268bd640 1 Processor -- start 2023-12-19T13:53:26.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.330+0000 7f77268bd640 1 -- start start 2023-12-19T13:53:26.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f77268bd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f772015b1d0 0x7f77200b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f77268bd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77200ceea0 0x7f77200cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f77268bd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772015fde0 con 0x7f77200b1ec0 2023-12-19T13:53:26.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f77268bd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77200cf870 con 0x7f77200ceea0 2023-12-19T13:53:26.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f77268bd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772015ef10 con 0x7f772015b1d0 2023-12-19T13:53:26.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f7724e5a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77200ceea0 0x7f77200cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f7724e5a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77200ceea0 0x7f77200cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48630/0 (socket says 172.21.15.113:48630) 2023-12-19T13:53:26.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f7724e5a640 1 -- 172.21.15.113:0/2850380176 learned_addr learned my addr 172.21.15.113:0/2850380176 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:26.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.332+0000 7f771ffff640 1 --2- 172.21.15.113:0/2850380176 >> v2:172.21.15.151:3300/0 conn(0x7f772015b1d0 0x7f77200b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.333+0000 7f7724e5a640 1 -- 172.21.15.113:0/2850380176 >> v2:172.21.15.151:3300/0 conn(0x7f772015b1d0 msgr2=0x7f77200b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:26.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.333+0000 7f7724e5a640 1 --2- 172.21.15.113:0/2850380176 >> v2:172.21.15.151:3300/0 conn(0x7f772015b1d0 0x7f77200b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.333+0000 7f7724e5a640 1 -- 172.21.15.113:0/2850380176 >> v1:172.21.15.151:6789/0 conn(0x7f77200b1ec0 legacy=0x7f772015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:26.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.333+0000 7f7724e5a640 1 -- 172.21.15.113:0/2850380176 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200b2320 con 0x7f77200ceea0 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.334+0000 7f7724e5a640 1 --2- 172.21.15.113:0/2850380176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77200ceea0 0x7f77200cf330 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f77200ae020 tx=0x7f771802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772d86b3bf18ce86 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.334+0000 7f771effd640 1 -- 172.21.15.113:0/2850380176 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771802ca80 con 0x7f77200ceea0 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.334+0000 7f771effd640 1 -- 172.21.15.113:0/2850380176 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771802cbe0 con 0x7f77200ceea0 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.334+0000 7f771effd640 1 -- 172.21.15.113:0/2850380176 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180343f0 con 0x7f77200ceea0 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 -- 172.21.15.113:0/2850380176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77200ceea0 msgr2=0x7f77200cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 --2- 172.21.15.113:0/2850380176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77200ceea0 0x7f77200cf330 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f77200ae020 tx=0x7f771802bee0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 -- 172.21.15.113:0/2850380176 shutdown_connections 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 --2- 172.21.15.113:0/2850380176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77200ceea0 0x7f77200cf330 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 --2- 172.21.15.113:0/2850380176 >> v2:172.21.15.151:3300/0 conn(0x7f772015b1d0 0x7f77200b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 -- 172.21.15.113:0/2850380176 >> 172.21.15.113:0/2850380176 conn(0x7f7720073150 msgr2=0x7f77200659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:26.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 -- 172.21.15.113:0/2850380176 shutdown_connections 2023-12-19T13:53:26.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.335+0000 7f77268bd640 1 -- 172.21.15.113:0/2850380176 wait complete. 2023-12-19T13:53:26.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.337+0000 7f77268bd640 1 Processor -- start 2023-12-19T13:53:26.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.337+0000 7f77268bd640 1 -- start start 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f77268bd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77200b1ec0 0x7f772006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f77268bd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77200ceea0 0x7f77200ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f77268bd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f772015b1d0 0x7f77200b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f77268bd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77200c9cc0 con 0x7f772015b1d0 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f77268bd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77200ca520 con 0x7f77200ceea0 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f77268bd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772006d960 con 0x7f77200b1ec0 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f7724e5a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f772015b1d0 0x7f77200b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f7724e5a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f772015b1d0 0x7f77200b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48632/0 (socket says 172.21.15.113:48632) 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f7724e5a640 1 -- 172.21.15.113:0/4194372674 learned_addr learned my addr 172.21.15.113:0/4194372674 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f771ffff640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77200b1ec0 0x7f772006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f771f7fe640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77200ceea0 0x7f77200ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.338+0000 7f7724e5a640 1 -- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77200b1ec0 msgr2=0x7f772006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f7724e5a640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77200b1ec0 0x7f772006d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f7724e5a640 1 -- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77200ceea0 msgr2=0x7f77200ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f7724e5a640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77200ceea0 0x7f77200ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f7724e5a640 1 -- 172.21.15.113:0/4194372674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009b30 con 0x7f772015b1d0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f7724e5a640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f772015b1d0 0x7f77200b35d0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7718036040 tx=0x7f7718004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f771cff9640 1 -- 172.21.15.113:0/4194372674 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718009510 con 0x7f772015b1d0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f771cff9640 1 -- 172.21.15.113:0/4194372674 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771803e450 con 0x7f772015b1d0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f771cff9640 1 -- 172.21.15.113:0/4194372674 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771803e800 con 0x7f772015b1d0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77200c9ed0 con 0x7f772015b1d0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.339+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77200b3b10 con 0x7f772015b1d0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.341+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77200ca6d0 con 0x7f772015b1d0 2023-12-19T13:53:26.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.341+0000 7f771cff9640 1 -- 172.21.15.113:0/4194372674 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f771802cd50 con 0x7f772015b1d0 2023-12-19T13:53:26.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.342+0000 7f771cff9640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f770c06a430 0x7f770c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.342+0000 7f771cff9640 1 -- 172.21.15.113:0/4194372674 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77180ab4b0 con 0x7f772015b1d0 2023-12-19T13:53:26.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.343+0000 7f771ffff640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f770c06a430 0x7f770c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.343+0000 7f771ffff640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f770c06a430 0x7f770c06c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7710006fd0 tx=0x7f7710008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:26.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.347+0000 7f771cff9640 1 -- 172.21.15.113:0/4194372674 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f77200ca6d0 con 0x7f772015b1d0 2023-12-19T13:53:26.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.538+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77200ca690 con 0x7f772015b1d0 2023-12-19T13:53:26.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.538+0000 7f771cff9640 1 -- 172.21.15.113:0/4194372674 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7718076a00 con 0x7f772015b1d0 2023-12-19T13:53:26.538 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:53:26.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f770c06a430 msgr2=0x7f770c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f770c06a430 0x7f770c06c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7710006fd0 tx=0x7f7710008040 comp rx=0 tx=0).stop 2023-12-19T13:53:26.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f772015b1d0 msgr2=0x7f77200b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f772015b1d0 0x7f77200b35d0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7718036040 tx=0x7f7718004a40 comp rx=0 tx=0).stop 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 shutdown_connections 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f770c06a430 0x7f770c06c8f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f772015b1d0 0x7f77200b35d0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77200ceea0 0x7f77200ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 --2- 172.21.15.113:0/4194372674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77200b1ec0 0x7f772006d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 >> 172.21.15.113:0/4194372674 conn(0x7f7720073150 msgr2=0x7f77201587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 shutdown_connections 2023-12-19T13:53:26.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.542+0000 7f77268bd640 1 -- 172.21.15.113:0/4194372674 wait complete. 2023-12-19T13:53:26.560 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:53:26.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.775+0000 7fdfe0a17640 1 Processor -- start 2023-12-19T13:53:26.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.775+0000 7fdfe0a17640 1 -- start start 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfe0a17640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc146da0 0x7fdfdc0aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfe0a17640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdfdc147180 0x7fdfdc0aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfe0a17640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0d1070 con 0x7fdfdc1611f0 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfe0a17640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc162020 con 0x7fdfdc147180 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfe0a17640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0aabd0 con 0x7fdfdc146da0 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfd9d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdfdc147180 0x7fdfdc0aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfd9d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdfdc147180 0x7fdfdc0aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48644/0 (socket says 172.21.15.113:48644) 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfd9d9b640 1 -- 172.21.15.113:0/19699443 learned_addr learned my addr 172.21.15.113:0/19699443 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfda59c640 1 --2- 172.21.15.113:0/19699443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc146da0 0x7fdfdc0aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfd9d9b640 1 -- 172.21.15.113:0/19699443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc146da0 msgr2=0x7fdfdc0aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfd9d9b640 1 --2- 172.21.15.113:0/19699443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc146da0 0x7fdfdc0aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfd9d9b640 1 -- 172.21.15.113:0/19699443 >> v1:172.21.15.113:6789/0 conn(0x7fdfdc1611f0 legacy=0x7fdfdc0abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfd9d9b640 1 -- 172.21.15.113:0/19699443 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0aaeb0 con 0x7fdfdc147180 2023-12-19T13:53:26.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.777+0000 7fdfda59c640 1 --2- 172.21.15.113:0/19699443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc146da0 0x7fdfdc0aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfd9d9b640 1 --2- 172.21.15.113:0/19699443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc147180 0x7fdfdc0aa5a0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009870 tx=0x7fdfc402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07a4de2d939130 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfd959a640 1 -- 172.21.15.113:0/19699443 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4030840 con 0x7fdfdc147180 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfd959a640 1 -- 172.21.15.113:0/19699443 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc40309a0 con 0x7fdfdc147180 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfd959a640 1 -- 172.21.15.113:0/19699443 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4030d30 con 0x7fdfdc147180 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfe0a17640 1 -- 172.21.15.113:0/19699443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc147180 msgr2=0x7fdfdc0aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/19699443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc147180 0x7fdfdc0aa5a0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009870 tx=0x7fdfc402b980 comp rx=0 tx=0).stop 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfe0a17640 1 -- 172.21.15.113:0/19699443 shutdown_connections 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/19699443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc147180 0x7fdfdc0aa5a0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/19699443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc146da0 0x7fdfdc0aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.779+0000 7fdfe0a17640 1 -- 172.21.15.113:0/19699443 >> 172.21.15.113:0/19699443 conn(0x7fdfdc071a50 msgr2=0x7fdfdc0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:26.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.780+0000 7fdfe0a17640 1 -- 172.21.15.113:0/19699443 shutdown_connections 2023-12-19T13:53:26.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.780+0000 7fdfe0a17640 1 -- 172.21.15.113:0/19699443 wait complete. 2023-12-19T13:53:26.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.781+0000 7fdfe0a17640 1 Processor -- start 2023-12-19T13:53:26.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.781+0000 7fdfe0a17640 1 -- start start 2023-12-19T13:53:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.782+0000 7fdfe0a17640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc146da0 0x7fdfdc13a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.782+0000 7fdfe0a17640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc1611f0 0x7fdfdc0d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.782+0000 7fdfe0a17640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc145df0 0x7fdfdc142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.782+0000 7fdfe0a17640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc139660 con 0x7fdfdc146da0 2023-12-19T13:53:26.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.782+0000 7fdfe0a17640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc13a4c0 con 0x7fdfdc145df0 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.782+0000 7fdfe0a17640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc145200 con 0x7fdfdc1611f0 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc146da0 0x7fdfdc13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc146da0 0x7fdfdc13a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48648/0 (socket says 172.21.15.113:48648) 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 -- 172.21.15.113:0/3095481198 learned_addr learned my addr 172.21.15.113:0/3095481198 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfd9d9b640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc1611f0 0x7fdfdc0d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfdad9d640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc145df0 0x7fdfdc142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 -- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc1611f0 msgr2=0x7fdfdc0d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc1611f0 0x7fdfdc0d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 -- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc145df0 msgr2=0x7fdfdc142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc145df0 0x7fdfdc142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 -- 172.21.15.113:0/3095481198 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40094d0 con 0x7fdfdc146da0 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfdad9d640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc145df0 0x7fdfdc142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.783+0000 7fdfda59c640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc146da0 0x7fdfdc13a950 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00cf90 tx=0x7fdfcc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.784+0000 7fdfd2ffd640 1 -- 172.21.15.113:0/3095481198 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00d840 con 0x7fdfdc146da0 2023-12-19T13:53:26.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.784+0000 7fdfd2ffd640 1 -- 172.21.15.113:0/3095481198 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00d9a0 con 0x7fdfdc146da0 2023-12-19T13:53:26.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.784+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc1398b0 con 0x7fdfdc146da0 2023-12-19T13:53:26.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.784+0000 7fdfd2ffd640 1 -- 172.21.15.113:0/3095481198 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00dd30 con 0x7fdfdc146da0 2023-12-19T13:53:26.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.784+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc139e70 con 0x7fdfdc146da0 2023-12-19T13:53:26.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.785+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc073ec0 con 0x7fdfdc146da0 2023-12-19T13:53:26.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.786+0000 7fdfd2ffd640 1 -- 172.21.15.113:0/3095481198 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdfcc015440 con 0x7fdfdc146da0 2023-12-19T13:53:26.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.787+0000 7fdfd2ffd640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:26.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.787+0000 7fdfd2ffd640 1 -- 172.21.15.113:0/3095481198 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfcc0893b0 con 0x7fdfdc146da0 2023-12-19T13:53:26.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.787+0000 7fdfd9d9b640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:26.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.788+0000 7fdfd9d9b640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4036000 tx=0x7fdfc4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.791+0000 7fdfd2ffd640 1 -- 172.21.15.113:0/3095481198 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdfcc0549b0 con 0x7fdfdc146da0 2023-12-19T13:53:26.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.993+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdfdc061910 con 0x7fdfdc146da0 2023-12-19T13:53:26.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.994+0000 7fdfd2ffd640 1 -- 172.21.15.113:0/3095481198 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v120) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdfcc057fd0 con 0x7fdfdc146da0 2023-12-19T13:53:26.994 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:53:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdfbc06a430 msgr2=0x7fdfbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4036000 tx=0x7fdfc4008030 comp rx=0 tx=0).stop 2023-12-19T13:53:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc146da0 msgr2=0x7fdfdc13a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:26.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc146da0 0x7fdfdc13a950 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00cf90 tx=0x7fdfcc00a7d0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 shutdown_connections 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc145df0 0x7fdfdc142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdfdc1611f0 0x7fdfdc0d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 --2- 172.21.15.113:0/3095481198 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfdc146da0 0x7fdfdc13a950 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 >> 172.21.15.113:0/3095481198 conn(0x7fdfdc071a50 msgr2=0x7fdfdc15ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 shutdown_connections 2023-12-19T13:53:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:26.997+0000 7fdfe0a17640 1 -- 172.21.15.113:0/3095481198 wait complete. 2023-12-19T13:53:27.016 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:53:27.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:27.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:53:27.125 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:53:27.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:27.126 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:53:27.181 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:27.181 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:27.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:53:27.242 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:53:27.242 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:27.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:53:27.302 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:27.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.525+0000 7fa0b70ef640 1 Processor -- start 2023-12-19T13:53:27.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.525+0000 7fa0b70ef640 1 -- start start 2023-12-19T13:53:27.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b70ef640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0b015da00 0x7fa0b00b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b70ef640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b00b4120 con 0x7fa0b00cf670 2023-12-19T13:53:27.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b70ef640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b00b5b80 con 0x7fa0b015d620 2023-12-19T13:53:27.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b70ef640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b00b6ee0 con 0x7fa0b015da00 2023-12-19T13:53:27.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b58ec640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa0b00cf670 0x7fa0b00b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57254/0 (socket says 172.21.15.113:57254) 2023-12-19T13:53:27.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b58ec640 1 -- 172.21.15.113:0/4143693257 learned_addr learned my addr 172.21.15.113:0/4143693257 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376358044 0 0) 0x7fa0b00b4120 con 0x7fa0b00cf670 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa09c003520 con 0x7fa0b00cf670 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.527+0000 7fa0b68ee640 1 --2- 172.21.15.113:0/4143693257 >> v2:172.21.15.151:3300/0 conn(0x7fa0b015da00 0x7fa0b00b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389461918 0 0) 0x7fa09c003520 con 0x7fa0b00cf670 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 >> v2:172.21.15.151:3300/0 conn(0x7fa0b015da00 msgr2=0x7fa0b00b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 --2- 172.21.15.113:0/4143693257 >> v2:172.21.15.151:3300/0 conn(0x7fa0b015da00 0x7fa0b00b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 >> v1:172.21.15.151:6789/0 conn(0x7fa0b015d620 legacy=0x7fa0b00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b00b71c0 con 0x7fa0b00cf670 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fa0a0001670 con 0x7fa0b00cf670 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 >> v1:172.21.15.113:6789/0 conn(0x7fa0b00cf670 legacy=0x7fa0b00b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa09c003970 0x7fa09c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa09c0047c0 0x7fa09c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c005180 0x7fa09c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b00b6ee0 con 0x7fa09c0047c0 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c00c020 con 0x7fa09c003970 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c00c1e0 con 0x7fa09c005180 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.528+0000 7fa0b58ec640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa09c0047c0 0x7fa09c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b58ec640 1 -- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c005180 msgr2=0x7fa09c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b58ec640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c005180 0x7fa09c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b60ed640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa09c003970 0x7fa09c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b58ec640 1 -- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa09c003970 msgr2=0x7fa09c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b58ec640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa09c003970 0x7fa09c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b68ee640 1 -- 172.21.15.113:0/4143693257 reap_dead start 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b58ec640 1 -- 172.21.15.113:0/4143693257 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c003520 con 0x7fa09c0047c0 2023-12-19T13:53:27.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.529+0000 7fa0b60ed640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa09c003970 0x7fa09c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:27.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.530+0000 7fa0b58ec640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa09c0047c0 0x7fa09c004c40 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000c190 tx=0x7fa09c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2954518b181a60df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.530+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0005ad0 con 0x7fa09c0047c0 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.530+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0005c50 con 0x7fa09c0047c0 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.530+0000 7fa0b50eb640 1 -- 172.21.15.113:0/4143693257 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a002c870 con 0x7fa09c0047c0 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.531+0000 7fa0b70ef640 1 -- 172.21.15.113:0/4143693257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa09c0047c0 msgr2=0x7fa09c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.531+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa09c0047c0 0x7fa09c004c40 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000c190 tx=0x7fa09c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.531+0000 7fa0b70ef640 1 -- 172.21.15.113:0/4143693257 shutdown_connections 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.531+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/4143693257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa09c0047c0 0x7fa09c004c40 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.531+0000 7fa0b70ef640 1 -- 172.21.15.113:0/4143693257 >> 172.21.15.113:0/4143693257 conn(0x7fa0b00cfb90 msgr2=0x7fa0b00cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.531+0000 7fa0b70ef640 1 -- 172.21.15.113:0/4143693257 shutdown_connections 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.531+0000 7fa0b70ef640 1 -- 172.21.15.113:0/4143693257 wait complete. 2023-12-19T13:53:27.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.533+0000 7fa0b70ef640 1 Processor -- start 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.533+0000 7fa0b70ef640 1 -- start start 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b70ef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c0047c0 0x7fa0b015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b70ef640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0b015e320 0x7fa0b01453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b70ef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0b0145900 0x7fa0b0145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b70ef640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b015f4d0 con 0x7fa0b015e320 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b70ef640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b015e950 con 0x7fa0b0145900 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b70ef640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b015ec30 con 0x7fa09c0047c0 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0b015e320 0x7fa0b01453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0b015e320 0x7fa0b01453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48666/0 (socket says 172.21.15.113:48666) 2023-12-19T13:53:27.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 -- 172.21.15.113:0/475051477 learned_addr learned my addr 172.21.15.113:0/475051477 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b68ee640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0b0145900 0x7fa0b0145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b60ed640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c0047c0 0x7fa0b015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 -- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c0047c0 msgr2=0x7fa0b015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c0047c0 0x7fa0b015dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 -- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0b0145900 msgr2=0x7fa0b0145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0b0145900 0x7fa0b0145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b58ec640 1 -- 172.21.15.113:0/475051477 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b015ef10 con 0x7fa0b015e320 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.534+0000 7fa0b68ee640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0b0145900 0x7fa0b0145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:27.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.535+0000 7fa0b58ec640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0b015e320 0x7fa0b01453c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0001930 tx=0x7fa0a002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:27.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.535+0000 7fa0a6ffd640 1 -- 172.21.15.113:0/475051477 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a003c040 con 0x7fa0b015e320 2023-12-19T13:53:27.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.535+0000 7fa0a6ffd640 1 -- 172.21.15.113:0/475051477 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a002cdc0 con 0x7fa0b015e320 2023-12-19T13:53:27.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.535+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b015f1f0 con 0x7fa0b015e320 2023-12-19T13:53:27.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.535+0000 7fa0a6ffd640 1 -- 172.21.15.113:0/475051477 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0007290 con 0x7fa0b015e320 2023-12-19T13:53:27.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.535+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b00cde10 con 0x7fa0b015e320 2023-12-19T13:53:27.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.536+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b0156770 con 0x7fa0b015e320 2023-12-19T13:53:27.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.537+0000 7fa0a6ffd640 1 -- 172.21.15.113:0/475051477 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa0a0032070 con 0x7fa0b015e320 2023-12-19T13:53:27.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.538+0000 7fa0a6ffd640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa09406a430 0x7fa09406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.538+0000 7fa0a6ffd640 1 -- 172.21.15.113:0/475051477 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0a00a9e90 con 0x7fa0b015e320 2023-12-19T13:53:27.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.538+0000 7fa0b60ed640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa09406a430 0x7fa09406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.539+0000 7fa0b60ed640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa09406a430 0x7fa09406c8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa0b015d030 tx=0x7fa0ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:27.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.542+0000 7fa0a6ffd640 1 -- 172.21.15.113:0/475051477 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa0a00753e0 con 0x7fa0b015e320 2023-12-19T13:53:27.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.772+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0b0061910 con 0x7fa0b015e320 2023-12-19T13:53:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.773+0000 7fa0a6ffd640 1 -- 172.21.15.113:0/475051477 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fa0a00ab090 con 0x7fa0b015e320 2023-12-19T13:53:27.772 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:27.772 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:53:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:53:27.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.775+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa09406a430 msgr2=0x7fa09406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:27.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.775+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa09406a430 0x7fa09406c8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa0b015d030 tx=0x7fa0ac009040 comp rx=0 tx=0).stop 2023-12-19T13:53:27.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.775+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0b015e320 msgr2=0x7fa0b01453c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:27.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.775+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0b015e320 0x7fa0b01453c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0001930 tx=0x7fa0a002e070 comp rx=0 tx=0).stop 2023-12-19T13:53:27.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 shutdown_connections 2023-12-19T13:53:27.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa09406a430 0x7fa09406c8f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0b0145900 0x7fa0b0145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0b015e320 0x7fa0b01453c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 --2- 172.21.15.113:0/475051477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa09c0047c0 0x7fa0b015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 >> 172.21.15.113:0/475051477 conn(0x7fa0b00cfb90 msgr2=0x7fa0b0156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:27.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 shutdown_connections 2023-12-19T13:53:27.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.776+0000 7fa0b70ef640 1 -- 172.21.15.113:0/475051477 wait complete. 2023-12-19T13:53:27.792 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:27.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.997+0000 7fde07dd9640 1 Processor -- start 2023-12-19T13:53:27.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.997+0000 7fde07dd9640 1 -- start start 2023-12-19T13:53:27.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde07dd9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fde00157bf0 0x7fde0015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde07dd9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde000ae110 0x7fde000b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:27.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde07dd9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000b0a90 con 0x7fde000b0640 2023-12-19T13:53:27.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde07dd9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0006b8c0 con 0x7fde00157bf0 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde07dd9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0015b740 con 0x7fde000ae110 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde05b75640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fde00157bf0 0x7fde0015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde05b75640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fde00157bf0 0x7fde0015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56534/0 (socket says 172.21.15.113:56534) 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde05b75640 1 -- 172.21.15.113:0/895666519 learned_addr learned my addr 172.21.15.113:0/895666519 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde05b75640 1 -- 172.21.15.113:0/895666519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde000ae110 msgr2=0x7fde000b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:27.999+0000 7fde05b75640 1 --2- 172.21.15.113:0/895666519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde000ae110 0x7fde000b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.000+0000 7fde05b75640 1 -- 172.21.15.113:0/895666519 >> v1:172.21.15.151:6789/0 conn(0x7fde000b0640 legacy=0x7fde0015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:27.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.000+0000 7fde05b75640 1 -- 172.21.15.113:0/895666519 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000ae640 con 0x7fde00157bf0 2023-12-19T13:53:28.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.001+0000 7fde05b75640 1 --2- 172.21.15.113:0/895666519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde00157bf0 0x7fde0015b200 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009870 tx=0x7fddfc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b1eda57c0bb174 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.001+0000 7fde04b73640 1 -- 172.21.15.113:0/895666519 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc031640 con 0x7fde00157bf0 2023-12-19T13:53:28.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.001+0000 7fde04b73640 1 -- 172.21.15.113:0/895666519 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc0317a0 con 0x7fde00157bf0 2023-12-19T13:53:28.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.001+0000 7fde04b73640 1 -- 172.21.15.113:0/895666519 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc031b30 con 0x7fde00157bf0 2023-12-19T13:53:28.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 -- 172.21.15.113:0/895666519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde00157bf0 msgr2=0x7fde0015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 --2- 172.21.15.113:0/895666519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde00157bf0 0x7fde0015b200 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009870 tx=0x7fddfc02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 -- 172.21.15.113:0/895666519 shutdown_connections 2023-12-19T13:53:28.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 --2- 172.21.15.113:0/895666519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde000ae110 0x7fde000b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 --2- 172.21.15.113:0/895666519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde00157bf0 0x7fde0015b200 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 -- 172.21.15.113:0/895666519 >> 172.21.15.113:0/895666519 conn(0x7fde000cbb70 msgr2=0x7fde000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:28.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 -- 172.21.15.113:0/895666519 shutdown_connections 2023-12-19T13:53:28.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.002+0000 7fde07dd9640 1 -- 172.21.15.113:0/895666519 wait complete. 2023-12-19T13:53:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.003+0000 7fde07dd9640 1 Processor -- start 2023-12-19T13:53:28.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.004+0000 7fde07dd9640 1 -- start start 2023-12-19T13:53:28.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde07dd9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde000ae110 0x7fde0014b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde07dd9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde000b0640 0x7fde0014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde07dd9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde00157bf0 0x7fde000cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde07dd9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0014bc70 con 0x7fde000b0640 2023-12-19T13:53:28.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde07dd9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0014daf0 con 0x7fde000ae110 2023-12-19T13:53:28.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde07dd9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0014ddd0 con 0x7fde00157bf0 2023-12-19T13:53:28.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde000b0640 0x7fde0014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde000b0640 0x7fde0014d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56550/0 (socket says 172.21.15.113:56550) 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 -- 172.21.15.113:0/2913362877 learned_addr learned my addr 172.21.15.113:0/2913362877 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05b75640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde000ae110 0x7fde0014b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 -- 172.21.15.113:0/2913362877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde00157bf0 msgr2=0x7fde000cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde00157bf0 0x7fde000cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 -- 172.21.15.113:0/2913362877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde000ae110 msgr2=0x7fde0014b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde000ae110 0x7fde0014b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.005+0000 7fde05374640 1 -- 172.21.15.113:0/2913362877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc0094d0 con 0x7fde000b0640 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.006+0000 7fde05374640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde000b0640 0x7fde0014d0f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b450 tx=0x7fddf000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.006+0000 7fddf67fc640 1 -- 172.21.15.113:0/2913362877 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0011890 con 0x7fde000b0640 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.006+0000 7fddf67fc640 1 -- 172.21.15.113:0/2913362877 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf00119f0 con 0x7fde000b0640 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.006+0000 7fddf67fc640 1 -- 172.21.15.113:0/2913362877 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0011da0 con 0x7fde000b0640 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.006+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0014e0b0 con 0x7fde000b0640 2023-12-19T13:53:28.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.006+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0014e670 con 0x7fde000b0640 2023-12-19T13:53:28.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.007+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde00061910 con 0x7fde000b0640 2023-12-19T13:53:28.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.008+0000 7fddf67fc640 1 -- 172.21.15.113:0/2913362877 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fddf001a400 con 0x7fde000b0640 2023-12-19T13:53:28.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.009+0000 7fddf67fc640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdde406a430 0x7fdde406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.009+0000 7fddf67fc640 1 -- 172.21.15.113:0/2913362877 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddf0088d20 con 0x7fde000b0640 2023-12-19T13:53:28.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.010+0000 7fde05b75640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdde406a430 0x7fdde406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.010+0000 7fde05b75640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdde406a430 0x7fdde406c8f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fddfc036000 tx=0x7fddfc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.013+0000 7fddf67fc640 1 -- 172.21.15.113:0/2913362877 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fddf0054310 con 0x7fde000b0640 2023-12-19T13:53:28.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.206+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde0006c7f0 con 0x7fde000b0640 2023-12-19T13:53:28.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.208+0000 7fddf67fc640 1 -- 172.21.15.113:0/2913362877 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16164 (secure 0 0 0) 0x7fddf0015090 con 0x7fde000b0640 2023-12-19T13:53:28.208 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:28.208 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":120,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:14.625779+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:28.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdde406a430 msgr2=0x7fdde406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdde406a430 0x7fdde406c8f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fddfc036000 tx=0x7fddfc03c040 comp rx=0 tx=0).stop 2023-12-19T13:53:28.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde000b0640 msgr2=0x7fde0014d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde000b0640 0x7fde0014d0f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b450 tx=0x7fddf000b910 comp rx=0 tx=0).stop 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 shutdown_connections 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdde406a430 0x7fdde406c8f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde00157bf0 0x7fde000cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde000b0640 0x7fde0014d0f0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 --2- 172.21.15.113:0/2913362877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde000ae110 0x7fde0014b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 >> 172.21.15.113:0/2913362877 conn(0x7fde000cbb70 msgr2=0x7fde000ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 shutdown_connections 2023-12-19T13:53:28.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.211+0000 7fde07dd9640 1 -- 172.21.15.113:0/2913362877 wait complete. 2023-12-19T13:53:28.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:52:38.334371+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:52:39.588248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:53:28.230 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:53:28.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.447+0000 7efc8b3f6640 1 Processor -- start 2023-12-19T13:53:28.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.447+0000 7efc8b3f6640 1 -- start start 2023-12-19T13:53:28.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.449+0000 7efc8b3f6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efc840cf5b0 0x7efc840b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.449+0000 7efc8b3f6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8415fde0 con 0x7efc8415b1d0 2023-12-19T13:53:28.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.449+0000 7efc8b3f6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc840b2bc0 con 0x7efc840b2760 2023-12-19T13:53:28.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.449+0000 7efc8b3f6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc840b2400 con 0x7efc840cf5b0 2023-12-19T13:53:28.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc89192640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7efc8415b1d0 0x7efc8415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59024/0 (socket says 172.21.15.113:59024) 2023-12-19T13:53:28.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc89192640 1 -- 172.21.15.113:0/686025361 learned_addr learned my addr 172.21.15.113:0/686025361 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:28.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc89993640 1 --2- 172.21.15.113:0/686025361 >> v2:172.21.15.113:3300/0 conn(0x7efc840cf5b0 0x7efc840b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc7bfff640 1 -- 172.21.15.113:0/686025361 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163121194 0 0) 0x7efc8415fde0 con 0x7efc8415b1d0 2023-12-19T13:53:28.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc7bfff640 1 -- 172.21.15.113:0/686025361 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc70003520 con 0x7efc8415b1d0 2023-12-19T13:53:28.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc89993640 1 -- 172.21.15.113:0/686025361 >> v1:172.21.15.151:6789/0 conn(0x7efc840b2760 legacy=0x7efc840ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc89993640 1 -- 172.21.15.113:0/686025361 >> v1:172.21.15.113:6789/0 conn(0x7efc8415b1d0 legacy=0x7efc8415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.450+0000 7efc89993640 1 -- 172.21.15.113:0/686025361 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8415ef10 con 0x7efc840cf5b0 2023-12-19T13:53:28.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.451+0000 7efc89993640 1 --2- 172.21.15.113:0/686025361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc840cf5b0 0x7efc840b1ec0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d90 tx=0x7efc7c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c917c052484aec76 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.452+0000 7efc7bfff640 1 -- 172.21.15.113:0/686025361 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c02ccf0 con 0x7efc840cf5b0 2023-12-19T13:53:28.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.452+0000 7efc7bfff640 1 -- 172.21.15.113:0/686025361 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c02ce50 con 0x7efc840cf5b0 2023-12-19T13:53:28.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.452+0000 7efc7bfff640 1 -- 172.21.15.113:0/686025361 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c034660 con 0x7efc840cf5b0 2023-12-19T13:53:28.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.452+0000 7efc8b3f6640 1 -- 172.21.15.113:0/686025361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc840cf5b0 msgr2=0x7efc840b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.452+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/686025361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc840cf5b0 0x7efc840b1ec0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d90 tx=0x7efc7c02bf40 comp rx=0 tx=0).stop 2023-12-19T13:53:28.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.453+0000 7efc8b3f6640 1 -- 172.21.15.113:0/686025361 shutdown_connections 2023-12-19T13:53:28.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.453+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/686025361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc840cf5b0 0x7efc840b1ec0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.453+0000 7efc8b3f6640 1 -- 172.21.15.113:0/686025361 >> 172.21.15.113:0/686025361 conn(0x7efc84073150 msgr2=0x7efc840659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:28.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.453+0000 7efc8b3f6640 1 -- 172.21.15.113:0/686025361 shutdown_connections 2023-12-19T13:53:28.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.453+0000 7efc8b3f6640 1 -- 172.21.15.113:0/686025361 wait complete. 2023-12-19T13:53:28.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.454+0000 7efc8b3f6640 1 Processor -- start 2023-12-19T13:53:28.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.455+0000 7efc8b3f6640 1 -- start start 2023-12-19T13:53:28.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc8b3f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc840b2760 0x7efc8415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc8b3f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc840cf5b0 0x7efc84147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc8b3f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc8415b1d0 0x7efc840af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc8b3f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc841f6450 con 0x7efc8415b1d0 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc8b3f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc841f6090 con 0x7efc840cf5b0 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc8b3f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8415e620 con 0x7efc840b2760 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc8415b1d0 0x7efc840af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc8415b1d0 0x7efc840af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56560/0 (socket says 172.21.15.113:56560) 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 -- 172.21.15.113:0/2527080731 learned_addr learned my addr 172.21.15.113:0/2527080731 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc88991640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc840cf5b0 0x7efc84147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89192640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc840b2760 0x7efc8415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 -- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc840b2760 msgr2=0x7efc8415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc840b2760 0x7efc8415dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 -- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc840cf5b0 msgr2=0x7efc84147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc840cf5b0 0x7efc84147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.456+0000 7efc89993640 1 -- 172.21.15.113:0/2527080731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c009a70 con 0x7efc8415b1d0 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.457+0000 7efc89993640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc8415b1d0 0x7efc840af2a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7efc7c037040 tx=0x7efc7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.457+0000 7efc79ffb640 1 -- 172.21.15.113:0/2527080731 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c03d600 con 0x7efc8415b1d0 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.457+0000 7efc79ffb640 1 -- 172.21.15.113:0/2527080731 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c03d760 con 0x7efc8415b1d0 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.457+0000 7efc79ffb640 1 -- 172.21.15.113:0/2527080731 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c03db10 con 0x7efc8415b1d0 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.457+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8415e900 con 0x7efc8415b1d0 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.457+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc84148120 con 0x7efc8415b1d0 2023-12-19T13:53:28.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.458+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc841f6590 con 0x7efc8415b1d0 2023-12-19T13:53:28.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.459+0000 7efc79ffb640 1 -- 172.21.15.113:0/2527080731 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc7c03b040 con 0x7efc8415b1d0 2023-12-19T13:53:28.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.460+0000 7efc79ffb640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efc6806a430 0x7efc6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.460+0000 7efc79ffb640 1 -- 172.21.15.113:0/2527080731 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc7c0aae80 con 0x7efc8415b1d0 2023-12-19T13:53:28.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.461+0000 7efc89192640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efc6806a430 0x7efc6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.461+0000 7efc89192640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efc6806a430 0x7efc6806c8f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efc800011e0 tx=0x7efc80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.464+0000 7efc79ffb640 1 -- 172.21.15.113:0/2527080731 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efc841f6590 con 0x7efc8415b1d0 2023-12-19T13:53:28.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.655+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc841f6590 con 0x7efc8415b1d0 2023-12-19T13:53:28.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.656+0000 7efc79ffb640 1 -- 172.21.15.113:0/2527080731 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc7c04e020 con 0x7efc8415b1d0 2023-12-19T13:53:28.656 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:53:28.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efc6806a430 msgr2=0x7efc6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efc6806a430 0x7efc6806c8f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efc800011e0 tx=0x7efc80009040 comp rx=0 tx=0).stop 2023-12-19T13:53:28.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc8415b1d0 msgr2=0x7efc840af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc8415b1d0 0x7efc840af2a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7efc7c037040 tx=0x7efc7c004a40 comp rx=0 tx=0).stop 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 shutdown_connections 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efc6806a430 0x7efc6806c8f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efc8415b1d0 0x7efc840af2a0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc840cf5b0 0x7efc84147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 --2- 172.21.15.113:0/2527080731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc840b2760 0x7efc8415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 >> 172.21.15.113:0/2527080731 conn(0x7efc84073150 msgr2=0x7efc840cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 shutdown_connections 2023-12-19T13:53:28.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.659+0000 7efc8b3f6640 1 -- 172.21.15.113:0/2527080731 wait complete. 2023-12-19T13:53:28.677 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:53:28.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.887+0000 7fbe56a7a640 1 Processor -- start 2023-12-19T13:53:28.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.888+0000 7fbe56a7a640 1 -- start start 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe56a7a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbe50146e10 0x7fbe500d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe56a7a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbe500d2b00 0x7fbe500b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe56a7a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 0x7fbe500ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe56a7a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500d2430 con 0x7fbe500d2b00 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe56a7a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500ceac0 con 0x7fbe50146e10 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe56a7a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500cd840 con 0x7fbe500ce110 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe4ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbe500d2b00 0x7fbe500b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.889+0000 7fbe4ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbe500d2b00 0x7fbe500b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56576/0 (socket says 172.21.15.113:56576) 2023-12-19T13:53:28.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.890+0000 7fbe4ffff640 1 -- 172.21.15.113:0/1103059047 learned_addr learned my addr 172.21.15.113:0/1103059047 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:28.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.890+0000 7fbe4ffff640 1 -- 172.21.15.113:0/1103059047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 msgr2=0x7fbe500ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:28.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.890+0000 7fbe4ffff640 1 --2- 172.21.15.113:0/1103059047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 0x7fbe500ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.890+0000 7fbe4ffff640 1 -- 172.21.15.113:0/1103059047 >> v2:172.21.15.151:3300/0 conn(0x7fbe50146e10 msgr2=0x7fbe500d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:28.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.890+0000 7fbe4ffff640 1 --2- 172.21.15.113:0/1103059047 >> v2:172.21.15.151:3300/0 conn(0x7fbe50146e10 0x7fbe500d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.890+0000 7fbe4ffff640 1 -- 172.21.15.113:0/1103059047 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500d2620 con 0x7fbe500d2b00 2023-12-19T13:53:28.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.891+0000 7fbe4ffff640 1 --2- 172.21.15.113:0/1103059047 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe500b6780 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbe500d0720 tx=0x7fbe3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29fa2b8326cebc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.891+0000 7fbe4f7fe640 1 -- 172.21.15.113:0/1103059047 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c031640 con 0x7fbe500d2b00 2023-12-19T13:53:28.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.891+0000 7fbe4f7fe640 1 -- 172.21.15.113:0/1103059047 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c0317a0 con 0x7fbe500d2b00 2023-12-19T13:53:28.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.891+0000 7fbe4f7fe640 1 -- 172.21.15.113:0/1103059047 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c031b30 con 0x7fbe500d2b00 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 -- 172.21.15.113:0/1103059047 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 msgr2=0x7fbe500b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/1103059047 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe500b6780 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbe500d0720 tx=0x7fbe3c02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 -- 172.21.15.113:0/1103059047 shutdown_connections 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/1103059047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 0x7fbe500ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/1103059047 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe500b6780 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/1103059047 >> v2:172.21.15.151:3300/0 conn(0x7fbe50146e10 0x7fbe500d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 -- 172.21.15.113:0/1103059047 >> 172.21.15.113:0/1103059047 conn(0x7fbe500b29c0 msgr2=0x7fbe500b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 -- 172.21.15.113:0/1103059047 shutdown_connections 2023-12-19T13:53:28.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.892+0000 7fbe56a7a640 1 -- 172.21.15.113:0/1103059047 wait complete. 2023-12-19T13:53:28.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.894+0000 7fbe56a7a640 1 Processor -- start 2023-12-19T13:53:28.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.894+0000 7fbe56a7a640 1 -- start start 2023-12-19T13:53:28.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe56a7a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 0x7fbe5015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe56a7a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe50140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe56a7a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe50146e10 0x7fbe501405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe56a7a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5013e780 con 0x7fbe500d2b00 2023-12-19T13:53:28.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe56a7a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5013ea60 con 0x7fbe50146e10 2023-12-19T13:53:28.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe56a7a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5013ed40 con 0x7fbe500ce110 2023-12-19T13:53:28.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe50140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe50140070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56578/0 (socket says 172.21.15.113:56578) 2023-12-19T13:53:28.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.895+0000 7fbe4ffff640 1 -- 172.21.15.113:0/112803193 learned_addr learned my addr 172.21.15.113:0/112803193 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:28.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4ffff640 1 -- 172.21.15.113:0/112803193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 msgr2=0x7fbe5015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4ffff640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 0x7fbe5015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4ffff640 1 -- 172.21.15.113:0/112803193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe50146e10 msgr2=0x7fbe501405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:28.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4ffff640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe50146e10 0x7fbe501405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4ffff640 1 -- 172.21.15.113:0/112803193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c0094d0 con 0x7fbe500d2b00 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4ffff640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe50140070 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009870 tx=0x7fbe3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4d7fa640 1 -- 172.21.15.113:0/112803193 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c03ac60 con 0x7fbe500d2b00 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4d7fa640 1 -- 172.21.15.113:0/112803193 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c03adc0 con 0x7fbe500d2b00 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5013f020 con 0x7fbe500d2b00 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe4d7fa640 1 -- 172.21.15.113:0/112803193 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c044630 con 0x7fbe500d2b00 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.896+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe50160330 con 0x7fbe500d2b00 2023-12-19T13:53:28.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.898+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe500b4760 con 0x7fbe500d2b00 2023-12-19T13:53:28.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.898+0000 7fbe4d7fa640 1 -- 172.21.15.113:0/112803193 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe3c02f050 con 0x7fbe500d2b00 2023-12-19T13:53:28.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.899+0000 7fbe4d7fa640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe3406a430 0x7fbe3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:28.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.899+0000 7fbe4d7fa640 1 -- 172.21.15.113:0/112803193 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe3c0aaa10 con 0x7fbe500d2b00 2023-12-19T13:53:28.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.900+0000 7fbe54816640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe3406a430 0x7fbe3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:28.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.900+0000 7fbe54816640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe3406a430 0x7fbe3406c8f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009670 tx=0x7fbe44006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:28.904+0000 7fbe4d7fa640 1 -- 172.21.15.113:0/112803193 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbe500b4760 con 0x7fbe500d2b00 2023-12-19T13:53:29.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.094+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe500b4760 con 0x7fbe500d2b00 2023-12-19T13:53:29.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.096+0000 7fbe4d7fa640 1 -- 172.21.15.113:0/112803193 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe500b4760 con 0x7fbe500d2b00 2023-12-19T13:53:29.095 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe3406a430 msgr2=0x7fbe3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe3406a430 0x7fbe3406c8f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009670 tx=0x7fbe44006bf0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 msgr2=0x7fbe50140070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe50140070 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009870 tx=0x7fbe3c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 shutdown_connections 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe3406a430 0x7fbe3406c8f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe50146e10 0x7fbe501405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe500d2b00 0x7fbe50140070 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 --2- 172.21.15.113:0/112803193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe500ce110 0x7fbe5015fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 >> 172.21.15.113:0/112803193 conn(0x7fbe500b29c0 msgr2=0x7fbe500d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:29.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 shutdown_connections 2023-12-19T13:53:29.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.098+0000 7fbe56a7a640 1 -- 172.21.15.113:0/112803193 wait complete. 2023-12-19T13:53:29.115 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:53:29.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.317+0000 7fcbc651b640 1 Processor -- start 2023-12-19T13:53:29.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.317+0000 7fcbc651b640 1 -- start start 2023-12-19T13:53:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.319+0000 7fcbc651b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 0x7fcbc00b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.319+0000 7fcbc651b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00ccbd0 con 0x7fcbc00b0070 2023-12-19T13:53:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.319+0000 7fcbc651b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc0154b40 con 0x7fcbc0154760 2023-12-19T13:53:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.319+0000 7fcbc651b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00ccf20 con 0x7fcbc015b290 2023-12-19T13:53:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.319+0000 7fcbc4ab8640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcbc00b0070 0x7fcbc00cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59036/0 (socket says 172.21.15.113:59036) 2023-12-19T13:53:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.319+0000 7fcbc4ab8640 1 -- 172.21.15.113:0/283377883 learned_addr learned my addr 172.21.15.113:0/283377883 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:29.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.319+0000 7fcbbf7fe640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 0x7fcbc00b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494647893 0 0) 0x7fcbc00ccbd0 con 0x7fcbc00b0070 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba8003520 con 0x7fcbc00b0070 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3602076002 0 0) 0x7fcba8003520 con 0x7fcbc00b0070 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 msgr2=0x7fcbc00b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 0x7fcbc00b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 >> v1:172.21.15.151:6789/0 conn(0x7fcbc0154760 legacy=0x7fcbc00cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00cc060 con 0x7fcbc00b0070 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fcbb80019f0 con 0x7fcbc00b0070 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 >> v1:172.21.15.113:6789/0 conn(0x7fcbc00b0070 legacy=0x7fcbc00cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 0x7fcba8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcba8004040 0x7fcba80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004d50 0x7fcba80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00ccf20 con 0x7fcba8004040 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba800de40 con 0x7fcba8004d50 2023-12-19T13:53:29.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba800e000 con 0x7fcbc015b290 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.320+0000 7fcbbf7fe640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcba8004040 0x7fcba80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.321+0000 7fcbbffff640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 0x7fcba8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.321+0000 7fcbbf7fe640 1 -- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 msgr2=0x7fcba8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.321+0000 7fcbbf7fe640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc015b290 0x7fcba8003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.321+0000 7fcbc4ab8640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004d50 0x7fcba80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.321+0000 7fcbbf7fe640 1 -- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004d50 msgr2=0x7fcba80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.321+0000 7fcbbf7fe640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004d50 0x7fcba80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.321+0000 7fcbbf7fe640 1 -- 172.21.15.113:0/283377883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8003520 con 0x7fcba8004040 2023-12-19T13:53:29.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.322+0000 7fcbbf7fe640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcba8004040 0x7fcba80047c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400ba10 tx=0x7fcba80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad2bac8d681a5ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:29.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.322+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4032630 con 0x7fcba8004040 2023-12-19T13:53:29.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.322+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb4032790 con 0x7fcba8004040 2023-12-19T13:53:29.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.322+0000 7fcbbeffd640 1 -- 172.21.15.113:0/283377883 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4032b20 con 0x7fcba8004040 2023-12-19T13:53:29.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.323+0000 7fcbc651b640 1 -- 172.21.15.113:0/283377883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcba8004040 msgr2=0x7fcba80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.323+0000 7fcbc651b640 1 --2- 172.21.15.113:0/283377883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcba8004040 0x7fcba80047c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400ba10 tx=0x7fcba80057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.323+0000 7fcbc4ab8640 1 -- 172.21.15.113:0/283377883 reap_dead start 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.323+0000 7fcbc651b640 1 -- 172.21.15.113:0/283377883 shutdown_connections 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.323+0000 7fcbc651b640 1 -- 172.21.15.113:0/283377883 >> 172.21.15.113:0/283377883 conn(0x7fcbc0073150 msgr2=0x7fcbc00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.323+0000 7fcbc651b640 1 -- 172.21.15.113:0/283377883 shutdown_connections 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.323+0000 7fcbc651b640 1 -- 172.21.15.113:0/283377883 wait complete. 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.324+0000 7fcbc651b640 1 Processor -- start 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.325+0000 7fcbc651b640 1 -- start start 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.325+0000 7fcbc651b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004040 0x7fcbc01507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.325+0000 7fcbc651b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc0156cd0 0x7fcbc01f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.325+0000 7fcbc651b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcbc014f8a0 0x7fcbc00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.325+0000 7fcbc651b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01f2ac0 con 0x7fcbc014f8a0 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.325+0000 7fcbc651b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0156840 con 0x7fcba8004040 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.325+0000 7fcbc651b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0155f10 con 0x7fcbc0156cd0 2023-12-19T13:53:29.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcbc014f8a0 0x7fcbc00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcbc014f8a0 0x7fcbc00cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56588/0 (socket says 172.21.15.113:56588) 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 -- 172.21.15.113:0/3788788750 learned_addr learned my addr 172.21.15.113:0/3788788750 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbbffff640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004040 0x7fcbc01507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 -- 172.21.15.113:0/3788788750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc0156cd0 msgr2=0x7fcbc01f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc0156cd0 0x7fcbc01f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 -- 172.21.15.113:0/3788788750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004040 msgr2=0x7fcbc01507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004040 0x7fcbc01507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 -- 172.21.15.113:0/3788788750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc01561f0 con 0x7fcbc014f8a0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.326+0000 7fcbc4ab8640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcbc014f8a0 0x7fcbc00cef10 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001580 tx=0x7fcbb800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.327+0000 7fcbbcff9640 1 -- 172.21.15.113:0/3788788750 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8004d60 con 0x7fcbc014f8a0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.327+0000 7fcbbcff9640 1 -- 172.21.15.113:0/3788788750 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb800bb80 con 0x7fcbc014f8a0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.327+0000 7fcbbcff9640 1 -- 172.21.15.113:0/3788788750 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8007070 con 0x7fcbc014f8a0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.327+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc01564d0 con 0x7fcbc014f8a0 2023-12-19T13:53:29.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.327+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc0155b30 con 0x7fcbc014f8a0 2023-12-19T13:53:29.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.328+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc0156660 con 0x7fcbc014f8a0 2023-12-19T13:53:29.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.329+0000 7fcbbcff9640 1 -- 172.21.15.113:0/3788788750 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbb80071d0 con 0x7fcbc014f8a0 2023-12-19T13:53:29.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.329+0000 7fcbbcff9640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbac06a430 0x7fcbac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.330+0000 7fcbbcff9640 1 -- 172.21.15.113:0/3788788750 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbb8088e40 con 0x7fcbc014f8a0 2023-12-19T13:53:29.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.330+0000 7fcbbffff640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbac06a430 0x7fcbac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.330+0000 7fcbbffff640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbac06a430 0x7fcbac06c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcbc01577b0 tx=0x7fcbb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:29.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.334+0000 7fcbbcff9640 1 -- 172.21.15.113:0/3788788750 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbb8054390 con 0x7fcbc014f8a0 2023-12-19T13:53:29.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.522+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbc0061910 con 0x7fcbc014f8a0 2023-12-19T13:53:29.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.523+0000 7fcbbcff9640 1 -- 172.21.15.113:0/3788788750 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbb80579b0 con 0x7fcbc014f8a0 2023-12-19T13:53:29.523 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbac06a430 msgr2=0x7fcbac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbac06a430 0x7fcbac06c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcbc01577b0 tx=0x7fcbb0009040 comp rx=0 tx=0).stop 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcbc014f8a0 msgr2=0x7fcbc00cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcbc014f8a0 0x7fcbc00cef10 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001580 tx=0x7fcbb800b4a0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 shutdown_connections 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcbac06a430 0x7fcbac06c8f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcbc014f8a0 0x7fcbc00cef10 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbc0156cd0 0x7fcbc01f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 --2- 172.21.15.113:0/3788788750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba8004040 0x7fcbc01507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 >> 172.21.15.113:0/3788788750 conn(0x7fcbc0073150 msgr2=0x7fcbc015a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:29.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 shutdown_connections 2023-12-19T13:53:29.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.526+0000 7fcbc651b640 1 -- 172.21.15.113:0/3788788750 wait complete. 2023-12-19T13:53:29.545 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.756+0000 7f1cda2ec640 1 Processor -- start 2023-12-19T13:53:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.756+0000 7f1cda2ec640 1 -- start start 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cda2ec640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cd4157bf0 0x7f1cd415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cda2ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40ae110 0x7f1cd40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cda2ec640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd40b0a90 con 0x7f1cd40b0640 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cda2ec640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd406b8c0 con 0x7f1cd4157bf0 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cda2ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415b740 con 0x7f1cd40ae110 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cd4157bf0 0x7f1cd415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cd4157bf0 0x7f1cd415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56590/0 (socket says 172.21.15.113:56590) 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd3fff640 1 -- 172.21.15.113:0/146094395 learned_addr learned my addr 172.21.15.113:0/146094395 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd8889640 1 --1- 172.21.15.113:0/146094395 >> v1:172.21.15.113:6789/0 conn(0x7f1cd40b0640 0x7f1cd415dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59038/0 (socket says 172.21.15.113:59038) 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd3fff640 1 -- 172.21.15.113:0/146094395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40ae110 msgr2=0x7f1cd40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd3fff640 1 --2- 172.21.15.113:0/146094395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40ae110 0x7f1cd40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd3fff640 1 -- 172.21.15.113:0/146094395 >> v1:172.21.15.113:6789/0 conn(0x7f1cd40b0640 legacy=0x7f1cd415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.758+0000 7f1cd3fff640 1 -- 172.21.15.113:0/146094395 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd40ae640 con 0x7f1cd4157bf0 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.759+0000 7f1cd3fff640 1 --2- 172.21.15.113:0/146094395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd4157bf0 0x7f1cd415b200 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dea0efc8b81e25 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.760+0000 7f1cd2ffd640 1 -- 172.21.15.113:0/146094395 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc030840 con 0x7f1cd4157bf0 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.760+0000 7f1cd2ffd640 1 -- 172.21.15.113:0/146094395 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0309a0 con 0x7f1cd4157bf0 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.760+0000 7f1cd2ffd640 1 -- 172.21.15.113:0/146094395 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc030d30 con 0x7f1cd4157bf0 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.760+0000 7f1cda2ec640 1 -- 172.21.15.113:0/146094395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd4157bf0 msgr2=0x7f1cd415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.760+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/146094395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd4157bf0 0x7f1cd415b200 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc02b980 comp rx=0 tx=0).stop 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.761+0000 7f1cda2ec640 1 -- 172.21.15.113:0/146094395 shutdown_connections 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.761+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/146094395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40ae110 0x7f1cd40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.761+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/146094395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd4157bf0 0x7f1cd415b200 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.761+0000 7f1cda2ec640 1 -- 172.21.15.113:0/146094395 >> 172.21.15.113:0/146094395 conn(0x7f1cd40cbb70 msgr2=0x7f1cd40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.761+0000 7f1cda2ec640 1 -- 172.21.15.113:0/146094395 shutdown_connections 2023-12-19T13:53:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.761+0000 7f1cda2ec640 1 -- 172.21.15.113:0/146094395 wait complete. 2023-12-19T13:53:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.762+0000 7f1cda2ec640 1 Processor -- start 2023-12-19T13:53:29.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.762+0000 7f1cda2ec640 1 -- start start 2023-12-19T13:53:29.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.763+0000 7f1cda2ec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd40ae110 0x7f1cd414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.763+0000 7f1cda2ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40b0640 0x7f1cd414d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.763+0000 7f1cda2ec640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cd4157bf0 0x7f1cd414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.763+0000 7f1cda2ec640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414c130 con 0x7f1cd40ae110 2023-12-19T13:53:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.763+0000 7f1cda2ec640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415c240 con 0x7f1cd4157bf0 2023-12-19T13:53:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.763+0000 7f1cda2ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414de80 con 0x7f1cd40b0640 2023-12-19T13:53:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd40ae110 0x7f1cd414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd40ae110 0x7f1cd414bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56606/0 (socket says 172.21.15.113:56606) 2023-12-19T13:53:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 -- 172.21.15.113:0/4066588440 learned_addr learned my addr 172.21.15.113:0/4066588440 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 -- 172.21.15.113:0/4066588440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40b0640 msgr2=0x7f1cd414d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd8889640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cd4157bf0 0x7f1cd414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40b0640 0x7f1cd414d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 -- 172.21.15.113:0/4066588440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cd4157bf0 msgr2=0x7f1cd414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cd4157bf0 0x7f1cd414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 -- 172.21.15.113:0/4066588440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0094d0 con 0x7f1cd40ae110 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.764+0000 7f1cd3fff640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd40ae110 0x7f1cd414bbf0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.765+0000 7f1cd0ff9640 1 -- 172.21.15.113:0/4066588440 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0307f0 con 0x7f1cd40ae110 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.765+0000 7f1cd0ff9640 1 -- 172.21.15.113:0/4066588440 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc039d90 con 0x7f1cd40ae110 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.765+0000 7f1cd0ff9640 1 -- 172.21.15.113:0/4066588440 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc043610 con 0x7f1cd40ae110 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.765+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd4159480 con 0x7f1cd40ae110 2023-12-19T13:53:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.765+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd415c7c0 con 0x7f1cd40ae110 2023-12-19T13:53:29.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.766+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd4061910 con 0x7f1cd40ae110 2023-12-19T13:53:29.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.767+0000 7f1cd0ff9640 1 -- 172.21.15.113:0/4066588440 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cbc042390 con 0x7f1cd40ae110 2023-12-19T13:53:29.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.768+0000 7f1cd0ff9640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cb406a430 0x7f1cb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:29.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.768+0000 7f1cd0ff9640 1 -- 172.21.15.113:0/4066588440 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cbc0aad10 con 0x7f1cd40ae110 2023-12-19T13:53:29.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.768+0000 7f1cd37fe640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cb406a430 0x7f1cb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:29.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.769+0000 7f1cd37fe640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cb406a430 0x7f1cb406c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1cd415d9a0 tx=0x7f1cc4009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:29.772+0000 7f1cd0ff9640 1 -- 172.21.15.113:0/4066588440 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cbc076400 con 0x7f1cd40ae110 2023-12-19T13:53:29.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.000+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cd40cac10 con 0x7f1cd40ae110 2023-12-19T13:53:30.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.001+0000 7f1cd0ff9640 1 -- 172.21.15.113:0/4066588440 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f1cbc079a20 con 0x7f1cd40ae110 2023-12-19T13:53:30.000 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:30.000 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:53:30.000 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cb406a430 msgr2=0x7f1cb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cb406a430 0x7f1cb406c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1cd415d9a0 tx=0x7f1cc4009250 comp rx=0 tx=0).stop 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd40ae110 msgr2=0x7f1cd414bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd40ae110 0x7f1cd414bbf0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc004730 comp rx=0 tx=0).stop 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 shutdown_connections 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cb406a430 0x7f1cb406c8f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cd4157bf0 0x7f1cd414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cd40b0640 0x7f1cd414d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 --2- 172.21.15.113:0/4066588440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cd40ae110 0x7f1cd414bbf0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 >> 172.21.15.113:0/4066588440 conn(0x7f1cd40cbb70 msgr2=0x7f1cd40ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:30.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 shutdown_connections 2023-12-19T13:53:30.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.003+0000 7f1cda2ec640 1 -- 172.21.15.113:0/4066588440 wait complete. 2023-12-19T13:53:30.022 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:30.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.228+0000 7fd1be8f7640 1 Processor -- start 2023-12-19T13:53:30.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.228+0000 7fd1be8f7640 1 -- start start 2023-12-19T13:53:30.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.229+0000 7fd1be8f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1b8157bf0 0x7fd1b815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.229+0000 7fd1be8f7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd1b80b0810 0x7fd1b806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.229+0000 7fd1be8f7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b815b740 con 0x7fd1b80ae110 2023-12-19T13:53:30.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.229+0000 7fd1be8f7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b806b8c0 con 0x7fd1b80b0810 2023-12-19T13:53:30.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.229+0000 7fd1be8f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80ae640 con 0x7fd1b8157bf0 2023-12-19T13:53:30.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1affff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd1b80ae110 0x7fd1b80b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59048/0 (socket says 172.21.15.113:59048) 2023-12-19T13:53:30.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1affff640 1 -- 172.21.15.113:0/3171125080 learned_addr learned my addr 172.21.15.113:0/3171125080 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1bce94640 1 --2- 172.21.15.113:0/3171125080 >> v2:172.21.15.151:3300/0 conn(0x7fd1b80b0810 0x7fd1b806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363461892 0 0) 0x7fd1b815b740 con 0x7fd1b80ae110 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a4003520 con 0x7fd1b80ae110 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b7fff640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1b8157bf0 0x7fd1b815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3051378090 0 0) 0x7fd1a4003520 con 0x7fd1b80ae110 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1b8157bf0 msgr2=0x7fd1b815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1b8157bf0 0x7fd1b815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 >> v2:172.21.15.151:3300/0 conn(0x7fd1b80b0810 msgr2=0x7fd1b806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 --2- 172.21.15.113:0/3171125080 >> v2:172.21.15.151:3300/0 conn(0x7fd1b80b0810 0x7fd1b806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80ae920 con 0x7fd1b80ae110 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fd1a0001670 con 0x7fd1b80ae110 2023-12-19T13:53:30.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 >> v1:172.21.15.113:6789/0 conn(0x7fd1b80ae110 legacy=0x7fd1b80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.230+0000 7fd1b77fe640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a40039e0 0x7fd1a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1b77fe640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1a40047c0 0x7fd1a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1b77fe640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1b8157bf0 0x7fd1a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b806b8c0 con 0x7fd1a40047c0 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80ae640 con 0x7fd1a40039e0 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a400bb00 con 0x7fd1b8157bf0 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1affff640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1a40047c0 0x7fd1a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1b7fff640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a40039e0 0x7fd1a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1affff640 1 -- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1b8157bf0 msgr2=0x7fd1a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:30.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1affff640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1b8157bf0 0x7fd1a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1affff640 1 -- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a40039e0 msgr2=0x7fd1a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:30.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1affff640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a40039e0 0x7fd1a4003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.231+0000 7fd1affff640 1 -- 172.21.15.113:0/3171125080 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4003520 con 0x7fd1a40047c0 2023-12-19T13:53:30.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.232+0000 7fd1affff640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1a40047c0 0x7fd1a4004c40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000c0e0 tx=0x7fd1a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe0783f346dc0ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:30.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0005ad0 con 0x7fd1a40047c0 2023-12-19T13:53:30.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a0005c50 con 0x7fd1a40047c0 2023-12-19T13:53:30.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1b77fe640 1 -- 172.21.15.113:0/3171125080 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a002c810 con 0x7fd1a40047c0 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1be8f7640 1 -- 172.21.15.113:0/3171125080 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1a40047c0 msgr2=0x7fd1a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1be8f7640 1 --2- 172.21.15.113:0/3171125080 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1a40047c0 0x7fd1a4004c40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000c0e0 tx=0x7fd1a40057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1bce94640 1 -- 172.21.15.113:0/3171125080 reap_dead start 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1be8f7640 1 -- 172.21.15.113:0/3171125080 shutdown_connections 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1be8f7640 1 -- 172.21.15.113:0/3171125080 >> 172.21.15.113:0/3171125080 conn(0x7fd1b80cbb70 msgr2=0x7fd1b80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1be8f7640 1 -- 172.21.15.113:0/3171125080 shutdown_connections 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.233+0000 7fd1be8f7640 1 -- 172.21.15.113:0/3171125080 wait complete. 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.235+0000 7fd1be8f7640 1 Processor -- start 2023-12-19T13:53:30.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.235+0000 7fd1be8f7640 1 -- start start 2023-12-19T13:53:30.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1be8f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a40047c0 0x7fd1b8155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1be8f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1b8146700 0x7fd1b8148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1be8f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1b80ac8b0 0x7fd1b80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1be8f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80ad270 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1be8f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8146eb0 con 0x7fd1b8146700 2023-12-19T13:53:30.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1be8f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8147190 con 0x7fd1a40047c0 2023-12-19T13:53:30.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1bce94640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1b80ac8b0 0x7fd1b80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1bce94640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1b80ac8b0 0x7fd1b80acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56620/0 (socket says 172.21.15.113:56620) 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.236+0000 7fd1bce94640 1 -- 172.21.15.113:0/1036143626 learned_addr learned my addr 172.21.15.113:0/1036143626 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1affff640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1b8146700 0x7fd1b8148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1bce94640 1 -- 172.21.15.113:0/1036143626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a40047c0 msgr2=0x7fd1b8155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1bce94640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a40047c0 0x7fd1b8155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1bce94640 1 -- 172.21.15.113:0/1036143626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1b8146700 msgr2=0x7fd1b8148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1bce94640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1b8146700 0x7fd1b8148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1bce94640 1 -- 172.21.15.113:0/1036143626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8149450 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1bce94640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1b80ac8b0 0x7fd1b80acd30 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd1b815dcd0 tx=0x7fd1b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1b57fa640 1 -- 172.21.15.113:0/1036143626 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000edc0 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1b57fa640 1 -- 172.21.15.113:0/1036143626 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0014420 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1b57fa640 1 -- 172.21.15.113:0/1036143626 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00147d0 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.237+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b8146b80 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.238+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b81499c0 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.239+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b8061910 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.240+0000 7fd1b57fa640 1 -- 172.21.15.113:0/1036143626 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1b0014930 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.240+0000 7fd1b57fa640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a460 0x7fd19806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.241+0000 7fd1b57fa640 1 -- 172.21.15.113:0/1036143626 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1b0088ee0 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.241+0000 7fd1b7fff640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a460 0x7fd19806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.241+0000 7fd1b7fff640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a460 0x7fd19806c920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8006f00 tx=0x7fd1a8006e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:30.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.245+0000 7fd1b57fa640 1 -- 172.21.15.113:0/1036143626 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1b0054430 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.429+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b81472d0 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.431+0000 7fd1b57fa640 1 -- 172.21.15.113:0/1036143626 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16164 (secure 0 0 0) 0x7fd1b0057a50 con 0x7fd1b80ac8b0 2023-12-19T13:53:30.430 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:30.431 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":120,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:14.625779+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a460 msgr2=0x7fd19806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a460 0x7fd19806c920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8006f00 tx=0x7fd1a8006e10 comp rx=0 tx=0).stop 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1b80ac8b0 msgr2=0x7fd1b80acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1b80ac8b0 0x7fd1b80acd30 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd1b815dcd0 tx=0x7fd1b000e4b0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 shutdown_connections 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd19806a460 0x7fd19806c920 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1b80ac8b0 0x7fd1b80acd30 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1b8146700 0x7fd1b8148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 --2- 172.21.15.113:0/1036143626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a40047c0 0x7fd1b8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.433+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 >> 172.21.15.113:0/1036143626 conn(0x7fd1b80cbb70 msgr2=0x7fd1b80ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:30.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.434+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 shutdown_connections 2023-12-19T13:53:30.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.434+0000 7fd1be8f7640 1 -- 172.21.15.113:0/1036143626 wait complete. 2023-12-19T13:53:30.450 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:53:30.450 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:30.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.642+0000 7f95dba17640 1 Processor -- start 2023-12-19T13:53:30.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.642+0000 7f95dba17640 1 -- start start 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.643+0000 7f95dba17640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f95d40b0b50 0x7f95d406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.643+0000 7f95dba17640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d406bb30 con 0x7f95d406b590 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.643+0000 7f95dba17640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d40b0070 con 0x7f95d41449e0 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.643+0000 7f95dba17640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d40b0350 con 0x7f95d40b0b50 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.644+0000 7f95d8fb2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f95d40b0b50 0x7f95d406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.644+0000 7f95d8fb2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f95d40b0b50 0x7f95d406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56634/0 (socket says 172.21.15.113:56634) 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.644+0000 7f95d8fb2640 1 -- 172.21.15.113:0/4035472918 learned_addr learned my addr 172.21.15.113:0/4035472918 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:30.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.644+0000 7f95d9fb4640 1 --1- 172.21.15.113:0/4035472918 >> v1:172.21.15.113:6789/0 conn(0x7f95d406b590 0x7f95d40b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59058/0 (socket says 172.21.15.113:59058) 2023-12-19T13:53:30.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.644+0000 7f95d8fb2640 1 -- 172.21.15.113:0/4035472918 >> v1:172.21.15.151:6789/0 conn(0x7f95d41449e0 legacy=0x7f95d40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:30.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.644+0000 7f95d8fb2640 1 -- 172.21.15.113:0/4035472918 >> v1:172.21.15.113:6789/0 conn(0x7f95d406b590 legacy=0x7f95d40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.644+0000 7f95d8fb2640 1 -- 172.21.15.113:0/4035472918 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40b0630 con 0x7f95d40b0b50 2023-12-19T13:53:30.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.645+0000 7f95d8fb2640 1 --2- 172.21.15.113:0/4035472918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d406bfa0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009870 tx=0x7f95c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6335e848c373ec77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:30.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.645+0000 7f95c7fff640 1 -- 172.21.15.113:0/4035472918 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8030860 con 0x7f95d40b0b50 2023-12-19T13:53:30.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.645+0000 7f95c7fff640 1 -- 172.21.15.113:0/4035472918 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c80309c0 con 0x7f95d40b0b50 2023-12-19T13:53:30.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.645+0000 7f95c7fff640 1 -- 172.21.15.113:0/4035472918 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8030d50 con 0x7f95d40b0b50 2023-12-19T13:53:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.646+0000 7f95dba17640 1 -- 172.21.15.113:0/4035472918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 msgr2=0x7f95d406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.646+0000 7f95dba17640 1 --2- 172.21.15.113:0/4035472918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d406bfa0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009870 tx=0x7f95c802b9a0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.646+0000 7f95dba17640 1 -- 172.21.15.113:0/4035472918 shutdown_connections 2023-12-19T13:53:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.646+0000 7f95dba17640 1 --2- 172.21.15.113:0/4035472918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d406bfa0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.646+0000 7f95dba17640 1 -- 172.21.15.113:0/4035472918 >> 172.21.15.113:0/4035472918 conn(0x7f95d40cbb70 msgr2=0x7f95d40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.646+0000 7f95dba17640 1 -- 172.21.15.113:0/4035472918 shutdown_connections 2023-12-19T13:53:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.646+0000 7f95dba17640 1 -- 172.21.15.113:0/4035472918 wait complete. 2023-12-19T13:53:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.648+0000 7f95dba17640 1 Processor -- start 2023-12-19T13:53:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.648+0000 7f95dba17640 1 -- start start 2023-12-19T13:53:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95dba17640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d406b590 0x7f95d415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95dba17640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d41f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95dba17640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d41449e0 0x7f95d413f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95dba17640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d413c540 con 0x7f95d40b0b50 2023-12-19T13:53:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95dba17640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d415dab0 con 0x7f95d41449e0 2023-12-19T13:53:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95dba17640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d415dd90 con 0x7f95d406b590 2023-12-19T13:53:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d41f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d41f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56650/0 (socket says 172.21.15.113:56650) 2023-12-19T13:53:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 -- 172.21.15.113:0/1940273507 learned_addr learned my addr 172.21.15.113:0/1940273507 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 -- 172.21.15.113:0/1940273507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d406b590 msgr2=0x7f95d415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d406b590 0x7f95d415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 -- 172.21.15.113:0/1940273507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d41449e0 msgr2=0x7f95d413f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d41449e0 0x7f95d413f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.649+0000 7f95d8fb2640 1 -- 172.21.15.113:0/1940273507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c80094d0 con 0x7f95d40b0b50 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.650+0000 7f95d8fb2640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d41f14e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009870 tx=0x7f95c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.650+0000 7f95c5ffb640 1 -- 172.21.15.113:0/1940273507 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8030810 con 0x7f95d40b0b50 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.650+0000 7f95c5ffb640 1 -- 172.21.15.113:0/1940273507 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c8043400 con 0x7f95d40b0b50 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.650+0000 7f95c5ffb640 1 -- 172.21.15.113:0/1940273507 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c80437b0 con 0x7f95d40b0b50 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.650+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d415e070 con 0x7f95d40b0b50 2023-12-19T13:53:30.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.650+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d413fa30 con 0x7f95d40b0b50 2023-12-19T13:53:30.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.651+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d413fbc0 con 0x7f95d40b0b50 2023-12-19T13:53:30.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.652+0000 7f95c5ffb640 1 -- 172.21.15.113:0/1940273507 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95c8043910 con 0x7f95d40b0b50 2023-12-19T13:53:30.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.653+0000 7f95c5ffb640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f95b806a430 0x7f95b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:30.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.653+0000 7f95c5ffb640 1 -- 172.21.15.113:0/1940273507 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95c803e070 con 0x7f95d40b0b50 2023-12-19T13:53:30.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.653+0000 7f95d97b3640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f95b806a430 0x7f95b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.654+0000 7f95d97b3640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f95b806a430 0x7f95b806c8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006fd0 tx=0x7f95d0006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:30.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.657+0000 7f95c5ffb640 1 -- 172.21.15.113:0/1940273507 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f95c8077250 con 0x7f95d40b0b50 2023-12-19T13:53:30.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.885+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95d4061910 con 0x7f95d40b0b50 2023-12-19T13:53:30.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.886+0000 7f95c5ffb640 1 -- 172.21.15.113:0/1940273507 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f95c8034090 con 0x7f95d40b0b50 2023-12-19T13:53:30.886 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:30.886 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:53:30.886 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f95b806a430 msgr2=0x7f95b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f95b806a430 0x7f95b806c8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006fd0 tx=0x7f95d0006bc0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 msgr2=0x7f95d41f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d41f14e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009870 tx=0x7f95c8004730 comp rx=0 tx=0).stop 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 shutdown_connections 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f95b806a430 0x7f95b806c8f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d41449e0 0x7f95d413f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95d40b0b50 0x7f95d41f14e0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.888+0000 7f95dba17640 1 --2- 172.21.15.113:0/1940273507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d406b590 0x7f95d415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:30.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.889+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 >> 172.21.15.113:0/1940273507 conn(0x7f95d40cbb70 msgr2=0x7f95d41585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:30.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.889+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 shutdown_connections 2023-12-19T13:53:30.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:30.889+0000 7f95dba17640 1 -- 172.21.15.113:0/1940273507 wait complete. 2023-12-19T13:53:30.905 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:31.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.109+0000 7f0be0927640 1 Processor -- start 2023-12-19T13:53:31.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.109+0000 7f0be0927640 1 -- start start 2023-12-19T13:53:31.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0be0927640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc1449e0 0x7f0bdc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0be0927640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0afb10 con 0x7f0bdc0b0b50 2023-12-19T13:53:31.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0be0927640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc06bb30 con 0x7f0bdc06c6b0 2023-12-19T13:53:31.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0be0927640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b0070 con 0x7f0bdc1449e0 2023-12-19T13:53:31.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0bd9d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0bdc0b0b50 0x7f0bdc06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59062/0 (socket says 172.21.15.113:59062) 2023-12-19T13:53:31.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0bd9d9b640 1 -- 172.21.15.113:0/267695508 learned_addr learned my addr 172.21.15.113:0/267695508 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040411463 0 0) 0x7f0bdc0afb10 con 0x7f0bdc0b0b50 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0bda59c640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc1449e0 0x7f0bdc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.111+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc8003520 con 0x7f0bdc0b0b50 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664095129 0 0) 0x7f0bc8003520 con 0x7f0bdc0b0b50 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc1449e0 msgr2=0x7f0bdc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc1449e0 0x7f0bdc0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 >> v1:172.21.15.151:6789/0 conn(0x7f0bdc06c6b0 legacy=0x7f0bdc0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0b0350 con 0x7f0bdc0b0b50 2023-12-19T13:53:31.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0bcc001670 con 0x7f0bdc0b0b50 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 >> v1:172.21.15.113:6789/0 conn(0x7f0bdc0b0b50 legacy=0x7f0bdc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc8003a10 0x7f0bc8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bc80047c0 0x7f0bc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc1449e0 0x7f0bc8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b0070 con 0x7f0bc80047c0 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc800bb40 con 0x7f0bc8003a10 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc800bd00 con 0x7f0bdc1449e0 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bd9d9b640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bc80047c0 0x7f0bc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.112+0000 7f0bda59c640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc8003a10 0x7f0bc8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.113+0000 7f0bd9d9b640 1 -- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc1449e0 msgr2=0x7f0bc8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.113+0000 7f0bd9d9b640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc1449e0 0x7f0bc8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.113+0000 7f0bd9d9b640 1 -- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc8003a10 msgr2=0x7f0bc8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:31.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.113+0000 7f0bd9d9b640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc8003a10 0x7f0bc8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.113+0000 7f0bd9d9b640 1 -- 172.21.15.113:0/267695508 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8003520 con 0x7f0bc80047c0 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.114+0000 7f0bd9d9b640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bc80047c0 0x7f0bc8004c40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c240 tx=0x7f0bc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130f7d186f7e07c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.114+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc005ad0 con 0x7f0bc80047c0 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.114+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc005c50 con 0x7f0bc80047c0 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.114+0000 7f0bd959a640 1 -- 172.21.15.113:0/267695508 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc02c8b0 con 0x7f0bc80047c0 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.115+0000 7f0be0927640 1 -- 172.21.15.113:0/267695508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bc80047c0 msgr2=0x7f0bc8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.115+0000 7f0be0927640 1 --2- 172.21.15.113:0/267695508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bc80047c0 0x7f0bc8004c40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c240 tx=0x7f0bc80057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.115+0000 7f0bdad9d640 1 -- 172.21.15.113:0/267695508 reap_dead start 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.115+0000 7f0be0927640 1 -- 172.21.15.113:0/267695508 shutdown_connections 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.115+0000 7f0be0927640 1 -- 172.21.15.113:0/267695508 >> 172.21.15.113:0/267695508 conn(0x7f0bdc0cbb70 msgr2=0x7f0bdc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.115+0000 7f0be0927640 1 -- 172.21.15.113:0/267695508 shutdown_connections 2023-12-19T13:53:31.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.115+0000 7f0be0927640 1 -- 172.21.15.113:0/267695508 wait complete. 2023-12-19T13:53:31.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.116+0000 7f0be0927640 1 Processor -- start 2023-12-19T13:53:31.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.117+0000 7f0be0927640 1 -- start start 2023-12-19T13:53:31.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.117+0000 7f0be0927640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc80047c0 0x7f0bdc159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.117+0000 7f0be0927640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc159ec0 0x7f0bdc142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.117+0000 7f0be0927640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bdc15a340 0x7f0bdc142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.117+0000 7f0be0927640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15bab0 con 0x7f0bdc15a340 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.117+0000 7f0be0927640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15a910 con 0x7f0bc80047c0 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.117+0000 7f0be0927640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15abf0 con 0x7f0bdc159ec0 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bdc15a340 0x7f0bdc142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bdc15a340 0x7f0bdc142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56672/0 (socket says 172.21.15.113:56672) 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 -- 172.21.15.113:0/2134660139 learned_addr learned my addr 172.21.15.113:0/2134660139 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bda59c640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc80047c0 0x7f0bdc159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bd9d9b640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc159ec0 0x7f0bdc142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 -- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc159ec0 msgr2=0x7f0bdc142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc159ec0 0x7f0bdc142150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 -- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc80047c0 msgr2=0x7f0bdc159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc80047c0 0x7f0bdc159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 -- 172.21.15.113:0/2134660139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc15aed0 con 0x7f0bdc15a340 2023-12-19T13:53:31.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.118+0000 7f0bdad9d640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bdc15a340 0x7f0bdc142690 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc071cd0 tx=0x7f0bd400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.119+0000 7f0bd2ffd640 1 -- 172.21.15.113:0/2134660139 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4005d40 con 0x7f0bdc15a340 2023-12-19T13:53:31.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.119+0000 7f0bd2ffd640 1 -- 172.21.15.113:0/2134660139 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400ced0 con 0x7f0bdc15a340 2023-12-19T13:53:31.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.119+0000 7f0bd2ffd640 1 -- 172.21.15.113:0/2134660139 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400a850 con 0x7f0bdc15a340 2023-12-19T13:53:31.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.119+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc15b1b0 con 0x7f0bdc15a340 2023-12-19T13:53:31.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.119+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc15db20 con 0x7f0bdc15a340 2023-12-19T13:53:31.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.120+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc15bc20 con 0x7f0bdc15a340 2023-12-19T13:53:31.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.121+0000 7f0bd2ffd640 1 -- 172.21.15.113:0/2134660139 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bd400a9b0 con 0x7f0bdc15a340 2023-12-19T13:53:31.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.122+0000 7f0bd2ffd640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0bbc06a430 0x7f0bbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.122+0000 7f0bd2ffd640 1 -- 172.21.15.113:0/2134660139 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bd4087890 con 0x7f0bdc15a340 2023-12-19T13:53:31.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.122+0000 7f0bda59c640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0bbc06a430 0x7f0bbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.122+0000 7f0bda59c640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0bbc06a430 0x7f0bbc06c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4006fd0 tx=0x7f0bc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.126+0000 7f0bd2ffd640 1 -- 172.21.15.113:0/2134660139 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0bd4052de0 con 0x7f0bdc15a340 2023-12-19T13:53:31.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.335+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bdc061910 con 0x7f0bdc15a340 2023-12-19T13:53:31.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.336+0000 7f0bd2ffd640 1 -- 172.21.15.113:0/2134660139 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f0bd4056400 con 0x7f0bdc15a340 2023-12-19T13:53:31.336 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:31.336 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:52:40.568364+0000","modified":"2023-12-19T13:52:43.584604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6900},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6900":{"gid":6900,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/835415073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":835415073},{"type":"v1","addr":"172.21.15.113:6837","nonce":835415073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T13:53:31.336 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 49 2023-12-19T13:53:31.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0bbc06a430 msgr2=0x7f0bbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0bbc06a430 0x7f0bbc06c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4006fd0 tx=0x7f0bc4008040 comp rx=0 tx=0).stop 2023-12-19T13:53:31.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bdc15a340 msgr2=0x7f0bdc142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bdc15a340 0x7f0bdc142690 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc071cd0 tx=0x7f0bd400cb90 comp rx=0 tx=0).stop 2023-12-19T13:53:31.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 shutdown_connections 2023-12-19T13:53:31.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0bbc06a430 0x7f0bbc06c8f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bdc15a340 0x7f0bdc142690 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc159ec0 0x7f0bdc142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 --2- 172.21.15.113:0/2134660139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc80047c0 0x7f0bdc159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 >> 172.21.15.113:0/2134660139 conn(0x7f0bdc0cbb70 msgr2=0x7f0bdc0ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:31.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 shutdown_connections 2023-12-19T13:53:31.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.339+0000 7f0be0927640 1 -- 172.21.15.113:0/2134660139 wait complete. 2023-12-19T13:53:31.357 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:31.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.558+0000 7f0f94bc4640 1 Processor -- start 2023-12-19T13:53:31.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.559+0000 7f0f94bc4640 1 -- start start 2023-12-19T13:53:31.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.560+0000 7f0f94bc4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0f9015e3f0 0x7f0f900b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.560+0000 7f0f94bc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f9006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.560+0000 7f0f94bc4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f900b2fa0 con 0x7f0f900b2460 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.560+0000 7f0f94bc4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9006f600 con 0x7f0f9015e3f0 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.560+0000 7f0f94bc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9015e7d0 con 0x7f0f900acfc0 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f87fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0f900b2460 0x7f0f900ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59064/0 (socket says 172.21.15.113:59064) 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f87fff640 1 -- 172.21.15.113:0/2029097603 learned_addr learned my addr 172.21.15.113:0/2029097603 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8f7fe640 1 --2- 172.21.15.113:0/2029097603 >> v2:172.21.15.113:3300/0 conn(0x7f0f9015e3f0 0x7f0f900b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8ffff640 1 --2- 172.21.15.113:0/2029097603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f9006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8effd640 1 -- 172.21.15.113:0/2029097603 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989742337 0 0) 0x7f0f900b2fa0 con 0x7f0f900b2460 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8effd640 1 -- 172.21.15.113:0/2029097603 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f7c003520 con 0x7f0f900b2460 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8f7fe640 1 -- 172.21.15.113:0/2029097603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 msgr2=0x7f0f9006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8f7fe640 1 --2- 172.21.15.113:0/2029097603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f9006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8f7fe640 1 -- 172.21.15.113:0/2029097603 >> v1:172.21.15.113:6789/0 conn(0x7f0f900b2460 legacy=0x7f0f900ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.561+0000 7f0f8f7fe640 1 -- 172.21.15.113:0/2029097603 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900b29e0 con 0x7f0f9015e3f0 2023-12-19T13:53:31.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.562+0000 7f0f8f7fe640 1 --2- 172.21.15.113:0/2029097603 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f900b1f20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0f800097a0 tx=0x7f0f8002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02e89083d967cd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.562+0000 7f0f8effd640 1 -- 172.21.15.113:0/2029097603 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80031780 con 0x7f0f9015e3f0 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f8effd640 1 -- 172.21.15.113:0/2029097603 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f800318e0 con 0x7f0f9015e3f0 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f8effd640 1 -- 172.21.15.113:0/2029097603 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80031c70 con 0x7f0f9015e3f0 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 -- 172.21.15.113:0/2029097603 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 msgr2=0x7f0f900b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/2029097603 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f900b1f20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0f800097a0 tx=0x7f0f8002b820 comp rx=0 tx=0).stop 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 -- 172.21.15.113:0/2029097603 shutdown_connections 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/2029097603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f9006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/2029097603 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f900b1f20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 -- 172.21.15.113:0/2029097603 >> 172.21.15.113:0/2029097603 conn(0x7f0f900b0100 msgr2=0x7f0f900b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 -- 172.21.15.113:0/2029097603 shutdown_connections 2023-12-19T13:53:31.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.563+0000 7f0f94bc4640 1 -- 172.21.15.113:0/2029097603 wait complete. 2023-12-19T13:53:31.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.565+0000 7f0f94bc4640 1 Processor -- start 2023-12-19T13:53:31.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.565+0000 7f0f94bc4640 1 -- start start 2023-12-19T13:53:31.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f94bc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f90159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f94bc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f900b2460 0x7f0f90160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f94bc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f901612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f94bc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9006e710 con 0x7f0f9015e3f0 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f94bc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9006c530 con 0x7f0f900b2460 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f94bc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9006c810 con 0x7f0f900acfc0 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f8ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f901612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f8ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f901612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56680/0 (socket says 172.21.15.113:56680) 2023-12-19T13:53:31.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.566+0000 7f0f8ffff640 1 -- 172.21.15.113:0/1221432818 learned_addr learned my addr 172.21.15.113:0/1221432818 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:31.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f87fff640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f900b2460 0x7f0f90160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8f7fe640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f90159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8ffff640 1 -- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 msgr2=0x7f0f90159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8ffff640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f90159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8ffff640 1 -- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f900b2460 msgr2=0x7f0f90160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8ffff640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f900b2460 0x7f0f90160da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8ffff640 1 -- 172.21.15.113:0/1221432818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80009400 con 0x7f0f9015e3f0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8ffff640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f901612e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0f88007d40 tx=0x7f0f8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8cff9640 1 -- 172.21.15.113:0/1221432818 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88014420 con 0x7f0f9015e3f0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8cff9640 1 -- 172.21.15.113:0/1221432818 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f880145a0 con 0x7f0f9015e3f0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f8cff9640 1 -- 172.21.15.113:0/1221432818 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88014950 con 0x7f0f9015e3f0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.567+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9006caf0 con 0x7f0f9015e3f0 2023-12-19T13:53:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.568+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9006d2f0 con 0x7f0f9015e3f0 2023-12-19T13:53:31.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.569+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9006d010 con 0x7f0f9015e3f0 2023-12-19T13:53:31.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.570+0000 7f0f8cff9640 1 -- 172.21.15.113:0/1221432818 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f88014ab0 con 0x7f0f9015e3f0 2023-12-19T13:53:31.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.571+0000 7f0f8cff9640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f7006a430 0x7f0f7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.571+0000 7f0f8cff9640 1 -- 172.21.15.113:0/1221432818 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f88089130 con 0x7f0f9015e3f0 2023-12-19T13:53:31.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.571+0000 7f0f8f7fe640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f7006a430 0x7f0f7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.572+0000 7f0f8f7fe640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f7006a430 0x7f0f7006c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0f80036000 tx=0x7f0f8003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.575+0000 7f0f8cff9640 1 -- 172.21.15.113:0/1221432818 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f9006d010 con 0x7f0f9015e3f0 2023-12-19T13:53:31.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.752+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f9006d010 con 0x7f0f9015e3f0 2023-12-19T13:53:31.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.754+0000 7f0f8cff9640 1 -- 172.21.15.113:0/1221432818 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16164 (secure 0 0 0) 0x7f0f9006d010 con 0x7f0f9015e3f0 2023-12-19T13:53:31.753 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:31.754 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":120,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:14.625779+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:52:38.334371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T13:52:39.588248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:31.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.756+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f7006a430 msgr2=0x7f0f7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.756+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f7006a430 0x7f0f7006c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0f80036000 tx=0x7f0f8003d040 comp rx=0 tx=0).stop 2023-12-19T13:53:31.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.756+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 msgr2=0x7f0f901612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.756+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f901612e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0f88007d40 tx=0x7f0f8800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 shutdown_connections 2023-12-19T13:53:31.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f7006a430 0x7f0f7006c8f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f9015e3f0 0x7f0f901612e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f900b2460 0x7f0f90160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 --2- 172.21.15.113:0/1221432818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f900acfc0 0x7f0f90159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 >> 172.21.15.113:0/1221432818 conn(0x7f0f900b0100 msgr2=0x7f0f90070810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:31.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 shutdown_connections 2023-12-19T13:53:31.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.757+0000 7f0f94bc4640 1 -- 172.21.15.113:0/1221432818 wait complete. 2023-12-19T13:53:31.773 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:53:31.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.980+0000 7fe780a1b640 1 Processor -- start 2023-12-19T13:53:31.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.980+0000 7fe780a1b640 1 -- start start 2023-12-19T13:53:31.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe780a1b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c0b1230 0x7fe77c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe780a1b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c06b3a0 con 0x7fe77c159e40 2023-12-19T13:53:31.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe780a1b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c0b1630 con 0x7fe77c0b0a00 2023-12-19T13:53:31.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe780a1b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0b23e0 con 0x7fe77c0b1230 2023-12-19T13:53:31.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe77b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe77c159e40 0x7fe77c0b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59080/0 (socket says 172.21.15.113:59080) 2023-12-19T13:53:31.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe77b7fe640 1 -- 172.21.15.113:0/3152865986 learned_addr learned my addr 172.21.15.113:0/3152865986 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:31.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665138033 0 0) 0x7fe77c06b3a0 con 0x7fe77c159e40 2023-12-19T13:53:31.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe768005730 con 0x7fe77c159e40 2023-12-19T13:53:31.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.982+0000 7fe77bfff640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c0b1230 0x7fe77c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261291041 0 0) 0x7fe768005730 con 0x7fe77c159e40 2023-12-19T13:53:31.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c0b1230 msgr2=0x7fe77c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:31.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c0b1230 0x7fe77c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 >> v1:172.21.15.151:6789/0 conn(0x7fe77c0b0a00 legacy=0x7fe77c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0b1860 con 0x7fe77c159e40 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe76c001670 con 0x7fe77c159e40 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 >> v1:172.21.15.113:6789/0 conn(0x7fe77c159e40 legacy=0x7fe77c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe768006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c0b1230 0x7fe7680069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe768006f60 0x7fe7680073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0b23e0 con 0x7fe768005c20 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76800dde0 con 0x7fe768006f60 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76800dfa0 con 0x7fe77c0b1230 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77b7fe640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe768006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77b7fe640 1 -- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c0b1230 msgr2=0x7fe7680069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77b7fe640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c0b1230 0x7fe7680069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77b7fe640 1 -- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe768006f60 msgr2=0x7fe7680073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:31.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.983+0000 7fe77bfff640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe768006f60 0x7fe7680073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.984+0000 7fe77b7fe640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe768006f60 0x7fe7680073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.984+0000 7fe77b7fe640 1 -- 172.21.15.113:0/3152865986 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768005730 con 0x7fe768005c20 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe77b7fe640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe768006040 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c240 tx=0x7fe768007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4122fe3dbc383fb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c005ad0 con 0x7fe768005c20 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c005c30 con 0x7fe768005c20 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe77affd640 1 -- 172.21.15.113:0/3152865986 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c02c8b0 con 0x7fe768005c20 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe780a1b640 1 -- 172.21.15.113:0/3152865986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 msgr2=0x7fe768006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe780a1b640 1 --2- 172.21.15.113:0/3152865986 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe768006040 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c240 tx=0x7fe768007a00 comp rx=0 tx=0).stop 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe77bfff640 1 -- 172.21.15.113:0/3152865986 reap_dead start 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe780a1b640 1 -- 172.21.15.113:0/3152865986 shutdown_connections 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.985+0000 7fe780a1b640 1 -- 172.21.15.113:0/3152865986 >> 172.21.15.113:0/3152865986 conn(0x7fe77c0659a0 msgr2=0x7fe77c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:31.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.986+0000 7fe780a1b640 1 -- 172.21.15.113:0/3152865986 shutdown_connections 2023-12-19T13:53:31.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.986+0000 7fe780a1b640 1 -- 172.21.15.113:0/3152865986 wait complete. 2023-12-19T13:53:31.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.987+0000 7fe780a1b640 1 Processor -- start 2023-12-19T13:53:31.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.987+0000 7fe780a1b640 1 -- start start 2023-12-19T13:53:31.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.988+0000 7fe780a1b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe77c14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.988+0000 7fe780a1b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c149dd0 0x7fe77c14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.988+0000 7fe780a1b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c14bc40 0x7fe77c14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.988+0000 7fe780a1b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0cd970 con 0x7fe768005c20 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.988+0000 7fe780a1b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c14c600 con 0x7fe77c149dd0 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.988+0000 7fe780a1b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c14e250 con 0x7fe77c14bc40 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe77c14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe77c14a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56702/0 (socket says 172.21.15.113:56702) 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 -- 172.21.15.113:0/4080334614 learned_addr learned my addr 172.21.15.113:0/4080334614 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 -- 172.21.15.113:0/4080334614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c14bc40 msgr2=0x7fe77c14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c14bc40 0x7fe77c14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 -- 172.21.15.113:0/4080334614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c149dd0 msgr2=0x7fe77c14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe773fff640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c149dd0 0x7fe77c14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c149dd0 0x7fe77c14dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:31.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 -- 172.21.15.113:0/4080334614 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0ada50 con 0x7fe768005c20 2023-12-19T13:53:31.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.989+0000 7fe77b7fe640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe77c14a4b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe76c02c450 tx=0x7fe76c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.990+0000 7fe778ff9640 1 -- 172.21.15.113:0/4080334614 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c039070 con 0x7fe768005c20 2023-12-19T13:53:31.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.990+0000 7fe778ff9640 1 -- 172.21.15.113:0/4080334614 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c02ddd0 con 0x7fe768005c20 2023-12-19T13:53:31.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.990+0000 7fe778ff9640 1 -- 172.21.15.113:0/4080334614 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c03c040 con 0x7fe768005c20 2023-12-19T13:53:31.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.990+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c0adca0 con 0x7fe768005c20 2023-12-19T13:53:31.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.990+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c0ae260 con 0x7fe768005c20 2023-12-19T13:53:31.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.991+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c061910 con 0x7fe768005c20 2023-12-19T13:53:31.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.992+0000 7fe778ff9640 1 -- 172.21.15.113:0/4080334614 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe76c032070 con 0x7fe768005c20 2023-12-19T13:53:31.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.993+0000 7fe778ff9640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe75c06a460 0x7fe75c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:31.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.993+0000 7fe778ff9640 1 -- 172.21.15.113:0/4080334614 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe76c0a9c20 con 0x7fe768005c20 2023-12-19T13:53:31.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.993+0000 7fe773fff640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe75c06a460 0x7fe75c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:31.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.993+0000 7fe773fff640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe75c06a460 0x7fe75c06c920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe77c158d80 tx=0x7fe764009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:31.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:31.997+0000 7fe778ff9640 1 -- 172.21.15.113:0/4080334614 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe76c075200 con 0x7fe768005c20 2023-12-19T13:53:32.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.206+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe77c0cca00 con 0x7fe768005c20 2023-12-19T13:53:32.206 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:53:32.207+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:53:32.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.227+0000 7fe778ff9640 1 -- 172.21.15.113:0/4080334614 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe76c046070 con 0x7fe768005c20 2023-12-19T13:53:32.227 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe75c06a460 msgr2=0x7fe75c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe75c06a460 0x7fe75c06c920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe77c158d80 tx=0x7fe764009040 comp rx=0 tx=0).stop 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 msgr2=0x7fe77c14a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe77c14a4b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe76c02c450 tx=0x7fe76c001a00 comp rx=0 tx=0).stop 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 shutdown_connections 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe75c06a460 0x7fe75c06c920 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe77c14bc40 0x7fe77c14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c149dd0 0x7fe77c14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:32.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 --2- 172.21.15.113:0/4080334614 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe768005c20 0x7fe77c14a4b0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:32.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.230+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 >> 172.21.15.113:0/4080334614 conn(0x7fe77c0659a0 msgr2=0x7fe77c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:32.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.231+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 shutdown_connections 2023-12-19T13:53:32.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.231+0000 7fe780a1b640 1 -- 172.21.15.113:0/4080334614 wait complete. 2023-12-19T13:53:32.247 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:53:32.290 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:53:32.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.428+0000 7f6b812f7640 1 Processor -- start 2023-12-19T13:53:32.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.428+0000 7f6b812f7640 1 -- start start 2023-12-19T13:53:32.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b812f7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6b7c0b02b0 0x7f6b7c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:32.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b812f7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c0af110 con 0x7f6b7c15a190 2023-12-19T13:53:32.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b812f7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c0ad960 con 0x7f6b7c0ce420 2023-12-19T13:53:32.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b812f7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c0b0c80 con 0x7f6b7c0b02b0 2023-12-19T13:53:32.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b727fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6b7c0b02b0 0x7f6b7c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:32.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b7affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6b7c15a190 0x7f6b7c0aea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59088/0 (socket says 172.21.15.113:59088) 2023-12-19T13:53:32.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b7affd640 1 -- 172.21.15.113:0/2647004865 learned_addr learned my addr 172.21.15.113:0/2647004865 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:32.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b727fc640 1 -- 172.21.15.113:0/2647004865 >> v1:172.21.15.151:6789/0 conn(0x7f6b7c0ce420 legacy=0x7f6b7c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:32.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b727fc640 1 -- 172.21.15.113:0/2647004865 >> v1:172.21.15.113:6789/0 conn(0x7f6b7c15a190 legacy=0x7f6b7c0aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:32.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b727fc640 1 -- 172.21.15.113:0/2647004865 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c0adc40 con 0x7f6b7c0b02b0 2023-12-19T13:53:32.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.430+0000 7f6b7a7fc640 1 -- 172.21.15.113:0/2647004865 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244883257 0 0) 0x7f6b7c0af110 con 0x7f6b7c15a190 2023-12-19T13:53:32.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.432+0000 7f6b727fc640 1 --2- 172.21.15.113:0/2647004865 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c0b02b0 0x7f6b7c0b0740 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6b640097a0 tx=0x7f6b6402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a81d8209b5dbb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:32.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.432+0000 7f6b7a7fc640 1 -- 172.21.15.113:0/2647004865 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6402e070 con 0x7f6b7c0b02b0 2023-12-19T13:53:32.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.432+0000 7f6b7a7fc640 1 -- 172.21.15.113:0/2647004865 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b640315a0 con 0x7f6b7c0b02b0 2023-12-19T13:53:32.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.432+0000 7f6b7a7fc640 1 -- 172.21.15.113:0/2647004865 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64031930 con 0x7f6b7c0b02b0 2023-12-19T13:53:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.432+0000 7f6b812f7640 1 -- 172.21.15.113:0/2647004865 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c0b02b0 msgr2=0x7f6b7c0b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.432+0000 7f6b812f7640 1 --2- 172.21.15.113:0/2647004865 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c0b02b0 0x7f6b7c0b0740 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6b640097a0 tx=0x7f6b6402b840 comp rx=0 tx=0).stop 2023-12-19T13:53:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.433+0000 7f6b812f7640 1 -- 172.21.15.113:0/2647004865 shutdown_connections 2023-12-19T13:53:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.433+0000 7f6b812f7640 1 --2- 172.21.15.113:0/2647004865 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c0b02b0 0x7f6b7c0b0740 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.433+0000 7f6b812f7640 1 -- 172.21.15.113:0/2647004865 >> 172.21.15.113:0/2647004865 conn(0x7f6b7c066160 msgr2=0x7f6b7c0cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.433+0000 7f6b812f7640 1 -- 172.21.15.113:0/2647004865 shutdown_connections 2023-12-19T13:53:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.433+0000 7f6b812f7640 1 -- 172.21.15.113:0/2647004865 wait complete. 2023-12-19T13:53:32.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.434+0000 7f6b812f7640 1 Processor -- start 2023-12-19T13:53:32.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.435+0000 7f6b812f7640 1 -- start start 2023-12-19T13:53:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b812f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b7c0b02b0 0x7f6b7c0ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b812f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ce420 0x7f6b7c158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b812f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c15a190 0x7f6b7c158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b812f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1f17e0 con 0x7f6b7c15a190 2023-12-19T13:53:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b812f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1f1500 con 0x7f6b7c0ce420 2023-12-19T13:53:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b812f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1f3f60 con 0x7f6b7c0b02b0 2023-12-19T13:53:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c15a190 0x7f6b7c158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c15a190 0x7f6b7c158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56748/0 (socket says 172.21.15.113:56748) 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 -- 172.21.15.113:0/3823509342 learned_addr learned my addr 172.21.15.113:0/3823509342 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7affd640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b7c0b02b0 0x7f6b7c0ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b727fc640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ce420 0x7f6b7c158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 -- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b7c0b02b0 msgr2=0x7f6b7c0ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b7c0b02b0 0x7f6b7c0ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 -- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ce420 msgr2=0x7f6b7c158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ce420 0x7f6b7c158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7b7fe640 1 -- 172.21.15.113:0/3823509342 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b64009400 con 0x7f6b7c15a190 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.436+0000 7f6b7affd640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b7c0b02b0 0x7f6b7c0ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.437+0000 7f6b7b7fe640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c15a190 0x7f6b7c158cd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c410 tx=0x7f6b7400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.437+0000 7f6b73fff640 1 -- 172.21.15.113:0/3823509342 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74011790 con 0x7f6b7c15a190 2023-12-19T13:53:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.437+0000 7f6b73fff640 1 -- 172.21.15.113:0/3823509342 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b740118f0 con 0x7f6b7c15a190 2023-12-19T13:53:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.437+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c1f4240 con 0x7f6b7c15a190 2023-12-19T13:53:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.437+0000 7f6b73fff640 1 -- 172.21.15.113:0/3823509342 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74011ce0 con 0x7f6b7c15a190 2023-12-19T13:53:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.437+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c0ab970 con 0x7f6b7c15a190 2023-12-19T13:53:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.438+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c1f3dc0 con 0x7f6b7c15a190 2023-12-19T13:53:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.439+0000 7f6b73fff640 1 -- 172.21.15.113:0/3823509342 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b7401c460 con 0x7f6b7c15a190 2023-12-19T13:53:32.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.440+0000 7f6b73fff640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6b5c06a460 0x7f6b5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:32.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.440+0000 7f6b73fff640 1 -- 172.21.15.113:0/3823509342 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6b74088720 con 0x7f6b7c15a190 2023-12-19T13:53:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.440+0000 7f6b7affd640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6b5c06a460 0x7f6b5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.441+0000 7f6b7affd640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6b5c06a460 0x7f6b5c06c920 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c007fd0 tx=0x7f6b6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.444+0000 7f6b73fff640 1 -- 172.21.15.113:0/3823509342 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6b7c1f3dc0 con 0x7f6b7c15a190 2023-12-19T13:53:32.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:32.674+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6b7c1f3dc0 con 0x7f6b7c15a190 2023-12-19T13:53:33.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.230+0000 7f6b73fff640 1 -- 172.21.15.113:0/3823509342 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b7c1f3dc0 con 0x7f6b7c15a190 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6b5c06a460 msgr2=0x7f6b5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6b5c06a460 0x7f6b5c06c920 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c007fd0 tx=0x7f6b6c009040 comp rx=0 tx=0).stop 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c15a190 msgr2=0x7f6b7c158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c15a190 0x7f6b7c158cd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c410 tx=0x7f6b7400c8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 shutdown_connections 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6b5c06a460 0x7f6b5c06c920 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b7c15a190 0x7f6b7c158cd0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ce420 0x7f6b7c158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 --2- 172.21.15.113:0/3823509342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b7c0b02b0 0x7f6b7c0ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 >> 172.21.15.113:0/3823509342 conn(0x7f6b7c066160 msgr2=0x7f6b7c0af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:33.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.234+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 shutdown_connections 2023-12-19T13:53:33.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.235+0000 7f6b812f7640 1 -- 172.21.15.113:0/3823509342 wait complete. 2023-12-19T13:53:33.256 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:53:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.520+0000 7fac84fd0640 1 Processor -- start 2023-12-19T13:53:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.520+0000 7fac84fd0640 1 -- start start 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac84fd0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fac80146800 0x7fac800a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac84fd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800ab150 0x7fac800a9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac84fd0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac800a9e80 0x7fac80160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac84fd0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac80146be0 con 0x7fac80146800 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac84fd0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac80147060 con 0x7fac800a9e80 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac84fd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac800ab710 con 0x7fac800ab150 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac7e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fac80146800 0x7fac800a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:33.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac7e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fac80146800 0x7fac800a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56754/0 (socket says 172.21.15.113:56754) 2023-12-19T13:53:33.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.522+0000 7fac7e59c640 1 -- 172.21.15.113:0/3810928873 learned_addr learned my addr 172.21.15.113:0/3810928873 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:33.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.523+0000 7fac7e59c640 1 -- 172.21.15.113:0/3810928873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800ab150 msgr2=0x7fac800a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:33.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.523+0000 7fac7e59c640 1 --2- 172.21.15.113:0/3810928873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800ab150 0x7fac800a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.523+0000 7fac7e59c640 1 -- 172.21.15.113:0/3810928873 >> v2:172.21.15.151:3300/0 conn(0x7fac800a9e80 msgr2=0x7fac80160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:33.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.523+0000 7fac7e59c640 1 --2- 172.21.15.113:0/3810928873 >> v2:172.21.15.151:3300/0 conn(0x7fac800a9e80 0x7fac80160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.523+0000 7fac7e59c640 1 -- 172.21.15.113:0/3810928873 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac800ab9f0 con 0x7fac80146800 2023-12-19T13:53:33.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.524+0000 7fac7e59c640 1 --2- 172.21.15.113:0/3810928873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac800a9400 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fac80066980 tx=0x7fac7002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd782bcfe32d075 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:33.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.524+0000 7fac7dd9b640 1 -- 172.21.15.113:0/3810928873 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7002c9e0 con 0x7fac80146800 2023-12-19T13:53:33.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.524+0000 7fac7dd9b640 1 -- 172.21.15.113:0/3810928873 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7002cb40 con 0x7fac80146800 2023-12-19T13:53:33.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.524+0000 7fac7dd9b640 1 -- 172.21.15.113:0/3810928873 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac700343f0 con 0x7fac80146800 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 -- 172.21.15.113:0/3810928873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 msgr2=0x7fac800a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3810928873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac800a9400 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fac80066980 tx=0x7fac7002be40 comp rx=0 tx=0).stop 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 -- 172.21.15.113:0/3810928873 shutdown_connections 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3810928873 >> v2:172.21.15.151:3300/0 conn(0x7fac800a9e80 0x7fac80160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3810928873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800ab150 0x7fac800a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3810928873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac800a9400 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 -- 172.21.15.113:0/3810928873 >> 172.21.15.113:0/3810928873 conn(0x7fac8006f5a0 msgr2=0x7fac8006f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 -- 172.21.15.113:0/3810928873 shutdown_connections 2023-12-19T13:53:33.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.525+0000 7fac84fd0640 1 -- 172.21.15.113:0/3810928873 wait complete. 2023-12-19T13:53:33.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.527+0000 7fac84fd0640 1 Processor -- start 2023-12-19T13:53:33.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.527+0000 7fac84fd0640 1 -- start start 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.528+0000 7fac84fd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800a9e80 0x7fac80139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac84fd0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac800ab150 0x7fac8013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac84fd0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac80138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac84fd0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8015dbb0 con 0x7fac80146800 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac84fd0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8015de90 con 0x7fac800ab150 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac84fd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8015e170 con 0x7fac800a9e80 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac80138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:33.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac80138580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56756/0 (socket says 172.21.15.113:56756) 2023-12-19T13:53:33.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 -- 172.21.15.113:0/3508690479 learned_addr learned my addr 172.21.15.113:0/3508690479 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac75d9b640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac800ab150 0x7fac8013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 -- 172.21.15.113:0/3508690479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800a9e80 msgr2=0x7fac80139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800a9e80 0x7fac80139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 -- 172.21.15.113:0/3508690479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac800ab150 msgr2=0x7fac8013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac800ab150 0x7fac8013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.529+0000 7fac7ed9d640 1 -- 172.21.15.113:0/3508690479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70009b30 con 0x7fac80146800 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.530+0000 7fac7ed9d640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac80138580 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fac7800b410 tx=0x7fac7800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.530+0000 7fac777fe640 1 -- 172.21.15.113:0/3508690479 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78011830 con 0x7fac80146800 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.530+0000 7fac777fe640 1 -- 172.21.15.113:0/3508690479 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac780119b0 con 0x7fac80146800 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.530+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8015e450 con 0x7fac80146800 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.530+0000 7fac777fe640 1 -- 172.21.15.113:0/3508690479 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78011d60 con 0x7fac80146800 2023-12-19T13:53:33.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.530+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8013a1c0 con 0x7fac80146800 2023-12-19T13:53:33.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.531+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8015e970 con 0x7fac80146800 2023-12-19T13:53:33.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.532+0000 7fac777fe640 1 -- 172.21.15.113:0/3508690479 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fac7801a400 con 0x7fac80146800 2023-12-19T13:53:33.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.533+0000 7fac777fe640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac6006a430 0x7fac6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:33.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.533+0000 7fac777fe640 1 -- 172.21.15.113:0/3508690479 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fac78088aa0 con 0x7fac80146800 2023-12-19T13:53:33.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.534+0000 7fac7e59c640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac6006a430 0x7fac6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:33.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.534+0000 7fac7e59c640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac6006a430 0x7fac6006c8f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fac70035000 tx=0x7fac7002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:33.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.537+0000 7fac777fe640 1 -- 172.21.15.113:0/3508690479 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fac8015e970 con 0x7fac80146800 2023-12-19T13:53:33.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:33.735+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fac8015e970 con 0x7fac80146800 2023-12-19T13:53:34.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.720+0000 7fac777fe640 1 -- 172.21.15.113:0/3508690479 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) v1 ==== 181+0+0 (secure 0 0 0) 0x7fac8015e970 con 0x7fac80146800 2023-12-19T13:53:34.720 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:53:34.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.724+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac6006a430 msgr2=0x7fac6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:34.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.724+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac6006a430 0x7fac6006c8f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fac70035000 tx=0x7fac7002e000 comp rx=0 tx=0).stop 2023-12-19T13:53:34.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.724+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 msgr2=0x7fac80138580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:34.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.724+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac80138580 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fac7800b410 tx=0x7fac7800b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 shutdown_connections 2023-12-19T13:53:34.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac6006a430 0x7fac6006c8f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac80146800 0x7fac80138580 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac800ab150 0x7fac8013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 --2- 172.21.15.113:0/3508690479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac800a9e80 0x7fac80139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 >> 172.21.15.113:0/3508690479 conn(0x7fac8006f5a0 msgr2=0x7fac800aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:34.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 shutdown_connections 2023-12-19T13:53:34.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.725+0000 7fac84fd0640 1 -- 172.21.15.113:0/3508690479 wait complete. 2023-12-19T13:53:34.747 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:53:34.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.970+0000 7f3a5f4f7640 1 Processor -- start 2023-12-19T13:53:34.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.970+0000 7f3a5f4f7640 1 -- start start 2023-12-19T13:53:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.972+0000 7f3a5f4f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a581402c0 0x7f3a58143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.972+0000 7f3a5f4f7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a58143c50 con 0x7f3a58161130 2023-12-19T13:53:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.972+0000 7f3a5f4f7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5815db40 con 0x7f3a581406a0 2023-12-19T13:53:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.972+0000 7f3a5f4f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b6760 con 0x7f3a581402c0 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.972+0000 7f3a5ca92640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3a58161130 0x7f3a58140c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59090/0 (socket says 172.21.15.113:59090) 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.972+0000 7f3a5ca92640 1 -- 172.21.15.113:0/3739504432 learned_addr learned my addr 172.21.15.113:0/3739504432 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a5d293640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a581402c0 0x7f3a58143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362572391 0 0) 0x7f3a4c001110 con 0x7f3a58161130 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a40003520 con 0x7f3a58161130 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2707041630 0 0) 0x7f3a40003520 con 0x7f3a58161130 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a581402c0 msgr2=0x7f3a58143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:34.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a581402c0 0x7f3a58143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 >> v1:172.21.15.151:6789/0 conn(0x7f3a581406a0 legacy=0x7f3a580b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58161660 con 0x7f3a58161130 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3a4c001800 con 0x7f3a58161130 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 >> v1:172.21.15.113:6789/0 conn(0x7f3a58161130 legacy=0x7f3a58140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.973+0000 7f3a57fff640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a581402c0 0x7f3a400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a57fff640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a40003f70 0x7f3a400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a57fff640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b6760 con 0x7f3a40004d00 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4000bac0 con 0x7f3a40003f70 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4000bc80 con 0x7f3a581402c0 2023-12-19T13:53:34.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a5da94640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a5da94640 1 -- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a581402c0 msgr2=0x7f3a400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a5da94640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a581402c0 0x7f3a400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a5da94640 1 -- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a40003f70 msgr2=0x7f3a400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a5ca92640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a40003f70 0x7f3a400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a5da94640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a40003f70 0x7f3a400047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.974+0000 7f3a5da94640 1 -- 172.21.15.113:0/3739504432 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40003520 con 0x7f3a40004d00 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.976+0000 7f3a5da94640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a40005180 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3a50001750 tx=0x7f3a400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a76e3ba7d1a6d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.976+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500052d0 con 0x7f3a40004d00 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.976+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5002e050 con 0x7f3a40004d00 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.976+0000 7f3a57fff640 1 -- 172.21.15.113:0/3739504432 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50003830 con 0x7f3a40004d00 2023-12-19T13:53:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.976+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/3739504432 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 msgr2=0x7f3a40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.976+0000 7f3a5f4f7640 1 --2- 172.21.15.113:0/3739504432 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a40005180 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3a50001750 tx=0x7f3a400057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.976+0000 7f3a5da94640 1 -- 172.21.15.113:0/3739504432 reap_dead start 2023-12-19T13:53:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.977+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/3739504432 shutdown_connections 2023-12-19T13:53:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.977+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/3739504432 >> 172.21.15.113:0/3739504432 conn(0x7f3a58065dc0 msgr2=0x7f3a580b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.977+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/3739504432 shutdown_connections 2023-12-19T13:53:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.977+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/3739504432 wait complete. 2023-12-19T13:53:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.978+0000 7f3a5f4f7640 1 Processor -- start 2023-12-19T13:53:34.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.979+0000 7f3a5f4f7640 1 -- start start 2023-12-19T13:53:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.979+0000 7f3a5f4f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a580b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.979+0000 7f3a5f4f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a580b5870 0x7f3a58156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.979+0000 7f3a5f4f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a58157070 0x7f3a58158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.979+0000 7f3a5f4f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a58157580 con 0x7f3a40004d00 2023-12-19T13:53:34.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.979+0000 7f3a5f4f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815bd10 con 0x7f3a58157070 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.979+0000 7f3a5f4f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815bff0 con 0x7f3a580b5870 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a580b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a580b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56768/0 (socket says 172.21.15.113:56768) 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 -- 172.21.15.113:0/2365301988 learned_addr learned my addr 172.21.15.113:0/2365301988 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 -- 172.21.15.113:0/2365301988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a580b5870 msgr2=0x7f3a58156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a580b5870 0x7f3a58156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 -- 172.21.15.113:0/2365301988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a58157070 msgr2=0x7f3a58158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a58157070 0x7f3a58158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 -- 172.21.15.113:0/2365301988 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5815c2d0 con 0x7f3a40004d00 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.980+0000 7f3a5d293640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a580b5330 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800ef40 tx=0x7f3a4800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.981+0000 7f3a55ffb640 1 -- 172.21.15.113:0/2365301988 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48010040 con 0x7f3a40004d00 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.981+0000 7f3a55ffb640 1 -- 172.21.15.113:0/2365301988 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a48009e60 con 0x7f3a40004d00 2023-12-19T13:53:34.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.981+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5815b9c0 con 0x7f3a40004d00 2023-12-19T13:53:34.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.981+0000 7f3a55ffb640 1 -- 172.21.15.113:0/2365301988 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48003bb0 con 0x7f3a40004d00 2023-12-19T13:53:34.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.981+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a581f7040 con 0x7f3a40004d00 2023-12-19T13:53:34.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.982+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a58061910 con 0x7f3a40004d00 2023-12-19T13:53:34.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.983+0000 7f3a55ffb640 1 -- 172.21.15.113:0/2365301988 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3a48003d10 con 0x7f3a40004d00 2023-12-19T13:53:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.984+0000 7f3a55ffb640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a4406a430 0x7f3a4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.984+0000 7f3a55ffb640 1 -- 172.21.15.113:0/2365301988 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3a48088d90 con 0x7f3a40004d00 2023-12-19T13:53:34.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.984+0000 7f3a5ca92640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a4406a430 0x7f3a4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:34.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.985+0000 7f3a5ca92640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a4406a430 0x7f3a4406c8f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c001270 tx=0x7f3a4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:34.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:34.990+0000 7f3a55ffb640 1 -- 172.21.15.113:0/2365301988 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3a480544d0 con 0x7f3a40004d00 2023-12-19T13:53:35.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.180+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3a5815c460 con 0x7f3a40004d00 2023-12-19T13:53:35.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.727+0000 7f3a55ffb640 1 -- 172.21.15.113:0/2365301988 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3a48057af0 con 0x7f3a40004d00 2023-12-19T13:53:35.727 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:53:35.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.732+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a4406a430 msgr2=0x7f3a4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:35.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.732+0000 7f3a5f4f7640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a4406a430 0x7f3a4406c8f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c001270 tx=0x7f3a4c009040 comp rx=0 tx=0).stop 2023-12-19T13:53:35.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.732+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 msgr2=0x7f3a580b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:35.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.732+0000 7f3a5f4f7640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a580b5330 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800ef40 tx=0x7f3a4800b480 comp rx=0 tx=0).stop 2023-12-19T13:53:35.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.733+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 shutdown_connections 2023-12-19T13:53:35.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.733+0000 7f3a5f4f7640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a4406a430 0x7f3a4406c8f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.733+0000 7f3a5f4f7640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a58157070 0x7f3a58158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.733+0000 7f3a5f4f7640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a580b5870 0x7f3a58156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.733+0000 7f3a5f4f7640 1 --2- 172.21.15.113:0/2365301988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40004d00 0x7f3a580b5330 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.734+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 >> 172.21.15.113:0/2365301988 conn(0x7f3a58065dc0 msgr2=0x7f3a581540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:35.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.734+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 shutdown_connections 2023-12-19T13:53:35.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.734+0000 7f3a5f4f7640 1 -- 172.21.15.113:0/2365301988 wait complete. 2023-12-19T13:53:35.754 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:53:35.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.958+0000 7f476e669640 1 Processor -- start 2023-12-19T13:53:35.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.958+0000 7f476e669640 1 -- start start 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.959+0000 7f476e669640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f47680b02b0 0x7f47680b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.959+0000 7f476e669640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f47680ce420 0x7f47680ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.959+0000 7f476e669640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47680af110 con 0x7f476815a190 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.959+0000 7f476e669640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47680b0c80 con 0x7f47680b02b0 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.959+0000 7f476e669640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47680ad960 con 0x7f47680ce420 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f4767fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f476815a190 0x7f47680aea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59102/0 (socket says 172.21.15.113:59102) 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f4767fff640 1 -- 172.21.15.113:0/1853007698 learned_addr learned my addr 172.21.15.113:0/1853007698 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:35.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f47677fe640 1 --2- 172.21.15.113:0/1853007698 >> v2:172.21.15.113:3300/0 conn(0x7f47680b02b0 0x7f47680b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f4766ffd640 1 -- 172.21.15.113:0/1853007698 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088292378 0 0) 0x7f47680af110 con 0x7f476815a190 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f4766ffd640 1 -- 172.21.15.113:0/1853007698 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4750005730 con 0x7f476815a190 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f476cc06640 1 --2- 172.21.15.113:0/1853007698 >> v2:172.21.15.151:3300/0 conn(0x7f47680ce420 0x7f47680ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f47677fe640 1 -- 172.21.15.113:0/1853007698 >> v2:172.21.15.151:3300/0 conn(0x7f47680ce420 msgr2=0x7f47680ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f47677fe640 1 --2- 172.21.15.113:0/1853007698 >> v2:172.21.15.151:3300/0 conn(0x7f47680ce420 0x7f47680ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f47677fe640 1 -- 172.21.15.113:0/1853007698 >> v1:172.21.15.113:6789/0 conn(0x7f476815a190 legacy=0x7f47680aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f47677fe640 1 -- 172.21.15.113:0/1853007698 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47680adc40 con 0x7f47680b02b0 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.960+0000 7f476cc06640 1 --2- 172.21.15.113:0/1853007698 >> v2:172.21.15.151:3300/0 conn(0x7f47680ce420 0x7f47680ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:35.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.962+0000 7f47677fe640 1 --2- 172.21.15.113:0/1853007698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f47680b0740 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f47680cbaa0 tx=0x7f475c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1a38d39eaa5068 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:35.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.962+0000 7f4766ffd640 1 -- 172.21.15.113:0/1853007698 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c02e070 con 0x7f47680b02b0 2023-12-19T13:53:35.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.962+0000 7f4766ffd640 1 -- 172.21.15.113:0/1853007698 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c0315a0 con 0x7f47680b02b0 2023-12-19T13:53:35.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.962+0000 7f4766ffd640 1 -- 172.21.15.113:0/1853007698 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c031930 con 0x7f47680b02b0 2023-12-19T13:53:35.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.962+0000 7f476e669640 1 -- 172.21.15.113:0/1853007698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 msgr2=0x7f47680b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:35.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.962+0000 7f476e669640 1 --2- 172.21.15.113:0/1853007698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f47680b0740 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f47680cbaa0 tx=0x7f475c02b840 comp rx=0 tx=0).stop 2023-12-19T13:53:35.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.963+0000 7f476e669640 1 -- 172.21.15.113:0/1853007698 shutdown_connections 2023-12-19T13:53:35.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.963+0000 7f476e669640 1 --2- 172.21.15.113:0/1853007698 >> v2:172.21.15.151:3300/0 conn(0x7f47680ce420 0x7f47680ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.963+0000 7f476e669640 1 --2- 172.21.15.113:0/1853007698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f47680b0740 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.963+0000 7f476e669640 1 -- 172.21.15.113:0/1853007698 >> 172.21.15.113:0/1853007698 conn(0x7f4768066160 msgr2=0x7f47680cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:35.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.963+0000 7f476e669640 1 -- 172.21.15.113:0/1853007698 shutdown_connections 2023-12-19T13:53:35.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.963+0000 7f476e669640 1 -- 172.21.15.113:0/1853007698 wait complete. 2023-12-19T13:53:35.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.964+0000 7f476e669640 1 Processor -- start 2023-12-19T13:53:35.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.965+0000 7f476e669640 1 -- start start 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.965+0000 7f476e669640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f476815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.965+0000 7f476e669640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47680ce420 0x7f476815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.965+0000 7f476e669640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476815a190 0x7f4768149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.965+0000 7f476e669640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476815c560 con 0x7f47680b02b0 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.965+0000 7f476e669640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476814a010 con 0x7f476815a190 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.965+0000 7f476e669640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680a89a0 con 0x7f47680ce420 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f476815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f476815c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56784/0 (socket says 172.21.15.113:56784) 2023-12-19T13:53:35.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 -- 172.21.15.113:0/736773724 learned_addr learned my addr 172.21.15.113:0/736773724 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f47677fe640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47680ce420 0x7f476815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f476cc06640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476815a190 0x7f4768149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 -- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47680ce420 msgr2=0x7f476815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47680ce420 0x7f476815d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 -- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476815a190 msgr2=0x7f4768149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476815a190 0x7f4768149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.966+0000 7f4767fff640 1 -- 172.21.15.113:0/736773724 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c009400 con 0x7f47680b02b0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.967+0000 7f4767fff640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f476815c980 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f475800c500 tx=0x7f475800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.967+0000 7f4764ff9640 1 -- 172.21.15.113:0/736773724 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758005ce0 con 0x7f47680b02b0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.967+0000 7f4764ff9640 1 -- 172.21.15.113:0/736773724 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4758005e40 con 0x7f47680b02b0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.967+0000 7f4764ff9640 1 -- 172.21.15.113:0/736773724 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758007330 con 0x7f47680b02b0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.967+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476806fa50 con 0x7f47680b02b0 2023-12-19T13:53:35.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.967+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4768070010 con 0x7f47680b02b0 2023-12-19T13:53:35.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.968+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4768061910 con 0x7f47680b02b0 2023-12-19T13:53:35.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.969+0000 7f4764ff9640 1 -- 172.21.15.113:0/736773724 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4758007550 con 0x7f47680b02b0 2023-12-19T13:53:35.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.970+0000 7f4764ff9640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f475406a430 0x7f475406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:35.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.970+0000 7f4764ff9640 1 -- 172.21.15.113:0/736773724 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4758087c70 con 0x7f47680b02b0 2023-12-19T13:53:35.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.970+0000 7f47677fe640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f475406a430 0x7f475406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:35.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.971+0000 7f47677fe640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f475406a430 0x7f475406c8f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f475c036000 tx=0x7f475c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:35.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:35.975+0000 7f4764ff9640 1 -- 172.21.15.113:0/736773724 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f47580536b0 con 0x7f47680b02b0 2023-12-19T13:53:36.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.163+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f47680b37a0 con 0x7f47680b02b0 2023-12-19T13:53:36.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.171+0000 7f4764ff9640 1 -- 172.21.15.113:0/736773724 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4758056cd0 con 0x7f47680b02b0 2023-12-19T13:53:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.173+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f475406a430 msgr2=0x7f475406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.173+0000 7f476e669640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f475406a430 0x7f475406c8f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f475c036000 tx=0x7f475c03d040 comp rx=0 tx=0).stop 2023-12-19T13:53:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.173+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 msgr2=0x7f476815c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.173+0000 7f476e669640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f476815c980 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f475800c500 tx=0x7f475800c9c0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 shutdown_connections 2023-12-19T13:53:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f475406a430 0x7f475406c8f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476815a190 0x7f4768149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47680ce420 0x7f476815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 --2- 172.21.15.113:0/736773724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47680b02b0 0x7f476815c980 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 >> 172.21.15.113:0/736773724 conn(0x7f4768066160 msgr2=0x7f4768156800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 shutdown_connections 2023-12-19T13:53:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.174+0000 7f476e669640 1 -- 172.21.15.113:0/736773724 wait complete. 2023-12-19T13:53:36.192 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-19T13:53:36.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.394+0000 7fe3163ab640 1 Processor -- start 2023-12-19T13:53:36.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.394+0000 7fe3163ab640 1 -- start start 2023-12-19T13:53:36.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe3163ab640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe310161020 0x7fe31015da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe3163ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe310143230 0x7fe310143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe3163ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe3100b63c0 0x7fe3100b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe3163ab640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31015df70 con 0x7fe310161020 2023-12-19T13:53:36.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe3163ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31015e1a0 con 0x7fe3100b63c0 2023-12-19T13:53:36.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe3163ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31015e480 con 0x7fe310143230 2023-12-19T13:53:36.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe30ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe310161020 0x7fe31015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe30ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe310161020 0x7fe31015da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56788/0 (socket says 172.21.15.113:56788) 2023-12-19T13:53:36.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.396+0000 7fe30ffff640 1 -- 172.21.15.113:0/199476192 learned_addr learned my addr 172.21.15.113:0/199476192 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.397+0000 7fe314948640 1 --2- 172.21.15.113:0/199476192 >> v2:172.21.15.151:3300/0 conn(0x7fe3100b63c0 0x7fe3100b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.397+0000 7fe30f7fe640 1 --2- 172.21.15.113:0/199476192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe310143230 0x7fe310143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.397+0000 7fe30ffff640 1 -- 172.21.15.113:0/199476192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe310143230 msgr2=0x7fe310143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.397+0000 7fe30ffff640 1 --2- 172.21.15.113:0/199476192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe310143230 0x7fe310143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.397+0000 7fe30ffff640 1 -- 172.21.15.113:0/199476192 >> v2:172.21.15.151:3300/0 conn(0x7fe3100b63c0 msgr2=0x7fe3100b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.397+0000 7fe30ffff640 1 --2- 172.21.15.113:0/199476192 >> v2:172.21.15.151:3300/0 conn(0x7fe3100b63c0 0x7fe3100b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.397+0000 7fe30ffff640 1 -- 172.21.15.113:0/199476192 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31015e760 con 0x7fe310161020 2023-12-19T13:53:36.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.398+0000 7fe30ffff640 1 --2- 172.21.15.113:0/199476192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310161020 0x7fe31015da30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe3100d0ed0 tx=0x7fe30002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a629147f10c80a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:36.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.399+0000 7fe30effd640 1 -- 172.21.15.113:0/199476192 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30002ca70 con 0x7fe310161020 2023-12-19T13:53:36.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.399+0000 7fe30effd640 1 -- 172.21.15.113:0/199476192 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30002cbd0 con 0x7fe310161020 2023-12-19T13:53:36.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.399+0000 7fe30effd640 1 -- 172.21.15.113:0/199476192 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000343f0 con 0x7fe310161020 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.399+0000 7fe3163ab640 1 -- 172.21.15.113:0/199476192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310161020 msgr2=0x7fe31015da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.399+0000 7fe3163ab640 1 --2- 172.21.15.113:0/199476192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310161020 0x7fe31015da30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe3100d0ed0 tx=0x7fe30002bed0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.400+0000 7fe3163ab640 1 -- 172.21.15.113:0/199476192 shutdown_connections 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.400+0000 7fe3163ab640 1 --2- 172.21.15.113:0/199476192 >> v2:172.21.15.151:3300/0 conn(0x7fe3100b63c0 0x7fe3100b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.400+0000 7fe3163ab640 1 --2- 172.21.15.113:0/199476192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe310143230 0x7fe310143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.400+0000 7fe3163ab640 1 --2- 172.21.15.113:0/199476192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310161020 0x7fe31015da30 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.400+0000 7fe3163ab640 1 -- 172.21.15.113:0/199476192 >> 172.21.15.113:0/199476192 conn(0x7fe3100b26f0 msgr2=0x7fe3100b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.400+0000 7fe3163ab640 1 -- 172.21.15.113:0/199476192 shutdown_connections 2023-12-19T13:53:36.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.400+0000 7fe3163ab640 1 -- 172.21.15.113:0/199476192 wait complete. 2023-12-19T13:53:36.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.401+0000 7fe3163ab640 1 Processor -- start 2023-12-19T13:53:36.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.401+0000 7fe3163ab640 1 -- start start 2023-12-19T13:53:36.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.402+0000 7fe3163ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3100b63c0 0x7fe31012dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.402+0000 7fe3163ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310143230 0x7fe310141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.402+0000 7fe3163ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe310161020 0x7fe3101417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.402+0000 7fe3163ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31012e250 con 0x7fe310143230 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.402+0000 7fe3163ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3101f5df0 con 0x7fe310161020 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.402+0000 7fe3163ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3101f35c0 con 0x7fe3100b63c0 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310143230 0x7fe310141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310143230 0x7fe310141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56794/0 (socket says 172.21.15.113:56794) 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 -- 172.21.15.113:0/3228804211 learned_addr learned my addr 172.21.15.113:0/3228804211 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe314948640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe310161020 0x7fe3101417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30ffff640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3100b63c0 0x7fe31012dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 -- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3100b63c0 msgr2=0x7fe31012dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3100b63c0 0x7fe31012dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 -- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe310161020 msgr2=0x7fe3101417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe310161020 0x7fe3101417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 -- 172.21.15.113:0/3228804211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300009b30 con 0x7fe310143230 2023-12-19T13:53:36.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.403+0000 7fe30f7fe640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310143230 0x7fe310141260 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d800 tx=0x7fe2f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:36.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.404+0000 7fe30cff9640 1 -- 172.21.15.113:0/3228804211 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800b6c0 con 0x7fe310143230 2023-12-19T13:53:36.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.404+0000 7fe30cff9640 1 -- 172.21.15.113:0/3228804211 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f800b820 con 0x7fe310143230 2023-12-19T13:53:36.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.404+0000 7fe30cff9640 1 -- 172.21.15.113:0/3228804211 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800bbb0 con 0x7fe310143230 2023-12-19T13:53:36.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.404+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3101f6040 con 0x7fe310143230 2023-12-19T13:53:36.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.404+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3101f6600 con 0x7fe310143230 2023-12-19T13:53:36.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.405+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3101f67c0 con 0x7fe310143230 2023-12-19T13:53:36.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.406+0000 7fe30cff9640 1 -- 172.21.15.113:0/3228804211 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2f800bd10 con 0x7fe310143230 2023-12-19T13:53:36.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.407+0000 7fe30cff9640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2f006a430 0x7fe2f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.407+0000 7fe30cff9640 1 -- 172.21.15.113:0/3228804211 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2f8088b70 con 0x7fe310143230 2023-12-19T13:53:36.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.407+0000 7fe30ffff640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2f006a430 0x7fe2f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.408+0000 7fe30ffff640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2f006a430 0x7fe2f006c8f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe300035000 tx=0x7fe300030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:36.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.411+0000 7fe30cff9640 1 -- 172.21.15.113:0/3228804211 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe2f8054450 con 0x7fe310143230 2023-12-19T13:53:36.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.670+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fe310061910 con 0x7fe310143230 2023-12-19T13:53:36.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.737+0000 7fe30cff9640 1 -- 172.21.15.113:0/3228804211 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v362) v1 ==== 137+0+0 (secure 0 0 0) 0x7fe2f8057a70 con 0x7fe310143230 2023-12-19T13:53:36.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2f006a430 msgr2=0x7fe2f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2f006a430 0x7fe2f006c8f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe300035000 tx=0x7fe300030000 comp rx=0 tx=0).stop 2023-12-19T13:53:36.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310143230 msgr2=0x7fe310141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310143230 0x7fe310141260 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d800 tx=0x7fe2f800dcc0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 shutdown_connections 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe2f006a430 0x7fe2f006c8f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe310161020 0x7fe3101417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe310143230 0x7fe310141260 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 --2- 172.21.15.113:0/3228804211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3100b63c0 0x7fe31012dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 >> 172.21.15.113:0/3228804211 conn(0x7fe3100b26f0 msgr2=0x7fe310070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 shutdown_connections 2023-12-19T13:53:36.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.740+0000 7fe3163ab640 1 -- 172.21.15.113:0/3228804211 wait complete. 2023-12-19T13:53:36.756 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-19T13:53:36.757 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-19T13:53:36.757 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T13:53:36.757 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.952+0000 7fa2cfa5f640 1 Processor -- start 2023-12-19T13:53:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.952+0000 7fa2cfa5f640 1 -- start start 2023-12-19T13:53:36.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.954+0000 7fa2cfa5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa2c8161900 0x7fa2c8168580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.954+0000 7fa2cfa5f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c80d1070 con 0x7fa2c8147180 2023-12-19T13:53:36.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.954+0000 7fa2cfa5f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c8162020 con 0x7fa2c8146da0 2023-12-19T13:53:36.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.954+0000 7fa2cfa5f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c80aabd0 con 0x7fa2c8161900 2023-12-19T13:53:36.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.954+0000 7fa2ccffa640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa2c8147180 0x7fa2c81611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59104/0 (socket says 172.21.15.113:59104) 2023-12-19T13:53:36.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.954+0000 7fa2ccffa640 1 -- 172.21.15.113:0/722617146 learned_addr learned my addr 172.21.15.113:0/722617146 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:36.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.954+0000 7fa2cdffc640 1 --2- 172.21.15.113:0/722617146 >> v2:172.21.15.113:3300/0 conn(0x7fa2c8161900 0x7fa2c8168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.955+0000 7fa2cdffc640 1 -- 172.21.15.113:0/722617146 >> v1:172.21.15.151:6789/0 conn(0x7fa2c8146da0 legacy=0x7fa2c80aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.955+0000 7fa2c7fff640 1 -- 172.21.15.113:0/722617146 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588450816 0 0) 0x7fa2c80d1070 con 0x7fa2c8147180 2023-12-19T13:53:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.955+0000 7fa2cdffc640 1 -- 172.21.15.113:0/722617146 >> v1:172.21.15.113:6789/0 conn(0x7fa2c8147180 legacy=0x7fa2c81611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.955+0000 7fa2cdffc640 1 -- 172.21.15.113:0/722617146 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c80aaeb0 con 0x7fa2c8161900 2023-12-19T13:53:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.956+0000 7fa2cdffc640 1 --2- 172.21.15.113:0/722617146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c8161900 0x7fa2c8168580 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00097a0 tx=0x7fa2c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28684e490e39bcb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.956+0000 7fa2c7fff640 1 -- 172.21.15.113:0/722617146 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0031830 con 0x7fa2c8161900 2023-12-19T13:53:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.956+0000 7fa2c7fff640 1 -- 172.21.15.113:0/722617146 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c0031990 con 0x7fa2c8161900 2023-12-19T13:53:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.956+0000 7fa2c7fff640 1 -- 172.21.15.113:0/722617146 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0031d20 con 0x7fa2c8161900 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.957+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/722617146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c8161900 msgr2=0x7fa2c8168580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.957+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/722617146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c8161900 0x7fa2c8168580 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00097a0 tx=0x7fa2c002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.957+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/722617146 shutdown_connections 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.957+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/722617146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c8161900 0x7fa2c8168580 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.957+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/722617146 >> 172.21.15.113:0/722617146 conn(0x7fa2c8071a50 msgr2=0x7fa2c80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.957+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/722617146 shutdown_connections 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.957+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/722617146 wait complete. 2023-12-19T13:53:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.958+0000 7fa2cfa5f640 1 Processor -- start 2023-12-19T13:53:36.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.959+0000 7fa2cfa5f640 1 -- start start 2023-12-19T13:53:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.959+0000 7fa2cfa5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2c8146da0 0x7fa2c80b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.959+0000 7fa2cfa5f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2c8161900 0x7fa2c815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.959+0000 7fa2cfa5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c81597f0 0x7fa2c8158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.959+0000 7fa2cfa5f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81436c0 con 0x7fa2c81597f0 2023-12-19T13:53:36.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.959+0000 7fa2cfa5f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81570e0 con 0x7fa2c8161900 2023-12-19T13:53:36.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.959+0000 7fa2cfa5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81573c0 con 0x7fa2c8146da0 2023-12-19T13:53:36.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c81597f0 0x7fa2c8158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c81597f0 0x7fa2c8158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56800/0 (socket says 172.21.15.113:56800) 2023-12-19T13:53:36.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 -- 172.21.15.113:0/1393628321 learned_addr learned my addr 172.21.15.113:0/1393628321 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:36.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cd7fb640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2c8146da0 0x7fa2c80b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2ccffa640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2c8161900 0x7fa2c815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 -- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2c8146da0 msgr2=0x7fa2c80b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2c8146da0 0x7fa2c80b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 -- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2c8161900 msgr2=0x7fa2c815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:36.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2c8161900 0x7fa2c815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:36.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2cdffc640 1 -- 172.21.15.113:0/1393628321 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0009400 con 0x7fa2c81597f0 2023-12-19T13:53:36.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.960+0000 7fa2ccffa640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2c8161900 0x7fa2c815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:36.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.961+0000 7fa2cdffc640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c81597f0 0x7fa2c8158180 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00097a0 tx=0x7fa2c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:36.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.961+0000 7fa2c5ffb640 1 -- 172.21.15.113:0/1393628321 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c003b9f0 con 0x7fa2c81597f0 2023-12-19T13:53:36.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.961+0000 7fa2c5ffb640 1 -- 172.21.15.113:0/1393628321 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c003bb50 con 0x7fa2c81597f0 2023-12-19T13:53:36.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.961+0000 7fa2c5ffb640 1 -- 172.21.15.113:0/1393628321 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00453f0 con 0x7fa2c81597f0 2023-12-19T13:53:36.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.961+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c81576a0 con 0x7fa2c81597f0 2023-12-19T13:53:36.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.961+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c8157c60 con 0x7fa2c81597f0 2023-12-19T13:53:36.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.962+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c8073ec0 con 0x7fa2c81597f0 2023-12-19T13:53:36.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.963+0000 7fa2c5ffb640 1 -- 172.21.15.113:0/1393628321 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2c004e450 con 0x7fa2c81597f0 2023-12-19T13:53:36.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.964+0000 7fa2c5ffb640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa2b406a460 0x7fa2b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:36.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.964+0000 7fa2c5ffb640 1 -- 172.21.15.113:0/1393628321 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa2c00aa870 con 0x7fa2c81597f0 2023-12-19T13:53:36.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.964+0000 7fa2cd7fb640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa2b406a460 0x7fa2b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:36.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.965+0000 7fa2cd7fb640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa2b406a460 0x7fa2b406c920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8005520 tx=0x7fa2b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:36.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:36.968+0000 7fa2c5ffb640 1 -- 172.21.15.113:0/1393628321 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa2c0076150 con 0x7fa2c81597f0 2023-12-19T13:53:37.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.157+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2c8061910 con 0x7fa2c81597f0 2023-12-19T13:53:37.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.113:0/1393628321 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+12577 (secure 0 0 0) 0x7fa2c0079770 con 0x7fa2c81597f0 2023-12-19T13:53:37.159 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:37.159 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":123,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:35.713659+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:6837/835415073":"2023-12-20T13:53:32.207451+0000","172.21.15.113:6835/835415073":"2023-12-20T13:53:32.207451+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa2b406a460 msgr2=0x7fa2b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa2b406a460 0x7fa2b406c920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8005520 tx=0x7fa2b8009040 comp rx=0 tx=0).stop 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c81597f0 msgr2=0x7fa2c8158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c81597f0 0x7fa2c8158180 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00097a0 tx=0x7fa2c00046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 shutdown_connections 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa2b406a460 0x7fa2b406c920 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c81597f0 0x7fa2c8158180 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2c8161900 0x7fa2c815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 --2- 172.21.15.113:0/1393628321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2c8146da0 0x7fa2c80b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 >> 172.21.15.113:0/1393628321 conn(0x7fa2c8071a50 msgr2=0x7fa2c8144140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 shutdown_connections 2023-12-19T13:53:37.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.162+0000 7fa2cfa5f640 1 -- 172.21.15.113:0/1393628321 wait complete. 2023-12-19T13:53:37.181 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:53:37.182 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:53:37.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.395+0000 7f78b5477640 1 Processor -- start 2023-12-19T13:53:37.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.395+0000 7f78b5477640 1 -- start start 2023-12-19T13:53:37.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.397+0000 7f78b5477640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f78b0161700 0x7f78b00cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.397+0000 7f78b5477640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00cc530 con 0x7f78b00ce230 2023-12-19T13:53:37.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.397+0000 7f78b5477640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00cb920 con 0x7f78b00b1830 2023-12-19T13:53:37.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.397+0000 7f78b5477640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b0166300 con 0x7f78b0161700 2023-12-19T13:53:37.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.397+0000 7f78af7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f78b00ce230 0x7f78b00ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59114/0 (socket says 172.21.15.113:59114) 2023-12-19T13:53:37.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.397+0000 7f78af7fe640 1 -- 172.21.15.113:0/1702390192 learned_addr learned my addr 172.21.15.113:0/1702390192 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:37.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78aeffd640 1 --2- 172.21.15.113:0/1702390192 >> v2:172.21.15.151:3300/0 conn(0x7f78b0161700 0x7f78b00cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772628374 0 0) 0x7f78b00cc530 con 0x7f78b00ce230 2023-12-19T13:53:37.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f789c003520 con 0x7f78b00ce230 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2410334926 0 0) 0x7f789c003520 con 0x7f78b00ce230 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 >> v2:172.21.15.151:3300/0 conn(0x7f78b0161700 msgr2=0x7f78b00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 --2- 172.21.15.113:0/1702390192 >> v2:172.21.15.151:3300/0 conn(0x7f78b0161700 0x7f78b00cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 >> v1:172.21.15.151:6789/0 conn(0x7f78b00b1830 legacy=0x7f78b00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00cbc00 con 0x7f78b00ce230 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f78a80019f0 con 0x7f78b00ce230 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 >> v1:172.21.15.113:6789/0 conn(0x7f78b00ce230 legacy=0x7f78b00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.398+0000 7f78ae7fc640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f789c003a30 0x7f789c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78ae7fc640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f789c0047c0 0x7f789c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78ae7fc640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c0051d0 0x7f789c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c00c0d0 con 0x7f789c003a30 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c00c240 con 0x7f789c0051d0 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c00c400 con 0x7f789c0047c0 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78aeffd640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f789c003a30 0x7f789c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78aeffd640 1 -- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f789c0047c0 msgr2=0x7f789c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78aeffd640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f789c0047c0 0x7f789c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78aeffd640 1 -- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c0051d0 msgr2=0x7f789c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78af7fe640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c0051d0 0x7f789c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78aeffd640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c0051d0 0x7f789c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78aeffd640 1 -- 172.21.15.113:0/1702390192 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c003520 con 0x7f789c003a30 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78af7fe640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c0051d0 0x7f789c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:37.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.399+0000 7f78af7fe640 1 -- 172.21.15.113:0/1702390192 reap_dead start 2023-12-19T13:53:37.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.400+0000 7f78aeffd640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f789c003a30 0x7f789c003e50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009ac0 tx=0x7f789c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b824fcac2a3c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:37.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a002c6b0 con 0x7f789c003a30 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a002c810 con 0x7f789c003a30 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78ae7fc640 1 -- 172.21.15.113:0/1702390192 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a002cba0 con 0x7f789c003a30 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78b5477640 1 -- 172.21.15.113:0/1702390192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f789c003a30 msgr2=0x7f789c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78b5477640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f789c003a30 0x7f789c003e50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009ac0 tx=0x7f789c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78b5477640 1 -- 172.21.15.113:0/1702390192 shutdown_connections 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78b5477640 1 --2- 172.21.15.113:0/1702390192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f789c003a30 0x7f789c003e50 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78b5477640 1 -- 172.21.15.113:0/1702390192 >> 172.21.15.113:0/1702390192 conn(0x7f78b0073150 msgr2=0x7f78b00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78b5477640 1 -- 172.21.15.113:0/1702390192 shutdown_connections 2023-12-19T13:53:37.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.401+0000 7f78b5477640 1 -- 172.21.15.113:0/1702390192 wait complete. 2023-12-19T13:53:37.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.403+0000 7f78b5477640 1 Processor -- start 2023-12-19T13:53:37.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.403+0000 7f78b5477640 1 -- start start 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.404+0000 7f78b5477640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c003a30 0x7f78b006c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.404+0000 7f78b5477640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b0144610 0x7f78b0143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.404+0000 7f78b5477640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78b0143e50 0x7f78b00b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.404+0000 7f78b5477640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b006dd90 con 0x7f78b0143e50 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.404+0000 7f78b5477640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b01442d0 con 0x7f789c003a30 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.404+0000 7f78b5477640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b006ccf0 con 0x7f78b0144610 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78b0143e50 0x7f78b00b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78b0143e50 0x7f78b00b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56812/0 (socket says 172.21.15.113:56812) 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 -- 172.21.15.113:0/3994409095 learned_addr learned my addr 172.21.15.113:0/3994409095 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78aeffd640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c003a30 0x7f78b006c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78a7fff640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b0144610 0x7f78b0143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 -- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b0144610 msgr2=0x7f78b0143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b0144610 0x7f78b0143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 -- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c003a30 msgr2=0x7f78b006c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c003a30 0x7f78b006c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 -- 172.21.15.113:0/3994409095 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b006cfd0 con 0x7f78b0143e50 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.405+0000 7f78af7fe640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78b0143e50 0x7f78b00b0560 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f78b00b11b0 tx=0x7f78a800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.406+0000 7f78a77fe640 1 -- 172.21.15.113:0/3994409095 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800b860 con 0x7f78b0143e50 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.406+0000 7f78a77fe640 1 -- 172.21.15.113:0/3994409095 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800b9e0 con 0x7f78b0143e50 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.406+0000 7f78a77fe640 1 -- 172.21.15.113:0/3994409095 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800bd90 con 0x7f78b0143e50 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.406+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b006d2b0 con 0x7f78b0143e50 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.406+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b006d870 con 0x7f78b0143e50 2023-12-19T13:53:37.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.407+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b0061910 con 0x7f78b0143e50 2023-12-19T13:53:37.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.408+0000 7f78a77fe640 1 -- 172.21.15.113:0/3994409095 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f78a8007070 con 0x7f78b0143e50 2023-12-19T13:53:37.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.409+0000 7f78a77fe640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f789006a430 0x7f789006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.410+0000 7f78a77fe640 1 -- 172.21.15.113:0/3994409095 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f78a8088990 con 0x7f78b0143e50 2023-12-19T13:53:37.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.410+0000 7f78aeffd640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f789006a430 0x7f789006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.410+0000 7f78aeffd640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f789006a430 0x7f789006c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78a0036000 tx=0x7f78a0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:37.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.414+0000 7f78a77fe640 1 -- 172.21.15.113:0/3994409095 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f78a80541e0 con 0x7f78b0143e50 2023-12-19T13:53:37.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.602+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78b00b1610 con 0x7f78b0143e50 2023-12-19T13:53:37.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.603+0000 7f78a77fe640 1 -- 172.21.15.113:0/3994409095 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78a8057800 con 0x7f78b0143e50 2023-12-19T13:53:37.603 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:53:37.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f789006a430 msgr2=0x7f789006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f789006a430 0x7f789006c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78a0036000 tx=0x7f78a0030000 comp rx=0 tx=0).stop 2023-12-19T13:53:37.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78b0143e50 msgr2=0x7f78b00b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78b0143e50 0x7f78b00b0560 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f78b00b11b0 tx=0x7f78a800df70 comp rx=0 tx=0).stop 2023-12-19T13:53:37.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 shutdown_connections 2023-12-19T13:53:37.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f789006a430 0x7f789006c8f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78b0143e50 0x7f78b00b0560 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b0144610 0x7f78b0143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 --2- 172.21.15.113:0/3994409095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f789c003a30 0x7f78b006c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.605+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 >> 172.21.15.113:0/3994409095 conn(0x7f78b0073150 msgr2=0x7f78b015c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:37.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.606+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 shutdown_connections 2023-12-19T13:53:37.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.606+0000 7f78b5477640 1 -- 172.21.15.113:0/3994409095 wait complete. 2023-12-19T13:53:37.625 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-19T13:53:37.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.826+0000 7f5cf359e640 1 Processor -- start 2023-12-19T13:53:37.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.826+0000 7f5cf359e640 1 -- start start 2023-12-19T13:53:37.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.827+0000 7f5cf359e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5cf4146e30 0x7f5cf40b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.827+0000 7f5cf359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40b7ea0 0x7f5cf40d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.827+0000 7f5cf359e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf40b8300 con 0x7f5cf40d0a90 2023-12-19T13:53:37.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.827+0000 7f5cf359e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf4147210 con 0x7f5cf4146e30 2023-12-19T13:53:37.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.827+0000 7f5cf359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf40d2370 con 0x7f5cf40b7ea0 2023-12-19T13:53:37.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.828+0000 7f5cf1d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40b7ea0 0x7f5cf40d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.828+0000 7f5cf259c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5cf4146e30 0x7f5cf40b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.828+0000 7f5cf1d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40b7ea0 0x7f5cf40d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:58066/0 (socket says 172.21.15.113:58066) 2023-12-19T13:53:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.828+0000 7f5cf1d9b640 1 -- 172.21.15.113:0/1962726183 learned_addr learned my addr 172.21.15.113:0/1962726183 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.829+0000 7f5cf1d9b640 1 -- 172.21.15.113:0/1962726183 >> v2:172.21.15.151:3300/0 conn(0x7f5cf4146e30 msgr2=0x7f5cf40b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.829+0000 7f5cf1d9b640 1 --2- 172.21.15.113:0/1962726183 >> v2:172.21.15.151:3300/0 conn(0x7f5cf4146e30 0x7f5cf40b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.829+0000 7f5cf1d9b640 1 -- 172.21.15.113:0/1962726183 >> v1:172.21.15.151:6789/0 conn(0x7f5cf40d0a90 legacy=0x7f5cf406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.829+0000 7f5cf1d9b640 1 -- 172.21.15.113:0/1962726183 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf40d12d0 con 0x7f5cf40b7ea0 2023-12-19T13:53:37.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.830+0000 7f5cf1d9b640 1 --2- 172.21.15.113:0/1962726183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40b7ea0 0x7f5cf40d0550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009870 tx=0x7f5cdc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b7ec81633462c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf159a640 1 -- 172.21.15.113:0/1962726183 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc031640 con 0x7f5cf40b7ea0 2023-12-19T13:53:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf159a640 1 -- 172.21.15.113:0/1962726183 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0317a0 con 0x7f5cf40b7ea0 2023-12-19T13:53:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf159a640 1 -- 172.21.15.113:0/1962726183 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc031b30 con 0x7f5cf40b7ea0 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf359e640 1 -- 172.21.15.113:0/1962726183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40b7ea0 msgr2=0x7f5cf40d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf359e640 1 --2- 172.21.15.113:0/1962726183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40b7ea0 0x7f5cf40d0550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009870 tx=0x7f5cdc02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf359e640 1 -- 172.21.15.113:0/1962726183 shutdown_connections 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf359e640 1 --2- 172.21.15.113:0/1962726183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40b7ea0 0x7f5cf40d0550 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.831+0000 7f5cf359e640 1 --2- 172.21.15.113:0/1962726183 >> v2:172.21.15.151:3300/0 conn(0x7f5cf4146e30 0x7f5cf40b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.832+0000 7f5cf359e640 1 -- 172.21.15.113:0/1962726183 >> 172.21.15.113:0/1962726183 conn(0x7f5cf40b2990 msgr2=0x7f5cf40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.832+0000 7f5cf359e640 1 -- 172.21.15.113:0/1962726183 shutdown_connections 2023-12-19T13:53:37.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.832+0000 7f5cf359e640 1 -- 172.21.15.113:0/1962726183 wait complete. 2023-12-19T13:53:37.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.834+0000 7f5cf359e640 1 Processor -- start 2023-12-19T13:53:37.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.834+0000 7f5cf359e640 1 -- start start 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.835+0000 7f5cf359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf40b7ea0 0x7f5cf4141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.835+0000 7f5cf359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40d0a90 0x7f5cf41f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.835+0000 7f5cf359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cf4146e30 0x7f5cf41e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.835+0000 7f5cf359e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf413f090 con 0x7f5cf4146e30 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.835+0000 7f5cf359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf41f6a70 con 0x7f5cf40b7ea0 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.835+0000 7f5cf359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf41df320 con 0x7f5cf40d0a90 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.835+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cf4146e30 0x7f5cf41e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cf4146e30 0x7f5cf41e2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56822/0 (socket says 172.21.15.113:56822) 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 -- 172.21.15.113:0/2808625653 learned_addr learned my addr 172.21.15.113:0/2808625653 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:37.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf1d9b640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40d0a90 0x7f5cf41f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf259c640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf40b7ea0 0x7f5cf4141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 -- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40d0a90 msgr2=0x7f5cf41f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40d0a90 0x7f5cf41f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 -- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf40b7ea0 msgr2=0x7f5cf4141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf40b7ea0 0x7f5cf4141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 -- 172.21.15.113:0/2808625653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0094d0 con 0x7f5cf4146e30 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf1d9b640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40d0a90 0x7f5cf41f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.836+0000 7f5cf2d9d640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cf4146e30 0x7f5cf41e2a30 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c400 tx=0x7f5cec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.837+0000 7f5ceaffd640 1 -- 172.21.15.113:0/2808625653 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0052d0 con 0x7f5cf4146e30 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.837+0000 7f5ceaffd640 1 -- 172.21.15.113:0/2808625653 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec005430 con 0x7f5cf4146e30 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.837+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf413ead0 con 0x7f5cf4146e30 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.837+0000 7f5ceaffd640 1 -- 172.21.15.113:0/2808625653 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec003810 con 0x7f5cf4146e30 2023-12-19T13:53:37.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.837+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf41f6690 con 0x7f5cf4146e30 2023-12-19T13:53:37.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.838+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf41f64f0 con 0x7f5cf4146e30 2023-12-19T13:53:37.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.839+0000 7f5ceaffd640 1 -- 172.21.15.113:0/2808625653 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5cec003970 con 0x7f5cf4146e30 2023-12-19T13:53:37.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.840+0000 7f5ceaffd640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd406a430 0x7f5cd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:37.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.840+0000 7f5ceaffd640 1 -- 172.21.15.113:0/2808625653 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5cec087bf0 con 0x7f5cf4146e30 2023-12-19T13:53:37.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.840+0000 7f5cf259c640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd406a430 0x7f5cd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:37.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.841+0000 7f5cf259c640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd406a430 0x7f5cd406c8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40074a0 tx=0x7f5ce400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:37.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:37.846+0000 7f5ceaffd640 1 -- 172.21.15.113:0/2808625653 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5cf41f64f0 con 0x7f5cf4146e30 2023-12-19T13:53:38.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.107+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f5cf41f64f0 con 0x7f5cf4146e30 2023-12-19T13:53:38.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.749+0000 7f5ceaffd640 1 -- 172.21.15.113:0/2808625653 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v364) v1 ==== 131+0+0 (secure 0 0 0) 0x7f5cf41f64f0 con 0x7f5cf4146e30 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd406a430 msgr2=0x7f5cd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd406a430 0x7f5cd406c8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40074a0 tx=0x7f5ce400b040 comp rx=0 tx=0).stop 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cf4146e30 msgr2=0x7f5cf41e2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cf4146e30 0x7f5cf41e2a30 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c400 tx=0x7f5cec00c8c0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 shutdown_connections 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5cd406a430 0x7f5cd406c8f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cf4146e30 0x7f5cf41e2a30 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cf40d0a90 0x7f5cf41f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 --2- 172.21.15.113:0/2808625653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf40b7ea0 0x7f5cf4141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.753+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 >> 172.21.15.113:0/2808625653 conn(0x7f5cf40b2990 msgr2=0x7f5cf41e8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:38.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.754+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 shutdown_connections 2023-12-19T13:53:38.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.754+0000 7f5cf359e640 1 -- 172.21.15.113:0/2808625653 wait complete. 2023-12-19T13:53:38.775 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:53:38.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.987+0000 7f92ef4ab640 1 Processor -- start 2023-12-19T13:53:38.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.988+0000 7f92ef4ab640 1 -- start start 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.989+0000 7f92ef4ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f92e815b1d0 0x7f92e80b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.989+0000 7f92ef4ab640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f92e80ceea0 0x7f92e80cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.989+0000 7f92ef4ab640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e815fde0 con 0x7f92e80b1ec0 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.989+0000 7f92ef4ab640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e80cf870 con 0x7f92e80ceea0 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.989+0000 7f92ef4ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e815ef10 con 0x7f92e815b1d0 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92eca46640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f92e80b1ec0 0x7f92e815f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51240/0 (socket says 172.21.15.113:51240) 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92eca46640 1 -- 172.21.15.113:0/2559903311 learned_addr learned my addr 172.21.15.113:0/2559903311 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92eda48640 1 --2- 172.21.15.113:0/2559903311 >> v2:172.21.15.113:3300/0 conn(0x7f92e80ceea0 0x7f92e80cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92ed247640 1 --2- 172.21.15.113:0/2559903311 >> v2:172.21.15.151:3300/0 conn(0x7f92e815b1d0 0x7f92e80b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92eda48640 1 -- 172.21.15.113:0/2559903311 >> v2:172.21.15.151:3300/0 conn(0x7f92e815b1d0 msgr2=0x7f92e80b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:38.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92eda48640 1 --2- 172.21.15.113:0/2559903311 >> v2:172.21.15.151:3300/0 conn(0x7f92e815b1d0 0x7f92e80b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92eda48640 1 -- 172.21.15.113:0/2559903311 >> v1:172.21.15.113:6789/0 conn(0x7f92e80b1ec0 legacy=0x7f92e815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:38.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.990+0000 7f92eda48640 1 -- 172.21.15.113:0/2559903311 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e80b2320 con 0x7f92e80ceea0 2023-12-19T13:53:38.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.991+0000 7f92eda48640 1 --2- 172.21.15.113:0/2559903311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80cf330 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f92e80ae020 tx=0x7f92e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeafcff67642d35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:38.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92dffff640 1 -- 172.21.15.113:0/2559903311 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e002cc80 con 0x7f92e80ceea0 2023-12-19T13:53:38.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92dffff640 1 -- 172.21.15.113:0/2559903311 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e002cde0 con 0x7f92e80ceea0 2023-12-19T13:53:38.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92dffff640 1 -- 172.21.15.113:0/2559903311 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0034660 con 0x7f92e80ceea0 2023-12-19T13:53:38.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92ef4ab640 1 -- 172.21.15.113:0/2559903311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 msgr2=0x7f92e80cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:38.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/2559903311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80cf330 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f92e80ae020 tx=0x7f92e002bed0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92ef4ab640 1 -- 172.21.15.113:0/2559903311 shutdown_connections 2023-12-19T13:53:38.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/2559903311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80cf330 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/2559903311 >> v2:172.21.15.151:3300/0 conn(0x7f92e815b1d0 0x7f92e80b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:38.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92ef4ab640 1 -- 172.21.15.113:0/2559903311 >> 172.21.15.113:0/2559903311 conn(0x7f92e8073150 msgr2=0x7f92e80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:38.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.992+0000 7f92ef4ab640 1 -- 172.21.15.113:0/2559903311 shutdown_connections 2023-12-19T13:53:38.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.993+0000 7f92ef4ab640 1 -- 172.21.15.113:0/2559903311 wait complete. 2023-12-19T13:53:38.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.994+0000 7f92ef4ab640 1 Processor -- start 2023-12-19T13:53:38.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.994+0000 7f92ef4ab640 1 -- start start 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.995+0000 7f92ef4ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e80b1ec0 0x7f92e8154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.995+0000 7f92ef4ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.995+0000 7f92ef4ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92e815b1d0 0x7f92e8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.995+0000 7f92ef4ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80cb9b0 con 0x7f92e80ceea0 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.995+0000 7f92ef4ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8154580 con 0x7f92e80b1ec0 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.995+0000 7f92ef4ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80cbc00 con 0x7f92e815b1d0 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40630/0 (socket says 172.21.15.113:40630) 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 -- 172.21.15.113:0/3784311820 learned_addr learned my addr 172.21.15.113:0/3784311820 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92ed247640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e80b1ec0 0x7f92e8154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 -- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92e815b1d0 msgr2=0x7f92e8159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92e815b1d0 0x7f92e8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 -- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e80b1ec0 msgr2=0x7f92e8154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e80b1ec0 0x7f92e8154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 -- 172.21.15.113:0/3784311820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0009a70 con 0x7f92e80ceea0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92ed247640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e80b1ec0 0x7f92e8154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.996+0000 7f92eca46640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80c9d00 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f92d800c4a0 tx=0x7f92d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.997+0000 7f92ddffb640 1 -- 172.21.15.113:0/3784311820 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8005ce0 con 0x7f92e80ceea0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.997+0000 7f92ddffb640 1 -- 172.21.15.113:0/3784311820 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d8005e40 con 0x7f92e80ceea0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.997+0000 7f92ddffb640 1 -- 172.21.15.113:0/3784311820 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8007270 con 0x7f92e80ceea0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.997+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e80cbee0 con 0x7f92e80ceea0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.997+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e80cc4a0 con 0x7f92e80ceea0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.998+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8061910 con 0x7f92e80ceea0 2023-12-19T13:53:39.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:38.999+0000 7f92ddffb640 1 -- 172.21.15.113:0/3784311820 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f92d80073d0 con 0x7f92e80ceea0 2023-12-19T13:53:39.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.000+0000 7f92ddffb640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92cc06a460 0x7f92cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.000+0000 7f92ddffb640 1 -- 172.21.15.113:0/3784311820 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f92d8087a50 con 0x7f92e80ceea0 2023-12-19T13:53:39.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.000+0000 7f92ed247640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92cc06a460 0x7f92cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.001+0000 7f92ed247640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92cc06a460 0x7f92cc06c920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f92e4006fd0 tx=0x7f92e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:39.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.004+0000 7f92ddffb640 1 -- 172.21.15.113:0/3784311820 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f92d80533e0 con 0x7f92e80ceea0 2023-12-19T13:53:39.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.193+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f92e80cdc90 con 0x7f92e80ceea0 2023-12-19T13:53:39.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.200+0000 7f92ddffb640 1 -- 172.21.15.113:0/3784311820 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f92d80170c0 con 0x7f92e80ceea0 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92cc06a460 msgr2=0x7f92cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92cc06a460 0x7f92cc06c920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f92e4006fd0 tx=0x7f92e4008040 comp rx=0 tx=0).stop 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 msgr2=0x7f92e80c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80c9d00 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f92d800c4a0 tx=0x7f92d800c960 comp rx=0 tx=0).stop 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 shutdown_connections 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f92cc06a460 0x7f92cc06c920 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92e815b1d0 0x7f92e8159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92e80ceea0 0x7f92e80c9d00 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 --2- 172.21.15.113:0/3784311820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e80b1ec0 0x7f92e8154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 >> 172.21.15.113:0/3784311820 conn(0x7f92e8073150 msgr2=0x7f92e80b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:39.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 shutdown_connections 2023-12-19T13:53:39.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.203+0000 7f92ef4ab640 1 -- 172.21.15.113:0/3784311820 wait complete. 2023-12-19T13:53:39.222 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:53:39.222 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:53:39.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:53:39.460 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:53:39.460 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:39.460 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:39.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:53:39.521 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:53:39.521 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:39.580 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:53:39.581 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:39.581 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:39.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:53:39.643 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:53:39.643 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:39.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:53:39.705 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:53:39.705 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:39.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.926+0000 7f28f98f7640 1 Processor -- start 2023-12-19T13:53:39.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.927+0000 7f28f98f7640 1 -- start start 2023-12-19T13:53:39.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f98f7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28f40ae110 0x7f28f40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f98f7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f28f40b0640 0x7f28f406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f98f7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40b0a60 con 0x7f28f4157bf0 2023-12-19T13:53:39.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f98f7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f406b8c0 con 0x7f28f40b0640 2023-12-19T13:53:39.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f98f7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40ae640 con 0x7f28f40ae110 2023-12-19T13:53:39.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f2ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f28f4157bf0 0x7f28f415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51254/0 (socket says 172.21.15.113:51254) 2023-12-19T13:53:39.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f2ffd640 1 -- 172.21.15.113:0/3141606527 learned_addr learned my addr 172.21.15.113:0/3141606527 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:39.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f37fe640 1 --2- 172.21.15.113:0/3141606527 >> v2:172.21.15.113:3300/0 conn(0x7f28f40b0640 0x7f28f406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f27fc640 1 -- 172.21.15.113:0/3141606527 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646892191 0 0) 0x7f28f40b0a60 con 0x7f28f4157bf0 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28ea7fc640 1 --2- 172.21.15.113:0/3141606527 >> v2:172.21.15.151:3300/0 conn(0x7f28f40ae110 0x7f28f40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.929+0000 7f28f27fc640 1 -- 172.21.15.113:0/3141606527 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e0005730 con 0x7f28f4157bf0 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.930+0000 7f28f37fe640 1 -- 172.21.15.113:0/3141606527 >> v2:172.21.15.151:3300/0 conn(0x7f28f40ae110 msgr2=0x7f28f40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.930+0000 7f28f37fe640 1 --2- 172.21.15.113:0/3141606527 >> v2:172.21.15.151:3300/0 conn(0x7f28f40ae110 0x7f28f40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.930+0000 7f28f37fe640 1 -- 172.21.15.113:0/3141606527 >> v1:172.21.15.113:6789/0 conn(0x7f28f4157bf0 legacy=0x7f28f415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.930+0000 7f28f37fe640 1 -- 172.21.15.113:0/3141606527 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f40ae920 con 0x7f28f40b0640 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.930+0000 7f28ea7fc640 1 --2- 172.21.15.113:0/3141606527 >> v2:172.21.15.151:3300/0 conn(0x7f28f40ae110 0x7f28f40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:39.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.931+0000 7f28f37fe640 1 --2- 172.21.15.113:0/3141606527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f40b0640 0x7f28f406d230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f28f40af4b0 tx=0x7f28ec02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412f143f6ef960ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.931+0000 7f28f27fc640 1 -- 172.21.15.113:0/3141606527 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec02cc70 con 0x7f28f40b0640 2023-12-19T13:53:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.931+0000 7f28f27fc640 1 -- 172.21.15.113:0/3141606527 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec02cdd0 con 0x7f28f40b0640 2023-12-19T13:53:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.931+0000 7f28f27fc640 1 -- 172.21.15.113:0/3141606527 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec034660 con 0x7f28f40b0640 2023-12-19T13:53:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 -- 172.21.15.113:0/3141606527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f40b0640 msgr2=0x7f28f406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3141606527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f40b0640 0x7f28f406d230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f28f40af4b0 tx=0x7f28ec02bec0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 -- 172.21.15.113:0/3141606527 shutdown_connections 2023-12-19T13:53:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3141606527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f40b0640 0x7f28f406d230 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3141606527 >> v2:172.21.15.151:3300/0 conn(0x7f28f40ae110 0x7f28f40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 -- 172.21.15.113:0/3141606527 >> 172.21.15.113:0/3141606527 conn(0x7f28f40cbb70 msgr2=0x7f28f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:39.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 -- 172.21.15.113:0/3141606527 shutdown_connections 2023-12-19T13:53:39.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.932+0000 7f28f98f7640 1 -- 172.21.15.113:0/3141606527 wait complete. 2023-12-19T13:53:39.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.933+0000 7f28f98f7640 1 Processor -- start 2023-12-19T13:53:39.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.934+0000 7f28f98f7640 1 -- start start 2023-12-19T13:53:39.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.934+0000 7f28f98f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28f40ae110 0x7f28f41f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f98f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28f40b0640 0x7f28f415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f98f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f4157bf0 0x7f28f415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f98f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f41f5a60 con 0x7f28f4157bf0 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f98f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4157fd0 con 0x7f28f40b0640 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f98f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4158b50 con 0x7f28f40ae110 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f4157bf0 0x7f28f415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f4157bf0 0x7f28f415e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40650/0 (socket says 172.21.15.113:40650) 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 -- 172.21.15.113:0/3080180576 learned_addr learned my addr 172.21.15.113:0/3080180576 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f2ffd640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28f40ae110 0x7f28f41f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28ea7fc640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28f40b0640 0x7f28f415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 -- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28f40ae110 msgr2=0x7f28f41f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28f40ae110 0x7f28f41f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 -- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28f40b0640 msgr2=0x7f28f415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28f40b0640 0x7f28f415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28f37fe640 1 -- 172.21.15.113:0/3080180576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec009a70 con 0x7f28f4157bf0 2023-12-19T13:53:39.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.935+0000 7f28ea7fc640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28f40b0640 0x7f28f415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:39.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.936+0000 7f28f37fe640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f4157bf0 0x7f28f415e220 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f28ec02c4d0 tx=0x7f28ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:39.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.936+0000 7f28f0ff9640 1 -- 172.21.15.113:0/3080180576 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec040650 con 0x7f28f4157bf0 2023-12-19T13:53:39.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.936+0000 7f28f0ff9640 1 -- 172.21.15.113:0/3080180576 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec0407b0 con 0x7f28f4157bf0 2023-12-19T13:53:39.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.936+0000 7f28f0ff9640 1 -- 172.21.15.113:0/3080180576 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec040b60 con 0x7f28f4157bf0 2023-12-19T13:53:39.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.936+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f4158220 con 0x7f28f4157bf0 2023-12-19T13:53:39.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.936+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f41587e0 con 0x7f28f4157bf0 2023-12-19T13:53:39.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.937+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f4061910 con 0x7f28f4157bf0 2023-12-19T13:53:39.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.938+0000 7f28f0ff9640 1 -- 172.21.15.113:0/3080180576 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f28ec040cc0 con 0x7f28f4157bf0 2023-12-19T13:53:39.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.939+0000 7f28f0ff9640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f28d406a460 0x7f28d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:39.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.939+0000 7f28f0ff9640 1 -- 172.21.15.113:0/3080180576 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f28ec0ab5f0 con 0x7f28f4157bf0 2023-12-19T13:53:39.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.939+0000 7f28f2ffd640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f28d406a460 0x7f28d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:39.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.940+0000 7f28f2ffd640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f28d406a460 0x7f28d406c920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f28e40011e0 tx=0x7f28e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:39.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:39.944+0000 7f28f0ff9640 1 -- 172.21.15.113:0/3080180576 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f28ec076ee0 con 0x7f28f4157bf0 2023-12-19T13:53:40.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.168+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28f41589a0 con 0x7f28f4157bf0 2023-12-19T13:53:40.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.169+0000 7f28f0ff9640 1 -- 172.21.15.113:0/3080180576 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f28ec039de0 con 0x7f28f4157bf0 2023-12-19T13:53:40.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:40.168 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2689181507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2689181507},{"type":"v1","addr":"172.21.15.151:6834","nonce":2689181507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2268147026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2268147026},{"type":"v1","addr":"172.21.15.151:6835","nonce":2268147026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/113414448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":113414448},{"type":"v1","addr":"172.21.15.113:6836","nonce":113414448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/279385042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":279385042},{"type":"v1","addr":"172.21.15.113:6837","nonce":279385042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-12-19T13:53:40.168 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 51 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f28d406a460 msgr2=0x7f28d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f28d406a460 0x7f28d406c920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f28e40011e0 tx=0x7f28e4009040 comp rx=0 tx=0).stop 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f4157bf0 msgr2=0x7f28f415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f4157bf0 0x7f28f415e220 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f28ec02c4d0 tx=0x7f28ec004a40 comp rx=0 tx=0).stop 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 shutdown_connections 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f28d406a460 0x7f28d406c920 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f28f4157bf0 0x7f28f415e220 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28f40b0640 0x7f28f415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 --2- 172.21.15.113:0/3080180576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28f40ae110 0x7f28f41f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 >> 172.21.15.113:0/3080180576 conn(0x7f28f40cbb70 msgr2=0x7f28f40b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:40.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.171+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 shutdown_connections 2023-12-19T13:53:40.172 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.172+0000 7f28f98f7640 1 -- 172.21.15.113:0/3080180576 wait complete. 2023-12-19T13:53:40.190 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:53:40.190 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:53:40.190 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:53:40.190 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:53:40.190 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:53:40.190 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:53:40.191 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:53:40.191 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:53:40.191 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:53:40.191 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:53:40.191 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:53:40.191 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:53:40.191 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:53:40.191 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:53:40.192 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:53:40.192 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:53:40.209 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:53:40.210 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:53:40.213 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:53:40.213 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:53:40.214 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:53:40.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:53:40.216 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:53:40.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:53:40.261 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:53:40.264 DEBUG:teuthology.parallel:result is None 2023-12-19T13:53:40.265 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:53:40.265 DEBUG:teuthology.parallel:result is None 2023-12-19T13:53:40.269 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:53:40.269 DEBUG:teuthology.parallel:result is None 2023-12-19T13:53:40.272 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:53:40.272 DEBUG:teuthology.parallel:result is None 2023-12-19T13:53:40.273 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:53:40.419 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:53:40.421 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:53:40.421 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:53:40.433 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:53:40.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.471+0000 7f62c1b48640 1 Processor -- start 2023-12-19T13:53:40.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.471+0000 7f62c1b48640 1 -- start start 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.472+0000 7f62c1b48640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc157aa0 0x7f62bc0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.472+0000 7f62c1b48640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f62bc15e040 0x7f62bc15e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.472+0000 7f62c1b48640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc06e890 con 0x7f62bc06e410 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.472+0000 7f62c1b48640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc15e9c0 con 0x7f62bc15e040 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.472+0000 7f62c1b48640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b2600 con 0x7f62bc157aa0 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62baffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f62bc06e410 0x7f62bc161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51268/0 (socket says 172.21.15.113:51268) 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62baffd640 1 -- 172.21.15.113:0/2991995802 learned_addr learned my addr 172.21.15.113:0/2991995802 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62bbfff640 1 --2- 172.21.15.113:0/2991995802 >> v2:172.21.15.113:3300/0 conn(0x7f62bc15e040 0x7f62bc15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62bb7fe640 1 --2- 172.21.15.113:0/2991995802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc157aa0 0x7f62bc0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62ba7fc640 1 -- 172.21.15.113:0/2991995802 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262561107 0 0) 0x7f62bc06e890 con 0x7f62bc06e410 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62ba7fc640 1 -- 172.21.15.113:0/2991995802 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a4003520 con 0x7f62bc06e410 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62bbfff640 1 -- 172.21.15.113:0/2991995802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc157aa0 msgr2=0x7f62bc0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:40.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62bbfff640 1 --2- 172.21.15.113:0/2991995802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc157aa0 0x7f62bc0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62bbfff640 1 -- 172.21.15.113:0/2991995802 >> v1:172.21.15.113:6789/0 conn(0x7f62bc06e410 legacy=0x7f62bc161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.473+0000 7f62bbfff640 1 -- 172.21.15.113:0/2991995802 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0b1d60 con 0x7f62bc15e040 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.474+0000 7f62bbfff640 1 --2- 172.21.15.113:0/2991995802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc15e040 0x7f62bc15e480 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009d90 tx=0x7f62b402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a49ee91ee750f6a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62ba7fc640 1 -- 172.21.15.113:0/2991995802 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b402cc50 con 0x7f62bc15e040 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62ba7fc640 1 -- 172.21.15.113:0/2991995802 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b402cdb0 con 0x7f62bc15e040 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62ba7fc640 1 -- 172.21.15.113:0/2991995802 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4034660 con 0x7f62bc15e040 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/2991995802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc15e040 msgr2=0x7f62bc15e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/2991995802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc15e040 0x7f62bc15e480 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009d90 tx=0x7f62b402bea0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/2991995802 shutdown_connections 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/2991995802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc15e040 0x7f62bc15e480 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/2991995802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc157aa0 0x7f62bc0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/2991995802 >> 172.21.15.113:0/2991995802 conn(0x7f62bc0cbb70 msgr2=0x7f62bc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/2991995802 shutdown_connections 2023-12-19T13:53:40.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/2991995802 wait complete. 2023-12-19T13:53:40.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.477+0000 7f62c1b48640 1 Processor -- start 2023-12-19T13:53:40.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.477+0000 7f62c1b48640 1 -- start start 2023-12-19T13:53:40.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.478+0000 7f62c1b48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc06e410 0x7f62bc160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:40.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.478+0000 7f62c1b48640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62bc157aa0 0x7f62bc15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:40.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.478+0000 7f62c1b48640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc15e040 0x7f62bc145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:40.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.478+0000 7f62c1b48640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc1460f0 con 0x7f62bc06e410 2023-12-19T13:53:40.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.478+0000 7f62c1b48640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0ae920 con 0x7f62bc157aa0 2023-12-19T13:53:40.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.478+0000 7f62c1b48640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15f6f0 con 0x7f62bc15e040 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.478+0000 7f62bb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc06e410 0x7f62bc160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc06e410 0x7f62bc160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40682/0 (socket says 172.21.15.113:40682) 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 -- 172.21.15.113:0/3574998285 learned_addr learned my addr 172.21.15.113:0/3574998285 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 -- 172.21.15.113:0/3574998285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc15e040 msgr2=0x7f62bc145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc15e040 0x7f62bc145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 -- 172.21.15.113:0/3574998285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62bc157aa0 msgr2=0x7f62bc15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62bc157aa0 0x7f62bc15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 -- 172.21.15.113:0/3574998285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4009a70 con 0x7f62bc06e410 2023-12-19T13:53:40.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62bb7fe640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc06e410 0x7f62bc160790 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00e9b0 tx=0x7f62ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:40.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62a3fff640 1 -- 172.21.15.113:0/3574998285 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac009670 con 0x7f62bc06e410 2023-12-19T13:53:40.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62a3fff640 1 -- 172.21.15.113:0/3574998285 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac00c9a0 con 0x7f62bc06e410 2023-12-19T13:53:40.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62a3fff640 1 -- 172.21.15.113:0/3574998285 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00cd50 con 0x7f62bc06e410 2023-12-19T13:53:40.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.479+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc15f9d0 con 0x7f62bc06e410 2023-12-19T13:53:40.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.480+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc15ff90 con 0x7f62bc06e410 2023-12-19T13:53:40.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.481+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc061910 con 0x7f62bc06e410 2023-12-19T13:53:40.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.482+0000 7f62a3fff640 1 -- 172.21.15.113:0/3574998285 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62ac013470 con 0x7f62bc06e410 2023-12-19T13:53:40.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.483+0000 7f62a3fff640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f62a806a430 0x7f62a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:40.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.483+0000 7f62a3fff640 1 -- 172.21.15.113:0/3574998285 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f62ac0888f0 con 0x7f62bc06e410 2023-12-19T13:53:40.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.483+0000 7f62baffd640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f62a806a430 0x7f62a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:40.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.484+0000 7f62baffd640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f62a806a430 0x7f62a806c8f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0cc430 tx=0x7f62b0007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:40.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.487+0000 7f62a3fff640 1 -- 172.21.15.113:0/3574998285 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62ac0541d0 con 0x7f62bc06e410 2023-12-19T13:53:40.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:40.686+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f62bc071ae0 con 0x7f62bc06e410 2023-12-19T13:53:41.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.471+0000 7f62a3fff640 1 -- 172.21.15.113:0/3574998285 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v128) v1 ==== 97+0+0 (secure 0 0 0) 0x7f62ac017080 con 0x7f62bc06e410 2023-12-19T13:53:41.471 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f62a806a430 msgr2=0x7f62a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f62a806a430 0x7f62a806c8f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0cc430 tx=0x7f62b0007930 comp rx=0 tx=0).stop 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc06e410 msgr2=0x7f62bc160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc06e410 0x7f62bc160790 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00e9b0 tx=0x7f62ac00ee70 comp rx=0 tx=0).stop 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 shutdown_connections 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f62a806a430 0x7f62a806c8f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62bc15e040 0x7f62bc145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62bc157aa0 0x7f62bc15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 --2- 172.21.15.113:0/3574998285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62bc06e410 0x7f62bc160790 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 >> 172.21.15.113:0/3574998285 conn(0x7f62bc0cbb70 msgr2=0x7f62bc06d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:41.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 shutdown_connections 2023-12-19T13:53:41.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.475+0000 7f62c1b48640 1 -- 172.21.15.113:0/3574998285 wait complete. 2023-12-19T13:53:41.494 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:53:41.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.710+0000 7fb263a4c640 1 Processor -- start 2023-12-19T13:53:41.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.710+0000 7fb263a4c640 1 -- start start 2023-12-19T13:53:41.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.711+0000 7fb263a4c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb25c157bf0 0x7fb25c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:41.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.711+0000 7fb263a4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:41.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.712+0000 7fb263a4c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25c0b0a90 con 0x7fb25c0b0640 2023-12-19T13:53:41.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.712+0000 7fb263a4c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25c06b8c0 con 0x7fb25c157bf0 2023-12-19T13:53:41.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.712+0000 7fb263a4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c15b740 con 0x7fb25c0ae110 2023-12-19T13:53:41.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.712+0000 7fb260fe7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:41.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.712+0000 7fb260fe7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:53028/0 (socket says 172.21.15.113:53028) 2023-12-19T13:53:41.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.712+0000 7fb260fe7640 1 -- 172.21.15.113:0/732549079 learned_addr learned my addr 172.21.15.113:0/732549079 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:41.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.712+0000 7fb2617e8640 1 --2- 172.21.15.113:0/732549079 >> v2:172.21.15.151:3300/0 conn(0x7fb25c157bf0 0x7fb25c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:41.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.713+0000 7fb2617e8640 1 -- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 msgr2=0x7fb25c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:41.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.713+0000 7fb2617e8640 1 --2- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.713+0000 7fb2617e8640 1 -- 172.21.15.113:0/732549079 >> v1:172.21.15.151:6789/0 conn(0x7fb25c0b0640 legacy=0x7fb25c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:41.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.713+0000 7fb2617e8640 1 -- 172.21.15.113:0/732549079 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c0ae640 con 0x7fb25c157bf0 2023-12-19T13:53:41.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.713+0000 7fb260fe7640 1 --2- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:53:41.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.714+0000 7fb2617e8640 1 --2- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c15b200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2580097d0 tx=0x7fb25802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e7adf620fd61605 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:41.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.715+0000 7fb253fff640 1 -- 172.21.15.113:0/732549079 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25802d040 con 0x7fb25c157bf0 2023-12-19T13:53:41.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.715+0000 7fb253fff640 1 -- 172.21.15.113:0/732549079 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258031810 con 0x7fb25c157bf0 2023-12-19T13:53:41.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.715+0000 7fb253fff640 1 -- 172.21.15.113:0/732549079 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258031ba0 con 0x7fb25c157bf0 2023-12-19T13:53:41.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 -- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 msgr2=0x7fb25c15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:41.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 --2- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c15b200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2580097d0 tx=0x7fb25802b8b0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 -- 172.21.15.113:0/732549079 shutdown_connections 2023-12-19T13:53:41.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 --2- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 --2- 172.21.15.113:0/732549079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c15b200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 -- 172.21.15.113:0/732549079 >> 172.21.15.113:0/732549079 conn(0x7fb25c0cbb70 msgr2=0x7fb25c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:41.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 -- 172.21.15.113:0/732549079 shutdown_connections 2023-12-19T13:53:41.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.716+0000 7fb263a4c640 1 -- 172.21.15.113:0/732549079 wait complete. 2023-12-19T13:53:41.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.718+0000 7fb263a4c640 1 Processor -- start 2023-12-19T13:53:41.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.718+0000 7fb263a4c640 1 -- start start 2023-12-19T13:53:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.719+0000 7fb263a4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.719+0000 7fb263a4c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb25c0b0640 0x7fb25c147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.719+0000 7fb263a4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.719+0000 7fb263a4c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0ceb80 con 0x7fb25c0b0640 2023-12-19T13:53:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.719+0000 7fb263a4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0b2330 con 0x7fb25c157bf0 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.719+0000 7fb263a4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0ce600 con 0x7fb25c0ae110 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb25c0b0640 0x7fb25c147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb25c0b0640 0x7fb25c147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40686/0 (socket says 172.21.15.113:40686) 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 -- 172.21.15.113:0/607727862 learned_addr learned my addr 172.21.15.113:0/607727862 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb2617e8640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb261fe9640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 -- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 msgr2=0x7fb25c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 -- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 msgr2=0x7fb25c151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 -- 172.21.15.113:0/607727862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0094d0 con 0x7fb25c0b0640 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb261fe9640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.720+0000 7fb260fe7640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb25c0b0640 0x7fb25c147bd0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00e9a0 tx=0x7fb24c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:41.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.721+0000 7fb251ffb640 1 -- 172.21.15.113:0/607727862 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00ca00 con 0x7fb25c0b0640 2023-12-19T13:53:41.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.721+0000 7fb251ffb640 1 -- 172.21.15.113:0/607727862 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c00cb60 con 0x7fb25c0b0640 2023-12-19T13:53:41.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.721+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb258009400 con 0x7fb25c0b0640 2023-12-19T13:53:41.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.721+0000 7fb251ffb640 1 -- 172.21.15.113:0/607727862 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c013470 con 0x7fb25c0b0640 2023-12-19T13:53:41.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.721+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c0ce950 con 0x7fb25c0b0640 2023-12-19T13:53:41.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.722+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c061910 con 0x7fb25c0b0640 2023-12-19T13:53:41.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.723+0000 7fb251ffb640 1 -- 172.21.15.113:0/607727862 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb24c0135d0 con 0x7fb25c0b0640 2023-12-19T13:53:41.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.724+0000 7fb251ffb640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb24006a430 0x7fb24006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:41.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.724+0000 7fb251ffb640 1 -- 172.21.15.113:0/607727862 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb24c0888e0 con 0x7fb25c0b0640 2023-12-19T13:53:41.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.724+0000 7fb2617e8640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb24006a430 0x7fb24006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:41.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.725+0000 7fb2617e8640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb24006a430 0x7fb24006c8f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb258036000 tx=0x7fb25803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:41.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.728+0000 7fb251ffb640 1 -- 172.21.15.113:0/607727862 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb24c054210 con 0x7fb25c0b0640 2023-12-19T13:53:41.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.989+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb25c15b000 con 0x7fb25c0b0640 2023-12-19T13:53:41.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.990+0000 7fb251ffb640 1 -- 172.21.15.113:0/607727862 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb24c021090 con 0x7fb25c0b0640 2023-12-19T13:53:41.990 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:41.990 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:41.990 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:53:41.990 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:41.990 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:53:41.991 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:53:41.991 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:41.991 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:41.991 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:53:41.991 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:53:41.991 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:41.992 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:41.992 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:41.992 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:41.992 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:53:41.992 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:53:41.992 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:41.992 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:41.993 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:53:41.993 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:53:41.993 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:41.993 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:41.993 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:41.993 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:41.994 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:53:41.994 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:53:41.994 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:41.994 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:41.994 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:53:41.994 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:53:41.995 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:41.995 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:41.995 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:41.995 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:41.995 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:53:41.996 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:53:41.996 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:41.996 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:41.997 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:53:41.997 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:53:41.997 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:41.997 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:41.997 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:41.997 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:41.998 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:53:41.998 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:53:41.999 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:41.999 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:41.999 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:41.999 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:41.999 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:41.999 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:41.999 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.000 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:53:42.000 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:53:42.000 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.000 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:42.000 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:42.000 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.001 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.001 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.001 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.001 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:53:42.001 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:53:42.001 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:53:42.002 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:53:42.003 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.003 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:42.003 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:42.003 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.003 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.003 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.003 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.004 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.005 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:53:42.006 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:53:42.006 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.006 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:42.006 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:42.006 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.006 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.008 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:53:42.009 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.010 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.011 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:53:42.012 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb24006a430 msgr2=0x7fb24006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb24006a430 0x7fb24006c8f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb258036000 tx=0x7fb25803c040 comp rx=0 tx=0).stop 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb25c0b0640 msgr2=0x7fb25c147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb25c0b0640 0x7fb25c147bd0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00e9a0 tx=0x7fb24c00ee60 comp rx=0 tx=0).stop 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 shutdown_connections 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb24006a430 0x7fb24006c8f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c157bf0 0x7fb25c151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb25c0b0640 0x7fb25c147bd0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 --2- 172.21.15.113:0/607727862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb25c0ae110 0x7fb25c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.992+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 >> 172.21.15.113:0/607727862 conn(0x7fb25c0cbb70 msgr2=0x7fb25c0ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.993+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 shutdown_connections 2023-12-19T13:53:42.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:41.993+0000 7fb263a4c640 1 -- 172.21.15.113:0/607727862 wait complete. 2023-12-19T13:53:42.015 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:42.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.223+0000 7fb785511640 1 Processor -- start 2023-12-19T13:53:42.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.223+0000 7fb785511640 1 -- start start 2023-12-19T13:53:42.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.224+0000 7fb785511640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb78015e3f0 0x7fb7800b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.224+0000 7fb785511640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb7800b2460 0x7fb7800ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.224+0000 7fb785511640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7800ad240 con 0x7fb7800acdf0 2023-12-19T13:53:42.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.224+0000 7fb785511640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800b2fa0 con 0x7fb78015e3f0 2023-12-19T13:53:42.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.224+0000 7fb785511640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78006f600 con 0x7fb7800b2460 2023-12-19T13:53:42.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.225+0000 7fb784d10640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb7800acdf0 0x7fb780160e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51270/0 (socket says 172.21.15.113:51270) 2023-12-19T13:53:42.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.225+0000 7fb784d10640 1 -- 172.21.15.113:0/3541948214 learned_addr learned my addr 172.21.15.113:0/3541948214 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:42.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.225+0000 7fb77ffff640 1 --2- 172.21.15.113:0/3541948214 >> v2:172.21.15.113:3300/0 conn(0x7fb78015e3f0 0x7fb7800b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.225+0000 7fb777fff640 1 --2- 172.21.15.113:0/3541948214 >> v2:172.21.15.151:3300/0 conn(0x7fb7800b2460 0x7fb7800ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.225+0000 7fb77f7fe640 1 -- 172.21.15.113:0/3541948214 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467618513 0 0) 0x7fb778001490 con 0x7fb7800acdf0 2023-12-19T13:53:42.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.225+0000 7fb77f7fe640 1 -- 172.21.15.113:0/3541948214 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb76c003520 con 0x7fb7800acdf0 2023-12-19T13:53:42.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.226+0000 7fb77ffff640 1 -- 172.21.15.113:0/3541948214 >> v2:172.21.15.151:3300/0 conn(0x7fb7800b2460 msgr2=0x7fb7800ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:42.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.226+0000 7fb77ffff640 1 --2- 172.21.15.113:0/3541948214 >> v2:172.21.15.151:3300/0 conn(0x7fb7800b2460 0x7fb7800ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.226+0000 7fb77ffff640 1 -- 172.21.15.113:0/3541948214 >> v1:172.21.15.113:6789/0 conn(0x7fb7800acdf0 legacy=0x7fb780160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.226+0000 7fb77ffff640 1 -- 172.21.15.113:0/3541948214 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78015e7d0 con 0x7fb78015e3f0 2023-12-19T13:53:42.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.226+0000 7fb777fff640 1 --2- 172.21.15.113:0/3541948214 >> v2:172.21.15.151:3300/0 conn(0x7fb7800b2460 0x7fb7800ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.227+0000 7fb77ffff640 1 --2- 172.21.15.113:0/3541948214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb78015e3f0 0x7fb7800b1f20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb7800b1b80 tx=0x7fb77002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ce56ecba20ceea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.227+0000 7fb77f7fe640 1 -- 172.21.15.113:0/3541948214 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77002e070 con 0x7fb78015e3f0 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.227+0000 7fb77f7fe640 1 -- 172.21.15.113:0/3541948214 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7700315a0 con 0x7fb78015e3f0 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.227+0000 7fb77f7fe640 1 -- 172.21.15.113:0/3541948214 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770031930 con 0x7fb78015e3f0 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.227+0000 7fb785511640 1 -- 172.21.15.113:0/3541948214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb78015e3f0 msgr2=0x7fb7800b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.227+0000 7fb785511640 1 --2- 172.21.15.113:0/3541948214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb78015e3f0 0x7fb7800b1f20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb7800b1b80 tx=0x7fb77002b840 comp rx=0 tx=0).stop 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.228+0000 7fb785511640 1 -- 172.21.15.113:0/3541948214 shutdown_connections 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.228+0000 7fb785511640 1 --2- 172.21.15.113:0/3541948214 >> v2:172.21.15.151:3300/0 conn(0x7fb7800b2460 0x7fb7800ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.228+0000 7fb785511640 1 --2- 172.21.15.113:0/3541948214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb78015e3f0 0x7fb7800b1f20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.228+0000 7fb785511640 1 -- 172.21.15.113:0/3541948214 >> 172.21.15.113:0/3541948214 conn(0x7fb7800b0100 msgr2=0x7fb7800b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.228+0000 7fb785511640 1 -- 172.21.15.113:0/3541948214 shutdown_connections 2023-12-19T13:53:42.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.228+0000 7fb785511640 1 -- 172.21.15.113:0/3541948214 wait complete. 2023-12-19T13:53:42.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.229+0000 7fb785511640 1 Processor -- start 2023-12-19T13:53:42.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.230+0000 7fb785511640 1 -- start start 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.230+0000 7fb785511640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7800acdf0 0x7fb7801525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.230+0000 7fb785511640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7800b2460 0x7fb780152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.230+0000 7fb785511640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78015e3f0 0x7fb780143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.230+0000 7fb785511640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb780147700 con 0x7fb7800b2460 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb785511640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb780154b80 con 0x7fb7800acdf0 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb785511640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb780154e60 con 0x7fb78015e3f0 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7800b2460 0x7fb780152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7800b2460 0x7fb780152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40704/0 (socket says 172.21.15.113:40704) 2023-12-19T13:53:42.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 -- 172.21.15.113:0/270441109 learned_addr learned my addr 172.21.15.113:0/270441109 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:42.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 -- 172.21.15.113:0/270441109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78015e3f0 msgr2=0x7fb780143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78015e3f0 0x7fb780143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 -- 172.21.15.113:0/270441109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7800acdf0 msgr2=0x7fb7801525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7800acdf0 0x7fb7801525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 -- 172.21.15.113:0/270441109 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770009400 con 0x7fb7800b2460 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.231+0000 7fb777fff640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7800b2460 0x7fb780152af0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb76800d7d0 tx=0x7fb76800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.232+0000 7fb77d7fa640 1 -- 172.21.15.113:0/270441109 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768004030 con 0x7fb7800b2460 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.232+0000 7fb77d7fa640 1 -- 172.21.15.113:0/270441109 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768004190 con 0x7fb7800b2460 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.232+0000 7fb77d7fa640 1 -- 172.21.15.113:0/270441109 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768004520 con 0x7fb7800b2460 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.232+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb780155140 con 0x7fb7800b2460 2023-12-19T13:53:42.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.232+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb780155700 con 0x7fb7800b2460 2023-12-19T13:53:42.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.233+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb780061910 con 0x7fb7800b2460 2023-12-19T13:53:42.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.234+0000 7fb77d7fa640 1 -- 172.21.15.113:0/270441109 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb7680096a0 con 0x7fb7800b2460 2023-12-19T13:53:42.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.235+0000 7fb77d7fa640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb76006a460 0x7fb76006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.235+0000 7fb77d7fa640 1 -- 172.21.15.113:0/270441109 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb7680887f0 con 0x7fb7800b2460 2023-12-19T13:53:42.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.235+0000 7fb77ffff640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb76006a460 0x7fb76006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.236+0000 7fb77ffff640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb76006a460 0x7fb76006c920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb770036000 tx=0x7fb770030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:42.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.239+0000 7fb77d7fa640 1 -- 172.21.15.113:0/270441109 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb768054090 con 0x7fb7800b2460 2023-12-19T13:53:42.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.432+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb78006e800 con 0x7fb7800b2460 2023-12-19T13:53:42.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.434+0000 7fb77d7fa640 1 -- 172.21.15.113:0/270441109 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+12448 (secure 0 0 0) 0x7fb7680576b0 con 0x7fb7800b2460 2023-12-19T13:53:42.434 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:42.434 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":128,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:41.456618+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb76006a460 msgr2=0x7fb76006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb76006a460 0x7fb76006c920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb770036000 tx=0x7fb770030000 comp rx=0 tx=0).stop 2023-12-19T13:53:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7800b2460 msgr2=0x7fb780152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7800b2460 0x7fb780152af0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb76800d7d0 tx=0x7fb76800dc90 comp rx=0 tx=0).stop 2023-12-19T13:53:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 shutdown_connections 2023-12-19T13:53:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb76006a460 0x7fb76006c920 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78015e3f0 0x7fb780143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7800b2460 0x7fb780152af0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.436+0000 7fb785511640 1 --2- 172.21.15.113:0/270441109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7800acdf0 0x7fb7801525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.437+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 >> 172.21.15.113:0/270441109 conn(0x7fb7800b0100 msgr2=0x7fb7800b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:42.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.437+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 shutdown_connections 2023-12-19T13:53:42.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.437+0000 7fb785511640 1 -- 172.21.15.113:0/270441109 wait complete. 2023-12-19T13:53:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:53:42.456 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:53:42.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.673+0000 7f674c4ca640 1 Processor -- start 2023-12-19T13:53:42.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.673+0000 7f674c4ca640 1 -- start start 2023-12-19T13:53:42.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.675+0000 7f674c4ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 0x7f67440d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.675+0000 7f674c4ca640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6744161e70 con 0x7f674406fc40 2023-12-19T13:53:42.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.675+0000 7f674c4ca640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6744161260 con 0x7f67440b6430 2023-12-19T13:53:42.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.675+0000 7f674c4ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6744161080 con 0x7f6744146ff0 2023-12-19T13:53:42.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.675+0000 7f674aa67640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f674406fc40 0x7f674415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51274/0 (socket says 172.21.15.113:51274) 2023-12-19T13:53:42.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.675+0000 7f674aa67640 1 -- 172.21.15.113:0/2779704735 learned_addr learned my addr 172.21.15.113:0/2779704735 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:42.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.675+0000 7f674a266640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 0x7f67440d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096701309 0 0) 0x7f6744161e70 con 0x7f674406fc40 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6730003520 con 0x7f674406fc40 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1251873184 0 0) 0x7f6730003520 con 0x7f674406fc40 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 msgr2=0x7f67440d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 0x7f67440d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 >> v1:172.21.15.151:6789/0 conn(0x7f67440b6430 legacy=0x7f674406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6744161540 con 0x7f674406fc40 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f673c0019f0 con 0x7f674406fc40 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 >> v1:172.21.15.113:6789/0 conn(0x7f674406fc40 legacy=0x7f674415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6730003a10 0x7f6730003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 0x7f67300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6730004d00 0x7f6730005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6744161080 con 0x7f6730004d00 2023-12-19T13:53:42.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673000ba90 con 0x7f6730003a10 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673000bc50 con 0x7f6744146ff0 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.676+0000 7f674aa67640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6730004d00 0x7f6730005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.677+0000 7f6749a65640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 0x7f67300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.677+0000 7f674a266640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6730003a10 0x7f6730003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.677+0000 7f674aa67640 1 -- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 msgr2=0x7f67300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.677+0000 7f674aa67640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6744146ff0 0x7f67300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.677+0000 7f674aa67640 1 -- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6730003a10 msgr2=0x7f6730003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.677+0000 7f674aa67640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6730003a10 0x7f6730003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.677+0000 7f674aa67640 1 -- 172.21.15.113:0/2779704735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730003520 con 0x7f6730004d00 2023-12-19T13:53:42.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.678+0000 7f674aa67640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6730004d00 0x7f6730005180 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f673c00a800 tx=0x7f67300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e92cb56147c7bee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:42.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.678+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0072d0 con 0x7f6730004d00 2023-12-19T13:53:42.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.678+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c02f070 con 0x7f6730004d00 2023-12-19T13:53:42.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.678+0000 7f6749264640 1 -- 172.21.15.113:0/2779704735 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0076b0 con 0x7f6730004d00 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.679+0000 7f674c4ca640 1 -- 172.21.15.113:0/2779704735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6730004d00 msgr2=0x7f6730005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.679+0000 7f674c4ca640 1 --2- 172.21.15.113:0/2779704735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6730004d00 0x7f6730005180 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f673c00a800 tx=0x7f67300057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.679+0000 7f674aa67640 1 -- 172.21.15.113:0/2779704735 reap_dead start 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.679+0000 7f674c4ca640 1 -- 172.21.15.113:0/2779704735 shutdown_connections 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.679+0000 7f674c4ca640 1 -- 172.21.15.113:0/2779704735 >> 172.21.15.113:0/2779704735 conn(0x7f67440d3520 msgr2=0x7f67440d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.679+0000 7f674c4ca640 1 -- 172.21.15.113:0/2779704735 shutdown_connections 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.679+0000 7f674c4ca640 1 -- 172.21.15.113:0/2779704735 wait complete. 2023-12-19T13:53:42.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.681+0000 7f674c4ca640 1 Processor -- start 2023-12-19T13:53:42.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.681+0000 7f674c4ca640 1 -- start start 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674c4ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6730004d00 0x7f67440cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674c4ca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67440c9100 0x7f674415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674c4ca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67440ccad0 0x7f674415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674c4ca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440ce840 con 0x7f67440ccad0 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674c4ca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440ceab0 con 0x7f67440c9100 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674c4ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67440ced90 con 0x7f6730004d00 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674aa67640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67440ccad0 0x7f674415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674aa67640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67440ccad0 0x7f674415f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40718/0 (socket says 172.21.15.113:40718) 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.682+0000 7f674aa67640 1 -- 172.21.15.113:0/3403924608 learned_addr learned my addr 172.21.15.113:0/3403924608 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674a266640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6730004d00 0x7f67440cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f6749a65640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67440c9100 0x7f674415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674aa67640 1 -- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6730004d00 msgr2=0x7f67440cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674aa67640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6730004d00 0x7f67440cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674aa67640 1 -- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67440c9100 msgr2=0x7f674415cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674aa67640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67440c9100 0x7f674415cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674aa67640 1 -- 172.21.15.113:0/3403924608 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440cf070 con 0x7f67440ccad0 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f6749a65640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67440c9100 0x7f674415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674aa67640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67440ccad0 0x7f674415f9a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f673c02cb50 tx=0x7f673c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f673affd640 1 -- 172.21.15.113:0/3403924608 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0019b0 con 0x7f67440ccad0 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f673affd640 1 -- 172.21.15.113:0/3403924608 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c02ce90 con 0x7f67440ccad0 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67440cf350 con 0x7f67440ccad0 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.683+0000 7f673affd640 1 -- 172.21.15.113:0/3403924608 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0072f0 con 0x7f67440ccad0 2023-12-19T13:53:42.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.684+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67440ccf50 con 0x7f67440ccad0 2023-12-19T13:53:42.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.685+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67440cd230 con 0x7f67440ccad0 2023-12-19T13:53:42.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.686+0000 7f673affd640 1 -- 172.21.15.113:0/3403924608 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f673c031030 con 0x7f67440ccad0 2023-12-19T13:53:42.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.687+0000 7f673affd640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f672806a460 0x7f672806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:42.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.687+0000 7f673affd640 1 -- 172.21.15.113:0/3403924608 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f673c0aa0e0 con 0x7f67440ccad0 2023-12-19T13:53:42.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.687+0000 7f674a266640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f672806a460 0x7f672806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:42.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.688+0000 7f674a266640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f672806a460 0x7f672806c920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6740009a10 tx=0x7f6740008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:42.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.691+0000 7f673affd640 1 -- 172.21.15.113:0/3403924608 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f673c075980 con 0x7f67440ccad0 2023-12-19T13:53:42.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.873+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67440cd230 con 0x7f67440ccad0 2023-12-19T13:53:42.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.873+0000 7f673affd640 1 -- 172.21.15.113:0/3403924608 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7f673c078fa0 con 0x7f67440ccad0 2023-12-19T13:53:42.873 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:53:42.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f672806a460 msgr2=0x7f672806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f672806a460 0x7f672806c920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6740009a10 tx=0x7f6740008040 comp rx=0 tx=0).stop 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67440ccad0 msgr2=0x7f674415f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67440ccad0 0x7f674415f9a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f673c02cb50 tx=0x7f673c001d80 comp rx=0 tx=0).stop 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 shutdown_connections 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f672806a460 0x7f672806c920 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67440ccad0 0x7f674415f9a0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67440c9100 0x7f674415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 --2- 172.21.15.113:0/3403924608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6730004d00 0x7f67440cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 >> 172.21.15.113:0/3403924608 conn(0x7f67440d3520 msgr2=0x7f67440d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 shutdown_connections 2023-12-19T13:53:42.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:42.876+0000 7f674c4ca640 1 -- 172.21.15.113:0/3403924608 wait complete. 2023-12-19T13:53:42.893 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:53:43.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.088+0000 7f54f5231640 1 Processor -- start 2023-12-19T13:53:43.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.088+0000 7f54f5231640 1 -- start start 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.089+0000 7f54f5231640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54f0158df0 0x7f54f015c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.089+0000 7f54f5231640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006f160 0x7f54f00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54f5231640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f0070130 con 0x7f54f006d850 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54f5231640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f006f610 con 0x7f54f0158df0 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54f5231640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f006f890 con 0x7f54f006f160 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54eed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54f0158df0 0x7f54f015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54eed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54f0158df0 0x7f54f015c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40730/0 (socket says 172.21.15.113:40730) 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54eed9d640 1 -- 172.21.15.113:0/1280227027 learned_addr learned my addr 172.21.15.113:0/1280227027 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54eed9d640 1 -- 172.21.15.113:0/1280227027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006f160 msgr2=0x7f54f00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:43.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54eed9d640 1 --2- 172.21.15.113:0/1280227027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006f160 0x7f54f00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54eed9d640 1 -- 172.21.15.113:0/1280227027 >> v1:172.21.15.113:6789/0 conn(0x7f54f006d850 legacy=0x7f54f0070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.090+0000 7f54eed9d640 1 -- 172.21.15.113:0/1280227027 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f006fb70 con 0x7f54f0158df0 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.091+0000 7f54eed9d640 1 --2- 172.21.15.113:0/1280227027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f015c460 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009870 tx=0x7f54e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f6afb6553cfcb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54edd9b640 1 -- 172.21.15.113:0/1280227027 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0031640 con 0x7f54f0158df0 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54edd9b640 1 -- 172.21.15.113:0/1280227027 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e00317a0 con 0x7f54f0158df0 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54edd9b640 1 -- 172.21.15.113:0/1280227027 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0031b30 con 0x7f54f0158df0 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 -- 172.21.15.113:0/1280227027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 msgr2=0x7f54f015c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 --2- 172.21.15.113:0/1280227027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f015c460 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009870 tx=0x7f54e002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 -- 172.21.15.113:0/1280227027 shutdown_connections 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 --2- 172.21.15.113:0/1280227027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006f160 0x7f54f00cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 --2- 172.21.15.113:0/1280227027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f015c460 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 -- 172.21.15.113:0/1280227027 >> 172.21.15.113:0/1280227027 conn(0x7f54f00cf0b0 msgr2=0x7f54f00cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 -- 172.21.15.113:0/1280227027 shutdown_connections 2023-12-19T13:53:43.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.092+0000 7f54f5231640 1 -- 172.21.15.113:0/1280227027 wait complete. 2023-12-19T13:53:43.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.094+0000 7f54f5231640 1 Processor -- start 2023-12-19T13:53:43.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.094+0000 7f54f5231640 1 -- start start 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54f5231640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006d850 0x7f54f015e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54f5231640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f006f160 0x7f54f00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54f5231640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f00acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54f5231640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0146fa0 con 0x7f54f0158df0 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54f5231640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f01463a0 con 0x7f54f006f160 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54f5231640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0146670 con 0x7f54f006d850 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54ef59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f00acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:43.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54ef59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f00acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40740/0 (socket says 172.21.15.113:40740) 2023-12-19T13:53:43.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.095+0000 7f54ef59e640 1 -- 172.21.15.113:0/3523269032 learned_addr learned my addr 172.21.15.113:0/3523269032 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:43.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54ef59e640 1 -- 172.21.15.113:0/3523269032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006d850 msgr2=0x7f54f015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54ef59e640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006d850 0x7f54f015e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54ef59e640 1 -- 172.21.15.113:0/3523269032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f006f160 msgr2=0x7f54f00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54ef59e640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f006f160 0x7f54f00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54ef59e640 1 -- 172.21.15.113:0/3523269032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e00094d0 con 0x7f54f0158df0 2023-12-19T13:53:43.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54ef59e640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f00acdf0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c6b0 tx=0x7f54e800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:43.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54d77fe640 1 -- 172.21.15.113:0/3523269032 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8003b70 con 0x7f54f0158df0 2023-12-19T13:53:43.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54d77fe640 1 -- 172.21.15.113:0/3523269032 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e8003d10 con 0x7f54f0158df0 2023-12-19T13:53:43.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54d77fe640 1 -- 172.21.15.113:0/3523269032 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8005310 con 0x7f54f0158df0 2023-12-19T13:53:43.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.096+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f0146950 con 0x7f54f0158df0 2023-12-19T13:53:43.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.097+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f015e890 con 0x7f54f0158df0 2023-12-19T13:53:43.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.098+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f0074770 con 0x7f54f0158df0 2023-12-19T13:53:43.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.098+0000 7f54d77fe640 1 -- 172.21.15.113:0/3523269032 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f54e8005470 con 0x7f54f0158df0 2023-12-19T13:53:43.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.099+0000 7f54d77fe640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54dc06a430 0x7f54dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.099+0000 7f54d77fe640 1 -- 172.21.15.113:0/3523269032 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54e8088400 con 0x7f54f0158df0 2023-12-19T13:53:43.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.100+0000 7f54eed9d640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54dc06a430 0x7f54dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:43.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.100+0000 7f54eed9d640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54dc06a430 0x7f54dc06c8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f54e0036000 tx=0x7f54e0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:43.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.104+0000 7f54d77fe640 1 -- 172.21.15.113:0/3523269032 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f54e8053d40 con 0x7f54f0158df0 2023-12-19T13:53:43.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.293+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f54f0061910 con 0x7f54f0158df0 2023-12-19T13:53:43.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.294+0000 7f54d77fe640 1 -- 172.21.15.113:0/3523269032 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v128) v1 ==== 84+0+65 (secure 0 0 0) 0x7f54e8057360 con 0x7f54f0158df0 2023-12-19T13:53:43.293 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:43.293 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:53:43.293 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:53:43.293 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:53:43.293 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:53:43.294 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:53:43.294 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54dc06a430 msgr2=0x7f54dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54dc06a430 0x7f54dc06c8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f54e0036000 tx=0x7f54e0030000 comp rx=0 tx=0).stop 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 msgr2=0x7f54f00acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f00acdf0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c6b0 tx=0x7f54e800cb70 comp rx=0 tx=0).stop 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 shutdown_connections 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54dc06a430 0x7f54dc06c8f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54f0158df0 0x7f54f00acdf0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f006f160 0x7f54f00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 --2- 172.21.15.113:0/3523269032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54f006d850 0x7f54f015e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 >> 172.21.15.113:0/3523269032 conn(0x7f54f00cf0b0 msgr2=0x7f54f00ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:43.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.296+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 shutdown_connections 2023-12-19T13:53:43.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.297+0000 7f54f5231640 1 -- 172.21.15.113:0/3523269032 wait complete. 2023-12-19T13:53:43.315 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:53:43.315 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:53:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.531+0000 7f0419e54640 1 Processor -- start 2023-12-19T13:53:43.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.532+0000 7f0419e54640 1 -- start start 2023-12-19T13:53:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.533+0000 7f0419e54640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f04140b1d90 0x7f04140d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.533+0000 7f0419e54640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04140d07c0 con 0x7f041415d4e0 2023-12-19T13:53:43.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.533+0000 7f0419e54640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041415d8c0 con 0x7f04140d3650 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.533+0000 7f0419e54640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04140ce7b0 con 0x7f04140b1d90 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.533+0000 7f0418e52640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f041415d4e0 0x7f04140b8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51290/0 (socket says 172.21.15.113:51290) 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.533+0000 7f0418e52640 1 -- 172.21.15.113:0/904515086 learned_addr learned my addr 172.21.15.113:0/904515086 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.533+0000 7f0413fff640 1 --2- 172.21.15.113:0/904515086 >> v2:172.21.15.113:3300/0 conn(0x7f04140b1d90 0x7f04140d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.534+0000 7f04137fe640 1 -- 172.21.15.113:0/904515086 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650389925 0 0) 0x7f04140d07c0 con 0x7f041415d4e0 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.534+0000 7f0413fff640 1 -- 172.21.15.113:0/904515086 >> v1:172.21.15.151:6789/0 conn(0x7f04140d3650 legacy=0x7f04140d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.534+0000 7f0413fff640 1 -- 172.21.15.113:0/904515086 >> v1:172.21.15.113:6789/0 conn(0x7f041415d4e0 legacy=0x7f04140b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.534+0000 7f0413fff640 1 -- 172.21.15.113:0/904515086 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140cfbb0 con 0x7f04140b1d90 2023-12-19T13:53:43.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.535+0000 7f0413fff640 1 --2- 172.21.15.113:0/904515086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04140b1d90 0x7f04140d3110 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097a0 tx=0x7f03fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f2c7cfde6d8b51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:43.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.535+0000 7f04137fe640 1 -- 172.21.15.113:0/904515086 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc031830 con 0x7f04140b1d90 2023-12-19T13:53:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.535+0000 7f04137fe640 1 -- 172.21.15.113:0/904515086 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc031990 con 0x7f04140b1d90 2023-12-19T13:53:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.535+0000 7f04137fe640 1 -- 172.21.15.113:0/904515086 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc031d20 con 0x7f04140b1d90 2023-12-19T13:53:43.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.536+0000 7f0419e54640 1 -- 172.21.15.113:0/904515086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04140b1d90 msgr2=0x7f04140d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.536+0000 7f0419e54640 1 --2- 172.21.15.113:0/904515086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04140b1d90 0x7f04140d3110 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097a0 tx=0x7f03fc02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.536+0000 7f0419e54640 1 -- 172.21.15.113:0/904515086 shutdown_connections 2023-12-19T13:53:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.536+0000 7f0419e54640 1 --2- 172.21.15.113:0/904515086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f04140b1d90 0x7f04140d3110 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.536+0000 7f0419e54640 1 -- 172.21.15.113:0/904515086 >> 172.21.15.113:0/904515086 conn(0x7f0414072f40 msgr2=0x7f0414073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.536+0000 7f0419e54640 1 -- 172.21.15.113:0/904515086 shutdown_connections 2023-12-19T13:53:43.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.536+0000 7f0419e54640 1 -- 172.21.15.113:0/904515086 wait complete. 2023-12-19T13:53:43.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.538+0000 7f0419e54640 1 Processor -- start 2023-12-19T13:53:43.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.538+0000 7f0419e54640 1 -- start start 2023-12-19T13:53:43.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419e54640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04140b1d90 0x7f04140b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419e54640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04140d3650 0x7f041415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419e54640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041415d4e0 0x7f041414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419e54640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140b6ba0 con 0x7f041415d4e0 2023-12-19T13:53:43.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419e54640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140b6db0 con 0x7f04140b1d90 2023-12-19T13:53:43.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419e54640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04140b7090 con 0x7f04140d3650 2023-12-19T13:53:43.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041415d4e0 0x7f041414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:43.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041415d4e0 0x7f041414a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40758/0 (socket says 172.21.15.113:40758) 2023-12-19T13:53:43.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 -- 172.21.15.113:0/1547223804 learned_addr learned my addr 172.21.15.113:0/1547223804 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:43.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0413fff640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04140d3650 0x7f041415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:43.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 -- 172.21.15.113:0/1547223804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04140d3650 msgr2=0x7f041415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04140d3650 0x7f041415ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 -- 172.21.15.113:0/1547223804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04140b1d90 msgr2=0x7f04140b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:43.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04140b1d90 0x7f04140b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:43.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.539+0000 7f0419653640 1 -- 172.21.15.113:0/1547223804 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc009400 con 0x7f041415d4e0 2023-12-19T13:53:43.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.540+0000 7f0419653640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041415d4e0 0x7f041414a5e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c390 tx=0x7f040c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:43.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.540+0000 7f04117fa640 1 -- 172.21.15.113:0/1547223804 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0035f0 con 0x7f041415d4e0 2023-12-19T13:53:43.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.540+0000 7f04117fa640 1 -- 172.21.15.113:0/1547223804 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c003750 con 0x7f041415d4e0 2023-12-19T13:53:43.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.540+0000 7f04117fa640 1 -- 172.21.15.113:0/1547223804 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c003b00 con 0x7f041415d4e0 2023-12-19T13:53:43.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.540+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04140b7370 con 0x7f041415d4e0 2023-12-19T13:53:43.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.540+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041415f3c0 con 0x7f041415d4e0 2023-12-19T13:53:43.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.541+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04140b7890 con 0x7f041415d4e0 2023-12-19T13:53:43.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.542+0000 7f04117fa640 1 -- 172.21.15.113:0/1547223804 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f040c003c60 con 0x7f041415d4e0 2023-12-19T13:53:43.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.543+0000 7f04117fa640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03f406a430 0x7f03f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:43.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.543+0000 7f04117fa640 1 -- 172.21.15.113:0/1547223804 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f040c0878d0 con 0x7f041415d4e0 2023-12-19T13:53:43.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.544+0000 7f0418e52640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03f406a430 0x7f03f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:43.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.544+0000 7f0418e52640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03f406a430 0x7f03f406c8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0404001560 tx=0x7f0404007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:43.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.548+0000 7f04117fa640 1 -- 172.21.15.113:0/1547223804 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f04140b7890 con 0x7f041415d4e0 2023-12-19T13:53:43.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:43.738+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f04140b7890 con 0x7f041415d4e0 2023-12-19T13:53:44.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.576+0000 7f04117fa640 1 -- 172.21.15.113:0/1547223804 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v129) v1 ==== 138+0+0 (secure 0 0 0) 0x7f04140b7890 con 0x7f041415d4e0 2023-12-19T13:53:44.576 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:53:44.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.580+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03f406a430 msgr2=0x7f03f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:44.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.580+0000 7f0419e54640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03f406a430 0x7f03f406c8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0404001560 tx=0x7f0404007ca0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.580+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041415d4e0 msgr2=0x7f041414a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:44.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.580+0000 7f0419e54640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041415d4e0 0x7f041414a5e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c390 tx=0x7f040c00c850 comp rx=0 tx=0).stop 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 shutdown_connections 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f03f406a430 0x7f03f406c8f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f041415d4e0 0x7f041414a5e0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04140d3650 0x7f041415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 --2- 172.21.15.113:0/1547223804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04140b1d90 0x7f04140b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 >> 172.21.15.113:0/1547223804 conn(0x7f0414072f40 msgr2=0x7f04140b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 shutdown_connections 2023-12-19T13:53:44.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.581+0000 7f0419e54640 1 -- 172.21.15.113:0/1547223804 wait complete. 2023-12-19T13:53:44.603 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:53:44.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.824+0000 7f1eb148b640 1 Processor -- start 2023-12-19T13:53:44.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.824+0000 7f1eb148b640 1 -- start start 2023-12-19T13:53:44.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eb148b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1eac0cae20 0x7f1eac070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eb148b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 0x7f1eac06b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eb148b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac0cb2d0 con 0x7f1eac15a2d0 2023-12-19T13:53:44.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eb148b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac071470 con 0x7f1eac0cae20 2023-12-19T13:53:44.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eb148b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0cc1f0 con 0x7f1eac071040 2023-12-19T13:53:44.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eaaffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1eac15a2d0 0x7f1eac0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51294/0 (socket says 172.21.15.113:51294) 2023-12-19T13:53:44.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eaaffd640 1 -- 172.21.15.113:0/946795496 learned_addr learned my addr 172.21.15.113:0/946795496 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:44.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/946795496 >> v2:172.21.15.151:3300/0 conn(0x7f1eac0cae20 0x7f1eac070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1eab7fe640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 0x7f1eac06b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593730672 0 0) 0x7f1e9c001110 con 0x7f1eac15a2d0 2023-12-19T13:53:44.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.826+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e94003520 con 0x7f1eac15a2d0 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 264976097 0 0) 0x7f1e94003520 con 0x7f1eac15a2d0 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 msgr2=0x7f1eac06b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 0x7f1eac06b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 >> v2:172.21.15.151:3300/0 conn(0x7f1eac0cae20 msgr2=0x7f1eac070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 --2- 172.21.15.113:0/946795496 >> v2:172.21.15.151:3300/0 conn(0x7f1eac0cae20 0x7f1eac070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac06e840 con 0x7f1eac15a2d0 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1e9c001820 con 0x7f1eac15a2d0 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 >> v1:172.21.15.113:6789/0 conn(0x7f1eac15a2d0 legacy=0x7f1eac0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e94003970 0x7f1e94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e940047c0 0x7f1e94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 0x7f1e94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac071470 con 0x7f1e940047c0 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0cc1f0 con 0x7f1e94003970 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9400b9b0 con 0x7f1eac071040 2023-12-19T13:53:44.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.827+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e940047c0 0x7f1e94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eab7fe640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 0x7f1e94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eaaffd640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e94003970 0x7f1e94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eaa7fc640 1 -- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 msgr2=0x7f1e94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 0x7f1e94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eaa7fc640 1 -- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e94003970 msgr2=0x7f1e94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e94003970 0x7f1e94003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eaa7fc640 1 -- 172.21.15.113:0/946795496 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e94003520 con 0x7f1e940047c0 2023-12-19T13:53:44.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.828+0000 7f1eab7fe640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eac071040 0x7f1e94005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:44.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.829+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e940047c0 0x7f1e94004c40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009ac0 tx=0x7f1e940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f565c81084d0141f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:44.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.829+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea002c6d0 con 0x7f1e940047c0 2023-12-19T13:53:44.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.829+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea002c830 con 0x7f1e940047c0 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.829+0000 7f1ea9ffb640 1 -- 172.21.15.113:0/946795496 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea002cbc0 con 0x7f1e940047c0 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.830+0000 7f1eb148b640 1 -- 172.21.15.113:0/946795496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e940047c0 msgr2=0x7f1e94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.830+0000 7f1eb148b640 1 --2- 172.21.15.113:0/946795496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e940047c0 0x7f1e94004c40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009ac0 tx=0x7f1e940057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.830+0000 7f1eab7fe640 1 -- 172.21.15.113:0/946795496 reap_dead start 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.830+0000 7f1eb148b640 1 -- 172.21.15.113:0/946795496 shutdown_connections 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.830+0000 7f1eb148b640 1 -- 172.21.15.113:0/946795496 >> 172.21.15.113:0/946795496 conn(0x7f1eac0cf0b0 msgr2=0x7f1eac0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.830+0000 7f1eb148b640 1 -- 172.21.15.113:0/946795496 shutdown_connections 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.830+0000 7f1eb148b640 1 -- 172.21.15.113:0/946795496 wait complete. 2023-12-19T13:53:44.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.832+0000 7f1eb148b640 1 Processor -- start 2023-12-19T13:53:44.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.832+0000 7f1eb148b640 1 -- start start 2023-12-19T13:53:44.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eb148b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e940047c0 0x7f1eac14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eb148b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eac164a50 0x7f1eac15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eb148b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eac15c920 0x7f1eac15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eb148b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac163c90 con 0x7f1eac164a50 2023-12-19T13:53:44.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eb148b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac163f70 con 0x7f1eac15c920 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eb148b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac164250 con 0x7f1e940047c0 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eaa7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eac164a50 0x7f1eac15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eaa7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eac164a50 0x7f1eac15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40780/0 (socket says 172.21.15.113:40780) 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.833+0000 7f1eaa7fc640 1 -- 172.21.15.113:0/2784589758 learned_addr learned my addr 172.21.15.113:0/2784589758 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eaa7fc640 1 -- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e940047c0 msgr2=0x7f1eac14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e940047c0 0x7f1eac14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eab7fe640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eac15c920 0x7f1eac15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eaa7fc640 1 -- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eac15c920 msgr2=0x7f1eac15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eac15c920 0x7f1eac15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eaa7fc640 1 -- 172.21.15.113:0/2784589758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac164530 con 0x7f1eac164a50 2023-12-19T13:53:44.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eab7fe640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eac15c920 0x7f1eac15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:44.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eaa7fc640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eac164a50 0x7f1eac15c3e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f1ea002c2d0 tx=0x7f1ea0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:44.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1e937fe640 1 -- 172.21.15.113:0/2784589758 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0003810 con 0x7f1eac164a50 2023-12-19T13:53:44.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1e937fe640 1 -- 172.21.15.113:0/2784589758 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0003970 con 0x7f1eac164a50 2023-12-19T13:53:44.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1e937fe640 1 -- 172.21.15.113:0/2784589758 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0003ce0 con 0x7f1eac164a50 2023-12-19T13:53:44.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.834+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac15d1f0 con 0x7f1eac164a50 2023-12-19T13:53:44.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.835+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac15cdd0 con 0x7f1eac164a50 2023-12-19T13:53:44.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.836+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac15cfc0 con 0x7f1eac164a50 2023-12-19T13:53:44.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.837+0000 7f1e937fe640 1 -- 172.21.15.113:0/2784589758 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1ea0040660 con 0x7f1eac164a50 2023-12-19T13:53:44.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.838+0000 7f1e937fe640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9806a430 0x7f1e9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:44.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.838+0000 7f1e937fe640 1 -- 172.21.15.113:0/2784589758 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1ea00aa8f0 con 0x7f1eac164a50 2023-12-19T13:53:44.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.838+0000 7f1eaaffd640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9806a430 0x7f1e9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:44.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.839+0000 7f1eaaffd640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9806a430 0x7f1e9806c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c001eb0 tx=0x7f1e9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:44.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:44.843+0000 7f1e937fe640 1 -- 172.21.15.113:0/2784589758 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1ea0079b40 con 0x7f1eac164a50 2023-12-19T13:53:45.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.036+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1eac074770 con 0x7f1eac164a50 2023-12-19T13:53:45.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.588+0000 7f1e937fe640 1 -- 172.21.15.113:0/2784589758 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v130) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1ea00044e0 con 0x7f1eac164a50 2023-12-19T13:53:45.588 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:53:45.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.599+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9806a430 msgr2=0x7f1e9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:45.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.599+0000 7f1eb148b640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9806a430 0x7f1e9806c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c001eb0 tx=0x7f1e9c009040 comp rx=0 tx=0).stop 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.599+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eac164a50 msgr2=0x7f1eac15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.599+0000 7f1eb148b640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eac164a50 0x7f1eac15c3e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f1ea002c2d0 tx=0x7f1ea0004730 comp rx=0 tx=0).stop 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 shutdown_connections 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1e9806a430 0x7f1e9806c8f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eac15c920 0x7f1eac15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1eac164a50 0x7f1eac15c3e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 --2- 172.21.15.113:0/2784589758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e940047c0 0x7f1eac14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 >> 172.21.15.113:0/2784589758 conn(0x7f1eac0cf0b0 msgr2=0x7f1eac1555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 shutdown_connections 2023-12-19T13:53:45.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.600+0000 7f1eb148b640 1 -- 172.21.15.113:0/2784589758 wait complete. 2023-12-19T13:53:45.626 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:53:45.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.823+0000 7fbcde1ea640 1 Processor -- start 2023-12-19T13:53:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.823+0000 7fbcde1ea640 1 -- start start 2023-12-19T13:53:45.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.825+0000 7fbcde1ea640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbcd80b6430 0x7fbcd80d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.825+0000 7fbcde1ea640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd8161e70 con 0x7fbcd806fc40 2023-12-19T13:53:45.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.825+0000 7fbcde1ea640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd8161260 con 0x7fbcd8146ff0 2023-12-19T13:53:45.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.825+0000 7fbcde1ea640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd8161080 con 0x7fbcd80b6430 2023-12-19T13:53:45.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.825+0000 7fbcd6ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbcd806fc40 0x7fbcd815dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51298/0 (socket says 172.21.15.113:51298) 2023-12-19T13:53:45.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.825+0000 7fbcd6ffd640 1 -- 172.21.15.113:0/3067047007 learned_addr learned my addr 172.21.15.113:0/3067047007 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:45.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd7fff640 1 --2- 172.21.15.113:0/3067047007 >> v2:172.21.15.151:3300/0 conn(0x7fbcd80b6430 0x7fbcd80d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:45.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194670537 0 0) 0x7fbcd8161e70 con 0x7fbcd806fc40 2023-12-19T13:53:45.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc4003520 con 0x7fbcd806fc40 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258098 0 0) 0x7fbcc4003520 con 0x7fbcd806fc40 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 >> v2:172.21.15.151:3300/0 conn(0x7fbcd80b6430 msgr2=0x7fbcd80d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 --2- 172.21.15.113:0/3067047007 >> v2:172.21.15.151:3300/0 conn(0x7fbcd80b6430 0x7fbcd80d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 >> v1:172.21.15.151:6789/0 conn(0x7fbcd8146ff0 legacy=0x7fbcd806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd8161540 con 0x7fbcd806fc40 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbcc0001670 con 0x7fbcd806fc40 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 >> v1:172.21.15.113:6789/0 conn(0x7fbcd806fc40 legacy=0x7fbcd815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.826+0000 7fbcd67fc640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcc4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd67fc640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcc40047c0 0x7fbcc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd67fc640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcc4005180 0x7fbcc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8161080 con 0x7fbcc40039e0 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc400c0b0 con 0x7fbcc40047c0 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc400c270 con 0x7fbcc4005180 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd77fe640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcc4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd6ffd640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcc40047c0 0x7fbcc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd77fe640 1 -- 172.21.15.113:0/3067047007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcc4005180 msgr2=0x7fbcc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd77fe640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcc4005180 0x7fbcc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd77fe640 1 -- 172.21.15.113:0/3067047007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcc40047c0 msgr2=0x7fbcc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd77fe640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcc40047c0 0x7fbcc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd77fe640 1 -- 172.21.15.113:0/3067047007 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc4003520 con 0x7fbcc40039e0 2023-12-19T13:53:45.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.827+0000 7fbcd7fff640 1 -- 172.21.15.113:0/3067047007 reap_dead start 2023-12-19T13:53:45.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.828+0000 7fbcd77fe640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcc4003e00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001750 tx=0x7fbcc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109aae3b73df2262 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:45.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80052d0 con 0x7fbcc40039e0 2023-12-19T13:53:45.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc802e050 con 0x7fbcc40039e0 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcd67fc640 1 -- 172.21.15.113:0/3067047007 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8003830 con 0x7fbcc40039e0 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcde1ea640 1 -- 172.21.15.113:0/3067047007 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 msgr2=0x7fbcc4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcc4003e00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001750 tx=0x7fbcc40057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcde1ea640 1 -- 172.21.15.113:0/3067047007 shutdown_connections 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/3067047007 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcc4003e00 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcde1ea640 1 -- 172.21.15.113:0/3067047007 >> 172.21.15.113:0/3067047007 conn(0x7fbcd80d3520 msgr2=0x7fbcd80d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.829+0000 7fbcde1ea640 1 -- 172.21.15.113:0/3067047007 shutdown_connections 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.830+0000 7fbcde1ea640 1 -- 172.21.15.113:0/3067047007 wait complete. 2023-12-19T13:53:45.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.831+0000 7fbcde1ea640 1 Processor -- start 2023-12-19T13:53:45.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.831+0000 7fbcde1ea640 1 -- start start 2023-12-19T13:53:45.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.832+0000 7fbcde1ea640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcd81f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.832+0000 7fbcde1ea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd813ba90 0x7fbcd813e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.832+0000 7fbcde1ea640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd813bf10 0x7fbcd8141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.832+0000 7fbcde1ea640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81f6e90 con 0x7fbcc40039e0 2023-12-19T13:53:45.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.832+0000 7fbcde1ea640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81407c0 con 0x7fbcd813ba90 2023-12-19T13:53:45.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.832+0000 7fbcde1ea640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8140aa0 con 0x7fbcd813bf10 2023-12-19T13:53:45.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcd81f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcd81f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40808/0 (socket says 172.21.15.113:40808) 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 -- 172.21.15.113:0/1813084932 learned_addr learned my addr 172.21.15.113:0/1813084932 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd6ffd640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd813ba90 0x7fbcd813e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd7fff640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd813bf10 0x7fbcd8141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 -- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd813bf10 msgr2=0x7fbcd8141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd813bf10 0x7fbcd8141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 -- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd813ba90 msgr2=0x7fbcd813e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd813ba90 0x7fbcd813e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 -- 172.21.15.113:0/1813084932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd8140d80 con 0x7fbcc40039e0 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd7fff640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd813bf10 0x7fbcd8141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd6ffd640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd813ba90 0x7fbcd813e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.833+0000 7fbcd77fe640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcd81f61f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fbcc802bc30 tx=0x7fbcc8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.834+0000 7fbccffff640 1 -- 172.21.15.113:0/1813084932 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80076c0 con 0x7fbcc40039e0 2023-12-19T13:53:45.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.834+0000 7fbccffff640 1 -- 172.21.15.113:0/1813084932 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc8007a30 con 0x7fbcc40039e0 2023-12-19T13:53:45.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.834+0000 7fbccffff640 1 -- 172.21.15.113:0/1813084932 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8006be0 con 0x7fbcc40039e0 2023-12-19T13:53:45.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.834+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd8141060 con 0x7fbcc40039e0 2023-12-19T13:53:45.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.834+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd81404d0 con 0x7fbcc40039e0 2023-12-19T13:53:45.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.835+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd8061910 con 0x7fbcc40039e0 2023-12-19T13:53:45.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.836+0000 7fbccffff640 1 -- 172.21.15.113:0/1813084932 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbcc8006d40 con 0x7fbcc40039e0 2023-12-19T13:53:45.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.837+0000 7fbccffff640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcb806a460 0x7fbcb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:45.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.837+0000 7fbccffff640 1 -- 172.21.15.113:0/1813084932 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbcc80aa9f0 con 0x7fbcc40039e0 2023-12-19T13:53:45.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.838+0000 7fbcd6ffd640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcb806a460 0x7fbcb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:45.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.838+0000 7fbcd6ffd640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcb806a460 0x7fbcb806c920 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0001eb0 tx=0x7fbcc0000f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:45.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:45.841+0000 7fbccffff640 1 -- 172.21.15.113:0/1813084932 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbcc8076140 con 0x7fbcc40039e0 2023-12-19T13:53:46.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.067+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbcd80d4400 con 0x7fbcc40039e0 2023-12-19T13:53:46.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.079+0000 7fbccffff640 1 -- 172.21.15.113:0/1813084932 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v53) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbcc8079760 con 0x7fbcc40039e0 2023-12-19T13:53:46.079 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 14 and data pool 15 2023-12-19T13:53:46.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.084+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcb806a460 msgr2=0x7fbcb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.084+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcb806a460 0x7fbcb806c920 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0001eb0 tx=0x7fbcc0000f10 comp rx=0 tx=0).stop 2023-12-19T13:53:46.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.084+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 msgr2=0x7fbcd81f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.084+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcd81f61f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fbcc802bc30 tx=0x7fbcc8001120 comp rx=0 tx=0).stop 2023-12-19T13:53:46.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 shutdown_connections 2023-12-19T13:53:46.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbcb806a460 0x7fbcb806c920 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd813bf10 0x7fbcd8141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd813ba90 0x7fbcd813e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 --2- 172.21.15.113:0/1813084932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbcc40039e0 0x7fbcd81f61f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 >> 172.21.15.113:0/1813084932 conn(0x7fbcd80d3520 msgr2=0x7fbcd806f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:46.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 shutdown_connections 2023-12-19T13:53:46.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.085+0000 7fbcde1ea640 1 -- 172.21.15.113:0/1813084932 wait complete. 2023-12-19T13:53:46.112 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:46.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.296+0000 7f85063d0640 1 Processor -- start 2023-12-19T13:53:46.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.296+0000 7f85063d0640 1 -- start start 2023-12-19T13:53:46.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.297+0000 7f85063d0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f850006c6b0 0x7f8500166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.297+0000 7f85063d0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850006bb30 con 0x7f85000b0b50 2023-12-19T13:53:46.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.297+0000 7f85063d0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000b0070 con 0x7f85001449e0 2023-12-19T13:53:46.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.297+0000 7f85063d0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000b0350 con 0x7f850006c6b0 2023-12-19T13:53:46.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.298+0000 7f84f7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f85000b0b50 0x7f850006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51310/0 (socket says 172.21.15.113:51310) 2023-12-19T13:53:46.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.298+0000 7f84f7fff640 1 -- 172.21.15.113:0/3498034511 learned_addr learned my addr 172.21.15.113:0/3498034511 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:46.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.298+0000 7f850496d640 1 --2- 172.21.15.113:0/3498034511 >> v2:172.21.15.151:3300/0 conn(0x7f850006c6b0 0x7f8500166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.298+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542832244 0 0) 0x7f850006bb30 con 0x7f85000b0b50 2023-12-19T13:53:46.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.298+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ec003520 con 0x7f85000b0b50 2023-12-19T13:53:46.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3904468458 0 0) 0x7f84ec003520 con 0x7f85000b0b50 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 >> v2:172.21.15.151:3300/0 conn(0x7f850006c6b0 msgr2=0x7f8500166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 --2- 172.21.15.113:0/3498034511 >> v2:172.21.15.151:3300/0 conn(0x7f850006c6b0 0x7f8500166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 >> v1:172.21.15.151:6789/0 conn(0x7f85001449e0 legacy=0x7f85000af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000b0630 con 0x7f85000b0b50 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f84e8001670 con 0x7f85000b0b50 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 >> v1:172.21.15.113:6789/0 conn(0x7f85000b0b50 legacy=0x7f850006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84ec003a30 0x7f84ec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84ec0047c0 0x7f84ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f84ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000b0350 con 0x7f84ec0051d0 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec00c100 con 0x7f84ec0047c0 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec00c2c0 con 0x7f84ec003a30 2023-12-19T13:53:46.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.299+0000 7f850496d640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f84ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f84fffff640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84ec003a30 0x7f84ec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f850496d640 1 -- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84ec003a30 msgr2=0x7f84ec003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f850496d640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84ec003a30 0x7f84ec003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f850496d640 1 -- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84ec0047c0 msgr2=0x7f84ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f84f7fff640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84ec0047c0 0x7f84ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f850496d640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84ec0047c0 0x7f84ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f850496d640 1 -- 172.21.15.113:0/3498034511 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec003520 con 0x7f84ec0051d0 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f84f7fff640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84ec0047c0 0x7f84ec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:46.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.300+0000 7f84fffff640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84ec003a30 0x7f84ec003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:46.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.301+0000 7f850496d640 1 -- 172.21.15.113:0/3498034511 reap_dead start 2023-12-19T13:53:46.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.301+0000 7f850496d640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f84ec00b980 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009f90 tx=0x7f84ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdb73ab01a19b00 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.301+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f802cc20 con 0x7f84ec0051d0 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.301+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f800f040 con 0x7f84ec0051d0 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.301+0000 7f84ff7fe640 1 -- 172.21.15.113:0/3498034511 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8003990 con 0x7f84ec0051d0 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.302+0000 7f85063d0640 1 -- 172.21.15.113:0/3498034511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 msgr2=0x7f84ec00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.302+0000 7f85063d0640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f84ec00b980 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009f90 tx=0x7f84ec0057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.302+0000 7f85063d0640 1 -- 172.21.15.113:0/3498034511 shutdown_connections 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.302+0000 7f85063d0640 1 --2- 172.21.15.113:0/3498034511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f84ec00b980 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.302+0000 7f85063d0640 1 -- 172.21.15.113:0/3498034511 >> 172.21.15.113:0/3498034511 conn(0x7f85000cbb70 msgr2=0x7f85000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.302+0000 7f85063d0640 1 -- 172.21.15.113:0/3498034511 shutdown_connections 2023-12-19T13:53:46.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.302+0000 7f85063d0640 1 -- 172.21.15.113:0/3498034511 wait complete. 2023-12-19T13:53:46.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.304+0000 7f85063d0640 1 Processor -- start 2023-12-19T13:53:46.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.304+0000 7f85063d0640 1 -- start start 2023-12-19T13:53:46.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f85063d0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f85001f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f85063d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f850015dbd0 0x7f850015e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f85063d0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f850015baa0 0x7f850015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f85063d0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850015e590 con 0x7f84ec0051d0 2023-12-19T13:53:46.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f85063d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850015c830 con 0x7f850015dbd0 2023-12-19T13:53:46.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f85063d0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850015cb10 con 0x7f850015baa0 2023-12-19T13:53:46.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f84fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f85001f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f84fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f85001f1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40816/0 (socket says 172.21.15.113:40816) 2023-12-19T13:53:46.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.305+0000 7f84fffff640 1 -- 172.21.15.113:0/3626365285 learned_addr learned my addr 172.21.15.113:0/3626365285 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fffff640 1 -- 172.21.15.113:0/3626365285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f850015baa0 msgr2=0x7f850015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fffff640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f850015baa0 0x7f850015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fffff640 1 -- 172.21.15.113:0/3626365285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f850015dbd0 msgr2=0x7f850015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fffff640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f850015dbd0 0x7f850015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fffff640 1 -- 172.21.15.113:0/3626365285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850015cdf0 con 0x7f84ec0051d0 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fffff640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f85001f1900 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f84f0000f60 tx=0x7f84f000d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fd7fa640 1 -- 172.21.15.113:0/3626365285 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0005480 con 0x7f84ec0051d0 2023-12-19T13:53:46.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fd7fa640 1 -- 172.21.15.113:0/3626365285 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0003610 con 0x7f84ec0051d0 2023-12-19T13:53:46.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f84fd7fa640 1 -- 172.21.15.113:0/3626365285 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00039c0 con 0x7f84ec0051d0 2023-12-19T13:53:46.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850015d0d0 con 0x7f84ec0051d0 2023-12-19T13:53:46.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.306+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850015c460 con 0x7f84ec0051d0 2023-12-19T13:53:46.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.307+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8500061910 con 0x7f84ec0051d0 2023-12-19T13:53:46.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.308+0000 7f84fd7fa640 1 -- 172.21.15.113:0/3626365285 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84f0003b20 con 0x7f84ec0051d0 2023-12-19T13:53:46.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.309+0000 7f84fd7fa640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f84e006a430 0x7f84e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.309+0000 7f84fd7fa640 1 -- 172.21.15.113:0/3626365285 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84f0088840 con 0x7f84ec0051d0 2023-12-19T13:53:46.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.309+0000 7f84f7fff640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f84e006a430 0x7f84e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.310+0000 7f84f7fff640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f84e006a430 0x7f84e006c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f84e8000c00 tx=0x7f84e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:46.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.314+0000 7f84fd7fa640 1 -- 172.21.15.113:0/3626365285 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f84f0053ee0 con 0x7f84ec0051d0 2023-12-19T13:53:46.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.505+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85000ae560 con 0x7f84ec0051d0 2023-12-19T13:53:46.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.508+0000 7f84fd7fa640 1 -- 172.21.15.113:0/3626365285 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f84f0001230 con 0x7f84ec0051d0 2023-12-19T13:53:46.507 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:46.507 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":131,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:46.068996+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.510+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f84e006a430 msgr2=0x7f84e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f84e006a430 0x7f84e006c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f84e8000c00 tx=0x7f84e8009040 comp rx=0 tx=0).stop 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 msgr2=0x7f85001f1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f85001f1900 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f84f0000f60 tx=0x7f84f000d9f0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 shutdown_connections 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f84e006a430 0x7f84e006c8f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f850015baa0 0x7f850015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f850015dbd0 0x7f850015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 --2- 172.21.15.113:0/3626365285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f84ec0051d0 0x7f85001f1900 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 >> 172.21.15.113:0/3626365285 conn(0x7f85000cbb70 msgr2=0x7f85000ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:46.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 shutdown_connections 2023-12-19T13:53:46.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.511+0000 7f85063d0640 1 -- 172.21.15.113:0/3626365285 wait complete. 2023-12-19T13:53:46.530 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:46.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.743+0000 7f30957e0640 1 Processor -- start 2023-12-19T13:53:46.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.744+0000 7f30957e0640 1 -- start start 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.745+0000 7f30957e0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30900d2b60 0x7f30900d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.745+0000 7f30957e0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3090142bf0 0x7f3090143040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.745+0000 7f30957e0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3090143940 con 0x7f3090070750 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.745+0000 7f30957e0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3090070b30 con 0x7f30900d2b60 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30957e0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30900d1060 con 0x7f3090142bf0 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30867fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30900d2b60 0x7f30900d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30867fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30900d2b60 0x7f30900d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40818/0 (socket says 172.21.15.113:40818) 2023-12-19T13:53:46.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30867fc640 1 -- 172.21.15.113:0/4208917335 learned_addr learned my addr 172.21.15.113:0/4208917335 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:46.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30867fc640 1 -- 172.21.15.113:0/4208917335 >> v2:172.21.15.151:3300/0 conn(0x7f3090142bf0 msgr2=0x7f3090143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:46.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f308f7fe640 1 --2- 172.21.15.113:0/4208917335 >> v2:172.21.15.151:3300/0 conn(0x7f3090142bf0 0x7f3090143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30867fc640 1 --2- 172.21.15.113:0/4208917335 >> v2:172.21.15.151:3300/0 conn(0x7f3090142bf0 0x7f3090143040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30867fc640 1 -- 172.21.15.113:0/4208917335 >> v1:172.21.15.151:6789/0 conn(0x7f3090070750 legacy=0x7f30900d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:46.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.746+0000 7f30867fc640 1 -- 172.21.15.113:0/4208917335 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900cfd60 con 0x7f30900d2b60 2023-12-19T13:53:46.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.748+0000 7f30867fc640 1 --2- 172.21.15.113:0/4208917335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f30900d0b20 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f30900b24f0 tx=0x7f307802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f22213bf7181ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:46.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.748+0000 7f308e7fc640 1 -- 172.21.15.113:0/4208917335 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078031870 con 0x7f30900d2b60 2023-12-19T13:53:46.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.748+0000 7f308e7fc640 1 -- 172.21.15.113:0/4208917335 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780319d0 con 0x7f30900d2b60 2023-12-19T13:53:46.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.748+0000 7f308e7fc640 1 -- 172.21.15.113:0/4208917335 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078031d60 con 0x7f30900d2b60 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.748+0000 7f30957e0640 1 -- 172.21.15.113:0/4208917335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 msgr2=0x7f30900d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.748+0000 7f30957e0640 1 --2- 172.21.15.113:0/4208917335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f30900d0b20 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f30900b24f0 tx=0x7f307802b910 comp rx=0 tx=0).stop 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.749+0000 7f30957e0640 1 -- 172.21.15.113:0/4208917335 shutdown_connections 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.749+0000 7f30957e0640 1 --2- 172.21.15.113:0/4208917335 >> v2:172.21.15.151:3300/0 conn(0x7f3090142bf0 0x7f3090143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.749+0000 7f30957e0640 1 --2- 172.21.15.113:0/4208917335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f30900d0b20 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.749+0000 7f30957e0640 1 -- 172.21.15.113:0/4208917335 >> 172.21.15.113:0/4208917335 conn(0x7f30900b2540 msgr2=0x7f30900b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.749+0000 7f30957e0640 1 -- 172.21.15.113:0/4208917335 shutdown_connections 2023-12-19T13:53:46.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.749+0000 7f30957e0640 1 -- 172.21.15.113:0/4208917335 wait complete. 2023-12-19T13:53:46.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.750+0000 7f30957e0640 1 Processor -- start 2023-12-19T13:53:46.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.750+0000 7f30957e0640 1 -- start start 2023-12-19T13:53:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.751+0000 7f30957e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3090070750 0x7f30900ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.751+0000 7f30957e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f3090160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.751+0000 7f30957e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3090142bf0 0x7f30900c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.751+0000 7f30957e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309013d7f0 con 0x7f30900d2b60 2023-12-19T13:53:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.751+0000 7f30957e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3090161300 con 0x7f3090142bf0 2023-12-19T13:53:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.751+0000 7f30957e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30901f60c0 con 0x7f3090070750 2023-12-19T13:53:46.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f3090160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f3090160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40828/0 (socket says 172.21.15.113:40828) 2023-12-19T13:53:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 -- 172.21.15.113:0/4257417068 learned_addr learned my addr 172.21.15.113:0/4257417068 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 -- 172.21.15.113:0/4257417068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3090070750 msgr2=0x7f30900ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3090070750 0x7f30900ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 -- 172.21.15.113:0/4257417068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3090142bf0 msgr2=0x7f30900c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3090142bf0 0x7f30900c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 -- 172.21.15.113:0/4257417068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780094d0 con 0x7f30900d2b60 2023-12-19T13:53:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.752+0000 7f30867fc640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f3090160dc0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f3078000c00 tx=0x7f30780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.753+0000 7f3087fff640 1 -- 172.21.15.113:0/4257417068 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078031840 con 0x7f30900d2b60 2023-12-19T13:53:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.753+0000 7f3087fff640 1 -- 172.21.15.113:0/4257417068 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780443f0 con 0x7f30900d2b60 2023-12-19T13:53:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.753+0000 7f3087fff640 1 -- 172.21.15.113:0/4257417068 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780447a0 con 0x7f30900d2b60 2023-12-19T13:53:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.753+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30901f63a0 con 0x7f30900d2b60 2023-12-19T13:53:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.753+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30901f6960 con 0x7f30900d2b60 2023-12-19T13:53:46.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.754+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3090061910 con 0x7f30900d2b60 2023-12-19T13:53:46.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.755+0000 7f3087fff640 1 -- 172.21.15.113:0/4257417068 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f307804d450 con 0x7f30900d2b60 2023-12-19T13:53:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.756+0000 7f3087fff640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f307006a430 0x7f307006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.756+0000 7f3087fff640 1 -- 172.21.15.113:0/4257417068 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f307802d040 con 0x7f30900d2b60 2023-12-19T13:53:46.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.756+0000 7f308effd640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f307006a430 0x7f307006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:46.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.757+0000 7f308effd640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f307006a430 0x7f307006c8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f308000ab90 tx=0x7f3080009230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:46.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.760+0000 7f3087fff640 1 -- 172.21.15.113:0/4257417068 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f30780766f0 con 0x7f30900d2b60 2023-12-19T13:53:46.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.952+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30900b6d80 con 0x7f30900d2b60 2023-12-19T13:53:46.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.955+0000 7f3087fff640 1 -- 172.21.15.113:0/4257417068 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f3078079d10 con 0x7f30900d2b60 2023-12-19T13:53:46.955 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:46.955 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":131,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:46.068996+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:46.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f307006a430 msgr2=0x7f307006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f307006a430 0x7f307006c8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f308000ab90 tx=0x7f3080009230 comp rx=0 tx=0).stop 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 msgr2=0x7f3090160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f3090160dc0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f3078000c00 tx=0x7f30780046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 shutdown_connections 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f307006a430 0x7f307006c8f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3090142bf0 0x7f30900c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30900d2b60 0x7f3090160dc0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 --2- 172.21.15.113:0/4257417068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3090070750 0x7f30900ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 >> 172.21.15.113:0/4257417068 conn(0x7f30900b2540 msgr2=0x7f309006f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 shutdown_connections 2023-12-19T13:53:46.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:46.958+0000 7f30957e0640 1 -- 172.21.15.113:0/4257417068 wait complete. 2023-12-19T13:53:46.975 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:53:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.190+0000 7f83fe417640 1 Processor -- start 2023-12-19T13:53:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.191+0000 7f83fe417640 1 -- start start 2023-12-19T13:53:47.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.192+0000 7f83fe417640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f83f8146e10 0x7f83f80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:47.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.192+0000 7f83fe417640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80cd840 con 0x7f83f80d2b00 2023-12-19T13:53:47.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.192+0000 7f83fe417640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80b6e90 con 0x7f83f80ce110 2023-12-19T13:53:47.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.192+0000 7f83fe417640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f80d2430 con 0x7f83f8146e10 2023-12-19T13:53:47.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.193+0000 7f83f7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f83f8146e10 0x7f83f80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:47.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.193+0000 7f83ef7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f83f80d2b00 0x7f83f80b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51324/0 (socket says 172.21.15.113:51324) 2023-12-19T13:53:47.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.193+0000 7f83ef7fe640 1 -- 172.21.15.113:0/2111590239 learned_addr learned my addr 172.21.15.113:0/2111590239 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:47.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.193+0000 7f83f7fff640 1 -- 172.21.15.113:0/2111590239 >> v1:172.21.15.151:6789/0 conn(0x7f83f80ce110 legacy=0x7f83f80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:47.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.193+0000 7f83f7fff640 1 -- 172.21.15.113:0/2111590239 >> v1:172.21.15.113:6789/0 conn(0x7f83f80d2b00 legacy=0x7f83f80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:47.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.193+0000 7f83f7fff640 1 -- 172.21.15.113:0/2111590239 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80d2620 con 0x7f83f8146e10 2023-12-19T13:53:47.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.193+0000 7f83f77fe640 1 -- 172.21.15.113:0/2111590239 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702081777 0 0) 0x7f83f80cd840 con 0x7f83f80d2b00 2023-12-19T13:53:47.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.194+0000 7f83f7fff640 1 --2- 172.21.15.113:0/2111590239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80d1ef0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f83e80097a0 tx=0x7f83e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6c3fdeeffb5d62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:47.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83f77fe640 1 -- 172.21.15.113:0/2111590239 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e802e070 con 0x7f83f8146e10 2023-12-19T13:53:47.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83f77fe640 1 -- 172.21.15.113:0/2111590239 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e80315a0 con 0x7f83f8146e10 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83f77fe640 1 -- 172.21.15.113:0/2111590239 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e8031930 con 0x7f83f8146e10 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83fe417640 1 -- 172.21.15.113:0/2111590239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 msgr2=0x7f83f80d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83fe417640 1 --2- 172.21.15.113:0/2111590239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80d1ef0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f83e80097a0 tx=0x7f83e802b840 comp rx=0 tx=0).stop 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83fe417640 1 -- 172.21.15.113:0/2111590239 shutdown_connections 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83fe417640 1 --2- 172.21.15.113:0/2111590239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80d1ef0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83fe417640 1 -- 172.21.15.113:0/2111590239 >> 172.21.15.113:0/2111590239 conn(0x7f83f80b29c0 msgr2=0x7f83f80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83fe417640 1 -- 172.21.15.113:0/2111590239 shutdown_connections 2023-12-19T13:53:47.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.195+0000 7f83fe417640 1 -- 172.21.15.113:0/2111590239 wait complete. 2023-12-19T13:53:47.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.197+0000 7f83fe417640 1 Processor -- start 2023-12-19T13:53:47.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.198+0000 7f83fe417640 1 -- start start 2023-12-19T13:53:47.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fe417640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f80ce110 0x7f83f815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:47.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fe417640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f80d2b00 0x7f83f80c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:47.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fe417640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:47.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fe417640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80c9290 con 0x7f83f8146e10 2023-12-19T13:53:47.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fe417640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80c83a0 con 0x7f83f80d2b00 2023-12-19T13:53:47.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fe417640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80c8680 con 0x7f83f80ce110 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fc9b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fc9b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40848/0 (socket says 172.21.15.113:40848) 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.199+0000 7f83fc9b4640 1 -- 172.21.15.113:0/3327316298 learned_addr learned my addr 172.21.15.113:0/3327316298 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83f7fff640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f80ce110 0x7f83f815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83ef7fe640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f80d2b00 0x7f83f80c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83fc9b4640 1 -- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f80ce110 msgr2=0x7f83f815c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83fc9b4640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f80ce110 0x7f83f815c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83fc9b4640 1 -- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f80d2b00 msgr2=0x7f83f80c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83fc9b4640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f80d2b00 0x7f83f80c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:47.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83fc9b4640 1 -- 172.21.15.113:0/3327316298 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e8009400 con 0x7f83f8146e10 2023-12-19T13:53:47.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83fc9b4640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80c9ef0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c780 tx=0x7f83f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:47.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83f57fa640 1 -- 172.21.15.113:0/3327316298 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0004b60 con 0x7f83f8146e10 2023-12-19T13:53:47.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83f57fa640 1 -- 172.21.15.113:0/3327316298 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f000ce90 con 0x7f83f8146e10 2023-12-19T13:53:47.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83f57fa640 1 -- 172.21.15.113:0/3327316298 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000a850 con 0x7f83f8146e10 2023-12-19T13:53:47.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.200+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f80c8960 con 0x7f83f8146e10 2023-12-19T13:53:47.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.201+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f80c8f20 con 0x7f83f8146e10 2023-12-19T13:53:47.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.202+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f80c9440 con 0x7f83f8146e10 2023-12-19T13:53:47.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.203+0000 7f83f57fa640 1 -- 172.21.15.113:0/3327316298 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f83f000a9b0 con 0x7f83f8146e10 2023-12-19T13:53:47.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.204+0000 7f83f57fa640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f83d806a430 0x7f83d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:47.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.204+0000 7f83f57fa640 1 -- 172.21.15.113:0/3327316298 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83f0088ac0 con 0x7f83f8146e10 2023-12-19T13:53:47.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.204+0000 7f83f7fff640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f83d806a430 0x7f83d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:47.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.205+0000 7f83f7fff640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f83d806a430 0x7f83d806c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f83e8036000 tx=0x7f83e803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:47.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.208+0000 7f83f57fa640 1 -- 172.21.15.113:0/3327316298 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f83f80c9440 con 0x7f83f8146e10 2023-12-19T13:53:47.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:47.435+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83f8061910 con 0x7f83f8146e10 2023-12-19T13:53:48.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.098+0000 7f83f57fa640 1 -- 172.21.15.113:0/3327316298 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83f0088e60 con 0x7f83f8146e10 2023-12-19T13:53:48.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.101+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f83d806a430 msgr2=0x7f83d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:48.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.101+0000 7f83fe417640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f83d806a430 0x7f83d806c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f83e8036000 tx=0x7f83e803d040 comp rx=0 tx=0).stop 2023-12-19T13:53:48.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 msgr2=0x7f83f80c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:48.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80c9ef0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c780 tx=0x7f83f000cc40 comp rx=0 tx=0).stop 2023-12-19T13:53:48.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 shutdown_connections 2023-12-19T13:53:48.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f83d806a430 0x7f83d806c8f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83f8146e10 0x7f83f80c9ef0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f80d2b00 0x7f83f80c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 --2- 172.21.15.113:0/3327316298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f80ce110 0x7f83f815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 >> 172.21.15.113:0/3327316298 conn(0x7f83f80b29c0 msgr2=0x7f83f80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:48.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 shutdown_connections 2023-12-19T13:53:48.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.102+0000 7f83fe417640 1 -- 172.21.15.113:0/3327316298 wait complete. 2023-12-19T13:53:48.121 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:53:48.121 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:53:48.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.333+0000 7f67611b8640 1 Processor -- start 2023-12-19T13:53:48.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.334+0000 7f67611b8640 1 -- start start 2023-12-19T13:53:48.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.335+0000 7f67611b8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c155460 0x7f675c0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:48.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.335+0000 7f67611b8640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f675c0b0830 0x7f675c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:48.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.335+0000 7f67611b8640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c15c9c0 con 0x7f675c06ca80 2023-12-19T13:53:48.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.335+0000 7f67611b8640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c0b0cb0 con 0x7f675c0b0830 2023-12-19T13:53:48.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.335+0000 7f67611b8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c06d270 con 0x7f675c155460 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.336+0000 7f675bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c155460 0x7f675c0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.336+0000 7f675bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c155460 0x7f675c0b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:42318/0 (socket says 172.21.15.113:42318) 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.336+0000 7f675bfff640 1 -- 172.21.15.113:0/4095332096 learned_addr learned my addr 172.21.15.113:0/4095332096 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.336+0000 7f6753fff640 1 --2- 172.21.15.113:0/4095332096 >> v2:172.21.15.151:3300/0 conn(0x7f675c0b0830 0x7f675c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.337+0000 7f675bfff640 1 -- 172.21.15.113:0/4095332096 >> v2:172.21.15.151:3300/0 conn(0x7f675c0b0830 msgr2=0x7f675c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.337+0000 7f675bfff640 1 --2- 172.21.15.113:0/4095332096 >> v2:172.21.15.151:3300/0 conn(0x7f675c0b0830 0x7f675c06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.337+0000 7f675bfff640 1 -- 172.21.15.113:0/4095332096 >> v1:172.21.15.151:6789/0 conn(0x7f675c06ca80 legacy=0x7f675c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:48.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.337+0000 7f675bfff640 1 -- 172.21.15.113:0/4095332096 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c06d550 con 0x7f675c155460 2023-12-19T13:53:48.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.338+0000 7f675bfff640 1 --2- 172.21.15.113:0/4095332096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c155460 0x7f675c0b02f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f674c009870 tx=0x7f674c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cc707e0aacbc46 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:48.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.338+0000 7f675b7fe640 1 -- 172.21.15.113:0/4095332096 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c030840 con 0x7f675c155460 2023-12-19T13:53:48.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f675b7fe640 1 -- 172.21.15.113:0/4095332096 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c0309a0 con 0x7f675c155460 2023-12-19T13:53:48.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f675b7fe640 1 -- 172.21.15.113:0/4095332096 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c030d30 con 0x7f675c155460 2023-12-19T13:53:48.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 -- 172.21.15.113:0/4095332096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c155460 msgr2=0x7f675c0b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:48.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 --2- 172.21.15.113:0/4095332096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c155460 0x7f675c0b02f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f674c009870 tx=0x7f674c02b980 comp rx=0 tx=0).stop 2023-12-19T13:53:48.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 -- 172.21.15.113:0/4095332096 shutdown_connections 2023-12-19T13:53:48.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 --2- 172.21.15.113:0/4095332096 >> v2:172.21.15.151:3300/0 conn(0x7f675c0b0830 0x7f675c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 --2- 172.21.15.113:0/4095332096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c155460 0x7f675c0b02f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 -- 172.21.15.113:0/4095332096 >> 172.21.15.113:0/4095332096 conn(0x7f675c0659a0 msgr2=0x7f675c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:48.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 -- 172.21.15.113:0/4095332096 shutdown_connections 2023-12-19T13:53:48.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.339+0000 7f67611b8640 1 -- 172.21.15.113:0/4095332096 wait complete. 2023-12-19T13:53:48.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.341+0000 7f67611b8640 1 Processor -- start 2023-12-19T13:53:48.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.341+0000 7f67611b8640 1 -- start start 2023-12-19T13:53:48.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f67611b8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f675c06ca80 0x7f675c0a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:48.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f67611b8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c0b0830 0x7f675c1f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:48.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f67611b8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f675c155460 0x7f675c0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f67611b8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cbd70 con 0x7f675c06ca80 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f67611b8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cc050 con 0x7f675c155460 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f67611b8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cc330 con 0x7f675c0b0830 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f675bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f675c06ca80 0x7f675c0a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.342+0000 7f675bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f675c06ca80 0x7f675c0a9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60450/0 (socket says 172.21.15.113:60450) 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f675bfff640 1 -- 172.21.15.113:0/1346310729 learned_addr learned my addr 172.21.15.113:0/1346310729 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f6753fff640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c0b0830 0x7f675c1f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f675bfff640 1 -- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c0b0830 msgr2=0x7f675c1f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f675bfff640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c0b0830 0x7f675c1f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f675bfff640 1 -- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f675c155460 msgr2=0x7f675c0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f67609b7640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f675c155460 0x7f675c0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:48.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f675bfff640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f675c155460 0x7f675c0ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f675bfff640 1 -- 172.21.15.113:0/1346310729 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c0094d0 con 0x7f675c06ca80 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.343+0000 7f675bfff640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f675c06ca80 0x7f675c0a9270 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f674c02b9c0 tx=0x7f674c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.344+0000 7f67597fa640 1 -- 172.21.15.113:0/1346310729 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c03e070 con 0x7f675c06ca80 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.344+0000 7f67597fa640 1 -- 172.21.15.113:0/1346310729 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c039a10 con 0x7f675c06ca80 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.344+0000 7f67597fa640 1 -- 172.21.15.113:0/1346310729 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c039de0 con 0x7f675c06ca80 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.344+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c0cc610 con 0x7f675c06ca80 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.344+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c0a97b0 con 0x7f675c06ca80 2023-12-19T13:53:48.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.345+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c0a9940 con 0x7f675c06ca80 2023-12-19T13:53:48.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.346+0000 7f67597fa640 1 -- 172.21.15.113:0/1346310729 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f674c04b400 con 0x7f675c06ca80 2023-12-19T13:53:48.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.346+0000 7f67597fa640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f673c06a430 0x7f673c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:48.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.347+0000 7f67597fa640 1 -- 172.21.15.113:0/1346310729 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f674c0aaf60 con 0x7f675c06ca80 2023-12-19T13:53:48.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.347+0000 7f6753fff640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f673c06a430 0x7f673c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:48.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.347+0000 7f6753fff640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f673c06a430 0x7f673c06c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f675c070920 tx=0x7f6744008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:48.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.351+0000 7f67597fa640 1 -- 172.21.15.113:0/1346310729 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f674c0764b0 con 0x7f675c06ca80 2023-12-19T13:53:48.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:48.565+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f675c061910 con 0x7f675c06ca80 2023-12-19T13:53:49.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.115+0000 7f67597fa640 1 -- 172.21.15.113:0/1346310729 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) v1 ==== 122+0+0 (secure 0 0 0) 0x7f674c0340c0 con 0x7f675c06ca80 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f673c06a430 msgr2=0x7f673c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f673c06a430 0x7f673c06c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f675c070920 tx=0x7f6744008040 comp rx=0 tx=0).stop 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f675c06ca80 msgr2=0x7f675c0a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f675c06ca80 0x7f675c0a9270 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f674c02b9c0 tx=0x7f674c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 shutdown_connections 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f673c06a430 0x7f673c06c8f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f675c155460 0x7f675c0ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f675c0b0830 0x7f675c1f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 --2- 172.21.15.113:0/1346310729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f675c06ca80 0x7f675c0a9270 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 >> 172.21.15.113:0/1346310729 conn(0x7f675c0659a0 msgr2=0x7f675c15d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 shutdown_connections 2023-12-19T13:53:49.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.119+0000 7f67611b8640 1 -- 172.21.15.113:0/1346310729 wait complete. 2023-12-19T13:53:49.139 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:53:49.140 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:49.341 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:49.351 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:49.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.353+0000 7f735eb8f640 1 Processor -- start 2023-12-19T13:53:49.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.353+0000 7f735eb8f640 1 -- start start 2023-12-19T13:53:49.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.354+0000 7f735eb8f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73580b58c0 0x7f73580cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735eb8f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f73580cdeb0 0x7f735815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735eb8f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73580b6640 con 0x7f7358144c20 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735eb8f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73580b5da0 con 0x7f73580cdeb0 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735eb8f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73580b6080 con 0x7f73580b58c0 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735e38e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f73580cdeb0 0x7f735815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735e38e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f73580cdeb0 0x7f735815bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60454/0 (socket says 172.21.15.113:60454) 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735e38e640 1 -- 172.21.15.113:0/3592307202 learned_addr learned my addr 172.21.15.113:0/3592307202 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735d38c640 1 --2- 172.21.15.113:0/3592307202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73580b58c0 0x7f73580cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735e38e640 1 -- 172.21.15.113:0/3592307202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73580b58c0 msgr2=0x7f73580cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735e38e640 1 --2- 172.21.15.113:0/3592307202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73580b58c0 0x7f73580cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735e38e640 1 -- 172.21.15.113:0/3592307202 >> v1:172.21.15.151:6789/0 conn(0x7f7358144c20 legacy=0x7f73580b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.355+0000 7f735e38e640 1 -- 172.21.15.113:0/3592307202 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73580b6360 con 0x7f73580cdeb0 2023-12-19T13:53:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.357+0000 7f735e38e640 1 --2- 172.21.15.113:0/3592307202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580cdeb0 0x7f735815bea0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7350009e50 tx=0x7f735002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc887e865881dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.357+0000 7f735cb8b640 1 -- 172.21.15.113:0/3592307202 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735002ca70 con 0x7f73580cdeb0 2023-12-19T13:53:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.357+0000 7f735cb8b640 1 -- 172.21.15.113:0/3592307202 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735002cbd0 con 0x7f73580cdeb0 2023-12-19T13:53:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.357+0000 7f735cb8b640 1 -- 172.21.15.113:0/3592307202 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500343f0 con 0x7f73580cdeb0 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.357+0000 7f735eb8f640 1 -- 172.21.15.113:0/3592307202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580cdeb0 msgr2=0x7f735815bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.357+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3592307202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580cdeb0 0x7f735815bea0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7350009e50 tx=0x7f735002bed0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.358+0000 7f735eb8f640 1 -- 172.21.15.113:0/3592307202 shutdown_connections 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.358+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3592307202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580cdeb0 0x7f735815bea0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.358+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3592307202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73580b58c0 0x7f73580cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.358+0000 7f735eb8f640 1 -- 172.21.15.113:0/3592307202 >> 172.21.15.113:0/3592307202 conn(0x7f735806b8f0 msgr2=0x7f735806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.358+0000 7f735eb8f640 1 -- 172.21.15.113:0/3592307202 shutdown_connections 2023-12-19T13:53:49.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.358+0000 7f735eb8f640 1 -- 172.21.15.113:0/3592307202 wait complete. 2023-12-19T13:53:49.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.359+0000 7f735eb8f640 1 Processor -- start 2023-12-19T13:53:49.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.360+0000 7f735eb8f640 1 -- start start 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735eb8f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580b58c0 0x7f735815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735eb8f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73580cdeb0 0x7f73580cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735eb8f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7358144c20 0x7f73580cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735eb8f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580cd060 con 0x7f73580b58c0 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735eb8f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580cc4e0 con 0x7f73580cdeb0 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735eb8f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73580cc7c0 con 0x7f7358144c20 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580b58c0 0x7f735815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580b58c0 0x7f735815a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60464/0 (socket says 172.21.15.113:60464) 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 -- 172.21.15.113:0/3272619796 learned_addr learned my addr 172.21.15.113:0/3272619796 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:49.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735d38c640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73580cdeb0 0x7f73580cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 -- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7358144c20 msgr2=0x7f73580cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7358144c20 0x7f73580cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 -- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73580cdeb0 msgr2=0x7f73580cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73580cdeb0 0x7f73580cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735db8d640 1 -- 172.21.15.113:0/3272619796 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350009b30 con 0x7f73580b58c0 2023-12-19T13:53:49.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.361+0000 7f735d38c640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73580cdeb0 0x7f73580cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:49.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.362+0000 7f735db8d640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580b58c0 0x7f735815a9b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f735400b3f0 tx=0x7f735400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.362+0000 7f734e7fc640 1 -- 172.21.15.113:0/3272619796 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354011830 con 0x7f73580b58c0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.362+0000 7f734e7fc640 1 -- 172.21.15.113:0/3272619796 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354011990 con 0x7f73580b58c0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.362+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73580ccaa0 con 0x7f73580b58c0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.362+0000 7f734e7fc640 1 -- 172.21.15.113:0/3272619796 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354011d40 con 0x7f73580b58c0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.362+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735815aef0 con 0x7f73580b58c0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.364+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73580700e0 con 0x7f73580b58c0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.364+0000 7f734e7fc640 1 -- 172.21.15.113:0/3272619796 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f735401a400 con 0x7f73580b58c0 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.365+0000 7f734e7fc640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733c06a430 0x7f733c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.365+0000 7f734e7fc640 1 -- 172.21.15.113:0/3272619796 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7354088790 con 0x7f73580b58c0 2023-12-19T13:53:49.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.366+0000 7f735d38c640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733c06a430 0x7f733c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.366+0000 7f735d38c640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733c06a430 0x7f733c06c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f73581400a0 tx=0x7f7348008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:49.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.370+0000 7f734e7fc640 1 -- 172.21.15.113:0/3272619796 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7354053e10 con 0x7f73580b58c0 2023-12-19T13:53:49.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.584+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7358061910 con 0x7f73580b58c0 2023-12-19T13:53:49.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.585+0000 7f734e7fc640 1 -- 172.21.15.113:0/3272619796 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f7354057430 con 0x7f73580b58c0 2023-12-19T13:53:49.586 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:49.586 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:53:49.586 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:53:49.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.588+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733c06a430 msgr2=0x7f733c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.588+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733c06a430 0x7f733c06c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f73581400a0 tx=0x7f7348008040 comp rx=0 tx=0).stop 2023-12-19T13:53:49.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.588+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580b58c0 msgr2=0x7f735815a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.588+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580b58c0 0x7f735815a9b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f735400b3f0 tx=0x7f735400b8b0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 shutdown_connections 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f733c06a430 0x7f733c06c8f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7358144c20 0x7f73580cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73580cdeb0 0x7f73580cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 --2- 172.21.15.113:0/3272619796 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f73580b58c0 0x7f735815a9b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 >> 172.21.15.113:0/3272619796 conn(0x7f735806b8f0 msgr2=0x7f7358142210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 shutdown_connections 2023-12-19T13:53:49.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.589+0000 7f735eb8f640 1 -- 172.21.15.113:0/3272619796 wait complete. 2023-12-19T13:53:49.606 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.798+0000 7f295ddf6640 1 Processor -- start 2023-12-19T13:53:49.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.798+0000 7f295ddf6640 1 -- start start 2023-12-19T13:53:49.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.799+0000 7f295ddf6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f29581599c0 0x7f295815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.799+0000 7f295ddf6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295806e190 0x7f29580cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.799+0000 7f295ddf6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f29580af540 0x7f29580af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.799+0000 7f295ddf6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295815daa0 con 0x7f29580af540 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.799+0000 7f295ddf6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580aff30 con 0x7f29581599c0 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.799+0000 7f295ddf6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295815e400 con 0x7f295806e190 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f29580af540 0x7f29580af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f29580af540 0x7f29580af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60470/0 (socket says 172.21.15.113:60470) 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 -- 172.21.15.113:0/848612405 learned_addr learned my addr 172.21.15.113:0/848612405 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2956ffd640 1 --2- 172.21.15.113:0/848612405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295806e190 0x7f29580cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 -- 172.21.15.113:0/848612405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295806e190 msgr2=0x7f29580cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 --2- 172.21.15.113:0/848612405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295806e190 0x7f29580cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f29577fe640 1 --2- 172.21.15.113:0/848612405 >> v2:172.21.15.151:3300/0 conn(0x7f29581599c0 0x7f295815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 -- 172.21.15.113:0/848612405 >> v2:172.21.15.151:3300/0 conn(0x7f29581599c0 msgr2=0x7f295815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:49.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 --2- 172.21.15.113:0/848612405 >> v2:172.21.15.151:3300/0 conn(0x7f29581599c0 0x7f295815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2957fff640 1 -- 172.21.15.113:0/848612405 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580ce780 con 0x7f29580af540 2023-12-19T13:53:49.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.800+0000 7f2956ffd640 1 --2- 172.21.15.113:0/848612405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295806e190 0x7f29580cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.801+0000 7f2957fff640 1 --2- 172.21.15.113:0/848612405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29580af9f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f29580b0e40 tx=0x7f294802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bda8a4a61f28472 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f29567fc640 1 -- 172.21.15.113:0/848612405 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948031740 con 0x7f29580af540 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f29567fc640 1 -- 172.21.15.113:0/848612405 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29480318a0 con 0x7f29580af540 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f29567fc640 1 -- 172.21.15.113:0/848612405 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948031c30 con 0x7f29580af540 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 -- 172.21.15.113:0/848612405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 msgr2=0x7f29580af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 --2- 172.21.15.113:0/848612405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29580af9f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f29580b0e40 tx=0x7f294802b7e0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 -- 172.21.15.113:0/848612405 shutdown_connections 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 --2- 172.21.15.113:0/848612405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29580af9f0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 --2- 172.21.15.113:0/848612405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295806e190 0x7f29580cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 --2- 172.21.15.113:0/848612405 >> v2:172.21.15.151:3300/0 conn(0x7f29581599c0 0x7f295815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 -- 172.21.15.113:0/848612405 >> 172.21.15.113:0/848612405 conn(0x7f29580cbb70 msgr2=0x7f29580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:49.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 -- 172.21.15.113:0/848612405 shutdown_connections 2023-12-19T13:53:49.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.802+0000 7f295ddf6640 1 -- 172.21.15.113:0/848612405 wait complete. 2023-12-19T13:53:49.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.804+0000 7f295ddf6640 1 Processor -- start 2023-12-19T13:53:49.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.804+0000 7f295ddf6640 1 -- start start 2023-12-19T13:53:49.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f295ddf6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f295806e190 0x7f2958139800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f295ddf6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29581f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f295ddf6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29581599c0 0x7f295814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f295ddf6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29581f37d0 con 0x7f29580af540 2023-12-19T13:53:49.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f295ddf6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295814bc00 con 0x7f295806e190 2023-12-19T13:53:49.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f295ddf6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295815b200 con 0x7f29581599c0 2023-12-19T13:53:49.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f2956ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29581f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.805+0000 7f2956ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29581f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60482/0 (socket says 172.21.15.113:60482) 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2956ffd640 1 -- 172.21.15.113:0/831223242 learned_addr learned my addr 172.21.15.113:0/831223242 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f29577fe640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f295806e190 0x7f2958139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2957fff640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29581599c0 0x7f295814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2956ffd640 1 -- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29581599c0 msgr2=0x7f295814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2956ffd640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29581599c0 0x7f295814b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2956ffd640 1 -- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f295806e190 msgr2=0x7f2958139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2956ffd640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f295806e190 0x7f2958139800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2956ffd640 1 -- 172.21.15.113:0/831223242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480094d0 con 0x7f29580af540 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f29577fe640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f295806e190 0x7f2958139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f2956ffd640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29581f3290 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f294000c7f0 tx=0x7f294000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.806+0000 7f294ffff640 1 -- 172.21.15.113:0/831223242 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940007820 con 0x7f29580af540 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.807+0000 7f294ffff640 1 -- 172.21.15.113:0/831223242 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2940007980 con 0x7f29580af540 2023-12-19T13:53:49.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.807+0000 7f294ffff640 1 -- 172.21.15.113:0/831223242 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940007d30 con 0x7f29580af540 2023-12-19T13:53:49.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.807+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2958139e10 con 0x7f29580af540 2023-12-19T13:53:49.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.807+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295813a3d0 con 0x7f29580af540 2023-12-19T13:53:49.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.808+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2958061910 con 0x7f29580af540 2023-12-19T13:53:49.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.809+0000 7f294ffff640 1 -- 172.21.15.113:0/831223242 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f29400113f0 con 0x7f29580af540 2023-12-19T13:53:49.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.810+0000 7f294ffff640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f293806a460 0x7f293806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:49.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.810+0000 7f294ffff640 1 -- 172.21.15.113:0/831223242 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2940088b90 con 0x7f29580af540 2023-12-19T13:53:49.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.810+0000 7f29577fe640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f293806a460 0x7f293806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:49.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.811+0000 7f29577fe640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f293806a460 0x7f293806c920 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2950007f50 tx=0x7f29500074a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:49.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:49.814+0000 7f294ffff640 1 -- 172.21.15.113:0/831223242 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2940054180 con 0x7f29580af540 2023-12-19T13:53:50.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.004+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f295815b370 con 0x7f29580af540 2023-12-19T13:53:50.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.005+0000 7f294ffff640 1 -- 172.21.15.113:0/831223242 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f295815b370 con 0x7f29580af540 2023-12-19T13:53:50.007 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:50.007 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":132,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:47.073619+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f293806a460 msgr2=0x7f293806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f293806a460 0x7f293806c920 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2950007f50 tx=0x7f29500074a0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 msgr2=0x7f29581f3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29581f3290 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f294000c7f0 tx=0x7f294000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 shutdown_connections 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f293806a460 0x7f293806c920 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29581599c0 0x7f295814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29580af540 0x7f29581f3290 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 --2- 172.21.15.113:0/831223242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f295806e190 0x7f2958139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 >> 172.21.15.113:0/831223242 conn(0x7f29580cbb70 msgr2=0x7f295815ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 shutdown_connections 2023-12-19T13:53:50.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.008+0000 7f295ddf6640 1 -- 172.21.15.113:0/831223242 wait complete. 2023-12-19T13:53:50.026 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:53:50.027 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:53:50.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.247+0000 7f0151600640 1 Processor -- start 2023-12-19T13:53:50.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.247+0000 7f0151600640 1 -- start start 2023-12-19T13:53:50.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.249+0000 7f0151600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f014c06c6b0 0x7f014c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.249+0000 7f0151600640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c15e2a0 con 0x7f014c15b3c0 2023-12-19T13:53:50.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.249+0000 7f0151600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c161510 con 0x7f014c15ddf0 2023-12-19T13:53:50.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.249+0000 7f0151600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c06d080 con 0x7f014c06c6b0 2023-12-19T13:53:50.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.249+0000 7f014affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f014c15b3c0 0x7f014c0cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43198/0 (socket says 172.21.15.113:43198) 2023-12-19T13:53:50.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.249+0000 7f014affd640 1 -- 172.21.15.113:0/1107041920 learned_addr learned my addr 172.21.15.113:0/1107041920 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:50.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f014b7fe640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f014c06c6b0 0x7f014c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544426663 0 0) 0x7f014c15e2a0 con 0x7f014c15b3c0 2023-12-19T13:53:50.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0134003520 con 0x7f014c15b3c0 2023-12-19T13:53:50.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866026410 0 0) 0x7f0134003520 con 0x7f014c15b3c0 2023-12-19T13:53:50.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f014c06c6b0 msgr2=0x7f014c06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f014c06c6b0 0x7f014c06cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 >> v1:172.21.15.151:6789/0 conn(0x7f014c15ddf0 legacy=0x7f014c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c15ed70 con 0x7f014c15b3c0 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f013c001670 con 0x7f014c15b3c0 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 >> v1:172.21.15.113:6789/0 conn(0x7f014c15b3c0 legacy=0x7f014c0cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f014c06c6b0 0x7f0134003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0134003fe0 0x7f01340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0134004d00 0x7f0134005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c06d080 con 0x7f0134004d00 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013400bb40 con 0x7f0134003fe0 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.250+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013400bd00 con 0x7f014c06c6b0 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014b7fe640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0134004d00 0x7f0134005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014b7fe640 1 -- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f014c06c6b0 msgr2=0x7f0134003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:50.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014b7fe640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f014c06c6b0 0x7f0134003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014b7fe640 1 -- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0134003fe0 msgr2=0x7f01340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:50.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014a7fc640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0134003fe0 0x7f01340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014b7fe640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0134003fe0 0x7f01340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014b7fe640 1 -- 172.21.15.113:0/1107041920 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134003520 con 0x7f0134004d00 2023-12-19T13:53:50.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.251+0000 7f014a7fc640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0134003fe0 0x7f01340047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:50.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.252+0000 7f014b7fe640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0134004d00 0x7f0134005180 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f0144009fc0 tx=0x7f01340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ff03a9909a3677 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:50.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.252+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014402cc60 con 0x7f0134004d00 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014400f040 con 0x7f0134004d00 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0149ffb640 1 -- 172.21.15.113:0/1107041920 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144034440 con 0x7f0134004d00 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0151600640 1 -- 172.21.15.113:0/1107041920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0134004d00 msgr2=0x7f0134005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0151600640 1 --2- 172.21.15.113:0/1107041920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0134004d00 0x7f0134005180 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f0144009fc0 tx=0x7f01340057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f014b7fe640 1 -- 172.21.15.113:0/1107041920 reap_dead start 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0151600640 1 -- 172.21.15.113:0/1107041920 shutdown_connections 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0151600640 1 -- 172.21.15.113:0/1107041920 >> 172.21.15.113:0/1107041920 conn(0x7f014c0d01a0 msgr2=0x7f014c0d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0151600640 1 -- 172.21.15.113:0/1107041920 shutdown_connections 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.253+0000 7f0151600640 1 -- 172.21.15.113:0/1107041920 wait complete. 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.255+0000 7f0151600640 1 Processor -- start 2023-12-19T13:53:50.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.255+0000 7f0151600640 1 -- start start 2023-12-19T13:53:50.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.256+0000 7f0151600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0134004d00 0x7f014c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.256+0000 7f0151600640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f014c0ceed0 0x7f014c0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.256+0000 7f0151600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1f2f30 0x7f014c1f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.256+0000 7f0151600640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c1598b0 con 0x7f014c0ceed0 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.256+0000 7f0151600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c1592d0 con 0x7f014c1f2f30 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.256+0000 7f0151600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c160c20 con 0x7f0134004d00 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.256+0000 7f014a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f014c0ceed0 0x7f014c0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f014c0ceed0 0x7f014c0cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60510/0 (socket says 172.21.15.113:60510) 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 -- 172.21.15.113:0/2059699503 learned_addr learned my addr 172.21.15.113:0/2059699503 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 -- 172.21.15.113:0/2059699503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0134004d00 msgr2=0x7f014c155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0134004d00 0x7f014c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 -- 172.21.15.113:0/2059699503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1f2f30 msgr2=0x7f014c1f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1f2f30 0x7f014c1f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 -- 172.21.15.113:0/2059699503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c159540 con 0x7f014c0ceed0 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f014a7fc640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f014c0ceed0 0x7f014c0cd030 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f014000d7d0 tx=0x7f014000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:50.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f01337fe640 1 -- 172.21.15.113:0/2059699503 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140017070 con 0x7f014c0ceed0 2023-12-19T13:53:50.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f01337fe640 1 -- 172.21.15.113:0/2059699503 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140005070 con 0x7f014c0ceed0 2023-12-19T13:53:50.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f01337fe640 1 -- 172.21.15.113:0/2059699503 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140005440 con 0x7f014c0ceed0 2023-12-19T13:53:50.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.257+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c160f00 con 0x7f014c0ceed0 2023-12-19T13:53:50.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.258+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0cd570 con 0x7f014c0ceed0 2023-12-19T13:53:50.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.259+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c061910 con 0x7f014c0ceed0 2023-12-19T13:53:50.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.260+0000 7f01337fe640 1 -- 172.21.15.113:0/2059699503 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0140007030 con 0x7f014c0ceed0 2023-12-19T13:53:50.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.260+0000 7f01337fe640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f013806a430 0x7f013806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.261+0000 7f01337fe640 1 -- 172.21.15.113:0/2059699503 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01400881f0 con 0x7f014c0ceed0 2023-12-19T13:53:50.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.261+0000 7f014affd640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f013806a430 0x7f013806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.261+0000 7f014affd640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f013806a430 0x7f013806c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f014c155d70 tx=0x7f013c001560 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:50.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.265+0000 7f01337fe640 1 -- 172.21.15.113:0/2059699503 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0140053740 con 0x7f014c0ceed0 2023-12-19T13:53:50.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.449+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f014c15e7b0 con 0x7f013806a430 2023-12-19T13:53:50.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.471+0000 7f01337fe640 1 -- 172.21.15.113:0/2059699503 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273641 (secure 0 0 0) 0x7f013c001c10 con 0x7f013806a430 2023-12-19T13:53:50.476 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:50.478 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:53:50.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f013806a430 msgr2=0x7f013806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f013806a430 0x7f013806c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f014c155d70 tx=0x7f013c001560 comp rx=0 tx=0).stop 2023-12-19T13:53:50.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f014c0ceed0 msgr2=0x7f014c0cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f014c0ceed0 0x7f014c0cd030 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f014000d7d0 tx=0x7f014000dc90 comp rx=0 tx=0).stop 2023-12-19T13:53:50.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 shutdown_connections 2023-12-19T13:53:50.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f013806a430 0x7f013806c8f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1f2f30 0x7f014c1f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f014c0ceed0 0x7f014c0cd030 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 --2- 172.21.15.113:0/2059699503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0134004d00 0x7f014c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 >> 172.21.15.113:0/2059699503 conn(0x7f014c0d01a0 msgr2=0x7f014c156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:50.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 shutdown_connections 2023-12-19T13:53:50.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.476+0000 7f0151600640 1 -- 172.21.15.113:0/2059699503 wait complete. 2023-12-19T13:53:50.495 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2023-12-19T13:53:48.554948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555770,"statfs":{"total":1600000000,"available":1593109153,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001121"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.578008+0000","last_change":"2023-12-19T13:53:44.578008+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.578008+0000","last_undegraded":"2023-12-19T13:53:44.578008+0000","last_fullsized":"2023-12-19T13:53:44.578008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:00:02.059047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.587017+0000","last_change":"2023-12-19T13:53:44.587017+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.587017+0000","last_undegraded":"2023-12-19T13:53:44.587017+0000","last_fullsized":"2023-12-19T13:53:44.587017+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:24.492764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.581237+0000","last_change":"2023-12-19T13:53:44.581237+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.581237+0000","last_undegraded":"2023-12-19T13:53:44.581237+0000","last_fullsized":"2023-12-19T13:53:44.581237+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:33:46.762032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.577705+0000","last_change":"2023-12-19T13:53:44.577705+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.577705+0000","last_undegraded":"2023-12-19T13:53:44.577705+0000","last_fullsized":"2023-12-19T13:53:44.577705+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.085707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.578843+0000","last_change":"2023-12-19T13:53:44.578843+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.578843+0000","last_undegraded":"2023-12-19T13:53:44.578843+0000","last_fullsized":"2023-12-19T13:53:44.578843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:33:46.762032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.581055+0000","last_change":"2023-12-19T13:53:44.581055+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.581055+0000","last_undegraded":"2023-12-19T13:53:44.581055+0000","last_fullsized":"2023-12-19T13:53:44.581055+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:00:02.059047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.586252+0000","last_change":"2023-12-19T13:53:44.586252+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.586252+0000","last_undegraded":"2023-12-19T13:53:44.586252+0000","last_fullsized":"2023-12-19T13:53:44.586252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:15.600663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.586502+0000","last_change":"2023-12-19T13:53:44.586502+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.586502+0000","last_undegraded":"2023-12-19T13:53:44.586502+0000","last_fullsized":"2023-12-19T13:53:44.586502+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:59.562277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.583319+0000","last_change":"2023-12-19T13:53:44.583319+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.583319+0000","last_undegraded":"2023-12-19T13:53:44.583319+0000","last_fullsized":"2023-12-19T13:53:44.583319+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:30.823661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.577005+0000","last_change":"2023-12-19T13:53:44.577005+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.577005+0000","last_undegraded":"2023-12-19T13:53:44.577005+0000","last_fullsized":"2023-12-19T13:53:44.577005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:24.507203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.586179+0000","last_change":"2023-12-19T13:53:44.586179+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.586179+0000","last_undegraded":"2023-12-19T13:53:44.586179+0000","last_fullsized":"2023-12-19T13:53:44.586179+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:57.504722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.581091+0000","last_change":"2023-12-19T13:53:44.581091+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.581091+0000","last_undegraded":"2023-12-19T13:53:44.581091+0000","last_fullsized":"2023-12-19T13:53:44.581091+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:00.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.585615+0000","last_change":"2023-12-19T13:53:44.585615+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.585615+0000","last_undegraded":"2023-12-19T13:53:44.585615+0000","last_fullsized":"2023-12-19T13:53:44.585615+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:11.250836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.576517+0000","last_change":"2023-12-19T13:53:44.576517+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.576517+0000","last_undegraded":"2023-12-19T13:53:44.576517+0000","last_fullsized":"2023-12-19T13:53:44.576517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:00.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.580495+0000","last_change":"2023-12-19T13:53:44.580495+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.580495+0000","last_undegraded":"2023-12-19T13:53:44.580495+0000","last_fullsized":"2023-12-19T13:53:44.580495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:25:37.327195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.577450+0000","last_change":"2023-12-19T13:53:44.577450+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.577450+0000","last_undegraded":"2023-12-19T13:53:44.577450+0000","last_fullsized":"2023-12-19T13:53:44.577450+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:40.642318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.580080+0000","last_change":"2023-12-19T13:53:44.580080+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.580080+0000","last_undegraded":"2023-12-19T13:53:44.580080+0000","last_fullsized":"2023-12-19T13:53:44.580080+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:02.041076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.586285+0000","last_change":"2023-12-19T13:53:44.586285+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.586285+0000","last_undegraded":"2023-12-19T13:53:44.586285+0000","last_fullsized":"2023-12-19T13:53:44.586285+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:09.932132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.584467+0000","last_change":"2023-12-19T13:53:44.584467+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.584467+0000","last_undegraded":"2023-12-19T13:53:44.584467+0000","last_fullsized":"2023-12-19T13:53:44.584467+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:18.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.576395+0000","last_change":"2023-12-19T13:53:44.576395+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.576395+0000","last_undegraded":"2023-12-19T13:53:44.576395+0000","last_fullsized":"2023-12-19T13:53:44.576395+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:02.041076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.580518+0000","last_change":"2023-12-19T13:53:44.580518+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.580518+0000","last_undegraded":"2023-12-19T13:53:44.580518+0000","last_fullsized":"2023-12-19T13:53:44.580518+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:38.604032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.654603+0000","last_change":"2023-12-19T13:53:44.654603+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.654603+0000","last_undegraded":"2023-12-19T13:53:44.654603+0000","last_fullsized":"2023-12-19T13:53:44.654603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:52:36.776690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.582382+0000","last_change":"2023-12-19T13:53:44.582382+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.582382+0000","last_undegraded":"2023-12-19T13:53:44.582382+0000","last_fullsized":"2023-12-19T13:53:44.582382+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:50.318527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.579866+0000","last_change":"2023-12-19T13:53:44.579866+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.579866+0000","last_undegraded":"2023-12-19T13:53:44.579866+0000","last_fullsized":"2023-12-19T13:53:44.579866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:29:19.703836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.583029+0000","last_change":"2023-12-19T13:53:44.583029+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.583029+0000","last_undegraded":"2023-12-19T13:53:44.583029+0000","last_fullsized":"2023-12-19T13:53:44.583029+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:16.808600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.583785+0000","last_change":"2023-12-19T13:53:44.583785+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.583785+0000","last_undegraded":"2023-12-19T13:53:44.583785+0000","last_fullsized":"2023-12-19T13:53:44.583785+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:38.023440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.581164+0000","last_change":"2023-12-19T13:53:44.581164+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.581164+0000","last_undegraded":"2023-12-19T13:53:44.581164+0000","last_fullsized":"2023-12-19T13:53:44.581164+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:49.648350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.581579+0000","last_change":"2023-12-19T13:53:44.581579+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.581579+0000","last_undegraded":"2023-12-19T13:53:44.581579+0000","last_fullsized":"2023-12-19T13:53:44.581579+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.085707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.580777+0000","last_change":"2023-12-19T13:53:44.580777+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.580777+0000","last_undegraded":"2023-12-19T13:53:44.580777+0000","last_fullsized":"2023-12-19T13:53:44.580777+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:44.486218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.576625+0000","last_change":"2023-12-19T13:53:44.576625+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.576625+0000","last_undegraded":"2023-12-19T13:53:44.576625+0000","last_fullsized":"2023-12-19T13:53:44.576625+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.085707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.580551+0000","last_change":"2023-12-19T13:53:44.580551+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.580551+0000","last_undegraded":"2023-12-19T13:53:44.580551+0000","last_fullsized":"2023-12-19T13:53:44.580551+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:16.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:53:45.571717+0000","last_change":"2023-12-19T13:53:45.571717+0000","last_active":"2023-12-19T13:53:45.571717+0000","last_peered":"2023-12-19T13:53:45.571717+0000","last_clean":"2023-12-19T13:53:45.571717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:45.571717+0000","last_undegraded":"2023-12-19T13:53:45.571717+0000","last_fullsized":"2023-12-19T13:53:45.571717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2023-12-19T13:53:44.579865+0000","last_change":"2023-12-19T13:53:44.579865+0000","last_active":"2023-12-19T13:53:44.567112+0000","last_peered":"2023-12-19T13:53:44.567112+0000","last_clean":"2023-12-19T13:53:44.567112+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:53:44.579865+0000","last_undegraded":"2023-12-19T13:53:44.579865+0000","last_fullsized":"2023-12-19T13:53:44.579865+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:06.105930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":268,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T13:53:41.470022+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:53:41.470022+0000","last_peered":"2023-12-19T13:53:41.470022+0000","last_clean":"2023-12-19T13:53:41.470022+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:53:41.470022+0000","last_undegraded":"2023-12-19T13:53:41.470022+0000","last_fullsized":"2023-12-19T13:53:41.470022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":692,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.032},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6240000000000001,"5min":1.6950000000000001,"15min":1.9059999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1120000000000001,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.7190000000000001,"15min":2.008},"last":0.80400000000000005}]},{"osd":1,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.167,"15min":1.103},"min":{"1min":0.71599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6479999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.294},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.1679999999999999,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.728,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":0.999}]},{"osd":2,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1399999999999999,"15min":1.135},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.84999999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":1.1910000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2390000000000001,"15min":1.179},"min":{"1min":0.74199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.359,"5min":1.3120000000000001,"15min":1.2609999999999999},"min":{"1min":0.98999999999999999,"5min":0.70599999999999996,"15min":0.65200000000000002},"max":{"1min":1.883,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.3799999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2649999999999999,"15min":1.284},"min":{"1min":0.94999999999999996,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.629},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.321,"15min":1.3799999999999999},"min":{"1min":0.83099999999999996,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.48}]},{"osd":5,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.2869999999999999,"15min":1.2410000000000001},"min":{"1min":0.94599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.405,"15min":1.425},"min":{"1min":1.103,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.7010000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.3979999999999999,"15min":1.306},"min":{"1min":1.1140000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.663},{"interface":"front","average":{"1min":1.571,"5min":1.5049999999999999,"15min":1.4950000000000001},"min":{"1min":1.228,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.75}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":697,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194614,"statfs":{"total":200000000,"available":199285509,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.59299999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5329999999999999,"5min":1.6220000000000001,"15min":2.0640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.099,"15min":1.1160000000000001},"min":{"1min":0.71399999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.631,"15min":3.2069999999999999},"last":0.88300000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.069,"15min":1.044},"min":{"1min":0.72899999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4570000000000001,"5min":1.5580000000000001,"15min":1.962},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.6279999999999999},"last":1.262}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":1.012,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.8180000000000001},"last":1.361},{"interface":"front","average":{"1min":1.21,"5min":1.2609999999999999,"15min":1.1839999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.647,"5min":1.802,"15min":1.802},"last":1.327}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.242,"15min":1.319},"min":{"1min":0.78600000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.232,"15min":1.2589999999999999},"min":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.67900000000000005},"max":{"1min":1.5660000000000001,"5min":1.819,"15min":4.3899999999999997},"last":1.0629999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.325,"15min":1.238},"min":{"1min":1,"5min":0.64500000000000002,"15min":0.47899999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.3779999999999999,"15min":1.3140000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.70699999999999996},"max":{"1min":1.768,"5min":1.895,"15min":1.895},"last":1.4079999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.327,"15min":1.2669999999999999},"min":{"1min":0.83899999999999997,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.857,"5min":1.962,"15min":1.962},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4390000000000001,"15min":1.387},"min":{"1min":0.90600000000000003,"5min":0.80200000000000005,"15min":0.48799999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.458}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4730000000000001,"15min":1.4319999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.59599999999999997},"max":{"1min":1.7529999999999999,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4490000000000001,"15min":1.3799999999999999},"min":{"1min":1.073,"5min":0.72799999999999998,"15min":0.57999999999999996},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.681}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1274,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194038,"statfs":{"total":200000000,"available":198695141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.075,"15min":1.0049999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2170000000000001,"15min":1.1080000000000001},"min":{"1min":0.81100000000000005,"5min":0.67500000000000004,"15min":0.53900000000000003},"max":{"1min":2.1429999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.94999999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.167,"15min":1.1220000000000001},"min":{"1min":0.67100000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6839999999999999,"5min":6.101,"15min":6.101},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1830000000000001,"15min":1.0580000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.694,"5min":2.077,"15min":2.077},"last":1.016}]},{"osd":2,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2509999999999999,"15min":1.248},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.6839999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.246,"15min":1.2629999999999999},"min":{"1min":0.754,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5569999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.258}]},{"osd":3,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3460000000000001,"15min":1.2450000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.595,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.079},{"interface":"front","average":{"1min":1.335,"5min":1.296,"15min":1.2609999999999999},"min":{"1min":0.82099999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.75,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.5029999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.21,"15min":1.1599999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.982},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.395,"15min":1.3160000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":1.819,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.54}]},{"osd":6,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3700000000000001,"15min":1.335},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.821,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.3680000000000001,"15min":1.369},"min":{"1min":0.78400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4419999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5229999999999999,"15min":1.4390000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.1219999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.571,"5min":1.5129999999999999,"15min":1.4410000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.1070000000000002,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.76}]}]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":697,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194614,"statfs":{"total":200000000,"available":199285509,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.052,"15min":1.0109999999999999},"min":{"1min":0.67700000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":1.649,"15min":1.657},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.091,"15min":1.1160000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.016},"last":1.9810000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0720000000000001,"15min":1.0669999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.143},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.73399999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6080000000000001,"5min":1.887,"15min":1.887},"last":1.5780000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.119,"15min":1.05},"min":{"1min":0.71999999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.4119999999999999,"5min":1.704,"15min":1.704},"last":1.8799999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.161,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.617,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.4350000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.208,"15min":1.214},"min":{"1min":0.98299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4470000000000001,"5min":1.8360000000000001,"15min":1.952},"last":1.778},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.29,"15min":1.2809999999999999},"min":{"1min":0.94199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7050000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.3500000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2230000000000001,"15min":1.242},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.51700000000000002},"max":{"1min":1.6020000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.024},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3129999999999999,"15min":1.335},"min":{"1min":0.79700000000000004,"5min":0.61899999999999999,"15min":0.58399999999999996},"max":{"1min":1.7529999999999999,"5min":2.306,"15min":2.3570000000000002},"last":1.0980000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3300000000000001,"15min":1.381},"min":{"1min":0.82999999999999996,"5min":0.78800000000000003,"15min":0.55900000000000005},"max":{"1min":1.472,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.631},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.4490000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.831,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.677}]},{"osd":7,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.468,"15min":1.4670000000000001},"min":{"1min":1.0409999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7689999999999999,"5min":2.948,"15min":2.948},"last":2.1930000000000001},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5289999999999999,"15min":1.526},"min":{"1min":0.92900000000000005,"5min":0.85699999999999998,"15min":0.59999999999999998},"max":{"1min":1.8169999999999999,"5min":3.137,"15min":3.137},"last":1.722}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":697,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194614,"statfs":{"total":200000000,"available":199285509,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.90400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0760000000000001,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.95099999999999996},"min":{"1min":0.35699999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.49,"5min":1.502,"15min":3.0670000000000002},"last":0.747}]},{"osd":1,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.96599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1899999999999999,"5min":1.508,"15min":5.3769999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3979999999999999,"5min":1.5780000000000001,"15min":2.387},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.95599999999999996,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.3500000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.004,"15min":1.1020000000000001},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.722,"5min":1.722,"15min":2.657},"last":0.69799999999999995}]},{"osd":4,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1930000000000001,"15min":1.252},"min":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.607,"5min":1.718,"15min":3.0070000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.226,"15min":1.23},"min":{"1min":0.70799999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.629,"5min":1.835,"15min":2.7690000000000001},"last":1.323}]},{"osd":5,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2350000000000001,"15min":1.2909999999999999},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.72,"5min":1.72,"15min":2.7309999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2150000000000001,"15min":1.256},"min":{"1min":0.73199999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.5249999999999999},"last":1.4239999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2270000000000001,"15min":1.2889999999999999},"min":{"1min":0.59299999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.647,"5min":1.7090000000000001,"15min":2.9769999999999999},"last":1.26},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.75800000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":2.698},"last":1.48}]},{"osd":7,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.298,"15min":1.3540000000000001},"min":{"1min":0.73399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.609},"last":1.552},{"interface":"front","average":{"1min":1.335,"5min":1.355,"15min":1.389},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8999999999999999,"5min":2.02,"15min":3.0379999999999998},"last":1.583}]}]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":697,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194614,"statfs":{"total":200000000,"available":199285509,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82899999999999996,"15min":0.83199999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4550000000000001,"5min":1.544,"15min":2.258},"last":1.018},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.002,"15min":0.84799999999999998},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.542,"5min":11.85,"15min":11.85},"last":0.66200000000000003}]},{"osd":1,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.4610000000000001,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.111,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.381,"5min":11.788,"15min":11.788},"last":1.177}]},{"osd":3,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97999999999999998,"15min":0.94999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.373,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":0.88},{"interface":"front","average":{"1min":1.036,"5min":1.091,"15min":1.0369999999999999},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":1.5800000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":0.70499999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3640000000000001,"15min":1.1910000000000001},"min":{"1min":0.96499999999999997,"5min":0.81799999999999995,"15min":0.746},"max":{"1min":1.5580000000000001,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.786,"5min":1.786,"15min":2.2189999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4510000000000001,"15min":1.2629999999999999},"min":{"1min":0.94799999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.615,"5min":11.888,"15min":11.888},"last":1.278},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3120000000000001,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.85199999999999998,"15min":0.68899999999999995},"max":{"1min":1.843,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":0.98199999999999998}]},{"osd":6,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":1.0049999999999999,"5min":0.85899999999999999,"15min":0.72399999999999998},"max":{"1min":1.994,"5min":2.0640000000000001,"15min":2.964},"last":1.04},{"interface":"front","average":{"1min":1.28,"5min":1.3100000000000001,"15min":1.266},"min":{"1min":0.79000000000000004,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.8879999999999999,"5min":1.944,"15min":2.286},"last":1.2649999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.355,"15min":1.3180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.351},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.468,"15min":1.3080000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.75600000000000001},"max":{"1min":1.6739999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.363}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1274,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194038,"statfs":{"total":200000000,"available":198695141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.80500000000000005},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88200000000000001,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.94099999999999995,"15min":0.94899999999999995},"min":{"1min":0.58899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":2.351,"15min":3.3500000000000001},"last":1.1299999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93700000000000006,"15min":1.0509999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.119,"15min":1.1679999999999999},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5780000000000001,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0720000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.5},"max":{"1min":1.548,"5min":1.6759999999999999,"15min":3.4300000000000002},"last":0.872},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0189999999999999,"15min":1.1479999999999999},"min":{"1min":0.47599999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.522,"5min":1.706,"15min":7.157},"last":1.018}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.159,"15min":1.2110000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":1.4119999999999999,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.399},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.264,"15min":1.2909999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.579,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.0980000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.248,"15min":1.3100000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.538,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3839999999999999,"15min":1.363},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3999999999999999,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.3420000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.876,"5min":0.74199999999999999,"15min":0.67800000000000005},"max":{"1min":1.675,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.173},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3260000000000001,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.595,"5min":2.3159999999999998,"15min":3.786},"last":1.3680000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3799999999999999,"15min":1.4359999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.637,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.419},{"interface":"front","average":{"1min":1.218,"5min":1.3140000000000001,"15min":1.429},"min":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6100000000000001,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.268}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":697,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194614,"statfs":{"total":200000000,"available":199285509,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.76600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32200000000000001,"15min":0.28299999999999997},"max":{"1min":1.639,"5min":1.639,"15min":1.6399999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.046,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2629999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":1.1220000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.3029999999999999,"15min":1.008},"min":{"1min":0.443,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.8149999999999999,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.494,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4430000000000001,"5min":41.758000000000003,"15min":41.758000000000003},"last":1.708}]},{"osd":3,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.98399999999999999},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":1.109,"5min":1.619,"15min":4.4530000000000003},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.081,"15min":1.095},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.36499999999999999},"max":{"1min":1.9470000000000001,"5min":2.02,"15min":2.02},"last":1.2749999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.151,"15min":1.1990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.306,"5min":1.917,"15min":4.4269999999999996},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.407,"15min":1.234},"min":{"1min":0.80900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8700000000000001,"5min":15.766,"15min":15.766},"last":1.393}]},{"osd":5,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.393,"15min":1.2350000000000001},"min":{"1min":0.79500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.484,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.77},{"interface":"front","average":{"1min":1.147,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6499999999999999,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.4199999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.284},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.67800000000000005},"max":{"1min":1.7709999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.534,"15min":1.3420000000000001},"min":{"1min":0.78200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.599,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.502}]},{"osd":7,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.49,"15min":1.347},"min":{"1min":0.83799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.615,"5min":14.381,"15min":14.381},"last":1.8169999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.3979999999999999,"15min":1.3899999999999999},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4330000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.5509999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:53:50.501 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:53:50.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.755+0000 7f5e1a217640 1 Processor -- start 2023-12-19T13:53:50.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.756+0000 7f5e1a217640 1 -- start start 2023-12-19T13:53:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.757+0000 7f5e1a217640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 0x7f5e140af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.757+0000 7f5e1a217640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e140afb10 con 0x7f5e140b0b50 2023-12-19T13:53:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.757+0000 7f5e1a217640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1406bb30 con 0x7f5e1406c6b0 2023-12-19T13:53:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.757+0000 7f5e1a217640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140b0070 con 0x7f5e141449e0 2023-12-19T13:53:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.757+0000 7f5e12ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5e140b0b50 0x7f5e1406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43202/0 (socket says 172.21.15.113:43202) 2023-12-19T13:53:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.757+0000 7f5e12ffd640 1 -- 172.21.15.113:0/1661730164 learned_addr learned my addr 172.21.15.113:0/1661730164 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e137fe640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 0x7f5e140af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343919224 0 0) 0x7f5e140afb10 con 0x7f5e140b0b50 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dfc003520 con 0x7f5e140b0b50 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2751204520 0 0) 0x7f5dfc003520 con 0x7f5e140b0b50 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 msgr2=0x7f5e140af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 0x7f5e140af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 >> v1:172.21.15.151:6789/0 conn(0x7f5e1406c6b0 legacy=0x7f5e140b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e140b0350 con 0x7f5e140b0b50 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.758+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5e08001670 con 0x7f5e140b0b50 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 >> v1:172.21.15.113:6789/0 conn(0x7f5e140b0b50 legacy=0x7f5e1406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e127fc640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 0x7f5dfc003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e127fc640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc003f90 0x7f5dfc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e127fc640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5dfc004d00 0x7f5dfc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140b0070 con 0x7f5dfc004d00 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc00bae0 con 0x7f5dfc003f90 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc00bca0 con 0x7f5e141449e0 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e13fff640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5dfc004d00 0x7f5dfc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e137fe640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 0x7f5dfc003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e12ffd640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc003f90 0x7f5dfc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e13fff640 1 -- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 msgr2=0x7f5dfc003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:50.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e13fff640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e141449e0 0x7f5dfc003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e13fff640 1 -- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc003f90 msgr2=0x7f5dfc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:50.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.759+0000 7f5e13fff640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc003f90 0x7f5dfc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.760+0000 7f5e13fff640 1 -- 172.21.15.113:0/1661730164 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc003520 con 0x7f5dfc004d00 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.761+0000 7f5e13fff640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5dfc004d00 0x7f5dfc005180 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c001e50 tx=0x7f5dfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0317ebcc2685ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.761+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c003b70 con 0x7f5dfc004d00 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.761+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c003cd0 con 0x7f5dfc004d00 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.761+0000 7f5e127fc640 1 -- 172.21.15.113:0/1661730164 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c005310 con 0x7f5dfc004d00 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.761+0000 7f5e1a217640 1 -- 172.21.15.113:0/1661730164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5dfc004d00 msgr2=0x7f5dfc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.761+0000 7f5e1a217640 1 --2- 172.21.15.113:0/1661730164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5dfc004d00 0x7f5dfc005180 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c001e50 tx=0x7f5dfc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.761+0000 7f5e13fff640 1 -- 172.21.15.113:0/1661730164 reap_dead start 2023-12-19T13:53:50.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.762+0000 7f5e1a217640 1 -- 172.21.15.113:0/1661730164 shutdown_connections 2023-12-19T13:53:50.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.762+0000 7f5e1a217640 1 -- 172.21.15.113:0/1661730164 >> 172.21.15.113:0/1661730164 conn(0x7f5e140cbb70 msgr2=0x7f5e140cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:50.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.762+0000 7f5e1a217640 1 -- 172.21.15.113:0/1661730164 shutdown_connections 2023-12-19T13:53:50.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.762+0000 7f5e1a217640 1 -- 172.21.15.113:0/1661730164 wait complete. 2023-12-19T13:53:50.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.764+0000 7f5e1a217640 1 Processor -- start 2023-12-19T13:53:50.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.764+0000 7f5e1a217640 1 -- start start 2023-12-19T13:53:50.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e1a217640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc004d00 0x7f5e140ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e1a217640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140adf70 0x7f5e141f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e1a217640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140cd130 0x7f5e140acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e1a217640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140acb50 con 0x7f5e140cd130 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e1a217640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140cac00 con 0x7f5e140adf70 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e1a217640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e141f38c0 con 0x7f5dfc004d00 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140cd130 0x7f5e140acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140cd130 0x7f5e140acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60532/0 (socket says 172.21.15.113:60532) 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 -- 172.21.15.113:0/3085490490 learned_addr learned my addr 172.21.15.113:0/3085490490 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e137fe640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc004d00 0x7f5e140ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e12ffd640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140adf70 0x7f5e141f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 -- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc004d00 msgr2=0x7f5e140ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc004d00 0x7f5e140ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 -- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140adf70 msgr2=0x7f5e141f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140adf70 0x7f5e141f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e13fff640 1 -- 172.21.15.113:0/3085490490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e141f2dc0 con 0x7f5e140cd130 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.765+0000 7f5e137fe640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc004d00 0x7f5e140ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:50.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.766+0000 7f5e13fff640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140cd130 0x7f5e140acf70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c02c060 tx=0x7f5e0c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:50.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.766+0000 7f5dfbfff640 1 -- 172.21.15.113:0/3085490490 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c03e070 con 0x7f5e140cd130 2023-12-19T13:53:50.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.766+0000 7f5dfbfff640 1 -- 172.21.15.113:0/3085490490 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c003e40 con 0x7f5e140cd130 2023-12-19T13:53:50.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.766+0000 7f5dfbfff640 1 -- 172.21.15.113:0/3085490490 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c006d90 con 0x7f5e140cd130 2023-12-19T13:53:50.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.766+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e140c38f0 con 0x7f5e140cd130 2023-12-19T13:53:50.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.766+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e141f3300 con 0x7f5e140cd130 2023-12-19T13:53:50.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.767+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e14061910 con 0x7f5e140cd130 2023-12-19T13:53:50.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.768+0000 7f5dfbfff640 1 -- 172.21.15.113:0/3085490490 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e0c041070 con 0x7f5e140cd130 2023-12-19T13:53:50.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.769+0000 7f5dfbfff640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0006a460 0x7f5e0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:50.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.769+0000 7f5dfbfff640 1 -- 172.21.15.113:0/3085490490 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e0c0a98e0 con 0x7f5e140cd130 2023-12-19T13:53:50.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.769+0000 7f5e137fe640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0006a460 0x7f5e0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:50.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.770+0000 7f5e137fe640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0006a460 0x7f5e0006c920 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5e140ced50 tx=0x7f5e04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:50.770 INFO:tasks.ceph.mds.a.smithi113.stderr:2023-12-19T13:53:50.770+0000 7f208b683640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:53:50.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.773+0000 7f5dfbfff640 1 -- 172.21.15.113:0/3085490490 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e0c074f40 con 0x7f5e140cd130 2023-12-19T13:53:50.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.958+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e140b0630 con 0x7f5e0006a460 2023-12-19T13:53:50.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.981+0000 7f5dfbfff640 1 -- 172.21.15.113:0/3085490490 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282859 (secure 0 0 0) 0x7f5e04009690 con 0x7f5e0006a460 2023-12-19T13:53:50.984 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:50.988 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:53:50.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0006a460 msgr2=0x7f5e0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0006a460 0x7f5e0006c920 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5e140ced50 tx=0x7f5e04008040 comp rx=0 tx=0).stop 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140cd130 msgr2=0x7f5e140acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140cd130 0x7f5e140acf70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c02c060 tx=0x7f5e0c0014a0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 shutdown_connections 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0006a460 0x7f5e0006c920 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140cd130 0x7f5e140acf70 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140adf70 0x7f5e141f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 --2- 172.21.15.113:0/3085490490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc004d00 0x7f5e140ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 >> 172.21.15.113:0/3085490490 conn(0x7f5e140cbb70 msgr2=0x7f5e1415b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 shutdown_connections 2023-12-19T13:53:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:50.988+0000 7f5e1a217640 1 -- 172.21.15.113:0/3085490490 wait complete. 2023-12-19T13:53:51.009 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2023-12-19T13:53:50.555448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6884,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555615,"statfs":{"total":1600000000,"available":1592950112,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.980949"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409374+0000","last_change":"2023-12-19T13:53:46.114456+0000","last_active":"2023-12-19T13:53:48.409374+0000","last_peered":"2023-12-19T13:53:48.409374+0000","last_clean":"2023-12-19T13:53:48.409374+0000","last_became_active":"2023-12-19T13:53:46.113219+0000","last_became_peered":"2023-12-19T13:53:46.113219+0000","last_unstale":"2023-12-19T13:53:48.409374+0000","last_undegraded":"2023-12-19T13:53:48.409374+0000","last_fullsized":"2023-12-19T13:53:48.409374+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:18:38.923472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409353+0000","last_change":"2023-12-19T13:53:46.108736+0000","last_active":"2023-12-19T13:53:48.409353+0000","last_peered":"2023-12-19T13:53:48.409353+0000","last_clean":"2023-12-19T13:53:48.409353+0000","last_became_active":"2023-12-19T13:53:46.108424+0000","last_became_peered":"2023-12-19T13:53:46.108424+0000","last_unstale":"2023-12-19T13:53:48.409353+0000","last_undegraded":"2023-12-19T13:53:48.409353+0000","last_fullsized":"2023-12-19T13:53:48.409353+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:27:46.025049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757718+0000","last_change":"2023-12-19T13:53:46.088850+0000","last_active":"2023-12-19T13:53:49.757718+0000","last_peered":"2023-12-19T13:53:49.757718+0000","last_clean":"2023-12-19T13:53:49.757718+0000","last_became_active":"2023-12-19T13:53:46.087802+0000","last_became_peered":"2023-12-19T13:53:46.087802+0000","last_unstale":"2023-12-19T13:53:49.757718+0000","last_undegraded":"2023-12-19T13:53:49.757718+0000","last_fullsized":"2023-12-19T13:53:49.757718+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:42.676481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409810+0000","last_change":"2023-12-19T13:53:46.110318+0000","last_active":"2023-12-19T13:53:48.409810+0000","last_peered":"2023-12-19T13:53:48.409810+0000","last_clean":"2023-12-19T13:53:48.409810+0000","last_became_active":"2023-12-19T13:53:46.110044+0000","last_became_peered":"2023-12-19T13:53:46.110044+0000","last_unstale":"2023-12-19T13:53:48.409810+0000","last_undegraded":"2023-12-19T13:53:48.409810+0000","last_fullsized":"2023-12-19T13:53:48.409810+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:18:00.566882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758440+0000","last_change":"2023-12-19T13:53:46.092506+0000","last_active":"2023-12-19T13:53:49.758440+0000","last_peered":"2023-12-19T13:53:49.758440+0000","last_clean":"2023-12-19T13:53:49.758440+0000","last_became_active":"2023-12-19T13:53:46.090848+0000","last_became_peered":"2023-12-19T13:53:46.090848+0000","last_unstale":"2023-12-19T13:53:49.758440+0000","last_undegraded":"2023-12-19T13:53:49.758440+0000","last_fullsized":"2023-12-19T13:53:49.758440+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:36:34.467496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758250+0000","last_change":"2023-12-19T13:53:46.095272+0000","last_active":"2023-12-19T13:53:49.758250+0000","last_peered":"2023-12-19T13:53:49.758250+0000","last_clean":"2023-12-19T13:53:49.758250+0000","last_became_active":"2023-12-19T13:53:46.092247+0000","last_became_peered":"2023-12-19T13:53:46.092247+0000","last_unstale":"2023-12-19T13:53:49.758250+0000","last_undegraded":"2023-12-19T13:53:49.758250+0000","last_fullsized":"2023-12-19T13:53:49.758250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:11:51.216290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757867+0000","last_change":"2023-12-19T13:53:46.092753+0000","last_active":"2023-12-19T13:53:49.757867+0000","last_peered":"2023-12-19T13:53:49.757867+0000","last_clean":"2023-12-19T13:53:49.757867+0000","last_became_active":"2023-12-19T13:53:46.092554+0000","last_became_peered":"2023-12-19T13:53:46.092554+0000","last_unstale":"2023-12-19T13:53:49.757867+0000","last_undegraded":"2023-12-19T13:53:49.757867+0000","last_fullsized":"2023-12-19T13:53:49.757867+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:05.284708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758084+0000","last_change":"2023-12-19T13:53:46.088433+0000","last_active":"2023-12-19T13:53:49.758084+0000","last_peered":"2023-12-19T13:53:49.758084+0000","last_clean":"2023-12-19T13:53:49.758084+0000","last_became_active":"2023-12-19T13:53:46.085988+0000","last_became_peered":"2023-12-19T13:53:46.085988+0000","last_unstale":"2023-12-19T13:53:49.758084+0000","last_undegraded":"2023-12-19T13:53:49.758084+0000","last_fullsized":"2023-12-19T13:53:49.758084+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:38:58.647042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757665+0000","last_change":"2023-12-19T13:53:46.095430+0000","last_active":"2023-12-19T13:53:49.757665+0000","last_peered":"2023-12-19T13:53:49.757665+0000","last_clean":"2023-12-19T13:53:49.757665+0000","last_became_active":"2023-12-19T13:53:46.095248+0000","last_became_peered":"2023-12-19T13:53:46.095248+0000","last_unstale":"2023-12-19T13:53:49.757665+0000","last_undegraded":"2023-12-19T13:53:49.757665+0000","last_fullsized":"2023-12-19T13:53:49.757665+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:24.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758042+0000","last_change":"2023-12-19T13:53:46.105380+0000","last_active":"2023-12-19T13:53:49.758042+0000","last_peered":"2023-12-19T13:53:49.758042+0000","last_clean":"2023-12-19T13:53:49.758042+0000","last_became_active":"2023-12-19T13:53:46.105057+0000","last_became_peered":"2023-12-19T13:53:46.105057+0000","last_unstale":"2023-12-19T13:53:49.758042+0000","last_undegraded":"2023-12-19T13:53:49.758042+0000","last_fullsized":"2023-12-19T13:53:49.758042+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:12.559759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758466+0000","last_change":"2023-12-19T13:53:46.095439+0000","last_active":"2023-12-19T13:53:49.758466+0000","last_peered":"2023-12-19T13:53:49.758466+0000","last_clean":"2023-12-19T13:53:49.758466+0000","last_became_active":"2023-12-19T13:53:46.092537+0000","last_became_peered":"2023-12-19T13:53:46.092537+0000","last_unstale":"2023-12-19T13:53:49.758466+0000","last_undegraded":"2023-12-19T13:53:49.758466+0000","last_fullsized":"2023-12-19T13:53:49.758466+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:18.056420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.084032+0000","last_change":"2023-12-19T13:53:46.106672+0000","last_active":"2023-12-19T13:53:47.084032+0000","last_peered":"2023-12-19T13:53:47.084032+0000","last_clean":"2023-12-19T13:53:47.084032+0000","last_became_active":"2023-12-19T13:53:46.106448+0000","last_became_peered":"2023-12-19T13:53:46.106448+0000","last_unstale":"2023-12-19T13:53:47.084032+0000","last_undegraded":"2023-12-19T13:53:47.084032+0000","last_fullsized":"2023-12-19T13:53:47.084032+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:52:37.781295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.086064+0000","last_change":"2023-12-19T13:53:46.090378+0000","last_active":"2023-12-19T13:53:47.086064+0000","last_peered":"2023-12-19T13:53:47.086064+0000","last_clean":"2023-12-19T13:53:47.086064+0000","last_became_active":"2023-12-19T13:53:46.089672+0000","last_became_peered":"2023-12-19T13:53:46.089672+0000","last_unstale":"2023-12-19T13:53:47.086064+0000","last_undegraded":"2023-12-19T13:53:47.086064+0000","last_fullsized":"2023-12-19T13:53:47.086064+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:39.608637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.410069+0000","last_change":"2023-12-19T13:53:46.108390+0000","last_active":"2023-12-19T13:53:48.410069+0000","last_peered":"2023-12-19T13:53:48.410069+0000","last_clean":"2023-12-19T13:53:48.410069+0000","last_became_active":"2023-12-19T13:53:46.105773+0000","last_became_peered":"2023-12-19T13:53:46.105773+0000","last_unstale":"2023-12-19T13:53:48.410069+0000","last_undegraded":"2023-12-19T13:53:48.410069+0000","last_fullsized":"2023-12-19T13:53:48.410069+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:38:58.647042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409915+0000","last_change":"2023-12-19T13:53:46.104800+0000","last_active":"2023-12-19T13:53:48.409915+0000","last_peered":"2023-12-19T13:53:48.409915+0000","last_clean":"2023-12-19T13:53:48.409915+0000","last_became_active":"2023-12-19T13:53:46.104302+0000","last_became_peered":"2023-12-19T13:53:46.104302+0000","last_unstale":"2023-12-19T13:53:48.409915+0000","last_undegraded":"2023-12-19T13:53:48.409915+0000","last_fullsized":"2023-12-19T13:53:48.409915+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:19.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758636+0000","last_change":"2023-12-19T13:53:46.105883+0000","last_active":"2023-12-19T13:53:49.758636+0000","last_peered":"2023-12-19T13:53:49.758636+0000","last_clean":"2023-12-19T13:53:49.758636+0000","last_became_active":"2023-12-19T13:53:46.105673+0000","last_became_peered":"2023-12-19T13:53:46.105673+0000","last_unstale":"2023-12-19T13:53:49.758636+0000","last_undegraded":"2023-12-19T13:53:49.758636+0000","last_fullsized":"2023-12-19T13:53:49.758636+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:51.637314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.089299+0000","last_change":"2023-12-19T13:53:46.105494+0000","last_active":"2023-12-19T13:53:47.089299+0000","last_peered":"2023-12-19T13:53:47.089299+0000","last_clean":"2023-12-19T13:53:47.089299+0000","last_became_active":"2023-12-19T13:53:46.104954+0000","last_became_peered":"2023-12-19T13:53:46.104954+0000","last_unstale":"2023-12-19T13:53:47.089299+0000","last_undegraded":"2023-12-19T13:53:47.089299+0000","last_fullsized":"2023-12-19T13:53:47.089299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:58.509327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409649+0000","last_change":"2023-12-19T13:53:46.107600+0000","last_active":"2023-12-19T13:53:48.409649+0000","last_peered":"2023-12-19T13:53:48.409649+0000","last_clean":"2023-12-19T13:53:48.409649+0000","last_became_active":"2023-12-19T13:53:46.104640+0000","last_became_peered":"2023-12-19T13:53:46.104640+0000","last_unstale":"2023-12-19T13:53:48.409649+0000","last_undegraded":"2023-12-19T13:53:48.409649+0000","last_fullsized":"2023-12-19T13:53:48.409649+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:39.028045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.086578+0000","last_change":"2023-12-19T13:53:46.111458+0000","last_active":"2023-12-19T13:53:47.086578+0000","last_peered":"2023-12-19T13:53:47.086578+0000","last_clean":"2023-12-19T13:53:47.086578+0000","last_became_active":"2023-12-19T13:53:46.111012+0000","last_became_peered":"2023-12-19T13:53:46.111012+0000","last_unstale":"2023-12-19T13:53:47.086578+0000","last_undegraded":"2023-12-19T13:53:47.086578+0000","last_fullsized":"2023-12-19T13:53:47.086578+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:27.170493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.083928+0000","last_change":"2023-12-19T13:53:46.091219+0000","last_active":"2023-12-19T13:53:47.083928+0000","last_peered":"2023-12-19T13:53:47.083928+0000","last_clean":"2023-12-19T13:53:47.083928+0000","last_became_active":"2023-12-19T13:53:46.090991+0000","last_became_peered":"2023-12-19T13:53:46.090991+0000","last_unstale":"2023-12-19T13:53:47.083928+0000","last_undegraded":"2023-12-19T13:53:47.083928+0000","last_fullsized":"2023-12-19T13:53:47.083928+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:25.724472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757703+0000","last_change":"2023-12-19T13:53:46.099988+0000","last_active":"2023-12-19T13:53:49.757703+0000","last_peered":"2023-12-19T13:53:49.757703+0000","last_clean":"2023-12-19T13:53:49.757703+0000","last_became_active":"2023-12-19T13:53:46.098959+0000","last_became_peered":"2023-12-19T13:53:46.098959+0000","last_unstale":"2023-12-19T13:53:49.757703+0000","last_undegraded":"2023-12-19T13:53:49.757703+0000","last_fullsized":"2023-12-19T13:53:49.757703+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:18:38.923472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757752+0000","last_change":"2023-12-19T13:53:46.092602+0000","last_active":"2023-12-19T13:53:49.757752+0000","last_peered":"2023-12-19T13:53:49.757752+0000","last_clean":"2023-12-19T13:53:49.757752+0000","last_became_active":"2023-12-19T13:53:46.091781+0000","last_became_peered":"2023-12-19T13:53:46.091781+0000","last_unstale":"2023-12-19T13:53:49.757752+0000","last_undegraded":"2023-12-19T13:53:49.757752+0000","last_fullsized":"2023-12-19T13:53:49.757752+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:39.028045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409948+0000","last_change":"2023-12-19T13:53:46.109598+0000","last_active":"2023-12-19T13:53:48.409948+0000","last_peered":"2023-12-19T13:53:48.409948+0000","last_clean":"2023-12-19T13:53:48.409948+0000","last_became_active":"2023-12-19T13:53:46.107235+0000","last_became_peered":"2023-12-19T13:53:46.107235+0000","last_unstale":"2023-12-19T13:53:48.409948+0000","last_undegraded":"2023-12-19T13:53:48.409948+0000","last_fullsized":"2023-12-19T13:53:48.409948+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:20:40.140695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.064944+0000","last_change":"2023-12-19T13:53:46.107402+0000","last_active":"2023-12-19T13:53:49.064944+0000","last_peered":"2023-12-19T13:53:49.064944+0000","last_clean":"2023-12-19T13:53:49.064944+0000","last_became_active":"2023-12-19T13:53:46.106674+0000","last_became_peered":"2023-12-19T13:53:46.106674+0000","last_unstale":"2023-12-19T13:53:49.064944+0000","last_undegraded":"2023-12-19T13:53:49.064944+0000","last_fullsized":"2023-12-19T13:53:49.064944+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:33.563623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757807+0000","last_change":"2023-12-19T13:53:46.110561+0000","last_active":"2023-12-19T13:53:49.757807+0000","last_peered":"2023-12-19T13:53:49.757807+0000","last_clean":"2023-12-19T13:53:49.757807+0000","last_became_active":"2023-12-19T13:53:46.110335+0000","last_became_peered":"2023-12-19T13:53:46.110335+0000","last_unstale":"2023-12-19T13:53:49.757807+0000","last_undegraded":"2023-12-19T13:53:49.757807+0000","last_fullsized":"2023-12-19T13:53:49.757807+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:29:32.197209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.088566+0000","last_change":"2023-12-19T13:53:46.090740+0000","last_active":"2023-12-19T13:53:47.088566+0000","last_peered":"2023-12-19T13:53:47.088566+0000","last_clean":"2023-12-19T13:53:47.088566+0000","last_became_active":"2023-12-19T13:53:46.089881+0000","last_became_peered":"2023-12-19T13:53:46.089881+0000","last_unstale":"2023-12-19T13:53:47.088566+0000","last_undegraded":"2023-12-19T13:53:47.088566+0000","last_fullsized":"2023-12-19T13:53:47.088566+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:56.136942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.065597+0000","last_change":"2023-12-19T13:53:46.089104+0000","last_active":"2023-12-19T13:53:49.065597+0000","last_peered":"2023-12-19T13:53:49.065597+0000","last_clean":"2023-12-19T13:53:49.065597+0000","last_became_active":"2023-12-19T13:53:46.086450+0000","last_became_peered":"2023-12-19T13:53:46.086450+0000","last_unstale":"2023-12-19T13:53:49.065597+0000","last_undegraded":"2023-12-19T13:53:49.065597+0000","last_fullsized":"2023-12-19T13:53:49.065597+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:12.255440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.065335+0000","last_change":"2023-12-19T13:53:46.086001+0000","last_active":"2023-12-19T13:53:49.065335+0000","last_peered":"2023-12-19T13:53:49.065335+0000","last_clean":"2023-12-19T13:53:49.065335+0000","last_became_active":"2023-12-19T13:53:46.085585+0000","last_became_peered":"2023-12-19T13:53:46.085585+0000","last_unstale":"2023-12-19T13:53:49.065335+0000","last_undegraded":"2023-12-19T13:53:49.065335+0000","last_fullsized":"2023-12-19T13:53:49.065335+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:19.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.086208+0000","last_change":"2023-12-19T13:53:46.093373+0000","last_active":"2023-12-19T13:53:47.086208+0000","last_peered":"2023-12-19T13:53:47.086208+0000","last_clean":"2023-12-19T13:53:47.086208+0000","last_became_active":"2023-12-19T13:53:46.092761+0000","last_became_peered":"2023-12-19T13:53:46.092761+0000","last_unstale":"2023-12-19T13:53:47.086208+0000","last_undegraded":"2023-12-19T13:53:47.086208+0000","last_fullsized":"2023-12-19T13:53:47.086208+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:50.652955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.088577+0000","last_change":"2023-12-19T13:53:46.109112+0000","last_active":"2023-12-19T13:53:47.088577+0000","last_peered":"2023-12-19T13:53:47.088577+0000","last_clean":"2023-12-19T13:53:47.088577+0000","last_became_active":"2023-12-19T13:53:46.108858+0000","last_became_peered":"2023-12-19T13:53:46.108858+0000","last_unstale":"2023-12-19T13:53:47.088577+0000","last_undegraded":"2023-12-19T13:53:47.088577+0000","last_fullsized":"2023-12-19T13:53:47.088577+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:10:12.559759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757965+0000","last_change":"2023-12-19T13:53:46.096412+0000","last_active":"2023-12-19T13:53:49.757965+0000","last_peered":"2023-12-19T13:53:49.757965+0000","last_clean":"2023-12-19T13:53:49.757965+0000","last_became_active":"2023-12-19T13:53:46.095974+0000","last_became_peered":"2023-12-19T13:53:46.095974+0000","last_unstale":"2023-12-19T13:53:49.757965+0000","last_undegraded":"2023-12-19T13:53:49.757965+0000","last_fullsized":"2023-12-19T13:53:49.757965+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:27:46.025049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.410127+0000","last_change":"2023-12-19T13:53:46.111315+0000","last_active":"2023-12-19T13:53:48.410127+0000","last_peered":"2023-12-19T13:53:48.410127+0000","last_clean":"2023-12-19T13:53:48.410127+0000","last_became_active":"2023-12-19T13:53:46.111040+0000","last_became_peered":"2023-12-19T13:53:46.111040+0000","last_unstale":"2023-12-19T13:53:48.410127+0000","last_undegraded":"2023-12-19T13:53:48.410127+0000","last_fullsized":"2023-12-19T13:53:48.410127+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:12.255440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.086820+0000","last_change":"2023-12-19T13:53:46.108854+0000","last_active":"2023-12-19T13:53:47.086820+0000","last_peered":"2023-12-19T13:53:47.086820+0000","last_clean":"2023-12-19T13:53:47.086820+0000","last_became_active":"2023-12-19T13:53:46.108165+0000","last_became_peered":"2023-12-19T13:53:46.108165+0000","last_unstale":"2023-12-19T13:53:47.086820+0000","last_undegraded":"2023-12-19T13:53:47.086820+0000","last_fullsized":"2023-12-19T13:53:47.086820+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:16.605268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"131'4","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.106678+0000","last_change":"2023-12-19T13:53:45.592214+0000","last_active":"2023-12-19T13:53:46.106678+0000","last_peered":"2023-12-19T13:53:46.106678+0000","last_clean":"2023-12-19T13:53:46.106678+0000","last_became_active":"2023-12-19T13:53:45.587914+0000","last_became_peered":"2023-12-19T13:53:45.587914+0000","last_unstale":"2023-12-19T13:53:46.106678+0000","last_undegraded":"2023-12-19T13:53:46.106678+0000","last_fullsized":"2023-12-19T13:53:46.106678+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:00:02.059047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.086297+0000","last_change":"2023-12-19T13:53:46.093517+0000","last_active":"2023-12-19T13:53:47.086297+0000","last_peered":"2023-12-19T13:53:47.086297+0000","last_clean":"2023-12-19T13:53:47.086297+0000","last_became_active":"2023-12-19T13:53:46.092946+0000","last_became_peered":"2023-12-19T13:53:46.092946+0000","last_unstale":"2023-12-19T13:53:47.086297+0000","last_undegraded":"2023-12-19T13:53:47.086297+0000","last_fullsized":"2023-12-19T13:53:47.086297+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:29:32.197209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"131'1","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.106015+0000","last_change":"2023-12-19T13:53:45.611207+0000","last_active":"2023-12-19T13:53:46.106015+0000","last_peered":"2023-12-19T13:53:46.106015+0000","last_clean":"2023-12-19T13:53:46.106015+0000","last_became_active":"2023-12-19T13:53:45.610967+0000","last_became_peered":"2023-12-19T13:53:45.610967+0000","last_unstale":"2023-12-19T13:53:46.106015+0000","last_undegraded":"2023-12-19T13:53:46.106015+0000","last_fullsized":"2023-12-19T13:53:46.106015+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:24.492764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409645+0000","last_change":"2023-12-19T13:53:46.114108+0000","last_active":"2023-12-19T13:53:48.409645+0000","last_peered":"2023-12-19T13:53:48.409645+0000","last_clean":"2023-12-19T13:53:48.409645+0000","last_became_active":"2023-12-19T13:53:46.112522+0000","last_became_peered":"2023-12-19T13:53:46.112522+0000","last_unstale":"2023-12-19T13:53:48.409645+0000","last_undegraded":"2023-12-19T13:53:48.409645+0000","last_fullsized":"2023-12-19T13:53:48.409645+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:56.136942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"131'2","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.106494+0000","last_change":"2023-12-19T13:53:45.607954+0000","last_active":"2023-12-19T13:53:46.106494+0000","last_peered":"2023-12-19T13:53:46.106494+0000","last_clean":"2023-12-19T13:53:46.106494+0000","last_became_active":"2023-12-19T13:53:45.605489+0000","last_became_peered":"2023-12-19T13:53:45.605489+0000","last_unstale":"2023-12-19T13:53:46.106494+0000","last_undegraded":"2023-12-19T13:53:46.106494+0000","last_fullsized":"2023-12-19T13:53:46.106494+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:33:46.762032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758271+0000","last_change":"2023-12-19T13:53:46.092248+0000","last_active":"2023-12-19T13:53:49.758271+0000","last_peered":"2023-12-19T13:53:49.758271+0000","last_clean":"2023-12-19T13:53:49.758271+0000","last_became_active":"2023-12-19T13:53:46.091967+0000","last_became_peered":"2023-12-19T13:53:46.091967+0000","last_unstale":"2023-12-19T13:53:49.758271+0000","last_undegraded":"2023-12-19T13:53:49.758271+0000","last_fullsized":"2023-12-19T13:53:49.758271+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:45.490823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"131'2","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.113599+0000","last_change":"2023-12-19T13:53:45.610047+0000","last_active":"2023-12-19T13:53:46.113599+0000","last_peered":"2023-12-19T13:53:46.113599+0000","last_clean":"2023-12-19T13:53:46.113599+0000","last_became_active":"2023-12-19T13:53:45.609783+0000","last_became_peered":"2023-12-19T13:53:45.609783+0000","last_unstale":"2023-12-19T13:53:46.113599+0000","last_undegraded":"2023-12-19T13:53:46.113599+0000","last_fullsized":"2023-12-19T13:53:46.113599+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.085707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.083774+0000","last_change":"2023-12-19T13:53:46.094399+0000","last_active":"2023-12-19T13:53:47.083774+0000","last_peered":"2023-12-19T13:53:47.083774+0000","last_clean":"2023-12-19T13:53:47.083774+0000","last_became_active":"2023-12-19T13:53:46.094103+0000","last_became_peered":"2023-12-19T13:53:46.094103+0000","last_unstale":"2023-12-19T13:53:47.083774+0000","last_undegraded":"2023-12-19T13:53:47.083774+0000","last_fullsized":"2023-12-19T13:53:47.083774+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:50.652955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"131'1","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.110758+0000","last_change":"2023-12-19T13:53:45.606622+0000","last_active":"2023-12-19T13:53:46.110758+0000","last_peered":"2023-12-19T13:53:46.110758+0000","last_clean":"2023-12-19T13:53:46.110758+0000","last_became_active":"2023-12-19T13:53:45.606343+0000","last_became_peered":"2023-12-19T13:53:45.606343+0000","last_unstale":"2023-12-19T13:53:46.110758+0000","last_undegraded":"2023-12-19T13:53:46.110758+0000","last_fullsized":"2023-12-19T13:53:46.110758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:33:46.762032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757958+0000","last_change":"2023-12-19T13:53:46.092048+0000","last_active":"2023-12-19T13:53:49.757958+0000","last_peered":"2023-12-19T13:53:49.757958+0000","last_clean":"2023-12-19T13:53:49.757958+0000","last_became_active":"2023-12-19T13:53:46.089884+0000","last_became_peered":"2023-12-19T13:53:46.089884+0000","last_unstale":"2023-12-19T13:53:49.757958+0000","last_undegraded":"2023-12-19T13:53:49.757958+0000","last_fullsized":"2023-12-19T13:53:49.757958+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:21.127022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"131'1","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.104716+0000","last_change":"2023-12-19T13:53:45.593739+0000","last_active":"2023-12-19T13:53:46.104716+0000","last_peered":"2023-12-19T13:53:46.104716+0000","last_clean":"2023-12-19T13:53:46.104716+0000","last_became_active":"2023-12-19T13:53:45.593049+0000","last_became_peered":"2023-12-19T13:53:45.593049+0000","last_unstale":"2023-12-19T13:53:46.104716+0000","last_undegraded":"2023-12-19T13:53:46.104716+0000","last_fullsized":"2023-12-19T13:53:46.104716+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:00:02.059047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.088781+0000","last_change":"2023-12-19T13:53:46.099633+0000","last_active":"2023-12-19T13:53:47.088781+0000","last_peered":"2023-12-19T13:53:47.088781+0000","last_clean":"2023-12-19T13:53:47.088781+0000","last_became_active":"2023-12-19T13:53:46.099218+0000","last_became_peered":"2023-12-19T13:53:46.099218+0000","last_unstale":"2023-12-19T13:53:47.088781+0000","last_undegraded":"2023-12-19T13:53:47.088781+0000","last_fullsized":"2023-12-19T13:53:47.088781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:45.490823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.084761+0000","last_change":"2023-12-19T13:53:45.602161+0000","last_active":"2023-12-19T13:53:46.084761+0000","last_peered":"2023-12-19T13:53:46.084761+0000","last_clean":"2023-12-19T13:53:46.084761+0000","last_became_active":"2023-12-19T13:53:45.601614+0000","last_became_peered":"2023-12-19T13:53:45.601614+0000","last_unstale":"2023-12-19T13:53:46.084761+0000","last_undegraded":"2023-12-19T13:53:46.084761+0000","last_fullsized":"2023-12-19T13:53:46.084761+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:15.600663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.083612+0000","last_change":"2023-12-19T13:53:46.090529+0000","last_active":"2023-12-19T13:53:47.083612+0000","last_peered":"2023-12-19T13:53:47.083612+0000","last_clean":"2023-12-19T13:53:47.083612+0000","last_became_active":"2023-12-19T13:53:46.090295+0000","last_became_peered":"2023-12-19T13:53:46.090295+0000","last_unstale":"2023-12-19T13:53:47.083612+0000","last_undegraded":"2023-12-19T13:53:47.083612+0000","last_fullsized":"2023-12-19T13:53:47.083612+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:39.608637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.105942+0000","last_change":"2023-12-19T13:53:45.603855+0000","last_active":"2023-12-19T13:53:46.105942+0000","last_peered":"2023-12-19T13:53:46.105942+0000","last_clean":"2023-12-19T13:53:46.105942+0000","last_became_active":"2023-12-19T13:53:45.603092+0000","last_became_peered":"2023-12-19T13:53:45.603092+0000","last_unstale":"2023-12-19T13:53:46.105942+0000","last_undegraded":"2023-12-19T13:53:46.105942+0000","last_fullsized":"2023-12-19T13:53:46.105942+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:17:59.562277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409648+0000","last_change":"2023-12-19T13:53:46.113746+0000","last_active":"2023-12-19T13:53:48.409648+0000","last_peered":"2023-12-19T13:53:48.409648+0000","last_clean":"2023-12-19T13:53:48.409648+0000","last_became_active":"2023-12-19T13:53:46.113282+0000","last_became_peered":"2023-12-19T13:53:46.113282+0000","last_unstale":"2023-12-19T13:53:48.409648+0000","last_undegraded":"2023-12-19T13:53:48.409648+0000","last_fullsized":"2023-12-19T13:53:48.409648+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:17.813205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.078092+0000","last_change":"2023-12-19T13:53:45.608720+0000","last_active":"2023-12-19T13:53:46.078092+0000","last_peered":"2023-12-19T13:53:46.078092+0000","last_clean":"2023-12-19T13:53:46.078092+0000","last_became_active":"2023-12-19T13:53:45.607966+0000","last_became_peered":"2023-12-19T13:53:45.607966+0000","last_unstale":"2023-12-19T13:53:46.078092+0000","last_undegraded":"2023-12-19T13:53:46.078092+0000","last_fullsized":"2023-12-19T13:53:46.078092+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:30.823661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.065586+0000","last_change":"2023-12-19T13:53:46.092273+0000","last_active":"2023-12-19T13:53:49.065586+0000","last_peered":"2023-12-19T13:53:49.065586+0000","last_clean":"2023-12-19T13:53:49.065586+0000","last_became_active":"2023-12-19T13:53:46.092061+0000","last_became_peered":"2023-12-19T13:53:46.092061+0000","last_unstale":"2023-12-19T13:53:49.065586+0000","last_undegraded":"2023-12-19T13:53:49.065586+0000","last_fullsized":"2023-12-19T13:53:49.065586+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:29.729404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.103401+0000","last_change":"2023-12-19T13:53:45.602076+0000","last_active":"2023-12-19T13:53:46.103401+0000","last_peered":"2023-12-19T13:53:46.103401+0000","last_clean":"2023-12-19T13:53:46.103401+0000","last_became_active":"2023-12-19T13:53:45.599944+0000","last_became_peered":"2023-12-19T13:53:45.599944+0000","last_unstale":"2023-12-19T13:53:46.103401+0000","last_undegraded":"2023-12-19T13:53:46.103401+0000","last_fullsized":"2023-12-19T13:53:46.103401+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:24.507203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757932+0000","last_change":"2023-12-19T13:53:46.104593+0000","last_active":"2023-12-19T13:53:49.757932+0000","last_peered":"2023-12-19T13:53:49.757932+0000","last_clean":"2023-12-19T13:53:49.757932+0000","last_became_active":"2023-12-19T13:53:46.104348+0000","last_became_peered":"2023-12-19T13:53:46.104348+0000","last_unstale":"2023-12-19T13:53:49.757932+0000","last_undegraded":"2023-12-19T13:53:49.757932+0000","last_fullsized":"2023-12-19T13:53:49.757932+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:20:08.401981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"131'3","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.098123+0000","last_change":"2023-12-19T13:53:45.609274+0000","last_active":"2023-12-19T13:53:46.098123+0000","last_peered":"2023-12-19T13:53:46.098123+0000","last_clean":"2023-12-19T13:53:46.098123+0000","last_became_active":"2023-12-19T13:53:45.608687+0000","last_became_peered":"2023-12-19T13:53:45.608687+0000","last_unstale":"2023-12-19T13:53:46.098123+0000","last_undegraded":"2023-12-19T13:53:46.098123+0000","last_fullsized":"2023-12-19T13:53:46.098123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:57.504722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.065484+0000","last_change":"2023-12-19T13:53:46.110676+0000","last_active":"2023-12-19T13:53:49.065484+0000","last_peered":"2023-12-19T13:53:49.065484+0000","last_clean":"2023-12-19T13:53:49.065484+0000","last_became_active":"2023-12-19T13:53:46.110338+0000","last_became_peered":"2023-12-19T13:53:46.110338+0000","last_unstale":"2023-12-19T13:53:49.065484+0000","last_undegraded":"2023-12-19T13:53:49.065484+0000","last_fullsized":"2023-12-19T13:53:49.065484+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:13.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"131'6","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.112946+0000","last_change":"2023-12-19T13:53:45.608660+0000","last_active":"2023-12-19T13:53:46.112946+0000","last_peered":"2023-12-19T13:53:46.112946+0000","last_clean":"2023-12-19T13:53:46.112946+0000","last_became_active":"2023-12-19T13:53:45.608063+0000","last_became_peered":"2023-12-19T13:53:45.608063+0000","last_unstale":"2023-12-19T13:53:46.112946+0000","last_undegraded":"2023-12-19T13:53:46.112946+0000","last_fullsized":"2023-12-19T13:53:46.112946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:00.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409797+0000","last_change":"2023-12-19T13:53:46.114305+0000","last_active":"2023-12-19T13:53:48.409797+0000","last_peered":"2023-12-19T13:53:48.409797+0000","last_clean":"2023-12-19T13:53:48.409797+0000","last_became_active":"2023-12-19T13:53:46.112869+0000","last_became_peered":"2023-12-19T13:53:46.112869+0000","last_unstale":"2023-12-19T13:53:48.409797+0000","last_undegraded":"2023-12-19T13:53:48.409797+0000","last_fullsized":"2023-12-19T13:53:48.409797+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:49.879819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"131'2","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.109859+0000","last_change":"2023-12-19T13:53:45.604049+0000","last_active":"2023-12-19T13:53:46.109859+0000","last_peered":"2023-12-19T13:53:46.109859+0000","last_clean":"2023-12-19T13:53:46.109859+0000","last_became_active":"2023-12-19T13:53:45.603507+0000","last_became_peered":"2023-12-19T13:53:45.603507+0000","last_unstale":"2023-12-19T13:53:46.109859+0000","last_undegraded":"2023-12-19T13:53:46.109859+0000","last_fullsized":"2023-12-19T13:53:46.109859+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:11.250836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757832+0000","last_change":"2023-12-19T13:53:46.110417+0000","last_active":"2023-12-19T13:53:49.757832+0000","last_peered":"2023-12-19T13:53:49.757832+0000","last_clean":"2023-12-19T13:53:49.757832+0000","last_became_active":"2023-12-19T13:53:46.109206+0000","last_became_peered":"2023-12-19T13:53:46.109206+0000","last_unstale":"2023-12-19T13:53:49.757832+0000","last_undegraded":"2023-12-19T13:53:49.757832+0000","last_fullsized":"2023-12-19T13:53:49.757832+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:17.813205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.101770+0000","last_change":"2023-12-19T13:53:45.605699+0000","last_active":"2023-12-19T13:53:46.101770+0000","last_peered":"2023-12-19T13:53:46.101770+0000","last_clean":"2023-12-19T13:53:46.101770+0000","last_became_active":"2023-12-19T13:53:45.605478+0000","last_became_peered":"2023-12-19T13:53:45.605478+0000","last_unstale":"2023-12-19T13:53:46.101770+0000","last_undegraded":"2023-12-19T13:53:46.101770+0000","last_fullsized":"2023-12-19T13:53:46.101770+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:00.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757513+0000","last_change":"2023-12-19T13:53:46.093919+0000","last_active":"2023-12-19T13:53:49.757513+0000","last_peered":"2023-12-19T13:53:49.757513+0000","last_clean":"2023-12-19T13:53:49.757513+0000","last_became_active":"2023-12-19T13:53:46.093692+0000","last_became_peered":"2023-12-19T13:53:46.093692+0000","last_unstale":"2023-12-19T13:53:49.757513+0000","last_undegraded":"2023-12-19T13:53:49.757513+0000","last_fullsized":"2023-12-19T13:53:49.757513+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:33.703235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.083963+0000","last_change":"2023-12-19T13:53:45.607326+0000","last_active":"2023-12-19T13:53:46.083963+0000","last_peered":"2023-12-19T13:53:46.083963+0000","last_clean":"2023-12-19T13:53:46.083963+0000","last_became_active":"2023-12-19T13:53:45.606131+0000","last_became_peered":"2023-12-19T13:53:45.606131+0000","last_unstale":"2023-12-19T13:53:46.083963+0000","last_undegraded":"2023-12-19T13:53:46.083963+0000","last_fullsized":"2023-12-19T13:53:46.083963+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:25:37.327195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757451+0000","last_change":"2023-12-19T13:53:46.084502+0000","last_active":"2023-12-19T13:53:49.757451+0000","last_peered":"2023-12-19T13:53:49.757451+0000","last_clean":"2023-12-19T13:53:49.757451+0000","last_became_active":"2023-12-19T13:53:46.083658+0000","last_became_peered":"2023-12-19T13:53:46.083658+0000","last_unstale":"2023-12-19T13:53:49.757451+0000","last_undegraded":"2023-12-19T13:53:49.757451+0000","last_fullsized":"2023-12-19T13:53:49.757451+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:49.879819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"131'8","reported_seq":19,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.112783+0000","last_change":"2023-12-19T13:53:45.609976+0000","last_active":"2023-12-19T13:53:46.112783+0000","last_peered":"2023-12-19T13:53:46.112783+0000","last_clean":"2023-12-19T13:53:46.112783+0000","last_became_active":"2023-12-19T13:53:45.609725+0000","last_became_peered":"2023-12-19T13:53:45.609725+0000","last_unstale":"2023-12-19T13:53:46.112783+0000","last_undegraded":"2023-12-19T13:53:46.112783+0000","last_fullsized":"2023-12-19T13:53:46.112783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:40.642318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.065105+0000","last_change":"2023-12-19T13:53:46.084850+0000","last_active":"2023-12-19T13:53:49.065105+0000","last_peered":"2023-12-19T13:53:49.065105+0000","last_clean":"2023-12-19T13:53:49.065105+0000","last_became_active":"2023-12-19T13:53:46.084689+0000","last_became_peered":"2023-12-19T13:53:46.084689+0000","last_unstale":"2023-12-19T13:53:49.065105+0000","last_undegraded":"2023-12-19T13:53:49.065105+0000","last_fullsized":"2023-12-19T13:53:49.065105+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:18:00.566882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"131'2","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.105941+0000","last_change":"2023-12-19T13:53:45.603872+0000","last_active":"2023-12-19T13:53:46.105941+0000","last_peered":"2023-12-19T13:53:46.105941+0000","last_clean":"2023-12-19T13:53:46.105941+0000","last_became_active":"2023-12-19T13:53:45.603645+0000","last_became_peered":"2023-12-19T13:53:45.603645+0000","last_unstale":"2023-12-19T13:53:46.105941+0000","last_undegraded":"2023-12-19T13:53:46.105941+0000","last_fullsized":"2023-12-19T13:53:46.105941+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:02.041076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.065834+0000","last_change":"2023-12-19T13:53:46.086680+0000","last_active":"2023-12-19T13:53:49.065834+0000","last_peered":"2023-12-19T13:53:49.065834+0000","last_clean":"2023-12-19T13:53:49.065834+0000","last_became_active":"2023-12-19T13:53:46.086023+0000","last_became_peered":"2023-12-19T13:53:46.086023+0000","last_unstale":"2023-12-19T13:53:49.065834+0000","last_undegraded":"2023-12-19T13:53:49.065834+0000","last_fullsized":"2023-12-19T13:53:49.065834+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:38:58.647042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"131'1","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.097316+0000","last_change":"2023-12-19T13:53:45.607227+0000","last_active":"2023-12-19T13:53:46.097316+0000","last_peered":"2023-12-19T13:53:46.097316+0000","last_clean":"2023-12-19T13:53:46.097316+0000","last_became_active":"2023-12-19T13:53:45.606042+0000","last_became_peered":"2023-12-19T13:53:45.606042+0000","last_unstale":"2023-12-19T13:53:46.097316+0000","last_undegraded":"2023-12-19T13:53:46.097316+0000","last_fullsized":"2023-12-19T13:53:46.097316+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:09.932132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.083919+0000","last_change":"2023-12-19T13:53:46.091210+0000","last_active":"2023-12-19T13:53:47.083919+0000","last_peered":"2023-12-19T13:53:47.083919+0000","last_clean":"2023-12-19T13:53:47.083919+0000","last_became_active":"2023-12-19T13:53:46.090978+0000","last_became_peered":"2023-12-19T13:53:46.090978+0000","last_unstale":"2023-12-19T13:53:47.083919+0000","last_undegraded":"2023-12-19T13:53:47.083919+0000","last_fullsized":"2023-12-19T13:53:47.083919+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:59.839286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.103967+0000","last_change":"2023-12-19T13:53:45.607142+0000","last_active":"2023-12-19T13:53:46.103967+0000","last_peered":"2023-12-19T13:53:46.103967+0000","last_clean":"2023-12-19T13:53:46.103967+0000","last_became_active":"2023-12-19T13:53:45.606612+0000","last_became_peered":"2023-12-19T13:53:45.606612+0000","last_unstale":"2023-12-19T13:53:46.103967+0000","last_undegraded":"2023-12-19T13:53:46.103967+0000","last_fullsized":"2023-12-19T13:53:46.103967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:18.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.087063+0000","last_change":"2023-12-19T13:53:46.108710+0000","last_active":"2023-12-19T13:53:47.087063+0000","last_peered":"2023-12-19T13:53:47.087063+0000","last_clean":"2023-12-19T13:53:47.087063+0000","last_became_active":"2023-12-19T13:53:46.107886+0000","last_became_peered":"2023-12-19T13:53:46.107886+0000","last_unstale":"2023-12-19T13:53:47.087063+0000","last_undegraded":"2023-12-19T13:53:47.087063+0000","last_fullsized":"2023-12-19T13:53:47.087063+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:16.686143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"131'2","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.113496+0000","last_change":"2023-12-19T13:53:45.609071+0000","last_active":"2023-12-19T13:53:46.113496+0000","last_peered":"2023-12-19T13:53:46.113496+0000","last_clean":"2023-12-19T13:53:46.113496+0000","last_became_active":"2023-12-19T13:53:45.608810+0000","last_became_peered":"2023-12-19T13:53:45.608810+0000","last_unstale":"2023-12-19T13:53:46.113496+0000","last_undegraded":"2023-12-19T13:53:46.113496+0000","last_fullsized":"2023-12-19T13:53:46.113496+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:02.041076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.087241+0000","last_change":"2023-12-19T13:53:46.108530+0000","last_active":"2023-12-19T13:53:47.087241+0000","last_peered":"2023-12-19T13:53:47.087241+0000","last_clean":"2023-12-19T13:53:47.087241+0000","last_became_active":"2023-12-19T13:53:46.108057+0000","last_became_peered":"2023-12-19T13:53:46.108057+0000","last_unstale":"2023-12-19T13:53:47.087241+0000","last_undegraded":"2023-12-19T13:53:47.087241+0000","last_fullsized":"2023-12-19T13:53:47.087241+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:06:53.428109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.081108+0000","last_change":"2023-12-19T13:53:45.604703+0000","last_active":"2023-12-19T13:53:46.081108+0000","last_peered":"2023-12-19T13:53:46.081108+0000","last_clean":"2023-12-19T13:53:46.081108+0000","last_became_active":"2023-12-19T13:53:45.604446+0000","last_became_peered":"2023-12-19T13:53:45.604446+0000","last_unstale":"2023-12-19T13:53:46.081108+0000","last_undegraded":"2023-12-19T13:53:46.081108+0000","last_fullsized":"2023-12-19T13:53:46.081108+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:38.604032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:48.409941+0000","last_change":"2023-12-19T13:53:46.114656+0000","last_active":"2023-12-19T13:53:48.409941+0000","last_peered":"2023-12-19T13:53:48.409941+0000","last_clean":"2023-12-19T13:53:48.409941+0000","last_became_active":"2023-12-19T13:53:46.113857+0000","last_became_peered":"2023-12-19T13:53:46.113857+0000","last_unstale":"2023-12-19T13:53:48.409941+0000","last_undegraded":"2023-12-19T13:53:48.409941+0000","last_fullsized":"2023-12-19T13:53:48.409941+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:42.676481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.091143+0000","last_change":"2023-12-19T13:53:45.605330+0000","last_active":"2023-12-19T13:53:46.091143+0000","last_peered":"2023-12-19T13:53:46.091143+0000","last_clean":"2023-12-19T13:53:46.091143+0000","last_became_active":"2023-12-19T13:53:45.604275+0000","last_became_peered":"2023-12-19T13:53:45.604275+0000","last_unstale":"2023-12-19T13:53:46.091143+0000","last_undegraded":"2023-12-19T13:53:46.091143+0000","last_fullsized":"2023-12-19T13:53:46.091143+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:52:36.776690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.065401+0000","last_change":"2023-12-19T13:53:46.086542+0000","last_active":"2023-12-19T13:53:49.065401+0000","last_peered":"2023-12-19T13:53:49.065401+0000","last_clean":"2023-12-19T13:53:49.065401+0000","last_became_active":"2023-12-19T13:53:46.085379+0000","last_became_peered":"2023-12-19T13:53:46.085379+0000","last_unstale":"2023-12-19T13:53:49.065401+0000","last_undegraded":"2023-12-19T13:53:49.065401+0000","last_fullsized":"2023-12-19T13:53:49.065401+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:56.642067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.078350+0000","last_change":"2023-12-19T13:53:45.608894+0000","last_active":"2023-12-19T13:53:46.078350+0000","last_peered":"2023-12-19T13:53:46.078350+0000","last_clean":"2023-12-19T13:53:46.078350+0000","last_became_active":"2023-12-19T13:53:45.608390+0000","last_became_peered":"2023-12-19T13:53:45.608390+0000","last_unstale":"2023-12-19T13:53:46.078350+0000","last_undegraded":"2023-12-19T13:53:46.078350+0000","last_fullsized":"2023-12-19T13:53:46.078350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:50.318527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.087521+0000","last_change":"2023-12-19T13:53:46.108349+0000","last_active":"2023-12-19T13:53:47.087521+0000","last_peered":"2023-12-19T13:53:47.087521+0000","last_clean":"2023-12-19T13:53:47.087521+0000","last_became_active":"2023-12-19T13:53:46.107623+0000","last_became_peered":"2023-12-19T13:53:46.107623+0000","last_unstale":"2023-12-19T13:53:47.087521+0000","last_undegraded":"2023-12-19T13:53:47.087521+0000","last_fullsized":"2023-12-19T13:53:47.087521+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:57.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"131'2","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.094833+0000","last_change":"2023-12-19T13:53:45.606480+0000","last_active":"2023-12-19T13:53:46.094833+0000","last_peered":"2023-12-19T13:53:46.094833+0000","last_clean":"2023-12-19T13:53:46.094833+0000","last_became_active":"2023-12-19T13:53:45.605279+0000","last_became_peered":"2023-12-19T13:53:45.605279+0000","last_unstale":"2023-12-19T13:53:46.094833+0000","last_undegraded":"2023-12-19T13:53:46.094833+0000","last_fullsized":"2023-12-19T13:53:46.094833+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:29:19.703836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.089760+0000","last_change":"2023-12-19T13:53:46.111312+0000","last_active":"2023-12-19T13:53:47.089760+0000","last_peered":"2023-12-19T13:53:47.089760+0000","last_clean":"2023-12-19T13:53:47.089760+0000","last_became_active":"2023-12-19T13:53:46.111074+0000","last_became_peered":"2023-12-19T13:53:46.111074+0000","last_unstale":"2023-12-19T13:53:47.089760+0000","last_undegraded":"2023-12-19T13:53:47.089760+0000","last_fullsized":"2023-12-19T13:53:47.089760+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:58:16.899797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"132'1","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.087728+0000","last_change":"2023-12-19T13:53:45.607674+0000","last_active":"2023-12-19T13:53:47.087728+0000","last_peered":"2023-12-19T13:53:47.087728+0000","last_clean":"2023-12-19T13:53:47.087728+0000","last_became_active":"2023-12-19T13:53:45.607431+0000","last_became_peered":"2023-12-19T13:53:45.607431+0000","last_unstale":"2023-12-19T13:53:47.087728+0000","last_undegraded":"2023-12-19T13:53:47.087728+0000","last_fullsized":"2023-12-19T13:53:47.087728+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:16.808600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758128+0000","last_change":"2023-12-19T13:53:46.087275+0000","last_active":"2023-12-19T13:53:49.758128+0000","last_peered":"2023-12-19T13:53:49.758128+0000","last_clean":"2023-12-19T13:53:49.758128+0000","last_became_active":"2023-12-19T13:53:46.086344+0000","last_became_peered":"2023-12-19T13:53:46.086344+0000","last_unstale":"2023-12-19T13:53:49.758128+0000","last_undegraded":"2023-12-19T13:53:49.758128+0000","last_fullsized":"2023-12-19T13:53:49.758128+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:19.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.104564+0000","last_change":"2023-12-19T13:53:45.611024+0000","last_active":"2023-12-19T13:53:46.104564+0000","last_peered":"2023-12-19T13:53:46.104564+0000","last_clean":"2023-12-19T13:53:46.104564+0000","last_became_active":"2023-12-19T13:53:45.610791+0000","last_became_peered":"2023-12-19T13:53:45.610791+0000","last_unstale":"2023-12-19T13:53:46.104564+0000","last_undegraded":"2023-12-19T13:53:46.104564+0000","last_fullsized":"2023-12-19T13:53:46.104564+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:38.023440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758487+0000","last_change":"2023-12-19T13:53:46.092947+0000","last_active":"2023-12-19T13:53:49.758487+0000","last_peered":"2023-12-19T13:53:49.758487+0000","last_clean":"2023-12-19T13:53:49.758487+0000","last_became_active":"2023-12-19T13:53:46.092726+0000","last_became_peered":"2023-12-19T13:53:46.092726+0000","last_unstale":"2023-12-19T13:53:49.758487+0000","last_undegraded":"2023-12-19T13:53:49.758487+0000","last_fullsized":"2023-12-19T13:53:49.758487+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:05.792380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.077894+0000","last_change":"2023-12-19T13:53:45.603705+0000","last_active":"2023-12-19T13:53:46.077894+0000","last_peered":"2023-12-19T13:53:46.077894+0000","last_clean":"2023-12-19T13:53:46.077894+0000","last_became_active":"2023-12-19T13:53:45.603461+0000","last_became_peered":"2023-12-19T13:53:45.603461+0000","last_unstale":"2023-12-19T13:53:46.077894+0000","last_undegraded":"2023-12-19T13:53:46.077894+0000","last_fullsized":"2023-12-19T13:53:46.077894+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:49.648350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.089894+0000","last_change":"2023-12-19T13:53:46.105319+0000","last_active":"2023-12-19T13:53:47.089894+0000","last_peered":"2023-12-19T13:53:47.089894+0000","last_clean":"2023-12-19T13:53:47.089894+0000","last_became_active":"2023-12-19T13:53:46.104561+0000","last_became_peered":"2023-12-19T13:53:46.104561+0000","last_unstale":"2023-12-19T13:53:47.089894+0000","last_undegraded":"2023-12-19T13:53:47.089894+0000","last_fullsized":"2023-12-19T13:53:47.089894+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:25.497369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.078609+0000","last_change":"2023-12-19T13:53:45.606764+0000","last_active":"2023-12-19T13:53:46.078609+0000","last_peered":"2023-12-19T13:53:46.078609+0000","last_clean":"2023-12-19T13:53:46.078609+0000","last_became_active":"2023-12-19T13:53:45.605119+0000","last_became_peered":"2023-12-19T13:53:45.605119+0000","last_unstale":"2023-12-19T13:53:46.078609+0000","last_undegraded":"2023-12-19T13:53:46.078609+0000","last_fullsized":"2023-12-19T13:53:46.078609+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.085707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.758752+0000","last_change":"2023-12-19T13:53:46.097189+0000","last_active":"2023-12-19T13:53:49.758752+0000","last_peered":"2023-12-19T13:53:49.758752+0000","last_clean":"2023-12-19T13:53:49.758752+0000","last_became_active":"2023-12-19T13:53:46.096960+0000","last_became_peered":"2023-12-19T13:53:46.096960+0000","last_unstale":"2023-12-19T13:53:49.758752+0000","last_undegraded":"2023-12-19T13:53:49.758752+0000","last_fullsized":"2023-12-19T13:53:49.758752+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:42.391636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.078562+0000","last_change":"2023-12-19T13:53:45.610424+0000","last_active":"2023-12-19T13:53:46.078562+0000","last_peered":"2023-12-19T13:53:46.078562+0000","last_clean":"2023-12-19T13:53:46.078562+0000","last_became_active":"2023-12-19T13:53:45.610072+0000","last_became_peered":"2023-12-19T13:53:45.610072+0000","last_unstale":"2023-12-19T13:53:46.078562+0000","last_undegraded":"2023-12-19T13:53:46.078562+0000","last_fullsized":"2023-12-19T13:53:46.078562+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:44.486218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.087311+0000","last_change":"2023-12-19T13:53:46.108550+0000","last_active":"2023-12-19T13:53:47.087311+0000","last_peered":"2023-12-19T13:53:47.087311+0000","last_clean":"2023-12-19T13:53:47.087311+0000","last_became_active":"2023-12-19T13:53:46.104989+0000","last_became_peered":"2023-12-19T13:53:46.104989+0000","last_unstale":"2023-12-19T13:53:47.087311+0000","last_undegraded":"2023-12-19T13:53:47.087311+0000","last_fullsized":"2023-12-19T13:53:47.087311+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:10.936737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.082796+0000","last_change":"2023-12-19T13:53:45.603899+0000","last_active":"2023-12-19T13:53:46.082796+0000","last_peered":"2023-12-19T13:53:46.082796+0000","last_clean":"2023-12-19T13:53:46.082796+0000","last_became_active":"2023-12-19T13:53:45.603563+0000","last_became_peered":"2023-12-19T13:53:45.603563+0000","last_unstale":"2023-12-19T13:53:46.082796+0000","last_undegraded":"2023-12-19T13:53:46.082796+0000","last_fullsized":"2023-12-19T13:53:46.082796+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.085707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:47.083937+0000","last_change":"2023-12-19T13:53:46.105633+0000","last_active":"2023-12-19T13:53:47.083937+0000","last_peered":"2023-12-19T13:53:47.083937+0000","last_clean":"2023-12-19T13:53:47.083937+0000","last_became_active":"2023-12-19T13:53:46.104521+0000","last_became_peered":"2023-12-19T13:53:46.104521+0000","last_unstale":"2023-12-19T13:53:47.083937+0000","last_undegraded":"2023-12-19T13:53:47.083937+0000","last_fullsized":"2023-12-19T13:53:47.083937+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:45.490823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.076183+0000","last_change":"2023-12-19T13:53:45.610683+0000","last_active":"2023-12-19T13:53:46.076183+0000","last_peered":"2023-12-19T13:53:46.076183+0000","last_clean":"2023-12-19T13:53:46.076183+0000","last_became_active":"2023-12-19T13:53:45.610410+0000","last_became_peered":"2023-12-19T13:53:45.610410+0000","last_unstale":"2023-12-19T13:53:46.076183+0000","last_undegraded":"2023-12-19T13:53:46.076183+0000","last_fullsized":"2023-12-19T13:53:46.076183+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:16.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-12-19T13:53:49.757988+0000","last_change":"2023-12-19T13:53:46.106000+0000","last_active":"2023-12-19T13:53:49.757988+0000","last_peered":"2023-12-19T13:53:49.757988+0000","last_clean":"2023-12-19T13:53:49.757988+0000","last_became_active":"2023-12-19T13:53:46.105731+0000","last_became_peered":"2023-12-19T13:53:46.105731+0000","last_unstale":"2023-12-19T13:53:49.757988+0000","last_undegraded":"2023-12-19T13:53:49.757988+0000","last_fullsized":"2023-12-19T13:53:49.757988+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:45.571717+0000","last_clean_scrub_stamp":"2023-12-19T13:53:45.571717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:20:40.140695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"131'1","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.105882+0000","last_change":"2023-12-19T13:53:45.608507+0000","last_active":"2023-12-19T13:53:46.105882+0000","last_peered":"2023-12-19T13:53:46.105882+0000","last_clean":"2023-12-19T13:53:46.105882+0000","last_became_active":"2023-12-19T13:53:45.607722+0000","last_became_peered":"2023-12-19T13:53:45.607722+0000","last_unstale":"2023-12-19T13:53:46.105882+0000","last_undegraded":"2023-12-19T13:53:46.105882+0000","last_fullsized":"2023-12-19T13:53:46.105882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:53:44.567112+0000","last_clean_scrub_stamp":"2023-12-19T13:53:44.567112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:06.105930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":271,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-12-19T13:53:46.082270+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:53:46.082270+0000","last_peered":"2023-12-19T13:53:46.082270+0000","last_clean":"2023-12-19T13:53:46.082270+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:53:46.082270+0000","last_undegraded":"2023-12-19T13:53:46.082270+0000","last_fullsized":"2023-12-19T13:53:46.082270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":717,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199265577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.032},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6240000000000001,"5min":1.6950000000000001,"15min":1.9059999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1120000000000001,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.7190000000000001,"15min":2.008},"last":0.89400000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.167,"15min":1.103},"min":{"1min":0.71599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6479999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.1679999999999999,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.728,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.5680000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1399999999999999,"15min":1.135},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.226,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.84999999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2390000000000001,"15min":1.179},"min":{"1min":0.74199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.181},{"interface":"front","average":{"1min":1.359,"5min":1.3120000000000001,"15min":1.2609999999999999},"min":{"1min":0.98999999999999999,"5min":0.70599999999999996,"15min":0.65200000000000002},"max":{"1min":1.883,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.3080000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2649999999999999,"15min":1.284},"min":{"1min":0.94999999999999996,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.284},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.321,"15min":1.3799999999999999},"min":{"1min":0.83099999999999996,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.653}]},{"osd":5,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.2869999999999999,"15min":1.2410000000000001},"min":{"1min":0.94599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.405,"15min":1.425},"min":{"1min":1.103,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.3759999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.3979999999999999,"15min":1.306},"min":{"1min":1.1140000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.571,"5min":1.5049999999999999,"15min":1.4950000000000001},"min":{"1min":1.228,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.4730000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266159,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.59299999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5329999999999999,"5min":1.6220000000000001,"15min":2.0640000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.099,"15min":1.1160000000000001},"min":{"1min":0.71399999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.631,"15min":3.2069999999999999},"last":0.875}]},{"osd":1,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.069,"15min":1.044},"min":{"1min":0.72899999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4570000000000001,"5min":1.5580000000000001,"15min":1.962},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.6279999999999999},"last":1.399}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":1.012,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.8180000000000001},"last":1.002},{"interface":"front","average":{"1min":1.21,"5min":1.2609999999999999,"15min":1.1839999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.647,"5min":1.802,"15min":1.802},"last":1.3480000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.242,"15min":1.319},"min":{"1min":0.78600000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.665},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.232,"15min":1.2589999999999999},"min":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.67900000000000005},"max":{"1min":1.5660000000000001,"5min":1.819,"15min":4.3899999999999997},"last":1.218}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.325,"15min":1.238},"min":{"1min":1,"5min":0.64500000000000002,"15min":0.47899999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.3779999999999999,"15min":1.3140000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.70699999999999996},"max":{"1min":1.768,"5min":1.895,"15min":1.895},"last":1.849}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.327,"15min":1.2669999999999999},"min":{"1min":0.83899999999999997,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.857,"5min":1.962,"15min":1.962},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4390000000000001,"15min":1.387},"min":{"1min":0.90600000000000003,"5min":0.80200000000000005,"15min":0.48799999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.8180000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4730000000000001,"15min":1.4319999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.59599999999999997},"max":{"1min":1.7529999999999999,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.9570000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4490000000000001,"15min":1.3799999999999999},"min":{"1min":1.073,"5min":0.72799999999999998,"15min":0.57999999999999996},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.5660000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194017,"statfs":{"total":200000000,"available":198674171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.075,"15min":1.0049999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2170000000000001,"15min":1.1080000000000001},"min":{"1min":0.81100000000000005,"5min":0.67500000000000004,"15min":0.53900000000000003},"max":{"1min":2.1429999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.85899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.167,"15min":1.1220000000000001},"min":{"1min":0.67100000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6839999999999999,"5min":6.101,"15min":6.101},"last":1.008},{"interface":"front","average":{"1min":1.153,"5min":1.1830000000000001,"15min":1.0580000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.694,"5min":2.077,"15min":2.077},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2509999999999999,"15min":1.248},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.6839999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.246,"15min":1.2629999999999999},"min":{"1min":0.754,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5569999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.3600000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3460000000000001,"15min":1.2450000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.595,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.335,"5min":1.296,"15min":1.2609999999999999},"min":{"1min":0.82099999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.75,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.264}]},{"osd":4,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.21,"15min":1.1599999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.982},"last":1.327},{"interface":"front","average":{"1min":1.347,"5min":1.395,"15min":1.3160000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":1.819,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.591}]},{"osd":6,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3700000000000001,"15min":1.335},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.821,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.3680000000000001,"15min":1.369},"min":{"1min":0.78400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.667}]},{"osd":7,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5229999999999999,"15min":1.4390000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.1219999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.536},{"interface":"front","average":{"1min":1.571,"5min":1.5129999999999999,"15min":1.4410000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.1070000000000002,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.625}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":717,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199265577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.052,"15min":1.0109999999999999},"min":{"1min":0.67700000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":1.649,"15min":1.657},"last":1.002},{"interface":"front","average":{"1min":1.05,"5min":1.091,"15min":1.1160000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.016},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0720000000000001,"15min":1.0669999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.73399999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6080000000000001,"5min":1.887,"15min":1.887},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.119,"15min":1.05},"min":{"1min":0.71999999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.4119999999999999,"5min":1.704,"15min":1.704},"last":1.51},{"interface":"front","average":{"1min":1.127,"5min":1.161,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.617,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.96099999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.208,"15min":1.214},"min":{"1min":0.98299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4470000000000001,"5min":1.8360000000000001,"15min":1.952},"last":1.385},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.29,"15min":1.2809999999999999},"min":{"1min":0.94199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7050000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.0449999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2230000000000001,"15min":1.242},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.51700000000000002},"max":{"1min":1.6020000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.149},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3129999999999999,"15min":1.335},"min":{"1min":0.79700000000000004,"5min":0.61899999999999999,"15min":0.58399999999999996},"max":{"1min":1.7529999999999999,"5min":2.306,"15min":2.3570000000000002},"last":1.631}]},{"osd":6,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3300000000000001,"15min":1.381},"min":{"1min":0.82999999999999996,"5min":0.78800000000000003,"15min":0.55900000000000005},"max":{"1min":1.472,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.4490000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.831,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.238}]},{"osd":7,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.468,"15min":1.4670000000000001},"min":{"1min":1.0409999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7689999999999999,"5min":2.948,"15min":2.948},"last":1.577},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5289999999999999,"15min":1.526},"min":{"1min":0.92900000000000005,"5min":0.85699999999999998,"15min":0.59999999999999998},"max":{"1min":1.8169999999999999,"5min":3.137,"15min":3.137},"last":1.1779999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199265965,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.90400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0760000000000001,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.95099999999999996},"min":{"1min":0.35699999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.49,"5min":1.502,"15min":3.0670000000000002},"last":0.98199999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.96599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1899999999999999,"5min":1.508,"15min":5.3769999999999998},"last":1.155},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3979999999999999,"5min":1.5780000000000001,"15min":2.387},"last":0.76000000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.95599999999999996,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.3500000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.004,"15min":1.1020000000000001},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.722,"5min":1.722,"15min":2.657},"last":1.2689999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1930000000000001,"15min":1.252},"min":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.607,"5min":1.718,"15min":3.0070000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.226,"15min":1.23},"min":{"1min":0.70799999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.629,"5min":1.835,"15min":2.7690000000000001},"last":1.3220000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2350000000000001,"15min":1.2909999999999999},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.72,"5min":1.72,"15min":2.7309999999999999},"last":1.365},{"interface":"front","average":{"1min":1.196,"5min":1.2150000000000001,"15min":1.256},"min":{"1min":0.73199999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.5249999999999999},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2270000000000001,"15min":1.2889999999999999},"min":{"1min":0.59299999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.647,"5min":1.7090000000000001,"15min":2.9769999999999999},"last":1.079},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.75800000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":2.698},"last":1.4099999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.298,"15min":1.3540000000000001},"min":{"1min":0.73399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.609},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.355,"15min":1.389},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8999999999999999,"5min":2.02,"15min":3.0379999999999998},"last":1.119}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266089,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82899999999999996,"15min":0.83199999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4550000000000001,"5min":1.544,"15min":2.258},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.002,"15min":0.84799999999999998},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.542,"5min":11.85,"15min":11.85},"last":1.165}]},{"osd":1,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.4610000000000001,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.111,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.381,"5min":11.788,"15min":11.788},"last":1.373}]},{"osd":3,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97999999999999998,"15min":0.94999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.373,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":1.01},{"interface":"front","average":{"1min":1.036,"5min":1.091,"15min":1.0369999999999999},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":1.5800000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.232}]},{"osd":4,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3640000000000001,"15min":1.1910000000000001},"min":{"1min":0.96499999999999997,"5min":0.81799999999999995,"15min":0.746},"max":{"1min":1.5580000000000001,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.786,"5min":1.786,"15min":2.2189999999999999},"last":1.339}]},{"osd":5,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4510000000000001,"15min":1.2629999999999999},"min":{"1min":0.94799999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.615,"5min":11.888,"15min":11.888},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3120000000000001,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.85199999999999998,"15min":0.68899999999999995},"max":{"1min":1.843,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.647}]},{"osd":6,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":1.0049999999999999,"5min":0.85899999999999999,"15min":0.72399999999999998},"max":{"1min":1.994,"5min":2.0640000000000001,"15min":2.964},"last":1.833},{"interface":"front","average":{"1min":1.28,"5min":1.3100000000000001,"15min":1.266},"min":{"1min":0.79000000000000004,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.8879999999999999,"5min":1.944,"15min":2.286},"last":1.5529999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.355,"15min":1.3180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.351},"last":1.772},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.468,"15min":1.3080000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.75600000000000001},"max":{"1min":1.6739999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.738}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194017,"statfs":{"total":200000000,"available":198674115,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.80500000000000005},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88200000000000001,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.94099999999999995,"15min":0.94899999999999995},"min":{"1min":0.58899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":2.351,"15min":3.3500000000000001},"last":0.55800000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93700000000000006,"15min":1.0509999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.119,"15min":1.1679999999999999},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5780000000000001,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":0.81299999999999994}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0720000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.5},"max":{"1min":1.548,"5min":1.6759999999999999,"15min":3.4300000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0189999999999999,"15min":1.1479999999999999},"min":{"1min":0.47599999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.522,"5min":1.706,"15min":7.157},"last":1.421}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.159,"15min":1.2110000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":1.4119999999999999,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.264,"15min":1.2909999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.579,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.1639999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.248,"15min":1.3100000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.538,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.121},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3839999999999999,"15min":1.363},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3999999999999999,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.4570000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.876,"5min":0.74199999999999999,"15min":0.67800000000000005},"max":{"1min":1.675,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3260000000000001,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.595,"5min":2.3159999999999998,"15min":3.786},"last":1.595}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3799999999999999,"15min":1.4359999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.637,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.512},{"interface":"front","average":{"1min":1.218,"5min":1.3140000000000001,"15min":1.429},"min":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6100000000000001,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.573}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199272459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.76600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32200000000000001,"15min":0.28299999999999997},"max":{"1min":1.639,"5min":1.639,"15min":1.6399999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.046,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2629999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.3029999999999999,"15min":1.008},"min":{"1min":0.443,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.8149999999999999,"5min":33.799999999999997,"15min":33.799999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.494,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4430000000000001,"5min":41.758000000000003,"15min":41.758000000000003},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.98399999999999999},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":1.109,"5min":1.619,"15min":4.4530000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.997,"5min":1.081,"15min":1.095},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.36499999999999999},"max":{"1min":1.9470000000000001,"5min":2.02,"15min":2.02},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.151,"15min":1.1990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.306,"5min":1.917,"15min":4.4269999999999996},"last":1.179},{"interface":"front","average":{"1min":1.21,"5min":1.407,"15min":1.234},"min":{"1min":0.80900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8700000000000001,"5min":15.766,"15min":15.766},"last":0.94699999999999995}]},{"osd":5,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.393,"15min":1.2350000000000001},"min":{"1min":0.79500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.484,"5min":14.337999999999999,"15min":14.337999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.147,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6499999999999999,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.125}]},{"osd":6,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.284},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.67800000000000005},"max":{"1min":1.7709999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.534,"15min":1.3420000000000001},"min":{"1min":0.78200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.599,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.246}]},{"osd":7,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.49,"15min":1.347},"min":{"1min":0.83799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.615,"5min":14.381,"15min":14.381},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.3979999999999999,"15min":1.3899999999999999},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4330000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":0.93600000000000005}]}]}],"pool_statfs":[]}} 2023-12-19T13:53:51.013 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:53:51.014 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:53:51.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.280+0000 7f3027600640 1 Processor -- start 2023-12-19T13:53:51.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.280+0000 7f3027600640 1 -- start start 2023-12-19T13:53:51.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.282+0000 7f3027600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30201548a0 0x7f30200ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.282+0000 7f3027600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30200cb9e0 0x7f30200cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.282+0000 7f3027600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30200cc3d0 con 0x7f302015df40 2023-12-19T13:53:51.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.282+0000 7f3027600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30200ce060 con 0x7f30200cb9e0 2023-12-19T13:53:51.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.282+0000 7f3027600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302015ee70 con 0x7f30201548a0 2023-12-19T13:53:51.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f302539c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30201548a0 0x7f30200ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f302539c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30201548a0 0x7f30200ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:42444/0 (socket says 172.21.15.113:42444) 2023-12-19T13:53:51.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f302539c640 1 -- 172.21.15.113:0/3048448915 learned_addr learned my addr 172.21.15.113:0/3048448915 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:51.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f3025b9d640 1 --2- 172.21.15.113:0/3048448915 >> v2:172.21.15.151:3300/0 conn(0x7f30200cb9e0 0x7f30200cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f302539c640 1 -- 172.21.15.113:0/3048448915 >> v2:172.21.15.151:3300/0 conn(0x7f30200cb9e0 msgr2=0x7f30200cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:51.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f302539c640 1 --2- 172.21.15.113:0/3048448915 >> v2:172.21.15.151:3300/0 conn(0x7f30200cb9e0 0x7f30200cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f302539c640 1 -- 172.21.15.113:0/3048448915 >> v1:172.21.15.151:6789/0 conn(0x7f302015df40 legacy=0x7f302015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.283+0000 7f302539c640 1 -- 172.21.15.113:0/3048448915 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302015eb90 con 0x7f30201548a0 2023-12-19T13:53:51.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.285+0000 7f302539c640 1 --2- 172.21.15.113:0/3048448915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30201548a0 0x7f30200ceb00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f301c009870 tx=0x7f301c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a58e00b3856ac565 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:51.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3017fff640 1 -- 172.21.15.113:0/3048448915 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c030840 con 0x7f30201548a0 2023-12-19T13:53:51.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3017fff640 1 -- 172.21.15.113:0/3048448915 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c0309a0 con 0x7f30201548a0 2023-12-19T13:53:51.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3017fff640 1 -- 172.21.15.113:0/3048448915 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c030d30 con 0x7f30201548a0 2023-12-19T13:53:51.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3027600640 1 -- 172.21.15.113:0/3048448915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30201548a0 msgr2=0x7f30200ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3027600640 1 --2- 172.21.15.113:0/3048448915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30201548a0 0x7f30200ceb00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f301c009870 tx=0x7f301c02b980 comp rx=0 tx=0).stop 2023-12-19T13:53:51.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3027600640 1 -- 172.21.15.113:0/3048448915 shutdown_connections 2023-12-19T13:53:51.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3027600640 1 --2- 172.21.15.113:0/3048448915 >> v2:172.21.15.151:3300/0 conn(0x7f30200cb9e0 0x7f30200cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.286+0000 7f3027600640 1 --2- 172.21.15.113:0/3048448915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30201548a0 0x7f30200ceb00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.287+0000 7f3027600640 1 -- 172.21.15.113:0/3048448915 >> 172.21.15.113:0/3048448915 conn(0x7f30200659d0 msgr2=0x7f3020065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:51.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.287+0000 7f3027600640 1 -- 172.21.15.113:0/3048448915 shutdown_connections 2023-12-19T13:53:51.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.287+0000 7f3027600640 1 -- 172.21.15.113:0/3048448915 wait complete. 2023-12-19T13:53:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.289+0000 7f3027600640 1 Processor -- start 2023-12-19T13:53:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.289+0000 7f3027600640 1 -- start start 2023-12-19T13:53:51.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.290+0000 7f3027600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30200cb9e0 0x7f302014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.290+0000 7f3027600640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30201548a0 0x7f30200afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.290+0000 7f3027600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f302015df40 0x7f30201fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.290+0000 7f3027600640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30200af2d0 con 0x7f30201548a0 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.290+0000 7f3027600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30201faf40 con 0x7f30200cb9e0 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.290+0000 7f3027600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30201fb220 con 0x7f302015df40 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30201548a0 0x7f30200afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30201548a0 0x7f30200afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60546/0 (socket says 172.21.15.113:60546) 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 -- 172.21.15.113:0/3320891468 learned_addr learned my addr 172.21.15.113:0/3320891468 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f302539c640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30200cb9e0 0x7f302014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3025b9d640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f302015df40 0x7f30201fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 -- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f302015df40 msgr2=0x7f30201fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f302015df40 0x7f30201fa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 -- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30200cb9e0 msgr2=0x7f302014a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30200cb9e0 0x7f302014a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f3024b9b640 1 -- 172.21.15.113:0/3320891468 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0094d0 con 0x7f30201548a0 2023-12-19T13:53:51.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.291+0000 7f302539c640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30200cb9e0 0x7f302014a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:53:51.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.292+0000 7f3024b9b640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30201548a0 0x7f30200afd20 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f301000c400 tx=0x7f301000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:51.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.292+0000 7f3015ffb640 1 -- 172.21.15.113:0/3320891468 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100052d0 con 0x7f30201548a0 2023-12-19T13:53:51.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.292+0000 7f3015ffb640 1 -- 172.21.15.113:0/3320891468 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010005430 con 0x7f30201548a0 2023-12-19T13:53:51.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.292+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30200af520 con 0x7f30201548a0 2023-12-19T13:53:51.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.292+0000 7f3015ffb640 1 -- 172.21.15.113:0/3320891468 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010003830 con 0x7f30201548a0 2023-12-19T13:53:51.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.292+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302014a810 con 0x7f30201548a0 2023-12-19T13:53:51.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.293+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30200afa40 con 0x7f30201548a0 2023-12-19T13:53:51.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.294+0000 7f3015ffb640 1 -- 172.21.15.113:0/3320891468 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3010003990 con 0x7f30201548a0 2023-12-19T13:53:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.295+0000 7f3015ffb640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f300406a430 0x7f300406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.295+0000 7f3015ffb640 1 -- 172.21.15.113:0/3320891468 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3010087ec0 con 0x7f30201548a0 2023-12-19T13:53:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.296+0000 7f302539c640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f300406a430 0x7f300406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.296+0000 7f302539c640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f300406a430 0x7f300406c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f301c036000 tx=0x7f301c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:51.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.299+0000 7f3015ffb640 1 -- 172.21.15.113:0/3320891468 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f30200afa40 con 0x7f30201548a0 2023-12-19T13:53:51.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.557+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f30200afa40 con 0x7f30201548a0 2023-12-19T13:53:51.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.564+0000 7f3015ffb640 1 -- 172.21.15.113:0/3320891468 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f30200afa40 con 0x7f30201548a0 2023-12-19T13:53:51.564 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:53:51.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f300406a430 msgr2=0x7f300406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f300406a430 0x7f300406c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f301c036000 tx=0x7f301c008030 comp rx=0 tx=0).stop 2023-12-19T13:53:51.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30201548a0 msgr2=0x7f30200afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30201548a0 0x7f30200afd20 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f301000c400 tx=0x7f301000c8c0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 shutdown_connections 2023-12-19T13:53:51.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f300406a430 0x7f300406c8f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f302015df40 0x7f30201fa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30201548a0 0x7f30200afd20 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 --2- 172.21.15.113:0/3320891468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30200cb9e0 0x7f302014a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 >> 172.21.15.113:0/3320891468 conn(0x7f30200659d0 msgr2=0x7f302015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:51.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 shutdown_connections 2023-12-19T13:53:51.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.567+0000 7f3027600640 1 -- 172.21.15.113:0/3320891468 wait complete. 2023-12-19T13:53:51.586 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:51.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.793+0000 7f7a00ae5640 1 Processor -- start 2023-12-19T13:53:51.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.794+0000 7f7a00ae5640 1 -- start start 2023-12-19T13:53:51.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.795+0000 7f7a00ae5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f79fc1449e0 0x7f79fc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.795+0000 7f7a00ae5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79fc0b0b50 0x7f79fc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.795+0000 7f7a00ae5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc0afb10 con 0x7f79fc06b590 2023-12-19T13:53:51.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.795+0000 7f7a00ae5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc06bb30 con 0x7f79fc0b0b50 2023-12-19T13:53:51.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.795+0000 7f7a00ae5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc0b0070 con 0x7f79fc1449e0 2023-12-19T13:53:51.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.795+0000 7f79f3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79fc0b0b50 0x7f79fc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79fad9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f79fc06b590 0x7f79fc15eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43212/0 (socket says 172.21.15.113:43212) 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79fad9d640 1 -- 172.21.15.113:0/3560900792 learned_addr learned my addr 172.21.15.113:0/3560900792 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79fa59c640 1 --2- 172.21.15.113:0/3560900792 >> v2:172.21.15.151:3300/0 conn(0x7f79fc1449e0 0x7f79fc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79f3fff640 1 -- 172.21.15.113:0/3560900792 >> v2:172.21.15.151:3300/0 conn(0x7f79fc1449e0 msgr2=0x7f79fc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79f3fff640 1 --2- 172.21.15.113:0/3560900792 >> v2:172.21.15.151:3300/0 conn(0x7f79fc1449e0 0x7f79fc0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79f3fff640 1 -- 172.21.15.113:0/3560900792 >> v1:172.21.15.113:6789/0 conn(0x7f79fc06b590 legacy=0x7f79fc15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79f3fff640 1 -- 172.21.15.113:0/3560900792 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0b0350 con 0x7f79fc0b0b50 2023-12-19T13:53:51.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.796+0000 7f79f9d9b640 1 -- 172.21.15.113:0/3560900792 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465341668 0 0) 0x7f79fc0afb10 con 0x7f79fc06b590 2023-12-19T13:53:51.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.797+0000 7f79f3fff640 1 --2- 172.21.15.113:0/3560900792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc06bfa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f79fc071cd0 tx=0x7f79e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3938aa3b097e240c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.797+0000 7f79f9d9b640 1 -- 172.21.15.113:0/3560900792 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4031830 con 0x7f79fc0b0b50 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.797+0000 7f79f9d9b640 1 -- 172.21.15.113:0/3560900792 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4031990 con 0x7f79fc0b0b50 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.797+0000 7f79f9d9b640 1 -- 172.21.15.113:0/3560900792 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4031d20 con 0x7f79fc0b0b50 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 -- 172.21.15.113:0/3560900792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 msgr2=0x7f79fc06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/3560900792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc06bfa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f79fc071cd0 tx=0x7f79e402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 -- 172.21.15.113:0/3560900792 shutdown_connections 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/3560900792 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc06bfa0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/3560900792 >> v2:172.21.15.151:3300/0 conn(0x7f79fc1449e0 0x7f79fc0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 -- 172.21.15.113:0/3560900792 >> 172.21.15.113:0/3560900792 conn(0x7f79fc0cbb70 msgr2=0x7f79fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 -- 172.21.15.113:0/3560900792 shutdown_connections 2023-12-19T13:53:51.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.798+0000 7f7a00ae5640 1 -- 172.21.15.113:0/3560900792 wait complete. 2023-12-19T13:53:51.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.800+0000 7f7a00ae5640 1 Processor -- start 2023-12-19T13:53:51.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.800+0000 7f7a00ae5640 1 -- start start 2023-12-19T13:53:51.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f7a00ae5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc06b590 0x7f79fc15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f7a00ae5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f7a00ae5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc1449e0 0x7f79fc13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f7a00ae5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0ae1b0 con 0x7f79fc0b0b50 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f7a00ae5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc15b2d0 con 0x7f79fc1449e0 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f7a00ae5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0ad530 con 0x7f79fc06b590 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc13f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60562/0 (socket says 172.21.15.113:60562) 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f79f3fff640 1 -- 172.21.15.113:0/2704623721 learned_addr learned my addr 172.21.15.113:0/2704623721 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.801+0000 7f79f3fff640 1 -- 172.21.15.113:0/2704623721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc06b590 msgr2=0x7f79fc15ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f3fff640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc06b590 0x7f79fc15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f3fff640 1 -- 172.21.15.113:0/2704623721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc1449e0 msgr2=0x7f79fc13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f3fff640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc1449e0 0x7f79fc13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:51.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f3fff640 1 -- 172.21.15.113:0/2704623721 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4009400 con 0x7f79fc0b0b50 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f3fff640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc13f5f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009890 tx=0x7f79e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f2ffd640 1 -- 172.21.15.113:0/2704623721 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e403ba70 con 0x7f79fc0b0b50 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f2ffd640 1 -- 172.21.15.113:0/2704623721 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e403bbf0 con 0x7f79fc0b0b50 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f79f2ffd640 1 -- 172.21.15.113:0/2704623721 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4045400 con 0x7f79fc0b0b50 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc0ad810 con 0x7f79fc0b0b50 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.802+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc0addd0 con 0x7f79fc0b0b50 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.803+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc061910 con 0x7f79fc0b0b50 2023-12-19T13:53:51.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.804+0000 7f79f2ffd640 1 -- 172.21.15.113:0/2704623721 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79e404e440 con 0x7f79fc0b0b50 2023-12-19T13:53:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.805+0000 7f79f2ffd640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79dc06a430 0x7f79dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.805+0000 7f79f2ffd640 1 -- 172.21.15.113:0/2704623721 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79e40aace0 con 0x7f79fc0b0b50 2023-12-19T13:53:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.805+0000 7f79fa59c640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79dc06a430 0x7f79dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:51.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.806+0000 7f79fa59c640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79dc06a430 0x7f79dc06c8f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f79ec006fd0 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:51.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:51.809+0000 7f79f2ffd640 1 -- 172.21.15.113:0/2704623721 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f79e40763e0 con 0x7f79fc0b0b50 2023-12-19T13:53:52.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.031+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79fc0ae560 con 0x7f79fc0b0b50 2023-12-19T13:53:52.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.033+0000 7f79f2ffd640 1 -- 172.21.15.113:0/2704623721 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f79e4079a00 con 0x7f79fc0b0b50 2023-12-19T13:53:52.033 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:52.033 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:53:52.033 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:53:52.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79dc06a430 msgr2=0x7f79dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79dc06a430 0x7f79dc06c8f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f79ec006fd0 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 msgr2=0x7f79fc13f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc13f5f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009890 tx=0x7f79e40046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 shutdown_connections 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79dc06a430 0x7f79dc06c8f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc1449e0 0x7f79fc13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc0b0b50 0x7f79fc13f5f0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 --2- 172.21.15.113:0/2704623721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc06b590 0x7f79fc15ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 >> 172.21.15.113:0/2704623721 conn(0x7f79fc0cbb70 msgr2=0x7f79fc0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 shutdown_connections 2023-12-19T13:53:52.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.035+0000 7f7a00ae5640 1 -- 172.21.15.113:0/2704623721 wait complete. 2023-12-19T13:53:52.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:53:46.069612+0000', 'modified': '2023-12-19T13:53:49.096615+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7359}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7359': {'gid': 7359, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.113:6836/2259732918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6834', 'nonce': 2259732918}, {'type': 'v1', 'addr': '172.21.15.113:6836', 'nonce': 2259732918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:53:52.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:53:52.457 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T13:53:52.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.683+0000 7f656a19c640 1 Processor -- start 2023-12-19T13:53:52.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.683+0000 7f656a19c640 1 -- start start 2023-12-19T13:53:52.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.684+0000 7f656a19c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f65641449e0 0x7f65640af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.684+0000 7f656a19c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640afb10 con 0x7f656406c6b0 2023-12-19T13:53:52.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.684+0000 7f656a19c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656406bb30 con 0x7f65640b0b50 2023-12-19T13:53:52.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.684+0000 7f656a19c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65640b0070 con 0x7f65641449e0 2023-12-19T13:53:52.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.685+0000 7f65637fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f65641449e0 0x7f65640af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.685+0000 7f65637fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f65641449e0 0x7f65640af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60570/0 (socket says 172.21.15.113:60570) 2023-12-19T13:53:52.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.685+0000 7f65637fe640 1 -- 172.21.15.113:0/2331161441 learned_addr learned my addr 172.21.15.113:0/2331161441 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.685+0000 7f6563fff640 1 --1- 172.21.15.113:0/2331161441 >> v1:172.21.15.113:6789/0 conn(0x7f656406c6b0 0x7f65640b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43228/0 (socket says 172.21.15.113:43228) 2023-12-19T13:53:52.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.685+0000 7f65637fe640 1 -- 172.21.15.113:0/2331161441 >> v1:172.21.15.151:6789/0 conn(0x7f65640b0b50 legacy=0x7f656406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.685+0000 7f65637fe640 1 -- 172.21.15.113:0/2331161441 >> v1:172.21.15.113:6789/0 conn(0x7f656406c6b0 legacy=0x7f65640b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.685+0000 7f65637fe640 1 -- 172.21.15.113:0/2331161441 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640b0350 con 0x7f65641449e0 2023-12-19T13:53:52.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.686+0000 7f65637fe640 1 --2- 172.21.15.113:0/2331161441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65641449e0 0x7f65640af5d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6554009870 tx=0x7f655402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6940ab00846f5f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f6562ffd640 1 -- 172.21.15.113:0/2331161441 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554030860 con 0x7f65641449e0 2023-12-19T13:53:52.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f6562ffd640 1 -- 172.21.15.113:0/2331161441 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65540309c0 con 0x7f65641449e0 2023-12-19T13:53:52.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f6562ffd640 1 -- 172.21.15.113:0/2331161441 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554030d50 con 0x7f65641449e0 2023-12-19T13:53:52.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f656a19c640 1 -- 172.21.15.113:0/2331161441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65641449e0 msgr2=0x7f65640af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f656a19c640 1 --2- 172.21.15.113:0/2331161441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65641449e0 0x7f65640af5d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6554009870 tx=0x7f655402b9a0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f656a19c640 1 -- 172.21.15.113:0/2331161441 shutdown_connections 2023-12-19T13:53:52.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f656a19c640 1 --2- 172.21.15.113:0/2331161441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65641449e0 0x7f65640af5d0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f656a19c640 1 -- 172.21.15.113:0/2331161441 >> 172.21.15.113:0/2331161441 conn(0x7f65640cbb70 msgr2=0x7f65640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f656a19c640 1 -- 172.21.15.113:0/2331161441 shutdown_connections 2023-12-19T13:53:52.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.687+0000 7f656a19c640 1 -- 172.21.15.113:0/2331161441 wait complete. 2023-12-19T13:53:52.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.689+0000 7f656a19c640 1 Processor -- start 2023-12-19T13:53:52.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.690+0000 7f656a19c640 1 -- start start 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f656a19c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f656406c6b0 0x7f656413ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f656a19c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65640b0b50 0x7f65640b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f656a19c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65641449e0 0x7f65640b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f656a19c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656415dac0 con 0x7f65640b0b50 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f656a19c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656415ce40 con 0x7f65641449e0 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f656a19c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656415d120 con 0x7f656406c6b0 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65640b0b50 0x7f65640b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65640b0b50 0x7f65640b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60586/0 (socket says 172.21.15.113:60586) 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.691+0000 7f655bfff640 1 -- 172.21.15.113:0/342286825 learned_addr learned my addr 172.21.15.113:0/342286825 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f65637fe640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f656406c6b0 0x7f656413ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f655bfff640 1 -- 172.21.15.113:0/342286825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f656406c6b0 msgr2=0x7f656413ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f655bfff640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f656406c6b0 0x7f656413ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f655bfff640 1 -- 172.21.15.113:0/342286825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65641449e0 msgr2=0x7f65640b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f655bfff640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65641449e0 0x7f65640b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f655bfff640 1 -- 172.21.15.113:0/342286825 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65540094d0 con 0x7f65640b0b50 2023-12-19T13:53:52.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f655bfff640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65640b0b50 0x7f65640b1e70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f654c00c430 tx=0x7f654c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f6560ff9640 1 -- 172.21.15.113:0/342286825 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c011790 con 0x7f65640b0b50 2023-12-19T13:53:52.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f6560ff9640 1 -- 172.21.15.113:0/342286825 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c0118f0 con 0x7f65640b0b50 2023-12-19T13:53:52.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656415d400 con 0x7f65640b0b50 2023-12-19T13:53:52.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f6560ff9640 1 -- 172.21.15.113:0/342286825 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c011ce0 con 0x7f65640b0b50 2023-12-19T13:53:52.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.692+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656415dee0 con 0x7f65640b0b50 2023-12-19T13:53:52.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.695+0000 7f6560ff9640 1 -- 172.21.15.113:0/342286825 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f654c01c460 con 0x7f65640b0b50 2023-12-19T13:53:52.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.695+0000 7f6560ff9640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f654406a460 0x7f654406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.696+0000 7f6560ff9640 1 -- 172.21.15.113:0/342286825 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f654c0887c0 con 0x7f65640b0b50 2023-12-19T13:53:52.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.696+0000 7f65637fe640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f654406a460 0x7f654406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.697+0000 7f65637fe640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f654406a460 0x7f654406c920 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6554036000 tx=0x7f655403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.697+0000 7f656cddf740 1 Processor -- start 2023-12-19T13:53:52.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.697+0000 7f656cddf740 1 -- start start 2023-12-19T13:53:52.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f656cddf740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00c3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c0092cb0 0x5624c00bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f656cddf740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c0002f80 con 0x5624c00c2d30 2023-12-19T13:53:52.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c0000710 con 0x5624c0092cb0 2023-12-19T13:53:52.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624bfffc000 con 0x5624c00968b0 2023-12-19T13:53:52.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f65637fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f65637fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00c3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60592/0 (socket says 172.21.15.113:60592) 2023-12-19T13:53:52.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f65637fe640 1 -- 172.21.15.113:0/2414125660 learned_addr learned my addr 172.21.15.113:0/2414125660 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f65637fe640 1 -- 172.21.15.113:0/2414125660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 msgr2=0x5624c00c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.698+0000 7f65637fe640 1 --2- 172.21.15.113:0/2414125660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.699+0000 7f65637fe640 1 -- 172.21.15.113:0/2414125660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c0092cb0 msgr2=0x5624c00bffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.699+0000 7f65637fe640 1 --2- 172.21.15.113:0/2414125660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c0092cb0 0x5624c00bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.699+0000 7f65637fe640 1 -- 172.21.15.113:0/2414125660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bffc3690 con 0x5624c00c2d30 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.699+0000 7f65637fe640 1 --2- 172.21.15.113:0/2414125660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00c3110 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f655402bfb0 tx=0x7f6554030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45058387c5e7a910 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.699+0000 7f65597fa640 1 -- 172.21.15.113:0/2414125660 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554049070 con 0x5624c00c2d30 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.699+0000 7f65597fa640 1 -- 172.21.15.113:0/2414125660 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6554030cb0 con 0x5624c00c2d30 2023-12-19T13:53:52.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.699+0000 7f65597fa640 1 -- 172.21.15.113:0/2414125660 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655404e670 con 0x5624c00c2d30 2023-12-19T13:53:52.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 -- 172.21.15.113:0/2414125660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 msgr2=0x5624c00c3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 --2- 172.21.15.113:0/2414125660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00c3110 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f655402bfb0 tx=0x7f6554030000 comp rx=0 tx=0).stop 2023-12-19T13:53:52.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 -- 172.21.15.113:0/2414125660 shutdown_connections 2023-12-19T13:53:52.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 --2- 172.21.15.113:0/2414125660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 --2- 172.21.15.113:0/2414125660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c0092cb0 0x5624c00bffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 --2- 172.21.15.113:0/2414125660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00c3110 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 -- 172.21.15.113:0/2414125660 >> 172.21.15.113:0/2414125660 conn(0x5624c0094fc0 msgr2=0x5624c00ddb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 -- 172.21.15.113:0/2414125660 shutdown_connections 2023-12-19T13:53:52.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.700+0000 7f656cddf740 1 -- 172.21.15.113:0/2414125660 wait complete. 2023-12-19T13:53:52.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.701+0000 7f656cddf740 1 -- start start 2023-12-19T13:53:52.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.701+0000 7f656cddf740 1 Processor -- start 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f656cddf740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c69f0 0x5624c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f656cddf740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bff9d7d0 con 0x5624c00c2d30 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bff9d470 con 0x5624c00c69f0 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624bfd63f20 con 0x5624c00968b0 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f656cddf740 10 client.0 _ll_register_callbacks cb 0x5624bffec1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60594/0 (socket says 172.21.15.113:60594) 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.702+0000 7f655bfff640 1 -- 172.21.15.113:0/1261741169 learned_addr learned my addr 172.21.15.113:0/1261741169 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f65637fe640 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f655bfff640 1 -- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 msgr2=0x5624c00c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f655bfff640 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f655bfff640 1 -- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c69f0 msgr2=0x5624c00a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f655bfff640 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c69f0 0x5624c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f655bfff640 1 -- 172.21.15.113:0/1261741169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65640b0350 con 0x5624c00c2d30 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f65637fe640 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f655bfff640 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a4b80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f654c00a040 tx=0x7f654c057b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb04efb9963e207 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f65427fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f65427fc640 1 -- 172.21.15.113:0/1261741169 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c06f0d0 con 0x5624c00c2d30 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f65427fc640 1 -- 172.21.15.113:0/1261741169 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f654c05fae0 con 0x5624c00c2d30 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.703+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624c0026550 con 0x5624c00c2d30 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f65427fc640 1 -- 172.21.15.113:0/1261741169 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f654c05f650 con 0x5624c00c2d30 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 10 client.7500 fetch_fsmap learned FSMap version 57 2023-12-19T13:53:52.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5624bfffa680 con 0x5624c00c2d30 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f65427fc640 1 -- 172.21.15.113:0/1261741169 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624c0026550 con 0x5624c00c2d30 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f65427fc640 1 -- 172.21.15.113:0/1261741169 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 57) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f654c058b10 con 0x5624c00c2d30 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 10 client.7500 fetch_fsmap finished waiting for FSMap version 57 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 10 client.7500 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 20 client.7500 populate_metadata read hostname 'smithi113' 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00a6bb0 0x5624c00fa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 4 client.7500 mds_command: new command op to 7359 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 --> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624bffeeb50 con 0x5624c00a6bb0 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.704+0000 7f65637fe640 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00a6bb0 0x5624c00fa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.705+0000 7f65637fe640 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00a6bb0 0x5624c00fa9d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417e8f4931e90fe1 server_cookie=bf7cebf4c6dd656e in_seq=0 out_seq=0 2023-12-19T13:53:52.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.705+0000 7f65427fc640 10 client.7500 ms_handle_connect on v2:172.21.15.113:6834/2259732918 2023-12-19T13:53:52.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f65427fc640 1 -- 172.21.15.113:0/1261741169 <== mds.0 v2:172.21.15.113:6834/2259732918 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5624bffeeb50 con 0x5624c00a6bb0 2023-12-19T13:53:52.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f65427fc640 10 client.7500 handle_command_reply: tid=0 2023-12-19T13:53:52.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 client.7500 shutdown 2023-12-19T13:53:52.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 msgr2=0x5624c00a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a4b80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f654c00a040 tx=0x7f654c057b00 comp rx=0 tx=0).stop 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 shutdown_connections 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00a6bb0 0x5624c00fa9d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c69f0 0x5624c00a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a4b80 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 --2- 172.21.15.113:0/1261741169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c00c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f65427fc640 0 client.7500 ms_handle_reset on v2:172.21.15.113:6834/2259732918 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 >> 172.21.15.113:0/1261741169 conn(0x5624c0092cb0 msgr2=0x5624c0097270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 shutdown_connections 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 1 -- 172.21.15.113:0/1261741169 wait complete. 2023-12-19T13:53:52.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.706+0000 7f656cddf740 20 client.7500 trim_cache size 0 max 16384 2023-12-19T13:53:52.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.723+0000 7f656cddf740 1 Processor -- start 2023-12-19T13:53:52.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.723+0000 7f656cddf740 1 -- start start 2023-12-19T13:53:52.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.723+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c0097040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.723+0000 7f656cddf740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.723+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c1d80 0x5624c00a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.723+0000 7f656cddf740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c00e1440 con 0x5624c00c2d30 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c00fcca0 con 0x5624c00c1d80 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624c00c0e20 con 0x5624c00968b0 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60608/0 (socket says 172.21.15.113:60608) 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 -- 172.21.15.113:0/38165565 learned_addr learned my addr 172.21.15.113:0/38165565 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 -- 172.21.15.113:0/38165565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 msgr2=0x5624c0097040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f65637fe640 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c0097040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c0097040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 -- 172.21.15.113:0/38165565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c1d80 msgr2=0x5624c00a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c1d80 0x5624c00a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 -- 172.21.15.113:0/38165565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bff9c9e0 con 0x5624c00c2d30 2023-12-19T13:53:52.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.724+0000 7f655bfff640 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a98f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f654c057a90 tx=0x7f654c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec30a6b4ab625215 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f6559ffb640 1 -- 172.21.15.113:0/38165565 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c00e040 con 0x5624c00c2d30 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f6559ffb640 1 -- 172.21.15.113:0/38165565 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c06f0d0 con 0x5624c00c2d30 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f6559ffb640 1 -- 172.21.15.113:0/38165565 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c05fae0 con 0x5624c00c2d30 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 -- 172.21.15.113:0/38165565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 msgr2=0x5624c00a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a98f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f654c057a90 tx=0x7f654c013000 comp rx=0 tx=0).stop 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 -- 172.21.15.113:0/38165565 shutdown_connections 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00c1d80 0x5624c00a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00a98f0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 --2- 172.21.15.113:0/38165565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c00968b0 0x5624c0097040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 -- 172.21.15.113:0/38165565 >> 172.21.15.113:0/38165565 conn(0x5624c0092cb0 msgr2=0x5624c0093fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 -- 172.21.15.113:0/38165565 shutdown_connections 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.725+0000 7f656cddf740 1 -- 172.21.15.113:0/38165565 wait complete. 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.726+0000 7f656cddf740 1 -- start start 2023-12-19T13:53:52.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.726+0000 7f656cddf740 1 Processor -- start 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00968b0 0x5624c00db920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f656cddf740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00fc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f656cddf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c013b860 0x5624c00dbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f656cddf740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c0098730 con 0x5624c00c2d30 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c00f8fe0 con 0x5624c00968b0 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f656cddf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624c00bcaa0 con 0x5624c013b860 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f656cddf740 10 client.0 _ll_register_callbacks cb 0x7f65540096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00fc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f655bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00fc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60614/0 (socket says 172.21.15.113:60614) 2023-12-19T13:53:52.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.727+0000 7f655bfff640 1 -- 172.21.15.113:0/607684537 learned_addr learned my addr 172.21.15.113:0/607684537 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f655bfff640 1 -- 172.21.15.113:0/607684537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c013b860 msgr2=0x5624c00dbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f655bfff640 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c013b860 0x5624c00dbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f655bfff640 1 -- 172.21.15.113:0/607684537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00968b0 msgr2=0x5624c00db920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f65637fe640 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00968b0 0x5624c00db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f655bfff640 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00968b0 0x5624c00db920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f655bfff640 1 -- 172.21.15.113:0/607684537 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624bfffa680 con 0x5624c00c2d30 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f655bfff640 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00fc4a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f654c057800 tx=0x7f654c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af28ef34943fc389 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f65427fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f65427fc640 1 -- 172.21.15.113:0/607684537 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c00e040 con 0x5624c00c2d30 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f65427fc640 1 -- 172.21.15.113:0/607684537 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f654c05fae0 con 0x5624c00c2d30 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624c00c2990 con 0x5624c00c2d30 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f65427fc640 1 -- 172.21.15.113:0/607684537 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f654c053b00 con 0x5624c00c2d30 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f656cddf740 10 client.7506 fetch_fsmap learned FSMap version 57 2023-12-19T13:53:52.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.728+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5624bffc1ef0 con 0x5624c00c2d30 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f65427fc640 1 -- 172.21.15.113:0/607684537 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624c00c2990 con 0x5624c00c2d30 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f65427fc640 1 -- 172.21.15.113:0/607684537 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 57) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f654c056a60 con 0x5624c00c2d30 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f656cddf740 10 client.7506 fetch_fsmap finished waiting for FSMap version 57 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f656cddf740 10 client.7506 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f656cddf740 20 client.7506 populate_metadata read hostname 'smithi113' 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f656cddf740 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00de050 0x5624c00dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f656cddf740 4 client.7506 mds_command: new command op to 7359 tid=0[{"prefix": "status"}] 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 --> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f6554030cb0 con 0x5624c00de050 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.729+0000 7f65637fe640 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00de050 0x5624c00dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f65637fe640 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00de050 0x5624c00dc460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ca7c16b0078ff28 server_cookie=becc9122d569ae05 in_seq=0 out_seq=0 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f65427fc640 10 client.7506 ms_handle_connect on v2:172.21.15.113:6834/2259732918 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f65427fc640 1 -- 172.21.15.113:0/607684537 <== mds.0 v2:172.21.15.113:6834/2259732918 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f6554030cb0 con 0x5624c00de050 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f65427fc640 10 client.7506 handle_command_reply: tid=0 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 client.7506 shutdown 2023-12-19T13:53:52.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 msgr2=0x5624c00fc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00fc4a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f654c057800 tx=0x7f654c0036f0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 shutdown_connections 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:6834/2259732918,v1:172.21.15.113:6836/2259732918] conn(0x5624c00de050 0x5624c00dc460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5624c013b860 0x5624c00dbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5624c00c2d30 0x5624c00fc4a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f65427fc640 0 client.7506 ms_handle_reset on v2:172.21.15.113:6834/2259732918 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 --2- 172.21.15.113:0/607684537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624c00968b0 0x5624c00db920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 >> 172.21.15.113:0/607684537 conn(0x5624c0092cb0 msgr2=0x5624c0098cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 shutdown_connections 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.730+0000 7f656cddf740 1 -- 172.21.15.113:0/607684537 wait complete. 2023-12-19T13:53:52.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656cddf740 20 client.7506 trim_cache size 0 max 16384 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 7359, 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 6.6568799780000001, 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 57, 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 132, 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 132, 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 12.303778315000001 2023-12-19T13:53:52.735 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:53:52.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f654406a460 msgr2=0x7f654406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f654406a460 0x7f654406c920 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6554036000 tx=0x7f655403b040 comp rx=0 tx=0).stop 2023-12-19T13:53:52.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65640b0b50 msgr2=0x7f65640b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65640b0b50 0x7f65640b1e70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f654c00c430 tx=0x7f654c00c8f0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 shutdown_connections 2023-12-19T13:53:52.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f654406a460 0x7f654406c920 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65641449e0 0x7f65640b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65640b0b50 0x7f65640b1e70 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 --2- 172.21.15.113:0/342286825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f656406c6b0 0x7f656413ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 >> 172.21.15.113:0/342286825 conn(0x7f65640cbb70 msgr2=0x7f656406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 shutdown_connections 2023-12-19T13:53:52.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.731+0000 7f656a19c640 1 -- 172.21.15.113:0/342286825 wait complete. 2023-12-19T13:53:52.748 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:53:52.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.946+0000 7fc414631640 1 Processor -- start 2023-12-19T13:53:52.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.946+0000 7fc414631640 1 -- start start 2023-12-19T13:53:52.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc414631640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc414631640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc40c06b590 0x7fc40c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc414631640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c06bb30 con 0x7fc40c1449e0 2023-12-19T13:53:52.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc414631640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0b0070 con 0x7fc40c06b590 2023-12-19T13:53:52.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc414631640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0b0350 con 0x7fc40c0b0b50 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc412bce640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc40c06b590 0x7fc40c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc412bce640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc40c06b590 0x7fc40c06c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60616/0 (socket says 172.21.15.113:60616) 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc412bce640 1 -- 172.21.15.113:0/1645676568 learned_addr learned my addr 172.21.15.113:0/1645676568 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.948+0000 7fc411bcc640 1 --2- 172.21.15.113:0/1645676568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.949+0000 7fc412bce640 1 -- 172.21.15.113:0/1645676568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 msgr2=0x7fc40c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.949+0000 7fc412bce640 1 --2- 172.21.15.113:0/1645676568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.949+0000 7fc412bce640 1 -- 172.21.15.113:0/1645676568 >> v1:172.21.15.151:6789/0 conn(0x7fc40c1449e0 legacy=0x7fc40c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:52.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.949+0000 7fc412bce640 1 -- 172.21.15.113:0/1645676568 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0b0630 con 0x7fc40c06b590 2023-12-19T13:53:52.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.950+0000 7fc412bce640 1 --2- 172.21.15.113:0/1645676568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c06c4e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0b2960 tx=0x7fc40402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1e389861b3cbb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.950+0000 7fc4113cb640 1 -- 172.21.15.113:0/1645676568 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40402ca30 con 0x7fc40c06b590 2023-12-19T13:53:52.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc4113cb640 1 -- 172.21.15.113:0/1645676568 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40402cb90 con 0x7fc40c06b590 2023-12-19T13:53:52.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc4113cb640 1 -- 172.21.15.113:0/1645676568 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4040343f0 con 0x7fc40c06b590 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 -- 172.21.15.113:0/1645676568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 msgr2=0x7fc40c06c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 --2- 172.21.15.113:0/1645676568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c06c4e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0b2960 tx=0x7fc40402be90 comp rx=0 tx=0).stop 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 -- 172.21.15.113:0/1645676568 shutdown_connections 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 --2- 172.21.15.113:0/1645676568 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c06c4e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 --2- 172.21.15.113:0/1645676568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 -- 172.21.15.113:0/1645676568 >> 172.21.15.113:0/1645676568 conn(0x7fc40c0cbb70 msgr2=0x7fc40c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 -- 172.21.15.113:0/1645676568 shutdown_connections 2023-12-19T13:53:52.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.951+0000 7fc414631640 1 -- 172.21.15.113:0/1645676568 wait complete. 2023-12-19T13:53:52.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.954+0000 7fc414631640 1 Processor -- start 2023-12-19T13:53:52.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.954+0000 7fc414631640 1 -- start start 2023-12-19T13:53:52.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc414631640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc414631640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c13fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc414631640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c1449e0 0x7fc40c143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc414631640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c140500 con 0x7fc40c06b590 2023-12-19T13:53:52.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc414631640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c1407e0 con 0x7fc40c1449e0 2023-12-19T13:53:52.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc414631640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c140ac0 con 0x7fc40c0b0b50 2023-12-19T13:53:52.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc4123cd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc4123cd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c1415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60624/0 (socket says 172.21.15.113:60624) 2023-12-19T13:53:52.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.955+0000 7fc4123cd640 1 -- 172.21.15.113:0/1748013030 learned_addr learned my addr 172.21.15.113:0/1748013030 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:52.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc411bcc640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c13fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc412bce640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c1449e0 0x7fc40c143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc4123cd640 1 -- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 msgr2=0x7fc40c13fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc4123cd640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c13fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc4123cd640 1 -- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c1449e0 msgr2=0x7fc40c143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:52.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc4123cd640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c1449e0 0x7fc40c143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:52.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc4123cd640 1 -- 172.21.15.113:0/1748013030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009b30 con 0x7fc40c06b590 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc4123cd640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c1415a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fc40800b3f0 tx=0x7fc40800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc402ffd640 1 -- 172.21.15.113:0/1748013030 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408011830 con 0x7fc40c06b590 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc402ffd640 1 -- 172.21.15.113:0/1748013030 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408011990 con 0x7fc40c06b590 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c140da0 con 0x7fc40c06b590 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.956+0000 7fc402ffd640 1 -- 172.21.15.113:0/1748013030 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408011d40 con 0x7fc40c06b590 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.957+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c1400f0 con 0x7fc40c06b590 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.957+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c061910 con 0x7fc40c06b590 2023-12-19T13:53:52.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.959+0000 7fc402ffd640 1 -- 172.21.15.113:0/1748013030 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc40801a400 con 0x7fc40c06b590 2023-12-19T13:53:52.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.959+0000 7fc402ffd640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3f006a430 0x7fc3f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:52.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.959+0000 7fc402ffd640 1 -- 172.21.15.113:0/1748013030 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc408088760 con 0x7fc40c06b590 2023-12-19T13:53:52.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.960+0000 7fc411bcc640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3f006a430 0x7fc3f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:52.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.960+0000 7fc411bcc640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3f006a430 0x7fc3f006c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc40c144110 tx=0x7fc3fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:52.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:52.965+0000 7fc402ffd640 1 -- 172.21.15.113:0/1748013030 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc408053d50 con 0x7fc40c06b590 2023-12-19T13:53:53.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.195+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc40c0af180 con 0x7fc40c06b590 2023-12-19T13:53:53.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.196+0000 7fc402ffd640 1 -- 172.21.15.113:0/1748013030 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc408057370 con 0x7fc40c06b590 2023-12-19T13:53:53.197 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3f006a430 msgr2=0x7fc3f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3f006a430 0x7fc3f006c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc40c144110 tx=0x7fc3fc008040 comp rx=0 tx=0).stop 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 msgr2=0x7fc40c1415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c1415a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fc40800b3f0 tx=0x7fc40800b8b0 comp rx=0 tx=0).stop 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 shutdown_connections 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc3f006a430 0x7fc3f006c8f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c1449e0 0x7fc40c143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0b0b50 0x7fc40c13fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 --2- 172.21.15.113:0/1748013030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc40c06b590 0x7fc40c1415a0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 >> 172.21.15.113:0/1748013030 conn(0x7fc40c0cbb70 msgr2=0x7fc40c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 shutdown_connections 2023-12-19T13:53:53.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:53.199+0000 7fc414631640 1 -- 172.21.15.113:0/1748013030 wait complete. 2023-12-19T13:53:53.218 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:53:53.218 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:53:53.218 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:53:53.218 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:53:53.218 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:53:53.218 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:53:53.219 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:53:53.219 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:53:53.219 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:53:53.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:53.219 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:53:53.271 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:53:53.271 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:53.272 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 41987sec preferred_lft 41987sec 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:53:53.273 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:53:53.274 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:53.274 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:53:53.274 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:53:53.274 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:53:53.274 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:53.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:53.275 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:53:53.366 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:53:53.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:53.370 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:53:53.421 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:53:53.421 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:53:53.421 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:53:53.421 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:53:53.421 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:53:53.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:53.422 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:53:53.422 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:53:53.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:53:53.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:53:53.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:53:53.422 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:53:53.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:53.608 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:53:53.657 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:53:53.657 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:53:53.657 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:53:53.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:53.657 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:53:53.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:53:53.750 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:53:53.807 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:53:53.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:53:53.808 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:53:53.858 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:53:53.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:53.859 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:53:53.997 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:53:53.997 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:53:54.027 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:53:54.027 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:53:54.027 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:53:54.027 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:53:54.027 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:53:54.029 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:53:54.029 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:53:54.030 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:53:54.030 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:53:54.030 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:53:54.032 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:53:54.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:54.033 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:53:54.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:54.121 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:53:54.178 INFO:teuthology.orchestra.run.smithi113.stdout:client7515 2023-12-19T13:53:54.178 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:53:54.178 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:54.224 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:53:54.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.480+0000 7f7dde5c4640 1 Processor -- start 2023-12-19T13:53:54.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.481+0000 7f7dde5c4640 1 -- start start 2023-12-19T13:53:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.482+0000 7f7dde5c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd8157b60 0x7f7dd80d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.482+0000 7f7dde5c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd80ce640 0x7f7dd81611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.482+0000 7f7dde5c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7dd81616f0 0x7f7dd815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.482+0000 7f7dde5c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80d31c0 con 0x7f7dd8157b60 2023-12-19T13:53:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.482+0000 7f7dde5c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd8161b80 con 0x7f7dd81616f0 2023-12-19T13:53:54.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.482+0000 7f7dde5c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80d2920 con 0x7f7dd80ce640 2023-12-19T13:53:54.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.482+0000 7f7dd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd8157b60 0x7f7dd80d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd8157b60 0x7f7dd80d2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60632/0 (socket says 172.21.15.113:60632) 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dd7fff640 1 -- 172.21.15.113:0/2153706523 learned_addr learned my addr 172.21.15.113:0/2153706523 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dcf7fe640 1 --2- 172.21.15.113:0/2153706523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd80ce640 0x7f7dd81611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7ddcb61640 1 --2- 172.21.15.113:0/2153706523 >> v2:172.21.15.151:3300/0 conn(0x7f7dd81616f0 0x7f7dd815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dd7fff640 1 -- 172.21.15.113:0/2153706523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd80ce640 msgr2=0x7f7dd81611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dd7fff640 1 --2- 172.21.15.113:0/2153706523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd80ce640 0x7f7dd81611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dd7fff640 1 -- 172.21.15.113:0/2153706523 >> v2:172.21.15.151:3300/0 conn(0x7f7dd81616f0 msgr2=0x7f7dd815dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dd7fff640 1 --2- 172.21.15.113:0/2153706523 >> v2:172.21.15.151:3300/0 conn(0x7f7dd81616f0 0x7f7dd815dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.483+0000 7f7dd7fff640 1 -- 172.21.15.113:0/2153706523 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80d2c00 con 0x7f7dd8157b60 2023-12-19T13:53:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.485+0000 7f7dd7fff640 1 --2- 172.21.15.113:0/2153706523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd8157b60 0x7f7dd80d2290 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80d0f80 tx=0x7f7dc802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc20662c35b9654 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.485+0000 7f7dd77fe640 1 -- 172.21.15.113:0/2153706523 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc802ca70 con 0x7f7dd8157b60 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.485+0000 7f7dd77fe640 1 -- 172.21.15.113:0/2153706523 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc802cbd0 con 0x7f7dd8157b60 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.485+0000 7f7dd77fe640 1 -- 172.21.15.113:0/2153706523 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80343f0 con 0x7f7dd8157b60 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.485+0000 7f7dde5c4640 1 -- 172.21.15.113:0/2153706523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd8157b60 msgr2=0x7f7dd80d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.485+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/2153706523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd8157b60 0x7f7dd80d2290 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80d0f80 tx=0x7f7dc802bed0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.486+0000 7f7dde5c4640 1 -- 172.21.15.113:0/2153706523 shutdown_connections 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.486+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/2153706523 >> v2:172.21.15.151:3300/0 conn(0x7f7dd81616f0 0x7f7dd815dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.486+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/2153706523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd80ce640 0x7f7dd81611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.486+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/2153706523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd8157b60 0x7f7dd80d2290 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.486+0000 7f7dde5c4640 1 -- 172.21.15.113:0/2153706523 >> 172.21.15.113:0/2153706523 conn(0x7f7dd80b29c0 msgr2=0x7f7dd80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.486+0000 7f7dde5c4640 1 -- 172.21.15.113:0/2153706523 shutdown_connections 2023-12-19T13:53:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.486+0000 7f7dde5c4640 1 -- 172.21.15.113:0/2153706523 wait complete. 2023-12-19T13:53:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.487+0000 7f7dde5c4640 1 Processor -- start 2023-12-19T13:53:54.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.488+0000 7f7dde5c4640 1 -- start start 2023-12-19T13:53:54.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.488+0000 7f7dde5c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd80ce640 0x7f7dd80b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:54.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.488+0000 7f7dde5c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd8157b60 0x7f7dd8148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.488+0000 7f7dde5c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd81616f0 0x7f7dd8146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.488+0000 7f7dde5c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80cd570 con 0x7f7dd80ce640 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dde5c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd814b200 con 0x7f7dd81616f0 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dde5c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd81452a0 con 0x7f7dd8157b60 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd80ce640 0x7f7dd80b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd80ce640 0x7f7dd80b8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60648/0 (socket says 172.21.15.113:60648) 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 -- 172.21.15.113:0/555500479 learned_addr learned my addr 172.21.15.113:0/555500479 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dcf7fe640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd8157b60 0x7f7dd8148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 -- 172.21.15.113:0/555500479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd8157b60 msgr2=0x7f7dd8148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd8157b60 0x7f7dd8148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 -- 172.21.15.113:0/555500479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd81616f0 msgr2=0x7f7dd8146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd81616f0 0x7f7dd8146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 -- 172.21.15.113:0/555500479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8009b30 con 0x7f7dd80ce640 2023-12-19T13:53:54.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.489+0000 7f7dd7fff640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd80ce640 0x7f7dd80b8150 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8036040 tx=0x7f7dc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:54.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.490+0000 7f7dd57fa640 1 -- 172.21.15.113:0/555500479 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8009510 con 0x7f7dd80ce640 2023-12-19T13:53:54.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.490+0000 7f7dd57fa640 1 -- 172.21.15.113:0/555500479 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc803e450 con 0x7f7dd80ce640 2023-12-19T13:53:54.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.490+0000 7f7dd57fa640 1 -- 172.21.15.113:0/555500479 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc803e800 con 0x7f7dd80ce640 2023-12-19T13:53:54.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.490+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd8145580 con 0x7f7dd80ce640 2023-12-19T13:53:54.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.490+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd8145b40 con 0x7f7dd80ce640 2023-12-19T13:53:54.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.491+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd8161040 con 0x7f7dd80ce640 2023-12-19T13:53:54.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.492+0000 7f7dd57fa640 1 -- 172.21.15.113:0/555500479 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7dc803e960 con 0x7f7dd80ce640 2023-12-19T13:53:54.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.493+0000 7f7dd57fa640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db806a430 0x7f7db806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:54.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.493+0000 7f7dd57fa640 1 -- 172.21.15.113:0/555500479 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc80ab740 con 0x7f7dd80ce640 2023-12-19T13:53:54.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.493+0000 7f7dcf7fe640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db806a430 0x7f7db806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:54.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.494+0000 7f7dcf7fe640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db806a430 0x7f7db806c8f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0006fd0 tx=0x7f7dc0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:54.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.498+0000 7f7dd57fa640 1 -- 172.21.15.113:0/555500479 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7dc8076cd0 con 0x7f7dd80ce640 2023-12-19T13:53:54.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.726+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7dd8061910 con 0x7f7dd80ce640 2023-12-19T13:53:54.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.727+0000 7f7dd57fa640 1 -- 172.21.15.113:0/555500479 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7dc807a2f0 con 0x7f7dd80ce640 2023-12-19T13:53:54.728 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:53:54.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db806a430 msgr2=0x7f7db806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:54.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db806a430 0x7f7db806c8f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0006fd0 tx=0x7f7dc0008040 comp rx=0 tx=0).stop 2023-12-19T13:53:54.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd80ce640 msgr2=0x7f7dd80b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:54.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd80ce640 0x7f7dd80b8150 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8036040 tx=0x7f7dc8004a40 comp rx=0 tx=0).stop 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 shutdown_connections 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db806a430 0x7f7db806c8f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd81616f0 0x7f7dd8146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd8157b60 0x7f7dd8148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 --2- 172.21.15.113:0/555500479 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd80ce640 0x7f7dd80b8150 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 >> 172.21.15.113:0/555500479 conn(0x7f7dd80b29c0 msgr2=0x7f7dd80b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 shutdown_connections 2023-12-19T13:53:54.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:54.730+0000 7f7dde5c4640 1 -- 172.21.15.113:0/555500479 wait complete. 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:53:54.749 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:53:54.750 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:53:54.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:54.750 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:53:54.810 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:53:54.810 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:53:54.811 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41960sec preferred_lft 41960sec 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:53:54.812 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:54.813 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:53:54.813 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:53:54.813 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:53:54.813 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:53:54.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:54.813 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:53:54.904 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:53:54.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:54.909 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:53:54.963 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:53:54.963 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:53:54.963 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:53:54.963 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:53:54.963 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:53:54.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:54.964 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:53:54.964 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:53:54.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:53:54.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:53:54.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:53:54.964 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:53:55.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:55.146 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:53:55.199 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:53:55.199 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:53:55.199 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:53:55.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:55.199 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:53:55.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:53:55.293 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:53:55.344 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:53:55.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:53:55.344 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:53:55.392 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:53:55.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:55.393 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:53:55.525 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:53:55.525 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:53:55.560 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:53:55.560 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:53:55.560 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:53:55.560 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:53:55.560 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:53:55.563 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:53:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:53:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:53:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:53:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:53:55.567 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:53:55.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:55.567 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:53:55.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:55.645 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:53:55.698 INFO:teuthology.orchestra.run.smithi151.stdout:client7524 2023-12-19T13:53:55.698 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:53:55.698 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:53:55.752 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:53:55.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.979+0000 7f66e9c7d640 1 Processor -- start 2023-12-19T13:53:55.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.979+0000 7f66e9c7d640 1 -- start start 2023-12-19T13:53:55.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e9c7d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f66e41449e0 0x7f66e40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:55.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e9c7d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f66e40b0b50 0x7f66e406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:55.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e9c7d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40afb10 con 0x7f66e406b590 2023-12-19T13:53:55.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e9c7d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e406bb30 con 0x7f66e41449e0 2023-12-19T13:53:55.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e9c7d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40b0070 con 0x7f66e40b0b50 2023-12-19T13:53:55.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f66e41449e0 0x7f66e40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:55.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f66e406b590 0x7f66e415eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43234/0 (socket says 172.21.15.113:43234) 2023-12-19T13:53:55.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e3fff640 1 -- 172.21.15.113:0/2103332742 learned_addr learned my addr 172.21.15.113:0/2103332742 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:55.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.981+0000 7f66e2ffd640 1 --2- 172.21.15.113:0/2103332742 >> v2:172.21.15.151:3300/0 conn(0x7f66e40b0b50 0x7f66e406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:55.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.982+0000 7f66e37fe640 1 -- 172.21.15.113:0/2103332742 >> v2:172.21.15.151:3300/0 conn(0x7f66e40b0b50 msgr2=0x7f66e406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:55.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.982+0000 7f66e37fe640 1 --2- 172.21.15.113:0/2103332742 >> v2:172.21.15.151:3300/0 conn(0x7f66e40b0b50 0x7f66e406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:55.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.982+0000 7f66e37fe640 1 -- 172.21.15.113:0/2103332742 >> v1:172.21.15.113:6789/0 conn(0x7f66e406b590 legacy=0x7f66e415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:55.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.982+0000 7f66e37fe640 1 -- 172.21.15.113:0/2103332742 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40b0350 con 0x7f66e41449e0 2023-12-19T13:53:55.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.982+0000 7f66e27fc640 1 -- 172.21.15.113:0/2103332742 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759178242 0 0) 0x7f66e40afb10 con 0x7f66e406b590 2023-12-19T13:53:55.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.983+0000 7f66e37fe640 1 --2- 172.21.15.113:0/2103332742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e41449e0 0x7f66e40af5d0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f66e4071c80 tx=0x7f66d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff60ddb063753e9c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:55.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.983+0000 7f66e27fc640 1 -- 172.21.15.113:0/2103332742 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4031830 con 0x7f66e41449e0 2023-12-19T13:53:55.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.983+0000 7f66e27fc640 1 -- 172.21.15.113:0/2103332742 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4031990 con 0x7f66e41449e0 2023-12-19T13:53:55.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.983+0000 7f66e27fc640 1 -- 172.21.15.113:0/2103332742 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4031d20 con 0x7f66e41449e0 2023-12-19T13:53:55.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 -- 172.21.15.113:0/2103332742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e41449e0 msgr2=0x7f66e40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:55.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/2103332742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e41449e0 0x7f66e40af5d0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f66e4071c80 tx=0x7f66d402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:55.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 -- 172.21.15.113:0/2103332742 shutdown_connections 2023-12-19T13:53:55.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/2103332742 >> v2:172.21.15.151:3300/0 conn(0x7f66e40b0b50 0x7f66e406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:55.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/2103332742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e41449e0 0x7f66e40af5d0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:55.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 -- 172.21.15.113:0/2103332742 >> 172.21.15.113:0/2103332742 conn(0x7f66e40cbb70 msgr2=0x7f66e40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:55.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 -- 172.21.15.113:0/2103332742 shutdown_connections 2023-12-19T13:53:55.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.984+0000 7f66e9c7d640 1 -- 172.21.15.113:0/2103332742 wait complete. 2023-12-19T13:53:55.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.986+0000 7f66e9c7d640 1 Processor -- start 2023-12-19T13:53:55.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.986+0000 7f66e9c7d640 1 -- start start 2023-12-19T13:53:55.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e9c7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e406b590 0x7f66e4159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:55.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e9c7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e40b0b50 0x7f66e40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:55.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e9c7d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e41449e0 0x7f66e40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:55.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e9c7d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4159f90 con 0x7f66e40b0b50 2023-12-19T13:53:55.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e9c7d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4143310 con 0x7f66e406b590 2023-12-19T13:53:55.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e9c7d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e41435f0 con 0x7f66e41449e0 2023-12-19T13:53:55.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e40b0b50 0x7f66e40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:55.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e40b0b50 0x7f66e40b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60662/0 (socket says 172.21.15.113:60662) 2023-12-19T13:53:55.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 -- 172.21.15.113:0/3535229404 learned_addr learned my addr 172.21.15.113:0/3535229404 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 -- 172.21.15.113:0/3535229404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e41449e0 msgr2=0x7f66e40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e41449e0 0x7f66e40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 -- 172.21.15.113:0/3535229404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e406b590 msgr2=0x7f66e4159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e406b590 0x7f66e4159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.987+0000 7f66e2ffd640 1 -- 172.21.15.113:0/3535229404 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4009400 con 0x7f66e40b0b50 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.988+0000 7f66e2ffd640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e40b0b50 0x7f66e40b14e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f66d800d800 tx=0x7f66d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.988+0000 7f66cbfff640 1 -- 172.21.15.113:0/3535229404 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800b6c0 con 0x7f66e40b0b50 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.988+0000 7f66cbfff640 1 -- 172.21.15.113:0/3535229404 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800b820 con 0x7f66e40b0b50 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.988+0000 7f66cbfff640 1 -- 172.21.15.113:0/3535229404 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800bbb0 con 0x7f66e40b0b50 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.988+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e41438d0 con 0x7f66e40b0b50 2023-12-19T13:53:55.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.988+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e4142590 con 0x7f66e40b0b50 2023-12-19T13:53:55.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.989+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e4061910 con 0x7f66e40b0b50 2023-12-19T13:53:55.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.990+0000 7f66cbfff640 1 -- 172.21.15.113:0/3535229404 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f66d800bd10 con 0x7f66e40b0b50 2023-12-19T13:53:55.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.991+0000 7f66cbfff640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66d006a430 0x7f66d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:55.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.991+0000 7f66cbfff640 1 -- 172.21.15.113:0/3535229404 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66d8088ee0 con 0x7f66e40b0b50 2023-12-19T13:53:55.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.991+0000 7f66e37fe640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66d006a430 0x7f66d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:55.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.992+0000 7f66e37fe640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66d006a430 0x7f66d006c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f66d4036000 tx=0x7f66d4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:55.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:55.996+0000 7f66cbfff640 1 -- 172.21.15.113:0/3535229404 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f66d8054430 con 0x7f66e40b0b50 2023-12-19T13:53:56.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.223+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66e40ae560 con 0x7f66e40b0b50 2023-12-19T13:53:56.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.224+0000 7f66cbfff640 1 -- 172.21.15.113:0/3535229404 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f66d8057a50 con 0x7f66e40b0b50 2023-12-19T13:53:56.224 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:53:56.225 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:53:56.225 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66d006a430 msgr2=0x7f66d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66d006a430 0x7f66d006c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f66d4036000 tx=0x7f66d4030000 comp rx=0 tx=0).stop 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e40b0b50 msgr2=0x7f66e40b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e40b0b50 0x7f66e40b14e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f66d800d800 tx=0x7f66d800dcc0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 shutdown_connections 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66d006a430 0x7f66d006c8f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e41449e0 0x7f66e40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66e40b0b50 0x7f66e40b14e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 --2- 172.21.15.113:0/3535229404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e406b590 0x7f66e4159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 >> 172.21.15.113:0/3535229404 conn(0x7f66e40cbb70 msgr2=0x7f66e415adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.227+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 shutdown_connections 2023-12-19T13:53:56.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.228+0000 7f66e9c7d640 1 -- 172.21.15.113:0/3535229404 wait complete. 2023-12-19T13:53:56.247 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:53:56.476 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":7359,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.387196911,"mdsmap_epoch":57,"osdmap_epoch":132,"osdmap_epoch_barrier":132,"uptime":16.034106936000001} 2023-12-19T13:53:56.477 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 7359, "mdsmap_epoch": 57, "osdmap_epoch": 132, "osdmap_epoch_barrier": 132, "rank_uptime": 10.387196911, "state": "up:active", "uptime": 16.034106936, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:53:56.477 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T13:53:56.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.694+0000 7f7152b63640 1 Processor -- start 2023-12-19T13:53:56.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.694+0000 7f7152b63640 1 -- start start 2023-12-19T13:53:56.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f7152b63640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f714c0cbca0 0x7f714c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:56.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f7152b63640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f714c0b1dc0 0x7f714c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:56.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f7152b63640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0b2200 con 0x7f714c15a000 2023-12-19T13:53:56.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f7152b63640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c071c60 con 0x7f714c0cbca0 2023-12-19T13:53:56.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f7152b63640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c070bc0 con 0x7f714c0b1dc0 2023-12-19T13:53:56.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f714bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f714c0cbca0 0x7f714c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:56.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f714bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f714c0cbca0 0x7f714c0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60664/0 (socket says 172.21.15.113:60664) 2023-12-19T13:53:56.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.696+0000 7f714bfff640 1 -- 172.21.15.113:0/1673005641 learned_addr learned my addr 172.21.15.113:0/1673005641 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:56.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.697+0000 7f714bfff640 1 -- 172.21.15.113:0/1673005641 >> v2:172.21.15.151:3300/0 conn(0x7f714c0b1dc0 msgr2=0x7f714c06c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.697+0000 7f714bfff640 1 --2- 172.21.15.113:0/1673005641 >> v2:172.21.15.151:3300/0 conn(0x7f714c0b1dc0 0x7f714c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.697+0000 7f714bfff640 1 -- 172.21.15.113:0/1673005641 >> v1:172.21.15.151:6789/0 conn(0x7f714c15a000 legacy=0x7f714c15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.697+0000 7f714bfff640 1 -- 172.21.15.113:0/1673005641 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c070ea0 con 0x7f714c0cbca0 2023-12-19T13:53:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.698+0000 7f714bfff640 1 --2- 172.21.15.113:0/1673005641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0cbca0 0x7f714c0b1880 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ae430 tx=0x7f713802e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3c6d77337fa2fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.698+0000 7f714b7fe640 1 -- 172.21.15.113:0/1673005641 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713802eea0 con 0x7f714c0cbca0 2023-12-19T13:53:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.698+0000 7f714b7fe640 1 -- 172.21.15.113:0/1673005641 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138036440 con 0x7f714c0cbca0 2023-12-19T13:53:56.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.698+0000 7f714b7fe640 1 -- 172.21.15.113:0/1673005641 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71380367d0 con 0x7f714c0cbca0 2023-12-19T13:53:56.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 -- 172.21.15.113:0/1673005641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0cbca0 msgr2=0x7f714c0b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:56.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 --2- 172.21.15.113:0/1673005641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0cbca0 0x7f714c0b1880 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ae430 tx=0x7f713802e0f0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 -- 172.21.15.113:0/1673005641 shutdown_connections 2023-12-19T13:53:56.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 --2- 172.21.15.113:0/1673005641 >> v2:172.21.15.151:3300/0 conn(0x7f714c0b1dc0 0x7f714c06c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 --2- 172.21.15.113:0/1673005641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0cbca0 0x7f714c0b1880 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 -- 172.21.15.113:0/1673005641 >> 172.21.15.113:0/1673005641 conn(0x7f714c0cf230 msgr2=0x7f714c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:56.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 -- 172.21.15.113:0/1673005641 shutdown_connections 2023-12-19T13:53:56.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.699+0000 7f7152b63640 1 -- 172.21.15.113:0/1673005641 wait complete. 2023-12-19T13:53:56.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.701+0000 7f7152b63640 1 Processor -- start 2023-12-19T13:53:56.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.701+0000 7f7152b63640 1 -- start start 2023-12-19T13:53:56.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f7152b63640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0b1dc0 0x7f714c1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:56.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f7152b63640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714c0cbca0 0x7f714c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f7152b63640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c15a000 0x7f714c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f7152b63640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c153310 con 0x7f714c0b1dc0 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f7152b63640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1515c0 con 0x7f714c15a000 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f7152b63640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c150c90 con 0x7f714c0cbca0 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f71508ff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0b1dc0 0x7f714c1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f71508ff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0b1dc0 0x7f714c1495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60668/0 (socket says 172.21.15.113:60668) 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f71508ff640 1 -- 172.21.15.113:0/2293154463 learned_addr learned my addr 172.21.15.113:0/2293154463 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f71508ff640 1 -- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714c0cbca0 msgr2=0x7f714c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.702+0000 7f71508ff640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714c0cbca0 0x7f714c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f71508ff640 1 -- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c15a000 msgr2=0x7f714c156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:56.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f7151100640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c15a000 0x7f714c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f71508ff640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c15a000 0x7f714c156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f71508ff640 1 -- 172.21.15.113:0/2293154463 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713800b770 con 0x7f714c0b1dc0 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f7151100640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c15a000 0x7f714c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f71508ff640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0b1dc0 0x7f714c1495f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f714000b3e0 tx=0x7f714000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f71497fa640 1 -- 172.21.15.113:0/2293154463 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011830 con 0x7f714c0b1dc0 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f71497fa640 1 -- 172.21.15.113:0/2293154463 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400119b0 con 0x7f714c0b1dc0 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f71497fa640 1 -- 172.21.15.113:0/2293154463 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011d60 con 0x7f714c0b1dc0 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c150f70 con 0x7f714c0b1dc0 2023-12-19T13:53:56.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.703+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c151a50 con 0x7f714c0b1dc0 2023-12-19T13:53:56.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.705+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c061910 con 0x7f714c0b1dc0 2023-12-19T13:53:56.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.705+0000 7f71497fa640 1 -- 172.21.15.113:0/2293154463 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f714001a400 con 0x7f714c0b1dc0 2023-12-19T13:53:56.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.707+0000 7f71497fa640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f713006a430 0x7f713006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:56.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.707+0000 7f71497fa640 1 -- 172.21.15.113:0/2293154463 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7140088b60 con 0x7f714c0b1dc0 2023-12-19T13:53:56.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.707+0000 7f714bfff640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f713006a430 0x7f713006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:56.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.708+0000 7f714bfff640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f713006a430 0x7f713006c8f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7138038000 tx=0x7f7138030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:56.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.711+0000 7f71497fa640 1 -- 172.21.15.113:0/2293154463 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71400540b0 con 0x7f714c0b1dc0 2023-12-19T13:53:56.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:56.904+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f714c0cfff0 con 0x7f714c0b1dc0 2023-12-19T13:53:57.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.285+0000 7f71497fa640 1 -- 172.21.15.113:0/2293154463 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v133) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7140015020 con 0x7f714c0b1dc0 2023-12-19T13:53:57.287 INFO:teuthology.orchestra.run.smithi113.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f713006a430 msgr2=0x7f713006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f713006a430 0x7f713006c8f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7138038000 tx=0x7f7138030000 comp rx=0 tx=0).stop 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0b1dc0 msgr2=0x7f714c1495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0b1dc0 0x7f714c1495f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f714000b3e0 tx=0x7f714000b8a0 comp rx=0 tx=0).stop 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 shutdown_connections 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f713006a430 0x7f713006c8f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c15a000 0x7f714c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714c0cbca0 0x7f714c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 --2- 172.21.15.113:0/2293154463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f714c0b1dc0 0x7f714c1495f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:57.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.289+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 >> 172.21.15.113:0/2293154463 conn(0x7f714c0cf230 msgr2=0x7f714c14cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.290+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 shutdown_connections 2023-12-19T13:53:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:57.290+0000 7f7152b63640 1 -- 172.21.15.113:0/2293154463 wait complete. 2023-12-19T13:53:57.312 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:53:57.312 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:53:57.312 DEBUG:teuthology.orchestra.run.smithi113:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T13:53:57.312 DEBUG:teuthology.orchestra.run.smithi113:> os.fchmod(fd, 0O666) 2023-12-19T13:53:57.312 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(fd) 2023-12-19T13:53:57.312 DEBUG:teuthology.orchestra.run.smithi113:> os.close(fd) 2023-12-19T13:53:57.312 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:53:57.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:57.633 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:53:57.740 INFO:teuthology.orchestra.run.smithi113.stdout:client7515 2023-12-19T13:53:57.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:53:57.741 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client7515/osdmap') 2023-12-19T13:53:57.827 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 132 barrier 132 flags 0x588000 2023-12-19T13:53:57.827 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:53:57.827 INFO:teuthology.orchestra.run.smithi113.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:53:57.827 INFO:teuthology.orchestra.run.smithi113.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:53:57.827 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:53:57.828 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:53:57.828 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:53:57.828 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:53:57.828 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:53:57.828 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:53:57.828 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:53:57.829 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:53:57.829 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:53:57.829 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:53:57.829 INFO:teuthology.orchestra.run.smithi113.stderr:803 bytes copied, 7.1097e-05 s, 11.3 MB/s 2023-12-19T13:53:57.831 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-19T13:53:58.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.048+0000 7f5f39b6e640 1 Processor -- start 2023-12-19T13:53:58.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.049+0000 7f5f39b6e640 1 -- start start 2023-12-19T13:53:58.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.050+0000 7f5f39b6e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f34157aa0 0x7f5f340b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.050+0000 7f5f39b6e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5f3415e040 0x7f5f3415e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.050+0000 7f5f39b6e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3406e890 con 0x7f5f3406e410 2023-12-19T13:53:58.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.050+0000 7f5f39b6e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3415e9c0 con 0x7f5f3415e040 2023-12-19T13:53:58.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.050+0000 7f5f39b6e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340b2600 con 0x7f5f34157aa0 2023-12-19T13:53:58.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.050+0000 7f5f2bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5f3406e410 0x7f5f34161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60074/0 (socket says 172.21.15.113:60074) 2023-12-19T13:53:58.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.050+0000 7f5f2bfff640 1 -- 172.21.15.113:0/2114445045 learned_addr learned my addr 172.21.15.113:0/2114445045 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:58.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755970532 0 0) 0x7f5f3406e890 con 0x7f5f3406e410 2023-12-19T13:53:58.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f20003520 con 0x7f5f3406e410 2023-12-19T13:53:58.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f337fe640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f34157aa0 0x7f5f340b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f33fff640 1 --2- 172.21.15.113:0/2114445045 >> v2:172.21.15.151:3300/0 conn(0x7f5f3415e040 0x7f5f3415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033609936 0 0) 0x7f5f20003520 con 0x7f5f3406e410 2023-12-19T13:53:58.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f34157aa0 msgr2=0x7f5f340b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:58.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f34157aa0 0x7f5f340b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 >> v2:172.21.15.151:3300/0 conn(0x7f5f3415e040 msgr2=0x7f5f3415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 --2- 172.21.15.113:0/2114445045 >> v2:172.21.15.151:3300/0 conn(0x7f5f3415e040 0x7f5f3415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340b1d60 con 0x7f5f3406e410 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5f1c001670 con 0x7f5f3406e410 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 >> v1:172.21.15.113:6789/0 conn(0x7f5f3406e410 legacy=0x7f5f34161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f200039e0 0x7f5f20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.051+0000 7f5f32ffd640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f200047c0 0x7f5f20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f32ffd640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f34157aa0 0x7f5f20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415e9c0 con 0x7f5f200039e0 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340b2600 con 0x7f5f200047c0 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2000ba00 con 0x7f5f34157aa0 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f337fe640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f200039e0 0x7f5f20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f337fe640 1 -- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f34157aa0 msgr2=0x7f5f20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f337fe640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f34157aa0 0x7f5f20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f337fe640 1 -- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f200047c0 msgr2=0x7f5f20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f337fe640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f200047c0 0x7f5f20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.052+0000 7f5f337fe640 1 -- 172.21.15.113:0/2114445045 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20003520 con 0x7f5f200039e0 2023-12-19T13:53:58.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.053+0000 7f5f337fe640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f200039e0 0x7f5f20003e00 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009ac0 tx=0x7f5f200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5100bdacce404e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.053+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2402c710 con 0x7f5f200039e0 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2402c870 con 0x7f5f200039e0 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f32ffd640 1 -- 172.21.15.113:0/2114445045 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2402cc00 con 0x7f5f200039e0 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2114445045 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f200039e0 msgr2=0x7f5f20003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f39b6e640 1 --2- 172.21.15.113:0/2114445045 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f200039e0 0x7f5f20003e00 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009ac0 tx=0x7f5f200057f0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f33fff640 1 -- 172.21.15.113:0/2114445045 reap_dead start 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2114445045 shutdown_connections 2023-12-19T13:53:58.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2114445045 >> 172.21.15.113:0/2114445045 conn(0x7f5f340cbb70 msgr2=0x7f5f340cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:58.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2114445045 shutdown_connections 2023-12-19T13:53:58.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.054+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2114445045 wait complete. 2023-12-19T13:53:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.056+0000 7f5f39b6e640 1 Processor -- start 2023-12-19T13:53:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.056+0000 7f5f39b6e640 1 -- start start 2023-12-19T13:53:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f39b6e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f200039e0 0x7f5f3414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f39b6e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f341f6bc0 0x7f5f340ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f39b6e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f341f7040 0x7f5f340aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f39b6e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415a3a0 con 0x7f5f341f7040 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f39b6e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415a680 con 0x7f5f200039e0 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f39b6e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415a960 con 0x7f5f341f6bc0 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f33fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f341f7040 0x7f5f340aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f33fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f341f7040 0x7f5f340aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55652/0 (socket says 172.21.15.113:55652) 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.057+0000 7f5f33fff640 1 -- 172.21.15.113:0/2532437252 learned_addr learned my addr 172.21.15.113:0/2532437252 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f33fff640 1 -- 172.21.15.113:0/2532437252 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f341f6bc0 msgr2=0x7f5f340ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f33fff640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f341f6bc0 0x7f5f340ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f33fff640 1 -- 172.21.15.113:0/2532437252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f200039e0 msgr2=0x7f5f3414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f33fff640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f200039e0 0x7f5f3414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f33fff640 1 -- 172.21.15.113:0/2532437252 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3415ac40 con 0x7f5f341f7040 2023-12-19T13:53:58.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f33fff640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f341f7040 0x7f5f340aed60 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5f340cc960 tx=0x7f5f2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f30ff9640 1 -- 172.21.15.113:0/2532437252 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00ed90 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f30ff9640 1 -- 172.21.15.113:0/2532437252 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c014420 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3415af20 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.058+0000 7f5f30ff9640 1 -- 172.21.15.113:0/2532437252 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0147d0 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.059+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3415eb90 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.060+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3415b110 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.061+0000 7f5f30ff9640 1 -- 172.21.15.113:0/2532437252 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f2c014930 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.061+0000 7f5f30ff9640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f1406a460 0x7f5f1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.062+0000 7f5f30ff9640 1 -- 172.21.15.113:0/2532437252 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f2c088c30 con 0x7f5f341f7040 2023-12-19T13:53:58.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.062+0000 7f5f337fe640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f1406a460 0x7f5f1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.063+0000 7f5f337fe640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f1406a460 0x7f5f1406c920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009ac0 tx=0x7f5f2402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:58.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.066+0000 7f5f30ff9640 1 -- 172.21.15.113:0/2532437252 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f2c054180 con 0x7f5f341f7040 2023-12-19T13:53:58.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.269+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f5f34061910 con 0x7f5f341f7040 2023-12-19T13:53:58.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.306+0000 7f5f30ff9640 1 -- 172.21.15.113:0/2532437252 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v134) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5f2c0577a0 con 0x7f5f341f7040 2023-12-19T13:53:58.308 INFO:teuthology.orchestra.run.smithi113.stderr:pauserd,pausewr is set 2023-12-19T13:53:58.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.309+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f1406a460 msgr2=0x7f5f1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.309+0000 7f5f39b6e640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f1406a460 0x7f5f1406c920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009ac0 tx=0x7f5f2402e000 comp rx=0 tx=0).stop 2023-12-19T13:53:58.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f341f7040 msgr2=0x7f5f340aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f341f7040 0x7f5f340aed60 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5f340cc960 tx=0x7f5f2c00e4b0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 shutdown_connections 2023-12-19T13:53:58.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f1406a460 0x7f5f1406c920 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f341f7040 0x7f5f340aed60 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f341f6bc0 0x7f5f340ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 --2- 172.21.15.113:0/2532437252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f200039e0 0x7f5f3414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 >> 172.21.15.113:0/2532437252 conn(0x7f5f340cbb70 msgr2=0x7f5f340ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:58.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 shutdown_connections 2023-12-19T13:53:58.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.310+0000 7f5f39b6e640 1 -- 172.21.15.113:0/2532437252 wait complete. 2023-12-19T13:53:58.331 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-19T13:53:58.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.541+0000 7f778888a640 1 Processor -- start 2023-12-19T13:53:58.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.541+0000 7f778888a640 1 -- start start 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.543+0000 7f778888a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f77840b7360 0x7f77840b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.543+0000 7f778888a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f77840cf8e0 0x7f77840cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.543+0000 7f778888a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840b7d00 con 0x7f7784146c40 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.543+0000 7f778888a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77840700c0 con 0x7f77840b7360 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.543+0000 7f778888a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778406f160 con 0x7f77840cf8e0 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.543+0000 7f77837fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7784146c40 0x7f7784070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60086/0 (socket says 172.21.15.113:60086) 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.543+0000 7f77837fe640 1 -- 172.21.15.113:0/1229208487 learned_addr learned my addr 172.21.15.113:0/1229208487 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:58.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f7782ffd640 1 --2- 172.21.15.113:0/1229208487 >> v2:172.21.15.113:3300/0 conn(0x7f77840b7360 0x7f77840b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f7783fff640 1 --2- 172.21.15.113:0/1229208487 >> v2:172.21.15.151:3300/0 conn(0x7f77840cf8e0 0x7f77840cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f77827fc640 1 -- 172.21.15.113:0/1229208487 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081116296 0 0) 0x7f77840b7d00 con 0x7f7784146c40 2023-12-19T13:53:58.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f77827fc640 1 -- 172.21.15.113:0/1229208487 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7770003520 con 0x7f7784146c40 2023-12-19T13:53:58.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f7782ffd640 1 -- 172.21.15.113:0/1229208487 >> v2:172.21.15.151:3300/0 conn(0x7f77840cf8e0 msgr2=0x7f77840cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:58.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f7782ffd640 1 --2- 172.21.15.113:0/1229208487 >> v2:172.21.15.151:3300/0 conn(0x7f77840cf8e0 0x7f77840cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f7782ffd640 1 -- 172.21.15.113:0/1229208487 >> v1:172.21.15.113:6789/0 conn(0x7f7784146c40 legacy=0x7f7784070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.544+0000 7f7782ffd640 1 -- 172.21.15.113:0/1229208487 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778406f440 con 0x7f77840b7360 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.545+0000 7f7782ffd640 1 --2- 172.21.15.113:0/1229208487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840b7360 0x7f77840b77c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f77840cf490 tx=0x7f777402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bde7192c26d26dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.545+0000 7f77827fc640 1 -- 172.21.15.113:0/1229208487 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774031830 con 0x7f77840b7360 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.545+0000 7f77827fc640 1 -- 172.21.15.113:0/1229208487 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7774031990 con 0x7f77840b7360 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f77827fc640 1 -- 172.21.15.113:0/1229208487 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774031d20 con 0x7f77840b7360 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 -- 172.21.15.113:0/1229208487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840b7360 msgr2=0x7f77840b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 --2- 172.21.15.113:0/1229208487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840b7360 0x7f77840b77c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f77840cf490 tx=0x7f777402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 -- 172.21.15.113:0/1229208487 shutdown_connections 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 --2- 172.21.15.113:0/1229208487 >> v2:172.21.15.151:3300/0 conn(0x7f77840cf8e0 0x7f77840cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 --2- 172.21.15.113:0/1229208487 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840b7360 0x7f77840b77c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 -- 172.21.15.113:0/1229208487 >> 172.21.15.113:0/1229208487 conn(0x7f77840d31b0 msgr2=0x7f77840d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:58.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 -- 172.21.15.113:0/1229208487 shutdown_connections 2023-12-19T13:53:58.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.546+0000 7f778888a640 1 -- 172.21.15.113:0/1229208487 wait complete. 2023-12-19T13:53:58.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.548+0000 7f778888a640 1 Processor -- start 2023-12-19T13:53:58.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.548+0000 7f778888a640 1 -- start start 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.549+0000 7f778888a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77840b7360 0x7f778415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.549+0000 7f778888a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840cf8e0 0x7f77840b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.549+0000 7f778888a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7784146c40 0x7f77840ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.549+0000 7f778888a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77841f2410 con 0x7f77840cf8e0 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.549+0000 7f778888a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77840b40c0 con 0x7f7784146c40 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.549+0000 7f778888a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7784140c00 con 0x7f77840b7360 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.549+0000 7f7782ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840cf8e0 0x7f77840b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840cf8e0 0x7f77840b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55666/0 (socket says 172.21.15.113:55666) 2023-12-19T13:53:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 -- 172.21.15.113:0/781342601 learned_addr learned my addr 172.21.15.113:0/781342601 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f77837fe640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77840b7360 0x7f778415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 -- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77840b7360 msgr2=0x7f778415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77840b7360 0x7f778415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 -- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7784146c40 msgr2=0x7f77840ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7784146c40 0x7f77840ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 -- 172.21.15.113:0/781342601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774009400 con 0x7f77840cf8e0 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f77837fe640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77840b7360 0x7f778415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f7782ffd640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840cf8e0 0x7f77840b6a80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f777402bee0 tx=0x7f77740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.550+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777403a6f0 con 0x7f77840cf8e0 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.551+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777403a870 con 0x7f77840cf8e0 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.551+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7784140ee0 con 0x7f77840cf8e0 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.551+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777403ac20 con 0x7f77840cf8e0 2023-12-19T13:53:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.551+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77840b4310 con 0x7f77840cf8e0 2023-12-19T13:53:58.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.552+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77840b4500 con 0x7f77840cf8e0 2023-12-19T13:53:58.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.553+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7774043410 con 0x7f77840cf8e0 2023-12-19T13:53:58.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.554+0000 7f777bfff640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f776406a430 0x7f776406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:58.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.554+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77740aa400 con 0x7f77840cf8e0 2023-12-19T13:53:58.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.554+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=135+}) v3 -- 0x7f7764071f60 con 0x7f77840cf8e0 2023-12-19T13:53:58.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.554+0000 7f77837fe640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f776406a430 0x7f776406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:58.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.555+0000 7f77837fe640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f776406a430 0x7f776406c8f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f777c001560 tx=0x7f777c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:58.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.558+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7774035060 con 0x7f77840cf8e0 2023-12-19T13:53:58.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:58.765+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f7784061910 con 0x7f77840cf8e0 2023-12-19T13:53:59.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.575+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(135..135 src has 1..135) v4 ==== 288+0+0 (secure 0 0 0) 0x7f7774079e20 con 0x7f77840cf8e0 2023-12-19T13:53:59.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.575+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=136}) v3 -- 0x7f7764072810 con 0x7f77840cf8e0 2023-12-19T13:53:59.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.581+0000 7f777bfff640 1 -- 172.21.15.113:0/781342601 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v135) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7774035070 con 0x7f77840cf8e0 2023-12-19T13:53:59.582 INFO:teuthology.orchestra.run.smithi113.stderr:pauserd,pausewr is unset 2023-12-19T13:53:59.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f776406a430 msgr2=0x7f776406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:59.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f776406a430 0x7f776406c8f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f777c001560 tx=0x7f777c009040 comp rx=0 tx=0).stop 2023-12-19T13:53:59.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840cf8e0 msgr2=0x7f77840b6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:59.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840cf8e0 0x7f77840b6a80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f777402bee0 tx=0x7f77740046c0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 shutdown_connections 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f776406a430 0x7f776406c8f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7784146c40 0x7f77840ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840cf8e0 0x7f77840b6a80 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 --2- 172.21.15.113:0/781342601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77840b7360 0x7f778415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 >> 172.21.15.113:0/781342601 conn(0x7f77840d31b0 msgr2=0x7f77840d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 shutdown_connections 2023-12-19T13:53:59.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.585+0000 7f778888a640 1 -- 172.21.15.113:0/781342601 wait complete. 2023-12-19T13:53:59.608 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:53:59.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.816+0000 7f1c49bc9640 1 Processor -- start 2023-12-19T13:53:59.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.817+0000 7f1c49bc9640 1 -- start start 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c49bc9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c440ae110 0x7f1c440b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c49bc9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1c440b0640 0x7f1c4406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c49bc9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c440b0a60 con 0x7f1c44157bf0 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c49bc9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4406b8c0 con 0x7f1c440ae110 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c49bc9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c440ae640 con 0x7f1c440b0640 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c3bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c440ae110 0x7f1c440b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c437fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1c44157bf0 0x7f1c4415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60102/0 (socket says 172.21.15.113:60102) 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.818+0000 7f1c437fe640 1 -- 172.21.15.113:0/3831913934 learned_addr learned my addr 172.21.15.113:0/3831913934 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:53:59.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.819+0000 7f1c3bfff640 1 -- 172.21.15.113:0/3831913934 >> v2:172.21.15.151:3300/0 conn(0x7f1c440b0640 msgr2=0x7f1c4406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:53:59.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.819+0000 7f1c3bfff640 1 --2- 172.21.15.113:0/3831913934 >> v2:172.21.15.151:3300/0 conn(0x7f1c440b0640 0x7f1c4406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.819+0000 7f1c3bfff640 1 -- 172.21.15.113:0/3831913934 >> v1:172.21.15.113:6789/0 conn(0x7f1c44157bf0 legacy=0x7f1c4415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:59.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.819+0000 7f1c3bfff640 1 -- 172.21.15.113:0/3831913934 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440ae920 con 0x7f1c440ae110 2023-12-19T13:53:59.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.820+0000 7f1c3bfff640 1 --2- 172.21.15.113:0/3831913934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c440ae110 0x7f1c440b0100 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1c440b1210 tx=0x7f1c2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40f6149eb3ec9df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:59.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.820+0000 7f1c42ffd640 1 -- 172.21.15.113:0/3831913934 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c031830 con 0x7f1c440ae110 2023-12-19T13:53:59.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.820+0000 7f1c42ffd640 1 -- 172.21.15.113:0/3831913934 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c031990 con 0x7f1c440ae110 2023-12-19T13:53:59.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c42ffd640 1 -- 172.21.15.113:0/3831913934 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c031d20 con 0x7f1c440ae110 2023-12-19T13:53:59.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3831913934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c440ae110 msgr2=0x7f1c440b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:59.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3831913934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c440ae110 0x7f1c440b0100 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1c440b1210 tx=0x7f1c2c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3831913934 shutdown_connections 2023-12-19T13:53:59.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3831913934 >> v2:172.21.15.151:3300/0 conn(0x7f1c440b0640 0x7f1c4406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3831913934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c440ae110 0x7f1c440b0100 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3831913934 >> 172.21.15.113:0/3831913934 conn(0x7f1c440cbb70 msgr2=0x7f1c440cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:53:59.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3831913934 shutdown_connections 2023-12-19T13:53:59.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.821+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3831913934 wait complete. 2023-12-19T13:53:59.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.823+0000 7f1c49bc9640 1 Processor -- start 2023-12-19T13:53:59.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.823+0000 7f1c49bc9640 1 -- start start 2023-12-19T13:53:59.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c49bc9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c440ae110 0x7f1c440a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:59.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c49bc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c440b0640 0x7f1c44151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:59.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c49bc9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c44157bf0 0x7f1c4415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:59.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c49bc9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441f4bb0 con 0x7f1c44157bf0 2023-12-19T13:53:59.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c49bc9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441f3f30 con 0x7f1c440ae110 2023-12-19T13:53:59.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c49bc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441f4210 con 0x7f1c440b0640 2023-12-19T13:53:59.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c43fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c44157bf0 0x7f1c4415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:59.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c43fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c44157bf0 0x7f1c4415dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55688/0 (socket says 172.21.15.113:55688) 2023-12-19T13:53:59.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.824+0000 7f1c43fff640 1 -- 172.21.15.113:0/3775142534 learned_addr learned my addr 172.21.15.113:0/3775142534 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:53:59.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c3bfff640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c440b0640 0x7f1c44151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:59.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c43fff640 1 -- 172.21.15.113:0/3775142534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c440b0640 msgr2=0x7f1c44151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:59.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c43fff640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c440b0640 0x7f1c44151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c43fff640 1 -- 172.21.15.113:0/3775142534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c440ae110 msgr2=0x7f1c440a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:53:59.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c43fff640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c440ae110 0x7f1c440a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c43fff640 1 -- 172.21.15.113:0/3775142534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c009400 con 0x7f1c44157bf0 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c43fff640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c44157bf0 0x7f1c4415dd00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b970 tx=0x7f1c3c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c40ff9640 1 -- 172.21.15.113:0/3775142534 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00cb40 con 0x7f1c44157bf0 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c40ff9640 1 -- 172.21.15.113:0/3775142534 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c00ccc0 con 0x7f1c44157bf0 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c40ff9640 1 -- 172.21.15.113:0/3775142534 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c014680 con 0x7f1c44157bf0 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c441f44f0 con 0x7f1c44157bf0 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.825+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4415e240 con 0x7f1c44157bf0 2023-12-19T13:53:59.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.826+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c44061910 con 0x7f1c44157bf0 2023-12-19T13:53:59.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.827+0000 7f1c40ff9640 1 -- 172.21.15.113:0/3775142534 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c3c01d3b0 con 0x7f1c44157bf0 2023-12-19T13:53:59.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.828+0000 7f1c40ff9640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2406a430 0x7f1c2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:53:59.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.828+0000 7f1c40ff9640 1 -- 172.21.15.113:0/3775142534 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c3c088860 con 0x7f1c44157bf0 2023-12-19T13:53:59.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.829+0000 7f1c437fe640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2406a430 0x7f1c2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:53:59.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.829+0000 7f1c437fe640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2406a430 0x7f1c2406c8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1c340015f0 tx=0x7f1c34007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:53:59.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:53:59.833+0000 7f1c40ff9640 1 -- 172.21.15.113:0/3775142534 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c3c0578e0 con 0x7f1c44157bf0 2023-12-19T13:54:00.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.024+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c440ce4d0 con 0x7f1c44157bf0 2023-12-19T13:54:00.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.027+0000 7f1c40ff9640 1 -- 172.21.15.113:0/3775142534 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f1c3c019020 con 0x7f1c44157bf0 2023-12-19T13:54:00.028 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:00.028 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":135,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:59.572069+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2406a430 msgr2=0x7f1c2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2406a430 0x7f1c2406c8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1c340015f0 tx=0x7f1c34007a40 comp rx=0 tx=0).stop 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c44157bf0 msgr2=0x7f1c4415dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c44157bf0 0x7f1c4415dd00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b970 tx=0x7f1c3c00be30 comp rx=0 tx=0).stop 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 shutdown_connections 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2406a430 0x7f1c2406c8f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c44157bf0 0x7f1c4415dd00 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c440b0640 0x7f1c44151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 --2- 172.21.15.113:0/3775142534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c440ae110 0x7f1c440a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 >> 172.21.15.113:0/3775142534 conn(0x7f1c440cbb70 msgr2=0x7f1c44156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 shutdown_connections 2023-12-19T13:54:00.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.030+0000 7f1c49bc9640 1 -- 172.21.15.113:0/3775142534 wait complete. 2023-12-19T13:54:00.050 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:54:00.050 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:54:00.050 DEBUG:teuthology.orchestra.run.smithi113:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T13:54:00.050 DEBUG:teuthology.orchestra.run.smithi113:> os.fchmod(fd, 0O666) 2023-12-19T13:54:00.050 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(fd) 2023-12-19T13:54:00.050 DEBUG:teuthology.orchestra.run.smithi113:> os.close(fd) 2023-12-19T13:54:00.050 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:54:00.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:00.368 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:54:00.474 INFO:teuthology.orchestra.run.smithi113.stdout:client7515 2023-12-19T13:54:00.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:00.474 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client7515/osdmap') 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 132 barrier 132 flags 0x588000 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:54:00.570 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:54:00.571 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:54:00.571 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:54:00.571 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:54:00.571 INFO:teuthology.orchestra.run.smithi113.stderr:803 bytes copied, 0.000110113 s, 7.3 MB/s 2023-12-19T13:54:00.573 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:00.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.783+0000 7fb3273b5640 1 Processor -- start 2023-12-19T13:54:00.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.783+0000 7fb3273b5640 1 -- start start 2023-12-19T13:54:00.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.784+0000 7fb3273b5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 0x7fb32015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:00.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.784+0000 7fb3273b5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb32015a8a0 0x7fb32015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:00.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.784+0000 7fb3273b5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32006b520 con 0x7fb320159f80 2023-12-19T13:54:00.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.784+0000 7fb3273b5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3200b2b20 con 0x7fb32015a8a0 2023-12-19T13:54:00.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.784+0000 7fb3273b5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200b2fb0 con 0x7fb32015b1e0 2023-12-19T13:54:00.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.785+0000 7fb3263b3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb320159f80 0x7fb32006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60110/0 (socket says 172.21.15.113:60110) 2023-12-19T13:54:00.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.785+0000 7fb3263b3640 1 -- 172.21.15.113:0/3845227918 learned_addr learned my addr 172.21.15.113:0/3845227918 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:00.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.785+0000 7fb326bb4640 1 --2- 172.21.15.113:0/3845227918 >> v2:172.21.15.113:3300/0 conn(0x7fb32015a8a0 0x7fb32015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:00.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.785+0000 7fb325bb2640 1 --2- 172.21.15.113:0/3845227918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 0x7fb32015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:00.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.785+0000 7fb3253b1640 1 -- 172.21.15.113:0/3845227918 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590511594 0 0) 0x7fb32006b520 con 0x7fb320159f80 2023-12-19T13:54:00.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.785+0000 7fb3253b1640 1 -- 172.21.15.113:0/3845227918 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb30c003520 con 0x7fb320159f80 2023-12-19T13:54:00.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.786+0000 7fb326bb4640 1 -- 172.21.15.113:0/3845227918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 msgr2=0x7fb32015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:00.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.786+0000 7fb326bb4640 1 --2- 172.21.15.113:0/3845227918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 0x7fb32015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.786+0000 7fb326bb4640 1 -- 172.21.15.113:0/3845227918 >> v1:172.21.15.113:6789/0 conn(0x7fb320159f80 legacy=0x7fb32006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:00.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.786+0000 7fb326bb4640 1 -- 172.21.15.113:0/3845227918 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200b1f10 con 0x7fb32015a8a0 2023-12-19T13:54:00.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.787+0000 7fb326bb4640 1 --2- 172.21.15.113:0/3845227918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32015b770 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb318009d90 tx=0x7fb31802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935e205ec3c85b2b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:00.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.787+0000 7fb3253b1640 1 -- 172.21.15.113:0/3845227918 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31802cce0 con 0x7fb32015a8a0 2023-12-19T13:54:00.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.787+0000 7fb3253b1640 1 -- 172.21.15.113:0/3845227918 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31802ce40 con 0x7fb32015a8a0 2023-12-19T13:54:00.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.787+0000 7fb3253b1640 1 -- 172.21.15.113:0/3845227918 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb318034660 con 0x7fb32015a8a0 2023-12-19T13:54:00.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 -- 172.21.15.113:0/3845227918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 msgr2=0x7fb32015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:00.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 --2- 172.21.15.113:0/3845227918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32015b770 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb318009d90 tx=0x7fb31802bf30 comp rx=0 tx=0).stop 2023-12-19T13:54:00.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 -- 172.21.15.113:0/3845227918 shutdown_connections 2023-12-19T13:54:00.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 --2- 172.21.15.113:0/3845227918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32015b770 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 --2- 172.21.15.113:0/3845227918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 0x7fb32015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 -- 172.21.15.113:0/3845227918 >> 172.21.15.113:0/3845227918 conn(0x7fb3200b0100 msgr2=0x7fb3200b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:00.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 -- 172.21.15.113:0/3845227918 shutdown_connections 2023-12-19T13:54:00.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.788+0000 7fb3273b5640 1 -- 172.21.15.113:0/3845227918 wait complete. 2023-12-19T13:54:00.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.789+0000 7fb3273b5640 1 Processor -- start 2023-12-19T13:54:00.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.790+0000 7fb3273b5640 1 -- start start 2023-12-19T13:54:00.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.790+0000 7fb3273b5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb320159f80 0x7fb32014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:00.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb3273b5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:00.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb3273b5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 0x7fb32006ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:00.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb3273b5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32006e3c0 con 0x7fb32015a8a0 2023-12-19T13:54:00.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb3273b5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32014f5c0 con 0x7fb320159f80 2023-12-19T13:54:00.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb3273b5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32014f080 con 0x7fb32015b1e0 2023-12-19T13:54:00.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:00.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32006f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55706/0 (socket says 172.21.15.113:55706) 2023-12-19T13:54:00.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 -- 172.21.15.113:0/821447203 learned_addr learned my addr 172.21.15.113:0/821447203 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:00.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb3263b3640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb320159f80 0x7fb32014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:00.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 -- 172.21.15.113:0/821447203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 msgr2=0x7fb32006ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:00.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 0x7fb32006ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 -- 172.21.15.113:0/821447203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb320159f80 msgr2=0x7fb32014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb320159f80 0x7fb32014eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 -- 172.21.15.113:0/821447203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009a70 con 0x7fb32015a8a0 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.791+0000 7fb325bb2640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32006f9f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00e870 tx=0x7fb31c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.792+0000 7fb312ffd640 1 -- 172.21.15.113:0/821447203 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0094f0 con 0x7fb32015a8a0 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.792+0000 7fb312ffd640 1 -- 172.21.15.113:0/821447203 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c00c940 con 0x7fb32015a8a0 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.792+0000 7fb312ffd640 1 -- 172.21.15.113:0/821447203 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c00ccf0 con 0x7fb32015a8a0 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.792+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32014ff90 con 0x7fb32015a8a0 2023-12-19T13:54:00.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.792+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32006e0e0 con 0x7fb32015a8a0 2023-12-19T13:54:00.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.793+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32006db80 con 0x7fb32015a8a0 2023-12-19T13:54:00.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.794+0000 7fb312ffd640 1 -- 172.21.15.113:0/821447203 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb31c013470 con 0x7fb32015a8a0 2023-12-19T13:54:00.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.795+0000 7fb312ffd640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb30406a430 0x7fb30406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:00.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.796+0000 7fb312ffd640 1 -- 172.21.15.113:0/821447203 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb31c088880 con 0x7fb32015a8a0 2023-12-19T13:54:00.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.796+0000 7fb3263b3640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb30406a430 0x7fb30406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:00.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.796+0000 7fb3263b3640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb30406a430 0x7fb30406c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb3140011e0 tx=0x7fb314009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:00.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:00.800+0000 7fb312ffd640 1 -- 172.21.15.113:0/821447203 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb31c053e70 con 0x7fb32015a8a0 2023-12-19T13:54:01.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.026+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb320061910 con 0x7fb32015a8a0 2023-12-19T13:54:01.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.027+0000 7fb312ffd640 1 -- 172.21.15.113:0/821447203 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7fb31c017090 con 0x7fb32015a8a0 2023-12-19T13:54:01.027 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:01.028 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:54:01.028 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:54:01.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb30406a430 msgr2=0x7fb30406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:01.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb30406a430 0x7fb30406c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb3140011e0 tx=0x7fb314009040 comp rx=0 tx=0).stop 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 msgr2=0x7fb32006f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32006f9f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00e870 tx=0x7fb31c00ed30 comp rx=0 tx=0).stop 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 shutdown_connections 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb30406a430 0x7fb30406c8f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb32015b1e0 0x7fb32006ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb32015a8a0 0x7fb32006f9f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 --2- 172.21.15.113:0/821447203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb320159f80 0x7fb32014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 >> 172.21.15.113:0/821447203 conn(0x7fb3200b0100 msgr2=0x7fb3201591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 shutdown_connections 2023-12-19T13:54:01.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:01.030+0000 7fb3273b5640 1 -- 172.21.15.113:0/821447203 wait complete. 2023-12-19T13:54:01.049 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 135 2023-12-19T13:54:01.277 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-19T13:54:01.278 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:54:01.278 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:54:01.278 DEBUG:teuthology.orchestra.run.smithi113:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T13:54:01.278 DEBUG:teuthology.orchestra.run.smithi113:> os.fchmod(fd, 0O666) 2023-12-19T13:54:01.278 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(fd) 2023-12-19T13:54:01.278 DEBUG:teuthology.orchestra.run.smithi113:> os.close(fd) 2023-12-19T13:54:01.278 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:54:01.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:01.605 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:54:01.708 INFO:teuthology.orchestra.run.smithi113.stdout:client7515 2023-12-19T13:54:01.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:01.708 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client7515/osdmap') 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 135 barrier 135 flags 0x588000 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:54:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:54:01.802 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:54:01.802 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:54:01.802 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:54:01.802 INFO:teuthology.orchestra.run.smithi113.stderr:803 bytes copied, 8.2883e-05 s, 9.7 MB/s 2023-12-19T13:54:01.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:01.804 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:54:01.860 INFO:teuthology.orchestra.run.smithi113.stdout:client7515 2023-12-19T13:54:01.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:01.860 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8121e09-ebc1-4371-9bac-afd10a2a5b83.client7515/osdmap') 2023-12-19T13:54:01.952 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 135 barrier 135 flags 0x588000 2023-12-19T13:54:01.952 INFO:teuthology.orchestra.run.smithi113.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:01.952 INFO:teuthology.orchestra.run.smithi113.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:01.952 INFO:teuthology.orchestra.run.smithi113.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd0 (2)172.21.15.113:6811 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd1 (2)172.21.15.113:6800 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd2 (2)172.21.15.113:6809 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd3 (2)172.21.15.113:6808 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd4 (2)172.21.15.151:6800 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd5 (2)172.21.15.151:6808 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd6 (2)172.21.15.151:6824 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stdout:osd7 (2)172.21.15.151:6814 100% (exists, up) 100% -1 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records in 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stderr:1+1 records out 2023-12-19T13:54:01.953 INFO:teuthology.orchestra.run.smithi113.stderr:803 bytes copied, 9.7232e-05 s, 8.3 MB/s 2023-12-19T13:54:01.956 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:54:01.956 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:54:01.956 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:54:02.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:54:02.204 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:54:02.204 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:02.204 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:02.267 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:02.267 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:02.321 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:02.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.534+0000 7f3d66b00640 1 Processor -- start 2023-12-19T13:54:02.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.535+0000 7f3d66b00640 1 -- start start 2023-12-19T13:54:02.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.536+0000 7f3d66b00640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3d60157aa0 0x7f3d600b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.536+0000 7f3d66b00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d6015e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.536+0000 7f3d66b00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6006e8c0 con 0x7f3d6006e410 2023-12-19T13:54:02.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.536+0000 7f3d66b00640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6015e9c0 con 0x7f3d60157aa0 2023-12-19T13:54:02.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.536+0000 7f3d66b00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600b2600 con 0x7f3d6015e040 2023-12-19T13:54:02.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.536+0000 7f3d6489c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3d60157aa0 0x7f3d600b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.537+0000 7f3d6489c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3d60157aa0 0x7f3d600b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55720/0 (socket says 172.21.15.113:55720) 2023-12-19T13:54:02.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.537+0000 7f3d6489c640 1 -- 172.21.15.113:0/2332015122 learned_addr learned my addr 172.21.15.113:0/2332015122 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:02.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.537+0000 7f3d6509d640 1 --2- 172.21.15.113:0/2332015122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d6015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.537+0000 7f3d6489c640 1 -- 172.21.15.113:0/2332015122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 msgr2=0x7f3d6015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:02.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.537+0000 7f3d6489c640 1 --2- 172.21.15.113:0/2332015122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d6015e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.537+0000 7f3d6489c640 1 -- 172.21.15.113:0/2332015122 >> v1:172.21.15.151:6789/0 conn(0x7f3d6006e410 legacy=0x7f3d60161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:02.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.537+0000 7f3d6489c640 1 -- 172.21.15.113:0/2332015122 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600b1d60 con 0x7f3d60157aa0 2023-12-19T13:54:02.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.538+0000 7f3d6489c640 1 --2- 172.21.15.113:0/2332015122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d600b1710 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009870 tx=0x7f3d5402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4159a911c72c86 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.538+0000 7f3d5f7fe640 1 -- 172.21.15.113:0/2332015122 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54031640 con 0x7f3d60157aa0 2023-12-19T13:54:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.538+0000 7f3d5f7fe640 1 -- 172.21.15.113:0/2332015122 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d540317a0 con 0x7f3d60157aa0 2023-12-19T13:54:02.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.538+0000 7f3d5f7fe640 1 -- 172.21.15.113:0/2332015122 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54031b30 con 0x7f3d60157aa0 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 -- 172.21.15.113:0/2332015122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 msgr2=0x7f3d600b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2332015122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d600b1710 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009870 tx=0x7f3d5402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 -- 172.21.15.113:0/2332015122 shutdown_connections 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2332015122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d6015e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2332015122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d600b1710 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 -- 172.21.15.113:0/2332015122 >> 172.21.15.113:0/2332015122 conn(0x7f3d600cbb70 msgr2=0x7f3d600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 -- 172.21.15.113:0/2332015122 shutdown_connections 2023-12-19T13:54:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.539+0000 7f3d66b00640 1 -- 172.21.15.113:0/2332015122 wait complete. 2023-12-19T13:54:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.541+0000 7f3d66b00640 1 Processor -- start 2023-12-19T13:54:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.541+0000 7f3d66b00640 1 -- start start 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.542+0000 7f3d66b00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d6006e410 0x7f3d60160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.542+0000 7f3d66b00640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d6015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.542+0000 7f3d66b00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d60153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.542+0000 7f3d66b00640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d601541d0 con 0x7f3d60157aa0 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.542+0000 7f3d66b00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d601e9cc0 con 0x7f3d6006e410 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.542+0000 7f3d66b00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6015f8b0 con 0x7f3d6015e040 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d6015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d6015ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55736/0 (socket says 172.21.15.113:55736) 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 -- 172.21.15.113:0/2815009991 learned_addr learned my addr 172.21.15.113:0/2815009991 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:02.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d6509d640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d60153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d6489c640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d6006e410 0x7f3d60160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 -- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 msgr2=0x7f3d60153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d60153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 -- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d6006e410 msgr2=0x7f3d60160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d6006e410 0x7f3d60160950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 -- 172.21.15.113:0/2815009991 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540094d0 con 0x7f3d60157aa0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d6509d640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d60153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d6489c640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d6006e410 0x7f3d60160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.543+0000 7f3d5ffff640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d6015ecb0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c430 tx=0x7f3d4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.544+0000 7f3d5d7fa640 1 -- 172.21.15.113:0/2815009991 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c011790 con 0x7f3d60157aa0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.544+0000 7f3d5d7fa640 1 -- 172.21.15.113:0/2815009991 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0118f0 con 0x7f3d60157aa0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.544+0000 7f3d5d7fa640 1 -- 172.21.15.113:0/2815009991 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c011ca0 con 0x7f3d60157aa0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.544+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6015fb90 con 0x7f3d60157aa0 2023-12-19T13:54:02.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.544+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d60160150 con 0x7f3d60157aa0 2023-12-19T13:54:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.545+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d60061910 con 0x7f3d60157aa0 2023-12-19T13:54:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.546+0000 7f3d5d7fa640 1 -- 172.21.15.113:0/2815009991 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d4c01c460 con 0x7f3d60157aa0 2023-12-19T13:54:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.547+0000 7f3d5d7fa640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3d4406a430 0x7f3d4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.547+0000 7f3d5d7fa640 1 -- 172.21.15.113:0/2815009991 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d4c088920 con 0x7f3d60157aa0 2023-12-19T13:54:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.547+0000 7f3d6489c640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3d4406a430 0x7f3d4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.548+0000 7f3d6489c640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3d4406a430 0x7f3d4406c8f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3d54036000 tx=0x7f3d5403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:02.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.551+0000 7f3d5d7fa640 1 -- 172.21.15.113:0/2815009991 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3d4c053e70 con 0x7f3d60157aa0 2023-12-19T13:54:02.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.747+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d6015b410 con 0x7f3d60157aa0 2023-12-19T13:54:02.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.749+0000 7f3d5d7fa640 1 -- 172.21.15.113:0/2815009991 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f3d4c057490 con 0x7f3d60157aa0 2023-12-19T13:54:02.749 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:02.750 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":135,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:59.572069+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3d4406a430 msgr2=0x7f3d4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3d4406a430 0x7f3d4406c8f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3d54036000 tx=0x7f3d5403c040 comp rx=0 tx=0).stop 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 msgr2=0x7f3d6015ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d6015ecb0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c430 tx=0x7f3d4c00c8f0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 shutdown_connections 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3d4406a430 0x7f3d4406c8f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015e040 0x7f3d60153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d60157aa0 0x7f3d6015ecb0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.751+0000 7f3d66b00640 1 --2- 172.21.15.113:0/2815009991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d6006e410 0x7f3d60160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.752+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 >> 172.21.15.113:0/2815009991 conn(0x7f3d600cbb70 msgr2=0x7f3d600ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:02.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.752+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 shutdown_connections 2023-12-19T13:54:02.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.752+0000 7f3d66b00640 1 -- 172.21.15.113:0/2815009991 wait complete. 2023-12-19T13:54:02.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:53:43.793689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:53:45.092859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:54:02.771 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:54:02.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.978+0000 7f4efc857640 1 Processor -- start 2023-12-19T13:54:02.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.978+0000 7f4efc857640 1 -- start start 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.980+0000 7f4efc857640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ef80b2760 0x7f4ef80b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.980+0000 7f4efc857640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4ef80ceea0 0x7f4ef80cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.980+0000 7f4efc857640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef815fde0 con 0x7f4ef815b1d0 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.980+0000 7f4efc857640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80b2400 con 0x7f4ef80ceea0 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.980+0000 7f4efc857640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80cf870 con 0x7f4ef80b2760 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.980+0000 7f4ef6d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4ef80ceea0 0x7f4ef80cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.981+0000 7f4ef6d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4ef80ceea0 0x7f4ef80cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55740/0 (socket says 172.21.15.113:55740) 2023-12-19T13:54:02.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.981+0000 7f4ef6d9d640 1 -- 172.21.15.113:0/3775615048 learned_addr learned my addr 172.21.15.113:0/3775615048 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:02.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.981+0000 7f4eeffff640 1 --2- 172.21.15.113:0/3775615048 >> v2:172.21.15.151:3300/0 conn(0x7f4ef80b2760 0x7f4ef80b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.981+0000 7f4ef6d9d640 1 -- 172.21.15.113:0/3775615048 >> v2:172.21.15.151:3300/0 conn(0x7f4ef80b2760 msgr2=0x7f4ef80b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:02.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.981+0000 7f4ef6d9d640 1 --2- 172.21.15.113:0/3775615048 >> v2:172.21.15.151:3300/0 conn(0x7f4ef80b2760 0x7f4ef80b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.981+0000 7f4ef6d9d640 1 -- 172.21.15.113:0/3775615048 >> v1:172.21.15.151:6789/0 conn(0x7f4ef815b1d0 legacy=0x7f4ef815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.981+0000 7f4ef6d9d640 1 -- 172.21.15.113:0/3775615048 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80b2bc0 con 0x7f4ef80ceea0 2023-12-19T13:54:02.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.982+0000 7f4ef6d9d640 1 --2- 172.21.15.113:0/3775615048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80ceea0 0x7f4ef80cf330 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8073a40 tx=0x7f4ef002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fa0fb0c8539473 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:02.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.983+0000 7f4ef5d9b640 1 -- 172.21.15.113:0/3775615048 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef002cb20 con 0x7f4ef80ceea0 2023-12-19T13:54:02.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.983+0000 7f4ef5d9b640 1 -- 172.21.15.113:0/3775615048 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef002cc80 con 0x7f4ef80ceea0 2023-12-19T13:54:02.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.983+0000 7f4ef5d9b640 1 -- 172.21.15.113:0/3775615048 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00343f0 con 0x7f4ef80ceea0 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 -- 172.21.15.113:0/3775615048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80ceea0 msgr2=0x7f4ef80cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 --2- 172.21.15.113:0/3775615048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80ceea0 0x7f4ef80cf330 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8073a40 tx=0x7f4ef002bf80 comp rx=0 tx=0).stop 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 -- 172.21.15.113:0/3775615048 shutdown_connections 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 --2- 172.21.15.113:0/3775615048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80ceea0 0x7f4ef80cf330 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 --2- 172.21.15.113:0/3775615048 >> v2:172.21.15.151:3300/0 conn(0x7f4ef80b2760 0x7f4ef80b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 -- 172.21.15.113:0/3775615048 >> 172.21.15.113:0/3775615048 conn(0x7f4ef8073150 msgr2=0x7f4ef80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 -- 172.21.15.113:0/3775615048 shutdown_connections 2023-12-19T13:54:02.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.984+0000 7f4efc857640 1 -- 172.21.15.113:0/3775615048 wait complete. 2023-12-19T13:54:02.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.986+0000 7f4efc857640 1 Processor -- start 2023-12-19T13:54:02.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.986+0000 7f4efc857640 1 -- start start 2023-12-19T13:54:02.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4efc857640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80b2760 0x7f4ef814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4efc857640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ef80ceea0 0x7f4ef80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4efc857640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef815b1d0 0x7f4ef80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4efc857640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80cda60 con 0x7f4ef80b2760 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4efc857640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80cc9c0 con 0x7f4ef815b1d0 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4efc857640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80ccca0 con 0x7f4ef80ceea0 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80b2760 0x7f4ef814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80b2760 0x7f4ef814ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55746/0 (socket says 172.21.15.113:55746) 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 -- 172.21.15.113:0/3830280324 learned_addr learned my addr 172.21.15.113:0/3830280324 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 -- 172.21.15.113:0/3830280324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ef80ceea0 msgr2=0x7f4ef80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4eeffff640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ef80ceea0 0x7f4ef80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ef80ceea0 0x7f4ef80ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 -- 172.21.15.113:0/3830280324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef815b1d0 msgr2=0x7f4ef80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef815b1d0 0x7f4ef80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:02.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.988+0000 7f4ef659c640 1 -- 172.21.15.113:0/3830280324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0009b30 con 0x7f4ef80b2760 2023-12-19T13:54:02.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.989+0000 7f4ef659c640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80b2760 0x7f4ef814ada0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c400 tx=0x7f4ee800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:02.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.989+0000 7f4eeeffd640 1 -- 172.21.15.113:0/3830280324 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80052d0 con 0x7f4ef80b2760 2023-12-19T13:54:02.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.989+0000 7f4eeeffd640 1 -- 172.21.15.113:0/3830280324 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee8005430 con 0x7f4ef80b2760 2023-12-19T13:54:02.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.989+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef80ccf80 con 0x7f4ef80b2760 2023-12-19T13:54:02.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.989+0000 7f4eeeffd640 1 -- 172.21.15.113:0/3830280324 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8003830 con 0x7f4ef80b2760 2023-12-19T13:54:02.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.989+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80cd540 con 0x7f4ef80b2760 2023-12-19T13:54:02.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.991+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8061910 con 0x7f4ef80b2760 2023-12-19T13:54:02.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.991+0000 7f4eeeffd640 1 -- 172.21.15.113:0/3830280324 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ee8003990 con 0x7f4ef80b2760 2023-12-19T13:54:02.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.992+0000 7f4eeeffd640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ed806a430 0x7f4ed806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:02.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.992+0000 7f4eeeffd640 1 -- 172.21.15.113:0/3830280324 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ee8087f60 con 0x7f4ef80b2760 2023-12-19T13:54:02.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.993+0000 7f4eeffff640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ed806a430 0x7f4ed806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:02.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.993+0000 7f4eeffff640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ed806a430 0x7f4ed806c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8154ab0 tx=0x7f4ee0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:02.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:02.997+0000 7f4eeeffd640 1 -- 172.21.15.113:0/3830280324 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4ee80534b0 con 0x7f4ef80b2760 2023-12-19T13:54:03.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.185+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ef80cdc90 con 0x7f4ef80b2760 2023-12-19T13:54:03.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.186+0000 7f4eeeffd640 1 -- 172.21.15.113:0/3830280324 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ee8017020 con 0x7f4ef80b2760 2023-12-19T13:54:03.189 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ed806a430 msgr2=0x7f4ed806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ed806a430 0x7f4ed806c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8154ab0 tx=0x7f4ee0008040 comp rx=0 tx=0).stop 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80b2760 msgr2=0x7f4ef814ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80b2760 0x7f4ef814ada0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c400 tx=0x7f4ee800c8c0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 shutdown_connections 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4ed806a430 0x7f4ed806c8f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef815b1d0 0x7f4ef80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ef80ceea0 0x7f4ef80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 --2- 172.21.15.113:0/3830280324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ef80b2760 0x7f4ef814ada0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 >> 172.21.15.113:0/3830280324 conn(0x7f4ef8073150 msgr2=0x7f4ef80b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:03.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 shutdown_connections 2023-12-19T13:54:03.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.189+0000 7f4efc857640 1 -- 172.21.15.113:0/3830280324 wait complete. 2023-12-19T13:54:03.207 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:54:03.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.424+0000 7f1d7be48640 1 Processor -- start 2023-12-19T13:54:03.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.424+0000 7f1d7be48640 1 -- start start 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d7be48640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d741449e0 0x7f1d740af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d7be48640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1d740b0b50 0x7f1d7406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d7be48640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d740afb10 con 0x7f1d7406b590 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d7be48640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7406bb30 con 0x7f1d741449e0 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d7be48640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740b0070 con 0x7f1d740b0b50 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d7a3e5640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1d7406b590 0x7f1d7415eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60126/0 (socket says 172.21.15.113:60126) 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d7a3e5640 1 -- 172.21.15.113:0/3494051824 learned_addr learned my addr 172.21.15.113:0/3494051824 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:03.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d79be4640 1 --2- 172.21.15.113:0/3494051824 >> v2:172.21.15.113:3300/0 conn(0x7f1d741449e0 0x7f1d740af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d78be2640 1 -- 172.21.15.113:0/3494051824 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035255494 0 0) 0x7f1d740afb10 con 0x7f1d7406b590 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d78be2640 1 -- 172.21.15.113:0/3494051824 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d60003520 con 0x7f1d7406b590 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.426+0000 7f1d793e3640 1 --2- 172.21.15.113:0/3494051824 >> v2:172.21.15.151:3300/0 conn(0x7f1d740b0b50 0x7f1d7406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.427+0000 7f1d79be4640 1 -- 172.21.15.113:0/3494051824 >> v2:172.21.15.151:3300/0 conn(0x7f1d740b0b50 msgr2=0x7f1d7406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.427+0000 7f1d79be4640 1 --2- 172.21.15.113:0/3494051824 >> v2:172.21.15.151:3300/0 conn(0x7f1d740b0b50 0x7f1d7406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.427+0000 7f1d79be4640 1 -- 172.21.15.113:0/3494051824 >> v1:172.21.15.113:6789/0 conn(0x7f1d7406b590 legacy=0x7f1d7415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.427+0000 7f1d79be4640 1 -- 172.21.15.113:0/3494051824 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740b0350 con 0x7f1d741449e0 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.427+0000 7f1d793e3640 1 --2- 172.21.15.113:0/3494051824 >> v2:172.21.15.151:3300/0 conn(0x7f1d740b0b50 0x7f1d7406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:03.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.428+0000 7f1d79be4640 1 --2- 172.21.15.113:0/3494051824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d740af5d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1d74071c80 tx=0x7f1d7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e63dce422e89171 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:03.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.428+0000 7f1d78be2640 1 -- 172.21.15.113:0/3494051824 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70031830 con 0x7f1d741449e0 2023-12-19T13:54:03.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.428+0000 7f1d78be2640 1 -- 172.21.15.113:0/3494051824 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d70031990 con 0x7f1d741449e0 2023-12-19T13:54:03.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.428+0000 7f1d78be2640 1 -- 172.21.15.113:0/3494051824 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70031d00 con 0x7f1d741449e0 2023-12-19T13:54:03.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.428+0000 7f1d7be48640 1 -- 172.21.15.113:0/3494051824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 msgr2=0x7f1d740af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.428+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3494051824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d740af5d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1d74071c80 tx=0x7f1d7002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.429+0000 7f1d7be48640 1 -- 172.21.15.113:0/3494051824 shutdown_connections 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.429+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3494051824 >> v2:172.21.15.151:3300/0 conn(0x7f1d740b0b50 0x7f1d7406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.429+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3494051824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d740af5d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.429+0000 7f1d7be48640 1 -- 172.21.15.113:0/3494051824 >> 172.21.15.113:0/3494051824 conn(0x7f1d740cbb70 msgr2=0x7f1d740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.429+0000 7f1d7be48640 1 -- 172.21.15.113:0/3494051824 shutdown_connections 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.429+0000 7f1d7be48640 1 -- 172.21.15.113:0/3494051824 wait complete. 2023-12-19T13:54:03.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.430+0000 7f1d7be48640 1 Processor -- start 2023-12-19T13:54:03.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.431+0000 7f1d7be48640 1 -- start start 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.431+0000 7f1d7be48640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d7406b590 0x7f1d741f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.431+0000 7f1d7be48640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d740b0b50 0x7f1d7414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.431+0000 7f1d7be48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d7414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.431+0000 7f1d7be48640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d741f2810 con 0x7f1d741449e0 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.431+0000 7f1d7be48640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7414f3e0 con 0x7f1d7406b590 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.431+0000 7f1d7be48640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740ac1a0 con 0x7f1d740b0b50 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d7414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d7414ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55766/0 (socket says 172.21.15.113:55766) 2023-12-19T13:54:03.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 -- 172.21.15.113:0/3711824320 learned_addr learned my addr 172.21.15.113:0/3711824320 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 -- 172.21.15.113:0/3711824320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d740b0b50 msgr2=0x7f1d7414e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d740b0b50 0x7f1d7414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 -- 172.21.15.113:0/3711824320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d7406b590 msgr2=0x7f1d741f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d7406b590 0x7f1d741f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 -- 172.21.15.113:0/3711824320 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009400 con 0x7f1d741449e0 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.432+0000 7f1d7a3e5640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d7414ea90 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00cb70 tx=0x7f1d6c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.433+0000 7f1d6a7fc640 1 -- 172.21.15.113:0/3711824320 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00ad40 con 0x7f1d741449e0 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.433+0000 7f1d6a7fc640 1 -- 172.21.15.113:0/3711824320 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c012400 con 0x7f1d741449e0 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.433+0000 7f1d6a7fc640 1 -- 172.21.15.113:0/3711824320 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00aea0 con 0x7f1d741449e0 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.433+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d740ac480 con 0x7f1d741449e0 2023-12-19T13:54:03.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.433+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d740aca40 con 0x7f1d741449e0 2023-12-19T13:54:03.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.434+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d74061910 con 0x7f1d741449e0 2023-12-19T13:54:03.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.435+0000 7f1d6a7fc640 1 -- 172.21.15.113:0/3711824320 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d6c007070 con 0x7f1d741449e0 2023-12-19T13:54:03.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.436+0000 7f1d6a7fc640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d5806a430 0x7f1d5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.436+0000 7f1d6a7fc640 1 -- 172.21.15.113:0/3711824320 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d6c088960 con 0x7f1d741449e0 2023-12-19T13:54:03.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.436+0000 7f1d79be4640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d5806a430 0x7f1d5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.437+0000 7f1d79be4640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d5806a430 0x7f1d5806c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1d70036000 tx=0x7f1d70030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:03.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.440+0000 7f1d6a7fc640 1 -- 172.21.15.113:0/3711824320 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d6c053f50 con 0x7f1d741449e0 2023-12-19T13:54:03.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.628+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d74070f60 con 0x7f1d741449e0 2023-12-19T13:54:03.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.629+0000 7f1d6a7fc640 1 -- 172.21.15.113:0/3711824320 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d6c0170a0 con 0x7f1d741449e0 2023-12-19T13:54:03.629 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:54:03.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.631+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d5806a430 msgr2=0x7f1d5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.631+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d5806a430 0x7f1d5806c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1d70036000 tx=0x7f1d70030000 comp rx=0 tx=0).stop 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.631+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 msgr2=0x7f1d7414ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.631+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d7414ea90 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00cb70 tx=0x7f1d6c00a430 comp rx=0 tx=0).stop 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 shutdown_connections 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d5806a430 0x7f1d5806c8f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d741449e0 0x7f1d7414ea90 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d740b0b50 0x7f1d7414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 --2- 172.21.15.113:0/3711824320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d7406b590 0x7f1d741f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 >> 172.21.15.113:0/3711824320 conn(0x7f1d740cbb70 msgr2=0x7f1d7415e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:03.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 shutdown_connections 2023-12-19T13:54:03.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.632+0000 7f1d7be48640 1 -- 172.21.15.113:0/3711824320 wait complete. 2023-12-19T13:54:03.650 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:54:03.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.858+0000 7f2890cbd640 1 Processor -- start 2023-12-19T13:54:03.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.859+0000 7f2890cbd640 1 -- start start 2023-12-19T13:54:03.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.860+0000 7f2890cbd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c157c30 0x7f288c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.860+0000 7f2890cbd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f288c0ad300 0x7f288c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.860+0000 7f2890cbd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c15da00 con 0x7f288c0b0070 2023-12-19T13:54:03.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.860+0000 7f2890cbd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c15e940 con 0x7f288c0ad300 2023-12-19T13:54:03.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.860+0000 7f2890cbd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0adcc0 con 0x7f288c157c30 2023-12-19T13:54:03.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.861+0000 7f288a59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c157c30 0x7f288c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.861+0000 7f288a59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c157c30 0x7f288c0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:38532/0 (socket says 172.21.15.113:38532) 2023-12-19T13:54:03.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.861+0000 7f288a59c640 1 -- 172.21.15.113:0/841892983 learned_addr learned my addr 172.21.15.113:0/841892983 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:03.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.861+0000 7f2883fff640 1 --2- 172.21.15.113:0/841892983 >> v2:172.21.15.151:3300/0 conn(0x7f288c0ad300 0x7f288c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.862+0000 7f288a59c640 1 -- 172.21.15.113:0/841892983 >> v2:172.21.15.151:3300/0 conn(0x7f288c0ad300 msgr2=0x7f288c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:03.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.862+0000 7f288a59c640 1 --2- 172.21.15.113:0/841892983 >> v2:172.21.15.151:3300/0 conn(0x7f288c0ad300 0x7f288c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.862+0000 7f288a59c640 1 -- 172.21.15.113:0/841892983 >> v1:172.21.15.151:6789/0 conn(0x7f288c0b0070 legacy=0x7f288c0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.862+0000 7f288a59c640 1 -- 172.21.15.113:0/841892983 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0cf860 con 0x7f288c157c30 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.863+0000 7f288a59c640 1 --2- 172.21.15.113:0/841892983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c157c30 0x7f288c0cf320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f287c0098a0 tx=0x7f287c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29a265c023035781 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.863+0000 7f2889d9b640 1 -- 172.21.15.113:0/841892983 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c030840 con 0x7f288c157c30 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.864+0000 7f2889d9b640 1 -- 172.21.15.113:0/841892983 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0309a0 con 0x7f288c157c30 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.864+0000 7f2889d9b640 1 -- 172.21.15.113:0/841892983 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c030d30 con 0x7f288c157c30 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.864+0000 7f2890cbd640 1 -- 172.21.15.113:0/841892983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c157c30 msgr2=0x7f288c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.864+0000 7f2890cbd640 1 --2- 172.21.15.113:0/841892983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c157c30 0x7f288c0cf320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f287c0098a0 tx=0x7f287c02b980 comp rx=0 tx=0).stop 2023-12-19T13:54:03.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.865+0000 7f2890cbd640 1 -- 172.21.15.113:0/841892983 shutdown_connections 2023-12-19T13:54:03.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.865+0000 7f2890cbd640 1 --2- 172.21.15.113:0/841892983 >> v2:172.21.15.151:3300/0 conn(0x7f288c0ad300 0x7f288c0ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.865+0000 7f2890cbd640 1 --2- 172.21.15.113:0/841892983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c157c30 0x7f288c0cf320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.865+0000 7f2890cbd640 1 -- 172.21.15.113:0/841892983 >> 172.21.15.113:0/841892983 conn(0x7f288c073150 msgr2=0x7f288c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:03.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.865+0000 7f2890cbd640 1 -- 172.21.15.113:0/841892983 shutdown_connections 2023-12-19T13:54:03.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.865+0000 7f2890cbd640 1 -- 172.21.15.113:0/841892983 wait complete. 2023-12-19T13:54:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.867+0000 7f2890cbd640 1 Processor -- start 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.867+0000 7f2890cbd640 1 -- start start 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.868+0000 7f2890cbd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f288c0ad300 0x7f288c147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f2890cbd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c0b0070 0x7f288c15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f2890cbd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288c157c30 0x7f288c14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f2890cbd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c148010 con 0x7f288c0ad300 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f2890cbd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c156c50 con 0x7f288c157c30 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f2890cbd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c15ec00 con 0x7f288c0b0070 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f288c0ad300 0x7f288c147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f288c0ad300 0x7f288c147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55778/0 (socket says 172.21.15.113:55778) 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 -- 172.21.15.113:0/203963970 learned_addr learned my addr 172.21.15.113:0/203963970 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288ad9d640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288c157c30 0x7f288c14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f2883fff640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c0b0070 0x7f288c15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 -- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c0b0070 msgr2=0x7f288c15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c0b0070 0x7f288c15fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 -- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288c157c30 msgr2=0x7f288c14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288c157c30 0x7f288c14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288a59c640 1 -- 172.21.15.113:0/203963970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0094d0 con 0x7f288c0ad300 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.869+0000 7f288ad9d640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288c157c30 0x7f288c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.870+0000 7f288a59c640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f288c0ad300 0x7f288c147ad0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f287c000c00 tx=0x7f287c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.870+0000 7f2882ffd640 1 -- 172.21.15.113:0/203963970 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c039c90 con 0x7f288c0ad300 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.870+0000 7f2882ffd640 1 -- 172.21.15.113:0/203963970 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c039df0 con 0x7f288c0ad300 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.870+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c15eee0 con 0x7f288c0ad300 2023-12-19T13:54:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.870+0000 7f2882ffd640 1 -- 172.21.15.113:0/203963970 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c043640 con 0x7f288c0ad300 2023-12-19T13:54:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.870+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c15f4a0 con 0x7f288c0ad300 2023-12-19T13:54:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.871+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c061910 con 0x7f288c0ad300 2023-12-19T13:54:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.872+0000 7f2882ffd640 1 -- 172.21.15.113:0/203963970 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f287c0437a0 con 0x7f288c0ad300 2023-12-19T13:54:03.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.874+0000 7f2882ffd640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f286c06a430 0x7f286c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:03.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.874+0000 7f2882ffd640 1 -- 172.21.15.113:0/203963970 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f287c03e070 con 0x7f288c0ad300 2023-12-19T13:54:03.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.874+0000 7f2883fff640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f286c06a430 0x7f286c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:03.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.874+0000 7f2883fff640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f286c06a430 0x7f286c06c8f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f288c15caa0 tx=0x7f2874008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:03.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:03.879+0000 7f2882ffd640 1 -- 172.21.15.113:0/203963970 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f287c076f50 con 0x7f288c0ad300 2023-12-19T13:54:04.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.073+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f288c06e260 con 0x7f288c0ad300 2023-12-19T13:54:04.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.074+0000 7f2882ffd640 1 -- 172.21.15.113:0/203963970 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7f287c034020 con 0x7f288c0ad300 2023-12-19T13:54:04.074 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f286c06a430 msgr2=0x7f286c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f286c06a430 0x7f286c06c8f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f288c15caa0 tx=0x7f2874008040 comp rx=0 tx=0).stop 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f288c0ad300 msgr2=0x7f288c147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f288c0ad300 0x7f288c147ad0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f287c000c00 tx=0x7f287c004730 comp rx=0 tx=0).stop 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 shutdown_connections 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f286c06a430 0x7f286c06c8f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288c157c30 0x7f288c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288c0b0070 0x7f288c15fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 --2- 172.21.15.113:0/203963970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f288c0ad300 0x7f288c147ad0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 >> 172.21.15.113:0/203963970 conn(0x7f288c073150 msgr2=0x7f288c0cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:04.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 shutdown_connections 2023-12-19T13:54:04.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.076+0000 7f2890cbd640 1 -- 172.21.15.113:0/203963970 wait complete. 2023-12-19T13:54:04.096 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:54:04.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.302+0000 7f877ad92640 1 Processor -- start 2023-12-19T13:54:04.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.303+0000 7f877ad92640 1 -- start start 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.304+0000 7f877ad92640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8774146e10 0x7f87740d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.304+0000 7f877ad92640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87740d2b00 0x7f87740b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.304+0000 7f877ad92640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f87740ce110 0x7f87740ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.304+0000 7f877ad92640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87740d2430 con 0x7f87740ce110 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.304+0000 7f877ad92640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87740ceae0 con 0x7f8774146e10 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.304+0000 7f877ad92640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740cd840 con 0x7f87740d2b00 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.304+0000 7f877932f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f87740ce110 0x7f87740ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:04.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f877932f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f87740ce110 0x7f87740ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55790/0 (socket says 172.21.15.113:55790) 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f877932f640 1 -- 172.21.15.113:0/505240434 learned_addr learned my addr 172.21.15.113:0/505240434 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f8778b2e640 1 --2- 172.21.15.113:0/505240434 >> v2:172.21.15.151:3300/0 conn(0x7f8774146e10 0x7f87740d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f8773fff640 1 --2- 172.21.15.113:0/505240434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87740d2b00 0x7f87740b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f877932f640 1 -- 172.21.15.113:0/505240434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87740d2b00 msgr2=0x7f87740b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f877932f640 1 --2- 172.21.15.113:0/505240434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87740d2b00 0x7f87740b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f877932f640 1 -- 172.21.15.113:0/505240434 >> v2:172.21.15.151:3300/0 conn(0x7f8774146e10 msgr2=0x7f87740d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f877932f640 1 --2- 172.21.15.113:0/505240434 >> v2:172.21.15.151:3300/0 conn(0x7f8774146e10 0x7f87740d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f877932f640 1 -- 172.21.15.113:0/505240434 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740d2620 con 0x7f87740ce110 2023-12-19T13:54:04.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.305+0000 7f8778b2e640 1 --2- 172.21.15.113:0/505240434 >> v2:172.21.15.151:3300/0 conn(0x7f8774146e10 0x7f87740d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:54:04.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.306+0000 7f877932f640 1 --2- 172.21.15.113:0/505240434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f87740ce5a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f87740d0720 tx=0x7f876c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4479e30b2a6b8f04 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:04.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.306+0000 7f87737fe640 1 -- 172.21.15.113:0/505240434 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c031640 con 0x7f87740ce110 2023-12-19T13:54:04.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.306+0000 7f87737fe640 1 -- 172.21.15.113:0/505240434 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c0317a0 con 0x7f87740ce110 2023-12-19T13:54:04.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.306+0000 7f87737fe640 1 -- 172.21.15.113:0/505240434 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c031b30 con 0x7f87740ce110 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 -- 172.21.15.113:0/505240434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 msgr2=0x7f87740ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 --2- 172.21.15.113:0/505240434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f87740ce5a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f87740d0720 tx=0x7f876c02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 -- 172.21.15.113:0/505240434 shutdown_connections 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 --2- 172.21.15.113:0/505240434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f87740ce5a0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 --2- 172.21.15.113:0/505240434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87740d2b00 0x7f87740b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 --2- 172.21.15.113:0/505240434 >> v2:172.21.15.151:3300/0 conn(0x7f8774146e10 0x7f87740d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 -- 172.21.15.113:0/505240434 >> 172.21.15.113:0/505240434 conn(0x7f87740b29c0 msgr2=0x7f87740b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 -- 172.21.15.113:0/505240434 shutdown_connections 2023-12-19T13:54:04.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.307+0000 7f877ad92640 1 -- 172.21.15.113:0/505240434 wait complete. 2023-12-19T13:54:04.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.309+0000 7f877ad92640 1 Processor -- start 2023-12-19T13:54:04.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.309+0000 7f877ad92640 1 -- start start 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f877ad92640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f877413cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f877ad92640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87740d2b00 0x7f877413e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f877ad92640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774146e10 0x7f8774143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f877ad92640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8774143010 con 0x7f87740ce110 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f877ad92640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8774142140 con 0x7f87740d2b00 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f877ad92640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877413dc30 con 0x7f8774146e10 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f8778b2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f877413cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f8778b2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f877413cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55800/0 (socket says 172.21.15.113:55800) 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.310+0000 7f8778b2e640 1 -- 172.21.15.113:0/826558914 learned_addr learned my addr 172.21.15.113:0/826558914 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8773fff640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87740d2b00 0x7f877413e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f877932f640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774146e10 0x7f8774143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:04.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8778b2e640 1 -- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774146e10 msgr2=0x7f8774143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8778b2e640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774146e10 0x7f8774143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8778b2e640 1 -- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87740d2b00 msgr2=0x7f877413e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8778b2e640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87740d2b00 0x7f877413e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8778b2e640 1 -- 172.21.15.113:0/826558914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0094d0 con 0x7f87740ce110 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8773fff640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87740d2b00 0x7f877413e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f8778b2e640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f877413cbd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8764007f20 tx=0x7f876400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f87717fa640 1 -- 172.21.15.113:0/826558914 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876400dee0 con 0x7f87740ce110 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f87717fa640 1 -- 172.21.15.113:0/826558914 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876400f040 con 0x7f87740ce110 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f87717fa640 1 -- 172.21.15.113:0/826558914 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764003db0 con 0x7f87740ce110 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.311+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8774142390 con 0x7f87740ce110 2023-12-19T13:54:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.312+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8774142950 con 0x7f87740ce110 2023-12-19T13:54:04.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.313+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8774143280 con 0x7f87740ce110 2023-12-19T13:54:04.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.314+0000 7f87717fa640 1 -- 172.21.15.113:0/826558914 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8764004030 con 0x7f87740ce110 2023-12-19T13:54:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.314+0000 7f87717fa640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876006a430 0x7f876006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.315+0000 7f87717fa640 1 -- 172.21.15.113:0/826558914 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8764088bc0 con 0x7f87740ce110 2023-12-19T13:54:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.315+0000 7f8773fff640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876006a430 0x7f876006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.315+0000 7f8773fff640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876006a430 0x7f876006c8f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8768006fd0 tx=0x7f8768008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:04.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.319+0000 7f87717fa640 1 -- 172.21.15.113:0/826558914 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87640541c0 con 0x7f87740ce110 2023-12-19T13:54:04.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.524+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8774061910 con 0x7f87740ce110 2023-12-19T13:54:04.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.524+0000 7f87717fa640 1 -- 172.21.15.113:0/826558914 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v135) v1 ==== 80+0+0 (secure 0 0 0) 0x7f876401a080 con 0x7f87740ce110 2023-12-19T13:54:04.525 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:54:04.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876006a430 msgr2=0x7f876006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876006a430 0x7f876006c8f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8768006fd0 tx=0x7f8768008040 comp rx=0 tx=0).stop 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 msgr2=0x7f877413cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f877413cbd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8764007f20 tx=0x7f876400d560 comp rx=0 tx=0).stop 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 shutdown_connections 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f876006a430 0x7f876006c8f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8774146e10 0x7f8774143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87740d2b00 0x7f877413e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 --2- 172.21.15.113:0/826558914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87740ce110 0x7f877413cbd0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 >> 172.21.15.113:0/826558914 conn(0x7f87740b29c0 msgr2=0x7f87740b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 shutdown_connections 2023-12-19T13:54:04.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:04.527+0000 7f877ad92640 1 -- 172.21.15.113:0/826558914 wait complete. 2023-12-19T13:54:04.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:54:04.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:04.547 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:54:04.672 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:54:04.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:04.673 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:54:04.719 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:54:04.719 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:04.763 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:54:04.763 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:04.860 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:05.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.072+0000 7f50891b5640 1 Processor -- start 2023-12-19T13:54:05.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.072+0000 7f50891b5640 1 -- start start 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.073+0000 7f50891b5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50840b0b50 0x7f508406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.073+0000 7f50891b5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f508406b590 0x7f508406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.073+0000 7f50891b5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508406bb30 con 0x7f50841449e0 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.073+0000 7f50891b5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840b0070 con 0x7f508406b590 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.073+0000 7f50891b5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50840b0350 con 0x7f50840b0b50 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f5082d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f50841449e0 0x7f50840af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60132/0 (socket says 172.21.15.113:60132) 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f5082d9d640 1 -- 172.21.15.113:0/2709809369 learned_addr learned my addr 172.21.15.113:0/2709809369 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f508359e640 1 --2- 172.21.15.113:0/2709809369 >> v2:172.21.15.113:3300/0 conn(0x7f508406b590 0x7f508406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f508259c640 1 --2- 172.21.15.113:0/2709809369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50840b0b50 0x7f508406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f508359e640 1 -- 172.21.15.113:0/2709809369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50840b0b50 msgr2=0x7f508406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f508359e640 1 --2- 172.21.15.113:0/2709809369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50840b0b50 0x7f508406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f508359e640 1 -- 172.21.15.113:0/2709809369 >> v1:172.21.15.113:6789/0 conn(0x7f50841449e0 legacy=0x7f50840af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f508359e640 1 -- 172.21.15.113:0/2709809369 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840b0630 con 0x7f508406b590 2023-12-19T13:54:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.074+0000 7f5081d9b640 1 -- 172.21.15.113:0/2709809369 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208821325 0 0) 0x7f508406bb30 con 0x7f50841449e0 2023-12-19T13:54:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.075+0000 7f508359e640 1 --2- 172.21.15.113:0/2709809369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508406b590 0x7f508406c4e0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f507c009d90 tx=0x7f507c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120cdeeccdcc0bad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f5081d9b640 1 -- 172.21.15.113:0/2709809369 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c02cc50 con 0x7f508406b590 2023-12-19T13:54:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f5081d9b640 1 -- 172.21.15.113:0/2709809369 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c02cdb0 con 0x7f508406b590 2023-12-19T13:54:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f5081d9b640 1 -- 172.21.15.113:0/2709809369 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c034660 con 0x7f508406b590 2023-12-19T13:54:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 -- 172.21.15.113:0/2709809369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508406b590 msgr2=0x7f508406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 --2- 172.21.15.113:0/2709809369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508406b590 0x7f508406c4e0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f507c009d90 tx=0x7f507c02bea0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 -- 172.21.15.113:0/2709809369 shutdown_connections 2023-12-19T13:54:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 --2- 172.21.15.113:0/2709809369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f508406b590 0x7f508406c4e0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 --2- 172.21.15.113:0/2709809369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50840b0b50 0x7f508406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 -- 172.21.15.113:0/2709809369 >> 172.21.15.113:0/2709809369 conn(0x7f50840cbb70 msgr2=0x7f50840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 -- 172.21.15.113:0/2709809369 shutdown_connections 2023-12-19T13:54:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.076+0000 7f50891b5640 1 -- 172.21.15.113:0/2709809369 wait complete. 2023-12-19T13:54:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.078+0000 7f50891b5640 1 Processor -- start 2023-12-19T13:54:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.078+0000 7f50891b5640 1 -- start start 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f50891b5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508406b590 0x7f50840cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f50891b5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50840b0b50 0x7f508413a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f50891b5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50841449e0 0x7f50840ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f50891b5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50840cecc0 con 0x7f50840b0b50 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f50891b5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50840ce3e0 con 0x7f508406b590 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f50891b5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50841e52a0 con 0x7f50841449e0 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f508259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50840b0b50 0x7f508413a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.079+0000 7f508259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50840b0b50 0x7f508413a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55832/0 (socket says 172.21.15.113:55832) 2023-12-19T13:54:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f508259c640 1 -- 172.21.15.113:0/1753920241 learned_addr learned my addr 172.21.15.113:0/1753920241 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f5082d9d640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508406b590 0x7f50840cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f508259c640 1 -- 172.21.15.113:0/1753920241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50841449e0 msgr2=0x7f50840ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f508259c640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50841449e0 0x7f50840ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f508259c640 1 -- 172.21.15.113:0/1753920241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508406b590 msgr2=0x7f50840cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f508259c640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508406b590 0x7f50840cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f508259c640 1 -- 172.21.15.113:0/1753920241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c009a70 con 0x7f50840b0b50 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f508259c640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50840b0b50 0x7f508413a8e0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f507800d800 tx=0x7f507800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.080+0000 7f506b7fe640 1 -- 172.21.15.113:0/1753920241 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507800b660 con 0x7f50840b0b50 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.081+0000 7f506b7fe640 1 -- 172.21.15.113:0/1753920241 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507800b7c0 con 0x7f50840b0b50 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.081+0000 7f506b7fe640 1 -- 172.21.15.113:0/1753920241 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507800bb50 con 0x7f50840b0b50 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.081+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50840ce9e0 con 0x7f50840b0b50 2023-12-19T13:54:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.081+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50841f6740 con 0x7f50840b0b50 2023-12-19T13:54:05.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.082+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5084061910 con 0x7f50840b0b50 2023-12-19T13:54:05.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.083+0000 7f506b7fe640 1 -- 172.21.15.113:0/1753920241 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f507800bcb0 con 0x7f50840b0b50 2023-12-19T13:54:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.084+0000 7f506b7fe640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f507006a430 0x7f507006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.084+0000 7f506b7fe640 1 -- 172.21.15.113:0/1753920241 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5078088ec0 con 0x7f50840b0b50 2023-12-19T13:54:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.084+0000 7f5082d9d640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f507006a430 0x7f507006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.085+0000 7f5082d9d640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f507006a430 0x7f507006c8f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5074000f60 tx=0x7f5074009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.088+0000 7f506b7fe640 1 -- 172.21.15.113:0/1753920241 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5078054410 con 0x7f50840b0b50 2023-12-19T13:54:05.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.278+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50840ae560 con 0x7f50840b0b50 2023-12-19T13:54:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.281+0000 7f506b7fe640 1 -- 172.21.15.113:0/1753920241 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f5078057a30 con 0x7f50840b0b50 2023-12-19T13:54:05.282 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:05.282 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":135,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:59.572069+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:05.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.283+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f507006a430 msgr2=0x7f507006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.283+0000 7f50891b5640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f507006a430 0x7f507006c8f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5074000f60 tx=0x7f5074009040 comp rx=0 tx=0).stop 2023-12-19T13:54:05.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.283+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50840b0b50 msgr2=0x7f508413a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.283+0000 7f50891b5640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50840b0b50 0x7f508413a8e0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f507800d800 tx=0x7f507800dcc0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 shutdown_connections 2023-12-19T13:54:05.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f507006a430 0x7f507006c8f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50841449e0 0x7f50840ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50840b0b50 0x7f508413a8e0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 --2- 172.21.15.113:0/1753920241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f508406b590 0x7f50840cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 >> 172.21.15.113:0/1753920241 conn(0x7f50840cbb70 msgr2=0x7f5084143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:05.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 shutdown_connections 2023-12-19T13:54:05.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.284+0000 7f50891b5640 1 -- 172.21.15.113:0/1753920241 wait complete. 2023-12-19T13:54:05.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:53:43.793689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:53:45.092859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:54:05.302 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:54:05.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.516+0000 7f0bc759e640 1 Processor -- start 2023-12-19T13:54:05.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.516+0000 7f0bc759e640 1 -- start start 2023-12-19T13:54:05.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.517+0000 7f0bc759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0bc806f8f0 0x7f0bc80d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc759e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc8070260 con 0x7f0bc8146cd0 2023-12-19T13:54:05.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc80b6ea0 con 0x7f0bc806f490 2023-12-19T13:54:05.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc81470b0 con 0x7f0bc806f8f0 2023-12-19T13:54:05.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0bc8146cd0 0x7f0bc80b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60146/0 (socket says 172.21.15.113:60146) 2023-12-19T13:54:05.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc659c640 1 -- 172.21.15.113:0/147522076 learned_addr learned my addr 172.21.15.113:0/147522076 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc6d9d640 1 --2- 172.21.15.113:0/147522076 >> v2:172.21.15.151:3300/0 conn(0x7f0bc806f8f0 0x7f0bc80d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614072156 0 0) 0x7f0bc8070260 con 0x7f0bc8146cd0 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.518+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb4003520 con 0x7f0bc8146cd0 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4093112478 0 0) 0x7f0bb4003520 con 0x7f0bc8146cd0 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 >> v2:172.21.15.151:3300/0 conn(0x7f0bc806f8f0 msgr2=0x7f0bc80d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 --2- 172.21.15.113:0/147522076 >> v2:172.21.15.151:3300/0 conn(0x7f0bc806f8f0 0x7f0bc80d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 >> v1:172.21.15.151:6789/0 conn(0x7f0bc806f490 legacy=0x7f0bc80d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80b7180 con 0x7f0bc8146cd0 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0bb80019f0 con 0x7f0bc8146cd0 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 >> v1:172.21.15.113:6789/0 conn(0x7f0bc8146cd0 legacy=0x7f0bc80b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb40039c0 0x7f0bb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb40051d0 0x7f0bb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc81470b0 con 0x7f0bb40047c0 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb400c120 con 0x7f0bb40039c0 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb400c2e0 con 0x7f0bb40051d0 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.519+0000 7f0bc5d9b640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.520+0000 7f0bc6d9d640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb40051d0 0x7f0bb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.520+0000 7f0bc5d9b640 1 -- 172.21.15.113:0/147522076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb40051d0 msgr2=0x7f0bb400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.520+0000 7f0bc5d9b640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb40051d0 0x7f0bb400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.520+0000 7f0bc5d9b640 1 -- 172.21.15.113:0/147522076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb40039c0 msgr2=0x7f0bb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:05.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.520+0000 7f0bc5d9b640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb40039c0 0x7f0bb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.520+0000 7f0bc5d9b640 1 -- 172.21.15.113:0/147522076 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4003520 con 0x7f0bb40047c0 2023-12-19T13:54:05.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.520+0000 7f0bc6d9d640 1 -- 172.21.15.113:0/147522076 reap_dead start 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.521+0000 7f0bc5d9b640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bb4004c40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0001720 tx=0x7f0bb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9546ca0a601495e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.521+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00052d0 con 0x7f0bb40047c0 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.521+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb002e050 con 0x7f0bb40047c0 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.521+0000 7f0bc559a640 1 -- 172.21.15.113:0/147522076 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0003830 con 0x7f0bb40047c0 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.522+0000 7f0bc759e640 1 -- 172.21.15.113:0/147522076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 msgr2=0x7f0bb4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.522+0000 7f0bc759e640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bb4004c40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0001720 tx=0x7f0bb40057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.522+0000 7f0bc759e640 1 -- 172.21.15.113:0/147522076 shutdown_connections 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.522+0000 7f0bc759e640 1 --2- 172.21.15.113:0/147522076 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bb4004c40 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.522+0000 7f0bc759e640 1 -- 172.21.15.113:0/147522076 >> 172.21.15.113:0/147522076 conn(0x7f0bc80d3200 msgr2=0x7f0bc80d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.522+0000 7f0bc759e640 1 -- 172.21.15.113:0/147522076 shutdown_connections 2023-12-19T13:54:05.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.522+0000 7f0bc759e640 1 -- 172.21.15.113:0/147522076 wait complete. 2023-12-19T13:54:05.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.524+0000 7f0bc759e640 1 Processor -- start 2023-12-19T13:54:05.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.524+0000 7f0bc759e640 1 -- start start 2023-12-19T13:54:05.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bc815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc81f6df0 0x7f0bc81f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bc81f6900 0x7f0bc813c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc759e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc815e380 con 0x7f0bb40047c0 2023-12-19T13:54:05.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc815e8d0 con 0x7f0bc81f6df0 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc8161380 con 0x7f0bc81f6900 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bc815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bc815da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55848/0 (socket says 172.21.15.113:55848) 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.525+0000 7f0bc659c640 1 -- 172.21.15.113:0/3913345705 learned_addr learned my addr 172.21.15.113:0/3913345705 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc659c640 1 -- 172.21.15.113:0/3913345705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bc81f6900 msgr2=0x7f0bc813c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc659c640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bc81f6900 0x7f0bc813c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc659c640 1 -- 172.21.15.113:0/3913345705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc81f6df0 msgr2=0x7f0bc81f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc659c640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc81f6df0 0x7f0bc81f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc659c640 1 -- 172.21.15.113:0/3913345705 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8161660 con 0x7f0bb40047c0 2023-12-19T13:54:05.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc659c640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bc815da10 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8002230 tx=0x7f0bb800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bbeffd640 1 -- 172.21.15.113:0/3913345705 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800a5c0 con 0x7f0bb40047c0 2023-12-19T13:54:05.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bbeffd640 1 -- 172.21.15.113:0/3913345705 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb800a720 con 0x7f0bb40047c0 2023-12-19T13:54:05.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bbeffd640 1 -- 172.21.15.113:0/3913345705 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800aab0 con 0x7f0bb40047c0 2023-12-19T13:54:05.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc815e560 con 0x7f0bb40047c0 2023-12-19T13:54:05.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.526+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc813eaa0 con 0x7f0bb40047c0 2023-12-19T13:54:05.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.527+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc804e160 con 0x7f0bb40047c0 2023-12-19T13:54:05.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.528+0000 7f0bbeffd640 1 -- 172.21.15.113:0/3913345705 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bb800ac10 con 0x7f0bb40047c0 2023-12-19T13:54:05.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.530+0000 7f0bbeffd640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0ba806a430 0x7f0ba806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.530+0000 7f0bbeffd640 1 -- 172.21.15.113:0/3913345705 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bb8088080 con 0x7f0bb40047c0 2023-12-19T13:54:05.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.530+0000 7f0bc5d9b640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0ba806a430 0x7f0ba806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.531+0000 7f0bc5d9b640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0ba806a430 0x7f0ba806c8f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0033000 tx=0x7f0bb002f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.534+0000 7f0bbeffd640 1 -- 172.21.15.113:0/3913345705 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0bb80bac80 con 0x7f0bb40047c0 2023-12-19T13:54:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.725+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bc81618a0 con 0x7f0bb40047c0 2023-12-19T13:54:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.726+0000 7f0bbeffd640 1 -- 172.21.15.113:0/3913345705 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bb8018020 con 0x7f0bb40047c0 2023-12-19T13:54:05.726 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:54:05.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.728+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0ba806a430 msgr2=0x7f0ba806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.728+0000 7f0bc759e640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0ba806a430 0x7f0ba806c8f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0033000 tx=0x7f0bb002f000 comp rx=0 tx=0).stop 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.728+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 msgr2=0x7f0bc815da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.728+0000 7f0bc759e640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bc815da10 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8002230 tx=0x7f0bb800cf00 comp rx=0 tx=0).stop 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 shutdown_connections 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0ba806a430 0x7f0ba806c8f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bc81f6900 0x7f0bc813c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bc81f6df0 0x7f0bc81f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 --2- 172.21.15.113:0/3913345705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0bb40047c0 0x7f0bc815da10 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 >> 172.21.15.113:0/3913345705 conn(0x7f0bc80d3200 msgr2=0x7f0bc80b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 shutdown_connections 2023-12-19T13:54:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.729+0000 7f0bc759e640 1 -- 172.21.15.113:0/3913345705 wait complete. 2023-12-19T13:54:05.749 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:54:05.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.957+0000 7f3038f39640 1 Processor -- start 2023-12-19T13:54:05.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.957+0000 7f3038f39640 1 -- start start 2023-12-19T13:54:05.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.959+0000 7f3038f39640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30341449e0 0x7f30340af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.959+0000 7f3038f39640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340afb10 con 0x7f303406c6b0 2023-12-19T13:54:05.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.959+0000 7f3038f39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303406bb30 con 0x7f30340b0b50 2023-12-19T13:54:05.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.959+0000 7f3038f39640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340b0070 con 0x7f30341449e0 2023-12-19T13:54:05.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3032d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f303406c6b0 0x7f30340b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60148/0 (socket says 172.21.15.113:60148) 2023-12-19T13:54:05.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3032d9d640 1 -- 172.21.15.113:0/613856512 learned_addr learned my addr 172.21.15.113:0/613856512 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f303259c640 1 --2- 172.21.15.113:0/613856512 >> v2:172.21.15.151:3300/0 conn(0x7f30341449e0 0x7f30340af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153409580 0 0) 0x7f30340afb10 con 0x7f303406c6b0 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3020003520 con 0x7f303406c6b0 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1166894231 0 0) 0x7f3020003520 con 0x7f303406c6b0 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 >> v2:172.21.15.151:3300/0 conn(0x7f30341449e0 msgr2=0x7f30340af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 --2- 172.21.15.113:0/613856512 >> v2:172.21.15.151:3300/0 conn(0x7f30341449e0 0x7f30340af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 >> v1:172.21.15.151:6789/0 conn(0x7f30340b0b50 legacy=0x7f303406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340b0350 con 0x7f303406c6b0 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.960+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f302c0019f0 con 0x7f303406c6b0 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 >> v1:172.21.15.113:6789/0 conn(0x7f303406c6b0 legacy=0x7f30340b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3031d9b640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3020003a30 0x7f3020003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3031d9b640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30200047c0 0x7f3020004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3031d9b640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f302000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b0070 con 0x7f30200051d0 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302000c100 con 0x7f3020003a30 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302000c2c0 con 0x7f30200047c0 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3032d9d640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f302000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f303259c640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3020003a30 0x7f3020003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3032d9d640 1 -- 172.21.15.113:0/613856512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30200047c0 msgr2=0x7f3020004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3032d9d640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30200047c0 0x7f3020004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3032d9d640 1 -- 172.21.15.113:0/613856512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3020003a30 msgr2=0x7f3020003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3032d9d640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3020003a30 0x7f3020003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.961+0000 7f3032d9d640 1 -- 172.21.15.113:0/613856512 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3020003520 con 0x7f30200051d0 2023-12-19T13:54:05.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.962+0000 7f3032d9d640 1 -- 172.21.15.113:0/613856512 reap_dead start 2023-12-19T13:54:05.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.962+0000 7f3032d9d640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f302000b980 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f302c00a760 tx=0x7f30200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3fc5df0cb21727 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c034630 con 0x7f30200051d0 2023-12-19T13:54:05.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c02f070 con 0x7f30200051d0 2023-12-19T13:54:05.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3031d9b640 1 -- 172.21.15.113:0/613856512 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0349f0 con 0x7f30200051d0 2023-12-19T13:54:05.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3038f39640 1 -- 172.21.15.113:0/613856512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 msgr2=0x7f302000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3038f39640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f302000b980 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f302c00a760 tx=0x7f30200057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3038f39640 1 -- 172.21.15.113:0/613856512 shutdown_connections 2023-12-19T13:54:05.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3038f39640 1 --2- 172.21.15.113:0/613856512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f302000b980 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3038f39640 1 -- 172.21.15.113:0/613856512 >> 172.21.15.113:0/613856512 conn(0x7f30340cbb70 msgr2=0x7f30340cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:05.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.963+0000 7f3038f39640 1 -- 172.21.15.113:0/613856512 shutdown_connections 2023-12-19T13:54:05.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.964+0000 7f3038f39640 1 -- 172.21.15.113:0/613856512 wait complete. 2023-12-19T13:54:05.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.965+0000 7f3038f39640 1 Processor -- start 2023-12-19T13:54:05.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.966+0000 7f3038f39640 1 -- start start 2023-12-19T13:54:05.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f3038f39640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f303415aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f3038f39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30340ccc80 0x7f30340cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f3038f39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30340cd100 0x7f30340cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f3038f39640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340ae2b0 con 0x7f30200051d0 2023-12-19T13:54:05.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f3038f39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034143f50 con 0x7f30340ccc80 2023-12-19T13:54:05.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f3038f39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340ad630 con 0x7f30340cd100 2023-12-19T13:54:05.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f303415aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f303415aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55862/0 (socket says 172.21.15.113:55862) 2023-12-19T13:54:05.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 -- 172.21.15.113:0/2190580718 learned_addr learned my addr 172.21.15.113:0/2190580718 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:05.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 -- 172.21.15.113:0/2190580718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30340cd100 msgr2=0x7f30340cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30340cd100 0x7f30340cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 -- 172.21.15.113:0/2190580718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30340ccc80 msgr2=0x7f30340cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30340ccc80 0x7f30340cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.967+0000 7f303259c640 1 -- 172.21.15.113:0/2190580718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340ad910 con 0x7f30200051d0 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.968+0000 7f303259c640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f303415aad0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f3024010860 tx=0x7f3024010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.968+0000 7f302affd640 1 -- 172.21.15.113:0/2190580718 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024009610 con 0x7f30200051d0 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.968+0000 7f302affd640 1 -- 172.21.15.113:0/2190580718 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400eb60 con 0x7f30200051d0 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.968+0000 7f302affd640 1 -- 172.21.15.113:0/2190580718 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302401c400 con 0x7f30200051d0 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.968+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340adbf0 con 0x7f30200051d0 2023-12-19T13:54:05.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.968+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303415b010 con 0x7f30200051d0 2023-12-19T13:54:05.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.969+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3034061910 con 0x7f30200051d0 2023-12-19T13:54:05.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.970+0000 7f302affd640 1 -- 172.21.15.113:0/2190580718 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f302401c560 con 0x7f30200051d0 2023-12-19T13:54:05.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.971+0000 7f302affd640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f301406a430 0x7f301406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:05.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.971+0000 7f302affd640 1 -- 172.21.15.113:0/2190580718 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3024088f20 con 0x7f30200051d0 2023-12-19T13:54:05.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.971+0000 7f302bfff640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f301406a430 0x7f301406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:05.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.972+0000 7f302bfff640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f301406a430 0x7f301406c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f30341443f0 tx=0x7f301c0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:05.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:05.975+0000 7f302affd640 1 -- 172.21.15.113:0/2190580718 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3024054520 con 0x7f30200051d0 2023-12-19T13:54:06.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.162+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30340ae560 con 0x7f30200051d0 2023-12-19T13:54:06.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.163+0000 7f302affd640 1 -- 172.21.15.113:0/2190580718 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3024057b40 con 0x7f30200051d0 2023-12-19T13:54:06.163 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f301406a430 msgr2=0x7f301406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f301406a430 0x7f301406c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f30341443f0 tx=0x7f301c0079d0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 msgr2=0x7f303415aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f303415aad0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f3024010860 tx=0x7f3024010d20 comp rx=0 tx=0).stop 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 shutdown_connections 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f301406a430 0x7f301406c8f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30340cd100 0x7f30340cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30340ccc80 0x7f30340cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 --2- 172.21.15.113:0/2190580718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30200051d0 0x7f303415aad0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.165+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 >> 172.21.15.113:0/2190580718 conn(0x7f30340cbb70 msgr2=0x7f303406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:06.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.166+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 shutdown_connections 2023-12-19T13:54:06.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.166+0000 7f3038f39640 1 -- 172.21.15.113:0/2190580718 wait complete. 2023-12-19T13:54:06.184 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:54:06.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.397+0000 7f06cf1c4640 1 Processor -- start 2023-12-19T13:54:06.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.398+0000 7f06cf1c4640 1 -- start start 2023-12-19T13:54:06.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.399+0000 7f06cf1c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 0x7f06c80afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.399+0000 7f06cf1c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80b2410 con 0x7f06c814b0b0 2023-12-19T13:54:06.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.399+0000 7f06cf1c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80b26f0 con 0x7f06c80b1e60 2023-12-19T13:54:06.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.399+0000 7f06cf1c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80ce030 con 0x7f06c814acd0 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd9c1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f06c814b0b0 0x7f06c80b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60164/0 (socket says 172.21.15.113:60164) 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd9c1640 1 -- 172.21.15.113:0/2617403424 learned_addr learned my addr 172.21.15.113:0/2617403424 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06ce1c2640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 0x7f06c80afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668588394 0 0) 0x7f06c80b2410 con 0x7f06c814b0b0 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06b4003520 con 0x7f06c814b0b0 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3912041515 0 0) 0x7f06b4003520 con 0x7f06c814b0b0 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 msgr2=0x7f06c80afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 0x7f06c80afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 >> v1:172.21.15.151:6789/0 conn(0x7f06c80b1e60 legacy=0x7f06c80ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80ce310 con 0x7f06c814b0b0 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f06b8001670 con 0x7f06c814b0b0 2023-12-19T13:54:06.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 >> v1:172.21.15.113:6789/0 conn(0x7f06c814b0b0 legacy=0x7f06c80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 0x7f06b40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.400+0000 7f06cd1c0640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4003f20 0x7f06b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06cd1c0640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80ce030 con 0x7f06b4004d00 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b400ba60 con 0x7f06b4003f20 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b400bc20 con 0x7f06c814acd0 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06ce9c3640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06cd9c1640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4003f20 0x7f06b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06ce1c2640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 0x7f06b40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06ce9c3640 1 -- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 msgr2=0x7f06b40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06ce9c3640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c814acd0 0x7f06b40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06ce9c3640 1 -- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4003f20 msgr2=0x7f06b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06ce9c3640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4003f20 0x7f06b40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.401+0000 7f06ce9c3640 1 -- 172.21.15.113:0/2617403424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b4003520 con 0x7f06b4004d00 2023-12-19T13:54:06.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.402+0000 7f06ce9c3640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001e50 tx=0x7f06b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367d27b34b7f0f94 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:06.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0003b70 con 0x7f06b4004d00 2023-12-19T13:54:06.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0003cd0 con 0x7f06b4004d00 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cd1c0640 1 -- 172.21.15.113:0/2617403424 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0005310 con 0x7f06b4004d00 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2617403424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 msgr2=0x7f06b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cf1c4640 1 --2- 172.21.15.113:0/2617403424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001e50 tx=0x7f06b40057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06ce9c3640 1 -- 172.21.15.113:0/2617403424 reap_dead start 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2617403424 shutdown_connections 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2617403424 >> 172.21.15.113:0/2617403424 conn(0x7f06c806f630 msgr2=0x7f06c806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2617403424 shutdown_connections 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.403+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2617403424 wait complete. 2023-12-19T13:54:06.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.405+0000 7f06cf1c4640 1 Processor -- start 2023-12-19T13:54:06.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.405+0000 7f06cf1c4640 1 -- start start 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.406+0000 7f06cf1c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06c80c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.406+0000 7f06cf1c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c8148620 0x7f06c81e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.406+0000 7f06cf1c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c81e8aa0 0x7f06c81ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.406+0000 7f06cf1c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80c7160 con 0x7f06b4004d00 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.406+0000 7f06cf1c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81e8f20 con 0x7f06c8148620 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.406+0000 7f06cf1c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80c4310 con 0x7f06c81e8aa0 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06c80c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06c80c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55888/0 (socket says 172.21.15.113:55888) 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 -- 172.21.15.113:0/2136085935 learned_addr learned my addr 172.21.15.113:0/2136085935 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce9c3640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c81e8aa0 0x7f06c81ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06cd9c1640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c8148620 0x7f06c81e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 -- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c81e8aa0 msgr2=0x7f06c81ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c81e8aa0 0x7f06c81ed2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 -- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c8148620 msgr2=0x7f06c81e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c8148620 0x7f06c81e8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 -- 172.21.15.113:0/2136085935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80c45f0 con 0x7f06b4004d00 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.407+0000 7f06ce1c2640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06c80c76d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f06c4011630 tx=0x7f06c4011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.408+0000 7f06beffd640 1 -- 172.21.15.113:0/2136085935 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400f8c0 con 0x7f06b4004d00 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.408+0000 7f06beffd640 1 -- 172.21.15.113:0/2136085935 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c400fa20 con 0x7f06b4004d00 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.408+0000 7f06beffd640 1 -- 172.21.15.113:0/2136085935 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400fd90 con 0x7f06b4004d00 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.408+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c80c48d0 con 0x7f06b4004d00 2023-12-19T13:54:06.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.408+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c80c4e90 con 0x7f06b4004d00 2023-12-19T13:54:06.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.409+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c8061910 con 0x7f06b4004d00 2023-12-19T13:54:06.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.410+0000 7f06beffd640 1 -- 172.21.15.113:0/2136085935 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06c4015460 con 0x7f06b4004d00 2023-12-19T13:54:06.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.411+0000 7f06beffd640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06ac06a430 0x7f06ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.411+0000 7f06beffd640 1 -- 172.21.15.113:0/2136085935 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06c4088e50 con 0x7f06b4004d00 2023-12-19T13:54:06.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.411+0000 7f06cd9c1640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06ac06a430 0x7f06ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.412+0000 7f06cd9c1640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06ac06a430 0x7f06ac06c8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f06b8001eb0 tx=0x7f06b8001d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:06.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.415+0000 7f06beffd640 1 -- 172.21.15.113:0/2136085935 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f06c40543a0 con 0x7f06b4004d00 2023-12-19T13:54:06.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.605+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06c80b0910 con 0x7f06b4004d00 2023-12-19T13:54:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.606+0000 7f06beffd640 1 -- 172.21.15.113:0/2136085935 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06c40579c0 con 0x7f06b4004d00 2023-12-19T13:54:06.607 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:54:06.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06ac06a430 msgr2=0x7f06ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06ac06a430 0x7f06ac06c8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f06b8001eb0 tx=0x7f06b8001d60 comp rx=0 tx=0).stop 2023-12-19T13:54:06.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 msgr2=0x7f06c80c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06c80c76d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f06c4011630 tx=0x7f06c4011af0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 shutdown_connections 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06ac06a430 0x7f06ac06c8f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c81e8aa0 0x7f06c81ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c8148620 0x7f06c81e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 --2- 172.21.15.113:0/2136085935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06b4004d00 0x7f06c80c76d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 >> 172.21.15.113:0/2136085935 conn(0x7f06c806f630 msgr2=0x7f06c80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 shutdown_connections 2023-12-19T13:54:06.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.609+0000 7f06cf1c4640 1 -- 172.21.15.113:0/2136085935 wait complete. 2023-12-19T13:54:06.628 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:54:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.829+0000 7f5f7f15c640 1 Processor -- start 2023-12-19T13:54:06.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.829+0000 7f5f7f15c640 1 -- start start 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f7f15c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5f780ae110 0x7f5f780b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f7f15c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5f780b0640 0x7f5f7806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f7f15c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f780b0a60 con 0x7f5f78157bf0 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f7f15c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7806b8c0 con 0x7f5f780ae110 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f7f15c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f780ae640 con 0x7f5f780b0640 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f7cef8640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5f78157bf0 0x7f5f7815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60174/0 (socket says 172.21.15.113:60174) 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f7cef8640 1 -- 172.21.15.113:0/4040752312 learned_addr learned my addr 172.21.15.113:0/4040752312 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.830+0000 7f5f77fff640 1 --2- 172.21.15.113:0/4040752312 >> v2:172.21.15.113:3300/0 conn(0x7f5f780ae110 0x7f5f780b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.831+0000 7f5f7d6f9640 1 --2- 172.21.15.113:0/4040752312 >> v2:172.21.15.151:3300/0 conn(0x7f5f780b0640 0x7f5f7806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.831+0000 7f5f77fff640 1 -- 172.21.15.113:0/4040752312 >> v2:172.21.15.151:3300/0 conn(0x7f5f780b0640 msgr2=0x7f5f7806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:06.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.831+0000 7f5f77fff640 1 --2- 172.21.15.113:0/4040752312 >> v2:172.21.15.151:3300/0 conn(0x7f5f780b0640 0x7f5f7806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.831+0000 7f5f77fff640 1 -- 172.21.15.113:0/4040752312 >> v1:172.21.15.113:6789/0 conn(0x7f5f78157bf0 legacy=0x7f5f7815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.831+0000 7f5f77fff640 1 -- 172.21.15.113:0/4040752312 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780ae920 con 0x7f5f780ae110 2023-12-19T13:54:06.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.832+0000 7f5f77fff640 1 --2- 172.21.15.113:0/4040752312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f780b0100 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5f780b1210 tx=0x7f5f6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1006d596a1461318 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:06.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.832+0000 7f5f777fe640 1 -- 172.21.15.113:0/4040752312 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64031830 con 0x7f5f780ae110 2023-12-19T13:54:06.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f777fe640 1 -- 172.21.15.113:0/4040752312 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f64031990 con 0x7f5f780ae110 2023-12-19T13:54:06.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f777fe640 1 -- 172.21.15.113:0/4040752312 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64031d20 con 0x7f5f780ae110 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 -- 172.21.15.113:0/4040752312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 msgr2=0x7f5f780b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/4040752312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f780b0100 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5f780b1210 tx=0x7f5f6402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 -- 172.21.15.113:0/4040752312 shutdown_connections 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/4040752312 >> v2:172.21.15.151:3300/0 conn(0x7f5f780b0640 0x7f5f7806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/4040752312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f780b0100 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 -- 172.21.15.113:0/4040752312 >> 172.21.15.113:0/4040752312 conn(0x7f5f780cbb70 msgr2=0x7f5f780cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 -- 172.21.15.113:0/4040752312 shutdown_connections 2023-12-19T13:54:06.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.833+0000 7f5f7f15c640 1 -- 172.21.15.113:0/4040752312 wait complete. 2023-12-19T13:54:06.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.835+0000 7f5f7f15c640 1 Processor -- start 2023-12-19T13:54:06.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.835+0000 7f5f7f15c640 1 -- start start 2023-12-19T13:54:06.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7f15c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f78152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7f15c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f780b0640 0x7f5f7815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7f15c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f78157bf0 0x7f5f7814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7f15c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7815a7f0 con 0x7f5f780ae110 2023-12-19T13:54:06.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7f15c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7815ad70 con 0x7f5f780b0640 2023-12-19T13:54:06.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7f15c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7815b740 con 0x7f5f78157bf0 2023-12-19T13:54:06.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7cef8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f78152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7cef8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f78152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55906/0 (socket says 172.21.15.113:55906) 2023-12-19T13:54:06.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.836+0000 7f5f7cef8640 1 -- 172.21.15.113:0/2903976556 learned_addr learned my addr 172.21.15.113:0/2903976556 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:06.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7cef8640 1 -- 172.21.15.113:0/2903976556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f78157bf0 msgr2=0x7f5f7814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7cef8640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f78157bf0 0x7f5f7814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7cef8640 1 -- 172.21.15.113:0/2903976556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f780b0640 msgr2=0x7f5f7815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7cef8640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f780b0640 0x7f5f7815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7cef8640 1 -- 172.21.15.113:0/2903976556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64009400 con 0x7f5f780ae110 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7cef8640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f78152200 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00c400 tx=0x7f5f6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f757fa640 1 -- 172.21.15.113:0/2903976556 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c005ce0 con 0x7f5f780ae110 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f757fa640 1 -- 172.21.15.113:0/2903976556 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c005e40 con 0x7f5f780ae110 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f781528c0 con 0x7f5f780ae110 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f757fa640 1 -- 172.21.15.113:0/2903976556 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0072d0 con 0x7f5f780ae110 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.837+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7815aa00 con 0x7f5f780ae110 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.838+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f78061910 con 0x7f5f780ae110 2023-12-19T13:54:06.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.839+0000 7f5f757fa640 1 -- 172.21.15.113:0/2903976556 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f6c0074f0 con 0x7f5f780ae110 2023-12-19T13:54:06.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.840+0000 7f5f757fa640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f5c06a430 0x7f5f5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:06.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.840+0000 7f5f757fa640 1 -- 172.21.15.113:0/2903976556 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f6c087ff0 con 0x7f5f780ae110 2023-12-19T13:54:06.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.840+0000 7f5f77fff640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f5c06a430 0x7f5f5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:06.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.841+0000 7f5f77fff640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f5c06a430 0x7f5f5c06c8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5f64036000 tx=0x7f5f64030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:06.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:06.844+0000 7f5f757fa640 1 -- 172.21.15.113:0/2903976556 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f6c053540 con 0x7f5f780ae110 2023-12-19T13:54:07.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.047+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f78157250 con 0x7f5f780ae110 2023-12-19T13:54:07.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.048+0000 7f5f757fa640 1 -- 172.21.15.113:0/2903976556 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v135) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5f6c017080 con 0x7f5f780ae110 2023-12-19T13:54:07.048 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f5c06a430 msgr2=0x7f5f5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f5c06a430 0x7f5f5c06c8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5f64036000 tx=0x7f5f64030000 comp rx=0 tx=0).stop 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 msgr2=0x7f5f78152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f78152200 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00c400 tx=0x7f5f6c00c8c0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 shutdown_connections 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f5c06a430 0x7f5f5c06c8f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f78157bf0 0x7f5f7814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f780b0640 0x7f5f7815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 --2- 172.21.15.113:0/2903976556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f780ae110 0x7f5f78152200 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 >> 172.21.15.113:0/2903976556 conn(0x7f5f780cbb70 msgr2=0x7f5f7815dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:07.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 shutdown_connections 2023-12-19T13:54:07.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.050+0000 7f5f7f15c640 1 -- 172.21.15.113:0/2903976556 wait complete. 2023-12-19T13:54:07.069 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:54:07.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:07.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:54:07.183 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:54:07.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:07.183 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:54:07.244 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:07.244 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:07.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:54:07.301 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:54:07.301 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:07.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:54:07.361 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:07.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.569+0000 7fc64a2e2640 1 Processor -- start 2023-12-19T13:54:07.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.570+0000 7fc64a2e2640 1 -- start start 2023-12-19T13:54:07.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.571+0000 7fc64a2e2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 0x7fc6440cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.571+0000 7fc64a2e2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc644161a20 0x7fc644070270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.571+0000 7fc64a2e2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6440cfc20 con 0x7fc6440cf7c0 2023-12-19T13:54:07.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.571+0000 7fc64a2e2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc644161e90 con 0x7fc644161a20 2023-12-19T13:54:07.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.571+0000 7fc64a2e2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6441620b0 con 0x7fc64415d490 2023-12-19T13:54:07.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.571+0000 7fc6437fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc6440cf7c0 0x7fc644161310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60182/0 (socket says 172.21.15.113:60182) 2023-12-19T13:54:07.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.571+0000 7fc6437fe640 1 -- 172.21.15.113:0/2259417757 learned_addr learned my addr 172.21.15.113:0/2259417757 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:07.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948071259 0 0) 0x7fc6440cfc20 con 0x7fc6440cf7c0 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc64887f640 1 --2- 172.21.15.113:0/2259417757 >> v2:172.21.15.151:3300/0 conn(0x7fc644161a20 0x7fc644070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc643fff640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 0x7fc6440cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc630003520 con 0x7fc6440cf7c0 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3397381599 0 0) 0x7fc630003520 con 0x7fc6440cf7c0 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 msgr2=0x7fc6440cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 0x7fc6440cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 >> v2:172.21.15.151:3300/0 conn(0x7fc644161a20 msgr2=0x7fc644070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 --2- 172.21.15.113:0/2259417757 >> v2:172.21.15.151:3300/0 conn(0x7fc644161a20 0x7fc644070270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64406d900 con 0x7fc6440cf7c0 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc62c001670 con 0x7fc6440cf7c0 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 >> v1:172.21.15.113:6789/0 conn(0x7fc6440cf7c0 legacy=0x7fc644161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 0x7fc6300039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630004010 0x7fc6300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc630004d00 0x7fc630005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc644161e90 con 0x7fc630004d00 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6441620b0 con 0x7fc630004010 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.572+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63000bb10 con 0x7fc64415d490 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc64887f640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc630004d00 0x7fc630005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc643fff640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 0x7fc6300039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc64887f640 1 -- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 msgr2=0x7fc6300039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc64887f640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc64415d490 0x7fc6300039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc6437fe640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630004010 0x7fc6300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc64887f640 1 -- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630004010 msgr2=0x7fc6300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc64887f640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630004010 0x7fc6300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc64887f640 1 -- 172.21.15.113:0/2259417757 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630003520 con 0x7fc630004d00 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.573+0000 7fc6437fe640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630004010 0x7fc6300047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.574+0000 7fc64887f640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc630004d00 0x7fc630005180 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00ba00 tx=0x7fc6300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dece053fd4486b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:07.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.574+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c032640 con 0x7fc630004d00 2023-12-19T13:54:07.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.574+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c0327a0 con 0x7fc630004d00 2023-12-19T13:54:07.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.574+0000 7fc642ffd640 1 -- 172.21.15.113:0/2259417757 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c032b30 con 0x7fc630004d00 2023-12-19T13:54:07.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.575+0000 7fc64a2e2640 1 -- 172.21.15.113:0/2259417757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc630004d00 msgr2=0x7fc630005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.575+0000 7fc64a2e2640 1 --2- 172.21.15.113:0/2259417757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc630004d00 0x7fc630005180 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00ba00 tx=0x7fc6300057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.575+0000 7fc64887f640 1 -- 172.21.15.113:0/2259417757 reap_dead start 2023-12-19T13:54:07.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.575+0000 7fc64a2e2640 1 -- 172.21.15.113:0/2259417757 shutdown_connections 2023-12-19T13:54:07.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.575+0000 7fc64a2e2640 1 -- 172.21.15.113:0/2259417757 >> 172.21.15.113:0/2259417757 conn(0x7fc64406a2e0 msgr2=0x7fc64406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.575+0000 7fc64a2e2640 1 -- 172.21.15.113:0/2259417757 shutdown_connections 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.575+0000 7fc64a2e2640 1 -- 172.21.15.113:0/2259417757 wait complete. 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.577+0000 7fc64a2e2640 1 Processor -- start 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.577+0000 7fc64a2e2640 1 -- start start 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc64a2e2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004d00 0x7fc644155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc64a2e2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6440cd3a0 0x7fc6440cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc64a2e2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6440b6880 0x7fc6440b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc64a2e2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64415e920 con 0x7fc6440cd3a0 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc64a2e2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440cde60 con 0x7fc6440b6880 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc64a2e2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440ce140 con 0x7fc630004d00 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc6437fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6440cd3a0 0x7fc6440cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc6437fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6440cd3a0 0x7fc6440cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55926/0 (socket says 172.21.15.113:55926) 2023-12-19T13:54:07.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc6437fe640 1 -- 172.21.15.113:0/1444590312 learned_addr learned my addr 172.21.15.113:0/1444590312 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:07.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc643fff640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004d00 0x7fc644155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc64887f640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6440b6880 0x7fc6440b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.578+0000 7fc6437fe640 1 -- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004d00 msgr2=0x7fc644155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc6437fe640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004d00 0x7fc644155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc6437fe640 1 -- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6440b6880 msgr2=0x7fc6440b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc6437fe640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6440b6880 0x7fc6440b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc6437fe640 1 -- 172.21.15.113:0/1444590312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64415eb70 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc6437fe640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6440cd3a0 0x7fc6440cd820 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0017a0 tx=0x7fc62c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc640ff9640 1 -- 172.21.15.113:0/1444590312 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0074e0 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc640ff9640 1 -- 172.21.15.113:0/1444590312 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c007640 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64415ee50 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc640ff9640 1 -- 172.21.15.113:0/1444590312 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0049e0 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.579+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64415c470 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.580+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc644061910 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.581+0000 7fc640ff9640 1 -- 172.21.15.113:0/1444590312 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc62c004b40 con 0x7fc6440cd3a0 2023-12-19T13:54:07.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.582+0000 7fc640ff9640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc62406a430 0x7fc62406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:07.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.583+0000 7fc640ff9640 1 -- 172.21.15.113:0/1444590312 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc62c0883f0 con 0x7fc6440cd3a0 2023-12-19T13:54:07.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.583+0000 7fc643fff640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc62406a430 0x7fc62406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:07.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.583+0000 7fc643fff640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc62406a430 0x7fc62406c8f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc6440d0c40 tx=0x7fc63400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:07.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.587+0000 7fc640ff9640 1 -- 172.21.15.113:0/1444590312 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc62c053940 con 0x7fc6440cd3a0 2023-12-19T13:54:07.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.798+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6440b31d0 con 0x7fc6440cd3a0 2023-12-19T13:54:07.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.799+0000 7fc640ff9640 1 -- 172.21.15.113:0/1444590312 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7fc62c05d020 con 0x7fc6440cd3a0 2023-12-19T13:54:07.800 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:07.800 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:54:07.800 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.801+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc62406a430 msgr2=0x7fc62406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.801+0000 7fc64a2e2640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc62406a430 0x7fc62406c8f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc6440d0c40 tx=0x7fc63400b040 comp rx=0 tx=0).stop 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.801+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6440cd3a0 msgr2=0x7fc6440cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.801+0000 7fc64a2e2640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6440cd3a0 0x7fc6440cd820 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0017a0 tx=0x7fc62c00dd40 comp rx=0 tx=0).stop 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 shutdown_connections 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc62406a430 0x7fc62406c8f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6440b6880 0x7fc6440b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6440cd3a0 0x7fc6440cd820 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 --2- 172.21.15.113:0/1444590312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004d00 0x7fc644155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 >> 172.21.15.113:0/1444590312 conn(0x7fc64406a2e0 msgr2=0x7fc644070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 shutdown_connections 2023-12-19T13:54:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:07.802+0000 7fc64a2e2640 1 -- 172.21.15.113:0/1444590312 wait complete. 2023-12-19T13:54:07.819 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:08.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.029+0000 7f78dd0ec640 1 Processor -- start 2023-12-19T13:54:08.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.029+0000 7f78dd0ec640 1 -- start start 2023-12-19T13:54:08.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78dd0ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 0x7f78d815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78dd0ec640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f78d80ae110 0x7f78d80b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78dd0ec640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d80b0a90 con 0x7f78d80b0640 2023-12-19T13:54:08.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78dd0ec640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d806b8c0 con 0x7f78d80ae110 2023-12-19T13:54:08.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78dd0ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d815b740 con 0x7f78d8157bf0 2023-12-19T13:54:08.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78d759e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f78d80b0640 0x7f78d815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43822/0 (socket says 172.21.15.113:43822) 2023-12-19T13:54:08.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78d759e640 1 -- 172.21.15.113:0/17211540 learned_addr learned my addr 172.21.15.113:0/17211540 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:08.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78d659c640 1 --2- 172.21.15.113:0/17211540 >> v2:172.21.15.151:3300/0 conn(0x7f78d80ae110 0x7f78d80b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276263562 0 0) 0x7f78d0001110 con 0x7f78d80b0640 2023-12-19T13:54:08.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78d6d9d640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 0x7f78d815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.030+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c4003520 con 0x7f78d80b0640 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2435433140 0 0) 0x7f78c4003520 con 0x7f78d80b0640 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 msgr2=0x7f78d815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 0x7f78d815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 >> v2:172.21.15.151:3300/0 conn(0x7f78d80ae110 msgr2=0x7f78d80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 --2- 172.21.15.113:0/17211540 >> v2:172.21.15.151:3300/0 conn(0x7f78d80ae110 0x7f78d80b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80ae640 con 0x7f78d80b0640 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f78d0001800 con 0x7f78d80b0640 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 >> v1:172.21.15.113:6789/0 conn(0x7f78d80b0640 legacy=0x7f78d815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 0x7f78c40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78c4004d00 0x7f78c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d806b8c0 con 0x7f78c4004010 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d815b740 con 0x7f78c4004d00 2023-12-19T13:54:08.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c400bb10 con 0x7f78d8157bf0 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d659c640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.031+0000 7f78d6d9d640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 0x7f78c40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.032+0000 7f78d659c640 1 -- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 msgr2=0x7f78c40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.032+0000 7f78d659c640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d8157bf0 0x7f78c40039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.032+0000 7f78d759e640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78c4004d00 0x7f78c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.032+0000 7f78d659c640 1 -- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78c4004d00 msgr2=0x7f78c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.032+0000 7f78d659c640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78c4004d00 0x7f78c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.032+0000 7f78d659c640 1 -- 172.21.15.113:0/17211540 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c4003520 con 0x7f78c4004010 2023-12-19T13:54:08.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.032+0000 7f78d759e640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78c4004d00 0x7f78c4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:08.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.033+0000 7f78d659c640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78c40047c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ae570 tx=0x7f78c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1535bbbca0d2ff6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.033+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0032620 con 0x7f78c4004010 2023-12-19T13:54:08.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.033+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0032780 con 0x7f78c4004010 2023-12-19T13:54:08.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.033+0000 7f78d5d9b640 1 -- 172.21.15.113:0/17211540 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0032b10 con 0x7f78c4004010 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.033+0000 7f78dd0ec640 1 -- 172.21.15.113:0/17211540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 msgr2=0x7f78c40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.033+0000 7f78dd0ec640 1 --2- 172.21.15.113:0/17211540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78c40047c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ae570 tx=0x7f78c40057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.033+0000 7f78d759e640 1 -- 172.21.15.113:0/17211540 reap_dead start 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.034+0000 7f78dd0ec640 1 -- 172.21.15.113:0/17211540 shutdown_connections 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.034+0000 7f78dd0ec640 1 -- 172.21.15.113:0/17211540 >> 172.21.15.113:0/17211540 conn(0x7f78d80cbb70 msgr2=0x7f78d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.034+0000 7f78dd0ec640 1 -- 172.21.15.113:0/17211540 shutdown_connections 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.034+0000 7f78dd0ec640 1 -- 172.21.15.113:0/17211540 wait complete. 2023-12-19T13:54:08.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.035+0000 7f78dd0ec640 1 Processor -- start 2023-12-19T13:54:08.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.036+0000 7f78dd0ec640 1 -- start start 2023-12-19T13:54:08.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.036+0000 7f78dd0ec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78d80aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.036+0000 7f78dd0ec640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78d80ab030 0x7f78d815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78dd0ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d815abf0 0x7f78d81f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78dd0ec640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d815b070 con 0x7f78c4004010 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78dd0ec640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80ab540 con 0x7f78d80ab030 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78dd0ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80a84a0 con 0x7f78d815abf0 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78d80aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78d80aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33830/0 (socket says 172.21.15.113:33830) 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 -- 172.21.15.113:0/3588701767 learned_addr learned my addr 172.21.15.113:0/3588701767 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d659c640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78d80ab030 0x7f78d815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d759e640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d815abf0 0x7f78d81f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 -- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d815abf0 msgr2=0x7f78d81f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d815abf0 0x7f78d81f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 -- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78d80ab030 msgr2=0x7f78d815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78d80ab030 0x7f78d815a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d6d9d640 1 -- 172.21.15.113:0/3588701767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80a8780 con 0x7f78c4004010 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.037+0000 7f78d659c640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78d80ab030 0x7f78d815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.038+0000 7f78d6d9d640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78d80aaaf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f78c8007e60 tx=0x7f78c800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.038+0000 7f78cf7fe640 1 -- 172.21.15.113:0/3588701767 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80145f0 con 0x7f78c4004010 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.038+0000 7f78cf7fe640 1 -- 172.21.15.113:0/3588701767 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c8014750 con 0x7f78c4004010 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.038+0000 7f78cf7fe640 1 -- 172.21.15.113:0/3588701767 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8014ae0 con 0x7f78c4004010 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.038+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d80a8a60 con 0x7f78c4004010 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.038+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d80ace10 con 0x7f78c4004010 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.039+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d8061910 con 0x7f78c4004010 2023-12-19T13:54:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.040+0000 7f78cf7fe640 1 -- 172.21.15.113:0/3588701767 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f78c8014c40 con 0x7f78c4004010 2023-12-19T13:54:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.041+0000 7f78cf7fe640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f78b806a460 0x7f78b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.041+0000 7f78cf7fe640 1 -- 172.21.15.113:0/3588701767 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78c8089650 con 0x7f78c4004010 2023-12-19T13:54:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.041+0000 7f78d659c640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f78b806a460 0x7f78b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.042+0000 7f78d659c640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f78b806a460 0x7f78b806c920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f78c40057a0 tx=0x7f78c003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.046+0000 7f78cf7fe640 1 -- 172.21.15.113:0/3588701767 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f78c8054ba0 con 0x7f78c4004010 2023-12-19T13:54:08.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.234+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78d806c510 con 0x7f78c4004010 2023-12-19T13:54:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.235+0000 7f78cf7fe640 1 -- 172.21.15.113:0/3588701767 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f78c80581c0 con 0x7f78c4004010 2023-12-19T13:54:08.236 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:08.236 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":135,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:59.572069+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f78b806a460 msgr2=0x7f78b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f78b806a460 0x7f78b806c920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f78c40057a0 tx=0x7f78c003d040 comp rx=0 tx=0).stop 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 msgr2=0x7f78d80aaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78d80aaaf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f78c8007e60 tx=0x7f78c800f520 comp rx=0 tx=0).stop 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 shutdown_connections 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f78b806a460 0x7f78b806c920 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78d815abf0 0x7f78d81f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78d80ab030 0x7f78d815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 --2- 172.21.15.113:0/3588701767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f78c4004010 0x7f78d80aaaf0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.238+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 >> 172.21.15.113:0/3588701767 conn(0x7f78d80cbb70 msgr2=0x7f78d80cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:08.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.239+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 shutdown_connections 2023-12-19T13:54:08.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.239+0000 7f78dd0ec640 1 -- 172.21.15.113:0/3588701767 wait complete. 2023-12-19T13:54:08.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:53:43.793689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:53:45.092859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:54:08.259 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:54:08.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.475+0000 7f6f36118640 1 Processor -- start 2023-12-19T13:54:08.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.475+0000 7f6f36118640 1 -- start start 2023-12-19T13:54:08.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f36118640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f300b2760 0x7f6f300b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f36118640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6f300ceea0 0x7f6f300cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f36118640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3015fde0 con 0x7f6f3015b1d0 2023-12-19T13:54:08.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f36118640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300b2400 con 0x7f6f300ceea0 2023-12-19T13:54:08.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f36118640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300cf870 con 0x7f6f300b2760 2023-12-19T13:54:08.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6f3015b1d0 0x7f6f3015f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43826/0 (socket says 172.21.15.113:43826) 2023-12-19T13:54:08.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2f7fe640 1 -- 172.21.15.113:0/2367094541 learned_addr learned my addr 172.21.15.113:0/2367094541 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:08.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2ffff640 1 --2- 172.21.15.113:0/2367094541 >> v2:172.21.15.113:3300/0 conn(0x7f6f300ceea0 0x7f6f300cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2effd640 1 --2- 172.21.15.113:0/2367094541 >> v2:172.21.15.151:3300/0 conn(0x7f6f300b2760 0x7f6f300b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2e7fc640 1 -- 172.21.15.113:0/2367094541 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500847524 0 0) 0x7f6f3015fde0 con 0x7f6f3015b1d0 2023-12-19T13:54:08.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2e7fc640 1 -- 172.21.15.113:0/2367094541 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f18003520 con 0x7f6f3015b1d0 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2ffff640 1 -- 172.21.15.113:0/2367094541 >> v2:172.21.15.151:3300/0 conn(0x7f6f300b2760 msgr2=0x7f6f300b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2ffff640 1 --2- 172.21.15.113:0/2367094541 >> v2:172.21.15.151:3300/0 conn(0x7f6f300b2760 0x7f6f300b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2ffff640 1 -- 172.21.15.113:0/2367094541 >> v1:172.21.15.113:6789/0 conn(0x7f6f3015b1d0 legacy=0x7f6f3015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.477+0000 7f6f2ffff640 1 -- 172.21.15.113:0/2367094541 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300b2bc0 con 0x7f6f300ceea0 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.478+0000 7f6f2ffff640 1 --2- 172.21.15.113:0/2367094541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300ceea0 0x7f6f300cf330 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6f30073a40 tx=0x7f6f2802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2a383d12ff9120 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.478+0000 7f6f2e7fc640 1 -- 172.21.15.113:0/2367094541 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2802cc70 con 0x7f6f300ceea0 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.478+0000 7f6f2e7fc640 1 -- 172.21.15.113:0/2367094541 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2802cdd0 con 0x7f6f300ceea0 2023-12-19T13:54:08.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.478+0000 7f6f2e7fc640 1 -- 172.21.15.113:0/2367094541 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28034660 con 0x7f6f300ceea0 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 -- 172.21.15.113:0/2367094541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300ceea0 msgr2=0x7f6f300cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 --2- 172.21.15.113:0/2367094541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300ceea0 0x7f6f300cf330 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6f30073a40 tx=0x7f6f2802bec0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 -- 172.21.15.113:0/2367094541 shutdown_connections 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 --2- 172.21.15.113:0/2367094541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300ceea0 0x7f6f300cf330 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 --2- 172.21.15.113:0/2367094541 >> v2:172.21.15.151:3300/0 conn(0x7f6f300b2760 0x7f6f300b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 -- 172.21.15.113:0/2367094541 >> 172.21.15.113:0/2367094541 conn(0x7f6f30073150 msgr2=0x7f6f300659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 -- 172.21.15.113:0/2367094541 shutdown_connections 2023-12-19T13:54:08.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.479+0000 7f6f36118640 1 -- 172.21.15.113:0/2367094541 wait complete. 2023-12-19T13:54:08.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.481+0000 7f6f36118640 1 Processor -- start 2023-12-19T13:54:08.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.481+0000 7f6f36118640 1 -- start start 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f36118640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300b2760 0x7f6f30157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f36118640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f300ceea0 0x7f6f30152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f36118640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3015b1d0 0x7f6f300cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f36118640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3015c640 con 0x7f6f300b2760 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f36118640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3015c310 con 0x7f6f300ceea0 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f36118640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cc9a0 con 0x7f6f3015b1d0 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f2f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300b2760 0x7f6f30157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f2f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300b2760 0x7f6f30157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33834/0 (socket says 172.21.15.113:33834) 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.482+0000 7f6f2f7fe640 1 -- 172.21.15.113:0/110795823 learned_addr learned my addr 172.21.15.113:0/110795823 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2effd640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f300ceea0 0x7f6f30152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2ffff640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3015b1d0 0x7f6f300cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2f7fe640 1 -- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3015b1d0 msgr2=0x7f6f300cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2f7fe640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3015b1d0 0x7f6f300cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2f7fe640 1 -- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f300ceea0 msgr2=0x7f6f30152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2f7fe640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f300ceea0 0x7f6f30152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2f7fe640 1 -- 172.21.15.113:0/110795823 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009a70 con 0x7f6f300b2760 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2effd640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f300ceea0 0x7f6f30152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f2f7fe640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300b2760 0x7f6f30157c60 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c440 tx=0x7f6f2000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f17fff640 1 -- 172.21.15.113:0/110795823 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20005ce0 con 0x7f6f300b2760 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f17fff640 1 -- 172.21.15.113:0/110795823 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20005e40 con 0x7f6f300b2760 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f300ccbd0 con 0x7f6f300b2760 2023-12-19T13:54:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f17fff640 1 -- 172.21.15.113:0/110795823 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200072b0 con 0x7f6f300b2760 2023-12-19T13:54:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.483+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f300cd190 con 0x7f6f300b2760 2023-12-19T13:54:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.485+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30061910 con 0x7f6f300b2760 2023-12-19T13:54:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.486+0000 7f6f17fff640 1 -- 172.21.15.113:0/110795823 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6f20007410 con 0x7f6f300b2760 2023-12-19T13:54:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.486+0000 7f6f17fff640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f1c06a430 0x7f6f1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.487+0000 7f6f17fff640 1 -- 172.21.15.113:0/110795823 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f20087ef0 con 0x7f6f300b2760 2023-12-19T13:54:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.487+0000 7f6f2effd640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f1c06a430 0x7f6f1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.487+0000 7f6f2effd640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f1c06a430 0x7f6f1c06c8f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6f300cc0e0 tx=0x7f6f24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.491+0000 7f6f17fff640 1 -- 172.21.15.113:0/110795823 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6f20053590 con 0x7f6f300b2760 2023-12-19T13:54:08.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.682+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f300cb2c0 con 0x7f6f300b2760 2023-12-19T13:54:08.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.683+0000 7f6f17fff640 1 -- 172.21.15.113:0/110795823 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f200170a0 con 0x7f6f300b2760 2023-12-19T13:54:08.683 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f1c06a430 msgr2=0x7f6f1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f1c06a430 0x7f6f1c06c8f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6f300cc0e0 tx=0x7f6f24008040 comp rx=0 tx=0).stop 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300b2760 msgr2=0x7f6f30157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300b2760 0x7f6f30157c60 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c440 tx=0x7f6f2000c900 comp rx=0 tx=0).stop 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 shutdown_connections 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6f1c06a430 0x7f6f1c06c8f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3015b1d0 0x7f6f300cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f300ceea0 0x7f6f30152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 --2- 172.21.15.113:0/110795823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f300b2760 0x7f6f30157c60 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 >> 172.21.15.113:0/110795823 conn(0x7f6f30073150 msgr2=0x7f6f301587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.685+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 shutdown_connections 2023-12-19T13:54:08.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.686+0000 7f6f36118640 1 -- 172.21.15.113:0/110795823 wait complete. 2023-12-19T13:54:08.704 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:54:08.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.923+0000 7fb96ac84640 1 Processor -- start 2023-12-19T13:54:08.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.923+0000 7fb96ac84640 1 -- start start 2023-12-19T13:54:08.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.924+0000 7fb96ac84640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb9641449e0 0x7fb9640af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.924+0000 7fb96ac84640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9640b0b50 0x7fb96406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.924+0000 7fb96ac84640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640afb10 con 0x7fb96406b590 2023-12-19T13:54:08.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.924+0000 7fb96ac84640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96406bb30 con 0x7fb9641449e0 2023-12-19T13:54:08.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.924+0000 7fb96ac84640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640b0070 con 0x7fb9640b0b50 2023-12-19T13:54:08.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb969221640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb96406b590 0x7fb96415eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43830/0 (socket says 172.21.15.113:43830) 2023-12-19T13:54:08.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb969221640 1 -- 172.21.15.113:0/4035822648 learned_addr learned my addr 172.21.15.113:0/4035822648 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:08.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb968a20640 1 --2- 172.21.15.113:0/4035822648 >> v2:172.21.15.151:3300/0 conn(0x7fb9641449e0 0x7fb9640af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb963fff640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9640b0b50 0x7fb96406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887233050 0 0) 0x7fb9640afb10 con 0x7fb96406b590 2023-12-19T13:54:08.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb954003520 con 0x7fb96406b590 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077783792 0 0) 0x7fb954003520 con 0x7fb96406b590 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9640b0b50 msgr2=0x7fb96406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.925+0000 7fb9637fe640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9640b0b50 0x7fb96406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 >> v2:172.21.15.151:3300/0 conn(0x7fb9641449e0 msgr2=0x7fb9640af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 --2- 172.21.15.113:0/4035822648 >> v2:172.21.15.151:3300/0 conn(0x7fb9641449e0 0x7fb9640af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640b0350 con 0x7fb96406b590 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb95c0019f0 con 0x7fb96406b590 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 >> v1:172.21.15.113:6789/0 conn(0x7fb96406b590 legacy=0x7fb96415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9540039e0 0x7fb954003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb954004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9640b0b50 0x7fb954005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96406bb30 con 0x7fb9540047c0 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640b0070 con 0x7fb9540039e0 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95400b980 con 0x7fb9640b0b50 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb963fff640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb954004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb963fff640 1 -- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9640b0b50 msgr2=0x7fb954005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb963fff640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9640b0b50 0x7fb954005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb963fff640 1 -- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9540039e0 msgr2=0x7fb954003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb963fff640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9540039e0 0x7fb954003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.926+0000 7fb963fff640 1 -- 172.21.15.113:0/4035822648 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb954003520 con 0x7fb9540047c0 2023-12-19T13:54:08.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.927+0000 7fb963fff640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb954004c40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb950009af0 tx=0x7fb9540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28251b8e98060d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95002c710 con 0x7fb9540047c0 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95002c870 con 0x7fb9540047c0 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb9637fe640 1 -- 172.21.15.113:0/4035822648 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95002cc00 con 0x7fb9540047c0 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb96ac84640 1 -- 172.21.15.113:0/4035822648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 msgr2=0x7fb954004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb96ac84640 1 --2- 172.21.15.113:0/4035822648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb954004c40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb950009af0 tx=0x7fb9540057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb969221640 1 -- 172.21.15.113:0/4035822648 reap_dead start 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb96ac84640 1 -- 172.21.15.113:0/4035822648 shutdown_connections 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.928+0000 7fb96ac84640 1 -- 172.21.15.113:0/4035822648 >> 172.21.15.113:0/4035822648 conn(0x7fb9640cbb70 msgr2=0x7fb9640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.929+0000 7fb96ac84640 1 -- 172.21.15.113:0/4035822648 shutdown_connections 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.929+0000 7fb96ac84640 1 -- 172.21.15.113:0/4035822648 wait complete. 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.930+0000 7fb96ac84640 1 Processor -- start 2023-12-19T13:54:08.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.930+0000 7fb96ac84640 1 -- start start 2023-12-19T13:54:08.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.931+0000 7fb96ac84640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb96413ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.931+0000 7fb96ac84640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96413a660 0x7fb96415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.931+0000 7fb96ac84640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9641417d0 0x7fb964141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.931+0000 7fb96ac84640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96413c830 con 0x7fb9540047c0 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.931+0000 7fb96ac84640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96413ae90 con 0x7fb96413a660 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.931+0000 7fb96ac84640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96413b170 con 0x7fb9641417d0 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb96413ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb96413ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33840/0 (socket says 172.21.15.113:33840) 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 -- 172.21.15.113:0/2618232668 learned_addr learned my addr 172.21.15.113:0/2618232668 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 -- 172.21.15.113:0/2618232668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9641417d0 msgr2=0x7fb964141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9641417d0 0x7fb964141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 -- 172.21.15.113:0/2618232668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96413a660 msgr2=0x7fb96415ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96413a660 0x7fb96415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 -- 172.21.15.113:0/2618232668 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96413b450 con 0x7fb9540047c0 2023-12-19T13:54:08.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb968a20640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb96413ff50 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e860 tx=0x7fb95800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.932+0000 7fb9617fa640 1 -- 172.21.15.113:0/2618232668 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958009600 con 0x7fb9540047c0 2023-12-19T13:54:08.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.933+0000 7fb9617fa640 1 -- 172.21.15.113:0/2618232668 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800c940 con 0x7fb9540047c0 2023-12-19T13:54:08.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.933+0000 7fb9617fa640 1 -- 172.21.15.113:0/2618232668 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800ccd0 con 0x7fb9540047c0 2023-12-19T13:54:08.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.933+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96413ca80 con 0x7fb9540047c0 2023-12-19T13:54:08.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.933+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96415b1d0 con 0x7fb9540047c0 2023-12-19T13:54:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.934+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb964061910 con 0x7fb9540047c0 2023-12-19T13:54:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.935+0000 7fb9617fa640 1 -- 172.21.15.113:0/2618232668 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb958013470 con 0x7fb9540047c0 2023-12-19T13:54:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.935+0000 7fb9617fa640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb94806a460 0x7fb94806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.936+0000 7fb9617fa640 1 -- 172.21.15.113:0/2618232668 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb958088b40 con 0x7fb9540047c0 2023-12-19T13:54:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.936+0000 7fb963fff640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb94806a460 0x7fb94806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:08.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.936+0000 7fb963fff640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb94806a460 0x7fb94806c920 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb950036000 tx=0x7fb95002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:08.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:08.940+0000 7fb9617fa640 1 -- 172.21.15.113:0/2618232668 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb958057bb0 con 0x7fb9540047c0 2023-12-19T13:54:09.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.128+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb964070f60 con 0x7fb9540047c0 2023-12-19T13:54:09.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.129+0000 7fb9617fa640 1 -- 172.21.15.113:0/2618232668 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb958057740 con 0x7fb9540047c0 2023-12-19T13:54:09.129 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:54:09.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.131+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb94806a460 msgr2=0x7fb94806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.131+0000 7fb96ac84640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb94806a460 0x7fb94806c920 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb950036000 tx=0x7fb95002e000 comp rx=0 tx=0).stop 2023-12-19T13:54:09.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.131+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 msgr2=0x7fb96413ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.131+0000 7fb96ac84640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb96413ff50 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e860 tx=0x7fb95800ed20 comp rx=0 tx=0).stop 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 shutdown_connections 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb94806a460 0x7fb94806c920 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9641417d0 0x7fb964141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb96413a660 0x7fb96415ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 --2- 172.21.15.113:0/2618232668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9540047c0 0x7fb96413ff50 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 >> 172.21.15.113:0/2618232668 conn(0x7fb9640cbb70 msgr2=0x7fb96406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 shutdown_connections 2023-12-19T13:54:09.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.132+0000 7fb96ac84640 1 -- 172.21.15.113:0/2618232668 wait complete. 2023-12-19T13:54:09.151 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:54:09.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.363+0000 7ff2273d0640 1 Processor -- start 2023-12-19T13:54:09.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.363+0000 7ff2273d0640 1 -- start start 2023-12-19T13:54:09.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.365+0000 7ff2273d0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff22015b1d0 0x7ff2200b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.365+0000 7ff2273d0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200b1ec0 0x7ff22015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.365+0000 7ff2273d0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22015ef10 con 0x7ff2200ceea0 2023-12-19T13:54:09.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.365+0000 7ff2273d0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2200b2320 con 0x7ff22015b1d0 2023-12-19T13:54:09.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.365+0000 7ff2273d0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200b2e40 con 0x7ff2200b1ec0 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22516c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff22015b1d0 0x7ff2200b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22516c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff22015b1d0 0x7ff2200b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33842/0 (socket says 172.21.15.113:33842) 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22516c640 1 -- 172.21.15.113:0/2862933420 learned_addr learned my addr 172.21.15.113:0/2862933420 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22496b640 1 --2- 172.21.15.113:0/2862933420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200b1ec0 0x7ff22015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22516c640 1 -- 172.21.15.113:0/2862933420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200b1ec0 msgr2=0x7ff22015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22516c640 1 --2- 172.21.15.113:0/2862933420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200b1ec0 0x7ff22015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22516c640 1 -- 172.21.15.113:0/2862933420 >> v1:172.21.15.151:6789/0 conn(0x7ff2200ceea0 legacy=0x7ff22006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.366+0000 7ff22516c640 1 -- 172.21.15.113:0/2862933420 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200b3120 con 0x7ff22015b1d0 2023-12-19T13:54:09.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.368+0000 7ff22516c640 1 --2- 172.21.15.113:0/2862933420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff22015b1d0 0x7ff2200b2760 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009870 tx=0x7ff21c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683e08bee069f762 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:09.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.368+0000 7ff213fff640 1 -- 172.21.15.113:0/2862933420 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c030840 con 0x7ff22015b1d0 2023-12-19T13:54:09.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.368+0000 7ff213fff640 1 -- 172.21.15.113:0/2862933420 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c0309a0 con 0x7ff22015b1d0 2023-12-19T13:54:09.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.368+0000 7ff213fff640 1 -- 172.21.15.113:0/2862933420 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c030d30 con 0x7ff22015b1d0 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 -- 172.21.15.113:0/2862933420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff22015b1d0 msgr2=0x7ff2200b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 --2- 172.21.15.113:0/2862933420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff22015b1d0 0x7ff2200b2760 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009870 tx=0x7ff21c02b980 comp rx=0 tx=0).stop 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 -- 172.21.15.113:0/2862933420 shutdown_connections 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 --2- 172.21.15.113:0/2862933420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200b1ec0 0x7ff22015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 --2- 172.21.15.113:0/2862933420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff22015b1d0 0x7ff2200b2760 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 -- 172.21.15.113:0/2862933420 >> 172.21.15.113:0/2862933420 conn(0x7ff220073150 msgr2=0x7ff2200659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 -- 172.21.15.113:0/2862933420 shutdown_connections 2023-12-19T13:54:09.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.369+0000 7ff2273d0640 1 -- 172.21.15.113:0/2862933420 wait complete. 2023-12-19T13:54:09.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.371+0000 7ff2273d0640 1 Processor -- start 2023-12-19T13:54:09.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.371+0000 7ff2273d0640 1 -- start start 2023-12-19T13:54:09.373 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff2273d0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2200b1ec0 0x7ff22015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.373 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff2273d0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200ceea0 0x7ff2201e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.373 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff2273d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff22015b1d0 0x7ff220156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff2273d0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201e8cf0 con 0x7ff2200b1ec0 2023-12-19T13:54:09.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff2273d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201566c0 con 0x7ff22015b1d0 2023-12-19T13:54:09.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff2273d0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22015bff0 con 0x7ff2200ceea0 2023-12-19T13:54:09.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff22516c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2200b1ec0 0x7ff22015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff22516c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2200b1ec0 0x7ff22015b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33856/0 (socket says 172.21.15.113:33856) 2023-12-19T13:54:09.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.372+0000 7ff22516c640 1 -- 172.21.15.113:0/375303953 learned_addr learned my addr 172.21.15.113:0/375303953 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:09.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff22516c640 1 -- 172.21.15.113:0/375303953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200ceea0 msgr2=0x7ff2201e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff22516c640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200ceea0 0x7ff2201e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff22516c640 1 -- 172.21.15.113:0/375303953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff22015b1d0 msgr2=0x7ff220156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff22516c640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff22015b1d0 0x7ff220156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff22516c640 1 -- 172.21.15.113:0/375303953 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0094d0 con 0x7ff2200b1ec0 2023-12-19T13:54:09.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff22516c640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2200b1ec0 0x7ff22015b8f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:09.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff211ffb640 1 -- 172.21.15.113:0/375303953 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c039a90 con 0x7ff2200b1ec0 2023-12-19T13:54:09.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff211ffb640 1 -- 172.21.15.113:0/375303953 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c039bf0 con 0x7ff2200b1ec0 2023-12-19T13:54:09.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff211ffb640 1 -- 172.21.15.113:0/375303953 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c043410 con 0x7ff2200b1ec0 2023-12-19T13:54:09.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22015c2d0 con 0x7ff2200b1ec0 2023-12-19T13:54:09.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.373+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22015c890 con 0x7ff2200b1ec0 2023-12-19T13:54:09.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.374+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff220061910 con 0x7ff2200b1ec0 2023-12-19T13:54:09.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.375+0000 7ff211ffb640 1 -- 172.21.15.113:0/375303953 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff21c02f390 con 0x7ff2200b1ec0 2023-12-19T13:54:09.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.376+0000 7ff211ffb640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a430 0x7ff20406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.376+0000 7ff211ffb640 1 -- 172.21.15.113:0/375303953 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff21c0aac00 con 0x7ff2200b1ec0 2023-12-19T13:54:09.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.376+0000 7ff22496b640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a430 0x7ff20406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.377+0000 7ff22496b640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a430 0x7ff20406c8f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff220157310 tx=0x7ff214008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:09.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.381+0000 7ff211ffb640 1 -- 172.21.15.113:0/375303953 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff21c076270 con 0x7ff2200b1ec0 2023-12-19T13:54:09.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.569+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2200cdc90 con 0x7ff2200b1ec0 2023-12-19T13:54:09.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.570+0000 7ff211ffb640 1 -- 172.21.15.113:0/375303953 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff21c0480a0 con 0x7ff2200b1ec0 2023-12-19T13:54:09.570 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:54:09.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a430 msgr2=0x7ff20406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a430 0x7ff20406c8f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff220157310 tx=0x7ff214008040 comp rx=0 tx=0).stop 2023-12-19T13:54:09.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2200b1ec0 msgr2=0x7ff22015b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2200b1ec0 0x7ff22015b8f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c004730 comp rx=0 tx=0).stop 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 shutdown_connections 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff20406a430 0x7ff20406c8f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff22015b1d0 0x7ff220156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2200ceea0 0x7ff2201e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 --2- 172.21.15.113:0/375303953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2200b1ec0 0x7ff22015b8f0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 >> 172.21.15.113:0/375303953 conn(0x7ff220073150 msgr2=0x7ff2200b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 shutdown_connections 2023-12-19T13:54:09.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.573+0000 7ff2273d0640 1 -- 172.21.15.113:0/375303953 wait complete. 2023-12-19T13:54:09.591 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:09.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.804+0000 7efe5c500640 1 Processor -- start 2023-12-19T13:54:09.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.804+0000 7efe5c500640 1 -- start start 2023-12-19T13:54:09.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.806+0000 7efe5c500640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efe540d2b00 0x7efe540d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.806+0000 7efe5c500640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540cd840 con 0x7efe540ce110 2023-12-19T13:54:09.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.806+0000 7efe5c500640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540b6e90 con 0x7efe54146e10 2023-12-19T13:54:09.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.806+0000 7efe5c500640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe540d2430 con 0x7efe540d2b00 2023-12-19T13:54:09.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5aa9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7efe540ce110 0x7efe540b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43844/0 (socket says 172.21.15.113:43844) 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5aa9d640 1 -- 172.21.15.113:0/2652413304 learned_addr learned my addr 172.21.15.113:0/2652413304 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe59a9b640 1 --2- 172.21.15.113:0/2652413304 >> v2:172.21.15.151:3300/0 conn(0x7efe540d2b00 0x7efe540d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253949350 0 0) 0x7efe540cd840 con 0x7efe540ce110 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe40003520 con 0x7efe540ce110 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 826418368 0 0) 0x7efe40003520 con 0x7efe540ce110 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 >> v2:172.21.15.151:3300/0 conn(0x7efe540d2b00 msgr2=0x7efe540d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 --2- 172.21.15.113:0/2652413304 >> v2:172.21.15.151:3300/0 conn(0x7efe540d2b00 0x7efe540d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 >> v1:172.21.15.151:6789/0 conn(0x7efe54146e10 legacy=0x7efe540b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540d2620 con 0x7efe540ce110 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.807+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7efe4c001670 con 0x7efe540ce110 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 >> v1:172.21.15.113:6789/0 conn(0x7efe540ce110 legacy=0x7efe540b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5929a640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40003a30 0x7efe40003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5929a640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe400047c0 0x7efe40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5929a640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4000c140 con 0x7efe400052a0 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4000c2b0 con 0x7efe400047c0 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4000c470 con 0x7efe40003a30 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5aa9d640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe59a9b640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe400047c0 0x7efe40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5a29c640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40003a30 0x7efe40003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5aa9d640 1 -- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40003a30 msgr2=0x7efe40003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5aa9d640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40003a30 0x7efe40003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5aa9d640 1 -- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe400047c0 msgr2=0x7efe40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5aa9d640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe400047c0 0x7efe40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.808+0000 7efe5aa9d640 1 -- 172.21.15.113:0/2652413304 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40003520 con 0x7efe400052a0 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.809+0000 7efe5aa9d640 1 -- 172.21.15.113:0/2652413304 reap_dead start 2023-12-19T13:54:09.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.809+0000 7efe5aa9d640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe4000b980 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c0e0 tx=0x7efe400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1684dcd4ff692d52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.810+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c005ad0 con 0x7efe400052a0 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.810+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c005c50 con 0x7efe400052a0 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.810+0000 7efe5929a640 1 -- 172.21.15.113:0/2652413304 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c02c810 con 0x7efe400052a0 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.810+0000 7efe5c500640 1 -- 172.21.15.113:0/2652413304 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 msgr2=0x7efe4000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.810+0000 7efe5c500640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe4000b980 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c0e0 tx=0x7efe400057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.810+0000 7efe5c500640 1 -- 172.21.15.113:0/2652413304 shutdown_connections 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.810+0000 7efe5c500640 1 --2- 172.21.15.113:0/2652413304 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe4000b980 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.811+0000 7efe5c500640 1 -- 172.21.15.113:0/2652413304 >> 172.21.15.113:0/2652413304 conn(0x7efe540b29c0 msgr2=0x7efe540b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.811+0000 7efe5c500640 1 -- 172.21.15.113:0/2652413304 shutdown_connections 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.811+0000 7efe5c500640 1 -- 172.21.15.113:0/2652413304 wait complete. 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.812+0000 7efe5c500640 1 Processor -- start 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.813+0000 7efe5c500640 1 -- start start 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.813+0000 7efe5c500640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe54159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.813+0000 7efe5c500640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe541542a0 0x7efe5413cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5c500640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe5415b710 0x7efe54155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5c500640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5413d440 con 0x7efe400052a0 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5c500640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe54154700 con 0x7efe5415b710 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5c500640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5415a390 con 0x7efe541542a0 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe54159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe54159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33862/0 (socket says 172.21.15.113:33862) 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 -- 172.21.15.113:0/4072695550 learned_addr learned my addr 172.21.15.113:0/4072695550 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe59a9b640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe541542a0 0x7efe5413cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5aa9d640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe5415b710 0x7efe54155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 -- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe541542a0 msgr2=0x7efe5413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe541542a0 0x7efe5413cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 -- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe5415b710 msgr2=0x7efe54155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe5415b710 0x7efe54155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.814+0000 7efe5a29c640 1 -- 172.21.15.113:0/4072695550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5415a670 con 0x7efe400052a0 2023-12-19T13:54:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.815+0000 7efe5a29c640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe54159e10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efe5000e8f0 tx=0x7efe5000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.815+0000 7efe4affd640 1 -- 172.21.15.113:0/4072695550 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50003b80 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.815+0000 7efe4affd640 1 -- 172.21.15.113:0/4072695550 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50003ce0 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.815+0000 7efe4affd640 1 -- 172.21.15.113:0/4072695550 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500052f0 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.815+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5415a950 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.815+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5415af10 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.816+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe54061910 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.817+0000 7efe4affd640 1 -- 172.21.15.113:0/4072695550 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe50005450 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.818+0000 7efe4affd640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe3806a460 0x7efe3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.818+0000 7efe4affd640 1 -- 172.21.15.113:0/4072695550 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe50088910 con 0x7efe400052a0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.818+0000 7efe59a9b640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe3806a460 0x7efe3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:09.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.819+0000 7efe59a9b640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe3806a460 0x7efe3806c920 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efe540b9510 tx=0x7efe44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:09.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:09.823+0000 7efe4affd640 1 -- 172.21.15.113:0/4072695550 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe50053f90 con 0x7efe400052a0 2023-12-19T13:54:10.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.048+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe540b6160 con 0x7efe400052a0 2023-12-19T13:54:10.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.049+0000 7efe4affd640 1 -- 172.21.15.113:0/4072695550 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7efe500575b0 con 0x7efe400052a0 2023-12-19T13:54:10.048 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:10.049 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:54:10.049 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:54:10.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.051+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe3806a460 msgr2=0x7efe3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.051+0000 7efe5c500640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe3806a460 0x7efe3806c920 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efe540b9510 tx=0x7efe44008040 comp rx=0 tx=0).stop 2023-12-19T13:54:10.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.051+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 msgr2=0x7efe54159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe54159e10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efe5000e8f0 tx=0x7efe5000edb0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 shutdown_connections 2023-12-19T13:54:10.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe3806a460 0x7efe3806c920 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe5415b710 0x7efe54155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe541542a0 0x7efe5413cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 --2- 172.21.15.113:0/4072695550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe400052a0 0x7efe54159e10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 >> 172.21.15.113:0/4072695550 conn(0x7efe540b29c0 msgr2=0x7efe54145aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:10.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 shutdown_connections 2023-12-19T13:54:10.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.052+0000 7efe5c500640 1 -- 172.21.15.113:0/4072695550 wait complete. 2023-12-19T13:54:10.071 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.276+0000 7fb435f77640 1 Processor -- start 2023-12-19T13:54:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.277+0000 7fb435f77640 1 -- start start 2023-12-19T13:54:10.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.278+0000 7fb435f77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 0x7fb43015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.278+0000 7fb435f77640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4300cdbf0 0x7fb4300ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.278+0000 7fb435f77640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43015ec30 con 0x7fb43015e5a0 2023-12-19T13:54:10.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.278+0000 7fb435f77640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4300ce5c0 con 0x7fb4300cdbf0 2023-12-19T13:54:10.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.278+0000 7fb435f77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43015fbc0 con 0x7fb4300b2030 2023-12-19T13:54:10.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb434f75640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb43015e5a0 0x7fb4300b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43846/0 (socket says 172.21.15.113:43846) 2023-12-19T13:54:10.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb434f75640 1 -- 172.21.15.113:0/3220017907 learned_addr learned my addr 172.21.15.113:0/3220017907 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159502852 0 0) 0x7fb43015ec30 con 0x7fb43015e5a0 2023-12-19T13:54:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb420003520 con 0x7fb43015e5a0 2023-12-19T13:54:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb435776640 1 --2- 172.21.15.113:0/3220017907 >> v2:172.21.15.151:3300/0 conn(0x7fb4300cdbf0 0x7fb4300ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42ffff640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 0x7fb43015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2708002676 0 0) 0x7fb420003520 con 0x7fb43015e5a0 2023-12-19T13:54:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 msgr2=0x7fb43015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 0x7fb43015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 >> v2:172.21.15.151:3300/0 conn(0x7fb4300cdbf0 msgr2=0x7fb4300ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 --2- 172.21.15.113:0/3220017907 >> v2:172.21.15.151:3300/0 conn(0x7fb4300cdbf0 0x7fb4300ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43015e980 con 0x7fb43015e5a0 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb424001670 con 0x7fb43015e5a0 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.279+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 >> v1:172.21.15.113:6789/0 conn(0x7fb43015e5a0 legacy=0x7fb4300b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42f7fe640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb420003970 0x7fb420003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42f7fe640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb420004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42f7fe640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 0x7fb420005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300ce5c0 con 0x7fb4200047c0 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43015fbc0 con 0x7fb420003970 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42000ba60 con 0x7fb4300b2030 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42ffff640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb420004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb434f75640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb420003970 0x7fb420003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb435776640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 0x7fb420005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42ffff640 1 -- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 msgr2=0x7fb420005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42ffff640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4300b2030 0x7fb420005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42ffff640 1 -- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb420003970 msgr2=0x7fb420003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42ffff640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb420003970 0x7fb420003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb42ffff640 1 -- 172.21.15.113:0/3220017907 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420003520 con 0x7fb4200047c0 2023-12-19T13:54:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.280+0000 7fb434f75640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb420003970 0x7fb420003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:10.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.281+0000 7fb42ffff640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb420004c40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00ba00 tx=0x7fb4200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e10e5b876708362 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:10.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0325f0 con 0x7fb4200047c0 2023-12-19T13:54:10.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c032750 con 0x7fb4200047c0 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb42f7fe640 1 -- 172.21.15.113:0/3220017907 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c032ae0 con 0x7fb4200047c0 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb435f77640 1 -- 172.21.15.113:0/3220017907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 msgr2=0x7fb420004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb435f77640 1 --2- 172.21.15.113:0/3220017907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb420004c40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00ba00 tx=0x7fb4200057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb435776640 1 -- 172.21.15.113:0/3220017907 reap_dead start 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb435f77640 1 -- 172.21.15.113:0/3220017907 shutdown_connections 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb435f77640 1 -- 172.21.15.113:0/3220017907 >> 172.21.15.113:0/3220017907 conn(0x7fb4300b0100 msgr2=0x7fb4300b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb435f77640 1 -- 172.21.15.113:0/3220017907 shutdown_connections 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.282+0000 7fb435f77640 1 -- 172.21.15.113:0/3220017907 wait complete. 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.284+0000 7fb435f77640 1 Processor -- start 2023-12-19T13:54:10.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.284+0000 7fb435f77640 1 -- start start 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.285+0000 7fb435f77640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb430146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.285+0000 7fb435f77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4300aca40 0x7fb4300acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.285+0000 7fb435f77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb430158e20 0x7fb4301592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.285+0000 7fb435f77640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301470e0 con 0x7fb4200047c0 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.285+0000 7fb435f77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301597e0 con 0x7fb4300aca40 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.285+0000 7fb435f77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300cc790 con 0x7fb430158e20 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb430146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb430146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33882/0 (socket says 172.21.15.113:33882) 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 -- 172.21.15.113:0/1773167751 learned_addr learned my addr 172.21.15.113:0/1773167751 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb435776640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb430158e20 0x7fb4301592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb42ffff640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4300aca40 0x7fb4300acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 -- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb430158e20 msgr2=0x7fb4301592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb430158e20 0x7fb4301592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 -- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4300aca40 msgr2=0x7fb4300acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4300aca40 0x7fb4300acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 -- 172.21.15.113:0/1773167751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300cca70 con 0x7fb4200047c0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.286+0000 7fb434f75640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb430146ba0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fb42400d8c0 tx=0x7fb42400dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.287+0000 7fb42d7fa640 1 -- 172.21.15.113:0/1773167751 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240074e0 con 0x7fb4200047c0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.287+0000 7fb42d7fa640 1 -- 172.21.15.113:0/1773167751 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424007640 con 0x7fb4200047c0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.287+0000 7fb42d7fa640 1 -- 172.21.15.113:0/1773167751 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240049e0 con 0x7fb4200047c0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.287+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4300ccd50 con 0x7fb4200047c0 2023-12-19T13:54:10.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.287+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4300cd310 con 0x7fb4200047c0 2023-12-19T13:54:10.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.288+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430061910 con 0x7fb4200047c0 2023-12-19T13:54:10.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.289+0000 7fb42d7fa640 1 -- 172.21.15.113:0/1773167751 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb424004b40 con 0x7fb4200047c0 2023-12-19T13:54:10.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.290+0000 7fb42d7fa640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb41406a430 0x7fb41406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.290+0000 7fb42d7fa640 1 -- 172.21.15.113:0/1773167751 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb424088260 con 0x7fb4200047c0 2023-12-19T13:54:10.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.290+0000 7fb42ffff640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb41406a430 0x7fb41406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.291+0000 7fb42ffff640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb41406a430 0x7fb41406c8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb4200057a0 tx=0x7fb41c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:10.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.294+0000 7fb42d7fa640 1 -- 172.21.15.113:0/1773167751 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb424053900 con 0x7fb4200047c0 2023-12-19T13:54:10.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.483+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4300ce980 con 0x7fb4200047c0 2023-12-19T13:54:10.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.486+0000 7fb42d7fa640 1 -- 172.21.15.113:0/1773167751 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16107 (secure 0 0 0) 0x7fb424056f20 con 0x7fb4200047c0 2023-12-19T13:54:10.486 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:10.486 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":135,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:59.572069+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:10.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb41406a430 msgr2=0x7fb41406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb41406a430 0x7fb41406c8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb4200057a0 tx=0x7fb41c030000 comp rx=0 tx=0).stop 2023-12-19T13:54:10.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 msgr2=0x7fb430146ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb430146ba0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fb42400d8c0 tx=0x7fb42400dd80 comp rx=0 tx=0).stop 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 shutdown_connections 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb41406a430 0x7fb41406c8f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb430158e20 0x7fb4301592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4300aca40 0x7fb4300acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 --2- 172.21.15.113:0/1773167751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4200047c0 0x7fb430146ba0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 >> 172.21.15.113:0/1773167751 conn(0x7fb4300b0100 msgr2=0x7fb4300cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 shutdown_connections 2023-12-19T13:54:10.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.489+0000 7fb435f77640 1 -- 172.21.15.113:0/1773167751 wait complete. 2023-12-19T13:54:10.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:54:10.508 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:10.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.722+0000 7f5f42fc4640 1 Processor -- start 2023-12-19T13:54:10.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.722+0000 7f5f42fc4640 1 -- start start 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.723+0000 7f5f42fc4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5f3c1449e0 0x7f5f3c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.723+0000 7f5f42fc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c0b0b50 0x7f5f3c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.723+0000 7f5f42fc4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c0afb10 con 0x7f5f3c06b590 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.723+0000 7f5f42fc4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c06bb30 con 0x7f5f3c1449e0 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.723+0000 7f5f42fc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b0070 con 0x7f5f3c0b0b50 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f40d60640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5f3c1449e0 0x7f5f3c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f41561640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5f3c06b590 0x7f5f3c15eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43848/0 (socket says 172.21.15.113:43848) 2023-12-19T13:54:10.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f41561640 1 -- 172.21.15.113:0/2431864762 learned_addr learned my addr 172.21.15.113:0/2431864762 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f3bfff640 1 --2- 172.21.15.113:0/2431864762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c0b0b50 0x7f5f3c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f40d60640 1 -- 172.21.15.113:0/2431864762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c0b0b50 msgr2=0x7f5f3c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f40d60640 1 --2- 172.21.15.113:0/2431864762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c0b0b50 0x7f5f3c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f40d60640 1 -- 172.21.15.113:0/2431864762 >> v1:172.21.15.113:6789/0 conn(0x7f5f3c06b590 legacy=0x7f5f3c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f40d60640 1 -- 172.21.15.113:0/2431864762 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0b0350 con 0x7f5f3c1449e0 2023-12-19T13:54:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f3b7fe640 1 -- 172.21.15.113:0/2431864762 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124900580 0 0) 0x7f5f3c0afb10 con 0x7f5f3c06b590 2023-12-19T13:54:10.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.724+0000 7f5f3bfff640 1 --2- 172.21.15.113:0/2431864762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c0b0b50 0x7f5f3c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:10.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.725+0000 7f5f40d60640 1 --2- 172.21.15.113:0/2431864762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c0af5d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3923c739d3748dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f3b7fe640 1 -- 172.21.15.113:0/2431864762 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3002d040 con 0x7f5f3c1449e0 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f3b7fe640 1 -- 172.21.15.113:0/2431864762 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30031810 con 0x7f5f3c1449e0 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f3b7fe640 1 -- 172.21.15.113:0/2431864762 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30031ba0 con 0x7f5f3c1449e0 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f42fc4640 1 -- 172.21.15.113:0/2431864762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 msgr2=0x7f5f3c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/2431864762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c0af5d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3002b8b0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f42fc4640 1 -- 172.21.15.113:0/2431864762 shutdown_connections 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/2431864762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c0b0b50 0x7f5f3c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/2431864762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c0af5d0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f42fc4640 1 -- 172.21.15.113:0/2431864762 >> 172.21.15.113:0/2431864762 conn(0x7f5f3c0cbb70 msgr2=0x7f5f3c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.726+0000 7f5f42fc4640 1 -- 172.21.15.113:0/2431864762 shutdown_connections 2023-12-19T13:54:10.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.727+0000 7f5f42fc4640 1 -- 172.21.15.113:0/2431864762 wait complete. 2023-12-19T13:54:10.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.728+0000 7f5f42fc4640 1 Processor -- start 2023-12-19T13:54:10.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.728+0000 7f5f42fc4640 1 -- start start 2023-12-19T13:54:10.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.729+0000 7f5f42fc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c06b590 0x7f5f3c0c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.729+0000 7f5f42fc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f3c0b0b50 0x7f5f3c070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.729+0000 7f5f42fc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.729+0000 7f5f42fc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0ac7c0 con 0x7f5f3c1449e0 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.729+0000 7f5f42fc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c3ea0 con 0x7f5f3c0b0b50 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.729+0000 7f5f42fc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c4180 con 0x7f5f3c06b590 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33906/0 (socket says 172.21.15.113:33906) 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 -- 172.21.15.113:0/3252465248 learned_addr learned my addr 172.21.15.113:0/3252465248 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f40d60640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c06b590 0x7f5f3c0c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f3bfff640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f3c0b0b50 0x7f5f3c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 -- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c06b590 msgr2=0x7f5f3c0c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c06b590 0x7f5f3c0c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 -- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f3c0b0b50 msgr2=0x7f5f3c070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f3c0b0b50 0x7f5f3c070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 -- 172.21.15.113:0/3252465248 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009400 con 0x7f5f3c1449e0 2023-12-19T13:54:10.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f3bfff640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f3c0b0b50 0x7f5f3c070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:10.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.730+0000 7f5f41561640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c1587d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c780 tx=0x7f5f3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:10.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.731+0000 7f5f397fa640 1 -- 172.21.15.113:0/3252465248 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400ce90 con 0x7f5f3c1449e0 2023-12-19T13:54:10.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.731+0000 7f5f397fa640 1 -- 172.21.15.113:0/3252465248 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400a640 con 0x7f5f3c1449e0 2023-12-19T13:54:10.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.731+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c0aca60 con 0x7f5f3c1449e0 2023-12-19T13:54:10.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.731+0000 7f5f397fa640 1 -- 172.21.15.113:0/3252465248 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400a9d0 con 0x7f5f3c1449e0 2023-12-19T13:54:10.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.731+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c1f0790 con 0x7f5f3c1449e0 2023-12-19T13:54:10.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.732+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c0c43a0 con 0x7f5f3c1449e0 2023-12-19T13:54:10.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.733+0000 7f5f397fa640 1 -- 172.21.15.113:0/3252465248 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f3400ab30 con 0x7f5f3c1449e0 2023-12-19T13:54:10.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.734+0000 7f5f397fa640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f2006a430 0x7f5f2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:10.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.734+0000 7f5f397fa640 1 -- 172.21.15.113:0/3252465248 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f34088170 con 0x7f5f3c1449e0 2023-12-19T13:54:10.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.734+0000 7f5f40d60640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f2006a430 0x7f5f2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:10.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.735+0000 7f5f40d60640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f2006a430 0x7f5f2006c8f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f30036000 tx=0x7f5f3003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:10.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.738+0000 7f5f397fa640 1 -- 172.21.15.113:0/3252465248 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f3c0c43a0 con 0x7f5f3c1449e0 2023-12-19T13:54:10.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.968+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f3c0acf80 con 0x7f5f3c1449e0 2023-12-19T13:54:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.970+0000 7f5f397fa640 1 -- 172.21.15.113:0/3252465248 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f5f3c0acf80 con 0x7f5f3c1449e0 2023-12-19T13:54:10.969 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:10.969 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:54:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f2006a430 msgr2=0x7f5f2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f2006a430 0x7f5f2006c8f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f30036000 tx=0x7f5f3003c040 comp rx=0 tx=0).stop 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 msgr2=0x7f5f3c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c1587d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c780 tx=0x7f5f3400cc40 comp rx=0 tx=0).stop 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 shutdown_connections 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5f2006a430 0x7f5f2006c8f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f3c1449e0 0x7f5f3c1587d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f3c0b0b50 0x7f5f3c070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.972+0000 7f5f42fc4640 1 --2- 172.21.15.113:0/3252465248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f3c06b590 0x7f5f3c0c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:10.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.973+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 >> 172.21.15.113:0/3252465248 conn(0x7f5f3c0cbb70 msgr2=0x7f5f3c15ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:10.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.973+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 shutdown_connections 2023-12-19T13:54:10.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:10.973+0000 7f5f42fc4640 1 -- 172.21.15.113:0/3252465248 wait complete. 2023-12-19T13:54:10.990 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:11.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.201+0000 7fc11c5c4640 1 Processor -- start 2023-12-19T13:54:11.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.202+0000 7fc11c5c4640 1 -- start start 2023-12-19T13:54:11.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.203+0000 7fc11c5c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc114146ef0 0x7fc1140ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.203+0000 7fc11c5c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1141618a0 0x7fc1140b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.203+0000 7fc11c5c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1140d2a50 con 0x7fc1140b6710 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.203+0000 7fc11c5c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1140cda90 con 0x7fc1141618a0 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.203+0000 7fc11c5c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1140cdca0 con 0x7fc114146ef0 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.203+0000 7fc11ab61640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1141618a0 0x7fc1140b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.204+0000 7fc11ab61640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1141618a0 0x7fc1140b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33922/0 (socket says 172.21.15.113:33922) 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.204+0000 7fc11ab61640 1 -- 172.21.15.113:0/958976713 learned_addr learned my addr 172.21.15.113:0/958976713 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:11.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.204+0000 7fc11a360640 1 --2- 172.21.15.113:0/958976713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc114146ef0 0x7fc1140ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.204+0000 7fc11ab61640 1 -- 172.21.15.113:0/958976713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc114146ef0 msgr2=0x7fc1140ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:11.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.204+0000 7fc11ab61640 1 --2- 172.21.15.113:0/958976713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc114146ef0 0x7fc1140ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.204+0000 7fc11ab61640 1 -- 172.21.15.113:0/958976713 >> v1:172.21.15.151:6789/0 conn(0x7fc1140b6710 legacy=0x7fc114161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:11.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.204+0000 7fc11ab61640 1 -- 172.21.15.113:0/958976713 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1140cdf80 con 0x7fc1141618a0 2023-12-19T13:54:11.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.205+0000 7fc11ab61640 1 --2- 172.21.15.113:0/958976713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1141618a0 0x7fc1140b4bc0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed3177c2e0d5703 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:11.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.205+0000 7fc11935e640 1 -- 172.21.15.113:0/958976713 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c031740 con 0x7fc1141618a0 2023-12-19T13:54:11.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11935e640 1 -- 172.21.15.113:0/958976713 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0318a0 con 0x7fc1141618a0 2023-12-19T13:54:11.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11935e640 1 -- 172.21.15.113:0/958976713 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c031c30 con 0x7fc1141618a0 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 -- 172.21.15.113:0/958976713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1141618a0 msgr2=0x7fc1140b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/958976713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1141618a0 0x7fc1140b4bc0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c02b7e0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 -- 172.21.15.113:0/958976713 shutdown_connections 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/958976713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1141618a0 0x7fc1140b4bc0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/958976713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc114146ef0 0x7fc1140ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 -- 172.21.15.113:0/958976713 >> 172.21.15.113:0/958976713 conn(0x7fc1140b29c0 msgr2=0x7fc1140b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 -- 172.21.15.113:0/958976713 shutdown_connections 2023-12-19T13:54:11.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.206+0000 7fc11c5c4640 1 -- 172.21.15.113:0/958976713 wait complete. 2023-12-19T13:54:11.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.208+0000 7fc11c5c4640 1 Processor -- start 2023-12-19T13:54:11.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.208+0000 7fc11c5c4640 1 -- start start 2023-12-19T13:54:11.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11c5c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1140b6710 0x7fc11415f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11c5c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc114146ef0 0x7fc1140b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11c5c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1141618a0 0x7fc11415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11c5c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1141f3a50 con 0x7fc1140b6710 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11c5c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1141f2ed0 con 0x7fc114146ef0 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11c5c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1141f31b0 con 0x7fc1141618a0 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11a360640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1140b6710 0x7fc11415f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11a360640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1140b6710 0x7fc11415f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33926/0 (socket says 172.21.15.113:33926) 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.209+0000 7fc11a360640 1 -- 172.21.15.113:0/3586871029 learned_addr learned my addr 172.21.15.113:0/3586871029 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc119b5f640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc114146ef0 0x7fc1140b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11ab61640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1141618a0 0x7fc11415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11a360640 1 -- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1141618a0 msgr2=0x7fc11415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11a360640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1141618a0 0x7fc11415b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11a360640 1 -- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc114146ef0 msgr2=0x7fc1140b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11a360640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc114146ef0 0x7fc1140b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11a360640 1 -- 172.21.15.113:0/3586871029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0094d0 con 0x7fc1140b6710 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc119b5f640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc114146ef0 0x7fc1140b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11a360640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1140b6710 0x7fc11415f660 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc10800ce10 tx=0x7fc10800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc112ffd640 1 -- 172.21.15.113:0/3586871029 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108003b90 con 0x7fc1140b6710 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc112ffd640 1 -- 172.21.15.113:0/3586871029 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108003cf0 con 0x7fc1140b6710 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc112ffd640 1 -- 172.21.15.113:0/3586871029 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108003ea0 con 0x7fc1140b6710 2023-12-19T13:54:11.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.210+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1141f3490 con 0x7fc1140b6710 2023-12-19T13:54:11.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.211+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11415fba0 con 0x7fc1140b6710 2023-12-19T13:54:11.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.212+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc114061910 con 0x7fc1140b6710 2023-12-19T13:54:11.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.213+0000 7fc112ffd640 1 -- 172.21.15.113:0/3586871029 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc108004240 con 0x7fc1140b6710 2023-12-19T13:54:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.214+0000 7fc112ffd640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f806a430 0x7fc0f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.214+0000 7fc112ffd640 1 -- 172.21.15.113:0/3586871029 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc108012070 con 0x7fc1140b6710 2023-12-19T13:54:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.214+0000 7fc119b5f640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f806a430 0x7fc0f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.215+0000 7fc119b5f640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f806a430 0x7fc0f806c8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc1140708f0 tx=0x7fc100009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.218+0000 7fc112ffd640 1 -- 172.21.15.113:0/3586871029 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc1080549a0 con 0x7fc1140b6710 2023-12-19T13:54:11.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.444+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc114140ff0 con 0x7fc1140b6710 2023-12-19T13:54:11.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.446+0000 7fc112ffd640 1 -- 172.21.15.113:0/3586871029 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4659 (secure 0 0 0) 0x7fc108057fc0 con 0x7fc1140b6710 2023-12-19T13:54:11.446 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:11.446 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:53:46.069612+0000","modified":"2023-12-19T13:53:49.096615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6836/2259732918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2259732918},{"type":"v1","addr":"172.21.15.113:6836","nonce":2259732918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T13:54:11.446 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 57 2023-12-19T13:54:11.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.448+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f806a430 msgr2=0x7fc0f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.448+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f806a430 0x7fc0f806c8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc1140708f0 tx=0x7fc100009040 comp rx=0 tx=0).stop 2023-12-19T13:54:11.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.448+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1140b6710 msgr2=0x7fc11415f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.448+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1140b6710 0x7fc11415f660 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc10800ce10 tx=0x7fc10800a660 comp rx=0 tx=0).stop 2023-12-19T13:54:11.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 shutdown_connections 2023-12-19T13:54:11.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc0f806a430 0x7fc0f806c8f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1141618a0 0x7fc11415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc114146ef0 0x7fc1140b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 --2- 172.21.15.113:0/3586871029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1140b6710 0x7fc11415f660 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 >> 172.21.15.113:0/3586871029 conn(0x7fc1140b29c0 msgr2=0x7fc1140b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:11.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 shutdown_connections 2023-12-19T13:54:11.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.449+0000 7fc11c5c4640 1 -- 172.21.15.113:0/3586871029 wait complete. 2023-12-19T13:54:11.468 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:11.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.680+0000 7f7d3bfff640 1 Processor -- start 2023-12-19T13:54:11.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.680+0000 7f7d3bfff640 1 -- start start 2023-12-19T13:54:11.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7d3c0b8070 0x7f7d3c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3bfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7d3c0d0a90 0x7f7d3c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c0d12d0 con 0x7f7d3c146e30 2023-12-19T13:54:11.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3c147210 con 0x7f7d3c0b8070 2023-12-19T13:54:11.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3bfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3c0d2370 con 0x7f7d3c0d0a90 2023-12-19T13:54:11.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d327fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7d3c0b8070 0x7f7d3c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7d3c146e30 0x7f7d3c0b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43858/0 (socket says 172.21.15.113:43858) 2023-12-19T13:54:11.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3affd640 1 -- 172.21.15.113:0/361931051 learned_addr learned my addr 172.21.15.113:0/361931051 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:11.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d327fc640 1 -- 172.21.15.113:0/361931051 >> v2:172.21.15.151:3300/0 conn(0x7f7d3c0d0a90 msgr2=0x7f7d3c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:11.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d327fc640 1 --2- 172.21.15.113:0/361931051 >> v2:172.21.15.151:3300/0 conn(0x7f7d3c0d0a90 0x7f7d3c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d327fc640 1 -- 172.21.15.113:0/361931051 >> v1:172.21.15.113:6789/0 conn(0x7f7d3c146e30 legacy=0x7f7d3c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d327fc640 1 -- 172.21.15.113:0/361931051 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0d15b0 con 0x7f7d3c0b8070 2023-12-19T13:54:11.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.682+0000 7f7d3a7fc640 1 -- 172.21.15.113:0/361931051 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390496086 0 0) 0x7f7d3c0d12d0 con 0x7f7d3c146e30 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.683+0000 7f7d327fc640 1 --2- 172.21.15.113:0/361931051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c0b8070 0x7f7d3c0d0550 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c071060 tx=0x7f7d2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d3c24f35a7a235 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3a7fc640 1 -- 172.21.15.113:0/361931051 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2402e070 con 0x7f7d3c0b8070 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3a7fc640 1 -- 172.21.15.113:0/361931051 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d240315a0 con 0x7f7d3c0b8070 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3a7fc640 1 -- 172.21.15.113:0/361931051 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24031930 con 0x7f7d3c0b8070 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 -- 172.21.15.113:0/361931051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c0b8070 msgr2=0x7f7d3c0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/361931051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c0b8070 0x7f7d3c0d0550 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c071060 tx=0x7f7d2402b840 comp rx=0 tx=0).stop 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 -- 172.21.15.113:0/361931051 shutdown_connections 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/361931051 >> v2:172.21.15.151:3300/0 conn(0x7f7d3c0d0a90 0x7f7d3c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/361931051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c0b8070 0x7f7d3c0d0550 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 -- 172.21.15.113:0/361931051 >> 172.21.15.113:0/361931051 conn(0x7f7d3c0b2990 msgr2=0x7f7d3c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 -- 172.21.15.113:0/361931051 shutdown_connections 2023-12-19T13:54:11.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.684+0000 7f7d3bfff640 1 -- 172.21.15.113:0/361931051 wait complete. 2023-12-19T13:54:11.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.686+0000 7f7d3bfff640 1 Processor -- start 2023-12-19T13:54:11.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.686+0000 7f7d3bfff640 1 -- start start 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d3c0b8070 0x7f7d3c0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d3c0d0a90 0x7f7d3c0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c146e30 0x7f7d3c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3bfff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c1f6f30 con 0x7f7d3c146e30 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c1f60d0 con 0x7f7d3c0d0a90 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c1f6320 con 0x7f7d3c0b8070 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c146e30 0x7f7d3c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c146e30 0x7f7d3c0b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33940/0 (socket says 172.21.15.113:33940) 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.687+0000 7f7d3b7fe640 1 -- 172.21.15.113:0/4063106406 learned_addr learned my addr 172.21.15.113:0/4063106406 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d327fc640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d3c0d0a90 0x7f7d3c0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3affd640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d3c0b8070 0x7f7d3c0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3b7fe640 1 -- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d3c0b8070 msgr2=0x7f7d3c0b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3b7fe640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d3c0b8070 0x7f7d3c0b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3b7fe640 1 -- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d3c0d0a90 msgr2=0x7f7d3c0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3b7fe640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d3c0d0a90 0x7f7d3c0b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3b7fe640 1 -- 172.21.15.113:0/4063106406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24009400 con 0x7f7d3c146e30 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d327fc640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d3c0d0a90 0x7f7d3c0b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3b7fe640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c146e30 0x7f7d3c0b6160 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400b970 tx=0x7f7d3400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d38ff9640 1 -- 172.21.15.113:0/4063106406 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400cb40 con 0x7f7d3c146e30 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d38ff9640 1 -- 172.21.15.113:0/4063106406 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400ccc0 con 0x7f7d3c146e30 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3c1f6600 con 0x7f7d3c146e30 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d38ff9640 1 -- 172.21.15.113:0/4063106406 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34014680 con 0x7f7d3c146e30 2023-12-19T13:54:11.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.688+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3c1f6bc0 con 0x7f7d3c146e30 2023-12-19T13:54:11.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.689+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3c1f2b30 con 0x7f7d3c146e30 2023-12-19T13:54:11.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.690+0000 7f7d38ff9640 1 -- 172.21.15.113:0/4063106406 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d3401d3b0 con 0x7f7d3c146e30 2023-12-19T13:54:11.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.691+0000 7f7d38ff9640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1c06a460 0x7f7d1c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:11.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.691+0000 7f7d38ff9640 1 -- 172.21.15.113:0/4063106406 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d34088870 con 0x7f7d3c146e30 2023-12-19T13:54:11.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.691+0000 7f7d3affd640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1c06a460 0x7f7d1c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:11.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.692+0000 7f7d3affd640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1c06a460 0x7f7d1c06c920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c000f60 tx=0x7f7d2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:11.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.695+0000 7f7d38ff9640 1 -- 172.21.15.113:0/4063106406 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7d34053e50 con 0x7f7d3c146e30 2023-12-19T13:54:11.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.885+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d3c061910 con 0x7f7d3c146e30 2023-12-19T13:54:11.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.888+0000 7f7d38ff9640 1 -- 172.21.15.113:0/4063106406 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f7d34019090 con 0x7f7d3c146e30 2023-12-19T13:54:11.887 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:11.887 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":135,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:53:59.572069+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:53:43.793689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T13:53:45.092859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:11.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.890+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1c06a460 msgr2=0x7f7d1c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.890+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1c06a460 0x7f7d1c06c920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c000f60 tx=0x7f7d2c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:11.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c146e30 msgr2=0x7f7d3c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:11.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c146e30 0x7f7d3c0b6160 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400b970 tx=0x7f7d3400be30 comp rx=0 tx=0).stop 2023-12-19T13:54:11.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 shutdown_connections 2023-12-19T13:54:11.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7d1c06a460 0x7f7d1c06c920 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d3c146e30 0x7f7d3c0b6160 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d3c0d0a90 0x7f7d3c0b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 --2- 172.21.15.113:0/4063106406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d3c0b8070 0x7f7d3c0b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:11.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 >> 172.21.15.113:0/4063106406 conn(0x7f7d3c0b2990 msgr2=0x7f7d3c1e40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:11.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 shutdown_connections 2023-12-19T13:54:11.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:11.891+0000 7f7d3bfff640 1 -- 172.21.15.113:0/4063106406 wait complete. 2023-12-19T13:54:11.910 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:54:12.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.124+0000 7f4bc16ca640 1 Processor -- start 2023-12-19T13:54:12.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.124+0000 7f4bc16ca640 1 -- start start 2023-12-19T13:54:12.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.126+0000 7f4bc16ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc146e10 0x7f4bbc0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.126+0000 7f4bc16ca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4bbc0d2b00 0x7f4bbc0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.126+0000 7f4bc16ca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4bbc0ce110 0x7f4bbc0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.126+0000 7f4bc16ca640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc0d2430 con 0x7f4bbc0d2b00 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.126+0000 7f4bc16ca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc0ceae0 con 0x7f4bbc0ce110 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.126+0000 7f4bc16ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0cd840 con 0x7f4bbc146e10 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4bbc0d2b00 0x7f4bbc0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4bbc0d2b00 0x7f4bbc0b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33956/0 (socket says 172.21.15.113:33956) 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 -- 172.21.15.113:0/661006908 learned_addr learned my addr 172.21.15.113:0/661006908 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bbb7fe640 1 --2- 172.21.15.113:0/661006908 >> v2:172.21.15.151:3300/0 conn(0x7f4bbc0ce110 0x7f4bbc0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bbaffd640 1 --2- 172.21.15.113:0/661006908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc146e10 0x7f4bbc0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 -- 172.21.15.113:0/661006908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc146e10 msgr2=0x7f4bbc0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 --2- 172.21.15.113:0/661006908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc146e10 0x7f4bbc0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 -- 172.21.15.113:0/661006908 >> v2:172.21.15.151:3300/0 conn(0x7f4bbc0ce110 msgr2=0x7f4bbc0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:12.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 --2- 172.21.15.113:0/661006908 >> v2:172.21.15.151:3300/0 conn(0x7f4bbc0ce110 0x7f4bbc0ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bb27fc640 1 -- 172.21.15.113:0/661006908 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc0d2620 con 0x7f4bbc0d2b00 2023-12-19T13:54:12.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bbaffd640 1 --2- 172.21.15.113:0/661006908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc146e10 0x7f4bbc0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:12.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.127+0000 7f4bbb7fe640 1 --2- 172.21.15.113:0/661006908 >> v2:172.21.15.151:3300/0 conn(0x7f4bbc0ce110 0x7f4bbc0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:12.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.128+0000 7f4bb27fc640 1 --2- 172.21.15.113:0/661006908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0d2b00 0x7f4bbc0b6780 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0d3360 tx=0x7f4ba402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444754403cbc6722 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:12.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bba7fc640 1 -- 172.21.15.113:0/661006908 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4031640 con 0x7f4bbc0d2b00 2023-12-19T13:54:12.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bba7fc640 1 -- 172.21.15.113:0/661006908 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba40317a0 con 0x7f4bbc0d2b00 2023-12-19T13:54:12.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bba7fc640 1 -- 172.21.15.113:0/661006908 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4031b30 con 0x7f4bbc0d2b00 2023-12-19T13:54:12.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 -- 172.21.15.113:0/661006908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0d2b00 msgr2=0x7f4bbc0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/661006908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0d2b00 0x7f4bbc0b6780 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0d3360 tx=0x7f4ba402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 -- 172.21.15.113:0/661006908 shutdown_connections 2023-12-19T13:54:12.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/661006908 >> v2:172.21.15.151:3300/0 conn(0x7f4bbc0ce110 0x7f4bbc0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/661006908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0d2b00 0x7f4bbc0b6780 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/661006908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc146e10 0x7f4bbc0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 -- 172.21.15.113:0/661006908 >> 172.21.15.113:0/661006908 conn(0x7f4bbc0b29c0 msgr2=0x7f4bbc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:12.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 -- 172.21.15.113:0/661006908 shutdown_connections 2023-12-19T13:54:12.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.129+0000 7f4bc16ca640 1 -- 172.21.15.113:0/661006908 wait complete. 2023-12-19T13:54:12.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.131+0000 7f4bc16ca640 1 Processor -- start 2023-12-19T13:54:12.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.131+0000 7f4bc16ca640 1 -- start start 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bc16ca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0ce110 0x7f4bbc156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bc16ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc0d2b00 0x7f4bbc1f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bc16ca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bbc146e10 0x7f4bbc13f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bc16ca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1f36f0 con 0x7f4bbc0ce110 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bc16ca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0b8cb0 con 0x7f4bbc146e10 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bc16ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc13fcf0 con 0x7f4bbc0d2b00 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bbaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0ce110 0x7f4bbc156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bbaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0ce110 0x7f4bbc156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33966/0 (socket says 172.21.15.113:33966) 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.132+0000 7f4bbaffd640 1 -- 172.21.15.113:0/4204445548 learned_addr learned my addr 172.21.15.113:0/4204445548 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:12.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bbaffd640 1 -- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc0d2b00 msgr2=0x7f4bbc1f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bb27fc640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc0d2b00 0x7f4bbc1f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bbb7fe640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bbc146e10 0x7f4bbc13f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bbaffd640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc0d2b00 0x7f4bbc1f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bbaffd640 1 -- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bbc146e10 msgr2=0x7f4bbc13f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bbaffd640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bbc146e10 0x7f4bbc13f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bbaffd640 1 -- 172.21.15.113:0/4204445548 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba40094d0 con 0x7f4bbc0ce110 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bbaffd640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0ce110 0x7f4bbc156020 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c820 tx=0x7f4bac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bb3fff640 1 -- 172.21.15.113:0/4204445548 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac007a30 con 0x7f4bbc0ce110 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bb3fff640 1 -- 172.21.15.113:0/4204445548 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac007b90 con 0x7f4bbc0ce110 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bb3fff640 1 -- 172.21.15.113:0/4204445548 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00ce10 con 0x7f4bbc0ce110 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc1566e0 con 0x7f4bbc0ce110 2023-12-19T13:54:12.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.133+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc1580d0 con 0x7f4bbc0ce110 2023-12-19T13:54:12.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.135+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc061910 con 0x7f4bbc0ce110 2023-12-19T13:54:12.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.135+0000 7f4bb3fff640 1 -- 172.21.15.113:0/4204445548 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4bac0113f0 con 0x7f4bbc0ce110 2023-12-19T13:54:12.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.136+0000 7f4bb3fff640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b9c06a430 0x7f4b9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.136+0000 7f4bb3fff640 1 -- 172.21.15.113:0/4204445548 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bac088a10 con 0x7f4bbc0ce110 2023-12-19T13:54:12.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.136+0000 7f4bb27fc640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b9c06a430 0x7f4b9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.137+0000 7f4bb27fc640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b9c06a430 0x7f4b9c06c8f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4036000 tx=0x7f4ba403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:12.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.140+0000 7f4bb3fff640 1 -- 172.21.15.113:0/4204445548 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4bac053ff0 con 0x7f4bbc0ce110 2023-12-19T13:54:12.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.366+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4bbc06f580 con 0x7f4bbc0ce110 2023-12-19T13:54:12.368 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:54:12.369+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:54:12.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.389+0000 7f4bb3fff640 1 -- 172.21.15.113:0/4204445548 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4bac057610 con 0x7f4bbc0ce110 2023-12-19T13:54:12.389 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:54:12.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b9c06a430 msgr2=0x7f4b9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b9c06a430 0x7f4b9c06c8f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4036000 tx=0x7f4ba403c040 comp rx=0 tx=0).stop 2023-12-19T13:54:12.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0ce110 msgr2=0x7f4bbc156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0ce110 0x7f4bbc156020 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c820 tx=0x7f4bac00cce0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 shutdown_connections 2023-12-19T13:54:12.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4b9c06a430 0x7f4b9c06c8f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bbc146e10 0x7f4bbc13f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bbc0d2b00 0x7f4bbc1f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 --2- 172.21.15.113:0/4204445548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bbc0ce110 0x7f4bbc156020 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 >> 172.21.15.113:0/4204445548 conn(0x7f4bbc0b29c0 msgr2=0x7f4bbc1406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:12.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 shutdown_connections 2023-12-19T13:54:12.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.392+0000 7f4bc16ca640 1 -- 172.21.15.113:0/4204445548 wait complete. 2023-12-19T13:54:12.412 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:54:12.425 INFO:tasks.ceph.mds.a.smithi113.stderr: -4863> 2023-12-19T13:53:50.770+0000 7f208b683640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:54:12.487 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:54:12.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.617+0000 7fe6a4fc9640 1 Processor -- start 2023-12-19T13:54:12.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.617+0000 7fe6a4fc9640 1 -- start start 2023-12-19T13:54:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.618+0000 7fe6a4fc9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6a00adf00 0x7fe6a00c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.618+0000 7fe6a4fc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 0x7fe6a00aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.618+0000 7fe6a4fc9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a00b1dd0 con 0x7fe6a00b1610 2023-12-19T13:54:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.618+0000 7fe6a4fc9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a015bd00 con 0x7fe6a00adf00 2023-12-19T13:54:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.618+0000 7fe6a4fc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00b20b0 con 0x7fe6a00ae9c0 2023-12-19T13:54:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69dd9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe6a00b1610 0x7fe6a015c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43872/0 (socket says 172.21.15.113:43872) 2023-12-19T13:54:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69dd9b640 1 -- 172.21.15.113:0/3249517693 learned_addr learned my addr 172.21.15.113:0/3249517693 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:12.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69ed9d640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 0x7fe6a00aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767905121 0 0) 0x7fe6a00b1dd0 con 0x7fe6a00b1610 2023-12-19T13:54:12.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69e59c640 1 --2- 172.21.15.113:0/3249517693 >> v2:172.21.15.151:3300/0 conn(0x7fe6a00adf00 0x7fe6a00c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe688003520 con 0x7fe6a00b1610 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471076405 0 0) 0x7fe688003520 con 0x7fe6a00b1610 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 msgr2=0x7fe6a00aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.619+0000 7fe69d59a640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 0x7fe6a00aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 >> v2:172.21.15.151:3300/0 conn(0x7fe6a00adf00 msgr2=0x7fe6a00c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 --2- 172.21.15.113:0/3249517693 >> v2:172.21.15.151:3300/0 conn(0x7fe6a00adf00 0x7fe6a00c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a00b2390 con 0x7fe6a00b1610 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe694001670 con 0x7fe6a00b1610 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 >> v1:172.21.15.113:6789/0 conn(0x7fe6a00b1610 legacy=0x7fe6a015c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6880039e0 0x7fe688003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 0x7fe6880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe688005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a015bd00 con 0x7fe688004d00 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00b20b0 con 0x7fe6880039e0 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68800bab0 con 0x7fe6a00ae9c0 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69ed9d640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe688005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69dd9b640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 0x7fe6880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69ed9d640 1 -- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 msgr2=0x7fe6880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69ed9d640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ae9c0 0x7fe6880047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69ed9d640 1 -- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6880039e0 msgr2=0x7fe688003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.620+0000 7fe69e59c640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6880039e0 0x7fe688003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.621+0000 7fe69ed9d640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6880039e0 0x7fe688003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.621+0000 7fe69ed9d640 1 -- 172.21.15.113:0/3249517693 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688003520 con 0x7fe688004d00 2023-12-19T13:54:12.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.622+0000 7fe69ed9d640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe688005180 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe69800ba00 tx=0x7fe6880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb2074c1b3429a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:12.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.622+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698032620 con 0x7fe688004d00 2023-12-19T13:54:12.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.622+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe698032780 con 0x7fe688004d00 2023-12-19T13:54:12.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.622+0000 7fe69d59a640 1 -- 172.21.15.113:0/3249517693 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698032b10 con 0x7fe688004d00 2023-12-19T13:54:12.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.622+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/3249517693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 msgr2=0x7fe688005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.622+0000 7fe6a4fc9640 1 --2- 172.21.15.113:0/3249517693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe688005180 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe69800ba00 tx=0x7fe6880057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.622+0000 7fe69ed9d640 1 -- 172.21.15.113:0/3249517693 reap_dead start 2023-12-19T13:54:12.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.623+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/3249517693 shutdown_connections 2023-12-19T13:54:12.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.623+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/3249517693 >> 172.21.15.113:0/3249517693 conn(0x7fe6a0066160 msgr2=0x7fe6a00cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:12.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.623+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/3249517693 shutdown_connections 2023-12-19T13:54:12.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.623+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/3249517693 wait complete. 2023-12-19T13:54:12.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.624+0000 7fe6a4fc9640 1 Processor -- start 2023-12-19T13:54:12.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.625+0000 7fe6a4fc9640 1 -- start start 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.625+0000 7fe6a4fc9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe6a0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe6a4fc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ccc20 0x7fe6a00c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe6a4fc9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a00c30d0 0x7fe6a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe6a4fc9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a01f3f50 con 0x7fe688004d00 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe6a4fc9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a01f33d0 con 0x7fe6a00c30d0 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe6a4fc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a01f36b0 con 0x7fe6a00ccc20 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe6a0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe6a0157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34008/0 (socket says 172.21.15.113:34008) 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 -- 172.21.15.113:0/1903777387 learned_addr learned my addr 172.21.15.113:0/1903777387 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 -- 172.21.15.113:0/1903777387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ccc20 msgr2=0x7fe6a00c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ccc20 0x7fe6a00c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 -- 172.21.15.113:0/1903777387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a00c30d0 msgr2=0x7fe6a006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a00c30d0 0x7fe6a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.626+0000 7fe69e59c640 1 -- 172.21.15.113:0/1903777387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a01f3990 con 0x7fe688004d00 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.627+0000 7fe69e59c640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe6a0157b70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe690007ef0 tx=0x7fe69000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.627+0000 7fe68effd640 1 -- 172.21.15.113:0/1903777387 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69000fee0 con 0x7fe688004d00 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.627+0000 7fe68effd640 1 -- 172.21.15.113:0/1903777387 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6900145f0 con 0x7fe688004d00 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.627+0000 7fe68effd640 1 -- 172.21.15.113:0/1903777387 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690014980 con 0x7fe688004d00 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.627+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a01f3c70 con 0x7fe688004d00 2023-12-19T13:54:12.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.627+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a01f2f80 con 0x7fe688004d00 2023-12-19T13:54:12.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.628+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a0061910 con 0x7fe688004d00 2023-12-19T13:54:12.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.629+0000 7fe68effd640 1 -- 172.21.15.113:0/1903777387 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe690014ae0 con 0x7fe688004d00 2023-12-19T13:54:12.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.631+0000 7fe68effd640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe68006a430 0x7fe68006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:12.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.631+0000 7fe68effd640 1 -- 172.21.15.113:0/1903777387 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe6900897e0 con 0x7fe688004d00 2023-12-19T13:54:12.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.631+0000 7fe69dd9b640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe68006a430 0x7fe68006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:12.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.632+0000 7fe69dd9b640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe68006a430 0x7fe68006c8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe694000ff0 tx=0x7fe694009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:12.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.635+0000 7fe68effd640 1 -- 172.21.15.113:0/1903777387 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe690054cd0 con 0x7fe688004d00 2023-12-19T13:54:12.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:12.862+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe6a006bb90 con 0x7fe688004d00 2023-12-19T13:54:13.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.397+0000 7fe68effd640 1 -- 172.21.15.113:0/1903777387 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe6900582f0 con 0x7fe688004d00 2023-12-19T13:54:13.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.401+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe68006a430 msgr2=0x7fe68006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:13.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.401+0000 7fe6a4fc9640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe68006a430 0x7fe68006c8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe694000ff0 tx=0x7fe694009040 comp rx=0 tx=0).stop 2023-12-19T13:54:13.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.401+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 msgr2=0x7fe6a0157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:13.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.401+0000 7fe6a4fc9640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe6a0157b70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe690007ef0 tx=0x7fe69000f520 comp rx=0 tx=0).stop 2023-12-19T13:54:13.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 shutdown_connections 2023-12-19T13:54:13.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe68006a430 0x7fe68006c8f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a00c30d0 0x7fe6a006d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00ccc20 0x7fe6a00c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 --2- 172.21.15.113:0/1903777387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe688004d00 0x7fe6a0157b70 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 >> 172.21.15.113:0/1903777387 conn(0x7fe6a0066160 msgr2=0x7fe6a0158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:13.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 shutdown_connections 2023-12-19T13:54:13.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.402+0000 7fe6a4fc9640 1 -- 172.21.15.113:0/1903777387 wait complete. 2023-12-19T13:54:13.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:54:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.639+0000 7f3012817640 1 Processor -- start 2023-12-19T13:54:13.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.639+0000 7f3012817640 1 -- start start 2023-12-19T13:54:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.640+0000 7f3012817640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f300c15a000 0x7f300c15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.640+0000 7f3012817640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f300c0cbca0 0x7f300c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.640+0000 7f3012817640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300c15ec00 con 0x7f300c0b1dc0 2023-12-19T13:54:13.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.641+0000 7f3012817640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300c071c60 con 0x7f300c0cbca0 2023-12-19T13:54:13.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.641+0000 7f3012817640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300c0b2230 con 0x7f300c15a000 2023-12-19T13:54:13.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.641+0000 7f3003fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f300c0cbca0 0x7f300c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:13.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.641+0000 7f3003fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f300c0cbca0 0x7f300c0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34012/0 (socket says 172.21.15.113:34012) 2023-12-19T13:54:13.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.641+0000 7f3003fff640 1 -- 172.21.15.113:0/1286704725 learned_addr learned my addr 172.21.15.113:0/1286704725 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:13.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.641+0000 7f300bfff640 1 --2- 172.21.15.113:0/1286704725 >> v2:172.21.15.151:3300/0 conn(0x7f300c15a000 0x7f300c15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:13.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.642+0000 7f3003fff640 1 -- 172.21.15.113:0/1286704725 >> v2:172.21.15.151:3300/0 conn(0x7f300c15a000 msgr2=0x7f300c15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.642+0000 7f3003fff640 1 --2- 172.21.15.113:0/1286704725 >> v2:172.21.15.151:3300/0 conn(0x7f300c15a000 0x7f300c15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.642+0000 7f3003fff640 1 -- 172.21.15.113:0/1286704725 >> v1:172.21.15.151:6789/0 conn(0x7f300c0b1dc0 legacy=0x7f300c06b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.642+0000 7f3003fff640 1 -- 172.21.15.113:0/1286704725 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c070bc0 con 0x7f300c0cbca0 2023-12-19T13:54:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.643+0000 7f3003fff640 1 --2- 172.21.15.113:0/1286704725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c0cbca0 0x7f300c0b1880 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f300c06f7a0 tx=0x7f2ff402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb84493b85bfe4e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:13.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.643+0000 7f300b7fe640 1 -- 172.21.15.113:0/1286704725 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4030860 con 0x7f300c0cbca0 2023-12-19T13:54:13.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.643+0000 7f300b7fe640 1 -- 172.21.15.113:0/1286704725 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff40309c0 con 0x7f300c0cbca0 2023-12-19T13:54:13.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.643+0000 7f300b7fe640 1 -- 172.21.15.113:0/1286704725 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4030d50 con 0x7f300c0cbca0 2023-12-19T13:54:13.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 -- 172.21.15.113:0/1286704725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c0cbca0 msgr2=0x7f300c0b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:13.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 --2- 172.21.15.113:0/1286704725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c0cbca0 0x7f300c0b1880 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f300c06f7a0 tx=0x7f2ff402b9a0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 -- 172.21.15.113:0/1286704725 shutdown_connections 2023-12-19T13:54:13.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 --2- 172.21.15.113:0/1286704725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c0cbca0 0x7f300c0b1880 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 --2- 172.21.15.113:0/1286704725 >> v2:172.21.15.151:3300/0 conn(0x7f300c15a000 0x7f300c15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 -- 172.21.15.113:0/1286704725 >> 172.21.15.113:0/1286704725 conn(0x7f300c0cf230 msgr2=0x7f300c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:13.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 -- 172.21.15.113:0/1286704725 shutdown_connections 2023-12-19T13:54:13.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.644+0000 7f3012817640 1 -- 172.21.15.113:0/1286704725 wait complete. 2023-12-19T13:54:13.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.646+0000 7f3012817640 1 Processor -- start 2023-12-19T13:54:13.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.646+0000 7f3012817640 1 -- start start 2023-12-19T13:54:13.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3012817640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f300c0b1dc0 0x7f300c142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:13.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3012817640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f300c0cbca0 0x7f300c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:13.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3012817640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c15a000 0x7f300c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:13.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3012817640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c143360 con 0x7f300c15a000 2023-12-19T13:54:13.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3012817640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c154f60 con 0x7f300c0b1dc0 2023-12-19T13:54:13.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3012817640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c15e3f0 con 0x7f300c0cbca0 2023-12-19T13:54:13.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3010db4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c15a000 0x7f300c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:13.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3010db4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c15a000 0x7f300c154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34016/0 (socket says 172.21.15.113:34016) 2023-12-19T13:54:13.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3010db4640 1 -- 172.21.15.113:0/1653271842 learned_addr learned my addr 172.21.15.113:0/1653271842 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f3003fff640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f300c0cbca0 0x7f300c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.648+0000 7f300bfff640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f300c0b1dc0 0x7f300c142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3010db4640 1 -- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f300c0cbca0 msgr2=0x7f300c1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3010db4640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f300c0cbca0 0x7f300c1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3010db4640 1 -- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f300c0b1dc0 msgr2=0x7f300c142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3010db4640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f300c0b1dc0 0x7f300c142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3010db4640 1 -- 172.21.15.113:0/1653271842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40094d0 con 0x7f300c15a000 2023-12-19T13:54:13.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3010db4640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c15a000 0x7f300c154930 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f300400c7a0 tx=0x7f300400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:13.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f30097fa640 1 -- 172.21.15.113:0/1653271842 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004003b70 con 0x7f300c15a000 2023-12-19T13:54:13.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f30097fa640 1 -- 172.21.15.113:0/1653271842 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3004003cf0 con 0x7f300c15a000 2023-12-19T13:54:13.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f30097fa640 1 -- 172.21.15.113:0/1653271842 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004003ea0 con 0x7f300c15a000 2023-12-19T13:54:13.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c1447f0 con 0x7f300c15a000 2023-12-19T13:54:13.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.649+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c144db0 con 0x7f300c15a000 2023-12-19T13:54:13.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.650+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c061910 con 0x7f300c15a000 2023-12-19T13:54:13.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.651+0000 7f30097fa640 1 -- 172.21.15.113:0/1653271842 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f300400aa90 con 0x7f300c15a000 2023-12-19T13:54:13.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.652+0000 7f30097fa640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:13.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.652+0000 7f30097fa640 1 -- 172.21.15.113:0/1653271842 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3004088860 con 0x7f300c15a000 2023-12-19T13:54:13.652 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.653+0000 7f300bfff640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:13.653 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.654+0000 7f300bfff640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc006fd0 tx=0x7f2ffc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:13.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.659+0000 7f30097fa640 1 -- 172.21.15.113:0/1653271842 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3004053d50 con 0x7f300c15a000 2023-12-19T13:54:13.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:13.852+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f300c0af0a0 con 0x7f300c15a000 2023-12-19T13:54:14.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.697+0000 7f30097fa640 1 -- 172.21.15.113:0/1653271842 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v137) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3004057370 con 0x7f300c15a000 2023-12-19T13:54:14.697 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:54:14.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 msgr2=0x7f2fec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:14.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc006fd0 tx=0x7f2ffc008040 comp rx=0 tx=0).stop 2023-12-19T13:54:14.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c15a000 msgr2=0x7f300c154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c15a000 0x7f300c154930 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f300400c7a0 tx=0x7f300400cc60 comp rx=0 tx=0).stop 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 shutdown_connections 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2fec06a430 0x7f2fec06c8f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f300c15a000 0x7f300c154930 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f300c0cbca0 0x7f300c1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 --2- 172.21.15.113:0/1653271842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f300c0b1dc0 0x7f300c142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 >> 172.21.15.113:0/1653271842 conn(0x7f300c0cf230 msgr2=0x7f300c0af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 shutdown_connections 2023-12-19T13:54:14.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.703+0000 7f3012817640 1 -- 172.21.15.113:0/1653271842 wait complete. 2023-12-19T13:54:14.725 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:54:14.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.945+0000 7f6dd54a8640 1 Processor -- start 2023-12-19T13:54:14.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.945+0000 7f6dd54a8640 1 -- start start 2023-12-19T13:54:14.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dd54a8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6dd0145f00 0x7f6dd0146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:14.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dd54a8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b6100 0x7f6dd00cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dd54a8640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00b7140 con 0x7f6dd00b5540 2023-12-19T13:54:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dd54a8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00b68a0 con 0x7f6dd0145f00 2023-12-19T13:54:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dd54a8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00b6b80 con 0x7f6dd00b6100 2023-12-19T13:54:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dcffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6dd0145f00 0x7f6dd0146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dcffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6dd0145f00 0x7f6dd0146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34030/0 (socket says 172.21.15.113:34030) 2023-12-19T13:54:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.947+0000 7f6dcffff640 1 -- 172.21.15.113:0/644793643 learned_addr learned my addr 172.21.15.113:0/644793643 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.948+0000 7f6dcffff640 1 -- 172.21.15.113:0/644793643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b6100 msgr2=0x7f6dd00cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:14.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.948+0000 7f6dcffff640 1 --2- 172.21.15.113:0/644793643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b6100 0x7f6dd00cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.948+0000 7f6dcffff640 1 -- 172.21.15.113:0/644793643 >> v1:172.21.15.113:6789/0 conn(0x7f6dd00b5540 legacy=0x7f6dd00b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:14.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.948+0000 7f6dcffff640 1 -- 172.21.15.113:0/644793643 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00b6e60 con 0x7f6dd0145f00 2023-12-19T13:54:14.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.949+0000 7f6dcffff640 1 --2- 172.21.15.113:0/644793643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd0146af0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009e50 tx=0x7f6dc002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528f948256811082 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.949+0000 7f6dceffd640 1 -- 172.21.15.113:0/644793643 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc002c9f0 con 0x7f6dd0145f00 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.949+0000 7f6dceffd640 1 -- 172.21.15.113:0/644793643 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc002cb50 con 0x7f6dd0145f00 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.949+0000 7f6dceffd640 1 -- 172.21.15.113:0/644793643 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00343f0 con 0x7f6dd0145f00 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 -- 172.21.15.113:0/644793643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 msgr2=0x7f6dd0146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/644793643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd0146af0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009e50 tx=0x7f6dc002be50 comp rx=0 tx=0).stop 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 -- 172.21.15.113:0/644793643 shutdown_connections 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/644793643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b6100 0x7f6dd00cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/644793643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd0146af0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 -- 172.21.15.113:0/644793643 >> 172.21.15.113:0/644793643 conn(0x7f6dd00b4120 msgr2=0x7f6dd0071170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 -- 172.21.15.113:0/644793643 shutdown_connections 2023-12-19T13:54:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.950+0000 7f6dd54a8640 1 -- 172.21.15.113:0/644793643 wait complete. 2023-12-19T13:54:14.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.952+0000 7f6dd54a8640 1 Processor -- start 2023-12-19T13:54:14.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.952+0000 7f6dd54a8640 1 -- start start 2023-12-19T13:54:14.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd54a8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b5540 0x7f6dd0070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:14.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd54a8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd00b6100 0x7f6dd01f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:14.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd54a8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd01f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd54a8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd01f6e10 con 0x7f6dd0145f00 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd54a8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd01f2d00 con 0x7f6dd00b6100 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd54a8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd01f2fe0 con 0x7f6dd00b5540 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd4ca7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd01f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd4ca7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd01f65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34040/0 (socket says 172.21.15.113:34040) 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.953+0000 7f6dd4ca7640 1 -- 172.21.15.113:0/1171355790 learned_addr learned my addr 172.21.15.113:0/1171355790 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dcffff640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b5540 0x7f6dd0070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd4ca7640 1 -- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b5540 msgr2=0x7f6dd0070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd4ca7640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b5540 0x7f6dd0070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd4ca7640 1 -- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd00b6100 msgr2=0x7f6dd01f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd4ca7640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd00b6100 0x7f6dd01f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd4ca7640 1 -- 172.21.15.113:0/1171355790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0009b30 con 0x7f6dd0145f00 2023-12-19T13:54:14.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dcffff640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b5540 0x7f6dd0070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:14.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd4ca7640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd01f65e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c390 tx=0x7f6dc800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:14.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dccff9640 1 -- 172.21.15.113:0/1171355790 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80052d0 con 0x7f6dd0145f00 2023-12-19T13:54:14.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dccff9640 1 -- 172.21.15.113:0/1171355790 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8005430 con 0x7f6dd0145f00 2023-12-19T13:54:14.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dccff9640 1 -- 172.21.15.113:0/1171355790 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8003810 con 0x7f6dd0145f00 2023-12-19T13:54:14.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd01f32c0 con 0x7f6dd0145f00 2023-12-19T13:54:14.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.954+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd01f6b20 con 0x7f6dd0145f00 2023-12-19T13:54:14.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.955+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd01f3500 con 0x7f6dd0145f00 2023-12-19T13:54:14.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.956+0000 7f6dccff9640 1 -- 172.21.15.113:0/1171355790 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6dc8003970 con 0x7f6dd0145f00 2023-12-19T13:54:14.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.957+0000 7f6dccff9640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6db006a430 0x7f6db006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:14.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.957+0000 7f6dccff9640 1 -- 172.21.15.113:0/1171355790 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f6dc8087d60 con 0x7f6dd0145f00 2023-12-19T13:54:14.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.957+0000 7f6dcffff640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6db006a430 0x7f6db006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:14.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.958+0000 7f6dcffff640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6db006a430 0x7f6db006c8f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0035000 tx=0x7f6dc0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:14.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:14.962+0000 7f6dccff9640 1 -- 172.21.15.113:0/1171355790 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6dd01f3500 con 0x7f6dd0145f00 2023-12-19T13:54:15.155 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.155+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6dd01f34b0 con 0x7f6dd0145f00 2023-12-19T13:54:15.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.701+0000 7f6dccff9640 1 -- 172.21.15.113:0/1171355790 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v138) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6dc8053410 con 0x7f6dd0145f00 2023-12-19T13:54:15.701 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6db006a430 msgr2=0x7f6db006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6db006a430 0x7f6db006c8f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0035000 tx=0x7f6dc0030000 comp rx=0 tx=0).stop 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 msgr2=0x7f6dd01f65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd01f65e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c390 tx=0x7f6dc800c850 comp rx=0 tx=0).stop 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 shutdown_connections 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6db006a430 0x7f6db006c8f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6dd0145f00 0x7f6dd01f65e0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd00b6100 0x7f6dd01f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 --2- 172.21.15.113:0/1171355790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd00b5540 0x7f6dd0070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.705+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 >> 172.21.15.113:0/1171355790 conn(0x7f6dd00b4120 msgr2=0x7f6dd00d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:15.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.706+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 shutdown_connections 2023-12-19T13:54:15.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.706+0000 7f6dd54a8640 1 -- 172.21.15.113:0/1171355790 wait complete. 2023-12-19T13:54:15.727 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:54:15.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.936+0000 7fea150b6640 1 Processor -- start 2023-12-19T13:54:15.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.936+0000 7fea150b6640 1 -- start start 2023-12-19T13:54:15.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.938+0000 7fea150b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 0x7fea1015c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.938+0000 7fea150b6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea100c9e50 con 0x7fea1015c660 2023-12-19T13:54:15.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.938+0000 7fea150b6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea100b1dd0 con 0x7fea100adf00 2023-12-19T13:54:15.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.938+0000 7fea150b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1015bd00 con 0x7fea100c99f0 2023-12-19T13:54:15.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.938+0000 7fea0f59e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fea1015c660 0x7fea100ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43902/0 (socket says 172.21.15.113:43902) 2023-12-19T13:54:15.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.938+0000 7fea0f59e640 1 -- 172.21.15.113:0/2238788964 learned_addr learned my addr 172.21.15.113:0/2238788964 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396442377 0 0) 0x7fea100c9e50 con 0x7fea1015c660 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9fc003520 con 0x7fea1015c660 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea07fff640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 0x7fea1015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128362988 0 0) 0x7fe9fc003520 con 0x7fea1015c660 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 msgr2=0x7fea1015c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 0x7fea1015c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 >> v1:172.21.15.151:6789/0 conn(0x7fea100adf00 legacy=0x7fea100b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100b20b0 con 0x7fea1015c660 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fea080019f0 con 0x7fea1015c660 2023-12-19T13:54:15.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 >> v1:172.21.15.113:6789/0 conn(0x7fea1015c660 legacy=0x7fea100ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc003a10 0x7fe9fc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9fc0047c0 0x7fe9fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 0x7fe9fc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1015bd00 con 0x7fe9fc0047c0 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc00bb40 con 0x7fe9fc003a10 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.939+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc00bd00 con 0x7fea100c99f0 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea07fff640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9fc0047c0 0x7fe9fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea0f59e640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 0x7fe9fc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea07fff640 1 -- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 msgr2=0x7fe9fc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea07fff640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea100c99f0 0x7fe9fc005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea07fff640 1 -- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc003a10 msgr2=0x7fe9fc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:15.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea0ed9d640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc003a10 0x7fe9fc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea07fff640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc003a10 0x7fe9fc003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.940+0000 7fea07fff640 1 -- 172.21.15.113:0/2238788964 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc003520 con 0x7fe9fc0047c0 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.941+0000 7fea07fff640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9fc0047c0 0x7fe9fc004c40 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800ba30 tx=0x7fe9fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fcaea43668ba7b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8032640 con 0x7fe9fc0047c0 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80327a0 con 0x7fe9fc0047c0 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea0e59c640 1 -- 172.21.15.113:0/2238788964 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8032b30 con 0x7fe9fc0047c0 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea150b6640 1 -- 172.21.15.113:0/2238788964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9fc0047c0 msgr2=0x7fe9fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea150b6640 1 --2- 172.21.15.113:0/2238788964 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9fc0047c0 0x7fe9fc004c40 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800ba30 tx=0x7fe9fc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea0f59e640 1 -- 172.21.15.113:0/2238788964 reap_dead start 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea150b6640 1 -- 172.21.15.113:0/2238788964 shutdown_connections 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea150b6640 1 -- 172.21.15.113:0/2238788964 >> 172.21.15.113:0/2238788964 conn(0x7fea10066160 msgr2=0x7fea100cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea150b6640 1 -- 172.21.15.113:0/2238788964 shutdown_connections 2023-12-19T13:54:15.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.942+0000 7fea150b6640 1 -- 172.21.15.113:0/2238788964 wait complete. 2023-12-19T13:54:15.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.944+0000 7fea150b6640 1 Processor -- start 2023-12-19T13:54:15.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.944+0000 7fea150b6640 1 -- start start 2023-12-19T13:54:15.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea150b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc0047c0 0x7fea10155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea150b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea10153850 0x7fea10154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea150b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1006d6a0 0x7fea10070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea150b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101549d0 con 0x7fea10153850 2023-12-19T13:54:15.945 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea150b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10149590 con 0x7fe9fc0047c0 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea150b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea10153d50 con 0x7fea1006d6a0 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea07fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea10153850 0x7fea10154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea07fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea10153850 0x7fea10154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34068/0 (socket says 172.21.15.113:34068) 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.945+0000 7fea07fff640 1 -- 172.21.15.113:0/4109964636 learned_addr learned my addr 172.21.15.113:0/4109964636 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea0f59e640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1006d6a0 0x7fea10070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea0ed9d640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc0047c0 0x7fea10155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea07fff640 1 -- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1006d6a0 msgr2=0x7fea10070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea07fff640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1006d6a0 0x7fea10070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea07fff640 1 -- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc0047c0 msgr2=0x7fea10155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea07fff640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc0047c0 0x7fea10155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea07fff640 1 -- 172.21.15.113:0/4109964636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10154030 con 0x7fea10153850 2023-12-19T13:54:15.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea07fff640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea10153850 0x7fea10154df0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe9f802bf90 tx=0x7fe9f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:15.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea077fe640 1 -- 172.21.15.113:0/4109964636 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f803b7e0 con 0x7fea10153850 2023-12-19T13:54:15.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea077fe640 1 -- 172.21.15.113:0/4109964636 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f803b940 con 0x7fea10153850 2023-12-19T13:54:15.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.946+0000 7fea077fe640 1 -- 172.21.15.113:0/4109964636 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f803bcb0 con 0x7fea10153850 2023-12-19T13:54:15.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.947+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea10154310 con 0x7fea10153850 2023-12-19T13:54:15.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.947+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1006db20 con 0x7fea10153850 2023-12-19T13:54:15.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.948+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10154b10 con 0x7fea10153850 2023-12-19T13:54:15.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.949+0000 7fea077fe640 1 -- 172.21.15.113:0/4109964636 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe9f8043070 con 0x7fea10153850 2023-12-19T13:54:15.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.950+0000 7fea077fe640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe9f006a430 0x7fe9f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:15.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.950+0000 7fea077fe640 1 -- 172.21.15.113:0/4109964636 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe9f80aaa60 con 0x7fea10153850 2023-12-19T13:54:15.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.950+0000 7fea0ed9d640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe9f006a430 0x7fe9f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:15.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.951+0000 7fea0ed9d640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe9f006a430 0x7fe9f006c8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fea00001590 tx=0x7fea00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:15.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:15.954+0000 7fea077fe640 1 -- 172.21.15.113:0/4109964636 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea10154b10 con 0x7fea10153850 2023-12-19T13:54:16.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.142+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fea10154b10 con 0x7fea10153850 2023-12-19T13:54:16.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.150+0000 7fea077fe640 1 -- 172.21.15.113:0/4109964636 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fea10154b10 con 0x7fea10153850 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe9f006a430 msgr2=0x7fe9f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe9f006a430 0x7fe9f006c8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fea00001590 tx=0x7fea00009040 comp rx=0 tx=0).stop 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea10153850 msgr2=0x7fea10154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea10153850 0x7fea10154df0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe9f802bf90 tx=0x7fe9f8004730 comp rx=0 tx=0).stop 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 shutdown_connections 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe9f006a430 0x7fe9f006c8f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1006d6a0 0x7fea10070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fea10153850 0x7fea10154df0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 --2- 172.21.15.113:0/4109964636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9fc0047c0 0x7fea10155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 >> 172.21.15.113:0/4109964636 conn(0x7fea10066160 msgr2=0x7fea1015ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:16.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 shutdown_connections 2023-12-19T13:54:16.154 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.153+0000 7fea150b6640 1 -- 172.21.15.113:0/4109964636 wait complete. 2023-12-19T13:54:16.170 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-19T13:54:16.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.385+0000 7f7e90f8e640 1 Processor -- start 2023-12-19T13:54:16.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.385+0000 7f7e90f8e640 1 -- start start 2023-12-19T13:54:16.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.386+0000 7f7e90f8e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e8c15b1e0 0x7f7e8c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e90f8e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e8c15a8a0 0x7f7e8c15b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e90f8e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c06b520 con 0x7f7e8c159f80 2023-12-19T13:54:16.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e90f8e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8c0b2b20 con 0x7f7e8c15b1e0 2023-12-19T13:54:16.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e90f8e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8c0b2fb0 con 0x7f7e8c15a8a0 2023-12-19T13:54:16.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e8b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7e8c159f80 0x7f7e8c06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43916/0 (socket says 172.21.15.113:43916) 2023-12-19T13:54:16.387 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e8b7fe640 1 -- 172.21.15.113:0/1556245424 learned_addr learned my addr 172.21.15.113:0/1556245424 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:16.387 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e83fff640 1 --2- 172.21.15.113:0/1556245424 >> v2:172.21.15.113:3300/0 conn(0x7f7e8c15b1e0 0x7f7e8c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e8affd640 1 -- 172.21.15.113:0/1556245424 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393142155 0 0) 0x7f7e8c06b520 con 0x7f7e8c159f80 2023-12-19T13:54:16.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e8affd640 1 -- 172.21.15.113:0/1556245424 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e78003520 con 0x7f7e8c159f80 2023-12-19T13:54:16.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e8bfff640 1 --2- 172.21.15.113:0/1556245424 >> v2:172.21.15.151:3300/0 conn(0x7f7e8c15a8a0 0x7f7e8c15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e83fff640 1 -- 172.21.15.113:0/1556245424 >> v2:172.21.15.151:3300/0 conn(0x7f7e8c15a8a0 msgr2=0x7f7e8c15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e83fff640 1 --2- 172.21.15.113:0/1556245424 >> v2:172.21.15.151:3300/0 conn(0x7f7e8c15a8a0 0x7f7e8c15b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e83fff640 1 -- 172.21.15.113:0/1556245424 >> v1:172.21.15.113:6789/0 conn(0x7f7e8c159f80 legacy=0x7f7e8c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.387+0000 7f7e83fff640 1 -- 172.21.15.113:0/1556245424 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0b1f10 con 0x7f7e8c15b1e0 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.389+0000 7f7e83fff640 1 --2- 172.21.15.113:0/1556245424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c15b1e0 0x7f7e8c15a360 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ae020 tx=0x7f7e7402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324f14b782769a72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.389+0000 7f7e8affd640 1 -- 172.21.15.113:0/1556245424 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74030610 con 0x7f7e8c15b1e0 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.389+0000 7f7e8affd640 1 -- 172.21.15.113:0/1556245424 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74030770 con 0x7f7e8c15b1e0 2023-12-19T13:54:16.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.389+0000 7f7e8affd640 1 -- 172.21.15.113:0/1556245424 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74030b00 con 0x7f7e8c15b1e0 2023-12-19T13:54:16.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.389+0000 7f7e90f8e640 1 -- 172.21.15.113:0/1556245424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c15b1e0 msgr2=0x7f7e8c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.389+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/1556245424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c15b1e0 0x7f7e8c15a360 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ae020 tx=0x7f7e7402b960 comp rx=0 tx=0).stop 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.390+0000 7f7e90f8e640 1 -- 172.21.15.113:0/1556245424 shutdown_connections 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.390+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/1556245424 >> v2:172.21.15.151:3300/0 conn(0x7f7e8c15a8a0 0x7f7e8c15b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.390+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/1556245424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c15b1e0 0x7f7e8c15a360 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.390+0000 7f7e90f8e640 1 -- 172.21.15.113:0/1556245424 >> 172.21.15.113:0/1556245424 conn(0x7f7e8c0b0100 msgr2=0x7f7e8c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.390+0000 7f7e90f8e640 1 -- 172.21.15.113:0/1556245424 shutdown_connections 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.390+0000 7f7e90f8e640 1 -- 172.21.15.113:0/1556245424 wait complete. 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.391+0000 7f7e90f8e640 1 Processor -- start 2023-12-19T13:54:16.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.392+0000 7f7e90f8e640 1 -- start start 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.392+0000 7f7e90f8e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c159f80 0x7f7e8c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.392+0000 7f7e90f8e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e8c15a8a0 0x7f7e8c156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.392+0000 7f7e90f8e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e8c15b1e0 0x7f7e8c06d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.392+0000 7f7e90f8e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c06bfd0 con 0x7f7e8c159f80 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.392+0000 7f7e90f8e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c1e74c0 con 0x7f7e8c15a8a0 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.392+0000 7f7e90f8e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c06b630 con 0x7f7e8c15b1e0 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c159f80 0x7f7e8c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c159f80 0x7f7e8c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34100/0 (socket says 172.21.15.113:34100) 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 -- 172.21.15.113:0/987870133 learned_addr learned my addr 172.21.15.113:0/987870133 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 -- 172.21.15.113:0/987870133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e8c15b1e0 msgr2=0x7f7e8c06d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e8c15b1e0 0x7f7e8c06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 -- 172.21.15.113:0/987870133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e8c15a8a0 msgr2=0x7f7e8c156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e8c15a8a0 0x7f7e8c156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 -- 172.21.15.113:0/987870133 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74009400 con 0x7f7e8c159f80 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.393+0000 7f7e8b7fe640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c159f80 0x7f7e8c1555a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c500 tx=0x7f7e7c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.394+0000 7f7e88ff9640 1 -- 172.21.15.113:0/987870133 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c005ce0 con 0x7f7e8c159f80 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.394+0000 7f7e88ff9640 1 -- 172.21.15.113:0/987870133 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c005e40 con 0x7f7e8c159f80 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.394+0000 7f7e88ff9640 1 -- 172.21.15.113:0/987870133 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c007330 con 0x7f7e8c159f80 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.394+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c06b910 con 0x7f7e8c159f80 2023-12-19T13:54:16.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.394+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c155ae0 con 0x7f7e8c159f80 2023-12-19T13:54:16.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.395+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c06c110 con 0x7f7e8c159f80 2023-12-19T13:54:16.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.396+0000 7f7e88ff9640 1 -- 172.21.15.113:0/987870133 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e7c007490 con 0x7f7e8c159f80 2023-12-19T13:54:16.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.397+0000 7f7e88ff9640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e6c06a460 0x7f7e6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.397+0000 7f7e88ff9640 1 -- 172.21.15.113:0/987870133 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7e7c087c20 con 0x7f7e8c159f80 2023-12-19T13:54:16.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.397+0000 7f7e83fff640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e6c06a460 0x7f7e6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.398+0000 7f7e83fff640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e6c06a460 0x7f7e6c06c920 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7e74036000 tx=0x7f7e74030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:16.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.401+0000 7f7e88ff9640 1 -- 172.21.15.113:0/987870133 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e8c06c110 con 0x7f7e8c159f80 2023-12-19T13:54:16.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.660+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f7e8c06c110 con 0x7f7e8c159f80 2023-12-19T13:54:16.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.717+0000 7f7e88ff9640 1 -- 172.21.15.113:0/987870133 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v400) v1 ==== 128+0+0 (secure 0 0 0) 0x7f7e8c06c110 con 0x7f7e8c159f80 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e6c06a460 msgr2=0x7f7e6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e6c06a460 0x7f7e6c06c920 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7e74036000 tx=0x7f7e74030000 comp rx=0 tx=0).stop 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c159f80 msgr2=0x7f7e8c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c159f80 0x7f7e8c1555a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c500 tx=0x7f7e7c00c9c0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 shutdown_connections 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e6c06a460 0x7f7e6c06c920 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e8c15b1e0 0x7f7e8c06d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e8c15a8a0 0x7f7e8c156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 --2- 172.21.15.113:0/987870133 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e8c159f80 0x7f7e8c1555a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 >> 172.21.15.113:0/987870133 conn(0x7f7e8c0b0100 msgr2=0x7f7e8c0ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:16.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 shutdown_connections 2023-12-19T13:54:16.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.720+0000 7f7e90f8e640 1 -- 172.21.15.113:0/987870133 wait complete. 2023-12-19T13:54:16.739 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-19T13:54:16.740 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T13:54:16.741 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:16.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.949+0000 7f4c18c19640 1 Processor -- start 2023-12-19T13:54:16.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.949+0000 7f4c18c19640 1 -- start start 2023-12-19T13:54:16.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c18c19640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140ce770 0x7f4c14166190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c18c19640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1415c700 con 0x7f4c1415c320 2023-12-19T13:54:16.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c18c19640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c14140ab0 con 0x7f4c1406df00 2023-12-19T13:54:16.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c18c19640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140ced90 con 0x7f4c140ce770 2023-12-19T13:54:16.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c1259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4c1415c320 0x7f4c1406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43932/0 (socket says 172.21.15.113:43932) 2023-12-19T13:54:16.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c1259c640 1 -- 172.21.15.113:0/4027468640 learned_addr learned my addr 172.21.15.113:0/4027468640 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:16.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488918460 0 0) 0x7f4c1415c700 con 0x7f4c1415c320 2023-12-19T13:54:16.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf4003520 con 0x7f4c1415c320 2023-12-19T13:54:16.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.951+0000 7f4c12d9d640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140ce770 0x7f4c14166190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 511038463 0 0) 0x7f4bf4003520 con 0x7f4c1415c320 2023-12-19T13:54:16.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140ce770 msgr2=0x7f4c14166190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:16.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140ce770 0x7f4c14166190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 >> v1:172.21.15.151:6789/0 conn(0x7f4c1406df00 legacy=0x7f4c140ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14140d90 con 0x7f4c1415c320 2023-12-19T13:54:16.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f4c04001670 con 0x7f4c1415c320 2023-12-19T13:54:16.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 >> v1:172.21.15.113:6789/0 conn(0x7f4c1415c320 legacy=0x7f4c1406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bf4003a10 0x7f4bf4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf40047c0 0x7f4bf4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140ce770 0x7f4bf400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140ced90 con 0x7f4bf4003a10 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40054e0 con 0x7f4bf40047c0 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf400bec0 con 0x7f4c140ce770 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c1259c640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bf4003a10 0x7f4bf4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c1259c640 1 -- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140ce770 msgr2=0x7f4bf400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c1259c640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140ce770 0x7f4bf400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c1259c640 1 -- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf40047c0 msgr2=0x7f4bf4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.952+0000 7f4c0bfff640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf40047c0 0x7f4bf4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.953+0000 7f4c1259c640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf40047c0 0x7f4bf4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.953+0000 7f4c1259c640 1 -- 172.21.15.113:0/4027468640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4003520 con 0x7f4bf4003a10 2023-12-19T13:54:16.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.953+0000 7f4c0bfff640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf40047c0 0x7f4bf4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.954+0000 7f4c1259c640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bf4003a10 0x7f4bf4003e30 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c0e0 tx=0x7f4bf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe705d4b0c57a03 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.954+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04005ad0 con 0x7f4bf4003a10 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.954+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c04005c30 con 0x7f4bf4003a10 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.954+0000 7f4c11d9b640 1 -- 172.21.15.113:0/4027468640 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0402c7f0 con 0x7f4bf4003a10 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.954+0000 7f4c18c19640 1 -- 172.21.15.113:0/4027468640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bf4003a10 msgr2=0x7f4bf4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.954+0000 7f4c18c19640 1 --2- 172.21.15.113:0/4027468640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bf4003a10 0x7f4bf4003e30 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c0e0 tx=0x7f4bf40057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.954+0000 7f4c12d9d640 1 -- 172.21.15.113:0/4027468640 reap_dead start 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.955+0000 7f4c18c19640 1 -- 172.21.15.113:0/4027468640 shutdown_connections 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.955+0000 7f4c18c19640 1 -- 172.21.15.113:0/4027468640 >> 172.21.15.113:0/4027468640 conn(0x7f4c1406a2e0 msgr2=0x7f4c1406a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.955+0000 7f4c18c19640 1 -- 172.21.15.113:0/4027468640 shutdown_connections 2023-12-19T13:54:16.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.955+0000 7f4c18c19640 1 -- 172.21.15.113:0/4027468640 wait complete. 2023-12-19T13:54:16.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.956+0000 7f4c18c19640 1 Processor -- start 2023-12-19T13:54:16.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.957+0000 7f4c18c19640 1 -- start start 2023-12-19T13:54:16.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c18c19640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bf4003a10 0x7f4c14134680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c18c19640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c14153270 0x7f4c1415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c18c19640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c1415a790 0x7f4c141f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c18c19640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1415ac20 con 0x7f4c14153270 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c18c19640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14142c30 con 0x7f4c1415a790 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c18c19640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14155650 con 0x7f4bf4003a10 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c14153270 0x7f4c1415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c14153270 0x7f4c1415a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34114/0 (socket says 172.21.15.113:34114) 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 -- 172.21.15.113:0/1769441390 learned_addr learned my addr 172.21.15.113:0/1769441390 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 -- 172.21.15.113:0/1769441390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bf4003a10 msgr2=0x7f4c14134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bf4003a10 0x7f4c14134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 -- 172.21.15.113:0/1769441390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c1415a790 msgr2=0x7f4c141f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c12d9d640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c1415a790 0x7f4c141f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c1415a790 0x7f4c141f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.958+0000 7f4c0bfff640 1 -- 172.21.15.113:0/1769441390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14134bc0 con 0x7f4c14153270 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.959+0000 7f4c0bfff640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c14153270 0x7f4c1415a250 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00d540 tx=0x7f4bfc00da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.959+0000 7f4c0affd640 1 -- 172.21.15.113:0/1769441390 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc005480 con 0x7f4c14153270 2023-12-19T13:54:16.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.959+0000 7f4c0affd640 1 -- 172.21.15.113:0/1769441390 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc003610 con 0x7f4c14153270 2023-12-19T13:54:16.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.959+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c14153700 con 0x7f4c14153270 2023-12-19T13:54:16.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.959+0000 7f4c0affd640 1 -- 172.21.15.113:0/1769441390 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0039a0 con 0x7f4c14153270 2023-12-19T13:54:16.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.959+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14142ed0 con 0x7f4c14153270 2023-12-19T13:54:16.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.960+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c14061910 con 0x7f4c14153270 2023-12-19T13:54:16.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.961+0000 7f4c0affd640 1 -- 172.21.15.113:0/1769441390 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4bfc003b00 con 0x7f4c14153270 2023-12-19T13:54:16.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.962+0000 7f4c0affd640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4bf806a430 0x7f4bf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:16.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.962+0000 7f4c0affd640 1 -- 172.21.15.113:0/1769441390 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4bfc088510 con 0x7f4c14153270 2023-12-19T13:54:16.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.962+0000 7f4c1259c640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4bf806a430 0x7f4bf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:16.962 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.963+0000 7f4c1259c640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4bf806a430 0x7f4bf806c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c04034000 tx=0x7f4c04007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:16.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:16.966+0000 7f4c0affd640 1 -- 172.21.15.113:0/1769441390 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4bfc053df0 con 0x7f4c14153270 2023-12-19T13:54:17.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.160+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c140cf320 con 0x7f4c14153270 2023-12-19T13:54:17.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.161+0000 7f4c0affd640 1 -- 172.21.15.113:0/1769441390 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+12579 (secure 0 0 0) 0x7f4bfc057410 con 0x7f4c14153270 2023-12-19T13:54:17.161 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:17.161 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":138,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:54:15.690621+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:6836/2259732918":"2023-12-20T13:54:12.367925+0000","172.21.15.113:6834/2259732918":"2023-12-20T13:54:12.367925+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:17.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4bf806a430 msgr2=0x7f4bf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4bf806a430 0x7f4bf806c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c04034000 tx=0x7f4c04007000 comp rx=0 tx=0).stop 2023-12-19T13:54:17.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c14153270 msgr2=0x7f4c1415a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c14153270 0x7f4c1415a250 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00d540 tx=0x7f4bfc00da00 comp rx=0 tx=0).stop 2023-12-19T13:54:17.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 shutdown_connections 2023-12-19T13:54:17.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4bf806a430 0x7f4bf806c8f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c1415a790 0x7f4c141f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c14153270 0x7f4c1415a250 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 --2- 172.21.15.113:0/1769441390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bf4003a10 0x7f4c14134680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 >> 172.21.15.113:0/1769441390 conn(0x7f4c1406a2e0 msgr2=0x7f4c1406d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:17.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 shutdown_connections 2023-12-19T13:54:17.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.164+0000 7f4c18c19640 1 -- 172.21.15.113:0/1769441390 wait complete. 2023-12-19T13:54:17.180 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:54:17.181 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:54:17.390 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.391+0000 7f712096e640 1 Processor -- start 2023-12-19T13:54:17.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.391+0000 7f712096e640 1 -- start start 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f712096e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15ebc0 0x7f711c0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f712096e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f711c0b2020 0x7f711c0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f712096e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c0cfc90 con 0x7f711c15b040 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f712096e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0b29f0 con 0x7f711c0b2020 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f712096e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c15b420 con 0x7f711c15ebc0 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f711bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f711c0b2020 0x7f711c0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f711bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f711c0b2020 0x7f711c0b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34116/0 (socket says 172.21.15.113:34116) 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.393+0000 7f711bfff640 1 -- 172.21.15.113:0/1243127208 learned_addr learned my addr 172.21.15.113:0/1243127208 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:17.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.394+0000 7f7113fff640 1 --2- 172.21.15.113:0/1243127208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15ebc0 0x7f711c0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.394+0000 7f711bfff640 1 -- 172.21.15.113:0/1243127208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15ebc0 msgr2=0x7f711c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:17.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.394+0000 7f711bfff640 1 --2- 172.21.15.113:0/1243127208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15ebc0 0x7f711c0ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.394+0000 7f711bfff640 1 -- 172.21.15.113:0/1243127208 >> v1:172.21.15.151:6789/0 conn(0x7f711c15b040 legacy=0x7f711c0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:17.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.394+0000 7f711bfff640 1 -- 172.21.15.113:0/1243127208 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0cf080 con 0x7f711c0b2020 2023-12-19T13:54:17.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.395+0000 7f711bfff640 1 --2- 172.21.15.113:0/1243127208 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c0b24b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7114009e50 tx=0x7f711402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599a221a4602cdab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:17.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.395+0000 7f711affd640 1 -- 172.21.15.113:0/1243127208 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711402ca70 con 0x7f711c0b2020 2023-12-19T13:54:17.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.395+0000 7f711affd640 1 -- 172.21.15.113:0/1243127208 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711402cbd0 con 0x7f711c0b2020 2023-12-19T13:54:17.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.395+0000 7f711affd640 1 -- 172.21.15.113:0/1243127208 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140343f0 con 0x7f711c0b2020 2023-12-19T13:54:17.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 -- 172.21.15.113:0/1243127208 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 msgr2=0x7f711c0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 --2- 172.21.15.113:0/1243127208 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c0b24b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7114009e50 tx=0x7f711402bed0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 -- 172.21.15.113:0/1243127208 shutdown_connections 2023-12-19T13:54:17.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 --2- 172.21.15.113:0/1243127208 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c0b24b0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 --2- 172.21.15.113:0/1243127208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15ebc0 0x7f711c0ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 -- 172.21.15.113:0/1243127208 >> 172.21.15.113:0/1243127208 conn(0x7f711c071370 msgr2=0x7f711c071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:17.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 -- 172.21.15.113:0/1243127208 shutdown_connections 2023-12-19T13:54:17.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.396+0000 7f712096e640 1 -- 172.21.15.113:0/1243127208 wait complete. 2023-12-19T13:54:17.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.398+0000 7f712096e640 1 Processor -- start 2023-12-19T13:54:17.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.398+0000 7f712096e640 1 -- start start 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f712096e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f712096e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15b040 0x7f711c0ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f712096e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f711c15ebc0 0x7f711c0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f712096e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c154d90 con 0x7f711c0b2020 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f712096e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c156e00 con 0x7f711c15ebc0 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f712096e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1570a0 con 0x7f711c15b040 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34122/0 (socket says 172.21.15.113:34122) 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 -- 172.21.15.113:0/3811024922 learned_addr learned my addr 172.21.15.113:0/3811024922 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711bfff640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f711c15ebc0 0x7f711c0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 -- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15b040 msgr2=0x7f711c0ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f7113fff640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15b040 0x7f711c0ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15b040 0x7f711c0ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 -- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f711c15ebc0 msgr2=0x7f711c0a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f711c15ebc0 0x7f711c0a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711b7fe640 1 -- 172.21.15.113:0/3811024922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009b30 con 0x7f711c0b2020 2023-12-19T13:54:17.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.399+0000 7f711bfff640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f711c15ebc0 0x7f711c0a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:17.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.400+0000 7f711b7fe640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c154850 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f710c00b3e0 tx=0x7f710c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:17.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.400+0000 7f7118ff9640 1 -- 172.21.15.113:0/3811024922 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c011830 con 0x7f711c0b2020 2023-12-19T13:54:17.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.400+0000 7f7118ff9640 1 -- 172.21.15.113:0/3811024922 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c0119b0 con 0x7f711c0b2020 2023-12-19T13:54:17.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.400+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c157380 con 0x7f711c0b2020 2023-12-19T13:54:17.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.400+0000 7f7118ff9640 1 -- 172.21.15.113:0/3811024922 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c011d60 con 0x7f711c0b2020 2023-12-19T13:54:17.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.400+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c157940 con 0x7f711c0b2020 2023-12-19T13:54:17.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.401+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c157b60 con 0x7f711c0b2020 2023-12-19T13:54:17.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.402+0000 7f7118ff9640 1 -- 172.21.15.113:0/3811024922 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f710c01a400 con 0x7f711c0b2020 2023-12-19T13:54:17.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.403+0000 7f7118ff9640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f70fc06a460 0x7f70fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.403+0000 7f7118ff9640 1 -- 172.21.15.113:0/3811024922 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f710c088870 con 0x7f711c0b2020 2023-12-19T13:54:17.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.403+0000 7f7113fff640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f70fc06a460 0x7f70fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.404+0000 7f7113fff640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f70fc06a460 0x7f70fc06c920 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7104006fd0 tx=0x7f7104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:17.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.407+0000 7f7118ff9640 1 -- 172.21.15.113:0/3811024922 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f710c0540c0 con 0x7f711c0b2020 2023-12-19T13:54:17.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.581+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f711c061910 con 0x7f711c0b2020 2023-12-19T13:54:17.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.582+0000 7f7118ff9640 1 -- 172.21.15.113:0/3811024922 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v138) v1 ==== 93+0+10 (secure 0 0 0) 0x7f710c0150a0 con 0x7f711c0b2020 2023-12-19T13:54:17.581 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.584+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f70fc06a460 msgr2=0x7f70fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.584+0000 7f712096e640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f70fc06a460 0x7f70fc06c920 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7104006fd0 tx=0x7f7104008040 comp rx=0 tx=0).stop 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.584+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 msgr2=0x7f711c154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.584+0000 7f712096e640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c154850 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f710c00b3e0 tx=0x7f710c00b8a0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.584+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 shutdown_connections 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.584+0000 7f712096e640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f70fc06a460 0x7f70fc06c920 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.584+0000 7f712096e640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f711c15ebc0 0x7f711c0a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.585+0000 7f712096e640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f711c15b040 0x7f711c0ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.585+0000 7f712096e640 1 --2- 172.21.15.113:0/3811024922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f711c0b2020 0x7f711c154850 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.585+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 >> 172.21.15.113:0/3811024922 conn(0x7f711c071370 msgr2=0x7f711c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:17.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.585+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 shutdown_connections 2023-12-19T13:54:17.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.585+0000 7f712096e640 1 -- 172.21.15.113:0/3811024922 wait complete. 2023-12-19T13:54:17.601 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-19T13:54:17.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.798+0000 7fca22451640 1 Processor -- start 2023-12-19T13:54:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.798+0000 7fca22451640 1 -- start start 2023-12-19T13:54:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca22451640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fca1c06c6b0 0x7fca1c166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca22451640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1c06bb30 con 0x7fca1c1449e0 2023-12-19T13:54:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca22451640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1c0b0070 con 0x7fca1c0b0b50 2023-12-19T13:54:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca22451640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c0b0350 con 0x7fca1c06c6b0 2023-12-19T13:54:17.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca209ee640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fca1c06c6b0 0x7fca1c166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca209ee640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fca1c06c6b0 0x7fca1c166200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34138/0 (socket says 172.21.15.113:34138) 2023-12-19T13:54:17.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca209ee640 1 -- 172.21.15.113:0/2481634266 learned_addr learned my addr 172.21.15.113:0/2481634266 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:17.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.800+0000 7fca1bfff640 1 --1- 172.21.15.113:0/2481634266 >> v1:172.21.15.113:6789/0 conn(0x7fca1c1449e0 0x7fca1c0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43940/0 (socket says 172.21.15.113:43940) 2023-12-19T13:54:17.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.801+0000 7fca209ee640 1 -- 172.21.15.113:0/2481634266 >> v1:172.21.15.151:6789/0 conn(0x7fca1c0b0b50 legacy=0x7fca1c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:17.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.801+0000 7fca209ee640 1 -- 172.21.15.113:0/2481634266 >> v1:172.21.15.113:6789/0 conn(0x7fca1c1449e0 legacy=0x7fca1c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.801+0000 7fca209ee640 1 -- 172.21.15.113:0/2481634266 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c0b0630 con 0x7fca1c06c6b0 2023-12-19T13:54:17.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.802+0000 7fca209ee640 1 --2- 172.21.15.113:0/2481634266 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c06c6b0 0x7fca1c166200 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fca14009e50 tx=0x7fca1402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c648840a6c90491 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:17.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.802+0000 7fca1affd640 1 -- 172.21.15.113:0/2481634266 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1402cb20 con 0x7fca1c06c6b0 2023-12-19T13:54:17.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.802+0000 7fca1affd640 1 -- 172.21.15.113:0/2481634266 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1402cc80 con 0x7fca1c06c6b0 2023-12-19T13:54:17.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.802+0000 7fca1affd640 1 -- 172.21.15.113:0/2481634266 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140343f0 con 0x7fca1c06c6b0 2023-12-19T13:54:17.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.803+0000 7fca22451640 1 -- 172.21.15.113:0/2481634266 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c06c6b0 msgr2=0x7fca1c166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.803+0000 7fca22451640 1 --2- 172.21.15.113:0/2481634266 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c06c6b0 0x7fca1c166200 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fca14009e50 tx=0x7fca1402bf80 comp rx=0 tx=0).stop 2023-12-19T13:54:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.803+0000 7fca22451640 1 -- 172.21.15.113:0/2481634266 shutdown_connections 2023-12-19T13:54:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.803+0000 7fca22451640 1 --2- 172.21.15.113:0/2481634266 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c06c6b0 0x7fca1c166200 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.803+0000 7fca22451640 1 -- 172.21.15.113:0/2481634266 >> 172.21.15.113:0/2481634266 conn(0x7fca1c0cbb70 msgr2=0x7fca1c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.803+0000 7fca22451640 1 -- 172.21.15.113:0/2481634266 shutdown_connections 2023-12-19T13:54:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.803+0000 7fca22451640 1 -- 172.21.15.113:0/2481634266 wait complete. 2023-12-19T13:54:17.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.805+0000 7fca22451640 1 Processor -- start 2023-12-19T13:54:17.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.805+0000 7fca22451640 1 -- start start 2023-12-19T13:54:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca22451640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca1c06c6b0 0x7fca1c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca22451640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c0b0b50 0x7fca1c13def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca22451640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca1c1449e0 0x7fca1c15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca22451640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c15e7b0 con 0x7fca1c0b0b50 2023-12-19T13:54:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca22451640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c13cb90 con 0x7fca1c1449e0 2023-12-19T13:54:17.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca22451640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c13ce50 con 0x7fca1c06c6b0 2023-12-19T13:54:17.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca1b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c0b0b50 0x7fca1c13def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca1b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c0b0b50 0x7fca1c13def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34140/0 (socket says 172.21.15.113:34140) 2023-12-19T13:54:17.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.806+0000 7fca1b7fe640 1 -- 172.21.15.113:0/3478825055 learned_addr learned my addr 172.21.15.113:0/3478825055 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca1bfff640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca1c06c6b0 0x7fca1c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca1b7fe640 1 -- 172.21.15.113:0/3478825055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca1c06c6b0 msgr2=0x7fca1c15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca1b7fe640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca1c06c6b0 0x7fca1c15e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca1b7fe640 1 -- 172.21.15.113:0/3478825055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca1c1449e0 msgr2=0x7fca1c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca1b7fe640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca1c1449e0 0x7fca1c15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca1b7fe640 1 -- 172.21.15.113:0/3478825055 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14009b30 con 0x7fca1c0b0b50 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca1b7fe640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c0b0b50 0x7fca1c13def0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c430 tx=0x7fca1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca18ff9640 1 -- 172.21.15.113:0/3478825055 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10011790 con 0x7fca1c0b0b50 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca18ff9640 1 -- 172.21.15.113:0/3478825055 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca100118f0 con 0x7fca1c0b0b50 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca18ff9640 1 -- 172.21.15.113:0/3478825055 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10011ce0 con 0x7fca1c0b0b50 2023-12-19T13:54:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c13d130 con 0x7fca1c0b0b50 2023-12-19T13:54:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.807+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c13d6f0 con 0x7fca1c0b0b50 2023-12-19T13:54:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.808+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c061910 con 0x7fca1c0b0b50 2023-12-19T13:54:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.809+0000 7fca18ff9640 1 -- 172.21.15.113:0/3478825055 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca1001c460 con 0x7fca1c0b0b50 2023-12-19T13:54:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.810+0000 7fca18ff9640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca0806a460 0x7fca0806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.810+0000 7fca18ff9640 1 -- 172.21.15.113:0/3478825055 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca10088570 con 0x7fca1c0b0b50 2023-12-19T13:54:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.810+0000 7fca1bfff640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca0806a460 0x7fca0806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:17.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.811+0000 7fca1bfff640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca0806a460 0x7fca0806c920 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fca0c007fd0 tx=0x7fca0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:17.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:17.814+0000 7fca18ff9640 1 -- 172.21.15.113:0/3478825055 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca10053e60 con 0x7fca1c0b0b50 2023-12-19T13:54:18.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.073+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fca1c15bc70 con 0x7fca1c0b0b50 2023-12-19T13:54:18.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.728+0000 7fca18ff9640 1 -- 172.21.15.113:0/3478825055 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v402) v1 ==== 143+0+0 (secure 0 0 0) 0x7fca10057480 con 0x7fca1c0b0b50 2023-12-19T13:54:18.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca0806a460 msgr2=0x7fca0806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca0806a460 0x7fca0806c920 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fca0c007fd0 tx=0x7fca0c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c0b0b50 msgr2=0x7fca1c13def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c0b0b50 0x7fca1c13def0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c430 tx=0x7fca1000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 shutdown_connections 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fca0806a460 0x7fca0806c920 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca1c1449e0 0x7fca1c15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca1c0b0b50 0x7fca1c13def0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 --2- 172.21.15.113:0/3478825055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca1c06c6b0 0x7fca1c15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 >> 172.21.15.113:0/3478825055 conn(0x7fca1c0cbb70 msgr2=0x7fca1c0af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 shutdown_connections 2023-12-19T13:54:18.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.732+0000 7fca22451640 1 -- 172.21.15.113:0/3478825055 wait complete. 2023-12-19T13:54:18.753 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:54:18.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.970+0000 7f13408bd640 1 Processor -- start 2023-12-19T13:54:18.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.971+0000 7f13408bd640 1 -- start start 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.972+0000 7f13408bd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 0x7f133c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.972+0000 7f13408bd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f133c0cde40 0x7f133c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.972+0000 7f13408bd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c15da00 con 0x7f133c0ad300 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.972+0000 7f13408bd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c15e940 con 0x7f133c0cde40 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.972+0000 7f13408bd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0adcc0 con 0x7f133c157c30 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1333fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f133c0ad300 0x7f133c0b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59434/0 (socket says 172.21.15.113:59434) 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1333fff640 1 -- 172.21.15.113:0/588116155 learned_addr learned my addr 172.21.15.113:0/588116155 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:18.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579287145 0 0) 0x7f133c15da00 con 0x7f133c0ad300 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1328003520 con 0x7f133c0ad300 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f133a59c640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 0x7f133c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f133ad9d640 1 --2- 172.21.15.113:0/588116155 >> v2:172.21.15.151:3300/0 conn(0x7f133c0cde40 0x7f133c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3304988828 0 0) 0x7f1328003520 con 0x7f133c0ad300 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 msgr2=0x7f133c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 0x7f133c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 >> v2:172.21.15.151:3300/0 conn(0x7f133c0cde40 msgr2=0x7f133c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 --2- 172.21.15.113:0/588116155 >> v2:172.21.15.151:3300/0 conn(0x7f133c0cde40 0x7f133c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0cf860 con 0x7f133c0ad300 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1324001670 con 0x7f133c0ad300 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 >> v1:172.21.15.113:6789/0 conn(0x7f133c0ad300 legacy=0x7f133c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.973+0000 7f1339d9b640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13280039e0 0x7f1328003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f1339d9b640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 0x7f13280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f1339d9b640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1328004d00 0x7f1328005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c15e940 con 0x7f13280039e0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0adcc0 con 0x7f1328004d00 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132800bab0 con 0x7f133c157c30 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f133a59c640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13280039e0 0x7f1328003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f1333fff640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 0x7f13280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f133a59c640 1 -- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 msgr2=0x7f13280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f133ad9d640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1328004d00 0x7f1328005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f133a59c640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c157c30 0x7f13280047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f133a59c640 1 -- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1328004d00 msgr2=0x7f1328005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f133a59c640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1328004d00 0x7f1328005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.974+0000 7f133a59c640 1 -- 172.21.15.113:0/588116155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328003520 con 0x7f13280039e0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.975+0000 7f133a59c640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13280039e0 0x7f1328003e00 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f132c00ba00 tx=0x7f13280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18e926748240bbd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.975+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c032620 con 0x7f13280039e0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c032780 con 0x7f13280039e0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f1339d9b640 1 -- 172.21.15.113:0/588116155 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c032b10 con 0x7f13280039e0 2023-12-19T13:54:18.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f13408bd640 1 -- 172.21.15.113:0/588116155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13280039e0 msgr2=0x7f1328003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:18.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f13408bd640 1 --2- 172.21.15.113:0/588116155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13280039e0 0x7f1328003e00 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f132c00ba00 tx=0x7f13280057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f133ad9d640 1 -- 172.21.15.113:0/588116155 reap_dead start 2023-12-19T13:54:18.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f13408bd640 1 -- 172.21.15.113:0/588116155 shutdown_connections 2023-12-19T13:54:18.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f13408bd640 1 -- 172.21.15.113:0/588116155 >> 172.21.15.113:0/588116155 conn(0x7f133c073150 msgr2=0x7f133c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:18.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f13408bd640 1 -- 172.21.15.113:0/588116155 shutdown_connections 2023-12-19T13:54:18.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.976+0000 7f13408bd640 1 -- 172.21.15.113:0/588116155 wait complete. 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.978+0000 7f13408bd640 1 Processor -- start 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.978+0000 7f13408bd640 1 -- start start 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f13408bd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13280039e0 0x7f133c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f13408bd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c06c430 0x7f133c1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f13408bd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f133c154b60 0x7f133c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f13408bd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c158e40 con 0x7f133c154b60 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f13408bd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c06c910 con 0x7f13280039e0 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f13408bd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c06cbf0 con 0x7f133c06c430 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f133ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f133c154b60 0x7f133c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f133ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f133c154b60 0x7f133c155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34898/0 (socket says 172.21.15.113:34898) 2023-12-19T13:54:18.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.979+0000 7f133ad9d640 1 -- 172.21.15.113:0/2166494236 learned_addr learned my addr 172.21.15.113:0/2166494236 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f1333fff640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c06c430 0x7f133c1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f133ad9d640 1 -- 172.21.15.113:0/2166494236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c06c430 msgr2=0x7f133c1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f133ad9d640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c06c430 0x7f133c1519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f133ad9d640 1 -- 172.21.15.113:0/2166494236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13280039e0 msgr2=0x7f133c158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f133ad9d640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13280039e0 0x7f133c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f133ad9d640 1 -- 172.21.15.113:0/2166494236 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c06ced0 con 0x7f133c154b60 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f133ad9d640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f133c154b60 0x7f133c155c00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f133c071970 tx=0x7f133400e510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f1332ffd640 1 -- 172.21.15.113:0/2166494236 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334007e20 con 0x7f133c154b60 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f1332ffd640 1 -- 172.21.15.113:0/2166494236 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400f040 con 0x7f133c154b60 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c06d1b0 con 0x7f133c154b60 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.980+0000 7f1332ffd640 1 -- 172.21.15.113:0/2166494236 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334015650 con 0x7f133c154b60 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.981+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c151f10 con 0x7f133c154b60 2023-12-19T13:54:18.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.982+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c1520d0 con 0x7f133c154b60 2023-12-19T13:54:18.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.983+0000 7f1332ffd640 1 -- 172.21.15.113:0/2166494236 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f13340157b0 con 0x7f133c154b60 2023-12-19T13:54:18.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.983+0000 7f1332ffd640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f131c06a430 0x7f131c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:18.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.984+0000 7f1332ffd640 1 -- 172.21.15.113:0/2166494236 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1334088e90 con 0x7f133c154b60 2023-12-19T13:54:18.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.984+0000 7f133a59c640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f131c06a430 0x7f131c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:18.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.984+0000 7f133a59c640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f131c06a430 0x7f131c06c8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f132c037000 tx=0x7f132c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:18.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:18.988+0000 7f1332ffd640 1 -- 172.21.15.113:0/2166494236 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1334054810 con 0x7f133c154b60 2023-12-19T13:54:19.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.163+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f133c061910 con 0x7f133c154b60 2023-12-19T13:54:19.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.172+0000 7f1332ffd640 1 -- 172.21.15.113:0/2166494236 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1334057e30 con 0x7f133c154b60 2023-12-19T13:54:19.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.174+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f131c06a430 msgr2=0x7f131c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:19.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.174+0000 7f13408bd640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f131c06a430 0x7f131c06c8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f132c037000 tx=0x7f132c032000 comp rx=0 tx=0).stop 2023-12-19T13:54:19.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f133c154b60 msgr2=0x7f133c155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:19.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f133c154b60 0x7f133c155c00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f133c071970 tx=0x7f133400e510 comp rx=0 tx=0).stop 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 shutdown_connections 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f131c06a430 0x7f131c06c8f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f133c154b60 0x7f133c155c00 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f133c06c430 0x7f133c1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 --2- 172.21.15.113:0/2166494236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13280039e0 0x7f133c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 >> 172.21.15.113:0/2166494236 conn(0x7f133c073150 msgr2=0x7f133c06f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 shutdown_connections 2023-12-19T13:54:19.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.175+0000 7f13408bd640 1 -- 172.21.15.113:0/2166494236 wait complete. 2023-12-19T13:54:19.190 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:54:19.190 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:54:19.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:54:19.411 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:54:19.411 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:19.411 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:19.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:54:19.468 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:54:19.468 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:19.492 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:19.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:19.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:54:19.527 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:19.527 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:19.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:54:19.592 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:54:19.592 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:19.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:54:19.643 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:54:19.643 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:19.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.880+0000 7f106b170640 1 Processor -- start 2023-12-19T13:54:19.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.881+0000 7f106b170640 1 -- start start 2023-12-19T13:54:19.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106b170640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1064159f80 0x7f106406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:19.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106b170640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f106415b1e0 0x7f106415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:19.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106b170640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106406b520 con 0x7f106415a8a0 2023-12-19T13:54:19.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106b170640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640b2b20 con 0x7f106415b1e0 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106b170640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640b2fb0 con 0x7f1064159f80 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106996d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f106415b1e0 0x7f106415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106996d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f106415b1e0 0x7f106415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34910/0 (socket says 172.21.15.113:34910) 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.882+0000 7f106996d640 1 -- 172.21.15.113:0/2773875634 learned_addr learned my addr 172.21.15.113:0/2773875634 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.883+0000 7f106996d640 1 -- 172.21.15.113:0/2773875634 >> v2:172.21.15.151:3300/0 conn(0x7f1064159f80 msgr2=0x7f106406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.883+0000 7f106996d640 1 --2- 172.21.15.113:0/2773875634 >> v2:172.21.15.151:3300/0 conn(0x7f1064159f80 0x7f106406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.883+0000 7f106996d640 1 -- 172.21.15.113:0/2773875634 >> v1:172.21.15.151:6789/0 conn(0x7f106415a8a0 legacy=0x7f106415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:19.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.883+0000 7f106996d640 1 -- 172.21.15.113:0/2773875634 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640b1f10 con 0x7f106415b1e0 2023-12-19T13:54:19.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.884+0000 7f106996d640 1 --2- 172.21.15.113:0/2773875634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415a360 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f10640b3230 tx=0x7f105802dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bebcff43d949878 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:19.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.884+0000 7f106916c640 1 -- 172.21.15.113:0/2773875634 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105802e960 con 0x7f106415b1e0 2023-12-19T13:54:19.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.884+0000 7f106916c640 1 -- 172.21.15.113:0/2773875634 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105802eac0 con 0x7f106415b1e0 2023-12-19T13:54:19.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.884+0000 7f106916c640 1 -- 172.21.15.113:0/2773875634 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105802ee50 con 0x7f106415b1e0 2023-12-19T13:54:19.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 -- 172.21.15.113:0/2773875634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 msgr2=0x7f106415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:19.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 --2- 172.21.15.113:0/2773875634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415a360 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f10640b3230 tx=0x7f105802dbb0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 -- 172.21.15.113:0/2773875634 shutdown_connections 2023-12-19T13:54:19.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 --2- 172.21.15.113:0/2773875634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415a360 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 --2- 172.21.15.113:0/2773875634 >> v2:172.21.15.151:3300/0 conn(0x7f1064159f80 0x7f106406f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 -- 172.21.15.113:0/2773875634 >> 172.21.15.113:0/2773875634 conn(0x7f10640b0100 msgr2=0x7f10640b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:19.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 -- 172.21.15.113:0/2773875634 shutdown_connections 2023-12-19T13:54:19.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.885+0000 7f106b170640 1 -- 172.21.15.113:0/2773875634 wait complete. 2023-12-19T13:54:19.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.887+0000 7f106b170640 1 Processor -- start 2023-12-19T13:54:19.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.887+0000 7f106b170640 1 -- start start 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106b170640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1064159f80 0x7f1064143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106b170640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f106415a8a0 0x7f106415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106b170640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106b170640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10641538b0 con 0x7f106415b1e0 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106b170640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064153b90 con 0x7f1064159f80 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106b170640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1064153e70 con 0x7f106415a8a0 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106a96f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106a96f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34916/0 (socket says 172.21.15.113:34916) 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.888+0000 7f106a96f640 1 -- 172.21.15.113:0/2293162311 learned_addr learned my addr 172.21.15.113:0/2293162311 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106a96f640 1 -- 172.21.15.113:0/2293162311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f106415a8a0 msgr2=0x7f106415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106a96f640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f106415a8a0 0x7f106415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106a96f640 1 -- 172.21.15.113:0/2293162311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1064159f80 msgr2=0x7f1064143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106a16e640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1064159f80 0x7f1064143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106a96f640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1064159f80 0x7f1064143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106a96f640 1 -- 172.21.15.113:0/2293162311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10580094d0 con 0x7f106415b1e0 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106a96f640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415cce0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c390 tx=0x7f105c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f1062ffd640 1 -- 172.21.15.113:0/2293162311 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0035f0 con 0x7f106415b1e0 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f1062ffd640 1 -- 172.21.15.113:0/2293162311 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c003750 con 0x7f106415b1e0 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f1062ffd640 1 -- 172.21.15.113:0/2293162311 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c003b00 con 0x7f106415b1e0 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1064154150 con 0x7f106415b1e0 2023-12-19T13:54:19.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.889+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1064157160 con 0x7f106415b1e0 2023-12-19T13:54:19.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.890+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1064154670 con 0x7f106415b1e0 2023-12-19T13:54:19.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.891+0000 7f1062ffd640 1 -- 172.21.15.113:0/2293162311 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f105c003c60 con 0x7f106415b1e0 2023-12-19T13:54:19.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.892+0000 7f1062ffd640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f105006a460 0x7f105006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:19.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.892+0000 7f1062ffd640 1 -- 172.21.15.113:0/2293162311 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f105c087760 con 0x7f106415b1e0 2023-12-19T13:54:19.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.893+0000 7f106a16e640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f105006a460 0x7f105006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:19.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.893+0000 7f106a16e640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f105006a460 0x7f105006c920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1054007dc0 tx=0x7f10540072f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:19.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:19.896+0000 7f1062ffd640 1 -- 172.21.15.113:0/2293162311 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1064154670 con 0x7f106415b1e0 2023-12-19T13:54:20.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.127+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1064154670 con 0x7f106415b1e0 2023-12-19T13:54:20.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.128+0000 7f1062ffd640 1 -- 172.21.15.113:0/2293162311 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f105c017df0 con 0x7f106415b1e0 2023-12-19T13:54:20.128 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:20.128 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1401555168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1401555168},{"type":"v1","addr":"172.21.15.151:6833","nonce":1401555168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3819258570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3819258570},{"type":"v1","addr":"172.21.15.113:6837","nonce":3819258570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":5677,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/245996143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":245996143},{"type":"v1","addr":"172.21.15.151:6835","nonce":245996143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7719,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2855857095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2855857095},{"type":"v1","addr":"172.21.15.113:6836","nonce":2855857095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-12-19T13:54:20.128 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 59 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f105006a460 msgr2=0x7f105006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f105006a460 0x7f105006c920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1054007dc0 tx=0x7f10540072f0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 msgr2=0x7f106415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415cce0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c390 tx=0x7f105c00c850 comp rx=0 tx=0).stop 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 shutdown_connections 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f105006a460 0x7f105006c920 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f106415b1e0 0x7f106415cce0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f106415a8a0 0x7f106415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 --2- 172.21.15.113:0/2293162311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1064159f80 0x7f1064143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.131+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 >> 172.21.15.113:0/2293162311 conn(0x7f10640b0100 msgr2=0x7f10640b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:20.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.132+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 shutdown_connections 2023-12-19T13:54:20.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.132+0000 7f106b170640 1 -- 172.21.15.113:0/2293162311 wait complete. 2023-12-19T13:54:20.150 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:54:20.150 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:54:20.151 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:54:20.151 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:54:20.151 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:54:20.151 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:54:20.151 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:54:20.151 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:54:20.151 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:54:20.151 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:54:20.152 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:54:20.152 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:54:20.152 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:54:20.152 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:54:20.152 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:54:20.152 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:54:20.175 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:54:20.175 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:54:20.176 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:54:20.176 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:54:20.178 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:54:20.178 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:54:20.179 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:54:20.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:54:20.224 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:54:20.224 DEBUG:teuthology.parallel:result is None 2023-12-19T13:54:20.228 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:54:20.228 DEBUG:teuthology.parallel:result is None 2023-12-19T13:54:20.231 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:54:20.231 DEBUG:teuthology.parallel:result is None 2023-12-19T13:54:20.235 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:54:20.235 DEBUG:teuthology.parallel:result is None 2023-12-19T13:54:20.235 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:54:20.382 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:54:20.382 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:54:20.390 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:54:20.393 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:54:20.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.429+0000 7fbd5fedb640 1 Processor -- start 2023-12-19T13:54:20.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.430+0000 7fbd5fedb640 1 -- start start 2023-12-19T13:54:20.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.431+0000 7fbd5fedb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd58157bf0 0x7fbd5815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:20.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.431+0000 7fbd5fedb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5815b740 con 0x7fbd580ae110 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.431+0000 7fbd5fedb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580ae640 con 0x7fbd580b0810 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.431+0000 7fbd5fedb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5806b8c0 con 0x7fbd58157bf0 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.431+0000 7fbd5dc77640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd58157bf0 0x7fbd5815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.431+0000 7fbd5dc77640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd58157bf0 0x7fbd5815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34946/0 (socket says 172.21.15.113:34946) 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.431+0000 7fbd5dc77640 1 -- 172.21.15.113:0/3999483928 learned_addr learned my addr 172.21.15.113:0/3999483928 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.432+0000 7fbd5dc77640 1 -- 172.21.15.113:0/3999483928 >> v1:172.21.15.151:6789/0 conn(0x7fbd580b0810 legacy=0x7fbd5806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.432+0000 7fbd5dc77640 1 -- 172.21.15.113:0/3999483928 >> v1:172.21.15.113:6789/0 conn(0x7fbd580ae110 legacy=0x7fbd580b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:20.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.432+0000 7fbd5dc77640 1 -- 172.21.15.113:0/3999483928 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580ae920 con 0x7fbd58157bf0 2023-12-19T13:54:20.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.433+0000 7fbd5dc77640 1 --2- 172.21.15.113:0/3999483928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5815b200 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009870 tx=0x7fbd5402ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7db1356e04ef06 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:20.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.433+0000 7fbd5cc75640 1 -- 172.21.15.113:0/3999483928 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5402f860 con 0x7fbd58157bf0 2023-12-19T13:54:20.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.433+0000 7fbd5cc75640 1 -- 172.21.15.113:0/3999483928 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5402f9c0 con 0x7fbd58157bf0 2023-12-19T13:54:20.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.433+0000 7fbd5cc75640 1 -- 172.21.15.113:0/3999483928 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5402fd50 con 0x7fbd58157bf0 2023-12-19T13:54:20.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.434+0000 7fbd5fedb640 1 -- 172.21.15.113:0/3999483928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 msgr2=0x7fbd5815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:20.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.434+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/3999483928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5815b200 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009870 tx=0x7fbd5402ba40 comp rx=0 tx=0).stop 2023-12-19T13:54:20.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.434+0000 7fbd5fedb640 1 -- 172.21.15.113:0/3999483928 shutdown_connections 2023-12-19T13:54:20.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.434+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/3999483928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5815b200 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.434+0000 7fbd5fedb640 1 -- 172.21.15.113:0/3999483928 >> 172.21.15.113:0/3999483928 conn(0x7fbd580cbb70 msgr2=0x7fbd580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:20.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.434+0000 7fbd5fedb640 1 -- 172.21.15.113:0/3999483928 shutdown_connections 2023-12-19T13:54:20.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.434+0000 7fbd5fedb640 1 -- 172.21.15.113:0/3999483928 wait complete. 2023-12-19T13:54:20.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.435+0000 7fbd5fedb640 1 Processor -- start 2023-12-19T13:54:20.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.436+0000 7fbd5fedb640 1 -- start start 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.436+0000 7fbd5fedb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd580ae110 0x7fbd581478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.436+0000 7fbd5fedb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd580b0810 0x7fbd5814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.436+0000 7fbd5fedb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.436+0000 7fbd5fedb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5815a530 con 0x7fbd58157bf0 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.436+0000 7fbd5fedb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581596d0 con 0x7fbd580ae110 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.436+0000 7fbd5fedb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581599b0 con 0x7fbd580b0810 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:20.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5814fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34948/0 (socket says 172.21.15.113:34948) 2023-12-19T13:54:20.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5dc77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd580ae110 0x7fbd581478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:20.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 -- 172.21.15.113:0/285171260 learned_addr learned my addr 172.21.15.113:0/285171260 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:20.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5d476640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd580b0810 0x7fbd5814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 -- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd580b0810 msgr2=0x7fbd5814f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd580b0810 0x7fbd5814f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 -- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd580ae110 msgr2=0x7fbd581478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd580ae110 0x7fbd581478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 -- 172.21.15.113:0/285171260 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540094d0 con 0x7fbd58157bf0 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5dc77640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd580ae110 0x7fbd581478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.437+0000 7fbd5e478640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5814fdf0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000c7a0 tx=0x7fbd5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.438+0000 7fbd4e7fc640 1 -- 172.21.15.113:0/285171260 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50003b70 con 0x7fbd58157bf0 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.438+0000 7fbd4e7fc640 1 -- 172.21.15.113:0/285171260 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50003cf0 con 0x7fbd58157bf0 2023-12-19T13:54:20.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.438+0000 7fbd4e7fc640 1 -- 172.21.15.113:0/285171260 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50003ea0 con 0x7fbd58157bf0 2023-12-19T13:54:20.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.438+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd58159c90 con 0x7fbd58157bf0 2023-12-19T13:54:20.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.438+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5815a250 con 0x7fbd58157bf0 2023-12-19T13:54:20.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.439+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5814e630 con 0x7fbd58157bf0 2023-12-19T13:54:20.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.440+0000 7fbd4e7fc640 1 -- 172.21.15.113:0/285171260 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd5000aa90 con 0x7fbd58157bf0 2023-12-19T13:54:20.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.441+0000 7fbd4e7fc640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd3c06a430 0x7fbd3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:20.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.441+0000 7fbd4e7fc640 1 -- 172.21.15.113:0/285171260 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd500883b0 con 0x7fbd58157bf0 2023-12-19T13:54:20.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.441+0000 7fbd5dc77640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd3c06a430 0x7fbd3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:20.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.442+0000 7fbd5dc77640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd3c06a430 0x7fbd3c06c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbd54036000 tx=0x7fbd54008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:20.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.445+0000 7fbd4e7fc640 1 -- 172.21.15.113:0/285171260 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbd50053cb0 con 0x7fbd58157bf0 2023-12-19T13:54:20.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:20.647+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbd580aeeb0 con 0x7fbd58157bf0 2023-12-19T13:54:21.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.428+0000 7fbd4e7fc640 1 -- 172.21.15.113:0/285171260 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v143) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbd500572d0 con 0x7fbd58157bf0 2023-12-19T13:54:21.428 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:54:21.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd3c06a430 msgr2=0x7fbd3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:21.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd3c06a430 0x7fbd3c06c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbd54036000 tx=0x7fbd54008030 comp rx=0 tx=0).stop 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 msgr2=0x7fbd5814fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5814fdf0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000c7a0 tx=0x7fbd5000cc60 comp rx=0 tx=0).stop 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 shutdown_connections 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd3c06a430 0x7fbd3c06c8f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd58157bf0 0x7fbd5814fdf0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd580b0810 0x7fbd5814f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 --2- 172.21.15.113:0/285171260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd580ae110 0x7fbd581478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 >> 172.21.15.113:0/285171260 conn(0x7fbd580cbb70 msgr2=0x7fbd58150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 shutdown_connections 2023-12-19T13:54:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.432+0000 7fbd5fedb640 1 -- 172.21.15.113:0/285171260 wait complete. 2023-12-19T13:54:21.451 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:54:21.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.665+0000 7fdb9d911640 1 Processor -- start 2023-12-19T13:54:21.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.666+0000 7fdb9d911640 1 -- start start 2023-12-19T13:54:21.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.667+0000 7fdb9d911640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb98146e30 0x7fdb980b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:21.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.667+0000 7fdb9d911640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb980d0c60 0x7fdb9815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:21.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.667+0000 7fdb9d911640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb980d1070 con 0x7fdb980b7ea0 2023-12-19T13:54:21.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.667+0000 7fdb9d911640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb98147210 con 0x7fdb98146e30 2023-12-19T13:54:21.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.667+0000 7fdb9d911640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb980b8330 con 0x7fdb980d0c60 2023-12-19T13:54:21.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.667+0000 7fdb9c90f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb98146e30 0x7fdb980b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:21.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.668+0000 7fdb9c90f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb98146e30 0x7fdb980b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34958/0 (socket says 172.21.15.113:34958) 2023-12-19T13:54:21.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.668+0000 7fdb9c90f640 1 -- 172.21.15.113:0/4213647393 learned_addr learned my addr 172.21.15.113:0/4213647393 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:21.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.668+0000 7fdb9c90f640 1 -- 172.21.15.113:0/4213647393 >> v2:172.21.15.151:3300/0 conn(0x7fdb980d0c60 msgr2=0x7fdb9815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:21.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.668+0000 7fdb9c90f640 1 --2- 172.21.15.113:0/4213647393 >> v2:172.21.15.151:3300/0 conn(0x7fdb980d0c60 0x7fdb9815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.668+0000 7fdb9c90f640 1 -- 172.21.15.113:0/4213647393 >> v1:172.21.15.151:6789/0 conn(0x7fdb980b7ea0 legacy=0x7fdb980d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:21.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.668+0000 7fdb9c90f640 1 -- 172.21.15.113:0/4213647393 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980d12d0 con 0x7fdb98146e30 2023-12-19T13:54:21.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.669+0000 7fdb9c90f640 1 --2- 172.21.15.113:0/4213647393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb98146e30 0x7fdb980b7960 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fdb980b6450 tx=0x7fdb8802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74c95e22cd9042f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:21.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.669+0000 7fdb977fe640 1 -- 172.21.15.113:0/4213647393 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb880317e0 con 0x7fdb98146e30 2023-12-19T13:54:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.669+0000 7fdb977fe640 1 -- 172.21.15.113:0/4213647393 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb88031940 con 0x7fdb98146e30 2023-12-19T13:54:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.669+0000 7fdb977fe640 1 -- 172.21.15.113:0/4213647393 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88031cd0 con 0x7fdb98146e30 2023-12-19T13:54:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 -- 172.21.15.113:0/4213647393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb98146e30 msgr2=0x7fdb980b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:21.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 --2- 172.21.15.113:0/4213647393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb98146e30 0x7fdb980b7960 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fdb980b6450 tx=0x7fdb8802b880 comp rx=0 tx=0).stop 2023-12-19T13:54:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 -- 172.21.15.113:0/4213647393 shutdown_connections 2023-12-19T13:54:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 --2- 172.21.15.113:0/4213647393 >> v2:172.21.15.151:3300/0 conn(0x7fdb980d0c60 0x7fdb9815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 --2- 172.21.15.113:0/4213647393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb98146e30 0x7fdb980b7960 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 -- 172.21.15.113:0/4213647393 >> 172.21.15.113:0/4213647393 conn(0x7fdb980b2990 msgr2=0x7fdb980b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 -- 172.21.15.113:0/4213647393 shutdown_connections 2023-12-19T13:54:21.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.670+0000 7fdb9d911640 1 -- 172.21.15.113:0/4213647393 wait complete. 2023-12-19T13:54:21.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.672+0000 7fdb9d911640 1 Processor -- start 2023-12-19T13:54:21.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.672+0000 7fdb9d911640 1 -- start start 2023-12-19T13:54:21.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.673+0000 7fdb9d911640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb980b7ea0 0x7fdb980c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:21.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.673+0000 7fdb9d911640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb980d0c60 0x7fdb981410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.673+0000 7fdb9d911640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb98146e30 0x7fdb980ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.673+0000 7fdb9d911640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb98140ca0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.673+0000 7fdb9d911640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb981e5b50 con 0x7fdb980d0c60 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.673+0000 7fdb9d911640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb98140390 con 0x7fdb98146e30 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb980b7ea0 0x7fdb980c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb980b7ea0 0x7fdb980c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34966/0 (socket says 172.21.15.113:34966) 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 -- 172.21.15.113:0/1534998855 learned_addr learned my addr 172.21.15.113:0/1534998855 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 -- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb98146e30 msgr2=0x7fdb980ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb97fff640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb980d0c60 0x7fdb981410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9d110640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb98146e30 0x7fdb980ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb98146e30 0x7fdb980ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 -- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb980d0c60 msgr2=0x7fdb981410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:21.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb980d0c60 0x7fdb981410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9c90f640 1 -- 172.21.15.113:0/1534998855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb880094d0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb97fff640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb980d0c60 0x7fdb981410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:21.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.674+0000 7fdb9d110640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb98146e30 0x7fdb980ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:21.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.675+0000 7fdb9c90f640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb980b7ea0 0x7fdb980c8980 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fdb8802b8c0 tx=0x7fdb880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:21.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.675+0000 7fdb957fa640 1 -- 172.21.15.113:0/1534998855 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88032940 con 0x7fdb980b7ea0 2023-12-19T13:54:21.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.675+0000 7fdb957fa640 1 -- 172.21.15.113:0/1534998855 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb88032aa0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.675+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb980c8f60 con 0x7fdb980b7ea0 2023-12-19T13:54:21.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.675+0000 7fdb957fa640 1 -- 172.21.15.113:0/1534998855 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88032e50 con 0x7fdb980b7ea0 2023-12-19T13:54:21.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.675+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb981408c0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.676+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb98140de0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.677+0000 7fdb957fa640 1 -- 172.21.15.113:0/1534998855 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb8804e450 con 0x7fdb980b7ea0 2023-12-19T13:54:21.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.678+0000 7fdb957fa640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb8406a430 0x7fdb8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:21.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.678+0000 7fdb957fa640 1 -- 172.21.15.113:0/1534998855 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb880aa800 con 0x7fdb980b7ea0 2023-12-19T13:54:21.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.678+0000 7fdb97fff640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb8406a430 0x7fdb8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:21.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.679+0000 7fdb97fff640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb8406a430 0x7fdb8406c8f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0016b0 tx=0x7fdb8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:21.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.682+0000 7fdb957fa640 1 -- 172.21.15.113:0/1534998855 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb98140de0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.940+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdb98140de0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.942+0000 7fdb957fa640 1 -- 172.21.15.113:0/1534998855 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdb98140de0 con 0x7fdb980b7ea0 2023-12-19T13:54:21.941 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:21.941 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:21.941 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:54:21.941 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.941 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:54:21.942 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.943 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.944 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.945 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.946 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.947 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.948 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:54:21.949 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.950 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:54:21.953 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.955 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.955 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:54:21.955 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:54:21.956 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.956 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:54:21.956 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:54:21.956 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:54:21.956 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:21.957 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:21.958 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:21.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb8406a430 msgr2=0x7fdb8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb8406a430 0x7fdb8406c8f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0016b0 tx=0x7fdb8c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb980b7ea0 msgr2=0x7fdb980c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb980b7ea0 0x7fdb980c8980 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fdb8802b8c0 tx=0x7fdb880046c0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 shutdown_connections 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb8406a430 0x7fdb8406c8f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb98146e30 0x7fdb980ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb980d0c60 0x7fdb981410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 --2- 172.21.15.113:0/1534998855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb980b7ea0 0x7fdb980c8980 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 >> 172.21.15.113:0/1534998855 conn(0x7fdb980b2990 msgr2=0x7fdb98144530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 shutdown_connections 2023-12-19T13:54:21.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:21.944+0000 7fdb9d911640 1 -- 172.21.15.113:0/1534998855 wait complete. 2023-12-19T13:54:21.963 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:22.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.176+0000 7f06c850a640 1 Processor -- start 2023-12-19T13:54:22.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.176+0000 7f06c850a640 1 -- start start 2023-12-19T13:54:22.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c850a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06c00b0b50 0x7f06c006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c850a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f06c006b590 0x7f06c006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c850a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c006bb30 con 0x7f06c01449e0 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c850a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00b0070 con 0x7f06c00b0b50 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c850a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00b0350 con 0x7f06c006b590 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c5aa5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06c00b0b50 0x7f06c006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c5aa5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06c00b0b50 0x7f06c006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34972/0 (socket says 172.21.15.113:34972) 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c5aa5640 1 -- 172.21.15.113:0/1873005374 learned_addr learned my addr 172.21.15.113:0/1873005374 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c5aa5640 1 -- 172.21.15.113:0/1873005374 >> v2:172.21.15.151:3300/0 conn(0x7f06c006b590 msgr2=0x7f06c006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c5aa5640 1 --2- 172.21.15.113:0/1873005374 >> v2:172.21.15.151:3300/0 conn(0x7f06c006b590 0x7f06c006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c5aa5640 1 -- 172.21.15.113:0/1873005374 >> v1:172.21.15.151:6789/0 conn(0x7f06c01449e0 legacy=0x7f06c00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:22.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.178+0000 7f06c5aa5640 1 -- 172.21.15.113:0/1873005374 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00b0630 con 0x7f06c00b0b50 2023-12-19T13:54:22.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.180+0000 7f06c5aa5640 1 --2- 172.21.15.113:0/1873005374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c00b0b50 0x7f06c006bfa0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b1270 tx=0x7f06b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470112d992f60ecd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:22.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.180+0000 7f06c52a4640 1 -- 172.21.15.113:0/1873005374 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0031870 con 0x7f06c00b0b50 2023-12-19T13:54:22.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.180+0000 7f06c52a4640 1 -- 172.21.15.113:0/1873005374 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b00319d0 con 0x7f06c00b0b50 2023-12-19T13:54:22.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.180+0000 7f06c52a4640 1 -- 172.21.15.113:0/1873005374 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0031d60 con 0x7f06c00b0b50 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.180+0000 7f06c850a640 1 -- 172.21.15.113:0/1873005374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c00b0b50 msgr2=0x7f06c006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.180+0000 7f06c850a640 1 --2- 172.21.15.113:0/1873005374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c00b0b50 0x7f06c006bfa0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b1270 tx=0x7f06b002b910 comp rx=0 tx=0).stop 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.181+0000 7f06c850a640 1 -- 172.21.15.113:0/1873005374 shutdown_connections 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.181+0000 7f06c850a640 1 --2- 172.21.15.113:0/1873005374 >> v2:172.21.15.151:3300/0 conn(0x7f06c006b590 0x7f06c006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.181+0000 7f06c850a640 1 --2- 172.21.15.113:0/1873005374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c00b0b50 0x7f06c006bfa0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.181+0000 7f06c850a640 1 -- 172.21.15.113:0/1873005374 >> 172.21.15.113:0/1873005374 conn(0x7f06c00cbb70 msgr2=0x7f06c00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.181+0000 7f06c850a640 1 -- 172.21.15.113:0/1873005374 shutdown_connections 2023-12-19T13:54:22.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.181+0000 7f06c850a640 1 -- 172.21.15.113:0/1873005374 wait complete. 2023-12-19T13:54:22.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.182+0000 7f06c850a640 1 Processor -- start 2023-12-19T13:54:22.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.183+0000 7f06c850a640 1 -- start start 2023-12-19T13:54:22.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.183+0000 7f06c850a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c006b590 0x7f06c0159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.183+0000 7f06c850a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c00b0b50 0x7f06c013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c850a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c01449e0 0x7f06c01f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c850a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c013ff40 con 0x7f06c006b590 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c850a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c015a250 con 0x7f06c00b0b50 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c850a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c013f330 con 0x7f06c01449e0 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c006b590 0x7f06c0159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c006b590 0x7f06c0159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34980/0 (socket says 172.21.15.113:34980) 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 -- 172.21.15.113:0/3780041265 learned_addr learned my addr 172.21.15.113:0/3780041265 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 -- 172.21.15.113:0/3780041265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c01449e0 msgr2=0x7f06c01f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c01449e0 0x7f06c01f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 -- 172.21.15.113:0/3780041265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c00b0b50 msgr2=0x7f06c013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c5aa5640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c00b0b50 0x7f06c013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c00b0b50 0x7f06c013ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.184+0000 7f06c62a6640 1 -- 172.21.15.113:0/3780041265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00094d0 con 0x7f06c006b590 2023-12-19T13:54:22.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.185+0000 7f06c62a6640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c006b590 0x7f06c0159d10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b3e0 tx=0x7f06bc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:22.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.185+0000 7f06b6ffd640 1 -- 172.21.15.113:0/3780041265 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc011830 con 0x7f06c006b590 2023-12-19T13:54:22.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.185+0000 7f06b6ffd640 1 -- 172.21.15.113:0/3780041265 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc0119b0 con 0x7f06c006b590 2023-12-19T13:54:22.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.185+0000 7f06b6ffd640 1 -- 172.21.15.113:0/3780041265 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc011d60 con 0x7f06c006b590 2023-12-19T13:54:22.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.185+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c013f610 con 0x7f06c006b590 2023-12-19T13:54:22.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.185+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c013fbd0 con 0x7f06c006b590 2023-12-19T13:54:22.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.186+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c013e850 con 0x7f06c006b590 2023-12-19T13:54:22.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.187+0000 7f06b6ffd640 1 -- 172.21.15.113:0/3780041265 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06bc01a400 con 0x7f06c006b590 2023-12-19T13:54:22.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.188+0000 7f06b6ffd640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06a406a460 0x7f06a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.188+0000 7f06b6ffd640 1 -- 172.21.15.113:0/3780041265 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06bc088820 con 0x7f06c006b590 2023-12-19T13:54:22.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.188+0000 7f06c5aa5640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06a406a460 0x7f06a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.189+0000 7f06c5aa5640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06a406a460 0x7f06a406c920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f06b0036000 tx=0x7f06b003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:22.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.192+0000 7f06b6ffd640 1 -- 172.21.15.113:0/3780041265 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f06bc0540c0 con 0x7f06c006b590 2023-12-19T13:54:22.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.376+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c0061910 con 0x7f06c006b590 2023-12-19T13:54:22.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.378+0000 7f06b6ffd640 1 -- 172.21.15.113:0/3780041265 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+12448 (secure 0 0 0) 0x7f06bc015090 con 0x7f06c006b590 2023-12-19T13:54:22.378 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:22.378 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":143,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:54:21.415382+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:22.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.380+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06a406a460 msgr2=0x7f06a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.380+0000 7f06c850a640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06a406a460 0x7f06a406c920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f06b0036000 tx=0x7f06b003c040 comp rx=0 tx=0).stop 2023-12-19T13:54:22.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.380+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c006b590 msgr2=0x7f06c0159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.380+0000 7f06c850a640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c006b590 0x7f06c0159d10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b3e0 tx=0x7f06bc00b8a0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 shutdown_connections 2023-12-19T13:54:22.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f06a406a460 0x7f06a406c920 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06c01449e0 0x7f06c01f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06c00b0b50 0x7f06c013ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 --2- 172.21.15.113:0/3780041265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06c006b590 0x7f06c0159d10 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 >> 172.21.15.113:0/3780041265 conn(0x7f06c00cbb70 msgr2=0x7f06c00b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:22.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 shutdown_connections 2023-12-19T13:54:22.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.381+0000 7f06c850a640 1 -- 172.21.15.113:0/3780041265 wait complete. 2023-12-19T13:54:22.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:54:22.399 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:54:22.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.609+0000 7f9c5a5c4640 1 Processor -- start 2023-12-19T13:54:22.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.609+0000 7f9c5a5c4640 1 -- start start 2023-12-19T13:54:22.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.610+0000 7f9c5a5c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 0x7f9c540b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.610+0000 7f9c5a5c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5415fde0 con 0x7f9c540b2760 2023-12-19T13:54:22.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.611+0000 7f9c5a5c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540b2bc0 con 0x7f9c5415b1d0 2023-12-19T13:54:22.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.611+0000 7f9c5a5c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540b2400 con 0x7f9c540cf5b0 2023-12-19T13:54:22.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.611+0000 7f9c4bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9c540b2760 0x7f9c540ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59474/0 (socket says 172.21.15.113:59474) 2023-12-19T13:54:22.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.611+0000 7f9c4bfff640 1 -- 172.21.15.113:0/3289390470 learned_addr learned my addr 172.21.15.113:0/3289390470 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:22.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.611+0000 7f9c58b61640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 0x7f9c540b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.611+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473782139 0 0) 0x7f9c5415fde0 con 0x7f9c540b2760 2023-12-19T13:54:22.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.611+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c40003520 con 0x7f9c540b2760 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2735885537 0 0) 0x7f9c40003520 con 0x7f9c540b2760 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 msgr2=0x7f9c540b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 0x7f9c540b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 >> v1:172.21.15.151:6789/0 conn(0x7f9c5415b1d0 legacy=0x7f9c5415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5415ef10 con 0x7f9c540b2760 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9c3c001670 con 0x7f9c540b2760 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 >> v1:172.21.15.113:6789/0 conn(0x7f9c540b2760 legacy=0x7f9c540ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 0x7f9c40003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c40004090 0x7f9c400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004d70 0x7f9c400051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4000bbb0 con 0x7f9c40004090 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4000bd20 con 0x7f9c40004d70 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4000bee0 con 0x7f9c540cf5b0 2023-12-19T13:54:22.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c4bfff640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c40004090 0x7f9c400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c53fff640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 0x7f9c40003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c4bfff640 1 -- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 msgr2=0x7f9c40003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:22.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c4bfff640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c540cf5b0 0x7f9c40003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c4bfff640 1 -- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004d70 msgr2=0x7f9c400051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:22.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c58b61640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004d70 0x7f9c400051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c4bfff640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004d70 0x7f9c400051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.612+0000 7f9c4bfff640 1 -- 172.21.15.113:0/3289390470 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c40003520 con 0x7f9c40004090 2023-12-19T13:54:22.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.614+0000 7f9c4bfff640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c40004090 0x7f9c400047c0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c0e0 tx=0x7f9c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d9e74d865a3114 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:22.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.614+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c005ad0 con 0x7f9c40004090 2023-12-19T13:54:22.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.614+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c005c30 con 0x7f9c40004090 2023-12-19T13:54:22.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.614+0000 7f9c537fe640 1 -- 172.21.15.113:0/3289390470 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c02c7d0 con 0x7f9c40004090 2023-12-19T13:54:22.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.615+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3289390470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c40004090 msgr2=0x7f9c400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.615+0000 7f9c5a5c4640 1 --2- 172.21.15.113:0/3289390470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c40004090 0x7f9c400047c0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c0e0 tx=0x7f9c400057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.615+0000 7f9c58b61640 1 -- 172.21.15.113:0/3289390470 reap_dead start 2023-12-19T13:54:22.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.615+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3289390470 shutdown_connections 2023-12-19T13:54:22.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.615+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3289390470 >> 172.21.15.113:0/3289390470 conn(0x7f9c54073150 msgr2=0x7f9c540659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:22.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.615+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3289390470 shutdown_connections 2023-12-19T13:54:22.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.615+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3289390470 wait complete. 2023-12-19T13:54:22.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.616+0000 7f9c5a5c4640 1 Processor -- start 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.617+0000 7f9c5a5c4640 1 -- start start 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c5a5c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004090 0x7f9c540ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c5a5c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c54156ed0 0x7f9c54146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c5a5c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54157350 0x7f9c541f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c5a5c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541f1bd0 con 0x7f9c54157350 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c5a5c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540caef0 con 0x7f9c40004090 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c5a5c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541f1330 con 0x7f9c54156ed0 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54157350 0x7f9c541f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54157350 0x7f9c541f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34996/0 (socket says 172.21.15.113:34996) 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 -- 172.21.15.113:0/3599617993 learned_addr learned my addr 172.21.15.113:0/3599617993 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c53fff640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004090 0x7f9c540ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c4bfff640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c54156ed0 0x7f9c54146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 -- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c54156ed0 msgr2=0x7f9c54146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c54156ed0 0x7f9c54146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 -- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004090 msgr2=0x7f9c540ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004090 0x7f9c540ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.618+0000 7f9c58b61640 1 -- 172.21.15.113:0/3599617993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c541f1610 con 0x7f9c54157350 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.619+0000 7f9c58b61640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54157350 0x7f9c541f4190 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f9c540b1180 tx=0x7f9c4c009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.619+0000 7f9c517fa640 1 -- 172.21.15.113:0/3599617993 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c007d20 con 0x7f9c54157350 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.619+0000 7f9c517fa640 1 -- 172.21.15.113:0/3599617993 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c014400 con 0x7f9c54157350 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.619+0000 7f9c517fa640 1 -- 172.21.15.113:0/3599617993 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c007ea0 con 0x7f9c54157350 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.619+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c541f18f0 con 0x7f9c54157350 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.619+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54146ec0 con 0x7f9c54157350 2023-12-19T13:54:22.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.620+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c541462c0 con 0x7f9c54157350 2023-12-19T13:54:22.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.622+0000 7f9c517fa640 1 -- 172.21.15.113:0/3599617993 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c4c01d3b0 con 0x7f9c54157350 2023-12-19T13:54:22.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.622+0000 7f9c517fa640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c3406a430 0x7f9c3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:22.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.622+0000 7f9c517fa640 1 -- 172.21.15.113:0/3599617993 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c4c0883a0 con 0x7f9c54157350 2023-12-19T13:54:22.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.623+0000 7f9c53fff640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c3406a430 0x7f9c3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:22.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.623+0000 7f9c53fff640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c3406a430 0x7f9c3406c8f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9c44007fd0 tx=0x7f9c44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:22.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.627+0000 7f9c517fa640 1 -- 172.21.15.113:0/3599617993 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c541462c0 con 0x7f9c54157350 2023-12-19T13:54:22.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.803+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c541466a0 con 0x7f9c54157350 2023-12-19T13:54:22.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.804+0000 7f9c517fa640 1 -- 172.21.15.113:0/3599617993 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v143) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c541466a0 con 0x7f9c54157350 2023-12-19T13:54:22.804 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c3406a430 msgr2=0x7f9c3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c3406a430 0x7f9c3406c8f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9c44007fd0 tx=0x7f9c44009040 comp rx=0 tx=0).stop 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54157350 msgr2=0x7f9c541f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54157350 0x7f9c541f4190 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f9c540b1180 tx=0x7f9c4c009d30 comp rx=0 tx=0).stop 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 shutdown_connections 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c3406a430 0x7f9c3406c8f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54157350 0x7f9c541f4190 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c54156ed0 0x7f9c54146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 --2- 172.21.15.113:0/3599617993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c40004090 0x7f9c540ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:22.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 >> 172.21.15.113:0/3599617993 conn(0x7f9c54073150 msgr2=0x7f9c5415e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:22.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 shutdown_connections 2023-12-19T13:54:22.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:22.807+0000 7f9c5a5c4640 1 -- 172.21.15.113:0/3599617993 wait complete. 2023-12-19T13:54:22.823 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:54:23.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.015+0000 7f7e4c6b6640 1 Processor -- start 2023-12-19T13:54:23.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.016+0000 7f7e4c6b6640 1 -- start start 2023-12-19T13:54:23.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4c6b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e44158df0 0x7f7e4415c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4c6b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e4406d850 0x7f7e4406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4c6b6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e44070130 con 0x7f7e4406f160 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4c6b6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4406e1a0 con 0x7f7e4406d850 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4c6b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4406f5e0 con 0x7f7e44158df0 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4ac53640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e4406d850 0x7f7e4406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4ac53640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e4406d850 0x7f7e4406dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35004/0 (socket says 172.21.15.113:35004) 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.017+0000 7f7e4ac53640 1 -- 172.21.15.113:0/938903026 learned_addr learned my addr 172.21.15.113:0/938903026 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.018+0000 7f7e4a452640 1 --2- 172.21.15.113:0/938903026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e44158df0 0x7f7e4415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.018+0000 7f7e4ac53640 1 -- 172.21.15.113:0/938903026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e44158df0 msgr2=0x7f7e4415c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.018+0000 7f7e4ac53640 1 --2- 172.21.15.113:0/938903026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e44158df0 0x7f7e4415c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.018+0000 7f7e4ac53640 1 -- 172.21.15.113:0/938903026 >> v1:172.21.15.113:6789/0 conn(0x7f7e4406f160 legacy=0x7f7e440cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.018+0000 7f7e4ac53640 1 -- 172.21.15.113:0/938903026 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4406f890 con 0x7f7e4406d850 2023-12-19T13:54:23.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.018+0000 7f7e49450640 1 -- 172.21.15.113:0/938903026 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274747353 0 0) 0x7f7e44070130 con 0x7f7e4406f160 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.019+0000 7f7e4ac53640 1 --2- 172.21.15.113:0/938903026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406d850 0x7f7e4406dc60 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009e50 tx=0x7f7e3c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4459ebe5c5e76bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.019+0000 7f7e49450640 1 -- 172.21.15.113:0/938903026 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c02ca70 con 0x7f7e4406d850 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.019+0000 7f7e49450640 1 -- 172.21.15.113:0/938903026 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c02cbd0 con 0x7f7e4406d850 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.019+0000 7f7e49450640 1 -- 172.21.15.113:0/938903026 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0343f0 con 0x7f7e4406d850 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/938903026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406d850 msgr2=0x7f7e4406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/938903026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406d850 0x7f7e4406dc60 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009e50 tx=0x7f7e3c02bed0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/938903026 shutdown_connections 2023-12-19T13:54:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/938903026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406d850 0x7f7e4406dc60 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/938903026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e44158df0 0x7f7e4415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/938903026 >> 172.21.15.113:0/938903026 conn(0x7f7e440cf0b0 msgr2=0x7f7e440cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:23.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/938903026 shutdown_connections 2023-12-19T13:54:23.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.020+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/938903026 wait complete. 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.022+0000 7f7e4c6b6640 1 Processor -- start 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.022+0000 7f7e4c6b6640 1 -- start start 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e4c6b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4406d850 0x7f7e441f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e4c6b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406f160 0x7f7e440a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e4c6b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e44158df0 0x7f7e44146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e4c6b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e441f1770 con 0x7f7e4406f160 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e4c6b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440a89e0 con 0x7f7e44158df0 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e4c6b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44147090 con 0x7f7e4406d850 2023-12-19T13:54:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406f160 0x7f7e440a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406f160 0x7f7e440a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35016/0 (socket says 172.21.15.113:35016) 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 -- 172.21.15.113:0/1487336553 learned_addr learned my addr 172.21.15.113:0/1487336553 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e4a452640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4406d850 0x7f7e441f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 -- 172.21.15.113:0/1487336553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4406d850 msgr2=0x7f7e441f1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4406d850 0x7f7e441f1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 -- 172.21.15.113:0/1487336553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e44158df0 msgr2=0x7f7e44146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e44158df0 0x7f7e44146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.023+0000 7f7e49c51640 1 -- 172.21.15.113:0/1487336553 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009b30 con 0x7f7e4406f160 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.024+0000 7f7e49c51640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406f160 0x7f7e440a84a0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c410 tx=0x7f7e3400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.024+0000 7f7e3affd640 1 -- 172.21.15.113:0/1487336553 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e340035f0 con 0x7f7e4406f160 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.024+0000 7f7e3affd640 1 -- 172.21.15.113:0/1487336553 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34003770 con 0x7f7e4406f160 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.024+0000 7f7e3affd640 1 -- 172.21.15.113:0/1487336553 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34003b20 con 0x7f7e4406f160 2023-12-19T13:54:23.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.024+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e440a8bd0 con 0x7f7e4406f160 2023-12-19T13:54:23.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.024+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e440a9190 con 0x7f7e4406f160 2023-12-19T13:54:23.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.025+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e44074770 con 0x7f7e4406f160 2023-12-19T13:54:23.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.026+0000 7f7e3affd640 1 -- 172.21.15.113:0/1487336553 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e34003c80 con 0x7f7e4406f160 2023-12-19T13:54:23.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.027+0000 7f7e3affd640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e2806a430 0x7f7e2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.027+0000 7f7e3affd640 1 -- 172.21.15.113:0/1487336553 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e34087cb0 con 0x7f7e4406f160 2023-12-19T13:54:23.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.027+0000 7f7e4a452640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e2806a430 0x7f7e2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.028+0000 7f7e4a452640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e2806a430 0x7f7e2806c8f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006fd0 tx=0x7f7e40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:23.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.031+0000 7f7e3affd640 1 -- 172.21.15.113:0/1487336553 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e34053550 con 0x7f7e4406f160 2023-12-19T13:54:23.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.205+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7e440705f0 con 0x7f7e4406f160 2023-12-19T13:54:23.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.206+0000 7f7e3affd640 1 -- 172.21.15.113:0/1487336553 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v143) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7e34017090 con 0x7f7e4406f160 2023-12-19T13:54:23.205 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:23.205 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:54:23.205 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:23.206 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:54:23.206 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:54:23.206 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:23.206 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e2806a430 msgr2=0x7f7e2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e2806a430 0x7f7e2806c8f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006fd0 tx=0x7f7e40008040 comp rx=0 tx=0).stop 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406f160 msgr2=0x7f7e440a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406f160 0x7f7e440a84a0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c410 tx=0x7f7e3400c8d0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 shutdown_connections 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e2806a430 0x7f7e2806c8f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e44158df0 0x7f7e44146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e4406f160 0x7f7e440a84a0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 --2- 172.21.15.113:0/1487336553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4406d850 0x7f7e441f1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 >> 172.21.15.113:0/1487336553 conn(0x7f7e440cf0b0 msgr2=0x7f7e44070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 shutdown_connections 2023-12-19T13:54:23.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.208+0000 7f7e4c6b6640 1 -- 172.21.15.113:0/1487336553 wait complete. 2023-12-19T13:54:23.225 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:54:23.226 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:54:23.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.441+0000 7f8925577640 1 Processor -- start 2023-12-19T13:54:23.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.442+0000 7f8925577640 1 -- start start 2023-12-19T13:54:23.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.443+0000 7f8925577640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89200d3820 0x7f8920168350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.443+0000 7f8925577640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200d07c0 con 0x7f89200b1d90 2023-12-19T13:54:23.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.443+0000 7f8925577640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200d25c0 con 0x7f892015d4e0 2023-12-19T13:54:23.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.443+0000 7f8925577640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89200ce7b0 con 0x7f89200d3820 2023-12-19T13:54:23.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.443+0000 7f891f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f89200b1d90 0x7f89200d3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59492/0 (socket says 172.21.15.113:59492) 2023-12-19T13:54:23.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.443+0000 7f891f7fe640 1 -- 172.21.15.113:0/903921705 learned_addr learned my addr 172.21.15.113:0/903921705 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:23.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629719911 0 0) 0x7f89200d07c0 con 0x7f89200b1d90 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f8924d76640 1 --2- 172.21.15.113:0/903921705 >> v2:172.21.15.151:3300/0 conn(0x7f89200d3820 0x7f8920168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f890c003520 con 0x7f89200b1d90 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3859209234 0 0) 0x7f890c003520 con 0x7f89200b1d90 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 >> v2:172.21.15.151:3300/0 conn(0x7f89200d3820 msgr2=0x7f8920168350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 --2- 172.21.15.113:0/903921705 >> v2:172.21.15.151:3300/0 conn(0x7f89200d3820 0x7f8920168350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 >> v1:172.21.15.151:6789/0 conn(0x7f892015d4e0 legacy=0x7f89200b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892015d8c0 con 0x7f89200b1d90 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8908001670 con 0x7f89200b1d90 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 >> v1:172.21.15.113:6789/0 conn(0x7f89200b1d90 legacy=0x7f89200d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f890c0039c0 0x7f890c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0047c0 0x7f890c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890c0051d0 0x7f890c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200ce7b0 con 0x7f890c0039c0 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c00c100 con 0x7f890c0051d0 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.444+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c00c2c0 con 0x7f890c0047c0 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f891ffff640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f890c0039c0 0x7f890c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f891f7fe640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0047c0 0x7f890c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f891ffff640 1 -- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0047c0 msgr2=0x7f890c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f891ffff640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0047c0 0x7f890c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f891ffff640 1 -- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890c0051d0 msgr2=0x7f890c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f8924d76640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890c0051d0 0x7f890c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f891ffff640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890c0051d0 0x7f890c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f891ffff640 1 -- 172.21.15.113:0/903921705 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c003520 con 0x7f890c0039c0 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f8924d76640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890c0051d0 0x7f890c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.445+0000 7f8924d76640 1 -- 172.21.15.113:0/903921705 reap_dead start 2023-12-19T13:54:23.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.446+0000 7f891ffff640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f890c0039c0 0x7f890c003dc0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8910001d20 tx=0x7f890c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d70e7486911a70 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:23.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.446+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910003b90 con 0x7f890c0039c0 2023-12-19T13:54:23.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8910003d10 con 0x7f890c0039c0 2023-12-19T13:54:23.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f891effd640 1 -- 172.21.15.113:0/903921705 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100052b0 con 0x7f890c0039c0 2023-12-19T13:54:23.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f8925577640 1 -- 172.21.15.113:0/903921705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f890c0039c0 msgr2=0x7f890c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f8925577640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f890c0039c0 0x7f890c003dc0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8910001d20 tx=0x7f890c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f8925577640 1 -- 172.21.15.113:0/903921705 shutdown_connections 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f8925577640 1 --2- 172.21.15.113:0/903921705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f890c0039c0 0x7f890c003dc0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f8925577640 1 -- 172.21.15.113:0/903921705 >> 172.21.15.113:0/903921705 conn(0x7f8920072f40 msgr2=0x7f8920073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f8925577640 1 -- 172.21.15.113:0/903921705 shutdown_connections 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.447+0000 7f8925577640 1 -- 172.21.15.113:0/903921705 wait complete. 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.449+0000 7f8925577640 1 Processor -- start 2023-12-19T13:54:23.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.449+0000 7f8925577640 1 -- start start 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.450+0000 7f8925577640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0039c0 0x7f89201f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.450+0000 7f8925577640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89200b7da0 0x7f89200aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.450+0000 7f8925577640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89200b8220 0x7f89200aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.450+0000 7f8925577640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200b52f0 con 0x7f89200b7da0 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.450+0000 7f8925577640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200b55d0 con 0x7f89200b8220 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.450+0000 7f8925577640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200b58b0 con 0x7f890c0039c0 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.450+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89200b7da0 0x7f89200aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89200b7da0 0x7f89200aa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35028/0 (socket says 172.21.15.113:35028) 2023-12-19T13:54:23.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 -- 172.21.15.113:0/3890228800 learned_addr learned my addr 172.21.15.113:0/3890228800 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891ffff640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0039c0 0x7f89201f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f8924d76640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89200b8220 0x7f89200aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 -- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0039c0 msgr2=0x7f89201f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0039c0 0x7f89201f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 -- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89200b8220 msgr2=0x7f89200aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89200b8220 0x7f89200aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 -- 172.21.15.113:0/3890228800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200b5b90 con 0x7f89200b7da0 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891ffff640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0039c0 0x7f89201f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.451+0000 7f891f7fe640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89200b7da0 0x7f89200aa2c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f890800d7a0 tx=0x7f890800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.452+0000 7f891cff9640 1 -- 172.21.15.113:0/3890228800 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080074e0 con 0x7f89200b7da0 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.452+0000 7f891cff9640 1 -- 172.21.15.113:0/3890228800 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8908007640 con 0x7f89200b7da0 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.452+0000 7f891cff9640 1 -- 172.21.15.113:0/3890228800 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080049e0 con 0x7f89200b7da0 2023-12-19T13:54:23.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.452+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89200b5e70 con 0x7f89200b7da0 2023-12-19T13:54:23.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.452+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89201f4160 con 0x7f89200b7da0 2023-12-19T13:54:23.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.453+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920061910 con 0x7f89200b7da0 2023-12-19T13:54:23.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.454+0000 7f891cff9640 1 -- 172.21.15.113:0/3890228800 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8908004b40 con 0x7f89200b7da0 2023-12-19T13:54:23.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.455+0000 7f891cff9640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f890006a430 0x7f890006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:23.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.455+0000 7f891cff9640 1 -- 172.21.15.113:0/3890228800 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8908087d50 con 0x7f89200b7da0 2023-12-19T13:54:23.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.455+0000 7f891ffff640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f890006a430 0x7f890006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:23.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.456+0000 7f891ffff640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f890006a430 0x7f890006c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8910034000 tx=0x7f8910009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:23.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.459+0000 7f891cff9640 1 -- 172.21.15.113:0/3890228800 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89080535f0 con 0x7f89200b7da0 2023-12-19T13:54:23.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:23.649+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f89201f4160 con 0x7f89200b7da0 2023-12-19T13:54:24.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.592+0000 7f891cff9640 1 -- 172.21.15.113:0/3890228800 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v144) v1 ==== 138+0+0 (secure 0 0 0) 0x7f89201f4160 con 0x7f89200b7da0 2023-12-19T13:54:24.592 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:54:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.598+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f890006a430 msgr2=0x7f890006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.598+0000 7f8925577640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f890006a430 0x7f890006c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8910034000 tx=0x7f8910009030 comp rx=0 tx=0).stop 2023-12-19T13:54:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.598+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89200b7da0 msgr2=0x7f89200aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.598+0000 7f8925577640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89200b7da0 0x7f89200aa2c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f890800d7a0 tx=0x7f890800dc60 comp rx=0 tx=0).stop 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 shutdown_connections 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f890006a430 0x7f890006c8f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89200b8220 0x7f89200aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89200b7da0 0x7f89200aa2c0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 --2- 172.21.15.113:0/3890228800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f890c0039c0 0x7f89201f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 >> 172.21.15.113:0/3890228800 conn(0x7f8920072f40 msgr2=0x7f89200d1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 shutdown_connections 2023-12-19T13:54:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.599+0000 7f8925577640 1 -- 172.21.15.113:0/3890228800 wait complete. 2023-12-19T13:54:24.621 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:54:24.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.841+0000 7f02c64b6640 1 Processor -- start 2023-12-19T13:54:24.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.841+0000 7f02c64b6640 1 -- start start 2023-12-19T13:54:24.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.842+0000 7f02c64b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 0x7f02c00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:24.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c64b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f02c0071210 0x7f02c006b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:24.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c64b6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c00cc1f0 con 0x7f02c00ce830 2023-12-19T13:54:24.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c64b6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c006e840 con 0x7f02c0071210 2023-12-19T13:54:24.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c64b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00cbc30 con 0x7f02c015a2d0 2023-12-19T13:54:24.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c4a53640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f02c0071210 0x7f02c006b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:24.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c4a53640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f02c0071210 0x7f02c006b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35038/0 (socket says 172.21.15.113:35038) 2023-12-19T13:54:24.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c4a53640 1 -- 172.21.15.113:0/1812191969 learned_addr learned my addr 172.21.15.113:0/1812191969 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:24.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02bffff640 1 --2- 172.21.15.113:0/1812191969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 0x7f02c00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:24.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.843+0000 7f02c4a53640 1 -- 172.21.15.113:0/1812191969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 msgr2=0x7f02c00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:24.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.844+0000 7f02c4a53640 1 --2- 172.21.15.113:0/1812191969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 0x7f02c00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.844+0000 7f02c4a53640 1 -- 172.21.15.113:0/1812191969 >> v1:172.21.15.151:6789/0 conn(0x7f02c00ce830 legacy=0x7f02c0070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:24.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.844+0000 7f02c4a53640 1 -- 172.21.15.113:0/1812191969 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00cbf10 con 0x7f02c0071210 2023-12-19T13:54:24.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.845+0000 7f02c4a53640 1 --2- 172.21.15.113:0/1812191969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c006b640 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009e50 tx=0x7f02b802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8cf907782f33a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:24.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.845+0000 7f02beffd640 1 -- 172.21.15.113:0/1812191969 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b802c9e0 con 0x7f02c0071210 2023-12-19T13:54:24.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.845+0000 7f02beffd640 1 -- 172.21.15.113:0/1812191969 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b802cb40 con 0x7f02c0071210 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.845+0000 7f02beffd640 1 -- 172.21.15.113:0/1812191969 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80343f0 con 0x7f02c0071210 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 -- 172.21.15.113:0/1812191969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 msgr2=0x7f02c006b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 --2- 172.21.15.113:0/1812191969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c006b640 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009e50 tx=0x7f02b802be40 comp rx=0 tx=0).stop 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 -- 172.21.15.113:0/1812191969 shutdown_connections 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 --2- 172.21.15.113:0/1812191969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c006b640 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 --2- 172.21.15.113:0/1812191969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 0x7f02c00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 -- 172.21.15.113:0/1812191969 >> 172.21.15.113:0/1812191969 conn(0x7f02c00cf0b0 msgr2=0x7f02c00cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 -- 172.21.15.113:0/1812191969 shutdown_connections 2023-12-19T13:54:24.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.846+0000 7f02c64b6640 1 -- 172.21.15.113:0/1812191969 wait complete. 2023-12-19T13:54:24.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.848+0000 7f02c64b6640 1 Processor -- start 2023-12-19T13:54:24.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.848+0000 7f02c64b6640 1 -- start start 2023-12-19T13:54:24.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02c64b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c0154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02c64b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02c00ce830 0x7f02c01e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02c64b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 0x7f02c015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02c64b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0154db0 con 0x7f02c0071210 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02c64b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01e3c50 con 0x7f02c00ce830 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02c64b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01e3f30 con 0x7f02c015a2d0 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c0154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c0154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35040/0 (socket says 172.21.15.113:35040) 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 -- 172.21.15.113:0/223952532 learned_addr learned my addr 172.21.15.113:0/223952532 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:24.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 -- 172.21.15.113:0/223952532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 msgr2=0x7f02c015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:24.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 0x7f02c015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 -- 172.21.15.113:0/223952532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02c00ce830 msgr2=0x7f02c01e4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:24.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02c00ce830 0x7f02c01e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:24.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.849+0000 7f02bffff640 1 -- 172.21.15.113:0/223952532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8009b30 con 0x7f02c0071210 2023-12-19T13:54:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.850+0000 7f02bffff640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c0154870 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f02b000d5f0 tx=0x7f02b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.850+0000 7f02bcff9640 1 -- 172.21.15.113:0/223952532 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00125f0 con 0x7f02c0071210 2023-12-19T13:54:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.850+0000 7f02bcff9640 1 -- 172.21.15.113:0/223952532 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b0012750 con 0x7f02c0071210 2023-12-19T13:54:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.850+0000 7f02bcff9640 1 -- 172.21.15.113:0/223952532 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0012ae0 con 0x7f02c0071210 2023-12-19T13:54:24.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.850+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c01e4210 con 0x7f02c0071210 2023-12-19T13:54:24.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.850+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c01e47d0 con 0x7f02c0071210 2023-12-19T13:54:24.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.851+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c01e4990 con 0x7f02c0071210 2023-12-19T13:54:24.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.853+0000 7f02bcff9640 1 -- 172.21.15.113:0/223952532 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02b0012c40 con 0x7f02c0071210 2023-12-19T13:54:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.853+0000 7f02bcff9640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02ac06a460 0x7f02ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.853+0000 7f02bcff9640 1 -- 172.21.15.113:0/223952532 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f02b0088bc0 con 0x7f02c0071210 2023-12-19T13:54:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.854+0000 7f02bf7fe640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02ac06a460 0x7f02ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:24.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.854+0000 7f02bf7fe640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02ac06a460 0x7f02ac06c920 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f02c015cea0 tx=0x7f02b40079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:24.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:24.858+0000 7f02bcff9640 1 -- 172.21.15.113:0/223952532 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02b0054390 con 0x7f02c0071210 2023-12-19T13:54:25.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.054+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f02c0074770 con 0x7f02c0071210 2023-12-19T13:54:25.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.611+0000 7f02bcff9640 1 -- 172.21.15.113:0/223952532 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v145) v1 ==== 170+0+0 (secure 0 0 0) 0x7f02b0004640 con 0x7f02c0071210 2023-12-19T13:54:25.611 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:54:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02ac06a460 msgr2=0x7f02ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02ac06a460 0x7f02ac06c920 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f02c015cea0 tx=0x7f02b40079b0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 msgr2=0x7f02c0154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c0154870 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f02b000d5f0 tx=0x7f02b000dab0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 shutdown_connections 2023-12-19T13:54:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02ac06a460 0x7f02ac06c920 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c015a2d0 0x7f02c015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02c00ce830 0x7f02c01e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 --2- 172.21.15.113:0/223952532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c0071210 0x7f02c0154870 secure :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f02b000d5f0 tx=0x7f02b000dab0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.617+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 >> 172.21.15.113:0/223952532 conn(0x7f02c00cf0b0 msgr2=0x7f02c00ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.619+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 shutdown_connections 2023-12-19T13:54:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.619+0000 7f02c64b6640 1 -- 172.21.15.113:0/223952532 wait complete. 2023-12-19T13:54:25.645 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:54:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.837+0000 7fa3e1f39640 1 Processor -- start 2023-12-19T13:54:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.837+0000 7fa3e1f39640 1 -- start start 2023-12-19T13:54:25.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3e1f39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc157c70 0x7fa3dc0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:25.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3e1f39640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa3dc0660e0 0x7fa3dc0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:25.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3e1f39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc161d50 con 0x7fa3dc0cf1e0 2023-12-19T13:54:25.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3e1f39640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3dc161140 con 0x7fa3dc0660e0 2023-12-19T13:54:25.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3e1f39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc161420 con 0x7fa3dc157c70 2023-12-19T13:54:25.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa3dc0660e0 0x7fa3dc0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:25.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa3dc0660e0 0x7fa3dc0708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35048/0 (socket says 172.21.15.113:35048) 2023-12-19T13:54:25.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.839+0000 7fa3dbfff640 1 -- 172.21.15.113:0/2771852670 learned_addr learned my addr 172.21.15.113:0/2771852670 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:25.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.840+0000 7fa3db7fe640 1 --2- 172.21.15.113:0/2771852670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc157c70 0x7fa3dc0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:25.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.840+0000 7fa3dbfff640 1 -- 172.21.15.113:0/2771852670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc157c70 msgr2=0x7fa3dc0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:25.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.840+0000 7fa3dbfff640 1 --2- 172.21.15.113:0/2771852670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc157c70 0x7fa3dc0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.840+0000 7fa3dbfff640 1 -- 172.21.15.113:0/2771852670 >> v1:172.21.15.151:6789/0 conn(0x7fa3dc0cf1e0 legacy=0x7fa3dc0659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:25.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.840+0000 7fa3dbfff640 1 -- 172.21.15.113:0/2771852670 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc161700 con 0x7fa3dc0660e0 2023-12-19T13:54:25.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.841+0000 7fa3dbfff640 1 --2- 172.21.15.113:0/2771852670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc0708c0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009e50 tx=0x7fa3d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f36da8cf7b3b234 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:25.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.841+0000 7fa3da7fc640 1 -- 172.21.15.113:0/2771852670 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d402ca70 con 0x7fa3dc0660e0 2023-12-19T13:54:25.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.841+0000 7fa3da7fc640 1 -- 172.21.15.113:0/2771852670 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d402cbd0 con 0x7fa3dc0660e0 2023-12-19T13:54:25.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.841+0000 7fa3da7fc640 1 -- 172.21.15.113:0/2771852670 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40343f0 con 0x7fa3dc0660e0 2023-12-19T13:54:25.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2771852670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 msgr2=0x7fa3dc0708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:25.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2771852670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc0708c0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009e50 tx=0x7fa3d402bed0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2771852670 shutdown_connections 2023-12-19T13:54:25.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2771852670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc0708c0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2771852670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc157c70 0x7fa3dc0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2771852670 >> 172.21.15.113:0/2771852670 conn(0x7fa3dc06f160 msgr2=0x7fa3dc06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:25.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2771852670 shutdown_connections 2023-12-19T13:54:25.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.842+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2771852670 wait complete. 2023-12-19T13:54:25.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.844+0000 7fa3e1f39640 1 Processor -- start 2023-12-19T13:54:25.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.844+0000 7fa3e1f39640 1 -- start start 2023-12-19T13:54:25.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3e1f39640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:25.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3e1f39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc0cf1e0 0x7fa3dc146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:25.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3e1f39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3dc157c70 0x7fa3dc145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:25.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3e1f39640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc146a70 con 0x7fa3dc0660e0 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3e1f39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc146320 con 0x7fa3dc157c70 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3e1f39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc152bb0 con 0x7fa3dc0cf1e0 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35052/0 (socket says 172.21.15.113:35052) 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 -- 172.21.15.113:0/2655277395 learned_addr learned my addr 172.21.15.113:0/2655277395 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 -- 172.21.15.113:0/2655277395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc0cf1e0 msgr2=0x7fa3dc146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc0cf1e0 0x7fa3dc146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 -- 172.21.15.113:0/2655277395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3dc157c70 msgr2=0x7fa3dc145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3dc157c70 0x7fa3dc145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.845+0000 7fa3db7fe640 1 -- 172.21.15.113:0/2655277395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4009b30 con 0x7fa3dc0660e0 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.846+0000 7fa3db7fe640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc151f80 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00d5f0 tx=0x7fa3cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.846+0000 7fa3c3fff640 1 -- 172.21.15.113:0/2655277395 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0125f0 con 0x7fa3dc0660e0 2023-12-19T13:54:25.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.846+0000 7fa3c3fff640 1 -- 172.21.15.113:0/2655277395 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc012750 con 0x7fa3dc0660e0 2023-12-19T13:54:25.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.846+0000 7fa3c3fff640 1 -- 172.21.15.113:0/2655277395 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc012b00 con 0x7fa3dc0660e0 2023-12-19T13:54:25.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.846+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc1525f0 con 0x7fa3dc0660e0 2023-12-19T13:54:25.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.846+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc0af490 con 0x7fa3dc0660e0 2023-12-19T13:54:25.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.847+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc061910 con 0x7fa3dc0660e0 2023-12-19T13:54:25.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.849+0000 7fa3c3fff640 1 -- 172.21.15.113:0/2655277395 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3cc012c60 con 0x7fa3dc0660e0 2023-12-19T13:54:25.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.850+0000 7fa3c3fff640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa3c806a430 0x7fa3c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:25.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.850+0000 7fa3c3fff640 1 -- 172.21.15.113:0/2655277395 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa3cc089700 con 0x7fa3dc0660e0 2023-12-19T13:54:25.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.851+0000 7fa3daffd640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa3c806a430 0x7fa3c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:25.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.851+0000 7fa3daffd640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa3c806a430 0x7fa3c806c8f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0af080 tx=0x7fa3d00079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:25.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:25.855+0000 7fa3c3fff640 1 -- 172.21.15.113:0/2655277395 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa3cc054ec0 con 0x7fa3dc0660e0 2023-12-19T13:54:26.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.082+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa3dc0b3db0 con 0x7fa3dc0660e0 2023-12-19T13:54:26.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.097+0000 7fa3c3fff640 1 -- 172.21.15.113:0/2655277395 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa3cc0584e0 con 0x7fa3dc0660e0 2023-12-19T13:54:26.096 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 16 and data pool 17 2023-12-19T13:54:26.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.101+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa3c806a430 msgr2=0x7fa3c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.101+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa3c806a430 0x7fa3c806c8f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0af080 tx=0x7fa3d00079b0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.101+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 msgr2=0x7fa3dc151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.101+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc151f80 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00d5f0 tx=0x7fa3cc00dab0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.102+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 shutdown_connections 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.102+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa3c806a430 0x7fa3c806c8f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.102+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3dc157c70 0x7fa3dc145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.102+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3dc0cf1e0 0x7fa3dc146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.102+0000 7fa3e1f39640 1 --2- 172.21.15.113:0/2655277395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa3dc0660e0 0x7fa3dc151f80 secure :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00d5f0 tx=0x7fa3cc00dab0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.102+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 >> 172.21.15.113:0/2655277395 conn(0x7fa3dc06f160 msgr2=0x7fa3dc0cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:26.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.103+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 shutdown_connections 2023-12-19T13:54:26.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.104+0000 7fa3e1f39640 1 -- 172.21.15.113:0/2655277395 wait complete. 2023-12-19T13:54:26.126 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:26.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.301+0000 7fefc0df1640 1 Processor -- start 2023-12-19T13:54:26.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.301+0000 7fefc0df1640 1 -- start start 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.302+0000 7fefc0df1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefbc0b2460 0x7fefbc070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.302+0000 7fefc0df1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fefbc157c50 0x7fefbc0b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.302+0000 7fefc0df1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0b2d80 con 0x7fefbc0b6960 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.302+0000 7fefc0df1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc15e8b0 con 0x7fefbc0b2460 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.302+0000 7fefc0df1640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc15dc30 con 0x7fefbc157c50 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefba59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefbc0b2460 0x7fefbc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefba59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefbc0b2460 0x7fefbc070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35054/0 (socket says 172.21.15.113:35054) 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefba59c640 1 -- 172.21.15.113:0/805784693 learned_addr learned my addr 172.21.15.113:0/805784693 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefbad9d640 1 --1- 172.21.15.113:0/805784693 >> v1:172.21.15.113:6789/0 conn(0x7fefbc0b6960 0x7fefbc06d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59500/0 (socket says 172.21.15.113:59500) 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefb9d9b640 1 --2- 172.21.15.113:0/805784693 >> v2:172.21.15.151:3300/0 conn(0x7fefbc157c50 0x7fefbc0b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefba59c640 1 -- 172.21.15.113:0/805784693 >> v2:172.21.15.151:3300/0 conn(0x7fefbc157c50 msgr2=0x7fefbc0b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefba59c640 1 --2- 172.21.15.113:0/805784693 >> v2:172.21.15.151:3300/0 conn(0x7fefbc157c50 0x7fefbc0b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefba59c640 1 -- 172.21.15.113:0/805784693 >> v1:172.21.15.113:6789/0 conn(0x7fefbc0b6960 legacy=0x7fefbc06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefba59c640 1 -- 172.21.15.113:0/805784693 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc15df10 con 0x7fefbc0b2460 2023-12-19T13:54:26.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.303+0000 7fefb959a640 1 -- 172.21.15.113:0/805784693 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613895320 0 0) 0x7fefbc0b2d80 con 0x7fefbc0b6960 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefba59c640 1 --2- 172.21.15.113:0/805784693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc0b2460 0x7fefbc070740 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0b3b10 tx=0x7fefac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f8056a8e7976af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefb959a640 1 -- 172.21.15.113:0/805784693 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac030860 con 0x7fefbc0b2460 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefb959a640 1 -- 172.21.15.113:0/805784693 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac0309c0 con 0x7fefbc0b2460 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefb959a640 1 -- 172.21.15.113:0/805784693 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac030d50 con 0x7fefbc0b2460 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefc0df1640 1 -- 172.21.15.113:0/805784693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc0b2460 msgr2=0x7fefbc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefc0df1640 1 --2- 172.21.15.113:0/805784693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc0b2460 0x7fefbc070740 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0b3b10 tx=0x7fefac02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefc0df1640 1 -- 172.21.15.113:0/805784693 shutdown_connections 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.305+0000 7fefc0df1640 1 --2- 172.21.15.113:0/805784693 >> v2:172.21.15.151:3300/0 conn(0x7fefbc157c50 0x7fefbc0b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.306+0000 7fefc0df1640 1 --2- 172.21.15.113:0/805784693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc0b2460 0x7fefbc070740 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.306+0000 7fefc0df1640 1 -- 172.21.15.113:0/805784693 >> 172.21.15.113:0/805784693 conn(0x7fefbc0659d0 msgr2=0x7fefbc065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:26.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.306+0000 7fefc0df1640 1 -- 172.21.15.113:0/805784693 shutdown_connections 2023-12-19T13:54:26.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.306+0000 7fefc0df1640 1 -- 172.21.15.113:0/805784693 wait complete. 2023-12-19T13:54:26.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.307+0000 7fefc0df1640 1 Processor -- start 2023-12-19T13:54:26.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.307+0000 7fefc0df1640 1 -- start start 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefc0df1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefbc0b2460 0x7fefbc14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefc0df1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefbc0b6960 0x7fefbc070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefc0df1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc157c50 0x7fefbc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefc0df1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1f7570 con 0x7fefbc157c50 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefc0df1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1f2fe0 con 0x7fefbc0b6960 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefc0df1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1f3fb0 con 0x7fefbc0b2460 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefbad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc157c50 0x7fefbc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefbad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc157c50 0x7fefbc071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35064/0 (socket says 172.21.15.113:35064) 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.308+0000 7fefbad9d640 1 -- 172.21.15.113:0/1660194740 learned_addr learned my addr 172.21.15.113:0/1660194740 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefb9d9b640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefbc0b6960 0x7fefbc070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefbad9d640 1 -- 172.21.15.113:0/1660194740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefbc0b2460 msgr2=0x7fefbc14f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefbad9d640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefbc0b2460 0x7fefbc14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefbad9d640 1 -- 172.21.15.113:0/1660194740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefbc0b6960 msgr2=0x7fefbc070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefbad9d640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefbc0b6960 0x7fefbc070cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefbad9d640 1 -- 172.21.15.113:0/1660194740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0094d0 con 0x7fefbc157c50 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefbad9d640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc157c50 0x7fefbc071200 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c780 tx=0x7fefb400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefaaffd640 1 -- 172.21.15.113:0/1660194740 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400ce90 con 0x7fefbc157c50 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefaaffd640 1 -- 172.21.15.113:0/1660194740 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb400a640 con 0x7fefbc157c50 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefaaffd640 1 -- 172.21.15.113:0/1660194740 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400a9d0 con 0x7fefbc157c50 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.309+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc1f3b20 con 0x7fefbc157c50 2023-12-19T13:54:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.310+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc1f34d0 con 0x7fefbc157c50 2023-12-19T13:54:26.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.310+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc061910 con 0x7fefbc157c50 2023-12-19T13:54:26.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.311+0000 7fefaaffd640 1 -- 172.21.15.113:0/1660194740 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fefb400ab30 con 0x7fefbc157c50 2023-12-19T13:54:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.312+0000 7fefaaffd640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef9c06a430 0x7fef9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.312+0000 7fefaaffd640 1 -- 172.21.15.113:0/1660194740 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefb4087f30 con 0x7fefbc157c50 2023-12-19T13:54:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.313+0000 7fefba59c640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef9c06a430 0x7fef9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.313+0000 7fefba59c640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef9c06a430 0x7fef9c06c8f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fefac036000 tx=0x7fefac03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:26.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.317+0000 7fefaaffd640 1 -- 172.21.15.113:0/1660194740 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fefb4053480 con 0x7fefbc157c50 2023-12-19T13:54:26.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.502+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefbc1f3cb0 con 0x7fefbc157c50 2023-12-19T13:54:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.504+0000 7fefaaffd640 1 -- 172.21.15.113:0/1660194740 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16177 (secure 0 0 0) 0x7fefb4018020 con 0x7fefbc157c50 2023-12-19T13:54:26.503 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:26.504 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":146,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:54:26.083370+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef9c06a430 msgr2=0x7fef9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef9c06a430 0x7fef9c06c8f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fefac036000 tx=0x7fefac03b040 comp rx=0 tx=0).stop 2023-12-19T13:54:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc157c50 msgr2=0x7fefbc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc157c50 0x7fefbc071200 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c780 tx=0x7fefb400cc40 comp rx=0 tx=0).stop 2023-12-19T13:54:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 shutdown_connections 2023-12-19T13:54:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef9c06a430 0x7fef9c06c8f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefbc157c50 0x7fefbc071200 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefbc0b6960 0x7fefbc070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 --2- 172.21.15.113:0/1660194740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefbc0b2460 0x7fefbc14f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.506+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 >> 172.21.15.113:0/1660194740 conn(0x7fefbc0659d0 msgr2=0x7fefbc156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.507+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 shutdown_connections 2023-12-19T13:54:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.507+0000 7fefc0df1640 1 -- 172.21.15.113:0/1660194740 wait complete. 2023-12-19T13:54:26.524 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:26.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.730+0000 7f9fa66f3640 1 Processor -- start 2023-12-19T13:54:26.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.731+0000 7f9fa66f3640 1 -- start start 2023-12-19T13:54:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.732+0000 7f9fa66f3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 0x7f9fa00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.732+0000 7f9fa66f3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9fa006f160 0x7f9fa006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.732+0000 7f9fa66f3640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa00b22b0 con 0x7f9fa0161810 2023-12-19T13:54:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.732+0000 7f9fa66f3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa0161bf0 con 0x7f9fa006f160 2023-12-19T13:54:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9fa66f3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00b2830 con 0x7f9fa00cdf50 2023-12-19T13:54:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9fa56f1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9fa0161810 0x7f9fa00cc360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59510/0 (socket says 172.21.15.113:59510) 2023-12-19T13:54:26.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9fa56f1640 1 -- 172.21.15.113:0/1156231462 learned_addr learned my addr 172.21.15.113:0/1156231462 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:26.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221455197 0 0) 0x7f9fa00b22b0 con 0x7f9fa0161810 2023-12-19T13:54:26.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f8c003520 con 0x7f9fa0161810 2023-12-19T13:54:26.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9fa5ef2640 1 --2- 172.21.15.113:0/1156231462 >> v2:172.21.15.151:3300/0 conn(0x7f9fa006f160 0x7f9fa006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9fa4ef0640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 0x7f9fa00ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.733+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122356022 0 0) 0x7f9f8c003520 con 0x7f9fa0161810 2023-12-19T13:54:26.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 msgr2=0x7f9fa00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 0x7f9fa00ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 >> v2:172.21.15.151:3300/0 conn(0x7f9fa006f160 msgr2=0x7f9fa006f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 --2- 172.21.15.113:0/1156231462 >> v2:172.21.15.151:3300/0 conn(0x7f9fa006f160 0x7f9fa006f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00b2550 con 0x7f9fa0161810 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9f9c001670 con 0x7f9fa0161810 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 >> v1:172.21.15.113:6789/0 conn(0x7f9fa0161810 legacy=0x7f9fa00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c003970 0x7f9f8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f8c0047c0 0x7f9f8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 0x7f9f8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0161bf0 con 0x7f9f8c0047c0 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00b2830 con 0x7f9f8c003970 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c00bae0 con 0x7f9fa00cdf50 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa4ef0640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f8c0047c0 0x7f9f8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa56f1640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c003970 0x7f9f8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa5ef2640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 0x7f9f8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa4ef0640 1 -- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 msgr2=0x7f9f8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:26.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa4ef0640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00cdf50 0x7f9f8c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa4ef0640 1 -- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c003970 msgr2=0x7f9f8c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:26.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa4ef0640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c003970 0x7f9f8c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.734+0000 7f9fa4ef0640 1 -- 172.21.15.113:0/1156231462 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c003520 con 0x7f9f8c0047c0 2023-12-19T13:54:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.735+0000 7f9fa4ef0640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f8c0047c0 0x7f9f8c004c40 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000ba00 tx=0x7f9f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cf6d83a102631 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900325f0 con 0x7f9f8c0047c0 2023-12-19T13:54:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90032750 con 0x7f9f8c0047c0 2023-12-19T13:54:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9f97fff640 1 -- 172.21.15.113:0/1156231462 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90032ae0 con 0x7f9f8c0047c0 2023-12-19T13:54:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1156231462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f8c0047c0 msgr2=0x7f9f8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9fa66f3640 1 --2- 172.21.15.113:0/1156231462 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f8c0047c0 0x7f9f8c004c40 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000ba00 tx=0x7f9f8c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9fa5ef2640 1 -- 172.21.15.113:0/1156231462 reap_dead start 2023-12-19T13:54:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1156231462 shutdown_connections 2023-12-19T13:54:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1156231462 >> 172.21.15.113:0/1156231462 conn(0x7f9fa00b0100 msgr2=0x7f9fa00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.736+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1156231462 shutdown_connections 2023-12-19T13:54:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.737+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1156231462 wait complete. 2023-12-19T13:54:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.738+0000 7f9fa66f3640 1 Processor -- start 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.738+0000 7f9fa66f3640 1 -- start start 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.739+0000 7f9fa66f3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c0047c0 0x7f9fa01f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.739+0000 7f9fa66f3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00acaa0 0x7f9fa006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.739+0000 7f9fa66f3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa00acf20 0x7f9fa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.739+0000 7f9fa66f3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00aba00 con 0x7f9fa00acf20 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.739+0000 7f9fa66f3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00abce0 con 0x7f9f8c0047c0 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.739+0000 7f9fa66f3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00abfc0 con 0x7f9fa00acaa0 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa00acf20 0x7f9fa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa00acf20 0x7f9fa006d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35080/0 (socket says 172.21.15.113:35080) 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 -- 172.21.15.113:0/1713841873 learned_addr learned my addr 172.21.15.113:0/1713841873 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa56f1640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c0047c0 0x7f9fa01f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa4ef0640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00acaa0 0x7f9fa006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 -- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00acaa0 msgr2=0x7f9fa006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00acaa0 0x7f9fa006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 -- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c0047c0 msgr2=0x7f9fa01f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c0047c0 0x7f9fa01f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 -- 172.21.15.113:0/1713841873 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00ac2a0 con 0x7f9fa00acf20 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa4ef0640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00acaa0 0x7f9fa006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa56f1640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c0047c0 0x7f9fa01f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.740+0000 7f9fa5ef2640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa00acf20 0x7f9fa006d990 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0166320 tx=0x7f9f9800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.741+0000 7f9f95ffb640 1 -- 172.21.15.113:0/1713841873 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98007e20 con 0x7f9fa00acf20 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.741+0000 7f9f95ffb640 1 -- 172.21.15.113:0/1713841873 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f980143f0 con 0x7f9fa00acf20 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.741+0000 7f9f95ffb640 1 -- 172.21.15.113:0/1713841873 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980147a0 con 0x7f9fa00acf20 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.741+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa00ac580 con 0x7f9fa00acf20 2023-12-19T13:54:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.741+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa014f300 con 0x7f9fa00acf20 2023-12-19T13:54:26.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.742+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa0061910 con 0x7f9fa00acf20 2023-12-19T13:54:26.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.743+0000 7f9f95ffb640 1 -- 172.21.15.113:0/1713841873 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f98014900 con 0x7f9fa00acf20 2023-12-19T13:54:26.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.744+0000 7f9f95ffb640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f8406a460 0x7f9f8406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:26.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.744+0000 7f9f95ffb640 1 -- 172.21.15.113:0/1713841873 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f98088f60 con 0x7f9fa00acf20 2023-12-19T13:54:26.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.744+0000 7f9fa56f1640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f8406a460 0x7f9f8406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:26.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.745+0000 7f9fa56f1640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f8406a460 0x7f9f8406c920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c001eb0 tx=0x7f9f9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:26.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.748+0000 7f9f95ffb640 1 -- 172.21.15.113:0/1713841873 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f98054550 con 0x7f9fa00acf20 2023-12-19T13:54:26.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.937+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fa00b1ee0 con 0x7f9fa00acf20 2023-12-19T13:54:26.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.939+0000 7f9f95ffb640 1 -- 172.21.15.113:0/1713841873 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16177 (secure 0 0 0) 0x7f9f98057b70 con 0x7f9fa00acf20 2023-12-19T13:54:26.939 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:26.939 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":146,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:54:26.083370+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:26.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f8406a460 msgr2=0x7f9f8406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f8406a460 0x7f9f8406c920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c001eb0 tx=0x7f9f9c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa00acf20 msgr2=0x7f9fa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa00acf20 0x7f9fa006d990 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0166320 tx=0x7f9f9800f520 comp rx=0 tx=0).stop 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 shutdown_connections 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9f8406a460 0x7f9f8406c920 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa00acf20 0x7f9fa006d990 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa00acaa0 0x7f9fa006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 --2- 172.21.15.113:0/1713841873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f8c0047c0 0x7f9fa01f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 >> 172.21.15.113:0/1713841873 conn(0x7f9fa00b0100 msgr2=0x7f9fa00adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 shutdown_connections 2023-12-19T13:54:26.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:26.942+0000 7f9fa66f3640 1 -- 172.21.15.113:0/1713841873 wait complete. 2023-12-19T13:54:26.960 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:54:27.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.180+0000 7f51b67b9640 1 Processor -- start 2023-12-19T13:54:27.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.180+0000 7f51b67b9640 1 -- start start 2023-12-19T13:54:27.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.182+0000 7f51b67b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51b015e490 0x7f51b0160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.182+0000 7f51b67b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b0161f10 con 0x7f51b015e0b0 2023-12-19T13:54:27.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.182+0000 7f51b67b9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b015e940 con 0x7f51b00cfcd0 2023-12-19T13:54:27.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.182+0000 7f51b67b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b0161950 con 0x7f51b015e490 2023-12-19T13:54:27.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.182+0000 7f51affff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f51b015e0b0 0x7f51b00b2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59512/0 (socket says 172.21.15.113:59512) 2023-12-19T13:54:27.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.182+0000 7f51affff640 1 -- 172.21.15.113:0/545540682 learned_addr learned my addr 172.21.15.113:0/545540682 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:27.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51a7fff640 1 --2- 172.21.15.113:0/545540682 >> v2:172.21.15.151:3300/0 conn(0x7f51b015e490 0x7f51b0160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302827975 0 0) 0x7f51b0161f10 con 0x7f51b015e0b0 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f519c003520 con 0x7f51b015e0b0 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3518782288 0 0) 0x7f519c003520 con 0x7f51b015e0b0 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 >> v2:172.21.15.151:3300/0 conn(0x7f51b015e490 msgr2=0x7f51b0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 --2- 172.21.15.113:0/545540682 >> v2:172.21.15.151:3300/0 conn(0x7f51b015e490 0x7f51b0160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 >> v1:172.21.15.151:6789/0 conn(0x7f51b00cfcd0 legacy=0x7f51b00cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0161c30 con 0x7f51b015e0b0 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f51a0001670 con 0x7f51b015e0b0 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 >> v1:172.21.15.113:6789/0 conn(0x7f51b015e0b0 legacy=0x7f51b00b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f519c0039e0 0x7f519c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519c0047c0 0x7f519c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f519c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0161950 con 0x7f519c005180 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c00c0b0 con 0x7f519c0039e0 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c00c270 con 0x7f519c0047c0 2023-12-19T13:54:27.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.183+0000 7f51b4d56640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f519c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.184+0000 7f51affff640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f519c0039e0 0x7f519c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.184+0000 7f51b4d56640 1 -- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519c0047c0 msgr2=0x7f519c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:27.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.184+0000 7f51a7fff640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519c0047c0 0x7f519c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.184+0000 7f51b4d56640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519c0047c0 0x7f519c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:27.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.184+0000 7f51b4d56640 1 -- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f519c0039e0 msgr2=0x7f519c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:27.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.184+0000 7f51b4d56640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f519c0039e0 0x7f519c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:27.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.184+0000 7f51b4d56640 1 -- 172.21.15.113:0/545540682 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c003520 con 0x7f519c005180 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.185+0000 7f51b4d56640 1 -- 172.21.15.113:0/545540682 reap_dead start 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.185+0000 7f51b4d56640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f519c00b980 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f51a8001e50 tx=0x7f519c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1459d501da2d046 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.185+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8003b70 con 0x7f519c005180 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.185+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8003d10 con 0x7f519c005180 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.185+0000 7f51af7fe640 1 -- 172.21.15.113:0/545540682 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8005310 con 0x7f519c005180 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.186+0000 7f51b67b9640 1 -- 172.21.15.113:0/545540682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 msgr2=0x7f519c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.186+0000 7f51b67b9640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f519c00b980 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f51a8001e50 tx=0x7f519c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:27.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.186+0000 7f51b67b9640 1 -- 172.21.15.113:0/545540682 shutdown_connections 2023-12-19T13:54:27.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.186+0000 7f51b67b9640 1 --2- 172.21.15.113:0/545540682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f519c00b980 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:27.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.186+0000 7f51b67b9640 1 -- 172.21.15.113:0/545540682 >> 172.21.15.113:0/545540682 conn(0x7f51b00cc770 msgr2=0x7f51b00ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:27.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.186+0000 7f51b67b9640 1 -- 172.21.15.113:0/545540682 shutdown_connections 2023-12-19T13:54:27.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.186+0000 7f51b67b9640 1 -- 172.21.15.113:0/545540682 wait complete. 2023-12-19T13:54:27.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.188+0000 7f51b67b9640 1 Processor -- start 2023-12-19T13:54:27.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.188+0000 7f51b67b9640 1 -- start start 2023-12-19T13:54:27.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51b67b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f51b0152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51b67b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b015ed50 0x7f51b0152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51b67b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b006d880 0x7f51b00b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51b67b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0070900 con 0x7f519c005180 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51b67b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b01f2600 con 0x7f51b006d880 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51b67b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00b1a40 con 0x7f51b015ed50 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f51b0152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f51b0152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35086/0 (socket says 172.21.15.113:35086) 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 -- 172.21.15.113:0/255801015 learned_addr learned my addr 172.21.15.113:0/255801015 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51a7fff640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b015ed50 0x7f51b0152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51b4d56640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b006d880 0x7f51b00b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 -- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b015ed50 msgr2=0x7f51b0152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b015ed50 0x7f51b0152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 -- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b006d880 msgr2=0x7f51b00b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b006d880 0x7f51b00b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.189+0000 7f51affff640 1 -- 172.21.15.113:0/255801015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0070340 con 0x7f519c005180 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.190+0000 7f51affff640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f51b0152200 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e730 tx=0x7f51a000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.190+0000 7f51ad7fa640 1 -- 172.21.15.113:0/255801015 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000c6c0 con 0x7f519c005180 2023-12-19T13:54:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.190+0000 7f51ad7fa640 1 -- 172.21.15.113:0/255801015 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a000c820 con 0x7f519c005180 2023-12-19T13:54:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.190+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b0070620 con 0x7f519c005180 2023-12-19T13:54:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.190+0000 7f51ad7fa640 1 -- 172.21.15.113:0/255801015 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000cbd0 con 0x7f519c005180 2023-12-19T13:54:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.190+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b00b11c0 con 0x7f519c005180 2023-12-19T13:54:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.191+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b01f2a50 con 0x7f519c005180 2023-12-19T13:54:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.192+0000 7f51ad7fa640 1 -- 172.21.15.113:0/255801015 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f51a001d460 con 0x7f519c005180 2023-12-19T13:54:27.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.193+0000 7f51ad7fa640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f519006a430 0x7f519006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:27.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.193+0000 7f51ad7fa640 1 -- 172.21.15.113:0/255801015 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51a0088a40 con 0x7f519c005180 2023-12-19T13:54:27.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.193+0000 7f51a7fff640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f519006a430 0x7f519006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.194+0000 7f51a7fff640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f519006a430 0x7f519006c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f51b0155850 tx=0x7f5198008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:27.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.197+0000 7f51ad7fa640 1 -- 172.21.15.113:0/255801015 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f51b01f2a50 con 0x7f519c005180 2023-12-19T13:54:27.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:27.405+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f51b01f2a50 con 0x7f519c005180 2023-12-19T13:54:28.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.117+0000 7f51ad7fa640 1 -- 172.21.15.113:0/255801015 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7f51a008ae60 con 0x7f519c005180 2023-12-19T13:54:28.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.120+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f519006a430 msgr2=0x7f519006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:28.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f519006a430 0x7f519006c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f51b0155850 tx=0x7f5198008040 comp rx=0 tx=0).stop 2023-12-19T13:54:28.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 msgr2=0x7f51b0152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f51b0152200 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e730 tx=0x7f51a000ebf0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 shutdown_connections 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f519006a430 0x7f519006c8f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b006d880 0x7f51b00b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b015ed50 0x7f51b0152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 --2- 172.21.15.113:0/255801015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f519c005180 0x7f51b0152200 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 >> 172.21.15.113:0/255801015 conn(0x7f51b00cc770 msgr2=0x7f51b015fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 shutdown_connections 2023-12-19T13:54:28.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.121+0000 7f51b67b9640 1 -- 172.21.15.113:0/255801015 wait complete. 2023-12-19T13:54:28.141 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:54:28.142 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:54:28.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.353+0000 7f30d7f1b640 1 Processor -- start 2023-12-19T13:54:28.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.353+0000 7f30d7f1b640 1 -- start start 2023-12-19T13:54:28.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d7f1b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30d0157bf0 0x7f30d015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:28.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d7f1b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30d00ae110 0x7f30d00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:28.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d7f1b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 0x7f30d015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:28.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d7f1b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d006b8c0 con 0x7f30d00ae110 2023-12-19T13:54:28.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d7f1b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d00b0ab0 con 0x7f30d0157bf0 2023-12-19T13:54:28.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d7f1b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d015b740 con 0x7f30d00b0640 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30d00ae110 0x7f30d00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30d00ae110 0x7f30d00b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55788/0 (socket says 172.21.15.113:55788) 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 -- 172.21.15.113:0/3987088548 learned_addr learned my addr 172.21.15.113:0/3987088548 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 -- 172.21.15.113:0/3987088548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 msgr2=0x7f30d015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 --2- 172.21.15.113:0/3987088548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 0x7f30d015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 -- 172.21.15.113:0/3987088548 >> v2:172.21.15.151:3300/0 conn(0x7f30d0157bf0 msgr2=0x7f30d015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 --2- 172.21.15.113:0/3987088548 >> v2:172.21.15.151:3300/0 conn(0x7f30d0157bf0 0x7f30d015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.355+0000 7f30d54b6640 1 -- 172.21.15.113:0/3987088548 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d00ae640 con 0x7f30d00ae110 2023-12-19T13:54:28.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.356+0000 7f30d54b6640 1 --2- 172.21.15.113:0/3987088548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d00ae110 0x7f30d00b0100 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f30d00ccbc0 tx=0x7f30c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d92d2070deba131 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d4cb5640 1 -- 172.21.15.113:0/3987088548 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0031870 con 0x7f30d00ae110 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d4cb5640 1 -- 172.21.15.113:0/3987088548 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c00319d0 con 0x7f30d00ae110 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d4cb5640 1 -- 172.21.15.113:0/3987088548 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0031d60 con 0x7f30d00ae110 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 -- 172.21.15.113:0/3987088548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d00ae110 msgr2=0x7f30d00b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/3987088548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d00ae110 0x7f30d00b0100 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f30d00ccbc0 tx=0x7f30c002b910 comp rx=0 tx=0).stop 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 -- 172.21.15.113:0/3987088548 shutdown_connections 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/3987088548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 0x7f30d015dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/3987088548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d00ae110 0x7f30d00b0100 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/3987088548 >> v2:172.21.15.151:3300/0 conn(0x7f30d0157bf0 0x7f30d015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 -- 172.21.15.113:0/3987088548 >> 172.21.15.113:0/3987088548 conn(0x7f30d00cbb70 msgr2=0x7f30d00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.357+0000 7f30d7f1b640 1 -- 172.21.15.113:0/3987088548 shutdown_connections 2023-12-19T13:54:28.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.358+0000 7f30d7f1b640 1 -- 172.21.15.113:0/3987088548 wait complete. 2023-12-19T13:54:28.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.359+0000 7f30d7f1b640 1 Processor -- start 2023-12-19T13:54:28.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.359+0000 7f30d7f1b640 1 -- start start 2023-12-19T13:54:28.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d7f1b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30d00ae110 0x7f30d014ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d7f1b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 0x7f30d01f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d7f1b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d0157bf0 0x7f30d00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d7f1b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d01f3ba0 con 0x7f30d0157bf0 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d7f1b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d01f30d0 con 0x7f30d00ae110 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d7f1b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d00ceb00 con 0x7f30d00b0640 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d64b8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d0157bf0 0x7f30d00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d64b8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d0157bf0 0x7f30d00ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55798/0 (socket says 172.21.15.113:55798) 2023-12-19T13:54:28.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.360+0000 7f30d64b8640 1 -- 172.21.15.113:0/1283309114 learned_addr learned my addr 172.21.15.113:0/1283309114 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:28.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30d64b8640 1 -- 172.21.15.113:0/1283309114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 msgr2=0x7f30d01f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:28.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30d64b8640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 0x7f30d01f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30d64b8640 1 -- 172.21.15.113:0/1283309114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30d00ae110 msgr2=0x7f30d014ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:28.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30d64b8640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30d00ae110 0x7f30d014ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:28.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30d64b8640 1 -- 172.21.15.113:0/1283309114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00094d0 con 0x7f30d0157bf0 2023-12-19T13:54:28.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30d64b8640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d0157bf0 0x7f30d00ac8b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f30c800b9a0 tx=0x7f30c800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:28.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30c67fc640 1 -- 172.21.15.113:0/1283309114 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800cba0 con 0x7f30d0157bf0 2023-12-19T13:54:28.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30c67fc640 1 -- 172.21.15.113:0/1283309114 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c800cd20 con 0x7f30d0157bf0 2023-12-19T13:54:28.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30c67fc640 1 -- 172.21.15.113:0/1283309114 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8014680 con 0x7f30d0157bf0 2023-12-19T13:54:28.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.361+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d01f3300 con 0x7f30d0157bf0 2023-12-19T13:54:28.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.362+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d01f38c0 con 0x7f30d0157bf0 2023-12-19T13:54:28.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.363+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d0061910 con 0x7f30d0157bf0 2023-12-19T13:54:28.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.363+0000 7f30c67fc640 1 -- 172.21.15.113:0/1283309114 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f30c801d3b0 con 0x7f30d0157bf0 2023-12-19T13:54:28.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.365+0000 7f30c67fc640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30b406a430 0x7f30b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:28.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.365+0000 7f30c67fc640 1 -- 172.21.15.113:0/1283309114 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30c8088990 con 0x7f30d0157bf0 2023-12-19T13:54:28.364 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.365+0000 7f30d5cb7640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30b406a430 0x7f30b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:28.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.366+0000 7f30d5cb7640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30b406a430 0x7f30b406c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f30d006e270 tx=0x7f30cc006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:28.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.369+0000 7f30c67fc640 1 -- 172.21.15.113:0/1283309114 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f30c8053ee0 con 0x7f30d0157bf0 2023-12-19T13:54:28.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:28.602+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f30d00cc050 con 0x7f30d0157bf0 2023-12-19T13:54:29.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.592+0000 7f30c67fc640 1 -- 172.21.15.113:0/1283309114 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) v1 ==== 122+0+0 (secure 0 0 0) 0x7f30c8019020 con 0x7f30d0157bf0 2023-12-19T13:54:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.596+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30b406a430 msgr2=0x7f30b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.596+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30b406a430 0x7f30b406c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f30d006e270 tx=0x7f30cc006bf0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.596+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d0157bf0 msgr2=0x7f30d00ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.596+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d0157bf0 0x7f30d00ac8b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f30c800b9a0 tx=0x7f30c800be60 comp rx=0 tx=0).stop 2023-12-19T13:54:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 shutdown_connections 2023-12-19T13:54:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f30b406a430 0x7f30b406c8f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30d0157bf0 0x7f30d00ac8b0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30d00b0640 0x7f30d01f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 --2- 172.21.15.113:0/1283309114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30d00ae110 0x7f30d014ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 >> 172.21.15.113:0/1283309114 conn(0x7f30d00cbb70 msgr2=0x7f30d015dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:29.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 shutdown_connections 2023-12-19T13:54:29.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.597+0000 7f30d7f1b640 1 -- 172.21.15.113:0/1283309114 wait complete. 2023-12-19T13:54:29.619 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:54:29.619 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:29.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.834+0000 7fe0b00e2640 1 Processor -- start 2023-12-19T13:54:29.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.834+0000 7fe0b00e2640 1 -- start start 2023-12-19T13:54:29.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.836+0000 7fe0b00e2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0a80b0b50 0x7fe0a806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.836+0000 7fe0b00e2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a806bb30 con 0x7fe0a81449e0 2023-12-19T13:54:29.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.836+0000 7fe0b00e2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80b0070 con 0x7fe0a806b590 2023-12-19T13:54:29.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.836+0000 7fe0b00e2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80b0350 con 0x7fe0a80b0b50 2023-12-19T13:54:29.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.836+0000 7fe0ade7e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe0a81449e0 0x7fe0a80af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38662/0 (socket says 172.21.15.113:38662) 2023-12-19T13:54:29.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.836+0000 7fe0ade7e640 1 -- 172.21.15.113:0/3310090878 learned_addr learned my addr 172.21.15.113:0/3310090878 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742490486 0 0) 0x7fe0a806bb30 con 0x7fe0a81449e0 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe094003520 con 0x7fe0a81449e0 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/3310090878 >> v2:172.21.15.151:3300/0 conn(0x7fe0a80b0b50 0x7fe0a806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2664454448 0 0) 0x7fe094003520 con 0x7fe0a81449e0 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 >> v2:172.21.15.151:3300/0 conn(0x7fe0a80b0b50 msgr2=0x7fe0a806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 --2- 172.21.15.113:0/3310090878 >> v2:172.21.15.151:3300/0 conn(0x7fe0a80b0b50 0x7fe0a806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 >> v1:172.21.15.151:6789/0 conn(0x7fe0a806b590 legacy=0x7fe0a80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80b0630 con 0x7fe0a81449e0 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fe0a4001670 con 0x7fe0a81449e0 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 >> v1:172.21.15.113:6789/0 conn(0x7fe0a81449e0 legacy=0x7fe0a80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:29.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe094003a30 0x7fe094003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe094004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0940052a0 0x7fe09400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80b0350 con 0x7fe0940047c0 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09400c170 con 0x7fe094003a30 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.837+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09400c330 con 0x7fe0940052a0 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe094004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ae67f640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0940052a0 0x7fe09400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ade7e640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe094003a30 0x7fe094003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ad67d640 1 -- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0940052a0 msgr2=0x7fe09400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0940052a0 0x7fe09400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ad67d640 1 -- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe094003a30 msgr2=0x7fe094003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe094003a30 0x7fe094003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ad67d640 1 -- 172.21.15.113:0/3310090878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094003520 con 0x7fe0940047c0 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ade7e640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe094003a30 0x7fe094003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:29.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.838+0000 7fe0ae67f640 1 -- 172.21.15.113:0/3310090878 reap_dead start 2023-12-19T13:54:29.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.839+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe094004c40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe09800ba00 tx=0x7fe0940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7064e50c1e93168 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.839+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980325f0 con 0x7fe0940047c0 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.839+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098032750 con 0x7fe0940047c0 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.839+0000 7fe0ace7c640 1 -- 172.21.15.113:0/3310090878 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098032ae0 con 0x7fe0940047c0 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.840+0000 7fe0b00e2640 1 -- 172.21.15.113:0/3310090878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 msgr2=0x7fe094004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.840+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe094004c40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe09800ba00 tx=0x7fe0940057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.840+0000 7fe0b00e2640 1 -- 172.21.15.113:0/3310090878 shutdown_connections 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.840+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/3310090878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe094004c40 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.840+0000 7fe0b00e2640 1 -- 172.21.15.113:0/3310090878 >> 172.21.15.113:0/3310090878 conn(0x7fe0a80cbb70 msgr2=0x7fe0a80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.840+0000 7fe0b00e2640 1 -- 172.21.15.113:0/3310090878 shutdown_connections 2023-12-19T13:54:29.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.840+0000 7fe0b00e2640 1 -- 172.21.15.113:0/3310090878 wait complete. 2023-12-19T13:54:29.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.842+0000 7fe0b00e2640 1 Processor -- start 2023-12-19T13:54:29.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.842+0000 7fe0b00e2640 1 -- start start 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0b00e2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe0a815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0b00e2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0a8159790 0x7fe0a8159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0b00e2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0a80a9e10 0x7fe0a80aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0b00e2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80a8e70 con 0x7fe0940047c0 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0b00e2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80aa7b0 con 0x7fe0a8159790 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0b00e2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a815a020 con 0x7fe0a80a9e10 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0ade7e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe0a815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0ade7e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe0a815d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55808/0 (socket says 172.21.15.113:55808) 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.843+0000 7fe0ade7e640 1 -- 172.21.15.113:0/2312395731 learned_addr learned my addr 172.21.15.113:0/2312395731 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ae67f640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0a80a9e10 0x7fe0a80aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0a8159790 0x7fe0a8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ade7e640 1 -- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0a80a9e10 msgr2=0x7fe0a80aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ade7e640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0a80a9e10 0x7fe0a80aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ade7e640 1 -- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0a8159790 msgr2=0x7fe0a8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ade7e640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0a8159790 0x7fe0a8159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ade7e640 1 -- 172.21.15.113:0/2312395731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80a9980 con 0x7fe0940047c0 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0a8159790 0x7fe0a8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0ade7e640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe0a815d500 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400d7d0 tx=0x7fe0a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe09e7fc640 1 -- 172.21.15.113:0/2312395731 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40074e0 con 0x7fe0940047c0 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe09e7fc640 1 -- 172.21.15.113:0/2312395731 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a4007640 con 0x7fe0940047c0 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a8159540 con 0x7fe0940047c0 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.844+0000 7fe09e7fc640 1 -- 172.21.15.113:0/2312395731 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4004a20 con 0x7fe0940047c0 2023-12-19T13:54:29.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.845+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a80a9330 con 0x7fe0940047c0 2023-12-19T13:54:29.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.846+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8061910 con 0x7fe0940047c0 2023-12-19T13:54:29.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.847+0000 7fe09e7fc640 1 -- 172.21.15.113:0/2312395731 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0a4004b80 con 0x7fe0940047c0 2023-12-19T13:54:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.847+0000 7fe09e7fc640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe08c06a430 0x7fe08c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.848+0000 7fe09e7fc640 1 -- 172.21.15.113:0/2312395731 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0a40881f0 con 0x7fe0940047c0 2023-12-19T13:54:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.848+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe08c06a430 0x7fe08c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:29.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.848+0000 7fe0ad67d640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe08c06a430 0x7fe08c06c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe094004740 tx=0x7fe09803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:29.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:29.852+0000 7fe09e7fc640 1 -- 172.21.15.113:0/2312395731 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0a4053870 con 0x7fe0940047c0 2023-12-19T13:54:30.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.081+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0a80ae560 con 0x7fe0940047c0 2023-12-19T13:54:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.083+0000 7fe09e7fc640 1 -- 172.21.15.113:0/2312395731 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fe0a4056e90 con 0x7fe0940047c0 2023-12-19T13:54:30.082 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:30.082 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:54:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.085+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe08c06a430 msgr2=0x7fe08c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.085+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe08c06a430 0x7fe08c06c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe094004740 tx=0x7fe09803d040 comp rx=0 tx=0).stop 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.085+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 msgr2=0x7fe0a815d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.085+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe0a815d500 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400d7d0 tx=0x7fe0a400dc90 comp rx=0 tx=0).stop 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 shutdown_connections 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe08c06a430 0x7fe08c06c8f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0a80a9e10 0x7fe0a80aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0a8159790 0x7fe0a8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 --2- 172.21.15.113:0/2312395731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0940047c0 0x7fe0a815d500 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 >> 172.21.15.113:0/2312395731 conn(0x7fe0a80cbb70 msgr2=0x7fe0a806f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:30.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 shutdown_connections 2023-12-19T13:54:30.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.086+0000 7fe0b00e2640 1 -- 172.21.15.113:0/2312395731 wait complete. 2023-12-19T13:54:30.106 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:54:30.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.309+0000 7f79a359e640 1 Processor -- start 2023-12-19T13:54:30.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.309+0000 7f79a359e640 1 -- start start 2023-12-19T13:54:30.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.310+0000 7f79a359e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79a415aa70 0x7f79a4164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.310+0000 7f79a359e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a406b520 con 0x7f79a415b1e0 2023-12-19T13:54:30.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.310+0000 7f79a359e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a40b2b20 con 0x7f79a4159f80 2023-12-19T13:54:30.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f79a359e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40b2fb0 con 0x7f79a415aa70 2023-12-19T13:54:30.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f7999d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f79a415b1e0 0x7f79a415a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38670/0 (socket says 172.21.15.113:38670) 2023-12-19T13:54:30.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f7999d9b640 1 -- 172.21.15.113:0/894933067 learned_addr learned my addr 172.21.15.113:0/894933067 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:30.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f79a2d9d640 1 --2- 172.21.15.113:0/894933067 >> v2:172.21.15.113:3300/0 conn(0x7f79a415aa70 0x7f79a4164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f79a1d9b640 1 -- 172.21.15.113:0/894933067 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572137659 0 0) 0x7f79a406b520 con 0x7f79a415b1e0 2023-12-19T13:54:30.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f79a1d9b640 1 -- 172.21.15.113:0/894933067 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7990005730 con 0x7f79a415b1e0 2023-12-19T13:54:30.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f79a2d9d640 1 -- 172.21.15.113:0/894933067 >> v1:172.21.15.151:6789/0 conn(0x7f79a4159f80 legacy=0x7f79a406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f79a2d9d640 1 -- 172.21.15.113:0/894933067 >> v1:172.21.15.113:6789/0 conn(0x7f79a415b1e0 legacy=0x7f79a415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.311+0000 7f79a2d9d640 1 -- 172.21.15.113:0/894933067 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40b1f10 con 0x7f79a415aa70 2023-12-19T13:54:30.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.313+0000 7f79a2d9d640 1 --2- 172.21.15.113:0/894933067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a415aa70 0x7f79a4164f30 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f799c009d90 tx=0x7f799c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685ee690bb6c4a92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:30.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.313+0000 7f79a1d9b640 1 -- 172.21.15.113:0/894933067 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c02cd80 con 0x7f79a415aa70 2023-12-19T13:54:30.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.313+0000 7f79a1d9b640 1 -- 172.21.15.113:0/894933067 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c034440 con 0x7f79a415aa70 2023-12-19T13:54:30.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.313+0000 7f79a1d9b640 1 -- 172.21.15.113:0/894933067 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0347d0 con 0x7f79a415aa70 2023-12-19T13:54:30.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.313+0000 7f79a359e640 1 -- 172.21.15.113:0/894933067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a415aa70 msgr2=0x7f79a4164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.314+0000 7f79a359e640 1 --2- 172.21.15.113:0/894933067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a415aa70 0x7f79a4164f30 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f799c009d90 tx=0x7f799c02bfd0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.314+0000 7f79a359e640 1 -- 172.21.15.113:0/894933067 shutdown_connections 2023-12-19T13:54:30.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.314+0000 7f79a359e640 1 --2- 172.21.15.113:0/894933067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a415aa70 0x7f79a4164f30 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.314+0000 7f79a359e640 1 -- 172.21.15.113:0/894933067 >> 172.21.15.113:0/894933067 conn(0x7f79a40b0100 msgr2=0x7f79a40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:30.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.314+0000 7f79a359e640 1 -- 172.21.15.113:0/894933067 shutdown_connections 2023-12-19T13:54:30.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.314+0000 7f79a359e640 1 -- 172.21.15.113:0/894933067 wait complete. 2023-12-19T13:54:30.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.315+0000 7f79a359e640 1 Processor -- start 2023-12-19T13:54:30.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.316+0000 7f79a359e640 1 -- start start 2023-12-19T13:54:30.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.316+0000 7f79a359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a4159f80 0x7f79a4152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.316+0000 7f79a359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a415aa70 0x7f79a406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a415b1e0 0x7f79a4153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a359e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40af710 con 0x7f79a4159f80 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a41531f0 con 0x7f79a415b1e0 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4152c10 con 0x7f79a415aa70 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a4159f80 0x7f79a4152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a4159f80 0x7f79a4152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55826/0 (socket says 172.21.15.113:55826) 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 -- 172.21.15.113:0/1884354703 learned_addr learned my addr 172.21.15.113:0/1884354703 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f7999d9b640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a415aa70 0x7f79a406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a2d9d640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a415b1e0 0x7f79a4153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 -- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a415aa70 msgr2=0x7f79a406bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a415aa70 0x7f79a406bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 -- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a415b1e0 msgr2=0x7f79a4153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a415b1e0 0x7f79a4153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.317+0000 7f79a259c640 1 -- 172.21.15.113:0/1884354703 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009a70 con 0x7f79a4159f80 2023-12-19T13:54:30.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.318+0000 7f79a259c640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a4159f80 0x7f79a4152300 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f799400c480 tx=0x7f799400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:30.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.318+0000 7f799b7fe640 1 -- 172.21.15.113:0/1884354703 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940052d0 con 0x7f79a4159f80 2023-12-19T13:54:30.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.318+0000 7f799b7fe640 1 -- 172.21.15.113:0/1884354703 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7994005430 con 0x7f79a4159f80 2023-12-19T13:54:30.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.318+0000 7f799b7fe640 1 -- 172.21.15.113:0/1884354703 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994012870 con 0x7f79a4159f80 2023-12-19T13:54:30.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.318+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a4159410 con 0x7f79a4159f80 2023-12-19T13:54:30.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.318+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a41596f0 con 0x7f79a4159f80 2023-12-19T13:54:30.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.319+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a4061910 con 0x7f79a4159f80 2023-12-19T13:54:30.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.320+0000 7f799b7fe640 1 -- 172.21.15.113:0/1884354703 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79940129d0 con 0x7f79a4159f80 2023-12-19T13:54:30.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.321+0000 7f799b7fe640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f798406a460 0x7f798406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.321+0000 7f799b7fe640 1 -- 172.21.15.113:0/1884354703 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79940883c0 con 0x7f79a4159f80 2023-12-19T13:54:30.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.321+0000 7f7999d9b640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f798406a460 0x7f798406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.322+0000 7f7999d9b640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f798406a460 0x7f798406c920 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f79a40cb720 tx=0x7f798c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:30.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.325+0000 7f799b7fe640 1 -- 172.21.15.113:0/1884354703 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7994053a40 con 0x7f79a4159f80 2023-12-19T13:54:30.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.516+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79a40cd870 con 0x7f79a4159f80 2023-12-19T13:54:30.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.517+0000 7f799b7fe640 1 -- 172.21.15.113:0/1884354703 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+16164 (secure 0 0 0) 0x7f7994057060 con 0x7f79a4159f80 2023-12-19T13:54:30.517 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:30.517 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":147,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:54:27.088933+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:54:30.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.520+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f798406a460 msgr2=0x7f798406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.520+0000 7f79a359e640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f798406a460 0x7f798406c920 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f79a40cb720 tx=0x7f798c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:30.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.520+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a4159f80 msgr2=0x7f79a4152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.520+0000 7f79a359e640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a4159f80 0x7f79a4152300 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f799400c480 tx=0x7f799400c940 comp rx=0 tx=0).stop 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 shutdown_connections 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f798406a460 0x7f798406c920 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a415b1e0 0x7f79a4153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a415aa70 0x7f79a406bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 --2- 172.21.15.113:0/1884354703 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79a4159f80 0x7f79a4152300 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 >> 172.21.15.113:0/1884354703 conn(0x7f79a40b0100 msgr2=0x7f79a4155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 shutdown_connections 2023-12-19T13:54:30.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.521+0000 7f79a359e640 1 -- 172.21.15.113:0/1884354703 wait complete. 2023-12-19T13:54:30.538 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:54:30.538 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:54:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.749+0000 7f2bb66b6640 1 Processor -- start 2023-12-19T13:54:30.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.749+0000 7f2bb66b6640 1 -- start start 2023-12-19T13:54:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb66b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb006e190 0x7f2bb00cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb66b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2bb00af540 0x7f2bb00af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb66b6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb00ce780 con 0x7f2bb01599c0 2023-12-19T13:54:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb66b6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb015daa0 con 0x7f2bb00af540 2023-12-19T13:54:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb66b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00aff30 con 0x7f2bb006e190 2023-12-19T13:54:30.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb4c53640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2bb00af540 0x7f2bb00af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.751 INFO:tasks.ceph.mds.a.smithi113.stderr:2023-12-19T13:54:30.751+0000 7fc746fa1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb4c53640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2bb00af540 0x7f2bb00af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55838/0 (socket says 172.21.15.113:55838) 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2bb4c53640 1 -- 172.21.15.113:0/3741220274 learned_addr learned my addr 172.21.15.113:0/3741220274 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.751+0000 7f2baf7fe640 1 --2- 172.21.15.113:0/3741220274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb006e190 0x7f2bb00cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.752+0000 7f2bb4c53640 1 -- 172.21.15.113:0/3741220274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb006e190 msgr2=0x7f2bb00cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.752+0000 7f2bb4c53640 1 --2- 172.21.15.113:0/3741220274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb006e190 0x7f2bb00cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.752+0000 7f2bb4c53640 1 -- 172.21.15.113:0/3741220274 >> v1:172.21.15.151:6789/0 conn(0x7f2bb01599c0 legacy=0x7f2bb015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.752+0000 7f2bb4c53640 1 -- 172.21.15.113:0/3741220274 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb00cea60 con 0x7f2bb00af540 2023-12-19T13:54:30.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.753+0000 7f2bb4c53640 1 --2- 172.21.15.113:0/3741220274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb00af9f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5774e0ed16e3abd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.753+0000 7f2baeffd640 1 -- 172.21.15.113:0/3741220274 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8031740 con 0x7f2bb00af540 2023-12-19T13:54:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.753+0000 7f2baeffd640 1 -- 172.21.15.113:0/3741220274 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba80318a0 con 0x7f2bb00af540 2023-12-19T13:54:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.753+0000 7f2baeffd640 1 -- 172.21.15.113:0/3741220274 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8031c30 con 0x7f2bb00af540 2023-12-19T13:54:30.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3741220274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 msgr2=0x7f2bb00af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3741220274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb00af9f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba802b7e0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3741220274 shutdown_connections 2023-12-19T13:54:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3741220274 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb00af9f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3741220274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb006e190 0x7f2bb00cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3741220274 >> 172.21.15.113:0/3741220274 conn(0x7f2bb00cbb70 msgr2=0x7f2bb00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3741220274 shutdown_connections 2023-12-19T13:54:30.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.754+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3741220274 wait complete. 2023-12-19T13:54:30.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.756+0000 7f2bb66b6640 1 Processor -- start 2023-12-19T13:54:30.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.756+0000 7f2bb66b6640 1 -- start start 2023-12-19T13:54:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2bb66b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bb006e190 0x7f2bb0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2bb66b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb0149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2bb66b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb01599c0 0x7f2bb00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2bb66b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0151800 con 0x7f2bb00af540 2023-12-19T13:54:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2bb66b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb015af80 con 0x7f2bb006e190 2023-12-19T13:54:30.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2bb66b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb015a460 con 0x7f2bb01599c0 2023-12-19T13:54:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2baf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb0149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2baf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb0149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55854/0 (socket says 172.21.15.113:55854) 2023-12-19T13:54:30.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2baf7fe640 1 -- 172.21.15.113:0/3207305301 learned_addr learned my addr 172.21.15.113:0/3207305301 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:30.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2bb4c53640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb01599c0 0x7f2bb00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2baffff640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bb006e190 0x7f2bb0159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.757+0000 7f2baf7fe640 1 -- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb01599c0 msgr2=0x7f2bb00cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2baf7fe640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb01599c0 0x7f2bb00cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2baf7fe640 1 -- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bb006e190 msgr2=0x7f2bb0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2baf7fe640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bb006e190 0x7f2bb0159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2baf7fe640 1 -- 172.21.15.113:0/3207305301 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80094d0 con 0x7f2bb00af540 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2baffff640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bb006e190 0x7f2bb0159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2baf7fe640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb0149030 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800d5d0 tx=0x7f2b9800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2bacff9640 1 -- 172.21.15.113:0/3207305301 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98004240 con 0x7f2bb00af540 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2bacff9640 1 -- 172.21.15.113:0/3207305301 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980043a0 con 0x7f2bb00af540 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2bacff9640 1 -- 172.21.15.113:0/3207305301 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98003830 con 0x7f2bb00af540 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb015a6e0 con 0x7f2bb00af540 2023-12-19T13:54:30.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.758+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb015aca0 con 0x7f2bb00af540 2023-12-19T13:54:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.759+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb0061910 con 0x7f2bb00af540 2023-12-19T13:54:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.760+0000 7f2bacff9640 1 -- 172.21.15.113:0/3207305301 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b98003990 con 0x7f2bb00af540 2023-12-19T13:54:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.761+0000 7f2bacff9640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2b9006a430 0x7f2b9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.761+0000 7f2bacff9640 1 -- 172.21.15.113:0/3207305301 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b98088af0 con 0x7f2bb00af540 2023-12-19T13:54:30.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.761+0000 7f2baffff640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2b9006a430 0x7f2b9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:30.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.762+0000 7f2baffff640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2b9006a430 0x7f2b9006c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0004520 tx=0x7f2ba0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:30.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.765+0000 7f2bacff9640 1 -- 172.21.15.113:0/3207305301 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2b980540e0 con 0x7f2bb00af540 2023-12-19T13:54:30.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.955+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bb0159da0 con 0x7f2b9006a430 2023-12-19T13:54:30.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.967+0000 7f2bacff9640 1 -- 172.21.15.113:0/3207305301 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282810 (secure 0 0 0) 0x7f2ba000d8d0 con 0x7f2b9006a430 2023-12-19T13:54:30.971 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:30.973 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2b9006a430 msgr2=0x7f2b9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2b9006a430 0x7f2b9006c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0004520 tx=0x7f2ba0009040 comp rx=0 tx=0).stop 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 msgr2=0x7f2bb0149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb0149030 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800d5d0 tx=0x7f2b9800da90 comp rx=0 tx=0).stop 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 shutdown_connections 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2b9006a430 0x7f2b9006c8f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bb01599c0 0x7f2bb00cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bb00af540 0x7f2bb0149030 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 --2- 172.21.15.113:0/3207305301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bb006e190 0x7f2bb0159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.973+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 >> 172.21.15.113:0/3207305301 conn(0x7f2bb00cbb70 msgr2=0x7f2bb00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:30.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.974+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 shutdown_connections 2023-12-19T13:54:30.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:30.974+0000 7f2bb66b6640 1 -- 172.21.15.113:0/3207305301 wait complete. 2023-12-19T13:54:30.992 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2023-12-19T13:54:30.567104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7567,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554932,"statfs":{"total":1600000000,"available":1592250748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.976539"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666952+0000","last_change":"2023-12-19T13:54:26.117242+0000","last_active":"2023-12-19T13:54:27.666952+0000","last_peered":"2023-12-19T13:54:27.666952+0000","last_clean":"2023-12-19T13:54:27.666952+0000","last_became_active":"2023-12-19T13:54:26.116827+0000","last_became_peered":"2023-12-19T13:54:26.116827+0000","last_unstale":"2023-12-19T13:54:27.666952+0000","last_undegraded":"2023-12-19T13:54:27.666952+0000","last_fullsized":"2023-12-19T13:54:27.666952+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665324+0000","last_change":"2023-12-19T13:54:26.109599+0000","last_active":"2023-12-19T13:54:27.665324+0000","last_peered":"2023-12-19T13:54:27.665324+0000","last_clean":"2023-12-19T13:54:27.665324+0000","last_became_active":"2023-12-19T13:54:26.109097+0000","last_became_peered":"2023-12-19T13:54:26.109097+0000","last_unstale":"2023-12-19T13:54:27.665324+0000","last_undegraded":"2023-12-19T13:54:27.665324+0000","last_fullsized":"2023-12-19T13:54:27.665324+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:06.316861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095605+0000","last_change":"2023-12-19T13:54:26.097348+0000","last_active":"2023-12-19T13:54:27.095605+0000","last_peered":"2023-12-19T13:54:27.095605+0000","last_clean":"2023-12-19T13:54:27.095605+0000","last_became_active":"2023-12-19T13:54:26.097093+0000","last_became_peered":"2023-12-19T13:54:26.097093+0000","last_unstale":"2023-12-19T13:54:27.095605+0000","last_undegraded":"2023-12-19T13:54:27.095605+0000","last_fullsized":"2023-12-19T13:54:27.095605+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:23.258937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178637+0000","last_change":"2023-12-19T13:54:26.121798+0000","last_active":"2023-12-19T13:54:27.178637+0000","last_peered":"2023-12-19T13:54:27.178637+0000","last_clean":"2023-12-19T13:54:27.178637+0000","last_became_active":"2023-12-19T13:54:26.117032+0000","last_became_peered":"2023-12-19T13:54:26.117032+0000","last_unstale":"2023-12-19T13:54:27.178637+0000","last_undegraded":"2023-12-19T13:54:27.178637+0000","last_fullsized":"2023-12-19T13:54:27.178637+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:52.795112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.100543+0000","last_change":"2023-12-19T13:54:26.123990+0000","last_active":"2023-12-19T13:54:27.100543+0000","last_peered":"2023-12-19T13:54:27.100543+0000","last_clean":"2023-12-19T13:54:27.100543+0000","last_became_active":"2023-12-19T13:54:26.123769+0000","last_became_peered":"2023-12-19T13:54:26.123769+0000","last_unstale":"2023-12-19T13:54:27.100543+0000","last_undegraded":"2023-12-19T13:54:27.100543+0000","last_fullsized":"2023-12-19T13:54:27.100543+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665040+0000","last_change":"2023-12-19T13:54:26.125317+0000","last_active":"2023-12-19T13:54:27.665040+0000","last_peered":"2023-12-19T13:54:27.665040+0000","last_clean":"2023-12-19T13:54:27.665040+0000","last_became_active":"2023-12-19T13:54:26.125063+0000","last_became_peered":"2023-12-19T13:54:26.125063+0000","last_unstale":"2023-12-19T13:54:27.665040+0000","last_undegraded":"2023-12-19T13:54:27.665040+0000","last_fullsized":"2023-12-19T13:54:27.665040+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:18.236134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666150+0000","last_change":"2023-12-19T13:54:26.103244+0000","last_active":"2023-12-19T13:54:27.666150+0000","last_peered":"2023-12-19T13:54:27.666150+0000","last_clean":"2023-12-19T13:54:27.666150+0000","last_became_active":"2023-12-19T13:54:26.103029+0000","last_became_peered":"2023-12-19T13:54:26.103029+0000","last_unstale":"2023-12-19T13:54:27.666150+0000","last_undegraded":"2023-12-19T13:54:27.666150+0000","last_fullsized":"2023-12-19T13:54:27.666150+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:45.516555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.664983+0000","last_change":"2023-12-19T13:54:26.099667+0000","last_active":"2023-12-19T13:54:27.664983+0000","last_peered":"2023-12-19T13:54:27.664983+0000","last_clean":"2023-12-19T13:54:27.664983+0000","last_became_active":"2023-12-19T13:54:26.098781+0000","last_became_peered":"2023-12-19T13:54:26.098781+0000","last_unstale":"2023-12-19T13:54:27.664983+0000","last_undegraded":"2023-12-19T13:54:27.664983+0000","last_fullsized":"2023-12-19T13:54:27.664983+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:19.374606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665693+0000","last_change":"2023-12-19T13:54:26.126332+0000","last_active":"2023-12-19T13:54:27.665693+0000","last_peered":"2023-12-19T13:54:27.665693+0000","last_clean":"2023-12-19T13:54:27.665693+0000","last_became_active":"2023-12-19T13:54:26.121758+0000","last_became_peered":"2023-12-19T13:54:26.121758+0000","last_unstale":"2023-12-19T13:54:27.665693+0000","last_undegraded":"2023-12-19T13:54:27.665693+0000","last_fullsized":"2023-12-19T13:54:27.665693+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:31.846511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099715+0000","last_change":"2023-12-19T13:54:26.122639+0000","last_active":"2023-12-19T13:54:27.099715+0000","last_peered":"2023-12-19T13:54:27.099715+0000","last_clean":"2023-12-19T13:54:27.099715+0000","last_became_active":"2023-12-19T13:54:26.121828+0000","last_became_peered":"2023-12-19T13:54:26.121828+0000","last_unstale":"2023-12-19T13:54:27.099715+0000","last_undegraded":"2023-12-19T13:54:27.099715+0000","last_fullsized":"2023-12-19T13:54:27.099715+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:33.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665360+0000","last_change":"2023-12-19T13:54:26.107058+0000","last_active":"2023-12-19T13:54:27.665360+0000","last_peered":"2023-12-19T13:54:27.665360+0000","last_clean":"2023-12-19T13:54:27.665360+0000","last_became_active":"2023-12-19T13:54:26.106843+0000","last_became_peered":"2023-12-19T13:54:26.106843+0000","last_unstale":"2023-12-19T13:54:27.665360+0000","last_undegraded":"2023-12-19T13:54:27.665360+0000","last_fullsized":"2023-12-19T13:54:27.665360+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:02.592252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098772+0000","last_change":"2023-12-19T13:54:26.121190+0000","last_active":"2023-12-19T13:54:27.098772+0000","last_peered":"2023-12-19T13:54:27.098772+0000","last_clean":"2023-12-19T13:54:27.098772+0000","last_became_active":"2023-12-19T13:54:26.120950+0000","last_became_peered":"2023-12-19T13:54:26.120950+0000","last_unstale":"2023-12-19T13:54:27.098772+0000","last_undegraded":"2023-12-19T13:54:27.098772+0000","last_fullsized":"2023-12-19T13:54:27.098772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:39:08.448963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665644+0000","last_change":"2023-12-19T13:54:26.101429+0000","last_active":"2023-12-19T13:54:27.665644+0000","last_peered":"2023-12-19T13:54:27.665644+0000","last_clean":"2023-12-19T13:54:27.665644+0000","last_became_active":"2023-12-19T13:54:26.101220+0000","last_became_peered":"2023-12-19T13:54:26.101220+0000","last_unstale":"2023-12-19T13:54:27.665644+0000","last_undegraded":"2023-12-19T13:54:27.665644+0000","last_fullsized":"2023-12-19T13:54:27.665644+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:33.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098434+0000","last_change":"2023-12-19T13:54:26.106143+0000","last_active":"2023-12-19T13:54:27.098434+0000","last_peered":"2023-12-19T13:54:27.098434+0000","last_clean":"2023-12-19T13:54:27.098434+0000","last_became_active":"2023-12-19T13:54:26.105623+0000","last_became_peered":"2023-12-19T13:54:26.105623+0000","last_unstale":"2023-12-19T13:54:27.098434+0000","last_undegraded":"2023-12-19T13:54:27.098434+0000","last_fullsized":"2023-12-19T13:54:27.098434+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:38.639069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667035+0000","last_change":"2023-12-19T13:54:26.124559+0000","last_active":"2023-12-19T13:54:27.667035+0000","last_peered":"2023-12-19T13:54:27.667035+0000","last_clean":"2023-12-19T13:54:27.667035+0000","last_became_active":"2023-12-19T13:54:26.124186+0000","last_became_peered":"2023-12-19T13:54:26.124186+0000","last_unstale":"2023-12-19T13:54:27.667035+0000","last_undegraded":"2023-12-19T13:54:27.667035+0000","last_fullsized":"2023-12-19T13:54:27.667035+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:46:22.920971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099637+0000","last_change":"2023-12-19T13:54:26.111717+0000","last_active":"2023-12-19T13:54:27.099637+0000","last_peered":"2023-12-19T13:54:27.099637+0000","last_clean":"2023-12-19T13:54:27.099637+0000","last_became_active":"2023-12-19T13:54:26.110382+0000","last_became_peered":"2023-12-19T13:54:26.110382+0000","last_unstale":"2023-12-19T13:54:27.099637+0000","last_undegraded":"2023-12-19T13:54:27.099637+0000","last_fullsized":"2023-12-19T13:54:27.099637+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:14.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.094827+0000","last_change":"2023-12-19T13:54:26.103382+0000","last_active":"2023-12-19T13:54:27.094827+0000","last_peered":"2023-12-19T13:54:27.094827+0000","last_clean":"2023-12-19T13:54:27.094827+0000","last_became_active":"2023-12-19T13:54:26.103165+0000","last_became_peered":"2023-12-19T13:54:26.103165+0000","last_unstale":"2023-12-19T13:54:27.094827+0000","last_undegraded":"2023-12-19T13:54:27.094827+0000","last_fullsized":"2023-12-19T13:54:27.094827+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:22:31.092881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665225+0000","last_change":"2023-12-19T13:54:26.112673+0000","last_active":"2023-12-19T13:54:27.665225+0000","last_peered":"2023-12-19T13:54:27.665225+0000","last_clean":"2023-12-19T13:54:27.665225+0000","last_became_active":"2023-12-19T13:54:26.112394+0000","last_became_peered":"2023-12-19T13:54:26.112394+0000","last_unstale":"2023-12-19T13:54:27.665225+0000","last_undegraded":"2023-12-19T13:54:27.665225+0000","last_fullsized":"2023-12-19T13:54:27.665225+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:46.295002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095032+0000","last_change":"2023-12-19T13:54:26.102344+0000","last_active":"2023-12-19T13:54:27.095032+0000","last_peered":"2023-12-19T13:54:27.095032+0000","last_clean":"2023-12-19T13:54:27.095032+0000","last_became_active":"2023-12-19T13:54:26.102105+0000","last_became_peered":"2023-12-19T13:54:26.102105+0000","last_unstale":"2023-12-19T13:54:27.095032+0000","last_undegraded":"2023-12-19T13:54:27.095032+0000","last_fullsized":"2023-12-19T13:54:27.095032+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:04.857712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095901+0000","last_change":"2023-12-19T13:54:26.111659+0000","last_active":"2023-12-19T13:54:27.095901+0000","last_peered":"2023-12-19T13:54:27.095901+0000","last_clean":"2023-12-19T13:54:27.095901+0000","last_became_active":"2023-12-19T13:54:26.111377+0000","last_became_peered":"2023-12-19T13:54:26.111377+0000","last_unstale":"2023-12-19T13:54:27.095901+0000","last_undegraded":"2023-12-19T13:54:27.095901+0000","last_fullsized":"2023-12-19T13:54:27.095901+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:47.391493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665616+0000","last_change":"2023-12-19T13:54:26.111253+0000","last_active":"2023-12-19T13:54:27.665616+0000","last_peered":"2023-12-19T13:54:27.665616+0000","last_clean":"2023-12-19T13:54:27.665616+0000","last_became_active":"2023-12-19T13:54:26.111023+0000","last_became_peered":"2023-12-19T13:54:26.111023+0000","last_unstale":"2023-12-19T13:54:27.665616+0000","last_undegraded":"2023-12-19T13:54:27.665616+0000","last_fullsized":"2023-12-19T13:54:27.665616+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:54.177046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666043+0000","last_change":"2023-12-19T13:54:26.124420+0000","last_active":"2023-12-19T13:54:27.666043+0000","last_peered":"2023-12-19T13:54:27.666043+0000","last_clean":"2023-12-19T13:54:27.666043+0000","last_became_active":"2023-12-19T13:54:26.123631+0000","last_became_peered":"2023-12-19T13:54:26.123631+0000","last_unstale":"2023-12-19T13:54:27.666043+0000","last_undegraded":"2023-12-19T13:54:27.666043+0000","last_fullsized":"2023-12-19T13:54:27.666043+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:49:20.100742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098399+0000","last_change":"2023-12-19T13:54:26.108325+0000","last_active":"2023-12-19T13:54:27.098399+0000","last_peered":"2023-12-19T13:54:27.098399+0000","last_clean":"2023-12-19T13:54:27.098399+0000","last_became_active":"2023-12-19T13:54:26.108045+0000","last_became_peered":"2023-12-19T13:54:26.108045+0000","last_unstale":"2023-12-19T13:54:27.098399+0000","last_undegraded":"2023-12-19T13:54:27.098399+0000","last_fullsized":"2023-12-19T13:54:27.098399+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:06.316861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178793+0000","last_change":"2023-12-19T13:54:26.124649+0000","last_active":"2023-12-19T13:54:27.178793+0000","last_peered":"2023-12-19T13:54:27.178793+0000","last_clean":"2023-12-19T13:54:27.178793+0000","last_became_active":"2023-12-19T13:54:26.124204+0000","last_became_peered":"2023-12-19T13:54:26.124204+0000","last_unstale":"2023-12-19T13:54:27.178793+0000","last_undegraded":"2023-12-19T13:54:27.178793+0000","last_fullsized":"2023-12-19T13:54:27.178793+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:17.743121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665799+0000","last_change":"2023-12-19T13:54:26.098621+0000","last_active":"2023-12-19T13:54:27.665799+0000","last_peered":"2023-12-19T13:54:27.665799+0000","last_clean":"2023-12-19T13:54:27.665799+0000","last_became_active":"2023-12-19T13:54:26.098369+0000","last_became_peered":"2023-12-19T13:54:26.098369+0000","last_unstale":"2023-12-19T13:54:27.665799+0000","last_undegraded":"2023-12-19T13:54:27.665799+0000","last_fullsized":"2023-12-19T13:54:27.665799+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:22.822863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665626+0000","last_change":"2023-12-19T13:54:26.120035+0000","last_active":"2023-12-19T13:54:27.665626+0000","last_peered":"2023-12-19T13:54:27.665626+0000","last_clean":"2023-12-19T13:54:27.665626+0000","last_became_active":"2023-12-19T13:54:26.119808+0000","last_became_peered":"2023-12-19T13:54:26.119808+0000","last_unstale":"2023-12-19T13:54:27.665626+0000","last_undegraded":"2023-12-19T13:54:27.665626+0000","last_fullsized":"2023-12-19T13:54:27.665626+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:31.961971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178767+0000","last_change":"2023-12-19T13:54:26.125583+0000","last_active":"2023-12-19T13:54:27.178767+0000","last_peered":"2023-12-19T13:54:27.178767+0000","last_clean":"2023-12-19T13:54:27.178767+0000","last_became_active":"2023-12-19T13:54:26.125068+0000","last_became_peered":"2023-12-19T13:54:26.125068+0000","last_unstale":"2023-12-19T13:54:27.178767+0000","last_undegraded":"2023-12-19T13:54:27.178767+0000","last_fullsized":"2023-12-19T13:54:27.178767+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:58.298641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665047+0000","last_change":"2023-12-19T13:54:26.123934+0000","last_active":"2023-12-19T13:54:27.665047+0000","last_peered":"2023-12-19T13:54:27.665047+0000","last_clean":"2023-12-19T13:54:27.665047+0000","last_became_active":"2023-12-19T13:54:26.123691+0000","last_became_peered":"2023-12-19T13:54:26.123691+0000","last_unstale":"2023-12-19T13:54:27.665047+0000","last_undegraded":"2023-12-19T13:54:27.665047+0000","last_fullsized":"2023-12-19T13:54:27.665047+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:07.155650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098730+0000","last_change":"2023-12-19T13:54:26.106001+0000","last_active":"2023-12-19T13:54:27.098730+0000","last_peered":"2023-12-19T13:54:27.098730+0000","last_clean":"2023-12-19T13:54:27.098730+0000","last_became_active":"2023-12-19T13:54:26.105340+0000","last_became_peered":"2023-12-19T13:54:26.105340+0000","last_unstale":"2023-12-19T13:54:27.098730+0000","last_undegraded":"2023-12-19T13:54:27.098730+0000","last_fullsized":"2023-12-19T13:54:27.098730+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:11.863516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666014+0000","last_change":"2023-12-19T13:54:26.120147+0000","last_active":"2023-12-19T13:54:27.666014+0000","last_peered":"2023-12-19T13:54:27.666014+0000","last_clean":"2023-12-19T13:54:27.666014+0000","last_became_active":"2023-12-19T13:54:26.119955+0000","last_became_peered":"2023-12-19T13:54:26.119955+0000","last_unstale":"2023-12-19T13:54:27.666014+0000","last_undegraded":"2023-12-19T13:54:27.666014+0000","last_fullsized":"2023-12-19T13:54:27.666014+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:03.950277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667194+0000","last_change":"2023-12-19T13:54:26.114174+0000","last_active":"2023-12-19T13:54:27.667194+0000","last_peered":"2023-12-19T13:54:27.667194+0000","last_clean":"2023-12-19T13:54:27.667194+0000","last_became_active":"2023-12-19T13:54:26.112159+0000","last_became_peered":"2023-12-19T13:54:26.112159+0000","last_unstale":"2023-12-19T13:54:27.667194+0000","last_undegraded":"2023-12-19T13:54:27.667194+0000","last_fullsized":"2023-12-19T13:54:27.667194+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099399+0000","last_change":"2023-12-19T13:54:26.111975+0000","last_active":"2023-12-19T13:54:27.099399+0000","last_peered":"2023-12-19T13:54:27.099399+0000","last_clean":"2023-12-19T13:54:27.099399+0000","last_became_active":"2023-12-19T13:54:26.109129+0000","last_became_peered":"2023-12-19T13:54:26.109129+0000","last_unstale":"2023-12-19T13:54:27.099399+0000","last_undegraded":"2023-12-19T13:54:27.099399+0000","last_fullsized":"2023-12-19T13:54:27.099399+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:17.421083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665943+0000","last_change":"2023-12-19T13:54:26.126064+0000","last_active":"2023-12-19T13:54:27.665943+0000","last_peered":"2023-12-19T13:54:27.665943+0000","last_clean":"2023-12-19T13:54:27.665943+0000","last_became_active":"2023-12-19T13:54:26.121412+0000","last_became_peered":"2023-12-19T13:54:26.121412+0000","last_unstale":"2023-12-19T13:54:27.665943+0000","last_undegraded":"2023-12-19T13:54:27.665943+0000","last_fullsized":"2023-12-19T13:54:27.665943+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:40.805236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"146'4","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.111191+0000","last_change":"2023-12-19T13:54:25.628140+0000","last_active":"2023-12-19T13:54:26.111191+0000","last_peered":"2023-12-19T13:54:26.111191+0000","last_clean":"2023-12-19T13:54:26.111191+0000","last_became_active":"2023-12-19T13:54:25.627914+0000","last_became_peered":"2023-12-19T13:54:25.627914+0000","last_unstale":"2023-12-19T13:54:26.111191+0000","last_undegraded":"2023-12-19T13:54:26.111191+0000","last_fullsized":"2023-12-19T13:54:26.111191+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:05:33.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098511+0000","last_change":"2023-12-19T13:54:26.106713+0000","last_active":"2023-12-19T13:54:27.098511+0000","last_peered":"2023-12-19T13:54:27.098511+0000","last_clean":"2023-12-19T13:54:27.098511+0000","last_became_active":"2023-12-19T13:54:26.106341+0000","last_became_peered":"2023-12-19T13:54:26.106341+0000","last_unstale":"2023-12-19T13:54:27.098511+0000","last_undegraded":"2023-12-19T13:54:27.098511+0000","last_fullsized":"2023-12-19T13:54:27.098511+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:33.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.105793+0000","last_change":"2023-12-19T13:54:25.623750+0000","last_active":"2023-12-19T13:54:26.105793+0000","last_peered":"2023-12-19T13:54:26.105793+0000","last_clean":"2023-12-19T13:54:26.105793+0000","last_became_active":"2023-12-19T13:54:25.623313+0000","last_became_peered":"2023-12-19T13:54:25.623313+0000","last_unstale":"2023-12-19T13:54:26.105793+0000","last_undegraded":"2023-12-19T13:54:26.105793+0000","last_fullsized":"2023-12-19T13:54:26.105793+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:15.759770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665890+0000","last_change":"2023-12-19T13:54:26.119277+0000","last_active":"2023-12-19T13:54:27.665890+0000","last_peered":"2023-12-19T13:54:27.665890+0000","last_clean":"2023-12-19T13:54:27.665890+0000","last_became_active":"2023-12-19T13:54:26.119035+0000","last_became_peered":"2023-12-19T13:54:26.119035+0000","last_unstale":"2023-12-19T13:54:27.665890+0000","last_undegraded":"2023-12-19T13:54:27.665890+0000","last_fullsized":"2023-12-19T13:54:27.665890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:25.283122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.128086+0000","last_change":"2023-12-19T13:54:25.636220+0000","last_active":"2023-12-19T13:54:26.128086+0000","last_peered":"2023-12-19T13:54:26.128086+0000","last_clean":"2023-12-19T13:54:26.128086+0000","last_became_active":"2023-12-19T13:54:25.635798+0000","last_became_peered":"2023-12-19T13:54:25.635798+0000","last_unstale":"2023-12-19T13:54:26.128086+0000","last_undegraded":"2023-12-19T13:54:26.128086+0000","last_fullsized":"2023-12-19T13:54:26.128086+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:15.154617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.096118+0000","last_change":"2023-12-19T13:54:26.105415+0000","last_active":"2023-12-19T13:54:27.096118+0000","last_peered":"2023-12-19T13:54:27.096118+0000","last_clean":"2023-12-19T13:54:27.096118+0000","last_became_active":"2023-12-19T13:54:26.105174+0000","last_became_peered":"2023-12-19T13:54:26.105174+0000","last_unstale":"2023-12-19T13:54:27.096118+0000","last_undegraded":"2023-12-19T13:54:27.096118+0000","last_fullsized":"2023-12-19T13:54:27.096118+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:54.819547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.122533+0000","last_change":"2023-12-19T13:54:25.637661+0000","last_active":"2023-12-19T13:54:26.122533+0000","last_peered":"2023-12-19T13:54:26.122533+0000","last_clean":"2023-12-19T13:54:26.122533+0000","last_became_active":"2023-12-19T13:54:25.637025+0000","last_became_peered":"2023-12-19T13:54:25.637025+0000","last_unstale":"2023-12-19T13:54:26.122533+0000","last_undegraded":"2023-12-19T13:54:26.122533+0000","last_fullsized":"2023-12-19T13:54:26.122533+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:38.967262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178106+0000","last_change":"2023-12-19T13:54:26.127009+0000","last_active":"2023-12-19T13:54:27.178106+0000","last_peered":"2023-12-19T13:54:27.178106+0000","last_clean":"2023-12-19T13:54:27.178106+0000","last_became_active":"2023-12-19T13:54:26.126290+0000","last_became_peered":"2023-12-19T13:54:26.126290+0000","last_unstale":"2023-12-19T13:54:27.178106+0000","last_undegraded":"2023-12-19T13:54:27.178106+0000","last_fullsized":"2023-12-19T13:54:27.178106+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:20.697682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.120943+0000","last_change":"2023-12-19T13:54:25.625650+0000","last_active":"2023-12-19T13:54:26.120943+0000","last_peered":"2023-12-19T13:54:26.120943+0000","last_clean":"2023-12-19T13:54:26.120943+0000","last_became_active":"2023-12-19T13:54:25.625002+0000","last_became_peered":"2023-12-19T13:54:25.625002+0000","last_unstale":"2023-12-19T13:54:26.120943+0000","last_undegraded":"2023-12-19T13:54:26.120943+0000","last_fullsized":"2023-12-19T13:54:26.120943+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:57.068416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666367+0000","last_change":"2023-12-19T13:54:26.109378+0000","last_active":"2023-12-19T13:54:27.666367+0000","last_peered":"2023-12-19T13:54:27.666367+0000","last_clean":"2023-12-19T13:54:27.666367+0000","last_became_active":"2023-12-19T13:54:26.109180+0000","last_became_peered":"2023-12-19T13:54:26.109180+0000","last_unstale":"2023-12-19T13:54:27.666367+0000","last_undegraded":"2023-12-19T13:54:27.666367+0000","last_fullsized":"2023-12-19T13:54:27.666367+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:31:15.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.131455+0000","last_change":"2023-12-19T13:54:25.632853+0000","last_active":"2023-12-19T13:54:26.131455+0000","last_peered":"2023-12-19T13:54:26.131455+0000","last_clean":"2023-12-19T13:54:26.131455+0000","last_became_active":"2023-12-19T13:54:25.632620+0000","last_became_peered":"2023-12-19T13:54:25.632620+0000","last_unstale":"2023-12-19T13:54:26.131455+0000","last_undegraded":"2023-12-19T13:54:26.131455+0000","last_fullsized":"2023-12-19T13:54:26.131455+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:10.857856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.100066+0000","last_change":"2023-12-19T13:54:26.115820+0000","last_active":"2023-12-19T13:54:27.100066+0000","last_peered":"2023-12-19T13:54:27.100066+0000","last_clean":"2023-12-19T13:54:27.100066+0000","last_became_active":"2023-12-19T13:54:26.114852+0000","last_became_peered":"2023-12-19T13:54:26.114852+0000","last_unstale":"2023-12-19T13:54:27.100066+0000","last_undegraded":"2023-12-19T13:54:27.100066+0000","last_fullsized":"2023-12-19T13:54:27.100066+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.095114+0000","last_change":"2023-12-19T13:54:25.626600+0000","last_active":"2023-12-19T13:54:26.095114+0000","last_peered":"2023-12-19T13:54:26.095114+0000","last_clean":"2023-12-19T13:54:26.095114+0000","last_became_active":"2023-12-19T13:54:25.626279+0000","last_became_peered":"2023-12-19T13:54:25.626279+0000","last_unstale":"2023-12-19T13:54:26.095114+0000","last_undegraded":"2023-12-19T13:54:26.095114+0000","last_fullsized":"2023-12-19T13:54:26.095114+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:59.094564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665065+0000","last_change":"2023-12-19T13:54:26.097653+0000","last_active":"2023-12-19T13:54:27.665065+0000","last_peered":"2023-12-19T13:54:27.665065+0000","last_clean":"2023-12-19T13:54:27.665065+0000","last_became_active":"2023-12-19T13:54:26.097417+0000","last_became_peered":"2023-12-19T13:54:26.097417+0000","last_unstale":"2023-12-19T13:54:27.665065+0000","last_undegraded":"2023-12-19T13:54:27.665065+0000","last_fullsized":"2023-12-19T13:54:27.665065+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:16:22.516612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.097189+0000","last_change":"2023-12-19T13:54:25.635314+0000","last_active":"2023-12-19T13:54:26.097189+0000","last_peered":"2023-12-19T13:54:26.097189+0000","last_clean":"2023-12-19T13:54:26.097189+0000","last_became_active":"2023-12-19T13:54:25.635033+0000","last_became_peered":"2023-12-19T13:54:25.635033+0000","last_unstale":"2023-12-19T13:54:26.097189+0000","last_undegraded":"2023-12-19T13:54:26.097189+0000","last_fullsized":"2023-12-19T13:54:26.097189+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:13.434884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665552+0000","last_change":"2023-12-19T13:54:26.117164+0000","last_active":"2023-12-19T13:54:27.665552+0000","last_peered":"2023-12-19T13:54:27.665552+0000","last_clean":"2023-12-19T13:54:27.665552+0000","last_became_active":"2023-12-19T13:54:26.116997+0000","last_became_peered":"2023-12-19T13:54:26.116997+0000","last_unstale":"2023-12-19T13:54:27.665552+0000","last_undegraded":"2023-12-19T13:54:27.665552+0000","last_fullsized":"2023-12-19T13:54:27.665552+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106410+0000","last_change":"2023-12-19T13:54:25.637934+0000","last_active":"2023-12-19T13:54:26.106410+0000","last_peered":"2023-12-19T13:54:26.106410+0000","last_clean":"2023-12-19T13:54:26.106410+0000","last_became_active":"2023-12-19T13:54:25.637379+0000","last_became_peered":"2023-12-19T13:54:25.637379+0000","last_unstale":"2023-12-19T13:54:26.106410+0000","last_undegraded":"2023-12-19T13:54:26.106410+0000","last_fullsized":"2023-12-19T13:54:26.106410+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:32.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666162+0000","last_change":"2023-12-19T13:54:26.100216+0000","last_active":"2023-12-19T13:54:27.666162+0000","last_peered":"2023-12-19T13:54:27.666162+0000","last_clean":"2023-12-19T13:54:27.666162+0000","last_became_active":"2023-12-19T13:54:26.099992+0000","last_became_peered":"2023-12-19T13:54:26.099992+0000","last_unstale":"2023-12-19T13:54:27.666162+0000","last_undegraded":"2023-12-19T13:54:27.666162+0000","last_fullsized":"2023-12-19T13:54:27.666162+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.103197+0000","last_change":"2023-12-19T13:54:25.630517+0000","last_active":"2023-12-19T13:54:26.103197+0000","last_peered":"2023-12-19T13:54:26.103197+0000","last_clean":"2023-12-19T13:54:26.103197+0000","last_became_active":"2023-12-19T13:54:25.630237+0000","last_became_peered":"2023-12-19T13:54:25.630237+0000","last_unstale":"2023-12-19T13:54:26.103197+0000","last_undegraded":"2023-12-19T13:54:26.103197+0000","last_fullsized":"2023-12-19T13:54:26.103197+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:18.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.664939+0000","last_change":"2023-12-19T13:54:26.118019+0000","last_active":"2023-12-19T13:54:27.664939+0000","last_peered":"2023-12-19T13:54:27.664939+0000","last_clean":"2023-12-19T13:54:27.664939+0000","last_became_active":"2023-12-19T13:54:26.117769+0000","last_became_peered":"2023-12-19T13:54:26.117769+0000","last_unstale":"2023-12-19T13:54:27.664939+0000","last_undegraded":"2023-12-19T13:54:27.664939+0000","last_fullsized":"2023-12-19T13:54:27.664939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:11.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"146'3","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.123980+0000","last_change":"2023-12-19T13:54:25.635860+0000","last_active":"2023-12-19T13:54:26.123980+0000","last_peered":"2023-12-19T13:54:26.123980+0000","last_clean":"2023-12-19T13:54:26.123980+0000","last_became_active":"2023-12-19T13:54:25.633833+0000","last_became_peered":"2023-12-19T13:54:25.633833+0000","last_unstale":"2023-12-19T13:54:26.123980+0000","last_undegraded":"2023-12-19T13:54:26.123980+0000","last_fullsized":"2023-12-19T13:54:26.123980+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:22.253277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665464+0000","last_change":"2023-12-19T13:54:26.100623+0000","last_active":"2023-12-19T13:54:27.665464+0000","last_peered":"2023-12-19T13:54:27.665464+0000","last_clean":"2023-12-19T13:54:27.665464+0000","last_became_active":"2023-12-19T13:54:26.100378+0000","last_became_peered":"2023-12-19T13:54:26.100378+0000","last_unstale":"2023-12-19T13:54:27.665464+0000","last_undegraded":"2023-12-19T13:54:27.665464+0000","last_fullsized":"2023-12-19T13:54:27.665464+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:28.669470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"146'6","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.130000+0000","last_change":"2023-12-19T13:54:25.630326+0000","last_active":"2023-12-19T13:54:26.130000+0000","last_peered":"2023-12-19T13:54:26.130000+0000","last_clean":"2023-12-19T13:54:26.130000+0000","last_became_active":"2023-12-19T13:54:25.629814+0000","last_became_peered":"2023-12-19T13:54:25.629814+0000","last_unstale":"2023-12-19T13:54:26.130000+0000","last_undegraded":"2023-12-19T13:54:26.130000+0000","last_fullsized":"2023-12-19T13:54:26.130000+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:39:07.443303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099862+0000","last_change":"2023-12-19T13:54:26.111988+0000","last_active":"2023-12-19T13:54:27.099862+0000","last_peered":"2023-12-19T13:54:27.099862+0000","last_clean":"2023-12-19T13:54:27.099862+0000","last_became_active":"2023-12-19T13:54:26.111081+0000","last_became_peered":"2023-12-19T13:54:26.111081+0000","last_unstale":"2023-12-19T13:54:27.099862+0000","last_undegraded":"2023-12-19T13:54:27.099862+0000","last_fullsized":"2023-12-19T13:54:27.099862+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:16.160277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.126679+0000","last_change":"2023-12-19T13:54:25.633325+0000","last_active":"2023-12-19T13:54:26.126679+0000","last_peered":"2023-12-19T13:54:26.126679+0000","last_clean":"2023-12-19T13:54:26.126679+0000","last_became_active":"2023-12-19T13:54:25.630982+0000","last_became_peered":"2023-12-19T13:54:25.630982+0000","last_unstale":"2023-12-19T13:54:26.126679+0000","last_undegraded":"2023-12-19T13:54:26.126679+0000","last_fullsized":"2023-12-19T13:54:26.126679+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:51.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178938+0000","last_change":"2023-12-19T13:54:26.115781+0000","last_active":"2023-12-19T13:54:27.178938+0000","last_peered":"2023-12-19T13:54:27.178938+0000","last_clean":"2023-12-19T13:54:27.178938+0000","last_became_active":"2023-12-19T13:54:26.111692+0000","last_became_peered":"2023-12-19T13:54:26.111692+0000","last_unstale":"2023-12-19T13:54:27.178938+0000","last_undegraded":"2023-12-19T13:54:27.178938+0000","last_fullsized":"2023-12-19T13:54:27.178938+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:40.805236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.091721+0000","last_change":"2023-12-19T13:54:25.628424+0000","last_active":"2023-12-19T13:54:26.091721+0000","last_peered":"2023-12-19T13:54:26.091721+0000","last_clean":"2023-12-19T13:54:26.091721+0000","last_became_active":"2023-12-19T13:54:25.628055+0000","last_became_peered":"2023-12-19T13:54:25.628055+0000","last_unstale":"2023-12-19T13:54:26.091721+0000","last_undegraded":"2023-12-19T13:54:26.091721+0000","last_fullsized":"2023-12-19T13:54:26.091721+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:30.228285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.179017+0000","last_change":"2023-12-19T13:54:26.112724+0000","last_active":"2023-12-19T13:54:27.179017+0000","last_peered":"2023-12-19T13:54:27.179017+0000","last_clean":"2023-12-19T13:54:27.179017+0000","last_became_active":"2023-12-19T13:54:26.112252+0000","last_became_peered":"2023-12-19T13:54:26.112252+0000","last_unstale":"2023-12-19T13:54:27.179017+0000","last_undegraded":"2023-12-19T13:54:27.179017+0000","last_fullsized":"2023-12-19T13:54:27.179017+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:31.846511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"146'8","reported_seq":19,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.131195+0000","last_change":"2023-12-19T13:54:25.634788+0000","last_active":"2023-12-19T13:54:26.131195+0000","last_peered":"2023-12-19T13:54:26.131195+0000","last_clean":"2023-12-19T13:54:26.131195+0000","last_became_active":"2023-12-19T13:54:25.634396+0000","last_became_peered":"2023-12-19T13:54:25.634396+0000","last_unstale":"2023-12-19T13:54:26.131195+0000","last_undegraded":"2023-12-19T13:54:26.131195+0000","last_fullsized":"2023-12-19T13:54:26.131195+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:37.633410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667250+0000","last_change":"2023-12-19T13:54:26.122916+0000","last_active":"2023-12-19T13:54:27.667250+0000","last_peered":"2023-12-19T13:54:27.667250+0000","last_clean":"2023-12-19T13:54:27.667250+0000","last_became_active":"2023-12-19T13:54:26.122694+0000","last_became_peered":"2023-12-19T13:54:26.122694+0000","last_unstale":"2023-12-19T13:54:27.667250+0000","last_undegraded":"2023-12-19T13:54:27.667250+0000","last_fullsized":"2023-12-19T13:54:27.667250+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:31.134097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.120234+0000","last_change":"2023-12-19T13:54:25.632783+0000","last_active":"2023-12-19T13:54:26.120234+0000","last_peered":"2023-12-19T13:54:26.120234+0000","last_clean":"2023-12-19T13:54:26.120234+0000","last_became_active":"2023-12-19T13:54:25.629421+0000","last_became_peered":"2023-12-19T13:54:25.629421+0000","last_unstale":"2023-12-19T13:54:26.120234+0000","last_undegraded":"2023-12-19T13:54:26.120234+0000","last_fullsized":"2023-12-19T13:54:26.120234+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:46:21.915312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666207+0000","last_change":"2023-12-19T13:54:26.122034+0000","last_active":"2023-12-19T13:54:27.666207+0000","last_peered":"2023-12-19T13:54:27.666207+0000","last_clean":"2023-12-19T13:54:27.666207+0000","last_became_active":"2023-12-19T13:54:26.121044+0000","last_became_peered":"2023-12-19T13:54:26.121044+0000","last_unstale":"2023-12-19T13:54:27.666207+0000","last_undegraded":"2023-12-19T13:54:27.666207+0000","last_fullsized":"2023-12-19T13:54:27.666207+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:59.282095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.125654+0000","last_change":"2023-12-19T13:54:25.634307+0000","last_active":"2023-12-19T13:54:26.125654+0000","last_peered":"2023-12-19T13:54:26.125654+0000","last_clean":"2023-12-19T13:54:26.125654+0000","last_became_active":"2023-12-19T13:54:25.632020+0000","last_became_peered":"2023-12-19T13:54:25.632020+0000","last_unstale":"2023-12-19T13:54:26.125654+0000","last_undegraded":"2023-12-19T13:54:26.125654+0000","last_fullsized":"2023-12-19T13:54:26.125654+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:52.731731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666625+0000","last_change":"2023-12-19T13:54:26.110985+0000","last_active":"2023-12-19T13:54:27.666625+0000","last_peered":"2023-12-19T13:54:27.666625+0000","last_clean":"2023-12-19T13:54:27.666625+0000","last_became_active":"2023-12-19T13:54:26.110459+0000","last_became_peered":"2023-12-19T13:54:26.110459+0000","last_unstale":"2023-12-19T13:54:27.666625+0000","last_undegraded":"2023-12-19T13:54:27.666625+0000","last_fullsized":"2023-12-19T13:54:27.666625+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:14.042073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.119626+0000","last_change":"2023-12-19T13:54:25.628607+0000","last_active":"2023-12-19T13:54:26.119626+0000","last_peered":"2023-12-19T13:54:26.119626+0000","last_clean":"2023-12-19T13:54:26.119626+0000","last_became_active":"2023-12-19T13:54:25.628283+0000","last_became_peered":"2023-12-19T13:54:25.628283+0000","last_unstale":"2023-12-19T13:54:26.119626+0000","last_undegraded":"2023-12-19T13:54:26.119626+0000","last_fullsized":"2023-12-19T13:54:26.119626+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:52.731731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099495+0000","last_change":"2023-12-19T13:54:26.108079+0000","last_active":"2023-12-19T13:54:27.099495+0000","last_peered":"2023-12-19T13:54:27.099495+0000","last_clean":"2023-12-19T13:54:27.099495+0000","last_became_active":"2023-12-19T13:54:26.107718+0000","last_became_peered":"2023-12-19T13:54:26.107718+0000","last_unstale":"2023-12-19T13:54:27.099495+0000","last_undegraded":"2023-12-19T13:54:27.099495+0000","last_fullsized":"2023-12-19T13:54:27.099495+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:17.421083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.102020+0000","last_change":"2023-12-19T13:54:25.630391+0000","last_active":"2023-12-19T13:54:26.102020+0000","last_peered":"2023-12-19T13:54:26.102020+0000","last_clean":"2023-12-19T13:54:26.102020+0000","last_became_active":"2023-12-19T13:54:25.630167+0000","last_became_peered":"2023-12-19T13:54:25.630167+0000","last_unstale":"2023-12-19T13:54:26.102020+0000","last_undegraded":"2023-12-19T13:54:26.102020+0000","last_fullsized":"2023-12-19T13:54:26.102020+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:18.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095447+0000","last_change":"2023-12-19T13:54:26.096336+0000","last_active":"2023-12-19T13:54:27.095447+0000","last_peered":"2023-12-19T13:54:27.095447+0000","last_clean":"2023-12-19T13:54:27.095447+0000","last_became_active":"2023-12-19T13:54:26.096115+0000","last_became_peered":"2023-12-19T13:54:26.096115+0000","last_unstale":"2023-12-19T13:54:27.095447+0000","last_undegraded":"2023-12-19T13:54:27.095447+0000","last_fullsized":"2023-12-19T13:54:27.095447+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:14.440543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.118007+0000","last_change":"2023-12-19T13:54:25.635594+0000","last_active":"2023-12-19T13:54:26.118007+0000","last_peered":"2023-12-19T13:54:26.118007+0000","last_clean":"2023-12-19T13:54:26.118007+0000","last_became_active":"2023-12-19T13:54:25.633490+0000","last_became_peered":"2023-12-19T13:54:25.633490+0000","last_unstale":"2023-12-19T13:54:26.118007+0000","last_undegraded":"2023-12-19T13:54:26.118007+0000","last_fullsized":"2023-12-19T13:54:26.118007+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:05:33.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666619+0000","last_change":"2023-12-19T13:54:26.125996+0000","last_active":"2023-12-19T13:54:27.666619+0000","last_peered":"2023-12-19T13:54:27.666619+0000","last_clean":"2023-12-19T13:54:27.666619+0000","last_became_active":"2023-12-19T13:54:26.122577+0000","last_became_peered":"2023-12-19T13:54:26.122577+0000","last_unstale":"2023-12-19T13:54:27.666619+0000","last_undegraded":"2023-12-19T13:54:27.666619+0000","last_fullsized":"2023-12-19T13:54:27.666619+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:26.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.103997+0000","last_change":"2023-12-19T13:54:25.637945+0000","last_active":"2023-12-19T13:54:26.103997+0000","last_peered":"2023-12-19T13:54:26.103997+0000","last_clean":"2023-12-19T13:54:26.103997+0000","last_became_active":"2023-12-19T13:54:25.637699+0000","last_became_peered":"2023-12-19T13:54:25.637699+0000","last_unstale":"2023-12-19T13:54:26.103997+0000","last_undegraded":"2023-12-19T13:54:26.103997+0000","last_fullsized":"2023-12-19T13:54:26.103997+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:15.759770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099770+0000","last_change":"2023-12-19T13:54:26.118002+0000","last_active":"2023-12-19T13:54:27.099770+0000","last_peered":"2023-12-19T13:54:27.099770+0000","last_clean":"2023-12-19T13:54:27.099770+0000","last_became_active":"2023-12-19T13:54:26.117725+0000","last_became_peered":"2023-12-19T13:54:26.117725+0000","last_unstale":"2023-12-19T13:54:27.099770+0000","last_undegraded":"2023-12-19T13:54:27.099770+0000","last_fullsized":"2023-12-19T13:54:27.099770+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.100389+0000","last_change":"2023-12-19T13:54:25.636046+0000","last_active":"2023-12-19T13:54:26.100389+0000","last_peered":"2023-12-19T13:54:26.100389+0000","last_clean":"2023-12-19T13:54:26.100389+0000","last_became_active":"2023-12-19T13:54:25.635095+0000","last_became_peered":"2023-12-19T13:54:25.635095+0000","last_unstale":"2023-12-19T13:54:26.100389+0000","last_undegraded":"2023-12-19T13:54:26.100389+0000","last_fullsized":"2023-12-19T13:54:26.100389+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:13.188694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.100204+0000","last_change":"2023-12-19T13:54:26.118524+0000","last_active":"2023-12-19T13:54:27.100204+0000","last_peered":"2023-12-19T13:54:27.100204+0000","last_clean":"2023-12-19T13:54:27.100204+0000","last_became_active":"2023-12-19T13:54:26.115502+0000","last_became_peered":"2023-12-19T13:54:26.115502+0000","last_unstale":"2023-12-19T13:54:27.100204+0000","last_undegraded":"2023-12-19T13:54:27.100204+0000","last_fullsized":"2023-12-19T13:54:27.100204+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:06.316861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106619+0000","last_change":"2023-12-19T13:54:25.632551+0000","last_active":"2023-12-19T13:54:26.106619+0000","last_peered":"2023-12-19T13:54:26.106619+0000","last_clean":"2023-12-19T13:54:26.106619+0000","last_became_active":"2023-12-19T13:54:25.632166+0000","last_became_peered":"2023-12-19T13:54:25.632166+0000","last_unstale":"2023-12-19T13:54:26.106619+0000","last_undegraded":"2023-12-19T13:54:26.106619+0000","last_fullsized":"2023-12-19T13:54:26.106619+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:27.663946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098628+0000","last_change":"2023-12-19T13:54:26.116654+0000","last_active":"2023-12-19T13:54:27.098628+0000","last_peered":"2023-12-19T13:54:27.098628+0000","last_clean":"2023-12-19T13:54:27.098628+0000","last_became_active":"2023-12-19T13:54:26.116404+0000","last_became_peered":"2023-12-19T13:54:26.116404+0000","last_unstale":"2023-12-19T13:54:27.098628+0000","last_undegraded":"2023-12-19T13:54:27.098628+0000","last_fullsized":"2023-12-19T13:54:27.098628+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.125409+0000","last_change":"2023-12-19T13:54:25.632134+0000","last_active":"2023-12-19T13:54:26.125409+0000","last_peered":"2023-12-19T13:54:26.125409+0000","last_clean":"2023-12-19T13:54:26.125409+0000","last_became_active":"2023-12-19T13:54:25.631683+0000","last_became_peered":"2023-12-19T13:54:25.631683+0000","last_unstale":"2023-12-19T13:54:26.125409+0000","last_undegraded":"2023-12-19T13:54:26.125409+0000","last_fullsized":"2023-12-19T13:54:26.125409+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:10.857856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666278+0000","last_change":"2023-12-19T13:54:26.119383+0000","last_active":"2023-12-19T13:54:27.666278+0000","last_peered":"2023-12-19T13:54:27.666278+0000","last_clean":"2023-12-19T13:54:27.666278+0000","last_became_active":"2023-12-19T13:54:26.118934+0000","last_became_peered":"2023-12-19T13:54:26.118934+0000","last_unstale":"2023-12-19T13:54:27.666278+0000","last_undegraded":"2023-12-19T13:54:27.666278+0000","last_fullsized":"2023-12-19T13:54:27.666278+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:19:54.105973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"147'1","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665688+0000","last_change":"2023-12-19T13:54:25.613910+0000","last_active":"2023-12-19T13:54:27.665688+0000","last_peered":"2023-12-19T13:54:27.665688+0000","last_clean":"2023-12-19T13:54:27.665688+0000","last_became_active":"2023-12-19T13:54:25.613419+0000","last_became_peered":"2023-12-19T13:54:25.613419+0000","last_unstale":"2023-12-19T13:54:27.665688+0000","last_undegraded":"2023-12-19T13:54:27.665688+0000","last_fullsized":"2023-12-19T13:54:27.665688+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:08.010694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667382+0000","last_change":"2023-12-19T13:54:26.119338+0000","last_active":"2023-12-19T13:54:27.667382+0000","last_peered":"2023-12-19T13:54:27.667382+0000","last_clean":"2023-12-19T13:54:27.667382+0000","last_became_active":"2023-12-19T13:54:26.119099+0000","last_became_peered":"2023-12-19T13:54:26.119099+0000","last_unstale":"2023-12-19T13:54:27.667382+0000","last_undegraded":"2023-12-19T13:54:27.667382+0000","last_fullsized":"2023-12-19T13:54:27.667382+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:14.169202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106193+0000","last_change":"2023-12-19T13:54:25.628298+0000","last_active":"2023-12-19T13:54:26.106193+0000","last_peered":"2023-12-19T13:54:26.106193+0000","last_clean":"2023-12-19T13:54:26.106193+0000","last_became_active":"2023-12-19T13:54:25.627905+0000","last_became_peered":"2023-12-19T13:54:25.627905+0000","last_unstale":"2023-12-19T13:54:26.106193+0000","last_undegraded":"2023-12-19T13:54:26.106193+0000","last_fullsized":"2023-12-19T13:54:26.106193+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:16.415423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098972+0000","last_change":"2023-12-19T13:54:26.112081+0000","last_active":"2023-12-19T13:54:27.098972+0000","last_peered":"2023-12-19T13:54:27.098972+0000","last_clean":"2023-12-19T13:54:27.098972+0000","last_became_active":"2023-12-19T13:54:26.111864+0000","last_became_peered":"2023-12-19T13:54:26.111864+0000","last_unstale":"2023-12-19T13:54:27.098972+0000","last_undegraded":"2023-12-19T13:54:27.098972+0000","last_fullsized":"2023-12-19T13:54:27.098972+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:14.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.100630+0000","last_change":"2023-12-19T13:54:25.635569+0000","last_active":"2023-12-19T13:54:26.100630+0000","last_peered":"2023-12-19T13:54:26.100630+0000","last_clean":"2023-12-19T13:54:26.100630+0000","last_became_active":"2023-12-19T13:54:25.633893+0000","last_became_peered":"2023-12-19T13:54:25.633893+0000","last_unstale":"2023-12-19T13:54:26.100630+0000","last_undegraded":"2023-12-19T13:54:26.100630+0000","last_fullsized":"2023-12-19T13:54:26.100630+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:05.311202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095147+0000","last_change":"2023-12-19T13:54:26.111938+0000","last_active":"2023-12-19T13:54:27.095147+0000","last_peered":"2023-12-19T13:54:27.095147+0000","last_clean":"2023-12-19T13:54:27.095147+0000","last_became_active":"2023-12-19T13:54:26.111720+0000","last_became_peered":"2023-12-19T13:54:26.111720+0000","last_unstale":"2023-12-19T13:54:27.095147+0000","last_undegraded":"2023-12-19T13:54:27.095147+0000","last_fullsized":"2023-12-19T13:54:27.095147+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:39.808242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.095812+0000","last_change":"2023-12-19T13:54:25.622924+0000","last_active":"2023-12-19T13:54:26.095812+0000","last_peered":"2023-12-19T13:54:26.095812+0000","last_clean":"2023-12-19T13:54:26.095812+0000","last_became_active":"2023-12-19T13:54:25.622671+0000","last_became_peered":"2023-12-19T13:54:25.622671+0000","last_unstale":"2023-12-19T13:54:26.095812+0000","last_undegraded":"2023-12-19T13:54:26.095812+0000","last_fullsized":"2023-12-19T13:54:26.095812+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:11.392524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099952+0000","last_change":"2023-12-19T13:54:26.113241+0000","last_active":"2023-12-19T13:54:27.099952+0000","last_peered":"2023-12-19T13:54:27.099952+0000","last_clean":"2023-12-19T13:54:27.099952+0000","last_became_active":"2023-12-19T13:54:26.113037+0000","last_became_peered":"2023-12-19T13:54:26.113037+0000","last_unstale":"2023-12-19T13:54:27.099952+0000","last_undegraded":"2023-12-19T13:54:27.099952+0000","last_fullsized":"2023-12-19T13:54:27.099952+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:38.801564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.102109+0000","last_change":"2023-12-19T13:54:25.633771+0000","last_active":"2023-12-19T13:54:26.102109+0000","last_peered":"2023-12-19T13:54:26.102109+0000","last_clean":"2023-12-19T13:54:26.102109+0000","last_became_active":"2023-12-19T13:54:25.633519+0000","last_became_peered":"2023-12-19T13:54:25.633519+0000","last_unstale":"2023-12-19T13:54:26.102109+0000","last_undegraded":"2023-12-19T13:54:26.102109+0000","last_fullsized":"2023-12-19T13:54:26.102109+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:51.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099200+0000","last_change":"2023-12-19T13:54:26.104176+0000","last_active":"2023-12-19T13:54:27.099200+0000","last_peered":"2023-12-19T13:54:27.099200+0000","last_clean":"2023-12-19T13:54:27.099200+0000","last_became_active":"2023-12-19T13:54:26.103943+0000","last_became_peered":"2023-12-19T13:54:26.103943+0000","last_unstale":"2023-12-19T13:54:27.099200+0000","last_undegraded":"2023-12-19T13:54:27.099200+0000","last_fullsized":"2023-12-19T13:54:27.099200+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:16.765430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106326+0000","last_change":"2023-12-19T13:54:25.634619+0000","last_active":"2023-12-19T13:54:26.106326+0000","last_peered":"2023-12-19T13:54:26.106326+0000","last_clean":"2023-12-19T13:54:26.106326+0000","last_became_active":"2023-12-19T13:54:25.634100+0000","last_became_peered":"2023-12-19T13:54:25.634100+0000","last_unstale":"2023-12-19T13:54:26.106326+0000","last_undegraded":"2023-12-19T13:54:26.106326+0000","last_fullsized":"2023-12-19T13:54:26.106326+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:28.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665313+0000","last_change":"2023-12-19T13:54:26.127706+0000","last_active":"2023-12-19T13:54:27.665313+0000","last_peered":"2023-12-19T13:54:27.665313+0000","last_clean":"2023-12-19T13:54:27.665313+0000","last_became_active":"2023-12-19T13:54:26.127513+0000","last_became_peered":"2023-12-19T13:54:26.127513+0000","last_unstale":"2023-12-19T13:54:27.665313+0000","last_undegraded":"2023-12-19T13:54:27.665313+0000","last_fullsized":"2023-12-19T13:54:27.665313+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:08.807039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.109305+0000","last_change":"2023-12-19T13:54:25.632338+0000","last_active":"2023-12-19T13:54:26.109305+0000","last_peered":"2023-12-19T13:54:26.109305+0000","last_clean":"2023-12-19T13:54:26.109305+0000","last_became_active":"2023-12-19T13:54:25.628965+0000","last_became_peered":"2023-12-19T13:54:25.628965+0000","last_unstale":"2023-12-19T13:54:26.109305+0000","last_undegraded":"2023-12-19T13:54:26.109305+0000","last_fullsized":"2023-12-19T13:54:26.109305+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:13.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178575+0000","last_change":"2023-12-19T13:54:26.118452+0000","last_active":"2023-12-19T13:54:27.178575+0000","last_peered":"2023-12-19T13:54:27.178575+0000","last_clean":"2023-12-19T13:54:27.178575+0000","last_became_active":"2023-12-19T13:54:26.117149+0000","last_became_peered":"2023-12-19T13:54:26.117149+0000","last_unstale":"2023-12-19T13:54:27.178575+0000","last_undegraded":"2023-12-19T13:54:27.178575+0000","last_fullsized":"2023-12-19T13:54:27.178575+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:32:38.474781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.093262+0000","last_change":"2023-12-19T13:54:25.631087+0000","last_active":"2023-12-19T13:54:26.093262+0000","last_peered":"2023-12-19T13:54:26.093262+0000","last_clean":"2023-12-19T13:54:26.093262+0000","last_became_active":"2023-12-19T13:54:25.630834+0000","last_became_peered":"2023-12-19T13:54:25.630834+0000","last_unstale":"2023-12-19T13:54:26.093262+0000","last_undegraded":"2023-12-19T13:54:26.093262+0000","last_fullsized":"2023-12-19T13:54:26.093262+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:10.857856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.092253+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:54:26.092253+0000","last_peered":"2023-12-19T13:54:26.092253+0000","last_clean":"2023-12-19T13:54:26.092253+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:54:26.092253+0000","last_undegraded":"2023-12-19T13:54:26.092253+0000","last_fullsized":"2023-12-19T13:54:26.092253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.032},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6240000000000001,"5min":1.6950000000000001,"15min":1.9059999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1120000000000001,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.7190000000000001,"15min":2.008},"last":1.1120000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.167,"15min":1.103},"min":{"1min":0.71599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6479999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.1679999999999999,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.728,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.3340000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1399999999999999,"15min":1.135},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.081},{"interface":"front","average":{"1min":1.226,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.84999999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":1.7390000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2390000000000001,"15min":1.179},"min":{"1min":0.74199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.874},{"interface":"front","average":{"1min":1.359,"5min":1.3120000000000001,"15min":1.2609999999999999},"min":{"1min":0.98999999999999999,"5min":0.70599999999999996,"15min":0.65200000000000002},"max":{"1min":1.883,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.282}]},{"osd":4,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2649999999999999,"15min":1.284},"min":{"1min":0.94999999999999996,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.321,"15min":1.3799999999999999},"min":{"1min":0.83099999999999996,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.6879999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.2869999999999999,"15min":1.2410000000000001},"min":{"1min":0.94599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.216},{"interface":"front","average":{"1min":1.458,"5min":1.405,"15min":1.425},"min":{"1min":1.103,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.1699999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.3979999999999999,"15min":1.306},"min":{"1min":1.1140000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.409},{"interface":"front","average":{"1min":1.571,"5min":1.5049999999999999,"15min":1.4950000000000001},"min":{"1min":1.228,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.3720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.59299999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5329999999999999,"5min":1.6220000000000001,"15min":2.0640000000000001},"last":1.413},{"interface":"front","average":{"1min":1.113,"5min":1.099,"15min":1.1160000000000001},"min":{"1min":0.71399999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.631,"15min":3.2069999999999999},"last":0.997}]},{"osd":1,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.069,"15min":1.044},"min":{"1min":0.72899999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4570000000000001,"5min":1.5580000000000001,"15min":1.962},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.6279999999999999},"last":0.96399999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":1.012,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.8180000000000001},"last":1.504},{"interface":"front","average":{"1min":1.21,"5min":1.2609999999999999,"15min":1.1839999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.647,"5min":1.802,"15min":1.802},"last":1.573}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.242,"15min":1.319},"min":{"1min":0.78600000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.319},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.232,"15min":1.2589999999999999},"min":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.67900000000000005},"max":{"1min":1.5660000000000001,"5min":1.819,"15min":4.3899999999999997},"last":1.272}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.325,"15min":1.238},"min":{"1min":1,"5min":0.64500000000000002,"15min":0.47899999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.3779999999999999,"15min":1.3140000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.70699999999999996},"max":{"1min":1.768,"5min":1.895,"15min":1.895},"last":1.464}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.327,"15min":1.2669999999999999},"min":{"1min":0.83899999999999997,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.857,"5min":1.962,"15min":1.962},"last":1.157},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4390000000000001,"15min":1.387},"min":{"1min":0.90600000000000003,"5min":0.80200000000000005,"15min":0.48799999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.2210000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4730000000000001,"15min":1.4319999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.59599999999999997},"max":{"1min":1.7529999999999999,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4490000000000001,"15min":1.3799999999999999},"min":{"1min":1.073,"5min":0.72799999999999998,"15min":0.57999999999999996},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.3799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193934,"statfs":{"total":200000000,"available":198589066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.075,"15min":1.0049999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2170000000000001,"15min":1.1080000000000001},"min":{"1min":0.81100000000000005,"5min":0.67500000000000004,"15min":0.53900000000000003},"max":{"1min":2.1429999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.96299999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.167,"15min":1.1220000000000001},"min":{"1min":0.67100000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6839999999999999,"5min":6.101,"15min":6.101},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1830000000000001,"15min":1.0580000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.694,"5min":2.077,"15min":2.077},"last":1.625}]},{"osd":2,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2509999999999999,"15min":1.248},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.6839999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.123},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.246,"15min":1.2629999999999999},"min":{"1min":0.754,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5569999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.008}]},{"osd":3,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3460000000000001,"15min":1.2450000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.595,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.224},{"interface":"front","average":{"1min":1.335,"5min":1.296,"15min":1.2609999999999999},"min":{"1min":0.82099999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.75,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.4279999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.21,"15min":1.1599999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.982},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.395,"15min":1.3160000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":1.819,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.379}]},{"osd":6,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3700000000000001,"15min":1.335},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.821,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.3680000000000001,"15min":1.369},"min":{"1min":0.78400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.5680000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5229999999999999,"15min":1.4390000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.1219999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.52},{"interface":"front","average":{"1min":1.571,"5min":1.5129999999999999,"15min":1.4410000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.1070000000000002,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.5009999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.052,"15min":1.0109999999999999},"min":{"1min":0.67700000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":1.649,"15min":1.657},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.091,"15min":1.1160000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.016},"last":1.2889999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0720000000000001,"15min":1.0669999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.161},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.73399999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6080000000000001,"5min":1.887,"15min":1.887},"last":1.3089999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.119,"15min":1.05},"min":{"1min":0.71999999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.4119999999999999,"5min":1.704,"15min":1.704},"last":1.099},{"interface":"front","average":{"1min":1.127,"5min":1.161,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.617,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.3460000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.208,"15min":1.214},"min":{"1min":0.98299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4470000000000001,"5min":1.8360000000000001,"15min":1.952},"last":1.228},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.29,"15min":1.2809999999999999},"min":{"1min":0.94199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7050000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.45}]},{"osd":5,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2230000000000001,"15min":1.242},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.51700000000000002},"max":{"1min":1.6020000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.129},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3129999999999999,"15min":1.335},"min":{"1min":0.79700000000000004,"5min":0.61899999999999999,"15min":0.58399999999999996},"max":{"1min":1.7529999999999999,"5min":2.306,"15min":2.3570000000000002},"last":1.0249999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3300000000000001,"15min":1.381},"min":{"1min":0.82999999999999996,"5min":0.78800000000000003,"15min":0.55900000000000005},"max":{"1min":1.472,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.4490000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.831,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.252}]},{"osd":7,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.468,"15min":1.4670000000000001},"min":{"1min":1.0409999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7689999999999999,"5min":2.948,"15min":2.948},"last":1.395},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5289999999999999,"15min":1.526},"min":{"1min":0.92900000000000005,"5min":0.85699999999999998,"15min":0.59999999999999998},"max":{"1min":1.8169999999999999,"5min":3.137,"15min":3.137},"last":1.528}]}]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.90400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0760000000000001,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.95099999999999996},"min":{"1min":0.35699999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.49,"5min":1.502,"15min":3.0670000000000002},"last":0.90000000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.96599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1899999999999999,"5min":1.508,"15min":5.3769999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3979999999999999,"5min":1.5780000000000001,"15min":2.387},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.95599999999999996,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.3500000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.004,"15min":1.1020000000000001},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.722,"5min":1.722,"15min":2.657},"last":1.3180000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1930000000000001,"15min":1.252},"min":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.607,"5min":1.718,"15min":3.0070000000000001},"last":1.286},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.226,"15min":1.23},"min":{"1min":0.70799999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.629,"5min":1.835,"15min":2.7690000000000001},"last":1.389}]},{"osd":5,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2350000000000001,"15min":1.2909999999999999},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.72,"5min":1.72,"15min":2.7309999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2150000000000001,"15min":1.256},"min":{"1min":0.73199999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.5249999999999999},"last":1.242}]},{"osd":6,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2270000000000001,"15min":1.2889999999999999},"min":{"1min":0.59299999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.647,"5min":1.7090000000000001,"15min":2.9769999999999999},"last":1.345},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.75800000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":2.698},"last":1.181}]},{"osd":7,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.298,"15min":1.3540000000000001},"min":{"1min":0.73399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.609},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.355,"15min":1.389},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8999999999999999,"5min":2.02,"15min":3.0379999999999998},"last":1.4059999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82899999999999996,"15min":0.83199999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4550000000000001,"5min":1.544,"15min":2.258},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.002,"15min":0.84799999999999998},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.542,"5min":11.85,"15min":11.85},"last":1.1020000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.4610000000000001,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.111,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.381,"5min":11.788,"15min":11.788},"last":1.327}]},{"osd":3,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97999999999999998,"15min":0.94999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.373,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.091,"15min":1.0369999999999999},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":1.5800000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.2609999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3640000000000001,"15min":1.1910000000000001},"min":{"1min":0.96499999999999997,"5min":0.81799999999999995,"15min":0.746},"max":{"1min":1.5580000000000001,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.786,"5min":1.786,"15min":2.2189999999999999},"last":1.3}]},{"osd":5,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4510000000000001,"15min":1.2629999999999999},"min":{"1min":0.94799999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.615,"5min":11.888,"15min":11.888},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3120000000000001,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.85199999999999998,"15min":0.68899999999999995},"max":{"1min":1.843,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.585}]},{"osd":6,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":1.0049999999999999,"5min":0.85899999999999999,"15min":0.72399999999999998},"max":{"1min":1.994,"5min":2.0640000000000001,"15min":2.964},"last":1.383},{"interface":"front","average":{"1min":1.28,"5min":1.3100000000000001,"15min":1.266},"min":{"1min":0.79000000000000004,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.8879999999999999,"5min":1.944,"15min":2.286},"last":1.46}]},{"osd":7,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.355,"15min":1.3180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.351},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.468,"15min":1.3080000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.75600000000000001},"max":{"1min":1.6739999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.534}]}]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193934,"statfs":{"total":200000000,"available":198589158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.80500000000000005},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88200000000000001,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":1.3280000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.94099999999999995,"15min":0.94899999999999995},"min":{"1min":0.58899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":2.351,"15min":3.3500000000000001},"last":1.6639999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93700000000000006,"15min":1.0509999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.119,"15min":1.1679999999999999},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5780000000000001,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":1.619}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0720000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.5},"max":{"1min":1.548,"5min":1.6759999999999999,"15min":3.4300000000000002},"last":1.7},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0189999999999999,"15min":1.1479999999999999},"min":{"1min":0.47599999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.522,"5min":1.706,"15min":7.157},"last":1.054}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.159,"15min":1.2110000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":1.4119999999999999,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.264,"15min":1.2909999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.579,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.7490000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.248,"15min":1.3100000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.538,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3839999999999999,"15min":1.363},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3999999999999999,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.3819999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.876,"5min":0.74199999999999999,"15min":0.67800000000000005},"max":{"1min":1.675,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3260000000000001,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.595,"5min":2.3159999999999998,"15min":3.786},"last":1.4470000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3799999999999999,"15min":1.4359999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.637,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.3140000000000001,"15min":1.429},"min":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6100000000000001,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.5309999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.76600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32200000000000001,"15min":0.28299999999999997},"max":{"1min":1.639,"5min":1.639,"15min":1.6399999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.046,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2629999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.3029999999999999,"15min":1.008},"min":{"1min":0.443,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.8149999999999999,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.075},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.494,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4430000000000001,"5min":41.758000000000003,"15min":41.758000000000003},"last":1.153}]},{"osd":3,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.98399999999999999},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":1.109,"5min":1.619,"15min":4.4530000000000003},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.997,"5min":1.081,"15min":1.095},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.36499999999999999},"max":{"1min":1.9470000000000001,"5min":2.02,"15min":2.02},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.151,"15min":1.1990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.306,"5min":1.917,"15min":4.4269999999999996},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.407,"15min":1.234},"min":{"1min":0.80900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8700000000000001,"5min":15.766,"15min":15.766},"last":1.2070000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.393,"15min":1.2350000000000001},"min":{"1min":0.79500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.484,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6499999999999999,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.109}]},{"osd":6,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.284},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.67800000000000005},"max":{"1min":1.7709999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.534,"15min":1.3420000000000001},"min":{"1min":0.78200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.599,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.2829999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.49,"15min":1.347},"min":{"1min":0.83799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.615,"5min":14.381,"15min":14.381},"last":1.383},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.3979999999999999,"15min":1.3899999999999999},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4330000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.4059999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:54:31.040 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:54:31.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.267+0000 7efe745e0640 1 Processor -- start 2023-12-19T13:54:31.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.268+0000 7efe745e0640 1 -- start start 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.269+0000 7efe745e0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efe6c1449e0 0x7efe6c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.269+0000 7efe745e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c06c6b0 0x7efe6c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.269+0000 7efe745e0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c0afb10 con 0x7efe6c0b0b50 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.269+0000 7efe745e0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6c06bb30 con 0x7efe6c1449e0 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.269+0000 7efe745e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c0b0070 con 0x7efe6c06c6b0 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.269+0000 7efe7237c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efe6c1449e0 0x7efe6c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.270+0000 7efe7237c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efe6c1449e0 0x7efe6c0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55858/0 (socket says 172.21.15.113:55858) 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.270+0000 7efe7237c640 1 -- 172.21.15.113:0/1023290246 learned_addr learned my addr 172.21.15.113:0/1023290246 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:31.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.270+0000 7efe72b7d640 1 --2- 172.21.15.113:0/1023290246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c06c6b0 0x7efe6c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.270+0000 7efe7237c640 1 -- 172.21.15.113:0/1023290246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c06c6b0 msgr2=0x7efe6c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.270+0000 7efe7237c640 1 --2- 172.21.15.113:0/1023290246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c06c6b0 0x7efe6c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.270+0000 7efe7237c640 1 -- 172.21.15.113:0/1023290246 >> v1:172.21.15.151:6789/0 conn(0x7efe6c0b0b50 legacy=0x7efe6c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.270+0000 7efe7237c640 1 -- 172.21.15.113:0/1023290246 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c0b0350 con 0x7efe6c1449e0 2023-12-19T13:54:31.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.271+0000 7efe7237c640 1 --2- 172.21.15.113:0/1023290246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c1449e0 0x7efe6c0af5d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7efe68009870 tx=0x7efe6802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb072b9e9b687a88 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:31.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.272+0000 7efe7137a640 1 -- 172.21.15.113:0/1023290246 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68031640 con 0x7efe6c1449e0 2023-12-19T13:54:31.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.272+0000 7efe7137a640 1 -- 172.21.15.113:0/1023290246 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe680317a0 con 0x7efe6c1449e0 2023-12-19T13:54:31.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.272+0000 7efe7137a640 1 -- 172.21.15.113:0/1023290246 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68031b30 con 0x7efe6c1449e0 2023-12-19T13:54:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.272+0000 7efe745e0640 1 -- 172.21.15.113:0/1023290246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c1449e0 msgr2=0x7efe6c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.272+0000 7efe745e0640 1 --2- 172.21.15.113:0/1023290246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c1449e0 0x7efe6c0af5d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7efe68009870 tx=0x7efe6802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.273+0000 7efe745e0640 1 -- 172.21.15.113:0/1023290246 shutdown_connections 2023-12-19T13:54:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.273+0000 7efe745e0640 1 --2- 172.21.15.113:0/1023290246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c06c6b0 0x7efe6c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.273+0000 7efe745e0640 1 --2- 172.21.15.113:0/1023290246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c1449e0 0x7efe6c0af5d0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.273+0000 7efe745e0640 1 -- 172.21.15.113:0/1023290246 >> 172.21.15.113:0/1023290246 conn(0x7efe6c0cbb70 msgr2=0x7efe6c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.273+0000 7efe745e0640 1 -- 172.21.15.113:0/1023290246 shutdown_connections 2023-12-19T13:54:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.273+0000 7efe745e0640 1 -- 172.21.15.113:0/1023290246 wait complete. 2023-12-19T13:54:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.274+0000 7efe745e0640 1 Processor -- start 2023-12-19T13:54:31.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.275+0000 7efe745e0640 1 -- start start 2023-12-19T13:54:31.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.275+0000 7efe745e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c06c6b0 0x7efe6c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.275+0000 7efe745e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c0b0b50 0x7efe6c143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.275+0000 7efe745e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe6c1449e0 0x7efe6c0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.275+0000 7efe745e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c140740 con 0x7efe6c06c6b0 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.275+0000 7efe745e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c13eab0 con 0x7efe6c1449e0 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.275+0000 7efe745e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c13ed90 con 0x7efe6c0b0b50 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c06c6b0 0x7efe6c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c06c6b0 0x7efe6c159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55868/0 (socket says 172.21.15.113:55868) 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 -- 172.21.15.113:0/3637375549 learned_addr learned my addr 172.21.15.113:0/3637375549 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe71b7b640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c0b0b50 0x7efe6c143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe72b7d640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe6c1449e0 0x7efe6c0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 -- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c0b0b50 msgr2=0x7efe6c143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c0b0b50 0x7efe6c143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 -- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe6c1449e0 msgr2=0x7efe6c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe6c1449e0 0x7efe6c0cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.276+0000 7efe7237c640 1 -- 172.21.15.113:0/3637375549 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680094d0 con 0x7efe6c06c6b0 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.277+0000 7efe7237c640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c06c6b0 0x7efe6c159c10 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7efe68009870 tx=0x7efe680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.277+0000 7efe62ffd640 1 -- 172.21.15.113:0/3637375549 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6803ac60 con 0x7efe6c06c6b0 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.277+0000 7efe62ffd640 1 -- 172.21.15.113:0/3637375549 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6803adc0 con 0x7efe6c06c6b0 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.277+0000 7efe62ffd640 1 -- 172.21.15.113:0/3637375549 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68044630 con 0x7efe6c06c6b0 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.277+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c13f070 con 0x7efe6c06c6b0 2023-12-19T13:54:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.277+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c15a150 con 0x7efe6c06c6b0 2023-12-19T13:54:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.278+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c061910 con 0x7efe6c06c6b0 2023-12-19T13:54:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.279+0000 7efe62ffd640 1 -- 172.21.15.113:0/3637375549 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe6802f050 con 0x7efe6c06c6b0 2023-12-19T13:54:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.280+0000 7efe62ffd640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5006a430 0x7efe5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.280+0000 7efe62ffd640 1 -- 172.21.15.113:0/3637375549 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe680aa7a0 con 0x7efe6c06c6b0 2023-12-19T13:54:31.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.281+0000 7efe71b7b640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5006a430 0x7efe5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.281+0000 7efe71b7b640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5006a430 0x7efe5006c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efe6c13ae10 tx=0x7efe5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:31.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.285+0000 7efe62ffd640 1 -- 172.21.15.113:0/3637375549 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe68075d90 con 0x7efe6c06c6b0 2023-12-19T13:54:31.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.472+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe6c0b0630 con 0x7efe5006a430 2023-12-19T13:54:31.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.481+0000 7efe62ffd640 1 -- 172.21.15.113:0/3637375549 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282810 (secure 0 0 0) 0x7efe5c00e7b0 con 0x7efe5006a430 2023-12-19T13:54:31.484 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:31.486 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:54:31.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5006a430 msgr2=0x7efe5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5006a430 0x7efe5006c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efe6c13ae10 tx=0x7efe5c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:31.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c06c6b0 msgr2=0x7efe6c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c06c6b0 0x7efe6c159c10 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7efe68009870 tx=0x7efe680046c0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 shutdown_connections 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5006a430 0x7efe5006c8f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe6c1449e0 0x7efe6c0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6c0b0b50 0x7efe6c143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 --2- 172.21.15.113:0/3637375549 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe6c06c6b0 0x7efe6c159c10 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.486+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 >> 172.21.15.113:0/3637375549 conn(0x7efe6c0cbb70 msgr2=0x7efe6c06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.487+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 shutdown_connections 2023-12-19T13:54:31.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.487+0000 7efe745e0640 1 -- 172.21.15.113:0/3637375549 wait complete. 2023-12-19T13:54:31.506 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2023-12-19T13:54:30.567104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7567,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554932,"statfs":{"total":1600000000,"available":1592250748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.976539"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666952+0000","last_change":"2023-12-19T13:54:26.117242+0000","last_active":"2023-12-19T13:54:27.666952+0000","last_peered":"2023-12-19T13:54:27.666952+0000","last_clean":"2023-12-19T13:54:27.666952+0000","last_became_active":"2023-12-19T13:54:26.116827+0000","last_became_peered":"2023-12-19T13:54:26.116827+0000","last_unstale":"2023-12-19T13:54:27.666952+0000","last_undegraded":"2023-12-19T13:54:27.666952+0000","last_fullsized":"2023-12-19T13:54:27.666952+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665324+0000","last_change":"2023-12-19T13:54:26.109599+0000","last_active":"2023-12-19T13:54:27.665324+0000","last_peered":"2023-12-19T13:54:27.665324+0000","last_clean":"2023-12-19T13:54:27.665324+0000","last_became_active":"2023-12-19T13:54:26.109097+0000","last_became_peered":"2023-12-19T13:54:26.109097+0000","last_unstale":"2023-12-19T13:54:27.665324+0000","last_undegraded":"2023-12-19T13:54:27.665324+0000","last_fullsized":"2023-12-19T13:54:27.665324+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:06.316861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095605+0000","last_change":"2023-12-19T13:54:26.097348+0000","last_active":"2023-12-19T13:54:27.095605+0000","last_peered":"2023-12-19T13:54:27.095605+0000","last_clean":"2023-12-19T13:54:27.095605+0000","last_became_active":"2023-12-19T13:54:26.097093+0000","last_became_peered":"2023-12-19T13:54:26.097093+0000","last_unstale":"2023-12-19T13:54:27.095605+0000","last_undegraded":"2023-12-19T13:54:27.095605+0000","last_fullsized":"2023-12-19T13:54:27.095605+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:23.258937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178637+0000","last_change":"2023-12-19T13:54:26.121798+0000","last_active":"2023-12-19T13:54:27.178637+0000","last_peered":"2023-12-19T13:54:27.178637+0000","last_clean":"2023-12-19T13:54:27.178637+0000","last_became_active":"2023-12-19T13:54:26.117032+0000","last_became_peered":"2023-12-19T13:54:26.117032+0000","last_unstale":"2023-12-19T13:54:27.178637+0000","last_undegraded":"2023-12-19T13:54:27.178637+0000","last_fullsized":"2023-12-19T13:54:27.178637+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:52.795112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.100543+0000","last_change":"2023-12-19T13:54:26.123990+0000","last_active":"2023-12-19T13:54:27.100543+0000","last_peered":"2023-12-19T13:54:27.100543+0000","last_clean":"2023-12-19T13:54:27.100543+0000","last_became_active":"2023-12-19T13:54:26.123769+0000","last_became_peered":"2023-12-19T13:54:26.123769+0000","last_unstale":"2023-12-19T13:54:27.100543+0000","last_undegraded":"2023-12-19T13:54:27.100543+0000","last_fullsized":"2023-12-19T13:54:27.100543+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665040+0000","last_change":"2023-12-19T13:54:26.125317+0000","last_active":"2023-12-19T13:54:27.665040+0000","last_peered":"2023-12-19T13:54:27.665040+0000","last_clean":"2023-12-19T13:54:27.665040+0000","last_became_active":"2023-12-19T13:54:26.125063+0000","last_became_peered":"2023-12-19T13:54:26.125063+0000","last_unstale":"2023-12-19T13:54:27.665040+0000","last_undegraded":"2023-12-19T13:54:27.665040+0000","last_fullsized":"2023-12-19T13:54:27.665040+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:18.236134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666150+0000","last_change":"2023-12-19T13:54:26.103244+0000","last_active":"2023-12-19T13:54:27.666150+0000","last_peered":"2023-12-19T13:54:27.666150+0000","last_clean":"2023-12-19T13:54:27.666150+0000","last_became_active":"2023-12-19T13:54:26.103029+0000","last_became_peered":"2023-12-19T13:54:26.103029+0000","last_unstale":"2023-12-19T13:54:27.666150+0000","last_undegraded":"2023-12-19T13:54:27.666150+0000","last_fullsized":"2023-12-19T13:54:27.666150+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:45.516555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.664983+0000","last_change":"2023-12-19T13:54:26.099667+0000","last_active":"2023-12-19T13:54:27.664983+0000","last_peered":"2023-12-19T13:54:27.664983+0000","last_clean":"2023-12-19T13:54:27.664983+0000","last_became_active":"2023-12-19T13:54:26.098781+0000","last_became_peered":"2023-12-19T13:54:26.098781+0000","last_unstale":"2023-12-19T13:54:27.664983+0000","last_undegraded":"2023-12-19T13:54:27.664983+0000","last_fullsized":"2023-12-19T13:54:27.664983+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:19.374606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665693+0000","last_change":"2023-12-19T13:54:26.126332+0000","last_active":"2023-12-19T13:54:27.665693+0000","last_peered":"2023-12-19T13:54:27.665693+0000","last_clean":"2023-12-19T13:54:27.665693+0000","last_became_active":"2023-12-19T13:54:26.121758+0000","last_became_peered":"2023-12-19T13:54:26.121758+0000","last_unstale":"2023-12-19T13:54:27.665693+0000","last_undegraded":"2023-12-19T13:54:27.665693+0000","last_fullsized":"2023-12-19T13:54:27.665693+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:31.846511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099715+0000","last_change":"2023-12-19T13:54:26.122639+0000","last_active":"2023-12-19T13:54:27.099715+0000","last_peered":"2023-12-19T13:54:27.099715+0000","last_clean":"2023-12-19T13:54:27.099715+0000","last_became_active":"2023-12-19T13:54:26.121828+0000","last_became_peered":"2023-12-19T13:54:26.121828+0000","last_unstale":"2023-12-19T13:54:27.099715+0000","last_undegraded":"2023-12-19T13:54:27.099715+0000","last_fullsized":"2023-12-19T13:54:27.099715+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:33.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665360+0000","last_change":"2023-12-19T13:54:26.107058+0000","last_active":"2023-12-19T13:54:27.665360+0000","last_peered":"2023-12-19T13:54:27.665360+0000","last_clean":"2023-12-19T13:54:27.665360+0000","last_became_active":"2023-12-19T13:54:26.106843+0000","last_became_peered":"2023-12-19T13:54:26.106843+0000","last_unstale":"2023-12-19T13:54:27.665360+0000","last_undegraded":"2023-12-19T13:54:27.665360+0000","last_fullsized":"2023-12-19T13:54:27.665360+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:02.592252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098772+0000","last_change":"2023-12-19T13:54:26.121190+0000","last_active":"2023-12-19T13:54:27.098772+0000","last_peered":"2023-12-19T13:54:27.098772+0000","last_clean":"2023-12-19T13:54:27.098772+0000","last_became_active":"2023-12-19T13:54:26.120950+0000","last_became_peered":"2023-12-19T13:54:26.120950+0000","last_unstale":"2023-12-19T13:54:27.098772+0000","last_undegraded":"2023-12-19T13:54:27.098772+0000","last_fullsized":"2023-12-19T13:54:27.098772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:39:08.448963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665644+0000","last_change":"2023-12-19T13:54:26.101429+0000","last_active":"2023-12-19T13:54:27.665644+0000","last_peered":"2023-12-19T13:54:27.665644+0000","last_clean":"2023-12-19T13:54:27.665644+0000","last_became_active":"2023-12-19T13:54:26.101220+0000","last_became_peered":"2023-12-19T13:54:26.101220+0000","last_unstale":"2023-12-19T13:54:27.665644+0000","last_undegraded":"2023-12-19T13:54:27.665644+0000","last_fullsized":"2023-12-19T13:54:27.665644+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:33.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098434+0000","last_change":"2023-12-19T13:54:26.106143+0000","last_active":"2023-12-19T13:54:27.098434+0000","last_peered":"2023-12-19T13:54:27.098434+0000","last_clean":"2023-12-19T13:54:27.098434+0000","last_became_active":"2023-12-19T13:54:26.105623+0000","last_became_peered":"2023-12-19T13:54:26.105623+0000","last_unstale":"2023-12-19T13:54:27.098434+0000","last_undegraded":"2023-12-19T13:54:27.098434+0000","last_fullsized":"2023-12-19T13:54:27.098434+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:38.639069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667035+0000","last_change":"2023-12-19T13:54:26.124559+0000","last_active":"2023-12-19T13:54:27.667035+0000","last_peered":"2023-12-19T13:54:27.667035+0000","last_clean":"2023-12-19T13:54:27.667035+0000","last_became_active":"2023-12-19T13:54:26.124186+0000","last_became_peered":"2023-12-19T13:54:26.124186+0000","last_unstale":"2023-12-19T13:54:27.667035+0000","last_undegraded":"2023-12-19T13:54:27.667035+0000","last_fullsized":"2023-12-19T13:54:27.667035+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:46:22.920971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099637+0000","last_change":"2023-12-19T13:54:26.111717+0000","last_active":"2023-12-19T13:54:27.099637+0000","last_peered":"2023-12-19T13:54:27.099637+0000","last_clean":"2023-12-19T13:54:27.099637+0000","last_became_active":"2023-12-19T13:54:26.110382+0000","last_became_peered":"2023-12-19T13:54:26.110382+0000","last_unstale":"2023-12-19T13:54:27.099637+0000","last_undegraded":"2023-12-19T13:54:27.099637+0000","last_fullsized":"2023-12-19T13:54:27.099637+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:14.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.094827+0000","last_change":"2023-12-19T13:54:26.103382+0000","last_active":"2023-12-19T13:54:27.094827+0000","last_peered":"2023-12-19T13:54:27.094827+0000","last_clean":"2023-12-19T13:54:27.094827+0000","last_became_active":"2023-12-19T13:54:26.103165+0000","last_became_peered":"2023-12-19T13:54:26.103165+0000","last_unstale":"2023-12-19T13:54:27.094827+0000","last_undegraded":"2023-12-19T13:54:27.094827+0000","last_fullsized":"2023-12-19T13:54:27.094827+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:22:31.092881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665225+0000","last_change":"2023-12-19T13:54:26.112673+0000","last_active":"2023-12-19T13:54:27.665225+0000","last_peered":"2023-12-19T13:54:27.665225+0000","last_clean":"2023-12-19T13:54:27.665225+0000","last_became_active":"2023-12-19T13:54:26.112394+0000","last_became_peered":"2023-12-19T13:54:26.112394+0000","last_unstale":"2023-12-19T13:54:27.665225+0000","last_undegraded":"2023-12-19T13:54:27.665225+0000","last_fullsized":"2023-12-19T13:54:27.665225+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:46.295002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095032+0000","last_change":"2023-12-19T13:54:26.102344+0000","last_active":"2023-12-19T13:54:27.095032+0000","last_peered":"2023-12-19T13:54:27.095032+0000","last_clean":"2023-12-19T13:54:27.095032+0000","last_became_active":"2023-12-19T13:54:26.102105+0000","last_became_peered":"2023-12-19T13:54:26.102105+0000","last_unstale":"2023-12-19T13:54:27.095032+0000","last_undegraded":"2023-12-19T13:54:27.095032+0000","last_fullsized":"2023-12-19T13:54:27.095032+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:04.857712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095901+0000","last_change":"2023-12-19T13:54:26.111659+0000","last_active":"2023-12-19T13:54:27.095901+0000","last_peered":"2023-12-19T13:54:27.095901+0000","last_clean":"2023-12-19T13:54:27.095901+0000","last_became_active":"2023-12-19T13:54:26.111377+0000","last_became_peered":"2023-12-19T13:54:26.111377+0000","last_unstale":"2023-12-19T13:54:27.095901+0000","last_undegraded":"2023-12-19T13:54:27.095901+0000","last_fullsized":"2023-12-19T13:54:27.095901+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:47.391493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665616+0000","last_change":"2023-12-19T13:54:26.111253+0000","last_active":"2023-12-19T13:54:27.665616+0000","last_peered":"2023-12-19T13:54:27.665616+0000","last_clean":"2023-12-19T13:54:27.665616+0000","last_became_active":"2023-12-19T13:54:26.111023+0000","last_became_peered":"2023-12-19T13:54:26.111023+0000","last_unstale":"2023-12-19T13:54:27.665616+0000","last_undegraded":"2023-12-19T13:54:27.665616+0000","last_fullsized":"2023-12-19T13:54:27.665616+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:54.177046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666043+0000","last_change":"2023-12-19T13:54:26.124420+0000","last_active":"2023-12-19T13:54:27.666043+0000","last_peered":"2023-12-19T13:54:27.666043+0000","last_clean":"2023-12-19T13:54:27.666043+0000","last_became_active":"2023-12-19T13:54:26.123631+0000","last_became_peered":"2023-12-19T13:54:26.123631+0000","last_unstale":"2023-12-19T13:54:27.666043+0000","last_undegraded":"2023-12-19T13:54:27.666043+0000","last_fullsized":"2023-12-19T13:54:27.666043+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:49:20.100742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098399+0000","last_change":"2023-12-19T13:54:26.108325+0000","last_active":"2023-12-19T13:54:27.098399+0000","last_peered":"2023-12-19T13:54:27.098399+0000","last_clean":"2023-12-19T13:54:27.098399+0000","last_became_active":"2023-12-19T13:54:26.108045+0000","last_became_peered":"2023-12-19T13:54:26.108045+0000","last_unstale":"2023-12-19T13:54:27.098399+0000","last_undegraded":"2023-12-19T13:54:27.098399+0000","last_fullsized":"2023-12-19T13:54:27.098399+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:06.316861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178793+0000","last_change":"2023-12-19T13:54:26.124649+0000","last_active":"2023-12-19T13:54:27.178793+0000","last_peered":"2023-12-19T13:54:27.178793+0000","last_clean":"2023-12-19T13:54:27.178793+0000","last_became_active":"2023-12-19T13:54:26.124204+0000","last_became_peered":"2023-12-19T13:54:26.124204+0000","last_unstale":"2023-12-19T13:54:27.178793+0000","last_undegraded":"2023-12-19T13:54:27.178793+0000","last_fullsized":"2023-12-19T13:54:27.178793+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:17.743121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665799+0000","last_change":"2023-12-19T13:54:26.098621+0000","last_active":"2023-12-19T13:54:27.665799+0000","last_peered":"2023-12-19T13:54:27.665799+0000","last_clean":"2023-12-19T13:54:27.665799+0000","last_became_active":"2023-12-19T13:54:26.098369+0000","last_became_peered":"2023-12-19T13:54:26.098369+0000","last_unstale":"2023-12-19T13:54:27.665799+0000","last_undegraded":"2023-12-19T13:54:27.665799+0000","last_fullsized":"2023-12-19T13:54:27.665799+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:22.822863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665626+0000","last_change":"2023-12-19T13:54:26.120035+0000","last_active":"2023-12-19T13:54:27.665626+0000","last_peered":"2023-12-19T13:54:27.665626+0000","last_clean":"2023-12-19T13:54:27.665626+0000","last_became_active":"2023-12-19T13:54:26.119808+0000","last_became_peered":"2023-12-19T13:54:26.119808+0000","last_unstale":"2023-12-19T13:54:27.665626+0000","last_undegraded":"2023-12-19T13:54:27.665626+0000","last_fullsized":"2023-12-19T13:54:27.665626+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:31.961971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178767+0000","last_change":"2023-12-19T13:54:26.125583+0000","last_active":"2023-12-19T13:54:27.178767+0000","last_peered":"2023-12-19T13:54:27.178767+0000","last_clean":"2023-12-19T13:54:27.178767+0000","last_became_active":"2023-12-19T13:54:26.125068+0000","last_became_peered":"2023-12-19T13:54:26.125068+0000","last_unstale":"2023-12-19T13:54:27.178767+0000","last_undegraded":"2023-12-19T13:54:27.178767+0000","last_fullsized":"2023-12-19T13:54:27.178767+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:58.298641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665047+0000","last_change":"2023-12-19T13:54:26.123934+0000","last_active":"2023-12-19T13:54:27.665047+0000","last_peered":"2023-12-19T13:54:27.665047+0000","last_clean":"2023-12-19T13:54:27.665047+0000","last_became_active":"2023-12-19T13:54:26.123691+0000","last_became_peered":"2023-12-19T13:54:26.123691+0000","last_unstale":"2023-12-19T13:54:27.665047+0000","last_undegraded":"2023-12-19T13:54:27.665047+0000","last_fullsized":"2023-12-19T13:54:27.665047+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:07.155650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098730+0000","last_change":"2023-12-19T13:54:26.106001+0000","last_active":"2023-12-19T13:54:27.098730+0000","last_peered":"2023-12-19T13:54:27.098730+0000","last_clean":"2023-12-19T13:54:27.098730+0000","last_became_active":"2023-12-19T13:54:26.105340+0000","last_became_peered":"2023-12-19T13:54:26.105340+0000","last_unstale":"2023-12-19T13:54:27.098730+0000","last_undegraded":"2023-12-19T13:54:27.098730+0000","last_fullsized":"2023-12-19T13:54:27.098730+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:11.863516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666014+0000","last_change":"2023-12-19T13:54:26.120147+0000","last_active":"2023-12-19T13:54:27.666014+0000","last_peered":"2023-12-19T13:54:27.666014+0000","last_clean":"2023-12-19T13:54:27.666014+0000","last_became_active":"2023-12-19T13:54:26.119955+0000","last_became_peered":"2023-12-19T13:54:26.119955+0000","last_unstale":"2023-12-19T13:54:27.666014+0000","last_undegraded":"2023-12-19T13:54:27.666014+0000","last_fullsized":"2023-12-19T13:54:27.666014+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:03.950277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667194+0000","last_change":"2023-12-19T13:54:26.114174+0000","last_active":"2023-12-19T13:54:27.667194+0000","last_peered":"2023-12-19T13:54:27.667194+0000","last_clean":"2023-12-19T13:54:27.667194+0000","last_became_active":"2023-12-19T13:54:26.112159+0000","last_became_peered":"2023-12-19T13:54:26.112159+0000","last_unstale":"2023-12-19T13:54:27.667194+0000","last_undegraded":"2023-12-19T13:54:27.667194+0000","last_fullsized":"2023-12-19T13:54:27.667194+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099399+0000","last_change":"2023-12-19T13:54:26.111975+0000","last_active":"2023-12-19T13:54:27.099399+0000","last_peered":"2023-12-19T13:54:27.099399+0000","last_clean":"2023-12-19T13:54:27.099399+0000","last_became_active":"2023-12-19T13:54:26.109129+0000","last_became_peered":"2023-12-19T13:54:26.109129+0000","last_unstale":"2023-12-19T13:54:27.099399+0000","last_undegraded":"2023-12-19T13:54:27.099399+0000","last_fullsized":"2023-12-19T13:54:27.099399+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:17.421083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665943+0000","last_change":"2023-12-19T13:54:26.126064+0000","last_active":"2023-12-19T13:54:27.665943+0000","last_peered":"2023-12-19T13:54:27.665943+0000","last_clean":"2023-12-19T13:54:27.665943+0000","last_became_active":"2023-12-19T13:54:26.121412+0000","last_became_peered":"2023-12-19T13:54:26.121412+0000","last_unstale":"2023-12-19T13:54:27.665943+0000","last_undegraded":"2023-12-19T13:54:27.665943+0000","last_fullsized":"2023-12-19T13:54:27.665943+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:40.805236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"146'4","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.111191+0000","last_change":"2023-12-19T13:54:25.628140+0000","last_active":"2023-12-19T13:54:26.111191+0000","last_peered":"2023-12-19T13:54:26.111191+0000","last_clean":"2023-12-19T13:54:26.111191+0000","last_became_active":"2023-12-19T13:54:25.627914+0000","last_became_peered":"2023-12-19T13:54:25.627914+0000","last_unstale":"2023-12-19T13:54:26.111191+0000","last_undegraded":"2023-12-19T13:54:26.111191+0000","last_fullsized":"2023-12-19T13:54:26.111191+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:05:33.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098511+0000","last_change":"2023-12-19T13:54:26.106713+0000","last_active":"2023-12-19T13:54:27.098511+0000","last_peered":"2023-12-19T13:54:27.098511+0000","last_clean":"2023-12-19T13:54:27.098511+0000","last_became_active":"2023-12-19T13:54:26.106341+0000","last_became_peered":"2023-12-19T13:54:26.106341+0000","last_unstale":"2023-12-19T13:54:27.098511+0000","last_undegraded":"2023-12-19T13:54:27.098511+0000","last_fullsized":"2023-12-19T13:54:27.098511+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:33.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.105793+0000","last_change":"2023-12-19T13:54:25.623750+0000","last_active":"2023-12-19T13:54:26.105793+0000","last_peered":"2023-12-19T13:54:26.105793+0000","last_clean":"2023-12-19T13:54:26.105793+0000","last_became_active":"2023-12-19T13:54:25.623313+0000","last_became_peered":"2023-12-19T13:54:25.623313+0000","last_unstale":"2023-12-19T13:54:26.105793+0000","last_undegraded":"2023-12-19T13:54:26.105793+0000","last_fullsized":"2023-12-19T13:54:26.105793+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:15.759770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665890+0000","last_change":"2023-12-19T13:54:26.119277+0000","last_active":"2023-12-19T13:54:27.665890+0000","last_peered":"2023-12-19T13:54:27.665890+0000","last_clean":"2023-12-19T13:54:27.665890+0000","last_became_active":"2023-12-19T13:54:26.119035+0000","last_became_peered":"2023-12-19T13:54:26.119035+0000","last_unstale":"2023-12-19T13:54:27.665890+0000","last_undegraded":"2023-12-19T13:54:27.665890+0000","last_fullsized":"2023-12-19T13:54:27.665890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:25.283122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.128086+0000","last_change":"2023-12-19T13:54:25.636220+0000","last_active":"2023-12-19T13:54:26.128086+0000","last_peered":"2023-12-19T13:54:26.128086+0000","last_clean":"2023-12-19T13:54:26.128086+0000","last_became_active":"2023-12-19T13:54:25.635798+0000","last_became_peered":"2023-12-19T13:54:25.635798+0000","last_unstale":"2023-12-19T13:54:26.128086+0000","last_undegraded":"2023-12-19T13:54:26.128086+0000","last_fullsized":"2023-12-19T13:54:26.128086+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:15.154617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.096118+0000","last_change":"2023-12-19T13:54:26.105415+0000","last_active":"2023-12-19T13:54:27.096118+0000","last_peered":"2023-12-19T13:54:27.096118+0000","last_clean":"2023-12-19T13:54:27.096118+0000","last_became_active":"2023-12-19T13:54:26.105174+0000","last_became_peered":"2023-12-19T13:54:26.105174+0000","last_unstale":"2023-12-19T13:54:27.096118+0000","last_undegraded":"2023-12-19T13:54:27.096118+0000","last_fullsized":"2023-12-19T13:54:27.096118+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:32:54.819547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.122533+0000","last_change":"2023-12-19T13:54:25.637661+0000","last_active":"2023-12-19T13:54:26.122533+0000","last_peered":"2023-12-19T13:54:26.122533+0000","last_clean":"2023-12-19T13:54:26.122533+0000","last_became_active":"2023-12-19T13:54:25.637025+0000","last_became_peered":"2023-12-19T13:54:25.637025+0000","last_unstale":"2023-12-19T13:54:26.122533+0000","last_undegraded":"2023-12-19T13:54:26.122533+0000","last_fullsized":"2023-12-19T13:54:26.122533+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:38.967262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178106+0000","last_change":"2023-12-19T13:54:26.127009+0000","last_active":"2023-12-19T13:54:27.178106+0000","last_peered":"2023-12-19T13:54:27.178106+0000","last_clean":"2023-12-19T13:54:27.178106+0000","last_became_active":"2023-12-19T13:54:26.126290+0000","last_became_peered":"2023-12-19T13:54:26.126290+0000","last_unstale":"2023-12-19T13:54:27.178106+0000","last_undegraded":"2023-12-19T13:54:27.178106+0000","last_fullsized":"2023-12-19T13:54:27.178106+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:20.697682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.120943+0000","last_change":"2023-12-19T13:54:25.625650+0000","last_active":"2023-12-19T13:54:26.120943+0000","last_peered":"2023-12-19T13:54:26.120943+0000","last_clean":"2023-12-19T13:54:26.120943+0000","last_became_active":"2023-12-19T13:54:25.625002+0000","last_became_peered":"2023-12-19T13:54:25.625002+0000","last_unstale":"2023-12-19T13:54:26.120943+0000","last_undegraded":"2023-12-19T13:54:26.120943+0000","last_fullsized":"2023-12-19T13:54:26.120943+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:57.068416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666367+0000","last_change":"2023-12-19T13:54:26.109378+0000","last_active":"2023-12-19T13:54:27.666367+0000","last_peered":"2023-12-19T13:54:27.666367+0000","last_clean":"2023-12-19T13:54:27.666367+0000","last_became_active":"2023-12-19T13:54:26.109180+0000","last_became_peered":"2023-12-19T13:54:26.109180+0000","last_unstale":"2023-12-19T13:54:27.666367+0000","last_undegraded":"2023-12-19T13:54:27.666367+0000","last_fullsized":"2023-12-19T13:54:27.666367+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:31:15.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.131455+0000","last_change":"2023-12-19T13:54:25.632853+0000","last_active":"2023-12-19T13:54:26.131455+0000","last_peered":"2023-12-19T13:54:26.131455+0000","last_clean":"2023-12-19T13:54:26.131455+0000","last_became_active":"2023-12-19T13:54:25.632620+0000","last_became_peered":"2023-12-19T13:54:25.632620+0000","last_unstale":"2023-12-19T13:54:26.131455+0000","last_undegraded":"2023-12-19T13:54:26.131455+0000","last_fullsized":"2023-12-19T13:54:26.131455+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:10.857856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.100066+0000","last_change":"2023-12-19T13:54:26.115820+0000","last_active":"2023-12-19T13:54:27.100066+0000","last_peered":"2023-12-19T13:54:27.100066+0000","last_clean":"2023-12-19T13:54:27.100066+0000","last_became_active":"2023-12-19T13:54:26.114852+0000","last_became_peered":"2023-12-19T13:54:26.114852+0000","last_unstale":"2023-12-19T13:54:27.100066+0000","last_undegraded":"2023-12-19T13:54:27.100066+0000","last_fullsized":"2023-12-19T13:54:27.100066+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.095114+0000","last_change":"2023-12-19T13:54:25.626600+0000","last_active":"2023-12-19T13:54:26.095114+0000","last_peered":"2023-12-19T13:54:26.095114+0000","last_clean":"2023-12-19T13:54:26.095114+0000","last_became_active":"2023-12-19T13:54:25.626279+0000","last_became_peered":"2023-12-19T13:54:25.626279+0000","last_unstale":"2023-12-19T13:54:26.095114+0000","last_undegraded":"2023-12-19T13:54:26.095114+0000","last_fullsized":"2023-12-19T13:54:26.095114+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:59.094564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665065+0000","last_change":"2023-12-19T13:54:26.097653+0000","last_active":"2023-12-19T13:54:27.665065+0000","last_peered":"2023-12-19T13:54:27.665065+0000","last_clean":"2023-12-19T13:54:27.665065+0000","last_became_active":"2023-12-19T13:54:26.097417+0000","last_became_peered":"2023-12-19T13:54:26.097417+0000","last_unstale":"2023-12-19T13:54:27.665065+0000","last_undegraded":"2023-12-19T13:54:27.665065+0000","last_fullsized":"2023-12-19T13:54:27.665065+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:16:22.516612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.097189+0000","last_change":"2023-12-19T13:54:25.635314+0000","last_active":"2023-12-19T13:54:26.097189+0000","last_peered":"2023-12-19T13:54:26.097189+0000","last_clean":"2023-12-19T13:54:26.097189+0000","last_became_active":"2023-12-19T13:54:25.635033+0000","last_became_peered":"2023-12-19T13:54:25.635033+0000","last_unstale":"2023-12-19T13:54:26.097189+0000","last_undegraded":"2023-12-19T13:54:26.097189+0000","last_fullsized":"2023-12-19T13:54:26.097189+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:13.434884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665552+0000","last_change":"2023-12-19T13:54:26.117164+0000","last_active":"2023-12-19T13:54:27.665552+0000","last_peered":"2023-12-19T13:54:27.665552+0000","last_clean":"2023-12-19T13:54:27.665552+0000","last_became_active":"2023-12-19T13:54:26.116997+0000","last_became_peered":"2023-12-19T13:54:26.116997+0000","last_unstale":"2023-12-19T13:54:27.665552+0000","last_undegraded":"2023-12-19T13:54:27.665552+0000","last_fullsized":"2023-12-19T13:54:27.665552+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106410+0000","last_change":"2023-12-19T13:54:25.637934+0000","last_active":"2023-12-19T13:54:26.106410+0000","last_peered":"2023-12-19T13:54:26.106410+0000","last_clean":"2023-12-19T13:54:26.106410+0000","last_became_active":"2023-12-19T13:54:25.637379+0000","last_became_peered":"2023-12-19T13:54:25.637379+0000","last_unstale":"2023-12-19T13:54:26.106410+0000","last_undegraded":"2023-12-19T13:54:26.106410+0000","last_fullsized":"2023-12-19T13:54:26.106410+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:32.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666162+0000","last_change":"2023-12-19T13:54:26.100216+0000","last_active":"2023-12-19T13:54:27.666162+0000","last_peered":"2023-12-19T13:54:27.666162+0000","last_clean":"2023-12-19T13:54:27.666162+0000","last_became_active":"2023-12-19T13:54:26.099992+0000","last_became_peered":"2023-12-19T13:54:26.099992+0000","last_unstale":"2023-12-19T13:54:27.666162+0000","last_undegraded":"2023-12-19T13:54:27.666162+0000","last_fullsized":"2023-12-19T13:54:27.666162+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.103197+0000","last_change":"2023-12-19T13:54:25.630517+0000","last_active":"2023-12-19T13:54:26.103197+0000","last_peered":"2023-12-19T13:54:26.103197+0000","last_clean":"2023-12-19T13:54:26.103197+0000","last_became_active":"2023-12-19T13:54:25.630237+0000","last_became_peered":"2023-12-19T13:54:25.630237+0000","last_unstale":"2023-12-19T13:54:26.103197+0000","last_undegraded":"2023-12-19T13:54:26.103197+0000","last_fullsized":"2023-12-19T13:54:26.103197+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:18.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.664939+0000","last_change":"2023-12-19T13:54:26.118019+0000","last_active":"2023-12-19T13:54:27.664939+0000","last_peered":"2023-12-19T13:54:27.664939+0000","last_clean":"2023-12-19T13:54:27.664939+0000","last_became_active":"2023-12-19T13:54:26.117769+0000","last_became_peered":"2023-12-19T13:54:26.117769+0000","last_unstale":"2023-12-19T13:54:27.664939+0000","last_undegraded":"2023-12-19T13:54:27.664939+0000","last_fullsized":"2023-12-19T13:54:27.664939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:11.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"146'3","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.123980+0000","last_change":"2023-12-19T13:54:25.635860+0000","last_active":"2023-12-19T13:54:26.123980+0000","last_peered":"2023-12-19T13:54:26.123980+0000","last_clean":"2023-12-19T13:54:26.123980+0000","last_became_active":"2023-12-19T13:54:25.633833+0000","last_became_peered":"2023-12-19T13:54:25.633833+0000","last_unstale":"2023-12-19T13:54:26.123980+0000","last_undegraded":"2023-12-19T13:54:26.123980+0000","last_fullsized":"2023-12-19T13:54:26.123980+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:22.253277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665464+0000","last_change":"2023-12-19T13:54:26.100623+0000","last_active":"2023-12-19T13:54:27.665464+0000","last_peered":"2023-12-19T13:54:27.665464+0000","last_clean":"2023-12-19T13:54:27.665464+0000","last_became_active":"2023-12-19T13:54:26.100378+0000","last_became_peered":"2023-12-19T13:54:26.100378+0000","last_unstale":"2023-12-19T13:54:27.665464+0000","last_undegraded":"2023-12-19T13:54:27.665464+0000","last_fullsized":"2023-12-19T13:54:27.665464+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:47:28.669470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"146'6","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.130000+0000","last_change":"2023-12-19T13:54:25.630326+0000","last_active":"2023-12-19T13:54:26.130000+0000","last_peered":"2023-12-19T13:54:26.130000+0000","last_clean":"2023-12-19T13:54:26.130000+0000","last_became_active":"2023-12-19T13:54:25.629814+0000","last_became_peered":"2023-12-19T13:54:25.629814+0000","last_unstale":"2023-12-19T13:54:26.130000+0000","last_undegraded":"2023-12-19T13:54:26.130000+0000","last_fullsized":"2023-12-19T13:54:26.130000+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:39:07.443303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099862+0000","last_change":"2023-12-19T13:54:26.111988+0000","last_active":"2023-12-19T13:54:27.099862+0000","last_peered":"2023-12-19T13:54:27.099862+0000","last_clean":"2023-12-19T13:54:27.099862+0000","last_became_active":"2023-12-19T13:54:26.111081+0000","last_became_peered":"2023-12-19T13:54:26.111081+0000","last_unstale":"2023-12-19T13:54:27.099862+0000","last_undegraded":"2023-12-19T13:54:27.099862+0000","last_fullsized":"2023-12-19T13:54:27.099862+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:16.160277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.126679+0000","last_change":"2023-12-19T13:54:25.633325+0000","last_active":"2023-12-19T13:54:26.126679+0000","last_peered":"2023-12-19T13:54:26.126679+0000","last_clean":"2023-12-19T13:54:26.126679+0000","last_became_active":"2023-12-19T13:54:25.630982+0000","last_became_peered":"2023-12-19T13:54:25.630982+0000","last_unstale":"2023-12-19T13:54:26.126679+0000","last_undegraded":"2023-12-19T13:54:26.126679+0000","last_fullsized":"2023-12-19T13:54:26.126679+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:51.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178938+0000","last_change":"2023-12-19T13:54:26.115781+0000","last_active":"2023-12-19T13:54:27.178938+0000","last_peered":"2023-12-19T13:54:27.178938+0000","last_clean":"2023-12-19T13:54:27.178938+0000","last_became_active":"2023-12-19T13:54:26.111692+0000","last_became_peered":"2023-12-19T13:54:26.111692+0000","last_unstale":"2023-12-19T13:54:27.178938+0000","last_undegraded":"2023-12-19T13:54:27.178938+0000","last_fullsized":"2023-12-19T13:54:27.178938+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:00:40.805236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.091721+0000","last_change":"2023-12-19T13:54:25.628424+0000","last_active":"2023-12-19T13:54:26.091721+0000","last_peered":"2023-12-19T13:54:26.091721+0000","last_clean":"2023-12-19T13:54:26.091721+0000","last_became_active":"2023-12-19T13:54:25.628055+0000","last_became_peered":"2023-12-19T13:54:25.628055+0000","last_unstale":"2023-12-19T13:54:26.091721+0000","last_undegraded":"2023-12-19T13:54:26.091721+0000","last_fullsized":"2023-12-19T13:54:26.091721+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:30.228285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.179017+0000","last_change":"2023-12-19T13:54:26.112724+0000","last_active":"2023-12-19T13:54:27.179017+0000","last_peered":"2023-12-19T13:54:27.179017+0000","last_clean":"2023-12-19T13:54:27.179017+0000","last_became_active":"2023-12-19T13:54:26.112252+0000","last_became_peered":"2023-12-19T13:54:26.112252+0000","last_unstale":"2023-12-19T13:54:27.179017+0000","last_undegraded":"2023-12-19T13:54:27.179017+0000","last_fullsized":"2023-12-19T13:54:27.179017+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:57:31.846511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"146'8","reported_seq":19,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.131195+0000","last_change":"2023-12-19T13:54:25.634788+0000","last_active":"2023-12-19T13:54:26.131195+0000","last_peered":"2023-12-19T13:54:26.131195+0000","last_clean":"2023-12-19T13:54:26.131195+0000","last_became_active":"2023-12-19T13:54:25.634396+0000","last_became_peered":"2023-12-19T13:54:25.634396+0000","last_unstale":"2023-12-19T13:54:26.131195+0000","last_undegraded":"2023-12-19T13:54:26.131195+0000","last_fullsized":"2023-12-19T13:54:26.131195+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:37.633410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667250+0000","last_change":"2023-12-19T13:54:26.122916+0000","last_active":"2023-12-19T13:54:27.667250+0000","last_peered":"2023-12-19T13:54:27.667250+0000","last_clean":"2023-12-19T13:54:27.667250+0000","last_became_active":"2023-12-19T13:54:26.122694+0000","last_became_peered":"2023-12-19T13:54:26.122694+0000","last_unstale":"2023-12-19T13:54:27.667250+0000","last_undegraded":"2023-12-19T13:54:27.667250+0000","last_fullsized":"2023-12-19T13:54:27.667250+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:31.134097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.120234+0000","last_change":"2023-12-19T13:54:25.632783+0000","last_active":"2023-12-19T13:54:26.120234+0000","last_peered":"2023-12-19T13:54:26.120234+0000","last_clean":"2023-12-19T13:54:26.120234+0000","last_became_active":"2023-12-19T13:54:25.629421+0000","last_became_peered":"2023-12-19T13:54:25.629421+0000","last_unstale":"2023-12-19T13:54:26.120234+0000","last_undegraded":"2023-12-19T13:54:26.120234+0000","last_fullsized":"2023-12-19T13:54:26.120234+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:46:21.915312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666207+0000","last_change":"2023-12-19T13:54:26.122034+0000","last_active":"2023-12-19T13:54:27.666207+0000","last_peered":"2023-12-19T13:54:27.666207+0000","last_clean":"2023-12-19T13:54:27.666207+0000","last_became_active":"2023-12-19T13:54:26.121044+0000","last_became_peered":"2023-12-19T13:54:26.121044+0000","last_unstale":"2023-12-19T13:54:27.666207+0000","last_undegraded":"2023-12-19T13:54:27.666207+0000","last_fullsized":"2023-12-19T13:54:27.666207+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:04:59.282095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.125654+0000","last_change":"2023-12-19T13:54:25.634307+0000","last_active":"2023-12-19T13:54:26.125654+0000","last_peered":"2023-12-19T13:54:26.125654+0000","last_clean":"2023-12-19T13:54:26.125654+0000","last_became_active":"2023-12-19T13:54:25.632020+0000","last_became_peered":"2023-12-19T13:54:25.632020+0000","last_unstale":"2023-12-19T13:54:26.125654+0000","last_undegraded":"2023-12-19T13:54:26.125654+0000","last_fullsized":"2023-12-19T13:54:26.125654+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:52.731731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666625+0000","last_change":"2023-12-19T13:54:26.110985+0000","last_active":"2023-12-19T13:54:27.666625+0000","last_peered":"2023-12-19T13:54:27.666625+0000","last_clean":"2023-12-19T13:54:27.666625+0000","last_became_active":"2023-12-19T13:54:26.110459+0000","last_became_peered":"2023-12-19T13:54:26.110459+0000","last_unstale":"2023-12-19T13:54:27.666625+0000","last_undegraded":"2023-12-19T13:54:27.666625+0000","last_fullsized":"2023-12-19T13:54:27.666625+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:14.042073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"146'1","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.119626+0000","last_change":"2023-12-19T13:54:25.628607+0000","last_active":"2023-12-19T13:54:26.119626+0000","last_peered":"2023-12-19T13:54:26.119626+0000","last_clean":"2023-12-19T13:54:26.119626+0000","last_became_active":"2023-12-19T13:54:25.628283+0000","last_became_peered":"2023-12-19T13:54:25.628283+0000","last_unstale":"2023-12-19T13:54:26.119626+0000","last_undegraded":"2023-12-19T13:54:26.119626+0000","last_fullsized":"2023-12-19T13:54:26.119626+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:52.731731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099495+0000","last_change":"2023-12-19T13:54:26.108079+0000","last_active":"2023-12-19T13:54:27.099495+0000","last_peered":"2023-12-19T13:54:27.099495+0000","last_clean":"2023-12-19T13:54:27.099495+0000","last_became_active":"2023-12-19T13:54:26.107718+0000","last_became_peered":"2023-12-19T13:54:26.107718+0000","last_unstale":"2023-12-19T13:54:27.099495+0000","last_undegraded":"2023-12-19T13:54:27.099495+0000","last_fullsized":"2023-12-19T13:54:27.099495+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:17.421083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.102020+0000","last_change":"2023-12-19T13:54:25.630391+0000","last_active":"2023-12-19T13:54:26.102020+0000","last_peered":"2023-12-19T13:54:26.102020+0000","last_clean":"2023-12-19T13:54:26.102020+0000","last_became_active":"2023-12-19T13:54:25.630167+0000","last_became_peered":"2023-12-19T13:54:25.630167+0000","last_unstale":"2023-12-19T13:54:26.102020+0000","last_undegraded":"2023-12-19T13:54:26.102020+0000","last_fullsized":"2023-12-19T13:54:26.102020+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:18.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095447+0000","last_change":"2023-12-19T13:54:26.096336+0000","last_active":"2023-12-19T13:54:27.095447+0000","last_peered":"2023-12-19T13:54:27.095447+0000","last_clean":"2023-12-19T13:54:27.095447+0000","last_became_active":"2023-12-19T13:54:26.096115+0000","last_became_peered":"2023-12-19T13:54:26.096115+0000","last_unstale":"2023-12-19T13:54:27.095447+0000","last_undegraded":"2023-12-19T13:54:27.095447+0000","last_fullsized":"2023-12-19T13:54:27.095447+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:14.440543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.118007+0000","last_change":"2023-12-19T13:54:25.635594+0000","last_active":"2023-12-19T13:54:26.118007+0000","last_peered":"2023-12-19T13:54:26.118007+0000","last_clean":"2023-12-19T13:54:26.118007+0000","last_became_active":"2023-12-19T13:54:25.633490+0000","last_became_peered":"2023-12-19T13:54:25.633490+0000","last_unstale":"2023-12-19T13:54:26.118007+0000","last_undegraded":"2023-12-19T13:54:26.118007+0000","last_fullsized":"2023-12-19T13:54:26.118007+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:05:33.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666619+0000","last_change":"2023-12-19T13:54:26.125996+0000","last_active":"2023-12-19T13:54:27.666619+0000","last_peered":"2023-12-19T13:54:27.666619+0000","last_clean":"2023-12-19T13:54:27.666619+0000","last_became_active":"2023-12-19T13:54:26.122577+0000","last_became_peered":"2023-12-19T13:54:26.122577+0000","last_unstale":"2023-12-19T13:54:27.666619+0000","last_undegraded":"2023-12-19T13:54:27.666619+0000","last_fullsized":"2023-12-19T13:54:27.666619+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:26.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.103997+0000","last_change":"2023-12-19T13:54:25.637945+0000","last_active":"2023-12-19T13:54:26.103997+0000","last_peered":"2023-12-19T13:54:26.103997+0000","last_clean":"2023-12-19T13:54:26.103997+0000","last_became_active":"2023-12-19T13:54:25.637699+0000","last_became_peered":"2023-12-19T13:54:25.637699+0000","last_unstale":"2023-12-19T13:54:26.103997+0000","last_undegraded":"2023-12-19T13:54:26.103997+0000","last_fullsized":"2023-12-19T13:54:26.103997+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:15.759770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099770+0000","last_change":"2023-12-19T13:54:26.118002+0000","last_active":"2023-12-19T13:54:27.099770+0000","last_peered":"2023-12-19T13:54:27.099770+0000","last_clean":"2023-12-19T13:54:27.099770+0000","last_became_active":"2023-12-19T13:54:26.117725+0000","last_became_peered":"2023-12-19T13:54:26.117725+0000","last_unstale":"2023-12-19T13:54:27.099770+0000","last_undegraded":"2023-12-19T13:54:27.099770+0000","last_fullsized":"2023-12-19T13:54:27.099770+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:28.669606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.100389+0000","last_change":"2023-12-19T13:54:25.636046+0000","last_active":"2023-12-19T13:54:26.100389+0000","last_peered":"2023-12-19T13:54:26.100389+0000","last_clean":"2023-12-19T13:54:26.100389+0000","last_became_active":"2023-12-19T13:54:25.635095+0000","last_became_peered":"2023-12-19T13:54:25.635095+0000","last_unstale":"2023-12-19T13:54:26.100389+0000","last_undegraded":"2023-12-19T13:54:26.100389+0000","last_fullsized":"2023-12-19T13:54:26.100389+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:13.188694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.100204+0000","last_change":"2023-12-19T13:54:26.118524+0000","last_active":"2023-12-19T13:54:27.100204+0000","last_peered":"2023-12-19T13:54:27.100204+0000","last_clean":"2023-12-19T13:54:27.100204+0000","last_became_active":"2023-12-19T13:54:26.115502+0000","last_became_peered":"2023-12-19T13:54:26.115502+0000","last_unstale":"2023-12-19T13:54:27.100204+0000","last_undegraded":"2023-12-19T13:54:27.100204+0000","last_fullsized":"2023-12-19T13:54:27.100204+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:06.316861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106619+0000","last_change":"2023-12-19T13:54:25.632551+0000","last_active":"2023-12-19T13:54:26.106619+0000","last_peered":"2023-12-19T13:54:26.106619+0000","last_clean":"2023-12-19T13:54:26.106619+0000","last_became_active":"2023-12-19T13:54:25.632166+0000","last_became_peered":"2023-12-19T13:54:25.632166+0000","last_unstale":"2023-12-19T13:54:26.106619+0000","last_undegraded":"2023-12-19T13:54:26.106619+0000","last_fullsized":"2023-12-19T13:54:26.106619+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:27.663946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098628+0000","last_change":"2023-12-19T13:54:26.116654+0000","last_active":"2023-12-19T13:54:27.098628+0000","last_peered":"2023-12-19T13:54:27.098628+0000","last_clean":"2023-12-19T13:54:27.098628+0000","last_became_active":"2023-12-19T13:54:26.116404+0000","last_became_peered":"2023-12-19T13:54:26.116404+0000","last_unstale":"2023-12-19T13:54:27.098628+0000","last_undegraded":"2023-12-19T13:54:27.098628+0000","last_fullsized":"2023-12-19T13:54:27.098628+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:39.972921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"146'2","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.125409+0000","last_change":"2023-12-19T13:54:25.632134+0000","last_active":"2023-12-19T13:54:26.125409+0000","last_peered":"2023-12-19T13:54:26.125409+0000","last_clean":"2023-12-19T13:54:26.125409+0000","last_became_active":"2023-12-19T13:54:25.631683+0000","last_became_peered":"2023-12-19T13:54:25.631683+0000","last_unstale":"2023-12-19T13:54:26.125409+0000","last_undegraded":"2023-12-19T13:54:26.125409+0000","last_fullsized":"2023-12-19T13:54:26.125409+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:10.857856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.666278+0000","last_change":"2023-12-19T13:54:26.119383+0000","last_active":"2023-12-19T13:54:27.666278+0000","last_peered":"2023-12-19T13:54:27.666278+0000","last_clean":"2023-12-19T13:54:27.666278+0000","last_became_active":"2023-12-19T13:54:26.118934+0000","last_became_peered":"2023-12-19T13:54:26.118934+0000","last_unstale":"2023-12-19T13:54:27.666278+0000","last_undegraded":"2023-12-19T13:54:27.666278+0000","last_fullsized":"2023-12-19T13:54:27.666278+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:19:54.105973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"147'1","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665688+0000","last_change":"2023-12-19T13:54:25.613910+0000","last_active":"2023-12-19T13:54:27.665688+0000","last_peered":"2023-12-19T13:54:27.665688+0000","last_clean":"2023-12-19T13:54:27.665688+0000","last_became_active":"2023-12-19T13:54:25.613419+0000","last_became_peered":"2023-12-19T13:54:25.613419+0000","last_unstale":"2023-12-19T13:54:27.665688+0000","last_undegraded":"2023-12-19T13:54:27.665688+0000","last_fullsized":"2023-12-19T13:54:27.665688+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:08.010694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.667382+0000","last_change":"2023-12-19T13:54:26.119338+0000","last_active":"2023-12-19T13:54:27.667382+0000","last_peered":"2023-12-19T13:54:27.667382+0000","last_clean":"2023-12-19T13:54:27.667382+0000","last_became_active":"2023-12-19T13:54:26.119099+0000","last_became_peered":"2023-12-19T13:54:26.119099+0000","last_unstale":"2023-12-19T13:54:27.667382+0000","last_undegraded":"2023-12-19T13:54:27.667382+0000","last_fullsized":"2023-12-19T13:54:27.667382+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:14.169202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106193+0000","last_change":"2023-12-19T13:54:25.628298+0000","last_active":"2023-12-19T13:54:26.106193+0000","last_peered":"2023-12-19T13:54:26.106193+0000","last_clean":"2023-12-19T13:54:26.106193+0000","last_became_active":"2023-12-19T13:54:25.627905+0000","last_became_peered":"2023-12-19T13:54:25.627905+0000","last_unstale":"2023-12-19T13:54:26.106193+0000","last_undegraded":"2023-12-19T13:54:26.106193+0000","last_fullsized":"2023-12-19T13:54:26.106193+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:16.415423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.098972+0000","last_change":"2023-12-19T13:54:26.112081+0000","last_active":"2023-12-19T13:54:27.098972+0000","last_peered":"2023-12-19T13:54:27.098972+0000","last_clean":"2023-12-19T13:54:27.098972+0000","last_became_active":"2023-12-19T13:54:26.111864+0000","last_became_peered":"2023-12-19T13:54:26.111864+0000","last_unstale":"2023-12-19T13:54:27.098972+0000","last_undegraded":"2023-12-19T13:54:27.098972+0000","last_fullsized":"2023-12-19T13:54:27.098972+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:14.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.100630+0000","last_change":"2023-12-19T13:54:25.635569+0000","last_active":"2023-12-19T13:54:26.100630+0000","last_peered":"2023-12-19T13:54:26.100630+0000","last_clean":"2023-12-19T13:54:26.100630+0000","last_became_active":"2023-12-19T13:54:25.633893+0000","last_became_peered":"2023-12-19T13:54:25.633893+0000","last_unstale":"2023-12-19T13:54:26.100630+0000","last_undegraded":"2023-12-19T13:54:26.100630+0000","last_fullsized":"2023-12-19T13:54:26.100630+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:05.311202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.095147+0000","last_change":"2023-12-19T13:54:26.111938+0000","last_active":"2023-12-19T13:54:27.095147+0000","last_peered":"2023-12-19T13:54:27.095147+0000","last_clean":"2023-12-19T13:54:27.095147+0000","last_became_active":"2023-12-19T13:54:26.111720+0000","last_became_peered":"2023-12-19T13:54:26.111720+0000","last_unstale":"2023-12-19T13:54:27.095147+0000","last_undegraded":"2023-12-19T13:54:27.095147+0000","last_fullsized":"2023-12-19T13:54:27.095147+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:39.808242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.095812+0000","last_change":"2023-12-19T13:54:25.622924+0000","last_active":"2023-12-19T13:54:26.095812+0000","last_peered":"2023-12-19T13:54:26.095812+0000","last_clean":"2023-12-19T13:54:26.095812+0000","last_became_active":"2023-12-19T13:54:25.622671+0000","last_became_peered":"2023-12-19T13:54:25.622671+0000","last_unstale":"2023-12-19T13:54:26.095812+0000","last_undegraded":"2023-12-19T13:54:26.095812+0000","last_fullsized":"2023-12-19T13:54:26.095812+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:11.392524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099952+0000","last_change":"2023-12-19T13:54:26.113241+0000","last_active":"2023-12-19T13:54:27.099952+0000","last_peered":"2023-12-19T13:54:27.099952+0000","last_clean":"2023-12-19T13:54:27.099952+0000","last_became_active":"2023-12-19T13:54:26.113037+0000","last_became_peered":"2023-12-19T13:54:26.113037+0000","last_unstale":"2023-12-19T13:54:27.099952+0000","last_undegraded":"2023-12-19T13:54:27.099952+0000","last_fullsized":"2023-12-19T13:54:27.099952+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:38.801564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.102109+0000","last_change":"2023-12-19T13:54:25.633771+0000","last_active":"2023-12-19T13:54:26.102109+0000","last_peered":"2023-12-19T13:54:26.102109+0000","last_clean":"2023-12-19T13:54:26.102109+0000","last_became_active":"2023-12-19T13:54:25.633519+0000","last_became_peered":"2023-12-19T13:54:25.633519+0000","last_unstale":"2023-12-19T13:54:26.102109+0000","last_undegraded":"2023-12-19T13:54:26.102109+0000","last_fullsized":"2023-12-19T13:54:26.102109+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:51.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.099200+0000","last_change":"2023-12-19T13:54:26.104176+0000","last_active":"2023-12-19T13:54:27.099200+0000","last_peered":"2023-12-19T13:54:27.099200+0000","last_clean":"2023-12-19T13:54:27.099200+0000","last_became_active":"2023-12-19T13:54:26.103943+0000","last_became_peered":"2023-12-19T13:54:26.103943+0000","last_unstale":"2023-12-19T13:54:27.099200+0000","last_undegraded":"2023-12-19T13:54:27.099200+0000","last_fullsized":"2023-12-19T13:54:27.099200+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:16.765430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.106326+0000","last_change":"2023-12-19T13:54:25.634619+0000","last_active":"2023-12-19T13:54:26.106326+0000","last_peered":"2023-12-19T13:54:26.106326+0000","last_clean":"2023-12-19T13:54:26.106326+0000","last_became_active":"2023-12-19T13:54:25.634100+0000","last_became_peered":"2023-12-19T13:54:25.634100+0000","last_unstale":"2023-12-19T13:54:26.106326+0000","last_undegraded":"2023-12-19T13:54:26.106326+0000","last_fullsized":"2023-12-19T13:54:26.106326+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:28.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.665313+0000","last_change":"2023-12-19T13:54:26.127706+0000","last_active":"2023-12-19T13:54:27.665313+0000","last_peered":"2023-12-19T13:54:27.665313+0000","last_clean":"2023-12-19T13:54:27.665313+0000","last_became_active":"2023-12-19T13:54:26.127513+0000","last_became_peered":"2023-12-19T13:54:26.127513+0000","last_unstale":"2023-12-19T13:54:27.665313+0000","last_undegraded":"2023-12-19T13:54:27.665313+0000","last_fullsized":"2023-12-19T13:54:27.665313+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:08.807039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.109305+0000","last_change":"2023-12-19T13:54:25.632338+0000","last_active":"2023-12-19T13:54:26.109305+0000","last_peered":"2023-12-19T13:54:26.109305+0000","last_clean":"2023-12-19T13:54:26.109305+0000","last_became_active":"2023-12-19T13:54:25.628965+0000","last_became_peered":"2023-12-19T13:54:25.628965+0000","last_unstale":"2023-12-19T13:54:26.109305+0000","last_undegraded":"2023-12-19T13:54:26.109305+0000","last_fullsized":"2023-12-19T13:54:26.109305+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:13.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-12-19T13:54:27.178575+0000","last_change":"2023-12-19T13:54:26.118452+0000","last_active":"2023-12-19T13:54:27.178575+0000","last_peered":"2023-12-19T13:54:27.178575+0000","last_clean":"2023-12-19T13:54:27.178575+0000","last_became_active":"2023-12-19T13:54:26.117149+0000","last_became_peered":"2023-12-19T13:54:26.117149+0000","last_unstale":"2023-12-19T13:54:27.178575+0000","last_undegraded":"2023-12-19T13:54:27.178575+0000","last_fullsized":"2023-12-19T13:54:27.178575+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:25.589372+0000","last_clean_scrub_stamp":"2023-12-19T13:54:25.589372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:32:38.474781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.093262+0000","last_change":"2023-12-19T13:54:25.631087+0000","last_active":"2023-12-19T13:54:26.093262+0000","last_peered":"2023-12-19T13:54:26.093262+0000","last_clean":"2023-12-19T13:54:26.093262+0000","last_became_active":"2023-12-19T13:54:25.630834+0000","last_became_peered":"2023-12-19T13:54:25.630834+0000","last_unstale":"2023-12-19T13:54:26.093262+0000","last_undegraded":"2023-12-19T13:54:26.093262+0000","last_fullsized":"2023-12-19T13:54:26.093262+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:54:24.583713+0000","last_clean_scrub_stamp":"2023-12-19T13:54:24.583713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:10.857856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-12-19T13:54:26.092253+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:54:26.092253+0000","last_peered":"2023-12-19T13:54:26.092253+0000","last_clean":"2023-12-19T13:54:26.092253+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:54:26.092253+0000","last_undegraded":"2023-12-19T13:54:26.092253+0000","last_fullsized":"2023-12-19T13:54:26.092253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.032},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6240000000000001,"5min":1.6950000000000001,"15min":1.9059999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1120000000000001,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.7190000000000001,"15min":2.008},"last":1.1120000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.167,"15min":1.103},"min":{"1min":0.71599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6479999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.1679999999999999,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.728,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.3340000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1399999999999999,"15min":1.135},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.081},{"interface":"front","average":{"1min":1.226,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.84999999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":1.7390000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2390000000000001,"15min":1.179},"min":{"1min":0.74199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.874},{"interface":"front","average":{"1min":1.359,"5min":1.3120000000000001,"15min":1.2609999999999999},"min":{"1min":0.98999999999999999,"5min":0.70599999999999996,"15min":0.65200000000000002},"max":{"1min":1.883,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.282}]},{"osd":4,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2649999999999999,"15min":1.284},"min":{"1min":0.94999999999999996,"5min":0.84499999999999997,"15min":0.60299999999999998},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.321,"15min":1.3799999999999999},"min":{"1min":0.83099999999999996,"5min":0.78900000000000003,"15min":0.58499999999999996},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.6879999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.2869999999999999,"15min":1.2410000000000001},"min":{"1min":0.94599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.216},{"interface":"front","average":{"1min":1.458,"5min":1.405,"15min":1.425},"min":{"1min":1.103,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.1699999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.3979999999999999,"15min":1.306},"min":{"1min":1.1140000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.409},{"interface":"front","average":{"1min":1.571,"5min":1.5049999999999999,"15min":1.4950000000000001},"min":{"1min":1.228,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.3720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.59299999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5329999999999999,"5min":1.6220000000000001,"15min":2.0640000000000001},"last":1.413},{"interface":"front","average":{"1min":1.113,"5min":1.099,"15min":1.1160000000000001},"min":{"1min":0.71399999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.631,"15min":3.2069999999999999},"last":0.997}]},{"osd":1,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.069,"15min":1.044},"min":{"1min":0.72899999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4570000000000001,"5min":1.5580000000000001,"15min":1.962},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.6279999999999999},"last":0.96399999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.268,"15min":1.2350000000000001},"min":{"1min":1.012,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.8180000000000001},"last":1.504},{"interface":"front","average":{"1min":1.21,"5min":1.2609999999999999,"15min":1.1839999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.647,"5min":1.802,"15min":1.802},"last":1.573}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.242,"15min":1.319},"min":{"1min":0.78600000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.319},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.232,"15min":1.2589999999999999},"min":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.67900000000000005},"max":{"1min":1.5660000000000001,"5min":1.819,"15min":4.3899999999999997},"last":1.272}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.325,"15min":1.238},"min":{"1min":1,"5min":0.64500000000000002,"15min":0.47899999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.3779999999999999,"15min":1.3140000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.70699999999999996},"max":{"1min":1.768,"5min":1.895,"15min":1.895},"last":1.464}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.327,"15min":1.2669999999999999},"min":{"1min":0.83899999999999997,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.857,"5min":1.962,"15min":1.962},"last":1.157},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4390000000000001,"15min":1.387},"min":{"1min":0.90600000000000003,"5min":0.80200000000000005,"15min":0.48799999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.2210000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4730000000000001,"15min":1.4319999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.59599999999999997},"max":{"1min":1.7529999999999999,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4490000000000001,"15min":1.3799999999999999},"min":{"1min":1.073,"5min":0.72799999999999998,"15min":0.57999999999999996},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.3799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193934,"statfs":{"total":200000000,"available":198589066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.075,"15min":1.0049999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2170000000000001,"15min":1.1080000000000001},"min":{"1min":0.81100000000000005,"5min":0.67500000000000004,"15min":0.53900000000000003},"max":{"1min":2.1429999999999998,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":0.96299999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.167,"15min":1.1220000000000001},"min":{"1min":0.67100000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6839999999999999,"5min":6.101,"15min":6.101},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1830000000000001,"15min":1.0580000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.694,"5min":2.077,"15min":2.077},"last":1.625}]},{"osd":2,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2509999999999999,"15min":1.248},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.6839999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":1.123},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.246,"15min":1.2629999999999999},"min":{"1min":0.754,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5569999999999999,"5min":2.2730000000000001,"15min":2.863},"last":1.008}]},{"osd":3,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3460000000000001,"15min":1.2450000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.595,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.224},{"interface":"front","average":{"1min":1.335,"5min":1.296,"15min":1.2609999999999999},"min":{"1min":0.82099999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.75,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.4279999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.21,"15min":1.1599999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.982},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.395,"15min":1.3160000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":1.819,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.379}]},{"osd":6,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3700000000000001,"15min":1.335},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.821,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.3680000000000001,"15min":1.369},"min":{"1min":0.78400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.5680000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5229999999999999,"15min":1.4390000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.1219999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.52},{"interface":"front","average":{"1min":1.571,"5min":1.5129999999999999,"15min":1.4410000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.1070000000000002,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.5009999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.052,"15min":1.0109999999999999},"min":{"1min":0.67700000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":1.649,"15min":1.657},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.091,"15min":1.1160000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.016},"last":1.2889999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0720000000000001,"15min":1.0669999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.161},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.73399999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6080000000000001,"5min":1.887,"15min":1.887},"last":1.3089999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.119,"15min":1.05},"min":{"1min":0.71999999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.4119999999999999,"5min":1.704,"15min":1.704},"last":1.099},{"interface":"front","average":{"1min":1.127,"5min":1.161,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.617,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.3460000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.208,"15min":1.214},"min":{"1min":0.98299999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4470000000000001,"5min":1.8360000000000001,"15min":1.952},"last":1.228},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.29,"15min":1.2809999999999999},"min":{"1min":0.94199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7050000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.45}]},{"osd":5,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2230000000000001,"15min":1.242},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.51700000000000002},"max":{"1min":1.6020000000000001,"5min":1.9730000000000001,"15min":2.165},"last":1.129},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3129999999999999,"15min":1.335},"min":{"1min":0.79700000000000004,"5min":0.61899999999999999,"15min":0.58399999999999996},"max":{"1min":1.7529999999999999,"5min":2.306,"15min":2.3570000000000002},"last":1.0249999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3300000000000001,"15min":1.381},"min":{"1min":0.82999999999999996,"5min":0.78800000000000003,"15min":0.55900000000000005},"max":{"1min":1.472,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.4490000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.831,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.252}]},{"osd":7,"last update":"Tue Dec 19 13:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.468,"15min":1.4670000000000001},"min":{"1min":1.0409999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7689999999999999,"5min":2.948,"15min":2.948},"last":1.395},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5289999999999999,"15min":1.526},"min":{"1min":0.92900000000000005,"5min":0.85699999999999998,"15min":0.59999999999999998},"max":{"1min":1.8169999999999999,"5min":3.137,"15min":3.137},"last":1.528}]}]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.90400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0760000000000001,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.95099999999999996},"min":{"1min":0.35699999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.49,"5min":1.502,"15min":3.0670000000000002},"last":0.90000000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.96599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1899999999999999,"5min":1.508,"15min":5.3769999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3979999999999999,"5min":1.5780000000000001,"15min":2.387},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.95599999999999996,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.3500000000000001,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.004,"15min":1.1020000000000001},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.722,"5min":1.722,"15min":2.657},"last":1.3180000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1930000000000001,"15min":1.252},"min":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.607,"5min":1.718,"15min":3.0070000000000001},"last":1.286},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.226,"15min":1.23},"min":{"1min":0.70799999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.629,"5min":1.835,"15min":2.7690000000000001},"last":1.389}]},{"osd":5,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2350000000000001,"15min":1.2909999999999999},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.72,"5min":1.72,"15min":2.7309999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2150000000000001,"15min":1.256},"min":{"1min":0.73199999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.5249999999999999},"last":1.242}]},{"osd":6,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2270000000000001,"15min":1.2889999999999999},"min":{"1min":0.59299999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.647,"5min":1.7090000000000001,"15min":2.9769999999999999},"last":1.345},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.75800000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":2.698},"last":1.181}]},{"osd":7,"last update":"Tue Dec 19 13:53:28 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.298,"15min":1.3540000000000001},"min":{"1min":0.73399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.609},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.355,"15min":1.389},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8999999999999999,"5min":2.02,"15min":3.0379999999999998},"last":1.4059999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82899999999999996,"15min":0.83199999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4550000000000001,"5min":1.544,"15min":2.258},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.002,"15min":0.84799999999999998},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.542,"5min":11.85,"15min":11.85},"last":1.1020000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.4610000000000001,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.111,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.381,"5min":11.788,"15min":11.788},"last":1.327}]},{"osd":3,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97999999999999998,"15min":0.94999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.373,"5min":1.6599999999999999,"15min":2.3109999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.091,"15min":1.0369999999999999},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":1.5800000000000001,"5min":4.8079999999999998,"15min":4.8079999999999998},"last":1.2609999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3640000000000001,"15min":1.1910000000000001},"min":{"1min":0.96499999999999997,"5min":0.81799999999999995,"15min":0.746},"max":{"1min":1.5580000000000001,"5min":11.930999999999999,"15min":11.930999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.786,"5min":1.786,"15min":2.2189999999999999},"last":1.3}]},{"osd":5,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4510000000000001,"15min":1.2629999999999999},"min":{"1min":0.94799999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.615,"5min":11.888,"15min":11.888},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3120000000000001,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.85199999999999998,"15min":0.68899999999999995},"max":{"1min":1.843,"5min":1.9850000000000001,"15min":2.8769999999999998},"last":1.585}]},{"osd":6,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":1.0049999999999999,"5min":0.85899999999999999,"15min":0.72399999999999998},"max":{"1min":1.994,"5min":2.0640000000000001,"15min":2.964},"last":1.383},{"interface":"front","average":{"1min":1.28,"5min":1.3100000000000001,"15min":1.266},"min":{"1min":0.79000000000000004,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.8879999999999999,"5min":1.944,"15min":2.286},"last":1.46}]},{"osd":7,"last update":"Tue Dec 19 13:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.355,"15min":1.3180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.351},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.468,"15min":1.3080000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.75600000000000001},"max":{"1min":1.6739999999999999,"5min":11.962999999999999,"15min":11.962999999999999},"last":1.534}]}]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193934,"statfs":{"total":200000000,"available":198589158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.80500000000000005},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88200000000000001,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":1.3280000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.94099999999999995,"15min":0.94899999999999995},"min":{"1min":0.58899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":2.351,"15min":3.3500000000000001},"last":1.6639999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93700000000000006,"15min":1.0509999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.119,"15min":1.1679999999999999},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5780000000000001,"5min":1.7829999999999999,"15min":5.2009999999999996},"last":1.619}]},{"osd":3,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0720000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.5},"max":{"1min":1.548,"5min":1.6759999999999999,"15min":3.4300000000000002},"last":1.7},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0189999999999999,"15min":1.1479999999999999},"min":{"1min":0.47599999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.522,"5min":1.706,"15min":7.157},"last":1.054}]},{"osd":4,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.159,"15min":1.2110000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":1.4119999999999999,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.264,"15min":1.2909999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.579,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.7490000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.248,"15min":1.3100000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.538,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3839999999999999,"15min":1.363},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3999999999999999,"5min":15.576000000000001,"15min":15.576000000000001},"last":1.3819999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.876,"5min":0.74199999999999999,"15min":0.67800000000000005},"max":{"1min":1.675,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3260000000000001,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.595,"5min":2.3159999999999998,"15min":3.786},"last":1.4470000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3799999999999999,"15min":1.4359999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.637,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.3140000000000001,"15min":1.429},"min":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6100000000000001,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.5309999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.76600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32200000000000001,"15min":0.28299999999999997},"max":{"1min":1.639,"5min":1.639,"15min":1.6399999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.046,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2629999999999999,"5min":14.010999999999999,"15min":14.010999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.3029999999999999,"15min":1.008},"min":{"1min":0.443,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.8149999999999999,"5min":33.799999999999997,"15min":33.799999999999997},"last":1.075},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.494,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4430000000000001,"5min":41.758000000000003,"15min":41.758000000000003},"last":1.153}]},{"osd":3,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.98399999999999999},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":1.109,"5min":1.619,"15min":4.4530000000000003},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.997,"5min":1.081,"15min":1.095},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.36499999999999999},"max":{"1min":1.9470000000000001,"5min":2.02,"15min":2.02},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.151,"15min":1.1990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.306,"5min":1.917,"15min":4.4269999999999996},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.407,"15min":1.234},"min":{"1min":0.80900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8700000000000001,"5min":15.766,"15min":15.766},"last":1.2070000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.393,"15min":1.2350000000000001},"min":{"1min":0.79500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.484,"5min":14.337999999999999,"15min":14.337999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6499999999999999,"5min":2.8999999999999999,"15min":4.3970000000000002},"last":1.109}]},{"osd":6,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.284},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.67800000000000005},"max":{"1min":1.7709999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.534,"15min":1.3420000000000001},"min":{"1min":0.78200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.599,"5min":17.161000000000001,"15min":17.161000000000001},"last":1.2829999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:53:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.49,"15min":1.347},"min":{"1min":0.83799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.615,"5min":14.381,"15min":14.381},"last":1.383},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.3979999999999999,"15min":1.3899999999999999},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4330000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.4059999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:54:31.512 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:54:31.512 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:54:31.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.774+0000 7fce3f0c7640 1 Processor -- start 2023-12-19T13:54:31.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.774+0000 7fce3f0c7640 1 -- start start 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.776+0000 7fce3f0c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce3815e650 0x7fce380ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.776+0000 7fce3f0c7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce380cb9e0 0x7fce380cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.776+0000 7fce3f0c7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce380cc3d0 con 0x7fce381548a0 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.776+0000 7fce3f0c7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce380ce060 con 0x7fce380cb9e0 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.776+0000 7fce3f0c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3815ee70 con 0x7fce3815e650 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce3ce63640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fce381548a0 0x7fce3815df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38682/0 (socket says 172.21.15.113:38682) 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce3ce63640 1 -- 172.21.15.113:0/621626363 learned_addr learned my addr 172.21.15.113:0/621626363 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:31.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce3d664640 1 --2- 172.21.15.113:0/621626363 >> v2:172.21.15.113:3300/0 conn(0x7fce380cb9e0 0x7fce380cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce37fff640 1 --2- 172.21.15.113:0/621626363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce3815e650 0x7fce380ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce377fe640 1 -- 172.21.15.113:0/621626363 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841063116 0 0) 0x7fce380cc3d0 con 0x7fce381548a0 2023-12-19T13:54:31.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce3d664640 1 -- 172.21.15.113:0/621626363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce3815e650 msgr2=0x7fce380ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:31.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce3d664640 1 --2- 172.21.15.113:0/621626363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce3815e650 0x7fce380ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce3d664640 1 -- 172.21.15.113:0/621626363 >> v1:172.21.15.113:6789/0 conn(0x7fce381548a0 legacy=0x7fce3815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.777+0000 7fce3d664640 1 -- 172.21.15.113:0/621626363 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3815eb90 con 0x7fce380cb9e0 2023-12-19T13:54:31.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.778+0000 7fce3d664640 1 --2- 172.21.15.113:0/621626363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce380cb9e0 0x7fce380cbe90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e852540b4a8b85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:31.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce377fe640 1 -- 172.21.15.113:0/621626363 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3002cc50 con 0x7fce380cb9e0 2023-12-19T13:54:31.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce377fe640 1 -- 172.21.15.113:0/621626363 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3002cdb0 con 0x7fce380cb9e0 2023-12-19T13:54:31.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce377fe640 1 -- 172.21.15.113:0/621626363 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30034660 con 0x7fce380cb9e0 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce3f0c7640 1 -- 172.21.15.113:0/621626363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce380cb9e0 msgr2=0x7fce380cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/621626363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce380cb9e0 0x7fce380cbe90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3002bea0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce3f0c7640 1 -- 172.21.15.113:0/621626363 shutdown_connections 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/621626363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce380cb9e0 0x7fce380cbe90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/621626363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce3815e650 0x7fce380ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.779+0000 7fce3f0c7640 1 -- 172.21.15.113:0/621626363 >> 172.21.15.113:0/621626363 conn(0x7fce380659d0 msgr2=0x7fce38065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.780+0000 7fce3f0c7640 1 -- 172.21.15.113:0/621626363 shutdown_connections 2023-12-19T13:54:31.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.780+0000 7fce3f0c7640 1 -- 172.21.15.113:0/621626363 wait complete. 2023-12-19T13:54:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.781+0000 7fce3f0c7640 1 Processor -- start 2023-12-19T13:54:31.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.781+0000 7fce3f0c7640 1 -- start start 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.782+0000 7fce3f0c7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce380cb9e0 0x7fce3806f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.782+0000 7fce3f0c7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce381548a0 0x7fce38155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.782+0000 7fce3f0c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce3815e650 0x7fce380ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.782+0000 7fce3f0c7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce38070020 con 0x7fce381548a0 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.782+0000 7fce3f0c7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce38070300 con 0x7fce3815e650 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.782+0000 7fce3f0c7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce380705e0 con 0x7fce380cb9e0 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce381548a0 0x7fce38155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce381548a0 0x7fce38155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55882/0 (socket says 172.21.15.113:55882) 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 -- 172.21.15.113:0/3695963620 learned_addr learned my addr 172.21.15.113:0/3695963620 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce3ce63640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce380cb9e0 0x7fce3806f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 -- 172.21.15.113:0/3695963620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce380cb9e0 msgr2=0x7fce3806f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce380cb9e0 0x7fce3806f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 -- 172.21.15.113:0/3695963620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce3815e650 msgr2=0x7fce380ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce3815e650 0x7fce380ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 -- 172.21.15.113:0/3695963620 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30009a70 con 0x7fce381548a0 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.783+0000 7fce37fff640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce381548a0 0x7fce38155260 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fce2400d5c0 tx=0x7fce2400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.784+0000 7fce357fa640 1 -- 172.21.15.113:0/3695963620 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce240125f0 con 0x7fce381548a0 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.784+0000 7fce357fa640 1 -- 172.21.15.113:0/3695963620 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce24012750 con 0x7fce381548a0 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.784+0000 7fce357fa640 1 -- 172.21.15.113:0/3695963620 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24012b00 con 0x7fce381548a0 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.784+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce380708c0 con 0x7fce381548a0 2023-12-19T13:54:31.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.784+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce38143790 con 0x7fce381548a0 2023-12-19T13:54:31.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.785+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce38070ae0 con 0x7fce381548a0 2023-12-19T13:54:31.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.786+0000 7fce357fa640 1 -- 172.21.15.113:0/3695963620 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce24012c60 con 0x7fce381548a0 2023-12-19T13:54:31.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.787+0000 7fce357fa640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fce1c06a430 0x7fce1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:31.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.787+0000 7fce357fa640 1 -- 172.21.15.113:0/3695963620 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce24088e20 con 0x7fce381548a0 2023-12-19T13:54:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.787+0000 7fce3ce63640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fce1c06a430 0x7fce1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.788+0000 7fce3ce63640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fce1c06a430 0x7fce1c06c8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007fd0 tx=0x7fce2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:31.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:31.792+0000 7fce357fa640 1 -- 172.21.15.113:0/3695963620 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fce24054380 con 0x7fce381548a0 2023-12-19T13:54:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.056+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fce38143a10 con 0x7fce381548a0 2023-12-19T13:54:32.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.064+0000 7fce357fa640 1 -- 172.21.15.113:0/3695963620 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fce240579a0 con 0x7fce381548a0 2023-12-19T13:54:32.064 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fce1c06a430 msgr2=0x7fce1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fce1c06a430 0x7fce1c06c8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007fd0 tx=0x7fce2c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce381548a0 msgr2=0x7fce38155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce381548a0 0x7fce38155260 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fce2400d5c0 tx=0x7fce2400da80 comp rx=0 tx=0).stop 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 shutdown_connections 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fce1c06a430 0x7fce1c06c8f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce3815e650 0x7fce380ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce381548a0 0x7fce38155260 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 --2- 172.21.15.113:0/3695963620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce380cb9e0 0x7fce3806f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 >> 172.21.15.113:0/3695963620 conn(0x7fce380659d0 msgr2=0x7fce3815c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.067+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 shutdown_connections 2023-12-19T13:54:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.068+0000 7fce3f0c7640 1 -- 172.21.15.113:0/3695963620 wait complete. 2023-12-19T13:54:32.086 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:32.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.298+0000 7f271ac80640 1 Processor -- start 2023-12-19T13:54:32.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.299+0000 7f271ac80640 1 -- start start 2023-12-19T13:54:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.300+0000 7f271ac80640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f271415e5a0 0x7f27140b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.300+0000 7f271ac80640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271415ec30 con 0x7f271415f680 2023-12-19T13:54:32.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.300+0000 7f271ac80640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271415e980 con 0x7f27140cdbf0 2023-12-19T13:54:32.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.300+0000 7f271ac80640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140b2f90 con 0x7f271415e5a0 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f271947d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f271415f680 0x7f27140b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38698/0 (socket says 172.21.15.113:38698) 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f271947d640 1 -- 172.21.15.113:0/3754307446 learned_addr learned my addr 172.21.15.113:0/3754307446 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2719c7e640 1 --2- 172.21.15.113:0/3754307446 >> v2:172.21.15.151:3300/0 conn(0x7f271415e5a0 0x7f27140b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580837136 0 0) 0x7f271415ec30 con 0x7f271415f680 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2700003520 con 0x7f271415f680 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789884579 0 0) 0x7f2700003520 con 0x7f271415f680 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 >> v2:172.21.15.151:3300/0 conn(0x7f271415e5a0 msgr2=0x7f27140b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 --2- 172.21.15.113:0/3754307446 >> v2:172.21.15.151:3300/0 conn(0x7f271415e5a0 0x7f27140b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 >> v1:172.21.15.151:6789/0 conn(0x7f27140cdbf0 legacy=0x7f271406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140b3270 con 0x7f271415f680 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f2704001670 con 0x7f271415f680 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.301+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 >> v1:172.21.15.113:6789/0 conn(0x7f271415f680 legacy=0x7f27140b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f2718c7c640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700003970 0x7f2700003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f2718c7c640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27000047c0 0x7f2700004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f2718c7c640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2700005180 0x7f270000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140b2f90 con 0x7f2700005180 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270000c020 con 0x7f2700003970 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270000c1e0 con 0x7f27000047c0 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f271a47f640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2700005180 0x7f270000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f2719c7e640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700003970 0x7f2700003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f271947d640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27000047c0 0x7f2700004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f271a47f640 1 -- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27000047c0 msgr2=0x7f2700004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f271a47f640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27000047c0 0x7f2700004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f271a47f640 1 -- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700003970 msgr2=0x7f2700003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f271a47f640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700003970 0x7f2700003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.302+0000 7f271a47f640 1 -- 172.21.15.113:0/3754307446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700003520 con 0x7f2700005180 2023-12-19T13:54:32.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.303+0000 7f271a47f640 1 -- 172.21.15.113:0/3754307446 reap_dead start 2023-12-19T13:54:32.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.303+0000 7f271a47f640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2700005180 0x7f270000b980 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f270c001e50 tx=0x7f27000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da9c35492076610 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c003b70 con 0x7f2700005180 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c003d10 con 0x7f2700005180 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f2718c7c640 1 -- 172.21.15.113:0/3754307446 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c005310 con 0x7f2700005180 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f271ac80640 1 -- 172.21.15.113:0/3754307446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2700005180 msgr2=0x7f270000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f271ac80640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2700005180 0x7f270000b980 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f270c001e50 tx=0x7f27000057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f271ac80640 1 -- 172.21.15.113:0/3754307446 shutdown_connections 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f271ac80640 1 --2- 172.21.15.113:0/3754307446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2700005180 0x7f270000b980 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f271ac80640 1 -- 172.21.15.113:0/3754307446 >> 172.21.15.113:0/3754307446 conn(0x7f27140b0100 msgr2=0x7f27140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f271ac80640 1 -- 172.21.15.113:0/3754307446 shutdown_connections 2023-12-19T13:54:32.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.304+0000 7f271ac80640 1 -- 172.21.15.113:0/3754307446 wait complete. 2023-12-19T13:54:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.306+0000 7f271ac80640 1 Processor -- start 2023-12-19T13:54:32.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.306+0000 7f271ac80640 1 -- start start 2023-12-19T13:54:32.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271ac80640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700005180 0x7f271415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271ac80640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27140adc60 0x7f2714155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271ac80640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27140aa160 0x7f27140aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271ac80640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140aab50 con 0x7f27140adc60 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271ac80640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714155ac0 con 0x7f2700005180 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271ac80640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140ad2f0 con 0x7f27140aa160 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271947d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27140adc60 0x7f2714155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.307+0000 7f271947d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27140adc60 0x7f2714155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55908/0 (socket says 172.21.15.113:55908) 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271947d640 1 -- 172.21.15.113:0/17501630 learned_addr learned my addr 172.21.15.113:0/17501630 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f2719c7e640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700005180 0x7f271415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271a47f640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27140aa160 0x7f27140aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271947d640 1 -- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27140aa160 msgr2=0x7f27140aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271947d640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27140aa160 0x7f27140aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271947d640 1 -- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700005180 msgr2=0x7f271415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271947d640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700005180 0x7f271415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271947d640 1 -- 172.21.15.113:0/17501630 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140ad5d0 con 0x7f27140adc60 2023-12-19T13:54:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271a47f640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27140aa160 0x7f27140aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271947d640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27140adc60 0x7f2714155580 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f2704001200 tx=0x7f270400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f270a7fc640 1 -- 172.21.15.113:0/17501630 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040074e0 con 0x7f27140adc60 2023-12-19T13:54:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f270a7fc640 1 -- 172.21.15.113:0/17501630 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704007640 con 0x7f27140adc60 2023-12-19T13:54:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f270a7fc640 1 -- 172.21.15.113:0/17501630 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040049e0 con 0x7f27140adc60 2023-12-19T13:54:32.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.308+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27140ad8b0 con 0x7f27140adc60 2023-12-19T13:54:32.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.309+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271415b2e0 con 0x7f27140adc60 2023-12-19T13:54:32.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.310+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271415b4d0 con 0x7f27140adc60 2023-12-19T13:54:32.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.311+0000 7f270a7fc640 1 -- 172.21.15.113:0/17501630 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2704004b40 con 0x7f27140adc60 2023-12-19T13:54:32.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.311+0000 7f270a7fc640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26f806a460 0x7f26f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:32.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.312+0000 7f270a7fc640 1 -- 172.21.15.113:0/17501630 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27040881d0 con 0x7f27140adc60 2023-12-19T13:54:32.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.312+0000 7f2719c7e640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26f806a460 0x7f26f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:32.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.313+0000 7f2719c7e640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26f806a460 0x7f26f806c920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2710009990 tx=0x7f2710008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:32.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.316+0000 7f270a7fc640 1 -- 172.21.15.113:0/17501630 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2704053850 con 0x7f27140adc60 2023-12-19T13:54:32.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.545+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2714061910 con 0x7f27140adc60 2023-12-19T13:54:32.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.546+0000 7f270a7fc640 1 -- 172.21.15.113:0/17501630 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f2704056e70 con 0x7f27140adc60 2023-12-19T13:54:32.546 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:32.546 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:54:32.546 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26f806a460 msgr2=0x7f26f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26f806a460 0x7f26f806c920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2710009990 tx=0x7f2710008040 comp rx=0 tx=0).stop 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27140adc60 msgr2=0x7f2714155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27140adc60 0x7f2714155580 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f2704001200 tx=0x7f270400dc70 comp rx=0 tx=0).stop 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 shutdown_connections 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26f806a460 0x7f26f806c920 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27140aa160 0x7f27140aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27140adc60 0x7f2714155580 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 --2- 172.21.15.113:0/17501630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700005180 0x7f271415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 >> 172.21.15.113:0/17501630 conn(0x7f27140b0100 msgr2=0x7f27140b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:32.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 shutdown_connections 2023-12-19T13:54:32.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:32.549+0000 7f271ac80640 1 -- 172.21.15.113:0/17501630 wait complete. 2023-12-19T13:54:32.971 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:54:26.084550+0000', 'modified': '2023-12-19T13:54:29.585964+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7806}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7806': {'gid': 7806, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.113:6837/4021670999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6835', 'nonce': 4021670999}, {'type': 'v1', 'addr': '172.21.15.113:6837', 'nonce': 4021670999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:54:32.971 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:54:32.972 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T13:54:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.198+0000 7fe99e638640 1 Processor -- start 2023-12-19T13:54:33.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.199+0000 7fe99e638640 1 -- start start 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.200+0000 7fe99e638640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe9981449e0 0x7fe9980af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.200+0000 7fe99e638640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe9980b0b50 0x7fe99806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.200+0000 7fe99e638640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980afb10 con 0x7fe99806b590 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.200+0000 7fe99e638640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99806bb30 con 0x7fe9981449e0 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.200+0000 7fe99e638640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980b0070 con 0x7fe9980b0b50 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.200+0000 7fe997fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe9981449e0 0x7fe9980af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.200+0000 7fe99cbd5640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe99806b590 0x7fe99815eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38710/0 (socket says 172.21.15.113:38710) 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.201+0000 7fe99cbd5640 1 -- 172.21.15.113:0/1751604124 learned_addr learned my addr 172.21.15.113:0/1751604124 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:33.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.201+0000 7fe997fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe9981449e0 0x7fe9980af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55924/0 (socket says 172.21.15.113:55924) 2023-12-19T13:54:33.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.201+0000 7fe997fff640 1 -- 172.21.15.113:0/1751604124 >> v2:172.21.15.151:3300/0 conn(0x7fe9980b0b50 msgr2=0x7fe99806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.201+0000 7fe997fff640 1 --2- 172.21.15.113:0/1751604124 >> v2:172.21.15.151:3300/0 conn(0x7fe9980b0b50 0x7fe99806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.201+0000 7fe997fff640 1 -- 172.21.15.113:0/1751604124 >> v1:172.21.15.113:6789/0 conn(0x7fe99806b590 legacy=0x7fe99815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.201+0000 7fe9977fe640 1 -- 172.21.15.113:0/1751604124 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101185596 0 0) 0x7fe9980afb10 con 0x7fe99806b590 2023-12-19T13:54:33.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.201+0000 7fe997fff640 1 -- 172.21.15.113:0/1751604124 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980b0350 con 0x7fe9981449e0 2023-12-19T13:54:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.202+0000 7fe997fff640 1 --2- 172.21.15.113:0/1751604124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9981449e0 0x7fe9980af5d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fe998071c80 tx=0x7fe98802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c258198942c961 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.202+0000 7fe9977fe640 1 -- 172.21.15.113:0/1751604124 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988031830 con 0x7fe9981449e0 2023-12-19T13:54:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.202+0000 7fe9977fe640 1 -- 172.21.15.113:0/1751604124 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988031990 con 0x7fe9981449e0 2023-12-19T13:54:33.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.202+0000 7fe9977fe640 1 -- 172.21.15.113:0/1751604124 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988031d20 con 0x7fe9981449e0 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 -- 172.21.15.113:0/1751604124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9981449e0 msgr2=0x7fe9980af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 --2- 172.21.15.113:0/1751604124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9981449e0 0x7fe9980af5d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fe998071c80 tx=0x7fe98802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 -- 172.21.15.113:0/1751604124 shutdown_connections 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 --2- 172.21.15.113:0/1751604124 >> v2:172.21.15.151:3300/0 conn(0x7fe9980b0b50 0x7fe99806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 --2- 172.21.15.113:0/1751604124 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9981449e0 0x7fe9980af5d0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 -- 172.21.15.113:0/1751604124 >> 172.21.15.113:0/1751604124 conn(0x7fe9980cbb70 msgr2=0x7fe9980cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 -- 172.21.15.113:0/1751604124 shutdown_connections 2023-12-19T13:54:33.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.203+0000 7fe99e638640 1 -- 172.21.15.113:0/1751604124 wait complete. 2023-12-19T13:54:33.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.205+0000 7fe99e638640 1 Processor -- start 2023-12-19T13:54:33.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.205+0000 7fe99e638640 1 -- start start 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe99e638640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99806b590 0x7fe99813ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe99e638640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9980b0b50 0x7fe9981430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe99e638640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9981449e0 0x7fe99806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe99e638640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998142e00 con 0x7fe99806b590 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe99e638640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981421f0 con 0x7fe9980b0b50 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe99e638640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981424d0 con 0x7fe9981449e0 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99806b590 0x7fe99813ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99806b590 0x7fe99813ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55936/0 (socket says 172.21.15.113:55936) 2023-12-19T13:54:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.206+0000 7fe997fff640 1 -- 172.21.15.113:0/394990279 learned_addr learned my addr 172.21.15.113:0/394990279 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe997fff640 1 -- 172.21.15.113:0/394990279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9981449e0 msgr2=0x7fe99806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe997fff640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9981449e0 0x7fe99806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe997fff640 1 -- 172.21.15.113:0/394990279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9980b0b50 msgr2=0x7fe9981430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe997fff640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9980b0b50 0x7fe9981430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe997fff640 1 -- 172.21.15.113:0/394990279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009400 con 0x7fe99806b590 2023-12-19T13:54:33.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe997fff640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99806b590 0x7fe99813ac20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe988000c00 tx=0x7fe9880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe9957fa640 1 -- 172.21.15.113:0/394990279 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98803aa60 con 0x7fe99806b590 2023-12-19T13:54:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe9957fa640 1 -- 172.21.15.113:0/394990279 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98803abe0 con 0x7fe99806b590 2023-12-19T13:54:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe9957fa640 1 -- 172.21.15.113:0/394990279 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880443f0 con 0x7fe99806b590 2023-12-19T13:54:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.207+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9981427b0 con 0x7fe99806b590 2023-12-19T13:54:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.208+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9980cb2e0 con 0x7fe99806b590 2023-12-19T13:54:33.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.210+0000 7fe9957fa640 1 -- 172.21.15.113:0/394990279 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe98804d450 con 0x7fe99806b590 2023-12-19T13:54:33.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.210+0000 7fe9957fa640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe97806a460 0x7fe97806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.211+0000 7fe9957fa640 1 -- 172.21.15.113:0/394990279 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9880aab30 con 0x7fe99806b590 2023-12-19T13:54:33.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.211+0000 7fe98ffff640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe97806a460 0x7fe97806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.211+0000 7fe9a11a4740 1 Processor -- start 2023-12-19T13:54:33.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.211+0000 7fe98ffff640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe97806a460 0x7fe97806c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe99815a450 tx=0x7fe980006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.212+0000 7fe9a11a4740 1 -- start start 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.212+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025bed30 0x55eb025bf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.212+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb0258ecb0 0x55eb025bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025928b0 0x55eb025bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb024fef80 con 0x55eb025bed30 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb024fc710 con 0x55eb025928b0 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb024f8000 con 0x55eb0258ecb0 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025bed30 0x55eb025bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025bed30 0x55eb025bf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55952/0 (socket says 172.21.15.113:55952) 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 -- 172.21.15.113:0/3574457437 learned_addr learned my addr 172.21.15.113:0/3574457437 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:33.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 -- 172.21.15.113:0/3574457437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb0258ecb0 msgr2=0x55eb025bbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 --2- 172.21.15.113:0/3574457437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb0258ecb0 0x55eb025bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 -- 172.21.15.113:0/3574457437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025928b0 msgr2=0x55eb025bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 --2- 172.21.15.113:0/3574457437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025928b0 0x55eb025bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 -- 172.21.15.113:0/3574457437 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb024bf690 con 0x55eb025bed30 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.213+0000 7fe997fff640 1 --2- 172.21.15.113:0/3574457437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025bed30 0x55eb025bf110 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe988079e00 tx=0x7fe988079d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89458c51c4ea9c68 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe98dffb640 1 -- 172.21.15.113:0/3574457437 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988081e50 con 0x55eb025bed30 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe98dffb640 1 -- 172.21.15.113:0/3574457437 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988078210 con 0x55eb025bed30 2023-12-19T13:54:33.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe98dffb640 1 -- 172.21.15.113:0/3574457437 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988079360 con 0x55eb025bed30 2023-12-19T13:54:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 -- 172.21.15.113:0/3574457437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025bed30 msgr2=0x55eb025bf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/3574457437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025bed30 0x55eb025bf110 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe988079e00 tx=0x7fe988079d70 comp rx=0 tx=0).stop 2023-12-19T13:54:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 -- 172.21.15.113:0/3574457437 shutdown_connections 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/3574457437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025928b0 0x55eb025bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/3574457437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb0258ecb0 0x55eb025bbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/3574457437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025bed30 0x55eb025bf110 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 -- 172.21.15.113:0/3574457437 >> 172.21.15.113:0/3574457437 conn(0x55eb02590fc0 msgr2=0x55eb025d9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 -- 172.21.15.113:0/3574457437 shutdown_connections 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.214+0000 7fe9a11a4740 1 -- 172.21.15.113:0/3574457437 wait complete. 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.215+0000 7fe9a11a4740 1 -- start start 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.215+0000 7fe9a11a4740 1 Processor -- start 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.216+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.216+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.216+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025e9e30 0x55eb025dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.216+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb024997d0 con 0x55eb025928b0 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.216+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb02499470 con 0x55eb025bed30 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.216+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb0225ff20 con 0x55eb025e9e30 2023-12-19T13:54:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe9a11a4740 10 client.0 _ll_register_callbacks cb 0x55eb024e81b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025c1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55966/0 (socket says 172.21.15.113:55966) 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 -- 172.21.15.113:0/669961439 learned_addr learned my addr 172.21.15.113:0/669961439 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 -- 172.21.15.113:0/669961439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025e9e30 msgr2=0x55eb025dc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025e9e30 0x55eb025dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 -- 172.21.15.113:0/669961439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 msgr2=0x55eb025b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 -- 172.21.15.113:0/669961439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9980cb2e0 con 0x55eb025928b0 2023-12-19T13:54:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe997fff640 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025c1560 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fe9880aae10 tx=0x7fe98803af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe294f921bd387a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe976ffd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:54:33.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe976ffd640 1 -- 172.21.15.113:0/669961439 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988079560 con 0x55eb025928b0 2023-12-19T13:54:33.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.217+0000 7fe976ffd640 1 -- 172.21.15.113:0/669961439 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe988099e60 con 0x55eb025928b0 2023-12-19T13:54:33.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb02522550 con 0x55eb025928b0 2023-12-19T13:54:33.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe976ffd640 1 -- 172.21.15.113:0/669961439 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9880819c0 con 0x55eb025928b0 2023-12-19T13:54:33.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 10 client.7950 fetch_fsmap learned FSMap version 65 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55eb024f6680 con 0x55eb025928b0 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe976ffd640 1 -- 172.21.15.113:0/669961439 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988084020 con 0x55eb025928b0 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe976ffd640 1 -- 172.21.15.113:0/669961439 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 65) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe988075c60 con 0x55eb025928b0 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 10 client.7950 fetch_fsmap finished waiting for FSMap version 65 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 10 client.7950 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 20 client.7950 populate_metadata read hostname 'smithi113' 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025c04a0 0x55eb025b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 4 client.7950 mds_command: new command op to 7806 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 --> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb024eab50 con 0x55eb025c04a0 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.218+0000 7fe98ffff640 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025c04a0 0x55eb025b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.219+0000 7fe976ffd640 10 client.7950 ms_handle_connect on v2:172.21.15.113:6835/4021670999 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.219+0000 7fe98ffff640 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025c04a0 0x55eb025b7f80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd89dc8275b3e88b server_cookie=45f7418fc006b058 in_seq=0 out_seq=0 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe976ffd640 1 -- 172.21.15.113:0/669961439 <== mds.0 v2:172.21.15.113:6835/4021670999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55eb024eab50 con 0x55eb025c04a0 2023-12-19T13:54:33.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe976ffd640 10 client.7950 handle_command_reply: tid=0 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 client.7950 shutdown 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 msgr2=0x55eb025c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025c1560 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fe9880aae10 tx=0x7fe98803af90 comp rx=0 tx=0).stop 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 shutdown_connections 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025c04a0 0x55eb025b7f80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025e9e30 0x55eb025dc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/669961439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025c1560 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe976ffd640 0 client.7950 ms_handle_reset on v2:172.21.15.113:6835/4021670999 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 >> 172.21.15.113:0/669961439 conn(0x55eb0258ecb0 msgr2=0x55eb025c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 shutdown_connections 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 1 -- 172.21.15.113:0/669961439 wait complete. 2023-12-19T13:54:33.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.220+0000 7fe9a11a4740 20 client.7950 trim_cache size 0 max 16384 2023-12-19T13:54:33.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.237+0000 7fe9a11a4740 1 Processor -- start 2023-12-19T13:54:33.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.237+0000 7fe9a11a4740 1 -- start start 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025bed30 0x55eb025dd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025e9e30 0x55eb025e9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb0258f0b0 con 0x55eb025928b0 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb025b95c0 con 0x55eb025e9e30 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb025b9220 con 0x55eb025bed30 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55982/0 (socket says 172.21.15.113:55982) 2023-12-19T13:54:33.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 -- 172.21.15.113:0/2616145711 learned_addr learned my addr 172.21.15.113:0/2616145711 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 -- 172.21.15.113:0/2616145711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025bed30 msgr2=0x55eb025dd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 --2- 172.21.15.113:0/2616145711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025bed30 0x55eb025dd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 -- 172.21.15.113:0/2616145711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025e9e30 msgr2=0x55eb025e9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 --2- 172.21.15.113:0/2616145711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025e9e30 0x55eb025e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.238+0000 7fe997fff640 1 -- 172.21.15.113:0/2616145711 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb024989e0 con 0x55eb025928b0 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe997fff640 1 --2- 172.21.15.113:0/2616145711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025b4740 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fe988081920 tx=0x7fe988090000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b749ca67bdfcfa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe98e7fc640 1 -- 172.21.15.113:0/2616145711 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98807ae80 con 0x55eb025928b0 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe98e7fc640 1 -- 172.21.15.113:0/2616145711 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988084070 con 0x55eb025928b0 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe98e7fc640 1 -- 172.21.15.113:0/2616145711 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988079560 con 0x55eb025928b0 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 -- 172.21.15.113:0/2616145711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 msgr2=0x55eb025b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/2616145711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025b4740 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fe988081920 tx=0x7fe988090000 comp rx=0 tx=0).stop 2023-12-19T13:54:33.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 -- 172.21.15.113:0/2616145711 shutdown_connections 2023-12-19T13:54:33.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/2616145711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025e9e30 0x55eb025e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/2616145711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025bed30 0x55eb025dd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/2616145711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025928b0 0x55eb025b4740 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 -- 172.21.15.113:0/2616145711 >> 172.21.15.113:0/2616145711 conn(0x55eb0258ecb0 msgr2=0x55eb025bba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 -- 172.21.15.113:0/2616145711 shutdown_connections 2023-12-19T13:54:33.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.239+0000 7fe9a11a4740 1 -- 172.21.15.113:0/2616145711 wait complete. 2023-12-19T13:54:33.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.240+0000 7fe9a11a4740 1 -- start start 2023-12-19T13:54:33.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.240+0000 7fe9a11a4740 1 Processor -- start 2023-12-19T13:54:33.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.241+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025928b0 0x55eb025b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.241+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025ba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.241+0000 7fe9a11a4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025e9e30 0x55eb02630520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.241+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb025b2b90 con 0x55eb025e9e30 2023-12-19T13:54:33.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.241+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb025e9a20 con 0x55eb025bed30 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.241+0000 7fe9a11a4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb025f26e0 con 0x55eb025928b0 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.241+0000 7fe9a11a4740 10 client.0 _ll_register_callbacks cb 0x7fe988009110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025e9e30 0x55eb02630520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025e9e30 0x55eb02630520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55984/0 (socket says 172.21.15.113:55984) 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 -- 172.21.15.113:0/4124375108 learned_addr learned my addr 172.21.15.113:0/4124375108 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe997fff640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025928b0 0x55eb025b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe98ffff640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025ba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 -- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025928b0 msgr2=0x55eb025b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025928b0 0x55eb025b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 -- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 msgr2=0x55eb025ba510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025ba510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 -- 172.21.15.113:0/4124375108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb024f6680 con 0x55eb025e9e30 2023-12-19T13:54:33.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe98ffff640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025ba510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe99cbd5640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025e9e30 0x55eb02630520 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fe9900012e0 tx=0x7fe99000c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d91e7a975f4b2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.242+0000 7fe976ffd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe976ffd640 1 -- 172.21.15.113:0/4124375108 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990004d60 con 0x55eb025e9e30 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe976ffd640 1 -- 172.21.15.113:0/4124375108 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe990015ad0 con 0x55eb025e9e30 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe988078210 con 0x55eb025e9e30 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe976ffd640 1 -- 172.21.15.113:0/4124375108 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe990015cd0 con 0x55eb025e9e30 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 10 client.7956 fetch_fsmap learned FSMap version 65 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55eb024bdef0 con 0x55eb025e9e30 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe976ffd640 1 -- 172.21.15.113:0/4124375108 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988078210 con 0x55eb025e9e30 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe976ffd640 1 -- 172.21.15.113:0/4124375108 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 65) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe990015050 con 0x55eb025e9e30 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 10 client.7956 fetch_fsmap finished waiting for FSMap version 65 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 10 client.7956 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 20 client.7956 populate_metadata read hostname 'smithi113' 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025b84d0 0x55eb025b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 4 client.7956 mds_command: new command op to 7806 tid=0[{"prefix": "status"}] 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 --> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eb024f1080 con 0x55eb025b84d0 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.243+0000 7fe997fff640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025b84d0 0x55eb025b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe976ffd640 10 client.7956 ms_handle_connect on v2:172.21.15.113:6835/4021670999 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe997fff640 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025b84d0 0x55eb025b88b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a7c3158755ce4f server_cookie=5284ad7abf2171cc in_seq=0 out_seq=0 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe976ffd640 1 -- 172.21.15.113:0/4124375108 <== mds.0 v2:172.21.15.113:6835/4021670999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55eb024f1080 con 0x55eb025b84d0 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe976ffd640 10 client.7956 handle_command_reply: tid=0 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 client.7956 shutdown 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025e9e30 msgr2=0x55eb02630520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025e9e30 0x55eb02630520 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fe9900012e0 tx=0x7fe99000c5e0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 shutdown_connections 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:6835/4021670999,v1:172.21.15.113:6837/4021670999] conn(0x55eb025b84d0 0x55eb025b88b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55eb025e9e30 0x55eb02630520 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb025bed30 0x55eb025ba510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe976ffd640 0 client.7956 ms_handle_reset on v2:172.21.15.113:6835/4021670999 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 --2- 172.21.15.113:0/4124375108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eb025928b0 0x55eb025b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.244+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 >> 172.21.15.113:0/4124375108 conn(0x55eb0258ecb0 msgr2=0x55eb0258ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 shutdown_connections 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe9a11a4740 1 -- 172.21.15.113:0/4124375108 wait complete. 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe9a11a4740 20 client.7956 trim_cache size 0 max 16384 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:54:33.249 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 7806, 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 7.1548885359999996, 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 65, 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 147, 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 147, 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 12.85567743 2023-12-19T13:54:33.250 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe97806a460 msgr2=0x7fe97806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe97806a460 0x7fe97806c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe99815a450 tx=0x7fe980006c90 comp rx=0 tx=0).stop 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99806b590 msgr2=0x7fe99813ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99806b590 0x7fe99813ac20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe988000c00 tx=0x7fe9880046c0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 shutdown_connections 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe97806a460 0x7fe97806c920 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9981449e0 0x7fe99806f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9980b0b50 0x7fe9981430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 --2- 172.21.15.113:0/394990279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99806b590 0x7fe99813ac20 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.245+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 >> 172.21.15.113:0/394990279 conn(0x7fe9980cbb70 msgr2=0x7fe9980cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.246+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 shutdown_connections 2023-12-19T13:54:33.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.246+0000 7fe99e638640 1 -- 172.21.15.113:0/394990279 wait complete. 2023-12-19T13:54:33.261 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:54:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.465+0000 7f7a2a6b2640 1 Processor -- start 2023-12-19T13:54:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.466+0000 7f7a2a6b2640 1 -- start start 2023-12-19T13:54:33.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a2a6b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a24147180 0x7f7a241611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a2a6b2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a24161730 0x7f7a240d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a2a6b2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a240d1070 con 0x7f7a24146da0 2023-12-19T13:54:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a2a6b2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a24161ba0 con 0x7f7a24147180 2023-12-19T13:54:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a2a6b2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a24162020 con 0x7f7a24161730 2023-12-19T13:54:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a237fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a24147180 0x7f7a241611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a23fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7a24146da0 0x7f7a240aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38720/0 (socket says 172.21.15.113:38720) 2023-12-19T13:54:33.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.467+0000 7f7a23fff640 1 -- 172.21.15.113:0/3867900048 learned_addr learned my addr 172.21.15.113:0/3867900048 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.468+0000 7f7a28c4f640 1 --2- 172.21.15.113:0/3867900048 >> v2:172.21.15.151:3300/0 conn(0x7f7a24161730 0x7f7a240d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.468+0000 7f7a237fe640 1 -- 172.21.15.113:0/3867900048 >> v2:172.21.15.151:3300/0 conn(0x7f7a24161730 msgr2=0x7f7a240d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.468+0000 7f7a237fe640 1 --2- 172.21.15.113:0/3867900048 >> v2:172.21.15.151:3300/0 conn(0x7f7a24161730 0x7f7a240d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.468+0000 7f7a237fe640 1 -- 172.21.15.113:0/3867900048 >> v1:172.21.15.113:6789/0 conn(0x7f7a24146da0 legacy=0x7f7a240aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.468+0000 7f7a237fe640 1 -- 172.21.15.113:0/3867900048 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240aabd0 con 0x7f7a24147180 2023-12-19T13:54:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.468+0000 7f7a22ffd640 1 -- 172.21.15.113:0/3867900048 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951585847 0 0) 0x7f7a240d1070 con 0x7f7a24146da0 2023-12-19T13:54:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.469+0000 7f7a237fe640 1 --2- 172.21.15.113:0/3867900048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a24147180 0x7f7a241611f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ada40 tx=0x7f7a0c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ad8fb4c8b7a0dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.469+0000 7f7a22ffd640 1 -- 172.21.15.113:0/3867900048 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c02cc80 con 0x7f7a24147180 2023-12-19T13:54:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.469+0000 7f7a22ffd640 1 -- 172.21.15.113:0/3867900048 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c02cde0 con 0x7f7a24147180 2023-12-19T13:54:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.469+0000 7f7a22ffd640 1 -- 172.21.15.113:0/3867900048 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c034660 con 0x7f7a24147180 2023-12-19T13:54:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/3867900048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a24147180 msgr2=0x7f7a241611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/3867900048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a24147180 0x7f7a241611f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ada40 tx=0x7f7a0c02bed0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/3867900048 shutdown_connections 2023-12-19T13:54:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/3867900048 >> v2:172.21.15.151:3300/0 conn(0x7f7a24161730 0x7f7a240d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/3867900048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a24147180 0x7f7a241611f0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/3867900048 >> 172.21.15.113:0/3867900048 conn(0x7f7a24071a50 msgr2=0x7f7a240d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/3867900048 shutdown_connections 2023-12-19T13:54:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.470+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/3867900048 wait complete. 2023-12-19T13:54:33.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.472+0000 7f7a2a6b2640 1 Processor -- start 2023-12-19T13:54:33.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.472+0000 7f7a2a6b2640 1 -- start start 2023-12-19T13:54:33.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a2a6b2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a24146da0 0x7f7a240d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a2a6b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a24161730 0x7f7a24134300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a2a6b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a240c2b90 0x7f7a240c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a2a6b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24137700 con 0x7f7a240c2b90 2023-12-19T13:54:33.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a2a6b2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24134840 con 0x7f7a24146da0 2023-12-19T13:54:33.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a2a6b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240c3090 con 0x7f7a24161730 2023-12-19T13:54:33.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a28c4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a240c2b90 0x7f7a240c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a28c4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a240c2b90 0x7f7a240c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55998/0 (socket says 172.21.15.113:55998) 2023-12-19T13:54:33.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.473+0000 7f7a28c4f640 1 -- 172.21.15.113:0/4074934684 learned_addr learned my addr 172.21.15.113:0/4074934684 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:33.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a237fe640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a24161730 0x7f7a24134300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a28c4f640 1 -- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a24161730 msgr2=0x7f7a24134300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a28c4f640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a24161730 0x7f7a24134300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a23fff640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a24146da0 0x7f7a240d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a28c4f640 1 -- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a24146da0 msgr2=0x7f7a240d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a28c4f640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a24146da0 0x7f7a240d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a28c4f640 1 -- 172.21.15.113:0/4074934684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c009a70 con 0x7f7a240c2b90 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a28c4f640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a240c2b90 0x7f7a240c3f90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00c550 tx=0x7f7a1c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a20ff9640 1 -- 172.21.15.113:0/4074934684 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c004220 con 0x7f7a240c2b90 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a20ff9640 1 -- 172.21.15.113:0/4074934684 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c004380 con 0x7f7a240c2b90 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a240c3370 con 0x7f7a240c2b90 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a20ff9640 1 -- 172.21.15.113:0/4074934684 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c003830 con 0x7f7a240c2b90 2023-12-19T13:54:33.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.474+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a240c3930 con 0x7f7a240c2b90 2023-12-19T13:54:33.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.476+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a24073ec0 con 0x7f7a240c2b90 2023-12-19T13:54:33.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.477+0000 7f7a20ff9640 1 -- 172.21.15.113:0/4074934684 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a1c003990 con 0x7f7a240c2b90 2023-12-19T13:54:33.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.478+0000 7f7a20ff9640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a0806a430 0x7f7a0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:33.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.478+0000 7f7a20ff9640 1 -- 172.21.15.113:0/4074934684 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a1c088590 con 0x7f7a240c2b90 2023-12-19T13:54:33.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.478+0000 7f7a23fff640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a0806a430 0x7f7a0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:33.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.479+0000 7f7a23fff640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a0806a430 0x7f7a0806c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7a14007fd0 tx=0x7f7a14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:33.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.482+0000 7f7a20ff9640 1 -- 172.21.15.113:0/4074934684 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7a1c053c10 con 0x7f7a240c2b90 2023-12-19T13:54:33.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.715+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7a24061910 con 0x7f7a240c2b90 2023-12-19T13:54:33.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.716+0000 7f7a20ff9640 1 -- 172.21.15.113:0/4074934684 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7a1c057230 con 0x7f7a240c2b90 2023-12-19T13:54:33.715 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.718+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a0806a430 msgr2=0x7f7a0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.718+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a0806a430 0x7f7a0806c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7a14007fd0 tx=0x7f7a14009040 comp rx=0 tx=0).stop 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.718+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a240c2b90 msgr2=0x7f7a240c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.718+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a240c2b90 0x7f7a240c3f90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00c550 tx=0x7f7a1c00ca10 comp rx=0 tx=0).stop 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 shutdown_connections 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a0806a430 0x7f7a0806c8f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a240c2b90 0x7f7a240c3f90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a24161730 0x7f7a24134300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 --2- 172.21.15.113:0/4074934684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a24146da0 0x7f7a240d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:33.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 >> 172.21.15.113:0/4074934684 conn(0x7f7a24071a50 msgr2=0x7f7a24142f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:33.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 shutdown_connections 2023-12-19T13:54:33.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:33.719+0000 7f7a2a6b2640 1 -- 172.21.15.113:0/4074934684 wait complete. 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:54:33.736 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:54:33.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:54:33.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:33.737 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:54:33.790 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:54:33.791 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 41946sec preferred_lft 41946sec 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:33.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:33.793 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:54:33.884 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:54:33.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:33.888 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:54:33.944 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:54:33.945 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:54:33.945 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:54:33.945 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:54:33.945 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:54:33.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:33.946 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:54:33.946 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:54:33.946 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:54:33.946 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:54:33.947 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:54:33.947 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:54:34.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:34.139 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:54:34.191 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:54:34.191 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:54:34.191 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:54:34.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:34.192 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:54:34.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:54:34.283 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:54:34.341 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:54:34.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:54:34.341 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:54:34.394 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:54:34.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:34.394 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:54:34.537 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:54:34.537 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:54:34.573 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:54:34.573 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:54:34.573 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:54:34.573 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:54:34.573 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:54:34.575 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:54:34.575 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:54:34.576 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:54:34.576 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:54:34.576 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:54:34.580 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:54:34.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:34.580 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:54:34.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:34.660 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:54:34.727 INFO:teuthology.orchestra.run.smithi113.stdout:client5884 2023-12-19T13:54:34.728 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:34.728 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:34.783 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:54:34.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.993+0000 7fa25e926640 1 Processor -- start 2023-12-19T13:54:34.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.994+0000 7fa25e926640 1 -- start start 2023-12-19T13:54:34.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.995+0000 7fa25e926640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2580b2030 0x7fa25815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:34.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.995+0000 7fa25e926640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25815ec30 con 0x7fa25815e5a0 2023-12-19T13:54:34.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.995+0000 7fa25e926640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25815fbc0 con 0x7fa2580cdbf0 2023-12-19T13:54:34.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.995+0000 7fa25e926640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25815e980 con 0x7fa2580b2030 2023-12-19T13:54:34.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.995+0000 7fa25d924640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa25815e5a0 0x7fa2580b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38734/0 (socket says 172.21.15.113:38734) 2023-12-19T13:54:34.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.995+0000 7fa25d924640 1 -- 172.21.15.113:0/1676108521 learned_addr learned my addr 172.21.15.113:0/1676108521 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:34.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718895753 0 0) 0x7fa25815ec30 con 0x7fa25815e5a0 2023-12-19T13:54:34.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa244003520 con 0x7fa25815e5a0 2023-12-19T13:54:34.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25d123640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2580b2030 0x7fa25815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:34.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2216578508 0 0) 0x7fa244003520 con 0x7fa25815e5a0 2023-12-19T13:54:34.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2580b2030 msgr2=0x7fa25815f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:34.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2580b2030 0x7fa25815f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:34.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 >> v1:172.21.15.151:6789/0 conn(0x7fa2580cdbf0 legacy=0x7fa25806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:34.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580b2f90 con 0x7fa25815e5a0 2023-12-19T13:54:34.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fa254001670 con 0x7fa25815e5a0 2023-12-19T13:54:34.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 >> v1:172.21.15.113:6789/0 conn(0x7fa25815e5a0 legacy=0x7fa2580b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:34.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2440039a0 0x7fa244003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:34.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa244004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.996+0000 7fa25c922640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2580b2030 0x7fa244005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25815e980 con 0x7fa2440047c0 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400bb40 con 0x7fa2440039a0 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400bd00 con 0x7fa2580b2030 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25d123640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa244004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25d924640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2440039a0 0x7fa244003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25d123640 1 -- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2580b2030 msgr2=0x7fa244005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25d123640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2580b2030 0x7fa244005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25d123640 1 -- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2440039a0 msgr2=0x7fa244003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:34.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25d123640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2440039a0 0x7fa244003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.997+0000 7fa25d123640 1 -- 172.21.15.113:0/1676108521 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244003520 con 0x7fa2440047c0 2023-12-19T13:54:35.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.998+0000 7fa25d123640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa244004c40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa24800ba10 tx=0x7fa2440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c1d71ac91dc14e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.998+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248032680 con 0x7fa2440047c0 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa248032800 con 0x7fa2440047c0 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25c922640 1 -- 172.21.15.113:0/1676108521 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248032bb0 con 0x7fa2440047c0 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25e926640 1 -- 172.21.15.113:0/1676108521 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 msgr2=0x7fa244004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25e926640 1 --2- 172.21.15.113:0/1676108521 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa244004c40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa24800ba10 tx=0x7fa2440057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25e125640 1 -- 172.21.15.113:0/1676108521 reap_dead start 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25e926640 1 -- 172.21.15.113:0/1676108521 shutdown_connections 2023-12-19T13:54:35.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25e926640 1 -- 172.21.15.113:0/1676108521 >> 172.21.15.113:0/1676108521 conn(0x7fa2580b0100 msgr2=0x7fa2580b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25e926640 1 -- 172.21.15.113:0/1676108521 shutdown_connections 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:34.999+0000 7fa25e926640 1 -- 172.21.15.113:0/1676108521 wait complete. 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.001+0000 7fa25e926640 1 Processor -- start 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.001+0000 7fa25e926640 1 -- start start 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25e926640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa258153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25e926640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa258155ce0 0x7fa258156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25e926640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa258156d40 0x7fa2581543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25e926640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258154240 con 0x7fa2440047c0 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25e926640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2581571c0 con 0x7fa258155ce0 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25e926640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25815bb90 con 0x7fa258156d40 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25d924640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa258153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25d924640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa258153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56006/0 (socket says 172.21.15.113:56006) 2023-12-19T13:54:35.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.002+0000 7fa25d924640 1 -- 172.21.15.113:0/474972774 learned_addr learned my addr 172.21.15.113:0/474972774 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:35.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25e125640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa258156d40 0x7fa2581543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:35.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25d924640 1 -- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa258156d40 msgr2=0x7fa2581543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:35.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25d123640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa258155ce0 0x7fa258156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:35.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25d924640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa258156d40 0x7fa2581543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25d924640 1 -- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa258155ce0 msgr2=0x7fa258156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:35.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25d924640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa258155ce0 0x7fa258156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25d924640 1 -- 172.21.15.113:0/474972774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25815be70 con 0x7fa2440047c0 2023-12-19T13:54:35.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25d924640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa258153d00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e830 tx=0x7fa25400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:35.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa24e7fc640 1 -- 172.21.15.113:0/474972774 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400eee0 con 0x7fa2440047c0 2023-12-19T13:54:35.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa24e7fc640 1 -- 172.21.15.113:0/474972774 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25400c870 con 0x7fa2440047c0 2023-12-19T13:54:35.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.003+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25815c150 con 0x7fa2440047c0 2023-12-19T13:54:35.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.004+0000 7fa24e7fc640 1 -- 172.21.15.113:0/474972774 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400cc20 con 0x7fa2440047c0 2023-12-19T13:54:35.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.004+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25815c710 con 0x7fa2440047c0 2023-12-19T13:54:35.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.005+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258061910 con 0x7fa2440047c0 2023-12-19T13:54:35.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.006+0000 7fa24e7fc640 1 -- 172.21.15.113:0/474972774 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa25401d460 con 0x7fa2440047c0 2023-12-19T13:54:35.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.006+0000 7fa24e7fc640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa23c06a430 0x7fa23c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:35.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.007+0000 7fa24e7fc640 1 -- 172.21.15.113:0/474972774 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa254088840 con 0x7fa2440047c0 2023-12-19T13:54:35.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.007+0000 7fa25d123640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa23c06a430 0x7fa23c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:35.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.007+0000 7fa25d123640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa23c06a430 0x7fa23c06c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa24800b9e0 tx=0x7fa24803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:35.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.011+0000 7fa24e7fc640 1 -- 172.21.15.113:0/474972774 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa254057950 con 0x7fa2440047c0 2023-12-19T13:54:35.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.236+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa258157460 con 0x7fa2440047c0 2023-12-19T13:54:35.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.237+0000 7fa24e7fc640 1 -- 172.21.15.113:0/474972774 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa254001560 con 0x7fa2440047c0 2023-12-19T13:54:35.237 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:54:35.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa23c06a430 msgr2=0x7fa23c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:35.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa23c06a430 0x7fa23c06c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa24800b9e0 tx=0x7fa24803d040 comp rx=0 tx=0).stop 2023-12-19T13:54:35.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 msgr2=0x7fa258153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:35.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa258153d00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e830 tx=0x7fa25400ecf0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 shutdown_connections 2023-12-19T13:54:35.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa23c06a430 0x7fa23c06c8f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa258156d40 0x7fa2581543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa258155ce0 0x7fa258156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 --2- 172.21.15.113:0/474972774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2440047c0 0x7fa258153d00 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:35.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 >> 172.21.15.113:0/474972774 conn(0x7fa2580b0100 msgr2=0x7fa25806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:35.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 shutdown_connections 2023-12-19T13:54:35.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:35.240+0000 7fa25e926640 1 -- 172.21.15.113:0/474972774 wait complete. 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:54:35.257 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:54:35.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:35.258 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:35.319 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41920sec preferred_lft 41920sec 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:54:35.320 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:54:35.321 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:54:35.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:35.322 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:54:35.417 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:54:35.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:35.419 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:54:35.472 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:54:35.472 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:54:35.472 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:54:35.472 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:54:35.472 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:54:35.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:35.472 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:54:35.472 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:54:35.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:54:35.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:54:35.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:54:35.473 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:54:35.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:35.656 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:54:35.705 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:54:35.705 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:54:35.705 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:54:35.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:35.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:54:35.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:54:35.802 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:54:35.856 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:54:35.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:54:35.857 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:54:35.907 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:54:35.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:35.907 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:54:36.041 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:54:36.041 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:54:36.072 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:54:36.072 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:54:36.072 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:54:36.072 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:54:36.072 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:54:36.074 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:54:36.074 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:54:36.074 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:54:36.074 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:54:36.074 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:54:36.079 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:54:36.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:36.079 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:54:36.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:36.161 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:54:36.219 INFO:teuthology.orchestra.run.smithi151.stdout:client5462 2023-12-19T13:54:36.220 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:54:36.220 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:36.269 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:36.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.492+0000 7fee32577640 1 Processor -- start 2023-12-19T13:54:36.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.492+0000 7fee32577640 1 -- start start 2023-12-19T13:54:36.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.493+0000 7fee32577640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fee2c1449e0 0x7fee2c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:36.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.493+0000 7fee32577640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fee2c0b0b50 0x7fee2c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:36.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.493+0000 7fee32577640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c0afb10 con 0x7fee2c06b590 2023-12-19T13:54:36.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.493+0000 7fee32577640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c06bb30 con 0x7fee2c0b0b50 2023-12-19T13:54:36.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.493+0000 7fee32577640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0b0070 con 0x7fee2c1449e0 2023-12-19T13:54:36.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fee2c0b0b50 0x7fee2c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:36.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fee2c0b0b50 0x7fee2c06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56018/0 (socket says 172.21.15.113:56018) 2023-12-19T13:54:36.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2b7fe640 1 -- 172.21.15.113:0/297168362 learned_addr learned my addr 172.21.15.113:0/297168362 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:36.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2bfff640 1 --2- 172.21.15.113:0/297168362 >> v2:172.21.15.151:3300/0 conn(0x7fee2c1449e0 0x7fee2c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:36.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2b7fe640 1 -- 172.21.15.113:0/297168362 >> v2:172.21.15.151:3300/0 conn(0x7fee2c1449e0 msgr2=0x7fee2c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:36.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2b7fe640 1 --2- 172.21.15.113:0/297168362 >> v2:172.21.15.151:3300/0 conn(0x7fee2c1449e0 0x7fee2c0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2b7fe640 1 -- 172.21.15.113:0/297168362 >> v1:172.21.15.151:6789/0 conn(0x7fee2c06b590 legacy=0x7fee2c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:36.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.494+0000 7fee2b7fe640 1 -- 172.21.15.113:0/297168362 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c0b0350 con 0x7fee2c0b0b50 2023-12-19T13:54:36.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.495+0000 7fee2b7fe640 1 --2- 172.21.15.113:0/297168362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c06bfa0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fee2c071cd0 tx=0x7fee2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580192113e348e6e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:36.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.496+0000 7fee2affd640 1 -- 172.21.15.113:0/297168362 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20031870 con 0x7fee2c0b0b50 2023-12-19T13:54:36.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.496+0000 7fee2affd640 1 -- 172.21.15.113:0/297168362 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee200319d0 con 0x7fee2c0b0b50 2023-12-19T13:54:36.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.496+0000 7fee2affd640 1 -- 172.21.15.113:0/297168362 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20031d60 con 0x7fee2c0b0b50 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.496+0000 7fee32577640 1 -- 172.21.15.113:0/297168362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 msgr2=0x7fee2c06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.496+0000 7fee32577640 1 --2- 172.21.15.113:0/297168362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c06bfa0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fee2c071cd0 tx=0x7fee2002b910 comp rx=0 tx=0).stop 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.497+0000 7fee32577640 1 -- 172.21.15.113:0/297168362 shutdown_connections 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.497+0000 7fee32577640 1 --2- 172.21.15.113:0/297168362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c06bfa0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.497+0000 7fee32577640 1 --2- 172.21.15.113:0/297168362 >> v2:172.21.15.151:3300/0 conn(0x7fee2c1449e0 0x7fee2c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.497+0000 7fee32577640 1 -- 172.21.15.113:0/297168362 >> 172.21.15.113:0/297168362 conn(0x7fee2c0cbb70 msgr2=0x7fee2c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.497+0000 7fee32577640 1 -- 172.21.15.113:0/297168362 shutdown_connections 2023-12-19T13:54:36.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.497+0000 7fee32577640 1 -- 172.21.15.113:0/297168362 wait complete. 2023-12-19T13:54:36.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.498+0000 7fee32577640 1 Processor -- start 2023-12-19T13:54:36.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.499+0000 7fee32577640 1 -- start start 2023-12-19T13:54:36.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee32577640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee2c06b590 0x7fee2c15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:36.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee32577640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:36.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee32577640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c1449e0 0x7fee2c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:36.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee32577640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c13f3f0 con 0x7fee2c0b0b50 2023-12-19T13:54:36.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee32577640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c1f34f0 con 0x7fee2c1449e0 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee32577640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c13ea50 con 0x7fee2c06b590 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c0ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56032/0 (socket says 172.21.15.113:56032) 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 -- 172.21.15.113:0/2870553763 learned_addr learned my addr 172.21.15.113:0/2870553763 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2bfff640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee2c06b590 0x7fee2c15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee30b14640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c1449e0 0x7fee2c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 -- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee2c06b590 msgr2=0x7fee2c15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee2c06b590 0x7fee2c15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 -- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c1449e0 msgr2=0x7fee2c0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c1449e0 0x7fee2c0ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2b7fe640 1 -- 172.21.15.113:0/2870553763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200094d0 con 0x7fee2c0b0b50 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee2bfff640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee2c06b590 0x7fee2c15adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.500+0000 7fee30b14640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c1449e0 0x7fee2c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.501+0000 7fee2b7fe640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c0ad900 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fee20000c00 tx=0x7fee200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.501+0000 7fee28ff9640 1 -- 172.21.15.113:0/2870553763 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20031840 con 0x7fee2c0b0b50 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.501+0000 7fee28ff9640 1 -- 172.21.15.113:0/2870553763 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee200443f0 con 0x7fee2c0b0b50 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.501+0000 7fee28ff9640 1 -- 172.21.15.113:0/2870553763 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee200447a0 con 0x7fee2c0b0b50 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.501+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c13ed30 con 0x7fee2c0b0b50 2023-12-19T13:54:36.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.501+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c15b300 con 0x7fee2c0b0b50 2023-12-19T13:54:36.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.502+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c061910 con 0x7fee2c0b0b50 2023-12-19T13:54:36.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.503+0000 7fee28ff9640 1 -- 172.21.15.113:0/2870553763 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee2004d450 con 0x7fee2c0b0b50 2023-12-19T13:54:36.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.504+0000 7fee28ff9640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1806a430 0x7fee1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:36.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.504+0000 7fee28ff9640 1 -- 172.21.15.113:0/2870553763 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee2002d040 con 0x7fee2c0b0b50 2023-12-19T13:54:36.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.504+0000 7fee2bfff640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1806a430 0x7fee1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:36.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.505+0000 7fee2bfff640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1806a430 0x7fee1806c8f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fee1c007eb0 tx=0x7fee1c007400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:36.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.509+0000 7fee28ff9640 1 -- 172.21.15.113:0/2870553763 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee200766f0 con 0x7fee2c0b0b50 2023-12-19T13:54:36.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.736+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee2c0ae560 con 0x7fee2c0b0b50 2023-12-19T13:54:36.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.738+0000 7fee28ff9640 1 -- 172.21.15.113:0/2870553763 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fee20035090 con 0x7fee2c0b0b50 2023-12-19T13:54:36.738 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:36.738 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:54:36.739 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1806a430 msgr2=0x7fee1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1806a430 0x7fee1806c8f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fee1c007eb0 tx=0x7fee1c007400 comp rx=0 tx=0).stop 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 msgr2=0x7fee2c0ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c0ad900 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fee20000c00 tx=0x7fee200046c0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 shutdown_connections 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fee1806a430 0x7fee1806c8f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c1449e0 0x7fee2c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee2c0b0b50 0x7fee2c0ad900 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 --2- 172.21.15.113:0/2870553763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee2c06b590 0x7fee2c15adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 >> 172.21.15.113:0/2870553763 conn(0x7fee2c0cbb70 msgr2=0x7fee2c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 shutdown_connections 2023-12-19T13:54:36.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:36.740+0000 7fee32577640 1 -- 172.21.15.113:0/2870553763 wait complete. 2023-12-19T13:54:36.761 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:54:36.992 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":7806,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.887426362999999,"mdsmap_epoch":65,"osdmap_epoch":147,"osdmap_epoch_barrier":147,"uptime":16.588211512000001} 2023-12-19T13:54:36.993 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 7806, "mdsmap_epoch": 65, "osdmap_epoch": 147, "osdmap_epoch_barrier": 147, "rank_uptime": 10.887426363, "state": "up:active", "uptime": 16.588211512, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:54:36.993 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T13:54:37.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.211+0000 7f4ccad42640 1 Processor -- start 2023-12-19T13:54:37.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.212+0000 7f4ccad42640 1 -- start start 2023-12-19T13:54:37.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.213+0000 7f4ccad42640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:37.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.213+0000 7f4ccad42640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4cc40b1d90 0x7f4cc40d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:37.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.213+0000 7f4ccad42640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc40d07c0 con 0x7f4cc40d3650 2023-12-19T13:54:37.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.213+0000 7f4ccad42640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40ce7b0 con 0x7f4cc40b1d90 2023-12-19T13:54:37.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.213+0000 7f4ccad42640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40d3b00 con 0x7f4cc415d4e0 2023-12-19T13:54:37.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc9d40640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:37.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc9d40640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:52288/0 (socket says 172.21.15.113:52288) 2023-12-19T13:54:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc9d40640 1 -- 172.21.15.113:0/1836815467 learned_addr learned my addr 172.21.15.113:0/1836815467 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc953f640 1 --2- 172.21.15.113:0/1836815467 >> v2:172.21.15.151:3300/0 conn(0x7f4cc40b1d90 0x7f4cc40d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc9d40640 1 -- 172.21.15.113:0/1836815467 >> v2:172.21.15.151:3300/0 conn(0x7f4cc40b1d90 msgr2=0x7f4cc40d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc9d40640 1 --2- 172.21.15.113:0/1836815467 >> v2:172.21.15.151:3300/0 conn(0x7f4cc40b1d90 0x7f4cc40d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc9d40640 1 -- 172.21.15.113:0/1836815467 >> v1:172.21.15.151:6789/0 conn(0x7f4cc40d3650 legacy=0x7f4cc4160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.214+0000 7f4cc9d40640 1 -- 172.21.15.113:0/1836815467 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc40d25c0 con 0x7f4cc415d4e0 2023-12-19T13:54:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.216+0000 7f4cc9d40640 1 --2- 172.21.15.113:0/1836815467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b8a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009e50 tx=0x7f4cb402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66f6dcfe16a4883 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.216+0000 7f4cc8d3e640 1 -- 172.21.15.113:0/1836815467 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb402cb00 con 0x7f4cc415d4e0 2023-12-19T13:54:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.216+0000 7f4cc8d3e640 1 -- 172.21.15.113:0/1836815467 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb402cc60 con 0x7f4cc415d4e0 2023-12-19T13:54:37.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.216+0000 7f4cc8d3e640 1 -- 172.21.15.113:0/1836815467 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40343f0 con 0x7f4cc415d4e0 2023-12-19T13:54:37.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 -- 172.21.15.113:0/1836815467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 msgr2=0x7f4cc40b8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:37.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 --2- 172.21.15.113:0/1836815467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b8a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009e50 tx=0x7f4cb402bf60 comp rx=0 tx=0).stop 2023-12-19T13:54:37.217 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 -- 172.21.15.113:0/1836815467 shutdown_connections 2023-12-19T13:54:37.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 --2- 172.21.15.113:0/1836815467 >> v2:172.21.15.151:3300/0 conn(0x7f4cc40b1d90 0x7f4cc40d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 --2- 172.21.15.113:0/1836815467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b8a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 -- 172.21.15.113:0/1836815467 >> 172.21.15.113:0/1836815467 conn(0x7f4cc4072f40 msgr2=0x7f4cc4073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:37.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 -- 172.21.15.113:0/1836815467 shutdown_connections 2023-12-19T13:54:37.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.217+0000 7f4ccad42640 1 -- 172.21.15.113:0/1836815467 wait complete. 2023-12-19T13:54:37.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.219+0000 7f4ccad42640 1 Processor -- start 2023-12-19T13:54:37.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.219+0000 7f4ccad42640 1 -- start start 2023-12-19T13:54:37.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4ccad42640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cc40b1d90 0x7f4cc4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:37.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4ccad42640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cc40d3650 0x7f4cc40b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:37.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4ccad42640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:37.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4ccad42640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40b5230 con 0x7f4cc40d3650 2023-12-19T13:54:37.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4ccad42640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40b4c70 con 0x7f4cc40b1d90 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4ccad42640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40b4f50 con 0x7f4cc415d4e0 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4cc953f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cc40d3650 0x7f4cc40b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4cc953f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cc40d3650 0x7f4cc40b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56048/0 (socket says 172.21.15.113:56048) 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.220+0000 7f4cc953f640 1 -- 172.21.15.113:0/3196614145 learned_addr learned my addr 172.21.15.113:0/3196614145 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc9d40640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cc40b1d90 0x7f4cc4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cca541640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc953f640 1 -- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 msgr2=0x7f4cc40b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc953f640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc953f640 1 -- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cc40b1d90 msgr2=0x7f4cc4159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc953f640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cc40b1d90 0x7f4cc4159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc953f640 1 -- 172.21.15.113:0/3196614145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb4009b30 con 0x7f4cc40d3650 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cca541640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:37.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc953f640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cc40d3650 0x7f4cc40b4100 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800d7d0 tx=0x7f4cb800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.221+0000 7f4cc27fc640 1 -- 172.21.15.113:0/3196614145 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800b6c0 con 0x7f4cc40d3650 2023-12-19T13:54:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.222+0000 7f4cc27fc640 1 -- 172.21.15.113:0/3196614145 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800b820 con 0x7f4cc40d3650 2023-12-19T13:54:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.222+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc40b5780 con 0x7f4cc40d3650 2023-12-19T13:54:37.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.222+0000 7f4cc27fc640 1 -- 172.21.15.113:0/3196614145 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800bbb0 con 0x7f4cc40d3650 2023-12-19T13:54:37.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.222+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc40cca10 con 0x7f4cc40d3650 2023-12-19T13:54:37.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.223+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc4061910 con 0x7f4cc40d3650 2023-12-19T13:54:37.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.224+0000 7f4cc27fc640 1 -- 172.21.15.113:0/3196614145 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4cb800bd10 con 0x7f4cc40d3650 2023-12-19T13:54:37.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.225+0000 7f4cc27fc640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4cb006a430 0x7f4cb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:37.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.225+0000 7f4cc27fc640 1 -- 172.21.15.113:0/3196614145 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cb8088ec0 con 0x7f4cc40d3650 2023-12-19T13:54:37.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.225+0000 7f4cc9d40640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4cb006a430 0x7f4cb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:37.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.226+0000 7f4cc9d40640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4cb006a430 0x7f4cb006c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4035000 tx=0x7f4cb4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:37.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.229+0000 7f4cc27fc640 1 -- 172.21.15.113:0/3196614145 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4cb8054410 con 0x7f4cc40d3650 2023-12-19T13:54:37.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.416+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f4cc40d3e50 con 0x7f4cc40d3650 2023-12-19T13:54:37.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.629+0000 7f4cc27fc640 1 -- 172.21.15.113:0/3196614145 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v148) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4cb8057a30 con 0x7f4cc40d3650 2023-12-19T13:54:37.631 INFO:teuthology.orchestra.run.smithi113.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T13:54:37.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.634+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4cb006a430 msgr2=0x7f4cb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:37.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.634+0000 7f4ccad42640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4cb006a430 0x7f4cb006c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4035000 tx=0x7f4cb4030000 comp rx=0 tx=0).stop 2023-12-19T13:54:37.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.634+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cc40d3650 msgr2=0x7f4cc40b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:37.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.634+0000 7f4ccad42640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cc40d3650 0x7f4cc40b4100 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800d7d0 tx=0x7f4cb800dc90 comp rx=0 tx=0).stop 2023-12-19T13:54:37.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 shutdown_connections 2023-12-19T13:54:37.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4cb006a430 0x7f4cb006c8f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4cc415d4e0 0x7f4cc40b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cc40d3650 0x7f4cc40b4100 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 --2- 172.21.15.113:0/3196614145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cc40b1d90 0x7f4cc4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:37.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 >> 172.21.15.113:0/3196614145 conn(0x7f4cc4072f40 msgr2=0x7f4cc40b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:37.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 shutdown_connections 2023-12-19T13:54:37.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:37.635+0000 7f4ccad42640 1 -- 172.21.15.113:0/3196614145 wait complete. 2023-12-19T13:54:37.654 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:54:37.870 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:54:37.870 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:54:37.870 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-19T13:54:37.870 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:37.870 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:37.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:37.922 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-19T13:54:38.208 INFO:teuthology.orchestra.run.smithi113.stderr:16+0 records in 2023-12-19T13:54:38.208 INFO:teuthology.orchestra.run.smithi113.stderr:16+0 records out 2023-12-19T13:54:38.208 INFO:teuthology.orchestra.run.smithi113.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.180994 s, 92.7 MB/s 2023-12-19T13:54:38.210 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:38.210 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:38.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:38.259 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-19T13:54:38.527 INFO:teuthology.orchestra.run.smithi113.stderr:17+0 records in 2023-12-19T13:54:38.527 INFO:teuthology.orchestra.run.smithi113.stderr:17+0 records out 2023-12-19T13:54:38.527 INFO:teuthology.orchestra.run.smithi113.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.168239 s, 106 MB/s 2023-12-19T13:54:38.529 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T13:54:38.529 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:54:38.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.733+0000 7fe5257dc640 1 Processor -- start 2023-12-19T13:54:38.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.733+0000 7fe5257dc640 1 -- start start 2023-12-19T13:54:38.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.734+0000 7fe5257dc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe52006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:38.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.734+0000 7fe5257dc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe52015aa70 0x7fe52015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:38.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.734+0000 7fe5257dc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52006b520 con 0x7fe52015b1e0 2023-12-19T13:54:38.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.735+0000 7fe5257dc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200b2b20 con 0x7fe52015aa70 2023-12-19T13:54:38.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.735+0000 7fe5257dc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b2fb0 con 0x7fe520159f80 2023-12-19T13:54:38.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.735+0000 7fe524fdb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe52015aa70 0x7fe52015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:38.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.735+0000 7fe51f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe52015b1e0 0x7fe52015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37520/0 (socket says 172.21.15.113:37520) 2023-12-19T13:54:38.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.735+0000 7fe524fdb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe52015aa70 0x7fe52015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58124/0 (socket says 172.21.15.113:58124) 2023-12-19T13:54:38.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.735+0000 7fe51f7fe640 1 -- 172.21.15.113:0/735962677 learned_addr learned my addr 172.21.15.113:0/735962677 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:38.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.735+0000 7fe51ffff640 1 --2- 172.21.15.113:0/735962677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe52006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:38.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.736+0000 7fe524fdb640 1 -- 172.21.15.113:0/735962677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 msgr2=0x7fe52006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:38.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.736+0000 7fe524fdb640 1 --2- 172.21.15.113:0/735962677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe52006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:38.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.736+0000 7fe524fdb640 1 -- 172.21.15.113:0/735962677 >> v1:172.21.15.113:6789/0 conn(0x7fe52015b1e0 legacy=0x7fe52015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:38.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.736+0000 7fe524fdb640 1 -- 172.21.15.113:0/735962677 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200b1f10 con 0x7fe52015aa70 2023-12-19T13:54:38.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.736+0000 7fe51ffff640 1 --2- 172.21.15.113:0/735962677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe52006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.737+0000 7fe524fdb640 1 --2- 172.21.15.113:0/735962677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52015b770 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe5180097a0 tx=0x7fe51802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d459d9b95c6c2c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.737+0000 7fe51effd640 1 -- 172.21.15.113:0/735962677 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518030800 con 0x7fe52015aa70 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.737+0000 7fe51effd640 1 -- 172.21.15.113:0/735962677 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518030960 con 0x7fe52015aa70 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.737+0000 7fe51effd640 1 -- 172.21.15.113:0/735962677 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518030cf0 con 0x7fe52015aa70 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.737+0000 7fe5257dc640 1 -- 172.21.15.113:0/735962677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 msgr2=0x7fe52015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.737+0000 7fe5257dc640 1 --2- 172.21.15.113:0/735962677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52015b770 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe5180097a0 tx=0x7fe51802b940 comp rx=0 tx=0).stop 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.738+0000 7fe5257dc640 1 -- 172.21.15.113:0/735962677 shutdown_connections 2023-12-19T13:54:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.738+0000 7fe5257dc640 1 --2- 172.21.15.113:0/735962677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52015b770 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.738+0000 7fe5257dc640 1 --2- 172.21.15.113:0/735962677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe52006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.738+0000 7fe5257dc640 1 -- 172.21.15.113:0/735962677 >> 172.21.15.113:0/735962677 conn(0x7fe5200b0100 msgr2=0x7fe5200b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.738+0000 7fe5257dc640 1 -- 172.21.15.113:0/735962677 shutdown_connections 2023-12-19T13:54:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.738+0000 7fe5257dc640 1 -- 172.21.15.113:0/735962677 wait complete. 2023-12-19T13:54:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.739+0000 7fe5257dc640 1 Processor -- start 2023-12-19T13:54:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.739+0000 7fe5257dc640 1 -- start start 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.740+0000 7fe5257dc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe5201f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.740+0000 7fe5257dc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52014db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.740+0000 7fe5257dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe52015b1e0 0x7fe5200ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.740+0000 7fe5257dc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe520151af0 con 0x7fe52015aa70 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.740+0000 7fe5257dc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52014e390 con 0x7fe52015b1e0 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.740+0000 7fe5257dc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52014e670 con 0x7fe520159f80 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52014db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52014db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58126/0 (socket says 172.21.15.113:58126) 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 -- 172.21.15.113:0/262102421 learned_addr learned my addr 172.21.15.113:0/262102421 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51ffff640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe5201f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:38.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe524fdb640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe52015b1e0 0x7fe5200ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 -- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 msgr2=0x7fe5201f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe5201f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 -- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe52015b1e0 msgr2=0x7fe5200ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe52015b1e0 0x7fe5200ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 -- 172.21.15.113:0/262102421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009400 con 0x7fe52015aa70 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.741+0000 7fe51f7fe640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52014db40 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe51000cbc0 tx=0x7fe51000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.742+0000 7fe51cff9640 1 -- 172.21.15.113:0/262102421 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51000aca0 con 0x7fe52015aa70 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.742+0000 7fe51cff9640 1 -- 172.21.15.113:0/262102421 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51000ae00 con 0x7fe52015aa70 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.742+0000 7fe51cff9640 1 -- 172.21.15.113:0/262102421 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510012600 con 0x7fe52015aa70 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.742+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52014e950 con 0x7fe52015aa70 2023-12-19T13:54:38.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.742+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52014ec30 con 0x7fe52015aa70 2023-12-19T13:54:38.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.743+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe520151950 con 0x7fe52015aa70 2023-12-19T13:54:38.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.744+0000 7fe51cff9640 1 -- 172.21.15.113:0/262102421 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe510007070 con 0x7fe52015aa70 2023-12-19T13:54:38.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.745+0000 7fe51cff9640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe50006a430 0x7fe50006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:38.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.745+0000 7fe51cff9640 1 -- 172.21.15.113:0/262102421 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5100887c0 con 0x7fe52015aa70 2023-12-19T13:54:38.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.745+0000 7fe51ffff640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe50006a430 0x7fe50006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:38.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.746+0000 7fe51ffff640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe50006a430 0x7fe50006c8f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe520150ba0 tx=0x7fe508008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:38.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.749+0000 7fe51cff9640 1 -- 172.21.15.113:0/262102421 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe520151950 con 0x7fe52015aa70 2023-12-19T13:54:38.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.940+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe520151950 con 0x7fe52015aa70 2023-12-19T13:54:38.941 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.941+0000 7fe51cff9640 1 -- 172.21.15.113:0/262102421 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+33606 (secure 0 0 0) 0x7fe520151950 con 0x7fe52015aa70 2023-12-19T13:54:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 148, 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:54:37.622657+0000", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:54:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 17, 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:54:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:54:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 16, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:23.704080+0000", 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:54:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "146", 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:38.953 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:38.954 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:54:38.955 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 2.25, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 2.25, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2.25, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2.25, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 17, 2023-12-19T13:54:38.956 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:25.109205+0000", 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:38.957 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "148", 2023-12-19T13:54:38.958 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:38.959 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:38.960 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.961 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.962 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:38.963 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:38.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:38.965 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.966 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:54:38.967 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:38.968 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.969 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.970 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.971 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.972 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:54:38.973 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:38.974 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.975 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.976 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.977 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.978 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:38.979 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.980 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.981 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.982 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.983 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:54:38.984 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:38.985 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.986 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.987 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.988 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.989 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:38.990 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:54:38.991 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.992 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.993 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.994 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:38.995 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.997 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:38.998 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:38.999 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:39.000 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.001 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.002 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.003 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:39.004 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.005 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:39.006 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.007 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.008 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.009 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.010 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.011 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:39.012 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:54:39.013 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:54:39.014 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:54:39.015 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:54:39.015 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:54:39.015 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:54:39.015 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:54:39.015 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:54:39.015 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:39.015 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:39.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe50006a430 msgr2=0x7fe50006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:39.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe50006a430 0x7fe50006c8f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe520150ba0 tx=0x7fe508008040 comp rx=0 tx=0).stop 2023-12-19T13:54:39.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 msgr2=0x7fe52014db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:39.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52014db40 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe51000cbc0 tx=0x7fe51000a060 comp rx=0 tx=0).stop 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 shutdown_connections 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe50006a430 0x7fe50006c8f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe52015b1e0 0x7fe5200ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe52015aa70 0x7fe52014db40 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 --2- 172.21.15.113:0/262102421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe520159f80 0x7fe5201f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 >> 172.21.15.113:0/262102421 conn(0x7fe5200b0100 msgr2=0x7fe5200cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 shutdown_connections 2023-12-19T13:54:39.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:38.944+0000 7fe5257dc640 1 -- 172.21.15.113:0/262102421 wait complete. 2023-12-19T13:54:39.018 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:54:44.019 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:54:44.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.241+0000 7fd2f05fd640 1 Processor -- start 2023-12-19T13:54:44.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.241+0000 7fd2f05fd640 1 -- start start 2023-12-19T13:54:44.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.243+0000 7fd2f05fd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd2e80ae110 0x7fd2e80b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:44.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.243+0000 7fd2f05fd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80b0a60 con 0x7fd2e8157bf0 2023-12-19T13:54:44.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.243+0000 7fd2f05fd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80ae640 con 0x7fd2e80b0640 2023-12-19T13:54:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.243+0000 7fd2f05fd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e806b8c0 con 0x7fd2e80ae110 2023-12-19T13:54:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.243+0000 7fd2ee399640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd2e8157bf0 0x7fd2e815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37522/0 (socket says 172.21.15.113:37522) 2023-12-19T13:54:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.243+0000 7fd2ee399640 1 -- 172.21.15.113:0/3412484992 learned_addr learned my addr 172.21.15.113:0/3412484992 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.243+0000 7fd2edb98640 1 --2- 172.21.15.113:0/3412484992 >> v2:172.21.15.113:3300/0 conn(0x7fd2e80ae110 0x7fd2e80b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.244+0000 7fd2edb98640 1 -- 172.21.15.113:0/3412484992 >> v1:172.21.15.151:6789/0 conn(0x7fd2e80b0640 legacy=0x7fd2e806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:44.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.244+0000 7fd2edb98640 1 -- 172.21.15.113:0/3412484992 >> v1:172.21.15.113:6789/0 conn(0x7fd2e8157bf0 legacy=0x7fd2e815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:44.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.244+0000 7fd2edb98640 1 -- 172.21.15.113:0/3412484992 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80ae920 con 0x7fd2e80ae110 2023-12-19T13:54:44.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.244+0000 7fd2ed397640 1 -- 172.21.15.113:0/3412484992 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693514394 0 0) 0x7fd2e80b0a60 con 0x7fd2e8157bf0 2023-12-19T13:54:44.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.245+0000 7fd2edb98640 1 --2- 172.21.15.113:0/3412484992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80ae110 0x7fd2e80b0100 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80097a0 tx=0x7fd2d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220dc500e3cad9df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:44.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.245+0000 7fd2ed397640 1 -- 172.21.15.113:0/3412484992 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8031830 con 0x7fd2e80ae110 2023-12-19T13:54:44.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.245+0000 7fd2ed397640 1 -- 172.21.15.113:0/3412484992 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8031990 con 0x7fd2e80ae110 2023-12-19T13:54:44.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.245+0000 7fd2ed397640 1 -- 172.21.15.113:0/3412484992 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8031d20 con 0x7fd2e80ae110 2023-12-19T13:54:44.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.246+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3412484992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80ae110 msgr2=0x7fd2e80b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:44.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.246+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3412484992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80ae110 0x7fd2e80b0100 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80097a0 tx=0x7fd2d802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.246+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3412484992 shutdown_connections 2023-12-19T13:54:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.246+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3412484992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80ae110 0x7fd2e80b0100 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.246+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3412484992 >> 172.21.15.113:0/3412484992 conn(0x7fd2e80cbb70 msgr2=0x7fd2e80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.246+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3412484992 shutdown_connections 2023-12-19T13:54:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.246+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3412484992 wait complete. 2023-12-19T13:54:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.248+0000 7fd2f05fd640 1 Processor -- start 2023-12-19T13:54:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.248+0000 7fd2f05fd640 1 -- start start 2023-12-19T13:54:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2f05fd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e80ae110 0x7fd2e81f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2f05fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80b0640 0x7fd2e815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2f05fd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2e8157bf0 0x7fd2e8070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2f05fd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e81f2c60 con 0x7fd2e80b0640 2023-12-19T13:54:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2f05fd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e806f670 con 0x7fd2e80ae110 2023-12-19T13:54:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2f05fd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e806f950 con 0x7fd2e8157bf0 2023-12-19T13:54:44.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2edb98640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80b0640 0x7fd2e815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:44.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2edb98640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80b0640 0x7fd2e815d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58144/0 (socket says 172.21.15.113:58144) 2023-12-19T13:54:44.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2edb98640 1 -- 172.21.15.113:0/3433953965 learned_addr learned my addr 172.21.15.113:0/3433953965 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:44.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2ee399640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e80ae110 0x7fd2e81f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:44.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.249+0000 7fd2eeb9a640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2e8157bf0 0x7fd2e8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:44.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2edb98640 1 -- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2e8157bf0 msgr2=0x7fd2e8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2edb98640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2e8157bf0 0x7fd2e8070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2edb98640 1 -- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e80ae110 msgr2=0x7fd2e81f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2edb98640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e80ae110 0x7fd2e81f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2edb98640 1 -- 172.21.15.113:0/3433953965 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8009400 con 0x7fd2e80b0640 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2ee399640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e80ae110 0x7fd2e81f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2edb98640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80b0640 0x7fd2e815d0d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80098c0 tx=0x7fd2d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d803ba70 con 0x7fd2e80b0640 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.250+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d803bbd0 con 0x7fd2e80b0640 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.251+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e806fc30 con 0x7fd2e80b0640 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.251+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80453f0 con 0x7fd2e80b0640 2023-12-19T13:54:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.251+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e80701f0 con 0x7fd2e80b0640 2023-12-19T13:54:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.252+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e8061910 con 0x7fd2e80b0640 2023-12-19T13:54:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.253+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2d804e450 con 0x7fd2e80b0640 2023-12-19T13:54:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.254+0000 7fd2deffd640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd2cc06a460 0x7fd2cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.254+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2d80aabb0 con 0x7fd2e80b0640 2023-12-19T13:54:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.254+0000 7fd2ee399640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd2cc06a460 0x7fd2cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:44.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.254+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fd2cc071f90 con 0x7fd2e80b0640 2023-12-19T13:54:44.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.255+0000 7fd2ee399640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd2cc06a460 0x7fd2cc06c920 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4000f60 tx=0x7fd2e4007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:44.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.258+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2d8076100 con 0x7fd2e80b0640 2023-12-19T13:54:44.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.447+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd2e815eae0 con 0x7fd2e80b0640 2023-12-19T13:54:44.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.451+0000 7fd2deffd640 1 -- 172.21.15.113:0/3433953965 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+33625 (secure 0 0 0) 0x7fd2d8079720 con 0x7fd2e80b0640 2023-12-19T13:54:44.452 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:44.452 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:44.453 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 149, 2023-12-19T13:54:44.453 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:44.453 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:54:44.453 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:54:43.588740+0000", 2023-12-19T13:54:44.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:54:44.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:54:44.453 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:44.454 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:54:44.455 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:54:44.455 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:54:44.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:54:44.455 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:54:44.455 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 17, 2023-12-19T13:54:44.455 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:54:44.455 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:54:44.456 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:54:44.457 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:44.457 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:44.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:44.457 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:44.457 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:44.457 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:44.457 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:44.458 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:44.458 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:44.458 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:44.458 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:44.458 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:44.458 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:54:44.458 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:54:44.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:44.460 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:44.461 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.462 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 16, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:23.704080+0000", 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:44.464 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:44.465 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "146", 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:44.466 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:44.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:54:44.468 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 2.25, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 2.25, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2.25, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2.25, 2023-12-19T13:54:44.469 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 17, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:25.109205+0000", 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:44.470 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:44.471 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "149", 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:44.472 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:44.473 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:44.474 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:44.475 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.476 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.477 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.478 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.479 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.480 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.481 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.482 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.483 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.484 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.485 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.486 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.487 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.488 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:54:44.489 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.490 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:54:44.491 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.492 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.493 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.494 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.495 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:54:44.496 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.497 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.498 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.499 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.500 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.501 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.502 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.503 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.504 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.505 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.506 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.507 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.508 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.509 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.511 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.512 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.513 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.514 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.515 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:44.516 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.517 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.518 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.519 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.520 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:44.521 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.522 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.523 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.524 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.525 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.526 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:54:44.527 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:54:44.528 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:44.529 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:44.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.453+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd2cc06a460 msgr2=0x7fd2cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:44.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.453+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd2cc06a460 0x7fd2cc06c920 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4000f60 tx=0x7fd2e4007ca0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.453+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80b0640 msgr2=0x7fd2e815d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:44.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.453+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80b0640 0x7fd2e815d0d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80098c0 tx=0x7fd2d80046c0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 shutdown_connections 2023-12-19T13:54:44.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd2cc06a460 0x7fd2cc06c920 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2e8157bf0 0x7fd2e8070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2e80b0640 0x7fd2e815d0d0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 --2- 172.21.15.113:0/3433953965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e80ae110 0x7fd2e81f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:44.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 >> 172.21.15.113:0/3433953965 conn(0x7fd2e80cbb70 msgr2=0x7fd2e8155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:44.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 shutdown_connections 2023-12-19T13:54:44.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:44.454+0000 7fd2f05fd640 1 -- 172.21.15.113:0/3433953965 wait complete. 2023-12-19T13:54:44.532 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T13:54:44.533 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:44.533 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:44.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:44.591 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-19T13:54:45.014 INFO:teuthology.orchestra.run.smithi113.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T13:54:45.015 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T13:54:45.015 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T13:54:45.015 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.364898 s, 144 MB/s 2023-12-19T13:54:45.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:54:45.016 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:54:45.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.220+0000 7f0cb8a10640 1 Processor -- start 2023-12-19T13:54:45.220 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.220+0000 7f0cb8a10640 1 -- start start 2023-12-19T13:54:45.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.221+0000 7f0cb8a10640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0cb41449e0 0x7f0cb40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.221+0000 7f0cb8a10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 0x7f0cb406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0cb8a10640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb40afb10 con 0x7f0cb406b590 2023-12-19T13:54:45.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0cb8a10640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb406bb30 con 0x7f0cb41449e0 2023-12-19T13:54:45.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0cb8a10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b0070 con 0x7f0cb40b0b50 2023-12-19T13:54:45.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0cb2d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0cb406b590 0x7f0cb415eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37536/0 (socket says 172.21.15.113:37536) 2023-12-19T13:54:45.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0cb2d9d640 1 -- 172.21.15.113:0/2549986948 learned_addr learned my addr 172.21.15.113:0/2549986948 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:45.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0ca9d9b640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 0x7f0cb406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0cb259c640 1 --2- 172.21.15.113:0/2549986948 >> v2:172.21.15.151:3300/0 conn(0x7f0cb41449e0 0x7f0cb40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.222+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565424131 0 0) 0x7f0cb40afb10 con 0x7f0cb406b590 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca0003520 con 0x7f0cb406b590 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969795557 0 0) 0x7f0ca0003520 con 0x7f0cb406b590 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 msgr2=0x7f0cb406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 0x7f0cb406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 >> v2:172.21.15.151:3300/0 conn(0x7f0cb41449e0 msgr2=0x7f0cb40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 --2- 172.21.15.113:0/2549986948 >> v2:172.21.15.151:3300/0 conn(0x7f0cb41449e0 0x7f0cb40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40b0350 con 0x7f0cb406b590 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0cac001670 con 0x7f0cb406b590 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 >> v1:172.21.15.113:6789/0 conn(0x7f0cb406b590 legacy=0x7f0cb415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 0x7f0ca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb406bb30 con 0x7f0ca00039e0 2023-12-19T13:54:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b0070 con 0x7f0ca00047c0 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca000fe90 con 0x7f0cb40b0b50 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.223+0000 7f0cb259c640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.224+0000 7f0cb2d9d640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 0x7f0ca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.224+0000 7f0ca9d9b640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.224+0000 7f0cb259c640 1 -- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 msgr2=0x7f0ca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.224+0000 7f0cb259c640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb40b0b50 0x7f0ca0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.224+0000 7f0cb259c640 1 -- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00047c0 msgr2=0x7f0ca0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.224+0000 7f0cb259c640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.224+0000 7f0cb259c640 1 -- 172.21.15.113:0/2549986948 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0003520 con 0x7f0ca00039e0 2023-12-19T13:54:45.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.225+0000 7f0cb259c640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4007360 tx=0x7f0ca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb4091eecb5df0e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:45.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca402cca0 con 0x7f0ca00039e0 2023-12-19T13:54:45.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca402ce00 con 0x7f0ca00039e0 2023-12-19T13:54:45.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb1d9b640 1 -- 172.21.15.113:0/2549986948 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4034660 con 0x7f0ca00039e0 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb8a10640 1 -- 172.21.15.113:0/2549986948 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00039e0 msgr2=0x7f0ca0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb8a10640 1 --2- 172.21.15.113:0/2549986948 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4007360 tx=0x7f0ca00057f0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb2d9d640 1 -- 172.21.15.113:0/2549986948 reap_dead start 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb8a10640 1 -- 172.21.15.113:0/2549986948 shutdown_connections 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb8a10640 1 -- 172.21.15.113:0/2549986948 >> 172.21.15.113:0/2549986948 conn(0x7f0cb40cbb70 msgr2=0x7f0cb40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb8a10640 1 -- 172.21.15.113:0/2549986948 shutdown_connections 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.226+0000 7f0cb8a10640 1 -- 172.21.15.113:0/2549986948 wait complete. 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.228+0000 7f0cb8a10640 1 Processor -- start 2023-12-19T13:54:45.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.229+0000 7f0cb8a10640 1 -- start start 2023-12-19T13:54:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb8a10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00039e0 0x7f0cb415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb8a10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb4138c40 0x7f0cb415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb8a10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb415e3f0 0x7f0cb4141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb8a10640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb415c0e0 con 0x7f0cb4138c40 2023-12-19T13:54:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb8a10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb415e870 con 0x7f0cb415e3f0 2023-12-19T13:54:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb8a10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41428f0 con 0x7f0ca00039e0 2023-12-19T13:54:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0ca9d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb4138c40 0x7f0cb415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0ca9d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb4138c40 0x7f0cb415deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58176/0 (socket says 172.21.15.113:58176) 2023-12-19T13:54:45.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0ca9d9b640 1 -- 172.21.15.113:0/4134891280 learned_addr learned my addr 172.21.15.113:0/4134891280 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb259c640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00039e0 0x7f0cb415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.230+0000 7f0cb2d9d640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb415e3f0 0x7f0cb4141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0ca9d9b640 1 -- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00039e0 msgr2=0x7f0cb415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0ca9d9b640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00039e0 0x7f0cb415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0ca9d9b640 1 -- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb415e3f0 msgr2=0x7f0cb4141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0ca9d9b640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb415e3f0 0x7f0cb4141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0ca9d9b640 1 -- 172.21.15.113:0/4134891280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4142bd0 con 0x7f0cb4138c40 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0cb259c640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00039e0 0x7f0cb415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0ca9d9b640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb4138c40 0x7f0cb415deb0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c011600 tx=0x7f0c9c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00f920 con 0x7f0cb4138c40 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c00fa80 con 0x7f0cb4138c40 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb415ba20 con 0x7f0cb4138c40 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00fdf0 con 0x7f0cb4138c40 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.231+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb41420b0 con 0x7f0cb4138c40 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.232+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb415c350 con 0x7f0cb4138c40 2023-12-19T13:54:45.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.233+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c9c015460 con 0x7f0cb4138c40 2023-12-19T13:54:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.234+0000 7f0cab7fe640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a460 0x7f0c9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.234+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c9c088d20 con 0x7f0cb4138c40 2023-12-19T13:54:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.235+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f0c94071f90 con 0x7f0cb4138c40 2023-12-19T13:54:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.235+0000 7f0cb259c640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a460 0x7f0c9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.235+0000 7f0cb259c640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a460 0x7f0c9406c920 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4036000 tx=0x7f0ca4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:45.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.239+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c9c0543a0 con 0x7f0cb4138c40 2023-12-19T13:54:45.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.429+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0cb4061910 con 0x7f0cb4138c40 2023-12-19T13:54:45.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.432+0000 7f0cab7fe640 1 -- 172.21.15.113:0/4134891280 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+33625 (secure 0 0 0) 0x7f0c9c022020 con 0x7f0cb4138c40 2023-12-19T13:54:45.433 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 149, 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:54:43.588740+0000", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:54:45.434 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 17, 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:54:45.435 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:45.436 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:45.437 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:45.438 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:45.439 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:45.440 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:54:45.441 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 16, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:23.704080+0000", 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:45.442 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:54:45.443 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "146", 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:45.444 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:45.445 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:45.446 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.447 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 2.25, 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 2.25, 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2.25, 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2.25, 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.448 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 17, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:25.109205+0000", 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:45.449 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.450 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "149", 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:45.451 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:45.452 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:45.453 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.454 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.455 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.456 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.458 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:54:45.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.461 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.461 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.461 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:54:45.462 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.463 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:54:45.464 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:54:45.465 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.466 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.467 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.468 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.469 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.470 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.471 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:54:45.472 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:45.473 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.474 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.475 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.476 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.477 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.478 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.479 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.480 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.481 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.482 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.483 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.484 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.485 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.486 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.487 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:54:45.488 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.489 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:54:45.490 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.491 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.492 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.493 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:45.494 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:54:45.495 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.496 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.497 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:45.498 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:45.499 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.500 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.501 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.502 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.503 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:45.504 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:54:45.505 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:54:45.506 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:54:45.507 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:54:45.507 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:54:45.507 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:54:45.507 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:45.507 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:45.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a460 msgr2=0x7f0c9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a460 0x7f0c9406c920 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4036000 tx=0x7f0ca4030000 comp rx=0 tx=0).stop 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb4138c40 msgr2=0x7f0cb415deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb4138c40 0x7f0cb415deb0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c011600 tx=0x7f0c9c011ac0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 shutdown_connections 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c9406a460 0x7f0c9406c920 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb415e3f0 0x7f0cb4141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0cb4138c40 0x7f0cb415deb0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 --2- 172.21.15.113:0/4134891280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca00039e0 0x7f0cb415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 >> 172.21.15.113:0/4134891280 conn(0x7f0cb40cbb70 msgr2=0x7f0cb413fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 shutdown_connections 2023-12-19T13:54:45.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.435+0000 7f0cb8a10640 1 -- 172.21.15.113:0/4134891280 wait complete. 2023-12-19T13:54:45.510 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:45.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.733+0000 7ffa0759e640 1 Processor -- start 2023-12-19T13:54:45.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.733+0000 7ffa0759e640 1 -- start start 2023-12-19T13:54:45.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.734+0000 7ffa0759e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa08159f80 0x7ffa0806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.734+0000 7ffa0759e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0806b520 con 0x7ffa0815b1e0 2023-12-19T13:54:45.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa0759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa080b2b20 con 0x7ffa0815aa70 2023-12-19T13:54:45.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa0759e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa080b2fb0 con 0x7ffa08159f80 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa0659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa08159f80 0x7ffa0806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa05d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffa0815b1e0 0x7ffa0815a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37550/0 (socket says 172.21.15.113:37550) 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa05d9b640 1 -- 172.21.15.113:0/120679138 learned_addr learned my addr 172.21.15.113:0/120679138 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa0659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa08159f80 0x7ffa0806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58190/0 (socket says 172.21.15.113:58190) 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa0659c640 1 -- 172.21.15.113:0/120679138 >> v1:172.21.15.151:6789/0 conn(0x7ffa0815aa70 legacy=0x7ffa0815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa0659c640 1 -- 172.21.15.113:0/120679138 >> v1:172.21.15.113:6789/0 conn(0x7ffa0815b1e0 legacy=0x7ffa0815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.735+0000 7ffa0659c640 1 -- 172.21.15.113:0/120679138 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa080b1f10 con 0x7ffa08159f80 2023-12-19T13:54:45.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.736+0000 7ffa0659c640 1 --2- 172.21.15.113:0/120679138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa0806f160 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009d90 tx=0x7ff9f802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3479ee01900a4a0f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:45.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0559a640 1 -- 172.21.15.113:0/120679138 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f802cd00 con 0x7ffa08159f80 2023-12-19T13:54:45.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0559a640 1 -- 172.21.15.113:0/120679138 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f802ce60 con 0x7ffa08159f80 2023-12-19T13:54:45.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0559a640 1 -- 172.21.15.113:0/120679138 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8034660 con 0x7ffa08159f80 2023-12-19T13:54:45.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0759e640 1 -- 172.21.15.113:0/120679138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 msgr2=0x7ffa0806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0759e640 1 --2- 172.21.15.113:0/120679138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa0806f160 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009d90 tx=0x7ff9f802bf50 comp rx=0 tx=0).stop 2023-12-19T13:54:45.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0759e640 1 -- 172.21.15.113:0/120679138 shutdown_connections 2023-12-19T13:54:45.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0759e640 1 --2- 172.21.15.113:0/120679138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa0806f160 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.737+0000 7ffa0759e640 1 -- 172.21.15.113:0/120679138 >> 172.21.15.113:0/120679138 conn(0x7ffa080b0100 msgr2=0x7ffa080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:45.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.738+0000 7ffa0759e640 1 -- 172.21.15.113:0/120679138 shutdown_connections 2023-12-19T13:54:45.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.738+0000 7ffa0759e640 1 -- 172.21.15.113:0/120679138 wait complete. 2023-12-19T13:54:45.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.739+0000 7ffa0759e640 1 Processor -- start 2023-12-19T13:54:45.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.739+0000 7ffa0759e640 1 -- start start 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.740+0000 7ffa0759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa08149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.740+0000 7ffa0759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa0815aa70 0x7ffa080ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.740+0000 7ffa0759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0815b1e0 0x7ffa080acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.740+0000 7ffa0759e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0815b750 con 0x7ffa08159f80 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.740+0000 7ffa0759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0815d790 con 0x7ffa0815b1e0 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.740+0000 7ffa0759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa081f70b0 con 0x7ffa0815aa70 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa08149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa08149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58192/0 (socket says 172.21.15.113:58192) 2023-12-19T13:54:45.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 -- 172.21.15.113:0/370832358 learned_addr learned my addr 172.21.15.113:0/370832358 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:45.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa05d9b640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa0815aa70 0x7ffa080ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 -- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa0815aa70 msgr2=0x7ffa080ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa0815aa70 0x7ffa080ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa06d9d640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0815b1e0 0x7ffa080acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 -- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0815b1e0 msgr2=0x7ffa080acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0815b1e0 0x7ffa080acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa0659c640 1 -- 172.21.15.113:0/370832358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8009a70 con 0x7ffa08159f80 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa05d9b640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa0815aa70 0x7ffa080ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.741+0000 7ffa06d9d640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0815b1e0 0x7ffa080acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.742+0000 7ffa0659c640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa08149a30 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8037040 tx=0x7ff9f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.742+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f803d600 con 0x7ffa08159f80 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.742+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f803d780 con 0x7ffa08159f80 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.742+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa081f62f0 con 0x7ffa08159f80 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.742+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f803db30 con 0x7ffa08159f80 2023-12-19T13:54:45.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.742+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa081f68b0 con 0x7ffa08159f80 2023-12-19T13:54:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.743+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa08061910 con 0x7ffa08159f80 2023-12-19T13:54:45.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.744+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9f803b040 con 0x7ffa08159f80 2023-12-19T13:54:45.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.745+0000 7ff9feffd640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:45.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.745+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9f80aa9c0 con 0x7ffa08159f80 2023-12-19T13:54:45.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.745+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7ff9e8071f60 con 0x7ffa08159f80 2023-12-19T13:54:45.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.745+0000 7ffa05d9b640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:45.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.746+0000 7ffa05d9b640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0007fd0 tx=0x7ff9f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:45.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.750+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9f804d060 con 0x7ffa08159f80 2023-12-19T13:54:45.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.976+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa080b0f70 con 0x7ffa08159f80 2023-12-19T13:54:45.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.977+0000 7ff9feffd640 1 -- 172.21.15.113:0/370832358 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7ff9f804d070 con 0x7ffa08159f80 2023-12-19T13:54:45.978 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:45.978 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:54:45.978 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:54:45.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 msgr2=0x7ff9e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0007fd0 tx=0x7ff9f0009040 comp rx=0 tx=0).stop 2023-12-19T13:54:45.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 msgr2=0x7ffa08149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:45.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa08149a30 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8037040 tx=0x7ff9f8004a40 comp rx=0 tx=0).stop 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 shutdown_connections 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0815b1e0 0x7ffa080acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa0815aa70 0x7ffa080ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 --2- 172.21.15.113:0/370832358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa08159f80 0x7ffa08149a30 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 >> 172.21.15.113:0/370832358 conn(0x7ffa080b0100 msgr2=0x7ffa08158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 shutdown_connections 2023-12-19T13:54:45.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:45.980+0000 7ffa0759e640 1 -- 172.21.15.113:0/370832358 wait complete. 2023-12-19T13:54:45.998 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:54:46.233 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":7806,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.128072485000001,"mdsmap_epoch":65,"osdmap_epoch":149,"osdmap_epoch_barrier":149,"uptime":25.828870664} 2023-12-19T13:54:46.233 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 7806, "mdsmap_epoch": 65, "osdmap_epoch": 149, "osdmap_epoch_barrier": 149, "rank_uptime": 20.128072485, "state": "up:active", "uptime": 25.828870664, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:54:46.233 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:54:46.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:46.233 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T13:54:46.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:46.286 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T13:54:46.340 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:54:46.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.550+0000 7ff82a99f640 1 Processor -- start 2023-12-19T13:54:46.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.550+0000 7ff82a99f640 1 -- start start 2023-12-19T13:54:46.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.552+0000 7ff82a99f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8240b2460 0x7ff824070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:46.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.552+0000 7ff82a99f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff824157c50 0x7ff8240b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:46.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.552+0000 7ff82a99f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8240b2d80 con 0x7ff8240b6960 2023-12-19T13:54:46.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.552+0000 7ff82a99f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82415e8b0 con 0x7ff8240b2460 2023-12-19T13:54:46.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.552+0000 7ff82a99f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82415dc30 con 0x7ff824157c50 2023-12-19T13:54:46.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.553+0000 7ff81bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff824157c50 0x7ff8240b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:46.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.553+0000 7ff81bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff824157c50 0x7ff8240b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:43060/0 (socket says 172.21.15.113:43060) 2023-12-19T13:54:46.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.553+0000 7ff81bfff640 1 -- 172.21.15.113:0/2608354641 learned_addr learned my addr 172.21.15.113:0/2608354641 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:46.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.553+0000 7ff823fff640 1 --2- 172.21.15.113:0/2608354641 >> v2:172.21.15.151:3300/0 conn(0x7ff8240b2460 0x7ff824070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:46.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.554+0000 7ff81bfff640 1 -- 172.21.15.113:0/2608354641 >> v2:172.21.15.151:3300/0 conn(0x7ff8240b2460 msgr2=0x7ff824070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:46.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.554+0000 7ff81bfff640 1 --2- 172.21.15.113:0/2608354641 >> v2:172.21.15.151:3300/0 conn(0x7ff8240b2460 0x7ff824070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.554+0000 7ff81bfff640 1 -- 172.21.15.113:0/2608354641 >> v1:172.21.15.151:6789/0 conn(0x7ff8240b6960 legacy=0x7ff82406d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:46.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.554+0000 7ff81bfff640 1 -- 172.21.15.113:0/2608354641 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82415df10 con 0x7ff824157c50 2023-12-19T13:54:46.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.554+0000 7ff8237fe640 1 -- 172.21.15.113:0/2608354641 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235787163 0 0) 0x7ff8240b2d80 con 0x7ff8240b6960 2023-12-19T13:54:46.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.555+0000 7ff81bfff640 1 --2- 172.21.15.113:0/2608354641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff824157c50 0x7ff8240b2840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009870 tx=0x7ff80c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a27bf4c4668ebe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:46.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.556+0000 7ff8237fe640 1 -- 172.21.15.113:0/2608354641 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c030840 con 0x7ff824157c50 2023-12-19T13:54:46.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.556+0000 7ff8237fe640 1 -- 172.21.15.113:0/2608354641 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c0309a0 con 0x7ff824157c50 2023-12-19T13:54:46.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.556+0000 7ff8237fe640 1 -- 172.21.15.113:0/2608354641 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c030d30 con 0x7ff824157c50 2023-12-19T13:54:46.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 -- 172.21.15.113:0/2608354641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff824157c50 msgr2=0x7ff8240b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:46.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 --2- 172.21.15.113:0/2608354641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff824157c50 0x7ff8240b2840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009870 tx=0x7ff80c02b980 comp rx=0 tx=0).stop 2023-12-19T13:54:46.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 -- 172.21.15.113:0/2608354641 shutdown_connections 2023-12-19T13:54:46.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 --2- 172.21.15.113:0/2608354641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff824157c50 0x7ff8240b2840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 --2- 172.21.15.113:0/2608354641 >> v2:172.21.15.151:3300/0 conn(0x7ff8240b2460 0x7ff824070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 -- 172.21.15.113:0/2608354641 >> 172.21.15.113:0/2608354641 conn(0x7ff8240659d0 msgr2=0x7ff824065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:46.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 -- 172.21.15.113:0/2608354641 shutdown_connections 2023-12-19T13:54:46.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.557+0000 7ff82a99f640 1 -- 172.21.15.113:0/2608354641 wait complete. 2023-12-19T13:54:46.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.559+0000 7ff82a99f640 1 Processor -- start 2023-12-19T13:54:46.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.559+0000 7ff82a99f640 1 -- start start 2023-12-19T13:54:46.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.560+0000 7ff82a99f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8240b2460 0x7ff824140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:46.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.560+0000 7ff82a99f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8240b6960 0x7ff82414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:46.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.560+0000 7ff82a99f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff824157c50 0x7ff824070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:46.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.560+0000 7ff82a99f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff824151580 con 0x7ff824157c50 2023-12-19T13:54:46.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.560+0000 7ff82a99f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff824141470 con 0x7ff8240b2460 2023-12-19T13:54:46.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.560+0000 7ff82a99f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff824150900 con 0x7ff8240b6960 2023-12-19T13:54:46.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff824157c50 0x7ff824070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff824157c50 0x7ff824070cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58200/0 (socket says 172.21.15.113:58200) 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 -- 172.21.15.113:0/1813445490 learned_addr learned my addr 172.21.15.113:0/1813445490 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff823fff640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8240b2460 0x7ff824140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff81bfff640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8240b6960 0x7ff82414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 -- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8240b6960 msgr2=0x7ff82414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8240b6960 0x7ff82414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 -- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8240b2460 msgr2=0x7ff824140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8240b2460 0x7ff824140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff828f3c640 1 -- 172.21.15.113:0/1813445490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c0094d0 con 0x7ff824157c50 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff823fff640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8240b2460 0x7ff824140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.561+0000 7ff81bfff640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8240b6960 0x7ff82414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.562+0000 7ff828f3c640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff824157c50 0x7ff824070cc0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c740 tx=0x7ff81c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.562+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c003da0 con 0x7ff824157c50 2023-12-19T13:54:46.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.562+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c00ce50 con 0x7ff824157c50 2023-12-19T13:54:46.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.562+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff824150be0 con 0x7ff824157c50 2023-12-19T13:54:46.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.562+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c005290 con 0x7ff824157c50 2023-12-19T13:54:46.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.562+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8241511a0 con 0x7ff824157c50 2023-12-19T13:54:46.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.563+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8241516c0 con 0x7ff824157c50 2023-12-19T13:54:46.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.564+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff81c0053f0 con 0x7ff824157c50 2023-12-19T13:54:46.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.566+0000 7ff8217fa640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff80406a460 0x7ff80406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:46.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.566+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff81c088150 con 0x7ff824157c50 2023-12-19T13:54:46.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.566+0000 7ff823fff640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff80406a460 0x7ff80406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:46.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.566+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7ff804071f90 con 0x7ff824157c50 2023-12-19T13:54:46.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.567+0000 7ff823fff640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff80406a460 0x7ff80406c920 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff814009a20 tx=0x7ff814008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:46.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.571+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff81c017060 con 0x7ff824157c50 2023-12-19T13:54:46.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.761+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff824061910 con 0x7ff824157c50 2023-12-19T13:54:46.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.764+0000 7ff8217fa640 1 -- 172.21.15.113:0/1813445490 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+33625 (secure 0 0 0) 0x7ff8241516c0 con 0x7ff824157c50 2023-12-19T13:54:46.765 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:46.765 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:46.765 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 149, 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:54:43.588740+0000", 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:54:46.766 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 17, 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:54:46.767 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:46.768 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.769 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:46.770 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:46.771 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.772 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 16, 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:23.704080+0000", 2023-12-19T13:54:46.773 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:54:46.774 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "146", 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:46.775 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:46.776 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:46.777 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 2.25, 2023-12-19T13:54:46.778 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 2.25, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2.25, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2.25, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 17, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:25.109205+0000", 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:46.779 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:46.780 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "149", 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:46.781 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:46.782 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:46.783 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:54:46.784 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.785 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.786 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:54:46.787 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.788 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:46.789 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.790 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:54:46.791 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.792 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.793 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.794 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.795 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.796 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.797 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.798 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.799 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.800 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.801 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.802 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.803 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.804 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:54:46.805 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.806 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:54:46.807 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.808 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.809 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.810 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.811 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.812 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.813 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.814 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.815 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.817 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.818 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.819 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:54:46.820 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:46.821 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:54:46.822 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.823 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.824 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:46.825 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:46.826 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.827 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.828 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.829 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.830 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:46.831 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:54:46.832 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:54:46.833 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:54:46.834 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:54:46.834 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:46.834 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:46.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff80406a460 msgr2=0x7ff80406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:46.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff80406a460 0x7ff80406c920 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff814009a20 tx=0x7ff814008040 comp rx=0 tx=0).stop 2023-12-19T13:54:46.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff824157c50 msgr2=0x7ff824070cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:46.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff824157c50 0x7ff824070cc0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c740 tx=0x7ff81c00cc00 comp rx=0 tx=0).stop 2023-12-19T13:54:46.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 shutdown_connections 2023-12-19T13:54:46.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff80406a460 0x7ff80406c920 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff824157c50 0x7ff824070cc0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8240b6960 0x7ff82414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 --2- 172.21.15.113:0/1813445490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8240b2460 0x7ff824140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:46.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.767+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 >> 172.21.15.113:0/1813445490 conn(0x7ff8240659d0 msgr2=0x7ff8240b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:46.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.768+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 shutdown_connections 2023-12-19T13:54:46.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:46.768+0000 7ff82a99f640 1 -- 172.21.15.113:0/1813445490 wait complete. 2023-12-19T13:54:46.836 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:54:49.637 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:49.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:51.837 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:54:52.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.062+0000 7fb5dffff640 1 Processor -- start 2023-12-19T13:54:52.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.062+0000 7fb5dffff640 1 -- start start 2023-12-19T13:54:52.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0146e30 0x7fb5e00b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5dffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb5e00b7ea0 0x7fb5e00d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5dffff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e00b8300 con 0x7fb5e00d0a90 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5dffff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e0147210 con 0x7fb5e00b7ea0 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5dffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00d2370 con 0x7fb5e0146e30 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5d7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb5e00b7ea0 0x7fb5e00d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5d7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb5e00b7ea0 0x7fb5e00d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54398/0 (socket says 172.21.15.113:54398) 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5df7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb5e00d0a90 0x7fb5e006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42842/0 (socket says 172.21.15.113:42842) 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.064+0000 7fb5d7fff640 1 -- 172.21.15.113:0/1843551540 learned_addr learned my addr 172.21.15.113:0/1843551540 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:52.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.065+0000 7fb5deffd640 1 --2- 172.21.15.113:0/1843551540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0146e30 0x7fb5e00b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.065+0000 7fb5d7fff640 1 -- 172.21.15.113:0/1843551540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0146e30 msgr2=0x7fb5e00b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.065+0000 7fb5d7fff640 1 --2- 172.21.15.113:0/1843551540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0146e30 0x7fb5e00b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.065+0000 7fb5d7fff640 1 -- 172.21.15.113:0/1843551540 >> v1:172.21.15.113:6789/0 conn(0x7fb5e00d0a90 legacy=0x7fb5e006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.065+0000 7fb5de7fc640 1 -- 172.21.15.113:0/1843551540 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251382390 0 0) 0x7fb5e00b8300 con 0x7fb5e00d0a90 2023-12-19T13:54:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.065+0000 7fb5d7fff640 1 -- 172.21.15.113:0/1843551540 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00d12d0 con 0x7fb5e00b7ea0 2023-12-19T13:54:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.066+0000 7fb5d7fff640 1 --2- 172.21.15.113:0/1843551540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e00b7ea0 0x7fb5e00d0550 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80098a0 tx=0x7fb5c802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514422e55b8f228 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.066+0000 7fb5de7fc640 1 -- 172.21.15.113:0/1843551540 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8031640 con 0x7fb5e00b7ea0 2023-12-19T13:54:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.066+0000 7fb5de7fc640 1 -- 172.21.15.113:0/1843551540 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c80317a0 con 0x7fb5e00b7ea0 2023-12-19T13:54:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.066+0000 7fb5de7fc640 1 -- 172.21.15.113:0/1843551540 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8031b30 con 0x7fb5e00b7ea0 2023-12-19T13:54:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 -- 172.21.15.113:0/1843551540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e00b7ea0 msgr2=0x7fb5e00d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 --2- 172.21.15.113:0/1843551540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e00b7ea0 0x7fb5e00d0550 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80098a0 tx=0x7fb5c802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 -- 172.21.15.113:0/1843551540 shutdown_connections 2023-12-19T13:54:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 --2- 172.21.15.113:0/1843551540 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e00b7ea0 0x7fb5e00d0550 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 --2- 172.21.15.113:0/1843551540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0146e30 0x7fb5e00b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 -- 172.21.15.113:0/1843551540 >> 172.21.15.113:0/1843551540 conn(0x7fb5e00b2990 msgr2=0x7fb5e00b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 -- 172.21.15.113:0/1843551540 shutdown_connections 2023-12-19T13:54:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.067+0000 7fb5dffff640 1 -- 172.21.15.113:0/1843551540 wait complete. 2023-12-19T13:54:52.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.069+0000 7fb5dffff640 1 Processor -- start 2023-12-19T13:54:52.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.069+0000 7fb5dffff640 1 -- start start 2023-12-19T13:54:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e00b7ea0 0x7fb5e013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e00d0a90 0x7fb5e01e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e0146e30 0x7fb5e01f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5dffff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e01e25f0 con 0x7fb5e0146e30 2023-12-19T13:54:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5dffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e01f6b60 con 0x7fb5e00d0a90 2023-12-19T13:54:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5dffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e01d2560 con 0x7fb5e00b7ea0 2023-12-19T13:54:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5df7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e0146e30 0x7fb5e01f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5df7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e0146e30 0x7fb5e01f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54400/0 (socket says 172.21.15.113:54400) 2023-12-19T13:54:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.070+0000 7fb5df7fe640 1 -- 172.21.15.113:0/3932510182 learned_addr learned my addr 172.21.15.113:0/3932510182 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5deffd640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e00b7ea0 0x7fb5e013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5d7fff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e00d0a90 0x7fb5e01e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5df7fe640 1 -- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e00b7ea0 msgr2=0x7fb5e013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5df7fe640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e00b7ea0 0x7fb5e013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5df7fe640 1 -- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e00d0a90 msgr2=0x7fb5e01e20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5df7fe640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e00d0a90 0x7fb5e01e20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5df7fe640 1 -- 172.21.15.113:0/3932510182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80094d0 con 0x7fb5e0146e30 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5d7fff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e00d0a90 0x7fb5e01e20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5df7fe640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e0146e30 0x7fb5e01f6620 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800c7e0 tx=0x7fb5d800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800a640 con 0x7fb5e0146e30 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.071+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d800a7c0 con 0x7fb5e0146e30 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.072+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e01d2840 con 0x7fb5e0146e30 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.072+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800ab70 con 0x7fb5e0146e30 2023-12-19T13:54:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.072+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e01d2e00 con 0x7fb5e0146e30 2023-12-19T13:54:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.073+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e0061910 con 0x7fb5e0146e30 2023-12-19T13:54:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.074+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5d800acd0 con 0x7fb5e0146e30 2023-12-19T13:54:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.075+0000 7fb5d77fe640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c006a430 0x7fb5c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.075+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5d8087ed0 con 0x7fb5e0146e30 2023-12-19T13:54:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.075+0000 7fb5deffd640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c006a430 0x7fb5c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.076+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fb5c0071f60 con 0x7fb5e0146e30 2023-12-19T13:54:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.076+0000 7fb5deffd640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c006a430 0x7fb5c006c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0006fd0 tx=0x7fb5d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.080+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5d8018020 con 0x7fb5e0146e30 2023-12-19T13:54:52.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.270+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb5e013c590 con 0x7fb5e0146e30 2023-12-19T13:54:52.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.272+0000 7fb5d77fe640 1 -- 172.21.15.113:0/3932510182 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+33625 (secure 0 0 0) 0x7fb5d80534c0 con 0x7fb5e0146e30 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 149, 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:54:43.588740+0000", 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:54:52.273 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 17, 2023-12-19T13:54:52.274 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:54:52.276 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:54:52.277 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:52.278 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:52.279 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:52.280 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:52.281 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 16, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:23.704080+0000", 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:52.282 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:54:52.283 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "146", 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:52.284 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:52.285 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:52.286 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.287 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 2.25, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 2.25, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2.25, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2.25, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 17, 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:25.109205+0000", 2023-12-19T13:54:52.288 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:54:52.289 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "149", 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:52.291 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:52.292 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:52.293 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:52.294 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:54:52.295 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.296 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.297 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.298 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.299 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.300 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.301 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.302 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.303 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:54:52.304 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.305 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.306 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.307 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.308 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.309 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.310 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.311 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.312 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.313 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.314 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.315 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.316 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.317 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.318 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:54:52.319 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:52.320 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:52.321 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.322 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:54:52.323 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.324 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.325 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.326 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.327 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.328 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.329 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.330 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:54:52.331 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:52.332 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.333 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.334 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:54:52.335 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:52.336 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:54:52.337 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.338 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.339 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.340 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.341 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:52.342 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:54:52.343 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:54:52.344 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:54:52.345 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:54:52.345 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:54:52.345 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:52.345 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:52.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c006a430 msgr2=0x7fb5c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c006a430 0x7fb5c006c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0006fd0 tx=0x7fb5d0008040 comp rx=0 tx=0).stop 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e0146e30 msgr2=0x7fb5e01f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e0146e30 0x7fb5e01f6620 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800c7e0 tx=0x7fb5d800cca0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 shutdown_connections 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c006a430 0x7fb5c006c8f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e0146e30 0x7fb5e01f6620 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e00d0a90 0x7fb5e01e20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3932510182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e00b7ea0 0x7fb5e013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.274+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 >> 172.21.15.113:0/3932510182 conn(0x7fb5e00b2990 msgr2=0x7fb5e00b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.275+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 shutdown_connections 2023-12-19T13:54:52.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:52.275+0000 7fb5dffff640 1 -- 172.21.15.113:0/3932510182 wait complete. 2023-12-19T13:54:52.348 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T13:54:57.349 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:54:57.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.571+0000 7f1d3a58b640 1 Processor -- start 2023-12-19T13:54:57.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.571+0000 7f1d3a58b640 1 -- start start 2023-12-19T13:54:57.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.572+0000 7f1d3a58b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d340b0810 0x7f1d34164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:57.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.572+0000 7f1d3a58b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340ae640 con 0x7f1d340ae110 2023-12-19T13:54:57.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.572+0000 7f1d3a58b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340ae920 con 0x7f1d34157bf0 2023-12-19T13:54:57.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.572+0000 7f1d3a58b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3406b8c0 con 0x7f1d340b0810 2023-12-19T13:54:57.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.573+0000 7f1d38b28640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d340b0810 0x7f1d34164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:57.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.573+0000 7f1d2bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1d340ae110 0x7f1d340b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42846/0 (socket says 172.21.15.113:42846) 2023-12-19T13:54:57.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.573+0000 7f1d2bfff640 1 -- 172.21.15.113:0/2996033027 learned_addr learned my addr 172.21.15.113:0/2996033027 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:57.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.573+0000 7f1d38b28640 1 -- 172.21.15.113:0/2996033027 >> v1:172.21.15.151:6789/0 conn(0x7f1d34157bf0 legacy=0x7f1d3415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:57.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.573+0000 7f1d38b28640 1 -- 172.21.15.113:0/2996033027 >> v1:172.21.15.113:6789/0 conn(0x7f1d340ae110 legacy=0x7f1d340b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:57.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.573+0000 7f1d38b28640 1 -- 172.21.15.113:0/2996033027 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340aec00 con 0x7f1d340b0810 2023-12-19T13:54:57.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.573+0000 7f1d337fe640 1 -- 172.21.15.113:0/2996033027 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184944266 0 0) 0x7f1d340ae640 con 0x7f1d340ae110 2023-12-19T13:54:57.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.574+0000 7f1d38b28640 1 --2- 172.21.15.113:0/2996033027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340b0810 0x7f1d34164ed0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0097a0 tx=0x7f1d2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5af1ecee1664083 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:57.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d337fe640 1 -- 172.21.15.113:0/2996033027 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c031830 con 0x7f1d340b0810 2023-12-19T13:54:57.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d337fe640 1 -- 172.21.15.113:0/2996033027 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c031990 con 0x7f1d340b0810 2023-12-19T13:54:57.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d337fe640 1 -- 172.21.15.113:0/2996033027 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c031d20 con 0x7f1d340b0810 2023-12-19T13:54:57.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d3a58b640 1 -- 172.21.15.113:0/2996033027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340b0810 msgr2=0x7f1d34164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:57.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/2996033027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340b0810 0x7f1d34164ed0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0097a0 tx=0x7f1d2c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d3a58b640 1 -- 172.21.15.113:0/2996033027 shutdown_connections 2023-12-19T13:54:57.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/2996033027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340b0810 0x7f1d34164ed0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d3a58b640 1 -- 172.21.15.113:0/2996033027 >> 172.21.15.113:0/2996033027 conn(0x7f1d340cbb70 msgr2=0x7f1d340cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:57.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d3a58b640 1 -- 172.21.15.113:0/2996033027 shutdown_connections 2023-12-19T13:54:57.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.575+0000 7f1d3a58b640 1 -- 172.21.15.113:0/2996033027 wait complete. 2023-12-19T13:54:57.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.577+0000 7f1d3a58b640 1 Processor -- start 2023-12-19T13:54:57.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.577+0000 7f1d3a58b640 1 -- start start 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d3a58b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340ae110 0x7f1d3415b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d3a58b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d340b0810 0x7f1d341525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d3a58b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d34157bf0 0x7f1d34142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d3a58b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34143150 con 0x7f1d340ae110 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d3a58b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34152cb0 con 0x7f1d34157bf0 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d3a58b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34152f90 con 0x7f1d340b0810 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d33fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340ae110 0x7f1d3415b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:57.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d33fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340ae110 0x7f1d3415b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54414/0 (socket says 172.21.15.113:54414) 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.578+0000 7f1d33fff640 1 -- 172.21.15.113:0/3852168143 learned_addr learned my addr 172.21.15.113:0/3852168143 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d33fff640 1 -- 172.21.15.113:0/3852168143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d340b0810 msgr2=0x7f1d341525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d33fff640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d340b0810 0x7f1d341525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d33fff640 1 -- 172.21.15.113:0/3852168143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d34157bf0 msgr2=0x7f1d34142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d33fff640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d34157bf0 0x7f1d34142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d33fff640 1 -- 172.21.15.113:0/3852168143 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c009400 con 0x7f1d340ae110 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d33fff640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340ae110 0x7f1d3415b9e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400ba50 tx=0x7f1d2400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d317fa640 1 -- 172.21.15.113:0/3852168143 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2400cbe0 con 0x7f1d340ae110 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d317fa640 1 -- 172.21.15.113:0/3852168143 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2400cd80 con 0x7f1d340ae110 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d317fa640 1 -- 172.21.15.113:0/3852168143 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24014680 con 0x7f1d340ae110 2023-12-19T13:54:57.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.579+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d34153270 con 0x7f1d340ae110 2023-12-19T13:54:57.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.580+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d34153830 con 0x7f1d340ae110 2023-12-19T13:54:57.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.581+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d34061910 con 0x7f1d340ae110 2023-12-19T13:54:57.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.582+0000 7f1d317fa640 1 -- 172.21.15.113:0/3852168143 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d240147e0 con 0x7f1d340ae110 2023-12-19T13:54:57.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.582+0000 7f1d317fa640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d1406a430 0x7f1d1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:57.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.583+0000 7f1d317fa640 1 -- 172.21.15.113:0/3852168143 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d240887a0 con 0x7f1d340ae110 2023-12-19T13:54:57.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.583+0000 7f1d2bfff640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d1406a430 0x7f1d1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:57.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.584+0000 7f1d2bfff640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d1406a430 0x7f1d1406c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c007fd0 tx=0x7f1d1c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:57.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.587+0000 7f1d317fa640 1 -- 172.21.15.113:0/3852168143 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d24053e40 con 0x7f1d340ae110 2023-12-19T13:54:57.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.778+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1d3415e7f0 con 0x7f1d340ae110 2023-12-19T13:54:57.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.779+0000 7f1d317fa640 1 -- 172.21.15.113:0/3852168143 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v150) v1 ==== 81+0+33606 (secure 0 0 0) 0x7f1d24057460 con 0x7f1d340ae110 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 150, 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:54:53.593502+0000", 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:54:57.781 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:54:57.782 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 17, 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:57.783 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:57.784 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:57.785 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:57.786 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:57.787 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:54:57.788 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.789 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:57.789 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:54:57.789 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:54:57.789 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:54:57.789 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:54:57.789 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:54:57.789 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 16, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:23.704080+0000", 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:57.791 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "146", 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:57.792 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:57.793 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:57.794 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 2.25, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 2.25, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2.25, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2.25, 2023-12-19T13:54:57.795 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 17, 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:25.109205+0000", 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:57.796 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:54:57.797 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "150", 2023-12-19T13:54:57.798 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:57.799 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:57.800 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:54:57.801 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:57.802 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.803 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.804 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.805 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.806 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.806 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:54:57.806 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.806 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.806 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.806 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.807 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.808 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.809 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.809 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:54:57.809 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:57.809 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.809 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.809 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.810 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.811 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.811 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.811 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:57.811 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.811 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.811 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.812 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.812 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.812 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.812 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.812 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.812 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.812 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.813 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.813 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.813 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.813 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.813 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.813 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:54:57.813 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.814 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.815 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.816 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.817 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.818 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.819 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.820 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.821 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.822 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:54:57.823 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.824 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.825 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:54:57.826 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.827 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:54:57.828 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.829 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.830 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:54:57.831 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:54:57.832 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:54:57.833 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:54:57.834 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.835 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.836 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.837 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.838 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.839 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.840 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.841 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.842 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:54:57.843 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:57.844 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:57.845 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:54:57.846 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.847 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.848 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.849 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:57.850 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.851 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.852 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:57.853 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:54:57.854 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:57.855 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:54:57.856 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:54:57.857 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:54:57.858 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:54:57.858 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:54:57.858 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:54:57.858 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:54:57.858 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:57.858 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:57.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.782+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d1406a430 msgr2=0x7f1d1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.782+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d1406a430 0x7f1d1406c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c007fd0 tx=0x7f1d1c007920 comp rx=0 tx=0).stop 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.782+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340ae110 msgr2=0x7f1d3415b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.782+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340ae110 0x7f1d3415b9e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400ba50 tx=0x7f1d2400bf10 comp rx=0 tx=0).stop 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 shutdown_connections 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d1406a430 0x7f1d1406c8f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d34157bf0 0x7f1d34142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d340b0810 0x7f1d341525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 --2- 172.21.15.113:0/3852168143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d340ae110 0x7f1d3415b9e0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 >> 172.21.15.113:0/3852168143 conn(0x7f1d340cbb70 msgr2=0x7f1d3406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 shutdown_connections 2023-12-19T13:54:57.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:57.783+0000 7f1d3a58b640 1 -- 172.21.15.113:0/3852168143 wait complete. 2023-12-19T13:54:57.861 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T13:54:57.862 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:54:58.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.080+0000 7f8377530640 1 Processor -- start 2023-12-19T13:54:58.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.081+0000 7f8377530640 1 -- start start 2023-12-19T13:54:58.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.082+0000 7f8377530640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015b1e0 0x7f837015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.082+0000 7f8377530640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f837015a8a0 0x7f837015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.082+0000 7f8377530640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837006b520 con 0x7f8370159f80 2023-12-19T13:54:58.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.082+0000 7f8377530640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700b2b20 con 0x7f837015a8a0 2023-12-19T13:54:58.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.082+0000 7f8377530640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b2fb0 con 0x7f837015b1e0 2023-12-19T13:54:58.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.083+0000 7f837652e640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8370159f80 0x7f837006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:43782/0 (socket says 172.21.15.113:43782) 2023-12-19T13:54:58.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.083+0000 7f837652e640 1 -- 172.21.15.113:0/2610973031 learned_addr learned my addr 172.21.15.113:0/2610973031 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:58.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.083+0000 7f8375d2d640 1 --2- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015b1e0 0x7f837015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.084+0000 7f8376d2f640 1 --2- 172.21.15.113:0/2610973031 >> v2:172.21.15.151:3300/0 conn(0x7f837015a8a0 0x7f837015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.084+0000 7f837552c640 1 -- 172.21.15.113:0/2610973031 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298283816 0 0) 0x7f837006b520 con 0x7f8370159f80 2023-12-19T13:54:58.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.084+0000 7f837552c640 1 -- 172.21.15.113:0/2610973031 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8360003520 con 0x7f8370159f80 2023-12-19T13:54:58.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.084+0000 7f8376d2f640 1 -- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015b1e0 msgr2=0x7f837015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:58.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.084+0000 7f8376d2f640 1 --2- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015b1e0 0x7f837015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.084+0000 7f8376d2f640 1 -- 172.21.15.113:0/2610973031 >> v1:172.21.15.151:6789/0 conn(0x7f8370159f80 legacy=0x7f837006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.084+0000 7f8376d2f640 1 -- 172.21.15.113:0/2610973031 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700b1f10 con 0x7f837015a8a0 2023-12-19T13:54:58.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.086+0000 7f8376d2f640 1 --2- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f837015a8a0 0x7f837015b770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83680097a0 tx=0x7f836802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f90e57c6551bf94 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.086+0000 7f837552c640 1 -- 172.21.15.113:0/2610973031 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368030610 con 0x7f837015a8a0 2023-12-19T13:54:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f837552c640 1 -- 172.21.15.113:0/2610973031 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368030770 con 0x7f837015a8a0 2023-12-19T13:54:58.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f837552c640 1 -- 172.21.15.113:0/2610973031 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368030b00 con 0x7f837015a8a0 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 -- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f837015a8a0 msgr2=0x7f837015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 --2- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f837015a8a0 0x7f837015b770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83680097a0 tx=0x7f836802b960 comp rx=0 tx=0).stop 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 -- 172.21.15.113:0/2610973031 shutdown_connections 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 --2- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f837015a8a0 0x7f837015b770 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 --2- 172.21.15.113:0/2610973031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015b1e0 0x7f837015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 -- 172.21.15.113:0/2610973031 >> 172.21.15.113:0/2610973031 conn(0x7f83700b0100 msgr2=0x7f83700b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 -- 172.21.15.113:0/2610973031 shutdown_connections 2023-12-19T13:54:58.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.087+0000 7f8377530640 1 -- 172.21.15.113:0/2610973031 wait complete. 2023-12-19T13:54:58.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.089+0000 7f8377530640 1 Processor -- start 2023-12-19T13:54:58.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.089+0000 7f8377530640 1 -- start start 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.090+0000 7f8377530640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8370159f80 0x7f837006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.090+0000 7f8377530640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015a8a0 0x7f83701f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.090+0000 7f8377530640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f837015b1e0 0x7f837014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.090+0000 7f8377530640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83701f3b00 con 0x7f837015b1e0 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.090+0000 7f8377530640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837006b4b0 con 0x7f8370159f80 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.090+0000 7f8377530640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837014db00 con 0x7f837015a8a0 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f837015b1e0 0x7f837014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f837015b1e0 0x7f837014f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36516/0 (socket says 172.21.15.113:36516) 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 -- 172.21.15.113:0/2141508593 learned_addr learned my addr 172.21.15.113:0/2141508593 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f837652e640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8370159f80 0x7f837006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8375d2d640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015a8a0 0x7f83701f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 -- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015a8a0 msgr2=0x7f83701f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015a8a0 0x7f83701f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 -- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8370159f80 msgr2=0x7f837006d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8370159f80 0x7f837006d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.091+0000 7f8376d2f640 1 -- 172.21.15.113:0/2141508593 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009400 con 0x7f837015b1e0 2023-12-19T13:54:58.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.092+0000 7f8376d2f640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f837015b1e0 0x7f837014f3a0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f83680098c0 tx=0x7f8368004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.092+0000 7f836effd640 1 -- 172.21.15.113:0/2141508593 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836803e040 con 0x7f837015b1e0 2023-12-19T13:54:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.092+0000 7f836effd640 1 -- 172.21.15.113:0/2141508593 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83680398e0 con 0x7f837015b1e0 2023-12-19T13:54:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.092+0000 7f836effd640 1 -- 172.21.15.113:0/2141508593 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368039c70 con 0x7f837015b1e0 2023-12-19T13:54:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.092+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837014dde0 con 0x7f837015b1e0 2023-12-19T13:54:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.092+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837014e3a0 con 0x7f837015b1e0 2023-12-19T13:54:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.093+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837006b670 con 0x7f837015b1e0 2023-12-19T13:54:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.094+0000 7f836effd640 1 -- 172.21.15.113:0/2141508593 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f836804d3b0 con 0x7f837015b1e0 2023-12-19T13:54:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.095+0000 7f836effd640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f835406a430 0x7f835406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.095+0000 7f836effd640 1 -- 172.21.15.113:0/2141508593 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83680aae30 con 0x7f837015b1e0 2023-12-19T13:54:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.095+0000 7f837652e640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f835406a430 0x7f835406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.096+0000 7f837652e640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f835406a430 0x7f835406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8364001560 tx=0x7f8364009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:58.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.099+0000 7f836effd640 1 -- 172.21.15.113:0/2141508593 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f83680765b0 con 0x7f837015b1e0 2023-12-19T13:54:58.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.290+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8370061910 con 0x7f837015b1e0 2023-12-19T13:54:58.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.292+0000 7f836effd640 1 -- 172.21.15.113:0/2141508593 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v150) v1 ==== 81+0+33606 (secure 0 0 0) 0x7f8368079bd0 con 0x7f837015b1e0 2023-12-19T13:54:58.292 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:58.292 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:54:58.292 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 150, 2023-12-19T13:54:58.292 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:54:53.593502+0000", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:58.293 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 17, 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.294 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:58.295 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:54:58.296 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:58.297 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:58.298 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:54:58.299 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.300 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 16, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:23.704080+0000", 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:58.301 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:58.302 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "146", 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:58.303 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:58.304 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:54:58.305 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 2.25, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 2.25, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2.25, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2.25, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:58.306 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 17, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:54:25.109205+0000", 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:54:58.307 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:54:58.308 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "150", 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:54:58.309 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:54:58.310 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:54:58.311 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.312 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.313 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.314 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.315 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.316 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.317 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.318 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.319 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.320 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.321 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:54:58.322 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.323 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:54:58.324 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:54:58.325 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:54:58.326 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:54:58.327 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.328 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.329 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.330 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.331 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.332 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:54:58.333 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.334 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.335 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.336 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.337 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:54:58.338 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.339 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.340 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.341 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.342 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:54:58.343 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.344 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.345 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.346 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.347 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.348 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.349 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:54:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 145, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.351 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.352 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.353 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:54:58.354 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:54:58.355 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.356 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.357 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.358 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.359 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:54:58.360 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:54:58.361 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:54:58.362 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:54:58.363 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:54:58.363 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:54:58.363 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:54:58.363 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:54:58.363 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:54:58.363 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:54:58.363 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f835406a430 msgr2=0x7f835406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f835406a430 0x7f835406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8364001560 tx=0x7f8364009040 comp rx=0 tx=0).stop 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f837015b1e0 msgr2=0x7f837014f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f837015b1e0 0x7f837014f3a0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f83680098c0 tx=0x7f8368004730 comp rx=0 tx=0).stop 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 shutdown_connections 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f835406a430 0x7f835406c8f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f837015b1e0 0x7f837014f3a0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f837015a8a0 0x7f83701f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 --2- 172.21.15.113:0/2141508593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8370159f80 0x7f837006d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 >> 172.21.15.113:0/2141508593 conn(0x7f83700b0100 msgr2=0x7f83700cbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 shutdown_connections 2023-12-19T13:54:58.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.295+0000 7f8377530640 1 -- 172.21.15.113:0/2141508593 wait complete. 2023-12-19T13:54:58.366 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:54:58.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.575+0000 7f17527ab640 1 Processor -- start 2023-12-19T13:54:58.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.576+0000 7f17527ab640 1 -- start start 2023-12-19T13:54:58.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.577+0000 7f17527ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f174c0d2b00 0x7f174c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.577+0000 7f17527ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0ce110 0x7f174c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.577+0000 7f17527ab640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c0cd840 con 0x7f174c146e10 2023-12-19T13:54:58.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.577+0000 7f17527ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0d2430 con 0x7f174c0d2b00 2023-12-19T13:54:58.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.577+0000 7f17527ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0ceac0 con 0x7f174c0ce110 2023-12-19T13:54:58.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.578+0000 7f1750d48640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0ce110 0x7f174c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.578+0000 7f174bfff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f174c146e10 0x7f174c0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:43794/0 (socket says 172.21.15.113:43794) 2023-12-19T13:54:58.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.578+0000 7f174bfff640 1 -- 172.21.15.113:0/3673894242 learned_addr learned my addr 172.21.15.113:0/3673894242 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:54:58.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.578+0000 7f17437fe640 1 --2- 172.21.15.113:0/3673894242 >> v2:172.21.15.151:3300/0 conn(0x7f174c0d2b00 0x7f174c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.579+0000 7f174b7fe640 1 -- 172.21.15.113:0/3673894242 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299737878 0 0) 0x7f174c0cd840 con 0x7f174c146e10 2023-12-19T13:54:58.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.579+0000 7f174b7fe640 1 -- 172.21.15.113:0/3673894242 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1738003520 con 0x7f174c146e10 2023-12-19T13:54:58.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.579+0000 7f17437fe640 1 -- 172.21.15.113:0/3673894242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0ce110 msgr2=0x7f174c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:54:58.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.579+0000 7f17437fe640 1 --2- 172.21.15.113:0/3673894242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0ce110 0x7f174c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.579+0000 7f17437fe640 1 -- 172.21.15.113:0/3673894242 >> v1:172.21.15.151:6789/0 conn(0x7f174c146e10 legacy=0x7f174c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.579+0000 7f17437fe640 1 -- 172.21.15.113:0/3673894242 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0b6e90 con 0x7f174c0d2b00 2023-12-19T13:54:58.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.580+0000 7f17437fe640 1 --2- 172.21.15.113:0/3673894242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0d2b00 0x7f174c0d1ef0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f17340097d0 tx=0x7f173402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a80bb8e09303de2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:58.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.580+0000 7f174b7fe640 1 -- 172.21.15.113:0/3673894242 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734031800 con 0x7f174c0d2b00 2023-12-19T13:54:58.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f174b7fe640 1 -- 172.21.15.113:0/3673894242 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734031960 con 0x7f174c0d2b00 2023-12-19T13:54:58.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f174b7fe640 1 -- 172.21.15.113:0/3673894242 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734031cd0 con 0x7f174c0d2b00 2023-12-19T13:54:58.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 -- 172.21.15.113:0/3673894242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0d2b00 msgr2=0x7f174c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 --2- 172.21.15.113:0/3673894242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0d2b00 0x7f174c0d1ef0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f17340097d0 tx=0x7f173402b8a0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 -- 172.21.15.113:0/3673894242 shutdown_connections 2023-12-19T13:54:58.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 --2- 172.21.15.113:0/3673894242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0ce110 0x7f174c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 --2- 172.21.15.113:0/3673894242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0d2b00 0x7f174c0d1ef0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 -- 172.21.15.113:0/3673894242 >> 172.21.15.113:0/3673894242 conn(0x7f174c0b29c0 msgr2=0x7f174c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:58.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 -- 172.21.15.113:0/3673894242 shutdown_connections 2023-12-19T13:54:58.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.581+0000 7f17527ab640 1 -- 172.21.15.113:0/3673894242 wait complete. 2023-12-19T13:54:58.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.583+0000 7f17527ab640 1 Processor -- start 2023-12-19T13:54:58.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.583+0000 7f17527ab640 1 -- start start 2023-12-19T13:54:58.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f17527ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0ce110 0x7f174c1f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f17527ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0d2b00 0x7f174c161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f17527ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f174c146e10 0x7f174c161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f17527ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c15ffc0 con 0x7f174c146e10 2023-12-19T13:54:58.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f17527ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c15f340 con 0x7f174c0ce110 2023-12-19T13:54:58.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f17527ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c15f620 con 0x7f174c0d2b00 2023-12-19T13:54:58.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f1750d48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f174c146e10 0x7f174c161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f1750d48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f174c146e10 0x7f174c161550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36532/0 (socket says 172.21.15.113:36532) 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.584+0000 7f1750d48640 1 -- 172.21.15.113:0/365225581 learned_addr learned my addr 172.21.15.113:0/365225581 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f17437fe640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0d2b00 0x7f174c161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f174bfff640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0ce110 0x7f174c1f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f1750d48640 1 -- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0d2b00 msgr2=0x7f174c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f1750d48640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0d2b00 0x7f174c161010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f1750d48640 1 -- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0ce110 msgr2=0x7f174c1f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f1750d48640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0ce110 0x7f174c1f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f1750d48640 1 -- 172.21.15.113:0/365225581 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734009400 con 0x7f174c146e10 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f174bfff640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0ce110 0x7f174c1f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:54:58.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f1750d48640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f174c146e10 0x7f174c161550 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f174400efc0 tx=0x7f174400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:58.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f17497fa640 1 -- 172.21.15.113:0/365225581 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744009ba0 con 0x7f174c146e10 2023-12-19T13:54:58.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f17497fa640 1 -- 172.21.15.113:0/365225581 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400f040 con 0x7f174c146e10 2023-12-19T13:54:58.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f17497fa640 1 -- 172.21.15.113:0/365225581 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440146c0 con 0x7f174c146e10 2023-12-19T13:54:58.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.585+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c15f900 con 0x7f174c146e10 2023-12-19T13:54:58.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.586+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c1f5770 con 0x7f174c146e10 2023-12-19T13:54:58.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.587+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c160df0 con 0x7f174c146e10 2023-12-19T13:54:58.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.588+0000 7f17497fa640 1 -- 172.21.15.113:0/365225581 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1744014820 con 0x7f174c146e10 2023-12-19T13:54:58.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.589+0000 7f17497fa640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f172c06a430 0x7f172c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:54:58.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.590+0000 7f17497fa640 1 -- 172.21.15.113:0/365225581 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1744089580 con 0x7f174c146e10 2023-12-19T13:54:58.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.590+0000 7f174bfff640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f172c06a430 0x7f172c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:54:58.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.590+0000 7f174bfff640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f172c06a430 0x7f172c06c8f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f173c007fd0 tx=0x7f173c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:54:58.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.594+0000 7f17497fa640 1 -- 172.21.15.113:0/365225581 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1744054a50 con 0x7f174c146e10 2023-12-19T13:54:58.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.819+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f174c061910 con 0x7f174c146e10 2023-12-19T13:54:58.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.821+0000 7f17497fa640 1 -- 172.21.15.113:0/365225581 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f1744058070 con 0x7f174c146e10 2023-12-19T13:54:58.820 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:54:58.820 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:54:58.820 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:54:58.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f172c06a430 msgr2=0x7f172c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f172c06a430 0x7f172c06c8f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f173c007fd0 tx=0x7f173c009040 comp rx=0 tx=0).stop 2023-12-19T13:54:58.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f174c146e10 msgr2=0x7f174c161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:54:58.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f174c146e10 0x7f174c161550 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f174400efc0 tx=0x7f174400c490 comp rx=0 tx=0).stop 2023-12-19T13:54:58.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 shutdown_connections 2023-12-19T13:54:58.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f172c06a430 0x7f172c06c8f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f174c146e10 0x7f174c161550 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f174c0d2b00 0x7f174c161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 --2- 172.21.15.113:0/365225581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f174c0ce110 0x7f174c1f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:54:58.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 >> 172.21.15.113:0/365225581 conn(0x7f174c0b29c0 msgr2=0x7f174c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:54:58.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 shutdown_connections 2023-12-19T13:54:58.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:54:58.823+0000 7f17527ab640 1 -- 172.21.15.113:0/365225581 wait complete. 2023-12-19T13:54:58.840 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:54:59.063 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":7806,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":32.958066137000003,"mdsmap_epoch":65,"osdmap_epoch":150,"osdmap_epoch_barrier":149,"uptime":38.658864090000002} 2023-12-19T13:54:59.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 7806, "mdsmap_epoch": 65, "osdmap_epoch": 150, "osdmap_epoch_barrier": 149, "rank_uptime": 32.958066137, "state": "up:active", "uptime": 38.65886409, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:54:59.063 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T13:54:59.063 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:59.064 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:59.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:54:59.114 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T13:54:59.581 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T13:54:59.582 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T13:54:59.582 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.370539 s, 141 MB/s 2023-12-19T13:54:59.583 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:54:59.583 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:54:59.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:54:59.804 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:54:59.805 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:59.805 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:59.866 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:54:59.866 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:54:59.920 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:00.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.127+0000 7f14b9841640 1 Processor -- start 2023-12-19T13:55:00.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.127+0000 7f14b9841640 1 -- start start 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.128+0000 7f14b9841640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f14b415e0b0 0x7f14b415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.128+0000 7f14b9841640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cfcd0 0x7f14b40d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b9841640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b4161f10 con 0x7f14b40b2930 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b9841640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b415e9d0 con 0x7f14b415e0b0 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b9841640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40d0680 con 0x7f14b40cfcd0 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14abfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f14b40b2930 0x7f14b4160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52064/0 (socket says 172.21.15.113:52064) 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14abfff640 1 -- 172.21.15.113:0/2481262389 learned_addr learned my addr 172.21.15.113:0/2481262389 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:00.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b2ffd640 1 --2- 172.21.15.113:0/2481262389 >> v2:172.21.15.113:3300/0 conn(0x7f14b415e0b0 0x7f14b415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b27fc640 1 -- 172.21.15.113:0/2481262389 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259350039 0 0) 0x7f14b4161f10 con 0x7f14b40b2930 2023-12-19T13:55:00.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b27fc640 1 -- 172.21.15.113:0/2481262389 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a0003520 con 0x7f14b40b2930 2023-12-19T13:55:00.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b37fe640 1 --2- 172.21.15.113:0/2481262389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cfcd0 0x7f14b40d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b2ffd640 1 -- 172.21.15.113:0/2481262389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cfcd0 msgr2=0x7f14b40d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:00.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.129+0000 7f14b2ffd640 1 --2- 172.21.15.113:0/2481262389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cfcd0 0x7f14b40d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.130+0000 7f14b2ffd640 1 -- 172.21.15.113:0/2481262389 >> v1:172.21.15.113:6789/0 conn(0x7f14b40b2930 legacy=0x7f14b4160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.130+0000 7f14b2ffd640 1 -- 172.21.15.113:0/2481262389 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b41616f0 con 0x7f14b415e0b0 2023-12-19T13:55:00.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.131+0000 7f14b2ffd640 1 --2- 172.21.15.113:0/2481262389 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b415e490 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f14a40097d0 tx=0x7f14a402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917da2a958902247 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:00.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.131+0000 7f14b27fc640 1 -- 172.21.15.113:0/2481262389 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4031800 con 0x7f14b415e0b0 2023-12-19T13:55:00.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.131+0000 7f14b27fc640 1 -- 172.21.15.113:0/2481262389 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4031960 con 0x7f14b415e0b0 2023-12-19T13:55:00.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.131+0000 7f14b27fc640 1 -- 172.21.15.113:0/2481262389 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4031cf0 con 0x7f14b415e0b0 2023-12-19T13:55:00.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 -- 172.21.15.113:0/2481262389 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 msgr2=0x7f14b415e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 --2- 172.21.15.113:0/2481262389 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b415e490 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f14a40097d0 tx=0x7f14a402b8a0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 -- 172.21.15.113:0/2481262389 shutdown_connections 2023-12-19T13:55:00.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 --2- 172.21.15.113:0/2481262389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cfcd0 0x7f14b40d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 --2- 172.21.15.113:0/2481262389 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b415e490 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 -- 172.21.15.113:0/2481262389 >> 172.21.15.113:0/2481262389 conn(0x7f14b40cc770 msgr2=0x7f14b40ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:00.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 -- 172.21.15.113:0/2481262389 shutdown_connections 2023-12-19T13:55:00.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.132+0000 7f14b9841640 1 -- 172.21.15.113:0/2481262389 wait complete. 2023-12-19T13:55:00.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.134+0000 7f14b9841640 1 Processor -- start 2023-12-19T13:55:00.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.134+0000 7f14b9841640 1 -- start start 2023-12-19T13:55:00.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b9841640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40b2930 0x7f14b41484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b9841640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40cfcd0 0x7f14b4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b9841640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b4158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b9841640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40aedb0 con 0x7f14b415e0b0 2023-12-19T13:55:00.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b9841640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415cea0 con 0x7f14b40cfcd0 2023-12-19T13:55:00.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b9841640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415d180 con 0x7f14b40b2930 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b4158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b4158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36554/0 (socket says 172.21.15.113:36554) 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.135+0000 7f14b37fe640 1 -- 172.21.15.113:0/1291766422 learned_addr learned my addr 172.21.15.113:0/1291766422 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b2ffd640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40b2930 0x7f14b41484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b37fe640 1 -- 172.21.15.113:0/1291766422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40b2930 msgr2=0x7f14b41484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b37fe640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40b2930 0x7f14b41484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b37fe640 1 -- 172.21.15.113:0/1291766422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40cfcd0 msgr2=0x7f14b4158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b37fe640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40cfcd0 0x7f14b4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b37fe640 1 -- 172.21.15.113:0/1291766422 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009400 con 0x7f14b415e0b0 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b37fe640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b4158c70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00cd70 tx=0x7f14ac00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b0ff9640 1 -- 172.21.15.113:0/1291766422 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac003b90 con 0x7f14b415e0b0 2023-12-19T13:55:00.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b0ff9640 1 -- 172.21.15.113:0/1291766422 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac003cf0 con 0x7f14b415e0b0 2023-12-19T13:55:00.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b0ff9640 1 -- 172.21.15.113:0/1291766422 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac004240 con 0x7f14b415e0b0 2023-12-19T13:55:00.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b415d460 con 0x7f14b415e0b0 2023-12-19T13:55:00.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.136+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b415cbc0 con 0x7f14b415e0b0 2023-12-19T13:55:00.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.138+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b40cf2e0 con 0x7f14b415e0b0 2023-12-19T13:55:00.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.138+0000 7f14b0ff9640 1 -- 172.21.15.113:0/1291766422 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f14ac0043a0 con 0x7f14b415e0b0 2023-12-19T13:55:00.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.140+0000 7f14b0ff9640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f149406a460 0x7f149406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.140+0000 7f14b0ff9640 1 -- 172.21.15.113:0/1291766422 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14ac012070 con 0x7f14b415e0b0 2023-12-19T13:55:00.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.140+0000 7f14b2ffd640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f149406a460 0x7f149406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.141+0000 7f14b2ffd640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f149406a460 0x7f149406c920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f14a4036000 tx=0x7f14a403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:00.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.144+0000 7f14b0ff9640 1 -- 172.21.15.113:0/1291766422 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f14ac054910 con 0x7f14b415e0b0 2023-12-19T13:55:00.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.334+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14b4061910 con 0x7f14b415e0b0 2023-12-19T13:55:00.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.336+0000 7f14b0ff9640 1 -- 172.21.15.113:0/1291766422 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16171 (secure 0 0 0) 0x7f14ac057f30 con 0x7f14b415e0b0 2023-12-19T13:55:00.336 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:00.336 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":150,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:54:53.593502+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:00.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f149406a460 msgr2=0x7f149406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f149406a460 0x7f149406c920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f14a4036000 tx=0x7f14a403c040 comp rx=0 tx=0).stop 2023-12-19T13:55:00.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 msgr2=0x7f14b4158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b4158c70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00cd70 tx=0x7f14ac00a660 comp rx=0 tx=0).stop 2023-12-19T13:55:00.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 shutdown_connections 2023-12-19T13:55:00.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f149406a460 0x7f149406c920 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f14b415e0b0 0x7f14b4158c70 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40cfcd0 0x7f14b4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 --2- 172.21.15.113:0/1291766422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40b2930 0x7f14b41484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.338+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 >> 172.21.15.113:0/1291766422 conn(0x7f14b40cc770 msgr2=0x7f14b415ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:00.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.339+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 shutdown_connections 2023-12-19T13:55:00.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.339+0000 7f14b9841640 1 -- 172.21.15.113:0/1291766422 wait complete. 2023-12-19T13:55:00.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:54:23.704080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:54:25.109205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:55:00.358 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:55:00.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.571+0000 7fb160238640 1 Processor -- start 2023-12-19T13:55:00.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.571+0000 7fb160238640 1 -- start start 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb160238640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158154760 0x7fb15815b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb160238640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb1580b0070 0x7fb1580b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb160238640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580b0a10 con 0x7fb1580cb810 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb160238640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580ccf20 con 0x7fb1580b0070 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb160238640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580b1b50 con 0x7fb158154760 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb15e7d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb1580b0070 0x7fb1580b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb15e7d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb1580b0070 0x7fb1580b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36562/0 (socket says 172.21.15.113:36562) 2023-12-19T13:55:00.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb15e7d5640 1 -- 172.21.15.113:0/3643188255 learned_addr learned my addr 172.21.15.113:0/3643188255 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:00.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.572+0000 7fb15d7d3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb1580cb810 0x7fb1580b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52072/0 (socket says 172.21.15.113:52072) 2023-12-19T13:55:00.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.573+0000 7fb15dfd4640 1 --2- 172.21.15.113:0/3643188255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158154760 0x7fb15815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.573+0000 7fb15e7d5640 1 -- 172.21.15.113:0/3643188255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158154760 msgr2=0x7fb15815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:00.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.573+0000 7fb15e7d5640 1 --2- 172.21.15.113:0/3643188255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158154760 0x7fb15815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.573+0000 7fb15e7d5640 1 -- 172.21.15.113:0/3643188255 >> v1:172.21.15.113:6789/0 conn(0x7fb1580cb810 legacy=0x7fb1580b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.573+0000 7fb15e7d5640 1 -- 172.21.15.113:0/3643188255 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580ccbd0 con 0x7fb1580b0070 2023-12-19T13:55:00.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.574+0000 7fb15e7d5640 1 --2- 172.21.15.113:0/3643188255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580b0070 0x7fb1580b04d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb1500098a0 tx=0x7fb15002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b593b2fe914cc082 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:00.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.574+0000 7fb15cfd2640 1 -- 172.21.15.113:0/3643188255 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150031640 con 0x7fb1580b0070 2023-12-19T13:55:00.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.574+0000 7fb15cfd2640 1 -- 172.21.15.113:0/3643188255 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1500317a0 con 0x7fb1580b0070 2023-12-19T13:55:00.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.574+0000 7fb15cfd2640 1 -- 172.21.15.113:0/3643188255 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150031b30 con 0x7fb1580b0070 2023-12-19T13:55:00.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 -- 172.21.15.113:0/3643188255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580b0070 msgr2=0x7fb1580b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 --2- 172.21.15.113:0/3643188255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580b0070 0x7fb1580b04d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb1500098a0 tx=0x7fb15002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 -- 172.21.15.113:0/3643188255 shutdown_connections 2023-12-19T13:55:00.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 --2- 172.21.15.113:0/3643188255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580b0070 0x7fb1580b04d0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 --2- 172.21.15.113:0/3643188255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158154760 0x7fb15815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 -- 172.21.15.113:0/3643188255 >> 172.21.15.113:0/3643188255 conn(0x7fb158073150 msgr2=0x7fb1580659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:00.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 -- 172.21.15.113:0/3643188255 shutdown_connections 2023-12-19T13:55:00.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.575+0000 7fb160238640 1 -- 172.21.15.113:0/3643188255 wait complete. 2023-12-19T13:55:00.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.577+0000 7fb160238640 1 Processor -- start 2023-12-19T13:55:00.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.577+0000 7fb160238640 1 -- start start 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb160238640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1580b0070 0x7fb158140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb160238640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580cb810 0x7fb15814bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb160238640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158154760 0x7fb158159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb160238640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb158154d10 con 0x7fb1580cb810 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb160238640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15814c0e0 con 0x7fb158154760 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb160238640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb158154f60 con 0x7fb1580b0070 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb15d7d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580cb810 0x7fb15814bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb15d7d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580cb810 0x7fb15814bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36576/0 (socket says 172.21.15.113:36576) 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.578+0000 7fb15d7d3640 1 -- 172.21.15.113:0/2462628415 learned_addr learned my addr 172.21.15.113:0/2462628415 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15dfd4640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1580b0070 0x7fb158140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15e7d5640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158154760 0x7fb158159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15d7d3640 1 -- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1580b0070 msgr2=0x7fb158140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15d7d3640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1580b0070 0x7fb158140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15d7d3640 1 -- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158154760 msgr2=0x7fb158159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15d7d3640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158154760 0x7fb158159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15d7d3640 1 -- 172.21.15.113:0/2462628415 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500094d0 con 0x7fb1580cb810 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb15d7d3640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580cb810 0x7fb15814bba0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c4d0 tx=0x7fb14800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.579+0000 7fb14e7fc640 1 -- 172.21.15.113:0/2462628415 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148007480 con 0x7fb1580cb810 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.580+0000 7fb14e7fc640 1 -- 172.21.15.113:0/2462628415 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480075e0 con 0x7fb1580cb810 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.580+0000 7fb14e7fc640 1 -- 172.21.15.113:0/2462628415 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480049e0 con 0x7fb1580cb810 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.580+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb158155240 con 0x7fb1580cb810 2023-12-19T13:55:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.580+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb158155800 con 0x7fb1580cb810 2023-12-19T13:55:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.581+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb158061910 con 0x7fb1580cb810 2023-12-19T13:55:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.582+0000 7fb14e7fc640 1 -- 172.21.15.113:0/2462628415 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb148004b40 con 0x7fb1580cb810 2023-12-19T13:55:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.583+0000 7fb14e7fc640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb13c06a430 0x7fb13c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.583+0000 7fb14e7fc640 1 -- 172.21.15.113:0/2462628415 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb148087900 con 0x7fb1580cb810 2023-12-19T13:55:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.583+0000 7fb15dfd4640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb13c06a430 0x7fb13c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.583+0000 7fb15dfd4640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb13c06a430 0x7fb13c06c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb154007330 tx=0x7fb15400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.587+0000 7fb14e7fc640 1 -- 172.21.15.113:0/2462628415 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb148053030 con 0x7fb1580cb810 2023-12-19T13:55:00.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.776+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1580cc610 con 0x7fb1580cb810 2023-12-19T13:55:00.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.777+0000 7fb14e7fc640 1 -- 172.21.15.113:0/2462628415 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb148018020 con 0x7fb1580cb810 2023-12-19T13:55:00.777 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:55:00.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb13c06a430 msgr2=0x7fb13c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb13c06a430 0x7fb13c06c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb154007330 tx=0x7fb15400b040 comp rx=0 tx=0).stop 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580cb810 msgr2=0x7fb15814bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580cb810 0x7fb15814bba0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c4d0 tx=0x7fb14800c990 comp rx=0 tx=0).stop 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 shutdown_connections 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb13c06a430 0x7fb13c06c8f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158154760 0x7fb158159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1580cb810 0x7fb15814bba0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 --2- 172.21.15.113:0/2462628415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1580b0070 0x7fb158140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 >> 172.21.15.113:0/2462628415 conn(0x7fb158073150 msgr2=0x7fb15814cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 shutdown_connections 2023-12-19T13:55:00.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:00.780+0000 7fb160238640 1 -- 172.21.15.113:0/2462628415 wait complete. 2023-12-19T13:55:00.798 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:55:01.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.003+0000 7f64fc900640 1 Processor -- start 2023-12-19T13:55:01.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.003+0000 7f64fc900640 1 -- start start 2023-12-19T13:55:01.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64fc900640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f64f8146e10 0x7f64f80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64fc900640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f64f80ce110 0x7f64f80ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64fc900640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80cd840 con 0x7f64f80d2b00 2023-12-19T13:55:01.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64fc900640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80d2430 con 0x7f64f80ce110 2023-12-19T13:55:01.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64fc900640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80ceac0 con 0x7f64f8146e10 2023-12-19T13:55:01.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64f6d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f64f80ce110 0x7f64f80ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64f6d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f64f80ce110 0x7f64f80ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36586/0 (socket says 172.21.15.113:36586) 2023-12-19T13:55:01.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.005+0000 7f64f6d9d640 1 -- 172.21.15.113:0/955773111 learned_addr learned my addr 172.21.15.113:0/955773111 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:01.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.006+0000 7f64f659c640 1 --2- 172.21.15.113:0/955773111 >> v2:172.21.15.151:3300/0 conn(0x7f64f8146e10 0x7f64f80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.006+0000 7f64f6d9d640 1 -- 172.21.15.113:0/955773111 >> v2:172.21.15.151:3300/0 conn(0x7f64f8146e10 msgr2=0x7f64f80d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:01.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.006+0000 7f64f6d9d640 1 --2- 172.21.15.113:0/955773111 >> v2:172.21.15.151:3300/0 conn(0x7f64f8146e10 0x7f64f80d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.006+0000 7f64f6d9d640 1 -- 172.21.15.113:0/955773111 >> v1:172.21.15.113:6789/0 conn(0x7f64f80d2b00 legacy=0x7f64f80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.006+0000 7f64f6d9d640 1 -- 172.21.15.113:0/955773111 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80b6e90 con 0x7f64f80ce110 2023-12-19T13:55:01.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.007+0000 7f64f6d9d640 1 --2- 172.21.15.113:0/955773111 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f80ce580 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f64f80d0720 tx=0x7f64f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d325734932eebd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.007+0000 7f64f5d9b640 1 -- 172.21.15.113:0/955773111 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f002ca80 con 0x7f64f80ce110 2023-12-19T13:55:01.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.007+0000 7f64f5d9b640 1 -- 172.21.15.113:0/955773111 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f002cbe0 con 0x7f64f80ce110 2023-12-19T13:55:01.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.007+0000 7f64f5d9b640 1 -- 172.21.15.113:0/955773111 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00343f0 con 0x7f64f80ce110 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 -- 172.21.15.113:0/955773111 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 msgr2=0x7f64f80ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 --2- 172.21.15.113:0/955773111 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f80ce580 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f64f80d0720 tx=0x7f64f002bee0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 -- 172.21.15.113:0/955773111 shutdown_connections 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 --2- 172.21.15.113:0/955773111 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f80ce580 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 --2- 172.21.15.113:0/955773111 >> v2:172.21.15.151:3300/0 conn(0x7f64f8146e10 0x7f64f80d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 -- 172.21.15.113:0/955773111 >> 172.21.15.113:0/955773111 conn(0x7f64f80b29c0 msgr2=0x7f64f80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 -- 172.21.15.113:0/955773111 shutdown_connections 2023-12-19T13:55:01.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.008+0000 7f64fc900640 1 -- 172.21.15.113:0/955773111 wait complete. 2023-12-19T13:55:01.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.010+0000 7f64fc900640 1 Processor -- start 2023-12-19T13:55:01.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.010+0000 7f64fc900640 1 -- start start 2023-12-19T13:55:01.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64fc900640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f8140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64fc900640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f80d2b00 0x7f64f815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64fc900640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64f8146e10 0x7f64f80704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64fc900640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f815de70 con 0x7f64f80ce110 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64fc900640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f815e150 con 0x7f64f80d2b00 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64fc900640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f815e430 con 0x7f64f8146e10 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f8140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f8140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36588/0 (socket says 172.21.15.113:36588) 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 -- 172.21.15.113:0/2466222683 learned_addr learned my addr 172.21.15.113:0/2466222683 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 -- 172.21.15.113:0/2466222683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64f8146e10 msgr2=0x7f64f80704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f6d9d640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64f8146e10 0x7f64f80704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64f8146e10 0x7f64f80704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 -- 172.21.15.113:0/2466222683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f80d2b00 msgr2=0x7f64f815fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f80d2b00 0x7f64f815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.011+0000 7f64f659c640 1 -- 172.21.15.113:0/2466222683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0009b30 con 0x7f64f80ce110 2023-12-19T13:55:01.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.012+0000 7f64f659c640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f8140380 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f64e800c7f0 tx=0x7f64e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.012+0000 7f64ef7fe640 1 -- 172.21.15.113:0/2466222683 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e8004220 con 0x7f64f80ce110 2023-12-19T13:55:01.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.012+0000 7f64ef7fe640 1 -- 172.21.15.113:0/2466222683 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e80043a0 con 0x7f64f80ce110 2023-12-19T13:55:01.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.012+0000 7f64ef7fe640 1 -- 172.21.15.113:0/2466222683 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e8007860 con 0x7f64f80ce110 2023-12-19T13:55:01.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.012+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f815e710 con 0x7f64f80ce110 2023-12-19T13:55:01.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.012+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f815db00 con 0x7f64f80ce110 2023-12-19T13:55:01.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.013+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f815ec30 con 0x7f64f80ce110 2023-12-19T13:55:01.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.014+0000 7f64ef7fe640 1 -- 172.21.15.113:0/2466222683 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f64e8007bd0 con 0x7f64f80ce110 2023-12-19T13:55:01.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.015+0000 7f64ef7fe640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64d806a430 0x7f64d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.015+0000 7f64ef7fe640 1 -- 172.21.15.113:0/2466222683 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64e8088a90 con 0x7f64f80ce110 2023-12-19T13:55:01.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.016+0000 7f64edd9b640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64d806a430 0x7f64d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.016+0000 7f64edd9b640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64d806a430 0x7f64d806c8f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f64e0000f60 tx=0x7f64e00079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.019+0000 7f64ef7fe640 1 -- 172.21.15.113:0/2466222683 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f64e8053f50 con 0x7f64f80ce110 2023-12-19T13:55:01.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.207+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64f8061910 con 0x7f64f80ce110 2023-12-19T13:55:01.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.208+0000 7f64ef7fe640 1 -- 172.21.15.113:0/2466222683 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64e801e020 con 0x7f64f80ce110 2023-12-19T13:55:01.210 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64d806a430 msgr2=0x7f64d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64d806a430 0x7f64d806c8f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f64e0000f60 tx=0x7f64e00079b0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 msgr2=0x7f64f8140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f8140380 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f64e800c7f0 tx=0x7f64e800ccb0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 shutdown_connections 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f64d806a430 0x7f64d806c8f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64f8146e10 0x7f64f80704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f80d2b00 0x7f64f815fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 --2- 172.21.15.113:0/2466222683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64f80ce110 0x7f64f8140380 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 >> 172.21.15.113:0/2466222683 conn(0x7f64f80b29c0 msgr2=0x7f64f80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 shutdown_connections 2023-12-19T13:55:01.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.211+0000 7f64fc900640 1 -- 172.21.15.113:0/2466222683 wait complete. 2023-12-19T13:55:01.229 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:55:01.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.445+0000 7f9e5c547640 1 Processor -- start 2023-12-19T13:55:01.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.445+0000 7f9e5c547640 1 -- start start 2023-12-19T13:55:01.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.447+0000 7f9e5c547640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 0x7f9e540b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.447+0000 7f9e5c547640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5415fde0 con 0x7f9e540b1ec0 2023-12-19T13:55:01.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.447+0000 7f9e5c547640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5415ef10 con 0x7f9e540ceea0 2023-12-19T13:55:01.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.447+0000 7f9e5c547640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b2320 con 0x7f9e5415b1d0 2023-12-19T13:55:01.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.447+0000 7f9e59ae2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9e540b1ec0 0x7f9e5415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52094/0 (socket says 172.21.15.113:52094) 2023-12-19T13:55:01.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.447+0000 7f9e59ae2640 1 -- 172.21.15.113:0/2154205230 learned_addr learned my addr 172.21.15.113:0/2154205230 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:01.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e5a2e3640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 0x7f9e540b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990633628 0 0) 0x7f9e5415fde0 con 0x7f9e540b1ec0 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e40003520 con 0x7f9e540b1ec0 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2050515787 0 0) 0x7f9e40003520 con 0x7f9e540b1ec0 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 msgr2=0x7f9e540b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 0x7f9e540b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 >> v1:172.21.15.151:6789/0 conn(0x7f9e540ceea0 legacy=0x7f9e5406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540b2e40 con 0x7f9e540b1ec0 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9e44001670 con 0x7f9e540b1ec0 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 >> v1:172.21.15.113:6789/0 conn(0x7f9e540b1ec0 legacy=0x7f9e5415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 0x7f9e40003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e40003fe0 0x7f9e400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e40004d00 0x7f9e40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b2320 con 0x7f9e40004d00 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4000bb40 con 0x7f9e40003fe0 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.448+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4000bd00 con 0x7f9e5415b1d0 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.449+0000 7f9e5aae4640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e40004d00 0x7f9e40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.449+0000 7f9e5a2e3640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 0x7f9e40003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.449+0000 7f9e5aae4640 1 -- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 msgr2=0x7f9e40003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.449+0000 7f9e5aae4640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5415b1d0 0x7f9e40003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.449+0000 7f9e5aae4640 1 -- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e40003fe0 msgr2=0x7f9e400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.449+0000 7f9e5aae4640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e40003fe0 0x7f9e400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.449+0000 7f9e5aae4640 1 -- 172.21.15.113:0/2154205230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40003520 con 0x7f9e40004d00 2023-12-19T13:55:01.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.450+0000 7f9e5aae4640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e40004d00 0x7f9e40005180 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c001e50 tx=0x7f9e400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5094d3a5f354793d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.450+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c003b70 con 0x7f9e40004d00 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.450+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c003cd0 con 0x7f9e40004d00 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.450+0000 7f9e592e1640 1 -- 172.21.15.113:0/2154205230 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c005310 con 0x7f9e40004d00 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.451+0000 7f9e5c547640 1 -- 172.21.15.113:0/2154205230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e40004d00 msgr2=0x7f9e40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.451+0000 7f9e5c547640 1 --2- 172.21.15.113:0/2154205230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e40004d00 0x7f9e40005180 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c001e50 tx=0x7f9e400057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.451+0000 7f9e5aae4640 1 -- 172.21.15.113:0/2154205230 reap_dead start 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.451+0000 7f9e5c547640 1 -- 172.21.15.113:0/2154205230 shutdown_connections 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.451+0000 7f9e5c547640 1 -- 172.21.15.113:0/2154205230 >> 172.21.15.113:0/2154205230 conn(0x7f9e54073150 msgr2=0x7f9e540659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.451+0000 7f9e5c547640 1 -- 172.21.15.113:0/2154205230 shutdown_connections 2023-12-19T13:55:01.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.451+0000 7f9e5c547640 1 -- 172.21.15.113:0/2154205230 wait complete. 2023-12-19T13:55:01.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.453+0000 7f9e5c547640 1 Processor -- start 2023-12-19T13:55:01.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.453+0000 7f9e5c547640 1 -- start start 2023-12-19T13:55:01.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5c547640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e40004d00 0x7f9e541493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5c547640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e54145ff0 0x7f9e540cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5c547640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e5415d990 0x7f9e5415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5c547640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5415e350 con 0x7f9e5415d990 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5c547640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540ccac0 con 0x7f9e54145ff0 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5c547640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540ccd90 con 0x7f9e40004d00 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5aae4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e5415d990 0x7f9e5415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5aae4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e5415d990 0x7f9e5415de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36614/0 (socket says 172.21.15.113:36614) 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.454+0000 7f9e5aae4640 1 -- 172.21.15.113:0/1238490576 learned_addr learned my addr 172.21.15.113:0/1238490576 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5a2e3640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e40004d00 0x7f9e541493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e59ae2640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e54145ff0 0x7f9e540cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5aae4640 1 -- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e40004d00 msgr2=0x7f9e541493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5aae4640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e40004d00 0x7f9e541493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5aae4640 1 -- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e54145ff0 msgr2=0x7f9e540cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5aae4640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e54145ff0 0x7f9e540cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5aae4640 1 -- 172.21.15.113:0/1238490576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540cd070 con 0x7f9e5415d990 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e59ae2640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e54145ff0 0x7f9e540cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5aae4640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e5415d990 0x7f9e5415de10 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c001f70 tx=0x7f9e4c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e4affd640 1 -- 172.21.15.113:0/1238490576 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c03e070 con 0x7f9e5415d990 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e4affd640 1 -- 172.21.15.113:0/1238490576 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c003e40 con 0x7f9e5415d990 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e4affd640 1 -- 172.21.15.113:0/1238490576 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c006d50 con 0x7f9e5415d990 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e540cd350 con 0x7f9e5415d990 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.455+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e540cd910 con 0x7f9e5415d990 2023-12-19T13:55:01.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.456+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e541467a0 con 0x7f9e5415d990 2023-12-19T13:55:01.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.457+0000 7f9e4affd640 1 -- 172.21.15.113:0/1238490576 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e4c007030 con 0x7f9e5415d990 2023-12-19T13:55:01.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.459+0000 7f9e4affd640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e3806a430 0x7f9e3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.459+0000 7f9e4affd640 1 -- 172.21.15.113:0/1238490576 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e4c0a9be0 con 0x7f9e5415d990 2023-12-19T13:55:01.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.459+0000 7f9e5a2e3640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e3806a430 0x7f9e3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.460+0000 7f9e5a2e3640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e3806a430 0x7f9e3806c8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009950 tx=0x7f9e50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.463+0000 7f9e4affd640 1 -- 172.21.15.113:0/1238490576 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e4c075130 con 0x7f9e5415d990 2023-12-19T13:55:01.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.652+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e54061910 con 0x7f9e5415d990 2023-12-19T13:55:01.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.653+0000 7f9e4affd640 1 -- 172.21.15.113:0/1238490576 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e4c048070 con 0x7f9e5415d990 2023-12-19T13:55:01.654 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:55:01.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.655+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e3806a430 msgr2=0x7f9e3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.655+0000 7f9e5c547640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e3806a430 0x7f9e3806c8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009950 tx=0x7f9e50008040 comp rx=0 tx=0).stop 2023-12-19T13:55:01.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.655+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e5415d990 msgr2=0x7f9e5415de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.655+0000 7f9e5c547640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e5415d990 0x7f9e5415de10 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c001f70 tx=0x7f9e4c0014a0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.655 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 shutdown_connections 2023-12-19T13:55:01.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9e3806a430 0x7f9e3806c8f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e5415d990 0x7f9e5415de10 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e54145ff0 0x7f9e540cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 --2- 172.21.15.113:0/1238490576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e40004d00 0x7f9e541493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 >> 172.21.15.113:0/1238490576 conn(0x7f9e54073150 msgr2=0x7f9e540b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:01.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 shutdown_connections 2023-12-19T13:55:01.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.656+0000 7f9e5c547640 1 -- 172.21.15.113:0/1238490576 wait complete. 2023-12-19T13:55:01.673 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:55:01.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.883+0000 7f298ac26640 1 Processor -- start 2023-12-19T13:55:01.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.883+0000 7f298ac26640 1 -- start start 2023-12-19T13:55:01.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.885+0000 7f298ac26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 0x7f29840d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.885+0000 7f298ac26640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840cd840 con 0x7f29840d2b00 2023-12-19T13:55:01.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.885+0000 7f298ac26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840b6e90 con 0x7f29840ce110 2023-12-19T13:55:01.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.885+0000 7f298ac26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29840d2430 con 0x7f2984146e10 2023-12-19T13:55:01.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.885+0000 7f2983fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f29840d2b00 0x7f29840b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52100/0 (socket says 172.21.15.113:52100) 2023-12-19T13:55:01.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.885+0000 7f2983fff640 1 -- 172.21.15.113:0/2686451600 learned_addr learned my addr 172.21.15.113:0/2686451600 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29889c2640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 0x7f29840d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385516031 0 0) 0x7f29840cd840 con 0x7f29840d2b00 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f296c003520 con 0x7f29840d2b00 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2268591631 0 0) 0x7f296c003520 con 0x7f29840d2b00 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 msgr2=0x7f29840d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 0x7f29840d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 >> v1:172.21.15.151:6789/0 conn(0x7f29840ce110 legacy=0x7f29840b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840d2620 con 0x7f29840d2b00 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f2978001670 con 0x7f29840d2b00 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 >> v1:172.21.15.113:6789/0 conn(0x7f29840d2b00 legacy=0x7f29840b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f296c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 0x7f296c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.886+0000 7f29837fe640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c004d00 0x7f296c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00bb10 con 0x7f296c003a10 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00bc50 con 0x7f296c004d00 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00bde0 con 0x7f2984146e10 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29889c2640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f296c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f2983fff640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 0x7f296c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29889c2640 1 -- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 msgr2=0x7f296c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29889c2640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2984146e10 0x7f296c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29889c2640 1 -- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c004d00 msgr2=0x7f296c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29889c2640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c004d00 0x7f296c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.887+0000 7f29889c2640 1 -- 172.21.15.113:0/2686451600 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c003520 con 0x7f296c003a10 2023-12-19T13:55:01.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.888+0000 7f29889c2640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f296c003e30 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2974009fc0 tx=0x7f296c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4566924d9075e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297402cbd0 con 0x7f296c003a10 2023-12-19T13:55:01.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297400f040 con 0x7f296c003a10 2023-12-19T13:55:01.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f29837fe640 1 -- 172.21.15.113:0/2686451600 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974034440 con 0x7f296c003a10 2023-12-19T13:55:01.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f298ac26640 1 -- 172.21.15.113:0/2686451600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 msgr2=0x7f296c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f298ac26640 1 --2- 172.21.15.113:0/2686451600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f296c003e30 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2974009fc0 tx=0x7f296c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f29891c3640 1 -- 172.21.15.113:0/2686451600 reap_dead start 2023-12-19T13:55:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f298ac26640 1 -- 172.21.15.113:0/2686451600 shutdown_connections 2023-12-19T13:55:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f298ac26640 1 -- 172.21.15.113:0/2686451600 >> 172.21.15.113:0/2686451600 conn(0x7f29840b29c0 msgr2=0x7f29840b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f298ac26640 1 -- 172.21.15.113:0/2686451600 shutdown_connections 2023-12-19T13:55:01.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.889+0000 7f298ac26640 1 -- 172.21.15.113:0/2686451600 wait complete. 2023-12-19T13:55:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.891+0000 7f298ac26640 1 Processor -- start 2023-12-19T13:55:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.891+0000 7f298ac26640 1 -- start start 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.892+0000 7f298ac26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f29841f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.892+0000 7f298ac26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29841f3490 0x7f2984145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.892+0000 7f298ac26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2984145c80 0x7f29841f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.892+0000 7f298ac26640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298415eb20 con 0x7f296c003a10 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.892+0000 7f298ac26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984146100 con 0x7f2984145c80 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.892+0000 7f298ac26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29841406e0 con 0x7f29841f3490 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f29841f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f29841f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36632/0 (socket says 172.21.15.113:36632) 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 -- 172.21.15.113:0/3103720958 learned_addr learned my addr 172.21.15.113:0/3103720958 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f2983fff640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29841f3490 0x7f2984145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29891c3640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2984145c80 0x7f29841f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 -- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29841f3490 msgr2=0x7f2984145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29841f3490 0x7f2984145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 -- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2984145c80 msgr2=0x7f29841f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:01.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2984145c80 0x7f29841f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:01.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29889c2640 1 -- 172.21.15.113:0/3103720958 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298415dea0 con 0x7f296c003a10 2023-12-19T13:55:01.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f2983fff640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29841f3490 0x7f2984145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:01.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.893+0000 7f29891c3640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2984145c80 0x7f29841f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:01.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.894+0000 7f29889c2640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f29841f5a20 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f2974009f90 tx=0x7f2974009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.894+0000 7f29817fa640 1 -- 172.21.15.113:0/3103720958 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974034bd0 con 0x7f296c003a10 2023-12-19T13:55:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.894+0000 7f29817fa640 1 -- 172.21.15.113:0/3103720958 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974034d30 con 0x7f296c003a10 2023-12-19T13:55:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.894+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298415e180 con 0x7f296c003a10 2023-12-19T13:55:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.894+0000 7f29817fa640 1 -- 172.21.15.113:0/3103720958 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974034ea0 con 0x7f296c003a10 2023-12-19T13:55:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.894+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298415e740 con 0x7f296c003a10 2023-12-19T13:55:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.895+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298415e900 con 0x7f296c003a10 2023-12-19T13:55:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.896+0000 7f29817fa640 1 -- 172.21.15.113:0/3103720958 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2974040450 con 0x7f296c003a10 2023-12-19T13:55:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.897+0000 7f29817fa640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f297006a430 0x7f297006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.897+0000 7f29817fa640 1 -- 172.21.15.113:0/3103720958 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29740ab220 con 0x7f296c003a10 2023-12-19T13:55:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.897+0000 7f2983fff640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f297006a430 0x7f297006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:01.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.898+0000 7f2983fff640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f297006a430 0x7f297006c8f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2978001bc0 tx=0x7f2978000fb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:01.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:01.902+0000 7f29817fa640 1 -- 172.21.15.113:0/3103720958 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f29740768b0 con 0x7f296c003a10 2023-12-19T13:55:02.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.104+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2984061910 con 0x7f296c003a10 2023-12-19T13:55:02.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.104+0000 7f29817fa640 1 -- 172.21.15.113:0/3103720958 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v150) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2974079ed0 con 0x7f296c003a10 2023-12-19T13:55:02.104 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f297006a430 msgr2=0x7f297006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f297006a430 0x7f297006c8f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2978001bc0 tx=0x7f2978000fb0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 msgr2=0x7f29841f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f29841f5a20 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f2974009f90 tx=0x7f2974009750 comp rx=0 tx=0).stop 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 shutdown_connections 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f297006a430 0x7f297006c8f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2984145c80 0x7f29841f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29841f3490 0x7f2984145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 --2- 172.21.15.113:0/3103720958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f296c003a10 0x7f29841f5a20 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 >> 172.21.15.113:0/3103720958 conn(0x7f29840b29c0 msgr2=0x7f29840b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 shutdown_connections 2023-12-19T13:55:02.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.107+0000 7f298ac26640 1 -- 172.21.15.113:0/3103720958 wait complete. 2023-12-19T13:55:02.124 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:55:02.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:02.124 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:55:02.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:55:02.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:02.268 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:55:02.318 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:55:02.318 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:02.362 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:55:02.363 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:02.457 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:02.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.678+0000 7f5a518d7640 1 Processor -- start 2023-12-19T13:55:02.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.678+0000 7f5a518d7640 1 -- start start 2023-12-19T13:55:02.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a518d7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5a4c15e5a0 0x7f5a4c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a518d7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a4c0cdbf0 0x7f5a4c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a518d7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c15ec30 con 0x7f5a4c15f680 2023-12-19T13:55:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a518d7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c0ce560 con 0x7f5a4c15e5a0 2023-12-19T13:55:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a518d7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c15e980 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a508d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5a4c15e5a0 0x7f5a4c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a508d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5a4c15e5a0 0x7f5a4c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36644/0 (socket says 172.21.15.113:36644) 2023-12-19T13:55:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.680+0000 7f5a508d5640 1 -- 172.21.15.113:0/358253537 learned_addr learned my addr 172.21.15.113:0/358253537 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.681+0000 7f5a510d6640 1 --2- 172.21.15.113:0/358253537 >> v2:172.21.15.151:3300/0 conn(0x7f5a4c0cdbf0 0x7f5a4c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.681+0000 7f5a508d5640 1 -- 172.21.15.113:0/358253537 >> v2:172.21.15.151:3300/0 conn(0x7f5a4c0cdbf0 msgr2=0x7f5a4c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.681+0000 7f5a508d5640 1 --2- 172.21.15.113:0/358253537 >> v2:172.21.15.151:3300/0 conn(0x7f5a4c0cdbf0 0x7f5a4c0ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.681+0000 7f5a508d5640 1 -- 172.21.15.113:0/358253537 >> v1:172.21.15.113:6789/0 conn(0x7f5a4c15f680 legacy=0x7f5a4c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.681+0000 7f5a508d5640 1 -- 172.21.15.113:0/358253537 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0b2f90 con 0x7f5a4c15e5a0 2023-12-19T13:55:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.681+0000 7f5a4b7fe640 1 -- 172.21.15.113:0/358253537 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790278332 0 0) 0x7f5a4c15ec30 con 0x7f5a4c15f680 2023-12-19T13:55:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.681+0000 7f5a510d6640 1 --2- 172.21.15.113:0/358253537 >> v2:172.21.15.151:3300/0 conn(0x7f5a4c0cdbf0 0x7f5a4c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:02.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.682+0000 7f5a508d5640 1 --2- 172.21.15.113:0/358253537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c15e5a0 0x7f5a4c0b2030 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009870 tx=0x7f5a4002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9803257b0d192e06 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.682+0000 7f5a4b7fe640 1 -- 172.21.15.113:0/358253537 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40030850 con 0x7f5a4c15e5a0 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.682+0000 7f5a4b7fe640 1 -- 172.21.15.113:0/358253537 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400309b0 con 0x7f5a4c15e5a0 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.682+0000 7f5a4b7fe640 1 -- 172.21.15.113:0/358253537 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40030d40 con 0x7f5a4c15e5a0 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 -- 172.21.15.113:0/358253537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c15e5a0 msgr2=0x7f5a4c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 --2- 172.21.15.113:0/358253537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c15e5a0 0x7f5a4c0b2030 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009870 tx=0x7f5a4002b990 comp rx=0 tx=0).stop 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 -- 172.21.15.113:0/358253537 shutdown_connections 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 --2- 172.21.15.113:0/358253537 >> v2:172.21.15.151:3300/0 conn(0x7f5a4c0cdbf0 0x7f5a4c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 --2- 172.21.15.113:0/358253537 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c15e5a0 0x7f5a4c0b2030 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 -- 172.21.15.113:0/358253537 >> 172.21.15.113:0/358253537 conn(0x7f5a4c0b0100 msgr2=0x7f5a4c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 -- 172.21.15.113:0/358253537 shutdown_connections 2023-12-19T13:55:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.683+0000 7f5a518d7640 1 -- 172.21.15.113:0/358253537 wait complete. 2023-12-19T13:55:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.685+0000 7f5a518d7640 1 Processor -- start 2023-12-19T13:55:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.685+0000 7f5a518d7640 1 -- start start 2023-12-19T13:55:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a518d7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c0cdbf0 0x7f5a4c154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a518d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15e5a0 0x7f5a4c0abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a518d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15f680 0x7f5a4c15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a518d7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c1554e0 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a518d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0ad7f0 con 0x7f5a4c15e5a0 2023-12-19T13:55:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a518d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0aa870 con 0x7f5a4c15f680 2023-12-19T13:55:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a508d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c0cdbf0 0x7f5a4c154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a508d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c0cdbf0 0x7f5a4c154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36650/0 (socket says 172.21.15.113:36650) 2023-12-19T13:55:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.686+0000 7f5a508d5640 1 -- 172.21.15.113:0/3594717440 learned_addr learned my addr 172.21.15.113:0/3594717440 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a508d5640 1 -- 172.21.15.113:0/3594717440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15f680 msgr2=0x7f5a4c15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a508d5640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15f680 0x7f5a4c15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a508d5640 1 -- 172.21.15.113:0/3594717440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15e5a0 msgr2=0x7f5a4c0abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a508d5640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15e5a0 0x7f5a4c0abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a508d5640 1 -- 172.21.15.113:0/3594717440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400094d0 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a508d5640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c0cdbf0 0x7f5a4c154fa0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002b9d0 tx=0x7f5a40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a497fa640 1 -- 172.21.15.113:0/3594717440 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40030820 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a497fa640 1 -- 172.21.15.113:0/3594717440 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a40044480 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a497fa640 1 -- 172.21.15.113:0/3594717440 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40044850 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c0a9cf0 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.687+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c0aa2b0 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.689+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c061910 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.690+0000 7f5a497fa640 1 -- 172.21.15.113:0/3594717440 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a4002e070 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.690+0000 7f5a497fa640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a3006a430 0x7f5a3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:02.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.691+0000 7f5a497fa640 1 -- 172.21.15.113:0/3594717440 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a4003e070 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.691+0000 7f5a4bfff640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a3006a430 0x7f5a3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:02.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.691+0000 7f5a4bfff640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a3006a430 0x7f5a3006c8f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c1557c0 tx=0x7f5a38007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:02.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.695+0000 7f5a497fa640 1 -- 172.21.15.113:0/3594717440 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a40076690 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.887+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a4c0ce980 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.890+0000 7f5a497fa640 1 -- 172.21.15.113:0/3594717440 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16171 (secure 0 0 0) 0x7f5a40079cb0 con 0x7f5a4c0cdbf0 2023-12-19T13:55:02.889 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:02.889 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":150,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:54:53.593502+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:02.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.892+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a3006a430 msgr2=0x7f5a3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.892+0000 7f5a518d7640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a3006a430 0x7f5a3006c8f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c1557c0 tx=0x7f5a38007910 comp rx=0 tx=0).stop 2023-12-19T13:55:02.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.892+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c0cdbf0 msgr2=0x7f5a4c154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:02.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.892+0000 7f5a518d7640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c0cdbf0 0x7f5a4c154fa0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002b9d0 tx=0x7f5a40004730 comp rx=0 tx=0).stop 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 shutdown_connections 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5a3006a430 0x7f5a3006c8f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15f680 0x7f5a4c15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15e5a0 0x7f5a4c0abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 --2- 172.21.15.113:0/3594717440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a4c0cdbf0 0x7f5a4c154fa0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 >> 172.21.15.113:0/3594717440 conn(0x7f5a4c0b0100 msgr2=0x7f5a4c06d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 shutdown_connections 2023-12-19T13:55:02.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:02.893+0000 7f5a518d7640 1 -- 172.21.15.113:0/3594717440 wait complete. 2023-12-19T13:55:02.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:54:23.704080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:54:25.109205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:55:02.913 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:55:03.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.124+0000 7faf8893c640 1 Processor -- start 2023-12-19T13:55:03.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.125+0000 7faf8893c640 1 -- start start 2023-12-19T13:55:03.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.126+0000 7faf8893c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf840cf5b0 0x7faf840b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.126+0000 7faf8893c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8415fde0 con 0x7faf8415b1d0 2023-12-19T13:55:03.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.126+0000 7faf8893c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840b2bc0 con 0x7faf840b2760 2023-12-19T13:55:03.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.126+0000 7faf8893c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b2400 con 0x7faf840cf5b0 2023-12-19T13:55:03.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7faf8415b1d0 0x7faf8415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52104/0 (socket says 172.21.15.113:52104) 2023-12-19T13:55:03.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8259c640 1 -- 172.21.15.113:0/1797478758 learned_addr learned my addr 172.21.15.113:0/1797478758 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:03.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf82d9d640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf840cf5b0 0x7faf840b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485745006 0 0) 0x7faf8415fde0 con 0x7faf8415b1d0 2023-12-19T13:55:03.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf6c003520 con 0x7faf8415b1d0 2023-12-19T13:55:03.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1875069561 0 0) 0x7faf6c003520 con 0x7faf8415b1d0 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf840cf5b0 msgr2=0x7faf840b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf840cf5b0 0x7faf840b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 >> v1:172.21.15.151:6789/0 conn(0x7faf840b2760 legacy=0x7faf840ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8415ef10 con 0x7faf8415b1d0 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7faf74001670 con 0x7faf8415b1d0 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 >> v1:172.21.15.113:6789/0 conn(0x7faf8415b1d0 legacy=0x7faf8415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.127+0000 7faf8159a640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf6c003a10 0x7faf6c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf8159a640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf8159a640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c005180 0x7faf6c00fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c010490 con 0x7faf6c0047c0 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c010600 con 0x7faf6c005180 2023-12-19T13:55:03.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0107c0 con 0x7faf6c003a10 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf82d9d640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf840cf5b0 0x7faf840b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf81d9b640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf81d9b640 1 -- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf6c003a10 msgr2=0x7faf6c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf81d9b640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf6c003a10 0x7faf6c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf81d9b640 1 -- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c005180 msgr2=0x7faf6c00fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf81d9b640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c005180 0x7faf6c00fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.128+0000 7faf81d9b640 1 -- 172.21.15.113:0/1797478758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c003520 con 0x7faf6c0047c0 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.129+0000 7faf81d9b640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf6c004c40 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7faf78001750 tx=0x7faf6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72754b6f1bbe124 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.129+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780052d0 con 0x7faf6c0047c0 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7802e050 con 0x7faf6c0047c0 2023-12-19T13:55:03.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8159a640 1 -- 172.21.15.113:0/1797478758 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78003830 con 0x7faf6c0047c0 2023-12-19T13:55:03.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8893c640 1 -- 172.21.15.113:0/1797478758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 msgr2=0x7faf6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8893c640 1 --2- 172.21.15.113:0/1797478758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf6c004c40 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7faf78001750 tx=0x7faf6c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf82d9d640 1 -- 172.21.15.113:0/1797478758 reap_dead start 2023-12-19T13:55:03.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8893c640 1 -- 172.21.15.113:0/1797478758 shutdown_connections 2023-12-19T13:55:03.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8893c640 1 -- 172.21.15.113:0/1797478758 >> 172.21.15.113:0/1797478758 conn(0x7faf84073150 msgr2=0x7faf840659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:03.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8893c640 1 -- 172.21.15.113:0/1797478758 shutdown_connections 2023-12-19T13:55:03.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.130+0000 7faf8893c640 1 -- 172.21.15.113:0/1797478758 wait complete. 2023-12-19T13:55:03.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.132+0000 7faf8893c640 1 Processor -- start 2023-12-19T13:55:03.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.132+0000 7faf8893c640 1 -- start start 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8893c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf84152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8893c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf841eefc0 0x7faf84158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8893c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf841590f0 0x7faf840b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8893c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8415dc00 con 0x7faf6c0047c0 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8893c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84159580 con 0x7faf841590f0 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8893c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840af430 con 0x7faf841eefc0 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf84152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf84152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36670/0 (socket says 172.21.15.113:36670) 2023-12-19T13:55:03.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.133+0000 7faf8259c640 1 -- 172.21.15.113:0/1692390855 learned_addr learned my addr 172.21.15.113:0/1692390855 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:03.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf8259c640 1 -- 172.21.15.113:0/1692390855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf841eefc0 msgr2=0x7faf84158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf8259c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf841eefc0 0x7faf84158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf8259c640 1 -- 172.21.15.113:0/1692390855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf841590f0 msgr2=0x7faf840b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf8259c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf841590f0 0x7faf840b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf8259c640 1 -- 172.21.15.113:0/1692390855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840af710 con 0x7faf6c0047c0 2023-12-19T13:55:03.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf8259c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf84152360 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c680 tx=0x7faf7400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf72ffd640 1 -- 172.21.15.113:0/1692390855 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740072d0 con 0x7faf6c0047c0 2023-12-19T13:55:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf72ffd640 1 -- 172.21.15.113:0/1692390855 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74007430 con 0x7faf6c0047c0 2023-12-19T13:55:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf72ffd640 1 -- 172.21.15.113:0/1692390855 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740047e0 con 0x7faf6c0047c0 2023-12-19T13:55:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.134+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840af9f0 con 0x7faf6c0047c0 2023-12-19T13:55:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.135+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf840affb0 con 0x7faf6c0047c0 2023-12-19T13:55:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.136+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf840b01a0 con 0x7faf6c0047c0 2023-12-19T13:55:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.137+0000 7faf72ffd640 1 -- 172.21.15.113:0/1692390855 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf74004940 con 0x7faf6c0047c0 2023-12-19T13:55:03.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.138+0000 7faf72ffd640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf6406a430 0x7faf6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.138+0000 7faf72ffd640 1 -- 172.21.15.113:0/1692390855 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf74087de0 con 0x7faf6c0047c0 2023-12-19T13:55:03.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.138+0000 7faf81d9b640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf6406a430 0x7faf6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.139+0000 7faf81d9b640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf6406a430 0x7faf6406c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faf78033000 tx=0x7faf7802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:03.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.142+0000 7faf72ffd640 1 -- 172.21.15.113:0/1692390855 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faf74053330 con 0x7faf6c0047c0 2023-12-19T13:55:03.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.329+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf84061910 con 0x7faf6c0047c0 2023-12-19T13:55:03.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.330+0000 7faf72ffd640 1 -- 172.21.15.113:0/1692390855 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf74018020 con 0x7faf6c0047c0 2023-12-19T13:55:03.329 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:55:03.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf6406a430 msgr2=0x7faf6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf6406a430 0x7faf6406c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faf78033000 tx=0x7faf7802f000 comp rx=0 tx=0).stop 2023-12-19T13:55:03.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 msgr2=0x7faf84152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf84152360 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c680 tx=0x7faf7400cb40 comp rx=0 tx=0).stop 2023-12-19T13:55:03.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 shutdown_connections 2023-12-19T13:55:03.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faf6406a430 0x7faf6406c8f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf841590f0 0x7faf840b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf841eefc0 0x7faf84158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 --2- 172.21.15.113:0/1692390855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf6c0047c0 0x7faf84152360 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 >> 172.21.15.113:0/1692390855 conn(0x7faf84073150 msgr2=0x7faf840ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:03.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 shutdown_connections 2023-12-19T13:55:03.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.333+0000 7faf8893c640 1 -- 172.21.15.113:0/1692390855 wait complete. 2023-12-19T13:55:03.351 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:55:03.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.573+0000 7ff5a65c4640 1 Processor -- start 2023-12-19T13:55:03.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.574+0000 7ff5a65c4640 1 -- start start 2023-12-19T13:55:03.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.575+0000 7ff5a65c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 0x7ff5a0166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.575+0000 7ff5a65c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a006bb30 con 0x7ff5a01449e0 2023-12-19T13:55:03.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.575+0000 7ff5a65c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00b0070 con 0x7ff5a00b0b50 2023-12-19T13:55:03.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.575+0000 7ff5a65c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b0350 con 0x7ff5a006c6b0 2023-12-19T13:55:03.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.575+0000 7ff59ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff5a01449e0 0x7ff5a00af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52114/0 (socket says 172.21.15.113:52114) 2023-12-19T13:55:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59ffff640 1 -- 172.21.15.113:0/1887901373 learned_addr learned my addr 172.21.15.113:0/1887901373 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981819184 0 0) 0x7ff5a006bb30 con 0x7ff5a01449e0 2023-12-19T13:55:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 0x7ff5a0166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff58c003520 con 0x7ff5a01449e0 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362709654 0 0) 0x7ff58c003520 con 0x7ff5a01449e0 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 msgr2=0x7ff5a0166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 0x7ff5a0166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 >> v1:172.21.15.151:6789/0 conn(0x7ff5a00b0b50 legacy=0x7ff5a006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00b0630 con 0x7ff5a01449e0 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.576+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff590001670 con 0x7ff5a01449e0 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 >> v1:172.21.15.113:6789/0 conn(0x7ff5a01449e0 legacy=0x7ff5a00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59f7fe640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c003a10 0x7ff58c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59f7fe640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 0x7ff58c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59f7fe640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff58c004d00 0x7ff58c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b0350 con 0x7ff58c004d00 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c00bb10 con 0x7ff58c003a10 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c00bcd0 con 0x7ff5a006c6b0 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff58c004d00 0x7ff58c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff597fff640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 0x7ff58c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59ffff640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c003a10 0x7ff58c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff5a4b61640 1 -- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 msgr2=0x7ff58c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 0x7ff58c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff5a4b61640 1 -- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c003a10 msgr2=0x7ff58c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c003a10 0x7ff58c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff5a4b61640 1 -- 172.21.15.113:0/1887901373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c003520 con 0x7ff58c004d00 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff597fff640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a006c6b0 0x7ff58c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.577+0000 7ff59ffff640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c003a10 0x7ff58c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:03.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.578+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff58c004d00 0x7ff58c005180 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7ff598009f90 tx=0x7ff58c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27b1266d2016f2a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:03.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59802cbd0 con 0x7ff58c004d00 2023-12-19T13:55:03.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59800f040 con 0x7ff58c004d00 2023-12-19T13:55:03.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff59f7fe640 1 -- 172.21.15.113:0/1887901373 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598034440 con 0x7ff58c004d00 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff5a65c4640 1 -- 172.21.15.113:0/1887901373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff58c004d00 msgr2=0x7ff58c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff5a65c4640 1 --2- 172.21.15.113:0/1887901373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff58c004d00 0x7ff58c005180 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7ff598009f90 tx=0x7ff58c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff5a4b61640 1 -- 172.21.15.113:0/1887901373 reap_dead start 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff5a65c4640 1 -- 172.21.15.113:0/1887901373 shutdown_connections 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff5a65c4640 1 -- 172.21.15.113:0/1887901373 >> 172.21.15.113:0/1887901373 conn(0x7ff5a00cbb70 msgr2=0x7ff5a00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.579+0000 7ff5a65c4640 1 -- 172.21.15.113:0/1887901373 shutdown_connections 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.580+0000 7ff5a65c4640 1 -- 172.21.15.113:0/1887901373 wait complete. 2023-12-19T13:55:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.581+0000 7ff5a65c4640 1 Processor -- start 2023-12-19T13:55:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.581+0000 7ff5a65c4640 1 -- start start 2023-12-19T13:55:03.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.582+0000 7ff5a65c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c004d00 0x7ff5a013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.582+0000 7ff5a65c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a013d3a0 0x7ff5a013d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.582+0000 7ff5a65c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5a015d9c0 0x7ff5a015de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.582+0000 7ff5a65c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0155210 con 0x7ff5a015d9c0 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.582+0000 7ff5a65c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a015e380 con 0x7ff58c004d00 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.582+0000 7ff5a65c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0151f20 con 0x7ff5a013d3a0 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5a015d9c0 0x7ff5a015de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5a015d9c0 0x7ff5a015de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36694/0 (socket says 172.21.15.113:36694) 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 -- 172.21.15.113:0/2042889691 learned_addr learned my addr 172.21.15.113:0/2042889691 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff597fff640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a013d3a0 0x7ff5a013d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff59ffff640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c004d00 0x7ff5a013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 -- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a013d3a0 msgr2=0x7ff5a013d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a013d3a0 0x7ff5a013d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 -- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c004d00 msgr2=0x7ff5a013aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c004d00 0x7ff5a013aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff5a4b61640 1 -- 172.21.15.113:0/2042889691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a013e3b0 con 0x7ff5a015d9c0 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff597fff640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a013d3a0 0x7ff5a013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.583+0000 7ff59ffff640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c004d00 0x7ff5a013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.584+0000 7ff5a4b61640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5a015d9c0 0x7ff5a015de40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7ff59800e230 tx=0x7ff598009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.584+0000 7ff59d7fa640 1 -- 172.21.15.113:0/2042889691 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598003b90 con 0x7ff5a015d9c0 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.584+0000 7ff59d7fa640 1 -- 172.21.15.113:0/2042889691 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598003cf0 con 0x7ff5a015d9c0 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.584+0000 7ff59d7fa640 1 -- 172.21.15.113:0/2042889691 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598034b40 con 0x7ff5a015d9c0 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.584+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a013ddf0 con 0x7ff5a015d9c0 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.584+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a0151bb0 con 0x7ff5a015d9c0 2023-12-19T13:55:03.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.585+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0151d40 con 0x7ff5a015d9c0 2023-12-19T13:55:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.586+0000 7ff59d7fa640 1 -- 172.21.15.113:0/2042889691 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff598034ca0 con 0x7ff5a015d9c0 2023-12-19T13:55:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.587+0000 7ff59d7fa640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff58006a430 0x7ff58006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.587+0000 7ff59d7fa640 1 -- 172.21.15.113:0/2042889691 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5980aa180 con 0x7ff5a015d9c0 2023-12-19T13:55:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.587+0000 7ff59ffff640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff58006a430 0x7ff58006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.588+0000 7ff59ffff640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff58006a430 0x7ff58006c8f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff590007990 tx=0x7ff590009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:03.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.591+0000 7ff59d7fa640 1 -- 172.21.15.113:0/2042889691 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff598075780 con 0x7ff5a015d9c0 2023-12-19T13:55:03.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.782+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5a0061910 con 0x7ff5a015d9c0 2023-12-19T13:55:03.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.784+0000 7ff59d7fa640 1 -- 172.21.15.113:0/2042889691 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v151) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff598078da0 con 0x7ff5a015d9c0 2023-12-19T13:55:03.784 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:55:03.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff58006a430 msgr2=0x7ff58006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff58006a430 0x7ff58006c8f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff590007990 tx=0x7ff590009040 comp rx=0 tx=0).stop 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5a015d9c0 msgr2=0x7ff5a015de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5a015d9c0 0x7ff5a015de40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7ff59800e230 tx=0x7ff598009750 comp rx=0 tx=0).stop 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 shutdown_connections 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff58006a430 0x7ff58006c8f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5a015d9c0 0x7ff5a015de40 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a013d3a0 0x7ff5a013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 --2- 172.21.15.113:0/2042889691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c004d00 0x7ff5a013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 >> 172.21.15.113:0/2042889691 conn(0x7ff5a00cbb70 msgr2=0x7ff5a0070710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 shutdown_connections 2023-12-19T13:55:03.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:03.787+0000 7ff5a65c4640 1 -- 172.21.15.113:0/2042889691 wait complete. 2023-12-19T13:55:03.806 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:55:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.022+0000 7fef20630640 1 Processor -- start 2023-12-19T13:55:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.022+0000 7fef20630640 1 -- start start 2023-12-19T13:55:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.023+0000 7fef20630640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fef180cc880 0x7fef1815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.023+0000 7fef20630640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fef180cf580 0x7fef180ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.023+0000 7fef20630640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef1815a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.023+0000 7fef20630640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef180b2580 con 0x7fef180cf580 2023-12-19T13:55:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.023+0000 7fef20630640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef180b33e0 con 0x7fef180cc880 2023-12-19T13:55:04.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.023+0000 7fef20630640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180b1ea0 con 0x7fef180cc1a0 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fef180cf580 0x7fef180ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fef180cf580 0x7fef180ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36706/0 (socket says 172.21.15.113:36706) 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 -- 172.21.15.113:0/3406712078 learned_addr learned my addr 172.21.15.113:0/3406712078 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1e3cc640 1 --2- 172.21.15.113:0/3406712078 >> v2:172.21.15.151:3300/0 conn(0x7fef180cc880 0x7fef1815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1ebcd640 1 --2- 172.21.15.113:0/3406712078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef1815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 -- 172.21.15.113:0/3406712078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 msgr2=0x7fef1815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 --2- 172.21.15.113:0/3406712078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef1815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 -- 172.21.15.113:0/3406712078 >> v2:172.21.15.151:3300/0 conn(0x7fef180cc880 msgr2=0x7fef1815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 --2- 172.21.15.113:0/3406712078 >> v2:172.21.15.151:3300/0 conn(0x7fef180cc880 0x7fef1815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.024+0000 7fef1dbcb640 1 -- 172.21.15.113:0/3406712078 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180cd1a0 con 0x7fef180cf580 2023-12-19T13:55:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.026+0000 7fef1dbcb640 1 --2- 172.21.15.113:0/3406712078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef180ccc60 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fef180b1150 tx=0x7fef0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b305dc603f79da38 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.026+0000 7fef1d3ca640 1 -- 172.21.15.113:0/3406712078 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08031870 con 0x7fef180cf580 2023-12-19T13:55:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.026+0000 7fef1d3ca640 1 -- 172.21.15.113:0/3406712078 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef080319d0 con 0x7fef180cf580 2023-12-19T13:55:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.026+0000 7fef1d3ca640 1 -- 172.21.15.113:0/3406712078 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08031d60 con 0x7fef180cf580 2023-12-19T13:55:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 -- 172.21.15.113:0/3406712078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 msgr2=0x7fef180ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 --2- 172.21.15.113:0/3406712078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef180ccc60 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fef180b1150 tx=0x7fef0802b910 comp rx=0 tx=0).stop 2023-12-19T13:55:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 -- 172.21.15.113:0/3406712078 shutdown_connections 2023-12-19T13:55:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 --2- 172.21.15.113:0/3406712078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef1815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 --2- 172.21.15.113:0/3406712078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef180ccc60 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 --2- 172.21.15.113:0/3406712078 >> v2:172.21.15.151:3300/0 conn(0x7fef180cc880 0x7fef1815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 -- 172.21.15.113:0/3406712078 >> 172.21.15.113:0/3406712078 conn(0x7fef18073150 msgr2=0x7fef180659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 -- 172.21.15.113:0/3406712078 shutdown_connections 2023-12-19T13:55:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.027+0000 7fef20630640 1 -- 172.21.15.113:0/3406712078 wait complete. 2023-12-19T13:55:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.029+0000 7fef20630640 1 Processor -- start 2023-12-19T13:55:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.029+0000 7fef20630640 1 -- start start 2023-12-19T13:55:04.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef20630640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef181528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef20630640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef180cc880 0x7fef1806b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef20630640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef1806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef20630640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef181524c0 con 0x7fef180cf580 2023-12-19T13:55:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef20630640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18152e20 con 0x7fef180cc880 2023-12-19T13:55:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef20630640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef18151840 con 0x7fef180cc1a0 2023-12-19T13:55:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef1ebcd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef1806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef1ebcd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef1806b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36718/0 (socket says 172.21.15.113:36718) 2023-12-19T13:55:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef1ebcd640 1 -- 172.21.15.113:0/3142244862 learned_addr learned my addr 172.21.15.113:0/3142244862 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef1e3cc640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef181528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.030+0000 7fef1dbcb640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef180cc880 0x7fef1806b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef1ebcd640 1 -- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 msgr2=0x7fef181528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef1ebcd640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef181528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef1ebcd640 1 -- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef180cc880 msgr2=0x7fef1806b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef1ebcd640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef180cc880 0x7fef1806b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef1ebcd640 1 -- 172.21.15.113:0/3142244862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef080094d0 con 0x7fef180cf580 2023-12-19T13:55:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef1ebcd640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef1806b920 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c4c0 tx=0x7fef1000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:04.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10004220 con 0x7fef180cf580 2023-12-19T13:55:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef10004380 con 0x7fef180cf580 2023-12-19T13:55:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef18151b20 con 0x7fef180cf580 2023-12-19T13:55:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10003810 con 0x7fef180cf580 2023-12-19T13:55:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.031+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef181520e0 con 0x7fef180cf580 2023-12-19T13:55:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.032+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef18152600 con 0x7fef180cf580 2023-12-19T13:55:04.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.033+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef10003970 con 0x7fef180cf580 2023-12-19T13:55:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.034+0000 7fef0effd640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feefc06a430 0x7feefc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.034+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef100884d0 con 0x7fef180cf580 2023-12-19T13:55:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.034+0000 7fef1e3cc640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feefc06a430 0x7feefc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.034+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7feefc071f60 con 0x7fef180cf580 2023-12-19T13:55:04.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.035+0000 7fef1e3cc640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feefc06a430 0x7feefc06c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef140099c0 tx=0x7fef14003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:04.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.039+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef1001e060 con 0x7fef180cf580 2023-12-19T13:55:04.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.228+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef18061910 con 0x7fef180cf580 2023-12-19T13:55:04.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.229+0000 7fef0effd640 1 -- 172.21.15.113:0/3142244862 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v151) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef18152600 con 0x7fef180cf580 2023-12-19T13:55:04.228 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:55:04.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.231+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feefc06a430 msgr2=0x7feefc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.231+0000 7fef20630640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feefc06a430 0x7feefc06c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef140099c0 tx=0x7fef14003990 comp rx=0 tx=0).stop 2023-12-19T13:55:04.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.231+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 msgr2=0x7fef1806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.231+0000 7fef20630640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef1806b920 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c4c0 tx=0x7fef1000c980 comp rx=0 tx=0).stop 2023-12-19T13:55:04.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 shutdown_connections 2023-12-19T13:55:04.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7feefc06a430 0x7feefc06c8f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180cf580 0x7fef1806b920 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef180cc880 0x7fef1806b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 --2- 172.21.15.113:0/3142244862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180cc1a0 0x7fef181528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 >> 172.21.15.113:0/3142244862 conn(0x7fef18073150 msgr2=0x7fef1815a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:04.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 shutdown_connections 2023-12-19T13:55:04.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.232+0000 7fef20630640 1 -- 172.21.15.113:0/3142244862 wait complete. 2023-12-19T13:55:04.250 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:55:04.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.468+0000 7fd349cc4640 1 Processor -- start 2023-12-19T13:55:04.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.468+0000 7fd349cc4640 1 -- start start 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.470+0000 7fd349cc4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd3440ce820 0x7fd3440d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.470+0000 7fd349cc4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440cd840 con 0x7fd344146e10 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.470+0000 7fd349cc4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440b6e90 con 0x7fd3440d2b00 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.470+0000 7fd349cc4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3440d2430 con 0x7fd3440ce820 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.470+0000 7fd3437fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd344146e10 0x7fd3440b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52120/0 (socket says 172.21.15.113:52120) 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.470+0000 7fd3437fe640 1 -- 172.21.15.113:0/1545844254 learned_addr learned my addr 172.21.15.113:0/1545844254 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd343fff640 1 --2- 172.21.15.113:0/1545844254 >> v2:172.21.15.151:3300/0 conn(0x7fd3440ce820 0x7fd3440d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281522987 0 0) 0x7fd3440cd840 con 0x7fd344146e10 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd330003520 con 0x7fd344146e10 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054639245 0 0) 0x7fd330003520 con 0x7fd344146e10 2023-12-19T13:55:04.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 >> v2:172.21.15.151:3300/0 conn(0x7fd3440ce820 msgr2=0x7fd3440d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 --2- 172.21.15.113:0/1545844254 >> v2:172.21.15.151:3300/0 conn(0x7fd3440ce820 0x7fd3440d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 >> v1:172.21.15.151:6789/0 conn(0x7fd3440d2b00 legacy=0x7fd3440ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440d2620 con 0x7fd344146e10 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fd3340019f0 con 0x7fd344146e10 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.471+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 >> v1:172.21.15.113:6789/0 conn(0x7fd344146e10 legacy=0x7fd3440b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3427fc640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd330003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3427fc640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3300047c0 0x7fd330004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3427fc640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3300052a0 0x7fd33000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000c140 con 0x7fd330003a30 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000c2b0 con 0x7fd3300047c0 2023-12-19T13:55:04.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000c470 con 0x7fd3300052a0 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3437fe640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd330003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd342ffd640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3300047c0 0x7fd330004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3437fe640 1 -- 172.21.15.113:0/1545844254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3300052a0 msgr2=0x7fd33000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3437fe640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3300052a0 0x7fd33000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3437fe640 1 -- 172.21.15.113:0/1545844254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3300047c0 msgr2=0x7fd330004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3437fe640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3300047c0 0x7fd330004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd3437fe640 1 -- 172.21.15.113:0/1545844254 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330003520 con 0x7fd330003a30 2023-12-19T13:55:04.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.472+0000 7fd343fff640 1 -- 172.21.15.113:0/1545844254 reap_dead start 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.473+0000 7fd3437fe640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd330003e50 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fd33400a760 tx=0x7fd3300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92eafe42b80c2a9d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334034630 con 0x7fd330003a30 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33402f070 con 0x7fd330003a30 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd3427fc640 1 -- 172.21.15.113:0/1545844254 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334034a50 con 0x7fd330003a30 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd349cc4640 1 -- 172.21.15.113:0/1545844254 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 msgr2=0x7fd330003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd349cc4640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd330003e50 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fd33400a760 tx=0x7fd3300057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd349cc4640 1 -- 172.21.15.113:0/1545844254 shutdown_connections 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd349cc4640 1 --2- 172.21.15.113:0/1545844254 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd330003e50 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd349cc4640 1 -- 172.21.15.113:0/1545844254 >> 172.21.15.113:0/1545844254 conn(0x7fd3440b29c0 msgr2=0x7fd3440b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd349cc4640 1 -- 172.21.15.113:0/1545844254 shutdown_connections 2023-12-19T13:55:04.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.474+0000 7fd349cc4640 1 -- 172.21.15.113:0/1545844254 wait complete. 2023-12-19T13:55:04.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.476+0000 7fd349cc4640 1 Processor -- start 2023-12-19T13:55:04.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.476+0000 7fd349cc4640 1 -- start start 2023-12-19T13:55:04.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd349cc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd3441563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd349cc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd344156920 0x7fd3441570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd349cc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3441575e0 0x7fd34413ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd349cc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd344155b60 con 0x7fd330003a30 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd349cc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd344154d00 con 0x7fd3441575e0 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd349cc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd344154fe0 con 0x7fd344156920 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd3437fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd3441563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd3437fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd3441563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36742/0 (socket says 172.21.15.113:36742) 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.477+0000 7fd3437fe640 1 -- 172.21.15.113:0/586114750 learned_addr learned my addr 172.21.15.113:0/586114750 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd3437fe640 1 -- 172.21.15.113:0/586114750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd344156920 msgr2=0x7fd3441570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd3437fe640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd344156920 0x7fd3441570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd3437fe640 1 -- 172.21.15.113:0/586114750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3441575e0 msgr2=0x7fd34413ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd3437fe640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3441575e0 0x7fd34413ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd3437fe640 1 -- 172.21.15.113:0/586114750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3441552c0 con 0x7fd330003a30 2023-12-19T13:55:04.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd3437fe640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd3441563e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd33402ca60 tx=0x7fd334001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:04.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334004e20 con 0x7fd330003a30 2023-12-19T13:55:04.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33403f470 con 0x7fd330003a30 2023-12-19T13:55:04.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3441555a0 con 0x7fd330003a30 2023-12-19T13:55:04.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33403f7e0 con 0x7fd330003a30 2023-12-19T13:55:04.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.478+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34415a150 con 0x7fd330003a30 2023-12-19T13:55:04.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.480+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd344061910 con 0x7fd330003a30 2023-12-19T13:55:04.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.480+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd334031030 con 0x7fd330003a30 2023-12-19T13:55:04.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.481+0000 7fd33bfff640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32406a430 0x7fd32406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:04.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.481+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3340aa3e0 con 0x7fd330003a30 2023-12-19T13:55:04.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.482+0000 7fd342ffd640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32406a430 0x7fd32406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:04.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.482+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fd324071f60 con 0x7fd330003a30 2023-12-19T13:55:04.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.482+0000 7fd342ffd640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32406a430 0x7fd32406c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd344156d00 tx=0x7fd32c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:04.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.486+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3340759c0 con 0x7fd330003a30 2023-12-19T13:55:04.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.691+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd34415eb30 con 0x7fd330003a30 2023-12-19T13:55:04.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.692+0000 7fd33bfff640 1 -- 172.21.15.113:0/586114750 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v151) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd334044070 con 0x7fd330003a30 2023-12-19T13:55:04.691 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:55:04.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32406a430 msgr2=0x7fd32406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32406a430 0x7fd32406c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd344156d00 tx=0x7fd32c009040 comp rx=0 tx=0).stop 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 msgr2=0x7fd3441563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd3441563e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd33402ca60 tx=0x7fd334001cb0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 shutdown_connections 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32406a430 0x7fd32406c8f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3441575e0 0x7fd34413ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd344156920 0x7fd3441570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 --2- 172.21.15.113:0/586114750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd330003a30 0x7fd3441563e0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 >> 172.21.15.113:0/586114750 conn(0x7fd3440b29c0 msgr2=0x7fd3440b77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 shutdown_connections 2023-12-19T13:55:04.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:04.695+0000 7fd349cc4640 1 -- 172.21.15.113:0/586114750 wait complete. 2023-12-19T13:55:04.714 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:55:04.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:04.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:55:04.829 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:55:04.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:04.830 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:55:04.884 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:55:04.884 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:04.945 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:55:04.945 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:55:04.945 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:05.003 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:55:05.004 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:05.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.230+0000 7f743dadb640 1 Processor -- start 2023-12-19T13:55:05.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.230+0000 7f743dadb640 1 -- start start 2023-12-19T13:55:05.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f743dadb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7438157bf0 0x7f743815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f743dadb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74380b0810 0x7f743806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f743dadb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743815b740 con 0x7f74380ae110 2023-12-19T13:55:05.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f743dadb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743806b8c0 con 0x7f74380b0810 2023-12-19T13:55:05.231 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f743dadb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74380ae640 con 0x7f7438157bf0 2023-12-19T13:55:05.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f7437fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74380b0810 0x7f743806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f7437fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74380b0810 0x7f743806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36744/0 (socket says 172.21.15.113:36744) 2023-12-19T13:55:05.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f7437fff640 1 -- 172.21.15.113:0/209461582 learned_addr learned my addr 172.21.15.113:0/209461582 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:05.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f74377fe640 1 --2- 172.21.15.113:0/209461582 >> v2:172.21.15.151:3300/0 conn(0x7f7438157bf0 0x7f743815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f7437fff640 1 -- 172.21.15.113:0/209461582 >> v2:172.21.15.151:3300/0 conn(0x7f7438157bf0 msgr2=0x7f743815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:05.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f7437fff640 1 --2- 172.21.15.113:0/209461582 >> v2:172.21.15.151:3300/0 conn(0x7f7438157bf0 0x7f743815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.232+0000 7f7437fff640 1 -- 172.21.15.113:0/209461582 >> v1:172.21.15.151:6789/0 conn(0x7f74380ae110 legacy=0x7f74380b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:05.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.233+0000 7f7437fff640 1 -- 172.21.15.113:0/209461582 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380ae920 con 0x7f74380b0810 2023-12-19T13:55:05.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.233+0000 7f74377fe640 1 --2- 172.21.15.113:0/209461582 >> v2:172.21.15.151:3300/0 conn(0x7f7438157bf0 0x7f743815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.234+0000 7f7437fff640 1 --2- 172.21.15.113:0/209461582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74380b0810 0x7f743806d230 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f74380ccbc0 tx=0x7f743002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be709760aa0deda server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.234+0000 7f7436ffd640 1 -- 172.21.15.113:0/209461582 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743002ca80 con 0x7f74380b0810 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.234+0000 7f7436ffd640 1 -- 172.21.15.113:0/209461582 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743002cbe0 con 0x7f74380b0810 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.234+0000 7f7436ffd640 1 -- 172.21.15.113:0/209461582 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300343f0 con 0x7f74380b0810 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 -- 172.21.15.113:0/209461582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74380b0810 msgr2=0x7f743806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 --2- 172.21.15.113:0/209461582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74380b0810 0x7f743806d230 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f74380ccbc0 tx=0x7f743002bee0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 -- 172.21.15.113:0/209461582 shutdown_connections 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 --2- 172.21.15.113:0/209461582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74380b0810 0x7f743806d230 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 --2- 172.21.15.113:0/209461582 >> v2:172.21.15.151:3300/0 conn(0x7f7438157bf0 0x7f743815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 -- 172.21.15.113:0/209461582 >> 172.21.15.113:0/209461582 conn(0x7f74380cbb70 msgr2=0x7f74380cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:05.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 -- 172.21.15.113:0/209461582 shutdown_connections 2023-12-19T13:55:05.235 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.235+0000 7f743dadb640 1 -- 172.21.15.113:0/209461582 wait complete. 2023-12-19T13:55:05.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.237+0000 7f743dadb640 1 Processor -- start 2023-12-19T13:55:05.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.237+0000 7f743dadb640 1 -- start start 2023-12-19T13:55:05.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.238+0000 7f743dadb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380ae110 0x7f743815df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.238+0000 7f743dadb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74380b0810 0x7f7438142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.238+0000 7f743dadb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7438157bf0 0x7f7438143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.238+0000 7f743dadb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743815bd00 con 0x7f7438157bf0 2023-12-19T13:55:05.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.238+0000 7f743dadb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74381436b0 con 0x7f74380b0810 2023-12-19T13:55:05.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.238+0000 7f743dadb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74380ccc20 con 0x7f74380ae110 2023-12-19T13:55:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7438157bf0 0x7f7438143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7438157bf0 0x7f7438143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36758/0 (socket says 172.21.15.113:36758) 2023-12-19T13:55:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 -- 172.21.15.113:0/2416539961 learned_addr learned my addr 172.21.15.113:0/2416539961 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f742ffff640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74380b0810 0x7f7438142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f74377fe640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380ae110 0x7f743815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 -- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380ae110 msgr2=0x7f743815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380ae110 0x7f743815df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 -- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74380b0810 msgr2=0x7f7438142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74380b0810 0x7f7438142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 -- 172.21.15.113:0/2416539961 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009b30 con 0x7f7438157bf0 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f74377fe640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380ae110 0x7f743815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.239+0000 7f7437fff640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7438157bf0 0x7f7438143170 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f7430036040 tx=0x7f7430004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.240+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743003e450 con 0x7f7438157bf0 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.240+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743003e5d0 con 0x7f7438157bf0 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.240+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743003e980 con 0x7f7438157bf0 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.240+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74380cce70 con 0x7f7438157bf0 2023-12-19T13:55:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.240+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743815b920 con 0x7f7438157bf0 2023-12-19T13:55:05.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.241+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743815be40 con 0x7f7438157bf0 2023-12-19T13:55:05.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.242+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f743002cd50 con 0x7f7438157bf0 2023-12-19T13:55:05.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.243+0000 7f7434ff9640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f741806a460 0x7f741806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.243+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74300ab2e0 con 0x7f7438157bf0 2023-12-19T13:55:05.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.243+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f7418071f90 con 0x7f7438157bf0 2023-12-19T13:55:05.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.243+0000 7f74377fe640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f741806a460 0x7f741806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.244+0000 7f74377fe640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f741806a460 0x7f741806c920 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7428006fd0 tx=0x7f7428008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.248+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f743815be40 con 0x7f7438157bf0 2023-12-19T13:55:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.480+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f743815be40 con 0x7f7438157bf0 2023-12-19T13:55:05.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.481+0000 7f7434ff9640 1 -- 172.21.15.113:0/2416539961 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f743815be40 con 0x7f7438157bf0 2023-12-19T13:55:05.481 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:05.481 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:55:05.481 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:55:05.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f741806a460 msgr2=0x7f741806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f741806a460 0x7f741806c920 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7428006fd0 tx=0x7f7428008040 comp rx=0 tx=0).stop 2023-12-19T13:55:05.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7438157bf0 msgr2=0x7f7438143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7438157bf0 0x7f7438143170 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f7430036040 tx=0x7f7430004a40 comp rx=0 tx=0).stop 2023-12-19T13:55:05.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 shutdown_connections 2023-12-19T13:55:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f741806a460 0x7f741806c920 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7438157bf0 0x7f7438143170 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74380b0810 0x7f7438142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 --2- 172.21.15.113:0/2416539961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380ae110 0x7f743815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.484+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 >> 172.21.15.113:0/2416539961 conn(0x7f74380cbb70 msgr2=0x7f74380afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.485+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 shutdown_connections 2023-12-19T13:55:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.485+0000 7f743dadb640 1 -- 172.21.15.113:0/2416539961 wait complete. 2023-12-19T13:55:05.503 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:05.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.715+0000 7f5e3cf9c640 1 Processor -- start 2023-12-19T13:55:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.715+0000 7f5e3cf9c640 1 -- start start 2023-12-19T13:55:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.717+0000 7f5e3cf9c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e380ae110 0x7f5e380b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.717+0000 7f5e3cf9c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.717+0000 7f5e3cf9c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380ae640 con 0x7f5e38157bf0 2023-12-19T13:55:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.717+0000 7f5e3cf9c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3806b8c0 con 0x7f5e380ae110 2023-12-19T13:55:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.717+0000 7f5e3cf9c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380b0ab0 con 0x7f5e380b0640 2023-12-19T13:55:05.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e2ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e380ae110 0x7f5e380b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e36d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e2ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e380ae110 0x7f5e380b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:39098/0 (socket says 172.21.15.113:39098) 2023-12-19T13:55:05.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e36d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:43990/0 (socket says 172.21.15.113:43990) 2023-12-19T13:55:05.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e2ffff640 1 -- 172.21.15.113:0/2804503849 learned_addr learned my addr 172.21.15.113:0/2804503849 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:05.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e2ffff640 1 -- 172.21.15.113:0/2804503849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 msgr2=0x7f5e3806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:05.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e2ffff640 1 --2- 172.21.15.113:0/2804503849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e2ffff640 1 -- 172.21.15.113:0/2804503849 >> v1:172.21.15.151:6789/0 conn(0x7f5e38157bf0 legacy=0x7f5e3815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:05.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.718+0000 7f5e2ffff640 1 -- 172.21.15.113:0/2804503849 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380ae920 con 0x7f5e380ae110 2023-12-19T13:55:05.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.720+0000 7f5e2ffff640 1 --2- 172.21.15.113:0/2804503849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e380ae110 0x7f5e380b0100 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098a0 tx=0x7f5e2002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af31518960fdaf24 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:05.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.720+0000 7f5e35d9b640 1 -- 172.21.15.113:0/2804503849 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20030840 con 0x7f5e380ae110 2023-12-19T13:55:05.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.720+0000 7f5e35d9b640 1 -- 172.21.15.113:0/2804503849 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e200309a0 con 0x7f5e380ae110 2023-12-19T13:55:05.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.720+0000 7f5e35d9b640 1 -- 172.21.15.113:0/2804503849 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20030d30 con 0x7f5e380ae110 2023-12-19T13:55:05.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2804503849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e380ae110 msgr2=0x7f5e380b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2804503849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e380ae110 0x7f5e380b0100 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098a0 tx=0x7f5e2002b980 comp rx=0 tx=0).stop 2023-12-19T13:55:05.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2804503849 shutdown_connections 2023-12-19T13:55:05.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2804503849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2804503849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e380ae110 0x7f5e380b0100 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2804503849 >> 172.21.15.113:0/2804503849 conn(0x7f5e380cbb70 msgr2=0x7f5e380cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:05.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2804503849 shutdown_connections 2023-12-19T13:55:05.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.721+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2804503849 wait complete. 2023-12-19T13:55:05.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.723+0000 7f5e3cf9c640 1 Processor -- start 2023-12-19T13:55:05.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.723+0000 7f5e3cf9c640 1 -- start start 2023-12-19T13:55:05.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3cf9c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e380ae110 0x7f5e38149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3cf9c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3cf9c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e38157bf0 0x7f5e38070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3cf9c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380b1cd0 con 0x7f5e380ae110 2023-12-19T13:55:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3cf9c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380b13a0 con 0x7f5e38157bf0 2023-12-19T13:55:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3cf9c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380b1680 con 0x7f5e380b0640 2023-12-19T13:55:05.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e380ae110 0x7f5e38149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e380ae110 0x7f5e38149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36760/0 (socket says 172.21.15.113:36760) 2023-12-19T13:55:05.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e3659c640 1 -- 172.21.15.113:0/2333833655 learned_addr learned my addr 172.21.15.113:0/2333833655 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:05.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e2ffff640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.724+0000 7f5e36d9d640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e38157bf0 0x7f5e38070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3659c640 1 -- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 msgr2=0x7f5e3806fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3659c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3659c640 1 -- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e38157bf0 msgr2=0x7f5e38070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3659c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e38157bf0 0x7f5e38070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3659c640 1 -- 172.21.15.113:0/2333833655 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200094d0 con 0x7f5e380ae110 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e2ffff640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e36d9d640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e38157bf0 0x7f5e38070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3659c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e380ae110 0x7f5e38149f30 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800c390 tx=0x7f5e2800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280052d0 con 0x7f5e380ae110 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28005430 con 0x7f5e380ae110 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28003830 con 0x7f5e380ae110 2023-12-19T13:55:05.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380b1960 con 0x7f5e380ae110 2023-12-19T13:55:05.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.725+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3814a470 con 0x7f5e380ae110 2023-12-19T13:55:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.726+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e38061910 con 0x7f5e380ae110 2023-12-19T13:55:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.727+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e28003990 con 0x7f5e380ae110 2023-12-19T13:55:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.728+0000 7f5e2effd640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e1806a430 0x7f5e1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.728+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e28087ed0 con 0x7f5e380ae110 2023-12-19T13:55:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.728+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f5e18071f60 con 0x7f5e380ae110 2023-12-19T13:55:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.728+0000 7f5e2ffff640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e1806a430 0x7f5e1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:05.730 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.729+0000 7f5e2ffff640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e1806a430 0x7f5e1806c8f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5e20036000 tx=0x7f5e2003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:05.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.733+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e280534b0 con 0x7f5e380ae110 2023-12-19T13:55:05.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.929+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e38156a50 con 0x7f5e380ae110 2023-12-19T13:55:05.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.932+0000 7f5e2effd640 1 -- 172.21.15.113:0/2333833655 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16190 (secure 0 0 0) 0x7f5e28017020 con 0x7f5e380ae110 2023-12-19T13:55:05.932 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:05.932 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":151,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:03.600123+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e1806a430 msgr2=0x7f5e1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e1806a430 0x7f5e1806c8f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5e20036000 tx=0x7f5e2003b040 comp rx=0 tx=0).stop 2023-12-19T13:55:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e380ae110 msgr2=0x7f5e38149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:05.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e380ae110 0x7f5e38149f30 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800c390 tx=0x7f5e2800c850 comp rx=0 tx=0).stop 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 shutdown_connections 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e1806a430 0x7f5e1806c8f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e38157bf0 0x7f5e38070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e380b0640 0x7f5e3806fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 --2- 172.21.15.113:0/2333833655 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e380ae110 0x7f5e38149f30 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 >> 172.21.15.113:0/2333833655 conn(0x7f5e380cbb70 msgr2=0x7f5e3806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 shutdown_connections 2023-12-19T13:55:05.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:05.935+0000 7f5e3cf9c640 1 -- 172.21.15.113:0/2333833655 wait complete. 2023-12-19T13:55:05.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:54:23.704080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:54:25.109205+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:55:05.954 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:55:06.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.180+0000 7fb0c096e640 1 Processor -- start 2023-12-19T13:55:06.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.180+0000 7fb0c096e640 1 -- start start 2023-12-19T13:55:06.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.182+0000 7fb0c096e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb0bc15b1d0 0x7fb0bc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.182+0000 7fb0c096e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0bc0ceea0 0x7fb0bc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.182+0000 7fb0c096e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0bc15fde0 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.182+0000 7fb0c096e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc0cf870 con 0x7fb0bc0ceea0 2023-12-19T13:55:06.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.182+0000 7fb0c096e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc15ef10 con 0x7fb0bc15b1d0 2023-12-19T13:55:06.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.182+0000 7fb0bad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0bc0ceea0 0x7fb0bc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.182+0000 7fb0bad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0bc0ceea0 0x7fb0bc0cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36770/0 (socket says 172.21.15.113:36770) 2023-12-19T13:55:06.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.183+0000 7fb0bad9d640 1 -- 172.21.15.113:0/2246605823 learned_addr learned my addr 172.21.15.113:0/2246605823 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:06.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.183+0000 7fb0ba59c640 1 --2- 172.21.15.113:0/2246605823 >> v2:172.21.15.151:3300/0 conn(0x7fb0bc15b1d0 0x7fb0bc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.183+0000 7fb0bad9d640 1 -- 172.21.15.113:0/2246605823 >> v2:172.21.15.151:3300/0 conn(0x7fb0bc15b1d0 msgr2=0x7fb0bc0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:06.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.183+0000 7fb0bad9d640 1 --2- 172.21.15.113:0/2246605823 >> v2:172.21.15.151:3300/0 conn(0x7fb0bc15b1d0 0x7fb0bc0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.183+0000 7fb0bad9d640 1 -- 172.21.15.113:0/2246605823 >> v1:172.21.15.151:6789/0 conn(0x7fb0bc0b1ec0 legacy=0x7fb0bc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:06.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.183+0000 7fb0bad9d640 1 -- 172.21.15.113:0/2246605823 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc0b2320 con 0x7fb0bc0ceea0 2023-12-19T13:55:06.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.183+0000 7fb0ba59c640 1 --2- 172.21.15.113:0/2246605823 >> v2:172.21.15.151:3300/0 conn(0x7fb0bc15b1d0 0x7fb0bc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:06.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.184+0000 7fb0bad9d640 1 --2- 172.21.15.113:0/2246605823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0ceea0 0x7fb0bc0cf330 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0ae020 tx=0x7fb0b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a479e4d5eb7202a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:06.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.184+0000 7fb0b9d9b640 1 -- 172.21.15.113:0/2246605823 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b402ca80 con 0x7fb0bc0ceea0 2023-12-19T13:55:06.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.184+0000 7fb0b9d9b640 1 -- 172.21.15.113:0/2246605823 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b402cbe0 con 0x7fb0bc0ceea0 2023-12-19T13:55:06.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.184+0000 7fb0b9d9b640 1 -- 172.21.15.113:0/2246605823 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b40343f0 con 0x7fb0bc0ceea0 2023-12-19T13:55:06.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 -- 172.21.15.113:0/2246605823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0ceea0 msgr2=0x7fb0bc0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 --2- 172.21.15.113:0/2246605823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0ceea0 0x7fb0bc0cf330 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0ae020 tx=0x7fb0b402bee0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 -- 172.21.15.113:0/2246605823 shutdown_connections 2023-12-19T13:55:06.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 --2- 172.21.15.113:0/2246605823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0ceea0 0x7fb0bc0cf330 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 --2- 172.21.15.113:0/2246605823 >> v2:172.21.15.151:3300/0 conn(0x7fb0bc15b1d0 0x7fb0bc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 -- 172.21.15.113:0/2246605823 >> 172.21.15.113:0/2246605823 conn(0x7fb0bc073150 msgr2=0x7fb0bc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:06.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 -- 172.21.15.113:0/2246605823 shutdown_connections 2023-12-19T13:55:06.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.185+0000 7fb0c096e640 1 -- 172.21.15.113:0/2246605823 wait complete. 2023-12-19T13:55:06.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.187+0000 7fb0c096e640 1 Processor -- start 2023-12-19T13:55:06.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.188+0000 7fb0c096e640 1 -- start start 2023-12-19T13:55:06.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0c096e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0b1ec0 0x7fb0bc147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0c096e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0bc0ceea0 0x7fb0bc155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0c096e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0bc15b1d0 0x7fb0bc159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0c096e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc148090 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0c096e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0cac40 con 0x7fb0bc15b1d0 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0c096e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0ca030 con 0x7fb0bc0ceea0 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0b1ec0 0x7fb0bc147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0b1ec0 0x7fb0bc147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36786/0 (socket says 172.21.15.113:36786) 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 -- 172.21.15.113:0/3004486300 learned_addr learned my addr 172.21.15.113:0/3004486300 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 -- 172.21.15.113:0/3004486300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0bc0ceea0 msgr2=0x7fb0bc155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0bc0ceea0 0x7fb0bc155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 -- 172.21.15.113:0/3004486300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0bc15b1d0 msgr2=0x7fb0bc159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0bc15b1d0 0x7fb0bc159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.189+0000 7fb0ba59c640 1 -- 172.21.15.113:0/3004486300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b4009b30 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.190+0000 7fb0ba59c640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0b1ec0 0x7fb0bc147b50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00c7f0 tx=0x7fb0ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:06.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.190+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac007820 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.190+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac007980 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.190+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc0ca310 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.190+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac007cf0 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.190+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc0ca8d0 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.191+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0bc061910 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.192+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0ac0113f0 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.193+0000 7fb0b2ffd640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb09c06a460 0x7fb09c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.193+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0ac088c50 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.193+0000 7fb0b3fff640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb09c06a460 0x7fb09c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.193+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fb09c071f90 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.194+0000 7fb0b3fff640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb09c06a460 0x7fb09c06c920 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0b07f0 tx=0x7fb0a4007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:06.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.199+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb0ac01f060 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.384+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0bc0cdc90 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.385+0000 7fb0b2ffd640 1 -- 172.21.15.113:0/3004486300 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v151) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0ac054230 con 0x7fb0bc0b1ec0 2023-12-19T13:55:06.385 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:55:06.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb09c06a460 msgr2=0x7fb09c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.388 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb09c06a460 0x7fb09c06c920 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0b07f0 tx=0x7fb0a4007990 comp rx=0 tx=0).stop 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0b1ec0 msgr2=0x7fb0bc147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0b1ec0 0x7fb0bc147b50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00c7f0 tx=0x7fb0ac00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 shutdown_connections 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb09c06a460 0x7fb09c06c920 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0bc15b1d0 0x7fb0bc159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0bc0ceea0 0x7fb0bc155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 --2- 172.21.15.113:0/3004486300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0bc0b1ec0 0x7fb0bc147b50 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 >> 172.21.15.113:0/3004486300 conn(0x7fb0bc073150 msgr2=0x7fb0bc0b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 shutdown_connections 2023-12-19T13:55:06.389 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.389+0000 7fb0c096e640 1 -- 172.21.15.113:0/3004486300 wait complete. 2023-12-19T13:55:06.407 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:55:06.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.618+0000 7f8a03300640 1 Processor -- start 2023-12-19T13:55:06.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.618+0000 7f8a03300640 1 -- start start 2023-12-19T13:55:06.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a03300640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89fc0b0b50 0x7f89fc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a03300640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f89fc06b590 0x7f89fc06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a03300640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc06bb30 con 0x7f89fc1449e0 2023-12-19T13:55:06.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a03300640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0b0070 con 0x7f89fc06b590 2023-12-19T13:55:06.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a03300640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0b0350 con 0x7f89fc0b0b50 2023-12-19T13:55:06.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a0189d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f89fc06b590 0x7f89fc06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a0189d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f89fc06b590 0x7f89fc06c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36790/0 (socket says 172.21.15.113:36790) 2023-12-19T13:55:06.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.620+0000 7f8a0189d640 1 -- 172.21.15.113:0/4035365788 learned_addr learned my addr 172.21.15.113:0/4035365788 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:06.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.621+0000 7f8a0089b640 1 --2- 172.21.15.113:0/4035365788 >> v2:172.21.15.151:3300/0 conn(0x7f89fc0b0b50 0x7f89fc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.621+0000 7f8a0189d640 1 -- 172.21.15.113:0/4035365788 >> v2:172.21.15.151:3300/0 conn(0x7f89fc0b0b50 msgr2=0x7f89fc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:06.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.621+0000 7f8a0189d640 1 --2- 172.21.15.113:0/4035365788 >> v2:172.21.15.151:3300/0 conn(0x7f89fc0b0b50 0x7f89fc06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.621+0000 7f8a0189d640 1 -- 172.21.15.113:0/4035365788 >> v1:172.21.15.151:6789/0 conn(0x7f89fc1449e0 legacy=0x7f89fc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:06.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.621+0000 7f8a0189d640 1 -- 172.21.15.113:0/4035365788 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0b0630 con 0x7f89fc06b590 2023-12-19T13:55:06.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.622+0000 7f8a0189d640 1 --2- 172.21.15.113:0/4035365788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc06b590 0x7f89fc06c4e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f89fc071c80 tx=0x7f89f402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0afb388fbabc307 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:06.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.622+0000 7f89f3fff640 1 -- 172.21.15.113:0/4035365788 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f402ca80 con 0x7f89fc06b590 2023-12-19T13:55:06.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.622+0000 7f89f3fff640 1 -- 172.21.15.113:0/4035365788 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f402cbe0 con 0x7f89fc06b590 2023-12-19T13:55:06.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.622+0000 7f89f3fff640 1 -- 172.21.15.113:0/4035365788 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40343f0 con 0x7f89fc06b590 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 -- 172.21.15.113:0/4035365788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc06b590 msgr2=0x7f89fc06c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 --2- 172.21.15.113:0/4035365788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc06b590 0x7f89fc06c4e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f89fc071c80 tx=0x7f89f402bee0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 -- 172.21.15.113:0/4035365788 shutdown_connections 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 --2- 172.21.15.113:0/4035365788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc06b590 0x7f89fc06c4e0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 --2- 172.21.15.113:0/4035365788 >> v2:172.21.15.151:3300/0 conn(0x7f89fc0b0b50 0x7f89fc06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 -- 172.21.15.113:0/4035365788 >> 172.21.15.113:0/4035365788 conn(0x7f89fc0cbb70 msgr2=0x7f89fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 -- 172.21.15.113:0/4035365788 shutdown_connections 2023-12-19T13:55:06.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.623+0000 7f8a03300640 1 -- 172.21.15.113:0/4035365788 wait complete. 2023-12-19T13:55:06.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.625+0000 7f8a03300640 1 Processor -- start 2023-12-19T13:55:06.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.625+0000 7f8a03300640 1 -- start start 2023-12-19T13:55:06.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a03300640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89fc06b590 0x7f89fc157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a03300640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89fc0b0b50 0x7f89fc1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a03300640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc1449e0 0x7f89fc15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a03300640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc1592a0 con 0x7f89fc1449e0 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a03300640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc157ad0 con 0x7f89fc0b0b50 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a03300640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc13b600 con 0x7f89fc06b590 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a0189d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc1449e0 0x7f89fc15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a0189d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc1449e0 0x7f89fc15c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36802/0 (socket says 172.21.15.113:36802) 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a0189d640 1 -- 172.21.15.113:0/846393881 learned_addr learned my addr 172.21.15.113:0/846393881 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a0189d640 1 -- 172.21.15.113:0/846393881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89fc06b590 msgr2=0x7f89fc157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.626+0000 7f8a0189d640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89fc06b590 0x7f89fc157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f8a0189d640 1 -- 172.21.15.113:0/846393881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89fc0b0b50 msgr2=0x7f89fc1f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f8a0189d640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89fc0b0b50 0x7f89fc1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f8a0189d640 1 -- 172.21.15.113:0/846393881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4009b30 con 0x7f89fc1449e0 2023-12-19T13:55:06.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f8a0189d640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc1449e0 0x7f89fc15c370 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009f40 tx=0x7f89f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:06.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4009510 con 0x7f89fc1449e0 2023-12-19T13:55:06.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f403e450 con 0x7f89fc1449e0 2023-12-19T13:55:06.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f403e800 con 0x7f89fc1449e0 2023-12-19T13:55:06.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc1585a0 con 0x7f89fc1449e0 2023-12-19T13:55:06.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.627+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc157fe0 con 0x7f89fc1449e0 2023-12-19T13:55:06.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.628+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc061910 con 0x7f89fc1449e0 2023-12-19T13:55:06.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.629+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89f402cd50 con 0x7f89fc1449e0 2023-12-19T13:55:06.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.630+0000 7f89f1ffb640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89e006a480 0x7f89e006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:06.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.631+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89f40ab780 con 0x7f89fc1449e0 2023-12-19T13:55:06.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.631+0000 7f8a0109c640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89e006a480 0x7f89e006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:06.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.631+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f89e0071fb0 con 0x7f89fc1449e0 2023-12-19T13:55:06.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.632+0000 7f8a0109c640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89e006a480 0x7f89e006c940 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006fd0 tx=0x7f89f8006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:06.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.635+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89f4076d50 con 0x7f89fc1449e0 2023-12-19T13:55:06.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.826+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89fc0ae560 con 0x7f89fc1449e0 2023-12-19T13:55:06.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.826+0000 7f89f1ffb640 1 -- 172.21.15.113:0/846393881 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v151) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89f4043020 con 0x7f89fc1449e0 2023-12-19T13:55:06.826 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:55:06.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89e006a480 msgr2=0x7f89e006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89e006a480 0x7f89e006c940 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006fd0 tx=0x7f89f8006bc0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc1449e0 msgr2=0x7f89fc15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc1449e0 0x7f89fc15c370 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009f40 tx=0x7f89f4004a40 comp rx=0 tx=0).stop 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 shutdown_connections 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f89e006a480 0x7f89e006c940 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f89fc1449e0 0x7f89fc15c370 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89fc0b0b50 0x7f89fc1f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 --2- 172.21.15.113:0/846393881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89fc06b590 0x7f89fc157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 >> 172.21.15.113:0/846393881 conn(0x7f89fc0cbb70 msgr2=0x7f89fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 shutdown_connections 2023-12-19T13:55:06.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:06.829+0000 7f8a03300640 1 -- 172.21.15.113:0/846393881 wait complete. 2023-12-19T13:55:06.846 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:55:07.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.061+0000 7f7c6c210640 1 Processor -- start 2023-12-19T13:55:07.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.061+0000 7f7c6c210640 1 -- start start 2023-12-19T13:55:07.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.063+0000 7f7c6c210640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7c6406fc40 0x7f7c640d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.063+0000 7f7c6c210640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64161e70 con 0x7f7c640b6430 2023-12-19T13:55:07.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.063+0000 7f7c6c210640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64161260 con 0x7f7c64146ff0 2023-12-19T13:55:07.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.063+0000 7f7c6c210640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c64161080 con 0x7f7c6406fc40 2023-12-19T13:55:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.063+0000 7f7c6a7ad640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7c640b6430 0x7f7c6415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:52124/0 (socket says 172.21.15.113:52124) 2023-12-19T13:55:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.063+0000 7f7c6a7ad640 1 -- 172.21.15.113:0/3110855925 learned_addr learned my addr 172.21.15.113:0/3110855925 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:07.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c697ab640 1 --2- 172.21.15.113:0/3110855925 >> v2:172.21.15.151:3300/0 conn(0x7f7c6406fc40 0x7f7c640d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890724569 0 0) 0x7f7c64161e70 con 0x7f7c640b6430 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c4c003520 con 0x7f7c640b6430 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306882953 0 0) 0x7f7c4c003520 con 0x7f7c640b6430 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 >> v2:172.21.15.151:3300/0 conn(0x7f7c6406fc40 msgr2=0x7f7c640d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 --2- 172.21.15.113:0/3110855925 >> v2:172.21.15.151:3300/0 conn(0x7f7c6406fc40 0x7f7c640d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 >> v1:172.21.15.151:6789/0 conn(0x7f7c64146ff0 legacy=0x7f7c6406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c64161540 con 0x7f7c640b6430 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f7c5c001670 con 0x7f7c640b6430 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 >> v1:172.21.15.113:6789/0 conn(0x7f7c640b6430 legacy=0x7f7c6415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0039e0 0x7f7c4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.064+0000 7f7c68faa640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c68faa640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c005180 0x7f7c4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64161080 con 0x7f7c4c0047c0 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c00c080 con 0x7f7c4c0039e0 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c00c240 con 0x7f7c4c005180 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c697ab640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c697ab640 1 -- 172.21.15.113:0/3110855925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c005180 msgr2=0x7f7c4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c697ab640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c005180 0x7f7c4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c697ab640 1 -- 172.21.15.113:0/3110855925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0039e0 msgr2=0x7f7c4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c697ab640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0039e0 0x7f7c4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c697ab640 1 -- 172.21.15.113:0/3110855925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c003520 con 0x7f7c4c0047c0 2023-12-19T13:55:07.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.065+0000 7f7c6a7ad640 1 -- 172.21.15.113:0/3110855925 reap_dead start 2023-12-19T13:55:07.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.066+0000 7f7c697ab640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c4c004c40 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009a90 tx=0x7f7c4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bab75309c8cde8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.066+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5802c680 con 0x7f7c4c0047c0 2023-12-19T13:55:07.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.066+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5802c7e0 con 0x7f7c4c0047c0 2023-12-19T13:55:07.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.066+0000 7f7c68faa640 1 -- 172.21.15.113:0/3110855925 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5802cb90 con 0x7f7c4c0047c0 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.067+0000 7f7c6c210640 1 -- 172.21.15.113:0/3110855925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 msgr2=0x7f7c4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.067+0000 7f7c6c210640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c4c004c40 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009a90 tx=0x7f7c4c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.067+0000 7f7c6c210640 1 -- 172.21.15.113:0/3110855925 shutdown_connections 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.067+0000 7f7c6c210640 1 --2- 172.21.15.113:0/3110855925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c4c004c40 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.067+0000 7f7c6c210640 1 -- 172.21.15.113:0/3110855925 >> 172.21.15.113:0/3110855925 conn(0x7f7c640d3520 msgr2=0x7f7c640d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.067+0000 7f7c6c210640 1 -- 172.21.15.113:0/3110855925 shutdown_connections 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.067+0000 7f7c6c210640 1 -- 172.21.15.113:0/3110855925 wait complete. 2023-12-19T13:55:07.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.069+0000 7f7c6c210640 1 Processor -- start 2023-12-19T13:55:07.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.069+0000 7f7c6c210640 1 -- start start 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c6c210640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c6415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c6c210640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c640ca570 0x7f7c640ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c6c210640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c640ce990 0x7f7c640cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c6c210640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640cf350 con 0x7f7c4c0047c0 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c6c210640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c641f6bf0 con 0x7f7c640ca570 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c6c210640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640cdc10 con 0x7f7c640ce990 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c69fac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c6415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c69fac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c6415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36806/0 (socket says 172.21.15.113:36806) 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.070+0000 7f7c69fac640 1 -- 172.21.15.113:0/4248412413 learned_addr learned my addr 172.21.15.113:0/4248412413 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:07.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c69fac640 1 -- 172.21.15.113:0/4248412413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c640ce990 msgr2=0x7f7c640cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c69fac640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c640ce990 0x7f7c640cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c69fac640 1 -- 172.21.15.113:0/4248412413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c640ca570 msgr2=0x7f7c640ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c697ab640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c640ca570 0x7f7c640ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c69fac640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c640ca570 0x7f7c640ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c69fac640 1 -- 172.21.15.113:0/4248412413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c641f6910 con 0x7f7c4c0047c0 2023-12-19T13:55:07.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c69fac640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c6415cff0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c820 tx=0x7f7c5400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54004b60 con 0x7f7c4c0047c0 2023-12-19T13:55:07.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54004cc0 con 0x7f7c4c0047c0 2023-12-19T13:55:07.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400aa90 con 0x7f7c4c0047c0 2023-12-19T13:55:07.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c640cdeb0 con 0x7f7c4c0047c0 2023-12-19T13:55:07.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.071+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c640ce470 con 0x7f7c4c0047c0 2023-12-19T13:55:07.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.072+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c640b9720 con 0x7f7c4c0047c0 2023-12-19T13:55:07.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.073+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c5400abf0 con 0x7f7c4c0047c0 2023-12-19T13:55:07.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.075+0000 7f7c627fc640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c5006a430 0x7f7c5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.075+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c54088c80 con 0x7f7c4c0047c0 2023-12-19T13:55:07.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.075+0000 7f7c697ab640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c5006a430 0x7f7c5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.075+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f7c50071f60 con 0x7f7c4c0047c0 2023-12-19T13:55:07.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.076+0000 7f7c697ab640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c5006a430 0x7f7c5006c8f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7c58036000 tx=0x7f7c58030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.079+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c540541d0 con 0x7f7c4c0047c0 2023-12-19T13:55:07.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.267+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c64061910 con 0x7f7c4c0047c0 2023-12-19T13:55:07.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.268+0000 7f7c627fc640 1 -- 172.21.15.113:0/4248412413 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v151) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c540577f0 con 0x7f7c4c0047c0 2023-12-19T13:55:07.268 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c5006a430 msgr2=0x7f7c5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c5006a430 0x7f7c5006c8f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7c58036000 tx=0x7f7c58030000 comp rx=0 tx=0).stop 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 msgr2=0x7f7c6415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c6415cff0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c820 tx=0x7f7c5400cce0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 shutdown_connections 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c5006a430 0x7f7c5006c8f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c640ce990 0x7f7c640cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c640ca570 0x7f7c640ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 --2- 172.21.15.113:0/4248412413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c4c0047c0 0x7f7c6415cff0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 >> 172.21.15.113:0/4248412413 conn(0x7f7c640d3520 msgr2=0x7f7c64144770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:07.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 shutdown_connections 2023-12-19T13:55:07.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.271+0000 7f7c6c210640 1 -- 172.21.15.113:0/4248412413 wait complete. 2023-12-19T13:55:07.289 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:07.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.498+0000 7f1da09f5640 1 Processor -- start 2023-12-19T13:55:07.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.498+0000 7f1da09f5640 1 -- start start 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.500+0000 7f1da09f5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d9c0b2270 0x7f1d9c160e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.500+0000 7f1da09f5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c161380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.500+0000 7f1da09f5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0cbab0 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.500+0000 7f1da09f5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0cb180 con 0x7f1d9c0b2270 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.500+0000 7f1da09f5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0cb460 con 0x7f1d9c0ced30 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.500+0000 7f1d93fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d9c0b2270 0x7f1d9c160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d93fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d9c0b2270 0x7f1d9c160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36816/0 (socket says 172.21.15.113:36816) 2023-12-19T13:55:07.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d93fff640 1 -- 172.21.15.113:0/202997280 learned_addr learned my addr 172.21.15.113:0/202997280 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:07.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d9bfff640 1 --2- 172.21.15.113:0/202997280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d93fff640 1 -- 172.21.15.113:0/202997280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 msgr2=0x7f1d9c161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:07.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d93fff640 1 --2- 172.21.15.113:0/202997280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d93fff640 1 -- 172.21.15.113:0/202997280 >> v1:172.21.15.151:6789/0 conn(0x7f1d9c15d2c0 legacy=0x7f1d9c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:07.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d93fff640 1 -- 172.21.15.113:0/202997280 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0cb740 con 0x7f1d9c0b2270 2023-12-19T13:55:07.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.501+0000 7f1d9bfff640 1 --2- 172.21.15.113:0/202997280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:07.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.502+0000 7f1d93fff640 1 --2- 172.21.15.113:0/202997280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c0b2270 0x7f1d9c160e40 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009870 tx=0x7f1d8402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602d614b85e96d39 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.502+0000 7f1d9affd640 1 -- 172.21.15.113:0/202997280 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84031640 con 0x7f1d9c0b2270 2023-12-19T13:55:07.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.502+0000 7f1d9affd640 1 -- 172.21.15.113:0/202997280 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d840317a0 con 0x7f1d9c0b2270 2023-12-19T13:55:07.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1d9affd640 1 -- 172.21.15.113:0/202997280 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84031b30 con 0x7f1d9c0b2270 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 -- 172.21.15.113:0/202997280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c0b2270 msgr2=0x7f1d9c160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 --2- 172.21.15.113:0/202997280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c0b2270 0x7f1d9c160e40 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009870 tx=0x7f1d8402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 -- 172.21.15.113:0/202997280 shutdown_connections 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 --2- 172.21.15.113:0/202997280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 --2- 172.21.15.113:0/202997280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c0b2270 0x7f1d9c160e40 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 -- 172.21.15.113:0/202997280 >> 172.21.15.113:0/202997280 conn(0x7f1d9c0cfd80 msgr2=0x7f1d9c0cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 -- 172.21.15.113:0/202997280 shutdown_connections 2023-12-19T13:55:07.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.503+0000 7f1da09f5640 1 -- 172.21.15.113:0/202997280 wait complete. 2023-12-19T13:55:07.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.505+0000 7f1da09f5640 1 Processor -- start 2023-12-19T13:55:07.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.505+0000 7f1da09f5640 1 -- start start 2023-12-19T13:55:07.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.506+0000 7f1da09f5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d9c0b2270 0x7f1d9c159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.506+0000 7f1da09f5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.506+0000 7f1da09f5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c15d2c0 0x7f1d9c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.506+0000 7f1da09f5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0c7e70 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.506+0000 7f1da09f5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c160530 con 0x7f1d9c0b2270 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.506+0000 7f1da09f5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0c69a0 con 0x7f1d9c0ced30 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.506+0000 7f1d9bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c15d2c0 0x7f1d9c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c15d2c0 0x7f1d9c06ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36820/0 (socket says 172.21.15.113:36820) 2023-12-19T13:55:07.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 -- 172.21.15.113:0/818381898 learned_addr learned my addr 172.21.15.113:0/818381898 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:07.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d93fff640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9b7fe640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d9c0b2270 0x7f1d9c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 -- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 msgr2=0x7f1d9c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 -- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d9c0b2270 msgr2=0x7f1d9c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d9c0b2270 0x7f1d9c159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 -- 172.21.15.113:0/818381898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840094d0 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d93fff640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.507+0000 7f1d9bfff640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c15d2c0 0x7f1d9c06ca80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400cf20 tx=0x7f1d9400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.508+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400d840 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.508+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400d9a0 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.508+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400dd50 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.508+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c15f8b0 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.508+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c15fe70 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.509+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c160670 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.510+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d9401e3b0 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.511+0000 7f1d98ff9640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d7c06a460 0x7f1d7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.511+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d94089440 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.511+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f1d7c071f90 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.511+0000 7f1d9b7fe640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d7c06a460 0x7f1d7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.512+0000 7f1d9b7fe640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d7c06a460 0x7f1d7c06c920 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00a750 tx=0x7f1d8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.515+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d9401a060 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.741+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d9c061910 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.743+0000 7f1d98ff9640 1 -- 172.21.15.113:0/818381898 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f1d9c160670 con 0x7f1d9c15d2c0 2023-12-19T13:55:07.742 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:07.742 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:55:07.742 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:55:07.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d7c06a460 msgr2=0x7f1d7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d7c06a460 0x7f1d7c06c920 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00a750 tx=0x7f1d8c008040 comp rx=0 tx=0).stop 2023-12-19T13:55:07.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c15d2c0 msgr2=0x7f1d9c06ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c15d2c0 0x7f1d9c06ca80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400cf20 tx=0x7f1d9400a7d0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 shutdown_connections 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1d7c06a460 0x7f1d7c06c920 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d9c15d2c0 0x7f1d9c06ca80 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d9c0ced30 0x7f1d9c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 --2- 172.21.15.113:0/818381898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d9c0b2270 0x7f1d9c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 >> 172.21.15.113:0/818381898 conn(0x7f1d9c0cfd80 msgr2=0x7f1d9c0cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 shutdown_connections 2023-12-19T13:55:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.745+0000 7f1da09f5640 1 -- 172.21.15.113:0/818381898 wait complete. 2023-12-19T13:55:07.763 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:07.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.961+0000 7f0c619a4640 1 Processor -- start 2023-12-19T13:55:07.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.962+0000 7f0c619a4640 1 -- start start 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.963+0000 7f0c619a4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0c5c15da30 0x7f0c5c0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.963+0000 7f0c619a4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c0b6900 0x7f0c5c0b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.963+0000 7f0c619a4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c15e1a0 con 0x7f0c5c161020 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.963+0000 7f0c619a4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c0b6d00 con 0x7f0c5c15da30 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.963+0000 7f0c619a4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c15e480 con 0x7f0c5c0b6900 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.964+0000 7f0c5a7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0c5c15da30 0x7f0c5c0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.964+0000 7f0c5a7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0c5c15da30 0x7f0c5c0b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48750/0 (socket says 172.21.15.113:48750) 2023-12-19T13:55:07.963 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.964+0000 7f0c5a7fc640 1 -- 172.21.15.113:0/3926739196 learned_addr learned my addr 172.21.15.113:0/3926739196 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:07.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.964+0000 7f0c5a7fc640 1 -- 172.21.15.113:0/3926739196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c0b6900 msgr2=0x7f0c5c0b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:07.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.964+0000 7f0c5a7fc640 1 --2- 172.21.15.113:0/3926739196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c0b6900 0x7f0c5c0b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.964+0000 7f0c5a7fc640 1 -- 172.21.15.113:0/3926739196 >> v1:172.21.15.113:6789/0 conn(0x7f0c5c161020 legacy=0x7f0c5c143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.964+0000 7f0c5a7fc640 1 -- 172.21.15.113:0/3926739196 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c15e760 con 0x7f0c5c15da30 2023-12-19T13:55:07.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.965+0000 7f0c5a7fc640 1 --2- 172.21.15.113:0/3926739196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c15da30 0x7f0c5c0b63c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009870 tx=0x7f0c4402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec43fd1b162f7db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c59ffb640 1 -- 172.21.15.113:0/3926739196 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44030840 con 0x7f0c5c15da30 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c59ffb640 1 -- 172.21.15.113:0/3926739196 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c440309a0 con 0x7f0c5c15da30 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c59ffb640 1 -- 172.21.15.113:0/3926739196 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44030d30 con 0x7f0c5c15da30 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 -- 172.21.15.113:0/3926739196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c15da30 msgr2=0x7f0c5c0b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 --2- 172.21.15.113:0/3926739196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c15da30 0x7f0c5c0b63c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009870 tx=0x7f0c4402b980 comp rx=0 tx=0).stop 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 -- 172.21.15.113:0/3926739196 shutdown_connections 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 --2- 172.21.15.113:0/3926739196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c0b6900 0x7f0c5c0b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 --2- 172.21.15.113:0/3926739196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c15da30 0x7f0c5c0b63c0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 -- 172.21.15.113:0/3926739196 >> 172.21.15.113:0/3926739196 conn(0x7f0c5c0b26f0 msgr2=0x7f0c5c0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 -- 172.21.15.113:0/3926739196 shutdown_connections 2023-12-19T13:55:07.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.966+0000 7f0c619a4640 1 -- 172.21.15.113:0/3926739196 wait complete. 2023-12-19T13:55:07.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.968+0000 7f0c619a4640 1 Processor -- start 2023-12-19T13:55:07.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.968+0000 7f0c619a4640 1 -- start start 2023-12-19T13:55:07.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c619a4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c0b6900 0x7f0c5c1f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c619a4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c5c15da30 0x7f0c5c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c619a4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c161020 0x7f0c5c15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c619a4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c15d830 con 0x7f0c5c0b6900 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c619a4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c15cc20 con 0x7f0c5c15da30 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c619a4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c15cf00 con 0x7f0c5c161020 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c5affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c0b6900 0x7f0c5c1f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c5affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c0b6900 0x7f0c5c1f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48752/0 (socket says 172.21.15.113:48752) 2023-12-19T13:55:07.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.969+0000 7f0c5affd640 1 -- 172.21.15.113:0/75947698 learned_addr learned my addr 172.21.15.113:0/75947698 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:07.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c5affd640 1 -- 172.21.15.113:0/75947698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c161020 msgr2=0x7f0c5c15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c5affd640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c161020 0x7f0c5c15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c5affd640 1 -- 172.21.15.113:0/75947698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c5c15da30 msgr2=0x7f0c5c156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:07.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c5affd640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c5c15da30 0x7f0c5c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c5affd640 1 -- 172.21.15.113:0/75947698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440094d0 con 0x7f0c5c0b6900 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c5affd640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c0b6900 0x7f0c5c1f3760 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c730 tx=0x7f0c4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c003b70 con 0x7f0c5c0b6900 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c003cd0 con 0x7f0c5c0b6900 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00aa90 con 0x7f0c5c0b6900 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.970+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c15d1e0 con 0x7f0c5c0b6900 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.971+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c15c930 con 0x7f0c5c0b6900 2023-12-19T13:55:07.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.972+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c0b63c0 con 0x7f0c5c0b6900 2023-12-19T13:55:07.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.973+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c4c00abf0 con 0x7f0c5c0b6900 2023-12-19T13:55:07.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.973+0000 7f0c53fff640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:07.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.974+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c4c088770 con 0x7f0c5c0b6900 2023-12-19T13:55:07.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.974+0000 7f0c5a7fc640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:07.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.974+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f0c3c071f60 con 0x7f0c5c0b6900 2023-12-19T13:55:07.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.975+0000 7f0c5a7fc640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0c44036000 tx=0x7f0c4403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:07.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:07.978+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c4c053d60 con 0x7f0c5c0b6900 2023-12-19T13:55:08.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.171+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c5c061910 con 0x7f0c5c0b6900 2023-12-19T13:55:08.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.174+0000 7f0c53fff640 1 -- 172.21.15.113:0/75947698 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16190 (secure 0 0 0) 0x7f0c4c057380 con 0x7f0c5c0b6900 2023-12-19T13:55:08.174 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:08.174 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":151,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:03.600123+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:08.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c3c06a430 msgr2=0x7f0c3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0c44036000 tx=0x7f0c4403b040 comp rx=0 tx=0).stop 2023-12-19T13:55:08.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c0b6900 msgr2=0x7f0c5c1f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c0b6900 0x7f0c5c1f3760 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c730 tx=0x7f0c4c00cbf0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 shutdown_connections 2023-12-19T13:55:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c5c161020 0x7f0c5c15c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c5c15da30 0x7f0c5c156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.176+0000 7f0c619a4640 1 --2- 172.21.15.113:0/75947698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c5c0b6900 0x7f0c5c1f3760 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.177+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 >> 172.21.15.113:0/75947698 conn(0x7f0c5c0b26f0 msgr2=0x7f0c5c0b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.177+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 shutdown_connections 2023-12-19T13:55:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.177+0000 7f0c619a4640 1 -- 172.21.15.113:0/75947698 wait complete. 2023-12-19T13:55:08.195 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:55:08.195 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:08.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.401+0000 7f914c48b640 1 Processor -- start 2023-12-19T13:55:08.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.401+0000 7f914c48b640 1 -- start start 2023-12-19T13:55:08.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914c48b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9144146da0 0x7f91440aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914c48b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9144147180 0x7f91440aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914c48b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91441611f0 0x7f9144161640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914c48b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9144161b80 con 0x7f9144146da0 2023-12-19T13:55:08.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914c48b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440d1070 con 0x7f9144147180 2023-12-19T13:55:08.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914c48b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144162020 con 0x7f91441611f0 2023-12-19T13:55:08.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914a227640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9144146da0 0x7f91440aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914a227640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9144146da0 0x7f91440aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48756/0 (socket says 172.21.15.113:48756) 2023-12-19T13:55:08.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.403+0000 7f914a227640 1 -- 172.21.15.113:0/3415336327 learned_addr learned my addr 172.21.15.113:0/3415336327 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f914aa28640 1 --2- 172.21.15.113:0/3415336327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91441611f0 0x7f9144161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f9149a26640 1 --2- 172.21.15.113:0/3415336327 >> v2:172.21.15.151:3300/0 conn(0x7f9144147180 0x7f91440aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f914a227640 1 -- 172.21.15.113:0/3415336327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91441611f0 msgr2=0x7f9144161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f914a227640 1 --2- 172.21.15.113:0/3415336327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91441611f0 0x7f9144161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f914a227640 1 -- 172.21.15.113:0/3415336327 >> v2:172.21.15.151:3300/0 conn(0x7f9144147180 msgr2=0x7f91440aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f914a227640 1 --2- 172.21.15.113:0/3415336327 >> v2:172.21.15.151:3300/0 conn(0x7f9144147180 0x7f91440aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f914a227640 1 -- 172.21.15.113:0/3415336327 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440aabd0 con 0x7f9144146da0 2023-12-19T13:55:08.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.404+0000 7f9149a26640 1 --2- 172.21.15.113:0/3415336327 >> v2:172.21.15.151:3300/0 conn(0x7f9144147180 0x7f91440aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:08.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.405+0000 7f914a227640 1 --2- 172.21.15.113:0/3415336327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9144146da0 0x7f91440aa060 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f9144161150 tx=0x7f914002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a9b4fc08ac8dc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:08.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.405+0000 7f9149225640 1 -- 172.21.15.113:0/3415336327 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140031870 con 0x7f9144146da0 2023-12-19T13:55:08.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.405+0000 7f9149225640 1 -- 172.21.15.113:0/3415336327 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91400319d0 con 0x7f9144146da0 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f9149225640 1 -- 172.21.15.113:0/3415336327 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140031d60 con 0x7f9144146da0 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 -- 172.21.15.113:0/3415336327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9144146da0 msgr2=0x7f91440aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 --2- 172.21.15.113:0/3415336327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9144146da0 0x7f91440aa060 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f9144161150 tx=0x7f914002b910 comp rx=0 tx=0).stop 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 -- 172.21.15.113:0/3415336327 shutdown_connections 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 --2- 172.21.15.113:0/3415336327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91441611f0 0x7f9144161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 --2- 172.21.15.113:0/3415336327 >> v2:172.21.15.151:3300/0 conn(0x7f9144147180 0x7f91440aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 --2- 172.21.15.113:0/3415336327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9144146da0 0x7f91440aa060 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 -- 172.21.15.113:0/3415336327 >> 172.21.15.113:0/3415336327 conn(0x7f9144071a50 msgr2=0x7f91440d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 -- 172.21.15.113:0/3415336327 shutdown_connections 2023-12-19T13:55:08.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.406+0000 7f914c48b640 1 -- 172.21.15.113:0/3415336327 wait complete. 2023-12-19T13:55:08.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.408+0000 7f914c48b640 1 Processor -- start 2023-12-19T13:55:08.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.408+0000 7f914c48b640 1 -- start start 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914c48b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9144146da0 0x7f9144157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914c48b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91441611f0 0x7f9144157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914c48b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91441f2e70 0x7f91441f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914c48b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91441413d0 con 0x7f91441f2e70 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914c48b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144142f80 con 0x7f91441611f0 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914c48b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144158180 con 0x7f9144146da0 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914aa28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91441f2e70 0x7f91441f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914aa28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91441f2e70 0x7f91441f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48768/0 (socket says 172.21.15.113:48768) 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.409+0000 7f914aa28640 1 -- 172.21.15.113:0/549811048 learned_addr learned my addr 172.21.15.113:0/549811048 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f9149a26640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91441611f0 0x7f9144157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914a227640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9144146da0 0x7f9144157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914aa28640 1 -- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9144146da0 msgr2=0x7f9144157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914aa28640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9144146da0 0x7f9144157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914aa28640 1 -- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91441611f0 msgr2=0x7f9144157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914aa28640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91441611f0 0x7f9144157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914aa28640 1 -- 172.21.15.113:0/549811048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400094d0 con 0x7f91441f2e70 2023-12-19T13:55:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914aa28640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91441f2e70 0x7f91441f3320 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f913c00cd70 tx=0x7f913c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c003b90 con 0x7f91441f2e70 2023-12-19T13:55:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c003cf0 con 0x7f91441f2e70 2023-12-19T13:55:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c004240 con 0x7f91441f2e70 2023-12-19T13:55:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91441583f0 con 0x7f91441f2e70 2023-12-19T13:55:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.410+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91441589b0 con 0x7f91441f2e70 2023-12-19T13:55:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.412+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144073ec0 con 0x7f91441f2e70 2023-12-19T13:55:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.413+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f913c0043a0 con 0x7f91441f2e70 2023-12-19T13:55:08.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.414+0000 7f913affd640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f912806a430 0x7f912806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.414+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f913c012070 con 0x7f91441f2e70 2023-12-19T13:55:08.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.414+0000 7f914a227640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f912806a430 0x7f912806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.414+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f9128071f60 con 0x7f91441f2e70 2023-12-19T13:55:08.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.415+0000 7f914a227640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f912806a430 0x7f912806c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9140036000 tx=0x7f914003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:08.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.418+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f913c0548d0 con 0x7f91441f2e70 2023-12-19T13:55:08.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.629+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91441430f0 con 0x7f91441f2e70 2023-12-19T13:55:08.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.630+0000 7f913affd640 1 -- 172.21.15.113:0/549811048 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f913c057ef0 con 0x7f91441f2e70 2023-12-19T13:55:08.630 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:08.630 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:55:08.631 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:55:08.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f912806a430 msgr2=0x7f912806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f912806a430 0x7f912806c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9140036000 tx=0x7f914003c040 comp rx=0 tx=0).stop 2023-12-19T13:55:08.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91441f2e70 msgr2=0x7f91441f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91441f2e70 0x7f91441f3320 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f913c00cd70 tx=0x7f913c00a660 comp rx=0 tx=0).stop 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 shutdown_connections 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f912806a430 0x7f912806c8f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91441f2e70 0x7f91441f3320 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91441611f0 0x7f9144157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 --2- 172.21.15.113:0/549811048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9144146da0 0x7f9144157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 >> 172.21.15.113:0/549811048 conn(0x7f9144071a50 msgr2=0x7f9144070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 shutdown_connections 2023-12-19T13:55:08.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.633+0000 7f914c48b640 1 -- 172.21.15.113:0/549811048 wait complete. 2023-12-19T13:55:08.650 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:08.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.854+0000 7fc8c437e640 1 Processor -- start 2023-12-19T13:55:08.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.854+0000 7fc8c437e640 1 -- start start 2023-12-19T13:55:08.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.855+0000 7fc8c437e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc8bc1599c0 0x7fc8bc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.855+0000 7fc8c437e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc8bc06e190 0x7fc8bc0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.855+0000 7fc8c437e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc15e400 con 0x7fc8bc0af540 2023-12-19T13:55:08.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.855+0000 7fc8c437e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc15daa0 con 0x7fc8bc1599c0 2023-12-19T13:55:08.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.855+0000 7fc8c437e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ce780 con 0x7fc8bc06e190 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.856+0000 7fc8c211a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc8bc1599c0 0x7fc8bc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.856+0000 7fc8c211a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc8bc1599c0 0x7fc8bc15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48784/0 (socket says 172.21.15.113:48784) 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.856+0000 7fc8c211a640 1 -- 172.21.15.113:0/6287634 learned_addr learned my addr 172.21.15.113:0/6287634 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.856+0000 7fc8c1919640 1 --2- 172.21.15.113:0/6287634 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc06e190 0x7fc8bc0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.856+0000 7fc8c211a640 1 -- 172.21.15.113:0/6287634 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc06e190 msgr2=0x7fc8bc0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.856+0000 7fc8c211a640 1 --2- 172.21.15.113:0/6287634 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc06e190 0x7fc8bc0cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.857+0000 7fc8c211a640 1 -- 172.21.15.113:0/6287634 >> v1:172.21.15.151:6789/0 conn(0x7fc8bc0af540 legacy=0x7fc8bc0ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:08.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.857+0000 7fc8c211a640 1 -- 172.21.15.113:0/6287634 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0cea60 con 0x7fc8bc1599c0 2023-12-19T13:55:08.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.858+0000 7fc8c211a640 1 --2- 172.21.15.113:0/6287634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc1599c0 0x7fc8bc15dec0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0b0e70 tx=0x7fc8ac02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe28d35bdbf9036f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:08.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.858+0000 7fc8c1118640 1 -- 172.21.15.113:0/6287634 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02c960 con 0x7fc8bc1599c0 2023-12-19T13:55:08.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.858+0000 7fc8c1118640 1 -- 172.21.15.113:0/6287634 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac02cac0 con 0x7fc8bc1599c0 2023-12-19T13:55:08.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.858+0000 7fc8c1118640 1 -- 172.21.15.113:0/6287634 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02ce50 con 0x7fc8bc1599c0 2023-12-19T13:55:08.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 -- 172.21.15.113:0/6287634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc1599c0 msgr2=0x7fc8bc15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 --2- 172.21.15.113:0/6287634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc1599c0 0x7fc8bc15dec0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0b0e70 tx=0x7fc8ac02bdc0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 -- 172.21.15.113:0/6287634 shutdown_connections 2023-12-19T13:55:08.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 --2- 172.21.15.113:0/6287634 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc06e190 0x7fc8bc0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 --2- 172.21.15.113:0/6287634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc1599c0 0x7fc8bc15dec0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 -- 172.21.15.113:0/6287634 >> 172.21.15.113:0/6287634 conn(0x7fc8bc0cbb70 msgr2=0x7fc8bc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:08.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 -- 172.21.15.113:0/6287634 shutdown_connections 2023-12-19T13:55:08.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.859+0000 7fc8c437e640 1 -- 172.21.15.113:0/6287634 wait complete. 2023-12-19T13:55:08.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.861+0000 7fc8c437e640 1 Processor -- start 2023-12-19T13:55:08.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.861+0000 7fc8c437e640 1 -- start start 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c437e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc06e190 0x7fc8bc1e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c437e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc0af540 0x7fc8bc15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c437e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc1599c0 0x7fc8bc14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c437e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e3c90 con 0x7fc8bc0af540 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c437e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e3f70 con 0x7fc8bc1599c0 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c437e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e4250 con 0x7fc8bc06e190 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc0af540 0x7fc8bc15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc0af540 0x7fc8bc15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48794/0 (socket says 172.21.15.113:48794) 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 -- 172.21.15.113:0/428284276 learned_addr learned my addr 172.21.15.113:0/428284276 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 -- 172.21.15.113:0/428284276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc06e190 msgr2=0x7fc8bc1e3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc06e190 0x7fc8bc1e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 -- 172.21.15.113:0/428284276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc1599c0 msgr2=0x7fc8bc14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:08.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c291b640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc1599c0 0x7fc8bc14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc1599c0 0x7fc8bc14b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:08.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.862+0000 7fc8c1919640 1 -- 172.21.15.113:0/428284276 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009b30 con 0x7fc8bc0af540 2023-12-19T13:55:08.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.863+0000 7fc8c1919640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc0af540 0x7fc8bc15c1a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c7f0 tx=0x7fc8b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:08.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.863+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0004230 con 0x7fc8bc0af540 2023-12-19T13:55:08.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.863+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b0004390 con 0x7fc8bc0af540 2023-12-19T13:55:08.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.863+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0007860 con 0x7fc8bc0af540 2023-12-19T13:55:08.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.863+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc1e4530 con 0x7fc8bc0af540 2023-12-19T13:55:08.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.863+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1e3880 con 0x7fc8bc0af540 2023-12-19T13:55:08.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.864+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc061910 con 0x7fc8bc0af540 2023-12-19T13:55:08.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.865+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8b0007bd0 con 0x7fc8bc0af540 2023-12-19T13:55:08.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.867+0000 7fc8baffd640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a806a430 0x7fc8a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:08.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.867+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8b00889a0 con 0x7fc8bc0af540 2023-12-19T13:55:08.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.867+0000 7fc8c211a640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a806a430 0x7fc8a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:08.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.867+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fc8a8071f60 con 0x7fc8bc0af540 2023-12-19T13:55:08.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.868+0000 7fc8c211a640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a806a430 0x7fc8a806c8f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac035000 tx=0x7fc8ac02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:08.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:08.871+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc8b001e020 con 0x7fc8bc0af540 2023-12-19T13:55:09.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.100+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8bc15d690 con 0x7fc8bc0af540 2023-12-19T13:55:09.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.101+0000 7fc8baffd640 1 -- 172.21.15.113:0/428284276 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fc8b0053f80 con 0x7fc8bc0af540 2023-12-19T13:55:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:09.101 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:54:26.084550+0000","modified":"2023-12-19T13:54:29.585964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/4021670999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4021670999},{"type":"v1","addr":"172.21.15.113:6837","nonce":4021670999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T13:55:09.101 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 65 2023-12-19T13:55:09.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a806a430 msgr2=0x7fc8a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a806a430 0x7fc8a806c8f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac035000 tx=0x7fc8ac02e000 comp rx=0 tx=0).stop 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc0af540 msgr2=0x7fc8bc15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc0af540 0x7fc8bc15c1a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c7f0 tx=0x7fc8b000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 shutdown_connections 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc8a806a430 0x7fc8a806c8f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc1599c0 0x7fc8bc14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc8bc0af540 0x7fc8bc15c1a0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 --2- 172.21.15.113:0/428284276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc06e190 0x7fc8bc1e3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 >> 172.21.15.113:0/428284276 conn(0x7fc8bc0cbb70 msgr2=0x7fc8bc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 shutdown_connections 2023-12-19T13:55:09.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.104+0000 7fc8c437e640 1 -- 172.21.15.113:0/428284276 wait complete. 2023-12-19T13:55:09.122 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.338+0000 7f5858441640 1 Processor -- start 2023-12-19T13:55:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.338+0000 7f5858441640 1 -- start start 2023-12-19T13:55:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.339+0000 7f5858441640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58501449e0 0x7f58500af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.339+0000 7f5858441640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f585006c6b0 0x7f58500b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f5858441640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58500afb10 con 0x7f58500b0b50 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f5858441640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585006bb30 con 0x7f58501449e0 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f5858441640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500b0070 con 0x7f585006c6b0 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58561dd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58501449e0 0x7f58500af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58561dd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58501449e0 0x7f58500af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48800/0 (socket says 172.21.15.113:48800) 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58561dd640 1 -- 172.21.15.113:0/1942619260 learned_addr learned my addr 172.21.15.113:0/1942619260 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58569de640 1 --2- 172.21.15.113:0/1942619260 >> v2:172.21.15.151:3300/0 conn(0x7f585006c6b0 0x7f58500b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58561dd640 1 -- 172.21.15.113:0/1942619260 >> v2:172.21.15.151:3300/0 conn(0x7f585006c6b0 msgr2=0x7f58500b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58561dd640 1 --2- 172.21.15.113:0/1942619260 >> v2:172.21.15.151:3300/0 conn(0x7f585006c6b0 0x7f58500b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58561dd640 1 -- 172.21.15.113:0/1942619260 >> v1:172.21.15.151:6789/0 conn(0x7f58500b0b50 legacy=0x7f585006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58561dd640 1 -- 172.21.15.113:0/1942619260 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500b0350 con 0x7f58501449e0 2023-12-19T13:55:09.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.340+0000 7f58569de640 1 --2- 172.21.15.113:0/1942619260 >> v2:172.21.15.151:3300/0 conn(0x7f585006c6b0 0x7f58500b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:09.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.342+0000 7f58561dd640 1 --2- 172.21.15.113:0/1942619260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58500af5d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f58500b1270 tx=0x7f584002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6442c3a525a24af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:09.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.342+0000 7f58551db640 1 -- 172.21.15.113:0/1942619260 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584002ca80 con 0x7f58501449e0 2023-12-19T13:55:09.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.342+0000 7f58551db640 1 -- 172.21.15.113:0/1942619260 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584002cbe0 con 0x7f58501449e0 2023-12-19T13:55:09.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.342+0000 7f58551db640 1 -- 172.21.15.113:0/1942619260 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400343f0 con 0x7f58501449e0 2023-12-19T13:55:09.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 -- 172.21.15.113:0/1942619260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 msgr2=0x7f58500af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 --2- 172.21.15.113:0/1942619260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58500af5d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f58500b1270 tx=0x7f584002bee0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 -- 172.21.15.113:0/1942619260 shutdown_connections 2023-12-19T13:55:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 --2- 172.21.15.113:0/1942619260 >> v2:172.21.15.151:3300/0 conn(0x7f585006c6b0 0x7f58500b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 --2- 172.21.15.113:0/1942619260 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58500af5d0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 -- 172.21.15.113:0/1942619260 >> 172.21.15.113:0/1942619260 conn(0x7f58500cbb70 msgr2=0x7f58500cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 -- 172.21.15.113:0/1942619260 shutdown_connections 2023-12-19T13:55:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.343+0000 7f5858441640 1 -- 172.21.15.113:0/1942619260 wait complete. 2023-12-19T13:55:09.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.345+0000 7f5858441640 1 Processor -- start 2023-12-19T13:55:09.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.345+0000 7f5858441640 1 -- start start 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f5858441640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f585006c6b0 0x7f585012f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f5858441640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58500b0b50 0x7f585015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f5858441640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58501f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f5858441640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585015dc00 con 0x7f58501449e0 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f5858441640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501f6fa0 con 0x7f58500b0b50 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f5858441640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58501516d0 con 0x7f585006c6b0 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f58569de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58501f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f58569de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58501f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48814/0 (socket says 172.21.15.113:48814) 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.346+0000 7f58569de640 1 -- 172.21.15.113:0/3226301968 learned_addr learned my addr 172.21.15.113:0/3226301968 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58559dc640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58500b0b50 0x7f585015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58561dd640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f585006c6b0 0x7f585012f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58569de640 1 -- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f585006c6b0 msgr2=0x7f585012f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58569de640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f585006c6b0 0x7f585012f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58569de640 1 -- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58500b0b50 msgr2=0x7f585015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58569de640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58500b0b50 0x7f585015d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58569de640 1 -- 172.21.15.113:0/3226301968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840009b30 con 0x7f58501449e0 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58559dc640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58500b0b50 0x7f585015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f58569de640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58501f6a60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f584800c7f0 tx=0x7f584800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480077c0 con 0x7f58501449e0 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848007920 con 0x7f58501449e0 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585012fb30 con 0x7f58501449e0 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848007d10 con 0x7f58501449e0 2023-12-19T13:55:09.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.347+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58501300f0 con 0x7f58501449e0 2023-12-19T13:55:09.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.348+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5850151890 con 0x7f58501449e0 2023-12-19T13:55:09.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.349+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58480113f0 con 0x7f58501449e0 2023-12-19T13:55:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.350+0000 7f584effd640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f583c06a430 0x7f583c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.350+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5848088cd0 con 0x7f58501449e0 2023-12-19T13:55:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.351+0000 7f58561dd640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f583c06a430 0x7f583c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.351+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f583c071f60 con 0x7f58501449e0 2023-12-19T13:55:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.351+0000 7f58561dd640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f583c06a430 0x7f583c06c8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5840035000 tx=0x7f5840030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:09.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.354+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f584801f060 con 0x7f58501449e0 2023-12-19T13:55:09.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.545+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5850061910 con 0x7f58501449e0 2023-12-19T13:55:09.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.547+0000 7f584effd640 1 -- 172.21.15.113:0/3226301968 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16190 (secure 0 0 0) 0x7f5848054220 con 0x7f58501449e0 2023-12-19T13:55:09.547 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:09.547 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":151,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:03.600123+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:54:23.704080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T13:54:25.109205+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:09.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.549+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f583c06a430 msgr2=0x7f583c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.549+0000 7f5858441640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f583c06a430 0x7f583c06c8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5840035000 tx=0x7f5840030000 comp rx=0 tx=0).stop 2023-12-19T13:55:09.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 msgr2=0x7f58501f6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58501f6a60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f584800c7f0 tx=0x7f584800ccb0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 shutdown_connections 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f583c06a430 0x7f583c06c8f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58501449e0 0x7f58501f6a60 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58500b0b50 0x7f585015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 --2- 172.21.15.113:0/3226301968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f585006c6b0 0x7f585012f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 >> 172.21.15.113:0/3226301968 conn(0x7f58500cbb70 msgr2=0x7f58500b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 shutdown_connections 2023-12-19T13:55:09.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.550+0000 7f5858441640 1 -- 172.21.15.113:0/3226301968 wait complete. 2023-12-19T13:55:09.569 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:55:09.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.771+0000 7fc989e10640 1 Processor -- start 2023-12-19T13:55:09.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.771+0000 7fc989e10640 1 -- start start 2023-12-19T13:55:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc989e10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc984146e10 0x7fc9840d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc989e10640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9840d2b00 0x7fc9840b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc989e10640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9840cd840 con 0x7fc9840ce110 2023-12-19T13:55:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc989e10640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9840d2430 con 0x7fc9840d2b00 2023-12-19T13:55:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc989e10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840d2620 con 0x7fc984146e10 2023-12-19T13:55:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc982ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9840d2b00 0x7fc9840b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc982ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9840d2b00 0x7fc9840b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48830/0 (socket says 172.21.15.113:48830) 2023-12-19T13:55:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc982ffd640 1 -- 172.21.15.113:0/1645748667 learned_addr learned my addr 172.21.15.113:0/1645748667 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc9837fe640 1 --2- 172.21.15.113:0/1645748667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc984146e10 0x7fc9840d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.773+0000 7fc982ffd640 1 -- 172.21.15.113:0/1645748667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc984146e10 msgr2=0x7fc9840d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.774+0000 7fc982ffd640 1 --2- 172.21.15.113:0/1645748667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc984146e10 0x7fc9840d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.774+0000 7fc982ffd640 1 -- 172.21.15.113:0/1645748667 >> v1:172.21.15.151:6789/0 conn(0x7fc9840ce110 legacy=0x7fc9840b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:09.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.774+0000 7fc982ffd640 1 -- 172.21.15.113:0/1645748667 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9840b41c0 con 0x7fc9840d2b00 2023-12-19T13:55:09.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.775+0000 7fc982ffd640 1 --2- 172.21.15.113:0/1645748667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9840d2b00 0x7fc9840b6780 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009870 tx=0x7fc96c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a947f6aec549f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:09.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.775+0000 7fc9827fc640 1 -- 172.21.15.113:0/1645748667 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c031640 con 0x7fc9840d2b00 2023-12-19T13:55:09.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.775+0000 7fc9827fc640 1 -- 172.21.15.113:0/1645748667 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c0317a0 con 0x7fc9840d2b00 2023-12-19T13:55:09.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.775+0000 7fc9827fc640 1 -- 172.21.15.113:0/1645748667 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c031b30 con 0x7fc9840d2b00 2023-12-19T13:55:09.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 -- 172.21.15.113:0/1645748667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9840d2b00 msgr2=0x7fc9840b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 --2- 172.21.15.113:0/1645748667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9840d2b00 0x7fc9840b6780 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009870 tx=0x7fc96c02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 -- 172.21.15.113:0/1645748667 shutdown_connections 2023-12-19T13:55:09.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 --2- 172.21.15.113:0/1645748667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9840d2b00 0x7fc9840b6780 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 --2- 172.21.15.113:0/1645748667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc984146e10 0x7fc9840d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 -- 172.21.15.113:0/1645748667 >> 172.21.15.113:0/1645748667 conn(0x7fc9840b29c0 msgr2=0x7fc9840b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:09.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 -- 172.21.15.113:0/1645748667 shutdown_connections 2023-12-19T13:55:09.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.776+0000 7fc989e10640 1 -- 172.21.15.113:0/1645748667 wait complete. 2023-12-19T13:55:09.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.778+0000 7fc989e10640 1 Processor -- start 2023-12-19T13:55:09.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.778+0000 7fc989e10640 1 -- start start 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc989e10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9840ce110 0x7fc9840b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc989e10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9840d2b00 0x7fc984153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc989e10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc984146e10 0x7fc984154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc989e10640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984140700 con 0x7fc984146e10 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc989e10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840b97a0 con 0x7fc9840d2b00 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc989e10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9841428e0 con 0x7fc9840ce110 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc983fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc984146e10 0x7fc984154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc983fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc984146e10 0x7fc984154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48840/0 (socket says 172.21.15.113:48840) 2023-12-19T13:55:09.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc983fff640 1 -- 172.21.15.113:0/578469400 learned_addr learned my addr 172.21.15.113:0/578469400 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc9837fe640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9840ce110 0x7fc9840b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc982ffd640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9840d2b00 0x7fc984153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc983fff640 1 -- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9840ce110 msgr2=0x7fc9840b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc983fff640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9840ce110 0x7fc9840b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc983fff640 1 -- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9840d2b00 msgr2=0x7fc984153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.779+0000 7fc983fff640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9840d2b00 0x7fc984153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.780+0000 7fc983fff640 1 -- 172.21.15.113:0/578469400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0094d0 con 0x7fc984146e10 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.780+0000 7fc983fff640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc984146e10 0x7fc984154f90 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c410 tx=0x7fc97c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.780+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c011790 con 0x7fc984146e10 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.780+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c0118f0 con 0x7fc984146e10 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.780+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc984142bc0 con 0x7fc984146e10 2023-12-19T13:55:09.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.780+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c011ca0 con 0x7fc984146e10 2023-12-19T13:55:09.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.780+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984143180 con 0x7fc984146e10 2023-12-19T13:55:09.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.782+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc984061910 con 0x7fc984146e10 2023-12-19T13:55:09.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.782+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc97c01c460 con 0x7fc984146e10 2023-12-19T13:55:09.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.783+0000 7fc97bfff640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc96406a460 0x7fc96406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:09.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.783+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc97c088510 con 0x7fc984146e10 2023-12-19T13:55:09.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.783+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fc964071f90 con 0x7fc984146e10 2023-12-19T13:55:09.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.783+0000 7fc9837fe640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc96406a460 0x7fc96406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:09.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.784+0000 7fc9837fe640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc96406a460 0x7fc96406c920 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc974008e50 tx=0x7fc9740083a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:09.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:09.788+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc97c086e60 con 0x7fc984146e10 2023-12-19T13:55:10.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.016+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc98415c420 con 0x7fc984146e10 2023-12-19T13:55:10.016 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:55:10.017+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:55:10.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.020+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(152..152 src has 1..152) v4 ==== 374+0+0 (secure 0 0 0) 0x7fc97c057f50 con 0x7fc984146e10 2023-12-19T13:55:10.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.020+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7fc964072840 con 0x7fc984146e10 2023-12-19T13:55:10.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.032+0000 7fc97bfff640 1 -- 172.21.15.113:0/578469400 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc97c053b90 con 0x7fc984146e10 2023-12-19T13:55:10.032 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc96406a460 msgr2=0x7fc96406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc96406a460 0x7fc96406c920 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc974008e50 tx=0x7fc9740083a0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc984146e10 msgr2=0x7fc984154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc984146e10 0x7fc984154f90 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c410 tx=0x7fc97c00c8d0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 shutdown_connections 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc96406a460 0x7fc96406c920 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc984146e10 0x7fc984154f90 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9840d2b00 0x7fc984153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 --2- 172.21.15.113:0/578469400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9840ce110 0x7fc9840b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 >> 172.21.15.113:0/578469400 conn(0x7fc9840b29c0 msgr2=0x7fc9840d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 shutdown_connections 2023-12-19T13:55:10.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.035+0000 7fc989e10640 1 -- 172.21.15.113:0/578469400 wait complete. 2023-12-19T13:55:10.047 INFO:tasks.ceph.mds.a.smithi113.stderr: -9069> 2023-12-19T13:54:30.751+0000 7fc746fa1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:55:10.052 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:55:10.110 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:55:10.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.237+0000 7f212ac8f640 1 Processor -- start 2023-12-19T13:55:10.237 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.237+0000 7f212ac8f640 1 -- start start 2023-12-19T13:55:10.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.239+0000 7f212ac8f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2124146d60 0x7f21240b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.239+0000 7f212ac8f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21240d2d20 con 0x7f212406f160 2023-12-19T13:55:10.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.239+0000 7f212ac8f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21240d3000 con 0x7f21240d1e30 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.239+0000 7f212ac8f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240b8c70 con 0x7f2124146d60 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.239+0000 7f2123fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f212406f160 0x7f21240d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46230/0 (socket says 172.21.15.113:46230) 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.239+0000 7f2123fff640 1 -- 172.21.15.113:0/2759758403 learned_addr learned my addr 172.21.15.113:0/2759758403 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.239+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2759758403 >> v2:172.21.15.151:3300/0 conn(0x7f2124146d60 0x7f21240b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288487352 0 0) 0x7f21240d2d20 con 0x7f212406f160 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2104003520 con 0x7f212406f160 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 297308887 0 0) 0x7f2104003520 con 0x7f212406f160 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 >> v2:172.21.15.151:3300/0 conn(0x7f2124146d60 msgr2=0x7f21240b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 --2- 172.21.15.113:0/2759758403 >> v2:172.21.15.151:3300/0 conn(0x7f2124146d60 0x7f21240b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 >> v1:172.21.15.151:6789/0 conn(0x7f21240d1e30 legacy=0x7f212415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240b8f50 con 0x7f212406f160 2023-12-19T13:55:10.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f210c0019f0 con 0x7f212406f160 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 >> v1:172.21.15.113:6789/0 conn(0x7f212406f160 legacy=0x7f21240d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2104003a30 0x7f2104003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21040047c0 0x7f2104004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21040051d0 0x7f210400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240b8c70 con 0x7f2104003a30 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210400c100 con 0x7f21040047c0 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210400c2c0 con 0x7f21040051d0 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.240+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2104003a30 0x7f2104003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f2123fff640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21040047c0 0x7f2104004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f2128a2b640 1 -- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21040051d0 msgr2=0x7f210400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21040051d0 0x7f210400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f2128a2b640 1 -- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21040047c0 msgr2=0x7f2104004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21040047c0 0x7f2104004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f2128a2b640 1 -- 172.21.15.113:0/2759758403 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104003520 con 0x7f2104003a30 2023-12-19T13:55:10.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f212922c640 1 -- 172.21.15.113:0/2759758403 reap_dead start 2023-12-19T13:55:10.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.241+0000 7f2123fff640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21040047c0 0x7f2104004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2104003a30 0x7f2104003e50 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f2114009ac0 tx=0x7f21040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b4fa61a472f8c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211402c710 con 0x7f2104003a30 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211402c870 con 0x7f2104003a30 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f21237fe640 1 -- 172.21.15.113:0/2759758403 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211402cc00 con 0x7f2104003a30 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f212ac8f640 1 -- 172.21.15.113:0/2759758403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2104003a30 msgr2=0x7f2104003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2104003a30 0x7f2104003e50 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f2114009ac0 tx=0x7f21040057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f212ac8f640 1 -- 172.21.15.113:0/2759758403 shutdown_connections 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2759758403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2104003a30 0x7f2104003e50 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.242+0000 7f212ac8f640 1 -- 172.21.15.113:0/2759758403 >> 172.21.15.113:0/2759758403 conn(0x7f21240cfe10 msgr2=0x7f21240d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.243+0000 7f212ac8f640 1 -- 172.21.15.113:0/2759758403 shutdown_connections 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.243+0000 7f212ac8f640 1 -- 172.21.15.113:0/2759758403 wait complete. 2023-12-19T13:55:10.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.244+0000 7f212ac8f640 1 Processor -- start 2023-12-19T13:55:10.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.244+0000 7f212ac8f640 1 -- start start 2023-12-19T13:55:10.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.245+0000 7f212ac8f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2104003a30 0x7f212415d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.245+0000 7f212ac8f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2124160ed0 0x7f2124159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.245+0000 7f212ac8f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f212415fe90 0x7f212415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.245+0000 7f212ac8f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212415ec10 con 0x7f212415fe90 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.245+0000 7f212ac8f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212415d640 con 0x7f2124160ed0 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.245+0000 7f212ac8f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212415edf0 con 0x7f2104003a30 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.245+0000 7f212922c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f212415fe90 0x7f212415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f212415fe90 0x7f212415a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48858/0 (socket says 172.21.15.113:48858) 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 -- 172.21.15.113:0/2350907385 learned_addr learned my addr 172.21.15.113:0/2350907385 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2104003a30 0x7f212415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f2123fff640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2124160ed0 0x7f2124159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 -- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2104003a30 msgr2=0x7f212415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2104003a30 0x7f212415d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 -- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2124160ed0 msgr2=0x7f2124159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:10.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2124160ed0 0x7f2124159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 -- 172.21.15.113:0/2350907385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212415f0d0 con 0x7f212415fe90 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212922c640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f212415fe90 0x7f212415a620 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f21240b3460 tx=0x7f211c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c004220 con 0x7f212415fe90 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0043a0 con 0x7f212415fe90 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.246+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212415f3b0 con 0x7f212415fe90 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.247+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c007310 con 0x7f212415fe90 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.247+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212415f970 con 0x7f212415fe90 2023-12-19T13:55:10.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.248+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2124061910 con 0x7f212415fe90 2023-12-19T13:55:10.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.249+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f211c0057c0 con 0x7f212415fe90 2023-12-19T13:55:10.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.250+0000 7f21217fa640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f210806a460 0x7f210806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:10.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.250+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f211c087c90 con 0x7f212415fe90 2023-12-19T13:55:10.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.250+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f210806a460 0x7f210806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:10.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.251+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f21080720a0 con 0x7f212415fe90 2023-12-19T13:55:10.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.251+0000 7f2128a2b640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f210806a460 0x7f210806c920 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2114036000 tx=0x7f2114030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:10.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.255+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f211c053180 con 0x7f212415fe90 2023-12-19T13:55:10.464 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:10.465+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f212406fc20 con 0x7f212415fe90 2023-12-19T13:55:11.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.039+0000 7f21217fa640 1 -- 172.21.15.113:0/2350907385 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7f211c0567a0 con 0x7f212415fe90 2023-12-19T13:55:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f210806a460 msgr2=0x7f210806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f210806a460 0x7f210806c920 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2114036000 tx=0x7f2114030000 comp rx=0 tx=0).stop 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f212415fe90 msgr2=0x7f212415a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f212415fe90 0x7f212415a620 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f21240b3460 tx=0x7f211c00c820 comp rx=0 tx=0).stop 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 shutdown_connections 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f210806a460 0x7f210806c920 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f212415fe90 0x7f212415a620 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2124160ed0 0x7f2124159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 --2- 172.21.15.113:0/2350907385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2104003a30 0x7f212415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 >> 172.21.15.113:0/2350907385 conn(0x7f21240cfe10 msgr2=0x7f21240b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 shutdown_connections 2023-12-19T13:55:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.042+0000 7f212ac8f640 1 -- 172.21.15.113:0/2350907385 wait complete. 2023-12-19T13:55:11.063 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:55:11.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.273+0000 7f672c8af640 1 Processor -- start 2023-12-19T13:55:11.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.273+0000 7f672c8af640 1 -- start start 2023-12-19T13:55:11.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.275+0000 7f672c8af640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67280cbca0 0x7f67280b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:11.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.275+0000 7f672c8af640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67280b1dc0 0x7f672806c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:11.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.275+0000 7f672c8af640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6728070bc0 con 0x7f672815a000 2023-12-19T13:55:11.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.275+0000 7f672c8af640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6728071c60 con 0x7f67280b1dc0 2023-12-19T13:55:11.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.275+0000 7f672c8af640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67280b2250 con 0x7f67280cbca0 2023-12-19T13:55:11.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.276+0000 7f6726d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67280b1dc0 0x7f672806c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:11.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.276+0000 7f671ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67280cbca0 0x7f67280b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:11.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.276+0000 7f6726d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67280b1dc0 0x7f672806c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:45372/0 (socket says 172.21.15.113:45372) 2023-12-19T13:55:11.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.276+0000 7f6726d9d640 1 -- 172.21.15.113:0/452182469 learned_addr learned my addr 172.21.15.113:0/452182469 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.277+0000 7f6726d9d640 1 -- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67280cbca0 msgr2=0x7f67280b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.277+0000 7f6726d9d640 1 --2- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67280cbca0 0x7f67280b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.277+0000 7f6726d9d640 1 -- 172.21.15.113:0/452182469 >> v1:172.21.15.151:6789/0 conn(0x7f672815a000 legacy=0x7f672815e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.277+0000 7f6726d9d640 1 -- 172.21.15.113:0/452182469 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728070ea0 con 0x7f67280b1dc0 2023-12-19T13:55:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.277+0000 7f671ffff640 1 --2- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67280cbca0 0x7f67280b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:55:11.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.278+0000 7f6726d9d640 1 --2- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 0x7f672806c810 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6720009e50 tx=0x7f672002bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71a6cfdd3697e9b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:11.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.279+0000 7f6725d9b640 1 -- 172.21.15.113:0/452182469 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672002c8c0 con 0x7f67280b1dc0 2023-12-19T13:55:11.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.279+0000 7f6725d9b640 1 -- 172.21.15.113:0/452182469 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672002ca20 con 0x7f67280b1dc0 2023-12-19T13:55:11.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.279+0000 7f6725d9b640 1 -- 172.21.15.113:0/452182469 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672002cdb0 con 0x7f67280b1dc0 2023-12-19T13:55:11.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 -- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 msgr2=0x7f672806c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:11.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 --2- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 0x7f672806c810 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6720009e50 tx=0x7f672002bda0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 -- 172.21.15.113:0/452182469 shutdown_connections 2023-12-19T13:55:11.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 --2- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 0x7f672806c810 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 --2- 172.21.15.113:0/452182469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67280cbca0 0x7f67280b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 -- 172.21.15.113:0/452182469 >> 172.21.15.113:0/452182469 conn(0x7f67280cf230 msgr2=0x7f67280cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:11.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 -- 172.21.15.113:0/452182469 shutdown_connections 2023-12-19T13:55:11.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.280+0000 7f672c8af640 1 -- 172.21.15.113:0/452182469 wait complete. 2023-12-19T13:55:11.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.282+0000 7f672c8af640 1 Processor -- start 2023-12-19T13:55:11.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.282+0000 7f672c8af640 1 -- start start 2023-12-19T13:55:11.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f672c8af640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 0x7f672815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:11.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f672c8af640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67280cbca0 0x7f672815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:11.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f672c8af640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f672815a000 0x7f67281f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:11.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f672c8af640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672814d570 con 0x7f67280cbca0 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f672c8af640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672815d340 con 0x7f67280b1dc0 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f672c8af640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67281575f0 con 0x7f672815a000 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f671ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67280cbca0 0x7f672815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f671ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67280cbca0 0x7f672815ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48870/0 (socket says 172.21.15.113:48870) 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f671ffff640 1 -- 172.21.15.113:0/3010050550 learned_addr learned my addr 172.21.15.113:0/3010050550 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.283+0000 7f671ffff640 1 -- 172.21.15.113:0/3010050550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f672815a000 msgr2=0x7f67281f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671ffff640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f672815a000 0x7f67281f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f672659c640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 0x7f672815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671ffff640 1 -- 172.21.15.113:0/3010050550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 msgr2=0x7f672815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671ffff640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 0x7f672815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671ffff640 1 -- 172.21.15.113:0/3010050550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710009400 con 0x7f67280cbca0 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671ffff640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67280cbca0 0x7f672815ce00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f671000eb90 tx=0x7f671000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710009760 con 0x7f67280cbca0 2023-12-19T13:55:11.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671000ee90 con 0x7f67280cbca0 2023-12-19T13:55:11.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000cdf0 con 0x7f67280cbca0 2023-12-19T13:55:11.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6720009b30 con 0x7f67280cbca0 2023-12-19T13:55:11.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.284+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672815d860 con 0x7f67280cbca0 2023-12-19T13:55:11.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.285+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6728061910 con 0x7f67280cbca0 2023-12-19T13:55:11.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.286+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6710013470 con 0x7f67280cbca0 2023-12-19T13:55:11.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.287+0000 7f671effd640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f670806a430 0x7f670806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:11.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.287+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6710088bc0 con 0x7f67280cbca0 2023-12-19T13:55:11.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.288+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f6708072070 con 0x7f67280cbca0 2023-12-19T13:55:11.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.288+0000 7f672659c640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f670806a430 0x7f670806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:11.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.288+0000 7f672659c640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f670806a430 0x7f670806c8f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f672814ca80 tx=0x7f6718009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:11.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.292+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6710054140 con 0x7f67280cbca0 2023-12-19T13:55:11.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:11.481+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67280cfff0 con 0x7f67280cbca0 2023-12-19T13:55:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.047+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(153..153 src has 1..153) v4 ==== 296+0+0 (secure 0 0 0) 0x7f6710058500 con 0x7f67280cbca0 2023-12-19T13:55:12.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.047+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f67080704a0 con 0x7f67280cbca0 2023-12-19T13:55:12.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.054+0000 7f671effd640 1 -- 172.21.15.113:0/3010050550 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v153) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6710021020 con 0x7f67280cbca0 2023-12-19T13:55:12.055 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:55:12.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.059+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f670806a430 msgr2=0x7f670806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:12.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.059+0000 7f672c8af640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f670806a430 0x7f670806c8f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f672814ca80 tx=0x7f6718009040 comp rx=0 tx=0).stop 2023-12-19T13:55:12.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.059+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67280cbca0 msgr2=0x7f672815ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:12.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.059+0000 7f672c8af640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67280cbca0 0x7f672815ce00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f671000eb90 tx=0x7f671000c520 comp rx=0 tx=0).stop 2023-12-19T13:55:12.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 shutdown_connections 2023-12-19T13:55:12.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f670806a430 0x7f670806c8f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f672815a000 0x7f67281f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67280cbca0 0x7f672815ce00 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 --2- 172.21.15.113:0/3010050550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67280b1dc0 0x7f672815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 >> 172.21.15.113:0/3010050550 conn(0x7f67280cf230 msgr2=0x7f67280ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 shutdown_connections 2023-12-19T13:55:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.060+0000 7f672c8af640 1 -- 172.21.15.113:0/3010050550 wait complete. 2023-12-19T13:55:12.081 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:55:12.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.284+0000 7f0a73fab640 1 Processor -- start 2023-12-19T13:55:12.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.284+0000 7f0a73fab640 1 -- start start 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a73fab640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a6c06dac0 0x7f0a6c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a73fab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0a6c06dea0 0x7f0a6c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a73fab640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0b0770 con 0x7f0a6c0ae730 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a73fab640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0af290 con 0x7f0a6c06dac0 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a73fab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0b0490 con 0x7f0a6c06dea0 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a71d47640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a6c06dac0 0x7f0a6c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a72548640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0a6c0ae730 0x7f0a6c0aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46236/0 (socket says 172.21.15.113:46236) 2023-12-19T13:55:12.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.286+0000 7f0a72548640 1 -- 172.21.15.113:0/2802464068 learned_addr learned my addr 172.21.15.113:0/2802464068 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:12.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.287+0000 7f0a71d47640 1 -- 172.21.15.113:0/2802464068 >> v2:172.21.15.151:3300/0 conn(0x7f0a6c06dea0 msgr2=0x7f0a6c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:12.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.287+0000 7f0a71d47640 1 --2- 172.21.15.113:0/2802464068 >> v2:172.21.15.151:3300/0 conn(0x7f0a6c06dea0 0x7f0a6c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.287+0000 7f0a71d47640 1 -- 172.21.15.113:0/2802464068 >> v1:172.21.15.113:6789/0 conn(0x7f0a6c0ae730 legacy=0x7f0a6c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:12.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.287+0000 7f0a71d47640 1 -- 172.21.15.113:0/2802464068 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c15ca00 con 0x7f0a6c06dac0 2023-12-19T13:55:12.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.288+0000 7f0a71d47640 1 --2- 172.21.15.113:0/2802464068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c0af4a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c145280 tx=0x7f0a6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7691a9fad040984 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.288+0000 7f0a70d45640 1 -- 172.21.15.113:0/2802464068 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68031830 con 0x7f0a6c06dac0 2023-12-19T13:55:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.288+0000 7f0a70d45640 1 -- 172.21.15.113:0/2802464068 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a68031990 con 0x7f0a6c06dac0 2023-12-19T13:55:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.288+0000 7f0a70d45640 1 -- 172.21.15.113:0/2802464068 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68031d20 con 0x7f0a6c06dac0 2023-12-19T13:55:12.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 -- 172.21.15.113:0/2802464068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 msgr2=0x7f0a6c0af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 --2- 172.21.15.113:0/2802464068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c0af4a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c145280 tx=0x7f0a6802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 -- 172.21.15.113:0/2802464068 shutdown_connections 2023-12-19T13:55:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 --2- 172.21.15.113:0/2802464068 >> v2:172.21.15.151:3300/0 conn(0x7f0a6c06dea0 0x7f0a6c15c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 --2- 172.21.15.113:0/2802464068 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c0af4a0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 -- 172.21.15.113:0/2802464068 >> 172.21.15.113:0/2802464068 conn(0x7f0a6c0cf2f0 msgr2=0x7f0a6c0cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 -- 172.21.15.113:0/2802464068 shutdown_connections 2023-12-19T13:55:12.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.289+0000 7f0a73fab640 1 -- 172.21.15.113:0/2802464068 wait complete. 2023-12-19T13:55:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.291+0000 7f0a73fab640 1 Processor -- start 2023-12-19T13:55:12.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.291+0000 7f0a73fab640 1 -- start start 2023-12-19T13:55:12.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a73fab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a73fab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a6c06dea0 0x7f0a6c0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a73fab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a6c0ae730 0x7f0a6c0a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a73fab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c141630 con 0x7f0a6c06dac0 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a73fab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c141340 con 0x7f0a6c06dea0 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a73fab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c15d880 con 0x7f0a6c0ae730 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a71d47640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a71d47640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c140e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48894/0 (socket says 172.21.15.113:48894) 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.292+0000 7f0a71d47640 1 -- 172.21.15.113:0/3665891337 learned_addr learned my addr 172.21.15.113:0/3665891337 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a71d47640 1 -- 172.21.15.113:0/3665891337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a6c0ae730 msgr2=0x7f0a6c0a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a71d47640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a6c0ae730 0x7f0a6c0a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a71d47640 1 -- 172.21.15.113:0/3665891337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a6c06dea0 msgr2=0x7f0a6c0a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a71d47640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a6c06dea0 0x7f0a6c0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:12.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a71d47640 1 -- 172.21.15.113:0/3665891337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68009400 con 0x7f0a6c06dac0 2023-12-19T13:55:12.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a71d47640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c140e00 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0a68000c00 tx=0x7f0a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:12.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6803ba70 con 0x7f0a6c06dac0 2023-12-19T13:55:12.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6803bbf0 con 0x7f0a6c06dac0 2023-12-19T13:55:12.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c15db60 con 0x7f0a6c06dac0 2023-12-19T13:55:12.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680453f0 con 0x7f0a6c06dac0 2023-12-19T13:55:12.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.293+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c141b60 con 0x7f0a6c06dac0 2023-12-19T13:55:12.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.294+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c074770 con 0x7f0a6c06dac0 2023-12-19T13:55:12.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.295+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a68045550 con 0x7f0a6c06dac0 2023-12-19T13:55:12.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.296+0000 7f0a627fc640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a5006a430 0x7f0a5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:12.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.296+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0a680aac70 con 0x7f0a6c06dac0 2023-12-19T13:55:12.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.296+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f0a50071200 con 0x7f0a6c06dac0 2023-12-19T13:55:12.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.296+0000 7f0a71546640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a5006a430 0x7f0a5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:12.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.297+0000 7f0a71546640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a5006a430 0x7f0a5006c8f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c15c640 tx=0x7f0a5c006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:12.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.301+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a68035060 con 0x7f0a6c06dac0 2023-12-19T13:55:12.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:12.494+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a6c061910 con 0x7f0a6c06dac0 2023-12-19T13:55:13.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.060+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(154..154 src has 1..154) v4 ==== 296+0+0 (secure 0 0 0) 0x7f0a680b0020 con 0x7f0a6c06dac0 2023-12-19T13:55:13.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.060+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7f0a5006ff90 con 0x7f0a6c06dac0 2023-12-19T13:55:13.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.077+0000 7f0a627fc640 1 -- 172.21.15.113:0/3665891337 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v154) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0a68035070 con 0x7f0a6c06dac0 2023-12-19T13:55:13.080 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:55:13.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a5006a430 msgr2=0x7f0a5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a5006a430 0x7f0a5006c8f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c15c640 tx=0x7f0a5c006c90 comp rx=0 tx=0).stop 2023-12-19T13:55:13.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 msgr2=0x7f0a6c140e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c140e00 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0a68000c00 tx=0x7f0a680046c0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 shutdown_connections 2023-12-19T13:55:13.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0a5006a430 0x7f0a5006c8f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a6c0ae730 0x7f0a6c0a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a6c06dea0 0x7f0a6c0a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 --2- 172.21.15.113:0/3665891337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a6c06dac0 0x7f0a6c140e00 secure :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0a68000c00 tx=0x7f0a680046c0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.085+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 >> 172.21.15.113:0/3665891337 conn(0x7f0a6c0cf2f0 msgr2=0x7f0a6c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:13.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.087+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 shutdown_connections 2023-12-19T13:55:13.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.087+0000 7f0a73fab640 1 -- 172.21.15.113:0/3665891337 wait complete. 2023-12-19T13:55:13.108 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:55:13.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.308+0000 7f4478084640 1 Processor -- start 2023-12-19T13:55:13.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.308+0000 7f4478084640 1 -- start start 2023-12-19T13:55:13.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.310+0000 7f4478084640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 0x7f44701682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.310+0000 7f4478084640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700d2d20 con 0x7f4470146d60 2023-12-19T13:55:13.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.310+0000 7f4478084640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700d3000 con 0x7f447006f160 2023-12-19T13:55:13.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.310+0000 7f4478084640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44700b8c70 con 0x7f44700d1e30 2023-12-19T13:55:13.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.310+0000 7f4475e20640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4470146d60 0x7f44700b6ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46244/0 (socket says 172.21.15.113:46244) 2023-12-19T13:55:13.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.310+0000 7f4475e20640 1 -- 172.21.15.113:0/1969258466 learned_addr learned my addr 172.21.15.113:0/1969258466 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:13.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4476621640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 0x7f44701682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240392591 0 0) 0x7f44700d2d20 con 0x7f4470146d60 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f445c003520 con 0x7f4470146d60 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 591180541 0 0) 0x7f445c003520 con 0x7f4470146d60 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 msgr2=0x7f44701682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 0x7f44701682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 >> v1:172.21.15.151:6789/0 conn(0x7f447006f160 legacy=0x7f44700d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700b8f50 con 0x7f4470146d60 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f446c001670 con 0x7f4470146d60 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 >> v1:172.21.15.113:6789/0 conn(0x7f4470146d60 legacy=0x7f44700b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f445c003a10 0x7f445c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 0x7f445c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c004d00 0x7f445c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700b8c70 con 0x7f445c003a10 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c00bb10 con 0x7f445c004d00 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c00bca0 con 0x7f44700d1e30 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.311+0000 7f4475e20640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f445c003a10 0x7f445c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f4475e20640 1 -- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 msgr2=0x7f445c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f447561f640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 0x7f445c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f4476621640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c004d00 0x7f445c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f4475e20640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 0x7f445c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f4475e20640 1 -- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c004d00 msgr2=0x7f445c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f4475e20640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c004d00 0x7f445c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f4475e20640 1 -- 172.21.15.113:0/1969258466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c003520 con 0x7f445c003a10 2023-12-19T13:55:13.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.312+0000 7f447561f640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700d1e30 0x7f445c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:13.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.313+0000 7f4475e20640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f445c003a10 0x7f445c003e30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f446c00c0e0 tx=0x7f445c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393a8bcb80764953 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.313+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c005ad0 con 0x7f445c003a10 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.313+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c005c30 con 0x7f445c003a10 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.313+0000 7f4474e1e640 1 -- 172.21.15.113:0/1969258466 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c02c7c0 con 0x7f445c003a10 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.314+0000 7f4478084640 1 -- 172.21.15.113:0/1969258466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f445c003a10 msgr2=0x7f445c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.314+0000 7f4478084640 1 --2- 172.21.15.113:0/1969258466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f445c003a10 0x7f445c003e30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f446c00c0e0 tx=0x7f445c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.314+0000 7f4476621640 1 -- 172.21.15.113:0/1969258466 reap_dead start 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.314+0000 7f4478084640 1 -- 172.21.15.113:0/1969258466 shutdown_connections 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.314+0000 7f4478084640 1 -- 172.21.15.113:0/1969258466 >> 172.21.15.113:0/1969258466 conn(0x7f44700cfe10 msgr2=0x7f44700d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.314+0000 7f4478084640 1 -- 172.21.15.113:0/1969258466 shutdown_connections 2023-12-19T13:55:13.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.314+0000 7f4478084640 1 -- 172.21.15.113:0/1969258466 wait complete. 2023-12-19T13:55:13.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.316+0000 7f4478084640 1 Processor -- start 2023-12-19T13:55:13.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.316+0000 7f4478084640 1 -- start start 2023-12-19T13:55:13.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f4478084640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c003a10 0x7f447015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f4478084640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4470142ce0 0x7f44700b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f4478084640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700b66b0 0x7f44701584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f4478084640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447015cbb0 con 0x7f4470142ce0 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f4478084640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700b6b60 con 0x7f445c003a10 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f4478084640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44701591e0 con 0x7f44700b66b0 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f447561f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4470142ce0 0x7f44700b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f447561f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4470142ce0 0x7f44700b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48912/0 (socket says 172.21.15.113:48912) 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.317+0000 7f447561f640 1 -- 172.21.15.113:0/281693312 learned_addr learned my addr 172.21.15.113:0/281693312 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f447561f640 1 -- 172.21.15.113:0/281693312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700b66b0 msgr2=0x7f44701584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f447561f640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700b66b0 0x7f44701584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f447561f640 1 -- 172.21.15.113:0/281693312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c003a10 msgr2=0x7f447015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f447561f640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c003a10 0x7f447015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f447561f640 1 -- 172.21.15.113:0/281693312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447015b8d0 con 0x7f4470142ce0 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f447561f640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4470142ce0 0x7f44700b6170 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f446000d770 tx=0x7f446000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f44667fc640 1 -- 172.21.15.113:0/281693312 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460005270 con 0x7f4470142ce0 2023-12-19T13:55:13.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f44667fc640 1 -- 172.21.15.113:0/281693312 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44600053d0 con 0x7f4470142ce0 2023-12-19T13:55:13.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447015bbb0 con 0x7f4470142ce0 2023-12-19T13:55:13.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f44667fc640 1 -- 172.21.15.113:0/281693312 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446000b850 con 0x7f4470142ce0 2023-12-19T13:55:13.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.318+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447015c170 con 0x7f4470142ce0 2023-12-19T13:55:13.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.320+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447015c330 con 0x7f4470142ce0 2023-12-19T13:55:13.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.321+0000 7f44667fc640 1 -- 172.21.15.113:0/281693312 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f446000b9b0 con 0x7f4470142ce0 2023-12-19T13:55:13.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.322+0000 7f44667fc640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f445406a430 0x7f445406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.322+0000 7f44667fc640 1 -- 172.21.15.113:0/281693312 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f44600884f0 con 0x7f4470142ce0 2023-12-19T13:55:13.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.322+0000 7f4475e20640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f445406a430 0x7f445406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.323+0000 7f4475e20640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f445406a430 0x7f445406c8f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f446c034000 tx=0x7f446c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:13.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.326+0000 7f44667fc640 1 -- 172.21.15.113:0/281693312 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4460053dd0 con 0x7f4470142ce0 2023-12-19T13:55:13.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.516+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4470061910 con 0x7f4470142ce0 2023-12-19T13:55:13.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.525+0000 7f44667fc640 1 -- 172.21.15.113:0/281693312 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4460019310 con 0x7f4470142ce0 2023-12-19T13:55:13.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.527+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f445406a430 msgr2=0x7f445406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.527+0000 7f4478084640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f445406a430 0x7f445406c8f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f446c034000 tx=0x7f446c007000 comp rx=0 tx=0).stop 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4470142ce0 msgr2=0x7f44700b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4470142ce0 0x7f44700b6170 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f446000d770 tx=0x7f446000dc30 comp rx=0 tx=0).stop 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 shutdown_connections 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f445406a430 0x7f445406c8f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44700b66b0 0x7f44701584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4470142ce0 0x7f44700b6170 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 --2- 172.21.15.113:0/281693312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f445c003a10 0x7f447015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 >> 172.21.15.113:0/281693312 conn(0x7f44700cfe10 msgr2=0x7f44700d1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 shutdown_connections 2023-12-19T13:55:13.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.528+0000 7f4478084640 1 -- 172.21.15.113:0/281693312 wait complete. 2023-12-19T13:55:13.546 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-19T13:55:13.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.751+0000 7fdb86e8b640 1 Processor -- start 2023-12-19T13:55:13.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.752+0000 7fdb86e8b640 1 -- start start 2023-12-19T13:55:13.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.753+0000 7fdb86e8b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb80146e10 0x7fdb800d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.753+0000 7fdb86e8b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb800b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.753+0000 7fdb86e8b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb800ce110 0x7fdb800ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.753+0000 7fdb86e8b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800d2430 con 0x7fdb800ce110 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.753+0000 7fdb86e8b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800ceae0 con 0x7fdb80146e10 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.753+0000 7fdb86e8b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800cd840 con 0x7fdb800d2b00 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.753+0000 7fdb85428640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb800ce110 0x7fdb800ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb85428640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb800ce110 0x7fdb800ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48920/0 (socket says 172.21.15.113:48920) 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb85428640 1 -- 172.21.15.113:0/1404659952 learned_addr learned my addr 172.21.15.113:0/1404659952 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb84c27640 1 --2- 172.21.15.113:0/1404659952 >> v2:172.21.15.151:3300/0 conn(0x7fdb80146e10 0x7fdb800d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb7ffff640 1 --2- 172.21.15.113:0/1404659952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb800b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb85428640 1 -- 172.21.15.113:0/1404659952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 msgr2=0x7fdb800b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb85428640 1 --2- 172.21.15.113:0/1404659952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb800b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb85428640 1 -- 172.21.15.113:0/1404659952 >> v2:172.21.15.151:3300/0 conn(0x7fdb80146e10 msgr2=0x7fdb800d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb85428640 1 --2- 172.21.15.113:0/1404659952 >> v2:172.21.15.151:3300/0 conn(0x7fdb80146e10 0x7fdb800d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb85428640 1 -- 172.21.15.113:0/1404659952 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800d2620 con 0x7fdb800ce110 2023-12-19T13:55:13.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.754+0000 7fdb7ffff640 1 --2- 172.21.15.113:0/1404659952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb800b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.755+0000 7fdb85428640 1 --2- 172.21.15.113:0/1404659952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb800ce110 0x7fdb800ce5a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fdb800d0720 tx=0x7fdb7802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e848672031d90af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb7f7fe640 1 -- 172.21.15.113:0/1404659952 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7802ca70 con 0x7fdb800ce110 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb7f7fe640 1 -- 172.21.15.113:0/1404659952 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7802cbd0 con 0x7fdb800ce110 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb7f7fe640 1 -- 172.21.15.113:0/1404659952 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb780343f0 con 0x7fdb800ce110 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 -- 172.21.15.113:0/1404659952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb800ce110 msgr2=0x7fdb800ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/1404659952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb800ce110 0x7fdb800ce5a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fdb800d0720 tx=0x7fdb7802bed0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 -- 172.21.15.113:0/1404659952 shutdown_connections 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/1404659952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb800ce110 0x7fdb800ce5a0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/1404659952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb800b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/1404659952 >> v2:172.21.15.151:3300/0 conn(0x7fdb80146e10 0x7fdb800d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 -- 172.21.15.113:0/1404659952 >> 172.21.15.113:0/1404659952 conn(0x7fdb800b29c0 msgr2=0x7fdb800b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:13.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 -- 172.21.15.113:0/1404659952 shutdown_connections 2023-12-19T13:55:13.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.756+0000 7fdb86e8b640 1 -- 172.21.15.113:0/1404659952 wait complete. 2023-12-19T13:55:13.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.758+0000 7fdb86e8b640 1 Processor -- start 2023-12-19T13:55:13.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.758+0000 7fdb86e8b640 1 -- start start 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.759+0000 7fdb86e8b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb800ce110 0x7fdb800b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.759+0000 7fdb86e8b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb801f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.759+0000 7fdb86e8b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb80146e10 0x7fdb801f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.759+0000 7fdb86e8b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80152cf0 con 0x7fdb80146e10 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.759+0000 7fdb86e8b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80152fd0 con 0x7fdb800ce110 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.759+0000 7fdb86e8b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800b81a0 con 0x7fdb800d2b00 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.759+0000 7fdb85428640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb80146e10 0x7fdb801f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb80146e10 0x7fdb801f6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48930/0 (socket says 172.21.15.113:48930) 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 -- 172.21.15.113:0/678997085 learned_addr learned my addr 172.21.15.113:0/678997085 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb84c27640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb800ce110 0x7fdb800b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb7ffff640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb801f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 -- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 msgr2=0x7fdb801f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb801f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 -- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb800ce110 msgr2=0x7fdb800b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb800ce110 0x7fdb800b8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 -- 172.21.15.113:0/678997085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78009b30 con 0x7fdb80146e10 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb7ffff640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb801f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb85428640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb80146e10 0x7fdb801f6610 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fdb78036040 tx=0x7fdb78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb7d7fa640 1 -- 172.21.15.113:0/678997085 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78009510 con 0x7fdb80146e10 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.760+0000 7fdb7d7fa640 1 -- 172.21.15.113:0/678997085 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7803e450 con 0x7fdb80146e10 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.761+0000 7fdb7d7fa640 1 -- 172.21.15.113:0/678997085 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7803e7e0 con 0x7fdb80146e10 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.761+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb800b8480 con 0x7fdb80146e10 2023-12-19T13:55:13.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.761+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb801355f0 con 0x7fdb80146e10 2023-12-19T13:55:13.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.762+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb800b8940 con 0x7fdb80146e10 2023-12-19T13:55:13.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.763+0000 7fdb7d7fa640 1 -- 172.21.15.113:0/678997085 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb7803e940 con 0x7fdb80146e10 2023-12-19T13:55:13.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.763+0000 7fdb7d7fa640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:13.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.764+0000 7fdb7d7fa640 1 -- 172.21.15.113:0/678997085 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdb780ab430 con 0x7fdb80146e10 2023-12-19T13:55:13.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.764+0000 7fdb84c27640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:13.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.765+0000 7fdb84c27640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdb70006fd0 tx=0x7fdb70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:13.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:13.768+0000 7fdb7d7fa640 1 -- 172.21.15.113:0/678997085 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb78076c80 con 0x7fdb80146e10 2023-12-19T13:55:14.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.027+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fdb80061910 con 0x7fdb80146e10 2023-12-19T13:55:14.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.066+0000 7fdb7d7fa640 1 -- 172.21.15.113:0/678997085 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v448) v1 ==== 140+0+0 (secure 0 0 0) 0x7fdb7807a2a0 con 0x7fdb80146e10 2023-12-19T13:55:14.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb6c06a430 msgr2=0x7fdb6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdb70006fd0 tx=0x7fdb70008040 comp rx=0 tx=0).stop 2023-12-19T13:55:14.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb80146e10 msgr2=0x7fdb801f6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb80146e10 0x7fdb801f6610 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fdb78036040 tx=0x7fdb78004a40 comp rx=0 tx=0).stop 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 shutdown_connections 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 secure :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdb70006fd0 tx=0x7fdb70008040 comp rx=0 tx=0).stop 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb80146e10 0x7fdb801f6610 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb800d2b00 0x7fdb801f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 --2- 172.21.15.113:0/678997085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb800ce110 0x7fdb800b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 >> 172.21.15.113:0/678997085 conn(0x7fdb800b29c0 msgr2=0x7fdb800d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 shutdown_connections 2023-12-19T13:55:14.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.069+0000 7fdb86e8b640 1 -- 172.21.15.113:0/678997085 wait complete. 2023-12-19T13:55:14.087 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-19T13:55:14.088 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T13:55:14.088 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:14.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.296+0000 7f816c44c640 1 Processor -- start 2023-12-19T13:55:14.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.296+0000 7f816c44c640 1 -- start start 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816c44c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f81641449e0 0x7f81640af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816c44c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81640b0b50 0x7f816406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816c44c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81640afb10 con 0x7f816406b590 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816c44c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816406bb30 con 0x7f81641449e0 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816c44c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81640b0070 con 0x7f81640b0b50 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816a1e8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f81641449e0 0x7f81640af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816a9e9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f816406b590 0x7f816415eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46260/0 (socket says 172.21.15.113:46260) 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816a9e9640 1 -- 172.21.15.113:0/470746883 learned_addr learned my addr 172.21.15.113:0/470746883 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.298+0000 7f816a1e8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f81641449e0 0x7f81640af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48940/0 (socket says 172.21.15.113:48940) 2023-12-19T13:55:14.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.299+0000 7f81699e7640 1 --2- 172.21.15.113:0/470746883 >> v2:172.21.15.151:3300/0 conn(0x7f81640b0b50 0x7f816406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.299+0000 7f816a1e8640 1 -- 172.21.15.113:0/470746883 >> v2:172.21.15.151:3300/0 conn(0x7f81640b0b50 msgr2=0x7f816406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:14.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.299+0000 7f816a1e8640 1 --2- 172.21.15.113:0/470746883 >> v2:172.21.15.151:3300/0 conn(0x7f81640b0b50 0x7f816406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.299+0000 7f816a1e8640 1 -- 172.21.15.113:0/470746883 >> v1:172.21.15.113:6789/0 conn(0x7f816406b590 legacy=0x7f816415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.299+0000 7f816a1e8640 1 -- 172.21.15.113:0/470746883 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640b0350 con 0x7f81641449e0 2023-12-19T13:55:14.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.300+0000 7f816a1e8640 1 --2- 172.21.15.113:0/470746883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640af5d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8164071c80 tx=0x7f816002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883f0adfa4dabb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:14.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.300+0000 7f81691e6640 1 -- 172.21.15.113:0/470746883 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160031830 con 0x7f81641449e0 2023-12-19T13:55:14.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.300+0000 7f81691e6640 1 -- 172.21.15.113:0/470746883 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160031990 con 0x7f81641449e0 2023-12-19T13:55:14.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.300+0000 7f81691e6640 1 -- 172.21.15.113:0/470746883 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160031d20 con 0x7f81641449e0 2023-12-19T13:55:14.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 -- 172.21.15.113:0/470746883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 msgr2=0x7f81640af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 --2- 172.21.15.113:0/470746883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640af5d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8164071c80 tx=0x7f816002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 -- 172.21.15.113:0/470746883 shutdown_connections 2023-12-19T13:55:14.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 --2- 172.21.15.113:0/470746883 >> v2:172.21.15.151:3300/0 conn(0x7f81640b0b50 0x7f816406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 --2- 172.21.15.113:0/470746883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640af5d0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 -- 172.21.15.113:0/470746883 >> 172.21.15.113:0/470746883 conn(0x7f81640cbb70 msgr2=0x7f81640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:14.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 -- 172.21.15.113:0/470746883 shutdown_connections 2023-12-19T13:55:14.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.301+0000 7f816c44c640 1 -- 172.21.15.113:0/470746883 wait complete. 2023-12-19T13:55:14.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.303+0000 7f816c44c640 1 Processor -- start 2023-12-19T13:55:14.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.303+0000 7f816c44c640 1 -- start start 2023-12-19T13:55:14.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816c44c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816406b590 0x7f816413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816c44c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81640b0b50 0x7f81640cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816c44c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816c44c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164142610 con 0x7f81641449e0 2023-12-19T13:55:14.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816c44c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81641e5100 con 0x7f81640b0b50 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816c44c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8164141d00 con 0x7f816406b590 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816a9e9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816a9e9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48942/0 (socket says 172.21.15.113:48942) 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.304+0000 7f816a9e9640 1 -- 172.21.15.113:0/957600086 learned_addr learned my addr 172.21.15.113:0/957600086 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a1e8640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816406b590 0x7f816413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f81699e7640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81640b0b50 0x7f81640cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a9e9640 1 -- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816406b590 msgr2=0x7f816413ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a9e9640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816406b590 0x7f816413ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a9e9640 1 -- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81640b0b50 msgr2=0x7f81640cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a9e9640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81640b0b50 0x7f81640cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a9e9640 1 -- 172.21.15.113:0/957600086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160009400 con 0x7f81641449e0 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a1e8640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816406b590 0x7f816413ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816a9e9640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640cdce0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f815c00cbf0 tx=0x7f815c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:14.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f815affd640 1 -- 172.21.15.113:0/957600086 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00ad40 con 0x7f81641449e0 2023-12-19T13:55:14.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f815affd640 1 -- 172.21.15.113:0/957600086 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c012400 con 0x7f81641449e0 2023-12-19T13:55:14.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816413b040 con 0x7f81641449e0 2023-12-19T13:55:14.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f815affd640 1 -- 172.21.15.113:0/957600086 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00aea0 con 0x7f81641449e0 2023-12-19T13:55:14.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.305+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8164141f50 con 0x7f81641449e0 2023-12-19T13:55:14.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.307+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8164142750 con 0x7f81641449e0 2023-12-19T13:55:14.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.308+0000 7f815affd640 1 -- 172.21.15.113:0/957600086 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f815c007070 con 0x7f81641449e0 2023-12-19T13:55:14.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.309+0000 7f815affd640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f814806a430 0x7f814806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.309+0000 7f815affd640 1 -- 172.21.15.113:0/957600086 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f815c0884a0 con 0x7f81641449e0 2023-12-19T13:55:14.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.309+0000 7f816a1e8640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f814806a430 0x7f814806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.310+0000 7f816a1e8640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f814806a430 0x7f814806c8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8160036000 tx=0x7f816003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:14.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.313+0000 7f815affd640 1 -- 172.21.15.113:0/957600086 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f815c053e30 con 0x7f81641449e0 2023-12-19T13:55:14.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.501+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8164061910 con 0x7f81641449e0 2023-12-19T13:55:14.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.504+0000 7f815affd640 1 -- 172.21.15.113:0/957600086 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+12579 (secure 0 0 0) 0x7f815c057450 con 0x7f81641449e0 2023-12-19T13:55:14.503 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:14.503 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":154,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:13.048002+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:6837/4021670999":"2023-12-20T13:55:10.017128+0000","172.21.15.113:6835/4021670999":"2023-12-20T13:55:10.017128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.506+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f814806a430 msgr2=0x7f814806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.506+0000 7f816c44c640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f814806a430 0x7f814806c8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8160036000 tx=0x7f816003c040 comp rx=0 tx=0).stop 2023-12-19T13:55:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.506+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 msgr2=0x7f81640cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640cdce0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f815c00cbf0 tx=0x7f815c00a430 comp rx=0 tx=0).stop 2023-12-19T13:55:14.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 shutdown_connections 2023-12-19T13:55:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f814806a430 0x7f814806c8f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f81641449e0 0x7f81640cdce0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81640b0b50 0x7f81640cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 --2- 172.21.15.113:0/957600086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816406b590 0x7f816413ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 >> 172.21.15.113:0/957600086 conn(0x7f81640cbb70 msgr2=0x7f81640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 shutdown_connections 2023-12-19T13:55:14.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.507+0000 7f816c44c640 1 -- 172.21.15.113:0/957600086 wait complete. 2023-12-19T13:55:14.525 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:55:14.526 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:55:14.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.743+0000 7fc79d684640 1 Processor -- start 2023-12-19T13:55:14.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.743+0000 7fc79d684640 1 -- start start 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc79d684640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc798154760 0x7fc79815b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc79d684640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7980cb810 0x7fc7980b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc79d684640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7980b0070 0x7fc7980b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc79d684640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980ccf20 con 0x7fc7980cb810 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc79d684640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980b0a10 con 0x7fc7980b0070 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc79d684640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980ccbd0 con 0x7fc798154760 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc7967fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7980cb810 0x7fc7980b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc7967fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7980cb810 0x7fc7980b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48954/0 (socket says 172.21.15.113:48954) 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc7967fc640 1 -- 172.21.15.113:0/2742895065 learned_addr learned my addr 172.21.15.113:0/2742895065 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:14.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc796ffd640 1 --2- 172.21.15.113:0/2742895065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc798154760 0x7fc79815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.745+0000 7fc7977fe640 1 --2- 172.21.15.113:0/2742895065 >> v2:172.21.15.151:3300/0 conn(0x7fc7980b0070 0x7fc7980b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.746+0000 7fc7967fc640 1 -- 172.21.15.113:0/2742895065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc798154760 msgr2=0x7fc79815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.746+0000 7fc7967fc640 1 --2- 172.21.15.113:0/2742895065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc798154760 0x7fc79815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.746+0000 7fc7967fc640 1 -- 172.21.15.113:0/2742895065 >> v2:172.21.15.151:3300/0 conn(0x7fc7980b0070 msgr2=0x7fc7980b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.746+0000 7fc7967fc640 1 --2- 172.21.15.113:0/2742895065 >> v2:172.21.15.151:3300/0 conn(0x7fc7980b0070 0x7fc7980b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.746+0000 7fc7967fc640 1 -- 172.21.15.113:0/2742895065 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798154b40 con 0x7fc7980cb810 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.746+0000 7fc796ffd640 1 --2- 172.21.15.113:0/2742895065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc798154760 0x7fc79815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.746+0000 7fc7977fe640 1 --2- 172.21.15.113:0/2742895065 >> v2:172.21.15.151:3300/0 conn(0x7fc7980b0070 0x7fc7980b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:14.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.747+0000 7fc7967fc640 1 --2- 172.21.15.113:0/2742895065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7980cb810 0x7fc7980b1440 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc798071a40 tx=0x7fc78002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c1f4799e2b31a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:14.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.747+0000 7fc795ffb640 1 -- 172.21.15.113:0/2742895065 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78002ee00 con 0x7fc7980cb810 2023-12-19T13:55:14.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.747+0000 7fc795ffb640 1 -- 172.21.15.113:0/2742895065 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc780036440 con 0x7fc7980cb810 2023-12-19T13:55:14.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.747+0000 7fc795ffb640 1 -- 172.21.15.113:0/2742895065 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7800367d0 con 0x7fc7980cb810 2023-12-19T13:55:14.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.747+0000 7fc79d684640 1 -- 172.21.15.113:0/2742895065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7980cb810 msgr2=0x7fc7980b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.747+0000 7fc79d684640 1 --2- 172.21.15.113:0/2742895065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7980cb810 0x7fc7980b1440 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc798071a40 tx=0x7fc78002e050 comp rx=0 tx=0).stop 2023-12-19T13:55:14.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.748+0000 7fc79d684640 1 -- 172.21.15.113:0/2742895065 shutdown_connections 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.748+0000 7fc79d684640 1 --2- 172.21.15.113:0/2742895065 >> v2:172.21.15.151:3300/0 conn(0x7fc7980b0070 0x7fc7980b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.748+0000 7fc79d684640 1 --2- 172.21.15.113:0/2742895065 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7980cb810 0x7fc7980b1440 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.748+0000 7fc79d684640 1 --2- 172.21.15.113:0/2742895065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc798154760 0x7fc79815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.748+0000 7fc79d684640 1 -- 172.21.15.113:0/2742895065 >> 172.21.15.113:0/2742895065 conn(0x7fc798073150 msgr2=0x7fc7980659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.748+0000 7fc79d684640 1 -- 172.21.15.113:0/2742895065 shutdown_connections 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.748+0000 7fc79d684640 1 -- 172.21.15.113:0/2742895065 wait complete. 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.749+0000 7fc79d684640 1 Processor -- start 2023-12-19T13:55:14.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.750+0000 7fc79d684640 1 -- start start 2023-12-19T13:55:14.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.750+0000 7fc79d684640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7980b0070 0x7fc7980ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.750+0000 7fc79d684640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7980cb810 0x7fc7980ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.750+0000 7fc79d684640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc798154760 0x7fc798154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.750+0000 7fc79d684640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79806da60 con 0x7fc798154760 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.750+0000 7fc79d684640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798157a50 con 0x7fc7980cb810 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.750+0000 7fc79d684640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79806d410 con 0x7fc7980b0070 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc798154760 0x7fc798154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc798154760 0x7fc798154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48956/0 (socket says 172.21.15.113:48956) 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 -- 172.21.15.113:0/2200812257 learned_addr learned my addr 172.21.15.113:0/2200812257 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7967fc640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7980cb810 0x7fc7980ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc796ffd640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7980b0070 0x7fc7980ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 -- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7980b0070 msgr2=0x7fc7980ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7980b0070 0x7fc7980ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 -- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7980cb810 msgr2=0x7fc7980ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7980cb810 0x7fc7980ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.751+0000 7fc7977fe640 1 -- 172.21.15.113:0/2200812257 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78000b770 con 0x7fc798154760 2023-12-19T13:55:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.752+0000 7fc7977fe640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc798154760 0x7fc798154cd0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc79000afd0 tx=0x7fc79000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.752+0000 7fc78f7fe640 1 -- 172.21.15.113:0/2200812257 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790004440 con 0x7fc798154760 2023-12-19T13:55:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.752+0000 7fc78f7fe640 1 -- 172.21.15.113:0/2200812257 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc790003610 con 0x7fc798154760 2023-12-19T13:55:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.752+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79806d6f0 con 0x7fc798154760 2023-12-19T13:55:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.752+0000 7fc78f7fe640 1 -- 172.21.15.113:0/2200812257 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7900039c0 con 0x7fc798154760 2023-12-19T13:55:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.752+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79806d070 con 0x7fc798154760 2023-12-19T13:55:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.753+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79806dbd0 con 0x7fc798154760 2023-12-19T13:55:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.754+0000 7fc78f7fe640 1 -- 172.21.15.113:0/2200812257 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc790003b20 con 0x7fc798154760 2023-12-19T13:55:14.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.755+0000 7fc78f7fe640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc77806a480 0x7fc77806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:14.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.755+0000 7fc78f7fe640 1 -- 172.21.15.113:0/2200812257 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc790088730 con 0x7fc798154760 2023-12-19T13:55:14.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.755+0000 7fc796ffd640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc77806a480 0x7fc77806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:14.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.756+0000 7fc796ffd640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc77806a480 0x7fc77806c940 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc7880075b0 tx=0x7fc788007540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:14.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.759+0000 7fc78f7fe640 1 -- 172.21.15.113:0/2200812257 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc790054100 con 0x7fc798154760 2023-12-19T13:55:14.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.947+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc798061910 con 0x7fc798154760 2023-12-19T13:55:14.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.948+0000 7fc78f7fe640 1 -- 172.21.15.113:0/2200812257 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc790057720 con 0x7fc798154760 2023-12-19T13:55:14.947 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:55:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc77806a480 msgr2=0x7fc77806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc77806a480 0x7fc77806c940 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc7880075b0 tx=0x7fc788007540 comp rx=0 tx=0).stop 2023-12-19T13:55:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc798154760 msgr2=0x7fc798154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc798154760 0x7fc798154cd0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc79000afd0 tx=0x7fc79000ca20 comp rx=0 tx=0).stop 2023-12-19T13:55:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 shutdown_connections 2023-12-19T13:55:14.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc77806a480 0x7fc77806c940 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc798154760 0x7fc798154cd0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7980cb810 0x7fc7980ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 --2- 172.21.15.113:0/2200812257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7980b0070 0x7fc7980ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:14.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 >> 172.21.15.113:0/2200812257 conn(0x7fc798073150 msgr2=0x7fc7980af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:14.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 shutdown_connections 2023-12-19T13:55:14.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:14.951+0000 7fc79d684640 1 -- 172.21.15.113:0/2200812257 wait complete. 2023-12-19T13:55:14.969 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-19T13:55:15.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.184+0000 7f4dc9896640 1 Processor -- start 2023-12-19T13:55:15.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.184+0000 7f4dc9896640 1 -- start start 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc9896640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4dc41449e0 0x7f4dc40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc9896640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc406c6b0 0x7f4dc40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc9896640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40afb10 con 0x7f4dc40b0b50 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc9896640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc406bb30 con 0x7f4dc41449e0 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc9896640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40b0070 con 0x7f4dc406c6b0 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc2ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4dc41449e0 0x7f4dc40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc2ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4dc41449e0 0x7f4dc40af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48964/0 (socket says 172.21.15.113:48964) 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.186+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/2922027009 learned_addr learned my addr 172.21.15.113:0/2922027009 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.187+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/2922027009 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc406c6b0 msgr2=0x7f4dc40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.187+0000 7f4dc2ffd640 1 --2- 172.21.15.113:0/2922027009 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc406c6b0 0x7f4dc40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.187+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/2922027009 >> v1:172.21.15.151:6789/0 conn(0x7f4dc40b0b50 legacy=0x7f4dc406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:15.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.187+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/2922027009 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40b0350 con 0x7f4dc41449e0 2023-12-19T13:55:15.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.188+0000 7f4dc2ffd640 1 --2- 172.21.15.113:0/2922027009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc41449e0 0x7f4dc40af5d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009870 tx=0x7f4db402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db37f14efeadb30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:15.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.188+0000 7f4dc27fc640 1 -- 172.21.15.113:0/2922027009 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4031640 con 0x7f4dc41449e0 2023-12-19T13:55:15.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.188+0000 7f4dc27fc640 1 -- 172.21.15.113:0/2922027009 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40317a0 con 0x7f4dc41449e0 2023-12-19T13:55:15.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.188+0000 7f4dc27fc640 1 -- 172.21.15.113:0/2922027009 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4031b30 con 0x7f4dc41449e0 2023-12-19T13:55:15.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 -- 172.21.15.113:0/2922027009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc41449e0 msgr2=0x7f4dc40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:15.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 --2- 172.21.15.113:0/2922027009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc41449e0 0x7f4dc40af5d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009870 tx=0x7f4db402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:55:15.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 -- 172.21.15.113:0/2922027009 shutdown_connections 2023-12-19T13:55:15.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 --2- 172.21.15.113:0/2922027009 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc406c6b0 0x7f4dc40b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:15.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 --2- 172.21.15.113:0/2922027009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc41449e0 0x7f4dc40af5d0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:15.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 -- 172.21.15.113:0/2922027009 >> 172.21.15.113:0/2922027009 conn(0x7f4dc40cbb70 msgr2=0x7f4dc40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:15.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 -- 172.21.15.113:0/2922027009 shutdown_connections 2023-12-19T13:55:15.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.189+0000 7f4dc9896640 1 -- 172.21.15.113:0/2922027009 wait complete. 2023-12-19T13:55:15.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.190+0000 7f4dc9896640 1 Processor -- start 2023-12-19T13:55:15.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.191+0000 7f4dc9896640 1 -- start start 2023-12-19T13:55:15.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.191+0000 7f4dc9896640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc406c6b0 0x7f4dc413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:15.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.191+0000 7f4dc9896640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc40b0b50 0x7f4dc406fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:15.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.191+0000 7f4dc9896640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dc41449e0 0x7f4dc4070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:15.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.191+0000 7f4dc9896640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc413b360 con 0x7f4dc406c6b0 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.191+0000 7f4dc9896640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41f5f70 con 0x7f4dc41449e0 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc9896640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41f56d0 con 0x7f4dc40b0b50 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc406c6b0 0x7f4dc413ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc406c6b0 0x7f4dc413ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48978/0 (socket says 172.21.15.113:48978) 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/663136513 learned_addr learned my addr 172.21.15.113:0/663136513 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/663136513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc40b0b50 msgr2=0x7f4dc406fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc40b0b50 0x7f4dc406fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/663136513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dc41449e0 msgr2=0x7f4dc4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dc41449e0 0x7f4dc4070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 -- 172.21.15.113:0/663136513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db40094d0 con 0x7f4dc406c6b0 2023-12-19T13:55:15.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.192+0000 7f4dc2ffd640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc406c6b0 0x7f4dc413ae20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009870 tx=0x7f4db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:15.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.193+0000 7f4dc0ff9640 1 -- 172.21.15.113:0/663136513 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db403ac60 con 0x7f4dc406c6b0 2023-12-19T13:55:15.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.193+0000 7f4dc0ff9640 1 -- 172.21.15.113:0/663136513 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db403adc0 con 0x7f4dc406c6b0 2023-12-19T13:55:15.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.193+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc41f59b0 con 0x7f4dc406c6b0 2023-12-19T13:55:15.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.193+0000 7f4dc0ff9640 1 -- 172.21.15.113:0/663136513 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4044610 con 0x7f4dc406c6b0 2023-12-19T13:55:15.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.193+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc4157480 con 0x7f4dc406c6b0 2023-12-19T13:55:15.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.194+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4061910 con 0x7f4dc406c6b0 2023-12-19T13:55:15.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.195+0000 7f4dc0ff9640 1 -- 172.21.15.113:0/663136513 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4db402f050 con 0x7f4dc406c6b0 2023-12-19T13:55:15.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.196+0000 7f4dc0ff9640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4da406a430 0x7f4da406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:15.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.196+0000 7f4dc0ff9640 1 -- 172.21.15.113:0/663136513 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4db40aa670 con 0x7f4dc406c6b0 2023-12-19T13:55:15.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.196+0000 7f4dba7fc640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4da406a430 0x7f4da406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:15.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.197+0000 7f4dba7fc640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4da406a430 0x7f4da406c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4dc406f340 tx=0x7f4dac007d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:15.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.200+0000 7f4dc0ff9640 1 -- 172.21.15.113:0/663136513 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4db4075ec0 con 0x7f4dc406c6b0 2023-12-19T13:55:15.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:15.458+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f4dc4157670 con 0x7f4dc406c6b0 2023-12-19T13:55:16.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.079+0000 7f4dc0ff9640 1 -- 172.21.15.113:0/663136513 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v450) v1 ==== 135+0+0 (secure 0 0 0) 0x7f4db4031e60 con 0x7f4dc406c6b0 2023-12-19T13:55:16.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4da406a430 msgr2=0x7f4da406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4da406a430 0x7f4da406c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4dc406f340 tx=0x7f4dac007d10 comp rx=0 tx=0).stop 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc406c6b0 msgr2=0x7f4dc413ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc406c6b0 0x7f4dc413ae20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009870 tx=0x7f4db40046c0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 shutdown_connections 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4da406a430 0x7f4da406c8f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dc41449e0 0x7f4dc4070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dc40b0b50 0x7f4dc406fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 --2- 172.21.15.113:0/663136513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4dc406c6b0 0x7f4dc413ae20 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 >> 172.21.15.113:0/663136513 conn(0x7f4dc40cbb70 msgr2=0x7f4dc406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 shutdown_connections 2023-12-19T13:55:16.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.083+0000 7f4dc9896640 1 -- 172.21.15.113:0/663136513 wait complete. 2023-12-19T13:55:16.105 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:55:16.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.328+0000 7f6e6d638640 1 Processor -- start 2023-12-19T13:55:16.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.329+0000 7f6e6d638640 1 -- start start 2023-12-19T13:55:16.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.330+0000 7f6e6d638640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e6815da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e6d638640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6e6815f2f0 0x7f6e6815f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e6d638640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6815ea80 con 0x7f6e680b6430 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e6d638640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e68147540 con 0x7f6e6815f2f0 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e6d638640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6815ee60 con 0x7f6e680b7f20 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e677fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6e6815f2f0 0x7f6e6815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e5ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6e680b6430 0x7f6e680b8300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46276/0 (socket says 172.21.15.113:46276) 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e5ffff640 1 -- 172.21.15.113:0/236078530 learned_addr learned my addr 172.21.15.113:0/236078530 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e66ffd640 1 --2- 172.21.15.113:0/236078530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e6815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e677fe640 1 -- 172.21.15.113:0/236078530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 msgr2=0x7f6e6815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e677fe640 1 --2- 172.21.15.113:0/236078530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e6815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e677fe640 1 -- 172.21.15.113:0/236078530 >> v1:172.21.15.113:6789/0 conn(0x7f6e680b6430 legacy=0x7f6e680b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e677fe640 1 -- 172.21.15.113:0/236078530 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680b22e0 con 0x7f6e6815f2f0 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.331+0000 7f6e667fc640 1 -- 172.21.15.113:0/236078530 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329186533 0 0) 0x7f6e6815ea80 con 0x7f6e680b6430 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.332+0000 7f6e66ffd640 1 --2- 172.21.15.113:0/236078530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e6815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:16.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.333+0000 7f6e677fe640 1 --2- 172.21.15.113:0/236078530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e6815f2f0 0x7f6e6815f780 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009d90 tx=0x7f6e6002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7e2e72583ec6f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.333+0000 7f6e667fc640 1 -- 172.21.15.113:0/236078530 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6002cc60 con 0x7f6e6815f2f0 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.333+0000 7f6e667fc640 1 -- 172.21.15.113:0/236078530 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6002cdc0 con 0x7f6e6815f2f0 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.333+0000 7f6e667fc640 1 -- 172.21.15.113:0/236078530 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60034660 con 0x7f6e6815f2f0 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.333+0000 7f6e6d638640 1 -- 172.21.15.113:0/236078530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e6815f2f0 msgr2=0x7f6e6815f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.333+0000 7f6e6d638640 1 --2- 172.21.15.113:0/236078530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e6815f2f0 0x7f6e6815f780 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009d90 tx=0x7f6e6002beb0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.334+0000 7f6e6d638640 1 -- 172.21.15.113:0/236078530 shutdown_connections 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.334+0000 7f6e6d638640 1 --2- 172.21.15.113:0/236078530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e6815f2f0 0x7f6e6815f780 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.334+0000 7f6e6d638640 1 --2- 172.21.15.113:0/236078530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e6815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.334+0000 7f6e6d638640 1 -- 172.21.15.113:0/236078530 >> 172.21.15.113:0/236078530 conn(0x7f6e680d3520 msgr2=0x7f6e680d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.334+0000 7f6e6d638640 1 -- 172.21.15.113:0/236078530 shutdown_connections 2023-12-19T13:55:16.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.334+0000 7f6e6d638640 1 -- 172.21.15.113:0/236078530 wait complete. 2023-12-19T13:55:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.335+0000 7f6e6d638640 1 Processor -- start 2023-12-19T13:55:16.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.335+0000 7f6e6d638640 1 -- start start 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.336+0000 7f6e6d638640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e680b6430 0x7f6e68140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.336+0000 7f6e6d638640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e680d2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.336+0000 7f6e6d638640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e6815f2f0 0x7f6e680d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.336+0000 7f6e6d638640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6814e8d0 con 0x7f6e680b6430 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.336+0000 7f6e6d638640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6814ebb0 con 0x7f6e6815f2f0 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.336+0000 7f6e6d638640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6814ee90 con 0x7f6e680b7f20 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e680b6430 0x7f6e68140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:16.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e680b6430 0x7f6e68140eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48988/0 (socket says 172.21.15.113:48988) 2023-12-19T13:55:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 -- 172.21.15.113:0/4130753350 learned_addr learned my addr 172.21.15.113:0/4130753350 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e5ffff640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e680d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 -- 172.21.15.113:0/4130753350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 msgr2=0x7f6e680d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e680d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 -- 172.21.15.113:0/4130753350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e6815f2f0 msgr2=0x7f6e680d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.338 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e6815f2f0 0x7f6e680d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 -- 172.21.15.113:0/4130753350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009a70 con 0x7f6e680b6430 2023-12-19T13:55:16.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.337+0000 7f6e66ffd640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e680b6430 0x7f6e68140eb0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800c7f0 tx=0x7f6e5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:16.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.338+0000 7f6e5f7fe640 1 -- 172.21.15.113:0/4130753350 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58007a30 con 0x7f6e680b6430 2023-12-19T13:55:16.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.338+0000 7f6e5f7fe640 1 -- 172.21.15.113:0/4130753350 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58007b90 con 0x7f6e680b6430 2023-12-19T13:55:16.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.338+0000 7f6e5f7fe640 1 -- 172.21.15.113:0/4130753350 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800ce40 con 0x7f6e680b6430 2023-12-19T13:55:16.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.338+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6814f170 con 0x7f6e680b6430 2023-12-19T13:55:16.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.338+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e681413f0 con 0x7f6e680b6430 2023-12-19T13:55:16.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.339+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e680ccd70 con 0x7f6e680b6430 2023-12-19T13:55:16.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.340+0000 7f6e5f7fe640 1 -- 172.21.15.113:0/4130753350 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e580113f0 con 0x7f6e680b6430 2023-12-19T13:55:16.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.341+0000 7f6e5f7fe640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e4806a430 0x7f6e4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:16.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.341+0000 7f6e5f7fe640 1 -- 172.21.15.113:0/4130753350 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6e58088780 con 0x7f6e680b6430 2023-12-19T13:55:16.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.341+0000 7f6e5ffff640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e4806a430 0x7f6e4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:16.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.342+0000 7f6e5ffff640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e4806a430 0x7f6e4806c8f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6e680cf470 tx=0x7f6e50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:16.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.345+0000 7f6e5f7fe640 1 -- 172.21.15.113:0/4130753350 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6e58054100 con 0x7f6e680b6430 2023-12-19T13:55:16.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.536+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6e68061910 con 0x7f6e680b6430 2023-12-19T13:55:16.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.542+0000 7f6e5f7fe640 1 -- 172.21.15.113:0/4130753350 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e58057720 con 0x7f6e680b6430 2023-12-19T13:55:16.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e4806a430 msgr2=0x7f6e4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e4806a430 0x7f6e4806c8f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6e680cf470 tx=0x7f6e50009040 comp rx=0 tx=0).stop 2023-12-19T13:55:16.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e680b6430 msgr2=0x7f6e68140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:16.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e680b6430 0x7f6e68140eb0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800c7f0 tx=0x7f6e5800cbf0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 shutdown_connections 2023-12-19T13:55:16.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6e4806a430 0x7f6e4806c8f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e6815f2f0 0x7f6e680d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e680b7f20 0x7f6e680d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 --2- 172.21.15.113:0/4130753350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6e680b6430 0x7f6e68140eb0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:16.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.545+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 >> 172.21.15.113:0/4130753350 conn(0x7f6e680d3520 msgr2=0x7f6e680b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:16.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.546+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 shutdown_connections 2023-12-19T13:55:16.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:16.546+0000 7f6e6d638640 1 -- 172.21.15.113:0/4130753350 wait complete. 2023-12-19T13:55:16.565 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:55:16.565 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:55:16.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:55:16.809 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:55:16.809 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:55:16.809 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:16.871 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:55:16.871 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:55:16.871 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:16.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:55:16.931 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:55:16.931 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:16.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:55:16.991 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:55:16.991 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:17.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:55:17.050 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:55:17.050 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:17.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.269+0000 7fd1e0d58640 1 Processor -- start 2023-12-19T13:55:17.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.269+0000 7fd1e0d58640 1 -- start start 2023-12-19T13:55:17.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.270+0000 7fd1e0d58640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd1dc1449e0 0x7fd1dc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1e0d58640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1dc06c6b0 0x7fd1dc0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1e0d58640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0afb10 con 0x7fd1dc0b0b50 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1e0d58640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc06bb30 con 0x7fd1dc06c6b0 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1e0d58640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b0070 con 0x7fd1dc1449e0 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1dad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1dc06c6b0 0x7fd1dc0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1dad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1dc06c6b0 0x7fd1dc0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48990/0 (socket says 172.21.15.113:48990) 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2686911108 learned_addr learned my addr 172.21.15.113:0/2686911108 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1da59c640 1 --2- 172.21.15.113:0/2686911108 >> v2:172.21.15.151:3300/0 conn(0x7fd1dc1449e0 0x7fd1dc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2686911108 >> v2:172.21.15.151:3300/0 conn(0x7fd1dc1449e0 msgr2=0x7fd1dc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:17.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1dad9d640 1 --2- 172.21.15.113:0/2686911108 >> v2:172.21.15.151:3300/0 conn(0x7fd1dc1449e0 0x7fd1dc0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2686911108 >> v1:172.21.15.151:6789/0 conn(0x7fd1dc0b0b50 legacy=0x7fd1dc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:17.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.271+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2686911108 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0b0350 con 0x7fd1dc06c6b0 2023-12-19T13:55:17.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.273+0000 7fd1dad9d640 1 --2- 172.21.15.113:0/2686911108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc0b1710 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc071cd0 tx=0x7fd1d402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec7ab77d279d02a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:17.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.273+0000 7fd1d959a640 1 -- 172.21.15.113:0/2686911108 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d402ca80 con 0x7fd1dc06c6b0 2023-12-19T13:55:17.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.273+0000 7fd1d959a640 1 -- 172.21.15.113:0/2686911108 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d402cbe0 con 0x7fd1dc06c6b0 2023-12-19T13:55:17.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.273+0000 7fd1d959a640 1 -- 172.21.15.113:0/2686911108 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40343f0 con 0x7fd1dc06c6b0 2023-12-19T13:55:17.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2686911108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc06c6b0 msgr2=0x7fd1dc0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2686911108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc0b1710 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc071cd0 tx=0x7fd1d402bee0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2686911108 shutdown_connections 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2686911108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc0b1710 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2686911108 >> v2:172.21.15.151:3300/0 conn(0x7fd1dc1449e0 0x7fd1dc0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2686911108 >> 172.21.15.113:0/2686911108 conn(0x7fd1dc0cbb70 msgr2=0x7fd1dc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2686911108 shutdown_connections 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.274+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2686911108 wait complete. 2023-12-19T13:55:17.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.275+0000 7fd1e0d58640 1 Processor -- start 2023-12-19T13:55:17.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.276+0000 7fd1e0d58640 1 -- start start 2023-12-19T13:55:17.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1e0d58640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1e0d58640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1dc0b0b50 0x7fd1dc06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1e0d58640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc1449e0 0x7fd1dc06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1e0d58640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc15d8f0 con 0x7fd1dc1449e0 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1e0d58640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0ae3c0 con 0x7fd1dc06c6b0 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1e0d58640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0ccd90 con 0x7fd1dc0b0b50 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc1449e0 0x7fd1dc06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc1449e0 0x7fd1dc06fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49006/0 (socket says 172.21.15.113:49006) 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2836377166 learned_addr learned my addr 172.21.15.113:0/2836377166 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1da59c640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1dc0b0b50 msgr2=0x7fd1dc06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1d9d9b640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1dc0b0b50 0x7fd1dc06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1dc0b0b50 0x7fd1dc06f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1dc06c6b0 msgr2=0x7fd1dc15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1dad9d640 1 -- 172.21.15.113:0/2836377166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4009b30 con 0x7fd1dc1449e0 2023-12-19T13:55:17.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1da59c640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:17.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.277+0000 7fd1d9d9b640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1dc0b0b50 0x7fd1dc06f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:17.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.278+0000 7fd1dad9d640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc1449e0 0x7fd1dc06fef0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4036040 tx=0x7fd1d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:17.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.278+0000 7fd1caffd640 1 -- 172.21.15.113:0/2836377166 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4009510 con 0x7fd1dc1449e0 2023-12-19T13:55:17.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.278+0000 7fd1caffd640 1 -- 172.21.15.113:0/2836377166 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d403e450 con 0x7fd1dc1449e0 2023-12-19T13:55:17.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.278+0000 7fd1caffd640 1 -- 172.21.15.113:0/2836377166 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d403e820 con 0x7fd1dc1449e0 2023-12-19T13:55:17.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.278+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc0cd030 con 0x7fd1dc1449e0 2023-12-19T13:55:17.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.278+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc0cd5f0 con 0x7fd1dc1449e0 2023-12-19T13:55:17.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.279+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc061910 con 0x7fd1dc1449e0 2023-12-19T13:55:17.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.280+0000 7fd1caffd640 1 -- 172.21.15.113:0/2836377166 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1d402cd50 con 0x7fd1dc1449e0 2023-12-19T13:55:17.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.281+0000 7fd1caffd640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd1bc06a430 0x7fd1bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.281+0000 7fd1caffd640 1 -- 172.21.15.113:0/2836377166 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1d40ab4d0 con 0x7fd1dc1449e0 2023-12-19T13:55:17.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.281+0000 7fd1da59c640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd1bc06a430 0x7fd1bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.282+0000 7fd1da59c640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd1bc06a430 0x7fd1bc06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc006fd0 tx=0x7fd1cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:17.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.285+0000 7fd1caffd640 1 -- 172.21.15.113:0/2836377166 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1d4076e40 con 0x7fd1dc1449e0 2023-12-19T13:55:17.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.510+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1dc0b2260 con 0x7fd1dc1449e0 2023-12-19T13:55:17.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.512+0000 7fd1caffd640 1 -- 172.21.15.113:0/2836377166 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fd1d4043de0 con 0x7fd1dc1449e0 2023-12-19T13:55:17.511 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:17.511 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/402746213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":402746213},{"type":"v1","addr":"172.21.15.151:6833","nonce":402746213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5842,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3485271781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3485271781},{"type":"v1","addr":"172.21.15.151:6835","nonce":3485271781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7800,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/789562483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":789562483},{"type":"v1","addr":"172.21.15.113:6836","nonce":789562483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/325569021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":325569021},{"type":"v1","addr":"172.21.15.113:6837","nonce":325569021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[]} 2023-12-19T13:55:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 67 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd1bc06a430 msgr2=0x7fd1bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd1bc06a430 0x7fd1bc06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc006fd0 tx=0x7fd1cc008040 comp rx=0 tx=0).stop 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc1449e0 msgr2=0x7fd1dc06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc1449e0 0x7fd1dc06fef0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4036040 tx=0x7fd1d4004a40 comp rx=0 tx=0).stop 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 shutdown_connections 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd1bc06a430 0x7fd1bc06c8f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1dc1449e0 0x7fd1dc06fef0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1dc0b0b50 0x7fd1dc06f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 --2- 172.21.15.113:0/2836377166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1dc06c6b0 0x7fd1dc15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 >> 172.21.15.113:0/2836377166 conn(0x7fd1dc0cbb70 msgr2=0x7fd1dc13e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 shutdown_connections 2023-12-19T13:55:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.514+0000 7fd1e0d58640 1 -- 172.21.15.113:0/2836377166 wait complete. 2023-12-19T13:55:17.534 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:55:17.534 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:55:17.535 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:55:17.535 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:55:17.535 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:55:17.535 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:55:17.535 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:55:17.535 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:55:17.535 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:55:17.536 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:55:17.536 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:55:17.536 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:55:17.536 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:55:17.536 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:55:17.536 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:55:17.536 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:55:17.551 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:55:17.551 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:55:17.552 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:55:17.552 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:55:17.557 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:55:17.557 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:55:17.558 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:55:17.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:55:17.600 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:55:17.600 DEBUG:teuthology.parallel:result is None 2023-12-19T13:55:17.607 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:55:17.607 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:55:17.608 DEBUG:teuthology.parallel:result is None 2023-12-19T13:55:17.608 DEBUG:teuthology.parallel:result is None 2023-12-19T13:55:17.615 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:55:17.615 DEBUG:teuthology.parallel:result is None 2023-12-19T13:55:17.615 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:55:17.757 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:55:17.757 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:55:17.770 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:55:17.782 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:55:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.803+0000 7ff1832e6640 1 Processor -- start 2023-12-19T13:55:17.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.804+0000 7ff1832e6640 1 -- start start 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1832e6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff17c146c40 0x7ff17c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1832e6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff17c0b7360 0x7ff17c0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1832e6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c0b7d00 con 0x7ff17c160ee0 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1832e6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c0700c0 con 0x7ff17c146c40 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1832e6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c06f160 con 0x7ff17c0b7360 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1822e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff17c146c40 0x7ff17c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1822e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff17c146c40 0x7ff17c070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49036/0 (socket says 172.21.15.113:49036) 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff1822e4640 1 -- 172.21.15.113:0/4127838989 learned_addr learned my addr 172.21.15.113:0/4127838989 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.805+0000 7ff181ae3640 1 --2- 172.21.15.113:0/4127838989 >> v2:172.21.15.151:3300/0 conn(0x7ff17c0b7360 0x7ff17c0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.806+0000 7ff1822e4640 1 -- 172.21.15.113:0/4127838989 >> v2:172.21.15.151:3300/0 conn(0x7ff17c0b7360 msgr2=0x7ff17c0b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:17.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.806+0000 7ff1822e4640 1 --2- 172.21.15.113:0/4127838989 >> v2:172.21.15.151:3300/0 conn(0x7ff17c0b7360 0x7ff17c0b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.806+0000 7ff1822e4640 1 -- 172.21.15.113:0/4127838989 >> v1:172.21.15.151:6789/0 conn(0x7ff17c160ee0 legacy=0x7ff17c161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.806+0000 7ff1822e4640 1 -- 172.21.15.113:0/4127838989 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c06f440 con 0x7ff17c146c40 2023-12-19T13:55:17.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.806+0000 7ff181ae3640 1 --2- 172.21.15.113:0/4127838989 >> v2:172.21.15.151:3300/0 conn(0x7ff17c0b7360 0x7ff17c0b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:55:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.807+0000 7ff1822e4640 1 --2- 172.21.15.113:0/4127838989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c070e70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7ff17c066910 tx=0x7ff17802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202d17435ff0a6ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.807+0000 7ff1812e2640 1 -- 172.21.15.113:0/4127838989 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178030870 con 0x7ff17c146c40 2023-12-19T13:55:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.807+0000 7ff1812e2640 1 -- 172.21.15.113:0/4127838989 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780309d0 con 0x7ff17c146c40 2023-12-19T13:55:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.807+0000 7ff1812e2640 1 -- 172.21.15.113:0/4127838989 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178030d60 con 0x7ff17c146c40 2023-12-19T13:55:17.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.807+0000 7ff1832e6640 1 -- 172.21.15.113:0/4127838989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 msgr2=0x7ff17c070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.807+0000 7ff1832e6640 1 --2- 172.21.15.113:0/4127838989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c070e70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7ff17c066910 tx=0x7ff17802b9b0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.808+0000 7ff1832e6640 1 -- 172.21.15.113:0/4127838989 shutdown_connections 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.808+0000 7ff1832e6640 1 --2- 172.21.15.113:0/4127838989 >> v2:172.21.15.151:3300/0 conn(0x7ff17c0b7360 0x7ff17c0b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.808+0000 7ff1832e6640 1 --2- 172.21.15.113:0/4127838989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c070e70 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.808+0000 7ff1832e6640 1 -- 172.21.15.113:0/4127838989 >> 172.21.15.113:0/4127838989 conn(0x7ff17c0d31b0 msgr2=0x7ff17c0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.808+0000 7ff1832e6640 1 -- 172.21.15.113:0/4127838989 shutdown_connections 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.808+0000 7ff1832e6640 1 -- 172.21.15.113:0/4127838989 wait complete. 2023-12-19T13:55:17.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.809+0000 7ff1832e6640 1 Processor -- start 2023-12-19T13:55:17.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.809+0000 7ff1832e6640 1 -- start start 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.810+0000 7ff1832e6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff17c0b7360 0x7ff17c15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.810+0000 7ff1832e6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.810+0000 7ff1832e6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff17c160ee0 0x7ff17c0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.810+0000 7ff1832e6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c06bce0 con 0x7ff17c146c40 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.810+0000 7ff1832e6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c15d010 con 0x7ff17c160ee0 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.810+0000 7ff1832e6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c06ba00 con 0x7ff17c0b7360 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c0c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49042/0 (socket says 172.21.15.113:49042) 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 -- 172.21.15.113:0/397931634 learned_addr learned my addr 172.21.15.113:0/397931634 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff1822e4640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff17c0b7360 0x7ff17c15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff182ae5640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff17c160ee0 0x7ff17c0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 -- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff17c0b7360 msgr2=0x7ff17c15cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff17c0b7360 0x7ff17c15cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 -- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff17c160ee0 msgr2=0x7ff17c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff17c160ee0 0x7ff17c0c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 -- 172.21.15.113:0/397931634 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780094d0 con 0x7ff17c146c40 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.811+0000 7ff181ae3640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c0c8ad0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00e7e0 tx=0x7ff16c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.812+0000 7ff172ffd640 1 -- 172.21.15.113:0/397931634 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c004030 con 0x7ff17c146c40 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.812+0000 7ff172ffd640 1 -- 172.21.15.113:0/397931634 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c004190 con 0x7ff17c146c40 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.812+0000 7ff172ffd640 1 -- 172.21.15.113:0/397931634 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c004520 con 0x7ff17c146c40 2023-12-19T13:55:17.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.812+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c06c6b0 con 0x7ff17c146c40 2023-12-19T13:55:17.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.812+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c06cc70 con 0x7ff17c146c40 2023-12-19T13:55:17.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.813+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c06c510 con 0x7ff17c146c40 2023-12-19T13:55:17.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.814+0000 7ff172ffd640 1 -- 172.21.15.113:0/397931634 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff16c00c6d0 con 0x7ff17c146c40 2023-12-19T13:55:17.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.815+0000 7ff172ffd640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16006a430 0x7ff16006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:17.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.815+0000 7ff172ffd640 1 -- 172.21.15.113:0/397931634 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff16c088280 con 0x7ff17c146c40 2023-12-19T13:55:17.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.816+0000 7ff1822e4640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16006a430 0x7ff16006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:17.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.816+0000 7ff1822e4640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16006a430 0x7ff16006c8f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff178036000 tx=0x7ff178008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:17.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:17.819+0000 7ff172ffd640 1 -- 172.21.15.113:0/397931634 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff17c06c510 con 0x7ff17c146c40 2023-12-19T13:55:18.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.021+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff17c06c510 con 0x7ff17c146c40 2023-12-19T13:55:18.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.805+0000 7ff172ffd640 1 -- 172.21.15.113:0/397931634 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v159) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff17c06c510 con 0x7ff17c146c40 2023-12-19T13:55:18.805 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16006a430 msgr2=0x7ff16006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16006a430 0x7ff16006c8f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff178036000 tx=0x7ff178008030 comp rx=0 tx=0).stop 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 msgr2=0x7ff17c0c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c0c8ad0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00e7e0 tx=0x7ff16c00eca0 comp rx=0 tx=0).stop 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 shutdown_connections 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff16006a430 0x7ff16006c8f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff17c160ee0 0x7ff17c0c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff17c146c40 0x7ff17c0c8ad0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 --2- 172.21.15.113:0/397931634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff17c0b7360 0x7ff17c15cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.809+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 >> 172.21.15.113:0/397931634 conn(0x7ff17c0d31b0 msgr2=0x7ff17c1444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.810+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 shutdown_connections 2023-12-19T13:55:18.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:18.810+0000 7ff1832e6640 1 -- 172.21.15.113:0/397931634 wait complete. 2023-12-19T13:55:18.830 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:55:19.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.034+0000 7f67069dc640 1 Processor -- start 2023-12-19T13:55:19.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.035+0000 7f67069dc640 1 -- start start 2023-12-19T13:55:19.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.036+0000 7f67069dc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6700146e10 0x7f67000d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.036+0000 7f67069dc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67000ce110 0x7f67000ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.036+0000 7f67069dc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67000cd840 con 0x7f67000d2b00 2023-12-19T13:55:19.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.036+0000 7f67069dc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67000d2430 con 0x7f67000ce110 2023-12-19T13:55:19.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.036+0000 7f67069dc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67000ceae0 con 0x7f6700146e10 2023-12-19T13:55:19.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.037+0000 7f6704f79640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67000ce110 0x7f67000ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:19.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.037+0000 7f66fffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6700146e10 0x7f67000d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:19.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.037+0000 7f6704f79640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67000ce110 0x7f67000ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:57912/0 (socket says 172.21.15.113:57912) 2023-12-19T13:55:19.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.037+0000 7f6704f79640 1 -- 172.21.15.113:0/1915852151 learned_addr learned my addr 172.21.15.113:0/1915852151 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:19.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.038+0000 7f66fffff640 1 -- 172.21.15.113:0/1915852151 >> v2:172.21.15.151:3300/0 conn(0x7f67000ce110 msgr2=0x7f67000ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:19.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.038+0000 7f66fffff640 1 --2- 172.21.15.113:0/1915852151 >> v2:172.21.15.151:3300/0 conn(0x7f67000ce110 0x7f67000ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.038+0000 7f66fffff640 1 -- 172.21.15.113:0/1915852151 >> v1:172.21.15.151:6789/0 conn(0x7f67000d2b00 legacy=0x7f67000b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.038+0000 7f66fffff640 1 -- 172.21.15.113:0/1915852151 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000b6e90 con 0x7f6700146e10 2023-12-19T13:55:19.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.038+0000 7f6704f79640 1 --2- 172.21.15.113:0/1915852151 >> v2:172.21.15.151:3300/0 conn(0x7f67000ce110 0x7f67000ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:55:19.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.040+0000 7f66fffff640 1 --2- 172.21.15.113:0/1915852151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6700146e10 0x7f67000d1ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23b6fd2576700546 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.040+0000 7f66ff7fe640 1 -- 172.21.15.113:0/1915852151 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f002cc50 con 0x7f6700146e10 2023-12-19T13:55:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.040+0000 7f66ff7fe640 1 -- 172.21.15.113:0/1915852151 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f002cdb0 con 0x7f6700146e10 2023-12-19T13:55:19.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.040+0000 7f66ff7fe640 1 -- 172.21.15.113:0/1915852151 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0034660 con 0x7f6700146e10 2023-12-19T13:55:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 -- 172.21.15.113:0/1915852151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6700146e10 msgr2=0x7f67000d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 --2- 172.21.15.113:0/1915852151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6700146e10 0x7f67000d1ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f002bea0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 -- 172.21.15.113:0/1915852151 shutdown_connections 2023-12-19T13:55:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 --2- 172.21.15.113:0/1915852151 >> v2:172.21.15.151:3300/0 conn(0x7f67000ce110 0x7f67000ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 --2- 172.21.15.113:0/1915852151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6700146e10 0x7f67000d1ef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 -- 172.21.15.113:0/1915852151 >> 172.21.15.113:0/1915852151 conn(0x7f67000b29c0 msgr2=0x7f67000b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 -- 172.21.15.113:0/1915852151 shutdown_connections 2023-12-19T13:55:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.041+0000 7f67069dc640 1 -- 172.21.15.113:0/1915852151 wait complete. 2023-12-19T13:55:19.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.043+0000 7f67069dc640 1 Processor -- start 2023-12-19T13:55:19.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.043+0000 7f67069dc640 1 -- start start 2023-12-19T13:55:19.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f67069dc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67000ce110 0x7f6700159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f67069dc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67000d2b00 0x7f6700161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f67069dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6700146e10 0x7f6700144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f67069dc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700159ac0 con 0x7f67000ce110 2023-12-19T13:55:19.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f67069dc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670015dc10 con 0x7f6700146e10 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f67069dc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670015def0 con 0x7f67000d2b00 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67000ce110 0x7f6700159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67000ce110 0x7f6700159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45916/0 (socket says 172.21.15.113:45916) 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 -- 172.21.15.113:0/3270067643 learned_addr learned my addr 172.21.15.113:0/3270067643 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 -- 172.21.15.113:0/3270067643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67000d2b00 msgr2=0x7f6700161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67000d2b00 0x7f6700161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 -- 172.21.15.113:0/3270067643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6700146e10 msgr2=0x7f6700144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6700146e10 0x7f6700144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.045+0000 7f66fffff640 1 -- 172.21.15.113:0/3270067643 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80094d0 con 0x7f67000ce110 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.046+0000 7f66fffff640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67000ce110 0x7f6700159580 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009eb0 tx=0x7f66f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.046+0000 7f66fd7fa640 1 -- 172.21.15.113:0/3270067643 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f003e610 con 0x7f67000ce110 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.046+0000 7f66fd7fa640 1 -- 172.21.15.113:0/3270067643 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f003e770 con 0x7f67000ce110 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.046+0000 7f66fd7fa640 1 -- 172.21.15.113:0/3270067643 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f003eb20 con 0x7f67000ce110 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.046+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0009a70 con 0x7f67000ce110 2023-12-19T13:55:19.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.046+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670015e4b0 con 0x7f67000ce110 2023-12-19T13:55:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.047+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6700061910 con 0x7f67000ce110 2023-12-19T13:55:19.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.048+0000 7f66fd7fa640 1 -- 172.21.15.113:0/3270067643 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f66f003b050 con 0x7f67000ce110 2023-12-19T13:55:19.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.049+0000 7f66fd7fa640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66e006a460 0x7f66e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.049+0000 7f66fd7fa640 1 -- 172.21.15.113:0/3270067643 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66f00aac90 con 0x7f67000ce110 2023-12-19T13:55:19.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.049+0000 7f66f77fe640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66e006a460 0x7f66e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:19.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.050+0000 7f66f77fe640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66e006a460 0x7f66e006c920 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000f60 tx=0x7f66e80079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:19.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.054+0000 7f66fd7fa640 1 -- 172.21.15.113:0/3270067643 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f66f00765c0 con 0x7f67000ce110 2023-12-19T13:55:19.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.312+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f67000b3180 con 0x7f67000ce110 2023-12-19T13:55:19.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.313+0000 7f66fd7fa640 1 -- 172.21.15.113:0/3270067643 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f66f0009450 con 0x7f67000ce110 2023-12-19T13:55:19.312 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.313 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.314 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:55:19.315 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:55:19.316 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.317 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.318 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.319 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:55:19.320 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:55:19.321 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:55:19.322 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:55:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.324 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:55:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:55:19.326 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.326 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:19.326 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:55:19.326 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:55:19.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66e006a460 msgr2=0x7f66e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66e006a460 0x7f66e006c920 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000f60 tx=0x7f66e80079d0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67000ce110 msgr2=0x7f6700159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67000ce110 0x7f6700159580 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009eb0 tx=0x7f66f0004a40 comp rx=0 tx=0).stop 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 shutdown_connections 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f66e006a460 0x7f66e006c920 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6700146e10 0x7f6700144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67000d2b00 0x7f6700161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 --2- 172.21.15.113:0/3270067643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67000ce110 0x7f6700159580 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 >> 172.21.15.113:0/3270067643 conn(0x7f67000b29c0 msgr2=0x7f67000b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 shutdown_connections 2023-12-19T13:55:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.316+0000 7f67069dc640 1 -- 172.21.15.113:0/3270067643 wait complete. 2023-12-19T13:55:19.334 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:19.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.547+0000 7f69d74d7640 1 Processor -- start 2023-12-19T13:55:19.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.547+0000 7f69d74d7640 1 -- start start 2023-12-19T13:55:19.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.549+0000 7f69d74d7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f69d015da00 0x7f69d00b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.549+0000 7f69d74d7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d00b4120 con 0x7f69d00cf670 2023-12-19T13:55:19.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.549+0000 7f69d74d7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d00b5b80 con 0x7f69d015d620 2023-12-19T13:55:19.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.549+0000 7f69d74d7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d00b6ee0 con 0x7f69d015da00 2023-12-19T13:55:19.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.549+0000 7f69d6cd6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f69d015da00 0x7f69d00b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:19.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.549+0000 7f69d5cd4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f69d00cf670 0x7f69d00b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43608/0 (socket says 172.21.15.113:43608) 2023-12-19T13:55:19.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.549+0000 7f69d5cd4640 1 -- 172.21.15.113:0/1707146651 learned_addr learned my addr 172.21.15.113:0/1707146651 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:19.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.550+0000 7f69d6cd6640 1 -- 172.21.15.113:0/1707146651 >> v1:172.21.15.151:6789/0 conn(0x7f69d015d620 legacy=0x7f69d00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:19.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.550+0000 7f69d6cd6640 1 -- 172.21.15.113:0/1707146651 >> v1:172.21.15.113:6789/0 conn(0x7f69d00cf670 legacy=0x7f69d00b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.550+0000 7f69d6cd6640 1 -- 172.21.15.113:0/1707146651 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d00b71c0 con 0x7f69d015da00 2023-12-19T13:55:19.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.550+0000 7f69d54d3640 1 -- 172.21.15.113:0/1707146651 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575190400 0 0) 0x7f69d00b4120 con 0x7f69d00cf670 2023-12-19T13:55:19.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.551+0000 7f69d6cd6640 1 --2- 172.21.15.113:0/1707146651 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d015da00 0x7f69d00b6870 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097a0 tx=0x7f69c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa75f2ba41516c75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:19.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.551+0000 7f69d54d3640 1 -- 172.21.15.113:0/1707146651 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8031830 con 0x7f69d015da00 2023-12-19T13:55:19.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.551+0000 7f69d54d3640 1 -- 172.21.15.113:0/1707146651 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c8031990 con 0x7f69d015da00 2023-12-19T13:55:19.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.551+0000 7f69d54d3640 1 -- 172.21.15.113:0/1707146651 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8031d20 con 0x7f69d015da00 2023-12-19T13:55:19.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.552+0000 7f69d74d7640 1 -- 172.21.15.113:0/1707146651 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d015da00 msgr2=0x7f69d00b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.552+0000 7f69d74d7640 1 --2- 172.21.15.113:0/1707146651 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d015da00 0x7f69d00b6870 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097a0 tx=0x7f69c802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.552+0000 7f69d74d7640 1 -- 172.21.15.113:0/1707146651 shutdown_connections 2023-12-19T13:55:19.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.552+0000 7f69d74d7640 1 --2- 172.21.15.113:0/1707146651 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d015da00 0x7f69d00b6870 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.552+0000 7f69d74d7640 1 -- 172.21.15.113:0/1707146651 >> 172.21.15.113:0/1707146651 conn(0x7f69d00cfb90 msgr2=0x7f69d00cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:19.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.552+0000 7f69d74d7640 1 -- 172.21.15.113:0/1707146651 shutdown_connections 2023-12-19T13:55:19.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.552+0000 7f69d74d7640 1 -- 172.21.15.113:0/1707146651 wait complete. 2023-12-19T13:55:19.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.554+0000 7f69d74d7640 1 Processor -- start 2023-12-19T13:55:19.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.554+0000 7f69d74d7640 1 -- start start 2023-12-19T13:55:19.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d74d7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d00cf670 0x7f69d0159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d74d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69d015d620 0x7f69d0070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d74d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69d015da00 0x7f69d0070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d74d7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0159320 con 0x7f69d00cf670 2023-12-19T13:55:19.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d74d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01586a0 con 0x7f69d015da00 2023-12-19T13:55:19.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d74d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0158980 con 0x7f69d015d620 2023-12-19T13:55:19.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d64d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d00cf670 0x7f69d0159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:19.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d64d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d00cf670 0x7f69d0159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45936/0 (socket says 172.21.15.113:45936) 2023-12-19T13:55:19.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.555+0000 7f69d64d5640 1 -- 172.21.15.113:0/3665698162 learned_addr learned my addr 172.21.15.113:0/3665698162 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69d64d5640 1 -- 172.21.15.113:0/3665698162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69d015d620 msgr2=0x7f69d0070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69d64d5640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69d015d620 0x7f69d0070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69d64d5640 1 -- 172.21.15.113:0/3665698162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69d015da00 msgr2=0x7f69d0070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69d64d5640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69d015da00 0x7f69d0070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69d64d5640 1 -- 172.21.15.113:0/3665698162 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c8009400 con 0x7f69d00cf670 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69d64d5640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d00cf670 0x7f69d0159740 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f69c000c7c0 tx=0x7f69c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69ceffd640 1 -- 172.21.15.113:0/3665698162 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c000aa50 con 0x7f69d00cf670 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69ceffd640 1 -- 172.21.15.113:0/3665698162 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c000abb0 con 0x7f69d00cf670 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69ceffd640 1 -- 172.21.15.113:0/3665698162 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0012420 con 0x7f69d00cf670 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.556+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d0158c60 con 0x7f69d00cf670 2023-12-19T13:55:19.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.557+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d014a130 con 0x7f69d00cf670 2023-12-19T13:55:19.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.558+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d0061910 con 0x7f69d00cf670 2023-12-19T13:55:19.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.558+0000 7f69ceffd640 1 -- 172.21.15.113:0/3665698162 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f69c0012580 con 0x7f69d00cf670 2023-12-19T13:55:19.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.559+0000 7f69ceffd640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69bc06a430 0x7f69bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:19.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.559+0000 7f69ceffd640 1 -- 172.21.15.113:0/3665698162 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69c0088820 con 0x7f69d00cf670 2023-12-19T13:55:19.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.559+0000 7f69d5cd4640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69bc06a430 0x7f69bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:19.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.560+0000 7f69d5cd4640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69bc06a430 0x7f69bc06c8f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f69c4007fd0 tx=0x7f69c4007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:19.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.563+0000 7f69ceffd640 1 -- 172.21.15.113:0/3665698162 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f69c0054160 con 0x7f69d00cf670 2023-12-19T13:55:19.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.757+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69d0150520 con 0x7f69d00cf670 2023-12-19T13:55:19.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.758+0000 7f69ceffd640 1 -- 172.21.15.113:0/3665698162 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+12448 (secure 0 0 0) 0x7f69c0016090 con 0x7f69d00cf670 2023-12-19T13:55:19.757 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:19.757 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":159,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:18.798268+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.760+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69bc06a430 msgr2=0x7f69bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.760+0000 7f69d74d7640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69bc06a430 0x7f69bc06c8f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f69c4007fd0 tx=0x7f69c4007920 comp rx=0 tx=0).stop 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.760+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d00cf670 msgr2=0x7f69d0159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.760+0000 7f69d74d7640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d00cf670 0x7f69d0159740 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f69c000c7c0 tx=0x7f69c000cc80 comp rx=0 tx=0).stop 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 shutdown_connections 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f69bc06a430 0x7f69bc06c8f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69d015da00 0x7f69d0070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69d015d620 0x7f69d0070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 --2- 172.21.15.113:0/3665698162 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69d00cf670 0x7f69d0159740 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 >> 172.21.15.113:0/3665698162 conn(0x7f69d00cfb90 msgr2=0x7f69d00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 shutdown_connections 2023-12-19T13:55:19.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.761+0000 7f69d74d7640 1 -- 172.21.15.113:0/3665698162 wait complete. 2023-12-19T13:55:19.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:55:19.779 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:55:19.780 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:19.788 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:19.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.970+0000 7f57dea51640 1 Processor -- start 2023-12-19T13:55:20.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.970+0000 7f57dea51640 1 -- start start 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dea51640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d815b290 0x7f57d80b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dea51640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f57d80b0070 0x7f57d80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dea51640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d80ccbd0 con 0x7f57d8154760 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dea51640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d80ccf20 con 0x7f57d80b0070 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dea51640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80b0a30 con 0x7f57d815b290 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dcfee640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f57d80b0070 0x7f57d80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dcfee640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f57d80b0070 0x7f57d80b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45942/0 (socket says 172.21.15.113:45942) 2023-12-19T13:55:20.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.972+0000 7f57dcfee640 1 -- 172.21.15.113:0/1063848574 learned_addr learned my addr 172.21.15.113:0/1063848574 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.973+0000 7f57dcfee640 1 -- 172.21.15.113:0/1063848574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d815b290 msgr2=0x7f57d80b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.973+0000 7f57cffff640 1 --2- 172.21.15.113:0/1063848574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d815b290 0x7f57d80b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.973+0000 7f57dcfee640 1 --2- 172.21.15.113:0/1063848574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d815b290 0x7f57d80b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.973+0000 7f57dcfee640 1 -- 172.21.15.113:0/1063848574 >> v1:172.21.15.151:6789/0 conn(0x7f57d8154760 legacy=0x7f57d80cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.973+0000 7f57dcfee640 1 -- 172.21.15.113:0/1063848574 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8154b40 con 0x7f57d80b0070 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.974+0000 7f57dcfee640 1 --2- 172.21.15.113:0/1063848574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d80b0070 0x7f57d80b04f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8145cff0333a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.974+0000 7f57d77fe640 1 -- 172.21.15.113:0/1063848574 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d002c9e0 con 0x7f57d80b0070 2023-12-19T13:55:20.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.974+0000 7f57d77fe640 1 -- 172.21.15.113:0/1063848574 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d002cb40 con 0x7f57d80b0070 2023-12-19T13:55:20.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.974+0000 7f57d77fe640 1 -- 172.21.15.113:0/1063848574 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00343f0 con 0x7f57d80b0070 2023-12-19T13:55:20.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 -- 172.21.15.113:0/1063848574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d80b0070 msgr2=0x7f57d80b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 --2- 172.21.15.113:0/1063848574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d80b0070 0x7f57d80b04f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d002be40 comp rx=0 tx=0).stop 2023-12-19T13:55:20.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 -- 172.21.15.113:0/1063848574 shutdown_connections 2023-12-19T13:55:20.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 --2- 172.21.15.113:0/1063848574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d80b0070 0x7f57d80b04f0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 --2- 172.21.15.113:0/1063848574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d815b290 0x7f57d80b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 -- 172.21.15.113:0/1063848574 >> 172.21.15.113:0/1063848574 conn(0x7f57d8073150 msgr2=0x7f57d80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 -- 172.21.15.113:0/1063848574 shutdown_connections 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.975+0000 7f57dea51640 1 -- 172.21.15.113:0/1063848574 wait complete. 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.977+0000 7f57dea51640 1 Processor -- start 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.977+0000 7f57dea51640 1 -- start start 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dea51640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d80b0070 0x7f57d814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dea51640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d8154760 0x7f57d814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dea51640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d815b290 0x7f57d814b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dea51640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d815b9f0 con 0x7f57d815b290 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dea51640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8159770 con 0x7f57d80b0070 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dea51640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8159a50 con 0x7f57d8154760 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dcfee640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d815b290 0x7f57d814b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dcfee640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d815b290 0x7f57d814b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45952/0 (socket says 172.21.15.113:45952) 2023-12-19T13:55:20.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.978+0000 7f57dcfee640 1 -- 172.21.15.113:0/2555326910 learned_addr learned my addr 172.21.15.113:0/2555326910 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:20.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57cffff640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d8154760 0x7f57d814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57dcfee640 1 -- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d8154760 msgr2=0x7f57d814eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57d7fff640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d80b0070 0x7f57d814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57dcfee640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d8154760 0x7f57d814eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57dcfee640 1 -- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d80b0070 msgr2=0x7f57d814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57dcfee640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d80b0070 0x7f57d814e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57dcfee640 1 -- 172.21.15.113:0/2555326910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0009b30 con 0x7f57d815b290 2023-12-19T13:55:20.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57d7fff640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d80b0070 0x7f57d814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:20.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57dcfee640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d815b290 0x7f57d814b450 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57d57fa640 1 -- 172.21.15.113:0/2555326910 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0009510 con 0x7f57d815b290 2023-12-19T13:55:20.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57d57fa640 1 -- 172.21.15.113:0/2555326910 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d003e450 con 0x7f57d815b290 2023-12-19T13:55:20.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57d57fa640 1 -- 172.21.15.113:0/2555326910 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d003e800 con 0x7f57d815b290 2023-12-19T13:55:20.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.979+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d8159d30 con 0x7f57d815b290 2023-12-19T13:55:20.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.980+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d8159200 con 0x7f57d815b290 2023-12-19T13:55:20.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.981+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d815bba0 con 0x7f57d815b290 2023-12-19T13:55:20.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.981+0000 7f57d57fa640 1 -- 172.21.15.113:0/2555326910 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f57d003e960 con 0x7f57d815b290 2023-12-19T13:55:20.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.982+0000 7f57d57fa640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f57b806a430 0x7f57b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.982+0000 7f57d57fa640 1 -- 172.21.15.113:0/2555326910 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f57d00ab470 con 0x7f57d815b290 2023-12-19T13:55:20.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.983+0000 7f57d7fff640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f57b806a430 0x7f57b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.983+0000 7f57d7fff640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f57b806a430 0x7f57b806c8f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f57d8158900 tx=0x7f57c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:19.987+0000 7f57d57fa640 1 -- 172.21.15.113:0/2555326910 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f57d815bba0 con 0x7f57d815b290 2023-12-19T13:55:20.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.167+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57d8061910 con 0x7f57d815b290 2023-12-19T13:55:20.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.168+0000 7f57d57fa640 1 -- 172.21.15.113:0/2555326910 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57d0076dc0 con 0x7f57d815b290 2023-12-19T13:55:20.168 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:55:20.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f57b806a430 msgr2=0x7f57b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f57b806a430 0x7f57b806c8f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f57d8158900 tx=0x7f57c8008040 comp rx=0 tx=0).stop 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d815b290 msgr2=0x7f57d814b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d815b290 0x7f57d814b450 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d0004a40 comp rx=0 tx=0).stop 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 shutdown_connections 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f57b806a430 0x7f57b806c8f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f57d815b290 0x7f57d814b450 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57d8154760 0x7f57d814eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 --2- 172.21.15.113:0/2555326910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d80b0070 0x7f57d814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 >> 172.21.15.113:0/2555326910 conn(0x7f57d8073150 msgr2=0x7f57d80acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 shutdown_connections 2023-12-19T13:55:20.171 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.171+0000 7f57dea51640 1 -- 172.21.15.113:0/2555326910 wait complete. 2023-12-19T13:55:20.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:55:20.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.397+0000 7f496e6db640 1 Processor -- start 2023-12-19T13:55:20.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.397+0000 7f496e6db640 1 -- start start 2023-12-19T13:55:20.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.398+0000 7f496e6db640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4968158df0 0x7f496815c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.398+0000 7f496e6db640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f496806d850 0x7f496806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.398+0000 7f496e6db640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4968070130 con 0x7f496806f160 2023-12-19T13:55:20.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.398+0000 7f496e6db640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496806f610 con 0x7f4968158df0 2023-12-19T13:55:20.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.398+0000 7f496e6db640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496806e170 con 0x7f496806d850 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f4967fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4968158df0 0x7f496815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f4967fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4968158df0 0x7f496815c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45962/0 (socket says 172.21.15.113:45962) 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f4967fff640 1 -- 172.21.15.113:0/3803106873 learned_addr learned my addr 172.21.15.113:0/3803106873 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f496cc78640 1 --2- 172.21.15.113:0/3803106873 >> v2:172.21.15.151:3300/0 conn(0x7f496806d850 0x7f496806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f4967fff640 1 -- 172.21.15.113:0/3803106873 >> v2:172.21.15.151:3300/0 conn(0x7f496806d850 msgr2=0x7f496806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f4967fff640 1 --2- 172.21.15.113:0/3803106873 >> v2:172.21.15.151:3300/0 conn(0x7f496806d850 0x7f496806dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f4967fff640 1 -- 172.21.15.113:0/3803106873 >> v1:172.21.15.151:6789/0 conn(0x7f496806f160 legacy=0x7f49680cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f4967fff640 1 -- 172.21.15.113:0/3803106873 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496806f890 con 0x7f4968158df0 2023-12-19T13:55:20.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.399+0000 7f496cc78640 1 --2- 172.21.15.113:0/3803106873 >> v2:172.21.15.151:3300/0 conn(0x7f496806d850 0x7f496806dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:20.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.400+0000 7f4967fff640 1 --2- 172.21.15.113:0/3803106873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4968158df0 0x7f496815c460 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f49680d00c0 tx=0x7f495802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5418ae2f70460517 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f49677fe640 1 -- 172.21.15.113:0/3803106873 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580317e0 con 0x7f4968158df0 2023-12-19T13:55:20.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f49677fe640 1 -- 172.21.15.113:0/3803106873 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4958031940 con 0x7f4968158df0 2023-12-19T13:55:20.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f49677fe640 1 -- 172.21.15.113:0/3803106873 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958031cd0 con 0x7f4968158df0 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f496e6db640 1 -- 172.21.15.113:0/3803106873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4968158df0 msgr2=0x7f496815c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f496e6db640 1 --2- 172.21.15.113:0/3803106873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4968158df0 0x7f496815c460 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f49680d00c0 tx=0x7f495802b880 comp rx=0 tx=0).stop 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f496e6db640 1 -- 172.21.15.113:0/3803106873 shutdown_connections 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f496e6db640 1 --2- 172.21.15.113:0/3803106873 >> v2:172.21.15.151:3300/0 conn(0x7f496806d850 0x7f496806dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f496e6db640 1 --2- 172.21.15.113:0/3803106873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4968158df0 0x7f496815c460 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.401+0000 7f496e6db640 1 -- 172.21.15.113:0/3803106873 >> 172.21.15.113:0/3803106873 conn(0x7f49680cf0b0 msgr2=0x7f49680cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.402+0000 7f496e6db640 1 -- 172.21.15.113:0/3803106873 shutdown_connections 2023-12-19T13:55:20.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.402+0000 7f496e6db640 1 -- 172.21.15.113:0/3803106873 wait complete. 2023-12-19T13:55:20.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.403+0000 7f496e6db640 1 Processor -- start 2023-12-19T13:55:20.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.403+0000 7f496e6db640 1 -- start start 2023-12-19T13:55:20.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.404+0000 7f496e6db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f496806d850 0x7f4968147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.404+0000 7f496e6db640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f496806f160 0x7f49680af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.404+0000 7f496e6db640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4968158df0 0x7f496815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.404+0000 7f496e6db640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4968155d20 con 0x7f496806d850 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.404+0000 7f496e6db640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4968148130 con 0x7f4968158df0 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.404+0000 7f496e6db640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4968156280 con 0x7f496806f160 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f496806d850 0x7f4968147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f496806d850 0x7f4968147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45974/0 (socket says 172.21.15.113:45974) 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 -- 172.21.15.113:0/151328322 learned_addr learned my addr 172.21.15.113:0/151328322 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 -- 172.21.15.113:0/151328322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f496806f160 msgr2=0x7f49680af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f496806f160 0x7f49680af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 -- 172.21.15.113:0/151328322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4968158df0 msgr2=0x7f496815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4968158df0 0x7f496815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 -- 172.21.15.113:0/151328322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580094d0 con 0x7f496806d850 2023-12-19T13:55:20.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.405+0000 7f4967fff640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f496806d850 0x7f4968147bf0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f495802b8c0 tx=0x7f49580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.406+0000 7f49657fa640 1 -- 172.21.15.113:0/151328322 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580329c0 con 0x7f496806d850 2023-12-19T13:55:20.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.406+0000 7f49657fa640 1 -- 172.21.15.113:0/151328322 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4958032b40 con 0x7f496806d850 2023-12-19T13:55:20.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.406+0000 7f49657fa640 1 -- 172.21.15.113:0/151328322 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580453f0 con 0x7f496806d850 2023-12-19T13:55:20.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.406+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4968156530 con 0x7f496806d850 2023-12-19T13:55:20.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.406+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4968156af0 con 0x7f496806d850 2023-12-19T13:55:20.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.407+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4968074770 con 0x7f496806d850 2023-12-19T13:55:20.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.408+0000 7f49657fa640 1 -- 172.21.15.113:0/151328322 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f495804d3f0 con 0x7f496806d850 2023-12-19T13:55:20.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.408+0000 7f49657fa640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f494806a430 0x7f494806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.409+0000 7f49657fa640 1 -- 172.21.15.113:0/151328322 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f49580aa580 con 0x7f496806d850 2023-12-19T13:55:20.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.409+0000 7f495ffff640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f494806a430 0x7f494806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.409+0000 7f495ffff640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f494806a430 0x7f494806c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f496815e500 tx=0x7f4950007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.413+0000 7f49657fa640 1 -- 172.21.15.113:0/151328322 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4958075ed0 con 0x7f496806d850 2023-12-19T13:55:20.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.605+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4968061910 con 0x7f496806d850 2023-12-19T13:55:20.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.606+0000 7f49657fa640 1 -- 172.21.15.113:0/151328322 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v159) v1 ==== 84+0+65 (secure 0 0 0) 0x7f49580794f0 con 0x7f496806d850 2023-12-19T13:55:20.605 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:20.605 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:55:20.605 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:55:20.605 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:55:20.606 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:55:20.606 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:55:20.606 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:55:20.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f494806a430 msgr2=0x7f494806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f494806a430 0x7f494806c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f496815e500 tx=0x7f4950007990 comp rx=0 tx=0).stop 2023-12-19T13:55:20.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f496806d850 msgr2=0x7f4968147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f496806d850 0x7f4968147bf0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f495802b8c0 tx=0x7f49580046c0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 shutdown_connections 2023-12-19T13:55:20.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f494806a430 0x7f494806c8f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4968158df0 0x7f496815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f496806f160 0x7f49680af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.608+0000 7f496e6db640 1 --2- 172.21.15.113:0/151328322 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f496806d850 0x7f4968147bf0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.609+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 >> 172.21.15.113:0/151328322 conn(0x7f49680cf0b0 msgr2=0x7f496814acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:20.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.609+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 shutdown_connections 2023-12-19T13:55:20.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.609+0000 7f496e6db640 1 -- 172.21.15.113:0/151328322 wait complete. 2023-12-19T13:55:20.626 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:55:20.627 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:55:20.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.847+0000 7f0ddf241640 1 Processor -- start 2023-12-19T13:55:20.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.848+0000 7f0ddf241640 1 -- start start 2023-12-19T13:55:20.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.849+0000 7f0ddf241640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0dd80ab150 0x7f0dd80a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.849+0000 7f0ddf241640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 0x7f0dd80acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.849+0000 7f0ddf241640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd8147060 con 0x7f0dd8146800 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.849+0000 7f0ddf241640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd8146be0 con 0x7f0dd80ab150 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.849+0000 7f0ddf241640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80ab710 con 0x7f0dd80ac7b0 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0ddcfdd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0dd8146800 0x7f0dd80a9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43612/0 (socket says 172.21.15.113:43612) 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0ddcfdd640 1 -- 172.21.15.113:0/2348718988 learned_addr learned my addr 172.21.15.113:0/2348718988 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966180575 0 0) 0x7f0dd8147060 con 0x7f0dd8146800 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc4003520 con 0x7f0dd8146800 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd7fff640 1 --2- 172.21.15.113:0/2348718988 >> v2:172.21.15.151:3300/0 conn(0x7f0dd80ab150 0x7f0dd80a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0ddd7de640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 0x7f0dd80acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1172913803 0 0) 0x7f0dc4003520 con 0x7f0dd8146800 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 msgr2=0x7f0dd80acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 0x7f0dd80acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 >> v2:172.21.15.151:3300/0 conn(0x7f0dd80ab150 msgr2=0x7f0dd80a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 --2- 172.21.15.113:0/2348718988 >> v2:172.21.15.151:3300/0 conn(0x7f0dd80ab150 0x7f0dd80a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80ab9f0 con 0x7f0dd8146800 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0dc0001670 con 0x7f0dd8146800 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 >> v1:172.21.15.113:6789/0 conn(0x7f0dd8146800 legacy=0x7f0dd80a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.850+0000 7f0dd77fe640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 0x7f0dc40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd77fe640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dc4004060 0x7f0dc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd77fe640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004d00 0x7f0dc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8146be0 con 0x7f0dc4004060 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80ab710 con 0x7f0dc4004d00 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc400bce0 con 0x7f0dd80ac7b0 2023-12-19T13:55:20.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd7fff640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dc4004060 0x7f0dc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0ddcfdd640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 0x7f0dc40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd7fff640 1 -- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 msgr2=0x7f0dc40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd7fff640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd80ac7b0 0x7f0dc40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0ddd7de640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004d00 0x7f0dc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd7fff640 1 -- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004d00 msgr2=0x7f0dc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd7fff640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004d00 0x7f0dc4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.851+0000 7f0dd7fff640 1 -- 172.21.15.113:0/2348718988 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc4003520 con 0x7f0dc4004060 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.852+0000 7f0dd7fff640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dc4004060 0x7f0dc40047c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8007360 tx=0x7f0dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2423cbd243a60912 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc802ccf0 con 0x7f0dc4004060 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc802ce50 con 0x7f0dc4004060 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0dd77fe640 1 -- 172.21.15.113:0/2348718988 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8034660 con 0x7f0dc4004060 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0ddf241640 1 -- 172.21.15.113:0/2348718988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dc4004060 msgr2=0x7f0dc40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0ddf241640 1 --2- 172.21.15.113:0/2348718988 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dc4004060 0x7f0dc40047c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8007360 tx=0x7f0dc40057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0ddd7de640 1 -- 172.21.15.113:0/2348718988 reap_dead start 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0ddf241640 1 -- 172.21.15.113:0/2348718988 shutdown_connections 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0ddf241640 1 -- 172.21.15.113:0/2348718988 >> 172.21.15.113:0/2348718988 conn(0x7f0dd806f5a0 msgr2=0x7f0dd806f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:20.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0ddf241640 1 -- 172.21.15.113:0/2348718988 shutdown_connections 2023-12-19T13:55:20.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.853+0000 7f0ddf241640 1 -- 172.21.15.113:0/2348718988 wait complete. 2023-12-19T13:55:20.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.855+0000 7f0ddf241640 1 Processor -- start 2023-12-19T13:55:20.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.855+0000 7f0ddf241640 1 -- start start 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddf241640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004060 0x7f0dd815c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddf241640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd8144be0 0x7f0dd8145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddf241640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dd813d700 0x7f0dd813db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddf241640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81455a0 con 0x7f0dd813d700 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddf241640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8160a00 con 0x7f0dc4004060 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddf241640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81f6080 con 0x7f0dd8144be0 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddd7de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dd813d700 0x7f0dd813db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddd7de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dd813d700 0x7f0dd813db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45984/0 (socket says 172.21.15.113:45984) 2023-12-19T13:55:20.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.856+0000 7f0ddd7de640 1 -- 172.21.15.113:0/2972321660 learned_addr learned my addr 172.21.15.113:0/2972321660 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0dd7fff640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd8144be0 0x7f0dd8145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0ddd7de640 1 -- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd8144be0 msgr2=0x7f0dd8145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0ddd7de640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd8144be0 0x7f0dd8145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0ddd7de640 1 -- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004060 msgr2=0x7f0dd815c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0ddd7de640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004060 0x7f0dd815c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0ddd7de640 1 -- 172.21.15.113:0/2972321660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd81f6320 con 0x7f0dd813d700 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0dd7fff640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd8144be0 0x7f0dd8145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0ddd7de640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dd813d700 0x7f0dd813db80 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0006fd0 tx=0x7f0dd000e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0dd57fa640 1 -- 172.21.15.113:0/2972321660 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000c070 con 0x7f0dd813d700 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0dd57fa640 1 -- 172.21.15.113:0/2972321660 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd0013630 con 0x7f0dd813d700 2023-12-19T13:55:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.857+0000 7f0dd57fa640 1 -- 172.21.15.113:0/2972321660 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00139e0 con 0x7f0dd813d700 2023-12-19T13:55:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.858+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd81f6600 con 0x7f0dd813d700 2023-12-19T13:55:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.858+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd813e0c0 con 0x7f0dd813d700 2023-12-19T13:55:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.859+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd81f6f30 con 0x7f0dd813d700 2023-12-19T13:55:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.860+0000 7f0dd57fa640 1 -- 172.21.15.113:0/2972321660 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0dd0013b40 con 0x7f0dd813d700 2023-12-19T13:55:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.861+0000 7f0dd57fa640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0db806a460 0x7f0db806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.861+0000 7f0dd57fa640 1 -- 172.21.15.113:0/2972321660 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0dd0087f90 con 0x7f0dd813d700 2023-12-19T13:55:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.861+0000 7f0ddcfdd640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0db806a460 0x7f0db806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.861+0000 7f0ddcfdd640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0db806a460 0x7f0db806c920 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0001eb0 tx=0x7f0dc0001ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:20.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:20.865+0000 7f0dd57fa640 1 -- 172.21.15.113:0/2972321660 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0dd81f6f30 con 0x7f0dd813d700 2023-12-19T13:55:21.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.058+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0dd8061910 con 0x7f0dd813d700 2023-12-19T13:55:21.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.578+0000 7f0dd57fa640 1 -- 172.21.15.113:0/2972321660 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v160) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0dd0057350 con 0x7f0dd813d700 2023-12-19T13:55:21.580 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0db806a460 msgr2=0x7f0db806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0db806a460 0x7f0db806c920 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0001eb0 tx=0x7f0dc0001ca0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dd813d700 msgr2=0x7f0dd813db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dd813d700 0x7f0dd813db80 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0006fd0 tx=0x7f0dd000e830 comp rx=0 tx=0).stop 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 shutdown_connections 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0db806a460 0x7f0db806c920 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0dd813d700 0x7f0dd813db80 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dd8144be0 0x7f0dd8145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 --2- 172.21.15.113:0/2972321660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4004060 0x7f0dd815c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.584+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 >> 172.21.15.113:0/2972321660 conn(0x7f0dd806f5a0 msgr2=0x7f0dd80acbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:21.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.585+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 shutdown_connections 2023-12-19T13:55:21.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.585+0000 7f0ddf241640 1 -- 172.21.15.113:0/2972321660 wait complete. 2023-12-19T13:55:21.604 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:55:21.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.823+0000 7f3aaa461640 1 Processor -- start 2023-12-19T13:55:21.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.823+0000 7f3aaa461640 1 -- start start 2023-12-19T13:55:21.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.825+0000 7f3aaa461640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3aa4140cd0 0x7f3aa40b8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.825+0000 7f3aaa461640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 0x7f3aa4142c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.825+0000 7f3aaa461640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa415dc20 con 0x7f3aa40b5130 2023-12-19T13:55:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.825+0000 7f3aaa461640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa415da30 con 0x7f3aa4140cd0 2023-12-19T13:55:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.825+0000 7f3aaa461640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa415df00 con 0x7f3aa40b8e90 2023-12-19T13:55:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.825+0000 7f3aa3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3aa40b5130 0x7f3aa40b5510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43626/0 (socket says 172.21.15.113:43626) 2023-12-19T13:55:21.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa3fff640 1 -- 172.21.15.113:0/580125014 learned_addr learned my addr 172.21.15.113:0/580125014 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa89fe640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 0x7f3aa4142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3a9bfff640 1 --2- 172.21.15.113:0/580125014 >> v2:172.21.15.151:3300/0 conn(0x7f3aa4140cd0 0x7f3aa40b8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442435318 0 0) 0x7f3aa415dc20 con 0x7f3aa40b5130 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a90003520 con 0x7f3aa40b5130 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 711470018 0 0) 0x7f3a90003520 con 0x7f3aa40b5130 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 msgr2=0x7f3aa4142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 0x7f3aa4142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 >> v2:172.21.15.151:3300/0 conn(0x7f3aa4140cd0 msgr2=0x7f3aa40b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 --2- 172.21.15.113:0/580125014 >> v2:172.21.15.151:3300/0 conn(0x7f3aa4140cd0 0x7f3aa40b8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa415e1e0 con 0x7f3aa40b5130 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.826+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3a94001670 con 0x7f3aa40b5130 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 >> v1:172.21.15.113:6789/0 conn(0x7f3aa40b5130 legacy=0x7f3aa40b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa37fe640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a90003970 0x7f3a90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa37fe640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 0x7f3a900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa37fe640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a90004d00 0x7f3a90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa415df00 con 0x7f3a90003970 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9000b9d0 con 0x7f3a90004d00 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9000bb90 con 0x7f3aa40b8e90 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa3fff640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a90003970 0x7f3a90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3a9bfff640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 0x7f3a900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa89fe640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a90004d00 0x7f3a90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.827+0000 7f3aa3fff640 1 -- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 msgr2=0x7f3a900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.828+0000 7f3aa3fff640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 0x7f3a900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.828+0000 7f3aa3fff640 1 -- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a90004d00 msgr2=0x7f3a90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:21.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.828+0000 7f3aa3fff640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a90004d00 0x7f3a90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.828+0000 7f3aa3fff640 1 -- 172.21.15.113:0/580125014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90003520 con 0x7f3a90003970 2023-12-19T13:55:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.828+0000 7f3a9bfff640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa40b8e90 0x7f3a900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:55:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.830+0000 7f3aa3fff640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a90003970 0x7f3a90003d90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400c110 tx=0x7f3a900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5faa5b95d45a292 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.830+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94005ad0 con 0x7f3a90003970 2023-12-19T13:55:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.830+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a94005c50 con 0x7f3a90003970 2023-12-19T13:55:21.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.830+0000 7f3aa37fe640 1 -- 172.21.15.113:0/580125014 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9402c830 con 0x7f3a90003970 2023-12-19T13:55:21.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.831+0000 7f3aaa461640 1 -- 172.21.15.113:0/580125014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a90003970 msgr2=0x7f3a90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:21.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.831+0000 7f3aaa461640 1 --2- 172.21.15.113:0/580125014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a90003970 0x7f3a90003d90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400c110 tx=0x7f3a900057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.831+0000 7f3aa89fe640 1 -- 172.21.15.113:0/580125014 reap_dead start 2023-12-19T13:55:21.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.831+0000 7f3aaa461640 1 -- 172.21.15.113:0/580125014 shutdown_connections 2023-12-19T13:55:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.831+0000 7f3aaa461640 1 -- 172.21.15.113:0/580125014 >> 172.21.15.113:0/580125014 conn(0x7f3aa40d3370 msgr2=0x7f3aa40d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.831+0000 7f3aaa461640 1 -- 172.21.15.113:0/580125014 shutdown_connections 2023-12-19T13:55:21.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.831+0000 7f3aaa461640 1 -- 172.21.15.113:0/580125014 wait complete. 2023-12-19T13:55:21.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.834+0000 7f3aaa461640 1 Processor -- start 2023-12-19T13:55:21.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.834+0000 7f3aaa461640 1 -- start start 2023-12-19T13:55:21.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aaa461640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3aa413fdb0 0x7f3aa4155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aaa461640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3aa4140190 0x7f3aa4155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aaa461640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa41564b0 0x7f3aa41f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aaa461640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa41585e0 con 0x7f3aa413fdb0 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aaa461640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4071470 con 0x7f3aa4140190 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aaa461640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa415afb0 con 0x7f3aa41564b0 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aa3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3aa413fdb0 0x7f3aa4155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aa3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3aa413fdb0 0x7f3aa4155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46008/0 (socket says 172.21.15.113:46008) 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.835+0000 7f3aa3fff640 1 -- 172.21.15.113:0/3972956850 learned_addr learned my addr 172.21.15.113:0/3972956850 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa3fff640 1 -- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa41564b0 msgr2=0x7f3aa41f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3a9bfff640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3aa4140190 0x7f3aa4155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa3fff640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa41564b0 0x7f3aa41f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa3fff640 1 -- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3aa4140190 msgr2=0x7f3aa4155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa3fff640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3aa4140190 0x7f3aa4155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:21.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa3fff640 1 -- 172.21.15.113:0/3972956850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa415b290 con 0x7f3aa413fdb0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3a9bfff640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3aa4140190 0x7f3aa4155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa3fff640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3aa413fdb0 0x7f3aa4155a30 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f3a94000fd0 tx=0x7f3a940019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa17fa640 1 -- 172.21.15.113:0/3972956850 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9403c040 con 0x7f3aa413fdb0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aa17fa640 1 -- 172.21.15.113:0/3972956850 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9402cc40 con 0x7f3aa413fdb0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.836+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa415b570 con 0x7f3aa413fdb0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.837+0000 7f3aa17fa640 1 -- 172.21.15.113:0/3972956850 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94007070 con 0x7f3aa413fdb0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.837+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa415bd70 con 0x7f3aa413fdb0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.838+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa4061910 con 0x7f3aa413fdb0 2023-12-19T13:55:21.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.839+0000 7f3aa17fa640 1 -- 172.21.15.113:0/3972956850 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3a94032070 con 0x7f3aa413fdb0 2023-12-19T13:55:21.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.840+0000 7f3aa17fa640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a8406a430 0x7f3a8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:21.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.840+0000 7f3aa17fa640 1 -- 172.21.15.113:0/3972956850 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3a940a9e70 con 0x7f3aa413fdb0 2023-12-19T13:55:21.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.840+0000 7f3a9bfff640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a8406a430 0x7f3a8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:21.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.841+0000 7f3a9bfff640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a8406a430 0x7f3a8406c8f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c006d20 tx=0x7f3a8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:21.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:21.845+0000 7f3aa17fa640 1 -- 172.21.15.113:0/3972956850 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3a940756b0 con 0x7f3aa413fdb0 2023-12-19T13:55:22.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.039+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3aa40b6c60 con 0x7f3aa413fdb0 2023-12-19T13:55:22.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.594+0000 7f3aa17fa640 1 -- 172.21.15.113:0/3972956850 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v161) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3a94078cd0 con 0x7f3aa413fdb0 2023-12-19T13:55:22.594 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:55:22.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.602+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a8406a430 msgr2=0x7f3a8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:22.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.602+0000 7f3aaa461640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a8406a430 0x7f3a8406c8f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c006d20 tx=0x7f3a8c008040 comp rx=0 tx=0).stop 2023-12-19T13:55:22.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.602+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3aa413fdb0 msgr2=0x7f3aa4155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:22.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.602+0000 7f3aaa461640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3aa413fdb0 0x7f3aa4155a30 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f3a94000fd0 tx=0x7f3a940019a0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.608+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 shutdown_connections 2023-12-19T13:55:22.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.608+0000 7f3aaa461640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3a8406a430 0x7f3a8406c8f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.608+0000 7f3aaa461640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3aa41564b0 0x7f3aa41f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.608+0000 7f3aaa461640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3aa4140190 0x7f3aa4155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.608+0000 7f3aaa461640 1 --2- 172.21.15.113:0/3972956850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3aa413fdb0 0x7f3aa4155a30 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.608+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 >> 172.21.15.113:0/3972956850 conn(0x7f3aa40d3370 msgr2=0x7f3aa415cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:22.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.609+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 shutdown_connections 2023-12-19T13:55:22.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.609+0000 7f3aaa461640 1 -- 172.21.15.113:0/3972956850 wait complete. 2023-12-19T13:55:22.634 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:55:22.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.825+0000 7f4e4170a640 1 Processor -- start 2023-12-19T13:55:22.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.825+0000 7f4e4170a640 1 -- start start 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.826+0000 7f4e4170a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c154760 0x7f4e3c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.826+0000 7f4e4170a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4e3c0b0070 0x7f4e3c0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.826+0000 7f4e4170a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0b0a10 con 0x7f4e3c0cb810 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.826+0000 7f4e4170a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c0ccf20 con 0x7f4e3c0b0070 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.826+0000 7f4e4170a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0b1b50 con 0x7f4e3c154760 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4e3c0b0070 0x7f4e3c0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4e3c0b0070 0x7f4e3c0b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46022/0 (socket says 172.21.15.113:46022) 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3b7fe640 1 -- 172.21.15.113:0/867794652 learned_addr learned my addr 172.21.15.113:0/867794652 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:22.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3a7fc640 1 --1- 172.21.15.113:0/867794652 >> v1:172.21.15.113:6789/0 conn(0x7f4e3c0cb810 0x7f4e3c0b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43640/0 (socket says 172.21.15.113:43640) 2023-12-19T13:55:22.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3affd640 1 --2- 172.21.15.113:0/867794652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c154760 0x7f4e3c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:22.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3b7fe640 1 -- 172.21.15.113:0/867794652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c154760 msgr2=0x7f4e3c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:22.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3b7fe640 1 --2- 172.21.15.113:0/867794652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c154760 0x7f4e3c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3b7fe640 1 -- 172.21.15.113:0/867794652 >> v1:172.21.15.113:6789/0 conn(0x7f4e3c0cb810 legacy=0x7f4e3c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:22.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3b7fe640 1 -- 172.21.15.113:0/867794652 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0ccbd0 con 0x7f4e3c0b0070 2023-12-19T13:55:22.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e3affd640 1 --2- 172.21.15.113:0/867794652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c154760 0x7f4e3c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:22.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.827+0000 7f4e39ffb640 1 -- 172.21.15.113:0/867794652 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724663730 0 0) 0x7f4e3c0b0a10 con 0x7f4e3c0cb810 2023-12-19T13:55:22.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.828+0000 7f4e3b7fe640 1 --2- 172.21.15.113:0/867794652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c0b04d0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e80 tx=0x7f4e3402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc6b9290234f3cd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:22.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.828+0000 7f4e39ffb640 1 -- 172.21.15.113:0/867794652 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3402ca50 con 0x7f4e3c0b0070 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.828+0000 7f4e39ffb640 1 -- 172.21.15.113:0/867794652 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3402cbb0 con 0x7f4e3c0b0070 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e39ffb640 1 -- 172.21.15.113:0/867794652 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340343f0 con 0x7f4e3c0b0070 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 -- 172.21.15.113:0/867794652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 msgr2=0x7f4e3c0b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 --2- 172.21.15.113:0/867794652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c0b04d0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e80 tx=0x7f4e3402beb0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 -- 172.21.15.113:0/867794652 shutdown_connections 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 --2- 172.21.15.113:0/867794652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c0b04d0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 --2- 172.21.15.113:0/867794652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c154760 0x7f4e3c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 -- 172.21.15.113:0/867794652 >> 172.21.15.113:0/867794652 conn(0x7f4e3c073150 msgr2=0x7f4e3c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 -- 172.21.15.113:0/867794652 shutdown_connections 2023-12-19T13:55:22.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.829+0000 7f4e4170a640 1 -- 172.21.15.113:0/867794652 wait complete. 2023-12-19T13:55:22.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.831+0000 7f4e4170a640 1 Processor -- start 2023-12-19T13:55:22.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.831+0000 7f4e4170a640 1 -- start start 2023-12-19T13:55:22.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e4170a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c14a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:22.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e4170a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cb810 0x7f4e3c14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e4170a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c154760 0x7f4e3c1f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e4170a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1f2c10 con 0x7f4e3c0b0070 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e4170a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c14ac70 con 0x7f4e3c154760 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e4170a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c159b80 con 0x7f4e3c0cb810 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e3affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c14a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e3affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c14a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46038/0 (socket says 172.21.15.113:46038) 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.832+0000 7f4e3affd640 1 -- 172.21.15.113:0/193176476 learned_addr learned my addr 172.21.15.113:0/193176476 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e3affd640 1 -- 172.21.15.113:0/193176476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cb810 msgr2=0x7f4e3c14f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e3affd640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cb810 0x7f4e3c14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e3affd640 1 -- 172.21.15.113:0/193176476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c154760 msgr2=0x7f4e3c1f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e3affd640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c154760 0x7f4e3c1f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e3affd640 1 -- 172.21.15.113:0/193176476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34009b30 con 0x7f4e3c0b0070 2023-12-19T13:55:22.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e3affd640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c14a730 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c7f0 tx=0x7f4e2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:22.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e237fe640 1 -- 172.21.15.113:0/193176476 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c007820 con 0x7f4e3c0b0070 2023-12-19T13:55:22.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e237fe640 1 -- 172.21.15.113:0/193176476 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c007980 con 0x7f4e3c0b0070 2023-12-19T13:55:22.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e237fe640 1 -- 172.21.15.113:0/193176476 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c007cf0 con 0x7f4e3c0b0070 2023-12-19T13:55:22.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.833+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c159e60 con 0x7f4e3c0b0070 2023-12-19T13:55:22.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.834+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c1597c0 con 0x7f4e3c0b0070 2023-12-19T13:55:22.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.835+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c061910 con 0x7f4e3c0b0070 2023-12-19T13:55:22.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.836+0000 7f4e237fe640 1 -- 172.21.15.113:0/193176476 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e2c0113f0 con 0x7f4e3c0b0070 2023-12-19T13:55:22.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.836+0000 7f4e237fe640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e2806a480 0x7f4e2806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:22.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.837+0000 7f4e237fe640 1 -- 172.21.15.113:0/193176476 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4e2c088c20 con 0x7f4e3c0b0070 2023-12-19T13:55:22.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.837+0000 7f4e3a7fc640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e2806a480 0x7f4e2806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:22.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.838+0000 7f4e3a7fc640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e2806a480 0x7f4e2806c940 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4e30007fd0 tx=0x7f4e30007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:22.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:22.842+0000 7f4e237fe640 1 -- 172.21.15.113:0/193176476 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4e2c054250 con 0x7f4e3c0b0070 2023-12-19T13:55:23.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.074+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4e3c0cdde0 con 0x7f4e3c0b0070 2023-12-19T13:55:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.083+0000 7f4e237fe640 1 -- 172.21.15.113:0/193176476 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v69) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4e2c01f0c0 con 0x7f4e3c0b0070 2023-12-19T13:55:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 18 and data pool 19 2023-12-19T13:55:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.087+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e2806a480 msgr2=0x7f4e2806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.087+0000 7f4e4170a640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e2806a480 0x7f4e2806c940 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4e30007fd0 tx=0x7f4e30007aa0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 msgr2=0x7f4e3c14a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c14a730 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c7f0 tx=0x7f4e2c00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 shutdown_connections 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e2806a480 0x7f4e2806c940 secure :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4e30007fd0 tx=0x7f4e30007aa0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c154760 0x7f4e3c1f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cb810 0x7f4e3c14f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 --2- 172.21.15.113:0/193176476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e3c0b0070 0x7f4e3c14a730 secure :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c7f0 tx=0x7f4e2c00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.088+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 >> 172.21.15.113:0/193176476 conn(0x7f4e3c073150 msgr2=0x7f4e3c15da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.089+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 shutdown_connections 2023-12-19T13:55:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.089+0000 7f4e4170a640 1 -- 172.21.15.113:0/193176476 wait complete. 2023-12-19T13:55:23.117 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:23.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.299+0000 7f7a89fd9640 1 Processor -- start 2023-12-19T13:55:23.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.299+0000 7f7a89fd9640 1 -- start start 2023-12-19T13:55:23.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a89fd9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a840b1710 0x7f7a8406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a89fd9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a8415e040 0x7f7a8415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a89fd9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8415e9f0 con 0x7f7a84157aa0 2023-12-19T13:55:23.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a89fd9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a840b2600 con 0x7f7a8415e040 2023-12-19T13:55:23.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a89fd9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a840b1d60 con 0x7f7a840b1710 2023-12-19T13:55:23.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a83fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a8415e040 0x7f7a8415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a83fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a8415e040 0x7f7a8415e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46048/0 (socket says 172.21.15.113:46048) 2023-12-19T13:55:23.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.301+0000 7f7a83fff640 1 -- 172.21.15.113:0/3521743740 learned_addr learned my addr 172.21.15.113:0/3521743740 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:23.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.302+0000 7f7a7bfff640 1 --2- 172.21.15.113:0/3521743740 >> v2:172.21.15.151:3300/0 conn(0x7f7a840b1710 0x7f7a8406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.302+0000 7f7a83fff640 1 -- 172.21.15.113:0/3521743740 >> v2:172.21.15.151:3300/0 conn(0x7f7a840b1710 msgr2=0x7f7a8406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:23.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.302+0000 7f7a83fff640 1 --2- 172.21.15.113:0/3521743740 >> v2:172.21.15.151:3300/0 conn(0x7f7a840b1710 0x7f7a8406e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.302+0000 7f7a83fff640 1 -- 172.21.15.113:0/3521743740 >> v1:172.21.15.151:6789/0 conn(0x7f7a84157aa0 legacy=0x7f7a84161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:23.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.302+0000 7f7a83fff640 1 -- 172.21.15.113:0/3521743740 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a840b2040 con 0x7f7a8415e040 2023-12-19T13:55:23.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.303+0000 7f7a83fff640 1 --2- 172.21.15.113:0/3521743740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a8415e040 0x7f7a8415e4b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f7a840cc960 tx=0x7f7a7c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d247d5660afa49ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:23.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.303+0000 7f7a82ffd640 1 -- 172.21.15.113:0/3521743740 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c02ca70 con 0x7f7a8415e040 2023-12-19T13:55:23.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.303+0000 7f7a82ffd640 1 -- 172.21.15.113:0/3521743740 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c02cbd0 con 0x7f7a8415e040 2023-12-19T13:55:23.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.303+0000 7f7a82ffd640 1 -- 172.21.15.113:0/3521743740 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0343f0 con 0x7f7a8415e040 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 -- 172.21.15.113:0/3521743740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a8415e040 msgr2=0x7f7a8415e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/3521743740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a8415e040 0x7f7a8415e4b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f7a840cc960 tx=0x7f7a7c02bed0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 -- 172.21.15.113:0/3521743740 shutdown_connections 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/3521743740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a8415e040 0x7f7a8415e4b0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/3521743740 >> v2:172.21.15.151:3300/0 conn(0x7f7a840b1710 0x7f7a8406e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 -- 172.21.15.113:0/3521743740 >> 172.21.15.113:0/3521743740 conn(0x7f7a840cbb70 msgr2=0x7f7a840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 -- 172.21.15.113:0/3521743740 shutdown_connections 2023-12-19T13:55:23.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.304+0000 7f7a89fd9640 1 -- 172.21.15.113:0/3521743740 wait complete. 2023-12-19T13:55:23.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.306+0000 7f7a89fd9640 1 Processor -- start 2023-12-19T13:55:23.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.306+0000 7f7a89fd9640 1 -- start start 2023-12-19T13:55:23.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a89fd9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a840b1710 0x7f7a841f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a89fd9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a84157aa0 0x7f7a8415f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a89fd9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a8415e040 0x7f7a8415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a89fd9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a841e6c80 con 0x7f7a84157aa0 2023-12-19T13:55:23.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a89fd9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a841e6e10 con 0x7f7a8415e040 2023-12-19T13:55:23.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a89fd9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a841f2920 con 0x7f7a840b1710 2023-12-19T13:55:23.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a84157aa0 0x7f7a8415f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a84157aa0 0x7f7a8415f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46050/0 (socket says 172.21.15.113:46050) 2023-12-19T13:55:23.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.307+0000 7f7a7bfff640 1 -- 172.21.15.113:0/2507973735 learned_addr learned my addr 172.21.15.113:0/2507973735 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:23.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a837fe640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a840b1710 0x7f7a841f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a7bfff640 1 -- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a840b1710 msgr2=0x7f7a841f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a7bfff640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a840b1710 0x7f7a841f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a7bfff640 1 -- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a8415e040 msgr2=0x7f7a8415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a7bfff640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a8415e040 0x7f7a8415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a7bfff640 1 -- 172.21.15.113:0/2507973735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c009b30 con 0x7f7a84157aa0 2023-12-19T13:55:23.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a837fe640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a840b1710 0x7f7a841f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:23.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a7bfff640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a84157aa0 0x7f7a8415f590 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c7f0 tx=0x7f7a6c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:23.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a80ff9640 1 -- 172.21.15.113:0/2507973735 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c004220 con 0x7f7a84157aa0 2023-12-19T13:55:23.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a80ff9640 1 -- 172.21.15.113:0/2507973735 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c0043a0 con 0x7f7a84157aa0 2023-12-19T13:55:23.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a80ff9640 1 -- 172.21.15.113:0/2507973735 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c007860 con 0x7f7a84157aa0 2023-12-19T13:55:23.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a84160050 con 0x7f7a84157aa0 2023-12-19T13:55:23.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.308+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a84160610 con 0x7f7a84157aa0 2023-12-19T13:55:23.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.310+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a841e6fc0 con 0x7f7a84157aa0 2023-12-19T13:55:23.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.311+0000 7f7a80ff9640 1 -- 172.21.15.113:0/2507973735 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a6c007bd0 con 0x7f7a84157aa0 2023-12-19T13:55:23.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.312+0000 7f7a80ff9640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a6406a430 0x7f7a6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.312+0000 7f7a80ff9640 1 -- 172.21.15.113:0/2507973735 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a6c088860 con 0x7f7a84157aa0 2023-12-19T13:55:23.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.312+0000 7f7a837fe640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a6406a430 0x7f7a6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.313+0000 7f7a837fe640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a6406a430 0x7f7a6406c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7a74007fd0 tx=0x7f7a74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:23.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.316+0000 7f7a80ff9640 1 -- 172.21.15.113:0/2507973735 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7a841e6fc0 con 0x7f7a84157aa0 2023-12-19T13:55:23.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.505+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a841e6f80 con 0x7f7a84157aa0 2023-12-19T13:55:23.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.508+0000 7f7a80ff9640 1 -- 172.21.15.113:0/2507973735 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16121 (secure 0 0 0) 0x7f7a6c01e020 con 0x7f7a84157aa0 2023-12-19T13:55:23.507 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:23.507 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":162,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:23.075322+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:23.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a6406a430 msgr2=0x7f7a6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a6406a430 0x7f7a6406c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7a74007fd0 tx=0x7f7a74009040 comp rx=0 tx=0).stop 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a84157aa0 msgr2=0x7f7a8415f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a84157aa0 0x7f7a8415f590 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c7f0 tx=0x7f7a6c00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 shutdown_connections 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7a6406a430 0x7f7a6406c8f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a8415e040 0x7f7a8415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a84157aa0 0x7f7a8415f590 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 --2- 172.21.15.113:0/2507973735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a840b1710 0x7f7a841f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 >> 172.21.15.113:0/2507973735 conn(0x7f7a840cbb70 msgr2=0x7f7a840cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 shutdown_connections 2023-12-19T13:55:23.510 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.510+0000 7f7a89fd9640 1 -- 172.21.15.113:0/2507973735 wait complete. 2023-12-19T13:55:23.528 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:23.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.743+0000 7f8068b1c640 1 Processor -- start 2023-12-19T13:55:23.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.743+0000 7f8068b1c640 1 -- start start 2023-12-19T13:55:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.745+0000 7f8068b1c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 0x7f80640cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.745+0000 7f8068b1c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80640b22b0 con 0x7f80640ce660 2023-12-19T13:55:23.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.745+0000 7f8068b1c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80640b2830 con 0x7f80640cc8a0 2023-12-19T13:55:23.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.745+0000 7f8068b1c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8064161bf0 con 0x7f8064161810 2023-12-19T13:55:23.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.745+0000 7f8063fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f80640ce660 0x7f806406f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43642/0 (socket says 172.21.15.113:43642) 2023-12-19T13:55:23.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.745+0000 7f8063fff640 1 -- 172.21.15.113:0/58181669 learned_addr learned my addr 172.21.15.113:0/58181669 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:23.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f80637fe640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 0x7f80640cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318189193 0 0) 0x7f80640b22b0 con 0x7f80640ce660 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8050003520 con 0x7f80640ce660 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837617230 0 0) 0x7f8050003520 con 0x7f80640ce660 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 msgr2=0x7f80640cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 0x7f80640cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 >> v1:172.21.15.151:6789/0 conn(0x7f80640cc8a0 legacy=0x7f80640cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640b2550 con 0x7f80640ce660 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f805c0019f0 con 0x7f80640ce660 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 >> v1:172.21.15.113:6789/0 conn(0x7f80640ce660 legacy=0x7f806406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.746+0000 7f8062ffd640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80500039a0 0x7f8050003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f8062ffd640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80500047c0 0x7f8050004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f8062ffd640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 0x7f8050005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064161bf0 con 0x7f80500039a0 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805000bb10 con 0x7f80500047c0 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805000bcd0 con 0x7f8064161810 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f80637fe640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80500039a0 0x7f8050003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f80637fe640 1 -- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 msgr2=0x7f8050005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f8063fff640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 0x7f8050005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f805bfff640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80500047c0 0x7f8050004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f80637fe640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 0x7f8050005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f80637fe640 1 -- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80500047c0 msgr2=0x7f8050004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f80637fe640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80500047c0 0x7f8050004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f80637fe640 1 -- 172.21.15.113:0/58181669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050003520 con 0x7f80500039a0 2023-12-19T13:55:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.747+0000 7f8063fff640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8064161810 0x7f8050005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:23.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.748+0000 7f80637fe640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80500039a0 0x7f8050003dc0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f8054009ac0 tx=0x7f80500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6f89ff57dd57c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:23.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805402c6b0 con 0x7f80500039a0 2023-12-19T13:55:23.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805402c810 con 0x7f80500039a0 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8062ffd640 1 -- 172.21.15.113:0/58181669 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805402cba0 con 0x7f80500039a0 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8068b1c640 1 -- 172.21.15.113:0/58181669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80500039a0 msgr2=0x7f8050003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8068b1c640 1 --2- 172.21.15.113:0/58181669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f80500039a0 0x7f8050003dc0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f8054009ac0 tx=0x7f80500057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8063fff640 1 -- 172.21.15.113:0/58181669 reap_dead start 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8068b1c640 1 -- 172.21.15.113:0/58181669 shutdown_connections 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8068b1c640 1 -- 172.21.15.113:0/58181669 >> 172.21.15.113:0/58181669 conn(0x7f80640b0100 msgr2=0x7f80640b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8068b1c640 1 -- 172.21.15.113:0/58181669 shutdown_connections 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.749+0000 7f8068b1c640 1 -- 172.21.15.113:0/58181669 wait complete. 2023-12-19T13:55:23.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.751+0000 7f8068b1c640 1 Processor -- start 2023-12-19T13:55:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.751+0000 7f8068b1c640 1 -- start start 2023-12-19T13:55:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f8068b1c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80500039a0 0x7f8064162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f8068b1c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f806415d380 0x7f806415d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f8068b1c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f806415f830 0x7f806415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f8068b1c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806415dd40 con 0x7f806415d380 2023-12-19T13:55:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f8068b1c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064163420 con 0x7f806415f830 2023-12-19T13:55:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f8068b1c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806406e310 con 0x7f80500039a0 2023-12-19T13:55:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f805bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f806415d380 0x7f806415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f805bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f806415d380 0x7f806415d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46070/0 (socket says 172.21.15.113:46070) 2023-12-19T13:55:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.752+0000 7f805bfff640 1 -- 172.21.15.113:0/2661546433 learned_addr learned my addr 172.21.15.113:0/2661546433 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f80637fe640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80500039a0 0x7f8064162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f805bfff640 1 -- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80500039a0 msgr2=0x7f8064162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f805bfff640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80500039a0 0x7f8064162ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f805bfff640 1 -- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f806415f830 msgr2=0x7f806415fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f805bfff640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f806415f830 0x7f806415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f805bfff640 1 -- 172.21.15.113:0/2661546433 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064163650 con 0x7f806415d380 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f80637fe640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80500039a0 0x7f8064162ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f805bfff640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f806415d380 0x7f806415d800 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f804c00d4b0 tx=0x7f804c00d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f8060ff9640 1 -- 172.21.15.113:0/2661546433 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c005480 con 0x7f806415d380 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f8060ff9640 1 -- 172.21.15.113:0/2661546433 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c003610 con 0x7f806415d380 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f8060ff9640 1 -- 172.21.15.113:0/2661546433 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0039a0 con 0x7f806415d380 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.753+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8064163930 con 0x7f806415d380 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.754+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8064163ef0 con 0x7f806415d380 2023-12-19T13:55:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.755+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8064061910 con 0x7f806415d380 2023-12-19T13:55:23.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.756+0000 7f8060ff9640 1 -- 172.21.15.113:0/2661546433 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f804c003b00 con 0x7f806415d380 2023-12-19T13:55:23.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.756+0000 7f8060ff9640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f804406a430 0x7f804406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.757+0000 7f8060ff9640 1 -- 172.21.15.113:0/2661546433 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f804c088890 con 0x7f806415d380 2023-12-19T13:55:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.757+0000 7f80637fe640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f804406a430 0x7f804406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.757+0000 7f80637fe640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f804406a430 0x7f804406c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8054009ac0 tx=0x7f8054030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:23.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.761+0000 7f8060ff9640 1 -- 172.21.15.113:0/2661546433 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f804c053e10 con 0x7f806415d380 2023-12-19T13:55:23.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.953+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f806406f740 con 0x7f806415d380 2023-12-19T13:55:23.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.956+0000 7f8060ff9640 1 -- 172.21.15.113:0/2661546433 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16121 (secure 0 0 0) 0x7f804c080e60 con 0x7f806415d380 2023-12-19T13:55:23.956 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:23.956 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":162,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:23.075322+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:23.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f804406a430 msgr2=0x7f804406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f804406a430 0x7f804406c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8054009ac0 tx=0x7f8054030000 comp rx=0 tx=0).stop 2023-12-19T13:55:23.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f806415d380 msgr2=0x7f806415d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:23.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f806415d380 0x7f806415d800 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f804c00d4b0 tx=0x7f804c00d970 comp rx=0 tx=0).stop 2023-12-19T13:55:23.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 shutdown_connections 2023-12-19T13:55:23.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f804406a430 0x7f804406c8f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f806415f830 0x7f806415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f806415d380 0x7f806415d800 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 --2- 172.21.15.113:0/2661546433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80500039a0 0x7f8064162ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:23.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.959+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 >> 172.21.15.113:0/2661546433 conn(0x7f80640b0100 msgr2=0x7f80640b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:23.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.960+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 shutdown_connections 2023-12-19T13:55:23.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:23.960+0000 7f8068b1c640 1 -- 172.21.15.113:0/2661546433 wait complete. 2023-12-19T13:55:23.978 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:55:24.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.196+0000 7ff077995640 1 Processor -- start 2023-12-19T13:55:24.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.196+0000 7ff077995640 1 -- start start 2023-12-19T13:55:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff077995640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff070157bf0 0x7ff07015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff077995640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff0700ae110 0x7ff0700b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff077995640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0700b0a60 con 0x7ff0700b0640 2023-12-19T13:55:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff077995640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07006b8c0 con 0x7ff070157bf0 2023-12-19T13:55:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff077995640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07015b740 con 0x7ff0700ae110 2023-12-19T13:55:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff075731640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff070157bf0 0x7ff07015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff075f32640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff0700b0640 0x7ff07015dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43654/0 (socket says 172.21.15.113:43654) 2023-12-19T13:55:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.197+0000 7ff075f32640 1 -- 172.21.15.113:0/2740727805 learned_addr learned my addr 172.21.15.113:0/2740727805 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.198+0000 7ff074f30640 1 --2- 172.21.15.113:0/2740727805 >> v2:172.21.15.151:3300/0 conn(0x7ff0700ae110 0x7ff0700b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.198+0000 7ff075731640 1 -- 172.21.15.113:0/2740727805 >> v2:172.21.15.151:3300/0 conn(0x7ff0700ae110 msgr2=0x7ff0700b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.198+0000 7ff075731640 1 --2- 172.21.15.113:0/2740727805 >> v2:172.21.15.151:3300/0 conn(0x7ff0700ae110 0x7ff0700b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.198+0000 7ff075731640 1 -- 172.21.15.113:0/2740727805 >> v1:172.21.15.113:6789/0 conn(0x7ff0700b0640 legacy=0x7ff07015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.198+0000 7ff067fff640 1 -- 172.21.15.113:0/2740727805 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918600864 0 0) 0x7ff0700b0a60 con 0x7ff0700b0640 2023-12-19T13:55:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.198+0000 7ff075731640 1 -- 172.21.15.113:0/2740727805 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700ae640 con 0x7ff070157bf0 2023-12-19T13:55:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.199+0000 7ff075731640 1 --2- 172.21.15.113:0/2740727805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff070157bf0 0x7ff07015b200 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7ff0700af4b0 tx=0x7ff06c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63af3e4cfd8b17c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.200+0000 7ff067fff640 1 -- 172.21.15.113:0/2740727805 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c031830 con 0x7ff070157bf0 2023-12-19T13:55:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.200+0000 7ff067fff640 1 -- 172.21.15.113:0/2740727805 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c031990 con 0x7ff070157bf0 2023-12-19T13:55:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.200+0000 7ff067fff640 1 -- 172.21.15.113:0/2740727805 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c031d20 con 0x7ff070157bf0 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.200+0000 7ff077995640 1 -- 172.21.15.113:0/2740727805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff070157bf0 msgr2=0x7ff07015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.200+0000 7ff077995640 1 --2- 172.21.15.113:0/2740727805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff070157bf0 0x7ff07015b200 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7ff0700af4b0 tx=0x7ff06c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.201+0000 7ff077995640 1 -- 172.21.15.113:0/2740727805 shutdown_connections 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.201+0000 7ff077995640 1 --2- 172.21.15.113:0/2740727805 >> v2:172.21.15.151:3300/0 conn(0x7ff0700ae110 0x7ff0700b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.201+0000 7ff077995640 1 --2- 172.21.15.113:0/2740727805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff070157bf0 0x7ff07015b200 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.201+0000 7ff077995640 1 -- 172.21.15.113:0/2740727805 >> 172.21.15.113:0/2740727805 conn(0x7ff0700cbb70 msgr2=0x7ff0700cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.201+0000 7ff077995640 1 -- 172.21.15.113:0/2740727805 shutdown_connections 2023-12-19T13:55:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.201+0000 7ff077995640 1 -- 172.21.15.113:0/2740727805 wait complete. 2023-12-19T13:55:24.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.202+0000 7ff077995640 1 Processor -- start 2023-12-19T13:55:24.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.202+0000 7ff077995640 1 -- start start 2023-12-19T13:55:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.203+0000 7ff077995640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0700ae110 0x7ff070154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.203+0000 7ff077995640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0700b0640 0x7ff07006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.203+0000 7ff077995640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff070157bf0 0x7ff0700cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.203+0000 7ff077995640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070154a70 con 0x7ff0700b0640 2023-12-19T13:55:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.203+0000 7ff077995640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07015c940 con 0x7ff070157bf0 2023-12-19T13:55:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.203+0000 7ff077995640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700ac8b0 con 0x7ff0700ae110 2023-12-19T13:55:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0700b0640 0x7ff07006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0700b0640 0x7ff07006f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46086/0 (socket says 172.21.15.113:46086) 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 -- 172.21.15.113:0/2412676211 learned_addr learned my addr 172.21.15.113:0/2412676211 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff075731640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0700ae110 0x7ff070154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 -- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0700ae110 msgr2=0x7ff070154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0700ae110 0x7ff070154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 -- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff070157bf0 msgr2=0x7ff0700cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff070157bf0 0x7ff0700cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 -- 172.21.15.113:0/2412676211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c009400 con 0x7ff0700b0640 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff075731640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0700ae110 0x7ff070154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.204+0000 7ff074f30640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0700b0640 0x7ff07006f120 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7ff06000d800 tx=0x7ff06000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.205+0000 7ff065ffb640 1 -- 172.21.15.113:0/2412676211 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000b6c0 con 0x7ff0700b0640 2023-12-19T13:55:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.205+0000 7ff065ffb640 1 -- 172.21.15.113:0/2412676211 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000b820 con 0x7ff0700b0640 2023-12-19T13:55:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.205+0000 7ff065ffb640 1 -- 172.21.15.113:0/2412676211 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000bbb0 con 0x7ff0700b0640 2023-12-19T13:55:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.205+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0700acb00 con 0x7ff0700b0640 2023-12-19T13:55:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.205+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff070154f60 con 0x7ff0700b0640 2023-12-19T13:55:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.206+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff070061910 con 0x7ff0700b0640 2023-12-19T13:55:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.207+0000 7ff065ffb640 1 -- 172.21.15.113:0/2412676211 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff06000bd10 con 0x7ff0700b0640 2023-12-19T13:55:24.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.208+0000 7ff065ffb640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff05406a430 0x7ff05406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:24.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.208+0000 7ff065ffb640 1 -- 172.21.15.113:0/2412676211 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff060088e60 con 0x7ff0700b0640 2023-12-19T13:55:24.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.208+0000 7ff075731640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff05406a430 0x7ff05406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:24.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.209+0000 7ff075731640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff05406a430 0x7ff05406c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff06c036000 tx=0x7ff06c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.214+0000 7ff065ffb640 1 -- 172.21.15.113:0/2412676211 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff060054450 con 0x7ff0700b0640 2023-12-19T13:55:24.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:24.441+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff070154850 con 0x7ff0700b0640 2023-12-19T13:55:25.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.102+0000 7ff065ffb640 1 -- 172.21.15.113:0/2412676211 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff060057a70 con 0x7ff0700b0640 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.105+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff05406a430 msgr2=0x7ff05406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.105+0000 7ff077995640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff05406a430 0x7ff05406c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff06c036000 tx=0x7ff06c03c040 comp rx=0 tx=0).stop 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.105+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0700b0640 msgr2=0x7ff07006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.105+0000 7ff077995640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0700b0640 0x7ff07006f120 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7ff06000d800 tx=0x7ff06000dcc0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.105+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 shutdown_connections 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.105+0000 7ff077995640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff05406a430 0x7ff05406c8f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.105+0000 7ff077995640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff070157bf0 0x7ff0700cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.106+0000 7ff077995640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0700b0640 0x7ff07006f120 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.106+0000 7ff077995640 1 --2- 172.21.15.113:0/2412676211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0700ae110 0x7ff070154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.106+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 >> 172.21.15.113:0/2412676211 conn(0x7ff0700cbb70 msgr2=0x7ff0700caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:25.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.106+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 shutdown_connections 2023-12-19T13:55:25.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.106+0000 7ff077995640 1 -- 172.21.15.113:0/2412676211 wait complete. 2023-12-19T13:55:25.126 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:55:25.126 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:55:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.345+0000 7fcd78a41640 1 Processor -- start 2023-12-19T13:55:25.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.345+0000 7fcd78a41640 1 -- start start 2023-12-19T13:55:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd78a41640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd74157bf0 0x7fcd7415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd78a41640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7415b740 con 0x7fcd740b0810 2023-12-19T13:55:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd78a41640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd740ae640 con 0x7fcd740ae110 2023-12-19T13:55:25.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd78a41640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7406b8c0 con 0x7fcd74157bf0 2023-12-19T13:55:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd72d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcd740b0810 0x7fcd7406d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43670/0 (socket says 172.21.15.113:43670) 2023-12-19T13:55:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd72d9d640 1 -- 172.21.15.113:0/1831341994 learned_addr learned my addr 172.21.15.113:0/1831341994 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd7259c640 1 --2- 172.21.15.113:0/1831341994 >> v2:172.21.15.151:3300/0 conn(0x7fcd74157bf0 0x7fcd7415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.347+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382624365 0 0) 0x7fcd7415b740 con 0x7fcd740b0810 2023-12-19T13:55:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd5c003520 con 0x7fcd740b0810 2023-12-19T13:55:25.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2742472933 0 0) 0x7fcd5c003520 con 0x7fcd740b0810 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 >> v2:172.21.15.151:3300/0 conn(0x7fcd74157bf0 msgr2=0x7fcd7415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 --2- 172.21.15.113:0/1831341994 >> v2:172.21.15.151:3300/0 conn(0x7fcd74157bf0 0x7fcd7415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 >> v1:172.21.15.151:6789/0 conn(0x7fcd740ae110 legacy=0x7fcd740b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd740ae920 con 0x7fcd740b0810 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fcd6c0019f0 con 0x7fcd740b0810 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 >> v1:172.21.15.113:6789/0 conn(0x7fcd740b0810 legacy=0x7fcd7406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c003a30 0x7fcd5c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0051d0 0x7fcd5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7406b8c0 con 0x7fcd5c0051d0 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c00c100 con 0x7fcd5c0047c0 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c00e4d0 con 0x7fcd5c003a30 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.348+0000 7fcd72d9d640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0051d0 0x7fcd5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd7259c640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c003a30 0x7fcd5c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd71d9b640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd72d9d640 1 -- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c003a30 msgr2=0x7fcd5c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd72d9d640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c003a30 0x7fcd5c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd72d9d640 1 -- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd5c0047c0 msgr2=0x7fcd5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd72d9d640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd72d9d640 1 -- 172.21.15.113:0/1831341994 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c003520 con 0x7fcd5c0051d0 2023-12-19T13:55:25.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.349+0000 7fcd7259c640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c003a30 0x7fcd5c003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.350+0000 7fcd72d9d640 1 -- 172.21.15.113:0/1831341994 reap_dead start 2023-12-19T13:55:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.350+0000 7fcd72d9d640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0051d0 0x7fcd5c00b980 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00a760 tx=0x7fcd5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a470ba63b7f98120 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.350+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c034630 con 0x7fcd5c0051d0 2023-12-19T13:55:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.350+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c02f070 con 0x7fcd5c0051d0 2023-12-19T13:55:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.350+0000 7fcd7159a640 1 -- 172.21.15.113:0/1831341994 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c034a10 con 0x7fcd5c0051d0 2023-12-19T13:55:25.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.351+0000 7fcd78a41640 1 -- 172.21.15.113:0/1831341994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0051d0 msgr2=0x7fcd5c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:25.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.351+0000 7fcd78a41640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0051d0 0x7fcd5c00b980 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00a760 tx=0x7fcd5c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.351+0000 7fcd78a41640 1 -- 172.21.15.113:0/1831341994 shutdown_connections 2023-12-19T13:55:25.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.351+0000 7fcd78a41640 1 --2- 172.21.15.113:0/1831341994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0051d0 0x7fcd5c00b980 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.351+0000 7fcd78a41640 1 -- 172.21.15.113:0/1831341994 >> 172.21.15.113:0/1831341994 conn(0x7fcd740cbb70 msgr2=0x7fcd740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:25.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.351+0000 7fcd78a41640 1 -- 172.21.15.113:0/1831341994 shutdown_connections 2023-12-19T13:55:25.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.351+0000 7fcd78a41640 1 -- 172.21.15.113:0/1831341994 wait complete. 2023-12-19T13:55:25.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.353+0000 7fcd78a41640 1 Processor -- start 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.353+0000 7fcd78a41640 1 -- start start 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd78a41640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c0051d0 0x7fcd74151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd78a41640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd741f37c0 0x7fcd741f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd78a41640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd740acb20 0x7fcd7414d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd78a41640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74152870 con 0x7fcd740acb20 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd78a41640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74152b50 con 0x7fcd741f37c0 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd78a41640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74152e30 con 0x7fcd5c0051d0 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd72d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd740acb20 0x7fcd7414d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd72d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd740acb20 0x7fcd7414d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46096/0 (socket says 172.21.15.113:46096) 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd72d9d640 1 -- 172.21.15.113:0/2392309810 learned_addr learned my addr 172.21.15.113:0/2392309810 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd7259c640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c0051d0 0x7fcd74151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.354+0000 7fcd71d9b640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd741f37c0 0x7fcd741f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd72d9d640 1 -- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c0051d0 msgr2=0x7fcd74151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd72d9d640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c0051d0 0x7fcd74151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd72d9d640 1 -- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd741f37c0 msgr2=0x7fcd741f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd72d9d640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd741f37c0 0x7fcd741f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:25.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd72d9d640 1 -- 172.21.15.113:0/2392309810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd741f6100 con 0x7fcd740acb20 2023-12-19T13:55:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd72d9d640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd740acb20 0x7fcd7414d6b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c002230 tx=0x7fcd6c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2392309810 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c001730 con 0x7fcd740acb20 2023-12-19T13:55:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2392309810 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c001890 con 0x7fcd740acb20 2023-12-19T13:55:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2392309810 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c004da0 con 0x7fcd740acb20 2023-12-19T13:55:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd741f63e0 con 0x7fcd740acb20 2023-12-19T13:55:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.355+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd741f6e40 con 0x7fcd740acb20 2023-12-19T13:55:25.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.356+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd741f7030 con 0x7fcd740acb20 2023-12-19T13:55:25.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.357+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2392309810 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd6c031030 con 0x7fcd740acb20 2023-12-19T13:55:25.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.358+0000 7fcd62ffd640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd5406a460 0x7fcd5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:25.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.358+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2392309810 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd6c0a9d70 con 0x7fcd740acb20 2023-12-19T13:55:25.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.358+0000 7fcd7259c640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd5406a460 0x7fcd5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:25.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.359+0000 7fcd7259c640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd5406a460 0x7fcd5406c920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcd64009aa0 tx=0x7fcd64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:25.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.363+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2392309810 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcd6c0752c0 con 0x7fcd740acb20 2023-12-19T13:55:25.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:25.573+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcd74061910 con 0x7fcd740acb20 2023-12-19T13:55:26.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.104+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2392309810 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd6c0788e0 con 0x7fcd740acb20 2023-12-19T13:55:26.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.107+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd5406a460 msgr2=0x7fcd5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.107+0000 7fcd78a41640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd5406a460 0x7fcd5406c920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcd64009aa0 tx=0x7fcd64008040 comp rx=0 tx=0).stop 2023-12-19T13:55:26.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.107+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd740acb20 msgr2=0x7fcd7414d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd740acb20 0x7fcd7414d6b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c002230 tx=0x7fcd6c001cb0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 shutdown_connections 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd5406a460 0x7fcd5406c920 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd740acb20 0x7fcd7414d6b0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd741f37c0 0x7fcd741f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 --2- 172.21.15.113:0/2392309810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd5c0051d0 0x7fcd74151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 >> 172.21.15.113:0/2392309810 conn(0x7fcd740cbb70 msgr2=0x7fcd74156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 shutdown_connections 2023-12-19T13:55:26.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.108+0000 7fcd78a41640 1 -- 172.21.15.113:0/2392309810 wait complete. 2023-12-19T13:55:26.130 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:55:26.130 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:26.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.347+0000 7f10a3a5f640 1 Processor -- start 2023-12-19T13:55:26.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.347+0000 7f10a3a5f640 1 -- start start 2023-12-19T13:55:26.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.348+0000 7f10a3a5f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f109c161660 0x7f109c166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a3a5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f109c161a40 0x7f109c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a3a5f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109c165bc0 con 0x7f109c0afa50 2023-12-19T13:55:26.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a3a5f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c06e520 con 0x7f109c161a40 2023-12-19T13:55:26.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a3a5f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c0afef0 con 0x7f109c161660 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a1ffc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f109c161a40 0x7f109c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a1ffc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f109c161a40 0x7f109c0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46112/0 (socket says 172.21.15.113:46112) 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a1ffc640 1 -- 172.21.15.113:0/1056324191 learned_addr learned my addr 172.21.15.113:0/1056324191 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a17fb640 1 --2- 172.21.15.113:0/1056324191 >> v2:172.21.15.151:3300/0 conn(0x7f109c161660 0x7f109c166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a1ffc640 1 -- 172.21.15.113:0/1056324191 >> v2:172.21.15.151:3300/0 conn(0x7f109c161660 msgr2=0x7f109c166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a1ffc640 1 --2- 172.21.15.113:0/1056324191 >> v2:172.21.15.151:3300/0 conn(0x7f109c161660 0x7f109c166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a1ffc640 1 -- 172.21.15.113:0/1056324191 >> v1:172.21.15.151:6789/0 conn(0x7f109c0afa50 legacy=0x7f109c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.349+0000 7f10a1ffc640 1 -- 172.21.15.113:0/1056324191 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c165570 con 0x7f109c161a40 2023-12-19T13:55:26.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.350+0000 7f10a1ffc640 1 --2- 172.21.15.113:0/1056324191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c0b08c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f109c0cf010 tx=0x7f109402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f3a67ea6a1c80 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:26.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f1093fff640 1 -- 172.21.15.113:0/1056324191 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109402ca80 con 0x7f109c161a40 2023-12-19T13:55:26.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f1093fff640 1 -- 172.21.15.113:0/1056324191 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109402cbe0 con 0x7f109c161a40 2023-12-19T13:55:26.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f1093fff640 1 -- 172.21.15.113:0/1056324191 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940343f0 con 0x7f109c161a40 2023-12-19T13:55:26.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f10a3a5f640 1 -- 172.21.15.113:0/1056324191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 msgr2=0x7f109c0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/1056324191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c0b08c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f109c0cf010 tx=0x7f109402bee0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f10a3a5f640 1 -- 172.21.15.113:0/1056324191 shutdown_connections 2023-12-19T13:55:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/1056324191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c0b08c0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/1056324191 >> v2:172.21.15.151:3300/0 conn(0x7f109c161660 0x7f109c166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.351+0000 7f10a3a5f640 1 -- 172.21.15.113:0/1056324191 >> 172.21.15.113:0/1056324191 conn(0x7f109c0cbb70 msgr2=0x7f109c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.352+0000 7f10a3a5f640 1 -- 172.21.15.113:0/1056324191 shutdown_connections 2023-12-19T13:55:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.352+0000 7f10a3a5f640 1 -- 172.21.15.113:0/1056324191 wait complete. 2023-12-19T13:55:26.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.353+0000 7f10a3a5f640 1 Processor -- start 2023-12-19T13:55:26.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.353+0000 7f10a3a5f640 1 -- start start 2023-12-19T13:55:26.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.354+0000 7f10a3a5f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f109c0afa50 0x7f109c06c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.354+0000 7f10a3a5f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f109c161660 0x7f109c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.354+0000 7f10a3a5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.354+0000 7f10a3a5f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c06c680 con 0x7f109c161a40 2023-12-19T13:55:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.354+0000 7f10a3a5f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c06c900 con 0x7f109c0afa50 2023-12-19T13:55:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.354+0000 7f10a3a5f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c06cbe0 con 0x7f109c161660 2023-12-19T13:55:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c15d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46128/0 (socket says 172.21.15.113:46128) 2023-12-19T13:55:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 -- 172.21.15.113:0/272536296 learned_addr learned my addr 172.21.15.113:0/272536296 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a17fb640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f109c0afa50 0x7f109c06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a0ffa640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f109c161660 0x7f109c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 -- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f109c161660 msgr2=0x7f109c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f109c161660 0x7f109c15d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 -- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f109c0afa50 msgr2=0x7f109c06c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f109c0afa50 0x7f109c06c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 -- 172.21.15.113:0/272536296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094009b30 con 0x7f109c161a40 2023-12-19T13:55:26.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.355+0000 7f10a1ffc640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c15d7f0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1094036040 tx=0x7f1094004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:26.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.356+0000 7f1091ffb640 1 -- 172.21.15.113:0/272536296 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094009510 con 0x7f109c161a40 2023-12-19T13:55:26.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.356+0000 7f1091ffb640 1 -- 172.21.15.113:0/272536296 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109403e450 con 0x7f109c161a40 2023-12-19T13:55:26.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.356+0000 7f1091ffb640 1 -- 172.21.15.113:0/272536296 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109403e7e0 con 0x7f109c161a40 2023-12-19T13:55:26.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.356+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c06cec0 con 0x7f109c161a40 2023-12-19T13:55:26.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.356+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c1f69a0 con 0x7f109c161a40 2023-12-19T13:55:26.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.357+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c06d0e0 con 0x7f109c161a40 2023-12-19T13:55:26.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.358+0000 7f1091ffb640 1 -- 172.21.15.113:0/272536296 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f109402cd50 con 0x7f109c161a40 2023-12-19T13:55:26.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.359+0000 7f1091ffb640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f108006a430 0x7f108006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.359+0000 7f1091ffb640 1 -- 172.21.15.113:0/272536296 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10940ab440 con 0x7f109c161a40 2023-12-19T13:55:26.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.359+0000 7f10a17fb640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f108006a430 0x7f108006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.360+0000 7f10a17fb640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f108006a430 0x7f108006c8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1098006fd0 tx=0x7f1098008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:26.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.363+0000 7f1091ffb640 1 -- 172.21.15.113:0/272536296 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1094076a20 con 0x7f109c161a40 2023-12-19T13:55:26.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.588+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f109c146a10 con 0x7f109c161a40 2023-12-19T13:55:26.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.589+0000 7f1091ffb640 1 -- 172.21.15.113:0/272536296 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f109407a040 con 0x7f109c161a40 2023-12-19T13:55:26.589 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:26.590 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:55:23.075987+0000","modified":"2023-12-19T13:55:26.098528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8268":{"gid":8268,"name":"d","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1201018731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1201018731},{"type":"v1","addr":"172.21.15.151:6833","nonce":1201018731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T13:55:26.590 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 72 2023-12-19T13:55:26.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f108006a430 msgr2=0x7f108006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f108006a430 0x7f108006c8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1098006fd0 tx=0x7f1098008040 comp rx=0 tx=0).stop 2023-12-19T13:55:26.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 msgr2=0x7f109c15d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c15d7f0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1094036040 tx=0x7f1094004a40 comp rx=0 tx=0).stop 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 shutdown_connections 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f108006a430 0x7f108006c8f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f109c161a40 0x7f109c15d7f0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f109c161660 0x7f109c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 --2- 172.21.15.113:0/272536296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f109c0afa50 0x7f109c06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 >> 172.21.15.113:0/272536296 conn(0x7f109c0cbb70 msgr2=0x7f109c0aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 shutdown_connections 2023-12-19T13:55:26.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.593+0000 7f10a3a5f640 1 -- 172.21.15.113:0/272536296 wait complete. 2023-12-19T13:55:26.613 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:55:26.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.829+0000 7fdbc193d640 1 Processor -- start 2023-12-19T13:55:26.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.829+0000 7fdbc193d640 1 -- start start 2023-12-19T13:55:26.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.830+0000 7fdbc193d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc146e30 0x7fdbbc0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc193d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0d0c60 0x7fdbbc15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc193d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0b8300 con 0x7fdbbc0b7ea0 2023-12-19T13:55:26.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc193d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc147210 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc193d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0d10d0 con 0x7fdbbc146e30 2023-12-19T13:55:26.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc093b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc146e30 0x7fdbbc0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc113c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0d0c60 0x7fdbbc15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc113c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0d0c60 0x7fdbbc15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:58130/0 (socket says 172.21.15.113:58130) 2023-12-19T13:55:26.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.831+0000 7fdbc113c640 1 -- 172.21.15.113:0/3849297428 learned_addr learned my addr 172.21.15.113:0/3849297428 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:26.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.832+0000 7fdbc113c640 1 -- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc146e30 msgr2=0x7fdbbc0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:26.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.832+0000 7fdbc113c640 1 --2- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc146e30 0x7fdbbc0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.832+0000 7fdbc113c640 1 -- 172.21.15.113:0/3849297428 >> v1:172.21.15.151:6789/0 conn(0x7fdbbc0b7ea0 legacy=0x7fdbbc0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.832+0000 7fdbc113c640 1 -- 172.21.15.113:0/3849297428 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0d12d0 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.832+0000 7fdbc093b640 1 --2- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc146e30 0x7fdbbc0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:55:26.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.834+0000 7fdbc113c640 1 --2- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc15d870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009e50 tx=0x7fdbb402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8573ff98ef574d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:26.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.834+0000 7fdbbb7fe640 1 -- 172.21.15.113:0/3849297428 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb402ca70 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.834+0000 7fdbbb7fe640 1 -- 172.21.15.113:0/3849297428 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb402cbd0 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.834+0000 7fdbbb7fe640 1 -- 172.21.15.113:0/3849297428 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40343f0 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 -- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc0d0c60 msgr2=0x7fdbbc15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 --2- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc15d870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009e50 tx=0x7fdbb402bed0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 -- 172.21.15.113:0/3849297428 shutdown_connections 2023-12-19T13:55:26.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 --2- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc15d870 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 --2- 172.21.15.113:0/3849297428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc146e30 0x7fdbbc0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 -- 172.21.15.113:0/3849297428 >> 172.21.15.113:0/3849297428 conn(0x7fdbbc0b2990 msgr2=0x7fdbbc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:26.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 -- 172.21.15.113:0/3849297428 shutdown_connections 2023-12-19T13:55:26.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.835+0000 7fdbc193d640 1 -- 172.21.15.113:0/3849297428 wait complete. 2023-12-19T13:55:26.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.838+0000 7fdbc193d640 1 Processor -- start 2023-12-19T13:55:26.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.838+0000 7fdbc193d640 1 -- start start 2023-12-19T13:55:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbc193d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b7ea0 0x7fdbbc1e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbc193d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc1e1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbc193d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc146e30 0x7fdbbc1e1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbc193d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc1e5a30 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbc193d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc1de310 con 0x7fdbbc146e30 2023-12-19T13:55:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbc193d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc1e00d0 con 0x7fdbbc0b7ea0 2023-12-19T13:55:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbbbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc1e1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbbbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc1e1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46134/0 (socket says 172.21.15.113:46134) 2023-12-19T13:55:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.839+0000 7fdbbbfff640 1 -- 172.21.15.113:0/2510521253 learned_addr learned my addr 172.21.15.113:0/2510521253 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbc113c640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc146e30 0x7fdbbc1e1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbc093b640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b7ea0 0x7fdbbc1e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbbbfff640 1 -- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b7ea0 msgr2=0x7fdbbc1e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbbbfff640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b7ea0 0x7fdbbc1e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbbbfff640 1 -- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc146e30 msgr2=0x7fdbbc1e1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbbbfff640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc146e30 0x7fdbbc1e1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbbbfff640 1 -- 172.21.15.113:0/2510521253 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb0009400 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbbbfff640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc1e1210 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fdba800c430 tx=0x7fdba800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:26.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.840+0000 7fdbb97fa640 1 -- 172.21.15.113:0/2510521253 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba80052d0 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.841+0000 7fdbb97fa640 1 -- 172.21.15.113:0/2510521253 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8005430 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.841+0000 7fdbb97fa640 1 -- 172.21.15.113:0/2510521253 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8003830 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.841+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb4009b30 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.841+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc1e0690 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.842+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc1e5b70 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.843+0000 7fdbb97fa640 1 -- 172.21.15.113:0/2510521253 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdba8003990 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.844+0000 7fdbb97fa640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdba006a430 0x7fdba006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:26.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.844+0000 7fdbb97fa640 1 -- 172.21.15.113:0/2510521253 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdba8087df0 con 0x7fdbbc0d0c60 2023-12-19T13:55:26.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.844+0000 7fdbc093b640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdba006a430 0x7fdba006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:26.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.845+0000 7fdbc093b640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdba006a430 0x7fdba006c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009c60 tx=0x7fdbb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:26.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:26.848+0000 7fdbb97fa640 1 -- 172.21.15.113:0/2510521253 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdbbc1e5b70 con 0x7fdbbc0d0c60 2023-12-19T13:55:27.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.042+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbbc1e5b70 con 0x7fdbbc0d0c60 2023-12-19T13:55:27.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.044+0000 7fdbb97fa640 1 -- 172.21.15.113:0/2510521253 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16108 (secure 0 0 0) 0x7fdbbc1e5b70 con 0x7fdbbc0d0c60 2023-12-19T13:55:27.044 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:27.045 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":163,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:55:24.079898+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:55:27.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.046+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdba006a430 msgr2=0x7fdba006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.046+0000 7fdbc193d640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdba006a430 0x7fdba006c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009c60 tx=0x7fdbb0008040 comp rx=0 tx=0).stop 2023-12-19T13:55:27.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbbc0d0c60 msgr2=0x7fdbbc1e1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc1e1210 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fdba800c430 tx=0x7fdba800c8f0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 shutdown_connections 2023-12-19T13:55:27.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdba006a430 0x7fdba006c8f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc146e30 0x7fdbbc1e1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbbc0d0c60 0x7fdbbc1e1210 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 --2- 172.21.15.113:0/2510521253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b7ea0 0x7fdbbc1e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 >> 172.21.15.113:0/2510521253 conn(0x7fdbbc0b2990 msgr2=0x7fdbbc1e86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:27.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 shutdown_connections 2023-12-19T13:55:27.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.047+0000 7fdbc193d640 1 -- 172.21.15.113:0/2510521253 wait complete. 2023-12-19T13:55:27.066 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:55:27.067 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:55:27.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.286+0000 7f1d05e3e640 1 Processor -- start 2023-12-19T13:55:27.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.286+0000 7f1d05e3e640 1 -- start start 2023-12-19T13:55:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1d05e3e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d000b0b50 0x7f1d0006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1d05e3e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1d0006b590 0x7f1d0006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1d05e3e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0006bb30 con 0x7f1d001449e0 2023-12-19T13:55:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1d05e3e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d000b0070 con 0x7f1d000b0b50 2023-12-19T13:55:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1d05e3e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d000b0350 con 0x7f1d0006b590 2023-12-19T13:55:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1cfeffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d000b0b50 0x7f1d0006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1cfeffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1d000b0b50 0x7f1d0006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46136/0 (socket says 172.21.15.113:46136) 2023-12-19T13:55:27.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.288+0000 7f1cfeffd640 1 -- 172.21.15.113:0/2202269151 learned_addr learned my addr 172.21.15.113:0/2202269151 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.289+0000 7f1cfeffd640 1 -- 172.21.15.113:0/2202269151 >> v2:172.21.15.151:3300/0 conn(0x7f1d0006b590 msgr2=0x7f1d0006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.289+0000 7f1cfffff640 1 --2- 172.21.15.113:0/2202269151 >> v2:172.21.15.151:3300/0 conn(0x7f1d0006b590 0x7f1d0006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.289+0000 7f1cfeffd640 1 --2- 172.21.15.113:0/2202269151 >> v2:172.21.15.151:3300/0 conn(0x7f1d0006b590 0x7f1d0006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.289+0000 7f1cfeffd640 1 -- 172.21.15.113:0/2202269151 >> v1:172.21.15.151:6789/0 conn(0x7f1d001449e0 legacy=0x7f1d000af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.289+0000 7f1cfeffd640 1 -- 172.21.15.113:0/2202269151 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000b0630 con 0x7f1d000b0b50 2023-12-19T13:55:27.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.289+0000 7f1cfffff640 1 --2- 172.21.15.113:0/2202269151 >> v2:172.21.15.151:3300/0 conn(0x7f1d0006b590 0x7f1d0006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.290+0000 7f1cfeffd640 1 --2- 172.21.15.113:0/2202269151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d000b0b50 0x7f1d0006bfa0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1d000b1270 tx=0x7f1cf402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5185460b435f7c0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.290+0000 7f1cfe7fc640 1 -- 172.21.15.113:0/2202269151 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4031870 con 0x7f1d000b0b50 2023-12-19T13:55:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.290+0000 7f1cfe7fc640 1 -- 172.21.15.113:0/2202269151 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf40319d0 con 0x7f1d000b0b50 2023-12-19T13:55:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.290+0000 7f1cfe7fc640 1 -- 172.21.15.113:0/2202269151 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4031d60 con 0x7f1d000b0b50 2023-12-19T13:55:27.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 -- 172.21.15.113:0/2202269151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d000b0b50 msgr2=0x7f1d0006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/2202269151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d000b0b50 0x7f1d0006bfa0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1d000b1270 tx=0x7f1cf402b910 comp rx=0 tx=0).stop 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 -- 172.21.15.113:0/2202269151 shutdown_connections 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/2202269151 >> v2:172.21.15.151:3300/0 conn(0x7f1d0006b590 0x7f1d0006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/2202269151 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d000b0b50 0x7f1d0006bfa0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 -- 172.21.15.113:0/2202269151 >> 172.21.15.113:0/2202269151 conn(0x7f1d000cbb70 msgr2=0x7f1d000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 -- 172.21.15.113:0/2202269151 shutdown_connections 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.291+0000 7f1d05e3e640 1 -- 172.21.15.113:0/2202269151 wait complete. 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.293+0000 7f1d05e3e640 1 Processor -- start 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.293+0000 7f1d05e3e640 1 -- start start 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1d05e3e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d0006b590 0x7f1d0015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1d05e3e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d000b0b50 0x7f1d00140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1d05e3e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d001449e0 0x7f1d00140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1d05e3e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0015d2d0 con 0x7f1d0006b590 2023-12-19T13:55:27.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1d05e3e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0015c750 con 0x7f1d001449e0 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1d05e3e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0015ca30 con 0x7f1d000b0b50 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1cff7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d0006b590 0x7f1d0015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1cff7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d0006b590 0x7f1d0015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46148/0 (socket says 172.21.15.113:46148) 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.294+0000 7f1cff7fe640 1 -- 172.21.15.113:0/3330272269 learned_addr learned my addr 172.21.15.113:0/3330272269 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1cfffff640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d001449e0 0x7f1d00140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1cff7fe640 1 -- 172.21.15.113:0/3330272269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d000b0b50 msgr2=0x7f1d00140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1cff7fe640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d000b0b50 0x7f1d00140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1cff7fe640 1 -- 172.21.15.113:0/3330272269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d001449e0 msgr2=0x7f1d00140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1cff7fe640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d001449e0 0x7f1d00140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1cff7fe640 1 -- 172.21.15.113:0/3330272269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40094d0 con 0x7f1d0006b590 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1cff7fe640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d0006b590 0x7f1d0015abe0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000b3e0 tx=0x7f1cf000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:27.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1ce7fff640 1 -- 172.21.15.113:0/3330272269 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0011830 con 0x7f1d0006b590 2023-12-19T13:55:27.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1ce7fff640 1 -- 172.21.15.113:0/3330272269 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf00119b0 con 0x7f1d0006b590 2023-12-19T13:55:27.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1ce7fff640 1 -- 172.21.15.113:0/3330272269 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0011d60 con 0x7f1d0006b590 2023-12-19T13:55:27.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.295+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0015cd10 con 0x7f1d0006b590 2023-12-19T13:55:27.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.296+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0015b120 con 0x7f1d0006b590 2023-12-19T13:55:27.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.297+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d00061910 con 0x7f1d0006b590 2023-12-19T13:55:27.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.297+0000 7f1ce7fff640 1 -- 172.21.15.113:0/3330272269 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cf001a400 con 0x7f1d0006b590 2023-12-19T13:55:27.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.298+0000 7f1ce7fff640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cec06a460 0x7f1cec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.298+0000 7f1ce7fff640 1 -- 172.21.15.113:0/3330272269 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cf0088aa0 con 0x7f1d0006b590 2023-12-19T13:55:27.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.299+0000 7f1cfeffd640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cec06a460 0x7f1cec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.299+0000 7f1cfeffd640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cec06a460 0x7f1cec06c920 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4036000 tx=0x7f1cf4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:27.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.303+0000 7f1ce7fff640 1 -- 172.21.15.113:0/3330272269 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cf0054080 con 0x7f1d0006b590 2023-12-19T13:55:27.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.491+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d000b1710 con 0x7f1cec06a460 2023-12-19T13:55:27.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.514+0000 7f1ce7fff640 1 -- 172.21.15.113:0/3330272269 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282792 (secure 0 0 0) 0x7f1cf4031c40 con 0x7f1cec06a460 2023-12-19T13:55:27.519 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:27.521 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:55:27.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cec06a460 msgr2=0x7f1cec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cec06a460 0x7f1cec06c920 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4036000 tx=0x7f1cf4030000 comp rx=0 tx=0).stop 2023-12-19T13:55:27.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d0006b590 msgr2=0x7f1d0015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d0006b590 0x7f1d0015abe0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000b3e0 tx=0x7f1cf000b8a0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 shutdown_connections 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1cec06a460 0x7f1cec06c920 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d001449e0 0x7f1d00140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d000b0b50 0x7f1d00140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 --2- 172.21.15.113:0/3330272269 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d0006b590 0x7f1d0015abe0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 >> 172.21.15.113:0/3330272269 conn(0x7f1d000cbb70 msgr2=0x7f1d000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 shutdown_connections 2023-12-19T13:55:27.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.521+0000 7f1d05e3e640 1 -- 172.21.15.113:0/3330272269 wait complete. 2023-12-19T13:55:27.541 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":428,"stamp":"2023-12-19T13:55:26.584683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8293,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554206,"statfs":{"total":1600000000,"available":1591507328,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.010583"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088035+0000","last_change":"2023-12-19T13:55:23.109030+0000","last_active":"2023-12-19T13:55:24.088035+0000","last_peered":"2023-12-19T13:55:24.088035+0000","last_clean":"2023-12-19T13:55:24.088035+0000","last_became_active":"2023-12-19T13:55:23.108311+0000","last_became_peered":"2023-12-19T13:55:23.108311+0000","last_unstale":"2023-12-19T13:55:24.088035+0000","last_undegraded":"2023-12-19T13:55:24.088035+0000","last_fullsized":"2023-12-19T13:55:24.088035+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:28.428312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088546+0000","last_change":"2023-12-19T13:55:23.114140+0000","last_active":"2023-12-19T13:55:24.088546+0000","last_peered":"2023-12-19T13:55:24.088546+0000","last_clean":"2023-12-19T13:55:24.088546+0000","last_became_active":"2023-12-19T13:55:23.113668+0000","last_became_peered":"2023-12-19T13:55:23.113668+0000","last_unstale":"2023-12-19T13:55:24.088546+0000","last_undegraded":"2023-12-19T13:55:24.088546+0000","last_fullsized":"2023-12-19T13:55:24.088546+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:36:23.320500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698196+0000","last_change":"2023-12-19T13:55:23.095845+0000","last_active":"2023-12-19T13:55:24.698196+0000","last_peered":"2023-12-19T13:55:24.698196+0000","last_clean":"2023-12-19T13:55:24.698196+0000","last_became_active":"2023-12-19T13:55:23.095637+0000","last_became_peered":"2023-12-19T13:55:23.095637+0000","last_unstale":"2023-12-19T13:55:24.698196+0000","last_undegraded":"2023-12-19T13:55:24.698196+0000","last_fullsized":"2023-12-19T13:55:24.698196+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:16.950240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695401+0000","last_change":"2023-12-19T13:55:23.105256+0000","last_active":"2023-12-19T13:55:24.695401+0000","last_peered":"2023-12-19T13:55:24.695401+0000","last_clean":"2023-12-19T13:55:24.695401+0000","last_became_active":"2023-12-19T13:55:23.105064+0000","last_became_peered":"2023-12-19T13:55:23.105064+0000","last_unstale":"2023-12-19T13:55:24.695401+0000","last_undegraded":"2023-12-19T13:55:24.695401+0000","last_fullsized":"2023-12-19T13:55:24.695401+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:51.527820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090150+0000","last_change":"2023-12-19T13:55:23.116380+0000","last_active":"2023-12-19T13:55:24.090150+0000","last_peered":"2023-12-19T13:55:24.090150+0000","last_clean":"2023-12-19T13:55:24.090150+0000","last_became_active":"2023-12-19T13:55:23.116162+0000","last_became_peered":"2023-12-19T13:55:23.116162+0000","last_unstale":"2023-12-19T13:55:24.090150+0000","last_undegraded":"2023-12-19T13:55:24.090150+0000","last_fullsized":"2023-12-19T13:55:24.090150+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:23.875461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695653+0000","last_change":"2023-12-19T13:55:23.114248+0000","last_active":"2023-12-19T13:55:24.695653+0000","last_peered":"2023-12-19T13:55:24.695653+0000","last_clean":"2023-12-19T13:55:24.695653+0000","last_became_active":"2023-12-19T13:55:23.112089+0000","last_became_peered":"2023-12-19T13:55:23.112089+0000","last_unstale":"2023-12-19T13:55:24.695653+0000","last_undegraded":"2023-12-19T13:55:24.695653+0000","last_fullsized":"2023-12-19T13:55:24.695653+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:08.149290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089819+0000","last_change":"2023-12-19T13:55:23.110851+0000","last_active":"2023-12-19T13:55:24.089819+0000","last_peered":"2023-12-19T13:55:24.089819+0000","last_clean":"2023-12-19T13:55:24.089819+0000","last_became_active":"2023-12-19T13:55:23.110629+0000","last_became_peered":"2023-12-19T13:55:23.110629+0000","last_unstale":"2023-12-19T13:55:24.089819+0000","last_undegraded":"2023-12-19T13:55:24.089819+0000","last_fullsized":"2023-12-19T13:55:24.089819+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:26.586823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089682+0000","last_change":"2023-12-19T13:55:23.104563+0000","last_active":"2023-12-19T13:55:24.089682+0000","last_peered":"2023-12-19T13:55:24.089682+0000","last_clean":"2023-12-19T13:55:24.089682+0000","last_became_active":"2023-12-19T13:55:23.104280+0000","last_became_peered":"2023-12-19T13:55:23.104280+0000","last_unstale":"2023-12-19T13:55:24.089682+0000","last_undegraded":"2023-12-19T13:55:24.089682+0000","last_fullsized":"2023-12-19T13:55:24.089682+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:31.266898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695481+0000","last_change":"2023-12-19T13:55:23.097358+0000","last_active":"2023-12-19T13:55:24.695481+0000","last_peered":"2023-12-19T13:55:24.695481+0000","last_clean":"2023-12-19T13:55:24.695481+0000","last_became_active":"2023-12-19T13:55:23.094209+0000","last_became_peered":"2023-12-19T13:55:23.094209+0000","last_unstale":"2023-12-19T13:55:24.695481+0000","last_undegraded":"2023-12-19T13:55:24.695481+0000","last_fullsized":"2023-12-19T13:55:24.695481+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:42.689584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.087821+0000","last_change":"2023-12-19T13:55:23.109043+0000","last_active":"2023-12-19T13:55:24.087821+0000","last_peered":"2023-12-19T13:55:24.087821+0000","last_clean":"2023-12-19T13:55:24.087821+0000","last_became_active":"2023-12-19T13:55:23.108384+0000","last_became_peered":"2023-12-19T13:55:23.108384+0000","last_unstale":"2023-12-19T13:55:24.087821+0000","last_undegraded":"2023-12-19T13:55:24.087821+0000","last_fullsized":"2023-12-19T13:55:24.087821+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:01:42.623800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695926+0000","last_change":"2023-12-19T13:55:23.098811+0000","last_active":"2023-12-19T13:55:24.695926+0000","last_peered":"2023-12-19T13:55:24.695926+0000","last_clean":"2023-12-19T13:55:24.695926+0000","last_became_active":"2023-12-19T13:55:23.098570+0000","last_became_peered":"2023-12-19T13:55:23.098570+0000","last_unstale":"2023-12-19T13:55:24.695926+0000","last_undegraded":"2023-12-19T13:55:24.695926+0000","last_fullsized":"2023-12-19T13:55:24.695926+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:04.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696672+0000","last_change":"2023-12-19T13:55:23.112932+0000","last_active":"2023-12-19T13:55:24.696672+0000","last_peered":"2023-12-19T13:55:24.696672+0000","last_clean":"2023-12-19T13:55:24.696672+0000","last_became_active":"2023-12-19T13:55:23.107702+0000","last_became_peered":"2023-12-19T13:55:23.107702+0000","last_unstale":"2023-12-19T13:55:24.696672+0000","last_undegraded":"2023-12-19T13:55:24.696672+0000","last_fullsized":"2023-12-19T13:55:24.696672+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:29.143561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695815+0000","last_change":"2023-12-19T13:55:23.090310+0000","last_active":"2023-12-19T13:55:24.695815+0000","last_peered":"2023-12-19T13:55:24.695815+0000","last_clean":"2023-12-19T13:55:24.695815+0000","last_became_active":"2023-12-19T13:55:23.090011+0000","last_became_peered":"2023-12-19T13:55:23.090011+0000","last_unstale":"2023-12-19T13:55:24.695815+0000","last_undegraded":"2023-12-19T13:55:24.695815+0000","last_fullsized":"2023-12-19T13:55:24.695815+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:42.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231401+0000","last_change":"2023-12-19T13:55:23.098175+0000","last_active":"2023-12-19T13:55:24.231401+0000","last_peered":"2023-12-19T13:55:24.231401+0000","last_clean":"2023-12-19T13:55:24.231401+0000","last_became_active":"2023-12-19T13:55:23.097862+0000","last_became_peered":"2023-12-19T13:55:23.097862+0000","last_unstale":"2023-12-19T13:55:24.231401+0000","last_undegraded":"2023-12-19T13:55:24.231401+0000","last_fullsized":"2023-12-19T13:55:24.231401+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:19.039260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090689+0000","last_change":"2023-12-19T13:55:23.111436+0000","last_active":"2023-12-19T13:55:24.090689+0000","last_peered":"2023-12-19T13:55:24.090689+0000","last_clean":"2023-12-19T13:55:24.090689+0000","last_became_active":"2023-12-19T13:55:23.111160+0000","last_became_peered":"2023-12-19T13:55:23.111160+0000","last_unstale":"2023-12-19T13:55:24.090689+0000","last_undegraded":"2023-12-19T13:55:24.090689+0000","last_fullsized":"2023-12-19T13:55:24.090689+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:08.944157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231665+0000","last_change":"2023-12-19T13:55:23.104338+0000","last_active":"2023-12-19T13:55:24.231665+0000","last_peered":"2023-12-19T13:55:24.231665+0000","last_clean":"2023-12-19T13:55:24.231665+0000","last_became_active":"2023-12-19T13:55:23.104120+0000","last_became_peered":"2023-12-19T13:55:23.104120+0000","last_unstale":"2023-12-19T13:55:24.231665+0000","last_undegraded":"2023-12-19T13:55:24.231665+0000","last_fullsized":"2023-12-19T13:55:24.231665+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:13.157395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697208+0000","last_change":"2023-12-19T13:55:23.092778+0000","last_active":"2023-12-19T13:55:24.697208+0000","last_peered":"2023-12-19T13:55:24.697208+0000","last_clean":"2023-12-19T13:55:24.697208+0000","last_became_active":"2023-12-19T13:55:23.092489+0000","last_became_peered":"2023-12-19T13:55:23.092489+0000","last_unstale":"2023-12-19T13:55:24.697208+0000","last_undegraded":"2023-12-19T13:55:24.697208+0000","last_fullsized":"2023-12-19T13:55:24.697208+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:10.792506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089764+0000","last_change":"2023-12-19T13:55:23.094408+0000","last_active":"2023-12-19T13:55:24.089764+0000","last_peered":"2023-12-19T13:55:24.089764+0000","last_clean":"2023-12-19T13:55:24.089764+0000","last_became_active":"2023-12-19T13:55:23.094157+0000","last_became_peered":"2023-12-19T13:55:23.094157+0000","last_unstale":"2023-12-19T13:55:24.089764+0000","last_undegraded":"2023-12-19T13:55:24.089764+0000","last_fullsized":"2023-12-19T13:55:24.089764+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:31.266898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.087809+0000","last_change":"2023-12-19T13:55:23.110018+0000","last_active":"2023-12-19T13:55:24.087809+0000","last_peered":"2023-12-19T13:55:24.087809+0000","last_clean":"2023-12-19T13:55:24.087809+0000","last_became_active":"2023-12-19T13:55:23.109604+0000","last_became_peered":"2023-12-19T13:55:23.109604+0000","last_unstale":"2023-12-19T13:55:24.087809+0000","last_undegraded":"2023-12-19T13:55:24.087809+0000","last_fullsized":"2023-12-19T13:55:24.087809+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:52.619721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.091098+0000","last_change":"2023-12-19T13:55:23.097997+0000","last_active":"2023-12-19T13:55:24.091098+0000","last_peered":"2023-12-19T13:55:24.091098+0000","last_clean":"2023-12-19T13:55:24.091098+0000","last_became_active":"2023-12-19T13:55:23.097760+0000","last_became_peered":"2023-12-19T13:55:23.097760+0000","last_unstale":"2023-12-19T13:55:24.091098+0000","last_undegraded":"2023-12-19T13:55:24.091098+0000","last_fullsized":"2023-12-19T13:55:24.091098+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:55.635662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695893+0000","last_change":"2023-12-19T13:55:23.114537+0000","last_active":"2023-12-19T13:55:24.695893+0000","last_peered":"2023-12-19T13:55:24.695893+0000","last_clean":"2023-12-19T13:55:24.695893+0000","last_became_active":"2023-12-19T13:55:23.112356+0000","last_became_peered":"2023-12-19T13:55:23.112356+0000","last_unstale":"2023-12-19T13:55:24.695893+0000","last_undegraded":"2023-12-19T13:55:24.695893+0000","last_fullsized":"2023-12-19T13:55:24.695893+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:55.635662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088791+0000","last_change":"2023-12-19T13:55:23.096152+0000","last_active":"2023-12-19T13:55:24.088791+0000","last_peered":"2023-12-19T13:55:24.088791+0000","last_clean":"2023-12-19T13:55:24.088791+0000","last_became_active":"2023-12-19T13:55:23.095495+0000","last_became_peered":"2023-12-19T13:55:23.095495+0000","last_unstale":"2023-12-19T13:55:24.088791+0000","last_undegraded":"2023-12-19T13:55:24.088791+0000","last_fullsized":"2023-12-19T13:55:24.088791+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:43.926042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695859+0000","last_change":"2023-12-19T13:55:23.112079+0000","last_active":"2023-12-19T13:55:24.695859+0000","last_peered":"2023-12-19T13:55:24.695859+0000","last_clean":"2023-12-19T13:55:24.695859+0000","last_became_active":"2023-12-19T13:55:23.111861+0000","last_became_peered":"2023-12-19T13:55:23.111861+0000","last_unstale":"2023-12-19T13:55:24.695859+0000","last_undegraded":"2023-12-19T13:55:24.695859+0000","last_fullsized":"2023-12-19T13:55:24.695859+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:17.565114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090075+0000","last_change":"2023-12-19T13:55:23.102707+0000","last_active":"2023-12-19T13:55:24.090075+0000","last_peered":"2023-12-19T13:55:24.090075+0000","last_clean":"2023-12-19T13:55:24.090075+0000","last_became_active":"2023-12-19T13:55:23.102316+0000","last_became_peered":"2023-12-19T13:55:23.102316+0000","last_unstale":"2023-12-19T13:55:24.090075+0000","last_undegraded":"2023-12-19T13:55:24.090075+0000","last_fullsized":"2023-12-19T13:55:24.090075+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:02.490924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695848+0000","last_change":"2023-12-19T13:55:23.090999+0000","last_active":"2023-12-19T13:55:24.695848+0000","last_peered":"2023-12-19T13:55:24.695848+0000","last_clean":"2023-12-19T13:55:24.695848+0000","last_became_active":"2023-12-19T13:55:23.088258+0000","last_became_peered":"2023-12-19T13:55:23.088258+0000","last_unstale":"2023-12-19T13:55:24.695848+0000","last_undegraded":"2023-12-19T13:55:24.695848+0000","last_fullsized":"2023-12-19T13:55:24.695848+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:03:30.372109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088291+0000","last_change":"2023-12-19T13:55:23.092319+0000","last_active":"2023-12-19T13:55:24.088291+0000","last_peered":"2023-12-19T13:55:24.088291+0000","last_clean":"2023-12-19T13:55:24.088291+0000","last_became_active":"2023-12-19T13:55:23.092106+0000","last_became_peered":"2023-12-19T13:55:23.092106+0000","last_unstale":"2023-12-19T13:55:24.088291+0000","last_undegraded":"2023-12-19T13:55:24.088291+0000","last_fullsized":"2023-12-19T13:55:24.088291+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:04.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231666+0000","last_change":"2023-12-19T13:55:23.109491+0000","last_active":"2023-12-19T13:55:24.231666+0000","last_peered":"2023-12-19T13:55:24.231666+0000","last_clean":"2023-12-19T13:55:24.231666+0000","last_became_active":"2023-12-19T13:55:23.109165+0000","last_became_peered":"2023-12-19T13:55:23.109165+0000","last_unstale":"2023-12-19T13:55:24.231666+0000","last_undegraded":"2023-12-19T13:55:24.231666+0000","last_fullsized":"2023-12-19T13:55:24.231666+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:08.149290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.694971+0000","last_change":"2023-12-19T13:55:23.102781+0000","last_active":"2023-12-19T13:55:24.694971+0000","last_peered":"2023-12-19T13:55:24.694971+0000","last_clean":"2023-12-19T13:55:24.694971+0000","last_became_active":"2023-12-19T13:55:23.102374+0000","last_became_peered":"2023-12-19T13:55:23.102374+0000","last_unstale":"2023-12-19T13:55:24.694971+0000","last_undegraded":"2023-12-19T13:55:24.694971+0000","last_fullsized":"2023-12-19T13:55:24.694971+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:50.090700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.087543+0000","last_change":"2023-12-19T13:55:23.098918+0000","last_active":"2023-12-19T13:55:24.087543+0000","last_peered":"2023-12-19T13:55:24.087543+0000","last_clean":"2023-12-19T13:55:24.087543+0000","last_became_active":"2023-12-19T13:55:23.098657+0000","last_became_peered":"2023-12-19T13:55:23.098657+0000","last_unstale":"2023-12-19T13:55:24.087543+0000","last_undegraded":"2023-12-19T13:55:24.087543+0000","last_fullsized":"2023-12-19T13:55:24.087543+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:09.691437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088813+0000","last_change":"2023-12-19T13:55:23.091572+0000","last_active":"2023-12-19T13:55:24.088813+0000","last_peered":"2023-12-19T13:55:24.088813+0000","last_clean":"2023-12-19T13:55:24.088813+0000","last_became_active":"2023-12-19T13:55:23.091331+0000","last_became_peered":"2023-12-19T13:55:23.091331+0000","last_unstale":"2023-12-19T13:55:24.088813+0000","last_undegraded":"2023-12-19T13:55:24.088813+0000","last_fullsized":"2023-12-19T13:55:24.088813+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:51.527820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696117+0000","last_change":"2023-12-19T13:55:23.095266+0000","last_active":"2023-12-19T13:55:24.696117+0000","last_peered":"2023-12-19T13:55:24.696117+0000","last_clean":"2023-12-19T13:55:24.696117+0000","last_became_active":"2023-12-19T13:55:23.094158+0000","last_became_peered":"2023-12-19T13:55:23.094158+0000","last_unstale":"2023-12-19T13:55:24.696117+0000","last_undegraded":"2023-12-19T13:55:24.696117+0000","last_fullsized":"2023-12-19T13:55:24.696117+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:54.202203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697436+0000","last_change":"2023-12-19T13:55:23.093275+0000","last_active":"2023-12-19T13:55:24.697436+0000","last_peered":"2023-12-19T13:55:24.697436+0000","last_clean":"2023-12-19T13:55:24.697436+0000","last_became_active":"2023-12-19T13:55:23.093037+0000","last_became_peered":"2023-12-19T13:55:23.093037+0000","last_unstale":"2023-12-19T13:55:24.697436+0000","last_undegraded":"2023-12-19T13:55:24.697436+0000","last_fullsized":"2023-12-19T13:55:24.697436+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:42.427130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231676+0000","last_change":"2023-12-19T13:55:23.103693+0000","last_active":"2023-12-19T13:55:24.231676+0000","last_peered":"2023-12-19T13:55:24.231676+0000","last_clean":"2023-12-19T13:55:24.231676+0000","last_became_active":"2023-12-19T13:55:23.103445+0000","last_became_peered":"2023-12-19T13:55:23.103445+0000","last_unstale":"2023-12-19T13:55:24.231676+0000","last_undegraded":"2023-12-19T13:55:24.231676+0000","last_fullsized":"2023-12-19T13:55:24.231676+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:06.275917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"162'4","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089763+0000","last_change":"2023-12-19T13:55:22.619901+0000","last_active":"2023-12-19T13:55:24.089763+0000","last_peered":"2023-12-19T13:55:24.089763+0000","last_clean":"2023-12-19T13:55:24.089763+0000","last_became_active":"2023-12-19T13:55:22.619486+0000","last_became_peered":"2023-12-19T13:55:22.619486+0000","last_unstale":"2023-12-19T13:55:24.089763+0000","last_undegraded":"2023-12-19T13:55:24.089763+0000","last_fullsized":"2023-12-19T13:55:24.089763+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:45.489463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698428+0000","last_change":"2023-12-19T13:55:23.091930+0000","last_active":"2023-12-19T13:55:24.698428+0000","last_peered":"2023-12-19T13:55:24.698428+0000","last_clean":"2023-12-19T13:55:24.698428+0000","last_became_active":"2023-12-19T13:55:23.091640+0000","last_became_peered":"2023-12-19T13:55:23.091640+0000","last_unstale":"2023-12-19T13:55:24.698428+0000","last_undegraded":"2023-12-19T13:55:24.698428+0000","last_fullsized":"2023-12-19T13:55:24.698428+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:07.639191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695971+0000","last_change":"2023-12-19T13:55:22.616173+0000","last_active":"2023-12-19T13:55:24.695971+0000","last_peered":"2023-12-19T13:55:24.695971+0000","last_clean":"2023-12-19T13:55:24.695971+0000","last_became_active":"2023-12-19T13:55:22.615777+0000","last_became_peered":"2023-12-19T13:55:22.615777+0000","last_unstale":"2023-12-19T13:55:24.695971+0000","last_undegraded":"2023-12-19T13:55:24.695971+0000","last_fullsized":"2023-12-19T13:55:24.695971+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:21.983634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697193+0000","last_change":"2023-12-19T13:55:23.092438+0000","last_active":"2023-12-19T13:55:24.697193+0000","last_peered":"2023-12-19T13:55:24.697193+0000","last_clean":"2023-12-19T13:55:24.697193+0000","last_became_active":"2023-12-19T13:55:23.090975+0000","last_became_peered":"2023-12-19T13:55:23.090975+0000","last_unstale":"2023-12-19T13:55:24.697193+0000","last_undegraded":"2023-12-19T13:55:24.697193+0000","last_fullsized":"2023-12-19T13:55:24.697193+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:28.273009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696083+0000","last_change":"2023-12-19T13:55:22.602821+0000","last_active":"2023-12-19T13:55:24.696083+0000","last_peered":"2023-12-19T13:55:24.696083+0000","last_clean":"2023-12-19T13:55:24.696083+0000","last_became_active":"2023-12-19T13:55:22.601225+0000","last_became_peered":"2023-12-19T13:55:22.601225+0000","last_unstale":"2023-12-19T13:55:24.696083+0000","last_undegraded":"2023-12-19T13:55:24.696083+0000","last_fullsized":"2023-12-19T13:55:24.696083+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:43.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698404+0000","last_change":"2023-12-19T13:55:23.106615+0000","last_active":"2023-12-19T13:55:24.698404+0000","last_peered":"2023-12-19T13:55:24.698404+0000","last_clean":"2023-12-19T13:55:24.698404+0000","last_became_active":"2023-12-19T13:55:23.106042+0000","last_became_peered":"2023-12-19T13:55:23.106042+0000","last_unstale":"2023-12-19T13:55:24.698404+0000","last_undegraded":"2023-12-19T13:55:24.698404+0000","last_fullsized":"2023-12-19T13:55:24.698404+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:25.735136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088544+0000","last_change":"2023-12-19T13:55:22.616043+0000","last_active":"2023-12-19T13:55:24.088544+0000","last_peered":"2023-12-19T13:55:24.088544+0000","last_clean":"2023-12-19T13:55:24.088544+0000","last_became_active":"2023-12-19T13:55:22.612923+0000","last_became_peered":"2023-12-19T13:55:22.612923+0000","last_unstale":"2023-12-19T13:55:24.088544+0000","last_undegraded":"2023-12-19T13:55:24.088544+0000","last_fullsized":"2023-12-19T13:55:24.088544+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:47.600802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089900+0000","last_change":"2023-12-19T13:55:23.111426+0000","last_active":"2023-12-19T13:55:24.089900+0000","last_peered":"2023-12-19T13:55:24.089900+0000","last_clean":"2023-12-19T13:55:24.089900+0000","last_became_active":"2023-12-19T13:55:23.111182+0000","last_became_peered":"2023-12-19T13:55:23.111182+0000","last_unstale":"2023-12-19T13:55:24.089900+0000","last_undegraded":"2023-12-19T13:55:24.089900+0000","last_fullsized":"2023-12-19T13:55:24.089900+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:58.824351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089744+0000","last_change":"2023-12-19T13:55:22.614919+0000","last_active":"2023-12-19T13:55:24.089744+0000","last_peered":"2023-12-19T13:55:24.089744+0000","last_clean":"2023-12-19T13:55:24.089744+0000","last_became_active":"2023-12-19T13:55:22.614413+0000","last_became_peered":"2023-12-19T13:55:22.614413+0000","last_unstale":"2023-12-19T13:55:24.089744+0000","last_undegraded":"2023-12-19T13:55:24.089744+0000","last_fullsized":"2023-12-19T13:55:24.089744+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:22.861059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696917+0000","last_change":"2023-12-19T13:55:23.104631+0000","last_active":"2023-12-19T13:55:24.696917+0000","last_peered":"2023-12-19T13:55:24.696917+0000","last_clean":"2023-12-19T13:55:24.696917+0000","last_became_active":"2023-12-19T13:55:23.104402+0000","last_became_peered":"2023-12-19T13:55:23.104402+0000","last_unstale":"2023-12-19T13:55:24.696917+0000","last_undegraded":"2023-12-19T13:55:24.696917+0000","last_fullsized":"2023-12-19T13:55:24.696917+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:48.046200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090220+0000","last_change":"2023-12-19T13:55:22.612897+0000","last_active":"2023-12-19T13:55:24.090220+0000","last_peered":"2023-12-19T13:55:24.090220+0000","last_clean":"2023-12-19T13:55:24.090220+0000","last_became_active":"2023-12-19T13:55:22.612498+0000","last_became_peered":"2023-12-19T13:55:22.612498+0000","last_unstale":"2023-12-19T13:55:24.090220+0000","last_undegraded":"2023-12-19T13:55:24.090220+0000","last_fullsized":"2023-12-19T13:55:24.090220+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:03:42.714548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697998+0000","last_change":"2023-12-19T13:55:23.115923+0000","last_active":"2023-12-19T13:55:24.697998+0000","last_peered":"2023-12-19T13:55:24.697998+0000","last_clean":"2023-12-19T13:55:24.697998+0000","last_became_active":"2023-12-19T13:55:23.115623+0000","last_became_peered":"2023-12-19T13:55:23.115623+0000","last_unstale":"2023-12-19T13:55:24.697998+0000","last_undegraded":"2023-12-19T13:55:24.697998+0000","last_fullsized":"2023-12-19T13:55:24.697998+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:13.157395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696330+0000","last_change":"2023-12-19T13:55:22.616025+0000","last_active":"2023-12-19T13:55:24.696330+0000","last_peered":"2023-12-19T13:55:24.696330+0000","last_clean":"2023-12-19T13:55:24.696330+0000","last_became_active":"2023-12-19T13:55:22.615357+0000","last_became_peered":"2023-12-19T13:55:22.615357+0000","last_unstale":"2023-12-19T13:55:24.696330+0000","last_undegraded":"2023-12-19T13:55:24.696330+0000","last_fullsized":"2023-12-19T13:55:24.696330+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:34:17.570231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088083+0000","last_change":"2023-12-19T13:55:23.096655+0000","last_active":"2023-12-19T13:55:24.088083+0000","last_peered":"2023-12-19T13:55:24.088083+0000","last_clean":"2023-12-19T13:55:24.088083+0000","last_became_active":"2023-12-19T13:55:23.096387+0000","last_became_peered":"2023-12-19T13:55:23.096387+0000","last_unstale":"2023-12-19T13:55:24.088083+0000","last_undegraded":"2023-12-19T13:55:24.088083+0000","last_fullsized":"2023-12-19T13:55:24.088083+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:55.365889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089013+0000","last_change":"2023-12-19T13:55:22.614505+0000","last_active":"2023-12-19T13:55:24.089013+0000","last_peered":"2023-12-19T13:55:24.089013+0000","last_clean":"2023-12-19T13:55:24.089013+0000","last_became_active":"2023-12-19T13:55:22.614225+0000","last_became_peered":"2023-12-19T13:55:22.614225+0000","last_unstale":"2023-12-19T13:55:24.089013+0000","last_undegraded":"2023-12-19T13:55:24.089013+0000","last_fullsized":"2023-12-19T13:55:24.089013+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:30.252496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089036+0000","last_change":"2023-12-19T13:55:23.095821+0000","last_active":"2023-12-19T13:55:24.089036+0000","last_peered":"2023-12-19T13:55:24.089036+0000","last_clean":"2023-12-19T13:55:24.089036+0000","last_became_active":"2023-12-19T13:55:23.095166+0000","last_became_peered":"2023-12-19T13:55:23.095166+0000","last_unstale":"2023-12-19T13:55:24.089036+0000","last_undegraded":"2023-12-19T13:55:24.089036+0000","last_fullsized":"2023-12-19T13:55:24.089036+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:54:43.055764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697475+0000","last_change":"2023-12-19T13:55:22.616798+0000","last_active":"2023-12-19T13:55:24.697475+0000","last_peered":"2023-12-19T13:55:24.697475+0000","last_clean":"2023-12-19T13:55:24.697475+0000","last_became_active":"2023-12-19T13:55:22.616528+0000","last_became_peered":"2023-12-19T13:55:22.616528+0000","last_unstale":"2023-12-19T13:55:24.697475+0000","last_undegraded":"2023-12-19T13:55:24.697475+0000","last_fullsized":"2023-12-19T13:55:24.697475+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:42:39.292219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089871+0000","last_change":"2023-12-19T13:55:23.110992+0000","last_active":"2023-12-19T13:55:24.089871+0000","last_peered":"2023-12-19T13:55:24.089871+0000","last_clean":"2023-12-19T13:55:24.089871+0000","last_became_active":"2023-12-19T13:55:23.110790+0000","last_became_peered":"2023-12-19T13:55:23.110790+0000","last_unstale":"2023-12-19T13:55:24.089871+0000","last_undegraded":"2023-12-19T13:55:24.089871+0000","last_fullsized":"2023-12-19T13:55:24.089871+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:58.824351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090442+0000","last_change":"2023-12-19T13:55:22.610389+0000","last_active":"2023-12-19T13:55:24.090442+0000","last_peered":"2023-12-19T13:55:24.090442+0000","last_clean":"2023-12-19T13:55:24.090442+0000","last_became_active":"2023-12-19T13:55:22.609899+0000","last_became_peered":"2023-12-19T13:55:22.609899+0000","last_unstale":"2023-12-19T13:55:24.090442+0000","last_undegraded":"2023-12-19T13:55:24.090442+0000","last_fullsized":"2023-12-19T13:55:24.090442+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:42:39.292219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695893+0000","last_change":"2023-12-19T13:55:23.110206+0000","last_active":"2023-12-19T13:55:24.695893+0000","last_peered":"2023-12-19T13:55:24.695893+0000","last_clean":"2023-12-19T13:55:24.695893+0000","last_became_active":"2023-12-19T13:55:23.108436+0000","last_became_peered":"2023-12-19T13:55:23.108436+0000","last_unstale":"2023-12-19T13:55:24.695893+0000","last_undegraded":"2023-12-19T13:55:24.695893+0000","last_fullsized":"2023-12-19T13:55:24.695893+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:06.275917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"162'3","reported_seq":14,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089841+0000","last_change":"2023-12-19T13:55:22.619742+0000","last_active":"2023-12-19T13:55:24.089841+0000","last_peered":"2023-12-19T13:55:24.089841+0000","last_clean":"2023-12-19T13:55:24.089841+0000","last_became_active":"2023-12-19T13:55:22.619167+0000","last_became_peered":"2023-12-19T13:55:22.619167+0000","last_unstale":"2023-12-19T13:55:24.089841+0000","last_undegraded":"2023-12-19T13:55:24.089841+0000","last_fullsized":"2023-12-19T13:55:24.089841+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:42.364979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696109+0000","last_change":"2023-12-19T13:55:23.107015+0000","last_active":"2023-12-19T13:55:24.696109+0000","last_peered":"2023-12-19T13:55:24.696109+0000","last_clean":"2023-12-19T13:55:24.696109+0000","last_became_active":"2023-12-19T13:55:23.106490+0000","last_became_peered":"2023-12-19T13:55:23.106490+0000","last_unstale":"2023-12-19T13:55:24.696109+0000","last_undegraded":"2023-12-19T13:55:24.696109+0000","last_fullsized":"2023-12-19T13:55:24.696109+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:34.599808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"162'6","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695037+0000","last_change":"2023-12-19T13:55:22.615108+0000","last_active":"2023-12-19T13:55:24.695037+0000","last_peered":"2023-12-19T13:55:24.695037+0000","last_clean":"2023-12-19T13:55:24.695037+0000","last_became_active":"2023-12-19T13:55:22.614778+0000","last_became_peered":"2023-12-19T13:55:22.614778+0000","last_unstale":"2023-12-19T13:55:24.695037+0000","last_undegraded":"2023-12-19T13:55:24.695037+0000","last_fullsized":"2023-12-19T13:55:24.695037+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:43:27.729568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231639+0000","last_change":"2023-12-19T13:55:23.102594+0000","last_active":"2023-12-19T13:55:24.231639+0000","last_peered":"2023-12-19T13:55:24.231639+0000","last_clean":"2023-12-19T13:55:24.231639+0000","last_became_active":"2023-12-19T13:55:23.102343+0000","last_became_peered":"2023-12-19T13:55:23.102343+0000","last_unstale":"2023-12-19T13:55:24.231639+0000","last_undegraded":"2023-12-19T13:55:24.231639+0000","last_fullsized":"2023-12-19T13:55:24.231639+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:48.046200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231979+0000","last_change":"2023-12-19T13:55:22.612897+0000","last_active":"2023-12-19T13:55:24.231979+0000","last_peered":"2023-12-19T13:55:24.231979+0000","last_clean":"2023-12-19T13:55:24.231979+0000","last_became_active":"2023-12-19T13:55:22.612255+0000","last_became_peered":"2023-12-19T13:55:22.612255+0000","last_unstale":"2023-12-19T13:55:24.231979+0000","last_undegraded":"2023-12-19T13:55:24.231979+0000","last_fullsized":"2023-12-19T13:55:24.231979+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:12:27.744900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231395+0000","last_change":"2023-12-19T13:55:23.104698+0000","last_active":"2023-12-19T13:55:24.231395+0000","last_peered":"2023-12-19T13:55:24.231395+0000","last_clean":"2023-12-19T13:55:24.231395+0000","last_became_active":"2023-12-19T13:55:23.104444+0000","last_became_peered":"2023-12-19T13:55:23.104444+0000","last_unstale":"2023-12-19T13:55:24.231395+0000","last_undegraded":"2023-12-19T13:55:24.231395+0000","last_fullsized":"2023-12-19T13:55:24.231395+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:53.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695790+0000","last_change":"2023-12-19T13:55:22.616740+0000","last_active":"2023-12-19T13:55:24.695790+0000","last_peered":"2023-12-19T13:55:24.695790+0000","last_clean":"2023-12-19T13:55:24.695790+0000","last_became_active":"2023-12-19T13:55:22.616219+0000","last_became_peered":"2023-12-19T13:55:22.616219+0000","last_unstale":"2023-12-19T13:55:24.695790+0000","last_undegraded":"2023-12-19T13:55:24.695790+0000","last_fullsized":"2023-12-19T13:55:24.695790+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:07.134888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697295+0000","last_change":"2023-12-19T13:55:23.107974+0000","last_active":"2023-12-19T13:55:24.697295+0000","last_peered":"2023-12-19T13:55:24.697295+0000","last_clean":"2023-12-19T13:55:24.697295+0000","last_became_active":"2023-12-19T13:55:23.107417+0000","last_became_peered":"2023-12-19T13:55:23.107417+0000","last_unstale":"2023-12-19T13:55:24.697295+0000","last_undegraded":"2023-12-19T13:55:24.697295+0000","last_fullsized":"2023-12-19T13:55:24.697295+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:19.039260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"162'8","reported_seq":19,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696351+0000","last_change":"2023-12-19T13:55:22.616396+0000","last_active":"2023-12-19T13:55:24.696351+0000","last_peered":"2023-12-19T13:55:24.696351+0000","last_clean":"2023-12-19T13:55:24.696351+0000","last_became_active":"2023-12-19T13:55:22.615601+0000","last_became_peered":"2023-12-19T13:55:22.615601+0000","last_unstale":"2023-12-19T13:55:24.696351+0000","last_undegraded":"2023-12-19T13:55:24.696351+0000","last_fullsized":"2023-12-19T13:55:24.696351+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:22.492323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090373+0000","last_change":"2023-12-19T13:55:23.108891+0000","last_active":"2023-12-19T13:55:24.090373+0000","last_peered":"2023-12-19T13:55:24.090373+0000","last_clean":"2023-12-19T13:55:24.090373+0000","last_became_active":"2023-12-19T13:55:23.108551+0000","last_became_peered":"2023-12-19T13:55:23.108551+0000","last_unstale":"2023-12-19T13:55:24.090373+0000","last_undegraded":"2023-12-19T13:55:24.090373+0000","last_fullsized":"2023-12-19T13:55:24.090373+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:55.635662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696826+0000","last_change":"2023-12-19T13:55:22.613023+0000","last_active":"2023-12-19T13:55:24.696826+0000","last_peered":"2023-12-19T13:55:24.696826+0000","last_clean":"2023-12-19T13:55:24.696826+0000","last_became_active":"2023-12-19T13:55:22.612613+0000","last_became_peered":"2023-12-19T13:55:22.612613+0000","last_unstale":"2023-12-19T13:55:24.696826+0000","last_undegraded":"2023-12-19T13:55:24.696826+0000","last_fullsized":"2023-12-19T13:55:24.696826+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:45.489463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089800+0000","last_change":"2023-12-19T13:55:23.108516+0000","last_active":"2023-12-19T13:55:24.089800+0000","last_peered":"2023-12-19T13:55:24.089800+0000","last_clean":"2023-12-19T13:55:24.089800+0000","last_became_active":"2023-12-19T13:55:23.107974+0000","last_became_peered":"2023-12-19T13:55:23.107974+0000","last_unstale":"2023-12-19T13:55:24.089800+0000","last_undegraded":"2023-12-19T13:55:24.089800+0000","last_fullsized":"2023-12-19T13:55:24.089800+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:08.944157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696313+0000","last_change":"2023-12-19T13:55:22.613375+0000","last_active":"2023-12-19T13:55:24.696313+0000","last_peered":"2023-12-19T13:55:24.696313+0000","last_clean":"2023-12-19T13:55:24.696313+0000","last_became_active":"2023-12-19T13:55:22.612642+0000","last_became_peered":"2023-12-19T13:55:22.612642+0000","last_unstale":"2023-12-19T13:55:24.696313+0000","last_undegraded":"2023-12-19T13:55:24.696313+0000","last_fullsized":"2023-12-19T13:55:24.696313+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:18.024857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089261+0000","last_change":"2023-12-19T13:55:23.113990+0000","last_active":"2023-12-19T13:55:24.089261+0000","last_peered":"2023-12-19T13:55:24.089261+0000","last_clean":"2023-12-19T13:55:24.089261+0000","last_became_active":"2023-12-19T13:55:23.113391+0000","last_became_peered":"2023-12-19T13:55:23.113391+0000","last_unstale":"2023-12-19T13:55:24.089261+0000","last_undegraded":"2023-12-19T13:55:24.089261+0000","last_fullsized":"2023-12-19T13:55:24.089261+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:27:28.474177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697835+0000","last_change":"2023-12-19T13:55:22.613325+0000","last_active":"2023-12-19T13:55:24.697835+0000","last_peered":"2023-12-19T13:55:24.697835+0000","last_clean":"2023-12-19T13:55:24.697835+0000","last_became_active":"2023-12-19T13:55:22.612724+0000","last_became_peered":"2023-12-19T13:55:22.612724+0000","last_unstale":"2023-12-19T13:55:24.697835+0000","last_undegraded":"2023-12-19T13:55:24.697835+0000","last_fullsized":"2023-12-19T13:55:24.697835+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:42:25.369100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088802+0000","last_change":"2023-12-19T13:55:23.096782+0000","last_active":"2023-12-19T13:55:24.088802+0000","last_peered":"2023-12-19T13:55:24.088802+0000","last_clean":"2023-12-19T13:55:24.088802+0000","last_became_active":"2023-12-19T13:55:23.096422+0000","last_became_peered":"2023-12-19T13:55:23.096422+0000","last_unstale":"2023-12-19T13:55:24.088802+0000","last_undegraded":"2023-12-19T13:55:24.088802+0000","last_fullsized":"2023-12-19T13:55:24.088802+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:42.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090006+0000","last_change":"2023-12-19T13:55:22.617055+0000","last_active":"2023-12-19T13:55:24.090006+0000","last_peered":"2023-12-19T13:55:24.090006+0000","last_clean":"2023-12-19T13:55:24.090006+0000","last_became_active":"2023-12-19T13:55:22.616811+0000","last_became_peered":"2023-12-19T13:55:22.616811+0000","last_unstale":"2023-12-19T13:55:24.090006+0000","last_undegraded":"2023-12-19T13:55:24.090006+0000","last_fullsized":"2023-12-19T13:55:24.090006+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:44.426461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088354+0000","last_change":"2023-12-19T13:55:23.109867+0000","last_active":"2023-12-19T13:55:24.088354+0000","last_peered":"2023-12-19T13:55:24.088354+0000","last_clean":"2023-12-19T13:55:24.088354+0000","last_became_active":"2023-12-19T13:55:23.109240+0000","last_became_peered":"2023-12-19T13:55:23.109240+0000","last_unstale":"2023-12-19T13:55:24.088354+0000","last_undegraded":"2023-12-19T13:55:24.088354+0000","last_fullsized":"2023-12-19T13:55:24.088354+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:47.069368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698686+0000","last_change":"2023-12-19T13:55:22.619640+0000","last_active":"2023-12-19T13:55:24.698686+0000","last_peered":"2023-12-19T13:55:24.698686+0000","last_clean":"2023-12-19T13:55:24.698686+0000","last_became_active":"2023-12-19T13:55:22.619187+0000","last_became_peered":"2023-12-19T13:55:22.619187+0000","last_unstale":"2023-12-19T13:55:24.698686+0000","last_undegraded":"2023-12-19T13:55:24.698686+0000","last_fullsized":"2023-12-19T13:55:24.698686+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:34:43.532996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696366+0000","last_change":"2023-12-19T13:55:23.090152+0000","last_active":"2023-12-19T13:55:24.696366+0000","last_peered":"2023-12-19T13:55:24.696366+0000","last_clean":"2023-12-19T13:55:24.696366+0000","last_became_active":"2023-12-19T13:55:23.089523+0000","last_became_peered":"2023-12-19T13:55:23.089523+0000","last_unstale":"2023-12-19T13:55:24.696366+0000","last_undegraded":"2023-12-19T13:55:24.696366+0000","last_fullsized":"2023-12-19T13:55:24.696366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:56.814307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090575+0000","last_change":"2023-12-19T13:55:22.618022+0000","last_active":"2023-12-19T13:55:24.090575+0000","last_peered":"2023-12-19T13:55:24.090575+0000","last_clean":"2023-12-19T13:55:24.090575+0000","last_became_active":"2023-12-19T13:55:22.617711+0000","last_became_peered":"2023-12-19T13:55:22.617711+0000","last_unstale":"2023-12-19T13:55:24.090575+0000","last_undegraded":"2023-12-19T13:55:24.090575+0000","last_fullsized":"2023-12-19T13:55:24.090575+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:42.364979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231852+0000","last_change":"2023-12-19T13:55:23.097597+0000","last_active":"2023-12-19T13:55:24.231852+0000","last_peered":"2023-12-19T13:55:24.231852+0000","last_clean":"2023-12-19T13:55:24.231852+0000","last_became_active":"2023-12-19T13:55:23.097261+0000","last_became_peered":"2023-12-19T13:55:23.097261+0000","last_unstale":"2023-12-19T13:55:24.231852+0000","last_undegraded":"2023-12-19T13:55:24.231852+0000","last_fullsized":"2023-12-19T13:55:24.231852+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:44.798151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.232130+0000","last_change":"2023-12-19T13:55:22.617006+0000","last_active":"2023-12-19T13:55:24.232130+0000","last_peered":"2023-12-19T13:55:24.232130+0000","last_clean":"2023-12-19T13:55:24.232130+0000","last_became_active":"2023-12-19T13:55:22.616573+0000","last_became_peered":"2023-12-19T13:55:22.616573+0000","last_unstale":"2023-12-19T13:55:24.232130+0000","last_undegraded":"2023-12-19T13:55:24.232130+0000","last_fullsized":"2023-12-19T13:55:24.232130+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:25.572421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698129+0000","last_change":"2023-12-19T13:55:23.106758+0000","last_active":"2023-12-19T13:55:24.698129+0000","last_peered":"2023-12-19T13:55:24.698129+0000","last_clean":"2023-12-19T13:55:24.698129+0000","last_became_active":"2023-12-19T13:55:23.106353+0000","last_became_peered":"2023-12-19T13:55:23.106353+0000","last_unstale":"2023-12-19T13:55:24.698129+0000","last_undegraded":"2023-12-19T13:55:24.698129+0000","last_fullsized":"2023-12-19T13:55:24.698129+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:53.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696423+0000","last_change":"2023-12-19T13:55:22.609488+0000","last_active":"2023-12-19T13:55:24.696423+0000","last_peered":"2023-12-19T13:55:24.696423+0000","last_clean":"2023-12-19T13:55:24.696423+0000","last_became_active":"2023-12-19T13:55:22.609109+0000","last_became_peered":"2023-12-19T13:55:22.609109+0000","last_unstale":"2023-12-19T13:55:24.696423+0000","last_undegraded":"2023-12-19T13:55:24.696423+0000","last_fullsized":"2023-12-19T13:55:24.696423+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:12.142993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696644+0000","last_change":"2023-12-19T13:55:23.107143+0000","last_active":"2023-12-19T13:55:24.696644+0000","last_peered":"2023-12-19T13:55:24.696644+0000","last_clean":"2023-12-19T13:55:24.696644+0000","last_became_active":"2023-12-19T13:55:23.106807+0000","last_became_peered":"2023-12-19T13:55:23.106807+0000","last_unstale":"2023-12-19T13:55:24.696644+0000","last_undegraded":"2023-12-19T13:55:24.696644+0000","last_fullsized":"2023-12-19T13:55:24.696644+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:35.596539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090743+0000","last_change":"2023-12-19T13:55:22.610140+0000","last_active":"2023-12-19T13:55:24.090743+0000","last_peered":"2023-12-19T13:55:24.090743+0000","last_clean":"2023-12-19T13:55:24.090743+0000","last_became_active":"2023-12-19T13:55:22.607768+0000","last_became_peered":"2023-12-19T13:55:22.607768+0000","last_unstale":"2023-12-19T13:55:24.090743+0000","last_undegraded":"2023-12-19T13:55:24.090743+0000","last_fullsized":"2023-12-19T13:55:24.090743+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:33:22.787365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089515+0000","last_change":"2023-12-19T13:55:23.113830+0000","last_active":"2023-12-19T13:55:24.089515+0000","last_peered":"2023-12-19T13:55:24.089515+0000","last_clean":"2023-12-19T13:55:24.089515+0000","last_became_active":"2023-12-19T13:55:23.113190+0000","last_became_peered":"2023-12-19T13:55:23.113190+0000","last_unstale":"2023-12-19T13:55:24.089515+0000","last_undegraded":"2023-12-19T13:55:24.089515+0000","last_fullsized":"2023-12-19T13:55:24.089515+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:02.781993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089905+0000","last_change":"2023-12-19T13:55:22.614560+0000","last_active":"2023-12-19T13:55:24.089905+0000","last_peered":"2023-12-19T13:55:24.089905+0000","last_clean":"2023-12-19T13:55:24.089905+0000","last_became_active":"2023-12-19T13:55:22.614336+0000","last_became_peered":"2023-12-19T13:55:22.614336+0000","last_unstale":"2023-12-19T13:55:24.089905+0000","last_undegraded":"2023-12-19T13:55:24.089905+0000","last_fullsized":"2023-12-19T13:55:24.089905+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:33:22.787365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231866+0000","last_change":"2023-12-19T13:55:23.101229+0000","last_active":"2023-12-19T13:55:24.231866+0000","last_peered":"2023-12-19T13:55:24.231866+0000","last_clean":"2023-12-19T13:55:24.231866+0000","last_became_active":"2023-12-19T13:55:23.101010+0000","last_became_peered":"2023-12-19T13:55:23.101010+0000","last_unstale":"2023-12-19T13:55:24.231866+0000","last_undegraded":"2023-12-19T13:55:24.231866+0000","last_fullsized":"2023-12-19T13:55:24.231866+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:20.175899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090935+0000","last_change":"2023-12-19T13:55:22.615804+0000","last_active":"2023-12-19T13:55:24.090935+0000","last_peered":"2023-12-19T13:55:24.090935+0000","last_clean":"2023-12-19T13:55:24.090935+0000","last_became_active":"2023-12-19T13:55:22.615166+0000","last_became_peered":"2023-12-19T13:55:22.615166+0000","last_unstale":"2023-12-19T13:55:24.090935+0000","last_undegraded":"2023-12-19T13:55:24.090935+0000","last_fullsized":"2023-12-19T13:55:24.090935+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:45.489463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695729+0000","last_change":"2023-12-19T13:55:23.097956+0000","last_active":"2023-12-19T13:55:24.695729+0000","last_peered":"2023-12-19T13:55:24.695729+0000","last_clean":"2023-12-19T13:55:24.695729+0000","last_became_active":"2023-12-19T13:55:23.097111+0000","last_became_peered":"2023-12-19T13:55:23.097111+0000","last_unstale":"2023-12-19T13:55:24.695729+0000","last_undegraded":"2023-12-19T13:55:24.695729+0000","last_fullsized":"2023-12-19T13:55:24.695729+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:14:46.996742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.232233+0000","last_change":"2023-12-19T13:55:22.616800+0000","last_active":"2023-12-19T13:55:24.232233+0000","last_peered":"2023-12-19T13:55:24.232233+0000","last_clean":"2023-12-19T13:55:24.232233+0000","last_became_active":"2023-12-19T13:55:22.615859+0000","last_became_peered":"2023-12-19T13:55:22.615859+0000","last_unstale":"2023-12-19T13:55:24.232233+0000","last_undegraded":"2023-12-19T13:55:24.232233+0000","last_fullsized":"2023-12-19T13:55:24.232233+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:22.492323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697512+0000","last_change":"2023-12-19T13:55:23.113594+0000","last_active":"2023-12-19T13:55:24.697512+0000","last_peered":"2023-12-19T13:55:24.697512+0000","last_clean":"2023-12-19T13:55:24.697512+0000","last_became_active":"2023-12-19T13:55:23.113336+0000","last_became_peered":"2023-12-19T13:55:23.113336+0000","last_unstale":"2023-12-19T13:55:24.697512+0000","last_undegraded":"2023-12-19T13:55:24.697512+0000","last_fullsized":"2023-12-19T13:55:24.697512+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:44.798151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089014+0000","last_change":"2023-12-19T13:55:22.618146+0000","last_active":"2023-12-19T13:55:24.089014+0000","last_peered":"2023-12-19T13:55:24.089014+0000","last_clean":"2023-12-19T13:55:24.089014+0000","last_became_active":"2023-12-19T13:55:22.617685+0000","last_became_peered":"2023-12-19T13:55:22.617685+0000","last_unstale":"2023-12-19T13:55:24.089014+0000","last_undegraded":"2023-12-19T13:55:24.089014+0000","last_fullsized":"2023-12-19T13:55:24.089014+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:07.929755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697118+0000","last_change":"2023-12-19T13:55:23.110536+0000","last_active":"2023-12-19T13:55:24.697118+0000","last_peered":"2023-12-19T13:55:24.697118+0000","last_clean":"2023-12-19T13:55:24.697118+0000","last_became_active":"2023-12-19T13:55:23.108276+0000","last_became_peered":"2023-12-19T13:55:23.108276+0000","last_unstale":"2023-12-19T13:55:24.697118+0000","last_undegraded":"2023-12-19T13:55:24.697118+0000","last_fullsized":"2023-12-19T13:55:24.697118+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:20.175899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697804+0000","last_change":"2023-12-19T13:55:22.614284+0000","last_active":"2023-12-19T13:55:24.697804+0000","last_peered":"2023-12-19T13:55:24.697804+0000","last_clean":"2023-12-19T13:55:24.697804+0000","last_became_active":"2023-12-19T13:55:22.613962+0000","last_became_peered":"2023-12-19T13:55:22.613962+0000","last_unstale":"2023-12-19T13:55:24.697804+0000","last_undegraded":"2023-12-19T13:55:24.697804+0000","last_fullsized":"2023-12-19T13:55:24.697804+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:42.364979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090322+0000","last_change":"2023-12-19T13:55:23.102563+0000","last_active":"2023-12-19T13:55:24.090322+0000","last_peered":"2023-12-19T13:55:24.090322+0000","last_clean":"2023-12-19T13:55:24.090322+0000","last_became_active":"2023-12-19T13:55:23.101833+0000","last_became_peered":"2023-12-19T13:55:23.101833+0000","last_unstale":"2023-12-19T13:55:24.090322+0000","last_undegraded":"2023-12-19T13:55:24.090322+0000","last_fullsized":"2023-12-19T13:55:24.090322+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:48.615204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695967+0000","last_change":"2023-12-19T13:55:22.618429+0000","last_active":"2023-12-19T13:55:24.695967+0000","last_peered":"2023-12-19T13:55:24.695967+0000","last_clean":"2023-12-19T13:55:24.695967+0000","last_became_active":"2023-12-19T13:55:22.618127+0000","last_became_peered":"2023-12-19T13:55:22.618127+0000","last_unstale":"2023-12-19T13:55:24.695967+0000","last_undegraded":"2023-12-19T13:55:24.695967+0000","last_fullsized":"2023-12-19T13:55:24.695967+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:52.238215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231595+0000","last_change":"2023-12-19T13:55:23.105648+0000","last_active":"2023-12-19T13:55:24.231595+0000","last_peered":"2023-12-19T13:55:24.231595+0000","last_clean":"2023-12-19T13:55:24.231595+0000","last_became_active":"2023-12-19T13:55:23.105413+0000","last_became_peered":"2023-12-19T13:55:23.105413+0000","last_unstale":"2023-12-19T13:55:24.231595+0000","last_undegraded":"2023-12-19T13:55:24.231595+0000","last_fullsized":"2023-12-19T13:55:24.231595+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:25.735136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231898+0000","last_change":"2023-12-19T13:55:22.611237+0000","last_active":"2023-12-19T13:55:24.231898+0000","last_peered":"2023-12-19T13:55:24.231898+0000","last_clean":"2023-12-19T13:55:24.231898+0000","last_became_active":"2023-12-19T13:55:22.610962+0000","last_became_peered":"2023-12-19T13:55:22.610962+0000","last_unstale":"2023-12-19T13:55:24.231898+0000","last_undegraded":"2023-12-19T13:55:24.231898+0000","last_fullsized":"2023-12-19T13:55:24.231898+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:32.812990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697437+0000","last_change":"2023-12-19T13:55:23.092935+0000","last_active":"2023-12-19T13:55:24.697437+0000","last_peered":"2023-12-19T13:55:24.697437+0000","last_clean":"2023-12-19T13:55:24.697437+0000","last_became_active":"2023-12-19T13:55:23.091831+0000","last_became_peered":"2023-12-19T13:55:23.091831+0000","last_unstale":"2023-12-19T13:55:24.697437+0000","last_undegraded":"2023-12-19T13:55:24.697437+0000","last_fullsized":"2023-12-19T13:55:24.697437+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:30:15.391207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698518+0000","last_change":"2023-12-19T13:55:22.614798+0000","last_active":"2023-12-19T13:55:24.698518+0000","last_peered":"2023-12-19T13:55:24.698518+0000","last_clean":"2023-12-19T13:55:24.698518+0000","last_became_active":"2023-12-19T13:55:22.614438+0000","last_became_peered":"2023-12-19T13:55:22.614438+0000","last_unstale":"2023-12-19T13:55:24.698518+0000","last_undegraded":"2023-12-19T13:55:24.698518+0000","last_fullsized":"2023-12-19T13:55:24.698518+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:03:42.714548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":300,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-12-19T13:55:23.082746+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:55:23.082746+0000","last_peered":"2023-12-19T13:55:23.082746+0000","last_clean":"2023-12-19T13:55:23.082746+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:55:23.082746+0000","last_undegraded":"2023-12-19T13:55:23.082746+0000","last_fullsized":"2023-12-19T13:55:23.082746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085777,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1000000000000001,"15min":1.036},"min":{"1min":0.67100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5900000000000001,"5min":1.6950000000000001,"15min":1.9059999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.121,"15min":1.032},"min":{"1min":0.70799999999999996,"5min":0.64400000000000002,"15min":0.54400000000000004},"max":{"1min":1.516,"5min":1.7190000000000001,"15min":2.008},"last":1.319}]},{"osd":1,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1759999999999999,"15min":1.1060000000000001},"min":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6439999999999999,"5min":1.6479999999999999,"15min":1.6890000000000001},"last":1.407},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1970000000000001,"15min":1.085},"min":{"1min":0.80100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.5680000000000001,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.2090000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1359999999999999},"min":{"1min":0.76300000000000001,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":1.5109999999999999,"5min":2.008,"15min":2.008},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2130000000000001,"15min":1.173},"min":{"1min":0.95899999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7390000000000001,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":1.288}]},{"osd":3,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.2609999999999999,"15min":1.1899999999999999},"min":{"1min":0.874,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9359999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.548},{"interface":"front","average":{"1min":1.319,"5min":1.333,"15min":1.268},"min":{"1min":1.0960000000000001,"5min":0.70599999999999996,"15min":0.65200000000000002},"max":{"1min":1.9810000000000001,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.347}]},{"osd":4,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.2929999999999999,"15min":1.288},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.60299999999999998},"max":{"1min":2.0179999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.48},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3540000000000001,"15min":1.381},"min":{"1min":0.97799999999999998,"5min":0.83099999999999996,"15min":0.58499999999999996},"max":{"1min":1.7190000000000001,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.159}]},{"osd":5,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.288,"15min":1.2470000000000001},"min":{"1min":0.73399999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.819,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.4259999999999999,"15min":1.429},"min":{"1min":1.113,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":2.097,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.252}]},{"osd":6,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.429,"15min":1.3220000000000001},"min":{"1min":1.115,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.853,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.573,"5min":1.522,"15min":1.502},"min":{"1min":1.208,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":2.202,"5min":2.673,"15min":2.673},"last":1.6020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085811,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.05,"15min":1.0389999999999999},"min":{"1min":0.66200000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6160000000000001,"5min":1.6220000000000001,"15min":2.0640000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.097,"15min":1.1080000000000001},"min":{"1min":0.70199999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.605,"5min":1.631,"15min":3.2069999999999999},"last":0.90100000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0509999999999999,"15min":1.04},"min":{"1min":0.64900000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.181,"5min":1.5580000000000001,"15min":1.962},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.198,"5min":1.1579999999999999,"15min":1.079},"min":{"1min":0.74099999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5640000000000001,"5min":1.619,"15min":1.6279999999999999},"last":1.321}]},{"osd":2,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.268,"15min":1.24},"min":{"1min":0.94999999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.629,"5min":1.806,"15min":1.8180000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.264,"15min":1.1930000000000001},"min":{"1min":0.70999999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.573,"5min":1.802,"15min":1.802},"last":1.26}]},{"osd":3,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.232,"15min":1.306},"min":{"1min":0.81499999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.665,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.2110000000000001,"15min":1.25},"min":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.67900000000000005},"max":{"1min":1.474,"5min":1.819,"15min":4.3899999999999997},"last":1.7}]},{"osd":4,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.321,"15min":1.246},"min":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.47899999999999998},"max":{"1min":1.7430000000000001,"5min":1.905,"15min":1.905},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3660000000000001,"15min":1.3200000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.70699999999999996},"max":{"1min":1.849,"5min":1.895,"15min":1.895},"last":1.6539999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3200000000000001,"15min":1.274},"min":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.4339999999999999,"15min":1.397},"min":{"1min":0.85299999999999998,"5min":0.80200000000000005,"15min":0.48799999999999999},"max":{"1min":1.978,"5min":2.169,"15min":2.169},"last":1.5}]},{"osd":7,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.4850000000000001,"15min":1.4390000000000001},"min":{"1min":0.83299999999999996,"5min":0.82499999999999996,"15min":0.59599999999999997},"max":{"1min":1.9570000000000001,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.474},{"interface":"front","average":{"1min":1.494,"5min":1.45,"15min":1.3899999999999999},"min":{"1min":0.747,"5min":0.72799999999999998,"15min":0.57999999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.6279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193842,"statfs":{"total":200000000,"available":198494701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0680000000000001,"15min":1.006},"min":{"1min":0.628,"5min":0.433,"15min":0.433},"max":{"1min":1.4710000000000001,"5min":1.835,"15min":1.835},"last":1.298},{"interface":"front","average":{"1min":1.157,"5min":1.226,"15min":1.1140000000000001},"min":{"1min":0.71299999999999997,"5min":0.67500000000000004,"15min":0.53900000000000003},"max":{"1min":1.8700000000000001,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.1539999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.169,"15min":1.1220000000000001},"min":{"1min":0.68500000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6839999999999999,"5min":6.101,"15min":6.101},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1879999999999999,"15min":1.0680000000000001},"min":{"1min":0.66500000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.625,"5min":2.077,"15min":2.077},"last":1.415}]},{"osd":2,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.264,"15min":1.2450000000000001},"min":{"1min":0.82899999999999996,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.8919999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.2230000000000001,"15min":1.25},"min":{"1min":0.76900000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.393,"5min":2.2730000000000001,"15min":2.863},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3480000000000001,"15min":1.2529999999999999},"min":{"1min":0.95699999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1880000000000002,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.3009999999999999,"15min":1.262},"min":{"1min":0.78300000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.587,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.202}]},{"osd":4,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.226,"15min":1.1699999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6759999999999999,"5min":1.8919999999999999,"15min":1.982},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4330000000000001,"15min":1.329},"min":{"1min":0.93700000000000006,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":2.0800000000000001,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.3420000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.373,"15min":1.3400000000000001},"min":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.784,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.367},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.387,"15min":1.373},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.5740000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.55,"15min":1.45},"min":{"1min":0.86799999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.278,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.25},{"interface":"front","average":{"1min":1.494,"5min":1.524,"15min":1.448},"min":{"1min":0.80200000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.974,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.4359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085811,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.077,"15min":1.016},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.87},{"interface":"front","average":{"1min":1.113,"5min":1.0960000000000001,"15min":1.1140000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.016},"last":1.3200000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6379999999999999,"5min":1.661,"15min":1.661},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.113,"15min":1.111},"min":{"1min":0.75,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5780000000000001,"5min":1.887,"15min":1.887},"last":1.232}]},{"osd":2,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1339999999999999,"15min":1.0629999999999999},"min":{"1min":0.77800000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.1850000000000001,"15min":1.133},"min":{"1min":0.88800000000000001,"5min":0.75,"15min":0.68000000000000005},"max":{"1min":1.5109999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.4610000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2310000000000001,"15min":1.216},"min":{"1min":0.72999999999999998,"5min":0.63500000000000001,"15min":0.57599999999999996},"max":{"1min":1.778,"5min":1.8360000000000001,"15min":1.952},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.298,"15min":1.2789999999999999},"min":{"1min":0.82799999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6870000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.6719999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.22,"15min":1.234},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.51700000000000002},"max":{"1min":1.825,"5min":1.9730000000000001,"15min":2.165},"last":1.389},{"interface":"front","average":{"1min":1.218,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.58399999999999996},"max":{"1min":1.631,"5min":2.306,"15min":2.3570000000000002},"last":2.0379999999999998}]},{"osd":6,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.337,"15min":1.377},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.55900000000000005},"max":{"1min":1.782,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.395,"15min":1.4359999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8540000000000001,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.7110000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4850000000000001,"15min":1.4670000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.65500000000000003},"max":{"1min":2.1930000000000001,"5min":2.948,"15min":2.948},"last":2.0830000000000002},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.542,"15min":1.5249999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.59999999999999998},"max":{"1min":2.0270000000000001,"5min":3.137,"15min":3.137},"last":1.8620000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.77200000000000002,"15min":0.88400000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.032,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.86199999999999999,"15min":0.93400000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":1.175,"5min":1.502,"15min":3.0670000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.94399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.155,"5min":1.508,"15min":5.3769999999999998},"last":1.091},{"interface":"front","average":{"1min":0.746,"5min":0.89600000000000002,"15min":0.95599999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.3200000000000001,"5min":1.5780000000000001,"15min":2.387},"last":0.55500000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.95099999999999996,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.2869999999999999,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.97799999999999998,"15min":1.0800000000000001},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.39200000000000002},"max":{"1min":1.3180000000000001,"5min":1.722,"15min":2.657},"last":0.97399999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1910000000000001,"15min":1.2390000000000001},"min":{"1min":0.76200000000000001,"5min":0.64000000000000001,"15min":0.48299999999999998},"max":{"1min":1.627,"5min":1.718,"15min":3.0070000000000001},"last":1.044},{"interface":"front","average":{"1min":1.097,"5min":1.21,"15min":1.22},"min":{"1min":0.626,"5min":0.60199999999999998,"15min":0.54600000000000004},"max":{"1min":1.611,"5min":1.835,"15min":2.7690000000000001},"last":1.24}]},{"osd":5,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2789999999999999},"min":{"1min":0.75700000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.589,"5min":1.72,"15min":2.7309999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1819999999999999,"15min":1.2410000000000001},"min":{"1min":0.72599999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.577,"5min":1.7729999999999999,"15min":3.5249999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2310000000000001,"15min":1.2809999999999999},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.53300000000000003},"max":{"1min":1.6990000000000001,"5min":1.7090000000000001,"15min":2.9769999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2909999999999999,"15min":1.325},"min":{"1min":0.746,"5min":0.746,"15min":0.52600000000000002},"max":{"1min":1.48,"5min":1.8120000000000001,"15min":2.698},"last":1.498}]},{"osd":7,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.272,"15min":1.335},"min":{"1min":0.81699999999999995,"5min":0.624,"15min":0.51500000000000001},"max":{"1min":1.6459999999999999,"5min":2.0939999999999999,"15min":3.609},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3420000000000001,"15min":1.379},"min":{"1min":0.82099999999999995,"5min":0.69299999999999995,"15min":0.58699999999999997},"max":{"1min":1.7629999999999999,"5min":1.8999999999999999,"15min":3.0379999999999998},"last":1.079}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085139,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.196,"5min":1.544,"15min":2.258},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.85099999999999998,"15min":0.84499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":1.6539999999999999,"15min":11.85},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.88500000000000001,"15min":0.84399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.376},"max":{"1min":1.248,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.97499999999999998,"15min":0.95699999999999996},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4199999999999999,"5min":1.5349999999999999,"15min":11.788},"last":0.51400000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.97899999999999998,"15min":0.94699999999999995},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":2.3109999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.044,"15min":1.038},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":1.5609999999999999,"5min":1.5800000000000001,"15min":4.8079999999999998},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.204,"15min":1.1870000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6100000000000001,"5min":1.6839999999999999,"15min":11.930999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.1919999999999999,"15min":1.212},"min":{"1min":0.81000000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4590000000000001,"5min":1.786,"15min":2.2189999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.298,"15min":1.2629999999999999},"min":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4870000000000001,"5min":1.748,"15min":11.888},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.302,"15min":1.304},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.68899999999999995},"max":{"1min":1.655,"5min":1.843,"15min":2.8769999999999998},"last":0.92500000000000004}]},{"osd":6,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2809999999999999,"15min":1.3049999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.833,"5min":1.994,"15min":2.964},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.2969999999999999,"15min":1.2669999999999999},"min":{"1min":0.84699999999999998,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.5529999999999999,"5min":1.929,"15min":2.286},"last":0.71899999999999997}]},{"osd":7,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.341,"15min":1.3180000000000001},"min":{"1min":0.80700000000000005,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":1.772,"5min":2.0569999999999999,"15min":2.351},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.738,"5min":1.8200000000000001,"15min":11.962999999999999},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193841,"statfs":{"total":200000000,"available":198493857,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.80100000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.30599999999999999},"max":{"1min":1.3280000000000001,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":3.3500000000000001},"last":0.70299999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.91500000000000004,"15min":1.0289999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2050000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.083,"15min":1.1519999999999999},"min":{"1min":0.54100000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.619,"5min":1.764,"15min":5.2009999999999996},"last":1.5189999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.044,"15min":1.0589999999999999},"min":{"1min":0.55500000000000005,"5min":0.501,"15min":0.5},"max":{"1min":1.7,"5min":1.7,"15min":3.4300000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0289999999999999,"15min":1.131},"min":{"1min":0.54700000000000004,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.488,"5min":1.706,"15min":7.157},"last":1.1919999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1499999999999999,"15min":1.202},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.61699999999999999},"max":{"1min":1.446,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.248,"15min":1.282},"min":{"1min":0.751,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7490000000000001,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.411}]},{"osd":5,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2430000000000001,"15min":1.2989999999999999},"min":{"1min":0.80200000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6679999999999999,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2270000000000001,"15min":1.353},"min":{"1min":0.81799999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6040000000000001,"5min":1.9870000000000001,"15min":15.576000000000001},"last":1.4990000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.323,"15min":1.339},"min":{"1min":0.83899999999999997,"5min":0.74199999999999999,"15min":0.67800000000000005},"max":{"1min":1.7929999999999999,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.611},{"interface":"front","average":{"1min":1.337,"5min":1.3380000000000001,"15min":1.393},"min":{"1min":0.93000000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8149999999999999,"5min":2.3159999999999998,"15min":3.786},"last":1.6459999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.391,"15min":1.4279999999999999},"min":{"1min":0.84399999999999997,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.7609999999999999,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.722},{"interface":"front","average":{"1min":1.258,"5min":1.3140000000000001,"15min":1.413},"min":{"1min":0.86899999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6930000000000001,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.452}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194424,"statfs":{"total":200000000,"available":199090491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80500000000000005,"15min":0.76600000000000001},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.28299999999999997},"max":{"1min":1.2370000000000001,"5min":1.639,"15min":1.6399999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.90300000000000002,"15min":0.95099999999999996},"min":{"1min":0.53300000000000003,"5min":0.371,"15min":0.371},"max":{"1min":1.361,"5min":1.766,"15min":14.010999999999999},"last":0.73299999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92700000000000005,"15min":1.0109999999999999},"min":{"1min":0.41799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7050000000000001,"5min":1.845,"15min":33.799999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.0389999999999999,"15min":1.1080000000000001},"min":{"1min":0.623,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.708,"5min":2.056,"15min":41.758000000000003},"last":0.628}]},{"osd":3,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.97499999999999998},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.35099999999999998},"max":{"1min":1.5049999999999999,"5min":1.619,"15min":4.4530000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1020000000000001,"15min":1.0900000000000001},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.36499999999999999},"max":{"1min":1.7210000000000001,"5min":2.02,"15min":2.02},"last":1.1910000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.175,"15min":1.1970000000000001},"min":{"1min":0.873,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.679,"5min":1.917,"15min":4.4269999999999996},"last":1.327},{"interface":"front","average":{"1min":1.258,"5min":1.26,"15min":1.242},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.68999999999999995},"max":{"1min":1.79,"5min":2.1099999999999999,"15min":15.766},"last":1.3400000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2490000000000001,"15min":1.242},"min":{"1min":0.90800000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.77,"5min":2.4569999999999999,"15min":14.337999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.2470000000000001,"15min":1.2709999999999999},"min":{"1min":0.755,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5660000000000001,"5min":2.3119999999999998,"15min":4.3970000000000002},"last":1.0920000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3759999999999999,"15min":1.296},"min":{"1min":0.876,"5min":0.753,"15min":0.67800000000000005},"max":{"1min":1.9470000000000001,"5min":2.242,"15min":5.4669999999999996},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.359,"15min":1.349},"min":{"1min":0.81499999999999995,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.823,"5min":2.5489999999999999,"15min":17.161000000000001},"last":1.119}]},{"osd":7,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.363,"15min":1.3540000000000001},"min":{"1min":0.746,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8169999999999999,"5min":2.653,"15min":14.381},"last":1.214},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3200000000000001,"15min":1.383},"min":{"1min":0.91900000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1230000000000002,"5min":2.3879999999999999,"15min":9.7080000000000002},"last":1.1659999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:55:27.547 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:55:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.802+0000 7f25fb80b640 1 Processor -- start 2023-12-19T13:55:27.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.803+0000 7f25fb80b640 1 -- start start 2023-12-19T13:55:27.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25fb80b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25f4157bf0 0x7f25f415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25fb80b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40ae110 0x7f25f40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25fb80b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40b0a90 con 0x7f25f40b0640 2023-12-19T13:55:27.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25fb80b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f406b8c0 con 0x7f25f4157bf0 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25fb80b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415b740 con 0x7f25f40ae110 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25f95a7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25f4157bf0 0x7f25f415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25f9da8640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f25f40b0640 0x7f25f415dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:43686/0 (socket says 172.21.15.113:43686) 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25f95a7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25f4157bf0 0x7f25f415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46150/0 (socket says 172.21.15.113:46150) 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.804+0000 7f25f9da8640 1 -- 172.21.15.113:0/179225237 learned_addr learned my addr 172.21.15.113:0/179225237 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.805+0000 7f25f8da6640 1 --2- 172.21.15.113:0/179225237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40ae110 0x7f25f40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.805+0000 7f25f95a7640 1 -- 172.21.15.113:0/179225237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40ae110 msgr2=0x7f25f40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.805+0000 7f25f95a7640 1 --2- 172.21.15.113:0/179225237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40ae110 0x7f25f40b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.805+0000 7f25f95a7640 1 -- 172.21.15.113:0/179225237 >> v1:172.21.15.113:6789/0 conn(0x7f25f40b0640 legacy=0x7f25f415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.805+0000 7f25f95a7640 1 -- 172.21.15.113:0/179225237 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40ae640 con 0x7f25f4157bf0 2023-12-19T13:55:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.806+0000 7f25f95a7640 1 --2- 172.21.15.113:0/179225237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f4157bf0 0x7f25f415b200 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f25f00097a0 tx=0x7f25f002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81130dd30f9747ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.806+0000 7f25ebfff640 1 -- 172.21.15.113:0/179225237 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f002d040 con 0x7f25f4157bf0 2023-12-19T13:55:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.806+0000 7f25ebfff640 1 -- 172.21.15.113:0/179225237 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0031810 con 0x7f25f4157bf0 2023-12-19T13:55:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.806+0000 7f25ebfff640 1 -- 172.21.15.113:0/179225237 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0031ba0 con 0x7f25f4157bf0 2023-12-19T13:55:27.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 -- 172.21.15.113:0/179225237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f4157bf0 msgr2=0x7f25f415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 --2- 172.21.15.113:0/179225237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f4157bf0 0x7f25f415b200 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f25f00097a0 tx=0x7f25f002b8b0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 -- 172.21.15.113:0/179225237 shutdown_connections 2023-12-19T13:55:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 --2- 172.21.15.113:0/179225237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40ae110 0x7f25f40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 --2- 172.21.15.113:0/179225237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f4157bf0 0x7f25f415b200 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 -- 172.21.15.113:0/179225237 >> 172.21.15.113:0/179225237 conn(0x7f25f40cbb70 msgr2=0x7f25f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 -- 172.21.15.113:0/179225237 shutdown_connections 2023-12-19T13:55:27.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.807+0000 7f25fb80b640 1 -- 172.21.15.113:0/179225237 wait complete. 2023-12-19T13:55:27.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.809+0000 7f25fb80b640 1 Processor -- start 2023-12-19T13:55:27.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.809+0000 7f25fb80b640 1 -- start start 2023-12-19T13:55:27.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25fb80b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f40ae110 0x7f25f4151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25fb80b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40b0640 0x7f25f4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25fb80b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25f4157bf0 0x7f25f414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25fb80b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40cd630 con 0x7f25f40ae110 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25fb80b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4158510 con 0x7f25f4157bf0 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25fb80b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40cd840 con 0x7f25f40b0640 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25f95a7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f40ae110 0x7f25f4151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25f95a7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f40ae110 0x7f25f4151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46164/0 (socket says 172.21.15.113:46164) 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.810+0000 7f25f95a7640 1 -- 172.21.15.113:0/2562508204 learned_addr learned my addr 172.21.15.113:0/2562508204 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25f8da6640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40b0640 0x7f25f4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25f95a7640 1 -- 172.21.15.113:0/2562508204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40b0640 msgr2=0x7f25f4157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25f95a7640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40b0640 0x7f25f4157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25f95a7640 1 -- 172.21.15.113:0/2562508204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25f4157bf0 msgr2=0x7f25f414c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25f95a7640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25f4157bf0 0x7f25f414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25f95a7640 1 -- 172.21.15.113:0/2562508204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0009400 con 0x7f25f40ae110 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25f95a7640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f40ae110 0x7f25f4151d30 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:27.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25e9ffb640 1 -- 172.21.15.113:0/2562508204 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f003ad60 con 0x7f25f40ae110 2023-12-19T13:55:27.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25e9ffb640 1 -- 172.21.15.113:0/2562508204 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f00443f0 con 0x7f25f40ae110 2023-12-19T13:55:27.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25e9ffb640 1 -- 172.21.15.113:0/2562508204 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00447a0 con 0x7f25f40ae110 2023-12-19T13:55:27.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f40cdb20 con 0x7f25f40ae110 2023-12-19T13:55:27.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.811+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f40ce0e0 con 0x7f25f40ae110 2023-12-19T13:55:27.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.812+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4061910 con 0x7f25f40ae110 2023-12-19T13:55:27.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.814+0000 7f25e9ffb640 1 -- 172.21.15.113:0/2562508204 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25f004d450 con 0x7f25f40ae110 2023-12-19T13:55:27.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.815+0000 7f25e9ffb640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f25d806a430 0x7f25d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:27.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.815+0000 7f25e9ffb640 1 -- 172.21.15.113:0/2562508204 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25f00aac40 con 0x7f25f40ae110 2023-12-19T13:55:27.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.815+0000 7f25f8da6640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f25d806a430 0x7f25d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:27.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.816+0000 7f25f8da6640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f25d806a430 0x7f25d806c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f25e4006fd0 tx=0x7f25e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:27.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:27.826+0000 7f25e9ffb640 1 -- 172.21.15.113:0/2562508204 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25f00762a0 con 0x7f25f40ae110 2023-12-19T13:55:28.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.013+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25f40aec00 con 0x7f25d806a430 2023-12-19T13:55:28.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.035+0000 7f25e9ffb640 1 -- 172.21.15.113:0/2562508204 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282792 (secure 0 0 0) 0x7f25e400c040 con 0x7f25d806a430 2023-12-19T13:55:28.037 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:28.040 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:55:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f25d806a430 msgr2=0x7f25d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f25d806a430 0x7f25d806c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f25e4006fd0 tx=0x7f25e4008040 comp rx=0 tx=0).stop 2023-12-19T13:55:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f40ae110 msgr2=0x7f25f4151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f40ae110 0x7f25f4151d30 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f00046c0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 shutdown_connections 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f25d806a430 0x7f25d806c8f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25f4157bf0 0x7f25f414c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25f40b0640 0x7f25f4157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 --2- 172.21.15.113:0/2562508204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f40ae110 0x7f25f4151d30 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 >> 172.21.15.113:0/2562508204 conn(0x7f25f40cbb70 msgr2=0x7f25f406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.042+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 shutdown_connections 2023-12-19T13:55:28.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.043+0000 7f25fb80b640 1 -- 172.21.15.113:0/2562508204 wait complete. 2023-12-19T13:55:28.065 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":428,"stamp":"2023-12-19T13:55:26.584683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8293,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554206,"statfs":{"total":1600000000,"available":1591507328,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.010583"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088035+0000","last_change":"2023-12-19T13:55:23.109030+0000","last_active":"2023-12-19T13:55:24.088035+0000","last_peered":"2023-12-19T13:55:24.088035+0000","last_clean":"2023-12-19T13:55:24.088035+0000","last_became_active":"2023-12-19T13:55:23.108311+0000","last_became_peered":"2023-12-19T13:55:23.108311+0000","last_unstale":"2023-12-19T13:55:24.088035+0000","last_undegraded":"2023-12-19T13:55:24.088035+0000","last_fullsized":"2023-12-19T13:55:24.088035+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:28.428312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088546+0000","last_change":"2023-12-19T13:55:23.114140+0000","last_active":"2023-12-19T13:55:24.088546+0000","last_peered":"2023-12-19T13:55:24.088546+0000","last_clean":"2023-12-19T13:55:24.088546+0000","last_became_active":"2023-12-19T13:55:23.113668+0000","last_became_peered":"2023-12-19T13:55:23.113668+0000","last_unstale":"2023-12-19T13:55:24.088546+0000","last_undegraded":"2023-12-19T13:55:24.088546+0000","last_fullsized":"2023-12-19T13:55:24.088546+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:36:23.320500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698196+0000","last_change":"2023-12-19T13:55:23.095845+0000","last_active":"2023-12-19T13:55:24.698196+0000","last_peered":"2023-12-19T13:55:24.698196+0000","last_clean":"2023-12-19T13:55:24.698196+0000","last_became_active":"2023-12-19T13:55:23.095637+0000","last_became_peered":"2023-12-19T13:55:23.095637+0000","last_unstale":"2023-12-19T13:55:24.698196+0000","last_undegraded":"2023-12-19T13:55:24.698196+0000","last_fullsized":"2023-12-19T13:55:24.698196+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:16.950240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695401+0000","last_change":"2023-12-19T13:55:23.105256+0000","last_active":"2023-12-19T13:55:24.695401+0000","last_peered":"2023-12-19T13:55:24.695401+0000","last_clean":"2023-12-19T13:55:24.695401+0000","last_became_active":"2023-12-19T13:55:23.105064+0000","last_became_peered":"2023-12-19T13:55:23.105064+0000","last_unstale":"2023-12-19T13:55:24.695401+0000","last_undegraded":"2023-12-19T13:55:24.695401+0000","last_fullsized":"2023-12-19T13:55:24.695401+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:51.527820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090150+0000","last_change":"2023-12-19T13:55:23.116380+0000","last_active":"2023-12-19T13:55:24.090150+0000","last_peered":"2023-12-19T13:55:24.090150+0000","last_clean":"2023-12-19T13:55:24.090150+0000","last_became_active":"2023-12-19T13:55:23.116162+0000","last_became_peered":"2023-12-19T13:55:23.116162+0000","last_unstale":"2023-12-19T13:55:24.090150+0000","last_undegraded":"2023-12-19T13:55:24.090150+0000","last_fullsized":"2023-12-19T13:55:24.090150+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:23.875461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695653+0000","last_change":"2023-12-19T13:55:23.114248+0000","last_active":"2023-12-19T13:55:24.695653+0000","last_peered":"2023-12-19T13:55:24.695653+0000","last_clean":"2023-12-19T13:55:24.695653+0000","last_became_active":"2023-12-19T13:55:23.112089+0000","last_became_peered":"2023-12-19T13:55:23.112089+0000","last_unstale":"2023-12-19T13:55:24.695653+0000","last_undegraded":"2023-12-19T13:55:24.695653+0000","last_fullsized":"2023-12-19T13:55:24.695653+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:08.149290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089819+0000","last_change":"2023-12-19T13:55:23.110851+0000","last_active":"2023-12-19T13:55:24.089819+0000","last_peered":"2023-12-19T13:55:24.089819+0000","last_clean":"2023-12-19T13:55:24.089819+0000","last_became_active":"2023-12-19T13:55:23.110629+0000","last_became_peered":"2023-12-19T13:55:23.110629+0000","last_unstale":"2023-12-19T13:55:24.089819+0000","last_undegraded":"2023-12-19T13:55:24.089819+0000","last_fullsized":"2023-12-19T13:55:24.089819+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:26.586823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089682+0000","last_change":"2023-12-19T13:55:23.104563+0000","last_active":"2023-12-19T13:55:24.089682+0000","last_peered":"2023-12-19T13:55:24.089682+0000","last_clean":"2023-12-19T13:55:24.089682+0000","last_became_active":"2023-12-19T13:55:23.104280+0000","last_became_peered":"2023-12-19T13:55:23.104280+0000","last_unstale":"2023-12-19T13:55:24.089682+0000","last_undegraded":"2023-12-19T13:55:24.089682+0000","last_fullsized":"2023-12-19T13:55:24.089682+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:31.266898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695481+0000","last_change":"2023-12-19T13:55:23.097358+0000","last_active":"2023-12-19T13:55:24.695481+0000","last_peered":"2023-12-19T13:55:24.695481+0000","last_clean":"2023-12-19T13:55:24.695481+0000","last_became_active":"2023-12-19T13:55:23.094209+0000","last_became_peered":"2023-12-19T13:55:23.094209+0000","last_unstale":"2023-12-19T13:55:24.695481+0000","last_undegraded":"2023-12-19T13:55:24.695481+0000","last_fullsized":"2023-12-19T13:55:24.695481+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:42.689584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.087821+0000","last_change":"2023-12-19T13:55:23.109043+0000","last_active":"2023-12-19T13:55:24.087821+0000","last_peered":"2023-12-19T13:55:24.087821+0000","last_clean":"2023-12-19T13:55:24.087821+0000","last_became_active":"2023-12-19T13:55:23.108384+0000","last_became_peered":"2023-12-19T13:55:23.108384+0000","last_unstale":"2023-12-19T13:55:24.087821+0000","last_undegraded":"2023-12-19T13:55:24.087821+0000","last_fullsized":"2023-12-19T13:55:24.087821+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:01:42.623800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695926+0000","last_change":"2023-12-19T13:55:23.098811+0000","last_active":"2023-12-19T13:55:24.695926+0000","last_peered":"2023-12-19T13:55:24.695926+0000","last_clean":"2023-12-19T13:55:24.695926+0000","last_became_active":"2023-12-19T13:55:23.098570+0000","last_became_peered":"2023-12-19T13:55:23.098570+0000","last_unstale":"2023-12-19T13:55:24.695926+0000","last_undegraded":"2023-12-19T13:55:24.695926+0000","last_fullsized":"2023-12-19T13:55:24.695926+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:04.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696672+0000","last_change":"2023-12-19T13:55:23.112932+0000","last_active":"2023-12-19T13:55:24.696672+0000","last_peered":"2023-12-19T13:55:24.696672+0000","last_clean":"2023-12-19T13:55:24.696672+0000","last_became_active":"2023-12-19T13:55:23.107702+0000","last_became_peered":"2023-12-19T13:55:23.107702+0000","last_unstale":"2023-12-19T13:55:24.696672+0000","last_undegraded":"2023-12-19T13:55:24.696672+0000","last_fullsized":"2023-12-19T13:55:24.696672+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:29.143561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695815+0000","last_change":"2023-12-19T13:55:23.090310+0000","last_active":"2023-12-19T13:55:24.695815+0000","last_peered":"2023-12-19T13:55:24.695815+0000","last_clean":"2023-12-19T13:55:24.695815+0000","last_became_active":"2023-12-19T13:55:23.090011+0000","last_became_peered":"2023-12-19T13:55:23.090011+0000","last_unstale":"2023-12-19T13:55:24.695815+0000","last_undegraded":"2023-12-19T13:55:24.695815+0000","last_fullsized":"2023-12-19T13:55:24.695815+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:42.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231401+0000","last_change":"2023-12-19T13:55:23.098175+0000","last_active":"2023-12-19T13:55:24.231401+0000","last_peered":"2023-12-19T13:55:24.231401+0000","last_clean":"2023-12-19T13:55:24.231401+0000","last_became_active":"2023-12-19T13:55:23.097862+0000","last_became_peered":"2023-12-19T13:55:23.097862+0000","last_unstale":"2023-12-19T13:55:24.231401+0000","last_undegraded":"2023-12-19T13:55:24.231401+0000","last_fullsized":"2023-12-19T13:55:24.231401+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:19.039260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090689+0000","last_change":"2023-12-19T13:55:23.111436+0000","last_active":"2023-12-19T13:55:24.090689+0000","last_peered":"2023-12-19T13:55:24.090689+0000","last_clean":"2023-12-19T13:55:24.090689+0000","last_became_active":"2023-12-19T13:55:23.111160+0000","last_became_peered":"2023-12-19T13:55:23.111160+0000","last_unstale":"2023-12-19T13:55:24.090689+0000","last_undegraded":"2023-12-19T13:55:24.090689+0000","last_fullsized":"2023-12-19T13:55:24.090689+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:08.944157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231665+0000","last_change":"2023-12-19T13:55:23.104338+0000","last_active":"2023-12-19T13:55:24.231665+0000","last_peered":"2023-12-19T13:55:24.231665+0000","last_clean":"2023-12-19T13:55:24.231665+0000","last_became_active":"2023-12-19T13:55:23.104120+0000","last_became_peered":"2023-12-19T13:55:23.104120+0000","last_unstale":"2023-12-19T13:55:24.231665+0000","last_undegraded":"2023-12-19T13:55:24.231665+0000","last_fullsized":"2023-12-19T13:55:24.231665+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:13.157395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697208+0000","last_change":"2023-12-19T13:55:23.092778+0000","last_active":"2023-12-19T13:55:24.697208+0000","last_peered":"2023-12-19T13:55:24.697208+0000","last_clean":"2023-12-19T13:55:24.697208+0000","last_became_active":"2023-12-19T13:55:23.092489+0000","last_became_peered":"2023-12-19T13:55:23.092489+0000","last_unstale":"2023-12-19T13:55:24.697208+0000","last_undegraded":"2023-12-19T13:55:24.697208+0000","last_fullsized":"2023-12-19T13:55:24.697208+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:10.792506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089764+0000","last_change":"2023-12-19T13:55:23.094408+0000","last_active":"2023-12-19T13:55:24.089764+0000","last_peered":"2023-12-19T13:55:24.089764+0000","last_clean":"2023-12-19T13:55:24.089764+0000","last_became_active":"2023-12-19T13:55:23.094157+0000","last_became_peered":"2023-12-19T13:55:23.094157+0000","last_unstale":"2023-12-19T13:55:24.089764+0000","last_undegraded":"2023-12-19T13:55:24.089764+0000","last_fullsized":"2023-12-19T13:55:24.089764+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:31.266898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.087809+0000","last_change":"2023-12-19T13:55:23.110018+0000","last_active":"2023-12-19T13:55:24.087809+0000","last_peered":"2023-12-19T13:55:24.087809+0000","last_clean":"2023-12-19T13:55:24.087809+0000","last_became_active":"2023-12-19T13:55:23.109604+0000","last_became_peered":"2023-12-19T13:55:23.109604+0000","last_unstale":"2023-12-19T13:55:24.087809+0000","last_undegraded":"2023-12-19T13:55:24.087809+0000","last_fullsized":"2023-12-19T13:55:24.087809+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:52.619721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.091098+0000","last_change":"2023-12-19T13:55:23.097997+0000","last_active":"2023-12-19T13:55:24.091098+0000","last_peered":"2023-12-19T13:55:24.091098+0000","last_clean":"2023-12-19T13:55:24.091098+0000","last_became_active":"2023-12-19T13:55:23.097760+0000","last_became_peered":"2023-12-19T13:55:23.097760+0000","last_unstale":"2023-12-19T13:55:24.091098+0000","last_undegraded":"2023-12-19T13:55:24.091098+0000","last_fullsized":"2023-12-19T13:55:24.091098+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:55.635662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695893+0000","last_change":"2023-12-19T13:55:23.114537+0000","last_active":"2023-12-19T13:55:24.695893+0000","last_peered":"2023-12-19T13:55:24.695893+0000","last_clean":"2023-12-19T13:55:24.695893+0000","last_became_active":"2023-12-19T13:55:23.112356+0000","last_became_peered":"2023-12-19T13:55:23.112356+0000","last_unstale":"2023-12-19T13:55:24.695893+0000","last_undegraded":"2023-12-19T13:55:24.695893+0000","last_fullsized":"2023-12-19T13:55:24.695893+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:55.635662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088791+0000","last_change":"2023-12-19T13:55:23.096152+0000","last_active":"2023-12-19T13:55:24.088791+0000","last_peered":"2023-12-19T13:55:24.088791+0000","last_clean":"2023-12-19T13:55:24.088791+0000","last_became_active":"2023-12-19T13:55:23.095495+0000","last_became_peered":"2023-12-19T13:55:23.095495+0000","last_unstale":"2023-12-19T13:55:24.088791+0000","last_undegraded":"2023-12-19T13:55:24.088791+0000","last_fullsized":"2023-12-19T13:55:24.088791+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:43.926042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695859+0000","last_change":"2023-12-19T13:55:23.112079+0000","last_active":"2023-12-19T13:55:24.695859+0000","last_peered":"2023-12-19T13:55:24.695859+0000","last_clean":"2023-12-19T13:55:24.695859+0000","last_became_active":"2023-12-19T13:55:23.111861+0000","last_became_peered":"2023-12-19T13:55:23.111861+0000","last_unstale":"2023-12-19T13:55:24.695859+0000","last_undegraded":"2023-12-19T13:55:24.695859+0000","last_fullsized":"2023-12-19T13:55:24.695859+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:17.565114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090075+0000","last_change":"2023-12-19T13:55:23.102707+0000","last_active":"2023-12-19T13:55:24.090075+0000","last_peered":"2023-12-19T13:55:24.090075+0000","last_clean":"2023-12-19T13:55:24.090075+0000","last_became_active":"2023-12-19T13:55:23.102316+0000","last_became_peered":"2023-12-19T13:55:23.102316+0000","last_unstale":"2023-12-19T13:55:24.090075+0000","last_undegraded":"2023-12-19T13:55:24.090075+0000","last_fullsized":"2023-12-19T13:55:24.090075+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:02.490924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695848+0000","last_change":"2023-12-19T13:55:23.090999+0000","last_active":"2023-12-19T13:55:24.695848+0000","last_peered":"2023-12-19T13:55:24.695848+0000","last_clean":"2023-12-19T13:55:24.695848+0000","last_became_active":"2023-12-19T13:55:23.088258+0000","last_became_peered":"2023-12-19T13:55:23.088258+0000","last_unstale":"2023-12-19T13:55:24.695848+0000","last_undegraded":"2023-12-19T13:55:24.695848+0000","last_fullsized":"2023-12-19T13:55:24.695848+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:03:30.372109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088291+0000","last_change":"2023-12-19T13:55:23.092319+0000","last_active":"2023-12-19T13:55:24.088291+0000","last_peered":"2023-12-19T13:55:24.088291+0000","last_clean":"2023-12-19T13:55:24.088291+0000","last_became_active":"2023-12-19T13:55:23.092106+0000","last_became_peered":"2023-12-19T13:55:23.092106+0000","last_unstale":"2023-12-19T13:55:24.088291+0000","last_undegraded":"2023-12-19T13:55:24.088291+0000","last_fullsized":"2023-12-19T13:55:24.088291+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:04.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231666+0000","last_change":"2023-12-19T13:55:23.109491+0000","last_active":"2023-12-19T13:55:24.231666+0000","last_peered":"2023-12-19T13:55:24.231666+0000","last_clean":"2023-12-19T13:55:24.231666+0000","last_became_active":"2023-12-19T13:55:23.109165+0000","last_became_peered":"2023-12-19T13:55:23.109165+0000","last_unstale":"2023-12-19T13:55:24.231666+0000","last_undegraded":"2023-12-19T13:55:24.231666+0000","last_fullsized":"2023-12-19T13:55:24.231666+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:08.149290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.694971+0000","last_change":"2023-12-19T13:55:23.102781+0000","last_active":"2023-12-19T13:55:24.694971+0000","last_peered":"2023-12-19T13:55:24.694971+0000","last_clean":"2023-12-19T13:55:24.694971+0000","last_became_active":"2023-12-19T13:55:23.102374+0000","last_became_peered":"2023-12-19T13:55:23.102374+0000","last_unstale":"2023-12-19T13:55:24.694971+0000","last_undegraded":"2023-12-19T13:55:24.694971+0000","last_fullsized":"2023-12-19T13:55:24.694971+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:50.090700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.087543+0000","last_change":"2023-12-19T13:55:23.098918+0000","last_active":"2023-12-19T13:55:24.087543+0000","last_peered":"2023-12-19T13:55:24.087543+0000","last_clean":"2023-12-19T13:55:24.087543+0000","last_became_active":"2023-12-19T13:55:23.098657+0000","last_became_peered":"2023-12-19T13:55:23.098657+0000","last_unstale":"2023-12-19T13:55:24.087543+0000","last_undegraded":"2023-12-19T13:55:24.087543+0000","last_fullsized":"2023-12-19T13:55:24.087543+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:09.691437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088813+0000","last_change":"2023-12-19T13:55:23.091572+0000","last_active":"2023-12-19T13:55:24.088813+0000","last_peered":"2023-12-19T13:55:24.088813+0000","last_clean":"2023-12-19T13:55:24.088813+0000","last_became_active":"2023-12-19T13:55:23.091331+0000","last_became_peered":"2023-12-19T13:55:23.091331+0000","last_unstale":"2023-12-19T13:55:24.088813+0000","last_undegraded":"2023-12-19T13:55:24.088813+0000","last_fullsized":"2023-12-19T13:55:24.088813+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:51.527820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696117+0000","last_change":"2023-12-19T13:55:23.095266+0000","last_active":"2023-12-19T13:55:24.696117+0000","last_peered":"2023-12-19T13:55:24.696117+0000","last_clean":"2023-12-19T13:55:24.696117+0000","last_became_active":"2023-12-19T13:55:23.094158+0000","last_became_peered":"2023-12-19T13:55:23.094158+0000","last_unstale":"2023-12-19T13:55:24.696117+0000","last_undegraded":"2023-12-19T13:55:24.696117+0000","last_fullsized":"2023-12-19T13:55:24.696117+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:54.202203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697436+0000","last_change":"2023-12-19T13:55:23.093275+0000","last_active":"2023-12-19T13:55:24.697436+0000","last_peered":"2023-12-19T13:55:24.697436+0000","last_clean":"2023-12-19T13:55:24.697436+0000","last_became_active":"2023-12-19T13:55:23.093037+0000","last_became_peered":"2023-12-19T13:55:23.093037+0000","last_unstale":"2023-12-19T13:55:24.697436+0000","last_undegraded":"2023-12-19T13:55:24.697436+0000","last_fullsized":"2023-12-19T13:55:24.697436+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:56:42.427130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231676+0000","last_change":"2023-12-19T13:55:23.103693+0000","last_active":"2023-12-19T13:55:24.231676+0000","last_peered":"2023-12-19T13:55:24.231676+0000","last_clean":"2023-12-19T13:55:24.231676+0000","last_became_active":"2023-12-19T13:55:23.103445+0000","last_became_peered":"2023-12-19T13:55:23.103445+0000","last_unstale":"2023-12-19T13:55:24.231676+0000","last_undegraded":"2023-12-19T13:55:24.231676+0000","last_fullsized":"2023-12-19T13:55:24.231676+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:06.275917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"162'4","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089763+0000","last_change":"2023-12-19T13:55:22.619901+0000","last_active":"2023-12-19T13:55:24.089763+0000","last_peered":"2023-12-19T13:55:24.089763+0000","last_clean":"2023-12-19T13:55:24.089763+0000","last_became_active":"2023-12-19T13:55:22.619486+0000","last_became_peered":"2023-12-19T13:55:22.619486+0000","last_unstale":"2023-12-19T13:55:24.089763+0000","last_undegraded":"2023-12-19T13:55:24.089763+0000","last_fullsized":"2023-12-19T13:55:24.089763+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:45.489463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698428+0000","last_change":"2023-12-19T13:55:23.091930+0000","last_active":"2023-12-19T13:55:24.698428+0000","last_peered":"2023-12-19T13:55:24.698428+0000","last_clean":"2023-12-19T13:55:24.698428+0000","last_became_active":"2023-12-19T13:55:23.091640+0000","last_became_peered":"2023-12-19T13:55:23.091640+0000","last_unstale":"2023-12-19T13:55:24.698428+0000","last_undegraded":"2023-12-19T13:55:24.698428+0000","last_fullsized":"2023-12-19T13:55:24.698428+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:07.639191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695971+0000","last_change":"2023-12-19T13:55:22.616173+0000","last_active":"2023-12-19T13:55:24.695971+0000","last_peered":"2023-12-19T13:55:24.695971+0000","last_clean":"2023-12-19T13:55:24.695971+0000","last_became_active":"2023-12-19T13:55:22.615777+0000","last_became_peered":"2023-12-19T13:55:22.615777+0000","last_unstale":"2023-12-19T13:55:24.695971+0000","last_undegraded":"2023-12-19T13:55:24.695971+0000","last_fullsized":"2023-12-19T13:55:24.695971+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:21.983634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697193+0000","last_change":"2023-12-19T13:55:23.092438+0000","last_active":"2023-12-19T13:55:24.697193+0000","last_peered":"2023-12-19T13:55:24.697193+0000","last_clean":"2023-12-19T13:55:24.697193+0000","last_became_active":"2023-12-19T13:55:23.090975+0000","last_became_peered":"2023-12-19T13:55:23.090975+0000","last_unstale":"2023-12-19T13:55:24.697193+0000","last_undegraded":"2023-12-19T13:55:24.697193+0000","last_fullsized":"2023-12-19T13:55:24.697193+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:28.273009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696083+0000","last_change":"2023-12-19T13:55:22.602821+0000","last_active":"2023-12-19T13:55:24.696083+0000","last_peered":"2023-12-19T13:55:24.696083+0000","last_clean":"2023-12-19T13:55:24.696083+0000","last_became_active":"2023-12-19T13:55:22.601225+0000","last_became_peered":"2023-12-19T13:55:22.601225+0000","last_unstale":"2023-12-19T13:55:24.696083+0000","last_undegraded":"2023-12-19T13:55:24.696083+0000","last_fullsized":"2023-12-19T13:55:24.696083+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:43.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698404+0000","last_change":"2023-12-19T13:55:23.106615+0000","last_active":"2023-12-19T13:55:24.698404+0000","last_peered":"2023-12-19T13:55:24.698404+0000","last_clean":"2023-12-19T13:55:24.698404+0000","last_became_active":"2023-12-19T13:55:23.106042+0000","last_became_peered":"2023-12-19T13:55:23.106042+0000","last_unstale":"2023-12-19T13:55:24.698404+0000","last_undegraded":"2023-12-19T13:55:24.698404+0000","last_fullsized":"2023-12-19T13:55:24.698404+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:25.735136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088544+0000","last_change":"2023-12-19T13:55:22.616043+0000","last_active":"2023-12-19T13:55:24.088544+0000","last_peered":"2023-12-19T13:55:24.088544+0000","last_clean":"2023-12-19T13:55:24.088544+0000","last_became_active":"2023-12-19T13:55:22.612923+0000","last_became_peered":"2023-12-19T13:55:22.612923+0000","last_unstale":"2023-12-19T13:55:24.088544+0000","last_undegraded":"2023-12-19T13:55:24.088544+0000","last_fullsized":"2023-12-19T13:55:24.088544+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:47.600802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089900+0000","last_change":"2023-12-19T13:55:23.111426+0000","last_active":"2023-12-19T13:55:24.089900+0000","last_peered":"2023-12-19T13:55:24.089900+0000","last_clean":"2023-12-19T13:55:24.089900+0000","last_became_active":"2023-12-19T13:55:23.111182+0000","last_became_peered":"2023-12-19T13:55:23.111182+0000","last_unstale":"2023-12-19T13:55:24.089900+0000","last_undegraded":"2023-12-19T13:55:24.089900+0000","last_fullsized":"2023-12-19T13:55:24.089900+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:58.824351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089744+0000","last_change":"2023-12-19T13:55:22.614919+0000","last_active":"2023-12-19T13:55:24.089744+0000","last_peered":"2023-12-19T13:55:24.089744+0000","last_clean":"2023-12-19T13:55:24.089744+0000","last_became_active":"2023-12-19T13:55:22.614413+0000","last_became_peered":"2023-12-19T13:55:22.614413+0000","last_unstale":"2023-12-19T13:55:24.089744+0000","last_undegraded":"2023-12-19T13:55:24.089744+0000","last_fullsized":"2023-12-19T13:55:24.089744+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:22.861059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696917+0000","last_change":"2023-12-19T13:55:23.104631+0000","last_active":"2023-12-19T13:55:24.696917+0000","last_peered":"2023-12-19T13:55:24.696917+0000","last_clean":"2023-12-19T13:55:24.696917+0000","last_became_active":"2023-12-19T13:55:23.104402+0000","last_became_peered":"2023-12-19T13:55:23.104402+0000","last_unstale":"2023-12-19T13:55:24.696917+0000","last_undegraded":"2023-12-19T13:55:24.696917+0000","last_fullsized":"2023-12-19T13:55:24.696917+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:48.046200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090220+0000","last_change":"2023-12-19T13:55:22.612897+0000","last_active":"2023-12-19T13:55:24.090220+0000","last_peered":"2023-12-19T13:55:24.090220+0000","last_clean":"2023-12-19T13:55:24.090220+0000","last_became_active":"2023-12-19T13:55:22.612498+0000","last_became_peered":"2023-12-19T13:55:22.612498+0000","last_unstale":"2023-12-19T13:55:24.090220+0000","last_undegraded":"2023-12-19T13:55:24.090220+0000","last_fullsized":"2023-12-19T13:55:24.090220+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:03:42.714548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697998+0000","last_change":"2023-12-19T13:55:23.115923+0000","last_active":"2023-12-19T13:55:24.697998+0000","last_peered":"2023-12-19T13:55:24.697998+0000","last_clean":"2023-12-19T13:55:24.697998+0000","last_became_active":"2023-12-19T13:55:23.115623+0000","last_became_peered":"2023-12-19T13:55:23.115623+0000","last_unstale":"2023-12-19T13:55:24.697998+0000","last_undegraded":"2023-12-19T13:55:24.697998+0000","last_fullsized":"2023-12-19T13:55:24.697998+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:13.157395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696330+0000","last_change":"2023-12-19T13:55:22.616025+0000","last_active":"2023-12-19T13:55:24.696330+0000","last_peered":"2023-12-19T13:55:24.696330+0000","last_clean":"2023-12-19T13:55:24.696330+0000","last_became_active":"2023-12-19T13:55:22.615357+0000","last_became_peered":"2023-12-19T13:55:22.615357+0000","last_unstale":"2023-12-19T13:55:24.696330+0000","last_undegraded":"2023-12-19T13:55:24.696330+0000","last_fullsized":"2023-12-19T13:55:24.696330+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:34:17.570231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088083+0000","last_change":"2023-12-19T13:55:23.096655+0000","last_active":"2023-12-19T13:55:24.088083+0000","last_peered":"2023-12-19T13:55:24.088083+0000","last_clean":"2023-12-19T13:55:24.088083+0000","last_became_active":"2023-12-19T13:55:23.096387+0000","last_became_peered":"2023-12-19T13:55:23.096387+0000","last_unstale":"2023-12-19T13:55:24.088083+0000","last_undegraded":"2023-12-19T13:55:24.088083+0000","last_fullsized":"2023-12-19T13:55:24.088083+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:55.365889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089013+0000","last_change":"2023-12-19T13:55:22.614505+0000","last_active":"2023-12-19T13:55:24.089013+0000","last_peered":"2023-12-19T13:55:24.089013+0000","last_clean":"2023-12-19T13:55:24.089013+0000","last_became_active":"2023-12-19T13:55:22.614225+0000","last_became_peered":"2023-12-19T13:55:22.614225+0000","last_unstale":"2023-12-19T13:55:24.089013+0000","last_undegraded":"2023-12-19T13:55:24.089013+0000","last_fullsized":"2023-12-19T13:55:24.089013+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:30.252496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089036+0000","last_change":"2023-12-19T13:55:23.095821+0000","last_active":"2023-12-19T13:55:24.089036+0000","last_peered":"2023-12-19T13:55:24.089036+0000","last_clean":"2023-12-19T13:55:24.089036+0000","last_became_active":"2023-12-19T13:55:23.095166+0000","last_became_peered":"2023-12-19T13:55:23.095166+0000","last_unstale":"2023-12-19T13:55:24.089036+0000","last_undegraded":"2023-12-19T13:55:24.089036+0000","last_fullsized":"2023-12-19T13:55:24.089036+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:54:43.055764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697475+0000","last_change":"2023-12-19T13:55:22.616798+0000","last_active":"2023-12-19T13:55:24.697475+0000","last_peered":"2023-12-19T13:55:24.697475+0000","last_clean":"2023-12-19T13:55:24.697475+0000","last_became_active":"2023-12-19T13:55:22.616528+0000","last_became_peered":"2023-12-19T13:55:22.616528+0000","last_unstale":"2023-12-19T13:55:24.697475+0000","last_undegraded":"2023-12-19T13:55:24.697475+0000","last_fullsized":"2023-12-19T13:55:24.697475+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:42:39.292219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089871+0000","last_change":"2023-12-19T13:55:23.110992+0000","last_active":"2023-12-19T13:55:24.089871+0000","last_peered":"2023-12-19T13:55:24.089871+0000","last_clean":"2023-12-19T13:55:24.089871+0000","last_became_active":"2023-12-19T13:55:23.110790+0000","last_became_peered":"2023-12-19T13:55:23.110790+0000","last_unstale":"2023-12-19T13:55:24.089871+0000","last_undegraded":"2023-12-19T13:55:24.089871+0000","last_fullsized":"2023-12-19T13:55:24.089871+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:58.824351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090442+0000","last_change":"2023-12-19T13:55:22.610389+0000","last_active":"2023-12-19T13:55:24.090442+0000","last_peered":"2023-12-19T13:55:24.090442+0000","last_clean":"2023-12-19T13:55:24.090442+0000","last_became_active":"2023-12-19T13:55:22.609899+0000","last_became_peered":"2023-12-19T13:55:22.609899+0000","last_unstale":"2023-12-19T13:55:24.090442+0000","last_undegraded":"2023-12-19T13:55:24.090442+0000","last_fullsized":"2023-12-19T13:55:24.090442+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:42:39.292219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695893+0000","last_change":"2023-12-19T13:55:23.110206+0000","last_active":"2023-12-19T13:55:24.695893+0000","last_peered":"2023-12-19T13:55:24.695893+0000","last_clean":"2023-12-19T13:55:24.695893+0000","last_became_active":"2023-12-19T13:55:23.108436+0000","last_became_peered":"2023-12-19T13:55:23.108436+0000","last_unstale":"2023-12-19T13:55:24.695893+0000","last_undegraded":"2023-12-19T13:55:24.695893+0000","last_fullsized":"2023-12-19T13:55:24.695893+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:06.275917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"162'3","reported_seq":14,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089841+0000","last_change":"2023-12-19T13:55:22.619742+0000","last_active":"2023-12-19T13:55:24.089841+0000","last_peered":"2023-12-19T13:55:24.089841+0000","last_clean":"2023-12-19T13:55:24.089841+0000","last_became_active":"2023-12-19T13:55:22.619167+0000","last_became_peered":"2023-12-19T13:55:22.619167+0000","last_unstale":"2023-12-19T13:55:24.089841+0000","last_undegraded":"2023-12-19T13:55:24.089841+0000","last_fullsized":"2023-12-19T13:55:24.089841+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:42.364979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696109+0000","last_change":"2023-12-19T13:55:23.107015+0000","last_active":"2023-12-19T13:55:24.696109+0000","last_peered":"2023-12-19T13:55:24.696109+0000","last_clean":"2023-12-19T13:55:24.696109+0000","last_became_active":"2023-12-19T13:55:23.106490+0000","last_became_peered":"2023-12-19T13:55:23.106490+0000","last_unstale":"2023-12-19T13:55:24.696109+0000","last_undegraded":"2023-12-19T13:55:24.696109+0000","last_fullsized":"2023-12-19T13:55:24.696109+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:34.599808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"162'6","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695037+0000","last_change":"2023-12-19T13:55:22.615108+0000","last_active":"2023-12-19T13:55:24.695037+0000","last_peered":"2023-12-19T13:55:24.695037+0000","last_clean":"2023-12-19T13:55:24.695037+0000","last_became_active":"2023-12-19T13:55:22.614778+0000","last_became_peered":"2023-12-19T13:55:22.614778+0000","last_unstale":"2023-12-19T13:55:24.695037+0000","last_undegraded":"2023-12-19T13:55:24.695037+0000","last_fullsized":"2023-12-19T13:55:24.695037+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:43:27.729568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231639+0000","last_change":"2023-12-19T13:55:23.102594+0000","last_active":"2023-12-19T13:55:24.231639+0000","last_peered":"2023-12-19T13:55:24.231639+0000","last_clean":"2023-12-19T13:55:24.231639+0000","last_became_active":"2023-12-19T13:55:23.102343+0000","last_became_peered":"2023-12-19T13:55:23.102343+0000","last_unstale":"2023-12-19T13:55:24.231639+0000","last_undegraded":"2023-12-19T13:55:24.231639+0000","last_fullsized":"2023-12-19T13:55:24.231639+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:48.046200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231979+0000","last_change":"2023-12-19T13:55:22.612897+0000","last_active":"2023-12-19T13:55:24.231979+0000","last_peered":"2023-12-19T13:55:24.231979+0000","last_clean":"2023-12-19T13:55:24.231979+0000","last_became_active":"2023-12-19T13:55:22.612255+0000","last_became_peered":"2023-12-19T13:55:22.612255+0000","last_unstale":"2023-12-19T13:55:24.231979+0000","last_undegraded":"2023-12-19T13:55:24.231979+0000","last_fullsized":"2023-12-19T13:55:24.231979+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:12:27.744900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231395+0000","last_change":"2023-12-19T13:55:23.104698+0000","last_active":"2023-12-19T13:55:24.231395+0000","last_peered":"2023-12-19T13:55:24.231395+0000","last_clean":"2023-12-19T13:55:24.231395+0000","last_became_active":"2023-12-19T13:55:23.104444+0000","last_became_peered":"2023-12-19T13:55:23.104444+0000","last_unstale":"2023-12-19T13:55:24.231395+0000","last_undegraded":"2023-12-19T13:55:24.231395+0000","last_fullsized":"2023-12-19T13:55:24.231395+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:53.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695790+0000","last_change":"2023-12-19T13:55:22.616740+0000","last_active":"2023-12-19T13:55:24.695790+0000","last_peered":"2023-12-19T13:55:24.695790+0000","last_clean":"2023-12-19T13:55:24.695790+0000","last_became_active":"2023-12-19T13:55:22.616219+0000","last_became_peered":"2023-12-19T13:55:22.616219+0000","last_unstale":"2023-12-19T13:55:24.695790+0000","last_undegraded":"2023-12-19T13:55:24.695790+0000","last_fullsized":"2023-12-19T13:55:24.695790+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:07.134888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697295+0000","last_change":"2023-12-19T13:55:23.107974+0000","last_active":"2023-12-19T13:55:24.697295+0000","last_peered":"2023-12-19T13:55:24.697295+0000","last_clean":"2023-12-19T13:55:24.697295+0000","last_became_active":"2023-12-19T13:55:23.107417+0000","last_became_peered":"2023-12-19T13:55:23.107417+0000","last_unstale":"2023-12-19T13:55:24.697295+0000","last_undegraded":"2023-12-19T13:55:24.697295+0000","last_fullsized":"2023-12-19T13:55:24.697295+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:19.039260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"162'8","reported_seq":19,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696351+0000","last_change":"2023-12-19T13:55:22.616396+0000","last_active":"2023-12-19T13:55:24.696351+0000","last_peered":"2023-12-19T13:55:24.696351+0000","last_clean":"2023-12-19T13:55:24.696351+0000","last_became_active":"2023-12-19T13:55:22.615601+0000","last_became_peered":"2023-12-19T13:55:22.615601+0000","last_unstale":"2023-12-19T13:55:24.696351+0000","last_undegraded":"2023-12-19T13:55:24.696351+0000","last_fullsized":"2023-12-19T13:55:24.696351+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:22.492323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090373+0000","last_change":"2023-12-19T13:55:23.108891+0000","last_active":"2023-12-19T13:55:24.090373+0000","last_peered":"2023-12-19T13:55:24.090373+0000","last_clean":"2023-12-19T13:55:24.090373+0000","last_became_active":"2023-12-19T13:55:23.108551+0000","last_became_peered":"2023-12-19T13:55:23.108551+0000","last_unstale":"2023-12-19T13:55:24.090373+0000","last_undegraded":"2023-12-19T13:55:24.090373+0000","last_fullsized":"2023-12-19T13:55:24.090373+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:55.635662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696826+0000","last_change":"2023-12-19T13:55:22.613023+0000","last_active":"2023-12-19T13:55:24.696826+0000","last_peered":"2023-12-19T13:55:24.696826+0000","last_clean":"2023-12-19T13:55:24.696826+0000","last_became_active":"2023-12-19T13:55:22.612613+0000","last_became_peered":"2023-12-19T13:55:22.612613+0000","last_unstale":"2023-12-19T13:55:24.696826+0000","last_undegraded":"2023-12-19T13:55:24.696826+0000","last_fullsized":"2023-12-19T13:55:24.696826+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:45.489463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089800+0000","last_change":"2023-12-19T13:55:23.108516+0000","last_active":"2023-12-19T13:55:24.089800+0000","last_peered":"2023-12-19T13:55:24.089800+0000","last_clean":"2023-12-19T13:55:24.089800+0000","last_became_active":"2023-12-19T13:55:23.107974+0000","last_became_peered":"2023-12-19T13:55:23.107974+0000","last_unstale":"2023-12-19T13:55:24.089800+0000","last_undegraded":"2023-12-19T13:55:24.089800+0000","last_fullsized":"2023-12-19T13:55:24.089800+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:08.944157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696313+0000","last_change":"2023-12-19T13:55:22.613375+0000","last_active":"2023-12-19T13:55:24.696313+0000","last_peered":"2023-12-19T13:55:24.696313+0000","last_clean":"2023-12-19T13:55:24.696313+0000","last_became_active":"2023-12-19T13:55:22.612642+0000","last_became_peered":"2023-12-19T13:55:22.612642+0000","last_unstale":"2023-12-19T13:55:24.696313+0000","last_undegraded":"2023-12-19T13:55:24.696313+0000","last_fullsized":"2023-12-19T13:55:24.696313+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:18.024857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089261+0000","last_change":"2023-12-19T13:55:23.113990+0000","last_active":"2023-12-19T13:55:24.089261+0000","last_peered":"2023-12-19T13:55:24.089261+0000","last_clean":"2023-12-19T13:55:24.089261+0000","last_became_active":"2023-12-19T13:55:23.113391+0000","last_became_peered":"2023-12-19T13:55:23.113391+0000","last_unstale":"2023-12-19T13:55:24.089261+0000","last_undegraded":"2023-12-19T13:55:24.089261+0000","last_fullsized":"2023-12-19T13:55:24.089261+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:27:28.474177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"162'1","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697835+0000","last_change":"2023-12-19T13:55:22.613325+0000","last_active":"2023-12-19T13:55:24.697835+0000","last_peered":"2023-12-19T13:55:24.697835+0000","last_clean":"2023-12-19T13:55:24.697835+0000","last_became_active":"2023-12-19T13:55:22.612724+0000","last_became_peered":"2023-12-19T13:55:22.612724+0000","last_unstale":"2023-12-19T13:55:24.697835+0000","last_undegraded":"2023-12-19T13:55:24.697835+0000","last_fullsized":"2023-12-19T13:55:24.697835+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:42:25.369100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088802+0000","last_change":"2023-12-19T13:55:23.096782+0000","last_active":"2023-12-19T13:55:24.088802+0000","last_peered":"2023-12-19T13:55:24.088802+0000","last_clean":"2023-12-19T13:55:24.088802+0000","last_became_active":"2023-12-19T13:55:23.096422+0000","last_became_peered":"2023-12-19T13:55:23.096422+0000","last_unstale":"2023-12-19T13:55:24.088802+0000","last_undegraded":"2023-12-19T13:55:24.088802+0000","last_fullsized":"2023-12-19T13:55:24.088802+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:42.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090006+0000","last_change":"2023-12-19T13:55:22.617055+0000","last_active":"2023-12-19T13:55:24.090006+0000","last_peered":"2023-12-19T13:55:24.090006+0000","last_clean":"2023-12-19T13:55:24.090006+0000","last_became_active":"2023-12-19T13:55:22.616811+0000","last_became_peered":"2023-12-19T13:55:22.616811+0000","last_unstale":"2023-12-19T13:55:24.090006+0000","last_undegraded":"2023-12-19T13:55:24.090006+0000","last_fullsized":"2023-12-19T13:55:24.090006+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:44.426461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.088354+0000","last_change":"2023-12-19T13:55:23.109867+0000","last_active":"2023-12-19T13:55:24.088354+0000","last_peered":"2023-12-19T13:55:24.088354+0000","last_clean":"2023-12-19T13:55:24.088354+0000","last_became_active":"2023-12-19T13:55:23.109240+0000","last_became_peered":"2023-12-19T13:55:23.109240+0000","last_unstale":"2023-12-19T13:55:24.088354+0000","last_undegraded":"2023-12-19T13:55:24.088354+0000","last_fullsized":"2023-12-19T13:55:24.088354+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:47.069368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698686+0000","last_change":"2023-12-19T13:55:22.619640+0000","last_active":"2023-12-19T13:55:24.698686+0000","last_peered":"2023-12-19T13:55:24.698686+0000","last_clean":"2023-12-19T13:55:24.698686+0000","last_became_active":"2023-12-19T13:55:22.619187+0000","last_became_peered":"2023-12-19T13:55:22.619187+0000","last_unstale":"2023-12-19T13:55:24.698686+0000","last_undegraded":"2023-12-19T13:55:24.698686+0000","last_fullsized":"2023-12-19T13:55:24.698686+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:34:43.532996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696366+0000","last_change":"2023-12-19T13:55:23.090152+0000","last_active":"2023-12-19T13:55:24.696366+0000","last_peered":"2023-12-19T13:55:24.696366+0000","last_clean":"2023-12-19T13:55:24.696366+0000","last_became_active":"2023-12-19T13:55:23.089523+0000","last_became_peered":"2023-12-19T13:55:23.089523+0000","last_unstale":"2023-12-19T13:55:24.696366+0000","last_undegraded":"2023-12-19T13:55:24.696366+0000","last_fullsized":"2023-12-19T13:55:24.696366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:56.814307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090575+0000","last_change":"2023-12-19T13:55:22.618022+0000","last_active":"2023-12-19T13:55:24.090575+0000","last_peered":"2023-12-19T13:55:24.090575+0000","last_clean":"2023-12-19T13:55:24.090575+0000","last_became_active":"2023-12-19T13:55:22.617711+0000","last_became_peered":"2023-12-19T13:55:22.617711+0000","last_unstale":"2023-12-19T13:55:24.090575+0000","last_undegraded":"2023-12-19T13:55:24.090575+0000","last_fullsized":"2023-12-19T13:55:24.090575+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:42.364979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231852+0000","last_change":"2023-12-19T13:55:23.097597+0000","last_active":"2023-12-19T13:55:24.231852+0000","last_peered":"2023-12-19T13:55:24.231852+0000","last_clean":"2023-12-19T13:55:24.231852+0000","last_became_active":"2023-12-19T13:55:23.097261+0000","last_became_peered":"2023-12-19T13:55:23.097261+0000","last_unstale":"2023-12-19T13:55:24.231852+0000","last_undegraded":"2023-12-19T13:55:24.231852+0000","last_fullsized":"2023-12-19T13:55:24.231852+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:44.798151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.232130+0000","last_change":"2023-12-19T13:55:22.617006+0000","last_active":"2023-12-19T13:55:24.232130+0000","last_peered":"2023-12-19T13:55:24.232130+0000","last_clean":"2023-12-19T13:55:24.232130+0000","last_became_active":"2023-12-19T13:55:22.616573+0000","last_became_peered":"2023-12-19T13:55:22.616573+0000","last_unstale":"2023-12-19T13:55:24.232130+0000","last_undegraded":"2023-12-19T13:55:24.232130+0000","last_fullsized":"2023-12-19T13:55:24.232130+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:25.572421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698129+0000","last_change":"2023-12-19T13:55:23.106758+0000","last_active":"2023-12-19T13:55:24.698129+0000","last_peered":"2023-12-19T13:55:24.698129+0000","last_clean":"2023-12-19T13:55:24.698129+0000","last_became_active":"2023-12-19T13:55:23.106353+0000","last_became_peered":"2023-12-19T13:55:23.106353+0000","last_unstale":"2023-12-19T13:55:24.698129+0000","last_undegraded":"2023-12-19T13:55:24.698129+0000","last_fullsized":"2023-12-19T13:55:24.698129+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:53.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696423+0000","last_change":"2023-12-19T13:55:22.609488+0000","last_active":"2023-12-19T13:55:24.696423+0000","last_peered":"2023-12-19T13:55:24.696423+0000","last_clean":"2023-12-19T13:55:24.696423+0000","last_became_active":"2023-12-19T13:55:22.609109+0000","last_became_peered":"2023-12-19T13:55:22.609109+0000","last_unstale":"2023-12-19T13:55:24.696423+0000","last_undegraded":"2023-12-19T13:55:24.696423+0000","last_fullsized":"2023-12-19T13:55:24.696423+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:12.142993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.696644+0000","last_change":"2023-12-19T13:55:23.107143+0000","last_active":"2023-12-19T13:55:24.696644+0000","last_peered":"2023-12-19T13:55:24.696644+0000","last_clean":"2023-12-19T13:55:24.696644+0000","last_became_active":"2023-12-19T13:55:23.106807+0000","last_became_peered":"2023-12-19T13:55:23.106807+0000","last_unstale":"2023-12-19T13:55:24.696644+0000","last_undegraded":"2023-12-19T13:55:24.696644+0000","last_fullsized":"2023-12-19T13:55:24.696644+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:35.596539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090743+0000","last_change":"2023-12-19T13:55:22.610140+0000","last_active":"2023-12-19T13:55:24.090743+0000","last_peered":"2023-12-19T13:55:24.090743+0000","last_clean":"2023-12-19T13:55:24.090743+0000","last_became_active":"2023-12-19T13:55:22.607768+0000","last_became_peered":"2023-12-19T13:55:22.607768+0000","last_unstale":"2023-12-19T13:55:24.090743+0000","last_undegraded":"2023-12-19T13:55:24.090743+0000","last_fullsized":"2023-12-19T13:55:24.090743+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:33:22.787365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089515+0000","last_change":"2023-12-19T13:55:23.113830+0000","last_active":"2023-12-19T13:55:24.089515+0000","last_peered":"2023-12-19T13:55:24.089515+0000","last_clean":"2023-12-19T13:55:24.089515+0000","last_became_active":"2023-12-19T13:55:23.113190+0000","last_became_peered":"2023-12-19T13:55:23.113190+0000","last_unstale":"2023-12-19T13:55:24.089515+0000","last_undegraded":"2023-12-19T13:55:24.089515+0000","last_fullsized":"2023-12-19T13:55:24.089515+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:02.781993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089905+0000","last_change":"2023-12-19T13:55:22.614560+0000","last_active":"2023-12-19T13:55:24.089905+0000","last_peered":"2023-12-19T13:55:24.089905+0000","last_clean":"2023-12-19T13:55:24.089905+0000","last_became_active":"2023-12-19T13:55:22.614336+0000","last_became_peered":"2023-12-19T13:55:22.614336+0000","last_unstale":"2023-12-19T13:55:24.089905+0000","last_undegraded":"2023-12-19T13:55:24.089905+0000","last_fullsized":"2023-12-19T13:55:24.089905+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:33:22.787365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231866+0000","last_change":"2023-12-19T13:55:23.101229+0000","last_active":"2023-12-19T13:55:24.231866+0000","last_peered":"2023-12-19T13:55:24.231866+0000","last_clean":"2023-12-19T13:55:24.231866+0000","last_became_active":"2023-12-19T13:55:23.101010+0000","last_became_peered":"2023-12-19T13:55:23.101010+0000","last_unstale":"2023-12-19T13:55:24.231866+0000","last_undegraded":"2023-12-19T13:55:24.231866+0000","last_fullsized":"2023-12-19T13:55:24.231866+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:20.175899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090935+0000","last_change":"2023-12-19T13:55:22.615804+0000","last_active":"2023-12-19T13:55:24.090935+0000","last_peered":"2023-12-19T13:55:24.090935+0000","last_clean":"2023-12-19T13:55:24.090935+0000","last_became_active":"2023-12-19T13:55:22.615166+0000","last_became_peered":"2023-12-19T13:55:22.615166+0000","last_unstale":"2023-12-19T13:55:24.090935+0000","last_undegraded":"2023-12-19T13:55:24.090935+0000","last_fullsized":"2023-12-19T13:55:24.090935+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:45.489463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695729+0000","last_change":"2023-12-19T13:55:23.097956+0000","last_active":"2023-12-19T13:55:24.695729+0000","last_peered":"2023-12-19T13:55:24.695729+0000","last_clean":"2023-12-19T13:55:24.695729+0000","last_became_active":"2023-12-19T13:55:23.097111+0000","last_became_peered":"2023-12-19T13:55:23.097111+0000","last_unstale":"2023-12-19T13:55:24.695729+0000","last_undegraded":"2023-12-19T13:55:24.695729+0000","last_fullsized":"2023-12-19T13:55:24.695729+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:14:46.996742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.232233+0000","last_change":"2023-12-19T13:55:22.616800+0000","last_active":"2023-12-19T13:55:24.232233+0000","last_peered":"2023-12-19T13:55:24.232233+0000","last_clean":"2023-12-19T13:55:24.232233+0000","last_became_active":"2023-12-19T13:55:22.615859+0000","last_became_peered":"2023-12-19T13:55:22.615859+0000","last_unstale":"2023-12-19T13:55:24.232233+0000","last_undegraded":"2023-12-19T13:55:24.232233+0000","last_fullsized":"2023-12-19T13:55:24.232233+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:22.492323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697512+0000","last_change":"2023-12-19T13:55:23.113594+0000","last_active":"2023-12-19T13:55:24.697512+0000","last_peered":"2023-12-19T13:55:24.697512+0000","last_clean":"2023-12-19T13:55:24.697512+0000","last_became_active":"2023-12-19T13:55:23.113336+0000","last_became_peered":"2023-12-19T13:55:23.113336+0000","last_unstale":"2023-12-19T13:55:24.697512+0000","last_undegraded":"2023-12-19T13:55:24.697512+0000","last_fullsized":"2023-12-19T13:55:24.697512+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:44.798151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.089014+0000","last_change":"2023-12-19T13:55:22.618146+0000","last_active":"2023-12-19T13:55:24.089014+0000","last_peered":"2023-12-19T13:55:24.089014+0000","last_clean":"2023-12-19T13:55:24.089014+0000","last_became_active":"2023-12-19T13:55:22.617685+0000","last_became_peered":"2023-12-19T13:55:22.617685+0000","last_unstale":"2023-12-19T13:55:24.089014+0000","last_undegraded":"2023-12-19T13:55:24.089014+0000","last_fullsized":"2023-12-19T13:55:24.089014+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:07.929755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697118+0000","last_change":"2023-12-19T13:55:23.110536+0000","last_active":"2023-12-19T13:55:24.697118+0000","last_peered":"2023-12-19T13:55:24.697118+0000","last_clean":"2023-12-19T13:55:24.697118+0000","last_became_active":"2023-12-19T13:55:23.108276+0000","last_became_peered":"2023-12-19T13:55:23.108276+0000","last_unstale":"2023-12-19T13:55:24.697118+0000","last_undegraded":"2023-12-19T13:55:24.697118+0000","last_fullsized":"2023-12-19T13:55:24.697118+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:20.175899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697804+0000","last_change":"2023-12-19T13:55:22.614284+0000","last_active":"2023-12-19T13:55:24.697804+0000","last_peered":"2023-12-19T13:55:24.697804+0000","last_clean":"2023-12-19T13:55:24.697804+0000","last_became_active":"2023-12-19T13:55:22.613962+0000","last_became_peered":"2023-12-19T13:55:22.613962+0000","last_unstale":"2023-12-19T13:55:24.697804+0000","last_undegraded":"2023-12-19T13:55:24.697804+0000","last_fullsized":"2023-12-19T13:55:24.697804+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:42.364979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.090322+0000","last_change":"2023-12-19T13:55:23.102563+0000","last_active":"2023-12-19T13:55:24.090322+0000","last_peered":"2023-12-19T13:55:24.090322+0000","last_clean":"2023-12-19T13:55:24.090322+0000","last_became_active":"2023-12-19T13:55:23.101833+0000","last_became_peered":"2023-12-19T13:55:23.101833+0000","last_unstale":"2023-12-19T13:55:24.090322+0000","last_undegraded":"2023-12-19T13:55:24.090322+0000","last_fullsized":"2023-12-19T13:55:24.090322+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:48.615204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.695967+0000","last_change":"2023-12-19T13:55:22.618429+0000","last_active":"2023-12-19T13:55:24.695967+0000","last_peered":"2023-12-19T13:55:24.695967+0000","last_clean":"2023-12-19T13:55:24.695967+0000","last_became_active":"2023-12-19T13:55:22.618127+0000","last_became_peered":"2023-12-19T13:55:22.618127+0000","last_unstale":"2023-12-19T13:55:24.695967+0000","last_undegraded":"2023-12-19T13:55:24.695967+0000","last_fullsized":"2023-12-19T13:55:24.695967+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:52.238215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231595+0000","last_change":"2023-12-19T13:55:23.105648+0000","last_active":"2023-12-19T13:55:24.231595+0000","last_peered":"2023-12-19T13:55:24.231595+0000","last_clean":"2023-12-19T13:55:24.231595+0000","last_became_active":"2023-12-19T13:55:23.105413+0000","last_became_peered":"2023-12-19T13:55:23.105413+0000","last_unstale":"2023-12-19T13:55:24.231595+0000","last_undegraded":"2023-12-19T13:55:24.231595+0000","last_fullsized":"2023-12-19T13:55:24.231595+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:25.735136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.231898+0000","last_change":"2023-12-19T13:55:22.611237+0000","last_active":"2023-12-19T13:55:24.231898+0000","last_peered":"2023-12-19T13:55:24.231898+0000","last_clean":"2023-12-19T13:55:24.231898+0000","last_became_active":"2023-12-19T13:55:22.610962+0000","last_became_peered":"2023-12-19T13:55:22.610962+0000","last_unstale":"2023-12-19T13:55:24.231898+0000","last_undegraded":"2023-12-19T13:55:24.231898+0000","last_fullsized":"2023-12-19T13:55:24.231898+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:32.812990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.697437+0000","last_change":"2023-12-19T13:55:23.092935+0000","last_active":"2023-12-19T13:55:24.697437+0000","last_peered":"2023-12-19T13:55:24.697437+0000","last_clean":"2023-12-19T13:55:24.697437+0000","last_became_active":"2023-12-19T13:55:23.091831+0000","last_became_peered":"2023-12-19T13:55:23.091831+0000","last_unstale":"2023-12-19T13:55:24.697437+0000","last_undegraded":"2023-12-19T13:55:24.697437+0000","last_fullsized":"2023-12-19T13:55:24.697437+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:22.573219+0000","last_clean_scrub_stamp":"2023-12-19T13:55:22.573219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:30:15.391207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"162'2","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-12-19T13:55:24.698518+0000","last_change":"2023-12-19T13:55:22.614798+0000","last_active":"2023-12-19T13:55:24.698518+0000","last_peered":"2023-12-19T13:55:24.698518+0000","last_clean":"2023-12-19T13:55:24.698518+0000","last_became_active":"2023-12-19T13:55:22.614438+0000","last_became_peered":"2023-12-19T13:55:22.614438+0000","last_unstale":"2023-12-19T13:55:24.698518+0000","last_undegraded":"2023-12-19T13:55:24.698518+0000","last_fullsized":"2023-12-19T13:55:24.698518+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:55:21.558817+0000","last_clean_scrub_stamp":"2023-12-19T13:55:21.558817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:03:42.714548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":300,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-12-19T13:55:23.082746+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:55:23.082746+0000","last_peered":"2023-12-19T13:55:23.082746+0000","last_clean":"2023-12-19T13:55:23.082746+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:55:23.082746+0000","last_undegraded":"2023-12-19T13:55:23.082746+0000","last_fullsized":"2023-12-19T13:55:23.082746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085777,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1000000000000001,"15min":1.036},"min":{"1min":0.67100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5900000000000001,"5min":1.6950000000000001,"15min":1.9059999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.121,"15min":1.032},"min":{"1min":0.70799999999999996,"5min":0.64400000000000002,"15min":0.54400000000000004},"max":{"1min":1.516,"5min":1.7190000000000001,"15min":2.008},"last":1.319}]},{"osd":1,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1759999999999999,"15min":1.1060000000000001},"min":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6439999999999999,"5min":1.6479999999999999,"15min":1.6890000000000001},"last":1.407},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1970000000000001,"15min":1.085},"min":{"1min":0.80100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.5680000000000001,"5min":1.9870000000000001,"15min":2.1499999999999999},"last":1.2090000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1359999999999999},"min":{"1min":0.76300000000000001,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":1.5109999999999999,"5min":2.008,"15min":2.008},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2130000000000001,"15min":1.173},"min":{"1min":0.95899999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7390000000000001,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":1.288}]},{"osd":3,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.2609999999999999,"15min":1.1899999999999999},"min":{"1min":0.874,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9359999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.548},{"interface":"front","average":{"1min":1.319,"5min":1.333,"15min":1.268},"min":{"1min":1.0960000000000001,"5min":0.70599999999999996,"15min":0.65200000000000002},"max":{"1min":1.9810000000000001,"5min":3.6150000000000002,"15min":3.6150000000000002},"last":1.347}]},{"osd":4,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.2929999999999999,"15min":1.288},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.60299999999999998},"max":{"1min":2.0179999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.48},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3540000000000001,"15min":1.381},"min":{"1min":0.97799999999999998,"5min":0.83099999999999996,"15min":0.58499999999999996},"max":{"1min":1.7190000000000001,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.159}]},{"osd":5,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.288,"15min":1.2470000000000001},"min":{"1min":0.73399999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.819,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.4259999999999999,"15min":1.429},"min":{"1min":1.113,"5min":0.81999999999999995,"15min":0.76500000000000001},"max":{"1min":2.097,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.252}]},{"osd":6,"last update":"Tue Dec 19 13:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.429,"15min":1.3220000000000001},"min":{"1min":1.115,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.853,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.573,"5min":1.522,"15min":1.502},"min":{"1min":1.208,"5min":0.95499999999999996,"15min":0.64800000000000002},"max":{"1min":2.202,"5min":2.673,"15min":2.673},"last":1.6020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085811,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.05,"15min":1.0389999999999999},"min":{"1min":0.66200000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6160000000000001,"5min":1.6220000000000001,"15min":2.0640000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.097,"15min":1.1080000000000001},"min":{"1min":0.70199999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.605,"5min":1.631,"15min":3.2069999999999999},"last":0.90100000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0509999999999999,"15min":1.04},"min":{"1min":0.64900000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.181,"5min":1.5580000000000001,"15min":1.962},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.198,"5min":1.1579999999999999,"15min":1.079},"min":{"1min":0.74099999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5640000000000001,"5min":1.619,"15min":1.6279999999999999},"last":1.321}]},{"osd":2,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.268,"15min":1.24},"min":{"1min":0.94999999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.629,"5min":1.806,"15min":1.8180000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.264,"15min":1.1930000000000001},"min":{"1min":0.70999999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.573,"5min":1.802,"15min":1.802},"last":1.26}]},{"osd":3,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.232,"15min":1.306},"min":{"1min":0.81499999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.665,"5min":1.8009999999999999,"15min":4.2690000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.2110000000000001,"15min":1.25},"min":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.67900000000000005},"max":{"1min":1.474,"5min":1.819,"15min":4.3899999999999997},"last":1.7}]},{"osd":4,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.321,"15min":1.246},"min":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.47899999999999998},"max":{"1min":1.7430000000000001,"5min":1.905,"15min":1.905},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3660000000000001,"15min":1.3200000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.70699999999999996},"max":{"1min":1.849,"5min":1.895,"15min":1.895},"last":1.6539999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3200000000000001,"15min":1.274},"min":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.53700000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.4339999999999999,"15min":1.397},"min":{"1min":0.85299999999999998,"5min":0.80200000000000005,"15min":0.48799999999999999},"max":{"1min":1.978,"5min":2.169,"15min":2.169},"last":1.5}]},{"osd":7,"last update":"Tue Dec 19 13:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.4850000000000001,"15min":1.4390000000000001},"min":{"1min":0.83299999999999996,"5min":0.82499999999999996,"15min":0.59599999999999997},"max":{"1min":1.9570000000000001,"5min":1.9870000000000001,"15min":2.5419999999999998},"last":1.474},{"interface":"front","average":{"1min":1.494,"5min":1.45,"15min":1.3899999999999999},"min":{"1min":0.747,"5min":0.72799999999999998,"15min":0.57999999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.6279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193842,"statfs":{"total":200000000,"available":198494701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0680000000000001,"15min":1.006},"min":{"1min":0.628,"5min":0.433,"15min":0.433},"max":{"1min":1.4710000000000001,"5min":1.835,"15min":1.835},"last":1.298},{"interface":"front","average":{"1min":1.157,"5min":1.226,"15min":1.1140000000000001},"min":{"1min":0.71299999999999997,"5min":0.67500000000000004,"15min":0.53900000000000003},"max":{"1min":1.8700000000000001,"5min":5.4219999999999997,"15min":5.4219999999999997},"last":1.1539999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.169,"15min":1.1220000000000001},"min":{"1min":0.68500000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6839999999999999,"5min":6.101,"15min":6.101},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1879999999999999,"15min":1.0680000000000001},"min":{"1min":0.66500000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.625,"5min":2.077,"15min":2.077},"last":1.415}]},{"osd":2,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.264,"15min":1.2450000000000001},"min":{"1min":0.82899999999999996,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.8919999999999999,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.2230000000000001,"15min":1.25},"min":{"1min":0.76900000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.393,"5min":2.2730000000000001,"15min":2.863},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3480000000000001,"15min":1.2529999999999999},"min":{"1min":0.95699999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1880000000000002,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.3009999999999999,"15min":1.262},"min":{"1min":0.78300000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.587,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.202}]},{"osd":4,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.226,"15min":1.1699999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6759999999999999,"5min":1.8919999999999999,"15min":1.982},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4330000000000001,"15min":1.329},"min":{"1min":0.93700000000000006,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":2.0800000000000001,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":1.3420000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.373,"15min":1.3400000000000001},"min":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.784,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.367},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.387,"15min":1.373},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.5740000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.55,"15min":1.45},"min":{"1min":0.86799999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.278,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":1.25},{"interface":"front","average":{"1min":1.494,"5min":1.524,"15min":1.448},"min":{"1min":0.80200000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.974,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.4359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085811,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.077,"15min":1.016},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.87},{"interface":"front","average":{"1min":1.113,"5min":1.0960000000000001,"15min":1.1140000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.016},"last":1.3200000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6379999999999999,"5min":1.661,"15min":1.661},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.113,"15min":1.111},"min":{"1min":0.75,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5780000000000001,"5min":1.887,"15min":1.887},"last":1.232}]},{"osd":2,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1339999999999999,"15min":1.0629999999999999},"min":{"1min":0.77800000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.1850000000000001,"15min":1.133},"min":{"1min":0.88800000000000001,"5min":0.75,"15min":0.68000000000000005},"max":{"1min":1.5109999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.4610000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2310000000000001,"15min":1.216},"min":{"1min":0.72999999999999998,"5min":0.63500000000000001,"15min":0.57599999999999996},"max":{"1min":1.778,"5min":1.8360000000000001,"15min":1.952},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.298,"15min":1.2789999999999999},"min":{"1min":0.82799999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6870000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.6719999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.22,"15min":1.234},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.51700000000000002},"max":{"1min":1.825,"5min":1.9730000000000001,"15min":2.165},"last":1.389},{"interface":"front","average":{"1min":1.218,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.58399999999999996},"max":{"1min":1.631,"5min":2.306,"15min":2.3570000000000002},"last":2.0379999999999998}]},{"osd":6,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.337,"15min":1.377},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.55900000000000005},"max":{"1min":1.782,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.395,"15min":1.4359999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8540000000000001,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.7110000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4850000000000001,"15min":1.4670000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.65500000000000003},"max":{"1min":2.1930000000000001,"5min":2.948,"15min":2.948},"last":2.0830000000000002},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.542,"15min":1.5249999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.59999999999999998},"max":{"1min":2.0270000000000001,"5min":3.137,"15min":3.137},"last":1.8620000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.77200000000000002,"15min":0.88400000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.032,"5min":1.5069999999999999,"15min":3.4119999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.86199999999999999,"15min":0.93400000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":1.175,"5min":1.502,"15min":3.0670000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.94399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.155,"5min":1.508,"15min":5.3769999999999998},"last":1.091},{"interface":"front","average":{"1min":0.746,"5min":0.89600000000000002,"15min":0.95599999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.3200000000000001,"5min":1.5780000000000001,"15min":2.387},"last":0.55500000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.95099999999999996,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.2869999999999999,"5min":1.5600000000000001,"15min":2.9399999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.97799999999999998,"15min":1.0800000000000001},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.39200000000000002},"max":{"1min":1.3180000000000001,"5min":1.722,"15min":2.657},"last":0.97399999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1910000000000001,"15min":1.2390000000000001},"min":{"1min":0.76200000000000001,"5min":0.64000000000000001,"15min":0.48299999999999998},"max":{"1min":1.627,"5min":1.718,"15min":3.0070000000000001},"last":1.044},{"interface":"front","average":{"1min":1.097,"5min":1.21,"15min":1.22},"min":{"1min":0.626,"5min":0.60199999999999998,"15min":0.54600000000000004},"max":{"1min":1.611,"5min":1.835,"15min":2.7690000000000001},"last":1.24}]},{"osd":5,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2789999999999999},"min":{"1min":0.75700000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.589,"5min":1.72,"15min":2.7309999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1819999999999999,"15min":1.2410000000000001},"min":{"1min":0.72599999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.577,"5min":1.7729999999999999,"15min":3.5249999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2310000000000001,"15min":1.2809999999999999},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.53300000000000003},"max":{"1min":1.6990000000000001,"5min":1.7090000000000001,"15min":2.9769999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2909999999999999,"15min":1.325},"min":{"1min":0.746,"5min":0.746,"15min":0.52600000000000002},"max":{"1min":1.48,"5min":1.8120000000000001,"15min":2.698},"last":1.498}]},{"osd":7,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.272,"15min":1.335},"min":{"1min":0.81699999999999995,"5min":0.624,"15min":0.51500000000000001},"max":{"1min":1.6459999999999999,"5min":2.0939999999999999,"15min":3.609},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3420000000000001,"15min":1.379},"min":{"1min":0.82099999999999995,"5min":0.69299999999999995,"15min":0.58699999999999997},"max":{"1min":1.7629999999999999,"5min":1.8999999999999999,"15min":3.0379999999999998},"last":1.079}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085139,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.196,"5min":1.544,"15min":2.258},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.85099999999999998,"15min":0.84499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":1.6539999999999999,"15min":11.85},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.88500000000000001,"15min":0.84399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.376},"max":{"1min":1.248,"5min":1.5920000000000001,"15min":2.4420000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.97499999999999998,"15min":0.95699999999999996},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4199999999999999,"5min":1.5349999999999999,"15min":11.788},"last":0.51400000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.97899999999999998,"15min":0.94699999999999995},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":2.3109999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.044,"15min":1.038},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":1.5609999999999999,"5min":1.5800000000000001,"15min":4.8079999999999998},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.204,"15min":1.1870000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6100000000000001,"5min":1.6839999999999999,"15min":11.930999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.1919999999999999,"15min":1.212},"min":{"1min":0.81000000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4590000000000001,"5min":1.786,"15min":2.2189999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.298,"15min":1.2629999999999999},"min":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4870000000000001,"5min":1.748,"15min":11.888},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.302,"15min":1.304},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.68899999999999995},"max":{"1min":1.655,"5min":1.843,"15min":2.8769999999999998},"last":0.92500000000000004}]},{"osd":6,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2809999999999999,"15min":1.3049999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.833,"5min":1.994,"15min":2.964},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.2969999999999999,"15min":1.2669999999999999},"min":{"1min":0.84699999999999998,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":1.5529999999999999,"5min":1.929,"15min":2.286},"last":0.71899999999999997}]},{"osd":7,"last update":"Tue Dec 19 13:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.341,"15min":1.3180000000000001},"min":{"1min":0.80700000000000005,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":1.772,"5min":2.0569999999999999,"15min":2.351},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.738,"5min":1.8200000000000001,"15min":11.962999999999999},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193841,"statfs":{"total":200000000,"available":198493857,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.80100000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.30599999999999999},"max":{"1min":1.3280000000000001,"5min":1.4139999999999999,"15min":3.4700000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":3.3500000000000001},"last":0.70299999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.91500000000000004,"15min":1.0289999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2050000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.083,"15min":1.1519999999999999},"min":{"1min":0.54100000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.619,"5min":1.764,"15min":5.2009999999999996},"last":1.5189999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.044,"15min":1.0589999999999999},"min":{"1min":0.55500000000000005,"5min":0.501,"15min":0.5},"max":{"1min":1.7,"5min":1.7,"15min":3.4300000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0289999999999999,"15min":1.131},"min":{"1min":0.54700000000000004,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.488,"5min":1.706,"15min":7.157},"last":1.1919999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1499999999999999,"15min":1.202},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.61699999999999999},"max":{"1min":1.446,"5min":1.7030000000000001,"15min":4.0179999999999998},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.248,"15min":1.282},"min":{"1min":0.751,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7490000000000001,"5min":2.0979999999999999,"15min":3.7080000000000002},"last":1.411}]},{"osd":5,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2430000000000001,"15min":1.2989999999999999},"min":{"1min":0.80200000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6679999999999999,"5min":2.1850000000000001,"15min":3.8849999999999998},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2270000000000001,"15min":1.353},"min":{"1min":0.81799999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6040000000000001,"5min":1.9870000000000001,"15min":15.576000000000001},"last":1.4990000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.323,"15min":1.339},"min":{"1min":0.83899999999999997,"5min":0.74199999999999999,"15min":0.67800000000000005},"max":{"1min":1.7929999999999999,"5min":1.9950000000000001,"15min":4.0919999999999996},"last":1.611},{"interface":"front","average":{"1min":1.337,"5min":1.3380000000000001,"15min":1.393},"min":{"1min":0.93000000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8149999999999999,"5min":2.3159999999999998,"15min":3.786},"last":1.6459999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.391,"15min":1.4279999999999999},"min":{"1min":0.84399999999999997,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.7609999999999999,"5min":2.3929999999999998,"15min":3.8159999999999998},"last":1.722},{"interface":"front","average":{"1min":1.258,"5min":1.3140000000000001,"15min":1.413},"min":{"1min":0.86899999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6930000000000001,"5min":2.1659999999999999,"15min":4.0519999999999996},"last":1.452}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194424,"statfs":{"total":200000000,"available":199090491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80500000000000005,"15min":0.76600000000000001},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.28299999999999997},"max":{"1min":1.2370000000000001,"5min":1.639,"15min":1.6399999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.90300000000000002,"15min":0.95099999999999996},"min":{"1min":0.53300000000000003,"5min":0.371,"15min":0.371},"max":{"1min":1.361,"5min":1.766,"15min":14.010999999999999},"last":0.73299999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92700000000000005,"15min":1.0109999999999999},"min":{"1min":0.41799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7050000000000001,"5min":1.845,"15min":33.799999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.0389999999999999,"15min":1.1080000000000001},"min":{"1min":0.623,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.708,"5min":2.056,"15min":41.758000000000003},"last":0.628}]},{"osd":3,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.97499999999999998},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.35099999999999998},"max":{"1min":1.5049999999999999,"5min":1.619,"15min":4.4530000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1020000000000001,"15min":1.0900000000000001},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.36499999999999999},"max":{"1min":1.7210000000000001,"5min":2.02,"15min":2.02},"last":1.1910000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.175,"15min":1.1970000000000001},"min":{"1min":0.873,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.679,"5min":1.917,"15min":4.4269999999999996},"last":1.327},{"interface":"front","average":{"1min":1.258,"5min":1.26,"15min":1.242},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.68999999999999995},"max":{"1min":1.79,"5min":2.1099999999999999,"15min":15.766},"last":1.3400000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2490000000000001,"15min":1.242},"min":{"1min":0.90800000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.77,"5min":2.4569999999999999,"15min":14.337999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.2470000000000001,"15min":1.2709999999999999},"min":{"1min":0.755,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5660000000000001,"5min":2.3119999999999998,"15min":4.3970000000000002},"last":1.0920000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3759999999999999,"15min":1.296},"min":{"1min":0.876,"5min":0.753,"15min":0.67800000000000005},"max":{"1min":1.9470000000000001,"5min":2.242,"15min":5.4669999999999996},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.359,"15min":1.349},"min":{"1min":0.81499999999999995,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.823,"5min":2.5489999999999999,"15min":17.161000000000001},"last":1.119}]},{"osd":7,"last update":"Tue Dec 19 13:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.363,"15min":1.3540000000000001},"min":{"1min":0.746,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8169999999999999,"5min":2.653,"15min":14.381},"last":1.214},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3200000000000001,"15min":1.383},"min":{"1min":0.91900000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1230000000000002,"5min":2.3879999999999999,"15min":9.7080000000000002},"last":1.1659999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:55:28.070 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:55:28.070 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:55:28.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.334+0000 7fddd8c70640 1 Processor -- start 2023-12-19T13:55:28.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.334+0000 7fddd8c70640 1 -- start start 2023-12-19T13:55:28.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd8c70640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fddd415a1c0 0x7fddd415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd8c70640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 0x7fddd40c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd8c70640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd415a5a0 con 0x7fddd4143350 2023-12-19T13:55:28.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd8c70640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40c3db0 con 0x7fddd415a1c0 2023-12-19T13:55:28.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd8c70640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd413dfb0 con 0x7fddd40c2b90 2023-12-19T13:55:28.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd1d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fddd4143350 0x7fddd413d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54902/0 (socket says 172.21.15.113:54902) 2023-12-19T13:55:28.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd1d9b640 1 -- 172.21.15.113:0/3118951282 learned_addr learned my addr 172.21.15.113:0/3118951282 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:28.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.336+0000 7fddd259c640 1 --2- 172.21.15.113:0/3118951282 >> v2:172.21.15.151:3300/0 conn(0x7fddd415a1c0 0x7fddd415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd2d9d640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 0x7fddd40c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190000072 0 0) 0x7fddbc001110 con 0x7fddd4143350 2023-12-19T13:55:28.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc0003520 con 0x7fddd4143350 2023-12-19T13:55:28.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 945973234 0 0) 0x7fddc0003520 con 0x7fddd4143350 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 msgr2=0x7fddd40c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 0x7fddd40c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 >> v2:172.21.15.151:3300/0 conn(0x7fddd415a1c0 msgr2=0x7fddd415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 --2- 172.21.15.113:0/3118951282 >> v2:172.21.15.151:3300/0 conn(0x7fddd415a1c0 0x7fddd415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40c4050 con 0x7fddd4143350 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fddbc001800 con 0x7fddd4143350 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 >> v1:172.21.15.113:6789/0 conn(0x7fddd4143350 legacy=0x7fddd413d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc00039e0 0x7fddc0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddc00047c0 0x7fddc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 0x7fddc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40c3db0 con 0x7fddc00039e0 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd413dfb0 con 0x7fddc00047c0 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.337+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc000dbc0 con 0x7fddd40c2b90 2023-12-19T13:55:28.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd259c640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc00039e0 0x7fddc0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd259c640 1 -- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 msgr2=0x7fddc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd1d9b640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddc00047c0 0x7fddc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd2d9d640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 0x7fddc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd259c640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddd40c2b90 0x7fddc0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd259c640 1 -- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddc00047c0 msgr2=0x7fddc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd259c640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddc00047c0 0x7fddc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd259c640 1 -- 172.21.15.113:0/3118951282 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc0003520 con 0x7fddc00039e0 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.338+0000 7fddd1d9b640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddc00047c0 0x7fddc0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:28.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.339+0000 7fddd259c640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc00039e0 0x7fddc0003e00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009ac0 tx=0x7fddc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f3c16b3e70f94e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:28.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.339+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc402c710 con 0x7fddc00039e0 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.339+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc402c870 con 0x7fddc00039e0 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.339+0000 7fddd159a640 1 -- 172.21.15.113:0/3118951282 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc402cc00 con 0x7fddc00039e0 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.340+0000 7fddd8c70640 1 -- 172.21.15.113:0/3118951282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc00039e0 msgr2=0x7fddc0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.340+0000 7fddd8c70640 1 --2- 172.21.15.113:0/3118951282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc00039e0 0x7fddc0003e00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009ac0 tx=0x7fddc00057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.340+0000 7fddd2d9d640 1 -- 172.21.15.113:0/3118951282 reap_dead start 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.340+0000 7fddd8c70640 1 -- 172.21.15.113:0/3118951282 shutdown_connections 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.340+0000 7fddd8c70640 1 -- 172.21.15.113:0/3118951282 >> 172.21.15.113:0/3118951282 conn(0x7fddd406f160 msgr2=0x7fddd406f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.340+0000 7fddd8c70640 1 -- 172.21.15.113:0/3118951282 shutdown_connections 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.340+0000 7fddd8c70640 1 -- 172.21.15.113:0/3118951282 wait complete. 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.342+0000 7fddd8c70640 1 Processor -- start 2023-12-19T13:55:28.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.342+0000 7fddd8c70640 1 -- start start 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.343+0000 7fddd8c70640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddc00039e0 0x7fddd4157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.343+0000 7fddd8c70640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd4140bb0 0x7fddd4141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.343+0000 7fddd8c70640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddd40659a0 0x7fddd4065e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.343+0000 7fddd8c70640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4066360 con 0x7fddd4140bb0 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.343+0000 7fddd8c70640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4141670 con 0x7fddd40659a0 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.343+0000 7fddd8c70640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4141950 con 0x7fddc00039e0 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd4140bb0 0x7fddd4141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd4140bb0 0x7fddd4141010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49154/0 (socket says 172.21.15.113:49154) 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 -- 172.21.15.113:0/170523032 learned_addr learned my addr 172.21.15.113:0/170523032 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd259c640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddc00039e0 0x7fddd4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd2d9d640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddd40659a0 0x7fddd4065e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 -- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddc00039e0 msgr2=0x7fddd4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddc00039e0 0x7fddd4157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 -- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddd40659a0 msgr2=0x7fddd4065e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddd40659a0 0x7fddd4065e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 -- 172.21.15.113:0/170523032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4141c30 con 0x7fddd4140bb0 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd2d9d640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddd40659a0 0x7fddd4065e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.344+0000 7fddd1d9b640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd4140bb0 0x7fddd4141010 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00d7a0 tx=0x7fddbc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.345+0000 7fddcaffd640 1 -- 172.21.15.113:0/170523032 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0072d0 con 0x7fddd4140bb0 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.345+0000 7fddcaffd640 1 -- 172.21.15.113:0/170523032 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc007430 con 0x7fddd4140bb0 2023-12-19T13:55:28.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.345+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd4141f10 con 0x7fddd4140bb0 2023-12-19T13:55:28.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.345+0000 7fddcaffd640 1 -- 172.21.15.113:0/170523032 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0047e0 con 0x7fddd4140bb0 2023-12-19T13:55:28.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.345+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4157e60 con 0x7fddd4140bb0 2023-12-19T13:55:28.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.346+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4141a90 con 0x7fddd4140bb0 2023-12-19T13:55:28.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.347+0000 7fddcaffd640 1 -- 172.21.15.113:0/170523032 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fddbc004940 con 0x7fddd4140bb0 2023-12-19T13:55:28.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.348+0000 7fddcaffd640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fddb406a430 0x7fddb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.348+0000 7fddcaffd640 1 -- 172.21.15.113:0/170523032 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddbc088470 con 0x7fddd4140bb0 2023-12-19T13:55:28.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.348+0000 7fddd259c640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fddb406a430 0x7fddb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.349+0000 7fddd259c640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fddb406a430 0x7fddb406c8f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fddc4036000 tx=0x7fddc4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:28.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.353+0000 7fddcaffd640 1 -- 172.21.15.113:0/170523032 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fddd4141a90 con 0x7fddd4140bb0 2023-12-19T13:55:28.560 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-12-19T13:55:28.561+0000 7f4a12f07640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:55:28.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.611+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fddd415a5a0 con 0x7fddd4140bb0 2023-12-19T13:55:28.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.622+0000 7fddcaffd640 1 -- 172.21.15.113:0/170523032 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7fddd415a5a0 con 0x7fddd4140bb0 2023-12-19T13:55:28.622 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fddb406a430 msgr2=0x7fddb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fddb406a430 0x7fddb406c8f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fddc4036000 tx=0x7fddc4030000 comp rx=0 tx=0).stop 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd4140bb0 msgr2=0x7fddd4141010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd4140bb0 0x7fddd4141010 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00d7a0 tx=0x7fddbc00dc60 comp rx=0 tx=0).stop 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 shutdown_connections 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fddb406a430 0x7fddb406c8f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddd40659a0 0x7fddd4065e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd4140bb0 0x7fddd4141010 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 --2- 172.21.15.113:0/170523032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddc00039e0 0x7fddd4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.624+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 >> 172.21.15.113:0/170523032 conn(0x7fddd406f160 msgr2=0x7fddd406f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.625+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 shutdown_connections 2023-12-19T13:55:28.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.625+0000 7fddd8c70640 1 -- 172.21.15.113:0/170523032 wait complete. 2023-12-19T13:55:28.644 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:28.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.856+0000 7fcfd5f30640 1 Processor -- start 2023-12-19T13:55:28.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.856+0000 7fcfd5f30640 1 -- start start 2023-12-19T13:55:28.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.857+0000 7fcfd5f30640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcfd00ac8b0 0x7fcfd00acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.857+0000 7fcfd5f30640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcfd006fa90 0x7fcfd006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.857+0000 7fcfd5f30640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00b2fa0 con 0x7fcfd015e3f0 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.857+0000 7fcfd5f30640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00ad280 con 0x7fcfd006fa90 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.857+0000 7fcfd5f30640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd006f600 con 0x7fcfd00ac8b0 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfd572f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcfd006fa90 0x7fcfd006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfd572f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcfd006fa90 0x7fcfd006fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49156/0 (socket says 172.21.15.113:49156) 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfd572f640 1 -- 172.21.15.113:0/2367295396 learned_addr learned my addr 172.21.15.113:0/2367295396 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfcffff640 1 --2- 172.21.15.113:0/2367295396 >> v2:172.21.15.151:3300/0 conn(0x7fcfd00ac8b0 0x7fcfd00acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfd572f640 1 -- 172.21.15.113:0/2367295396 >> v2:172.21.15.151:3300/0 conn(0x7fcfd00ac8b0 msgr2=0x7fcfd00acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfd572f640 1 --2- 172.21.15.113:0/2367295396 >> v2:172.21.15.151:3300/0 conn(0x7fcfd00ac8b0 0x7fcfd00acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfd572f640 1 -- 172.21.15.113:0/2367295396 >> v1:172.21.15.151:6789/0 conn(0x7fcfd015e3f0 legacy=0x7fcfd00b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:28.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.858+0000 7fcfd572f640 1 -- 172.21.15.113:0/2367295396 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd015e7d0 con 0x7fcfd006fa90 2023-12-19T13:55:28.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.859+0000 7fcfd572f640 1 --2- 172.21.15.113:0/2367295396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006fee0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00b1b80 tx=0x7fcfc802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e3a8c93d316412 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:28.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfcf7fe640 1 -- 172.21.15.113:0/2367295396 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc802c9f0 con 0x7fcfd006fa90 2023-12-19T13:55:28.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfcf7fe640 1 -- 172.21.15.113:0/2367295396 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc802cb50 con 0x7fcfd006fa90 2023-12-19T13:55:28.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfcf7fe640 1 -- 172.21.15.113:0/2367295396 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80343f0 con 0x7fcfd006fa90 2023-12-19T13:55:28.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 -- 172.21.15.113:0/2367295396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 msgr2=0x7fcfd006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/2367295396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006fee0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00b1b80 tx=0x7fcfc802be50 comp rx=0 tx=0).stop 2023-12-19T13:55:28.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 -- 172.21.15.113:0/2367295396 shutdown_connections 2023-12-19T13:55:28.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/2367295396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006fee0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/2367295396 >> v2:172.21.15.151:3300/0 conn(0x7fcfd00ac8b0 0x7fcfd00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 -- 172.21.15.113:0/2367295396 >> 172.21.15.113:0/2367295396 conn(0x7fcfd00b0100 msgr2=0x7fcfd00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:28.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 -- 172.21.15.113:0/2367295396 shutdown_connections 2023-12-19T13:55:28.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.860+0000 7fcfd5f30640 1 -- 172.21.15.113:0/2367295396 wait complete. 2023-12-19T13:55:28.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.862+0000 7fcfd5f30640 1 Processor -- start 2023-12-19T13:55:28.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.862+0000 7fcfd5f30640 1 -- start start 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd5f30640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd5f30640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfd00ac8b0 0x7fcfd006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd5f30640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd015e3f0 0x7fcfd00cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd5f30640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01484e0 con 0x7fcfd006fa90 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd5f30640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00ce2e0 con 0x7fcfd015e3f0 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd5f30640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0147e90 con 0x7fcfd00ac8b0 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd4f2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.863+0000 7fcfd4f2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49160/0 (socket says 172.21.15.113:49160) 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd4f2e640 1 -- 172.21.15.113:0/244255294 learned_addr learned my addr 172.21.15.113:0/244255294 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:28.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd4f2e640 1 -- 172.21.15.113:0/244255294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfd00ac8b0 msgr2=0x7fcfd006dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd4f2e640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfd00ac8b0 0x7fcfd006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd4f2e640 1 -- 172.21.15.113:0/244255294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd015e3f0 msgr2=0x7fcfd00cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:28.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd4f2e640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd015e3f0 0x7fcfd00cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:28.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd4f2e640 1 -- 172.21.15.113:0/244255294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8009b30 con 0x7fcfd006fa90 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd4f2e640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006d960 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400b3f0 tx=0x7fcfc400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfcd7fa640 1 -- 172.21.15.113:0/244255294 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4011830 con 0x7fcfd006fa90 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfcd7fa640 1 -- 172.21.15.113:0/244255294 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc4011990 con 0x7fcfd006fa90 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfcd7fa640 1 -- 172.21.15.113:0/244255294 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4011d40 con 0x7fcfd006fa90 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.864+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd0148170 con 0x7fcfd006fa90 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.865+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd01478d0 con 0x7fcfd006fa90 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.866+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd0061910 con 0x7fcfd006fa90 2023-12-19T13:55:28.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.866+0000 7fcfcd7fa640 1 -- 172.21.15.113:0/244255294 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfc401a400 con 0x7fcfd006fa90 2023-12-19T13:55:28.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.867+0000 7fcfcd7fa640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcfb406a460 0x7fcfb406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:28.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.867+0000 7fcfcd7fa640 1 -- 172.21.15.113:0/244255294 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfc4088730 con 0x7fcfd006fa90 2023-12-19T13:55:28.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.868+0000 7fcfcffff640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcfb406a460 0x7fcfb406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:28.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.868+0000 7fcfcffff640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcfb406a460 0x7fcfb406c920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006fd0 tx=0x7fcfbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:28.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:28.872+0000 7fcfcd7fa640 1 -- 172.21.15.113:0/244255294 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcfc4053db0 con 0x7fcfd006fa90 2023-12-19T13:55:29.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.100+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfd00cb210 con 0x7fcfd006fa90 2023-12-19T13:55:29.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.101+0000 7fcfcd7fa640 1 -- 172.21.15.113:0/244255294 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fcfc40573d0 con 0x7fcfd006fa90 2023-12-19T13:55:29.101 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:29.101 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:55:23.075987+0000","modified":"2023-12-19T13:55:26.098528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8268":{"gid":8268,"name":"d","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1201018731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1201018731},{"type":"v1","addr":"172.21.15.151:6833","nonce":1201018731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T13:55:29.102 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 72 2023-12-19T13:55:29.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcfb406a460 msgr2=0x7fcfb406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcfb406a460 0x7fcfb406c920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006fd0 tx=0x7fcfbc008040 comp rx=0 tx=0).stop 2023-12-19T13:55:29.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 msgr2=0x7fcfd006d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006d960 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400b3f0 tx=0x7fcfc400b8b0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 shutdown_connections 2023-12-19T13:55:29.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcfb406a460 0x7fcfb406c920 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd015e3f0 0x7fcfd00cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfd00ac8b0 0x7fcfd006dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 --2- 172.21.15.113:0/244255294 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfd006fa90 0x7fcfd006d960 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.103+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 >> 172.21.15.113:0/244255294 conn(0x7fcfd00b0100 msgr2=0x7fcfd00b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:29.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.104+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 shutdown_connections 2023-12-19T13:55:29.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.104+0000 7fcfd5f30640 1 -- 172.21.15.113:0/244255294 wait complete. 2023-12-19T13:55:29.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:55:23.075987+0000', 'modified': '2023-12-19T13:55:26.098528+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8268}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8268': {'gid': 8268, 'name': 'd', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6833/1201018731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1201018731}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 1201018731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:55:29.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:55:29.525 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T13:55:29.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.753+0000 7ff057404640 1 Processor -- start 2023-12-19T13:55:29.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.753+0000 7ff057404640 1 -- start start 2023-12-19T13:55:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.755+0000 7ff057404640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0500b1710 0x7ff05006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.755+0000 7ff057404640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff05015e040 0x7ff05015e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.755+0000 7ff057404640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05015e9c0 con 0x7ff050157aa0 2023-12-19T13:55:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.755+0000 7ff057404640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500b2600 con 0x7ff05015e040 2023-12-19T13:55:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.755+0000 7ff057404640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500b1d60 con 0x7ff0500b1710 2023-12-19T13:55:29.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.755+0000 7ff0551a0640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff050157aa0 0x7ff050161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54918/0 (socket says 172.21.15.113:54918) 2023-12-19T13:55:29.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.755+0000 7ff0551a0640 1 -- 172.21.15.113:0/1238009683 learned_addr learned my addr 172.21.15.113:0/1238009683 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:29.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851706002 0 0) 0x7ff05015e9c0 con 0x7ff050157aa0 2023-12-19T13:55:29.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff05499f640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0500b1710 0x7ff05006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff038003520 con 0x7ff050157aa0 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff0559a1640 1 --2- 172.21.15.113:0/1238009683 >> v2:172.21.15.151:3300/0 conn(0x7ff05015e040 0x7ff05015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 918186945 0 0) 0x7ff038003520 con 0x7ff050157aa0 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0500b1710 msgr2=0x7ff05006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0500b1710 0x7ff05006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 >> v2:172.21.15.151:3300/0 conn(0x7ff05015e040 msgr2=0x7ff05015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 --2- 172.21.15.113:0/1238009683 >> v2:172.21.15.151:3300/0 conn(0x7ff05015e040 0x7ff05015e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500b2040 con 0x7ff050157aa0 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ff040001670 con 0x7ff050157aa0 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff0559a1640 1 --2- 172.21.15.113:0/1238009683 >> v2:172.21.15.151:3300/0 conn(0x7ff05015e040 0x7ff05015e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 >> v1:172.21.15.113:6789/0 conn(0x7ff050157aa0 legacy=0x7ff050161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0380039e0 0x7ff038003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0500b1710 0x7ff0380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff038005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500b2600 con 0x7ff038004d00 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500b1d60 con 0x7ff0380039e0 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.756+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03800ba00 con 0x7ff0500b1710 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0559a1640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff038005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0551a0640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0380039e0 0x7ff038003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0559a1640 1 -- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0500b1710 msgr2=0x7ff0380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0559a1640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0500b1710 0x7ff0380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0559a1640 1 -- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0380039e0 msgr2=0x7ff038003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0559a1640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0380039e0 0x7ff038003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0559a1640 1 -- 172.21.15.113:0/1238009683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038003520 con 0x7ff038004d00 2023-12-19T13:55:29.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.757+0000 7ff0551a0640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0380039e0 0x7ff038003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.758+0000 7ff0559a1640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff038005180 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7ff0480073e0 tx=0x7ff0380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5171bd12bee0c99 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.758+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04802cdc0 con 0x7ff038004d00 2023-12-19T13:55:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.758+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff048034440 con 0x7ff038004d00 2023-12-19T13:55:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.758+0000 7ff047fff640 1 -- 172.21.15.113:0/1238009683 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480347b0 con 0x7ff038004d00 2023-12-19T13:55:29.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.759+0000 7ff057404640 1 -- 172.21.15.113:0/1238009683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 msgr2=0x7ff038005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.759+0000 7ff057404640 1 --2- 172.21.15.113:0/1238009683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff038005180 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7ff0480073e0 tx=0x7ff0380057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.759+0000 7ff0559a1640 1 -- 172.21.15.113:0/1238009683 reap_dead start 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.759+0000 7ff057404640 1 -- 172.21.15.113:0/1238009683 shutdown_connections 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.759+0000 7ff057404640 1 -- 172.21.15.113:0/1238009683 >> 172.21.15.113:0/1238009683 conn(0x7ff0500cbb70 msgr2=0x7ff0500cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.759+0000 7ff057404640 1 -- 172.21.15.113:0/1238009683 shutdown_connections 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.759+0000 7ff057404640 1 -- 172.21.15.113:0/1238009683 wait complete. 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.761+0000 7ff057404640 1 Processor -- start 2023-12-19T13:55:29.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.761+0000 7ff057404640 1 -- start start 2023-12-19T13:55:29.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff057404640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff05013d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff057404640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff05013fbd0 0x7ff050140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff057404640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0500ae740 0x7ff0500aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff057404640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500af100 con 0x7ff038004d00 2023-12-19T13:55:29.762 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff057404640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05013e0a0 con 0x7ff0500ae740 2023-12-19T13:55:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff057404640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05013f7e0 con 0x7ff05013fbd0 2023-12-19T13:55:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff0551a0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff05013d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff0551a0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff05013d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49186/0 (socket says 172.21.15.113:49186) 2023-12-19T13:55:29.763 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.762+0000 7ff0551a0640 1 -- 172.21.15.113:0/1247509255 learned_addr learned my addr 172.21.15.113:0/1247509255 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff0551a0640 1 -- 172.21.15.113:0/1247509255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff05013fbd0 msgr2=0x7ff050140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff0551a0640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff05013fbd0 0x7ff050140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff0551a0640 1 -- 172.21.15.113:0/1247509255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0500ae740 msgr2=0x7ff0500aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff0551a0640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0500ae740 0x7ff0500aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff0551a0640 1 -- 172.21.15.113:0/1247509255 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050140650 con 0x7ff038004d00 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff0551a0640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff05013d1d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff04000d8b0 tx=0x7ff04000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff045ffb640 1 -- 172.21.15.113:0/1247509255 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400074e0 con 0x7ff038004d00 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff045ffb640 1 -- 172.21.15.113:0/1247509255 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040007640 con 0x7ff038004d00 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff045ffb640 1 -- 172.21.15.113:0/1247509255 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400049e0 con 0x7ff038004d00 2023-12-19T13:55:29.764 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff050140930 con 0x7ff038004d00 2023-12-19T13:55:29.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.763+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05013d710 con 0x7ff038004d00 2023-12-19T13:55:29.766 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.766+0000 7ff045ffb640 1 -- 172.21.15.113:0/1247509255 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff040004b40 con 0x7ff038004d00 2023-12-19T13:55:29.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.767+0000 7ff045ffb640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff03c06a430 0x7ff03c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.767+0000 7ff045ffb640 1 -- 172.21.15.113:0/1247509255 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff040088300 con 0x7ff038004d00 2023-12-19T13:55:29.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.768+0000 7ff05499f640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff03c06a430 0x7ff03c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.768+0000 7ff059f73740 1 Processor -- start 2023-12-19T13:55:29.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.768+0000 7ff059f73740 1 -- start start 2023-12-19T13:55:29.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.768+0000 7ff05499f640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff03c06a430 0x7ff03c06c8f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009a40 tx=0x7ff04c009500 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:29.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de6d30 0x55db36de7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff059f73740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36db6cb0 0x55db36de3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36de44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff059f73740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36d26f80 con 0x55db36db6cb0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36d24710 con 0x55db36de6d30 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db36d20000 con 0x55db36dba8b0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff05499f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36db6cb0 0x55db36de3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff05499f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36db6cb0 0x55db36de3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49194/0 (socket says 172.21.15.113:49194) 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.769+0000 7ff05499f640 1 -- 172.21.15.113:0/3401129016 learned_addr learned my addr 172.21.15.113:0/3401129016 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff05499f640 1 -- 172.21.15.113:0/3401129016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 msgr2=0x55db36de44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff05499f640 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36de44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff05499f640 1 -- 172.21.15.113:0/3401129016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de6d30 msgr2=0x55db36de7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff0551a0640 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de6d30 0x55db36de7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff05499f640 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de6d30 0x55db36de7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff05499f640 1 -- 172.21.15.113:0/3401129016 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db36ce7690 con 0x55db36db6cb0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff05499f640 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36db6cb0 0x55db36de3fa0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00eb10 tx=0x7ff04c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6998192b5e7466 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff036ffd640 1 -- 172.21.15.113:0/3401129016 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c015a40 con 0x55db36db6cb0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff036ffd640 1 -- 172.21.15.113:0/3401129016 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c015ba0 con 0x55db36db6cb0 2023-12-19T13:55:29.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.770+0000 7ff036ffd640 1 -- 172.21.15.113:0/3401129016 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c013450 con 0x55db36db6cb0 2023-12-19T13:55:29.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 -- 172.21.15.113:0/3401129016 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36db6cb0 msgr2=0x55db36de3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36db6cb0 0x55db36de3fa0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00eb10 tx=0x7ff04c011000 comp rx=0 tx=0).stop 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 -- 172.21.15.113:0/3401129016 shutdown_connections 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36de44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36db6cb0 0x55db36de3fa0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 --2- 172.21.15.113:0/3401129016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de6d30 0x55db36de7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 -- 172.21.15.113:0/3401129016 >> 172.21.15.113:0/3401129016 conn(0x55db36db8fc0 msgr2=0x55db36e01b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 -- 172.21.15.113:0/3401129016 shutdown_connections 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.771+0000 7ff059f73740 1 -- 172.21.15.113:0/3401129016 wait complete. 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.772+0000 7ff059f73740 1 -- start start 2023-12-19T13:55:29.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.772+0000 7ff059f73740 1 Processor -- start 2023-12-19T13:55:29.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff059f73740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36dba8b0 0x55db36de2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de6d30 0x55db36e04360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 0x55db36e048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff059f73740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36cc17d0 con 0x55db36dba8b0 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36cc1470 con 0x55db36de1e40 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db36a87f20 con 0x55db36de6d30 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff059f73740 10 client.0 _ll_register_callbacks cb 0x55db36d101b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff0551a0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36dba8b0 0x55db36de2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.773+0000 7ff0551a0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36dba8b0 0x55db36de2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49200/0 (socket says 172.21.15.113:49200) 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff0551a0640 1 -- 172.21.15.113:0/3639427199 learned_addr learned my addr 172.21.15.113:0/3639427199 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff0551a0640 1 -- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de6d30 msgr2=0x55db36e04360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff0551a0640 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de6d30 0x55db36e04360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff0551a0640 1 -- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 msgr2=0x55db36e048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff0551a0640 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 0x55db36e048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff0551a0640 1 -- 172.21.15.113:0/3639427199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c00e7f0 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff0551a0640 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36dba8b0 0x55db36de2360 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff04005f120 tx=0x7ff040057730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc18f8d3a6949a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff02bfff640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff02bfff640 1 -- 172.21.15.113:0/3639427199 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04005f650 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff02bfff640 1 -- 172.21.15.113:0/3639427199 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0400880c0 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.774+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db36d4a550 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff02bfff640 1 -- 172.21.15.113:0/3639427199 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff040055a10 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 10 client.8403 fetch_fsmap learned FSMap version 72 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55db36d1e680 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff02bfff640 1 -- 172.21.15.113:0/3639427199 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040072030 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff02bfff640 1 -- 172.21.15.113:0/3639427199 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff04005f1c0 con 0x55db36dba8b0 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 10 client.8403 fetch_fsmap finished waiting for FSMap version 72 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 10 client.8403 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 20 client.8403 populate_metadata read hostname 'smithi113' 2023-12-19T13:55:29.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36df8e60 0x55db36df9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 4 client.8403 mds_command: new command op to 8268 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:55:29.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.775+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 --> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db36d12b50 con 0x55db36df8e60 2023-12-19T13:55:29.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.776+0000 7ff05499f640 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36df8e60 0x55db36df9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.777+0000 7ff05499f640 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36df8e60 0x55db36df9240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91907b5682e34b5c server_cookie=45c8ace9dc7ec62c in_seq=0 out_seq=0 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.777+0000 7ff02bfff640 10 client.8403 ms_handle_connect on v2:172.21.15.151:6832/1201018731 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff02bfff640 1 -- 172.21.15.113:0/3639427199 <== mds.0 v2:172.21.15.151:6832/1201018731 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55db36d12b50 con 0x55db36df8e60 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff02bfff640 10 client.8403 handle_command_reply: tid=0 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 client.8403 shutdown 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36dba8b0 msgr2=0x55db36de2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36dba8b0 0x55db36de2360 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff04005f120 tx=0x7ff040057730 comp rx=0 tx=0).stop 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 shutdown_connections 2023-12-19T13:55:29.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36df8e60 0x55db36df9240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 0x55db36e048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de6d30 0x55db36e04360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 --2- 172.21.15.113:0/3639427199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36dba8b0 0x55db36de2360 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 >> 172.21.15.113:0/3639427199 conn(0x55db36db6cb0 msgr2=0x55db36dbb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.778+0000 7ff02bfff640 0 client.8403 ms_handle_reset on v2:172.21.15.151:6832/1201018731 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.779+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 shutdown_connections 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.779+0000 7ff059f73740 1 -- 172.21.15.113:0/3639427199 wait complete. 2023-12-19T13:55:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.779+0000 7ff059f73740 20 client.8403 trim_cache size 0 max 16384 2023-12-19T13:55:29.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.795+0000 7ff059f73740 1 Processor -- start 2023-12-19T13:55:29.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.795+0000 7ff059f73740 1 -- start start 2023-12-19T13:55:29.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36dba8b0 0x55db36e10380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de1e40 0x55db36e042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff059f73740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e04810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff059f73740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36de3e40 con 0x55db36de6d30 2023-12-19T13:55:29.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36dbd4d0 con 0x55db36dba8b0 2023-12-19T13:55:29.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db36e04d50 con 0x55db36de1e40 2023-12-19T13:55:29.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff0559a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e04810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff0559a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e04810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49216/0 (socket says 172.21.15.113:49216) 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.796+0000 7ff0559a1640 1 -- 172.21.15.113:0/2755953871 learned_addr learned my addr 172.21.15.113:0/2755953871 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff05499f640 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de1e40 0x55db36e042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0551a0640 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36dba8b0 0x55db36e10380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0559a1640 1 -- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de1e40 msgr2=0x55db36e042d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0559a1640 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de1e40 0x55db36e042d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0559a1640 1 -- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36dba8b0 msgr2=0x55db36e10380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0559a1640 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36dba8b0 0x55db36e10380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0559a1640 1 -- 172.21.15.113:0/2755953871 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db36cc09e0 con 0x55db36de6d30 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff05499f640 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de1e40 0x55db36e042d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0559a1640 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e04810 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ff0480073e0 tx=0x7ff048004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8770408d97ae212 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.797+0000 7ff0377fe640 1 -- 172.21.15.113:0/2755953871 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04802cbc0 con 0x55db36de6d30 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff0377fe640 1 -- 172.21.15.113:0/2755953871 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04802cd20 con 0x55db36de6d30 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff0377fe640 1 -- 172.21.15.113:0/2755953871 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480347f0 con 0x55db36de6d30 2023-12-19T13:55:29.799 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 -- 172.21.15.113:0/2755953871 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 msgr2=0x55db36e04810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e04810 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ff0480073e0 tx=0x7ff048004ab0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 -- 172.21.15.113:0/2755953871 shutdown_connections 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e04810 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36de1e40 0x55db36e042d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 --2- 172.21.15.113:0/2755953871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36dba8b0 0x55db36e10380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 -- 172.21.15.113:0/2755953871 >> 172.21.15.113:0/2755953871 conn(0x55db36db6cb0 msgr2=0x55db36e05050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 -- 172.21.15.113:0/2755953871 shutdown_connections 2023-12-19T13:55:29.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.798+0000 7ff059f73740 1 -- 172.21.15.113:0/2755953871 wait complete. 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.799+0000 7ff059f73740 1 -- start start 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.799+0000 7ff059f73740 1 Processor -- start 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36e667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff059f73740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 0x55db36e040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff059f73740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff059f73740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36e66d00 con 0x55db36de6d30 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db36dfa5d0 con 0x55db36de1e40 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff059f73740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db36dfaf10 con 0x55db36dba8b0 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff059f73740 10 client.0 _ll_register_callbacks cb 0x7ff04c009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff0559a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff0559a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49226/0 (socket says 172.21.15.113:49226) 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.800+0000 7ff0559a1640 1 -- 172.21.15.113:0/681878043 learned_addr learned my addr 172.21.15.113:0/681878043 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0551a0640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36e667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0559a1640 1 -- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 msgr2=0x55db36e667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff05499f640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 0x55db36e040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0559a1640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36e667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0559a1640 1 -- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 msgr2=0x55db36e040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0559a1640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 0x55db36e040a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0559a1640 1 -- 172.21.15.113:0/681878043 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff038003520 con 0x55db36de6d30 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0551a0640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36e667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff0559a1640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e045e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff04802c830 tx=0x7ff04802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a46e9fdc27a754 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff02bfff640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff02bfff640 1 -- 172.21.15.113:0/681878043 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048034db0 con 0x55db36de6d30 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff02bfff640 1 -- 172.21.15.113:0/681878043 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff048003990 con 0x55db36de6d30 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.801+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff04c015ba0 con 0x55db36de6d30 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff02bfff640 1 -- 172.21.15.113:0/681878043 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff04802ce90 con 0x55db36de6d30 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 10 client.8409 fetch_fsmap learned FSMap version 72 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55db36ce5ef0 con 0x55db36de6d30 2023-12-19T13:55:29.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff02bfff640 1 -- 172.21.15.113:0/681878043 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c015ba0 con 0x55db36de6d30 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff02bfff640 1 -- 172.21.15.113:0/681878043 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff048003b50 con 0x55db36de6d30 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 10 client.8409 fetch_fsmap finished waiting for FSMap version 72 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 10 client.8409 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 20 client.8409 populate_metadata read hostname 'smithi113' 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36e032d0 0x55db36e036b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 4 client.8409 mds_command: new command op to 8268 tid=0[{"prefix": "status"}] 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.802+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 --> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55db36d19080 con 0x55db36e032d0 2023-12-19T13:55:29.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.803+0000 7ff0551a0640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36e032d0 0x55db36e036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:29.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.804+0000 7ff0551a0640 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36e032d0 0x55db36e036b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae06d4a04cca5798 server_cookie=6fc55ecece930fbb in_seq=0 out_seq=0 2023-12-19T13:55:29.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.804+0000 7ff02bfff640 10 client.8409 ms_handle_connect on v2:172.21.15.151:6832/1201018731 2023-12-19T13:55:29.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff02bfff640 1 -- 172.21.15.113:0/681878043 <== mds.0 v2:172.21.15.151:6832/1201018731 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55db36d19080 con 0x55db36e032d0 2023-12-19T13:55:29.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff02bfff640 10 client.8409 handle_command_reply: tid=0 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 client.8409 shutdown 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 msgr2=0x55db36e045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e045e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff04802c830 tx=0x7ff04802e070 comp rx=0 tx=0).stop 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 shutdown_connections 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:6832/1201018731,v1:172.21.15.151:6833/1201018731] conn(0x55db36e032d0 0x55db36e036b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55db36de6d30 0x55db36e045e0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db36de1e40 0x55db36e040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 --2- 172.21.15.113:0/681878043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db36dba8b0 0x55db36e667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff02bfff640 0 client.8409 ms_handle_reset on v2:172.21.15.151:6832/1201018731 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 >> 172.21.15.113:0/681878043 conn(0x55db36db6cb0 msgr2=0x55db36e10630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 shutdown_connections 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 1 -- 172.21.15.113:0/681878043 wait complete. 2023-12-19T13:55:29.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.805+0000 7ff059f73740 20 client.8409 trim_cache size 0 max 16384 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 8268, 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 6.724422025, 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 72, 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 163, 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 163, 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 12.029257980000001 2023-12-19T13:55:29.808 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:55:29.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff03c06a430 msgr2=0x7ff03c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff03c06a430 0x7ff03c06c8f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009a40 tx=0x7ff04c009500 comp rx=0 tx=0).stop 2023-12-19T13:55:29.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 msgr2=0x7ff05013d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:29.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff05013d1d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff04000d8b0 tx=0x7ff04000dd70 comp rx=0 tx=0).stop 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 shutdown_connections 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff03c06a430 0x7ff03c06c8f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0500ae740 0x7ff0500aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff05013fbd0 0x7ff050140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 --2- 172.21.15.113:0/1247509255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff038004d00 0x7ff05013d1d0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 >> 172.21.15.113:0/1247509255 conn(0x7ff0500cbb70 msgr2=0x7ff05015cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 shutdown_connections 2023-12-19T13:55:29.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:29.806+0000 7ff057404640 1 -- 172.21.15.113:0/1247509255 wait complete. 2023-12-19T13:55:29.823 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:55:30.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.025+0000 7f66aee04640 1 Processor -- start 2023-12-19T13:55:30.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.025+0000 7f66aee04640 1 -- start start 2023-12-19T13:55:30.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66aee04640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f66a8146e10 0x7f66a80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66aee04640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 0x7f66a80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66aee04640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a80cd840 con 0x7f66a80ce110 2023-12-19T13:55:30.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66aee04640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a80d2430 con 0x7f66a8146e10 2023-12-19T13:55:30.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66aee04640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80d2620 con 0x7f66a80d2b00 2023-12-19T13:55:30.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66ad3a1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f66a80ce110 0x7f66a80b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54930/0 (socket says 172.21.15.113:54930) 2023-12-19T13:55:30.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2326983721 learned_addr learned my addr 172.21.15.113:0/2326983721 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66acba0640 1 --2- 172.21.15.113:0/2326983721 >> v2:172.21.15.151:3300/0 conn(0x7f66a8146e10 0x7f66a80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.027+0000 7f66a7fff640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 0x7f66a80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661824091 0 0) 0x7f66a80cd840 con 0x7f66a80ce110 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6698003520 con 0x7f66a80ce110 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051501186 0 0) 0x7f6698003520 con 0x7f66a80ce110 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 msgr2=0x7f66a80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 0x7f66a80b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 >> v2:172.21.15.151:3300/0 conn(0x7f66a8146e10 msgr2=0x7f66a80d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 --2- 172.21.15.113:0/2326983721 >> v2:172.21.15.151:3300/0 conn(0x7f66a8146e10 0x7f66a80d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80b41c0 con 0x7f66a80ce110 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f66a00019f0 con 0x7f66a80ce110 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 >> v1:172.21.15.113:6789/0 conn(0x7f66a80ce110 legacy=0x7f66a80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:30.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 0x7f66980039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698003f60 0x7f66980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6698004d00 0x7f6698005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80d2620 con 0x7f6698004d00 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669800b980 con 0x7f6698003f60 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.028+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669800baf0 con 0x7f66a80d2b00 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66ad3a1640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6698004d00 0x7f6698005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66acba0640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 0x7f66980039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66a7fff640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698003f60 0x7f66980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 msgr2=0x7f66980039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66ad3a1640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 0x7f66980039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698003f60 msgr2=0x7f66980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66ad3a1640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698003f60 0x7f66980047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2326983721 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698003520 con 0x7f6698004d00 2023-12-19T13:55:30.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.029+0000 7f66acba0640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a80d2b00 0x7f66980039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.030+0000 7f66ad3a1640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6698004d00 0x7f6698005180 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f66a000a8d0 tx=0x7f66980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dcab60d17c872b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.030+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0034630 con 0x7f6698004d00 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.030+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a002f070 con 0x7f6698004d00 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.030+0000 7f66a77fe640 1 -- 172.21.15.113:0/2326983721 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00349d0 con 0x7f6698004d00 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.031+0000 7f66aee04640 1 -- 172.21.15.113:0/2326983721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6698004d00 msgr2=0x7f6698005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.031+0000 7f66aee04640 1 --2- 172.21.15.113:0/2326983721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6698004d00 0x7f6698005180 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f66a000a8d0 tx=0x7f66980057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.031+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2326983721 reap_dead start 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.031+0000 7f66aee04640 1 -- 172.21.15.113:0/2326983721 shutdown_connections 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.031+0000 7f66aee04640 1 -- 172.21.15.113:0/2326983721 >> 172.21.15.113:0/2326983721 conn(0x7f66a80b29c0 msgr2=0x7f66a80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.031+0000 7f66aee04640 1 -- 172.21.15.113:0/2326983721 shutdown_connections 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.031+0000 7f66aee04640 1 -- 172.21.15.113:0/2326983721 wait complete. 2023-12-19T13:55:30.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.033+0000 7f66aee04640 1 Processor -- start 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.033+0000 7f66aee04640 1 -- start start 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66aee04640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698004d00 0x7f66a813b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66aee04640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a813d570 0x7f66a813d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66aee04640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66a813c310 0x7f66a813c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66aee04640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a813df30 con 0x7f66a813c310 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66aee04640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8139af0 con 0x7f6698004d00 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66aee04640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8139d90 con 0x7f66a813d570 2023-12-19T13:55:30.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66ad3a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66a813c310 0x7f66a813c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66ad3a1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66a813c310 0x7f66a813c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49240/0 (socket says 172.21.15.113:49240) 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.034+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2108799617 learned_addr learned my addr 172.21.15.113:0/2108799617 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66a7fff640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a813d570 0x7f66a813d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a813d570 msgr2=0x7f66a813d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66acba0640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698004d00 0x7f66a813b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66ad3a1640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a813d570 0x7f66a813d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698004d00 msgr2=0x7f66a813b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66ad3a1640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698004d00 0x7f66a813b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66ad3a1640 1 -- 172.21.15.113:0/2108799617 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a813a070 con 0x7f66a813c310 2023-12-19T13:55:30.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66ad3a1640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66a813c310 0x7f66a813c7c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f66a000a9f0 tx=0x7f66a0001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:30.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66a57fa640 1 -- 172.21.15.113:0/2108799617 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0034840 con 0x7f66a813c310 2023-12-19T13:55:30.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66a57fa640 1 -- 172.21.15.113:0/2108799617 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00349a0 con 0x7f66a813c310 2023-12-19T13:55:30.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66a57fa640 1 -- 172.21.15.113:0/2108799617 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0034d50 con 0x7f66a813c310 2023-12-19T13:55:30.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.035+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a813a350 con 0x7f66a813c310 2023-12-19T13:55:30.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.036+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a813bec0 con 0x7f66a813c310 2023-12-19T13:55:30.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.037+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a813c170 con 0x7f66a813c310 2023-12-19T13:55:30.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.037+0000 7f66a57fa640 1 -- 172.21.15.113:0/2108799617 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f66a0031030 con 0x7f66a813c310 2023-12-19T13:55:30.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.038+0000 7f66a57fa640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f668c06a460 0x7f668c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:30.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.038+0000 7f66a57fa640 1 -- 172.21.15.113:0/2108799617 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66a00aab60 con 0x7f66a813c310 2023-12-19T13:55:30.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.039+0000 7f66acba0640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f668c06a460 0x7f668c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:30.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.039+0000 7f66acba0640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f668c06a460 0x7f668c06c920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f669c009a40 tx=0x7f669c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:30.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.043+0000 7f66a57fa640 1 -- 172.21.15.113:0/2108799617 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f66a813c170 con 0x7f66a813c310 2023-12-19T13:55:30.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.264+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66a813c170 con 0x7f66a813c310 2023-12-19T13:55:30.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.265+0000 7f66a57fa640 1 -- 172.21.15.113:0/2108799617 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f66a813c170 con 0x7f66a813c310 2023-12-19T13:55:30.265 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:55:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f668c06a460 msgr2=0x7f668c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f668c06a460 0x7f668c06c920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f669c009a40 tx=0x7f669c008040 comp rx=0 tx=0).stop 2023-12-19T13:55:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66a813c310 msgr2=0x7f66a813c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66a813c310 0x7f66a813c7c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f66a000a9f0 tx=0x7f66a0001360 comp rx=0 tx=0).stop 2023-12-19T13:55:30.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 shutdown_connections 2023-12-19T13:55:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f668c06a460 0x7f668c06c920 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66a813c310 0x7f66a813c7c0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66a813d570 0x7f66a813d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 --2- 172.21.15.113:0/2108799617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6698004d00 0x7f66a813b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 >> 172.21.15.113:0/2108799617 conn(0x7f66a80b29c0 msgr2=0x7f66a80b7180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:30.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 shutdown_connections 2023-12-19T13:55:30.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:30.268+0000 7f66aee04640 1 -- 172.21.15.113:0/2108799617 wait complete. 2023-12-19T13:55:30.286 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:55:30.286 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:55:30.286 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:55:30.286 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:55:30.286 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:55:30.286 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:55:30.287 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:55:30.287 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:55:30.287 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:55:30.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:30.287 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:55:30.339 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:55:30.339 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:55:30.339 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:55:30.339 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:30.339 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:55:30.339 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:30.339 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 41890sec preferred_lft 41890sec 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:30.340 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:55:30.341 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:30.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:30.342 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:55:30.428 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:55:30.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:30.432 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:55:30.486 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:55:30.486 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:55:30.486 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:55:30.486 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:55:30.486 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:55:30.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:30.487 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:55:30.487 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:55:30.487 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:55:30.487 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:55:30.487 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:55:30.487 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:55:30.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:30.672 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:55:30.722 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:55:30.722 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:55:30.722 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:55:30.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:30.723 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:55:30.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:55:30.811 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:55:30.863 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:55:30.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:55:30.863 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:55:30.913 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:55:30.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:30.913 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:55:31.051 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:55:31.051 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:55:31.083 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:55:31.083 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:55:31.083 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:55:31.083 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:55:31.083 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:55:31.085 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:55:31.085 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:55:31.085 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:55:31.085 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:55:31.085 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:55:31.089 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:55:31.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:31.089 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:55:31.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:31.166 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:55:31.235 INFO:teuthology.orchestra.run.smithi113.stdout:client6070 2023-12-19T13:55:31.235 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:55:31.235 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:31.290 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:55:31.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.502+0000 7f826c223640 1 Processor -- start 2023-12-19T13:55:31.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.503+0000 7f826c223640 1 -- start start 2023-12-19T13:55:31.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.504+0000 7f826c223640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8264157aa0 0x7f82640b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:31.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.504+0000 7f826c223640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f826406e410 0x7f8264161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:31.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.504+0000 7f826c223640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826406e890 con 0x7f8264161540 2023-12-19T13:55:31.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.504+0000 7f826c223640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82640b2600 con 0x7f8264157aa0 2023-12-19T13:55:31.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.504+0000 7f826c223640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82640b1d60 con 0x7f826406e410 2023-12-19T13:55:31.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.505+0000 7f8269fbf640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8264157aa0 0x7f82640b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:31.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.505+0000 7f8269fbf640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8264157aa0 0x7f82640b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:55350/0 (socket says 172.21.15.113:55350) 2023-12-19T13:55:31.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.505+0000 7f8269fbf640 1 -- 172.21.15.113:0/3925136875 learned_addr learned my addr 172.21.15.113:0/3925136875 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:31.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.505+0000 7f82697be640 1 --2- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f826406e410 0x7f8264161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:31.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.506+0000 7f8269fbf640 1 -- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f826406e410 msgr2=0x7f8264161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:31.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.506+0000 7f8269fbf640 1 --2- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f826406e410 0x7f8264161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.506+0000 7f8269fbf640 1 -- 172.21.15.113:0/3925136875 >> v1:172.21.15.151:6789/0 conn(0x7f8264161540 legacy=0x7f826415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:31.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.506+0000 7f8269fbf640 1 -- 172.21.15.113:0/3925136875 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82640b2040 con 0x7f8264157aa0 2023-12-19T13:55:31.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.507+0000 7f8269fbf640 1 --2- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8264157aa0 0x7f82640b1710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8260009870 tx=0x7f826002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2001b7da21945725 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:31.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f8268fbd640 1 -- 172.21.15.113:0/3925136875 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260030840 con 0x7f8264157aa0 2023-12-19T13:55:31.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f8268fbd640 1 -- 172.21.15.113:0/3925136875 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82600309a0 con 0x7f8264157aa0 2023-12-19T13:55:31.508 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f8268fbd640 1 -- 172.21.15.113:0/3925136875 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260030d30 con 0x7f8264157aa0 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f826c223640 1 -- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8264157aa0 msgr2=0x7f82640b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f826c223640 1 --2- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8264157aa0 0x7f82640b1710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8260009870 tx=0x7f826002b980 comp rx=0 tx=0).stop 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f826c223640 1 -- 172.21.15.113:0/3925136875 shutdown_connections 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f826c223640 1 --2- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f826406e410 0x7f8264161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f826c223640 1 --2- 172.21.15.113:0/3925136875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8264157aa0 0x7f82640b1710 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.508+0000 7f826c223640 1 -- 172.21.15.113:0/3925136875 >> 172.21.15.113:0/3925136875 conn(0x7f82640cbb70 msgr2=0x7f82640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.509+0000 7f826c223640 1 -- 172.21.15.113:0/3925136875 shutdown_connections 2023-12-19T13:55:31.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.509+0000 7f826c223640 1 -- 172.21.15.113:0/3925136875 wait complete. 2023-12-19T13:55:31.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.511+0000 7f826c223640 1 Processor -- start 2023-12-19T13:55:31.511 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.511+0000 7f826c223640 1 -- start start 2023-12-19T13:55:31.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.512+0000 7f826c223640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f826406e410 0x7f826415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:31.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.512+0000 7f826c223640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8264157aa0 0x7f8264158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.512+0000 7f826c223640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8264161540 0x7f826406d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.512+0000 7f826c223640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826415a910 con 0x7f8264161540 2023-12-19T13:55:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.512+0000 7f826c223640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82641585d0 con 0x7f826406e410 2023-12-19T13:55:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.512+0000 7f826c223640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8264158850 con 0x7f8264157aa0 2023-12-19T13:55:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.512+0000 7f826a7c0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8264161540 0x7f826406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8264161540 0x7f826406d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49246/0 (socket says 172.21.15.113:49246) 2023-12-19T13:55:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 -- 172.21.15.113:0/105523667 learned_addr learned my addr 172.21.15.113:0/105523667 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:31.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f8269fbf640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f826406e410 0x7f826415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:31.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f82697be640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8264157aa0 0x7f8264158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:31.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 -- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8264157aa0 msgr2=0x7f8264158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:31.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8264157aa0 0x7f8264158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 -- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f826406e410 msgr2=0x7f826415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f826406e410 0x7f826415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 -- 172.21.15.113:0/105523667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600094d0 con 0x7f8264161540 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.513+0000 7f826a7c0640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8264161540 0x7f826406d080 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c6b0 tx=0x7f825c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.514+0000 7f825a7fc640 1 -- 172.21.15.113:0/105523667 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c003b70 con 0x7f8264161540 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.514+0000 7f825a7fc640 1 -- 172.21.15.113:0/105523667 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c003cd0 con 0x7f8264161540 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.514+0000 7f825a7fc640 1 -- 172.21.15.113:0/105523667 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c005310 con 0x7f8264161540 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.514+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8264158b30 con 0x7f8264161540 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.514+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82641590f0 con 0x7f8264161540 2023-12-19T13:55:31.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.515+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8264061910 con 0x7f8264161540 2023-12-19T13:55:31.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.516+0000 7f825a7fc640 1 -- 172.21.15.113:0/105523667 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f825c005470 con 0x7f8264161540 2023-12-19T13:55:31.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.517+0000 7f825a7fc640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824806a430 0x7f824806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:31.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.517+0000 7f825a7fc640 1 -- 172.21.15.113:0/105523667 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f825c088790 con 0x7f8264161540 2023-12-19T13:55:31.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.517+0000 7f8269fbf640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824806a430 0x7f824806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:31.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.518+0000 7f8269fbf640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824806a430 0x7f824806c8f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8260036000 tx=0x7f8260008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:31.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.522+0000 7f825a7fc640 1 -- 172.21.15.113:0/105523667 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f825c053ce0 con 0x7f8264161540 2023-12-19T13:55:31.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.753+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8264071ae0 con 0x7f8264161540 2023-12-19T13:55:31.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.754+0000 7f825a7fc640 1 -- 172.21.15.113:0/105523667 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f825c057300 con 0x7f8264161540 2023-12-19T13:55:31.754 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:55:31.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824806a430 msgr2=0x7f824806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824806a430 0x7f824806c8f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8260036000 tx=0x7f8260008030 comp rx=0 tx=0).stop 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8264161540 msgr2=0x7f826406d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8264161540 0x7f826406d080 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c6b0 tx=0x7f825c00cb70 comp rx=0 tx=0).stop 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 shutdown_connections 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824806a430 0x7f824806c8f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8264161540 0x7f826406d080 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8264157aa0 0x7f8264158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 --2- 172.21.15.113:0/105523667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f826406e410 0x7f826415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 >> 172.21.15.113:0/105523667 conn(0x7f82640cbb70 msgr2=0x7f826406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 shutdown_connections 2023-12-19T13:55:31.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:31.757+0000 7f826c223640 1 -- 172.21.15.113:0/105523667 wait complete. 2023-12-19T13:55:31.775 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:55:31.775 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:55:31.775 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:55:31.776 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:55:31.776 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:55:31.776 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:55:31.776 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:55:31.776 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:55:31.776 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:55:31.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:31.776 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:55:31.837 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:55:31.838 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41863sec preferred_lft 41863sec 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:31.839 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:55:31.840 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:55:31.840 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:55:31.840 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:31.840 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:55:31.840 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:55:31.840 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:55:31.840 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:55:31.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:31.841 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:55:31.935 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:55:31.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:31.939 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:55:31.994 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:55:31.994 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:55:31.994 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:55:31.994 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:55:31.994 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:55:31.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:31.995 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:55:31.995 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:55:31.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:55:31.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:55:31.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:55:31.995 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:55:32.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:32.179 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:55:32.234 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:55:32.234 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:55:32.234 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:55:32.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:32.235 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:55:32.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:55:32.334 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:55:32.391 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:55:32.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:55:32.391 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:55:32.444 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:55:32.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:32.444 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:55:32.589 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:55:32.589 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:55:32.621 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:55:32.621 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:55:32.621 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:55:32.621 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:55:32.621 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:55:32.622 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:55:32.622 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:55:32.623 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:55:32.623 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:55:32.623 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:55:32.626 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:55:32.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:32.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:55:32.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:55:32.704 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:55:32.756 INFO:teuthology.orchestra.run.smithi151.stdout:client6082 2023-12-19T13:55:32.756 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:55:32.756 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:55:32.805 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:55:33.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.026+0000 7fb49e91b640 1 Processor -- start 2023-12-19T13:55:33.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.026+0000 7fb49e91b640 1 -- start start 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb49e91b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb498157bf0 0x7fb49815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb49e91b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4980ae110 0x7fb4980b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb49e91b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980b0a90 con 0x7fb4980b0640 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb49e91b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49806b8c0 con 0x7fb498157bf0 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb49e91b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815b740 con 0x7fb4980ae110 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb497fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb498157bf0 0x7fb49815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb49ceb8640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb4980b0640 0x7fb49815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54944/0 (socket says 172.21.15.113:54944) 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb49ceb8640 1 -- 172.21.15.113:0/4010679922 learned_addr learned my addr 172.21.15.113:0/4010679922 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.028+0000 7fb497fff640 1 --2- 172.21.15.113:0/4010679922 >> v2:172.21.15.113:3300/0 conn(0x7fb498157bf0 0x7fb49815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49260/0 (socket says 172.21.15.113:49260) 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.029+0000 7fb497fff640 1 -- 172.21.15.113:0/4010679922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4980ae110 msgr2=0x7fb4980b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.029+0000 7fb497fff640 1 --2- 172.21.15.113:0/4010679922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4980ae110 0x7fb4980b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.029+0000 7fb497fff640 1 -- 172.21.15.113:0/4010679922 >> v1:172.21.15.113:6789/0 conn(0x7fb4980b0640 legacy=0x7fb49815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.029+0000 7fb497fff640 1 -- 172.21.15.113:0/4010679922 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980ae640 con 0x7fb498157bf0 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.029+0000 7fb496ffd640 1 -- 172.21.15.113:0/4010679922 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360461831 0 0) 0x7fb490001490 con 0x7fb4980b0640 2023-12-19T13:55:33.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.030+0000 7fb497fff640 1 --2- 172.21.15.113:0/4010679922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb498157bf0 0x7fb49815b200 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb4880097a0 tx=0x7fb48802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db0d8ce5412205d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:33.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.030+0000 7fb496ffd640 1 -- 172.21.15.113:0/4010679922 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488031830 con 0x7fb498157bf0 2023-12-19T13:55:33.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.030+0000 7fb496ffd640 1 -- 172.21.15.113:0/4010679922 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb488031990 con 0x7fb498157bf0 2023-12-19T13:55:33.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.030+0000 7fb496ffd640 1 -- 172.21.15.113:0/4010679922 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488031d20 con 0x7fb498157bf0 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 -- 172.21.15.113:0/4010679922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb498157bf0 msgr2=0x7fb49815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 --2- 172.21.15.113:0/4010679922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb498157bf0 0x7fb49815b200 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb4880097a0 tx=0x7fb48802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 -- 172.21.15.113:0/4010679922 shutdown_connections 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 --2- 172.21.15.113:0/4010679922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4980ae110 0x7fb4980b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 --2- 172.21.15.113:0/4010679922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb498157bf0 0x7fb49815b200 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 -- 172.21.15.113:0/4010679922 >> 172.21.15.113:0/4010679922 conn(0x7fb4980cbb70 msgr2=0x7fb4980cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 -- 172.21.15.113:0/4010679922 shutdown_connections 2023-12-19T13:55:33.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.031+0000 7fb49e91b640 1 -- 172.21.15.113:0/4010679922 wait complete. 2023-12-19T13:55:33.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.033+0000 7fb49e91b640 1 Processor -- start 2023-12-19T13:55:33.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.033+0000 7fb49e91b640 1 -- start start 2023-12-19T13:55:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb49e91b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4980ae110 0x7fb498155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb49e91b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4980b0640 0x7fb498156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb49e91b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb498157bf0 0x7fb4981512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb49e91b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981566d0 con 0x7fb4980ae110 2023-12-19T13:55:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb49e91b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498167610 con 0x7fb4980b0640 2023-12-19T13:55:33.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb49e91b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb498155a50 con 0x7fb498157bf0 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb497fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4980ae110 0x7fb498155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb497fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4980ae110 0x7fb498155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49264/0 (socket says 172.21.15.113:49264) 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.034+0000 7fb497fff640 1 -- 172.21.15.113:0/895811565 learned_addr learned my addr 172.21.15.113:0/895811565 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb49ceb8640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb498157bf0 0x7fb4981512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb4977fe640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4980b0640 0x7fb498156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb497fff640 1 -- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb498157bf0 msgr2=0x7fb4981512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb497fff640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb498157bf0 0x7fb4981512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb497fff640 1 -- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4980b0640 msgr2=0x7fb498156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb497fff640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4980b0640 0x7fb498156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb497fff640 1 -- 172.21.15.113:0/895811565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488009400 con 0x7fb4980ae110 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb497fff640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4980ae110 0x7fb498155450 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb4880097a0 tx=0x7fb4880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb494ff9640 1 -- 172.21.15.113:0/895811565 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48803aa60 con 0x7fb4980ae110 2023-12-19T13:55:33.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb494ff9640 1 -- 172.21.15.113:0/895811565 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48803abc0 con 0x7fb4980ae110 2023-12-19T13:55:33.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb494ff9640 1 -- 172.21.15.113:0/895811565 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4880443f0 con 0x7fb4980ae110 2023-12-19T13:55:33.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb498155d30 con 0x7fb4980ae110 2023-12-19T13:55:33.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.035+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4981562f0 con 0x7fb4980ae110 2023-12-19T13:55:33.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.037+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb498156810 con 0x7fb4980ae110 2023-12-19T13:55:33.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.037+0000 7fb494ff9640 1 -- 172.21.15.113:0/895811565 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb48804d450 con 0x7fb4980ae110 2023-12-19T13:55:33.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.038+0000 7fb494ff9640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb48406a460 0x7fb48406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.038+0000 7fb494ff9640 1 -- 172.21.15.113:0/895811565 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4880aab20 con 0x7fb4980ae110 2023-12-19T13:55:33.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.039+0000 7fb4977fe640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb48406a460 0x7fb48406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.039+0000 7fb4977fe640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb48406a460 0x7fb48406c920 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb4980ad220 tx=0x7fb48c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:33.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.043+0000 7fb494ff9640 1 -- 172.21.15.113:0/895811565 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb488076110 con 0x7fb4980ae110 2023-12-19T13:55:33.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.270+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb498061910 con 0x7fb4980ae110 2023-12-19T13:55:33.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.271+0000 7fb494ff9640 1 -- 172.21.15.113:0/895811565 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fb488079730 con 0x7fb4980ae110 2023-12-19T13:55:33.272 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:55:33.272 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:55:23.075987+0000","modified":"2023-12-19T13:55:26.098528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8268":{"gid":8268,"name":"d","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1201018731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1201018731},{"type":"v1","addr":"172.21.15.151:6833","nonce":1201018731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T13:55:33.272 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 72 2023-12-19T13:55:33.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb48406a460 msgr2=0x7fb48406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb48406a460 0x7fb48406c920 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb4980ad220 tx=0x7fb48c008040 comp rx=0 tx=0).stop 2023-12-19T13:55:33.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4980ae110 msgr2=0x7fb498155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4980ae110 0x7fb498155450 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb4880097a0 tx=0x7fb4880046c0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 shutdown_connections 2023-12-19T13:55:33.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb48406a460 0x7fb48406c920 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb498157bf0 0x7fb4981512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4980b0640 0x7fb498156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.273+0000 7fb49e91b640 1 --2- 172.21.15.113:0/895811565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4980ae110 0x7fb498155450 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.274+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 >> 172.21.15.113:0/895811565 conn(0x7fb4980cbb70 msgr2=0x7fb49806df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:33.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.274+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 shutdown_connections 2023-12-19T13:55:33.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.274+0000 7fb49e91b640 1 -- 172.21.15.113:0/895811565 wait complete. 2023-12-19T13:55:33.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-19T13:55:33.537 INFO:teuthology.orchestra.run.smithi151.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":8268,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.440776263,"mdsmap_epoch":72,"osdmap_epoch":163,"osdmap_epoch_barrier":163,"uptime":15.74564151} 2023-12-19T13:55:33.537 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 8268, "mdsmap_epoch": 72, "osdmap_epoch": 163, "osdmap_epoch_barrier": 163, "rank_uptime": 10.440776263, "state": "up:active", "uptime": 15.74564151, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:55:33.538 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T13:55:33.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.766+0000 7f348180e640 1 Processor -- start 2023-12-19T13:55:33.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.767+0000 7f348180e640 1 -- start start 2023-12-19T13:55:33.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.768+0000 7f348180e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 0x7f347c0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.768+0000 7f348180e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347c06ddc0 con 0x7f347c06d950 2023-12-19T13:55:33.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.768+0000 7f348180e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347c0ce540 con 0x7f347c0c6960 2023-12-19T13:55:33.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.768+0000 7f348180e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0cfc40 con 0x7f347c0cd7e0 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f348100d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f347c06d950 0x7f347c0d0060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54958/0 (socket says 172.21.15.113:54958) 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f348100d640 1 -- 172.21.15.113:0/3448789163 learned_addr learned my addr 172.21.15.113:0/3448789163 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f348080c640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 0x7f347c0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784162748 0 0) 0x7f347c06ddc0 con 0x7f347c06d950 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3464003520 con 0x7f347c06d950 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644382230 0 0) 0x7f3464003520 con 0x7f347c06d950 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 msgr2=0x7f347c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 0x7f347c0cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 >> v1:172.21.15.151:6789/0 conn(0x7f347c0c6960 legacy=0x7f347c0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c15b670 con 0x7f347c06d950 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f34740019f0 con 0x7f347c06d950 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 >> v1:172.21.15.113:6789/0 conn(0x7f347c06d950 legacy=0x7f347c0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34640039a0 0x7f3464003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.769+0000 7f34737fe640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 0x7f34640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f34737fe640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3464004d00 0x7f3464005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0cfc40 con 0x7f3464004d00 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346400bc00 con 0x7f34640039a0 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346400bdc0 con 0x7f347c0cd7e0 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348100d640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3464004d00 0x7f3464005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348080c640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34640039a0 0x7f3464003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348100d640 1 -- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 msgr2=0x7f34640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f3473fff640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 0x7f34640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348100d640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 0x7f34640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348100d640 1 -- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34640039a0 msgr2=0x7f3464003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:55:33.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348100d640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34640039a0 0x7f3464003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348100d640 1 -- 172.21.15.113:0/3448789163 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464003520 con 0x7f3464004d00 2023-12-19T13:55:33.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f348080c640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34640039a0 0x7f3464003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:33.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.770+0000 7f3473fff640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c0cd7e0 0x7f34640047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:55:33.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.771+0000 7f348100d640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3464004d00 0x7f3464005180 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f347400a760 tx=0x7f34640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b273960cc1476 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:33.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474034630 con 0x7f3464004d00 2023-12-19T13:55:33.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347402f070 con 0x7f3464004d00 2023-12-19T13:55:33.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f34737fe640 1 -- 172.21.15.113:0/3448789163 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474034a10 con 0x7f3464004d00 2023-12-19T13:55:33.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f348180e640 1 -- 172.21.15.113:0/3448789163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3464004d00 msgr2=0x7f3464005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f348180e640 1 --2- 172.21.15.113:0/3448789163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3464004d00 0x7f3464005180 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f347400a760 tx=0x7f34640057f0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f348100d640 1 -- 172.21.15.113:0/3448789163 reap_dead start 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f348180e640 1 -- 172.21.15.113:0/3448789163 shutdown_connections 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f348180e640 1 -- 172.21.15.113:0/3448789163 >> 172.21.15.113:0/3448789163 conn(0x7f347c071370 msgr2=0x7f347c071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f348180e640 1 -- 172.21.15.113:0/3448789163 shutdown_connections 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.772+0000 7f348180e640 1 -- 172.21.15.113:0/3448789163 wait complete. 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.774+0000 7f348180e640 1 Processor -- start 2023-12-19T13:55:33.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.774+0000 7f348180e640 1 -- start start 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f348180e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3464004d00 0x7f347c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f348180e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f347c1e4a30 0x7f347c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f348180e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c15e650 0x7f347c158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f348180e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c15dc70 con 0x7f347c1e4a30 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f348180e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c15d6b0 con 0x7f3464004d00 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f348180e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c15d990 con 0x7f347c15e650 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f3473fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f347c1e4a30 0x7f347c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f3473fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f347c1e4a30 0x7f347c15e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49282/0 (socket says 172.21.15.113:49282) 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.775+0000 7f3473fff640 1 -- 172.21.15.113:0/767240374 learned_addr learned my addr 172.21.15.113:0/767240374 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f3473fff640 1 -- 172.21.15.113:0/767240374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c15e650 msgr2=0x7f347c158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f3473fff640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c15e650 0x7f347c158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f3473fff640 1 -- 172.21.15.113:0/767240374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3464004d00 msgr2=0x7f347c0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f3473fff640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3464004d00 0x7f347c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f3473fff640 1 -- 172.21.15.113:0/767240374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c0b00a0 con 0x7f347c1e4a30 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f3473fff640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f347c1e4a30 0x7f347c15e110 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f346c00d7a0 tx=0x7f346c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f34717fa640 1 -- 172.21.15.113:0/767240374 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c017070 con 0x7f347c1e4a30 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f34717fa640 1 -- 172.21.15.113:0/767240374 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c005070 con 0x7f347c1e4a30 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f34717fa640 1 -- 172.21.15.113:0/767240374 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c005420 con 0x7f347c1e4a30 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.776+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c0b0380 con 0x7f347c1e4a30 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.777+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c0b2700 con 0x7f347c1e4a30 2023-12-19T13:55:33.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.778+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c0d20b0 con 0x7f347c1e4a30 2023-12-19T13:55:33.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.779+0000 7f34717fa640 1 -- 172.21.15.113:0/767240374 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f346c007030 con 0x7f347c1e4a30 2023-12-19T13:55:33.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.780+0000 7f34717fa640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f346806a430 0x7f346806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:55:33.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.780+0000 7f34717fa640 1 -- 172.21.15.113:0/767240374 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f346c088170 con 0x7f347c1e4a30 2023-12-19T13:55:33.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.780+0000 7f348080c640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f346806a430 0x7f346806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:55:33.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.781+0000 7f348080c640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f346806a430 0x7f346806c8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3478006fd0 tx=0x7f3478009350 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:55:33.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.785+0000 7f34717fa640 1 -- 172.21.15.113:0/767240374 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f346c053750 con 0x7f347c1e4a30 2023-12-19T13:55:33.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:33.977+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f347c061910 con 0x7f347c1e4a30 2023-12-19T13:55:34.656 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.656+0000 7f34717fa640 1 -- 172.21.15.113:0/767240374 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v164) v1 ==== 181+0+0 (secure 0 0 0) 0x7f346c056d70 con 0x7f347c1e4a30 2023-12-19T13:55:34.656 INFO:teuthology.orchestra.run.smithi113.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T13:55:34.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f346806a430 msgr2=0x7f346806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:34.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f346806a430 0x7f346806c8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3478006fd0 tx=0x7f3478009350 comp rx=0 tx=0).stop 2023-12-19T13:55:34.659 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f347c1e4a30 msgr2=0x7f347c15e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:55:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f347c1e4a30 0x7f347c15e110 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f346c00d7a0 tx=0x7f346c00dc60 comp rx=0 tx=0).stop 2023-12-19T13:55:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 shutdown_connections 2023-12-19T13:55:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f346806a430 0x7f346806c8f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f347c15e650 0x7f347c158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f347c1e4a30 0x7f347c15e110 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 --2- 172.21.15.113:0/767240374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3464004d00 0x7f347c0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:55:34.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.659+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 >> 172.21.15.113:0/767240374 conn(0x7f347c071370 msgr2=0x7f347c15acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:55:34.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.660+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 shutdown_connections 2023-12-19T13:55:34.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:55:34.660+0000 7f348180e640 1 -- 172.21.15.113:0/767240374 wait complete. 2023-12-19T13:55:34.681 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:55:34.894 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:55:34.894 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:55:34.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T13:55:35.121 INFO:teuthology.orchestra.run.smithi113.stdout:{"mon_tick_interval":"5"} 2023-12-19T13:55:35.122 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T13:55:35.122 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-19T13:55:35.122 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:55:35.122 DEBUG:teuthology.orchestra.run.smithi113:> import time 2023-12-19T13:55:35.122 DEBUG:teuthology.orchestra.run.smithi113:> import datetime 2023-12-19T13:55:35.122 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2023-12-19T13:55:35.122 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> # Write some buffered data through before going full, all should be well 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> print("writing some data through which we expect to succeed") 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> bytes = 0 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T13:55:35.123 DEBUG:teuthology.orchestra.run.smithi113:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> # from write 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> full = False 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> for n in range(0, int(32 * 0.9)): 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> print("done writing {0} bytes".format(bytes)) 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> # OK, now we should sneak in under the full condition 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> # due to the time it takes the OSDs to report to the 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> # mons, and get a successful fsync on our full-making data 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:55:35.124 DEBUG:teuthology.orchestra.run.smithi113:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> # buffered write, add more dirty data to the buffer 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> print("starting buffered write") 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> for n in range(0, int(32 * 0.2)): 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> time.sleep(15.0) 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> except OSError: 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> pass; 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.125 DEBUG:teuthology.orchestra.run.smithi113:> # Wait long enough for a background flush that should fail 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> time.sleep(30) 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> if False: 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> # ...and check that the failed background flush is reflected in fclose 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> os.close(f) 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> except OSError: 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> print("close() returned an error as expected") 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("close() failed to raise error") 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> # The kernel cephfs client does not raise errors on fclose 2023-12-19T13:55:35.126 DEBUG:teuthology.orchestra.run.smithi113:> os.close(f) 2023-12-19T13:55:35.127 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:55:35.127 DEBUG:teuthology.orchestra.run.smithi113:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T13:55:35.127 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:55:49.927 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:49.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:20.177 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:20.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:50.338 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:50.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:20.503 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:20.513 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:38.106 INFO:teuthology.orchestra.run.smithi113.stdout:writing some data through which we expect to succeed 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-19T13:57:38.107 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-19T13:57:38.108 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:done writing 29884416 bytes 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:successfully fsync'ed prior to getting full state reported 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:starting buffered write 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:57:38.109 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:57:38.110 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:57:38.110 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:57:38.110 INFO:teuthology.orchestra.run.smithi113.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-19T13:57:38.246 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:57:38.246 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:57:38.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:57:38.491 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:57:38.491 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:57:38.491 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:38.552 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:57:38.552 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:38.606 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:57:38.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.820+0000 7fec767c4640 1 Processor -- start 2023-12-19T13:57:38.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.820+0000 7fec767c4640 1 -- start start 2023-12-19T13:57:38.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.821+0000 7fec767c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700b0c90 0x7fec7015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.821+0000 7fec767c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec700add90 0x7fec700b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.821+0000 7fec767c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fec700ce710 0x7fec7006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.821+0000 7fec767c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7006e370 con 0x7fec700add90 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.821+0000 7fec767c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec70157c40 con 0x7fec700ce710 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.821+0000 7fec767c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec700ce280 con 0x7fec700b0c90 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec700add90 0x7fec700b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec700add90 0x7fec700b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39632/0 (socket says 172.21.15.113:39632) 2023-12-19T13:57:38.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 -- 172.21.15.113:0/1934114710 learned_addr learned my addr 172.21.15.113:0/1934114710 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec75fc3640 1 --2- 172.21.15.113:0/1934114710 >> v2:172.21.15.151:3300/0 conn(0x7fec700ce710 0x7fec7006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 -- 172.21.15.113:0/1934114710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700b0c90 msgr2=0x7fec7015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec757c2640 1 --2- 172.21.15.113:0/1934114710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700b0c90 0x7fec7015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 --2- 172.21.15.113:0/1934114710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700b0c90 0x7fec7015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 -- 172.21.15.113:0/1934114710 >> v2:172.21.15.151:3300/0 conn(0x7fec700ce710 msgr2=0x7fec7006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 --2- 172.21.15.113:0/1934114710 >> v2:172.21.15.151:3300/0 conn(0x7fec700ce710 0x7fec7006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec74fc1640 1 -- 172.21.15.113:0/1934114710 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700cd990 con 0x7fec700add90 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec757c2640 1 --2- 172.21.15.113:0/1934114710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700b0c90 0x7fec7015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:38.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.822+0000 7fec75fc3640 1 --2- 172.21.15.113:0/1934114710 >> v2:172.21.15.151:3300/0 conn(0x7fec700ce710 0x7fec7006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:38.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.823+0000 7fec74fc1640 1 --2- 172.21.15.113:0/1934114710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700add90 0x7fec700b1070 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fec7006c6d0 tx=0x7fec6002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70bc0bd6d09783a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec67fff640 1 -- 172.21.15.113:0/1934114710 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60031860 con 0x7fec700add90 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec67fff640 1 -- 172.21.15.113:0/1934114710 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600319c0 con 0x7fec700add90 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec67fff640 1 -- 172.21.15.113:0/1934114710 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60031d50 con 0x7fec700add90 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 -- 172.21.15.113:0/1934114710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700add90 msgr2=0x7fec700b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 --2- 172.21.15.113:0/1934114710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700add90 0x7fec700b1070 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fec7006c6d0 tx=0x7fec6002b900 comp rx=0 tx=0).stop 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 -- 172.21.15.113:0/1934114710 shutdown_connections 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 --2- 172.21.15.113:0/1934114710 >> v2:172.21.15.151:3300/0 conn(0x7fec700ce710 0x7fec7006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 --2- 172.21.15.113:0/1934114710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700add90 0x7fec700b1070 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 --2- 172.21.15.113:0/1934114710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700b0c90 0x7fec7015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 -- 172.21.15.113:0/1934114710 >> 172.21.15.113:0/1934114710 conn(0x7fec700cc3f0 msgr2=0x7fec700cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 -- 172.21.15.113:0/1934114710 shutdown_connections 2023-12-19T13:57:38.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.824+0000 7fec767c4640 1 -- 172.21.15.113:0/1934114710 wait complete. 2023-12-19T13:57:38.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.826+0000 7fec767c4640 1 Processor -- start 2023-12-19T13:57:38.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.826+0000 7fec767c4640 1 -- start start 2023-12-19T13:57:38.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec767c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec700add90 0x7fec70159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:38.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec767c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700b0c90 0x7fec70149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:38.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec767c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700ce710 0x7fec7015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:38.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec767c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70149740 con 0x7fec700b0c90 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec767c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70156740 con 0x7fec700add90 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec767c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7015acc0 con 0x7fec700ce710 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec74fc1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700b0c90 0x7fec70149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec74fc1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700b0c90 0x7fec70149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39640/0 (socket says 172.21.15.113:39640) 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.827+0000 7fec74fc1640 1 -- 172.21.15.113:0/3344204240 learned_addr learned my addr 172.21.15.113:0/3344204240 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec74fc1640 1 -- 172.21.15.113:0/3344204240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700ce710 msgr2=0x7fec7015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec757c2640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec700add90 0x7fec70159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec74fc1640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700ce710 0x7fec7015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec74fc1640 1 -- 172.21.15.113:0/3344204240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec700add90 msgr2=0x7fec70159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec74fc1640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec700add90 0x7fec70159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec74fc1640 1 -- 172.21.15.113:0/3344204240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600094d0 con 0x7fec700b0c90 2023-12-19T13:57:38.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec74fc1640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700b0c90 0x7fec70149200 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fec6002b940 tx=0x7fec600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:38.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60031850 con 0x7fec700b0c90 2023-12-19T13:57:38.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600443f0 con 0x7fec700b0c90 2023-12-19T13:57:38.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.828+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600447a0 con 0x7fec700b0c90 2023-12-19T13:57:38.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.829+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec701582b0 con 0x7fec700b0c90 2023-12-19T13:57:38.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.829+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70158870 con 0x7fec700b0c90 2023-12-19T13:57:38.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.830+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec700ae1b0 con 0x7fec700b0c90 2023-12-19T13:57:38.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.831+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fec6004d450 con 0x7fec700b0c90 2023-12-19T13:57:38.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.831+0000 7fec65ffb640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec5406a430 0x7fec5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:38.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.831+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec600ab100 con 0x7fec700b0c90 2023-12-19T13:57:38.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.832+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fec54071f60 con 0x7fec700b0c90 2023-12-19T13:57:38.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.832+0000 7fec757c2640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec5406a430 0x7fec5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:38.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.832+0000 7fec757c2640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec5406a430 0x7fec5406c8f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fec700b1160 tx=0x7fec6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:38.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:38.836+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fec60076650 con 0x7fec700b0c90 2023-12-19T13:57:39.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.031+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec70061910 con 0x7fec700b0c90 2023-12-19T13:57:39.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.033+0000 7fec65ffb640 1 -- 172.21.15.113:0/3344204240 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16134 (secure 0 0 0) 0x7fec60035030 con 0x7fec700b0c90 2023-12-19T13:57:39.032 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:39.033 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":165,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:56:58.643456+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.035+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec5406a430 msgr2=0x7fec5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.035+0000 7fec767c4640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec5406a430 0x7fec5406c8f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fec700b1160 tx=0x7fec6c008040 comp rx=0 tx=0).stop 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.035+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700b0c90 msgr2=0x7fec70149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.035+0000 7fec767c4640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700b0c90 0x7fec70149200 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fec6002b940 tx=0x7fec600046c0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 shutdown_connections 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fec5406a430 0x7fec5406c8f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec700ce710 0x7fec7015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec700b0c90 0x7fec70149200 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 --2- 172.21.15.113:0/3344204240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec700add90 0x7fec70159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 >> 172.21.15.113:0/3344204240 conn(0x7fec700cc3f0 msgr2=0x7fec7015cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 shutdown_connections 2023-12-19T13:57:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.036+0000 7fec767c4640 1 -- 172.21.15.113:0/3344204240 wait complete. 2023-12-19T13:57:39.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:55:21.110175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:55:22.094456+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:57:39.055 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:57:39.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.265+0000 7f5e2cb15640 1 Processor -- start 2023-12-19T13:57:39.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.265+0000 7f5e2cb15640 1 -- start start 2023-12-19T13:57:39.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e2cb15640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e2806f8f0 0x7f5e280d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e2cb15640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e28070260 con 0x7f5e28146cd0 2023-12-19T13:57:39.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e2cb15640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e280b6ea0 con 0x7f5e2806f490 2023-12-19T13:57:39.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e2cb15640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281470b0 con 0x7f5e2806f8f0 2023-12-19T13:57:39.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e277fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5e28146cd0 0x7f5e280b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37214/0 (socket says 172.21.15.113:37214) 2023-12-19T13:57:39.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e277fe640 1 -- 172.21.15.113:0/3070926261 learned_addr learned my addr 172.21.15.113:0/3070926261 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e27fff640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e2806f8f0 0x7f5e280d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295177524 0 0) 0x7f5e28070260 con 0x7f5e28146cd0 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.267+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e14003520 con 0x7f5e28146cd0 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821505962 0 0) 0x7f5e14003520 con 0x7f5e28146cd0 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e2806f8f0 msgr2=0x7f5e280d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e2806f8f0 0x7f5e280d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 >> v1:172.21.15.151:6789/0 conn(0x7f5e2806f490 legacy=0x7f5e280d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e280b7180 con 0x7f5e28146cd0 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f5e180019f0 con 0x7f5e28146cd0 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 >> v1:172.21.15.113:6789/0 conn(0x7f5e28146cd0 legacy=0x7f5e280b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140039a0 0x7f5e14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140047c0 0x7f5e14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e2806f8f0 0x7f5e14005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281470b0 con 0x7f5e140039a0 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1400bb40 con 0x7f5e140047c0 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1400bd00 con 0x7f5e2806f8f0 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e277fe640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140039a0 0x7f5e14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.268+0000 7f5e26ffd640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140047c0 0x7f5e14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.269+0000 7f5e277fe640 1 -- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e2806f8f0 msgr2=0x7f5e14005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.269+0000 7f5e277fe640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e2806f8f0 0x7f5e14005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.269+0000 7f5e277fe640 1 -- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140047c0 msgr2=0x7f5e14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.269+0000 7f5e277fe640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140047c0 0x7f5e14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.269+0000 7f5e277fe640 1 -- 172.21.15.113:0/3070926261 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14003520 con 0x7f5e140039a0 2023-12-19T13:57:39.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.269+0000 7f5e26ffd640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e140047c0 0x7f5e14004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e277fe640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140039a0 0x7f5e14003dc0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800a760 tx=0x7f5e140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0edb236a6f354e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18034630 con 0x7f5e140039a0 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1802f070 con 0x7f5e140039a0 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e267fc640 1 -- 172.21.15.113:0/3070926261 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e180349d0 con 0x7f5e140039a0 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3070926261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140039a0 msgr2=0x7f5e14003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e2cb15640 1 --2- 172.21.15.113:0/3070926261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e140039a0 0x7f5e14003dc0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800a760 tx=0x7f5e140057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e27fff640 1 -- 172.21.15.113:0/3070926261 reap_dead start 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3070926261 shutdown_connections 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.270+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3070926261 >> 172.21.15.113:0/3070926261 conn(0x7f5e280d3200 msgr2=0x7f5e280d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.271+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3070926261 shutdown_connections 2023-12-19T13:57:39.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.271+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3070926261 wait complete. 2023-12-19T13:57:39.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.272+0000 7f5e2cb15640 1 Processor -- start 2023-12-19T13:57:39.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.272+0000 7f5e2cb15640 1 -- start start 2023-12-19T13:57:39.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.273+0000 7f5e2cb15640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e140039a0 0x7f5e28130ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.273+0000 7f5e2cb15640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e281f5d30 0x7f5e28142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.273+0000 7f5e2cb15640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e28142740 0x7f5e281f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.273+0000 7f5e2cb15640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28157940 con 0x7f5e281f5d30 2023-12-19T13:57:39.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.273+0000 7f5e2cb15640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28156cc0 con 0x7f5e28142740 2023-12-19T13:57:39.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.273+0000 7f5e2cb15640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28156fa0 con 0x7f5e140039a0 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e281f5d30 0x7f5e28142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e281f5d30 0x7f5e28142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39660/0 (socket says 172.21.15.113:39660) 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 -- 172.21.15.113:0/3464487556 learned_addr learned my addr 172.21.15.113:0/3464487556 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e27fff640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e28142740 0x7f5e281f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 -- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e140039a0 msgr2=0x7f5e28130ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e277fe640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e140039a0 0x7f5e28130ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e140039a0 0x7f5e28130ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 -- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e28142740 msgr2=0x7f5e281f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e28142740 0x7f5e281f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 -- 172.21.15.113:0/3464487556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28157280 con 0x7f5e281f5d30 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e27fff640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e28142740 0x7f5e281f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:39.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.274+0000 7f5e26ffd640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e281f5d30 0x7f5e28142200 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000d770 tx=0x7f5e1000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:39.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.275+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10005270 con 0x7f5e281f5d30 2023-12-19T13:57:39.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.275+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e100053d0 con 0x7f5e281f5d30 2023-12-19T13:57:39.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.275+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000b8d0 con 0x7f5e281f5d30 2023-12-19T13:57:39.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.275+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e28157560 con 0x7f5e281f5d30 2023-12-19T13:57:39.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.275+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e28159870 con 0x7f5e281f5d30 2023-12-19T13:57:39.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.276+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e28061910 con 0x7f5e281f5d30 2023-12-19T13:57:39.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.277+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e1000ba30 con 0x7f5e281f5d30 2023-12-19T13:57:39.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.278+0000 7f5e1ffff640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0806a430 0x7f5e0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.278+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e100887f0 con 0x7f5e281f5d30 2023-12-19T13:57:39.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.278+0000 7f5e277fe640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0806a430 0x7f5e0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.278+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f5e08071f60 con 0x7f5e281f5d30 2023-12-19T13:57:39.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.279+0000 7f5e277fe640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0806a430 0x7f5e0806c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5e18034000 tx=0x7f5e1802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:39.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.282+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e10053e70 con 0x7f5e281f5d30 2023-12-19T13:57:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.471+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e2815cd00 con 0x7f5e281f5d30 2023-12-19T13:57:39.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.472+0000 7f5e1ffff640 1 -- 172.21.15.113:0/3464487556 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e10057490 con 0x7f5e281f5d30 2023-12-19T13:57:39.471 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:57:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0806a430 msgr2=0x7f5e0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0806a430 0x7f5e0806c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5e18034000 tx=0x7f5e1802f000 comp rx=0 tx=0).stop 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e281f5d30 msgr2=0x7f5e28142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e281f5d30 0x7f5e28142200 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000d770 tx=0x7f5e1000dc30 comp rx=0 tx=0).stop 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 shutdown_connections 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5e0806a430 0x7f5e0806c8f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e28142740 0x7f5e281f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e281f5d30 0x7f5e28142200 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 --2- 172.21.15.113:0/3464487556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e140039a0 0x7f5e28130ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 >> 172.21.15.113:0/3464487556 conn(0x7f5e280d3200 msgr2=0x7f5e28143490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 shutdown_connections 2023-12-19T13:57:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.474+0000 7f5e2cb15640 1 -- 172.21.15.113:0/3464487556 wait complete. 2023-12-19T13:57:39.492 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:57:39.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.697+0000 7f006a40b640 1 Processor -- start 2023-12-19T13:57:39.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.697+0000 7f006a40b640 1 -- start start 2023-12-19T13:57:39.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f006a40b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064146e10 0x7f00640d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f006a40b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00640d2b00 0x7f00640b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f006a40b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640cd840 con 0x7f00640ce110 2023-12-19T13:57:39.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f006a40b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640d2430 con 0x7f00640d2b00 2023-12-19T13:57:39.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f006a40b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640d2620 con 0x7f0064146e10 2023-12-19T13:57:39.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f005bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00640d2b00 0x7f00640b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f005bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00640d2b00 0x7f00640b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39662/0 (socket says 172.21.15.113:39662) 2023-12-19T13:57:39.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.699+0000 7f005bfff640 1 -- 172.21.15.113:0/3167595973 learned_addr learned my addr 172.21.15.113:0/3167595973 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:39.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.700+0000 7f0063fff640 1 --2- 172.21.15.113:0/3167595973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064146e10 0x7f00640d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.700+0000 7f005bfff640 1 -- 172.21.15.113:0/3167595973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064146e10 msgr2=0x7f00640d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:39.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.700+0000 7f005bfff640 1 --2- 172.21.15.113:0/3167595973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064146e10 0x7f00640d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.700+0000 7f005bfff640 1 -- 172.21.15.113:0/3167595973 >> v1:172.21.15.113:6789/0 conn(0x7f00640ce110 legacy=0x7f00640b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.700+0000 7f005bfff640 1 -- 172.21.15.113:0/3167595973 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640b41c0 con 0x7f00640d2b00 2023-12-19T13:57:39.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.700+0000 7f00637fe640 1 -- 172.21.15.113:0/3167595973 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046840826 0 0) 0x7f00640cd840 con 0x7f00640ce110 2023-12-19T13:57:39.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.701+0000 7f005bfff640 1 --2- 172.21.15.113:0/3167595973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f00640b6780 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f004c009870 tx=0x7f004c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cf7fc1245c5528 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:39.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.701+0000 7f00637fe640 1 -- 172.21.15.113:0/3167595973 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c030840 con 0x7f00640d2b00 2023-12-19T13:57:39.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.701+0000 7f00637fe640 1 -- 172.21.15.113:0/3167595973 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c0309a0 con 0x7f00640d2b00 2023-12-19T13:57:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.701+0000 7f00637fe640 1 -- 172.21.15.113:0/3167595973 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c030d30 con 0x7f00640d2b00 2023-12-19T13:57:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 -- 172.21.15.113:0/3167595973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 msgr2=0x7f00640b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 --2- 172.21.15.113:0/3167595973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f00640b6780 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f004c009870 tx=0x7f004c02b980 comp rx=0 tx=0).stop 2023-12-19T13:57:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 -- 172.21.15.113:0/3167595973 shutdown_connections 2023-12-19T13:57:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 --2- 172.21.15.113:0/3167595973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f00640b6780 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 --2- 172.21.15.113:0/3167595973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064146e10 0x7f00640d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 -- 172.21.15.113:0/3167595973 >> 172.21.15.113:0/3167595973 conn(0x7f00640b29c0 msgr2=0x7f00640b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 -- 172.21.15.113:0/3167595973 shutdown_connections 2023-12-19T13:57:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.702+0000 7f006a40b640 1 -- 172.21.15.113:0/3167595973 wait complete. 2023-12-19T13:57:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.704+0000 7f006a40b640 1 Processor -- start 2023-12-19T13:57:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.704+0000 7f006a40b640 1 -- start start 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f006a40b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00640ce110 0x7f006413d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f006a40b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f0064141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f006a40b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0064146e10 0x7f0064142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f006a40b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006413ef60 con 0x7f00640d2b00 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f006a40b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00641440b0 con 0x7f0064146e10 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f006a40b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006413e350 con 0x7f00640ce110 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f005bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f0064141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f005bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f0064141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39678/0 (socket says 172.21.15.113:39678) 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.705+0000 7f005bfff640 1 -- 172.21.15.113:0/3010537134 learned_addr learned my addr 172.21.15.113:0/3010537134 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f0063fff640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00640ce110 0x7f006413d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f005bfff640 1 -- 172.21.15.113:0/3010537134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00640ce110 msgr2=0x7f006413d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f005bfff640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00640ce110 0x7f006413d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f005bfff640 1 -- 172.21.15.113:0/3010537134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0064146e10 msgr2=0x7f0064142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f005bfff640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0064146e10 0x7f0064142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f005bfff640 1 -- 172.21.15.113:0/3010537134 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0094d0 con 0x7f00640d2b00 2023-12-19T13:57:39.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f005bfff640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f0064141ec0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c039c90 con 0x7f00640d2b00 2023-12-19T13:57:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c039df0 con 0x7f00640d2b00 2023-12-19T13:57:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c043640 con 0x7f00640d2b00 2023-12-19T13:57:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.706+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006413e630 con 0x7f00640d2b00 2023-12-19T13:57:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.707+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006413ebf0 con 0x7f00640d2b00 2023-12-19T13:57:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.708+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006413f0d0 con 0x7f00640d2b00 2023-12-19T13:57:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.709+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f004c0437a0 con 0x7f00640d2b00 2023-12-19T13:57:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.710+0000 7f00617fa640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004406a460 0x7f004406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.710+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f004c03e070 con 0x7f00640d2b00 2023-12-19T13:57:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.710+0000 7f0063fff640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004406a460 0x7f004406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.710+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f0044071f90 con 0x7f00640d2b00 2023-12-19T13:57:39.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.711+0000 7f0063fff640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004406a460 0x7f004406c920 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0054006fd0 tx=0x7f0054008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.715+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f004c034060 con 0x7f00640d2b00 2023-12-19T13:57:39.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.906+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0064061910 con 0x7f00640d2b00 2023-12-19T13:57:39.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.907+0000 7f00617fa640 1 -- 172.21.15.113:0/3010537134 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v165) v1 ==== 104+0+11 (secure 0 0 0) 0x7f004c034070 con 0x7f00640d2b00 2023-12-19T13:57:39.906 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:57:39.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004406a460 msgr2=0x7f004406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004406a460 0x7f004406c920 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0054006fd0 tx=0x7f0054008040 comp rx=0 tx=0).stop 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 msgr2=0x7f0064141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f0064141ec0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c004730 comp rx=0 tx=0).stop 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 shutdown_connections 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004406a460 0x7f004406c920 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0064146e10 0x7f0064142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00640d2b00 0x7f0064141ec0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 --2- 172.21.15.113:0/3010537134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00640ce110 0x7f006413d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.909+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 >> 172.21.15.113:0/3010537134 conn(0x7f00640b29c0 msgr2=0x7f006415ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.910+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 shutdown_connections 2023-12-19T13:57:39.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:39.910+0000 7f006a40b640 1 -- 172.21.15.113:0/3010537134 wait complete. 2023-12-19T13:57:39.926 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:57:40.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.134+0000 7effb62ec640 1 Processor -- start 2023-12-19T13:57:40.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.134+0000 7effb62ec640 1 -- start start 2023-12-19T13:57:40.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.135+0000 7effb62ec640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7effb00b0070 0x7effb00b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.135+0000 7effb62ec640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb00ccbd0 con 0x7effb0154760 2023-12-19T13:57:40.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.135+0000 7effb62ec640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0154b40 con 0x7effb015b290 2023-12-19T13:57:40.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.135+0000 7effb62ec640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00ccf20 con 0x7effb00b0070 2023-12-19T13:57:40.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.135+0000 7effaffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7effb0154760 0x7effb00cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37232/0 (socket says 172.21.15.113:37232) 2023-12-19T13:57:40.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.135+0000 7effaffff640 1 -- 172.21.15.113:0/3974785559 learned_addr learned my addr 172.21.15.113:0/3974785559 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effb4889640 1 --2- 172.21.15.113:0/3974785559 >> v2:172.21.15.151:3300/0 conn(0x7effb00b0070 0x7effb00b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545943052 0 0) 0x7effb00ccbd0 con 0x7effb0154760 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff9c003520 con 0x7effb0154760 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311143408 0 0) 0x7eff9c003520 con 0x7effb0154760 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 >> v2:172.21.15.151:3300/0 conn(0x7effb00b0070 msgr2=0x7effb00b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 --2- 172.21.15.113:0/3974785559 >> v2:172.21.15.151:3300/0 conn(0x7effb00b0070 0x7effb00b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 >> v1:172.21.15.151:6789/0 conn(0x7effb015b290 legacy=0x7effb00b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00cc060 con 0x7effb0154760 2023-12-19T13:57:40.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7effa0001670 con 0x7effb0154760 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 >> v1:172.21.15.113:6789/0 conn(0x7effb0154760 legacy=0x7effb00cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff9c003a30 0x7eff9c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0047c0 0x7eff9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff9c0052a0 0x7eff9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00ccf20 con 0x7eff9c0052a0 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c00c170 con 0x7eff9c0047c0 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.136+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c00c330 con 0x7eff9c003a30 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effb4889640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff9c0052a0 0x7eff9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effaffff640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff9c003a30 0x7eff9c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effa7fff640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0047c0 0x7eff9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effb4889640 1 -- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff9c003a30 msgr2=0x7eff9c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effb4889640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff9c003a30 0x7eff9c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effb4889640 1 -- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0047c0 msgr2=0x7eff9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effb4889640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0047c0 0x7eff9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effb4889640 1 -- 172.21.15.113:0/3974785559 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c003520 con 0x7eff9c0052a0 2023-12-19T13:57:40.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.137+0000 7effa7fff640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0047c0 0x7eff9c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:40.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.138+0000 7effb4889640 1 -- 172.21.15.113:0/3974785559 reap_dead start 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.138+0000 7effb4889640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff9c0052a0 0x7eff9c00b980 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7effa8009fc0 tx=0x7eff9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4087ebf8350e7a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.138+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa802cc60 con 0x7eff9c0052a0 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800f040 con 0x7eff9c0052a0 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effaf7fe640 1 -- 172.21.15.113:0/3974785559 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8003990 con 0x7eff9c0052a0 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effb62ec640 1 -- 172.21.15.113:0/3974785559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff9c0052a0 msgr2=0x7eff9c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effb62ec640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff9c0052a0 0x7eff9c00b980 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7effa8009fc0 tx=0x7eff9c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effb62ec640 1 -- 172.21.15.113:0/3974785559 shutdown_connections 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effb62ec640 1 --2- 172.21.15.113:0/3974785559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff9c0052a0 0x7eff9c00b980 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effb62ec640 1 -- 172.21.15.113:0/3974785559 >> 172.21.15.113:0/3974785559 conn(0x7effb0073150 msgr2=0x7effb00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:40.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effb62ec640 1 -- 172.21.15.113:0/3974785559 shutdown_connections 2023-12-19T13:57:40.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.139+0000 7effb62ec640 1 -- 172.21.15.113:0/3974785559 wait complete. 2023-12-19T13:57:40.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.141+0000 7effb62ec640 1 Processor -- start 2023-12-19T13:57:40.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.141+0000 7effb62ec640 1 -- start start 2023-12-19T13:57:40.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effb62ec640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0052a0 0x7effb0158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effb62ec640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effb0159a10 0x7effb00b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effb62ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effb01568d0 0x7effb01460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effb62ec640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00b0a60 con 0x7effb0159a10 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effb62ec640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb01f1e50 con 0x7eff9c0052a0 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effb62ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb01507a0 con 0x7effb01568d0 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effa7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effb0159a10 0x7effb00b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effa7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effb0159a10 0x7effb00b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39706/0 (socket says 172.21.15.113:39706) 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.142+0000 7effa7fff640 1 -- 172.21.15.113:0/1401666256 learned_addr learned my addr 172.21.15.113:0/1401666256 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effa7fff640 1 -- 172.21.15.113:0/1401666256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effb01568d0 msgr2=0x7effb01460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effa7fff640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effb01568d0 0x7effb01460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effa7fff640 1 -- 172.21.15.113:0/1401666256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0052a0 msgr2=0x7effb0158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effaffff640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0052a0 0x7effb0158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effa7fff640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0052a0 0x7effb0158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effa7fff640 1 -- 172.21.15.113:0/1401666256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0150a40 con 0x7effb0159a10 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effa7fff640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effb0159a10 0x7effb00b1480 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d540 tx=0x7eff9800da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98005480 con 0x7effb0159a10 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff98003610 con 0x7effb0159a10 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980039c0 con 0x7effb0159a10 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb0150d20 con 0x7effb0159a10 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.143+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb015a180 con 0x7effb0159a10 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.145+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb0061910 con 0x7effb0159a10 2023-12-19T13:57:40.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.145+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7eff98003b20 con 0x7effb0159a10 2023-12-19T13:57:40.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.146+0000 7effad7fa640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff9006a420 0x7eff9006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.146+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff980887b0 con 0x7effb0159a10 2023-12-19T13:57:40.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.146+0000 7effaffff640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff9006a420 0x7eff9006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.147+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7eff90071f50 con 0x7effb0159a10 2023-12-19T13:57:40.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.147+0000 7effaffff640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff9006a420 0x7eff9006c8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7effa0001650 tx=0x7effa0000f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:40.149 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.151+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7eff98053e30 con 0x7effb0159a10 2023-12-19T13:57:40.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.323+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effb00cbd80 con 0x7effb0159a10 2023-12-19T13:57:40.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.324+0000 7effad7fa640 1 -- 172.21.15.113:0/1401666256 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v165) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff98001230 con 0x7effb0159a10 2023-12-19T13:57:40.323 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:57:40.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff9006a420 msgr2=0x7eff9006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff9006a420 0x7eff9006c8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7effa0001650 tx=0x7effa0000f30 comp rx=0 tx=0).stop 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effb0159a10 msgr2=0x7effb00b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effb0159a10 0x7effb00b1480 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d540 tx=0x7eff9800da00 comp rx=0 tx=0).stop 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 shutdown_connections 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7eff9006a420 0x7eff9006c8e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effb01568d0 0x7effb01460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effb0159a10 0x7effb00b1480 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 --2- 172.21.15.113:0/1401666256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff9c0052a0 0x7effb0158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.326+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 >> 172.21.15.113:0/1401666256 conn(0x7effb0073150 msgr2=0x7effb01515a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.327+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 shutdown_connections 2023-12-19T13:57:40.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.327+0000 7effb62ec640 1 -- 172.21.15.113:0/1401666256 wait complete. 2023-12-19T13:57:40.343 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:57:40.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.548+0000 7f7dd8ae5640 1 Processor -- start 2023-12-19T13:57:40.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.549+0000 7f7dd8ae5640 1 -- start start 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.550+0000 7f7dd8ae5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7dd40b1710 0x7f7dd406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.550+0000 7f7dd8ae5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd415e040 0x7f7dd415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.550+0000 7f7dd8ae5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd415e9f0 con 0x7f7dd4157aa0 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.550+0000 7f7dd8ae5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40b2600 con 0x7f7dd415e040 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.550+0000 7f7dd8ae5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40b1d60 con 0x7f7dd40b1710 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.550+0000 7f7dd2d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd415e040 0x7f7dd415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.551+0000 7f7dd2d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7dd415e040 0x7f7dd415e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39718/0 (socket says 172.21.15.113:39718) 2023-12-19T13:57:40.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.551+0000 7f7dd2d9d640 1 -- 172.21.15.113:0/3251556565 learned_addr learned my addr 172.21.15.113:0/3251556565 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:40.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.551+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/3251556565 >> v2:172.21.15.151:3300/0 conn(0x7f7dd40b1710 0x7f7dd406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.551+0000 7f7dd2d9d640 1 -- 172.21.15.113:0/3251556565 >> v2:172.21.15.151:3300/0 conn(0x7f7dd40b1710 msgr2=0x7f7dd406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:40.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.551+0000 7f7dd2d9d640 1 --2- 172.21.15.113:0/3251556565 >> v2:172.21.15.151:3300/0 conn(0x7f7dd40b1710 0x7f7dd406e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.551+0000 7f7dd2d9d640 1 -- 172.21.15.113:0/3251556565 >> v1:172.21.15.151:6789/0 conn(0x7f7dd4157aa0 legacy=0x7f7dd4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:40.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.551+0000 7f7dd2d9d640 1 -- 172.21.15.113:0/3251556565 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40b2040 con 0x7f7dd415e040 2023-12-19T13:57:40.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.552+0000 7f7dd2d9d640 1 --2- 172.21.15.113:0/3251556565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd415e040 0x7f7dd415e4b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40cc960 tx=0x7f7dcc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1778450b57d847 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:40.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.552+0000 7f7dd1d9b640 1 -- 172.21.15.113:0/3251556565 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc02ca70 con 0x7f7dd415e040 2023-12-19T13:57:40.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.552+0000 7f7dd1d9b640 1 -- 172.21.15.113:0/3251556565 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc02cbd0 con 0x7f7dd415e040 2023-12-19T13:57:40.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.552+0000 7f7dd1d9b640 1 -- 172.21.15.113:0/3251556565 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0343f0 con 0x7f7dd415e040 2023-12-19T13:57:40.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/3251556565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd415e040 msgr2=0x7f7dd415e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/3251556565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd415e040 0x7f7dd415e4b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40cc960 tx=0x7f7dcc02bed0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/3251556565 shutdown_connections 2023-12-19T13:57:40.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/3251556565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd415e040 0x7f7dd415e4b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/3251556565 >> v2:172.21.15.151:3300/0 conn(0x7f7dd40b1710 0x7f7dd406e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/3251556565 >> 172.21.15.113:0/3251556565 conn(0x7f7dd40cbb70 msgr2=0x7f7dd40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:40.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/3251556565 shutdown_connections 2023-12-19T13:57:40.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.553+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/3251556565 wait complete. 2023-12-19T13:57:40.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.555+0000 7f7dd8ae5640 1 Processor -- start 2023-12-19T13:57:40.554 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.555+0000 7f7dd8ae5640 1 -- start start 2023-12-19T13:57:40.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd8ae5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b1710 0x7f7dd4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd8ae5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157aa0 0x7f7dd406c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd8ae5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd415e040 0x7f7dd41e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd8ae5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415f900 con 0x7f7dd40b1710 2023-12-19T13:57:40.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd8ae5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415fbe0 con 0x7f7dd415e040 2023-12-19T13:57:40.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd8ae5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415fec0 con 0x7f7dd4157aa0 2023-12-19T13:57:40.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b1710 0x7f7dd4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b1710 0x7f7dd4152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39722/0 (socket says 172.21.15.113:39722) 2023-12-19T13:57:40.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.556+0000 7f7dd259c640 1 -- 172.21.15.113:0/1428902414 learned_addr learned my addr 172.21.15.113:0/1428902414 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd259c640 1 -- 172.21.15.113:0/1428902414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157aa0 msgr2=0x7f7dd406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157aa0 0x7f7dd406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd259c640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157aa0 0x7f7dd406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd259c640 1 -- 172.21.15.113:0/1428902414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd415e040 msgr2=0x7f7dd41e6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd259c640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd415e040 0x7f7dd41e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd259c640 1 -- 172.21.15.113:0/1428902414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc009b30 con 0x7f7dd40b1710 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd259c640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b1710 0x7f7dd4152500 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c410 tx=0x7f7dc400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40035f0 con 0x7f7dd40b1710 2023-12-19T13:57:40.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4003750 con 0x7f7dd40b1710 2023-12-19T13:57:40.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4003b40 con 0x7f7dd40b1710 2023-12-19T13:57:40.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd41601a0 con 0x7f7dd40b1710 2023-12-19T13:57:40.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.557+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd4152a40 con 0x7f7dd40b1710 2023-12-19T13:57:40.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.559+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd41606c0 con 0x7f7dd40b1710 2023-12-19T13:57:40.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.559+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7dc4003ca0 con 0x7f7dd40b1710 2023-12-19T13:57:40.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.561+0000 7f7dcb7fe640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:40.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.561+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc4087b60 con 0x7f7dd40b1710 2023-12-19T13:57:40.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.561+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:40.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.561+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f7db4071f60 con 0x7f7dd40b1710 2023-12-19T13:57:40.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.562+0000 7f7dc9d9b640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40caf10 tx=0x7f7dbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:40.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.565+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7dc4053140 con 0x7f7dd40b1710 2023-12-19T13:57:40.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.770+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7dd4061910 con 0x7f7dd40b1710 2023-12-19T13:57:40.770 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.771+0000 7f7dcb7fe640 1 -- 172.21.15.113:0/1428902414 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v165) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7dc4017030 con 0x7f7dd40b1710 2023-12-19T13:57:40.770 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 msgr2=0x7f7db406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40caf10 tx=0x7f7dbc008040 comp rx=0 tx=0).stop 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b1710 msgr2=0x7f7dd4152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b1710 0x7f7dd4152500 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c410 tx=0x7f7dc400c8d0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 shutdown_connections 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7db406a430 0x7f7db406c8f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7dd415e040 0x7f7dd41e6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7dd4157aa0 0x7f7dd406c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 --2- 172.21.15.113:0/1428902414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7dd40b1710 0x7f7dd4152500 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:40.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 >> 172.21.15.113:0/1428902414 conn(0x7f7dd40cbb70 msgr2=0x7f7dd40cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.773+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 shutdown_connections 2023-12-19T13:57:40.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:40.774+0000 7f7dd8ae5640 1 -- 172.21.15.113:0/1428902414 wait complete. 2023-12-19T13:57:40.792 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:57:40.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:57:40.792 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:57:40.895 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:57:40.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:57:40.896 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:57:40.947 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:57:40.947 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:41.009 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:57:41.009 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:41.065 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:57:41.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.285+0000 7f240b59e640 1 Processor -- start 2023-12-19T13:57:41.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.286+0000 7f240b59e640 1 -- start start 2023-12-19T13:57:41.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.287+0000 7f240b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15e5a0 0x7f240c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.287+0000 7f240b59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f240c0cdbf0 0x7f240c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.287+0000 7f240b59e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c15ec30 con 0x7f240c15f680 2023-12-19T13:57:41.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.287+0000 7f240b59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0ce5c0 con 0x7f240c0cdbf0 2023-12-19T13:57:41.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.287+0000 7f240b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15e980 con 0x7f240c15e5a0 2023-12-19T13:57:41.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.287+0000 7f2403fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f240c15f680 0x7f240c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37246/0 (socket says 172.21.15.113:37246) 2023-12-19T13:57:41.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.287+0000 7f2403fff640 1 -- 172.21.15.113:0/1060339946 learned_addr learned my addr 172.21.15.113:0/1060339946 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:41.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f240a59c640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15e5a0 0x7f240c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078194454 0 0) 0x7f240c15ec30 con 0x7f240c15f680 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f240ad9d640 1 --2- 172.21.15.113:0/1060339946 >> v2:172.21.15.151:3300/0 conn(0x7f240c0cdbf0 0x7f240c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f8003520 con 0x7f240c15f680 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156944235 0 0) 0x7f23f8003520 con 0x7f240c15f680 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15e5a0 msgr2=0x7f240c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15e5a0 0x7f240c0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 >> v2:172.21.15.151:3300/0 conn(0x7f240c0cdbf0 msgr2=0x7f240c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 --2- 172.21.15.113:0/1060339946 >> v2:172.21.15.151:3300/0 conn(0x7f240c0cdbf0 0x7f240c0ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0b2f90 con 0x7f240c15f680 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f23f4001670 con 0x7f240c15f680 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 >> v1:172.21.15.113:6789/0 conn(0x7f240c15f680 legacy=0x7f240c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f23f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23f80047c0 0x7f23f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15e5a0 0x7f23f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0ce5c0 con 0x7f23f8003970 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15e980 con 0x7f23f80047c0 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.288+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800b980 con 0x7f240c15e5a0 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.289+0000 7f240a59c640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f23f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.289+0000 7f240a59c640 1 -- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15e5a0 msgr2=0x7f23f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.289+0000 7f240a59c640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15e5a0 0x7f23f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.289+0000 7f240a59c640 1 -- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23f80047c0 msgr2=0x7f23f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.289+0000 7f2403fff640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23f80047c0 0x7f23f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.289+0000 7f240a59c640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23f80047c0 0x7f23f8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.289+0000 7f240a59c640 1 -- 172.21.15.113:0/1060339946 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8003520 con 0x7f23f8003970 2023-12-19T13:57:41.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.290+0000 7f240a59c640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f23f8003d90 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009ac0 tx=0x7f23f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b3bef142abcfae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:41.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.290+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc02c710 con 0x7f23f8003970 2023-12-19T13:57:41.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.290+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc02c870 con 0x7f23f8003970 2023-12-19T13:57:41.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.290+0000 7f2409d9b640 1 -- 172.21.15.113:0/1060339946 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc02cc00 con 0x7f23f8003970 2023-12-19T13:57:41.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.291+0000 7f240b59e640 1 -- 172.21.15.113:0/1060339946 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 msgr2=0x7f23f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.291+0000 7f240b59e640 1 --2- 172.21.15.113:0/1060339946 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f23f8003d90 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009ac0 tx=0x7f23f80057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.291+0000 7f240ad9d640 1 -- 172.21.15.113:0/1060339946 reap_dead start 2023-12-19T13:57:41.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.291+0000 7f240b59e640 1 -- 172.21.15.113:0/1060339946 shutdown_connections 2023-12-19T13:57:41.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.291+0000 7f240b59e640 1 -- 172.21.15.113:0/1060339946 >> 172.21.15.113:0/1060339946 conn(0x7f240c0b0100 msgr2=0x7f240c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:41.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.291+0000 7f240b59e640 1 -- 172.21.15.113:0/1060339946 shutdown_connections 2023-12-19T13:57:41.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.291+0000 7f240b59e640 1 -- 172.21.15.113:0/1060339946 wait complete. 2023-12-19T13:57:41.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.293+0000 7f240b59e640 1 Processor -- start 2023-12-19T13:57:41.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.293+0000 7f240b59e640 1 -- start start 2023-12-19T13:57:41.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240b59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f240c144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240b59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f240c148b70 0x7f240c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15b040 0x7f240c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240b59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c145680 con 0x7f23f8003970 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240b59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15b4a0 con 0x7f240c148b70 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c1453e0 con 0x7f240c15b040 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f240c144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f240c144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39748/0 (socket says 172.21.15.113:39748) 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 -- 172.21.15.113:0/2575937360 learned_addr learned my addr 172.21.15.113:0/2575937360 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 -- 172.21.15.113:0/2575937360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15b040 msgr2=0x7f240c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15b040 0x7f240c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 -- 172.21.15.113:0/2575937360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f240c148b70 msgr2=0x7f240c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f2403fff640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f240c148b70 0x7f240c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f240c148b70 0x7f240c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.294+0000 7f240a59c640 1 -- 172.21.15.113:0/2575937360 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c145890 con 0x7f23f8003970 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.295+0000 7f240a59c640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f240c144ea0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.295+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc003810 con 0x7f23f8003970 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.295+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc003990 con 0x7f23f8003970 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.295+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc003d40 con 0x7f23f8003970 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.295+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c145b70 con 0x7f23f8003970 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.295+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c146130 con 0x7f23f8003970 2023-12-19T13:57:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.297+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c1462f0 con 0x7f23f8003970 2023-12-19T13:57:41.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.297+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23fc040450 con 0x7f23f8003970 2023-12-19T13:57:41.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.298+0000 7f2402ffd640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23ec06a430 0x7f23ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.298+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23fc0aab80 con 0x7f23f8003970 2023-12-19T13:57:41.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.298+0000 7f2403fff640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23ec06a430 0x7f23ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.298+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f23ec071f60 con 0x7f23f8003970 2023-12-19T13:57:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.299+0000 7f2403fff640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23ec06a430 0x7f23ec06c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f23f40017a0 tx=0x7f23f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:41.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.302+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23fc0760d0 con 0x7f23f8003970 2023-12-19T13:57:41.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.501+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f240c061910 con 0x7f23f8003970 2023-12-19T13:57:41.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.503+0000 7f2402ffd640 1 -- 172.21.15.113:0/2575937360 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f23fc044090 con 0x7f23f8003970 2023-12-19T13:57:41.502 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:41.502 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":165,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:56:58.643456+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:57:41.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.505+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23ec06a430 msgr2=0x7f23ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.505+0000 7f240b59e640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23ec06a430 0x7f23ec06c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f23f40017a0 tx=0x7f23f4009040 comp rx=0 tx=0).stop 2023-12-19T13:57:41.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.505+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 msgr2=0x7f240c144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.505+0000 7f240b59e640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f240c144ea0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc004730 comp rx=0 tx=0).stop 2023-12-19T13:57:41.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 shutdown_connections 2023-12-19T13:57:41.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f23ec06a430 0x7f23ec06c8f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f240c15b040 0x7f240c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f240c148b70 0x7f240c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 --2- 172.21.15.113:0/2575937360 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f8003970 0x7f240c144ea0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 >> 172.21.15.113:0/2575937360 conn(0x7f240c0b0100 msgr2=0x7f240c06d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 shutdown_connections 2023-12-19T13:57:41.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.506+0000 7f240b59e640 1 -- 172.21.15.113:0/2575937360 wait complete. 2023-12-19T13:57:41.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:55:21.110175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:55:22.094456+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:57:41.525 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:57:41.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.742+0000 7f402dbdc640 1 Processor -- start 2023-12-19T13:57:41.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.743+0000 7f402dbdc640 1 -- start start 2023-12-19T13:57:41.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.744+0000 7f402dbdc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f40280d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.744+0000 7f402dbdc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40280b6430 0x7f402815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.744+0000 7f402dbdc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4028161e70 con 0x7f4028146ff0 2023-12-19T13:57:41.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.744+0000 7f402dbdc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4028161080 con 0x7f40280b6430 2023-12-19T13:57:41.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.744+0000 7f402dbdc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4028161260 con 0x7f402806fc40 2023-12-19T13:57:41.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.745+0000 7f4027fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40280b6430 0x7f402815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.745+0000 7f401ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f40280d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.745+0000 7f401ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f40280d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:50336/0 (socket says 172.21.15.113:50336) 2023-12-19T13:57:41.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.745+0000 7f401ffff640 1 -- 172.21.15.113:0/659940886 learned_addr learned my addr 172.21.15.113:0/659940886 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:41.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.745+0000 7f4027fff640 1 --2- 172.21.15.113:0/659940886 >> v2:172.21.15.151:3300/0 conn(0x7f40280b6430 0x7f402815dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:33292/0 (socket says 172.21.15.113:33292) 2023-12-19T13:57:41.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.745+0000 7f40277fe640 1 --1- 172.21.15.113:0/659940886 >> v1:172.21.15.151:6789/0 conn(0x7f4028146ff0 0x7f402806f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:50204/0 (socket says 172.21.15.113:50204) 2023-12-19T13:57:41.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.746+0000 7f4027fff640 1 -- 172.21.15.113:0/659940886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 msgr2=0x7f40280d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:41.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.746+0000 7f4027fff640 1 --2- 172.21.15.113:0/659940886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f40280d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.746+0000 7f4027fff640 1 -- 172.21.15.113:0/659940886 >> v1:172.21.15.151:6789/0 conn(0x7f4028146ff0 legacy=0x7f402806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.746+0000 7f4027fff640 1 -- 172.21.15.113:0/659940886 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028161540 con 0x7f40280b6430 2023-12-19T13:57:41.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.748+0000 7f4027fff640 1 --2- 172.21.15.113:0/659940886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f402815dd40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4020009d90 tx=0x7f402002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f86e4f05c256bab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:41.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.748+0000 7f4026ffd640 1 -- 172.21.15.113:0/659940886 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402002cbd0 con 0x7f40280b6430 2023-12-19T13:57:41.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.748+0000 7f4026ffd640 1 -- 172.21.15.113:0/659940886 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402002cd30 con 0x7f40280b6430 2023-12-19T13:57:41.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.748+0000 7f4026ffd640 1 -- 172.21.15.113:0/659940886 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402002cea0 con 0x7f40280b6430 2023-12-19T13:57:41.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 -- 172.21.15.113:0/659940886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 msgr2=0x7f402815dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 --2- 172.21.15.113:0/659940886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f402815dd40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4020009d90 tx=0x7f402002be20 comp rx=0 tx=0).stop 2023-12-19T13:57:41.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 -- 172.21.15.113:0/659940886 shutdown_connections 2023-12-19T13:57:41.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 --2- 172.21.15.113:0/659940886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f402815dd40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 --2- 172.21.15.113:0/659940886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f40280d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 -- 172.21.15.113:0/659940886 >> 172.21.15.113:0/659940886 conn(0x7f40280d3520 msgr2=0x7f40280d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:41.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 -- 172.21.15.113:0/659940886 shutdown_connections 2023-12-19T13:57:41.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.749+0000 7f402dbdc640 1 -- 172.21.15.113:0/659940886 wait complete. 2023-12-19T13:57:41.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.751+0000 7f402dbdc640 1 Processor -- start 2023-12-19T13:57:41.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.752+0000 7f402dbdc640 1 -- start start 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f402dbdc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f402815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f402dbdc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f4028144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f402dbdc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4028146ff0 0x7f402815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f402dbdc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402815d560 con 0x7f4028146ff0 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f402dbdc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40281f3200 con 0x7f40280b6430 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f402dbdc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40281f34e0 con 0x7f402806fc40 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f4027fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4028146ff0 0x7f402815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f4027fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4028146ff0 0x7f402815ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39750/0 (socket says 172.21.15.113:39750) 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f4027fff640 1 -- 172.21.15.113:0/991333995 learned_addr learned my addr 172.21.15.113:0/991333995 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f40277fe640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f402815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.753+0000 7f401ffff640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f4028144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4027fff640 1 -- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 msgr2=0x7f402815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4027fff640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f402815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4027fff640 1 -- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 msgr2=0x7f4028144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4027fff640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f4028144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4027fff640 1 -- 172.21.15.113:0/991333995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009a70 con 0x7f4028146ff0 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f401ffff640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f4028144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4027fff640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4028146ff0 0x7f402815ebc0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f4020009eb0 tx=0x7f4020004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402002cea0 con 0x7f4028146ff0 2023-12-19T13:57:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402003e610 con 0x7f4028146ff0 2023-12-19T13:57:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40281f37c0 con 0x7f4028146ff0 2023-12-19T13:57:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402003e9c0 con 0x7f4028146ff0 2023-12-19T13:57:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.754+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40280c83a0 con 0x7f4028146ff0 2023-12-19T13:57:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.756+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40280674e0 con 0x7f4028146ff0 2023-12-19T13:57:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.756+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f402003b050 con 0x7f4028146ff0 2023-12-19T13:57:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.758+0000 7f4024ff9640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f400806a430 0x7f400806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.758+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40200ab110 con 0x7f4028146ff0 2023-12-19T13:57:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.758+0000 7f40277fe640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f400806a430 0x7f400806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:41.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.758+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f4008071f60 con 0x7f4028146ff0 2023-12-19T13:57:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.759+0000 7f40277fe640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f400806a430 0x7f400806c8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4018000f60 tx=0x7f4018007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:41.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.762+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4020076780 con 0x7f4028146ff0 2023-12-19T13:57:41.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.950+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40280c8590 con 0x7f4028146ff0 2023-12-19T13:57:41.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.951+0000 7f4024ff9640 1 -- 172.21.15.113:0/991333995 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7f402004e0a0 con 0x7f4028146ff0 2023-12-19T13:57:41.950 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f400806a430 msgr2=0x7f400806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f400806a430 0x7f400806c8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4018000f60 tx=0x7f4018007cc0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4028146ff0 msgr2=0x7f402815ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4028146ff0 0x7f402815ebc0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f4020009eb0 tx=0x7f4020004a40 comp rx=0 tx=0).stop 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 shutdown_connections 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f400806a430 0x7f400806c8f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4028146ff0 0x7f402815ebc0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40280b6430 0x7f4028144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 --2- 172.21.15.113:0/991333995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f402806fc40 0x7f402815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:41.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.953+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 >> 172.21.15.113:0/991333995 conn(0x7f40280d3520 msgr2=0x7f4028160480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:41.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.954+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 shutdown_connections 2023-12-19T13:57:41.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:41.954+0000 7f402dbdc640 1 -- 172.21.15.113:0/991333995 wait complete. 2023-12-19T13:57:41.970 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:57:42.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.188+0000 7fe71e527640 1 Processor -- start 2023-12-19T13:57:42.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.188+0000 7fe71e527640 1 -- start start 2023-12-19T13:57:42.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.190+0000 7fe71e527640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe71815da30 0x7fe7180b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.190+0000 7fe71e527640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe7180b6900 0x7fe7180b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.190+0000 7fe71e527640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71815e1a0 con 0x7fe718161020 2023-12-19T13:57:42.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.190+0000 7fe71e527640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71815e480 con 0x7fe71815da30 2023-12-19T13:57:42.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.190+0000 7fe71e527640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71815e760 con 0x7fe7180b6900 2023-12-19T13:57:42.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe70ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe71815da30 0x7fe7180b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe70ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe71815da30 0x7fe7180b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39758/0 (socket says 172.21.15.113:39758) 2023-12-19T13:57:42.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe70ffff640 1 -- 172.21.15.113:0/46799588 learned_addr learned my addr 172.21.15.113:0/46799588 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:42.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe71cac4640 1 --2- 172.21.15.113:0/46799588 >> v2:172.21.15.151:3300/0 conn(0x7fe7180b6900 0x7fe7180b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe70ffff640 1 -- 172.21.15.113:0/46799588 >> v2:172.21.15.151:3300/0 conn(0x7fe7180b6900 msgr2=0x7fe7180b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:42.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe70ffff640 1 --2- 172.21.15.113:0/46799588 >> v2:172.21.15.151:3300/0 conn(0x7fe7180b6900 0x7fe7180b89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe70ffff640 1 -- 172.21.15.113:0/46799588 >> v1:172.21.15.151:6789/0 conn(0x7fe718161020 legacy=0x7fe718143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:42.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.191+0000 7fe70ffff640 1 -- 172.21.15.113:0/46799588 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718142d10 con 0x7fe71815da30 2023-12-19T13:57:42.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.192+0000 7fe70ffff640 1 --2- 172.21.15.113:0/46799588 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe71815da30 0x7fe7180b63c0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe7180b8200 tx=0x7fe70002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f36cfa6f21bd320 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:42.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.193+0000 7fe7177fe640 1 -- 172.21.15.113:0/46799588 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700031870 con 0x7fe71815da30 2023-12-19T13:57:42.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.193+0000 7fe7177fe640 1 -- 172.21.15.113:0/46799588 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7000319d0 con 0x7fe71815da30 2023-12-19T13:57:42.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.193+0000 7fe7177fe640 1 -- 172.21.15.113:0/46799588 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700031d60 con 0x7fe71815da30 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.193+0000 7fe71e527640 1 -- 172.21.15.113:0/46799588 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe71815da30 msgr2=0x7fe7180b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.193+0000 7fe71e527640 1 --2- 172.21.15.113:0/46799588 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe71815da30 0x7fe7180b63c0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe7180b8200 tx=0x7fe70002b910 comp rx=0 tx=0).stop 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.194+0000 7fe71e527640 1 -- 172.21.15.113:0/46799588 shutdown_connections 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.194+0000 7fe71e527640 1 --2- 172.21.15.113:0/46799588 >> v2:172.21.15.151:3300/0 conn(0x7fe7180b6900 0x7fe7180b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.194+0000 7fe71e527640 1 --2- 172.21.15.113:0/46799588 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe71815da30 0x7fe7180b63c0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.194+0000 7fe71e527640 1 -- 172.21.15.113:0/46799588 >> 172.21.15.113:0/46799588 conn(0x7fe7180b26f0 msgr2=0x7fe7180b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.194+0000 7fe71e527640 1 -- 172.21.15.113:0/46799588 shutdown_connections 2023-12-19T13:57:42.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.194+0000 7fe71e527640 1 -- 172.21.15.113:0/46799588 wait complete. 2023-12-19T13:57:42.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.196+0000 7fe71e527640 1 Processor -- start 2023-12-19T13:57:42.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.196+0000 7fe71e527640 1 -- start start 2023-12-19T13:57:42.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe71e527640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7180b6900 0x7fe718146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe71e527640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe71815da30 0x7fe718158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe71e527640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718161020 0x7fe71813c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe71e527640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7181585a0 con 0x7fe7180b6900 2023-12-19T13:57:42.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe71e527640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718159350 con 0x7fe718161020 2023-12-19T13:57:42.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe71e527640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7181587d0 con 0x7fe71815da30 2023-12-19T13:57:42.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe717fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7180b6900 0x7fe718146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe717fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7180b6900 0x7fe718146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39774/0 (socket says 172.21.15.113:39774) 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe717fff640 1 -- 172.21.15.113:0/30460514 learned_addr learned my addr 172.21.15.113:0/30460514 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe70ffff640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe71815da30 0x7fe718158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.197+0000 7fe71cac4640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718161020 0x7fe71813c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe717fff640 1 -- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe71815da30 msgr2=0x7fe718158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe717fff640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe71815da30 0x7fe718158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe717fff640 1 -- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718161020 msgr2=0x7fe71813c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe717fff640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718161020 0x7fe71813c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe717fff640 1 -- 172.21.15.113:0/30460514 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000094d0 con 0x7fe7180b6900 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe717fff640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7180b6900 0x7fe718146660 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fe70800b3f0 tx=0x7fe70800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708011830 con 0x7fe7180b6900 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe708011990 con 0x7fe7180b6900 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe718158ab0 con 0x7fe7180b6900 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708011d40 con 0x7fe7180b6900 2023-12-19T13:57:42.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.198+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe718159070 con 0x7fe7180b6900 2023-12-19T13:57:42.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.200+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe718061910 con 0x7fe7180b6900 2023-12-19T13:57:42.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.201+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe70801a400 con 0x7fe7180b6900 2023-12-19T13:57:42.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.202+0000 7fe7157fa640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe6f806a430 0x7fe6f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.202+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7080887a0 con 0x7fe7180b6900 2023-12-19T13:57:42.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.202+0000 7fe70ffff640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe6f806a430 0x7fe6f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.202+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fe6f8071f60 con 0x7fe7180b6900 2023-12-19T13:57:42.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.203+0000 7fe70ffff640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe6f806a430 0x7fe6f806c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe700036000 tx=0x7fe70003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:42.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.206+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe708015060 con 0x7fe7180b6900 2023-12-19T13:57:42.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.395+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7180b5cb0 con 0x7fe7180b6900 2023-12-19T13:57:42.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.396+0000 7fe7157fa640 1 -- 172.21.15.113:0/30460514 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v165) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe708053d90 con 0x7fe7180b6900 2023-12-19T13:57:42.395 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe6f806a430 msgr2=0x7fe6f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe6f806a430 0x7fe6f806c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe700036000 tx=0x7fe70003c040 comp rx=0 tx=0).stop 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7180b6900 msgr2=0x7fe718146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7180b6900 0x7fe718146660 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fe70800b3f0 tx=0x7fe70800b8b0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 shutdown_connections 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe6f806a430 0x7fe6f806c8f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718161020 0x7fe71813c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe71815da30 0x7fe718158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 --2- 172.21.15.113:0/30460514 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7180b6900 0x7fe718146660 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.398+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 >> 172.21.15.113:0/30460514 conn(0x7fe7180b26f0 msgr2=0x7fe7180b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.399+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 shutdown_connections 2023-12-19T13:57:42.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.399+0000 7fe71e527640 1 -- 172.21.15.113:0/30460514 wait complete. 2023-12-19T13:57:42.417 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:57:42.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.626+0000 7f430d45f640 1 Processor -- start 2023-12-19T13:57:42.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.626+0000 7f430d45f640 1 -- start start 2023-12-19T13:57:42.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f430d45f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 0x7f43080d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f430d45f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f430806fc40 0x7f430815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f430d45f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4308161e70 con 0x7f43080b6430 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f430d45f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4308161080 con 0x7f430806fc40 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f430d45f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4308161260 con 0x7f4308146ff0 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f43077fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f430806fc40 0x7f430815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f43077fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f430806fc40 0x7f430815dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39790/0 (socket says 172.21.15.113:39790) 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f43077fe640 1 -- 172.21.15.113:0/270159526 learned_addr learned my addr 172.21.15.113:0/270159526 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f4306ffd640 1 --2- 172.21.15.113:0/270159526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 0x7f43080d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f43077fe640 1 -- 172.21.15.113:0/270159526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 msgr2=0x7f43080d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f43077fe640 1 --2- 172.21.15.113:0/270159526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 0x7f43080d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.628+0000 7f43077fe640 1 -- 172.21.15.113:0/270159526 >> v1:172.21.15.151:6789/0 conn(0x7f43080b6430 legacy=0x7f430806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:42.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.629+0000 7f43077fe640 1 -- 172.21.15.113:0/270159526 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308161540 con 0x7f430806fc40 2023-12-19T13:57:42.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.630+0000 7f43077fe640 1 --2- 172.21.15.113:0/270159526 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f430806fc40 0x7f430815dd40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f4300009870 tx=0x7f430002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d66e306c60698f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:42.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.630+0000 7f4305ffb640 1 -- 172.21.15.113:0/270159526 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300031640 con 0x7f430806fc40 2023-12-19T13:57:42.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.630+0000 7f4305ffb640 1 -- 172.21.15.113:0/270159526 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000317a0 con 0x7f430806fc40 2023-12-19T13:57:42.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.630+0000 7f4305ffb640 1 -- 172.21.15.113:0/270159526 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300031b30 con 0x7f430806fc40 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 -- 172.21.15.113:0/270159526 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f430806fc40 msgr2=0x7f430815dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 --2- 172.21.15.113:0/270159526 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f430806fc40 0x7f430815dd40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f4300009870 tx=0x7f430002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 -- 172.21.15.113:0/270159526 shutdown_connections 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 --2- 172.21.15.113:0/270159526 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f430806fc40 0x7f430815dd40 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 --2- 172.21.15.113:0/270159526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 0x7f43080d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 -- 172.21.15.113:0/270159526 >> 172.21.15.113:0/270159526 conn(0x7f43080d3520 msgr2=0x7f43080d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 -- 172.21.15.113:0/270159526 shutdown_connections 2023-12-19T13:57:42.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.631+0000 7f430d45f640 1 -- 172.21.15.113:0/270159526 wait complete. 2023-12-19T13:57:42.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.632+0000 7f430d45f640 1 Processor -- start 2023-12-19T13:57:42.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.633+0000 7f430d45f640 1 -- start start 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f430d45f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f430806fc40 0x7f4308142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f430d45f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43080b6430 0x7f4308143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f430d45f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 0x7f43080ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f430d45f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080ca250 con 0x7f43080b6430 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f430d45f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080c95d0 con 0x7f430806fc40 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f430d45f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43080c98b0 con 0x7f4308146ff0 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43080b6430 0x7f4308143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43080b6430 0x7f4308143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39806/0 (socket says 172.21.15.113:39806) 2023-12-19T13:57:42.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 -- 172.21.15.113:0/2477456376 learned_addr learned my addr 172.21.15.113:0/2477456376 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:42.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 -- 172.21.15.113:0/2477456376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 msgr2=0x7f43080ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 0x7f43080ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f4306ffd640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f430806fc40 0x7f4308142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 -- 172.21.15.113:0/2477456376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f430806fc40 msgr2=0x7f4308142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f430806fc40 0x7f4308142ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.634+0000 7f43067fc640 1 -- 172.21.15.113:0/2477456376 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43000094d0 con 0x7f43080b6430 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.635+0000 7f43067fc640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43080b6430 0x7f4308143010 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c430 tx=0x7f42f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.635+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0011790 con 0x7f43080b6430 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.635+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f00118f0 con 0x7f43080b6430 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.635+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0011ca0 con 0x7f43080b6430 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.635+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43080c9b90 con 0x7f43080b6430 2023-12-19T13:57:42.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.635+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43080c9210 con 0x7f43080b6430 2023-12-19T13:57:42.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.636+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43080ca390 con 0x7f43080b6430 2023-12-19T13:57:42.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.637+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42f001c460 con 0x7f43080b6430 2023-12-19T13:57:42.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.638+0000 7f42ff7fe640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42e806a460 0x7f42e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:42.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.638+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42f0088960 con 0x7f43080b6430 2023-12-19T13:57:42.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.638+0000 7f4306ffd640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42e806a460 0x7f42e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:42.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.638+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f42e8071f90 con 0x7f43080b6430 2023-12-19T13:57:42.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.639+0000 7f4306ffd640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42e806a460 0x7f42e806c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f42f8008ef0 tx=0x7f42f8008440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:42.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.642+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43080ca390 con 0x7f43080b6430 2023-12-19T13:57:42.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.825+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43080ca390 con 0x7f43080b6430 2023-12-19T13:57:42.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.827+0000 7f42ff7fe640 1 -- 172.21.15.113:0/2477456376 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v165) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43080ca390 con 0x7f43080b6430 2023-12-19T13:57:42.826 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42e806a460 msgr2=0x7f42e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42e806a460 0x7f42e806c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f42f8008ef0 tx=0x7f42f8008440 comp rx=0 tx=0).stop 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43080b6430 msgr2=0x7f4308143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43080b6430 0x7f4308143010 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c430 tx=0x7f42f000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 shutdown_connections 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42e806a460 0x7f42e806c920 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4308146ff0 0x7f43080ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43080b6430 0x7f4308143010 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 --2- 172.21.15.113:0/2477456376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f430806fc40 0x7f4308142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.829+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 >> 172.21.15.113:0/2477456376 conn(0x7f43080d3520 msgr2=0x7f43080b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:42.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.830+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 shutdown_connections 2023-12-19T13:57:42.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:42.830+0000 7f430d45f640 1 -- 172.21.15.113:0/2477456376 wait complete. 2023-12-19T13:57:42.848 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:57:43.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.059+0000 7f7e6e5ea640 1 Processor -- start 2023-12-19T13:57:43.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.059+0000 7f7e6e5ea640 1 -- start start 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6e5ea640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e68146c40 0x7f7e68070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6e5ea640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e680b7360 0x7f7e680b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6e5ea640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680b7d00 con 0x7f7e68160ee0 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6e5ea640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680700c0 con 0x7f7e68146c40 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6e5ea640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6806f160 con 0x7f7e680b7360 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6d5e8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e68146c40 0x7f7e68070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6d5e8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e68146c40 0x7f7e68070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39818/0 (socket says 172.21.15.113:39818) 2023-12-19T13:57:43.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.061+0000 7f7e6d5e8640 1 -- 172.21.15.113:0/1226699281 learned_addr learned my addr 172.21.15.113:0/1226699281 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:43.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.062+0000 7f7e6cde7640 1 --2- 172.21.15.113:0/1226699281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e680b7360 0x7f7e680b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.062+0000 7f7e6d5e8640 1 -- 172.21.15.113:0/1226699281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e680b7360 msgr2=0x7f7e680b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:43.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.062+0000 7f7e6d5e8640 1 --2- 172.21.15.113:0/1226699281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e680b7360 0x7f7e680b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.062+0000 7f7e6d5e8640 1 -- 172.21.15.113:0/1226699281 >> v1:172.21.15.113:6789/0 conn(0x7f7e68160ee0 legacy=0x7f7e68161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.062+0000 7f7e6d5e8640 1 -- 172.21.15.113:0/1226699281 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6806f440 con 0x7f7e68146c40 2023-12-19T13:57:43.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.062+0000 7f7e6cde7640 1 --2- 172.21.15.113:0/1226699281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e680b7360 0x7f7e680b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:43.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.063+0000 7f7e6d5e8640 1 --2- 172.21.15.113:0/1226699281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e68070e70 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b67fd84c2d12ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:43.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.063+0000 7f7e5ffff640 1 -- 172.21.15.113:0/1226699281 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64030840 con 0x7f7e68146c40 2023-12-19T13:57:43.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.063+0000 7f7e5ffff640 1 -- 172.21.15.113:0/1226699281 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e640309a0 con 0x7f7e68146c40 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.063+0000 7f7e5ffff640 1 -- 172.21.15.113:0/1226699281 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64030d30 con 0x7f7e68146c40 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/1226699281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 msgr2=0x7f7e68070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/1226699281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e68070e70 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6402b980 comp rx=0 tx=0).stop 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/1226699281 shutdown_connections 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/1226699281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e680b7360 0x7f7e680b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/1226699281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e68070e70 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/1226699281 >> 172.21.15.113:0/1226699281 conn(0x7f7e680d31b0 msgr2=0x7f7e680d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/1226699281 shutdown_connections 2023-12-19T13:57:43.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.064+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/1226699281 wait complete. 2023-12-19T13:57:43.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.065+0000 7f7e6e5ea640 1 Processor -- start 2023-12-19T13:57:43.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.066+0000 7f7e6e5ea640 1 -- start start 2023-12-19T13:57:43.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.066+0000 7f7e6e5ea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e680b7360 0x7f7e680ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.066+0000 7f7e6e5ea640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e680b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6e5ea640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e68160ee0 0x7f7e680b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6e5ea640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680c8940 con 0x7f7e68146c40 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6e5ea640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680cee50 con 0x7f7e680b7360 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6e5ea640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680c8b90 con 0x7f7e68160ee0 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e680b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e680b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39826/0 (socket says 172.21.15.113:39826) 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 -- 172.21.15.113:0/4129157230 learned_addr learned my addr 172.21.15.113:0/4129157230 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6d5e8640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e680b7360 0x7f7e680ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6dde9640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e68160ee0 0x7f7e680b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 -- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e68160ee0 msgr2=0x7f7e680b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e68160ee0 0x7f7e680b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 -- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e680b7360 msgr2=0x7f7e680ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e680b7360 0x7f7e680ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.067+0000 7f7e6cde7640 1 -- 172.21.15.113:0/4129157230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640094d0 con 0x7f7e68146c40 2023-12-19T13:57:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.068+0000 7f7e6cde7640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e680b6290 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c7f0 tx=0x7f7e5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.068+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58007820 con 0x7f7e68146c40 2023-12-19T13:57:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.068+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e58007980 con 0x7f7e68146c40 2023-12-19T13:57:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.068+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58007cf0 con 0x7f7e68146c40 2023-12-19T13:57:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.068+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e680c8e70 con 0x7f7e68146c40 2023-12-19T13:57:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.068+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e680c9430 con 0x7f7e68146c40 2023-12-19T13:57:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.069+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68061910 con 0x7f7e68146c40 2023-12-19T13:57:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.070+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e580113f0 con 0x7f7e68146c40 2023-12-19T13:57:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.071+0000 7f7e5dffb640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4c06a430 0x7f7e4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.071+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e58088c40 con 0x7f7e68146c40 2023-12-19T13:57:43.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.071+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f7e4c071f60 con 0x7f7e68146c40 2023-12-19T13:57:43.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.071+0000 7f7e6d5e8640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4c06a430 0x7f7e4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.072+0000 7f7e6d5e8640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4c06a430 0x7f7e4c06c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7e64036000 tx=0x7f7e64008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:43.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.075+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e5801f060 con 0x7f7e68146c40 2023-12-19T13:57:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.260+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e680b8a50 con 0x7f7e68146c40 2023-12-19T13:57:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.261+0000 7f7e5dffb640 1 -- 172.21.15.113:0/4129157230 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v165) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e58054230 con 0x7f7e68146c40 2023-12-19T13:57:43.260 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.263+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4c06a430 msgr2=0x7f7e4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.263+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4c06a430 0x7f7e4c06c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7e64036000 tx=0x7f7e64008030 comp rx=0 tx=0).stop 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.263+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 msgr2=0x7f7e680b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.263+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e680b6290 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c7f0 tx=0x7f7e5800ccb0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 shutdown_connections 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7e4c06a430 0x7f7e4c06c8f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e68160ee0 0x7f7e680b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e68146c40 0x7f7e680b6290 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 --2- 172.21.15.113:0/4129157230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e680b7360 0x7f7e680ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 >> 172.21.15.113:0/4129157230 conn(0x7f7e680d31b0 msgr2=0x7f7e6815f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:43.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 shutdown_connections 2023-12-19T13:57:43.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.264+0000 7f7e6e5ea640 1 -- 172.21.15.113:0/4129157230 wait complete. 2023-12-19T13:57:43.281 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:57:43.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:57:43.281 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:57:43.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:57:43.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:57:43.398 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:57:43.448 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:57:43.449 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:43.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:57:43.506 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:57:43.506 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:43.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:57:43.561 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:57:43.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.779+0000 7fe94af8e640 1 Processor -- start 2023-12-19T13:57:43.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.779+0000 7fe94af8e640 1 -- start start 2023-12-19T13:57:43.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.780+0000 7fe94af8e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe94415e3f0 0x7fe9440b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.780+0000 7fe94af8e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe9440b2460 0x7fe9440ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.780+0000 7fe94af8e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440b2fa0 con 0x7fe9440acdf0 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94af8e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9440ad280 con 0x7fe9440b2460 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94af8e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94406f600 con 0x7fe94415e3f0 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94978b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe9440b2460 0x7fe9440ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94978b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe9440b2460 0x7fe9440ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39828/0 (socket says 172.21.15.113:39828) 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94978b640 1 -- 172.21.15.113:0/172908643 learned_addr learned my addr 172.21.15.113:0/172908643 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe949f8c640 1 --2- 172.21.15.113:0/172908643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe94415e3f0 0x7fe9440b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94978b640 1 -- 172.21.15.113:0/172908643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe94415e3f0 msgr2=0x7fe9440b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94978b640 1 --2- 172.21.15.113:0/172908643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe94415e3f0 0x7fe9440b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94978b640 1 -- 172.21.15.113:0/172908643 >> v1:172.21.15.113:6789/0 conn(0x7fe9440acdf0 legacy=0x7fe944160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.781+0000 7fe94978b640 1 -- 172.21.15.113:0/172908643 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94415e7d0 con 0x7fe9440b2460 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.782+0000 7fe94978b640 1 --2- 172.21.15.113:0/172908643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440b2460 0x7fe9440ac8b0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe934009870 tx=0x7fe93402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9538a7f720565701 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe948f8a640 1 -- 172.21.15.113:0/172908643 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934031640 con 0x7fe9440b2460 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe948f8a640 1 -- 172.21.15.113:0/172908643 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9340317a0 con 0x7fe9440b2460 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe948f8a640 1 -- 172.21.15.113:0/172908643 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934031b30 con 0x7fe9440b2460 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 -- 172.21.15.113:0/172908643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440b2460 msgr2=0x7fe9440ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 --2- 172.21.15.113:0/172908643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440b2460 0x7fe9440ac8b0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe934009870 tx=0x7fe93402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 -- 172.21.15.113:0/172908643 shutdown_connections 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 --2- 172.21.15.113:0/172908643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440b2460 0x7fe9440ac8b0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 --2- 172.21.15.113:0/172908643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe94415e3f0 0x7fe9440b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 -- 172.21.15.113:0/172908643 >> 172.21.15.113:0/172908643 conn(0x7fe9440b0100 msgr2=0x7fe9440b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 -- 172.21.15.113:0/172908643 shutdown_connections 2023-12-19T13:57:43.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.783+0000 7fe94af8e640 1 -- 172.21.15.113:0/172908643 wait complete. 2023-12-19T13:57:43.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.786+0000 7fe94af8e640 1 Processor -- start 2023-12-19T13:57:43.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.786+0000 7fe94af8e640 1 -- start start 2023-12-19T13:57:43.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe94af8e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440acdf0 0x7fe944150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe94af8e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9440b2460 0x7fe944151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe94af8e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe94415e3f0 0x7fe9441527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe94af8e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe944155e60 con 0x7fe9440acdf0 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe94af8e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe944152360 con 0x7fe94415e3f0 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe94af8e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe944152ce0 con 0x7fe9440b2460 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe949f8c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440acdf0 0x7fe944150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe949f8c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440acdf0 0x7fe944150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39836/0 (socket says 172.21.15.113:39836) 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.787+0000 7fe949f8c640 1 -- 172.21.15.113:0/319364441 learned_addr learned my addr 172.21.15.113:0/319364441 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe94978b640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9440b2460 0x7fe944151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe949f8c640 1 -- 172.21.15.113:0/319364441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9440b2460 msgr2=0x7fe944151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe949f8c640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9440b2460 0x7fe944151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe949f8c640 1 -- 172.21.15.113:0/319364441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe94415e3f0 msgr2=0x7fe9441527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe949f8c640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe94415e3f0 0x7fe9441527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe949f8c640 1 -- 172.21.15.113:0/319364441 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9340094d0 con 0x7fe9440acdf0 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe949f8c640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440acdf0 0x7fe944150cd0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c7f0 tx=0x7fe94000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940004220 con 0x7fe9440acdf0 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9400043a0 con 0x7fe9440acdf0 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.788+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9441f6440 con 0x7fe9440acdf0 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.789+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940007860 con 0x7fe9440acdf0 2023-12-19T13:57:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.789+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9441f6a00 con 0x7fe9440acdf0 2023-12-19T13:57:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.790+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe944061910 con 0x7fe9440acdf0 2023-12-19T13:57:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.790+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe940007bd0 con 0x7fe9440acdf0 2023-12-19T13:57:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.791+0000 7fe93a7fc640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe92806a430 0x7fe92806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.792+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9400888e0 con 0x7fe9440acdf0 2023-12-19T13:57:43.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.792+0000 7fe94978b640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe92806a430 0x7fe92806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:43.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.792+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fe928071f60 con 0x7fe9440acdf0 2023-12-19T13:57:43.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.792+0000 7fe94978b640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe92806a430 0x7fe92806c8f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe934036000 tx=0x7fe93403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:43.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:43.796+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe94001e020 con 0x7fe9440acdf0 2023-12-19T13:57:44.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.024+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe94406e800 con 0x7fe9440acdf0 2023-12-19T13:57:44.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.025+0000 7fe93a7fc640 1 -- 172.21.15.113:0/319364441 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fe940053ec0 con 0x7fe9440acdf0 2023-12-19T13:57:44.024 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:44.024 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:55:23.075987+0000","modified":"2023-12-19T13:55:26.098528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8268":{"gid":8268,"name":"d","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1201018731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1201018731},{"type":"v1","addr":"172.21.15.151:6833","nonce":1201018731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T13:57:44.024 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 72 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.027+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe92806a430 msgr2=0x7fe92806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.027+0000 7fe94af8e640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe92806a430 0x7fe92806c8f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe934036000 tx=0x7fe93403c040 comp rx=0 tx=0).stop 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.027+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440acdf0 msgr2=0x7fe944150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.027+0000 7fe94af8e640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440acdf0 0x7fe944150cd0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c7f0 tx=0x7fe94000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 shutdown_connections 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe92806a430 0x7fe92806c8f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe94415e3f0 0x7fe9441527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9440b2460 0x7fe944151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 --2- 172.21.15.113:0/319364441 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe9440acdf0 0x7fe944150cd0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 >> 172.21.15.113:0/319364441 conn(0x7fe9440b0100 msgr2=0x7fe944157710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:44.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 shutdown_connections 2023-12-19T13:57:44.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.028+0000 7fe94af8e640 1 -- 172.21.15.113:0/319364441 wait complete. 2023-12-19T13:57:44.045 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:57:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.254+0000 7fd3539e0640 1 Processor -- start 2023-12-19T13:57:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.254+0000 7fd3539e0640 1 -- start start 2023-12-19T13:57:44.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.256+0000 7fd3539e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c0b0b50 0x7fd34c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.256+0000 7fd3539e0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd34c06b590 0x7fd34c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.256+0000 7fd3539e0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c06bb30 con 0x7fd34c1449e0 2023-12-19T13:57:44.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.256+0000 7fd3539e0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c0b0070 con 0x7fd34c06b590 2023-12-19T13:57:44.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.256+0000 7fd3539e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0b0350 con 0x7fd34c0b0b50 2023-12-19T13:57:44.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.257+0000 7fd351f7d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd34c06b590 0x7fd34c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.257+0000 7fd351f7d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd34c06b590 0x7fd34c06c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:33346/0 (socket says 172.21.15.113:33346) 2023-12-19T13:57:44.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.257+0000 7fd351f7d640 1 -- 172.21.15.113:0/2558415824 learned_addr learned my addr 172.21.15.113:0/2558415824 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:44.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.257+0000 7fd350f7b640 1 --2- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c0b0b50 0x7fd34c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.258+0000 7fd351f7d640 1 -- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c0b0b50 msgr2=0x7fd34c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.258+0000 7fd351f7d640 1 --2- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c0b0b50 0x7fd34c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.258+0000 7fd351f7d640 1 -- 172.21.15.113:0/2558415824 >> v1:172.21.15.151:6789/0 conn(0x7fd34c1449e0 legacy=0x7fd34c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.258+0000 7fd351f7d640 1 -- 172.21.15.113:0/2558415824 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0b0630 con 0x7fd34c06b590 2023-12-19T13:57:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.258+0000 7fd350f7b640 1 --2- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c0b0b50 0x7fd34c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:57:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.258+0000 7fd343fff640 1 -- 172.21.15.113:0/2558415824 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852092468 0 0) 0x7fd34c06bb30 con 0x7fd34c1449e0 2023-12-19T13:57:44.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.259+0000 7fd351f7d640 1 --2- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 0x7fd34c06c4e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd344009e50 tx=0x7fd34402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc64f0bcbc616e22 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:44.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd343fff640 1 -- 172.21.15.113:0/2558415824 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34402cb00 con 0x7fd34c06b590 2023-12-19T13:57:44.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd343fff640 1 -- 172.21.15.113:0/2558415824 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34402cc60 con 0x7fd34c06b590 2023-12-19T13:57:44.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd343fff640 1 -- 172.21.15.113:0/2558415824 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3440343f0 con 0x7fd34c06b590 2023-12-19T13:57:44.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd3539e0640 1 -- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 msgr2=0x7fd34c06c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd3539e0640 1 --2- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 0x7fd34c06c4e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd344009e50 tx=0x7fd34402bf60 comp rx=0 tx=0).stop 2023-12-19T13:57:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd3539e0640 1 -- 172.21.15.113:0/2558415824 shutdown_connections 2023-12-19T13:57:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd3539e0640 1 --2- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 0x7fd34c06c4e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.260+0000 7fd3539e0640 1 --2- 172.21.15.113:0/2558415824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c0b0b50 0x7fd34c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.261+0000 7fd3539e0640 1 -- 172.21.15.113:0/2558415824 >> 172.21.15.113:0/2558415824 conn(0x7fd34c0cbb70 msgr2=0x7fd34c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.261+0000 7fd3539e0640 1 -- 172.21.15.113:0/2558415824 shutdown_connections 2023-12-19T13:57:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.261+0000 7fd3539e0640 1 -- 172.21.15.113:0/2558415824 wait complete. 2023-12-19T13:57:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.262+0000 7fd3539e0640 1 Processor -- start 2023-12-19T13:57:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.262+0000 7fd3539e0640 1 -- start start 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.263+0000 7fd3539e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 0x7fd34c13ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.263+0000 7fd3539e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34c0b0b50 0x7fd34c157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.263+0000 7fd3539e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c1449e0 0x7fd34c13f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.263+0000 7fd3539e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c158a60 con 0x7fd34c0b0b50 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.263+0000 7fd3539e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c13b040 con 0x7fd34c06b590 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.263+0000 7fd3539e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c157ee0 con 0x7fd34c1449e0 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34c0b0b50 0x7fd34c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34c0b0b50 0x7fd34c157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39846/0 (socket says 172.21.15.113:39846) 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 -- 172.21.15.113:0/3727119926 learned_addr learned my addr 172.21.15.113:0/3727119926 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd35177c640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 0x7fd34c13ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd351f7d640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c1449e0 0x7fd34c13f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 -- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c1449e0 msgr2=0x7fd34c13f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c1449e0 0x7fd34c13f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 -- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 msgr2=0x7fd34c13ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 0x7fd34c13ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 -- 172.21.15.113:0/3727119926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c009400 con 0x7fd34c0b0b50 2023-12-19T13:57:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd351f7d640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c1449e0 0x7fd34c13f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:44.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.264+0000 7fd350f7b640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34c0b0b50 0x7fd34c157400 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00ebe0 tx=0x7fd33c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:44.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.265+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c009760 con 0x7fd34c0b0b50 2023-12-19T13:57:44.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.265+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00cc30 con 0x7fd34c0b0b50 2023-12-19T13:57:44.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.265+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00eee0 con 0x7fd34c0b0b50 2023-12-19T13:57:44.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.265+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd344009b30 con 0x7fd34c0b0b50 2023-12-19T13:57:44.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.265+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c1584a0 con 0x7fd34c0b0b50 2023-12-19T13:57:44.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.266+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c15c8a0 con 0x7fd34c0b0b50 2023-12-19T13:57:44.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.267+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd33c013470 con 0x7fd34c0b0b50 2023-12-19T13:57:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.268+0000 7fd341ffb640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd33006a430 0x7fd33006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.268+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd33c088ca0 con 0x7fd34c0b0b50 2023-12-19T13:57:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.268+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fd330071f60 con 0x7fd34c0b0b50 2023-12-19T13:57:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.268+0000 7fd35177c640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd33006a430 0x7fd33006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.269+0000 7fd35177c640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd33006a430 0x7fd33006c8f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd348007fd0 tx=0x7fd348009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:44.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.273+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd33c054280 con 0x7fd34c0b0b50 2023-12-19T13:57:44.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.461+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd34c061910 con 0x7fd34c0b0b50 2023-12-19T13:57:44.463 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.464+0000 7fd341ffb640 1 -- 172.21.15.113:0/3727119926 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16134 (secure 0 0 0) 0x7fd33c021020 con 0x7fd34c0b0b50 2023-12-19T13:57:44.463 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:44.463 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":165,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:56:58.643456+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.466+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd33006a430 msgr2=0x7fd33006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.466+0000 7fd3539e0640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd33006a430 0x7fd33006c8f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd348007fd0 tx=0x7fd348009040 comp rx=0 tx=0).stop 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.466+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34c0b0b50 msgr2=0x7fd34c157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.466+0000 7fd3539e0640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34c0b0b50 0x7fd34c157400 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00ebe0 tx=0x7fd33c00c520 comp rx=0 tx=0).stop 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 shutdown_connections 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd33006a430 0x7fd33006c8f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd34c1449e0 0x7fd34c13f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34c0b0b50 0x7fd34c157400 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 --2- 172.21.15.113:0/3727119926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd34c06b590 0x7fd34c13ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 >> 172.21.15.113:0/3727119926 conn(0x7fd34c0cbb70 msgr2=0x7fd34c0ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:44.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 shutdown_connections 2023-12-19T13:57:44.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.467+0000 7fd3539e0640 1 -- 172.21.15.113:0/3727119926 wait complete. 2023-12-19T13:57:44.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:55:21.110175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:55:22.094456+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:57:44.484 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:57:44.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.696+0000 7fde350b6640 1 Processor -- start 2023-12-19T13:57:44.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.696+0000 7fde350b6640 1 -- start start 2023-12-19T13:57:44.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.698+0000 7fde350b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 0x7fde300b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.698+0000 7fde350b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fde300b1ec0 0x7fde3015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.698+0000 7fde350b6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fde300ceea0 0x7fde300cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.698+0000 7fde350b6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300cf870 con 0x7fde300b1ec0 2023-12-19T13:57:44.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.698+0000 7fde350b6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3015ef10 con 0x7fde300ceea0 2023-12-19T13:57:44.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.698+0000 7fde350b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde300b2320 con 0x7fde3015b1d0 2023-12-19T13:57:44.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fde300b1ec0 0x7fde3015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fde300b1ec0 0x7fde3015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39856/0 (socket says 172.21.15.113:39856) 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 -- 172.21.15.113:0/2090425119 learned_addr learned my addr 172.21.15.113:0/2090425119 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde2f59e640 1 --2- 172.21.15.113:0/2090425119 >> v2:172.21.15.151:3300/0 conn(0x7fde300ceea0 0x7fde300cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde2ed9d640 1 --2- 172.21.15.113:0/2090425119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 0x7fde300b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 -- 172.21.15.113:0/2090425119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 msgr2=0x7fde300b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 --2- 172.21.15.113:0/2090425119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 0x7fde300b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 -- 172.21.15.113:0/2090425119 >> v2:172.21.15.151:3300/0 conn(0x7fde300ceea0 msgr2=0x7fde300cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 --2- 172.21.15.113:0/2090425119 >> v2:172.21.15.151:3300/0 conn(0x7fde300ceea0 0x7fde300cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde27fff640 1 -- 172.21.15.113:0/2090425119 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300b2e40 con 0x7fde300b1ec0 2023-12-19T13:57:44.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.699+0000 7fde2f59e640 1 --2- 172.21.15.113:0/2090425119 >> v2:172.21.15.151:3300/0 conn(0x7fde300ceea0 0x7fde300cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:57:44.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.700+0000 7fde27fff640 1 --2- 172.21.15.113:0/2090425119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde3015f6d0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fde30071a10 tx=0x7fde1802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85214cea8626909 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:44.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde2e59c640 1 -- 172.21.15.113:0/2090425119 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18031870 con 0x7fde300b1ec0 2023-12-19T13:57:44.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde2e59c640 1 -- 172.21.15.113:0/2090425119 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde180319d0 con 0x7fde300b1ec0 2023-12-19T13:57:44.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde2e59c640 1 -- 172.21.15.113:0/2090425119 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18031d60 con 0x7fde300b1ec0 2023-12-19T13:57:44.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 -- 172.21.15.113:0/2090425119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 msgr2=0x7fde3015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 --2- 172.21.15.113:0/2090425119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde3015f6d0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fde30071a10 tx=0x7fde1802b910 comp rx=0 tx=0).stop 2023-12-19T13:57:44.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 -- 172.21.15.113:0/2090425119 shutdown_connections 2023-12-19T13:57:44.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 --2- 172.21.15.113:0/2090425119 >> v2:172.21.15.151:3300/0 conn(0x7fde300ceea0 0x7fde300cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 --2- 172.21.15.113:0/2090425119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde3015f6d0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 --2- 172.21.15.113:0/2090425119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 0x7fde300b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 -- 172.21.15.113:0/2090425119 >> 172.21.15.113:0/2090425119 conn(0x7fde30073150 msgr2=0x7fde300659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:44.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 -- 172.21.15.113:0/2090425119 shutdown_connections 2023-12-19T13:57:44.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.701+0000 7fde350b6640 1 -- 172.21.15.113:0/2090425119 wait complete. 2023-12-19T13:57:44.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.703+0000 7fde350b6640 1 Processor -- start 2023-12-19T13:57:44.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.703+0000 7fde350b6640 1 -- start start 2023-12-19T13:57:44.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.704+0000 7fde350b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde300c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.704+0000 7fde350b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde300ceea0 0x7fde3015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.704+0000 7fde350b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 0x7fde300cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.704+0000 7fde350b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3014e300 con 0x7fde300b1ec0 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.704+0000 7fde350b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3015c760 con 0x7fde300ceea0 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.704+0000 7fde350b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde300c4470 con 0x7fde3015b1d0 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde300c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde300c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39864/0 (socket says 172.21.15.113:39864) 2023-12-19T13:57:44.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 -- 172.21.15.113:0/2646786152 learned_addr learned my addr 172.21.15.113:0/2646786152 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:44.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 -- 172.21.15.113:0/2646786152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 msgr2=0x7fde300cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 0x7fde300cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 -- 172.21.15.113:0/2646786152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde300ceea0 msgr2=0x7fde3015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde27fff640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde300ceea0 0x7fde3015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde300ceea0 0x7fde3015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 -- 172.21.15.113:0/2646786152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde180094d0 con 0x7fde300b1ec0 2023-12-19T13:57:44.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.705+0000 7fde2ed9d640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde300c3e90 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fde2000e870 tx=0x7fde2000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:44.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.707+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde200094f0 con 0x7fde300b1ec0 2023-12-19T13:57:44.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.707+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000c940 con 0x7fde300b1ec0 2023-12-19T13:57:44.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.707+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000ccf0 con 0x7fde300b1ec0 2023-12-19T13:57:44.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.707+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3015ca00 con 0x7fde300b1ec0 2023-12-19T13:57:44.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.707+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3015cfc0 con 0x7fde300b1ec0 2023-12-19T13:57:44.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.708+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde30061910 con 0x7fde300b1ec0 2023-12-19T13:57:44.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.709+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde20013470 con 0x7fde300b1ec0 2023-12-19T13:57:44.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.710+0000 7fde277fe640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fde1006a430 0x7fde1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:44.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.710+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde20088a30 con 0x7fde300b1ec0 2023-12-19T13:57:44.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.710+0000 7fde27fff640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fde1006a430 0x7fde1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:44.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.710+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fde10071f60 con 0x7fde300b1ec0 2023-12-19T13:57:44.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.711+0000 7fde27fff640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fde1006a430 0x7fde1006c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fde18036000 tx=0x7fde1803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:44.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.715+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fde20017060 con 0x7fde300b1ec0 2023-12-19T13:57:44.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.901+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde300cdc90 con 0x7fde300b1ec0 2023-12-19T13:57:44.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.901+0000 7fde277fe640 1 -- 172.21.15.113:0/2646786152 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde20021070 con 0x7fde300b1ec0 2023-12-19T13:57:44.901 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:57:44.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fde1006a430 msgr2=0x7fde1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fde1006a430 0x7fde1006c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fde18036000 tx=0x7fde1803c040 comp rx=0 tx=0).stop 2023-12-19T13:57:44.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 msgr2=0x7fde300c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:44.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde300c3e90 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fde2000e870 tx=0x7fde2000ed30 comp rx=0 tx=0).stop 2023-12-19T13:57:44.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 shutdown_connections 2023-12-19T13:57:44.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fde1006a430 0x7fde1006c8f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3015b1d0 0x7fde300cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde300ceea0 0x7fde3015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 --2- 172.21.15.113:0/2646786152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fde300b1ec0 0x7fde300c3e90 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:44.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 >> 172.21.15.113:0/2646786152 conn(0x7fde30073150 msgr2=0x7fde30156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:44.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 shutdown_connections 2023-12-19T13:57:44.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:44.904+0000 7fde350b6640 1 -- 172.21.15.113:0/2646786152 wait complete. 2023-12-19T13:57:44.920 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:57:45.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.132+0000 7fa5729b9640 1 Processor -- start 2023-12-19T13:57:45.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.133+0000 7fa5729b9640 1 -- start start 2023-12-19T13:57:45.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.134+0000 7fa5729b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa56c146e10 0x7fa56c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.134+0000 7fa5729b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c0cd840 con 0x7fa56c0d2b00 2023-12-19T13:57:45.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.135+0000 7fa5729b9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c0b6e90 con 0x7fa56c0ce110 2023-12-19T13:57:45.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.135+0000 7fa5729b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c0d2430 con 0x7fa56c146e10 2023-12-19T13:57:45.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.135+0000 7fa56b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa56c0d2b00 0x7fa56c0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37270/0 (socket says 172.21.15.113:37270) 2023-12-19T13:57:45.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.135+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2500484941 learned_addr learned my addr 172.21.15.113:0/2500484941 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:45.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.135+0000 7fa56bfff640 1 --2- 172.21.15.113:0/2500484941 >> v2:172.21.15.151:3300/0 conn(0x7fa56c146e10 0x7fa56c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.135+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389688169 0 0) 0x7fa56c0cd840 con 0x7fa56c0d2b00 2023-12-19T13:57:45.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.135+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa558003520 con 0x7fa56c0d2b00 2023-12-19T13:57:45.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933899440 0 0) 0x7fa558003520 con 0x7fa56c0d2b00 2023-12-19T13:57:45.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 >> v2:172.21.15.151:3300/0 conn(0x7fa56c146e10 msgr2=0x7fa56c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:45.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 --2- 172.21.15.113:0/2500484941 >> v2:172.21.15.151:3300/0 conn(0x7fa56c146e10 0x7fa56c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 >> v1:172.21.15.151:6789/0 conn(0x7fa56c0ce110 legacy=0x7fa56c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0d2620 con 0x7fa56c0d2b00 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fa554001670 con 0x7fa56c0d2b00 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 >> v1:172.21.15.113:6789/0 conn(0x7fa56c0d2b00 legacy=0x7fa56c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5580039e0 0x7fa558003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5580047c0 0x7fa558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580051f0 0x7fa55800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55800c120 con 0x7fa5580047c0 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55800c290 con 0x7fa5580051f0 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55800c450 con 0x7fa5580039e0 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa56b7fe640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5580047c0 0x7fa558004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.136+0000 7fa570f56640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580051f0 0x7fa55800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.137+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5580039e0 msgr2=0x7fa558003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.137+0000 7fa56b7fe640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5580039e0 0x7fa558003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.137+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580051f0 msgr2=0x7fa55800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:45.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.137+0000 7fa56b7fe640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580051f0 0x7fa55800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.137+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2500484941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558003520 con 0x7fa5580047c0 2023-12-19T13:57:45.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.137+0000 7fa570f56640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580051f0 0x7fa55800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:45.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.137+0000 7fa570f56640 1 -- 172.21.15.113:0/2500484941 reap_dead start 2023-12-19T13:57:45.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.138+0000 7fa56b7fe640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5580047c0 0x7fa558004c40 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c240 tx=0x7fa5580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cce6b8bb4b582bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:45.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.138+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554005ad0 con 0x7fa5580047c0 2023-12-19T13:57:45.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.138+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa554005c30 con 0x7fa5580047c0 2023-12-19T13:57:45.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.138+0000 7fa56affd640 1 -- 172.21.15.113:0/2500484941 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55402caf0 con 0x7fa5580047c0 2023-12-19T13:57:45.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.138+0000 7fa5729b9640 1 -- 172.21.15.113:0/2500484941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5580047c0 msgr2=0x7fa558004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.138+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5580047c0 0x7fa558004c40 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c240 tx=0x7fa5580057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.139 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.139+0000 7fa5729b9640 1 -- 172.21.15.113:0/2500484941 shutdown_connections 2023-12-19T13:57:45.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.139+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2500484941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5580047c0 0x7fa558004c40 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.139+0000 7fa5729b9640 1 -- 172.21.15.113:0/2500484941 >> 172.21.15.113:0/2500484941 conn(0x7fa56c0b29c0 msgr2=0x7fa56c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:45.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.139+0000 7fa5729b9640 1 -- 172.21.15.113:0/2500484941 shutdown_connections 2023-12-19T13:57:45.140 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.139+0000 7fa5729b9640 1 -- 172.21.15.113:0/2500484941 wait complete. 2023-12-19T13:57:45.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.140+0000 7fa5729b9640 1 Processor -- start 2023-12-19T13:57:45.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.141+0000 7fa5729b9640 1 -- start start 2023-12-19T13:57:45.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.141+0000 7fa5729b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580047c0 0x7fa56c13c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.141+0000 7fa5729b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56c13e300 0x7fa56c13c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.141+0000 7fa5729b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa56c13cd50 0x7fa56c15fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.141+0000 7fa5729b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c13d260 con 0x7fa56c13e300 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.141+0000 7fa5729b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c13d540 con 0x7fa5580047c0 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.141+0000 7fa5729b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c13d820 con 0x7fa56c13cd50 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56c13e300 0x7fa56c13c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56c13e300 0x7fa56c13c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39882/0 (socket says 172.21.15.113:39882) 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2029722189 learned_addr learned my addr 172.21.15.113:0/2029722189 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56bfff640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580047c0 0x7fa56c13c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa56c13cd50 msgr2=0x7fa56c15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa56c13cd50 0x7fa56c15fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580047c0 msgr2=0x7fa56c13c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580047c0 0x7fa56c13c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 -- 172.21.15.113:0/2029722189 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c13db00 con 0x7fa56c13e300 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56bfff640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580047c0 0x7fa56c13c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.142+0000 7fa56b7fe640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56c13e300 0x7fa56c13c810 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fa554001930 tx=0x7fa55402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.143+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55403c040 con 0x7fa56c13e300 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.143+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55402cd80 con 0x7fa56c13e300 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.143+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554007290 con 0x7fa56c13e300 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.143+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c13dde0 con 0x7fa56c13e300 2023-12-19T13:57:45.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.143+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c160210 con 0x7fa56c13e300 2023-12-19T13:57:45.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.144+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c13df70 con 0x7fa56c13e300 2023-12-19T13:57:45.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.145+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa554032070 con 0x7fa56c13e300 2023-12-19T13:57:45.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.146+0000 7fa568ff9640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54c06a430 0x7fa54c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.146+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5540a9d50 con 0x7fa56c13e300 2023-12-19T13:57:45.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.146+0000 7fa56bfff640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54c06a430 0x7fa54c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.146+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fa54c071f60 con 0x7fa56c13e300 2023-12-19T13:57:45.146 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.146+0000 7fa56bfff640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54c06a430 0x7fa54c06c8f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa55c007520 tx=0x7fa55c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:45.150 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.151+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5540ad030 con 0x7fa56c13e300 2023-12-19T13:57:45.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.339+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa56c061910 con 0x7fa56c13e300 2023-12-19T13:57:45.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.340+0000 7fa568ff9640 1 -- 172.21.15.113:0/2029722189 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v165) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa55407c020 con 0x7fa56c13e300 2023-12-19T13:57:45.340 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:57:45.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54c06a430 msgr2=0x7fa54c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54c06a430 0x7fa54c06c8f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa55c007520 tx=0x7fa55c00b040 comp rx=0 tx=0).stop 2023-12-19T13:57:45.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56c13e300 msgr2=0x7fa56c13c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56c13e300 0x7fa56c13c810 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fa554001930 tx=0x7fa55402e070 comp rx=0 tx=0).stop 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 shutdown_connections 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa54c06a430 0x7fa54c06c8f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa56c13cd50 0x7fa56c15fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa56c13e300 0x7fa56c13c810 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 --2- 172.21.15.113:0/2029722189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5580047c0 0x7fa56c13c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 >> 172.21.15.113:0/2029722189 conn(0x7fa56c0b29c0 msgr2=0x7fa56c0b7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.343+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 shutdown_connections 2023-12-19T13:57:45.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.344+0000 7fa5729b9640 1 -- 172.21.15.113:0/2029722189 wait complete. 2023-12-19T13:57:45.360 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:57:45.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.576+0000 7fbd9361a640 1 Processor -- start 2023-12-19T13:57:45.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.576+0000 7fbd9361a640 1 -- start start 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd9361a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd8c147210 0x7fbd8c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd9361a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c15da80 0x7fbd8c0b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd9361a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd8c0b6530 0x7fbd8c0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd9361a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c0b8790 con 0x7fbd8c147210 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd9361a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c15ea90 con 0x7fbd8c0b6530 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd9361a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c15df10 con 0x7fbd8c15da80 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd913b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd8c147210 0x7fbd8c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd913b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd8c147210 0x7fbd8c06fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39888/0 (socket says 172.21.15.113:39888) 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd913b6640 1 -- 172.21.15.113:0/3343350960 learned_addr learned my addr 172.21.15.113:0/3343350960 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd91bb7640 1 --2- 172.21.15.113:0/3343350960 >> v2:172.21.15.151:3300/0 conn(0x7fbd8c0b6530 0x7fbd8c0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.578+0000 7fbd90bb5640 1 --2- 172.21.15.113:0/3343350960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c15da80 0x7fbd8c0b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.579+0000 7fbd913b6640 1 -- 172.21.15.113:0/3343350960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c15da80 msgr2=0x7fbd8c0b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:45.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.579+0000 7fbd913b6640 1 --2- 172.21.15.113:0/3343350960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c15da80 0x7fbd8c0b7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.579+0000 7fbd913b6640 1 -- 172.21.15.113:0/3343350960 >> v2:172.21.15.151:3300/0 conn(0x7fbd8c0b6530 msgr2=0x7fbd8c0b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:45.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.579+0000 7fbd913b6640 1 --2- 172.21.15.113:0/3343350960 >> v2:172.21.15.151:3300/0 conn(0x7fbd8c0b6530 0x7fbd8c0b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.579+0000 7fbd913b6640 1 -- 172.21.15.113:0/3343350960 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c15e1f0 con 0x7fbd8c147210 2023-12-19T13:57:45.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.579+0000 7fbd91bb7640 1 --2- 172.21.15.113:0/3343350960 >> v2:172.21.15.151:3300/0 conn(0x7fbd8c0b6530 0x7fbd8c0b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:57:45.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.580+0000 7fbd913b6640 1 --2- 172.21.15.113:0/3343350960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c147210 0x7fbd8c06fef0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0d1000 tx=0x7fbd7c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacef0f0a5206999 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:45.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd8bfff640 1 -- 172.21.15.113:0/3343350960 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c02c9e0 con 0x7fbd8c147210 2023-12-19T13:57:45.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd8bfff640 1 -- 172.21.15.113:0/3343350960 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c02cb40 con 0x7fbd8c147210 2023-12-19T13:57:45.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd8bfff640 1 -- 172.21.15.113:0/3343350960 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c0343f0 con 0x7fbd8c147210 2023-12-19T13:57:45.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 -- 172.21.15.113:0/3343350960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c147210 msgr2=0x7fbd8c06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 --2- 172.21.15.113:0/3343350960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c147210 0x7fbd8c06fef0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0d1000 tx=0x7fbd7c02be40 comp rx=0 tx=0).stop 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 -- 172.21.15.113:0/3343350960 shutdown_connections 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 --2- 172.21.15.113:0/3343350960 >> v2:172.21.15.151:3300/0 conn(0x7fbd8c0b6530 0x7fbd8c0b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 --2- 172.21.15.113:0/3343350960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c15da80 0x7fbd8c0b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 --2- 172.21.15.113:0/3343350960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c147210 0x7fbd8c06fef0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 -- 172.21.15.113:0/3343350960 >> 172.21.15.113:0/3343350960 conn(0x7fbd8c0d3520 msgr2=0x7fbd8c0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 -- 172.21.15.113:0/3343350960 shutdown_connections 2023-12-19T13:57:45.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.581+0000 7fbd9361a640 1 -- 172.21.15.113:0/3343350960 wait complete. 2023-12-19T13:57:45.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.583+0000 7fbd9361a640 1 Processor -- start 2023-12-19T13:57:45.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.583+0000 7fbd9361a640 1 -- start start 2023-12-19T13:57:45.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd9361a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0b6530 0x7fbd8c1f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd9361a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c147210 0x7fbd8c13f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd9361a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15cfa0 0x7fbd8c1f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd9361a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c13ff60 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd9361a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0d1270 con 0x7fbd8c0b6530 2023-12-19T13:57:45.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd9361a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c13fcc0 con 0x7fbd8c147210 2023-12-19T13:57:45.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd91bb7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15cfa0 0x7fbd8c1f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.584+0000 7fbd91bb7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15cfa0 0x7fbd8c1f3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39904/0 (socket says 172.21.15.113:39904) 2023-12-19T13:57:45.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd91bb7640 1 -- 172.21.15.113:0/541570669 learned_addr learned my addr 172.21.15.113:0/541570669 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:45.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd90bb5640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c147210 0x7fbd8c13f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd913b6640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0b6530 0x7fbd8c1f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd91bb7640 1 -- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c147210 msgr2=0x7fbd8c13f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd91bb7640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c147210 0x7fbd8c13f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd91bb7640 1 -- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0b6530 msgr2=0x7fbd8c1f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd91bb7640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0b6530 0x7fbd8c1f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd91bb7640 1 -- 172.21.15.113:0/541570669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c009b30 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd91bb7640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15cfa0 0x7fbd8c1f3720 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400e4e0 tx=0x7fbd8400e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84013610 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd84013770 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c0d1510 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.585+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84013b00 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.586+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c0d1ad0 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.587+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c0d1cf0 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.588+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd84013c60 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.589+0000 7fbd89ffb640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7806a430 0x7fbd7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:45.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.589+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd84088520 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.589+0000 7fbd913b6640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7806a430 0x7fbd7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:45.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.589+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fbd78071f60 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.590+0000 7fbd913b6640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7806a430 0x7fbd7806c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c035000 tx=0x7fbd7c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:45.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.593+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbd84053b10 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.785+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd8c061910 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.786+0000 7fbd89ffb640 1 -- 172.21.15.113:0/541570669 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v165) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd84021020 con 0x7fbd8c15cfa0 2023-12-19T13:57:45.785 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7806a430 msgr2=0x7fbd7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7806a430 0x7fbd7806c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c035000 tx=0x7fbd7c030000 comp rx=0 tx=0).stop 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15cfa0 msgr2=0x7fbd8c1f3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15cfa0 0x7fbd8c1f3720 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400e4e0 tx=0x7fbd8400e9a0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 shutdown_connections 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7806a430 0x7fbd7806c8f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15cfa0 0x7fbd8c1f3720 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c147210 0x7fbd8c13f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 --2- 172.21.15.113:0/541570669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c0b6530 0x7fbd8c1f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:45.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 >> 172.21.15.113:0/541570669 conn(0x7fbd8c0d3520 msgr2=0x7fbd8c0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:45.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 shutdown_connections 2023-12-19T13:57:45.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:45.789+0000 7fbd9361a640 1 -- 172.21.15.113:0/541570669 wait complete. 2023-12-19T13:57:45.807 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:57:46.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.013+0000 7f5346d9f640 1 Processor -- start 2023-12-19T13:57:46.013 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.013+0000 7f5346d9f640 1 -- start start 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.014+0000 7f5346d9f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f53400d2b00 0x7f53400d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f5346d9f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f53400ce110 0x7f53400ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f5346d9f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400cd840 con 0x7f5340146e10 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f5346d9f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53400d2430 con 0x7f53400d2b00 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f5346d9f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53400ceac0 con 0x7f53400ce110 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f5344b3b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5340146e10 0x7f53400b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37272/0 (socket says 172.21.15.113:37272) 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f5344b3b640 1 -- 172.21.15.113:0/3360557468 learned_addr learned my addr 172.21.15.113:0/3360557468 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:46.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f533ffff640 1 --2- 172.21.15.113:0/3360557468 >> v2:172.21.15.113:3300/0 conn(0x7f53400d2b00 0x7f53400d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f534533c640 1 --2- 172.21.15.113:0/3360557468 >> v2:172.21.15.151:3300/0 conn(0x7f53400ce110 0x7f53400ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f533f7fe640 1 -- 172.21.15.113:0/3360557468 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561933953 0 0) 0x7f53400cd840 con 0x7f5340146e10 2023-12-19T13:57:46.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f533ffff640 1 -- 172.21.15.113:0/3360557468 >> v2:172.21.15.151:3300/0 conn(0x7f53400ce110 msgr2=0x7f53400ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:46.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f533ffff640 1 --2- 172.21.15.113:0/3360557468 >> v2:172.21.15.151:3300/0 conn(0x7f53400ce110 0x7f53400ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f533ffff640 1 -- 172.21.15.113:0/3360557468 >> v1:172.21.15.113:6789/0 conn(0x7f5340146e10 legacy=0x7f53400b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.015+0000 7f533ffff640 1 -- 172.21.15.113:0/3360557468 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400b6e90 con 0x7f53400d2b00 2023-12-19T13:57:46.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.016+0000 7f534533c640 1 --2- 172.21.15.113:0/3360557468 >> v2:172.21.15.151:3300/0 conn(0x7f53400ce110 0x7f53400ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:46.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.017+0000 7f533ffff640 1 --2- 172.21.15.113:0/3360557468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400d2b00 0x7f53400d1ef0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f53400cedb0 tx=0x7f532c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a14c7bc2c3f3fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.017+0000 7f533f7fe640 1 -- 172.21.15.113:0/3360557468 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c02e070 con 0x7f53400d2b00 2023-12-19T13:57:46.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.017+0000 7f533f7fe640 1 -- 172.21.15.113:0/3360557468 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c0315a0 con 0x7f53400d2b00 2023-12-19T13:57:46.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.017+0000 7f533f7fe640 1 -- 172.21.15.113:0/3360557468 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c031930 con 0x7f53400d2b00 2023-12-19T13:57:46.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 -- 172.21.15.113:0/3360557468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400d2b00 msgr2=0x7f53400d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 --2- 172.21.15.113:0/3360557468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400d2b00 0x7f53400d1ef0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f53400cedb0 tx=0x7f532c02b840 comp rx=0 tx=0).stop 2023-12-19T13:57:46.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 -- 172.21.15.113:0/3360557468 shutdown_connections 2023-12-19T13:57:46.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 --2- 172.21.15.113:0/3360557468 >> v2:172.21.15.151:3300/0 conn(0x7f53400ce110 0x7f53400ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 --2- 172.21.15.113:0/3360557468 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400d2b00 0x7f53400d1ef0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 -- 172.21.15.113:0/3360557468 >> 172.21.15.113:0/3360557468 conn(0x7f53400b29c0 msgr2=0x7f53400b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:46.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 -- 172.21.15.113:0/3360557468 shutdown_connections 2023-12-19T13:57:46.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.018+0000 7f5346d9f640 1 -- 172.21.15.113:0/3360557468 wait complete. 2023-12-19T13:57:46.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.020+0000 7f5346d9f640 1 Processor -- start 2023-12-19T13:57:46.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.020+0000 7f5346d9f640 1 -- start start 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5346d9f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400ce110 0x7f534015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5346d9f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53400d2b00 0x7f53401436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5346d9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5340146e10 0x7f5340070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5346d9f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534015c550 con 0x7f53400ce110 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5346d9f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5340143c10 con 0x7f53400d2b00 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5346d9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53400cd2c0 con 0x7f5340146e10 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5344b3b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400ce110 0x7f534015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5344b3b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400ce110 0x7f534015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39916/0 (socket says 172.21.15.113:39916) 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5344b3b640 1 -- 172.21.15.113:0/683377587 learned_addr learned my addr 172.21.15.113:0/683377587 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5344b3b640 1 -- 172.21.15.113:0/683377587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5340146e10 msgr2=0x7f5340070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5344b3b640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5340146e10 0x7f5340070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.021+0000 7f5344b3b640 1 -- 172.21.15.113:0/683377587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53400d2b00 msgr2=0x7f53401436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f533ffff640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53400d2b00 0x7f53401436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f5344b3b640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53400d2b00 0x7f53401436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f5344b3b640 1 -- 172.21.15.113:0/683377587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c009400 con 0x7f53400ce110 2023-12-19T13:57:46.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f5344b3b640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400ce110 0x7f534015bcb0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f533400c4d0 tx=0x7f533400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340074e0 con 0x7f53400ce110 2023-12-19T13:57:46.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334007660 con 0x7f53400ce110 2023-12-19T13:57:46.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334004a20 con 0x7f53400ce110 2023-12-19T13:57:46.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53400cc990 con 0x7f53400ce110 2023-12-19T13:57:46.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.022+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53400ccf50 con 0x7f53400ce110 2023-12-19T13:57:46.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.024+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340061910 con 0x7f53400ce110 2023-12-19T13:57:46.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.024+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5334004b80 con 0x7f53400ce110 2023-12-19T13:57:46.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.025+0000 7f533d7fa640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f532406a430 0x7f532406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.025+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5334087af0 con 0x7f53400ce110 2023-12-19T13:57:46.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.025+0000 7f533ffff640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f532406a430 0x7f532406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.026+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f5324071f60 con 0x7f53400ce110 2023-12-19T13:57:46.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.026+0000 7f533ffff640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f532406a430 0x7f532406c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f532c036000 tx=0x7f532c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.029+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5334018020 con 0x7f53400ce110 2023-12-19T13:57:46.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.256+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53400d2100 con 0x7f53400ce110 2023-12-19T13:57:46.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.257+0000 7f533d7fa640 1 -- 172.21.15.113:0/683377587 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f5334018070 con 0x7f53400ce110 2023-12-19T13:57:46.257 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:46.257 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:55:23.075987+0000","modified":"2023-12-19T13:55:26.098528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8268":{"gid":8268,"name":"d","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1201018731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1201018731},{"type":"v1","addr":"172.21.15.151:6833","nonce":1201018731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T13:57:46.257 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 72 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f532406a430 msgr2=0x7f532406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f532406a430 0x7f532406c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f532c036000 tx=0x7f532c03d040 comp rx=0 tx=0).stop 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400ce110 msgr2=0x7f534015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400ce110 0x7f534015bcb0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f533400c4d0 tx=0x7f533400c990 comp rx=0 tx=0).stop 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 shutdown_connections 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f532406a430 0x7f532406c8f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5340146e10 0x7f5340070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53400d2b00 0x7f53401436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 --2- 172.21.15.113:0/683377587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53400ce110 0x7f534015bcb0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.260+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 >> 172.21.15.113:0/683377587 conn(0x7f53400b29c0 msgr2=0x7f53400b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:46.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.261+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 shutdown_connections 2023-12-19T13:57:46.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.261+0000 7f5346d9f640 1 -- 172.21.15.113:0/683377587 wait complete. 2023-12-19T13:57:46.277 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:57:46.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.487+0000 7f1767d73640 1 Processor -- start 2023-12-19T13:57:46.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.487+0000 7f1767d73640 1 -- start start 2023-12-19T13:57:46.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f1767d73640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1760157aa0 0x7f17600b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f1767d73640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f176006e410 0x7f1760161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f1767d73640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176006e8c0 con 0x7f1760161540 2023-12-19T13:57:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f1767d73640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600b2600 con 0x7f176006e410 2023-12-19T13:57:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f1767d73640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600b1d60 con 0x7f1760157aa0 2023-12-19T13:57:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f176530e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f176006e410 0x7f1760161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f176530e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f176006e410 0x7f1760161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39920/0 (socket says 172.21.15.113:39920) 2023-12-19T13:57:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.489+0000 7f176530e640 1 -- 172.21.15.113:0/846904559 learned_addr learned my addr 172.21.15.113:0/846904559 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.490+0000 7f1765b0f640 1 --2- 172.21.15.113:0/846904559 >> v2:172.21.15.151:3300/0 conn(0x7f1760157aa0 0x7f17600b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.490+0000 7f176530e640 1 -- 172.21.15.113:0/846904559 >> v2:172.21.15.151:3300/0 conn(0x7f1760157aa0 msgr2=0x7f17600b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.490+0000 7f176530e640 1 --2- 172.21.15.113:0/846904559 >> v2:172.21.15.151:3300/0 conn(0x7f1760157aa0 0x7f17600b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.490+0000 7f176530e640 1 -- 172.21.15.113:0/846904559 >> v1:172.21.15.151:6789/0 conn(0x7f1760161540 legacy=0x7f176015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.490+0000 7f176530e640 1 -- 172.21.15.113:0/846904559 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600b2040 con 0x7f176006e410 2023-12-19T13:57:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.491+0000 7f176530e640 1 --2- 172.21.15.113:0/846904559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f176006e410 0x7f1760161000 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f176006db00 tx=0x7f175002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7cd6d27407527 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.491+0000 7f1764b0d640 1 -- 172.21.15.113:0/846904559 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750031860 con 0x7f176006e410 2023-12-19T13:57:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.491+0000 7f1764b0d640 1 -- 172.21.15.113:0/846904559 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17500319c0 con 0x7f176006e410 2023-12-19T13:57:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.491+0000 7f1764b0d640 1 -- 172.21.15.113:0/846904559 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750031d50 con 0x7f176006e410 2023-12-19T13:57:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 -- 172.21.15.113:0/846904559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f176006e410 msgr2=0x7f1760161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 --2- 172.21.15.113:0/846904559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f176006e410 0x7f1760161000 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f176006db00 tx=0x7f175002b900 comp rx=0 tx=0).stop 2023-12-19T13:57:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 -- 172.21.15.113:0/846904559 shutdown_connections 2023-12-19T13:57:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 --2- 172.21.15.113:0/846904559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f176006e410 0x7f1760161000 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 --2- 172.21.15.113:0/846904559 >> v2:172.21.15.151:3300/0 conn(0x7f1760157aa0 0x7f17600b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 -- 172.21.15.113:0/846904559 >> 172.21.15.113:0/846904559 conn(0x7f17600cbb70 msgr2=0x7f17600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 -- 172.21.15.113:0/846904559 shutdown_connections 2023-12-19T13:57:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.492+0000 7f1767d73640 1 -- 172.21.15.113:0/846904559 wait complete. 2023-12-19T13:57:46.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.494+0000 7f1767d73640 1 Processor -- start 2023-12-19T13:57:46.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.494+0000 7f1767d73640 1 -- start start 2023-12-19T13:57:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1767d73640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f176006e410 0x7f176014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1767d73640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1760157aa0 0x7f17601546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1767d73640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1760161540 0x7f1760154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1767d73640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17601f48b0 con 0x7f1760161540 2023-12-19T13:57:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1767d73640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17601f3970 con 0x7f176006e410 2023-12-19T13:57:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1767d73640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17601f3c30 con 0x7f1760157aa0 2023-12-19T13:57:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1766310640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1760161540 0x7f1760154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1766310640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1760161540 0x7f1760154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39934/0 (socket says 172.21.15.113:39934) 2023-12-19T13:57:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.495+0000 7f1766310640 1 -- 172.21.15.113:0/1846790814 learned_addr learned my addr 172.21.15.113:0/1846790814 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f176530e640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1760157aa0 0x7f17601546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f1765b0f640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f176006e410 0x7f176014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f1766310640 1 -- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1760157aa0 msgr2=0x7f17601546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f1766310640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1760157aa0 0x7f17601546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f1766310640 1 -- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f176006e410 msgr2=0x7f176014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f1766310640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f176006e410 0x7f176014ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f1766310640 1 -- 172.21.15.113:0/1846790814 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500094d0 con 0x7f1760161540 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f176530e640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1760157aa0 0x7f17601546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f1766310640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1760161540 0x7f1760154c10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f175800b9e0 tx=0x7f175800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800cb20 con 0x7f1760161540 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800cc80 con 0x7f1760161540 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.496+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758014440 con 0x7f1760161540 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.497+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17601f3f10 con 0x7f1760161540 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.497+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17601f44d0 con 0x7f1760161540 2023-12-19T13:57:46.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.498+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1760061910 con 0x7f1760161540 2023-12-19T13:57:46.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.499+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f175801d3b0 con 0x7f1760161540 2023-12-19T13:57:46.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.499+0000 7f17567fc640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f174406a430 0x7f174406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.499+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1758088870 con 0x7f1760161540 2023-12-19T13:57:46.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.500+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f1744071f60 con 0x7f1760161540 2023-12-19T13:57:46.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.500+0000 7f1765b0f640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f174406a430 0x7f174406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.500+0000 7f1765b0f640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f174406a430 0x7f174406c8f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f175c006fd0 tx=0x7f175c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.504+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1758019020 con 0x7f1760161540 2023-12-19T13:57:46.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.699+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f176015b410 con 0x7f1760161540 2023-12-19T13:57:46.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.701+0000 7f17567fc640 1 -- 172.21.15.113:0/1846790814 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f1758053e50 con 0x7f1760161540 2023-12-19T13:57:46.701 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:46.701 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":165,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:56:58.643456+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f174406a430 msgr2=0x7f174406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f174406a430 0x7f174406c8f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f175c006fd0 tx=0x7f175c008040 comp rx=0 tx=0).stop 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1760161540 msgr2=0x7f1760154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1760161540 0x7f1760154c10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f175800b9e0 tx=0x7f175800bea0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 shutdown_connections 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f174406a430 0x7f174406c8f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1760161540 0x7f1760154c10 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1760157aa0 0x7f17601546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 --2- 172.21.15.113:0/1846790814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f176006e410 0x7f176014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.704+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 >> 172.21.15.113:0/1846790814 conn(0x7f17600cbb70 msgr2=0x7f17600cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:46.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.705+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 shutdown_connections 2023-12-19T13:57:46.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.705+0000 7f1767d73640 1 -- 172.21.15.113:0/1846790814 wait complete. 2023-12-19T13:57:46.722 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:57:46.722 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:57:46.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.922+0000 7f9ffa00b640 1 Processor -- start 2023-12-19T13:57:46.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.922+0000 7f9ffa00b640 1 -- start start 2023-12-19T13:57:46.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.923+0000 7f9ffa00b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ff4157bf0 0x7f9ff415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.924+0000 7f9ffa00b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40ae110 0x7f9ff40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.924+0000 7f9ffa00b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40b0a90 con 0x7f9ff40b0640 2023-12-19T13:57:46.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.924+0000 7f9ffa00b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff406b8c0 con 0x7f9ff4157bf0 2023-12-19T13:57:46.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.924+0000 7f9ffa00b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff415b740 con 0x7f9ff40ae110 2023-12-19T13:57:46.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.924+0000 7f9febfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40ae110 0x7f9ff40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.924+0000 7f9ff37fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ff4157bf0 0x7f9ff415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.925+0000 7f9febfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40ae110 0x7f9ff40b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:50496/0 (socket says 172.21.15.113:50496) 2023-12-19T13:57:46.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.925+0000 7f9febfff640 1 -- 172.21.15.113:0/2362213070 learned_addr learned my addr 172.21.15.113:0/2362213070 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:46.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.925+0000 7f9febfff640 1 -- 172.21.15.113:0/2362213070 >> v2:172.21.15.151:3300/0 conn(0x7f9ff4157bf0 msgr2=0x7f9ff415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:46.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.925+0000 7f9febfff640 1 --2- 172.21.15.113:0/2362213070 >> v2:172.21.15.151:3300/0 conn(0x7f9ff4157bf0 0x7f9ff415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.925+0000 7f9febfff640 1 -- 172.21.15.113:0/2362213070 >> v1:172.21.15.151:6789/0 conn(0x7f9ff40b0640 legacy=0x7f9ff415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.925+0000 7f9febfff640 1 -- 172.21.15.113:0/2362213070 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40ae640 con 0x7f9ff40ae110 2023-12-19T13:57:46.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.925+0000 7f9ff37fe640 1 --2- 172.21.15.113:0/2362213070 >> v2:172.21.15.151:3300/0 conn(0x7f9ff4157bf0 0x7f9ff415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:57:46.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.927+0000 7f9febfff640 1 --2- 172.21.15.113:0/2362213070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40ae110 0x7f9ff40b0100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009870 tx=0x7f9fdc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ce2fa097f99413 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ff2ffd640 1 -- 172.21.15.113:0/2362213070 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc030840 con 0x7f9ff40ae110 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ff2ffd640 1 -- 172.21.15.113:0/2362213070 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0309a0 con 0x7f9ff40ae110 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ff2ffd640 1 -- 172.21.15.113:0/2362213070 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc030d30 con 0x7f9ff40ae110 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 -- 172.21.15.113:0/2362213070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40ae110 msgr2=0x7f9ff40b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/2362213070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40ae110 0x7f9ff40b0100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009870 tx=0x7f9fdc02b980 comp rx=0 tx=0).stop 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 -- 172.21.15.113:0/2362213070 shutdown_connections 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/2362213070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40ae110 0x7f9ff40b0100 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/2362213070 >> v2:172.21.15.151:3300/0 conn(0x7f9ff4157bf0 0x7f9ff415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 -- 172.21.15.113:0/2362213070 >> 172.21.15.113:0/2362213070 conn(0x7f9ff40cbb70 msgr2=0x7f9ff40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:46.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 -- 172.21.15.113:0/2362213070 shutdown_connections 2023-12-19T13:57:46.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.928+0000 7f9ffa00b640 1 -- 172.21.15.113:0/2362213070 wait complete. 2023-12-19T13:57:46.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.930+0000 7f9ffa00b640 1 Processor -- start 2023-12-19T13:57:46.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.930+0000 7f9ffa00b640 1 -- start start 2023-12-19T13:57:46.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.931+0000 7f9ffa00b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ff40ae110 0x7f9ff4146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.931+0000 7f9ffa00b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40b0640 0x7f9ff40ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.931+0000 7f9ffa00b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff4157bf0 0x7f9ff415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.931+0000 7f9ffa00b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40a84a0 con 0x7f9ff40ae110 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.931+0000 7f9ffa00b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff41473b0 con 0x7f9ff4157bf0 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.931+0000 7f9ffa00b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40ace10 con 0x7f9ff40b0640 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ff40ae110 0x7f9ff4146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ff40ae110 0x7f9ff4146e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39940/0 (socket says 172.21.15.113:39940) 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 -- 172.21.15.113:0/1157515240 learned_addr learned my addr 172.21.15.113:0/1157515240 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9febfff640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40b0640 0x7f9ff40ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff3fff640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff4157bf0 0x7f9ff415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 -- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40b0640 msgr2=0x7f9ff40ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40b0640 0x7f9ff40ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 -- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff4157bf0 msgr2=0x7f9ff415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff4157bf0 0x7f9ff415a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff37fe640 1 -- 172.21.15.113:0/1157515240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009400 con 0x7f9ff40ae110 2023-12-19T13:57:46.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9febfff640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40b0640 0x7f9ff40ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:46.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.932+0000 7f9ff3fff640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff4157bf0 0x7f9ff415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:46.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.933+0000 7f9ff37fe640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ff40ae110 0x7f9ff4146e70 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400e960 tx=0x7f9fe400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.933+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400ca00 con 0x7f9ff40ae110 2023-12-19T13:57:46.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.933+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe400cb60 con 0x7f9ff40ae110 2023-12-19T13:57:46.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.933+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc0094d0 con 0x7f9ff40ae110 2023-12-19T13:57:46.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.933+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4013470 con 0x7f9ff40ae110 2023-12-19T13:57:46.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.933+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff40ad3d0 con 0x7f9ff40ae110 2023-12-19T13:57:46.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.934+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff4061910 con 0x7f9ff40ae110 2023-12-19T13:57:46.934 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.935+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fe40135d0 con 0x7f9ff40ae110 2023-12-19T13:57:46.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.936+0000 7f9ff0ff9640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fd406a430 0x7f9fd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:46.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.936+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fe4088c70 con 0x7f9ff40ae110 2023-12-19T13:57:46.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.936+0000 7f9febfff640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fd406a430 0x7f9fd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:46.935 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.936+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f9fd4071f60 con 0x7f9ff40ae110 2023-12-19T13:57:46.936 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.937+0000 7f9febfff640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fd406a430 0x7f9fd406c8f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc036000 tx=0x7f9fdc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:46.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:46.940+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9fe4017060 con 0x7f9ff40ae110 2023-12-19T13:57:47.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.170+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ff4156ee0 con 0x7f9ff40ae110 2023-12-19T13:57:47.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.171+0000 7f9ff0ff9640 1 -- 172.21.15.113:0/1157515240 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f9fe4021070 con 0x7f9ff40ae110 2023-12-19T13:57:47.171 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:47.171 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:55:23.075987+0000","modified":"2023-12-19T13:55:26.098528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8268":{"gid":8268,"name":"d","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1201018731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1201018731},{"type":"v1","addr":"172.21.15.151:6833","nonce":1201018731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T13:57:47.171 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 72 2023-12-19T13:57:47.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fd406a430 msgr2=0x7f9fd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fd406a430 0x7f9fd406c8f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc036000 tx=0x7f9fdc03b040 comp rx=0 tx=0).stop 2023-12-19T13:57:47.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ff40ae110 msgr2=0x7f9ff4146e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ff40ae110 0x7f9ff4146e70 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400e960 tx=0x7f9fe400ee20 comp rx=0 tx=0).stop 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 shutdown_connections 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9fd406a430 0x7f9fd406c8f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff4157bf0 0x7f9ff415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ff40b0640 0x7f9ff40ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 --2- 172.21.15.113:0/1157515240 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ff40ae110 0x7f9ff4146e70 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 >> 172.21.15.113:0/1157515240 conn(0x7f9ff40cbb70 msgr2=0x7f9ff40ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 shutdown_connections 2023-12-19T13:57:47.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.174+0000 7f9ffa00b640 1 -- 172.21.15.113:0/1157515240 wait complete. 2023-12-19T13:57:47.192 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:57:47.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.399+0000 7fa0180f7640 1 Processor -- start 2023-12-19T13:57:47.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.400+0000 7fa0180f7640 1 -- start start 2023-12-19T13:57:47.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.401+0000 7fa0180f7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa010146e10 0x7fa0100d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.401+0000 7fa0180f7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0100d2b00 0x7fa0100b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.401+0000 7fa0180f7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100cd840 con 0x7fa0100ce110 2023-12-19T13:57:47.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.401+0000 7fa0180f7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100d2430 con 0x7fa010146e10 2023-12-19T13:57:47.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.401+0000 7fa0180f7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100d2620 con 0x7fa0100d2b00 2023-12-19T13:57:47.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015e93640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa010146e10 0x7fa0100d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015e93640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa010146e10 0x7fa0100d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39946/0 (socket says 172.21.15.113:39946) 2023-12-19T13:57:47.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015e93640 1 -- 172.21.15.113:0/1526374669 learned_addr learned my addr 172.21.15.113:0/1526374669 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015692640 1 --2- 172.21.15.113:0/1526374669 >> v2:172.21.15.151:3300/0 conn(0x7fa0100d2b00 0x7fa0100b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015e93640 1 -- 172.21.15.113:0/1526374669 >> v2:172.21.15.151:3300/0 conn(0x7fa0100d2b00 msgr2=0x7fa0100b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015e93640 1 --2- 172.21.15.113:0/1526374669 >> v2:172.21.15.151:3300/0 conn(0x7fa0100d2b00 0x7fa0100b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015e93640 1 -- 172.21.15.113:0/1526374669 >> v1:172.21.15.113:6789/0 conn(0x7fa0100ce110 legacy=0x7fa0100b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015e93640 1 -- 172.21.15.113:0/1526374669 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100b41c0 con 0x7fa010146e10 2023-12-19T13:57:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa015692640 1 --2- 172.21.15.113:0/1526374669 >> v2:172.21.15.151:3300/0 conn(0x7fa0100d2b00 0x7fa0100b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.402+0000 7fa014e91640 1 -- 172.21.15.113:0/1526374669 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566890079 0 0) 0x7fa0100cd840 con 0x7fa0100ce110 2023-12-19T13:57:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.403+0000 7fa015e93640 1 --2- 172.21.15.113:0/1526374669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa0100d1ef0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fa0100d3360 tx=0x7fa00c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50573e6c5e2ae9df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.403+0000 7fa014e91640 1 -- 172.21.15.113:0/1526374669 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c031870 con 0x7fa010146e10 2023-12-19T13:57:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.403+0000 7fa014e91640 1 -- 172.21.15.113:0/1526374669 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c0319d0 con 0x7fa010146e10 2023-12-19T13:57:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.403+0000 7fa014e91640 1 -- 172.21.15.113:0/1526374669 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c031d60 con 0x7fa010146e10 2023-12-19T13:57:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 -- 172.21.15.113:0/1526374669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 msgr2=0x7fa0100d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 --2- 172.21.15.113:0/1526374669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa0100d1ef0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fa0100d3360 tx=0x7fa00c02b910 comp rx=0 tx=0).stop 2023-12-19T13:57:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 -- 172.21.15.113:0/1526374669 shutdown_connections 2023-12-19T13:57:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 --2- 172.21.15.113:0/1526374669 >> v2:172.21.15.151:3300/0 conn(0x7fa0100d2b00 0x7fa0100b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 --2- 172.21.15.113:0/1526374669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa0100d1ef0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 -- 172.21.15.113:0/1526374669 >> 172.21.15.113:0/1526374669 conn(0x7fa0100b29c0 msgr2=0x7fa0100b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 -- 172.21.15.113:0/1526374669 shutdown_connections 2023-12-19T13:57:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.404+0000 7fa0180f7640 1 -- 172.21.15.113:0/1526374669 wait complete. 2023-12-19T13:57:47.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.406+0000 7fa0180f7640 1 Processor -- start 2023-12-19T13:57:47.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.406+0000 7fa0180f7640 1 -- start start 2023-12-19T13:57:47.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa0180f7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0100ce110 0x7fa01015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa0180f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0100d2b00 0x7fa010153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa0180f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa01013ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa0180f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010160550 con 0x7fa010146e10 2023-12-19T13:57:47.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa0180f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010153270 con 0x7fa0100d2b00 2023-12-19T13:57:47.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa0180f7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa010160970 con 0x7fa0100ce110 2023-12-19T13:57:47.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa016694640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa01013ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa016694640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa01013ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39952/0 (socket says 172.21.15.113:39952) 2023-12-19T13:57:47.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.407+0000 7fa016694640 1 -- 172.21.15.113:0/2216572783 learned_addr learned my addr 172.21.15.113:0/2216572783 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa015692640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0100d2b00 0x7fa010153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa015e93640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0100ce110 0x7fa01015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa016694640 1 -- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0100ce110 msgr2=0x7fa01015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa016694640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0100ce110 0x7fa01015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa016694640 1 -- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0100d2b00 msgr2=0x7fa010153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa016694640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0100d2b00 0x7fa010153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa016694640 1 -- 172.21.15.113:0/2216572783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0094d0 con 0x7fa010146e10 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa015692640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0100d2b00 0x7fa010153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa016694640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa01013ca40 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c7e0 tx=0x7fa00800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008003da0 con 0x7fa010146e10 2023-12-19T13:57:47.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008005070 con 0x7fa010146e10 2023-12-19T13:57:47.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008005420 con 0x7fa010146e10 2023-12-19T13:57:47.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.408+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01015f8d0 con 0x7fa010146e10 2023-12-19T13:57:47.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.409+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01015fe90 con 0x7fa010146e10 2023-12-19T13:57:47.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.410+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa010160690 con 0x7fa010146e10 2023-12-19T13:57:47.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.410+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa008005580 con 0x7fa010146e10 2023-12-19T13:57:47.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.411+0000 7fa0067fc640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ff406a430 0x7f9ff406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.411+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0080881d0 con 0x7fa010146e10 2023-12-19T13:57:47.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.412+0000 7fa015e93640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ff406a430 0x7f9ff406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.412+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f9ff4071f60 con 0x7fa010146e10 2023-12-19T13:57:47.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.412+0000 7fa015e93640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ff406a430 0x7f9ff406c8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa00c036000 tx=0x7fa00c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:47.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.416+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa008017060 con 0x7fa010146e10 2023-12-19T13:57:47.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.645+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa010061910 con 0x7fa010146e10 2023-12-19T13:57:47.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.645+0000 7fa0067fc640 1 -- 172.21.15.113:0/2216572783 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fa010160690 con 0x7fa010146e10 2023-12-19T13:57:47.645 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:47.645 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:55:23.075987+0000","modified":"2023-12-19T13:55:26.098528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8268":{"gid":8268,"name":"d","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1201018731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1201018731},{"type":"v1","addr":"172.21.15.151:6833","nonce":1201018731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T13:57:47.645 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 72 2023-12-19T13:57:47.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ff406a430 msgr2=0x7f9ff406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ff406a430 0x7f9ff406c8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa00c036000 tx=0x7fa00c03c040 comp rx=0 tx=0).stop 2023-12-19T13:57:47.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 msgr2=0x7fa01013ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa01013ca40 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c7e0 tx=0x7fa00800cca0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 shutdown_connections 2023-12-19T13:57:47.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9ff406a430 0x7f9ff406c8f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa010146e10 0x7fa01013ca40 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0100d2b00 0x7fa010153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 --2- 172.21.15.113:0/2216572783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0100ce110 0x7fa01015f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 >> 172.21.15.113:0/2216572783 conn(0x7fa0100b29c0 msgr2=0x7fa01015b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:47.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 shutdown_connections 2023-12-19T13:57:47.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.648+0000 7fa0180f7640 1 -- 172.21.15.113:0/2216572783 wait complete. 2023-12-19T13:57:47.666 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:57:47.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.871+0000 7f6d15fb9640 1 Processor -- start 2023-12-19T13:57:47.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.871+0000 7f6d15fb9640 1 -- start start 2023-12-19T13:57:47.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d15fb9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6d101449e0 0x7f6d100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d15fb9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d100afb10 con 0x7f6d1006c6b0 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d15fb9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1006bb30 con 0x7f6d100b0b50 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d15fb9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d100b0070 con 0x7f6d101449e0 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d0f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6d101449e0 0x7f6d100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d0f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6d101449e0 0x7f6d100af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39966/0 (socket says 172.21.15.113:39966) 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d0f7fe640 1 -- 172.21.15.113:0/3476593225 learned_addr learned my addr 172.21.15.113:0/3476593225 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.873+0000 7f6d0ffff640 1 --1- 172.21.15.113:0/3476593225 >> v1:172.21.15.113:6789/0 conn(0x7f6d1006c6b0 0x7f6d100b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37284/0 (socket says 172.21.15.113:37284) 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.874+0000 7f6d0f7fe640 1 -- 172.21.15.113:0/3476593225 >> v1:172.21.15.151:6789/0 conn(0x7f6d100b0b50 legacy=0x7f6d1006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.874+0000 7f6d0f7fe640 1 -- 172.21.15.113:0/3476593225 >> v1:172.21.15.113:6789/0 conn(0x7f6d1006c6b0 legacy=0x7f6d100b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.874+0000 7f6d0f7fe640 1 -- 172.21.15.113:0/3476593225 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100b0350 con 0x7f6d101449e0 2023-12-19T13:57:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.875+0000 7f6d0f7fe640 1 --2- 172.21.15.113:0/3476593225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d101449e0 0x7f6d100af5d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009870 tx=0x7f6d0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d6c20ec1633258 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.875+0000 7f6d0e7fc640 1 -- 172.21.15.113:0/3476593225 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00030860 con 0x7f6d101449e0 2023-12-19T13:57:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.875+0000 7f6d0e7fc640 1 -- 172.21.15.113:0/3476593225 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000309c0 con 0x7f6d101449e0 2023-12-19T13:57:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.875+0000 7f6d0e7fc640 1 -- 172.21.15.113:0/3476593225 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00030d50 con 0x7f6d101449e0 2023-12-19T13:57:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.876+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3476593225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d101449e0 msgr2=0x7f6d100af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.876+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3476593225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d101449e0 0x7f6d100af5d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009870 tx=0x7f6d0002b9a0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.876+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3476593225 shutdown_connections 2023-12-19T13:57:47.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.876+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3476593225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d101449e0 0x7f6d100af5d0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.876+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3476593225 >> 172.21.15.113:0/3476593225 conn(0x7f6d100cbb70 msgr2=0x7f6d100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:47.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.876+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3476593225 shutdown_connections 2023-12-19T13:57:47.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.876+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3476593225 wait complete. 2023-12-19T13:57:47.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.878+0000 7f6d15fb9640 1 Processor -- start 2023-12-19T13:57:47.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.878+0000 7f6d15fb9640 1 -- start start 2023-12-19T13:57:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.879+0000 7f6d15fb9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d1006c6b0 0x7f6d10140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.879+0000 7f6d15fb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d100b0b50 0x7f6d1013a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.879+0000 7f6d15fb9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d101449e0 0x7f6d1013ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.879+0000 7f6d15fb9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1013c4e0 con 0x7f6d100b0b50 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.879+0000 7f6d15fb9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1013c7c0 con 0x7f6d1006c6b0 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.879+0000 7f6d15fb9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1013caa0 con 0x7f6d101449e0 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d100b0b50 0x7f6d1013a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d100b0b50 0x7f6d1013a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39970/0 (socket says 172.21.15.113:39970) 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 -- 172.21.15.113:0/3972696105 learned_addr learned my addr 172.21.15.113:0/3972696105 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0f7fe640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d1006c6b0 0x7f6d10140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 -- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d101449e0 msgr2=0x7f6d1013ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d101449e0 0x7f6d1013ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 -- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d1006c6b0 msgr2=0x7f6d10140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d1006c6b0 0x7f6d10140400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0effd640 1 -- 172.21.15.113:0/3972696105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000094d0 con 0x7f6d100b0b50 2023-12-19T13:57:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.880+0000 7f6d0f7fe640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d1006c6b0 0x7f6d10140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.881+0000 7f6d0effd640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d100b0b50 0x7f6d1013a920 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c430 tx=0x7f6d0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.881+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04011790 con 0x7f6d100b0b50 2023-12-19T13:57:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.881+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d040118f0 con 0x7f6d100b0b50 2023-12-19T13:57:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.881+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04011ce0 con 0x7f6d100b0b50 2023-12-19T13:57:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.881+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1013cd80 con 0x7f6d100b0b50 2023-12-19T13:57:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.881+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d10140940 con 0x7f6d100b0b50 2023-12-19T13:57:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.882+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1013dc30 con 0x7f6d100b0b50 2023-12-19T13:57:47.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.883+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d0401c460 con 0x7f6d100b0b50 2023-12-19T13:57:47.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.884+0000 7f6cf7fff640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6cfc06a430 0x7f6cfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:47.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.884+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d040888e0 con 0x7f6d100b0b50 2023-12-19T13:57:47.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.884+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7f6cfc071f60 con 0x7f6d100b0b50 2023-12-19T13:57:47.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.884+0000 7f6d0f7fe640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6cfc06a430 0x7f6cfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:47.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.885+0000 7f6d0f7fe640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6cfc06a430 0x7f6cfc06c8f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6d00036000 tx=0x7f6d0003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:47.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:47.889+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d1013dc30 con 0x7f6d100b0b50 2023-12-19T13:57:48.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.079+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d1013dc30 con 0x7f6d100b0b50 2023-12-19T13:57:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.081+0000 7f6cf7fff640 1 -- 172.21.15.113:0/3972696105 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f6d1013dc30 con 0x7f6d100b0b50 2023-12-19T13:57:48.080 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:48.080 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":165,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:56:58.643456+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:55:21.110175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T13:55:22.094456+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.083+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6cfc06a430 msgr2=0x7f6cfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.083+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6cfc06a430 0x7f6cfc06c8f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6d00036000 tx=0x7f6d0003b040 comp rx=0 tx=0).stop 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d100b0b50 msgr2=0x7f6d1013a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d100b0b50 0x7f6d1013a920 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c430 tx=0x7f6d0400c8f0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 shutdown_connections 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6cfc06a430 0x7f6cfc06c8f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d101449e0 0x7f6d1013ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6d100b0b50 0x7f6d1013a920 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 --2- 172.21.15.113:0/3972696105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d1006c6b0 0x7f6d10140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 >> 172.21.15.113:0/3972696105 conn(0x7f6d100cbb70 msgr2=0x7f6d100af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 shutdown_connections 2023-12-19T13:57:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.084+0000 7f6d15fb9640 1 -- 172.21.15.113:0/3972696105 wait complete. 2023-12-19T13:57:48.103 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:57:48.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.314+0000 7fcd68f01640 1 Processor -- start 2023-12-19T13:57:48.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.314+0000 7fcd68f01640 1 -- start start 2023-12-19T13:57:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.315+0000 7fcd68f01640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd640b0a00 0x7fcd6406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.315+0000 7fcd68f01640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6415c9c0 con 0x7fcd64155460 2023-12-19T13:57:48.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.315+0000 7fcd68f01640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6406d270 con 0x7fcd6406ca80 2023-12-19T13:57:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.315+0000 7fcd68f01640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6406d550 con 0x7fcd640b0a00 2023-12-19T13:57:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.316+0000 7fcd637fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcd64155460 0x7fcd640b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34680/0 (socket says 172.21.15.113:34680) 2023-12-19T13:57:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.316+0000 7fcd637fe640 1 -- 172.21.15.113:0/2883582396 learned_addr learned my addr 172.21.15.113:0/2883582396 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.316+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/2883582396 >> v2:172.21.15.151:3300/0 conn(0x7fcd640b0a00 0x7fcd6406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.316+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218255311 0 0) 0x7fcd6415c9c0 con 0x7fcd64155460 2023-12-19T13:57:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.316+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd50003520 con 0x7fcd64155460 2023-12-19T13:57:48.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1796655284 0 0) 0x7fcd50003520 con 0x7fcd64155460 2023-12-19T13:57:48.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 >> v2:172.21.15.151:3300/0 conn(0x7fcd640b0a00 msgr2=0x7fcd6406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:48.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 --2- 172.21.15.113:0/2883582396 >> v2:172.21.15.151:3300/0 conn(0x7fcd640b0a00 0x7fcd6406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 >> v1:172.21.15.151:6789/0 conn(0x7fcd6406ca80 legacy=0x7fcd640cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6406d830 con 0x7fcd64155460 2023-12-19T13:57:48.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fcd54001670 con 0x7fcd64155460 2023-12-19T13:57:48.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 >> v1:172.21.15.113:6789/0 conn(0x7fcd64155460 legacy=0x7fcd640b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd50003a30 0x7fcd50003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd500051d0 0x7fcd5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6406d550 con 0x7fcd500047c0 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5000c100 con 0x7fcd500051d0 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5000c2c0 con 0x7fcd50003a30 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd5bfff640 1 -- 172.21.15.113:0/2883582396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd50003a30 msgr2=0x7fcd50003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd50003a30 0x7fcd50003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd5bfff640 1 -- 172.21.15.113:0/2883582396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd500051d0 msgr2=0x7fcd5000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd500051d0 0x7fcd5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd5bfff640 1 -- 172.21.15.113:0/2883582396 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50003520 con 0x7fcd500047c0 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.317+0000 7fcd63fff640 1 -- 172.21.15.113:0/2883582396 reap_dead start 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.318+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009ac0 tx=0x7fcd500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be789a4945d30650 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c02c710 con 0x7fcd500047c0 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c02c870 con 0x7fcd500047c0 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd62ffd640 1 -- 172.21.15.113:0/2883582396 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c02cc00 con 0x7fcd500047c0 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd68f01640 1 -- 172.21.15.113:0/2883582396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 msgr2=0x7fcd50004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd68f01640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009ac0 tx=0x7fcd500057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd68f01640 1 -- 172.21.15.113:0/2883582396 shutdown_connections 2023-12-19T13:57:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd68f01640 1 --2- 172.21.15.113:0/2883582396 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd68f01640 1 -- 172.21.15.113:0/2883582396 >> 172.21.15.113:0/2883582396 conn(0x7fcd640659a0 msgr2=0x7fcd64065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.319+0000 7fcd68f01640 1 -- 172.21.15.113:0/2883582396 shutdown_connections 2023-12-19T13:57:48.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.320+0000 7fcd68f01640 1 -- 172.21.15.113:0/2883582396 wait complete. 2023-12-19T13:57:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.321+0000 7fcd68f01640 1 Processor -- start 2023-12-19T13:57:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.321+0000 7fcd68f01640 1 -- start start 2023-12-19T13:57:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.322+0000 7fcd68f01640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd64155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.322+0000 7fcd68f01640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd64070410 0x7fcd64156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.322+0000 7fcd68f01640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd64070890 0x7fcd64156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.322+0000 7fcd68f01640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641f6c00 con 0x7fcd500047c0 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.322+0000 7fcd68f01640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64156080 con 0x7fcd64070890 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.322+0000 7fcd68f01640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641f5ff0 con 0x7fcd64070410 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.322+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd64155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd64155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57700/0 (socket says 172.21.15.113:57700) 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 -- 172.21.15.113:0/153386296 learned_addr learned my addr 172.21.15.113:0/153386296 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd64070410 0x7fcd64156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 -- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd64070410 msgr2=0x7fcd64156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd63fff640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd64070890 0x7fcd64156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd64070410 0x7fcd64156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 -- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd64070890 msgr2=0x7fcd64156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd64070890 0x7fcd64156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 -- 172.21.15.113:0/153386296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd641f62d0 con 0x7fcd500047c0 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.323+0000 7fcd637fe640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd64155b40 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c730 tx=0x7fcd5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.324+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540072d0 con 0x7fcd500047c0 2023-12-19T13:57:48.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.324+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd54007430 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.324+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540047e0 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.324+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd641f65b0 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.324+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd641f5c80 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.325+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd64061910 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.326+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd54004940 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.327+0000 7fcd60ff9640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd4406a430 0x7fcd4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.327+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd54087db0 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.327+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd4406a430 0x7fcd4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.327+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fcd44071f60 con 0x7fcd500047c0 2023-12-19T13:57:48.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.328+0000 7fcd5bfff640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd4406a430 0x7fcd4406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c036000 tx=0x7fcd4c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:48.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.331+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcd54018020 con 0x7fcd500047c0 2023-12-19T13:57:48.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.553+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcd640afaf0 con 0x7fcd500047c0 2023-12-19T13:57:48.554 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:57:48.555+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:57:48.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.560+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(166..166 src has 1..166) v4 ==== 374+0+0 (secure 0 0 0) 0x7fcd54056fc0 con 0x7fcd500047c0 2023-12-19T13:57:48.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.560+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7fcd44072810 con 0x7fcd500047c0 2023-12-19T13:57:48.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.573+0000 7fcd60ff9640 1 -- 172.21.15.113:0/153386296 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcd5408c070 con 0x7fcd500047c0 2023-12-19T13:57:48.572 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:57:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd4406a430 msgr2=0x7fcd4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd4406a430 0x7fcd4406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c036000 tx=0x7fcd4c030000 comp rx=0 tx=0).stop 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 msgr2=0x7fcd64155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd64155b40 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c730 tx=0x7fcd5400cbf0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 shutdown_connections 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcd4406a430 0x7fcd4406c8f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd64070890 0x7fcd64156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd64070410 0x7fcd64156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 --2- 172.21.15.113:0/153386296 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd500047c0 0x7fcd64155b40 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 >> 172.21.15.113:0/153386296 conn(0x7fcd640659a0 msgr2=0x7fcd6406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.575+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 shutdown_connections 2023-12-19T13:57:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.576+0000 7fcd68f01640 1 -- 172.21.15.113:0/153386296 wait complete. 2023-12-19T13:57:48.593 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:57:48.691 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:57:48.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.801+0000 7f352d5ab640 1 Processor -- start 2023-12-19T13:57:48.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.802+0000 7f352d5ab640 1 -- start start 2023-12-19T13:57:48.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.803+0000 7f352d5ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f35280ceb30 0x7f35280b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.803+0000 7f352d5ab640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35280af110 con 0x7f352815a190 2023-12-19T13:57:48.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.804+0000 7f352d5ab640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35280ad960 con 0x7f35280b02b0 2023-12-19T13:57:48.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.804+0000 7f352d5ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35280b0c80 con 0x7f35280ceb30 2023-12-19T13:57:48.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.804+0000 7f3526ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f352815a190 0x7f35280aea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34684/0 (socket says 172.21.15.113:34684) 2023-12-19T13:57:48.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.804+0000 7f3526ffd640 1 -- 172.21.15.113:0/203599564 learned_addr learned my addr 172.21.15.113:0/203599564 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.804+0000 7f35277fe640 1 --2- 172.21.15.113:0/203599564 >> v2:172.21.15.151:3300/0 conn(0x7f35280ceb30 0x7f35280b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.804+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143506399 0 0) 0x7f35280af110 con 0x7f352815a190 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.804+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3514003520 con 0x7f352815a190 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265669503 0 0) 0x7f3514003520 con 0x7f352815a190 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 >> v2:172.21.15.151:3300/0 conn(0x7f35280ceb30 msgr2=0x7f35280b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 --2- 172.21.15.113:0/203599564 >> v2:172.21.15.151:3300/0 conn(0x7f35280ceb30 0x7f35280b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 >> v1:172.21.15.151:6789/0 conn(0x7f35280b02b0 legacy=0x7f35280ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280adc40 con 0x7f352815a190 2023-12-19T13:57:48.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3518001670 con 0x7f352815a190 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 >> v1:172.21.15.113:6789/0 conn(0x7f352815a190 legacy=0x7f35280aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35140039e0 0x7f3514003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140047c0 0x7f3514004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35140051f0 0x7f351400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280b0c80 con 0x7f35140039e0 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351400e360 con 0x7f35140047c0 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351400e520 con 0x7f35140051f0 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f3526ffd640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35140039e0 0x7f3514003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f3526ffd640 1 -- 172.21.15.113:0/203599564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35140051f0 msgr2=0x7f351400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f3526ffd640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35140051f0 0x7f351400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f3526ffd640 1 -- 172.21.15.113:0/203599564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140047c0 msgr2=0x7f3514004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f3526ffd640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140047c0 0x7f3514004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.805+0000 7f3526ffd640 1 -- 172.21.15.113:0/203599564 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514003520 con 0x7f35140039e0 2023-12-19T13:57:48.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.806+0000 7f35277fe640 1 -- 172.21.15.113:0/203599564 reap_dead start 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.806+0000 7f3526ffd640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35140039e0 0x7f3514003e00 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f351800c190 tx=0x7f35140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4768ce43c5d979db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518005ad0 con 0x7f35140039e0 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3518005c30 con 0x7f35140039e0 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f35267fc640 1 -- 172.21.15.113:0/203599564 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351802ca00 con 0x7f35140039e0 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f352d5ab640 1 -- 172.21.15.113:0/203599564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35140039e0 msgr2=0x7f3514003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f352d5ab640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35140039e0 0x7f3514003e00 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f351800c190 tx=0x7f35140057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f352d5ab640 1 -- 172.21.15.113:0/203599564 shutdown_connections 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f352d5ab640 1 --2- 172.21.15.113:0/203599564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35140039e0 0x7f3514003e00 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f352d5ab640 1 -- 172.21.15.113:0/203599564 >> 172.21.15.113:0/203599564 conn(0x7f3528066160 msgr2=0x7f35280cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.807+0000 7f352d5ab640 1 -- 172.21.15.113:0/203599564 shutdown_connections 2023-12-19T13:57:48.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.808+0000 7f352d5ab640 1 -- 172.21.15.113:0/203599564 wait complete. 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.809+0000 7f352d5ab640 1 Processor -- start 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.809+0000 7f352d5ab640 1 -- start start 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f352d5ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140039e0 0x7f3528158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f352d5ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f352815bce0 0x7f3528145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f352d5ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35281e3d70 0x7f35281e41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f352d5ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35281e4730 con 0x7f35281e3d70 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f352d5ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352815d040 con 0x7f35140039e0 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f352d5ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352815c160 con 0x7f352815bce0 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f35277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35281e3d70 0x7f35281e41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f35277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35281e3d70 0x7f35281e41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57720/0 (socket says 172.21.15.113:57720) 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.810+0000 7f35277fe640 1 -- 172.21.15.113:0/3529985621 learned_addr learned my addr 172.21.15.113:0/3529985621 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f3526ffd640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140039e0 0x7f3528158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f35277fe640 1 -- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f352815bce0 msgr2=0x7f3528145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f35277fe640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f352815bce0 0x7f3528145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f35277fe640 1 -- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140039e0 msgr2=0x7f3528158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f35277fe640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140039e0 0x7f3528158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f35277fe640 1 -- 172.21.15.113:0/3529985621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528157520 con 0x7f35281e3d70 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f3526ffd640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140039e0 0x7f3528158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f35277fe640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35281e3d70 0x7f35281e41f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f35280cad00 tx=0x7f352000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f351ffff640 1 -- 172.21.15.113:0/3529985621 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520010040 con 0x7f35281e3d70 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f351ffff640 1 -- 172.21.15.113:0/3529985621 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000bd10 con 0x7f35281e3d70 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352815c430 con 0x7f35281e3d70 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.811+0000 7f351ffff640 1 -- 172.21.15.113:0/3529985621 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520014640 con 0x7f35281e3d70 2023-12-19T13:57:48.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.812+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352815c9f0 con 0x7f35281e3d70 2023-12-19T13:57:48.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.812+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352815d1d0 con 0x7f35281e3d70 2023-12-19T13:57:48.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.813+0000 7f351ffff640 1 -- 172.21.15.113:0/3529985621 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f35200147a0 con 0x7f35281e3d70 2023-12-19T13:57:48.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.814+0000 7f351ffff640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f350806a430 0x7f350806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:48.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.815+0000 7f351ffff640 1 -- 172.21.15.113:0/3529985621 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3520088d40 con 0x7f35281e3d70 2023-12-19T13:57:48.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.815+0000 7f3526ffd640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f350806a430 0x7f350806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:48.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.815+0000 7f3526ffd640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f350806a430 0x7f350806c8f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3518034000 tx=0x7f3518009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:48.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:48.819+0000 7f351ffff640 1 -- 172.21.15.113:0/3529985621 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3520054230 con 0x7f35281e3d70 2023-12-19T13:57:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.044+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3528061910 con 0x7f35281e3d70 2023-12-19T13:57:49.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.685+0000 7f351ffff640 1 -- 172.21.15.113:0/3529985621 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3520057850 con 0x7f35281e3d70 2023-12-19T13:57:49.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.688+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f350806a430 msgr2=0x7f350806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:49.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.688+0000 7f352d5ab640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f350806a430 0x7f350806c8f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3518034000 tx=0x7f3518009030 comp rx=0 tx=0).stop 2023-12-19T13:57:49.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.688+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35281e3d70 msgr2=0x7f35281e41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:49.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.688+0000 7f352d5ab640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35281e3d70 0x7f35281e41f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f35280cad00 tx=0x7f352000b480 comp rx=0 tx=0).stop 2023-12-19T13:57:49.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 shutdown_connections 2023-12-19T13:57:49.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f350806a430 0x7f350806c8f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:49.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35281e3d70 0x7f35281e41f0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:49.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f352815bce0 0x7f3528145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:49.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 --2- 172.21.15.113:0/3529985621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35140039e0 0x7f3528158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:49.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 >> 172.21.15.113:0/3529985621 conn(0x7f3528066160 msgr2=0x7f3528070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:49.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 shutdown_connections 2023-12-19T13:57:49.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.689+0000 7f352d5ab640 1 -- 172.21.15.113:0/3529985621 wait complete. 2023-12-19T13:57:49.708 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:57:49.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.914+0000 7f3f04f39640 1 Processor -- start 2023-12-19T13:57:49.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.915+0000 7f3f04f39640 1 -- start start 2023-12-19T13:57:49.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.916+0000 7f3f04f39640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3f000ab150 0x7f3f000a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:49.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.916+0000 7f3f04f39640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f00147060 con 0x7f3f00146800 2023-12-19T13:57:49.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.916+0000 7f3f04f39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f000ab710 con 0x7f3f000ac7b0 2023-12-19T13:57:49.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.916+0000 7f3f04f39640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f00146be0 con 0x7f3f000ab150 2023-12-19T13:57:49.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efdd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3f000ab150 0x7f3f000a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:49.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efdd9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3f000ab150 0x7f3f000a9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57732/0 (socket says 172.21.15.113:57732) 2023-12-19T13:57:49.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efe59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3f00146800 0x7f3f000a9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34690/0 (socket says 172.21.15.113:34690) 2023-12-19T13:57:49.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efdd9b640 1 -- 172.21.15.113:0/3397858670 learned_addr learned my addr 172.21.15.113:0/3397858670 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:49.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efdd9b640 1 -- 172.21.15.113:0/3397858670 >> v1:172.21.15.151:6789/0 conn(0x7f3f000ac7b0 legacy=0x7f3f000acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:49.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efdd9b640 1 -- 172.21.15.113:0/3397858670 >> v1:172.21.15.113:6789/0 conn(0x7f3f00146800 legacy=0x7f3f000a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:49.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efdd9b640 1 -- 172.21.15.113:0/3397858670 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000ab9f0 con 0x7f3f000ab150 2023-12-19T13:57:49.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.917+0000 7f3efd59a640 1 -- 172.21.15.113:0/3397858670 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104145103 0 0) 0x7f3f00147060 con 0x7f3f00146800 2023-12-19T13:57:49.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.918+0000 7f3efdd9b640 1 --2- 172.21.15.113:0/3397858670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f000ab150 0x7f3f000a9b10 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009e50 tx=0x7f3ef002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccc465b7b0ee0cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:49.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.918+0000 7f3efd59a640 1 -- 172.21.15.113:0/3397858670 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef002c9f0 con 0x7f3f000ab150 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.918+0000 7f3efd59a640 1 -- 172.21.15.113:0/3397858670 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef002cb50 con 0x7f3f000ab150 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.918+0000 7f3efd59a640 1 -- 172.21.15.113:0/3397858670 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00343f0 con 0x7f3f000ab150 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.919+0000 7f3f04f39640 1 -- 172.21.15.113:0/3397858670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f000ab150 msgr2=0x7f3f000a9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.919+0000 7f3f04f39640 1 --2- 172.21.15.113:0/3397858670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f000ab150 0x7f3f000a9b10 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009e50 tx=0x7f3ef002be50 comp rx=0 tx=0).stop 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.919+0000 7f3f04f39640 1 -- 172.21.15.113:0/3397858670 shutdown_connections 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.919+0000 7f3f04f39640 1 --2- 172.21.15.113:0/3397858670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f000ab150 0x7f3f000a9b10 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.919+0000 7f3f04f39640 1 -- 172.21.15.113:0/3397858670 >> 172.21.15.113:0/3397858670 conn(0x7f3f0006f5a0 msgr2=0x7f3f0006f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.919+0000 7f3f04f39640 1 -- 172.21.15.113:0/3397858670 shutdown_connections 2023-12-19T13:57:49.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.919+0000 7f3f04f39640 1 -- 172.21.15.113:0/3397858670 wait complete. 2023-12-19T13:57:49.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.921+0000 7f3f04f39640 1 Processor -- start 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.921+0000 7f3f04f39640 1 -- start start 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3f04f39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f000ab150 0x7f3f0015f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3f04f39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f000ac7b0 0x7f3f000afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3f04f39640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f00146800 0x7f3f000aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3f04f39640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000d1100 con 0x7f3f00146800 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3f04f39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0015fc90 con 0x7f3f000ab150 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3f04f39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0015ff70 con 0x7f3f000ac7b0 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3efed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f00146800 0x7f3f000aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3efed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f00146800 0x7f3f000aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57736/0 (socket says 172.21.15.113:57736) 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.922+0000 7f3efed9d640 1 -- 172.21.15.113:0/289020898 learned_addr learned my addr 172.21.15.113:0/289020898 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3efed9d640 1 -- 172.21.15.113:0/289020898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f000ac7b0 msgr2=0x7f3f000afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:49.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3efed9d640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f000ac7b0 0x7f3f000afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3efed9d640 1 -- 172.21.15.113:0/289020898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f000ab150 msgr2=0x7f3f0015f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3efed9d640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f000ab150 0x7f3f0015f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3efed9d640 1 -- 172.21.15.113:0/289020898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0009b30 con 0x7f3f00146800 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3efed9d640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f00146800 0x7f3f000aff40 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800b490 tx=0x7f3ee800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3ef6ffd640 1 -- 172.21.15.113:0/289020898 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8011830 con 0x7f3f00146800 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3ef6ffd640 1 -- 172.21.15.113:0/289020898 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80119b0 con 0x7f3f00146800 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3ef6ffd640 1 -- 172.21.15.113:0/289020898 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8011d60 con 0x7f3f00146800 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f00160250 con 0x7f3f00146800 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.923+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f00160810 con 0x7f3f00146800 2023-12-19T13:57:49.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.924+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f00160a30 con 0x7f3f00146800 2023-12-19T13:57:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.925+0000 7f3ef6ffd640 1 -- 172.21.15.113:0/289020898 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ee801a400 con 0x7f3f00146800 2023-12-19T13:57:49.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.927+0000 7f3ef6ffd640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ee006a430 0x7f3ee006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:49.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.927+0000 7f3ef6ffd640 1 -- 172.21.15.113:0/289020898 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3ee8088a50 con 0x7f3f00146800 2023-12-19T13:57:49.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.927+0000 7f3efe59c640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ee006a430 0x7f3ee006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:49.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.927+0000 7f3efe59c640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ee006a430 0x7f3ee006c8f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8007fd0 tx=0x7f3ef8007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:49.930 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:49.931+0000 7f3ef6ffd640 1 -- 172.21.15.113:0/289020898 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ee8053fe0 con 0x7f3f00146800 2023-12-19T13:57:50.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.125+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f00061910 con 0x7f3f00146800 2023-12-19T13:57:50.659 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:50.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:50.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.752+0000 7f3ef6ffd640 1 -- 172.21.15.113:0/289020898 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v168) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3ee8015020 con 0x7f3f00146800 2023-12-19T13:57:50.753 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:57:50.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.758+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ee006a430 msgr2=0x7f3ee006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:50.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.758+0000 7f3f04f39640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ee006a430 0x7f3ee006c8f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8007fd0 tx=0x7f3ef8007960 comp rx=0 tx=0).stop 2023-12-19T13:57:50.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.758+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f00146800 msgr2=0x7f3f000aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:50.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.758+0000 7f3f04f39640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f00146800 0x7f3f000aff40 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800b490 tx=0x7f3ee800b950 comp rx=0 tx=0).stop 2023-12-19T13:57:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.759+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 shutdown_connections 2023-12-19T13:57:50.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.759+0000 7f3f04f39640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3ee006a430 0x7f3ee006c8f0 secure :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8007fd0 tx=0x7f3ef8007960 comp rx=0 tx=0).stop 2023-12-19T13:57:50.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.759+0000 7f3f04f39640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3f00146800 0x7f3f000aff40 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.759+0000 7f3f04f39640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f000ac7b0 0x7f3f000afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.759+0000 7f3f04f39640 1 --2- 172.21.15.113:0/289020898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f000ab150 0x7f3f0015f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.759+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 >> 172.21.15.113:0/289020898 conn(0x7f3f0006f5a0 msgr2=0x7f3f000aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.761+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 shutdown_connections 2023-12-19T13:57:50.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.761+0000 7f3f04f39640 1 -- 172.21.15.113:0/289020898 wait complete. 2023-12-19T13:57:50.779 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:57:50.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.981+0000 7f51d1363640 1 Processor -- start 2023-12-19T13:57:50.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.981+0000 7f51d1363640 1 -- start start 2023-12-19T13:57:50.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51d1363640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51cc15a970 0x7f51cc15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51d1363640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51cc0cae20 0x7f51cc0cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51d1363640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc0cd680 con 0x7f51cc15ad50 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51d1363640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0cc160 con 0x7f51cc0cae20 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51d1363640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0cb8c0 con 0x7f51cc15a970 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51c3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51cc0cae20 0x7f51cc0cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51c3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51cc0cae20 0x7f51cc0cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57752/0 (socket says 172.21.15.113:57752) 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.983+0000 7f51c3fff640 1 -- 172.21.15.113:0/2949874483 learned_addr learned my addr 172.21.15.113:0/2949874483 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:50.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.984+0000 7f51caffd640 1 --2- 172.21.15.113:0/2949874483 >> v2:172.21.15.151:3300/0 conn(0x7f51cc15a970 0x7f51cc15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:50.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.984+0000 7f51ca7fc640 1 -- 172.21.15.113:0/2949874483 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728456568 0 0) 0x7f51cc0cd680 con 0x7f51cc15ad50 2023-12-19T13:57:50.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.984+0000 7f51ca7fc640 1 -- 172.21.15.113:0/2949874483 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b8003520 con 0x7f51cc15ad50 2023-12-19T13:57:50.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.984+0000 7f51c3fff640 1 -- 172.21.15.113:0/2949874483 >> v2:172.21.15.151:3300/0 conn(0x7f51cc15a970 msgr2=0x7f51cc15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:50.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.984+0000 7f51c3fff640 1 --2- 172.21.15.113:0/2949874483 >> v2:172.21.15.151:3300/0 conn(0x7f51cc15a970 0x7f51cc15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.984+0000 7f51c3fff640 1 -- 172.21.15.113:0/2949874483 >> v1:172.21.15.113:6789/0 conn(0x7f51cc15ad50 legacy=0x7f51cc15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:50.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.984+0000 7f51c3fff640 1 -- 172.21.15.113:0/2949874483 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0cbba0 con 0x7f51cc0cae20 2023-12-19T13:57:50.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.985+0000 7f51c3fff640 1 --2- 172.21.15.113:0/2949874483 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc0cae20 0x7f51cc0cb2b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f51cc071d20 tx=0x7f51b402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dfec5c30ae14d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.985+0000 7f51ca7fc640 1 -- 172.21.15.113:0/2949874483 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4030860 con 0x7f51cc0cae20 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.985+0000 7f51ca7fc640 1 -- 172.21.15.113:0/2949874483 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b40309c0 con 0x7f51cc0cae20 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.985+0000 7f51ca7fc640 1 -- 172.21.15.113:0/2949874483 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4030d50 con 0x7f51cc0cae20 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 -- 172.21.15.113:0/2949874483 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc0cae20 msgr2=0x7f51cc0cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 --2- 172.21.15.113:0/2949874483 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc0cae20 0x7f51cc0cb2b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f51cc071d20 tx=0x7f51b402b9a0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 -- 172.21.15.113:0/2949874483 shutdown_connections 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 --2- 172.21.15.113:0/2949874483 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc0cae20 0x7f51cc0cb2b0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 --2- 172.21.15.113:0/2949874483 >> v2:172.21.15.151:3300/0 conn(0x7f51cc15a970 0x7f51cc15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 -- 172.21.15.113:0/2949874483 >> 172.21.15.113:0/2949874483 conn(0x7f51cc0cf2f0 msgr2=0x7f51cc0cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 -- 172.21.15.113:0/2949874483 shutdown_connections 2023-12-19T13:57:50.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.986+0000 7f51d1363640 1 -- 172.21.15.113:0/2949874483 wait complete. 2023-12-19T13:57:50.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.988+0000 7f51d1363640 1 Processor -- start 2023-12-19T13:57:50.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.988+0000 7f51d1363640 1 -- start start 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51d1363640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51cc0cae20 0x7f51cc14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51d1363640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51cc15a970 0x7f51cc1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51d1363640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc15ad50 0x7f51cc06c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51d1363640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc155b80 con 0x7f51cc15ad50 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51d1363640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc06cb10 con 0x7f51cc15a970 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51d1363640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc06cdf0 con 0x7f51cc0cae20 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51cb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc15ad50 0x7f51cc06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51cb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc15ad50 0x7f51cc06c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57764/0 (socket says 172.21.15.113:57764) 2023-12-19T13:57:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.989+0000 7f51cb7fe640 1 -- 172.21.15.113:0/3973840169 learned_addr learned my addr 172.21.15.113:0/3973840169 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51cb7fe640 1 -- 172.21.15.113:0/3973840169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51cc0cae20 msgr2=0x7f51cc14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51cb7fe640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51cc0cae20 0x7f51cc14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51cb7fe640 1 -- 172.21.15.113:0/3973840169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51cc15a970 msgr2=0x7f51cc1f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51c3fff640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51cc15a970 0x7f51cc1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51cb7fe640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51cc15a970 0x7f51cc1f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51cb7fe640 1 -- 172.21.15.113:0/3973840169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40094d0 con 0x7f51cc15ad50 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51cb7fe640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc15ad50 0x7f51cc06c050 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c6e0 tx=0x7f51c400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51c37fe640 1 -- 172.21.15.113:0/3973840169 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4003b70 con 0x7f51cc15ad50 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51c37fe640 1 -- 172.21.15.113:0/3973840169 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4003cd0 con 0x7f51cc15ad50 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc06d0d0 con 0x7f51cc15ad50 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51c37fe640 1 -- 172.21.15.113:0/3973840169 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c40052d0 con 0x7f51cc15ad50 2023-12-19T13:57:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.990+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc06d690 con 0x7f51cc15ad50 2023-12-19T13:57:50.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.992+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc074770 con 0x7f51cc15ad50 2023-12-19T13:57:50.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.993+0000 7f51c37fe640 1 -- 172.21.15.113:0/3973840169 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f51c4005430 con 0x7f51cc15ad50 2023-12-19T13:57:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.993+0000 7f51c37fe640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f51ac06a430 0x7f51ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.994+0000 7f51c37fe640 1 -- 172.21.15.113:0/3973840169 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f51c40885d0 con 0x7f51cc15ad50 2023-12-19T13:57:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.994+0000 7f51caffd640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f51ac06a430 0x7f51ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.994+0000 7f51caffd640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f51ac06a430 0x7f51ac06c8f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f51bc006a90 tx=0x7f51bc006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:50.998+0000 7f51c37fe640 1 -- 172.21.15.113:0/3973840169 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f51c4053d20 con 0x7f51cc15ad50 2023-12-19T13:57:51.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.186+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51cc0cfc30 con 0x7f51cc15ad50 2023-12-19T13:57:51.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.756+0000 7f51c37fe640 1 -- 172.21.15.113:0/3973840169 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v169) v1 ==== 169+0+0 (secure 0 0 0) 0x7f51c4057340 con 0x7f51cc15ad50 2023-12-19T13:57:51.756 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:57:51.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.760+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f51ac06a430 msgr2=0x7f51ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:51.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.760+0000 7f51d1363640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f51ac06a430 0x7f51ac06c8f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f51bc006a90 tx=0x7f51bc006a20 comp rx=0 tx=0).stop 2023-12-19T13:57:51.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc15ad50 msgr2=0x7f51cc06c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:51.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc15ad50 0x7f51cc06c050 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c6e0 tx=0x7f51c400cba0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 shutdown_connections 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f51ac06a430 0x7f51ac06c8f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51cc15ad50 0x7f51cc06c050 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51cc15a970 0x7f51cc1f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 --2- 172.21.15.113:0/3973840169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51cc0cae20 0x7f51cc14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 >> 172.21.15.113:0/3973840169 conn(0x7f51cc0cf2f0 msgr2=0x7f51cc0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.761+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 shutdown_connections 2023-12-19T13:57:51.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.762+0000 7f51d1363640 1 -- 172.21.15.113:0/3973840169 wait complete. 2023-12-19T13:57:51.781 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:57:51.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.992+0000 7efd60917640 1 Processor -- start 2023-12-19T13:57:51.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.992+0000 7efd60917640 1 -- start start 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.993+0000 7efd60917640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd5c157710 0x7efd5c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.993+0000 7efd60917640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efd5c0b2990 0x7efd5c0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd60917640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c0b0c80 con 0x7efd5c0b0830 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd60917640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c15d7d0 con 0x7efd5c157710 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd60917640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c0b2ea0 con 0x7efd5c0b2990 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd5ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd5c157710 0x7efd5c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd5ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd5c157710 0x7efd5c0b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57776/0 (socket says 172.21.15.113:57776) 2023-12-19T13:57:51.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd5ad9d640 1 -- 172.21.15.113:0/2078962525 learned_addr learned my addr 172.21.15.113:0/2078962525 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:51.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd53fff640 1 --2- 172.21.15.113:0/2078962525 >> v2:172.21.15.151:3300/0 conn(0x7efd5c0b2990 0x7efd5c0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:51.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd5ad9d640 1 -- 172.21.15.113:0/2078962525 >> v2:172.21.15.151:3300/0 conn(0x7efd5c0b2990 msgr2=0x7efd5c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:51.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd5ad9d640 1 --2- 172.21.15.113:0/2078962525 >> v2:172.21.15.151:3300/0 conn(0x7efd5c0b2990 0x7efd5c0b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd5ad9d640 1 -- 172.21.15.113:0/2078962525 >> v1:172.21.15.151:6789/0 conn(0x7efd5c0b0830 legacy=0x7efd5c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:51.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.994+0000 7efd5ad9d640 1 -- 172.21.15.113:0/2078962525 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c15da90 con 0x7efd5c157710 2023-12-19T13:57:51.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.995+0000 7efd5ad9d640 1 --2- 172.21.15.113:0/2078962525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c157710 0x7efd5c0b2450 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0cc280 tx=0x7efd4c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e965f5e2a4708f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:51.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd5a59c640 1 -- 172.21.15.113:0/2078962525 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c031750 con 0x7efd5c157710 2023-12-19T13:57:51.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd5a59c640 1 -- 172.21.15.113:0/2078962525 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c0318b0 con 0x7efd5c157710 2023-12-19T13:57:51.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd5a59c640 1 -- 172.21.15.113:0/2078962525 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c031c40 con 0x7efd5c157710 2023-12-19T13:57:51.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd60917640 1 -- 172.21.15.113:0/2078962525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c157710 msgr2=0x7efd5c0b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:51.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd60917640 1 --2- 172.21.15.113:0/2078962525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c157710 0x7efd5c0b2450 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0cc280 tx=0x7efd4c02b7f0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd60917640 1 -- 172.21.15.113:0/2078962525 shutdown_connections 2023-12-19T13:57:51.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd60917640 1 --2- 172.21.15.113:0/2078962525 >> v2:172.21.15.151:3300/0 conn(0x7efd5c0b2990 0x7efd5c0b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.996+0000 7efd60917640 1 --2- 172.21.15.113:0/2078962525 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c157710 0x7efd5c0b2450 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:51.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.997+0000 7efd60917640 1 -- 172.21.15.113:0/2078962525 >> 172.21.15.113:0/2078962525 conn(0x7efd5c0659a0 msgr2=0x7efd5c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:51.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.997+0000 7efd60917640 1 -- 172.21.15.113:0/2078962525 shutdown_connections 2023-12-19T13:57:51.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.997+0000 7efd60917640 1 -- 172.21.15.113:0/2078962525 wait complete. 2023-12-19T13:57:51.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.998+0000 7efd60917640 1 Processor -- start 2023-12-19T13:57:51.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.999+0000 7efd60917640 1 -- start start 2023-12-19T13:57:51.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.999+0000 7efd60917640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c0b0830 0x7efd5c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:51.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.999+0000 7efd60917640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c0b2990 0x7efd5c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:51.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.999+0000 7efd60917640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c157710 0x7efd5c0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:51.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.999+0000 7efd60917640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c06c190 con 0x7efd5c0b0830 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.999+0000 7efd60917640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c06c470 con 0x7efd5c157710 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:51.999+0000 7efd60917640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c06c750 con 0x7efd5c0b2990 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c0b0830 0x7efd5c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c0b0830 0x7efd5c0c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57790/0 (socket says 172.21.15.113:57790) 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 -- 172.21.15.113:0/573826654 learned_addr learned my addr 172.21.15.113:0/573826654 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5b59e640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c157710 0x7efd5c0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 -- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c0b2990 msgr2=0x7efd5c159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c0b2990 0x7efd5c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 -- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c157710 msgr2=0x7efd5c0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c157710 0x7efd5c0c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5ad9d640 1 -- 172.21.15.113:0/573826654 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0094d0 con 0x7efd5c0b0830 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.000+0000 7efd5b59e640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c157710 0x7efd5c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:52.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.001+0000 7efd5ad9d640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c0b0830 0x7efd5c0c6040 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7efd4c000c00 tx=0x7efd4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:52.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.001+0000 7efd537fe640 1 -- 172.21.15.113:0/573826654 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c033c80 con 0x7efd5c0b0830 2023-12-19T13:57:52.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.001+0000 7efd537fe640 1 -- 172.21.15.113:0/573826654 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c033de0 con 0x7efd5c0b0830 2023-12-19T13:57:52.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.001+0000 7efd537fe640 1 -- 172.21.15.113:0/573826654 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c03c640 con 0x7efd5c0b0830 2023-12-19T13:57:52.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.001+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c06ca30 con 0x7efd5c0b0830 2023-12-19T13:57:52.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.001+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c0c6580 con 0x7efd5c0b0830 2023-12-19T13:57:52.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.002+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c0aed80 con 0x7efd5c0b0830 2023-12-19T13:57:52.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.003+0000 7efd537fe640 1 -- 172.21.15.113:0/573826654 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd4c03a040 con 0x7efd5c0b0830 2023-12-19T13:57:52.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.004+0000 7efd537fe640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd3c06a430 0x7efd3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.004+0000 7efd537fe640 1 -- 172.21.15.113:0/573826654 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd4c0aa160 con 0x7efd5c0b0830 2023-12-19T13:57:52.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.004+0000 7efd53fff640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd3c06a430 0x7efd3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.005+0000 7efd53fff640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd3c06a430 0x7efd3c06c8f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efd44006fd0 tx=0x7efd44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:52.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.008+0000 7efd537fe640 1 -- 172.21.15.113:0/573826654 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd4c075ae0 con 0x7efd5c0b0830 2023-12-19T13:57:52.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.205+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efd5c0b0c80 con 0x7efd5c0b0830 2023-12-19T13:57:52.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.213+0000 7efd537fe640 1 -- 172.21.15.113:0/573826654 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7efd5c0b0c80 con 0x7efd5c0b0830 2023-12-19T13:57:52.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd3c06a430 msgr2=0x7efd3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd3c06a430 0x7efd3c06c8f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efd44006fd0 tx=0x7efd44008040 comp rx=0 tx=0).stop 2023-12-19T13:57:52.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c0b0830 msgr2=0x7efd5c0c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c0b0830 0x7efd5c0c6040 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7efd4c000c00 tx=0x7efd4c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 shutdown_connections 2023-12-19T13:57:52.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd3c06a430 0x7efd3c06c8f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c157710 0x7efd5c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c0b2990 0x7efd5c159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 --2- 172.21.15.113:0/573826654 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd5c0b0830 0x7efd5c0c6040 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 >> 172.21.15.113:0/573826654 conn(0x7efd5c0659a0 msgr2=0x7efd5c0af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:52.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 shutdown_connections 2023-12-19T13:57:52.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.216+0000 7efd60917640 1 -- 172.21.15.113:0/573826654 wait complete. 2023-12-19T13:57:52.234 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-19T13:57:52.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.445+0000 7fc6c6bd0640 1 Processor -- start 2023-12-19T13:57:52.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.445+0000 7fc6c6bd0640 1 -- start start 2023-12-19T13:57:52.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.446+0000 7fc6c6bd0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6c01402a0 0x7fc6c006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.446+0000 7fc6c6bd0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6c015e6d0 0x7fc6c006d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c6bd0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c015eaf0 con 0x7fc6c0140680 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c6bd0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c015b290 con 0x7fc6c015e6d0 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c6bd0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c0142ed0 con 0x7fc6c01402a0 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6bffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc6c0140680 0x7fc6c015dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34712/0 (socket says 172.21.15.113:34712) 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6bffff640 1 -- 172.21.15.113:0/4222898280 learned_addr learned my addr 172.21.15.113:0/4222898280 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c516d640 1 --2- 172.21.15.113:0/4222898280 >> v2:172.21.15.113:3300/0 conn(0x7fc6c015e6d0 0x7fc6c006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c496c640 1 --2- 172.21.15.113:0/4222898280 >> v2:172.21.15.151:3300/0 conn(0x7fc6c01402a0 0x7fc6c006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c516d640 1 -- 172.21.15.113:0/4222898280 >> v2:172.21.15.151:3300/0 conn(0x7fc6c01402a0 msgr2=0x7fc6c006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c516d640 1 --2- 172.21.15.113:0/4222898280 >> v2:172.21.15.151:3300/0 conn(0x7fc6c01402a0 0x7fc6c006cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c516d640 1 -- 172.21.15.113:0/4222898280 >> v1:172.21.15.113:6789/0 conn(0x7fc6c0140680 legacy=0x7fc6c015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6c516d640 1 -- 172.21.15.113:0/4222898280 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c015ed30 con 0x7fc6c015e6d0 2023-12-19T13:57:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.447+0000 7fc6bf7fe640 1 -- 172.21.15.113:0/4222898280 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115724265 0 0) 0x7fc6ac001110 con 0x7fc6c0140680 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6c516d640 1 --2- 172.21.15.113:0/4222898280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c015e6d0 0x7fc6c006d460 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00b19f0 tx=0x7fc6b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a275b0b73261b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6bf7fe640 1 -- 172.21.15.113:0/4222898280 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b802cc80 con 0x7fc6c015e6d0 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6bf7fe640 1 -- 172.21.15.113:0/4222898280 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b802cde0 con 0x7fc6c015e6d0 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6bf7fe640 1 -- 172.21.15.113:0/4222898280 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8034660 con 0x7fc6c015e6d0 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/4222898280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c015e6d0 msgr2=0x7fc6c006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/4222898280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c015e6d0 0x7fc6c006d460 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00b19f0 tx=0x7fc6b802bed0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/4222898280 shutdown_connections 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/4222898280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c015e6d0 0x7fc6c006d460 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/4222898280 >> v2:172.21.15.151:3300/0 conn(0x7fc6c01402a0 0x7fc6c006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.449+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/4222898280 >> 172.21.15.113:0/4222898280 conn(0x7fc6c00b11d0 msgr2=0x7fc6c00cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.450+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/4222898280 shutdown_connections 2023-12-19T13:57:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.450+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/4222898280 wait complete. 2023-12-19T13:57:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.451+0000 7fc6c6bd0640 1 Processor -- start 2023-12-19T13:57:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.451+0000 7fc6c6bd0640 1 -- start start 2023-12-19T13:57:52.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.452+0000 7fc6c6bd0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6c01402a0 0x7fc6c013d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.452+0000 7fc6c6bd0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c0140680 0x7fc6c013bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.452+0000 7fc6c6bd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6c015e6d0 0x7fc6c01544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.452+0000 7fc6c6bd0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0154a00 con 0x7fc6c0140680 2023-12-19T13:57:52.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.452+0000 7fc6c6bd0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c013cd40 con 0x7fc6c01402a0 2023-12-19T13:57:52.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.452+0000 7fc6c6bd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c015a0e0 con 0x7fc6c015e6d0 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c0140680 0x7fc6c013bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c0140680 0x7fc6c013bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57794/0 (socket says 172.21.15.113:57794) 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 -- 172.21.15.113:0/2112963395 learned_addr learned my addr 172.21.15.113:0/2112963395 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6c516d640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6c015e6d0 0x7fc6c01544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6c496c640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6c01402a0 0x7fc6c013d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 -- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6c015e6d0 msgr2=0x7fc6c01544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6c015e6d0 0x7fc6c01544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 -- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6c01402a0 msgr2=0x7fc6c013d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6c01402a0 0x7fc6c013d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 -- 172.21.15.113:0/2112963395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8009a70 con 0x7fc6c0140680 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6c516d640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6c015e6d0 0x7fc6c01544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:52.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.453+0000 7fc6bffff640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c0140680 0x7fc6c013bc70 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c7b0 tx=0x7fc6ac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:52.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.454+0000 7fc6bd7fa640 1 -- 172.21.15.113:0/2112963395 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0072d0 con 0x7fc6c0140680 2023-12-19T13:57:52.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.454+0000 7fc6bd7fa640 1 -- 172.21.15.113:0/2112963395 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac007450 con 0x7fc6c0140680 2023-12-19T13:57:52.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.454+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c013c410 con 0x7fc6c0140680 2023-12-19T13:57:52.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.454+0000 7fc6bd7fa640 1 -- 172.21.15.113:0/2112963395 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0047e0 con 0x7fc6c0140680 2023-12-19T13:57:52.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.454+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c013c9d0 con 0x7fc6c0140680 2023-12-19T13:57:52.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.455+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c0074770 con 0x7fc6c0140680 2023-12-19T13:57:52.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.456+0000 7fc6bd7fa640 1 -- 172.21.15.113:0/2112963395 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6ac004960 con 0x7fc6c0140680 2023-12-19T13:57:52.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.457+0000 7fc6bd7fa640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6a406a430 0x7fc6a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.457+0000 7fc6bd7fa640 1 -- 172.21.15.113:0/2112963395 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc6ac087740 con 0x7fc6c0140680 2023-12-19T13:57:52.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.457+0000 7fc6c496c640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6a406a430 0x7fc6a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.458+0000 7fc6c496c640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6a406a430 0x7fc6a406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4006fd0 tx=0x7fc6b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:52.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.461+0000 7fc6bd7fa640 1 -- 172.21.15.113:0/2112963395 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc6ac052f90 con 0x7fc6c0140680 2023-12-19T13:57:52.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.721+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fc6c015eaf0 con 0x7fc6c0140680 2023-12-19T13:57:52.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.765+0000 7fc6bd7fa640 1 -- 172.21.15.113:0/2112963395 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v544) v1 ==== 132+0+0 (secure 0 0 0) 0x7fc6c015eaf0 con 0x7fc6c0140680 2023-12-19T13:57:52.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6a406a430 msgr2=0x7fc6a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6a406a430 0x7fc6a406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4006fd0 tx=0x7fc6b4008040 comp rx=0 tx=0).stop 2023-12-19T13:57:52.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c0140680 msgr2=0x7fc6c013bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c0140680 0x7fc6c013bc70 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c7b0 tx=0x7fc6ac00cc70 comp rx=0 tx=0).stop 2023-12-19T13:57:52.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 shutdown_connections 2023-12-19T13:57:52.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6a406a430 0x7fc6a406c8f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6c015e6d0 0x7fc6c01544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6c0140680 0x7fc6c013bc70 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 --2- 172.21.15.113:0/2112963395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6c01402a0 0x7fc6c013d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 >> 172.21.15.113:0/2112963395 conn(0x7fc6c00b11d0 msgr2=0x7fc6c00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:52.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 shutdown_connections 2023-12-19T13:57:52.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.768+0000 7fc6c6bd0640 1 -- 172.21.15.113:0/2112963395 wait complete. 2023-12-19T13:57:52.786 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-19T13:57:52.787 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-12-19T13:57:52.787 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T13:57:52.787 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:57:52.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.994+0000 7fcf18417640 1 Processor -- start 2023-12-19T13:57:52.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.994+0000 7fcf18417640 1 -- start start 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.995+0000 7fcf18417640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcf101449e0 0x7fcf100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf18417640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf100afb10 con 0x7fcf1006c6b0 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf18417640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1006bb30 con 0x7fcf100b0b50 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf18417640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf100b0070 con 0x7fcf101449e0 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf161b3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcf101449e0 0x7fcf100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf161b3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcf101449e0 0x7fcf100af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57810/0 (socket says 172.21.15.113:57810) 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf161b3640 1 -- 172.21.15.113:0/3820035752 learned_addr learned my addr 172.21.15.113:0/3820035752 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:52.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf169b4640 1 --1- 172.21.15.113:0/3820035752 >> v1:172.21.15.113:6789/0 conn(0x7fcf1006c6b0 0x7fcf100b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34722/0 (socket says 172.21.15.113:34722) 2023-12-19T13:57:52.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf161b3640 1 -- 172.21.15.113:0/3820035752 >> v1:172.21.15.151:6789/0 conn(0x7fcf100b0b50 legacy=0x7fcf1006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:52.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.996+0000 7fcf161b3640 1 -- 172.21.15.113:0/3820035752 >> v1:172.21.15.113:6789/0 conn(0x7fcf1006c6b0 legacy=0x7fcf100b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.997+0000 7fcf161b3640 1 -- 172.21.15.113:0/3820035752 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf100b0350 con 0x7fcf101449e0 2023-12-19T13:57:52.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.998+0000 7fcf161b3640 1 --2- 172.21.15.113:0/3820035752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf100af5d0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009870 tx=0x7fcf0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8aed84d5b3cf988 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:52.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.998+0000 7fcf151b1640 1 -- 172.21.15.113:0/3820035752 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c030860 con 0x7fcf101449e0 2023-12-19T13:57:52.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.998+0000 7fcf151b1640 1 -- 172.21.15.113:0/3820035752 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c0309c0 con 0x7fcf101449e0 2023-12-19T13:57:52.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.998+0000 7fcf151b1640 1 -- 172.21.15.113:0/3820035752 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c030d50 con 0x7fcf101449e0 2023-12-19T13:57:52.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.999+0000 7fcf18417640 1 -- 172.21.15.113:0/3820035752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 msgr2=0x7fcf100af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:52.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.999+0000 7fcf18417640 1 --2- 172.21.15.113:0/3820035752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf100af5d0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009870 tx=0x7fcf0c02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.999+0000 7fcf18417640 1 -- 172.21.15.113:0/3820035752 shutdown_connections 2023-12-19T13:57:52.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.999+0000 7fcf18417640 1 --2- 172.21.15.113:0/3820035752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf100af5d0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:52.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.999+0000 7fcf18417640 1 -- 172.21.15.113:0/3820035752 >> 172.21.15.113:0/3820035752 conn(0x7fcf100cbb70 msgr2=0x7fcf100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:52.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.999+0000 7fcf18417640 1 -- 172.21.15.113:0/3820035752 shutdown_connections 2023-12-19T13:57:52.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:52.999+0000 7fcf18417640 1 -- 172.21.15.113:0/3820035752 wait complete. 2023-12-19T13:57:53.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.001+0000 7fcf18417640 1 Processor -- start 2023-12-19T13:57:53.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.001+0000 7fcf18417640 1 -- start start 2023-12-19T13:57:53.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf18417640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1006c6b0 0x7fcf10156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf18417640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf100b0b50 0x7fcf10154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf18417640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf1013a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf18417640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf101578a0 con 0x7fcf101449e0 2023-12-19T13:57:53.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf18417640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1015c8b0 con 0x7fcf1006c6b0 2023-12-19T13:57:53.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf18417640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10153910 con 0x7fcf100b0b50 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf1013a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf1013a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57812/0 (socket says 172.21.15.113:57812) 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 -- 172.21.15.113:0/1583387058 learned_addr learned my addr 172.21.15.113:0/1583387058 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 -- 172.21.15.113:0/1583387058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf100b0b50 msgr2=0x7fcf10154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf100b0b50 0x7fcf10154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 -- 172.21.15.113:0/1583387058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1006c6b0 msgr2=0x7fcf10156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1006c6b0 0x7fcf10156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.002+0000 7fcf169b4640 1 -- 172.21.15.113:0/1583387058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0094d0 con 0x7fcf101449e0 2023-12-19T13:57:53.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.003+0000 7fcf169b4640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf1013a580 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c7b0 tx=0x7fcf0800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.003+0000 7fcf06ffd640 1 -- 172.21.15.113:0/1583387058 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800a640 con 0x7fcf101449e0 2023-12-19T13:57:53.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.003+0000 7fcf06ffd640 1 -- 172.21.15.113:0/1583387058 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0800a7a0 con 0x7fcf101449e0 2023-12-19T13:57:53.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.003+0000 7fcf06ffd640 1 -- 172.21.15.113:0/1583387058 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800ab10 con 0x7fcf101449e0 2023-12-19T13:57:53.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.003+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10154f50 con 0x7fcf101449e0 2023-12-19T13:57:53.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.003+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1015c260 con 0x7fcf101449e0 2023-12-19T13:57:53.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.004+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10061910 con 0x7fcf101449e0 2023-12-19T13:57:53.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.005+0000 7fcf06ffd640 1 -- 172.21.15.113:0/1583387058 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf0800ac70 con 0x7fcf101449e0 2023-12-19T13:57:53.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.006+0000 7fcf06ffd640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcef406a430 0x7fcef406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.006+0000 7fcf06ffd640 1 -- 172.21.15.113:0/1583387058 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf08087ce0 con 0x7fcf101449e0 2023-12-19T13:57:53.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.006+0000 7fcf161b3640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcef406a430 0x7fcef406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.007+0000 7fcf161b3640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcef406a430 0x7fcef406c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c036000 tx=0x7fcf0c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.010+0000 7fcf06ffd640 1 -- 172.21.15.113:0/1583387058 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcf08053670 con 0x7fcf101449e0 2023-12-19T13:57:53.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.187+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf1015c9f0 con 0x7fcf101449e0 2023-12-19T13:57:53.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.189+0000 7fcf06ffd640 1 -- 172.21.15.113:0/1583387058 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+12579 (secure 0 0 0) 0x7fcf08017090 con 0x7fcf101449e0 2023-12-19T13:57:53.190 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:53.190 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":169,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:57:51.747829+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:6833/1201018731":"2023-12-20T13:57:48.554784+0000","172.21.15.151:6832/1201018731":"2023-12-20T13:57:48.554784+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.191+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcef406a430 msgr2=0x7fcef406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.191+0000 7fcf18417640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcef406a430 0x7fcef406c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c036000 tx=0x7fcf0c03b040 comp rx=0 tx=0).stop 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.191+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 msgr2=0x7fcf1013a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.191+0000 7fcf18417640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf1013a580 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c7b0 tx=0x7fcf0800cc70 comp rx=0 tx=0).stop 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 shutdown_connections 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcef406a430 0x7fcef406c8f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf101449e0 0x7fcf1013a580 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf100b0b50 0x7fcf10154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 --2- 172.21.15.113:0/1583387058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1006c6b0 0x7fcf10156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 >> 172.21.15.113:0/1583387058 conn(0x7fcf100cbb70 msgr2=0x7fcf1006bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:53.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 shutdown_connections 2023-12-19T13:57:53.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.192+0000 7fcf18417640 1 -- 172.21.15.113:0/1583387058 wait complete. 2023-12-19T13:57:53.210 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:57:53.210 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:57:53.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.417+0000 7fd14c9ef640 1 Processor -- start 2023-12-19T13:57:53.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.417+0000 7fd14c9ef640 1 -- start start 2023-12-19T13:57:53.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.418+0000 7fd14c9ef640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd148141900 0x7fd1480afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd14c9ef640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14806e220 con 0x7fd14806dc00 2023-12-19T13:57:53.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd14c9ef640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1480cbea0 con 0x7fd1480b02a0 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd14c9ef640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1480b0730 con 0x7fd148141900 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd146d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd148141900 0x7fd1480afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd14759e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd14806dc00 0x7fd1480ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34732/0 (socket says 172.21.15.113:34732) 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd14759e640 1 -- 172.21.15.113:0/605362751 learned_addr learned my addr 172.21.15.113:0/605362751 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd145d9b640 1 -- 172.21.15.113:0/605362751 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877739948 0 0) 0x7fd14806e220 con 0x7fd14806dc00 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd145d9b640 1 -- 172.21.15.113:0/605362751 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd130003520 con 0x7fd14806dc00 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd146d9d640 1 -- 172.21.15.113:0/605362751 >> v1:172.21.15.151:6789/0 conn(0x7fd1480b02a0 legacy=0x7fd14806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd146d9d640 1 -- 172.21.15.113:0/605362751 >> v1:172.21.15.113:6789/0 conn(0x7fd14806dc00 legacy=0x7fd1480ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.419+0000 7fd146d9d640 1 -- 172.21.15.113:0/605362751 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1480cc180 con 0x7fd148141900 2023-12-19T13:57:53.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.421+0000 7fd146d9d640 1 --2- 172.21.15.113:0/605362751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1480afd60 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fd1380097a0 tx=0x7fd13802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2997dbc4bb5bc243 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.421+0000 7fd145d9b640 1 -- 172.21.15.113:0/605362751 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138031830 con 0x7fd148141900 2023-12-19T13:57:53.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd145d9b640 1 -- 172.21.15.113:0/605362751 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd138031990 con 0x7fd148141900 2023-12-19T13:57:53.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd145d9b640 1 -- 172.21.15.113:0/605362751 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138031d20 con 0x7fd148141900 2023-12-19T13:57:53.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd14c9ef640 1 -- 172.21.15.113:0/605362751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 msgr2=0x7fd1480afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/605362751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1480afd60 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fd1380097a0 tx=0x7fd13802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd14c9ef640 1 -- 172.21.15.113:0/605362751 shutdown_connections 2023-12-19T13:57:53.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/605362751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1480afd60 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd14c9ef640 1 -- 172.21.15.113:0/605362751 >> 172.21.15.113:0/605362751 conn(0x7fd14806f630 msgr2=0x7fd14806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:53.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.422+0000 7fd14c9ef640 1 -- 172.21.15.113:0/605362751 shutdown_connections 2023-12-19T13:57:53.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.423+0000 7fd14c9ef640 1 -- 172.21.15.113:0/605362751 wait complete. 2023-12-19T13:57:53.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.424+0000 7fd14c9ef640 1 Processor -- start 2023-12-19T13:57:53.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.424+0000 7fd14c9ef640 1 -- start start 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.425+0000 7fd14c9ef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd14806dc00 0x7fd1480c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.425+0000 7fd14c9ef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1480b02a0 0x7fd1480c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.425+0000 7fd14c9ef640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1481e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.425+0000 7fd14c9ef640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480c50b0 con 0x7fd148141900 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.425+0000 7fd14c9ef640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480c5e30 con 0x7fd1480b02a0 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.425+0000 7fd14c9ef640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481e7710 con 0x7fd14806dc00 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.425+0000 7fd14759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1481e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1481e71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57830/0 (socket says 172.21.15.113:57830) 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 -- 172.21.15.113:0/895428539 learned_addr learned my addr 172.21.15.113:0/895428539 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 -- 172.21.15.113:0/895428539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd14806dc00 msgr2=0x7fd1480c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd14806dc00 0x7fd1480c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 -- 172.21.15.113:0/895428539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1480b02a0 msgr2=0x7fd1480c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1480b02a0 0x7fd1480c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 -- 172.21.15.113:0/895428539 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009400 con 0x7fd148141900 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14759e640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1481e71d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fd14000cb70 tx=0x7fd14000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd12f7fe640 1 -- 172.21.15.113:0/895428539 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000ace0 con 0x7fd148141900 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd12f7fe640 1 -- 172.21.15.113:0/895428539 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14000ae40 con 0x7fd148141900 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd12f7fe640 1 -- 172.21.15.113:0/895428539 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140012620 con 0x7fd148141900 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.426+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1481e7930 con 0x7fd148141900 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.427+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1480c3e60 con 0x7fd148141900 2023-12-19T13:57:53.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.428+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd148061910 con 0x7fd148141900 2023-12-19T13:57:53.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.428+0000 7fd12f7fe640 1 -- 172.21.15.113:0/895428539 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd140007070 con 0x7fd148141900 2023-12-19T13:57:53.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.429+0000 7fd12f7fe640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd13406a460 0x7fd13406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.429+0000 7fd12f7fe640 1 -- 172.21.15.113:0/895428539 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1400886b0 con 0x7fd148141900 2023-12-19T13:57:53.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.430+0000 7fd146d9d640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd13406a460 0x7fd13406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.430+0000 7fd146d9d640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd13406a460 0x7fd13406c920 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd138036000 tx=0x7fd138030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.434+0000 7fd12f7fe640 1 -- 172.21.15.113:0/895428539 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd140053f00 con 0x7fd148141900 2023-12-19T13:57:53.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.609+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1480ae230 con 0x7fd148141900 2023-12-19T13:57:53.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.610+0000 7fd12f7fe640 1 -- 172.21.15.113:0/895428539 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v169) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1400170a0 con 0x7fd148141900 2023-12-19T13:57:53.610 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:57:53.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.612+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd13406a460 msgr2=0x7fd13406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.612+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd13406a460 0x7fd13406c920 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd138036000 tx=0x7fd138030000 comp rx=0 tx=0).stop 2023-12-19T13:57:53.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 msgr2=0x7fd1481e71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1481e71d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fd14000cb70 tx=0x7fd14000a430 comp rx=0 tx=0).stop 2023-12-19T13:57:53.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 shutdown_connections 2023-12-19T13:57:53.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd13406a460 0x7fd13406c920 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd148141900 0x7fd1481e71d0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1480b02a0 0x7fd1480c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 --2- 172.21.15.113:0/895428539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd14806dc00 0x7fd1480c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 >> 172.21.15.113:0/895428539 conn(0x7fd14806f630 msgr2=0x7fd14815c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:53.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 shutdown_connections 2023-12-19T13:57:53.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.613+0000 7fd14c9ef640 1 -- 172.21.15.113:0/895428539 wait complete. 2023-12-19T13:57:53.632 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-19T13:57:53.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.828+0000 7f515897e640 1 Processor -- start 2023-12-19T13:57:53.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.828+0000 7f515897e640 1 -- start start 2023-12-19T13:57:53.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.829+0000 7f515897e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f515415aa70 0x7f5154164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.829+0000 7f515897e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515406b520 con 0x7f515415b1e0 2023-12-19T13:57:53.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f515897e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51540b2b20 con 0x7f5154159f80 2023-12-19T13:57:53.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f515897e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51540b2fb0 con 0x7f515415aa70 2023-12-19T13:57:53.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f5153fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f515415aa70 0x7f5154164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f5153fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f515415aa70 0x7f5154164f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57840/0 (socket says 172.21.15.113:57840) 2023-12-19T13:57:53.830 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f5153fff640 1 -- 172.21.15.113:0/2424009546 learned_addr learned my addr 172.21.15.113:0/2424009546 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:53.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f5153fff640 1 -- 172.21.15.113:0/2424009546 >> v1:172.21.15.151:6789/0 conn(0x7f5154159f80 legacy=0x7f515406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:53.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f5153fff640 1 -- 172.21.15.113:0/2424009546 >> v1:172.21.15.113:6789/0 conn(0x7f515415b1e0 legacy=0x7f515415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.830+0000 7f5153fff640 1 -- 172.21.15.113:0/2424009546 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540b1f10 con 0x7f515415aa70 2023-12-19T13:57:53.831 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.831+0000 7f5153fff640 1 --2- 172.21.15.113:0/2424009546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f5154164f30 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f514c009e50 tx=0x7f514c02e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aff75a3070cd4a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f51527fc640 1 -- 172.21.15.113:0/2424009546 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c02edc0 con 0x7f515415aa70 2023-12-19T13:57:53.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f51527fc640 1 -- 172.21.15.113:0/2424009546 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c0363f0 con 0x7f515415aa70 2023-12-19T13:57:53.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f51527fc640 1 -- 172.21.15.113:0/2424009546 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c036780 con 0x7f515415aa70 2023-12-19T13:57:53.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f515897e640 1 -- 172.21.15.113:0/2424009546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 msgr2=0x7f5154164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f515897e640 1 --2- 172.21.15.113:0/2424009546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f5154164f30 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f514c009e50 tx=0x7f514c02e220 comp rx=0 tx=0).stop 2023-12-19T13:57:53.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f515897e640 1 -- 172.21.15.113:0/2424009546 shutdown_connections 2023-12-19T13:57:53.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f515897e640 1 --2- 172.21.15.113:0/2424009546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f5154164f30 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f515897e640 1 -- 172.21.15.113:0/2424009546 >> 172.21.15.113:0/2424009546 conn(0x7f51540b0100 msgr2=0x7f51540b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:53.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.832+0000 7f515897e640 1 -- 172.21.15.113:0/2424009546 shutdown_connections 2023-12-19T13:57:53.833 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.833+0000 7f515897e640 1 -- 172.21.15.113:0/2424009546 wait complete. 2023-12-19T13:57:53.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.834+0000 7f515897e640 1 Processor -- start 2023-12-19T13:57:53.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.834+0000 7f515897e640 1 -- start start 2023-12-19T13:57:53.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.835+0000 7f515897e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5154159f80 0x7f5154153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.835+0000 7f515897e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f51540a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.835+0000 7f515897e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f515415b1e0 0x7f515406c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.835+0000 7f515897e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51541540d0 con 0x7f515415aa70 2023-12-19T13:57:53.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.835+0000 7f515897e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51541ee6c0 con 0x7f5154159f80 2023-12-19T13:57:53.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.835+0000 7f515897e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51541ee980 con 0x7f515415b1e0 2023-12-19T13:57:53.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.835+0000 7f5152ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f51540a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f51540a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57846/0 (socket says 172.21.15.113:57846) 2023-12-19T13:57:53.836 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 -- 172.21.15.113:0/3597220619 learned_addr learned my addr 172.21.15.113:0/3597220619 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:53.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f51537fe640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5154159f80 0x7f5154153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 -- 172.21.15.113:0/3597220619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f515415b1e0 msgr2=0x7f515406c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f515415b1e0 0x7f515406c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 -- 172.21.15.113:0/3597220619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5154159f80 msgr2=0x7f5154153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:53.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5154159f80 0x7f5154153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:53.837 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 -- 172.21.15.113:0/3597220619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c009b30 con 0x7f515415aa70 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f5152ffd640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f51540a8e70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c400 tx=0x7f513c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.836+0000 7f514bfff640 1 -- 172.21.15.113:0/3597220619 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0052d0 con 0x7f515415aa70 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.837+0000 7f514bfff640 1 -- 172.21.15.113:0/3597220619 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c005430 con 0x7f515415aa70 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.837+0000 7f514bfff640 1 -- 172.21.15.113:0/3597220619 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c003830 con 0x7f515415aa70 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.837+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51541eec60 con 0x7f515415aa70 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.837+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51541ef220 con 0x7f515415aa70 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.838+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5154061910 con 0x7f515415aa70 2023-12-19T13:57:53.838 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.839+0000 7f514bfff640 1 -- 172.21.15.113:0/3597220619 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f513c003990 con 0x7f515415aa70 2023-12-19T13:57:53.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.839+0000 7f514bfff640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f513406a430 0x7f513406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:53.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.840+0000 7f514bfff640 1 -- 172.21.15.113:0/3597220619 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f513c087bb0 con 0x7f515415aa70 2023-12-19T13:57:53.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.840+0000 7f51537fe640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f513406a430 0x7f513406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:53.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.840+0000 7f51537fe640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f513406a430 0x7f513406c8f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5144003d90 tx=0x7f5144009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:53.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:53.844+0000 7f514bfff640 1 -- 172.21.15.113:0/3597220619 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f513c0534a0 con 0x7f515415aa70 2023-12-19T13:57:54.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.103+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f51541ef410 con 0x7f515415aa70 2023-12-19T13:57:54.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.781+0000 7f514bfff640 1 -- 172.21.15.113:0/3597220619 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v546) v1 ==== 134+0+0 (secure 0 0 0) 0x7f513c056ac0 con 0x7f515415aa70 2023-12-19T13:57:54.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.784+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f513406a430 msgr2=0x7f513406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:54.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f513406a430 0x7f513406c8f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5144003d90 tx=0x7f5144009040 comp rx=0 tx=0).stop 2023-12-19T13:57:54.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 msgr2=0x7f51540a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:54.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f51540a8e70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c400 tx=0x7f513c00c8c0 comp rx=0 tx=0).stop 2023-12-19T13:57:54.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 shutdown_connections 2023-12-19T13:57:54.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f513406a430 0x7f513406c8f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:54.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f515415b1e0 0x7f515406c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:54.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f515415aa70 0x7f51540a8e70 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:54.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 --2- 172.21.15.113:0/3597220619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5154159f80 0x7f5154153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:54.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 >> 172.21.15.113:0/3597220619 conn(0x7f51540b0100 msgr2=0x7f51540b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:54.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 shutdown_connections 2023-12-19T13:57:54.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:54.785+0000 7f515897e640 1 -- 172.21.15.113:0/3597220619 wait complete. 2023-12-19T13:57:54.804 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:57:55.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.011+0000 7f861567d640 1 Processor -- start 2023-12-19T13:57:55.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.011+0000 7f861567d640 1 -- start start 2023-12-19T13:57:55.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.013+0000 7f861567d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8610146ff0 0x7f86100d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.013+0000 7f861567d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8610161e70 con 0x7f861006fc40 2023-12-19T13:57:55.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.013+0000 7f861567d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8610161260 con 0x7f86100b6430 2023-12-19T13:57:55.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.013+0000 7f861567d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8610161080 con 0x7f8610146ff0 2023-12-19T13:57:55.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.014+0000 7f860f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f861006fc40 0x7f861015dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34752/0 (socket says 172.21.15.113:34752) 2023-12-19T13:57:55.014 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.014+0000 7f860f7fe640 1 -- 172.21.15.113:0/4146567548 learned_addr learned my addr 172.21.15.113:0/4146567548 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.014+0000 7f860effd640 1 --2- 172.21.15.113:0/4146567548 >> v2:172.21.15.151:3300/0 conn(0x7f8610146ff0 0x7f86100d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.014+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293658595 0 0) 0x7f8610161e70 con 0x7f861006fc40 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.014+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85fc003520 con 0x7f861006fc40 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588968417 0 0) 0x7f85fc003520 con 0x7f861006fc40 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 >> v2:172.21.15.151:3300/0 conn(0x7f8610146ff0 msgr2=0x7f86100d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 --2- 172.21.15.113:0/4146567548 >> v2:172.21.15.151:3300/0 conn(0x7f8610146ff0 0x7f86100d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 >> v1:172.21.15.151:6789/0 conn(0x7f86100b6430 legacy=0x7f861006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610161540 con 0x7f861006fc40 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8608001670 con 0x7f861006fc40 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 >> v1:172.21.15.113:6789/0 conn(0x7f861006fc40 legacy=0x7f861015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc0039e0 0x7f85fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85fc0047c0 0x7f85fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85fc005180 0x7f85fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610161080 con 0x7f85fc005180 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc00c0b0 con 0x7f85fc0039e0 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc00c270 con 0x7f85fc0047c0 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.015+0000 7f860f7fe640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85fc005180 0x7f85fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.016+0000 7f860f7fe640 1 -- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85fc0047c0 msgr2=0x7f85fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.016+0000 7f860f7fe640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85fc0047c0 0x7f85fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.016+0000 7f860effd640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc0039e0 0x7f85fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.016+0000 7f860f7fe640 1 -- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc0039e0 msgr2=0x7f85fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.016+0000 7f860f7fe640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc0039e0 0x7f85fc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.016+0000 7f860f7fe640 1 -- 172.21.15.113:0/4146567548 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc003520 con 0x7f85fc005180 2023-12-19T13:57:55.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.016+0000 7f860effd640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc0039e0 0x7f85fc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:55.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.017+0000 7f860f7fe640 1 -- 172.21.15.113:0/4146567548 reap_dead start 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.017+0000 7f860f7fe640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85fc005180 0x7f85fc00b980 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f8608007fd0 tx=0x7f85fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbac96881128a28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.017+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608005ad0 con 0x7f85fc005180 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.017+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608005c30 con 0x7f85fc005180 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.017+0000 7f860e7fc640 1 -- 172.21.15.113:0/4146567548 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860802c850 con 0x7f85fc005180 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.018+0000 7f861567d640 1 -- 172.21.15.113:0/4146567548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85fc005180 msgr2=0x7f85fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.018+0000 7f861567d640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85fc005180 0x7f85fc00b980 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f8608007fd0 tx=0x7f85fc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.018+0000 7f861567d640 1 -- 172.21.15.113:0/4146567548 shutdown_connections 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.018+0000 7f861567d640 1 --2- 172.21.15.113:0/4146567548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85fc005180 0x7f85fc00b980 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.018+0000 7f861567d640 1 -- 172.21.15.113:0/4146567548 >> 172.21.15.113:0/4146567548 conn(0x7f86100d3520 msgr2=0x7f86100d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.018+0000 7f861567d640 1 -- 172.21.15.113:0/4146567548 shutdown_connections 2023-12-19T13:57:55.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.018+0000 7f861567d640 1 -- 172.21.15.113:0/4146567548 wait complete. 2023-12-19T13:57:55.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.020+0000 7f861567d640 1 Processor -- start 2023-12-19T13:57:55.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.020+0000 7f861567d640 1 -- start start 2023-12-19T13:57:55.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.021+0000 7f861567d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc005180 0x7f861015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.021+0000 7f861567d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86100b5ce0 0x7f86101f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f861567d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86100d1970 0x7f861013be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f861567d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861015c480 con 0x7f86100d1970 2023-12-19T13:57:55.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f861567d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86101f6c30 con 0x7f85fc005180 2023-12-19T13:57:55.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f861567d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86101f6670 con 0x7f86100b5ce0 2023-12-19T13:57:55.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86100d1970 0x7f861013be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86100d1970 0x7f861013be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57868/0 (socket says 172.21.15.113:57868) 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 -- 172.21.15.113:0/3353385328 learned_addr learned my addr 172.21.15.113:0/3353385328 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860effd640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc005180 0x7f861015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f86067fc640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86100b5ce0 0x7f86101f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 -- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86100b5ce0 msgr2=0x7f86101f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86100b5ce0 0x7f86101f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 -- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc005180 msgr2=0x7f861015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc005180 0x7f861015bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.022+0000 7f860f7fe640 1 -- 172.21.15.113:0/3353385328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86101f6950 con 0x7f86100d1970 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.023+0000 7f860f7fe640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86100d1970 0x7f861013be60 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f860800c250 tx=0x7f8608001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.023+0000 7f8607fff640 1 -- 172.21.15.113:0/3353385328 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860802dea0 con 0x7f86100d1970 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.023+0000 7f8607fff640 1 -- 172.21.15.113:0/3353385328 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86080049e0 con 0x7f86100d1970 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.023+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86100d1170 con 0x7f86100d1970 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.023+0000 7f8607fff640 1 -- 172.21.15.113:0/3353385328 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608004d70 con 0x7f86100d1970 2023-12-19T13:57:55.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.023+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86101f6260 con 0x7f86100d1970 2023-12-19T13:57:55.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.024+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8610061910 con 0x7f86100d1970 2023-12-19T13:57:55.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.025+0000 7f8607fff640 1 -- 172.21.15.113:0/3353385328 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8608032070 con 0x7f86100d1970 2023-12-19T13:57:55.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.026+0000 7f8607fff640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f006a430 0x7f85f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.026+0000 7f8607fff640 1 -- 172.21.15.113:0/3353385328 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f860803c070 con 0x7f86100d1970 2023-12-19T13:57:55.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.026+0000 7f860effd640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f006a430 0x7f85f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.027+0000 7f860effd640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f006a430 0x7f85f006c8f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8610146c90 tx=0x7f860000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:55.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.031+0000 7f8607fff640 1 -- 172.21.15.113:0/3353385328 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86080751f0 con 0x7f86100d1970 2023-12-19T13:57:55.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.220+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f86100d2390 con 0x7f86100d1970 2023-12-19T13:57:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.229+0000 7f8607fff640 1 -- 172.21.15.113:0/3353385328 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86080390c0 con 0x7f86100d1970 2023-12-19T13:57:55.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f006a430 msgr2=0x7f85f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f006a430 0x7f85f006c8f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8610146c90 tx=0x7f860000b040 comp rx=0 tx=0).stop 2023-12-19T13:57:55.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86100d1970 msgr2=0x7f861013be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86100d1970 0x7f861013be60 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f860800c250 tx=0x7f8608001a00 comp rx=0 tx=0).stop 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 shutdown_connections 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f006a430 0x7f85f006c8f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86100d1970 0x7f861013be60 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86100b5ce0 0x7f86101f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 --2- 172.21.15.113:0/3353385328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85fc005180 0x7f861015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 >> 172.21.15.113:0/3353385328 conn(0x7f86100d3520 msgr2=0x7f861015f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 shutdown_connections 2023-12-19T13:57:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.232+0000 7f861567d640 1 -- 172.21.15.113:0/3353385328 wait complete. 2023-12-19T13:57:55.250 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:57:55.250 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:57:55.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:57:55.484 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:57:55.484 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:57:55.484 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:55.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:57:55.544 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:57:55.544 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:55.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:57:55.604 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:57:55.604 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:55.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:57:55.666 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:57:55.666 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:57:55.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:57:55.724 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:57:55.724 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:57:55.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.946+0000 7f88b321a640 1 Processor -- start 2023-12-19T13:57:55.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.946+0000 7f88b321a640 1 -- start start 2023-12-19T13:57:55.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.948+0000 7f88b321a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.948+0000 7f88b321a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f88ac06c6b0 0x7f88ac0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.948+0000 7f88b321a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac0afb10 con 0x7f88ac0b0b50 2023-12-19T13:57:55.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.948+0000 7f88b321a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac06bb30 con 0x7f88ac06c6b0 2023-12-19T13:57:55.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.948+0000 7f88b321a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b0070 con 0x7f88ac1449e0 2023-12-19T13:57:55.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.949+0000 7f88b17b7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f88ac06c6b0 0x7f88ac0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.949+0000 7f88b0fb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.949+0000 7f88b0fb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:53542/0 (socket says 172.21.15.113:53542) 2023-12-19T13:57:55.949 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.949+0000 7f88b0fb6640 1 -- 172.21.15.113:0/2836066598 learned_addr learned my addr 172.21.15.113:0/2836066598 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:55.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.950+0000 7f88b0fb6640 1 -- 172.21.15.113:0/2836066598 >> v2:172.21.15.151:3300/0 conn(0x7f88ac06c6b0 msgr2=0x7f88ac0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:55.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.950+0000 7f88b0fb6640 1 --2- 172.21.15.113:0/2836066598 >> v2:172.21.15.151:3300/0 conn(0x7f88ac06c6b0 0x7f88ac0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.950+0000 7f88b0fb6640 1 -- 172.21.15.113:0/2836066598 >> v1:172.21.15.151:6789/0 conn(0x7f88ac0b0b50 legacy=0x7f88ac06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.950+0000 7f88b0fb6640 1 -- 172.21.15.113:0/2836066598 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0b0350 con 0x7f88ac1449e0 2023-12-19T13:57:55.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.951+0000 7f88b0fb6640 1 --2- 172.21.15.113:0/2836066598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac0af5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009870 tx=0x7f88a002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aafb7e099e3407d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:55.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.952+0000 7f88ab7fe640 1 -- 172.21.15.113:0/2836066598 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0030840 con 0x7f88ac1449e0 2023-12-19T13:57:55.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.952+0000 7f88ab7fe640 1 -- 172.21.15.113:0/2836066598 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a00309a0 con 0x7f88ac1449e0 2023-12-19T13:57:55.952 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.952+0000 7f88ab7fe640 1 -- 172.21.15.113:0/2836066598 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0030d30 con 0x7f88ac1449e0 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.952+0000 7f88b321a640 1 -- 172.21.15.113:0/2836066598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 msgr2=0x7f88ac0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.952+0000 7f88b321a640 1 --2- 172.21.15.113:0/2836066598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac0af5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009870 tx=0x7f88a002b980 comp rx=0 tx=0).stop 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.953+0000 7f88b321a640 1 -- 172.21.15.113:0/2836066598 shutdown_connections 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.953+0000 7f88b321a640 1 --2- 172.21.15.113:0/2836066598 >> v2:172.21.15.151:3300/0 conn(0x7f88ac06c6b0 0x7f88ac0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.953+0000 7f88b321a640 1 --2- 172.21.15.113:0/2836066598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac0af5d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.953+0000 7f88b321a640 1 -- 172.21.15.113:0/2836066598 >> 172.21.15.113:0/2836066598 conn(0x7f88ac0cbb70 msgr2=0x7f88ac0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.953+0000 7f88b321a640 1 -- 172.21.15.113:0/2836066598 shutdown_connections 2023-12-19T13:57:55.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.953+0000 7f88b321a640 1 -- 172.21.15.113:0/2836066598 wait complete. 2023-12-19T13:57:55.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.954+0000 7f88b321a640 1 Processor -- start 2023-12-19T13:57:55.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.955+0000 7f88b321a640 1 -- start start 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.955+0000 7f88b321a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88ac06c6b0 0x7f88ac0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.955+0000 7f88b321a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88ac0b0b50 0x7f88ac13a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.955+0000 7f88b321a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88b321a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0ade40 con 0x7f88ac0b0b50 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88b321a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac13b350 con 0x7f88ac06c6b0 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88b321a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac13adc0 con 0x7f88ac1449e0 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88ac0b0b50 0x7f88ac13a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88ac0b0b50 0x7f88ac13a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57876/0 (socket says 172.21.15.113:57876) 2023-12-19T13:57:55.956 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 -- 172.21.15.113:0/2130966397 learned_addr learned my addr 172.21.15.113:0/2130966397 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:55.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88b0fb6640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88ac06c6b0 0x7f88ac0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.957 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88b17b7640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 -- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 msgr2=0x7f88ac06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac06fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 -- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88ac06c6b0 msgr2=0x7f88ac0ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88ac06c6b0 0x7f88ac0ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.956+0000 7f88abfff640 1 -- 172.21.15.113:0/2130966397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00094d0 con 0x7f88ac0b0b50 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.957+0000 7f88abfff640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88ac0b0b50 0x7f88ac13a880 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f889800c450 tx=0x7f889800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.957+0000 7f88a97fa640 1 -- 172.21.15.113:0/2130966397 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980052d0 con 0x7f88ac0b0b50 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.957+0000 7f88a97fa640 1 -- 172.21.15.113:0/2130966397 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898005430 con 0x7f88ac0b0b50 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.957+0000 7f88a97fa640 1 -- 172.21.15.113:0/2130966397 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898012870 con 0x7f88ac0b0b50 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.957+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac1549d0 con 0x7f88ac0b0b50 2023-12-19T13:57:55.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.957+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac154380 con 0x7f88ac0b0b50 2023-12-19T13:57:55.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.958+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac154b60 con 0x7f88ac0b0b50 2023-12-19T13:57:55.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.959+0000 7f88a97fa640 1 -- 172.21.15.113:0/2130966397 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88980129d0 con 0x7f88ac0b0b50 2023-12-19T13:57:55.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.960+0000 7f88a97fa640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f889006a430 0x7f889006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:55.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.960+0000 7f88a97fa640 1 -- 172.21.15.113:0/2130966397 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8898088180 con 0x7f88ac0b0b50 2023-12-19T13:57:55.960 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.961+0000 7f88b0fb6640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f889006a430 0x7f889006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:55.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.961+0000 7f88b0fb6640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f889006a430 0x7f889006c8f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f88a0036000 tx=0x7f88a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:55.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:55.965+0000 7f88a97fa640 1 -- 172.21.15.113:0/2130966397 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8898053a70 con 0x7f88ac0b0b50 2023-12-19T13:57:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.190+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88ac061910 con 0x7f88ac0b0b50 2023-12-19T13:57:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.191+0000 7f88a97fa640 1 -- 172.21.15.113:0/2130966397 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f8898057090 con 0x7f88ac0b0b50 2023-12-19T13:57:56.192 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:56.192 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1272154547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1272154547},{"type":"v1","addr":"172.21.15.151:6835","nonce":1272154547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/2040676494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2040676494},{"type":"v1","addr":"172.21.15.151:6833","nonce":2040676494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":5995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/3719188294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3719188294},{"type":"v1","addr":"172.21.15.113:6837","nonce":3719188294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/3092488369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":3092488369},{"type":"v1","addr":"172.21.15.113:6836","nonce":3092488369}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-12-19T13:57:56.192 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 74 2023-12-19T13:57:56.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f889006a430 msgr2=0x7f889006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f889006a430 0x7f889006c8f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f88a0036000 tx=0x7f88a0008030 comp rx=0 tx=0).stop 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88ac0b0b50 msgr2=0x7f88ac13a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88ac0b0b50 0x7f88ac13a880 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f889800c450 tx=0x7f889800c910 comp rx=0 tx=0).stop 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 shutdown_connections 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f889006a430 0x7f889006c8f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88ac1449e0 0x7f88ac06fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f88ac0b0b50 0x7f88ac13a880 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 --2- 172.21.15.113:0/2130966397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88ac06c6b0 0x7f88ac0ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 >> 172.21.15.113:0/2130966397 conn(0x7f88ac0cbb70 msgr2=0x7f88ac15d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 shutdown_connections 2023-12-19T13:57:56.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.194+0000 7f88b321a640 1 -- 172.21.15.113:0/2130966397 wait complete. 2023-12-19T13:57:56.213 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:57:56.213 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:57:56.214 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:57:56.214 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:57:56.214 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:57:56.214 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:57:56.214 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:57:56.214 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:57:56.215 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:57:56.215 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:57:56.215 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:57:56.215 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:57:56.215 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:57:56.215 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:57:56.215 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:57:56.215 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:57:56.231 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:57:56.232 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:57:56.234 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:57:56.234 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:57:56.238 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:57:56.238 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:57:56.242 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:57:56.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:57:56.286 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:57:56.286 DEBUG:teuthology.parallel:result is None 2023-12-19T13:57:56.291 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:57:56.291 DEBUG:teuthology.parallel:result is None 2023-12-19T13:57:56.293 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:57:56.294 DEBUG:teuthology.parallel:result is None 2023-12-19T13:57:56.298 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:57:56.298 DEBUG:teuthology.parallel:result is None 2023-12-19T13:57:56.299 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:57:56.445 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:57:56.448 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:57:56.464 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:57:56.473 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:57:56.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.486+0000 7f86f9426640 1 Processor -- start 2023-12-19T13:57:56.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.486+0000 7f86f9426640 1 -- start start 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f9426640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86f40b0b50 0x7f86f406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f9426640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406b590 0x7f86f406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f9426640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f406bb30 con 0x7f86f41449e0 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f9426640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f40b0070 con 0x7f86f40b0b50 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f9426640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40b0350 con 0x7f86f406b590 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86f40b0b50 0x7f86f406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f2ffd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f86f41449e0 0x7f86f40af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:58178/0 (socket says 172.21.15.113:58178) 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.487+0000 7f86f2ffd640 1 -- 172.21.15.113:0/2293308117 learned_addr learned my addr 172.21.15.113:0/2293308117 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:56.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.488+0000 7f86f37fe640 1 --2- 172.21.15.113:0/2293308117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406b590 0x7f86f406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:56.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.488+0000 7f86f27fc640 1 -- 172.21.15.113:0/2293308117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406b590 msgr2=0x7f86f406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:56.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.488+0000 7f86f27fc640 1 --2- 172.21.15.113:0/2293308117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406b590 0x7f86f406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.488+0000 7f86f27fc640 1 -- 172.21.15.113:0/2293308117 >> v1:172.21.15.151:6789/0 conn(0x7f86f41449e0 legacy=0x7f86f40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:56.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.488+0000 7f86f27fc640 1 -- 172.21.15.113:0/2293308117 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40b0630 con 0x7f86f40b0b50 2023-12-19T13:57:56.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.490+0000 7f86f27fc640 1 --2- 172.21.15.113:0/2293308117 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f406bfa0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f86e80097a0 tx=0x7f86e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41990db048404ec2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.490+0000 7f86f1ffb640 1 -- 172.21.15.113:0/2293308117 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8031830 con 0x7f86f40b0b50 2023-12-19T13:57:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.490+0000 7f86f1ffb640 1 -- 172.21.15.113:0/2293308117 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8031990 con 0x7f86f40b0b50 2023-12-19T13:57:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.490+0000 7f86f1ffb640 1 -- 172.21.15.113:0/2293308117 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8031d20 con 0x7f86f40b0b50 2023-12-19T13:57:56.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 -- 172.21.15.113:0/2293308117 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 msgr2=0x7f86f406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:56.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 --2- 172.21.15.113:0/2293308117 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f406bfa0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f86e80097a0 tx=0x7f86e802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 -- 172.21.15.113:0/2293308117 shutdown_connections 2023-12-19T13:57:56.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 --2- 172.21.15.113:0/2293308117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f406b590 0x7f86f406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 --2- 172.21.15.113:0/2293308117 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f406bfa0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 -- 172.21.15.113:0/2293308117 >> 172.21.15.113:0/2293308117 conn(0x7f86f40cbb70 msgr2=0x7f86f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:56.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 -- 172.21.15.113:0/2293308117 shutdown_connections 2023-12-19T13:57:56.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.491+0000 7f86f9426640 1 -- 172.21.15.113:0/2293308117 wait complete. 2023-12-19T13:57:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.493+0000 7f86f9426640 1 Processor -- start 2023-12-19T13:57:56.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.493+0000 7f86f9426640 1 -- start start 2023-12-19T13:57:56.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.494+0000 7f86f9426640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f406b590 0x7f86f4143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:56.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.494+0000 7f86f9426640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.494+0000 7f86f9426640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f41449e0 0x7f86f4158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.494+0000 7f86f9426640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f413bed0 con 0x7f86f40b0b50 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.494+0000 7f86f9426640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4159740 con 0x7f86f406b590 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.494+0000 7f86f9426640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f413b570 con 0x7f86f41449e0 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f41580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57906/0 (socket says 172.21.15.113:57906) 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 -- 172.21.15.113:0/1925258890 learned_addr learned my addr 172.21.15.113:0/1925258890 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f37fe640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f41449e0 0x7f86f4158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:56.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f2ffd640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f406b590 0x7f86f4143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 -- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f41449e0 msgr2=0x7f86f4158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f41449e0 0x7f86f4158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 -- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f406b590 msgr2=0x7f86f4143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f406b590 0x7f86f4143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 -- 172.21.15.113:0/1925258890 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8009400 con 0x7f86f40b0b50 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.495+0000 7f86f27fc640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f41580d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f86e802bee0 tx=0x7f86e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.496+0000 7f86db7fe640 1 -- 172.21.15.113:0/1925258890 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e803a6f0 con 0x7f86f40b0b50 2023-12-19T13:57:56.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.496+0000 7f86db7fe640 1 -- 172.21.15.113:0/1925258890 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e803a870 con 0x7f86f40b0b50 2023-12-19T13:57:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.496+0000 7f86db7fe640 1 -- 172.21.15.113:0/1925258890 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e803ac20 con 0x7f86f40b0b50 2023-12-19T13:57:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.496+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f413b810 con 0x7f86f40b0b50 2023-12-19T13:57:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.496+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f4158cb0 con 0x7f86f40b0b50 2023-12-19T13:57:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.497+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f413c010 con 0x7f86f40b0b50 2023-12-19T13:57:56.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.498+0000 7f86db7fe640 1 -- 172.21.15.113:0/1925258890 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86e8030380 con 0x7f86f40b0b50 2023-12-19T13:57:56.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.499+0000 7f86db7fe640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86e006a430 0x7f86e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:56.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.499+0000 7f86db7fe640 1 -- 172.21.15.113:0/1925258890 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86e80a9f00 con 0x7f86f40b0b50 2023-12-19T13:57:56.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.499+0000 7f86f2ffd640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86e006a430 0x7f86e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:56.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.500+0000 7f86f2ffd640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86e006a430 0x7f86e006c8f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f86e4005880 tx=0x7f86e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:56.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.503+0000 7f86db7fe640 1 -- 172.21.15.113:0/1925258890 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86f413c010 con 0x7f86f40b0b50 2023-12-19T13:57:56.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:56.706+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f86f413c010 con 0x7f86f40b0b50 2023-12-19T13:57:57.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.500+0000 7f86db7fe640 1 -- 172.21.15.113:0/1925258890 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v174) v1 ==== 97+0+0 (secure 0 0 0) 0x7f86f413c010 con 0x7f86f40b0b50 2023-12-19T13:57:57.501 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:57:57.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86e006a430 msgr2=0x7f86e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:57.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86e006a430 0x7f86e006c8f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f86e4005880 tx=0x7f86e4009040 comp rx=0 tx=0).stop 2023-12-19T13:57:57.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 msgr2=0x7f86f41580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:57.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f41580d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f86e802bee0 tx=0x7f86e80046c0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 shutdown_connections 2023-12-19T13:57:57.505 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f86e006a430 0x7f86e006c8f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86f41449e0 0x7f86f4158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86f40b0b50 0x7f86f41580d0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 --2- 172.21.15.113:0/1925258890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86f406b590 0x7f86f4143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 >> 172.21.15.113:0/1925258890 conn(0x7f86f40cbb70 msgr2=0x7f86f40ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:57.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 shutdown_connections 2023-12-19T13:57:57.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.504+0000 7f86f9426640 1 -- 172.21.15.113:0/1925258890 wait complete. 2023-12-19T13:57:57.526 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:57:57.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.738+0000 7fad4aff0640 1 Processor -- start 2023-12-19T13:57:57.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.738+0000 7fad4aff0640 1 -- start start 2023-12-19T13:57:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.740+0000 7fad4aff0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad440b0b50 0x7fad4406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:57.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.740+0000 7fad4aff0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4406bb30 con 0x7fad441449e0 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.740+0000 7fad4aff0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440b0070 con 0x7fad4406b590 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.740+0000 7fad4aff0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440b0350 con 0x7fad440b0b50 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.740+0000 7fad43fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad440b0b50 0x7fad4406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.740+0000 7fad43fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fad440b0b50 0x7fad4406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57914/0 (socket says 172.21.15.113:57914) 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.740+0000 7fad43fff640 1 -- 172.21.15.113:0/4245713422 learned_addr learned my addr 172.21.15.113:0/4245713422 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.741+0000 7fad43fff640 1 -- 172.21.15.113:0/4245713422 >> v1:172.21.15.151:6789/0 conn(0x7fad4406b590 legacy=0x7fad440b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.741+0000 7fad43fff640 1 -- 172.21.15.113:0/4245713422 >> v1:172.21.15.113:6789/0 conn(0x7fad441449e0 legacy=0x7fad440af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:57.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.741+0000 7fad43fff640 1 -- 172.21.15.113:0/4245713422 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440b0630 con 0x7fad440b0b50 2023-12-19T13:57:57.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.742+0000 7fad43fff640 1 --2- 172.21.15.113:0/4245713422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad4406bfa0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fad30009870 tx=0x7fad3002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f5315bbf2466c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:57.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.742+0000 7fad437fe640 1 -- 172.21.15.113:0/4245713422 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30030860 con 0x7fad440b0b50 2023-12-19T13:57:57.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.742+0000 7fad437fe640 1 -- 172.21.15.113:0/4245713422 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad300309c0 con 0x7fad440b0b50 2023-12-19T13:57:57.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.742+0000 7fad437fe640 1 -- 172.21.15.113:0/4245713422 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30030d50 con 0x7fad440b0b50 2023-12-19T13:57:57.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.743+0000 7fad4aff0640 1 -- 172.21.15.113:0/4245713422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 msgr2=0x7fad4406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:57.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.743+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4245713422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad4406bfa0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fad30009870 tx=0x7fad3002b9a0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.743+0000 7fad4aff0640 1 -- 172.21.15.113:0/4245713422 shutdown_connections 2023-12-19T13:57:57.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.743+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4245713422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad4406bfa0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.743+0000 7fad4aff0640 1 -- 172.21.15.113:0/4245713422 >> 172.21.15.113:0/4245713422 conn(0x7fad440cbb70 msgr2=0x7fad440cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:57.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.743+0000 7fad4aff0640 1 -- 172.21.15.113:0/4245713422 shutdown_connections 2023-12-19T13:57:57.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.743+0000 7fad4aff0640 1 -- 172.21.15.113:0/4245713422 wait complete. 2023-12-19T13:57:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.745+0000 7fad4aff0640 1 Processor -- start 2023-12-19T13:57:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.745+0000 7fad4aff0640 1 -- start start 2023-12-19T13:57:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.746+0000 7fad4aff0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad4406b590 0x7fad441f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.746+0000 7fad4aff0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad441405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.746+0000 7fad4aff0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad441449e0 0x7fad44140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.746+0000 7fad4aff0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad441316c0 con 0x7fad440b0b50 2023-12-19T13:57:57.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.746+0000 7fad4aff0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44141920 con 0x7fad441449e0 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.746+0000 7fad4aff0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad441f08e0 con 0x7fad4406b590 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad441405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad441405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57926/0 (socket says 172.21.15.113:57926) 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 -- 172.21.15.113:0/4104423465 learned_addr learned my addr 172.21.15.113:0/4104423465 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad4958d640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad441449e0 0x7fad44140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 -- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad4406b590 msgr2=0x7fad441f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad48d8c640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad4406b590 0x7fad441f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad4406b590 0x7fad441f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 -- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad441449e0 msgr2=0x7fad44140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad441449e0 0x7fad44140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 -- 172.21.15.113:0/4104423465 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad300094d0 con 0x7fad440b0b50 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad4958d640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad441449e0 0x7fad44140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.747+0000 7fad43fff640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad441405e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fad30009990 tx=0x7fad30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:57.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.748+0000 7fad417fa640 1 -- 172.21.15.113:0/4104423465 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30030810 con 0x7fad440b0b50 2023-12-19T13:57:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.748+0000 7fad417fa640 1 -- 172.21.15.113:0/4104423465 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad30044480 con 0x7fad440b0b50 2023-12-19T13:57:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.748+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4413ba90 con 0x7fad440b0b50 2023-12-19T13:57:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.748+0000 7fad417fa640 1 -- 172.21.15.113:0/4104423465 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30044830 con 0x7fad440b0b50 2023-12-19T13:57:57.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.748+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad44141640 con 0x7fad440b0b50 2023-12-19T13:57:57.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.749+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4412f1e0 con 0x7fad440b0b50 2023-12-19T13:57:57.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.750+0000 7fad417fa640 1 -- 172.21.15.113:0/4104423465 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad3004d3b0 con 0x7fad440b0b50 2023-12-19T13:57:57.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.751+0000 7fad417fa640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2806a430 0x7fad2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:57.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.751+0000 7fad417fa640 1 -- 172.21.15.113:0/4104423465 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad3003e070 con 0x7fad440b0b50 2023-12-19T13:57:57.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.751+0000 7fad48d8c640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2806a430 0x7fad2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:57.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.752+0000 7fad48d8c640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2806a430 0x7fad2806c8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fad4415b3a0 tx=0x7fad38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:57.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:57.755+0000 7fad417fa640 1 -- 172.21.15.113:0/4104423465 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad4412f1e0 con 0x7fad440b0b50 2023-12-19T13:57:58.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.011+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fad4412f1e0 con 0x7fad440b0b50 2023-12-19T13:57:58.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.012+0000 7fad417fa640 1 -- 172.21.15.113:0/4104423465 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fad4412f1e0 con 0x7fad440b0b50 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:57:58.013 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.014 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.015 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.016 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.017 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.018 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.019 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:57:58.021 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:57:58.022 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:57:58.023 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.024 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:57:58.025 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:57:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:57:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:57:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:57:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:58.026 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:57:58.026 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2806a430 msgr2=0x7fad2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2806a430 0x7fad2806c8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fad4415b3a0 tx=0x7fad38009040 comp rx=0 tx=0).stop 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 msgr2=0x7fad441405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad441405e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fad30009990 tx=0x7fad30004730 comp rx=0 tx=0).stop 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 shutdown_connections 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fad2806a430 0x7fad2806c8f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad441449e0 0x7fad44140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad440b0b50 0x7fad441405e0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 --2- 172.21.15.113:0/4104423465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad4406b590 0x7fad441f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 >> 172.21.15.113:0/4104423465 conn(0x7fad440cbb70 msgr2=0x7fad440ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:58.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 shutdown_connections 2023-12-19T13:57:58.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.015+0000 7fad4aff0640 1 -- 172.21.15.113:0/4104423465 wait complete. 2023-12-19T13:57:58.032 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:57:58.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.240+0000 7fae6803e640 1 Processor -- start 2023-12-19T13:57:58.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.240+0000 7fae6803e640 1 -- start start 2023-12-19T13:57:58.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.241+0000 7fae6803e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fae600b1710 0x7fae6006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.241+0000 7fae6803e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 0x7fae6015e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.241+0000 7fae6803e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6015e9c0 con 0x7fae60157aa0 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.241+0000 7fae6803e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600b2600 con 0x7fae600b1710 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.241+0000 7fae6803e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600b1d60 con 0x7fae6015e040 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae655d9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fae600b1710 0x7fae6006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae65dda640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fae60157aa0 0x7fae60161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37868/0 (socket says 172.21.15.113:37868) 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae65dda640 1 -- 172.21.15.113:0/46890663 learned_addr learned my addr 172.21.15.113:0/46890663 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae655d9640 1 -- 172.21.15.113:0/46890663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 msgr2=0x7fae6015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae665db640 1 --2- 172.21.15.113:0/46890663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 0x7fae6015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae655d9640 1 --2- 172.21.15.113:0/46890663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 0x7fae6015e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae64dd8640 1 -- 172.21.15.113:0/46890663 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639232753 0 0) 0x7fae6015e9c0 con 0x7fae60157aa0 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae655d9640 1 -- 172.21.15.113:0/46890663 >> v1:172.21.15.113:6789/0 conn(0x7fae60157aa0 legacy=0x7fae60161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.242+0000 7fae655d9640 1 -- 172.21.15.113:0/46890663 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae600b2040 con 0x7fae600b1710 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.243+0000 7fae655d9640 1 --2- 172.21.15.113:0/46890663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae600b1710 0x7fae6006e410 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fae540097a0 tx=0x7fae5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f955d91302376f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae64dd8640 1 -- 172.21.15.113:0/46890663 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54031830 con 0x7fae600b1710 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae64dd8640 1 -- 172.21.15.113:0/46890663 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae54031990 con 0x7fae600b1710 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae64dd8640 1 -- 172.21.15.113:0/46890663 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54031d20 con 0x7fae600b1710 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 -- 172.21.15.113:0/46890663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae600b1710 msgr2=0x7fae6006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 --2- 172.21.15.113:0/46890663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae600b1710 0x7fae6006e410 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fae540097a0 tx=0x7fae5402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 -- 172.21.15.113:0/46890663 shutdown_connections 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 --2- 172.21.15.113:0/46890663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 0x7fae6015e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 --2- 172.21.15.113:0/46890663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae600b1710 0x7fae6006e410 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 -- 172.21.15.113:0/46890663 >> 172.21.15.113:0/46890663 conn(0x7fae600cbb70 msgr2=0x7fae600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:58.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 -- 172.21.15.113:0/46890663 shutdown_connections 2023-12-19T13:57:58.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.244+0000 7fae6803e640 1 -- 172.21.15.113:0/46890663 wait complete. 2023-12-19T13:57:58.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.246+0000 7fae6803e640 1 Processor -- start 2023-12-19T13:57:58.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.246+0000 7fae6803e640 1 -- start start 2023-12-19T13:57:58.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae6803e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae600b1710 0x7fae60146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae6803e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae60157aa0 0x7fae60143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae6803e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 0x7fae601f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae6803e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae60144160 con 0x7fae60157aa0 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae6803e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae60159df0 con 0x7fae600b1710 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae6803e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6015a070 con 0x7fae6015e040 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae655d9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae60157aa0 0x7fae60143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae655d9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae60157aa0 0x7fae60143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53930/0 (socket says 172.21.15.113:53930) 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.247+0000 7fae655d9640 1 -- 172.21.15.113:0/1978692604 learned_addr learned my addr 172.21.15.113:0/1978692604 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae65dda640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae600b1710 0x7fae60146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae655d9640 1 -- 172.21.15.113:0/1978692604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 msgr2=0x7fae601f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae655d9640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 0x7fae601f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae655d9640 1 -- 172.21.15.113:0/1978692604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae600b1710 msgr2=0x7fae60146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae655d9640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae600b1710 0x7fae60146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae655d9640 1 -- 172.21.15.113:0/1978692604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54009400 con 0x7fae60157aa0 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae655d9640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae60157aa0 0x7fae60143c20 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fae5402bee0 tx=0x7fae540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae527fc640 1 -- 172.21.15.113:0/1978692604 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5403ba70 con 0x7fae60157aa0 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae527fc640 1 -- 172.21.15.113:0/1978692604 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5403bbf0 con 0x7fae60157aa0 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae527fc640 1 -- 172.21.15.113:0/1978692604 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540453f0 con 0x7fae60157aa0 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.248+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae601f30d0 con 0x7fae60157aa0 2023-12-19T13:57:58.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.249+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae601f3690 con 0x7fae60157aa0 2023-12-19T13:57:58.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.250+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6015a230 con 0x7fae60157aa0 2023-12-19T13:57:58.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.250+0000 7fae527fc640 1 -- 172.21.15.113:0/1978692604 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae5404e450 con 0x7fae60157aa0 2023-12-19T13:57:58.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.252+0000 7fae527fc640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae4406a460 0x7fae4406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.252+0000 7fae527fc640 1 -- 172.21.15.113:0/1978692604 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae540aa890 con 0x7fae60157aa0 2023-12-19T13:57:58.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.252+0000 7fae65dda640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae4406a460 0x7fae4406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.252+0000 7fae65dda640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae4406a460 0x7fae4406c920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fae5c007fd0 tx=0x7fae5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:58.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.255+0000 7fae527fc640 1 -- 172.21.15.113:0/1978692604 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae54076380 con 0x7fae60157aa0 2023-12-19T13:57:58.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.444+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae601f3880 con 0x7fae60157aa0 2023-12-19T13:57:58.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.446+0000 7fae527fc640 1 -- 172.21.15.113:0/1978692604 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+12448 (secure 0 0 0) 0x7fae540799a0 con 0x7fae60157aa0 2023-12-19T13:57:58.446 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:58.446 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":174,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:57:57.493066+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:57:58.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae4406a460 msgr2=0x7fae4406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae4406a460 0x7fae4406c920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fae5c007fd0 tx=0x7fae5c009040 comp rx=0 tx=0).stop 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae60157aa0 msgr2=0x7fae60143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae60157aa0 0x7fae60143c20 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fae5402bee0 tx=0x7fae540046c0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 shutdown_connections 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fae4406a460 0x7fae4406c920 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae6015e040 0x7fae601f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fae60157aa0 0x7fae60143c20 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 --2- 172.21.15.113:0/1978692604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae600b1710 0x7fae60146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 >> 172.21.15.113:0/1978692604 conn(0x7fae600cbb70 msgr2=0x7fae600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 shutdown_connections 2023-12-19T13:57:58.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.448+0000 7fae6803e640 1 -- 172.21.15.113:0/1978692604 wait complete. 2023-12-19T13:57:58.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:57:58.468 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:57:58.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.680+0000 7f4fb6426640 1 Processor -- start 2023-12-19T13:57:58.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.681+0000 7f4fb6426640 1 -- start start 2023-12-19T13:57:58.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.682+0000 7f4fb6426640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 0x7f4fb00ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.682+0000 7f4fb6426640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb015da00 con 0x7f4fb0157c30 2023-12-19T13:57:58.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.682+0000 7f4fb6426640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb015dcc0 con 0x7f4fb00cce30 2023-12-19T13:57:58.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.682+0000 7f4fb6426640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb015e940 con 0x7f4fb00ad300 2023-12-19T13:57:58.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.682+0000 7f4faffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4fb0157c30 0x7f4fb00cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37872/0 (socket says 172.21.15.113:37872) 2023-12-19T13:57:58.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faffff640 1 -- 172.21.15.113:0/4180174756 learned_addr learned my addr 172.21.15.113:0/4180174756 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:58.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771815787 0 0) 0x7f4fb015da00 con 0x7f4fb0157c30 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4fa7fff640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 0x7f4fb00ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f9c003520 con 0x7f4fb0157c30 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 606705079 0 0) 0x7f4f9c003520 con 0x7f4fb0157c30 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 msgr2=0x7f4fb00ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 0x7f4fb00ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 >> v1:172.21.15.151:6789/0 conn(0x7f4fb00cce30 legacy=0x7f4fb00cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb015dfa0 con 0x7f4fb0157c30 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f4fa0001670 con 0x7f4fb0157c30 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 >> v1:172.21.15.113:6789/0 conn(0x7f4fb0157c30 legacy=0x7f4fb00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f9c003a10 0x7f4f9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.683+0000 7f4faf7fe640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4faf7fe640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 0x7f4f9c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb015e940 con 0x7f4f9c0047c0 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c00bb40 con 0x7f4f9c003a10 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c00bd00 con 0x7f4fb00ad300 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4fa7fff640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4faffff640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f9c003a10 0x7f4f9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4fb49c3640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 0x7f4f9c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4fa7fff640 1 -- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 msgr2=0x7f4f9c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:58.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4fa7fff640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb00ad300 0x7f4f9c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4fa7fff640 1 -- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f9c003a10 msgr2=0x7f4f9c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:58.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4fa7fff640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f9c003a10 0x7f4f9c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.684+0000 7f4fa7fff640 1 -- 172.21.15.113:0/4180174756 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c003520 con 0x7f4f9c0047c0 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4fa7fff640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800ba30 tx=0x7f4f9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f97b7e6e532d20 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98032640 con 0x7f4f9c0047c0 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f980327a0 con 0x7f4f9c0047c0 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4faf7fe640 1 -- 172.21.15.113:0/4180174756 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98032b30 con 0x7f4f9c0047c0 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4fb6426640 1 -- 172.21.15.113:0/4180174756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f9c0047c0 msgr2=0x7f4f9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4fb6426640 1 --2- 172.21.15.113:0/4180174756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800ba30 tx=0x7f4f9c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4fb49c3640 1 -- 172.21.15.113:0/4180174756 reap_dead start 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.686+0000 7f4fb6426640 1 -- 172.21.15.113:0/4180174756 shutdown_connections 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.687+0000 7f4fb6426640 1 -- 172.21.15.113:0/4180174756 >> 172.21.15.113:0/4180174756 conn(0x7f4fb0073150 msgr2=0x7f4fb00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.687+0000 7f4fb6426640 1 -- 172.21.15.113:0/4180174756 shutdown_connections 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.687+0000 7f4fb6426640 1 -- 172.21.15.113:0/4180174756 wait complete. 2023-12-19T13:57:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.688+0000 7f4fb6426640 1 Processor -- start 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.689+0000 7f4fb6426640 1 -- start start 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.689+0000 7f4fb6426640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f9c0047c0 0x7f4fb01439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.689+0000 7f4fb6426640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0150e30 0x7f4fb015f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb6426640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fb014e870 0x7f4fb0152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb6426640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0152050 con 0x7f4fb014e870 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb6426640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0143f30 con 0x7f4fb0150e30 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb6426640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01513d0 con 0x7f4f9c0047c0 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fb014e870 0x7f4fb0152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fb014e870 0x7f4fb0152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53950/0 (socket says 172.21.15.113:53950) 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 -- 172.21.15.113:0/2302335341 learned_addr learned my addr 172.21.15.113:0/2302335341 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fa7fff640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0150e30 0x7f4fb015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 -- 172.21.15.113:0/2302335341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f9c0047c0 msgr2=0x7f4fb01439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f9c0047c0 0x7f4fb01439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 -- 172.21.15.113:0/2302335341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0150e30 msgr2=0x7f4fb015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0150e30 0x7f4fb015f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 -- 172.21.15.113:0/2302335341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb01516b0 con 0x7f4fb014e870 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.690+0000 7f4fb49c3640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fb014e870 0x7f4fb0152470 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8000f80 tx=0x7f4fa800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.691+0000 7f4fad7fa640 1 -- 172.21.15.113:0/2302335341 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8003970 con 0x7f4fb014e870 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.691+0000 7f4fad7fa640 1 -- 172.21.15.113:0/2302335341 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa8003ad0 con 0x7f4fb014e870 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.691+0000 7f4fad7fa640 1 -- 172.21.15.113:0/2302335341 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8003e80 con 0x7f4fb014e870 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.691+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0151990 con 0x7f4fb014e870 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.691+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb015f7b0 con 0x7f4fb014e870 2023-12-19T13:57:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.692+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb01522c0 con 0x7f4fb014e870 2023-12-19T13:57:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.693+0000 7f4fad7fa640 1 -- 172.21.15.113:0/2302335341 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4fa80050d0 con 0x7f4fb014e870 2023-12-19T13:57:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.694+0000 7f4fad7fa640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.694+0000 7f4fad7fa640 1 -- 172.21.15.113:0/2302335341 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4fa8088430 con 0x7f4fb014e870 2023-12-19T13:57:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.694+0000 7f4faffff640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.695+0000 7f4faffff640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f9006a430 0x7f4f9006c8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00018e0 tx=0x7f4fa0001850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:58.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.698+0000 7f4fad7fa640 1 -- 172.21.15.113:0/2302335341 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4fa8053cd0 con 0x7f4fb014e870 2023-12-19T13:57:58.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.892+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fb0061910 con 0x7f4fb014e870 2023-12-19T13:57:58.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.893+0000 7f4fad7fa640 1 -- 172.21.15.113:0/2302335341 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fa80572f0 con 0x7f4fb014e870 2023-12-19T13:57:58.893 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:57:58.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.895+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f9006a430 msgr2=0x7f4f9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f9006a430 0x7f4f9006c8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00018e0 tx=0x7f4fa0001850 comp rx=0 tx=0).stop 2023-12-19T13:57:58.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fb014e870 msgr2=0x7f4fb0152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:58.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fb014e870 0x7f4fb0152470 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8000f80 tx=0x7f4fa800ec10 comp rx=0 tx=0).stop 2023-12-19T13:57:58.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 shutdown_connections 2023-12-19T13:57:58.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4fb014e870 0x7f4fb0152470 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0150e30 0x7f4fb015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 --2- 172.21.15.113:0/2302335341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f9c0047c0 0x7f4fb01439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:58.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 >> 172.21.15.113:0/2302335341 conn(0x7f4fb0073150 msgr2=0x7f4fb00cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:58.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 shutdown_connections 2023-12-19T13:57:58.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:58.896+0000 7f4fb6426640 1 -- 172.21.15.113:0/2302335341 wait complete. 2023-12-19T13:57:58.914 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:57:59.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.122+0000 7f20011ab640 1 Processor -- start 2023-12-19T13:57:59.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.122+0000 7f20011ab640 1 -- start start 2023-12-19T13:57:59.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.123+0000 7f20011ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ffc0b1050 0x7f1ffc0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.123+0000 7f20011ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 0x7f1ffc0c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.123+0000 7f20011ab640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0caa80 con 0x7f1ffc0c63c0 2023-12-19T13:57:59.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.123+0000 7f20011ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0cb370 con 0x7f1ffc0b1050 2023-12-19T13:57:59.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.123+0000 7f20011ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c6850 con 0x7f1ffc0b1430 2023-12-19T13:57:59.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.123+0000 7f1ffb59e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1ffc0c63c0 0x7f1ffc0cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37878/0 (socket says 172.21.15.113:37878) 2023-12-19T13:57:59.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.123+0000 7f1ffb59e640 1 -- 172.21.15.113:0/3539465476 learned_addr learned my addr 172.21.15.113:0/3539465476 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:59.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/3539465476 >> v2:172.21.15.151:3300/0 conn(0x7f1ffc0b1050 0x7f1ffc0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ff3fff640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 0x7f1ffc0c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257634679 0 0) 0x7f1ffc0caa80 con 0x7f1ffc0c63c0 2023-12-19T13:57:59.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe8003520 con 0x7f1ffc0c63c0 2023-12-19T13:57:59.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167767652 0 0) 0x7f1fe8003520 con 0x7f1ffc0c63c0 2023-12-19T13:57:59.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 msgr2=0x7f1ffc0c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 0x7f1ffc0c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 >> v2:172.21.15.151:3300/0 conn(0x7f1ffc0b1050 msgr2=0x7f1ffc0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 --2- 172.21.15.113:0/3539465476 >> v2:172.21.15.151:3300/0 conn(0x7f1ffc0b1050 0x7f1ffc0cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc162060 con 0x7f1ffc0c63c0 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1ff40019f0 con 0x7f1ffc0c63c0 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/3539465476 >> v2:172.21.15.151:3300/0 conn(0x7f1ffc0b1050 0x7f1ffc0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ff3fff640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 0x7f1ffc0c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 >> v1:172.21.15.113:6789/0 conn(0x7f1ffc0c63c0 legacy=0x7f1ffc0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fe80039a0 0x7f1fe8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fe80047c0 0x7f1fe8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 0x7f1fe8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0cb370 con 0x7f1fe80039a0 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c6850 con 0x7f1fe80047c0 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.124+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe800bab0 con 0x7f1ffc0b1430 2023-12-19T13:57:59.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.125+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fe80039a0 0x7f1fe8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.125+0000 7f1ffad9d640 1 -- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 msgr2=0x7f1fe8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.125+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ffc0b1430 0x7f1fe8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.125+0000 7f1ff3fff640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fe80047c0 0x7f1fe8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.125+0000 7f1ffad9d640 1 -- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fe80047c0 msgr2=0x7f1fe8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.125+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fe80047c0 0x7f1fe8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.125+0000 7f1ffad9d640 1 -- 172.21.15.113:0/3539465476 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8003520 con 0x7f1fe80039a0 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.126+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fe80039a0 0x7f1fe8003dc0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0098a0 tx=0x7f1fe80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dec1d1df9293234 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.126+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec004230 con 0x7f1fe80039a0 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.126+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec004390 con 0x7f1fe80039a0 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.126+0000 7f1ffa59c640 1 -- 172.21.15.113:0/3539465476 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec003830 con 0x7f1fe80039a0 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.127+0000 7f20011ab640 1 -- 172.21.15.113:0/3539465476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fe80039a0 msgr2=0x7f1fe8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.127+0000 7f20011ab640 1 --2- 172.21.15.113:0/3539465476 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fe80039a0 0x7f1fe8003dc0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0098a0 tx=0x7f1fe80057f0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.127+0000 7f1ffb59e640 1 -- 172.21.15.113:0/3539465476 reap_dead start 2023-12-19T13:57:59.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.127+0000 7f20011ab640 1 -- 172.21.15.113:0/3539465476 shutdown_connections 2023-12-19T13:57:59.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.127+0000 7f20011ab640 1 -- 172.21.15.113:0/3539465476 >> 172.21.15.113:0/3539465476 conn(0x7f1ffc0cc7c0 msgr2=0x7f1ffc0ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:59.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.127+0000 7f20011ab640 1 -- 172.21.15.113:0/3539465476 shutdown_connections 2023-12-19T13:57:59.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.127+0000 7f20011ab640 1 -- 172.21.15.113:0/3539465476 wait complete. 2023-12-19T13:57:59.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.129+0000 7f20011ab640 1 Processor -- start 2023-12-19T13:57:59.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.129+0000 7f20011ab640 1 -- start start 2023-12-19T13:57:59.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f20011ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fe80039a0 0x7f1ffc1f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f20011ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ffc144e50 0x7f1ffc1452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f20011ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ffc142f70 0x7f1ffc1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f20011ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc145d30 con 0x7f1ffc144e50 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f20011ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc145810 con 0x7f1ffc142f70 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f20011ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc142b20 con 0x7f1fe80039a0 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ffc144e50 0x7f1ffc1452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ffc144e50 0x7f1ffc1452d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53966/0 (socket says 172.21.15.113:53966) 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 -- 172.21.15.113:0/2939379763 learned_addr learned my addr 172.21.15.113:0/2939379763 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 -- 172.21.15.113:0/2939379763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fe80039a0 msgr2=0x7f1ffc1f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fe80039a0 0x7f1ffc1f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 -- 172.21.15.113:0/2939379763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ffc142f70 msgr2=0x7f1ffc1433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ffc142f70 0x7f1ffc1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.130+0000 7f1ff3fff640 1 -- 172.21.15.113:0/2939379763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc15b590 con 0x7f1ffc144e50 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.131+0000 7f1ff3fff640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ffc144e50 0x7f1ffc1452d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400f510 tx=0x7f1fe400f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.131+0000 7f1ff37fe640 1 -- 172.21.15.113:0/2939379763 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4014890 con 0x7f1ffc144e50 2023-12-19T13:57:59.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.131+0000 7f1ff37fe640 1 -- 172.21.15.113:0/2939379763 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400c030 con 0x7f1ffc144e50 2023-12-19T13:57:59.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.131+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc15b7e0 con 0x7f1ffc144e50 2023-12-19T13:57:59.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.131+0000 7f1ff37fe640 1 -- 172.21.15.113:0/2939379763 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4014c30 con 0x7f1ffc144e50 2023-12-19T13:57:59.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.131+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc15bda0 con 0x7f1ffc144e50 2023-12-19T13:57:59.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.132+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc074770 con 0x7f1ffc144e50 2023-12-19T13:57:59.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.133+0000 7f1ff37fe640 1 -- 172.21.15.113:0/2939379763 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1fe40133e0 con 0x7f1ffc144e50 2023-12-19T13:57:59.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.134+0000 7f1ff37fe640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1fdc06a430 0x7f1fdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.134+0000 7f1ff37fe640 1 -- 172.21.15.113:0/2939379763 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1fe4088830 con 0x7f1ffc144e50 2023-12-19T13:57:59.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.134+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1fdc06a430 0x7f1fdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.135+0000 7f1ffad9d640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1fdc06a430 0x7f1fdc06c8f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1fec035000 tx=0x7f1fec030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:59.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.138+0000 7f1ff37fe640 1 -- 172.21.15.113:0/2939379763 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1fe40540d0 con 0x7f1ffc144e50 2023-12-19T13:57:59.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.327+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1ffc0caf60 con 0x7f1ffc144e50 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.328+0000 7f1ff37fe640 1 -- 172.21.15.113:0/2939379763 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v174) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1fe40576f0 con 0x7f1ffc144e50 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:57:59.328 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1fdc06a430 msgr2=0x7f1fdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1fdc06a430 0x7f1fdc06c8f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1fec035000 tx=0x7f1fec030000 comp rx=0 tx=0).stop 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ffc144e50 msgr2=0x7f1ffc1452d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ffc144e50 0x7f1ffc1452d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400f510 tx=0x7f1fe400f9d0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 shutdown_connections 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1fdc06a430 0x7f1fdc06c8f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ffc142f70 0x7f1ffc1433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ffc144e50 0x7f1ffc1452d0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 --2- 172.21.15.113:0/2939379763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fe80039a0 0x7f1ffc1f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.330+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 >> 172.21.15.113:0/2939379763 conn(0x7f1ffc0cc7c0 msgr2=0x7f1ffc0cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:59.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.331+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 shutdown_connections 2023-12-19T13:57:59.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.331+0000 7f20011ab640 1 -- 172.21.15.113:0/2939379763 wait complete. 2023-12-19T13:57:59.350 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:57:59.350 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:57:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.566+0000 7f4d6565f640 1 Processor -- start 2023-12-19T13:57:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.567+0000 7f4d6565f640 1 -- start start 2023-12-19T13:57:59.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d6565f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d6015a000 0x7f4d6015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d6565f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4d600b1f90 0x7f4d6006c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d6565f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6015ec00 con 0x7f4d600cbca0 2023-12-19T13:57:59.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d6565f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d60071c60 con 0x7f4d6015a000 2023-12-19T13:57:59.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d6565f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d60070bc0 con 0x7f4d600b1f90 2023-12-19T13:57:59.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d5effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d6015a000 0x7f4d6015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d57fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4d600cbca0 0x7f4d600b1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37880/0 (socket says 172.21.15.113:37880) 2023-12-19T13:57:59.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.569+0000 7f4d57fff640 1 -- 172.21.15.113:0/2768991516 learned_addr learned my addr 172.21.15.113:0/2768991516 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:57:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.570+0000 7f4d5f7fe640 1 --2- 172.21.15.113:0/2768991516 >> v2:172.21.15.151:3300/0 conn(0x7f4d600b1f90 0x7f4d6006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.570+0000 7f4d5effd640 1 -- 172.21.15.113:0/2768991516 >> v2:172.21.15.151:3300/0 conn(0x7f4d600b1f90 msgr2=0x7f4d6006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:57:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.570+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2768991516 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374684139 0 0) 0x7f4d6015ec00 con 0x7f4d600cbca0 2023-12-19T13:57:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.570+0000 7f4d5effd640 1 --2- 172.21.15.113:0/2768991516 >> v2:172.21.15.151:3300/0 conn(0x7f4d600b1f90 0x7f4d6006c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.570+0000 7f4d5effd640 1 -- 172.21.15.113:0/2768991516 >> v1:172.21.15.113:6789/0 conn(0x7f4d600cbca0 legacy=0x7f4d600b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.570+0000 7f4d5effd640 1 -- 172.21.15.113:0/2768991516 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60070ea0 con 0x7f4d6015a000 2023-12-19T13:57:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.570+0000 7f4d5f7fe640 1 --2- 172.21.15.113:0/2768991516 >> v2:172.21.15.151:3300/0 conn(0x7f4d600b1f90 0x7f4d6006c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:59.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.571+0000 7f4d5effd640 1 --2- 172.21.15.113:0/2768991516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6015a000 0x7f4d6015e6c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4d600cc130 tx=0x7f4d5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5885c74a8ba81c6f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2768991516 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50031830 con 0x7f4d6015a000 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2768991516 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50031990 con 0x7f4d6015a000 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d5e7fc640 1 -- 172.21.15.113:0/2768991516 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50031d20 con 0x7f4d6015a000 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 -- 172.21.15.113:0/2768991516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6015a000 msgr2=0x7f4d6015e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 --2- 172.21.15.113:0/2768991516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6015a000 0x7f4d6015e6c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4d600cc130 tx=0x7f4d5002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 -- 172.21.15.113:0/2768991516 shutdown_connections 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 --2- 172.21.15.113:0/2768991516 >> v2:172.21.15.151:3300/0 conn(0x7f4d600b1f90 0x7f4d6006c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 --2- 172.21.15.113:0/2768991516 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d6015a000 0x7f4d6015e6c0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 -- 172.21.15.113:0/2768991516 >> 172.21.15.113:0/2768991516 conn(0x7f4d600cf230 msgr2=0x7f4d600cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 -- 172.21.15.113:0/2768991516 shutdown_connections 2023-12-19T13:57:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.572+0000 7f4d6565f640 1 -- 172.21.15.113:0/2768991516 wait complete. 2023-12-19T13:57:59.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.574+0000 7f4d6565f640 1 Processor -- start 2023-12-19T13:57:59.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.574+0000 7f4d6565f640 1 -- start start 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.575+0000 7f4d6565f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d600b1f90 0x7f4d6014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.575+0000 7f4d6565f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d600cbca0 0x7f4d601f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.575+0000 7f4d6565f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6015a000 0x7f4d60146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.575+0000 7f4d6565f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601f6640 con 0x7f4d600cbca0 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.575+0000 7f4d6565f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601f6920 con 0x7f4d600b1f90 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.575+0000 7f4d6565f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601f6c00 con 0x7f4d6015a000 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d600cbca0 0x7f4d601f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d600cbca0 0x7f4d601f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53998/0 (socket says 172.21.15.113:53998) 2023-12-19T13:57:59.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 -- 172.21.15.113:0/3581323488 learned_addr learned my addr 172.21.15.113:0/3581323488 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d5effd640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d600b1f90 0x7f4d6014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 -- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6015a000 msgr2=0x7f4d60146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6015a000 0x7f4d60146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 -- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d600b1f90 msgr2=0x7f4d6014c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d600b1f90 0x7f4d6014c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 -- 172.21.15.113:0/3581323488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d50009400 con 0x7f4d600cbca0 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d5effd640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d600b1f90 0x7f4d6014c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.576+0000 7f4d57fff640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d600cbca0 0x7f4d601f5df0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c4d0 tx=0x7f4d4800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.577+0000 7f4d577fe640 1 -- 172.21.15.113:0/3581323488 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d480074e0 con 0x7f4d600cbca0 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.577+0000 7f4d577fe640 1 -- 172.21.15.113:0/3581323488 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48007660 con 0x7f4d600cbca0 2023-12-19T13:57:59.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.577+0000 7f4d577fe640 1 -- 172.21.15.113:0/3581323488 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48004a20 con 0x7f4d600cbca0 2023-12-19T13:57:59.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.577+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d60156360 con 0x7f4d600cbca0 2023-12-19T13:57:59.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.577+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d601f6330 con 0x7f4d600cbca0 2023-12-19T13:57:59.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.578+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d60061910 con 0x7f4d600cbca0 2023-12-19T13:57:59.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.579+0000 7f4d577fe640 1 -- 172.21.15.113:0/3581323488 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d48004b80 con 0x7f4d600cbca0 2023-12-19T13:57:59.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.580+0000 7f4d577fe640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4006a430 0x7f4d4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:57:59.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.580+0000 7f4d577fe640 1 -- 172.21.15.113:0/3581323488 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4d48087760 con 0x7f4d600cbca0 2023-12-19T13:57:59.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.580+0000 7f4d5effd640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4006a430 0x7f4d4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:57:59.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.581+0000 7f4d5effd640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4006a430 0x7f4d4006c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4d50036000 tx=0x7f4d50008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:57:59.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.585+0000 7f4d577fe640 1 -- 172.21.15.113:0/3581323488 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d48053130 con 0x7f4d600cbca0 2023-12-19T13:57:59.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.760+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4d600cfff0 con 0x7f4d600cbca0 2023-12-19T13:57:59.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.870+0000 7f4d577fe640 1 -- 172.21.15.113:0/3581323488 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v175) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4d480180b0 con 0x7f4d600cbca0 2023-12-19T13:57:59.871 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:57:59.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.875+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4006a430 msgr2=0x7f4d4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.875+0000 7f4d6565f640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4006a430 0x7f4d4006c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4d50036000 tx=0x7f4d50008030 comp rx=0 tx=0).stop 2023-12-19T13:57:59.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.875+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d600cbca0 msgr2=0x7f4d601f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:57:59.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.875+0000 7f4d6565f640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d600cbca0 0x7f4d601f5df0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c4d0 tx=0x7f4d4800c990 comp rx=0 tx=0).stop 2023-12-19T13:57:59.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 shutdown_connections 2023-12-19T13:57:59.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4d4006a430 0x7f4d4006c8f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6015a000 0x7f4d60146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d600cbca0 0x7f4d601f5df0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 --2- 172.21.15.113:0/3581323488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d600b1f90 0x7f4d6014c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:57:59.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 >> 172.21.15.113:0/3581323488 conn(0x7f4d600cf230 msgr2=0x7f4d6014ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:57:59.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 shutdown_connections 2023-12-19T13:57:59.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:57:59.876+0000 7f4d6565f640 1 -- 172.21.15.113:0/3581323488 wait complete. 2023-12-19T13:57:59.896 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:58:00.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.101+0000 7f63e2817640 1 Processor -- start 2023-12-19T13:58:00.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.101+0000 7f63e2817640 1 -- start start 2023-12-19T13:58:00.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63e2817640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f63dc15a2d0 0x7f63dc0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:00.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63e2817640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc06b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:00.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63e2817640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc0cc1f0 con 0x7f63dc0ce830 2023-12-19T13:58:00.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63e2817640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc06e840 con 0x7f63dc15a2d0 2023-12-19T13:58:00.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63e2817640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0cbc30 con 0x7f63dc071210 2023-12-19T13:58:00.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f63dc15a2d0 0x7f63dc0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:00.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63dbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f63dc15a2d0 0x7f63dc0cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54014/0 (socket says 172.21.15.113:54014) 2023-12-19T13:58:00.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.103+0000 7f63dbfff640 1 -- 172.21.15.113:0/3267492305 learned_addr learned my addr 172.21.15.113:0/3267492305 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:00.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.104+0000 7f63e0db4640 1 --2- 172.21.15.113:0/3267492305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc06b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:00.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.104+0000 7f63dbfff640 1 -- 172.21.15.113:0/3267492305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 msgr2=0x7f63dc06b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:00.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.104+0000 7f63dbfff640 1 --2- 172.21.15.113:0/3267492305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc06b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.104+0000 7f63dbfff640 1 -- 172.21.15.113:0/3267492305 >> v1:172.21.15.151:6789/0 conn(0x7f63dc0ce830 legacy=0x7f63dc070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:00.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.104+0000 7f63dbfff640 1 -- 172.21.15.113:0/3267492305 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0cbf10 con 0x7f63dc15a2d0 2023-12-19T13:58:00.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.104+0000 7f63e0db4640 1 --2- 172.21.15.113:0/3267492305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc06b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:00.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.105+0000 7f63dbfff640 1 --2- 172.21.15.113:0/3267492305 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc15a2d0 0x7f63dc0cae20 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009870 tx=0x7f63cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a277b768b978318c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:00.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.105+0000 7f63db7fe640 1 -- 172.21.15.113:0/3267492305 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0317c0 con 0x7f63dc15a2d0 2023-12-19T13:58:00.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.105+0000 7f63db7fe640 1 -- 172.21.15.113:0/3267492305 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc031920 con 0x7f63dc15a2d0 2023-12-19T13:58:00.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.105+0000 7f63db7fe640 1 -- 172.21.15.113:0/3267492305 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc031cb0 con 0x7f63dc15a2d0 2023-12-19T13:58:00.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 -- 172.21.15.113:0/3267492305 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc15a2d0 msgr2=0x7f63dc0cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:00.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 --2- 172.21.15.113:0/3267492305 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc15a2d0 0x7f63dc0cae20 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009870 tx=0x7f63cc02b860 comp rx=0 tx=0).stop 2023-12-19T13:58:00.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 -- 172.21.15.113:0/3267492305 shutdown_connections 2023-12-19T13:58:00.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 --2- 172.21.15.113:0/3267492305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc06b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 --2- 172.21.15.113:0/3267492305 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc15a2d0 0x7f63dc0cae20 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 -- 172.21.15.113:0/3267492305 >> 172.21.15.113:0/3267492305 conn(0x7f63dc0cf0b0 msgr2=0x7f63dc0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:00.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 -- 172.21.15.113:0/3267492305 shutdown_connections 2023-12-19T13:58:00.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.106+0000 7f63e2817640 1 -- 172.21.15.113:0/3267492305 wait complete. 2023-12-19T13:58:00.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.108+0000 7f63e2817640 1 Processor -- start 2023-12-19T13:58:00.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.108+0000 7f63e2817640 1 -- start start 2023-12-19T13:58:00.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.109+0000 7f63e2817640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:00.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.109+0000 7f63e2817640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc0ce830 0x7f63dc15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.109+0000 7f63e2817640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63dc15a2d0 0x7f63dc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.109+0000 7f63e2817640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc15c240 con 0x7f63dc0ce830 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.109+0000 7f63e2817640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc15c520 con 0x7f63dc15a2d0 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.109+0000 7f63e2817640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc15c800 con 0x7f63dc071210 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.109+0000 7f63d3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc0ce830 0x7f63dc15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc0ce830 0x7f63dc15b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54016/0 (socket says 172.21.15.113:54016) 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 -- 172.21.15.113:0/3912828849 learned_addr learned my addr 172.21.15.113:0/3912828849 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63dbfff640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63e0db4640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63dc15a2d0 0x7f63dc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 -- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 msgr2=0x7f63dc146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 -- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63dc15a2d0 msgr2=0x7f63dc0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63dc15a2d0 0x7f63dc0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 -- 172.21.15.113:0/3912828849 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0094d0 con 0x7f63dc0ce830 2023-12-19T13:58:00.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.110+0000 7f63d3fff640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc0ce830 0x7f63dc15b860 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c430 tx=0x7f63c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:00.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.111+0000 7f63d97fa640 1 -- 172.21.15.113:0/3912828849 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4011790 con 0x7f63dc0ce830 2023-12-19T13:58:00.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.111+0000 7f63d97fa640 1 -- 172.21.15.113:0/3912828849 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c40118f0 con 0x7f63dc0ce830 2023-12-19T13:58:00.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.111+0000 7f63d97fa640 1 -- 172.21.15.113:0/3912828849 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4011ce0 con 0x7f63dc0ce830 2023-12-19T13:58:00.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.111+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc1476c0 con 0x7f63dc0ce830 2023-12-19T13:58:00.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.111+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc1472b0 con 0x7f63dc0ce830 2023-12-19T13:58:00.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.112+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc074770 con 0x7f63dc0ce830 2023-12-19T13:58:00.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.113+0000 7f63d97fa640 1 -- 172.21.15.113:0/3912828849 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f63c4026430 con 0x7f63dc0ce830 2023-12-19T13:58:00.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.114+0000 7f63d97fa640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63bc06a430 0x7f63bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:00.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.114+0000 7f63d97fa640 1 -- 172.21.15.113:0/3912828849 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f63c4089080 con 0x7f63dc0ce830 2023-12-19T13:58:00.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.114+0000 7f63dbfff640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63bc06a430 0x7f63bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:00.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.115+0000 7f63dbfff640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63bc06a430 0x7f63bc06c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f63cc036000 tx=0x7f63cc03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:00.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.118+0000 7f63d97fa640 1 -- 172.21.15.113:0/3912828849 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f63c4054930 con 0x7f63dc0ce830 2023-12-19T13:58:00.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.293+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f63dc147be0 con 0x7f63dc0ce830 2023-12-19T13:58:00.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.883+0000 7f63d97fa640 1 -- 172.21.15.113:0/3912828849 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v176) v1 ==== 170+0+0 (secure 0 0 0) 0x7f63dc147be0 con 0x7f63dc0ce830 2023-12-19T13:58:00.884 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:58:00.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.888+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63bc06a430 msgr2=0x7f63bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:00.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.888+0000 7f63e2817640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63bc06a430 0x7f63bc06c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f63cc036000 tx=0x7f63cc03d040 comp rx=0 tx=0).stop 2023-12-19T13:58:00.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.888+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc0ce830 msgr2=0x7f63dc15b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:00.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.888+0000 7f63e2817640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc0ce830 0x7f63dc15b860 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c430 tx=0x7f63c400c8f0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.892+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 shutdown_connections 2023-12-19T13:58:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.892+0000 7f63e2817640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f63bc06a430 0x7f63bc06c8f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.892+0000 7f63e2817640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63dc15a2d0 0x7f63dc0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.892+0000 7f63e2817640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63dc0ce830 0x7f63dc15b860 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.892+0000 7f63e2817640 1 --2- 172.21.15.113:0/3912828849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63dc071210 0x7f63dc146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.892+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 >> 172.21.15.113:0/3912828849 conn(0x7f63dc0cf0b0 msgr2=0x7f63dc0ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:00.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.894+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 shutdown_connections 2023-12-19T13:58:00.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:00.894+0000 7f63e2817640 1 -- 172.21.15.113:0/3912828849 wait complete. 2023-12-19T13:58:00.918 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:58:01.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.106+0000 7f6688d3e640 1 Processor -- start 2023-12-19T13:58:01.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.106+0000 7f6688d3e640 1 -- start start 2023-12-19T13:58:01.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.108+0000 7f6688d3e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f668406f530 0x7f668415e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.108+0000 7f6688d3e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f66840b7df0 0x7f66840b8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.108+0000 7f6688d3e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668415ea80 con 0x7f6684147010 2023-12-19T13:58:01.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.108+0000 7f6688d3e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840b6730 con 0x7f668406f530 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.108+0000 7f6688d3e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668406f9c0 con 0x7f66840b7df0 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.108+0000 7f6681d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f668406f530 0x7f668415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.108+0000 7f6681d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f668406f530 0x7f668415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54024/0 (socket says 172.21.15.113:54024) 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f6681d9b640 1 -- 172.21.15.113:0/3472631188 learned_addr learned my addr 172.21.15.113:0/3472631188 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f668259c640 1 --1- 172.21.15.113:0/3472631188 >> v1:172.21.15.113:6789/0 conn(0x7f6684147010 0x7f668415ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37890/0 (socket says 172.21.15.113:37890) 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f6681d9b640 1 -- 172.21.15.113:0/3472631188 >> v2:172.21.15.151:3300/0 conn(0x7f66840b7df0 msgr2=0x7f66840b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f6682d9d640 1 --2- 172.21.15.113:0/3472631188 >> v2:172.21.15.151:3300/0 conn(0x7f66840b7df0 0x7f66840b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f6681d9b640 1 --2- 172.21.15.113:0/3472631188 >> v2:172.21.15.151:3300/0 conn(0x7f66840b7df0 0x7f66840b8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f668159a640 1 -- 172.21.15.113:0/3472631188 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074606493 0 0) 0x7f6674001110 con 0x7f6684147010 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f6681d9b640 1 -- 172.21.15.113:0/3472631188 >> v1:172.21.15.113:6789/0 conn(0x7f6684147010 legacy=0x7f668415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.109+0000 7f6681d9b640 1 -- 172.21.15.113:0/3472631188 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668406fca0 con 0x7f668406f530 2023-12-19T13:58:01.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.110+0000 7f6681d9b640 1 --2- 172.21.15.113:0/3472631188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f668406f530 0x7f668415e540 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f66840d34d0 tx=0x7f667802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cacac8be67454f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.110+0000 7f668159a640 1 -- 172.21.15.113:0/3472631188 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678031870 con 0x7f668406f530 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.110+0000 7f668159a640 1 -- 172.21.15.113:0/3472631188 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780319d0 con 0x7f668406f530 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.110+0000 7f668159a640 1 -- 172.21.15.113:0/3472631188 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678031d60 con 0x7f668406f530 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 -- 172.21.15.113:0/3472631188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f668406f530 msgr2=0x7f668415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 --2- 172.21.15.113:0/3472631188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f668406f530 0x7f668415e540 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f66840d34d0 tx=0x7f667802b910 comp rx=0 tx=0).stop 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 -- 172.21.15.113:0/3472631188 shutdown_connections 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 --2- 172.21.15.113:0/3472631188 >> v2:172.21.15.151:3300/0 conn(0x7f66840b7df0 0x7f66840b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 --2- 172.21.15.113:0/3472631188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f668406f530 0x7f668415e540 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 -- 172.21.15.113:0/3472631188 >> 172.21.15.113:0/3472631188 conn(0x7f66840d3520 msgr2=0x7f66840d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:01.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 -- 172.21.15.113:0/3472631188 shutdown_connections 2023-12-19T13:58:01.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.111+0000 7f6688d3e640 1 -- 172.21.15.113:0/3472631188 wait complete. 2023-12-19T13:58:01.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.113+0000 7f6688d3e640 1 Processor -- start 2023-12-19T13:58:01.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.113+0000 7f6688d3e640 1 -- start start 2023-12-19T13:58:01.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f6688d3e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66840b7df0 0x7f66840cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f6688d3e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6684147010 0x7f6684143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f6688d3e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6684144570 0x7f66840ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f6688d3e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840cc8d0 con 0x7f66840b7df0 2023-12-19T13:58:01.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f6688d3e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840ccbb0 con 0x7f6684147010 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f6688d3e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840cce90 con 0x7f6684144570 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66840b7df0 0x7f66840cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66840b7df0 0x7f66840cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54030/0 (socket says 172.21.15.113:54030) 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 -- 172.21.15.113:0/776535369 learned_addr learned my addr 172.21.15.113:0/776535369 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 -- 172.21.15.113:0/776535369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6684144570 msgr2=0x7f66840ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6684144570 0x7f66840ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 -- 172.21.15.113:0/776535369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6684147010 msgr2=0x7f6684143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6684147010 0x7f6684143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.114+0000 7f668259c640 1 -- 172.21.15.113:0/776535369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66780094d0 con 0x7f66840b7df0 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.115+0000 7f668259c640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66840b7df0 0x7f66840cd970 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f667400c430 tx=0x7f667400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.115+0000 7f6672ffd640 1 -- 172.21.15.113:0/776535369 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740074e0 con 0x7f66840b7df0 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.115+0000 7f6672ffd640 1 -- 172.21.15.113:0/776535369 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674007660 con 0x7f66840b7df0 2023-12-19T13:58:01.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.115+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66840cd170 con 0x7f66840b7df0 2023-12-19T13:58:01.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.115+0000 7f6672ffd640 1 -- 172.21.15.113:0/776535369 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674004a20 con 0x7f66840b7df0 2023-12-19T13:58:01.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.115+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66840cdeb0 con 0x7f66840b7df0 2023-12-19T13:58:01.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.116+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6684061910 con 0x7f66840b7df0 2023-12-19T13:58:01.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.117+0000 7f6672ffd640 1 -- 172.21.15.113:0/776535369 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6674004b80 con 0x7f66840b7df0 2023-12-19T13:58:01.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.118+0000 7f6672ffd640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f666406a430 0x7f666406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.118+0000 7f6672ffd640 1 -- 172.21.15.113:0/776535369 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6674088560 con 0x7f66840b7df0 2023-12-19T13:58:01.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.118+0000 7f6681d9b640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f666406a430 0x7f666406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.119+0000 7f6681d9b640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f666406a430 0x7f666406c8f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6678036000 tx=0x7f6678030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.123+0000 7f6672ffd640 1 -- 172.21.15.113:0/776535369 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6674053ba0 con 0x7f66840b7df0 2023-12-19T13:58:01.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.332+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f668415ea80 con 0x7f66840b7df0 2023-12-19T13:58:01.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.345+0000 7f6672ffd640 1 -- 172.21.15.113:0/776535369 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v76) v1 ==== 174+0+0 (secure 0 0 0) 0x7f668415ea80 con 0x7f66840b7df0 2023-12-19T13:58:01.346 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 20 and data pool 21 2023-12-19T13:58:01.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f666406a430 msgr2=0x7f666406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f666406a430 0x7f666406c8f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6678036000 tx=0x7f6678030000 comp rx=0 tx=0).stop 2023-12-19T13:58:01.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66840b7df0 msgr2=0x7f66840cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66840b7df0 0x7f66840cd970 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f667400c430 tx=0x7f667400c8f0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 shutdown_connections 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f666406a430 0x7f666406c8f0 secure :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6678036000 tx=0x7f6678030000 comp rx=0 tx=0).stop 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6684144570 0x7f66840ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6684147010 0x7f6684143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 --2- 172.21.15.113:0/776535369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66840b7df0 0x7f66840cd970 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.349+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 >> 172.21.15.113:0/776535369 conn(0x7f66840d3520 msgr2=0x7f66840d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:01.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.350+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 shutdown_connections 2023-12-19T13:58:01.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.351+0000 7f6688d3e640 1 -- 172.21.15.113:0/776535369 wait complete. 2023-12-19T13:58:01.379 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:58:01.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.555+0000 7f26dd62d640 1 Processor -- start 2023-12-19T13:58:01.556 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.556+0000 7f26dd62d640 1 -- start start 2023-12-19T13:58:01.557 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.557+0000 7f26dd62d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f26d80b2030 0x7f26d815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.557+0000 7f26dd62d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f26d80cdbf0 0x7f26d80ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.557+0000 7f26dd62d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d815ec30 con 0x7f26d815e5a0 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.557+0000 7f26dd62d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d815fbc0 con 0x7f26d80b2030 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.557+0000 7f26dd62d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d80ce560 con 0x7f26d80cdbf0 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.557+0000 7f26d77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f26d80b2030 0x7f26d815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f26d80b2030 0x7f26d815f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54038/0 (socket says 172.21.15.113:54038) 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f26d815e5a0 0x7f26d80b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37892/0 (socket says 172.21.15.113:37892) 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d77fe640 1 -- 172.21.15.113:0/1552746822 learned_addr learned my addr 172.21.15.113:0/1552746822 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:01.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26dce2c640 1 --2- 172.21.15.113:0/1552746822 >> v2:172.21.15.151:3300/0 conn(0x7f26d80cdbf0 0x7f26d80ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d77fe640 1 -- 172.21.15.113:0/1552746822 >> v2:172.21.15.151:3300/0 conn(0x7f26d80cdbf0 msgr2=0x7f26d80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:01.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d77fe640 1 --2- 172.21.15.113:0/1552746822 >> v2:172.21.15.151:3300/0 conn(0x7f26d80cdbf0 0x7f26d80ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d77fe640 1 -- 172.21.15.113:0/1552746822 >> v1:172.21.15.113:6789/0 conn(0x7f26d815e5a0 legacy=0x7f26d80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d6ffd640 1 -- 172.21.15.113:0/1552746822 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362869050 0 0) 0x7f26d815ec30 con 0x7f26d815e5a0 2023-12-19T13:58:01.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.558+0000 7f26d77fe640 1 -- 172.21.15.113:0/1552746822 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d815e980 con 0x7f26d80b2030 2023-12-19T13:58:01.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.559+0000 7f26d77fe640 1 --2- 172.21.15.113:0/1552746822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d815f680 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009870 tx=0x7f26cc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cef8c361230dc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.559+0000 7f26d6ffd640 1 -- 172.21.15.113:0/1552746822 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc030860 con 0x7f26d80b2030 2023-12-19T13:58:01.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.559+0000 7f26d6ffd640 1 -- 172.21.15.113:0/1552746822 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0309c0 con 0x7f26d80b2030 2023-12-19T13:58:01.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.559+0000 7f26d6ffd640 1 -- 172.21.15.113:0/1552746822 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc030d50 con 0x7f26d80b2030 2023-12-19T13:58:01.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 -- 172.21.15.113:0/1552746822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 msgr2=0x7f26d815f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 --2- 172.21.15.113:0/1552746822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d815f680 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009870 tx=0x7f26cc02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 -- 172.21.15.113:0/1552746822 shutdown_connections 2023-12-19T13:58:01.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 --2- 172.21.15.113:0/1552746822 >> v2:172.21.15.151:3300/0 conn(0x7f26d80cdbf0 0x7f26d80ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 --2- 172.21.15.113:0/1552746822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d815f680 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 -- 172.21.15.113:0/1552746822 >> 172.21.15.113:0/1552746822 conn(0x7f26d80b0100 msgr2=0x7f26d80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:01.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 -- 172.21.15.113:0/1552746822 shutdown_connections 2023-12-19T13:58:01.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.560+0000 7f26dd62d640 1 -- 172.21.15.113:0/1552746822 wait complete. 2023-12-19T13:58:01.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.562+0000 7f26dd62d640 1 Processor -- start 2023-12-19T13:58:01.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.562+0000 7f26dd62d640 1 -- start start 2023-12-19T13:58:01.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26dd62d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d80a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26dd62d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26d80cdbf0 0x7f26d80ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26dd62d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26d815e5a0 0x7f26d814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26dd62d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80cbd40 con 0x7f26d80b2030 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26dd62d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80cc020 con 0x7f26d80cdbf0 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26dd62d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80cc300 con 0x7f26d815e5a0 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26d7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d80a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26d7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d80a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54050/0 (socket says 172.21.15.113:54050) 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26d7fff640 1 -- 172.21.15.113:0/838687027 learned_addr learned my addr 172.21.15.113:0/838687027 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26d7fff640 1 -- 172.21.15.113:0/838687027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26d815e5a0 msgr2=0x7f26d814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.563+0000 7f26d7fff640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26d815e5a0 0x7f26d814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26d7fff640 1 -- 172.21.15.113:0/838687027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26d80cdbf0 msgr2=0x7f26d80ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26d7fff640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26d80cdbf0 0x7f26d80ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26d7fff640 1 -- 172.21.15.113:0/838687027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0094d0 con 0x7f26d80b2030 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26d7fff640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d80a88d0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f26c800c4d0 tx=0x7f26c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26d4ff9640 1 -- 172.21.15.113:0/838687027 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80074e0 con 0x7f26d80b2030 2023-12-19T13:58:01.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26d4ff9640 1 -- 172.21.15.113:0/838687027 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c8007660 con 0x7f26d80b2030 2023-12-19T13:58:01.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26d4ff9640 1 -- 172.21.15.113:0/838687027 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8004a20 con 0x7f26d80b2030 2023-12-19T13:58:01.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d80cc5e0 con 0x7f26d80b2030 2023-12-19T13:58:01.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.564+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d814ef50 con 0x7f26d80b2030 2023-12-19T13:58:01.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.565+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d80ccb00 con 0x7f26d80b2030 2023-12-19T13:58:01.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.566+0000 7f26d4ff9640 1 -- 172.21.15.113:0/838687027 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f26c8004b80 con 0x7f26d80b2030 2023-12-19T13:58:01.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.567+0000 7f26d4ff9640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26c406a430 0x7f26c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.567+0000 7f26d4ff9640 1 -- 172.21.15.113:0/838687027 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26c8087a60 con 0x7f26d80b2030 2023-12-19T13:58:01.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.568+0000 7f26d77fe640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26c406a430 0x7f26c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.568+0000 7f26d77fe640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26c406a430 0x7f26c406c8f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f26cc036000 tx=0x7f26cc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.572+0000 7f26d4ff9640 1 -- 172.21.15.113:0/838687027 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f26d80ccb00 con 0x7f26d80b2030 2023-12-19T13:58:01.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.748+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26d80ccb00 con 0x7f26d80b2030 2023-12-19T13:58:01.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.750+0000 7f26d4ff9640 1 -- 172.21.15.113:0/838687027 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f26c8018020 con 0x7f26d80b2030 2023-12-19T13:58:01.751 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:01.751 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":177,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:58:01.335079+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:58:01.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.752+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26c406a430 msgr2=0x7f26c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.752+0000 7f26dd62d640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26c406a430 0x7f26c406c8f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f26cc036000 tx=0x7f26cc03b040 comp rx=0 tx=0).stop 2023-12-19T13:58:01.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.752+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 msgr2=0x7f26d80a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.752+0000 7f26dd62d640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d80a88d0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f26c800c4d0 tx=0x7f26c800c990 comp rx=0 tx=0).stop 2023-12-19T13:58:01.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 shutdown_connections 2023-12-19T13:58:01.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f26c406a430 0x7f26c406c8f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26d815e5a0 0x7f26d814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26d80cdbf0 0x7f26d80ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 --2- 172.21.15.113:0/838687027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d80b2030 0x7f26d80a88d0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 >> 172.21.15.113:0/838687027 conn(0x7f26d80b0100 msgr2=0x7f26d80b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:01.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 shutdown_connections 2023-12-19T13:58:01.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.753+0000 7f26dd62d640 1 -- 172.21.15.113:0/838687027 wait complete. 2023-12-19T13:58:01.772 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:58:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.966+0000 7f3cd8838640 1 Processor -- start 2023-12-19T13:58:01.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.966+0000 7f3cd8838640 1 -- start start 2023-12-19T13:58:01.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cd8838640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3cd4146e10 0x7f3cd40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cd8838640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd40cd840 con 0x7f3cd40d2b00 2023-12-19T13:58:01.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cd8838640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd40b6e90 con 0x7f3cd40ce110 2023-12-19T13:58:01.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cd8838640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd40d2430 con 0x7f3cd4146e10 2023-12-19T13:58:01.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cd259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3cd4146e10 0x7f3cd40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cc9d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3cd40d2b00 0x7f3cd40b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37902/0 (socket says 172.21.15.113:37902) 2023-12-19T13:58:01.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cd259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3cd4146e10 0x7f3cd40d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54056/0 (socket says 172.21.15.113:54056) 2023-12-19T13:58:01.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.968+0000 7f3cc9d9b640 1 -- 172.21.15.113:0/2598007250 learned_addr learned my addr 172.21.15.113:0/2598007250 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:58:01.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.969+0000 7f3cd259c640 1 -- 172.21.15.113:0/2598007250 >> v1:172.21.15.151:6789/0 conn(0x7f3cd40ce110 legacy=0x7f3cd40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:01.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.969+0000 7f3cd259c640 1 -- 172.21.15.113:0/2598007250 >> v1:172.21.15.113:6789/0 conn(0x7f3cd40d2b00 legacy=0x7f3cd40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.969+0000 7f3cd259c640 1 -- 172.21.15.113:0/2598007250 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40d2620 con 0x7f3cd4146e10 2023-12-19T13:58:01.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.970+0000 7f3cd259c640 1 --2- 172.21.15.113:0/2598007250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd4146e10 0x7f3cd40d1ef0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097a0 tx=0x7f3cc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a1c44b3e36bdbc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.970+0000 7f3cd1d9b640 1 -- 172.21.15.113:0/2598007250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc402e070 con 0x7f3cd4146e10 2023-12-19T13:58:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd1d9b640 1 -- 172.21.15.113:0/2598007250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40315a0 con 0x7f3cd4146e10 2023-12-19T13:58:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd1d9b640 1 -- 172.21.15.113:0/2598007250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4031930 con 0x7f3cd4146e10 2023-12-19T13:58:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd8838640 1 -- 172.21.15.113:0/2598007250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd4146e10 msgr2=0x7f3cd40d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd8838640 1 --2- 172.21.15.113:0/2598007250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd4146e10 0x7f3cd40d1ef0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097a0 tx=0x7f3cc402b840 comp rx=0 tx=0).stop 2023-12-19T13:58:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd8838640 1 -- 172.21.15.113:0/2598007250 shutdown_connections 2023-12-19T13:58:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd8838640 1 --2- 172.21.15.113:0/2598007250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd4146e10 0x7f3cd40d1ef0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd8838640 1 -- 172.21.15.113:0/2598007250 >> 172.21.15.113:0/2598007250 conn(0x7f3cd40b29c0 msgr2=0x7f3cd40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd8838640 1 -- 172.21.15.113:0/2598007250 shutdown_connections 2023-12-19T13:58:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.971+0000 7f3cd8838640 1 -- 172.21.15.113:0/2598007250 wait complete. 2023-12-19T13:58:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.973+0000 7f3cd8838640 1 Processor -- start 2023-12-19T13:58:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.973+0000 7f3cd8838640 1 -- start start 2023-12-19T13:58:01.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd8838640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd40ce110 0x7f3cd415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd8838640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40d2b00 0x7f3cd4145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd8838640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd4146e10 0x7f3cd41460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd8838640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415fe40 con 0x7f3cd40ce110 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd8838640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415f230 con 0x7f3cd4146e10 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd8838640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415f510 con 0x7f3cd40d2b00 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd40ce110 0x7f3cd415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd40ce110 0x7f3cd415eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54072/0 (socket says 172.21.15.113:54072) 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.974+0000 7f3cd259c640 1 -- 172.21.15.113:0/4057935989 learned_addr learned my addr 172.21.15.113:0/4057935989 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cc9d9b640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40d2b00 0x7f3cd4145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd259c640 1 -- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40d2b00 msgr2=0x7f3cd4145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd2d9d640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd4146e10 0x7f3cd41460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd259c640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40d2b00 0x7f3cd4145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd259c640 1 -- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd4146e10 msgr2=0x7f3cd41460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:01.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd259c640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd4146e10 0x7f3cd41460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd259c640 1 -- 172.21.15.113:0/4057935989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4009400 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd2d9d640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd4146e10 0x7f3cd41460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd259c640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd40ce110 0x7f3cd415eb30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4034040 tx=0x7f3cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3ccb7fe640 1 -- 172.21.15.113:0/4057935989 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4032900 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3ccb7fe640 1 -- 172.21.15.113:0/4057935989 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4032a80 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd415f7f0 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.975+0000 7f3ccb7fe640 1 -- 172.21.15.113:0/4057935989 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4032e30 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.976+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd41602d0 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.977+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd40cdeb0 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.977+0000 7f3ccb7fe640 1 -- 172.21.15.113:0/4057935989 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3cc403b3f0 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.978+0000 7f3ccb7fe640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cb406a430 0x7f3cb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.978+0000 7f3ccb7fe640 1 -- 172.21.15.113:0/4057935989 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cc40aa960 con 0x7f3cd40ce110 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.979+0000 7f3cc9d9b640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cb406a430 0x7f3cb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:01.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.979+0000 7f3cc9d9b640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cb406a430 0x7f3cb406c8f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4143690 tx=0x7f3cbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:01.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:01.983+0000 7f3ccb7fe640 1 -- 172.21.15.113:0/4057935989 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3cc4075f50 con 0x7f3cd40ce110 2023-12-19T13:58:02.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.173+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cd4061910 con 0x7f3cd40ce110 2023-12-19T13:58:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.176+0000 7f3ccb7fe640 1 -- 172.21.15.113:0/4057935989 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f3cc4079570 con 0x7f3cd40ce110 2023-12-19T13:58:02.176 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:02.176 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":177,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:58:01.335079+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:58:02.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cb406a430 msgr2=0x7f3cb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:02.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cb406a430 0x7f3cb406c8f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4143690 tx=0x7f3cbc009040 comp rx=0 tx=0).stop 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd40ce110 msgr2=0x7f3cd415eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd40ce110 0x7f3cd415eb30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4034040 tx=0x7f3cc40046c0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 shutdown_connections 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cb406a430 0x7f3cb406c8f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd4146e10 0x7f3cd41460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40d2b00 0x7f3cd4145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 --2- 172.21.15.113:0/4057935989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3cd40ce110 0x7f3cd415eb30 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.178+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 >> 172.21.15.113:0/4057935989 conn(0x7f3cd40b29c0 msgr2=0x7f3cd4070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.179+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 shutdown_connections 2023-12-19T13:58:02.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.179+0000 7f3cd8838640 1 -- 172.21.15.113:0/4057935989 wait complete. 2023-12-19T13:58:02.197 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:58:02.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.412+0000 7fb16f3f6640 1 Processor -- start 2023-12-19T13:58:02.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.412+0000 7fb16f3f6640 1 -- start start 2023-12-19T13:58:02.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.414+0000 7fb16f3f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1680b0b50 0x7fb16806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:02.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.414+0000 7fb16f3f6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb16806b590 0x7fb16806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:02.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.414+0000 7fb16f3f6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16806bb30 con 0x7fb1681449e0 2023-12-19T13:58:02.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.414+0000 7fb16f3f6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1680b0070 con 0x7fb16806b590 2023-12-19T13:58:02.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.414+0000 7fb16f3f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680b0350 con 0x7fb1680b0b50 2023-12-19T13:58:02.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.414+0000 7fb16c991640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1680b0b50 0x7fb16806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:02.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.415+0000 7fb16d993640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb16806b590 0x7fb16806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:02.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.415+0000 7fb16c991640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1680b0b50 0x7fb16806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:44000/0 (socket says 172.21.15.113:44000) 2023-12-19T13:58:02.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.415+0000 7fb16c991640 1 -- 172.21.15.113:0/2696977229 learned_addr learned my addr 172.21.15.113:0/2696977229 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:02.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.415+0000 7fb16c991640 1 -- 172.21.15.113:0/2696977229 >> v2:172.21.15.151:3300/0 conn(0x7fb16806b590 msgr2=0x7fb16806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:02.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.415+0000 7fb16c991640 1 --2- 172.21.15.113:0/2696977229 >> v2:172.21.15.151:3300/0 conn(0x7fb16806b590 0x7fb16806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.415+0000 7fb16c991640 1 -- 172.21.15.113:0/2696977229 >> v1:172.21.15.151:6789/0 conn(0x7fb1681449e0 legacy=0x7fb1680af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:02.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.415+0000 7fb16c991640 1 -- 172.21.15.113:0/2696977229 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680b0630 con 0x7fb1680b0b50 2023-12-19T13:58:02.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.417+0000 7fb16c991640 1 --2- 172.21.15.113:0/2696977229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1680b0b50 0x7fb16806bfa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb158009870 tx=0x7fb15802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bc97a9121f640b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:02.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.417+0000 7fb15ffff640 1 -- 172.21.15.113:0/2696977229 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158030840 con 0x7fb1680b0b50 2023-12-19T13:58:02.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.417+0000 7fb15ffff640 1 -- 172.21.15.113:0/2696977229 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1580309a0 con 0x7fb1680b0b50 2023-12-19T13:58:02.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.417+0000 7fb15ffff640 1 -- 172.21.15.113:0/2696977229 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158030d30 con 0x7fb1680b0b50 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 -- 172.21.15.113:0/2696977229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1680b0b50 msgr2=0x7fb16806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/2696977229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1680b0b50 0x7fb16806bfa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb158009870 tx=0x7fb15802b980 comp rx=0 tx=0).stop 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 -- 172.21.15.113:0/2696977229 shutdown_connections 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/2696977229 >> v2:172.21.15.151:3300/0 conn(0x7fb16806b590 0x7fb16806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/2696977229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1680b0b50 0x7fb16806bfa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 -- 172.21.15.113:0/2696977229 >> 172.21.15.113:0/2696977229 conn(0x7fb1680cbb70 msgr2=0x7fb1680cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 -- 172.21.15.113:0/2696977229 shutdown_connections 2023-12-19T13:58:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.418+0000 7fb16f3f6640 1 -- 172.21.15.113:0/2696977229 wait complete. 2023-12-19T13:58:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.420+0000 7fb16f3f6640 1 Processor -- start 2023-12-19T13:58:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.420+0000 7fb16f3f6640 1 -- start start 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.421+0000 7fb16f3f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb16806b590 0x7fb168143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.421+0000 7fb16f3f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1680b0b50 0x7fb168157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.421+0000 7fb16f3f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1681449e0 0x7fb168157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.421+0000 7fb16f3f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168141240 con 0x7fb1680b0b50 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.421+0000 7fb16f3f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168141d80 con 0x7fb16806b590 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.421+0000 7fb16f3f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb168141450 con 0x7fb1681449e0 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1680b0b50 0x7fb168157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1680b0b50 0x7fb168157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54084/0 (socket says 172.21.15.113:54084) 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 -- 172.21.15.113:0/1727429297 learned_addr learned my addr 172.21.15.113:0/1727429297 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16d993640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1681449e0 0x7fb168157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16d192640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb16806b590 0x7fb168143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 -- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1681449e0 msgr2=0x7fb168157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1681449e0 0x7fb168157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 -- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb16806b590 msgr2=0x7fb168143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb16806b590 0x7fb168143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.422+0000 7fb16c991640 1 -- 172.21.15.113:0/1727429297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580094d0 con 0x7fb1680b0b50 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.423+0000 7fb16c991640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1680b0b50 0x7fb168157850 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb158000c00 tx=0x7fb158004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.423+0000 7fb15dffb640 1 -- 172.21.15.113:0/1727429297 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158039c90 con 0x7fb1680b0b50 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.423+0000 7fb15dffb640 1 -- 172.21.15.113:0/1727429297 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158039df0 con 0x7fb1680b0b50 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.423+0000 7fb15dffb640 1 -- 172.21.15.113:0/1727429297 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158043640 con 0x7fb1680b0b50 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.423+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb168141730 con 0x7fb1680b0b50 2023-12-19T13:58:02.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.423+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb168142210 con 0x7fb1680b0b50 2023-12-19T13:58:02.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.424+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb168141f30 con 0x7fb1680b0b50 2023-12-19T13:58:02.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.425+0000 7fb15dffb640 1 -- 172.21.15.113:0/1727429297 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb1580437a0 con 0x7fb1680b0b50 2023-12-19T13:58:02.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.426+0000 7fb15dffb640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb14c06a460 0x7fb14c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:02.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.426+0000 7fb15dffb640 1 -- 172.21.15.113:0/1727429297 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb15803e070 con 0x7fb1680b0b50 2023-12-19T13:58:02.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.426+0000 7fb16d192640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb14c06a460 0x7fb14c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:02.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.427+0000 7fb16d192640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb14c06a460 0x7fb14c06c920 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f60 tx=0x7fb164009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:02.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.432+0000 7fb15dffb640 1 -- 172.21.15.113:0/1727429297 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb168141f30 con 0x7fb1680b0b50 2023-12-19T13:58:02.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:02.645+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb168141ef0 con 0x7fb1680b0b50 2023-12-19T13:58:03.363 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.363+0000 7fb15dffb640 1 -- 172.21.15.113:0/1727429297 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v79) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb158076f20 con 0x7fb1680b0b50 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb14c06a460 msgr2=0x7fb14c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb14c06a460 0x7fb14c06c920 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f60 tx=0x7fb164009040 comp rx=0 tx=0).stop 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1680b0b50 msgr2=0x7fb168157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1680b0b50 0x7fb168157850 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb158000c00 tx=0x7fb158004730 comp rx=0 tx=0).stop 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 shutdown_connections 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb14c06a460 0x7fb14c06c920 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1681449e0 0x7fb168157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1680b0b50 0x7fb168157850 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 --2- 172.21.15.113:0/1727429297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb16806b590 0x7fb168143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.366+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 >> 172.21.15.113:0/1727429297 conn(0x7fb1680cbb70 msgr2=0x7fb16813eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:03.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.367+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 shutdown_connections 2023-12-19T13:58:03.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.367+0000 7fb16f3f6640 1 -- 172.21.15.113:0/1727429297 wait complete. 2023-12-19T13:58:03.388 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:58:03.388 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:58:03.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.605+0000 7f5389749640 1 Processor -- start 2023-12-19T13:58:03.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.606+0000 7f5389749640 1 -- start start 2023-12-19T13:58:03.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.607+0000 7f5389749640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5384155460 0x7f53840b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:03.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.607+0000 7f5389749640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f538406cc50 0x7f53840cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:03.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.607+0000 7f5389749640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538415c9c0 con 0x7f53840b0830 2023-12-19T13:58:03.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.607+0000 7f5389749640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53840b0ce0 con 0x7f5384155460 2023-12-19T13:58:03.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.607+0000 7f5389749640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538406d270 con 0x7f538406cc50 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5383fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5384155460 0x7f53840b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5383fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5384155460 0x7f53840b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54098/0 (socket says 172.21.15.113:54098) 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5383fff640 1 -- 172.21.15.113:0/2615942233 learned_addr learned my addr 172.21.15.113:0/2615942233 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f537bfff640 1 --1- 172.21.15.113:0/2615942233 >> v1:172.21.15.113:6789/0 conn(0x7f53840b0830 0x7f538406c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37904/0 (socket says 172.21.15.113:37904) 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5388f48640 1 --2- 172.21.15.113:0/2615942233 >> v2:172.21.15.151:3300/0 conn(0x7f538406cc50 0x7f53840cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5383fff640 1 -- 172.21.15.113:0/2615942233 >> v2:172.21.15.151:3300/0 conn(0x7f538406cc50 msgr2=0x7f53840cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5383fff640 1 --2- 172.21.15.113:0/2615942233 >> v2:172.21.15.151:3300/0 conn(0x7f538406cc50 0x7f53840cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5383fff640 1 -- 172.21.15.113:0/2615942233 >> v1:172.21.15.113:6789/0 conn(0x7f53840b0830 legacy=0x7f538406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5383fff640 1 -- 172.21.15.113:0/2615942233 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538406d550 con 0x7f5384155460 2023-12-19T13:58:03.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.608+0000 7f5388f48640 1 --2- 172.21.15.113:0/2615942233 >> v2:172.21.15.151:3300/0 conn(0x7f538406cc50 0x7f53840cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:03.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.610+0000 7f5383fff640 1 --2- 172.21.15.113:0/2615942233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f53840b02f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f53840af7c0 tx=0x7f537402b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987c7984c62c9767 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:03.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.610+0000 7f53837fe640 1 -- 172.21.15.113:0/2615942233 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374030880 con 0x7f5384155460 2023-12-19T13:58:03.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.610+0000 7f53837fe640 1 -- 172.21.15.113:0/2615942233 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53740309e0 con 0x7f5384155460 2023-12-19T13:58:03.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.610+0000 7f53837fe640 1 -- 172.21.15.113:0/2615942233 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374030d70 con 0x7f5384155460 2023-12-19T13:58:03.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 -- 172.21.15.113:0/2615942233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 msgr2=0x7f53840b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:03.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 --2- 172.21.15.113:0/2615942233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f53840b02f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f53840af7c0 tx=0x7f537402b9c0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 -- 172.21.15.113:0/2615942233 shutdown_connections 2023-12-19T13:58:03.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 --2- 172.21.15.113:0/2615942233 >> v2:172.21.15.151:3300/0 conn(0x7f538406cc50 0x7f53840cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 --2- 172.21.15.113:0/2615942233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f53840b02f0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 -- 172.21.15.113:0/2615942233 >> 172.21.15.113:0/2615942233 conn(0x7f53840659a0 msgr2=0x7f5384065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:03.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 -- 172.21.15.113:0/2615942233 shutdown_connections 2023-12-19T13:58:03.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.611+0000 7f5389749640 1 -- 172.21.15.113:0/2615942233 wait complete. 2023-12-19T13:58:03.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.612+0000 7f5389749640 1 Processor -- start 2023-12-19T13:58:03.612 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.613+0000 7f5389749640 1 -- start start 2023-12-19T13:58:03.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5389749640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f538406cc50 0x7f5384156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:03.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5389749640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53840b0830 0x7f538414b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:03.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5389749640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f5384157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:03.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5389749640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840ac8b0 con 0x7f5384155460 2023-12-19T13:58:03.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5389749640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53841587c0 con 0x7f53840b0830 2023-12-19T13:58:03.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5389749640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53840acb00 con 0x7f538406cc50 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f5384157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f5384157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54106/0 (socket says 172.21.15.113:54106) 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 -- 172.21.15.113:0/544400978 learned_addr learned my addr 172.21.15.113:0/544400978 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f537bfff640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53840b0830 0x7f538414b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 -- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f538406cc50 msgr2=0x7f5384156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5383fff640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f538406cc50 0x7f5384156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f538406cc50 0x7f5384156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 -- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53840b0830 msgr2=0x7f538414b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53840b0830 0x7f538414b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f5388f48640 1 -- 172.21.15.113:0/544400978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740094d0 con 0x7f5384155460 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.614+0000 7f537bfff640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53840b0830 0x7f538414b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.615+0000 7f5388f48640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f5384157ef0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f537c00cef0 tx=0x7f537c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.615+0000 7f53817fa640 1 -- 172.21.15.113:0/544400978 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00d840 con 0x7f5384155460 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.615+0000 7f53817fa640 1 -- 172.21.15.113:0/544400978 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c00d9c0 con 0x7f5384155460 2023-12-19T13:58:03.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.615+0000 7f53817fa640 1 -- 172.21.15.113:0/544400978 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00dd70 con 0x7f5384155460 2023-12-19T13:58:03.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.615+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53840acde0 con 0x7f5384155460 2023-12-19T13:58:03.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.615+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538414b6b0 con 0x7f5384155460 2023-12-19T13:58:03.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.616+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5384061910 con 0x7f5384155460 2023-12-19T13:58:03.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.617+0000 7f53817fa640 1 -- 172.21.15.113:0/544400978 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f537c01e3b0 con 0x7f5384155460 2023-12-19T13:58:03.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.618+0000 7f53817fa640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f536406a430 0x7f536406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:03.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.618+0000 7f53817fa640 1 -- 172.21.15.113:0/544400978 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f537c089350 con 0x7f5384155460 2023-12-19T13:58:03.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.618+0000 7f5383fff640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f536406a430 0x7f536406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:03.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.619+0000 7f5383fff640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f536406a430 0x7f536406c8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5374036000 tx=0x7f537403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:03.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.622+0000 7f53817fa640 1 -- 172.21.15.113:0/544400978 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f537c054a90 con 0x7f5384155460 2023-12-19T13:58:03.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:03.854+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f538415bb90 con 0x7f5384155460 2023-12-19T13:58:04.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.843+0000 7f53817fa640 1 -- 172.21.15.113:0/544400978 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v80) v1 ==== 122+0+0 (secure 0 0 0) 0x7f537c0580b0 con 0x7f5384155460 2023-12-19T13:58:04.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.846+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f536406a430 msgr2=0x7f536406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:04.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.846+0000 7f5389749640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f536406a430 0x7f536406c8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5374036000 tx=0x7f537403b040 comp rx=0 tx=0).stop 2023-12-19T13:58:04.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.846+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 msgr2=0x7f5384157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.846+0000 7f5389749640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f5384157ef0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f537c00cef0 tx=0x7f537c00a710 comp rx=0 tx=0).stop 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 shutdown_connections 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f536406a430 0x7f536406c8f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5384155460 0x7f5384157ef0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53840b0830 0x7f538414b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 --2- 172.21.15.113:0/544400978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f538406cc50 0x7f5384156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 >> 172.21.15.113:0/544400978 conn(0x7f53840659a0 msgr2=0x7f538415cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 shutdown_connections 2023-12-19T13:58:04.848 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:04.847+0000 7f5389749640 1 -- 172.21.15.113:0/544400978 wait complete. 2023-12-19T13:58:04.867 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:58:04.867 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:58:05.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.065+0000 7f9e0359e640 1 Processor -- start 2023-12-19T13:58:05.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.065+0000 7f9e0359e640 1 -- start start 2023-12-19T13:58:05.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e0359e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e0415d620 0x7f9e040cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e0359e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9e040b6870 0x7f9e040cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e0359e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e040b6ca0 con 0x7f9e0415da00 2023-12-19T13:58:05.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e0359e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040b4120 con 0x7f9e040b6870 2023-12-19T13:58:05.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e0359e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040b5b80 con 0x7f9e0415d620 2023-12-19T13:58:05.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e02d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9e040b6870 0x7f9e040cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e02d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9e040b6870 0x7f9e040cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54112/0 (socket says 172.21.15.113:54112) 2023-12-19T13:58:05.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.067+0000 7f9e02d9d640 1 -- 172.21.15.113:0/2904003443 learned_addr learned my addr 172.21.15.113:0/2904003443 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:05.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.068+0000 7f9e0259c640 1 --2- 172.21.15.113:0/2904003443 >> v2:172.21.15.151:3300/0 conn(0x7f9e0415d620 0x7f9e040cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.068+0000 7f9e02d9d640 1 -- 172.21.15.113:0/2904003443 >> v2:172.21.15.151:3300/0 conn(0x7f9e0415d620 msgr2=0x7f9e040cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:05.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.068+0000 7f9e02d9d640 1 --2- 172.21.15.113:0/2904003443 >> v2:172.21.15.151:3300/0 conn(0x7f9e0415d620 0x7f9e040cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.068+0000 7f9e02d9d640 1 -- 172.21.15.113:0/2904003443 >> v1:172.21.15.151:6789/0 conn(0x7f9e0415da00 legacy=0x7f9e040b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:05.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.068+0000 7f9e02d9d640 1 -- 172.21.15.113:0/2904003443 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040b6ee0 con 0x7f9e040b6870 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.069+0000 7f9e02d9d640 1 --2- 172.21.15.113:0/2904003443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e040cf4a0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f9e040d1140 tx=0x7f9dfc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ead2590d87bf83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.069+0000 7f9e01d9b640 1 -- 172.21.15.113:0/2904003443 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc02cb20 con 0x7f9e040b6870 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.069+0000 7f9e01d9b640 1 -- 172.21.15.113:0/2904003443 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc02cc80 con 0x7f9e040b6870 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.069+0000 7f9e01d9b640 1 -- 172.21.15.113:0/2904003443 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0343f0 con 0x7f9e040b6870 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 -- 172.21.15.113:0/2904003443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 msgr2=0x7f9e040cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 --2- 172.21.15.113:0/2904003443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e040cf4a0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f9e040d1140 tx=0x7f9dfc02bf80 comp rx=0 tx=0).stop 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 -- 172.21.15.113:0/2904003443 shutdown_connections 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 --2- 172.21.15.113:0/2904003443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e040cf4a0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 --2- 172.21.15.113:0/2904003443 >> v2:172.21.15.151:3300/0 conn(0x7f9e0415d620 0x7f9e040cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 -- 172.21.15.113:0/2904003443 >> 172.21.15.113:0/2904003443 conn(0x7f9e040cfb90 msgr2=0x7f9e040cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:05.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 -- 172.21.15.113:0/2904003443 shutdown_connections 2023-12-19T13:58:05.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.070+0000 7f9e0359e640 1 -- 172.21.15.113:0/2904003443 wait complete. 2023-12-19T13:58:05.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.072+0000 7f9e0359e640 1 Processor -- start 2023-12-19T13:58:05.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.072+0000 7f9e0359e640 1 -- start start 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e0414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0415d620 0x7f9e04159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0415da00 0x7f9e04160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0359e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04152070 con 0x7f9e040b6870 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0414e050 con 0x7f9e0415d620 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041586a0 con 0x7f9e0415da00 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e0414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.073 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e0414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54128/0 (socket says 172.21.15.113:54128) 2023-12-19T13:58:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 -- 172.21.15.113:0/4062700338 learned_addr learned my addr 172.21.15.113:0/4062700338 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e02d9d640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0415da00 0x7f9e04160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9dfbfff640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0415d620 0x7f9e04159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 -- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0415da00 msgr2=0x7f9e04160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0415da00 0x7f9e04160640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 -- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0415d620 msgr2=0x7f9e04159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0415d620 0x7f9e04159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.073+0000 7f9e0259c640 1 -- 172.21.15.113:0/4062700338 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc009b30 con 0x7f9e040b6870 2023-12-19T13:58:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.074+0000 7f9e0259c640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e0414db10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f9df400d800 tx=0x7f9df400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.074+0000 7f9dfaffd640 1 -- 172.21.15.113:0/4062700338 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400b6c0 con 0x7f9e040b6870 2023-12-19T13:58:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.074+0000 7f9dfaffd640 1 -- 172.21.15.113:0/4062700338 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400b820 con 0x7f9e040b6870 2023-12-19T13:58:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.074+0000 7f9dfaffd640 1 -- 172.21.15.113:0/4062700338 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400bbb0 con 0x7f9e040b6870 2023-12-19T13:58:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.074+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04158980 con 0x7f9e040b6870 2023-12-19T13:58:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.074+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e04158f40 con 0x7f9e040b6870 2023-12-19T13:58:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.075+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e04061910 con 0x7f9e040b6870 2023-12-19T13:58:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.076+0000 7f9dfaffd640 1 -- 172.21.15.113:0/4062700338 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9df400bd10 con 0x7f9e040b6870 2023-12-19T13:58:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.077+0000 7f9dfaffd640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9de406a460 0x7f9de406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.077+0000 7f9dfaffd640 1 -- 172.21.15.113:0/4062700338 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9df4088e80 con 0x7f9e040b6870 2023-12-19T13:58:05.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.077+0000 7f9dfbfff640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9de406a460 0x7f9de406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.078+0000 7f9dfbfff640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9de406a460 0x7f9de406c920 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9e04070b40 tx=0x7f9dec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.083+0000 7f9dfaffd640 1 -- 172.21.15.113:0/4062700338 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9df4054460 con 0x7f9e040b6870 2023-12-19T13:58:05.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.312+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e04157240 con 0x7f9e040b6870 2023-12-19T13:58:05.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.312+0000 7f9dfaffd640 1 -- 172.21.15.113:0/4062700338 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f9df4057a80 con 0x7f9e040b6870 2023-12-19T13:58:05.313 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:05.313 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:58:01.335603+0000","modified":"2023-12-19T13:58:04.828919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/2910539170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2910539170},{"type":"v1","addr":"172.21.15.113:6837","nonce":2910539170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T13:58:05.313 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 80 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.315+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9de406a460 msgr2=0x7f9de406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.315+0000 7f9e0359e640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9de406a460 0x7f9de406c920 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9e04070b40 tx=0x7f9dec008040 comp rx=0 tx=0).stop 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.315+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 msgr2=0x7f9e0414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.315+0000 7f9e0359e640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e0414db10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f9df400d800 tx=0x7f9df400dcc0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.315+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 shutdown_connections 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.315+0000 7f9e0359e640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9de406a460 0x7f9de406c920 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.316+0000 7f9e0359e640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0415da00 0x7f9e04160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.316+0000 7f9e0359e640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e0415d620 0x7f9e04159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.316+0000 7f9e0359e640 1 --2- 172.21.15.113:0/4062700338 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e040b6870 0x7f9e0414db10 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.316+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 >> 172.21.15.113:0/4062700338 conn(0x7f9e040cfb90 msgr2=0x7f9e040b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:05.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.316+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 shutdown_connections 2023-12-19T13:58:05.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.316+0000 7f9e0359e640 1 -- 172.21.15.113:0/4062700338 wait complete. 2023-12-19T13:58:05.335 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:58:05.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.532+0000 7f3e1e881640 1 Processor -- start 2023-12-19T13:58:05.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.532+0000 7f3e1e881640 1 -- start start 2023-12-19T13:58:05.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.534+0000 7f3e1e881640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e180d2b00 0x7f3e180d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.534+0000 7f3e1e881640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180cd840 con 0x7f3e180ce110 2023-12-19T13:58:05.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.534+0000 7f3e1e881640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180b6e90 con 0x7f3e18146e10 2023-12-19T13:58:05.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.534+0000 7f3e1e881640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180d2430 con 0x7f3e180d2b00 2023-12-19T13:58:05.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.534+0000 7f3e1ce1e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3e180ce110 0x7f3e180b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37906/0 (socket says 172.21.15.113:37906) 2023-12-19T13:58:05.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.534+0000 7f3e1ce1e640 1 -- 172.21.15.113:0/3380794096 learned_addr learned my addr 172.21.15.113:0/3380794096 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:58:05.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e177fe640 1 --2- 172.21.15.113:0/3380794096 >> v2:172.21.15.151:3300/0 conn(0x7f3e180d2b00 0x7f3e180d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084403976 0 0) 0x7f3e180cd840 con 0x7f3e180ce110 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e00003520 con 0x7f3e180ce110 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2066190313 0 0) 0x7f3e00003520 con 0x7f3e180ce110 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 >> v2:172.21.15.151:3300/0 conn(0x7f3e180d2b00 msgr2=0x7f3e180d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 --2- 172.21.15.113:0/3380794096 >> v2:172.21.15.151:3300/0 conn(0x7f3e180d2b00 0x7f3e180d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 >> v1:172.21.15.151:6789/0 conn(0x7f3e18146e10 legacy=0x7f3e180b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180d2620 con 0x7f3e180ce110 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3e100019f0 con 0x7f3e180ce110 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 >> v1:172.21.15.113:6789/0 conn(0x7f3e180ce110 legacy=0x7f3e180b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e000039e0 0x7f3e00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000047c0 0x7f3e00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e000051d0 0x7f3e0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c0f0 con 0x7f3e000039e0 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c260 con 0x7f3e000047c0 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.535+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c420 con 0x7f3e000051d0 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e17fff640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e000039e0 0x7f3e00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e177fe640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000047c0 0x7f3e00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e17fff640 1 -- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e000051d0 msgr2=0x7f3e0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e17fff640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e000051d0 0x7f3e0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e17fff640 1 -- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000047c0 msgr2=0x7f3e00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e17fff640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000047c0 0x7f3e00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e17fff640 1 -- 172.21.15.113:0/3380794096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00003520 con 0x7f3e000039e0 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e177fe640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000047c0 0x7f3e00004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:05.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.536+0000 7f3e1ce1e640 1 -- 172.21.15.113:0/3380794096 reap_dead start 2023-12-19T13:58:05.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.537+0000 7f3e17fff640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e000039e0 0x7f3e00003de0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f3e08003d80 tx=0x7f3e000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f86c427f3578a54 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.537+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08032600 con 0x7f3e000039e0 2023-12-19T13:58:05.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.537+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0802e050 con 0x7f3e000039e0 2023-12-19T13:58:05.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.537+0000 7f3e16ffd640 1 -- 172.21.15.113:0/3380794096 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080329e0 con 0x7f3e000039e0 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.538+0000 7f3e1e881640 1 -- 172.21.15.113:0/3380794096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e000039e0 msgr2=0x7f3e00003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.538+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e000039e0 0x7f3e00003de0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f3e08003d80 tx=0x7f3e000057f0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.538+0000 7f3e1e881640 1 -- 172.21.15.113:0/3380794096 shutdown_connections 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.538+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3380794096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e000039e0 0x7f3e00003de0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.538+0000 7f3e1e881640 1 -- 172.21.15.113:0/3380794096 >> 172.21.15.113:0/3380794096 conn(0x7f3e180b29c0 msgr2=0x7f3e180b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.538+0000 7f3e1e881640 1 -- 172.21.15.113:0/3380794096 shutdown_connections 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.538+0000 7f3e1e881640 1 -- 172.21.15.113:0/3380794096 wait complete. 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.540+0000 7f3e1e881640 1 Processor -- start 2023-12-19T13:58:05.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.540+0000 7f3e1e881640 1 -- start start 2023-12-19T13:58:05.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e1e881640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000039e0 0x7f3e1813ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e1e881640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e180b78c0 0x7f3e180b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e1e881640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e1813e980 0x7f3e1813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e1e881640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180b74a0 con 0x7f3e180b78c0 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e1e881640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1813f340 con 0x7f3e000039e0 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e1e881640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1813d3d0 con 0x7f3e1813e980 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e180b78c0 0x7f3e180b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e180b78c0 0x7f3e180b7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54146/0 (socket says 172.21.15.113:54146) 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.541+0000 7f3e177fe640 1 -- 172.21.15.113:0/3693151207 learned_addr learned my addr 172.21.15.113:0/3693151207 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e1ce1e640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e1813e980 0x7f3e1813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e177fe640 1 -- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e1813e980 msgr2=0x7f3e1813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e177fe640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e1813e980 0x7f3e1813ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e177fe640 1 -- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000039e0 msgr2=0x7f3e1813ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e17fff640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000039e0 0x7f3e1813ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e177fe640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000039e0 0x7f3e1813ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e177fe640 1 -- 172.21.15.113:0/3693151207 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180b6820 con 0x7f3e180b78c0 2023-12-19T13:58:05.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e177fe640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e180b78c0 0x7f3e180b7d40 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0107f0 tx=0x7f3e0c010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e14ff9640 1 -- 172.21.15.113:0/3693151207 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00eb00 con 0x7f3e180b78c0 2023-12-19T13:58:05.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e14ff9640 1 -- 172.21.15.113:0/3693151207 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00ec60 con 0x7f3e180b78c0 2023-12-19T13:58:05.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e14ff9640 1 -- 172.21.15.113:0/3693151207 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c01c400 con 0x7f3e180b78c0 2023-12-19T13:58:05.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.542+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e180b6b00 con 0x7f3e180b78c0 2023-12-19T13:58:05.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.543+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e180b70c0 con 0x7f3e180b78c0 2023-12-19T13:58:05.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.544+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e18061910 con 0x7f3e180b78c0 2023-12-19T13:58:05.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.545+0000 7f3e14ff9640 1 -- 172.21.15.113:0/3693151207 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e0c01c560 con 0x7f3e180b78c0 2023-12-19T13:58:05.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.545+0000 7f3e14ff9640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e0406a460 0x7f3e0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.546+0000 7f3e14ff9640 1 -- 172.21.15.113:0/3693151207 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e0c088c10 con 0x7f3e180b78c0 2023-12-19T13:58:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.546+0000 7f3e17fff640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e0406a460 0x7f3e0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.546+0000 7f3e17fff640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e0406a460 0x7f3e0406c920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3e08034000 tx=0x7f3e08009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.550+0000 7f3e14ff9640 1 -- 172.21.15.113:0/3693151207 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e0c054340 con 0x7f3e180b78c0 2023-12-19T13:58:05.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.740+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e18144fe0 con 0x7f3e180b78c0 2023-12-19T13:58:05.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.741+0000 7f3e14ff9640 1 -- 172.21.15.113:0/3693151207 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16160 (secure 0 0 0) 0x7f3e0c057960 con 0x7f3e180b78c0 2023-12-19T13:58:05.741 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:05.742 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":178,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:58:02.339682+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:58:05.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e0406a460 msgr2=0x7f3e0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e0406a460 0x7f3e0406c920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3e08034000 tx=0x7f3e08009030 comp rx=0 tx=0).stop 2023-12-19T13:58:05.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e180b78c0 msgr2=0x7f3e180b7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e180b78c0 0x7f3e180b7d40 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0107f0 tx=0x7f3e0c010cb0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 shutdown_connections 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3e0406a460 0x7f3e0406c920 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e1813e980 0x7f3e1813ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e180b78c0 0x7f3e180b7d40 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 --2- 172.21.15.113:0/3693151207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000039e0 0x7f3e1813ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 >> 172.21.15.113:0/3693151207 conn(0x7f3e180b29c0 msgr2=0x7f3e1806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 shutdown_connections 2023-12-19T13:58:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.744+0000 7f3e1e881640 1 -- 172.21.15.113:0/3693151207 wait complete. 2023-12-19T13:58:05.764 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:58:05.764 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:58:05.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.979+0000 7f828d573640 1 Processor -- start 2023-12-19T13:58:05.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.979+0000 7f828d573640 1 -- start start 2023-12-19T13:58:05.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f828d573640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82881449e0 0x7f82880af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f828d573640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f828806c6b0 0x7f82880b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f828d573640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82880afb10 con 0x7f82880b0b50 2023-12-19T13:58:05.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f828d573640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828806bb30 con 0x7f828806c6b0 2023-12-19T13:58:05.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f828d573640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880b0070 con 0x7f82881449e0 2023-12-19T13:58:05.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f82877fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f828806c6b0 0x7f82880b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f82867fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f82880b0b50 0x7f828806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37908/0 (socket says 172.21.15.113:37908) 2023-12-19T13:58:05.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f82867fc640 1 -- 172.21.15.113:0/1559809350 learned_addr learned my addr 172.21.15.113:0/1559809350 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:58:05.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.981+0000 7f8286ffd640 1 --2- 172.21.15.113:0/1559809350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82881449e0 0x7f82880af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.982+0000 7f82877fe640 1 -- 172.21.15.113:0/1559809350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82881449e0 msgr2=0x7f82880af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:05.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.982+0000 7f82877fe640 1 --2- 172.21.15.113:0/1559809350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82881449e0 0x7f82880af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.982+0000 7f82877fe640 1 -- 172.21.15.113:0/1559809350 >> v1:172.21.15.113:6789/0 conn(0x7f82880b0b50 legacy=0x7f828806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.982+0000 7f82877fe640 1 -- 172.21.15.113:0/1559809350 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880b0350 con 0x7f828806c6b0 2023-12-19T13:58:05.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.983+0000 7f82877fe640 1 --2- 172.21.15.113:0/1559809350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f828806c6b0 0x7f82880b1710 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f828002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6febb29476855779 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.983+0000 7f8285ffb640 1 -- 172.21.15.113:0/1559809350 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828002cc60 con 0x7f828806c6b0 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.983+0000 7f8285ffb640 1 -- 172.21.15.113:0/1559809350 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828002cdc0 con 0x7f828806c6b0 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.983+0000 7f8285ffb640 1 -- 172.21.15.113:0/1559809350 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280034660 con 0x7f828806c6b0 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.983+0000 7f828d573640 1 -- 172.21.15.113:0/1559809350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f828806c6b0 msgr2=0x7f82880b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.983+0000 7f828d573640 1 --2- 172.21.15.113:0/1559809350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f828806c6b0 0x7f82880b1710 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f828002beb0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.984+0000 7f828d573640 1 -- 172.21.15.113:0/1559809350 shutdown_connections 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.984+0000 7f828d573640 1 --2- 172.21.15.113:0/1559809350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f828806c6b0 0x7f82880b1710 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.984+0000 7f828d573640 1 --2- 172.21.15.113:0/1559809350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82881449e0 0x7f82880af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.984+0000 7f828d573640 1 -- 172.21.15.113:0/1559809350 >> 172.21.15.113:0/1559809350 conn(0x7f82880cbb70 msgr2=0x7f82880cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.984+0000 7f828d573640 1 -- 172.21.15.113:0/1559809350 shutdown_connections 2023-12-19T13:58:05.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.984+0000 7f828d573640 1 -- 172.21.15.113:0/1559809350 wait complete. 2023-12-19T13:58:05.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.985+0000 7f828d573640 1 Processor -- start 2023-12-19T13:58:05.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.985+0000 7f828d573640 1 -- start start 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.986+0000 7f828d573640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828806c6b0 0x7f82881f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.986+0000 7f828d573640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82880b0b50 0x7f82880cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.986+0000 7f828d573640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82881449e0 0x7f82880ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.986+0000 7f828d573640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8288129c60 con 0x7f82881449e0 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f828d573640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8288129050 con 0x7f828806c6b0 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f828d573640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8288129330 con 0x7f82880b0b50 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82881449e0 0x7f82880ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82881449e0 0x7f82880ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54150/0 (socket says 172.21.15.113:54150) 2023-12-19T13:58:05.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 -- 172.21.15.113:0/1388790916 learned_addr learned my addr 172.21.15.113:0/1388790916 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f8286ffd640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828806c6b0 0x7f82881f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82867fc640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82880b0b50 0x7f82880cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 -- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82880b0b50 msgr2=0x7f82880cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82880b0b50 0x7f82880cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 -- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828806c6b0 msgr2=0x7f82881f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828806c6b0 0x7f82881f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.987+0000 7f82877fe640 1 -- 172.21.15.113:0/1388790916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009a70 con 0x7f82881449e0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.988+0000 7f82877fe640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82881449e0 0x7f82880ce320 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f8280004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.988+0000 7f826f7fe640 1 -- 172.21.15.113:0/1388790916 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280040650 con 0x7f82881449e0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.988+0000 7f826f7fe640 1 -- 172.21.15.113:0/1388790916 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82800407d0 con 0x7f82881449e0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.988+0000 7f826f7fe640 1 -- 172.21.15.113:0/1388790916 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280040b80 con 0x7f82881449e0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.988+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8288129610 con 0x7f82881449e0 2023-12-19T13:58:05.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.988+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82881f5ad0 con 0x7f82881449e0 2023-12-19T13:58:05.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.989+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8288129dd0 con 0x7f82881449e0 2023-12-19T13:58:05.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.990+0000 7f826f7fe640 1 -- 172.21.15.113:0/1388790916 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8280040ce0 con 0x7f82881449e0 2023-12-19T13:58:05.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.991+0000 7f826f7fe640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f827406a460 0x7f827406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:05.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.991+0000 7f826f7fe640 1 -- 172.21.15.113:0/1388790916 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82800ab740 con 0x7f82881449e0 2023-12-19T13:58:05.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.992+0000 7f8286ffd640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f827406a460 0x7f827406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:05.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.992+0000 7f8286ffd640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f827406a460 0x7f827406c920 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8278006fd0 tx=0x7f8278008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:05.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:05.996+0000 7f826f7fe640 1 -- 172.21.15.113:0/1388790916 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8280076d30 con 0x7f82881449e0 2023-12-19T13:58:06.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.180+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82880b0630 con 0x7f827406a460 2023-12-19T13:58:06.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.202+0000 7f826f7fe640 1 -- 172.21.15.113:0/1388790916 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273384 (secure 0 0 0) 0x7f827800f860 con 0x7f827406a460 2023-12-19T13:58:06.206 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:06.207 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:58:06.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f827406a460 msgr2=0x7f827406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f827406a460 0x7f827406c920 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8278006fd0 tx=0x7f8278008040 comp rx=0 tx=0).stop 2023-12-19T13:58:06.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82881449e0 msgr2=0x7f82880ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82881449e0 0x7f82880ce320 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f8280004a40 comp rx=0 tx=0).stop 2023-12-19T13:58:06.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 shutdown_connections 2023-12-19T13:58:06.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f827406a460 0x7f827406c920 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82881449e0 0x7f82880ce320 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82880b0b50 0x7f82880cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 --2- 172.21.15.113:0/1388790916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828806c6b0 0x7f82881f5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.207+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 >> 172.21.15.113:0/1388790916 conn(0x7f82880cbb70 msgr2=0x7f82880ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.208+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 shutdown_connections 2023-12-19T13:58:06.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.208+0000 7f828d573640 1 -- 172.21.15.113:0/1388790916 wait complete. 2023-12-19T13:58:06.227 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2023-12-19T13:58:04.646042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8799,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553700,"statfs":{"total":1600000000,"available":1590989629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.776862"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.875581+0000","last_change":"2023-12-19T13:57:59.875581+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.875581+0000","last_undegraded":"2023-12-19T13:57:59.875581+0000","last_fullsized":"2023-12-19T13:57:59.875581+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:55.218311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.876535+0000","last_change":"2023-12-19T13:57:59.876535+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.876535+0000","last_undegraded":"2023-12-19T13:57:59.876535+0000","last_fullsized":"2023-12-19T13:57:59.876535+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:04.036996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.875186+0000","last_change":"2023-12-19T13:57:59.875186+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.875186+0000","last_undegraded":"2023-12-19T13:57:59.875186+0000","last_fullsized":"2023-12-19T13:57:59.875186+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:42.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874205+0000","last_change":"2023-12-19T13:57:59.874205+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874205+0000","last_undegraded":"2023-12-19T13:57:59.874205+0000","last_fullsized":"2023-12-19T13:57:59.874205+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:40.643609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.877237+0000","last_change":"2023-12-19T13:57:59.877237+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.877237+0000","last_undegraded":"2023-12-19T13:57:59.877237+0000","last_fullsized":"2023-12-19T13:57:59.877237+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:36.345784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.877472+0000","last_change":"2023-12-19T13:57:59.877472+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.877472+0000","last_undegraded":"2023-12-19T13:57:59.877472+0000","last_fullsized":"2023-12-19T13:57:59.877472+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:00:04.868968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.875590+0000","last_change":"2023-12-19T13:57:59.875590+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.875590+0000","last_undegraded":"2023-12-19T13:57:59.875590+0000","last_fullsized":"2023-12-19T13:57:59.875590+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:19.922624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874658+0000","last_change":"2023-12-19T13:57:59.874658+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874658+0000","last_undegraded":"2023-12-19T13:57:59.874658+0000","last_fullsized":"2023-12-19T13:57:59.874658+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:16.535600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.875829+0000","last_change":"2023-12-19T13:57:59.875829+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.875829+0000","last_undegraded":"2023-12-19T13:57:59.875829+0000","last_fullsized":"2023-12-19T13:57:59.875829+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:53.842702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.877105+0000","last_change":"2023-12-19T13:57:59.877105+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.877105+0000","last_undegraded":"2023-12-19T13:57:59.877105+0000","last_fullsized":"2023-12-19T13:57:59.877105+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:37:59.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874702+0000","last_change":"2023-12-19T13:57:59.874702+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874702+0000","last_undegraded":"2023-12-19T13:57:59.874702+0000","last_fullsized":"2023-12-19T13:57:59.874702+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:43.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.873897+0000","last_change":"2023-12-19T13:57:59.873897+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.873897+0000","last_undegraded":"2023-12-19T13:57:59.873897+0000","last_fullsized":"2023-12-19T13:57:59.873897+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:14.469645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.871074+0000","last_change":"2023-12-19T13:57:59.871074+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.871074+0000","last_undegraded":"2023-12-19T13:57:59.871074+0000","last_fullsized":"2023-12-19T13:57:59.871074+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:19.922624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.872078+0000","last_change":"2023-12-19T13:57:59.872078+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.872078+0000","last_undegraded":"2023-12-19T13:57:59.872078+0000","last_fullsized":"2023-12-19T13:57:59.872078+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:19.088190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.879838+0000","last_change":"2023-12-19T13:57:59.879838+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.879838+0000","last_undegraded":"2023-12-19T13:57:59.879838+0000","last_fullsized":"2023-12-19T13:57:59.879838+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:24.969482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874319+0000","last_change":"2023-12-19T13:57:59.874319+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874319+0000","last_undegraded":"2023-12-19T13:57:59.874319+0000","last_fullsized":"2023-12-19T13:57:59.874319+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:28.525786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.879304+0000","last_change":"2023-12-19T13:57:59.879304+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.879304+0000","last_undegraded":"2023-12-19T13:57:59.879304+0000","last_fullsized":"2023-12-19T13:57:59.879304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:31.449130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.878271+0000","last_change":"2023-12-19T13:57:59.878271+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.878271+0000","last_undegraded":"2023-12-19T13:57:59.878271+0000","last_fullsized":"2023-12-19T13:57:59.878271+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:25.186221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.871204+0000","last_change":"2023-12-19T13:57:59.871204+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.871204+0000","last_undegraded":"2023-12-19T13:57:59.871204+0000","last_fullsized":"2023-12-19T13:57:59.871204+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:20.898323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.875194+0000","last_change":"2023-12-19T13:57:59.875194+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.875194+0000","last_undegraded":"2023-12-19T13:57:59.875194+0000","last_fullsized":"2023-12-19T13:57:59.875194+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:56.516367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.873794+0000","last_change":"2023-12-19T13:57:59.873794+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.873794+0000","last_undegraded":"2023-12-19T13:57:59.873794+0000","last_fullsized":"2023-12-19T13:57:59.873794+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:20.898323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.875369+0000","last_change":"2023-12-19T13:57:59.875369+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.875369+0000","last_undegraded":"2023-12-19T13:57:59.875369+0000","last_fullsized":"2023-12-19T13:57:59.875369+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:09.257373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.875156+0000","last_change":"2023-12-19T13:57:59.875156+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.875156+0000","last_undegraded":"2023-12-19T13:57:59.875156+0000","last_fullsized":"2023-12-19T13:57:59.875156+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:59.616044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874942+0000","last_change":"2023-12-19T13:57:59.874942+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874942+0000","last_undegraded":"2023-12-19T13:57:59.874942+0000","last_fullsized":"2023-12-19T13:57:59.874942+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:03.449485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.871128+0000","last_change":"2023-12-19T13:57:59.871128+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.871128+0000","last_undegraded":"2023-12-19T13:57:59.871128+0000","last_fullsized":"2023-12-19T13:57:59.871128+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:30.555190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.873656+0000","last_change":"2023-12-19T13:57:59.873656+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.873656+0000","last_undegraded":"2023-12-19T13:57:59.873656+0000","last_fullsized":"2023-12-19T13:57:59.873656+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.878363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874170+0000","last_change":"2023-12-19T13:57:59.874170+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874170+0000","last_undegraded":"2023-12-19T13:57:59.874170+0000","last_fullsized":"2023-12-19T13:57:59.874170+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:18.797470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.872185+0000","last_change":"2023-12-19T13:57:59.872185+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.872185+0000","last_undegraded":"2023-12-19T13:57:59.872185+0000","last_fullsized":"2023-12-19T13:57:59.872185+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:59.616044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874293+0000","last_change":"2023-12-19T13:57:59.874293+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874293+0000","last_undegraded":"2023-12-19T13:57:59.874293+0000","last_fullsized":"2023-12-19T13:57:59.874293+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:57:02.338063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.871074+0000","last_change":"2023-12-19T13:57:59.871074+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.871074+0000","last_undegraded":"2023-12-19T13:57:59.871074+0000","last_fullsized":"2023-12-19T13:57:59.871074+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:56.516367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.874574+0000","last_change":"2023-12-19T13:57:59.874574+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.874574+0000","last_undegraded":"2023-12-19T13:57:59.874574+0000","last_fullsized":"2023-12-19T13:57:59.874574+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:03:00.942467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:58:00.867723+0000","last_change":"2023-12-19T13:58:00.867723+0000","last_active":"2023-12-19T13:58:00.867723+0000","last_peered":"2023-12-19T13:58:00.867723+0000","last_clean":"2023-12-19T13:58:00.867723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:58:00.867723+0000","last_undegraded":"2023-12-19T13:58:00.867723+0000","last_fullsized":"2023-12-19T13:58:00.867723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2023-12-19T13:57:59.872177+0000","last_change":"2023-12-19T13:57:59.872177+0000","last_active":"2023-12-19T13:57:59.862688+0000","last_peered":"2023-12-19T13:57:59.862688+0000","last_clean":"2023-12-19T13:57:59.862688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:57:59.872177+0000","last_undegraded":"2023-12-19T13:57:59.872177+0000","last_fullsized":"2023-12-19T13:57:59.872177+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:03:00.942467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-12-19T13:57:58.231814+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:57:58.231814+0000","last_peered":"2023-12-19T13:57:58.231814+0000","last_clean":"2023-12-19T13:57:58.231814+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:57:58.231814+0000","last_undegraded":"2023-12-19T13:57:58.231814+0000","last_fullsized":"2023-12-19T13:57:58.231814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194353,"statfs":{"total":200000000,"available":199017660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.107,"15min":1.0649999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.53900000000000003},"max":{"1min":1.5700000000000001,"5min":1.7190000000000001,"15min":1.9059999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.141,"15min":1.0660000000000001},"min":{"1min":0.89600000000000002,"5min":0.64400000000000002,"15min":0.54400000000000004},"max":{"1min":1.855,"5min":1.855,"15min":2.008},"last":1.3859999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1599999999999999,"15min":1.1259999999999999},"min":{"1min":0.748,"5min":0.67000000000000004,"15min":0.59899999999999998},"max":{"1min":1.55,"5min":1.865,"15min":1.865},"last":1.504},{"interface":"front","average":{"1min":1.234,"5min":1.212,"15min":1.1180000000000001},"min":{"1min":0.81100000000000005,"5min":0.68400000000000005,"15min":0.497},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.5820000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1579999999999999,"15min":1.145},"min":{"1min":0.86599999999999999,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":1.5740000000000001,"5min":2.008,"15min":2.008},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.329,"5min":1.256,"15min":1.1990000000000001},"min":{"1min":1.002,"5min":0.84999999999999998,"15min":0.65700000000000003},"max":{"1min":1.6399999999999999,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":1.8759999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.296,"15min":1.2210000000000001},"min":{"1min":1.056,"5min":0.74199999999999999,"15min":0.59099999999999997},"max":{"1min":1.589,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.462},{"interface":"front","average":{"1min":1.417,"5min":1.345,"15min":1.294},"min":{"1min":1.1319999999999999,"5min":0.86499999999999999,"15min":0.65200000000000002},"max":{"1min":1.6990000000000001,"5min":1.9810000000000001,"15min":3.6150000000000002},"last":1.345}]},{"osd":4,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.331,"15min":1.2929999999999999},"min":{"1min":0.97399999999999998,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.6830000000000001,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.286},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.371,"15min":1.3740000000000001},"min":{"1min":1,"5min":0.70599999999999996,"15min":0.58499999999999996},"max":{"1min":1.6799999999999999,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.6679999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3009999999999999,"15min":1.2569999999999999},"min":{"1min":0.91100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6379999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.468,"15min":1.4359999999999999},"min":{"1min":1.1739999999999999,"5min":0.82499999999999996,"15min":0.76500000000000001},"max":{"1min":1.746,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.111}]},{"osd":6,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.4650000000000001,"15min":1.3600000000000001},"min":{"1min":1.0680000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.7949999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.514},"min":{"1min":1.2210000000000001,"5min":0.95899999999999996,"15min":0.64800000000000002},"max":{"1min":1.7969999999999999,"5min":2.673,"15min":2.673},"last":1.6259999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":953,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194358,"statfs":{"total":200000000,"available":199023477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.131,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.59299999999999997,"15min":0.42699999999999999},"max":{"1min":1.663,"5min":1.663,"15min":2.0640000000000001},"last":1.099},{"interface":"front","average":{"1min":1.052,"5min":1.0620000000000001,"15min":1.093},"min":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.61199999999999999},"max":{"1min":1.363,"5min":1.605,"15min":3.2069999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.073,"15min":1.0549999999999999},"min":{"1min":0.83199999999999996,"5min":0.64900000000000002,"15min":0.59099999999999997},"max":{"1min":1.851,"5min":1.851,"15min":1.962},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.21,"15min":1.1220000000000001},"min":{"1min":0.83899999999999997,"5min":0.64300000000000002,"15min":0.63800000000000001},"max":{"1min":1.605,"5min":1.671,"15min":1.671},"last":0.95199999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.325,"15min":1.2649999999999999},"min":{"1min":0.90300000000000002,"5min":0.69999999999999996,"15min":0.59199999999999997},"max":{"1min":1.613,"5min":1.806,"15min":1.8180000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.2629999999999999,"15min":1.22},"min":{"1min":0.85199999999999998,"5min":0.70999999999999996,"15min":0.68100000000000005},"max":{"1min":1.46,"5min":1.7050000000000001,"15min":1.802},"last":1.0589999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2190000000000001,"15min":1.2809999999999999},"min":{"1min":0.74099999999999999,"5min":0.73699999999999999,"15min":0.73599999999999999},"max":{"1min":1.3720000000000001,"5min":1.665,"15min":4.2690000000000001},"last":1.155},{"interface":"front","average":{"1min":1.258,"5min":1.22,"15min":1.2450000000000001},"min":{"1min":0.91900000000000004,"5min":0.79700000000000004,"15min":0.67900000000000005},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.22}]},{"osd":4,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.341,"15min":1.2769999999999999},"min":{"1min":0.70699999999999996,"5min":0.65700000000000003,"15min":0.47899999999999998},"max":{"1min":1.6659999999999999,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.3200000000000001,"15min":1.323},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.613,"5min":1.849,"15min":1.895},"last":1.2989999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.3100000000000001,"15min":1.286},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.8879999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.49,"15min":1.423},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":2.117,"5min":2.169,"15min":2.169},"last":1.802}]},{"osd":7,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.4510000000000001,"15min":1.4399999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.597,"5min":1.9570000000000001,"15min":2.5419999999999998},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.462,"15min":1.4119999999999999},"min":{"1min":0.92000000000000004,"5min":0.747,"15min":0.57999999999999996},"max":{"1min":1.889,"5min":2.141,"15min":2.141},"last":1.7509999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193776,"statfs":{"total":200000000,"available":198427292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.024},"min":{"1min":0.88700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.369,"5min":1.835,"15min":1.835},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.145,"15min":1.1220000000000001},"min":{"1min":0.84299999999999997,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.5640000000000001,"5min":2.1429999999999998,"15min":5.4219999999999997},"last":1.1830000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.153,"15min":1.1359999999999999},"min":{"1min":0.92500000000000004,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.55,"5min":1.6839999999999999,"15min":6.101},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1779999999999999,"15min":1.109},"min":{"1min":0.77000000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4319999999999999,"5min":1.694,"15min":2.077},"last":1.097}]},{"osd":2,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.194,"15min":1.2330000000000001},"min":{"1min":0.93500000000000005,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.6739999999999999,"5min":1.8919999999999999,"15min":5.5350000000000001},"last":0.877},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2010000000000001,"15min":1.242},"min":{"1min":0.89600000000000002,"5min":0.754,"15min":0.66400000000000003},"max":{"1min":1.593,"5min":1.6020000000000001,"15min":2.863},"last":0.91800000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":1.113,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6599999999999999,"5min":2.1880000000000002,"15min":5.6189999999999998},"last":1.28},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3240000000000001,"15min":1.282},"min":{"1min":1.075,"5min":0.78300000000000003,"15min":0.69899999999999995},"max":{"1min":1.74,"5min":1.75,"15min":1.8360000000000001},"last":1.3540000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2729999999999999,"15min":1.2},"min":{"1min":0.83099999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.74,"5min":1.8919999999999999,"15min":1.982},"last":1.476},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.373,"15min":1.343},"min":{"1min":1.018,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":1.764,"5min":2.0800000000000001,"15min":5.6970000000000001},"last":1.798}]},{"osd":6,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3720000000000001,"15min":1.351},"min":{"1min":1.0349999999999999,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.919,"5min":1.919,"15min":2.0310000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.4259999999999999,"15min":1.3839999999999999},"min":{"1min":0.91600000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8240000000000001,"5min":2.133,"15min":2.133},"last":1.613}]},{"osd":7,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.4810000000000001,"15min":1.458},"min":{"1min":1.1379999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.865,"5min":2.278,"15min":6.3959999999999999},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.522,"5min":1.5169999999999999,"15min":1.47},"min":{"1min":1.1890000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.855,"5min":2.1070000000000002,"15min":2.1819999999999999},"last":1.8169999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":953,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194358,"statfs":{"total":200000000,"available":199023477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.105,"15min":1.0429999999999999},"min":{"1min":0.77500000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.242,"5min":1.1539999999999999,"15min":1.1279999999999999},"min":{"1min":0.91500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.4159999999999999,"5min":2.448,"15min":2.448},"last":1.206}]},{"osd":1,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.163,"15min":1.1000000000000001},"min":{"1min":0.80500000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6890000000000001,"5min":1.754,"15min":1.754},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1679999999999999,"15min":1.1339999999999999},"min":{"1min":0.97699999999999998,"5min":0.73399999999999999,"15min":0.50700000000000001},"max":{"1min":1.8939999999999999,"5min":3.117,"15min":3.117},"last":1.151}]},{"osd":2,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2010000000000001,"15min":1.1140000000000001},"min":{"1min":0.88500000000000001,"5min":0.71999999999999997,"15min":0.629},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.028},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2430000000000001,"15min":1.173},"min":{"1min":0.98599999999999999,"5min":0.76600000000000001,"15min":0.68000000000000005},"max":{"1min":1.603,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.087}]},{"osd":3,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.29,"15min":1.2410000000000001},"min":{"1min":1.0249999999999999,"5min":0.72999999999999998,"15min":0.57599999999999996},"max":{"1min":2.524,"5min":2.653,"15min":2.653},"last":1.329},{"interface":"front","average":{"1min":1.345,"5min":1.3260000000000001,"15min":1.298},"min":{"1min":1.036,"5min":0.82799999999999996,"15min":0.66500000000000004},"max":{"1min":1.8540000000000001,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.472}]},{"osd":5,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.244,"15min":1.242},"min":{"1min":0.89900000000000002,"5min":0.58299999999999996,"15min":0.51700000000000002},"max":{"1min":3.145,"5min":3.625,"15min":3.625},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.3280000000000001,"15min":1.3340000000000001},"min":{"1min":0.83699999999999997,"5min":0.60499999999999998,"15min":0.58399999999999996},"max":{"1min":2.6989999999999998,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.821}]},{"osd":6,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3660000000000001,"15min":1.377},"min":{"1min":0.96499999999999997,"5min":0.65000000000000002,"15min":0.55900000000000005},"max":{"1min":1.9470000000000001,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.4059999999999999,"15min":1.4279999999999999},"min":{"1min":1.196,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.0299999999999998,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.5569999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":1.548,"15min":1.494},"min":{"1min":1.073,"5min":0.78400000000000003,"15min":0.65500000000000003},"max":{"1min":2.8109999999999999,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.925},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.573,"15min":1.542},"min":{"1min":0.98199999999999998,"5min":0.74199999999999999,"15min":0.59999999999999998},"max":{"1min":2.194,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.6679999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":953,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194358,"statfs":{"total":200000000,"available":199023477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.85999999999999999},"min":{"1min":0.56299999999999994,"5min":0.249,"15min":0.249},"max":{"1min":1.3799999999999999,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.90300000000000002,"15min":0.93000000000000005},"min":{"1min":0.63400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.347,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.80000000000000004}]},{"osd":1,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.84499999999999997,"15min":0.91000000000000003},"min":{"1min":0.67300000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.25,"5min":1.413,"15min":5.3769999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.94999999999999996,"15min":0.96099999999999997},"min":{"1min":0.75600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.573,"5min":1.573,"15min":2.387},"last":1.105}]},{"osd":2,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.96999999999999997,"15min":1.004},"min":{"1min":0.71899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.569,"5min":1.569,"15min":2.9399999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.0429999999999999,"15min":1.071},"min":{"1min":0.80900000000000005,"5min":0.433,"15min":0.39200000000000002},"max":{"1min":1.5940000000000001,"5min":1.722,"15min":2.657},"last":0.67300000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.92600000000000005,"5min":0.65700000000000003,"15min":0.48299999999999998},"max":{"1min":1.5720000000000001,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2430000000000001,"15min":1.2330000000000001},"min":{"1min":1.0329999999999999,"5min":0.626,"15min":0.54600000000000004},"max":{"1min":1.5389999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.0469999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.258,"15min":1.2749999999999999},"min":{"1min":1.0049999999999999,"5min":0.66900000000000004,"15min":0.58299999999999996},"max":{"1min":1.6060000000000001,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":0.871},{"interface":"front","average":{"1min":1.331,"5min":1.2509999999999999,"15min":1.25},"min":{"1min":1.071,"5min":0.72599999999999998,"15min":0.66700000000000004},"max":{"1min":1.657,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2809999999999999,"15min":1.2849999999999999},"min":{"1min":1.0469999999999999,"5min":0.59299999999999997,"15min":0.53300000000000003},"max":{"1min":1.7769999999999999,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.089},{"interface":"front","average":{"1min":1.413,"5min":1.3300000000000001,"15min":1.3320000000000001},"min":{"1min":1.147,"5min":0.746,"15min":0.52600000000000002},"max":{"1min":1.7390000000000001,"5min":2.077,"15min":2.698},"last":1.2010000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.3300000000000001,"15min":1.3420000000000001},"min":{"1min":1.056,"5min":0.73399999999999999,"15min":0.51500000000000001},"max":{"1min":1.72,"5min":2.1160000000000001,"15min":3.609},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.3759999999999999,"15min":1.3839999999999999},"min":{"1min":1.141,"5min":0.69299999999999995,"15min":0.58699999999999997},"max":{"1min":1.704,"5min":1.9370000000000001,"15min":3.0379999999999998},"last":1.258}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194353,"statfs":{"total":200000000,"available":199017660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.82899999999999996,"15min":0.82799999999999996},"min":{"1min":0.65100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3360000000000001,"5min":1.4550000000000001,"15min":2.258},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.90200000000000002,"15min":0.88900000000000001},"min":{"1min":0.55500000000000005,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.377,"5min":1.542,"15min":11.85},"last":0.46500000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.91400000000000003,"15min":0.872},"min":{"1min":0.66900000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.738,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.083,"5min":1.0369999999999999,"15min":1.0009999999999999},"min":{"1min":0.81599999999999995,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":1.4770000000000001,"5min":4.681,"15min":11.788},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0169999999999999,"15min":0.97399999999999998},"min":{"1min":0.90300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4730000000000001,"5min":1.702,"15min":2.3109999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1060000000000001,"15min":1.0669999999999999},"min":{"1min":0.84299999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.4299999999999999,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.99099999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.631,"5min":1.631,"15min":11.930999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.274,"5min":1.194,"15min":1.212},"min":{"1min":1.081,"5min":0.72399999999999998,"15min":0.72299999999999998},"max":{"1min":1.488,"5min":1.806,"15min":2.2189999999999999},"last":0.873}]},{"osd":5,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3160000000000001,"15min":1.302},"min":{"1min":1.1120000000000001,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.6379999999999999,"5min":1.7170000000000001,"15min":11.888},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":1.038,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.698,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.107}]},{"osd":6,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3420000000000001,"15min":1.3169999999999999},"min":{"1min":1.024,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.679,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.327,"15min":1.292},"min":{"1min":1.1659999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7929999999999999,"5min":1.9370000000000001,"15min":2.286},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3919999999999999,"15min":1.3440000000000001},"min":{"1min":1.085,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":1.8440000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.353,"15min":1.3420000000000001},"min":{"1min":1.1819999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7110000000000001,"5min":2.323,"15min":11.962999999999999},"last":0.85399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193782,"statfs":{"total":200000000,"available":198433109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.79000000000000004},"min":{"1min":0.65200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.28,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.92000000000000004,"15min":0.94499999999999995},"min":{"1min":0.747,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":1.595,"5min":1.6639999999999999,"15min":3.3500000000000001},"last":0.76000000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.92800000000000005,"15min":0.998},"min":{"1min":0.77900000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4830000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.0940000000000001,"15min":1.1419999999999999},"min":{"1min":0.83399999999999996,"5min":0.48599999999999999,"15min":0.45800000000000002},"max":{"1min":1.45,"5min":1.619,"15min":5.2009999999999996},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.024,"15min":1.0580000000000001},"min":{"1min":0.80100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.665,"5min":1.7,"15min":3.4300000000000002},"last":0.871},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0149999999999999,"15min":1.0920000000000001},"min":{"1min":0.877,"5min":0.47599999999999998,"15min":0.36899999999999999},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.157},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1739999999999999,"15min":1.1970000000000001},"min":{"1min":1.002,"5min":0.64400000000000002,"15min":0.61699999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":4.0179999999999998},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.252,"15min":1.278},"min":{"1min":1.0580000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6599999999999999,"5min":1.7490000000000001,"15min":3.7080000000000002},"last":1.321}]},{"osd":5,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2170000000000001,"15min":1.2749999999999999},"min":{"1min":1.0449999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.796,"5min":1.796,"15min":3.8849999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.359,"5min":1.258,"15min":1.341},"min":{"1min":1.167,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.571,"5min":1.6040000000000001,"15min":15.576000000000001},"last":1.006}]},{"osd":6,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3120000000000001,"15min":1.337},"min":{"1min":1.153,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.849,"5min":1.849,"15min":4.0919999999999996},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.337,"15min":1.373},"min":{"1min":1.137,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":3.786},"last":1.0840000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.373,"15min":1.4119999999999999},"min":{"1min":1.105,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":3.8159999999999998},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.3240000000000001,"15min":1.3879999999999999},"min":{"1min":1.024,"5min":0.78800000000000003,"15min":0.76500000000000001},"max":{"1min":2.032,"5min":2.032,"15min":4.0519999999999996},"last":1.1539999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":953,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194358,"statfs":{"total":200000000,"available":199023477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82699999999999996,"15min":0.78800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.28299999999999997},"max":{"1min":1.4339999999999999,"5min":1.639,"15min":1.6399999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93500000000000005,"15min":0.96299999999999997},"min":{"1min":0.60799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94199999999999995,"15min":1.0289999999999999},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.6379999999999999,"5min":1.8149999999999999,"15min":33.799999999999997},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0069999999999999,"15min":1.1319999999999999},"min":{"1min":0.56799999999999995,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.526,"5min":1.708,"15min":41.758000000000003},"last":1.26}]},{"osd":3,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92400000000000004,"15min":0.95799999999999996},"min":{"1min":0.47999999999999998,"5min":0.42099999999999999,"15min":0.35099999999999998},"max":{"1min":1.401,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":1.091},{"interface":"front","average":{"1min":1.079,"5min":1.0780000000000001,"15min":1.0900000000000001},"min":{"1min":0.58799999999999997,"5min":0.47699999999999998,"15min":0.36499999999999999},"max":{"1min":1.347,"5min":1.9470000000000001,"15min":2.02},"last":1.3260000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.78300000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.488,"5min":1.679,"15min":4.4269999999999996},"last":1.738},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.262,"15min":1.2689999999999999},"min":{"1min":1.1259999999999999,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.5960000000000001,"5min":1.8700000000000001,"15min":15.766},"last":1.5009999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2430000000000001,"15min":1.262},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.659,"5min":1.77,"15min":14.337999999999999},"last":2.0339999999999998},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.232,"15min":1.2629999999999999},"min":{"1min":0.877,"5min":0.747,"15min":0.63100000000000001},"max":{"1min":1.5389999999999999,"5min":1.6919999999999999,"15min":4.3970000000000002},"last":1.605}]},{"osd":6,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3620000000000001,"15min":1.3240000000000001},"min":{"1min":1.1020000000000001,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":1.5720000000000001,"5min":1.9470000000000001,"15min":5.4669999999999996},"last":1.655},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.347,"15min":1.3720000000000001},"min":{"1min":0.93700000000000006,"5min":0.78200000000000003,"15min":0.65100000000000002},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":17.161000000000001},"last":1.762}]},{"osd":7,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3740000000000001,"15min":1.3799999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":1.974,"5min":1.974,"15min":14.381},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.28,"15min":1.3640000000000001},"min":{"1min":0.875,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":1.488,"5min":2.1230000000000002,"15min":9.7080000000000002},"last":1.8759999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T13:58:06.233 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:58:06.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.489+0000 7ffb948b2640 1 Processor -- start 2023-12-19T13:58:06.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.489+0000 7ffb948b2640 1 -- start start 2023-12-19T13:58:06.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.490+0000 7ffb948b2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffb900b1710 0x7ffb9006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:06.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.490+0000 7ffb948b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9015e040 0x7ffb9015e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:06.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.491+0000 7ffb948b2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9015e9c0 con 0x7ffb90157aa0 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.491+0000 7ffb948b2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb900b2600 con 0x7ffb900b1710 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.491+0000 7ffb948b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900b1d60 con 0x7ffb9015e040 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.491+0000 7ffb8ed9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9015e040 0x7ffb9015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.491+0000 7ffb87fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffb900b1710 0x7ffb9006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.491+0000 7ffb8ed9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9015e040 0x7ffb9015e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:44066/0 (socket says 172.21.15.113:44066) 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.491+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/3554923178 learned_addr learned my addr 172.21.15.113:0/3554923178 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.492+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/3554923178 >> v2:172.21.15.151:3300/0 conn(0x7ffb900b1710 msgr2=0x7ffb9006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.492+0000 7ffb8ed9d640 1 --2- 172.21.15.113:0/3554923178 >> v2:172.21.15.151:3300/0 conn(0x7ffb900b1710 0x7ffb9006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.492+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/3554923178 >> v1:172.21.15.151:6789/0 conn(0x7ffb90157aa0 legacy=0x7ffb90161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.492+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/3554923178 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb900b2040 con 0x7ffb9015e040 2023-12-19T13:58:06.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.493+0000 7ffb8ed9d640 1 --2- 172.21.15.113:0/3554923178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9015e040 0x7ffb9015e480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009e50 tx=0x7ffb8802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5a10cb72a25344 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.494+0000 7ffb8dd9b640 1 -- 172.21.15.113:0/3554923178 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8802cb00 con 0x7ffb9015e040 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.494+0000 7ffb8dd9b640 1 -- 172.21.15.113:0/3554923178 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8802cc60 con 0x7ffb9015e040 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.494+0000 7ffb8dd9b640 1 -- 172.21.15.113:0/3554923178 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb880343f0 con 0x7ffb9015e040 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 -- 172.21.15.113:0/3554923178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9015e040 msgr2=0x7ffb9015e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 --2- 172.21.15.113:0/3554923178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9015e040 0x7ffb9015e480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009e50 tx=0x7ffb8802bf60 comp rx=0 tx=0).stop 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 -- 172.21.15.113:0/3554923178 shutdown_connections 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 --2- 172.21.15.113:0/3554923178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb9015e040 0x7ffb9015e480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 --2- 172.21.15.113:0/3554923178 >> v2:172.21.15.151:3300/0 conn(0x7ffb900b1710 0x7ffb9006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 -- 172.21.15.113:0/3554923178 >> 172.21.15.113:0/3554923178 conn(0x7ffb900cbb70 msgr2=0x7ffb900cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 -- 172.21.15.113:0/3554923178 shutdown_connections 2023-12-19T13:58:06.496 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.495+0000 7ffb948b2640 1 -- 172.21.15.113:0/3554923178 wait complete. 2023-12-19T13:58:06.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.497+0000 7ffb948b2640 1 Processor -- start 2023-12-19T13:58:06.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.497+0000 7ffb948b2640 1 -- start start 2023-12-19T13:58:06.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb948b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb900b1710 0x7ffb90156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:06.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb948b2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb90157aa0 0x7ffb9014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:06.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb948b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9015e040 0x7ffb900ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:06.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb948b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90156760 con 0x7ffb9015e040 2023-12-19T13:58:06.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb948b2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90155180 con 0x7ffb90157aa0 2023-12-19T13:58:06.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb948b2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90155460 con 0x7ffb900b1710 2023-12-19T13:58:06.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb8ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9015e040 0x7ffb900ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:06.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb8ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9015e040 0x7ffb900ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54158/0 (socket says 172.21.15.113:54158) 2023-12-19T13:58:06.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/2676707112 learned_addr learned my addr 172.21.15.113:0/2676707112 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:06.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb87fff640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb90157aa0 0x7ffb9014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:06.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.498+0000 7ffb8e59c640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb900b1710 0x7ffb90156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:06.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb900b1710 msgr2=0x7ffb90156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb8ed9d640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb900b1710 0x7ffb90156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb90157aa0 msgr2=0x7ffb9014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb8ed9d640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb90157aa0 0x7ffb9014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb8ed9d640 1 -- 172.21.15.113:0/2676707112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88009b30 con 0x7ffb9015e040 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb87fff640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb90157aa0 0x7ffb9014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb8ed9d640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9015e040 0x7ffb900ae4e0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009e50 tx=0x7ffb88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb86ffd640 1 -- 172.21.15.113:0/2676707112 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8803e450 con 0x7ffb9015e040 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb86ffd640 1 -- 172.21.15.113:0/2676707112 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8803e5b0 con 0x7ffb9015e040 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb86ffd640 1 -- 172.21.15.113:0/2676707112 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8803e960 con 0x7ffb9015e040 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb90155740 con 0x7ffb9015e040 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.499+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb90155d00 con 0x7ffb9015e040 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.500+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90061910 con 0x7ffb9015e040 2023-12-19T13:58:06.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.501+0000 7ffb86ffd640 1 -- 172.21.15.113:0/2676707112 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb8803eac0 con 0x7ffb9015e040 2023-12-19T13:58:06.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.502+0000 7ffb86ffd640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb7006a430 0x7ffb7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:06.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.502+0000 7ffb86ffd640 1 -- 172.21.15.113:0/2676707112 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb880ab4c0 con 0x7ffb9015e040 2023-12-19T13:58:06.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.503+0000 7ffb8e59c640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb7006a430 0x7ffb7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:06.503 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.503+0000 7ffb8e59c640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb7006a430 0x7ffb7006c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffb800015a0 tx=0x7ffb80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:06.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.507+0000 7ffb86ffd640 1 -- 172.21.15.113:0/2676707112 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb88076b40 con 0x7ffb9015e040 2023-12-19T13:58:06.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.694+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb9015db20 con 0x7ffb7006a430 2023-12-19T13:58:06.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.702+0000 7ffb86ffd640 1 -- 172.21.15.113:0/2676707112 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282514 (secure 0 0 0) 0x7ffb8000d4a0 con 0x7ffb7006a430 2023-12-19T13:58:06.706 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:06.708 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb7006a430 msgr2=0x7ffb7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb7006a430 0x7ffb7006c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffb800015a0 tx=0x7ffb80009040 comp rx=0 tx=0).stop 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9015e040 msgr2=0x7ffb900ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9015e040 0x7ffb900ae4e0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009e50 tx=0x7ffb88004a40 comp rx=0 tx=0).stop 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 shutdown_connections 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffb7006a430 0x7ffb7006c8f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb9015e040 0x7ffb900ae4e0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb90157aa0 0x7ffb9014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 --2- 172.21.15.113:0/2676707112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb900b1710 0x7ffb90156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:06.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.709+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 >> 172.21.15.113:0/2676707112 conn(0x7ffb900cbb70 msgr2=0x7ffb900cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:06.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.710+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 shutdown_connections 2023-12-19T13:58:06.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.710+0000 7ffb948b2640 1 -- 172.21.15.113:0/2676707112 wait complete. 2023-12-19T13:58:06.730 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2023-12-19T13:58:06.646659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8983,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553516,"statfs":{"total":1600000000,"available":1590801020,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002097"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930375+0000","last_change":"2023-12-19T13:58:01.373012+0000","last_active":"2023-12-19T13:58:02.930375+0000","last_peered":"2023-12-19T13:58:02.930375+0000","last_clean":"2023-12-19T13:58:02.930375+0000","last_became_active":"2023-12-19T13:58:01.369910+0000","last_became_peered":"2023-12-19T13:58:01.369910+0000","last_unstale":"2023-12-19T13:58:02.930375+0000","last_undegraded":"2023-12-19T13:58:02.930375+0000","last_fullsized":"2023-12-19T13:58:02.930375+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:32:47.339457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356618+0000","last_change":"2023-12-19T13:58:01.363131+0000","last_active":"2023-12-19T13:58:02.356618+0000","last_peered":"2023-12-19T13:58:02.356618+0000","last_clean":"2023-12-19T13:58:02.356618+0000","last_became_active":"2023-12-19T13:58:01.359914+0000","last_became_peered":"2023-12-19T13:58:01.359914+0000","last_unstale":"2023-12-19T13:58:02.356618+0000","last_undegraded":"2023-12-19T13:58:02.356618+0000","last_fullsized":"2023-12-19T13:58:02.356618+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:37.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.354464+0000","last_change":"2023-12-19T13:58:01.368495+0000","last_active":"2023-12-19T13:58:02.354464+0000","last_peered":"2023-12-19T13:58:02.354464+0000","last_clean":"2023-12-19T13:58:02.354464+0000","last_became_active":"2023-12-19T13:58:01.368268+0000","last_became_peered":"2023-12-19T13:58:01.368268+0000","last_unstale":"2023-12-19T13:58:02.354464+0000","last_undegraded":"2023-12-19T13:58:02.354464+0000","last_fullsized":"2023-12-19T13:58:02.354464+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:33.421032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.620772+0000","last_change":"2023-12-19T13:58:01.362068+0000","last_active":"2023-12-19T13:58:02.620772+0000","last_peered":"2023-12-19T13:58:02.620772+0000","last_clean":"2023-12-19T13:58:02.620772+0000","last_became_active":"2023-12-19T13:58:01.361217+0000","last_became_peered":"2023-12-19T13:58:01.361217+0000","last_unstale":"2023-12-19T13:58:02.620772+0000","last_undegraded":"2023-12-19T13:58:02.620772+0000","last_fullsized":"2023-12-19T13:58:02.620772+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:19.802506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.928377+0000","last_change":"2023-12-19T13:58:01.357318+0000","last_active":"2023-12-19T13:58:02.928377+0000","last_peered":"2023-12-19T13:58:02.928377+0000","last_clean":"2023-12-19T13:58:02.928377+0000","last_became_active":"2023-12-19T13:58:01.357104+0000","last_became_peered":"2023-12-19T13:58:01.357104+0000","last_unstale":"2023-12-19T13:58:02.928377+0000","last_undegraded":"2023-12-19T13:58:02.928377+0000","last_fullsized":"2023-12-19T13:58:02.928377+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:05.062889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930868+0000","last_change":"2023-12-19T13:58:01.372303+0000","last_active":"2023-12-19T13:58:02.930868+0000","last_peered":"2023-12-19T13:58:02.930868+0000","last_clean":"2023-12-19T13:58:02.930868+0000","last_became_active":"2023-12-19T13:58:01.371274+0000","last_became_peered":"2023-12-19T13:58:01.371274+0000","last_unstale":"2023-12-19T13:58:02.930868+0000","last_undegraded":"2023-12-19T13:58:02.930868+0000","last_fullsized":"2023-12-19T13:58:02.930868+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:37.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929353+0000","last_change":"2023-12-19T13:58:01.361604+0000","last_active":"2023-12-19T13:58:02.929353+0000","last_peered":"2023-12-19T13:58:02.929353+0000","last_clean":"2023-12-19T13:58:02.929353+0000","last_became_active":"2023-12-19T13:58:01.361093+0000","last_became_peered":"2023-12-19T13:58:01.361093+0000","last_unstale":"2023-12-19T13:58:02.929353+0000","last_undegraded":"2023-12-19T13:58:02.929353+0000","last_fullsized":"2023-12-19T13:58:02.929353+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:29.561314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929962+0000","last_change":"2023-12-19T13:58:01.372316+0000","last_active":"2023-12-19T13:58:02.929962+0000","last_peered":"2023-12-19T13:58:02.929962+0000","last_clean":"2023-12-19T13:58:02.929962+0000","last_became_active":"2023-12-19T13:58:01.372077+0000","last_became_peered":"2023-12-19T13:58:01.372077+0000","last_unstale":"2023-12-19T13:58:02.929962+0000","last_undegraded":"2023-12-19T13:58:02.929962+0000","last_fullsized":"2023-12-19T13:58:02.929962+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:43:27.279520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.928159+0000","last_change":"2023-12-19T13:58:01.365782+0000","last_active":"2023-12-19T13:58:02.928159+0000","last_peered":"2023-12-19T13:58:02.928159+0000","last_clean":"2023-12-19T13:58:02.928159+0000","last_became_active":"2023-12-19T13:58:01.365523+0000","last_became_peered":"2023-12-19T13:58:01.365523+0000","last_unstale":"2023-12-19T13:58:02.928159+0000","last_undegraded":"2023-12-19T13:58:02.928159+0000","last_fullsized":"2023-12-19T13:58:02.928159+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.066941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.354659+0000","last_change":"2023-12-19T13:58:01.348382+0000","last_active":"2023-12-19T13:58:02.354659+0000","last_peered":"2023-12-19T13:58:02.354659+0000","last_clean":"2023-12-19T13:58:02.354659+0000","last_became_active":"2023-12-19T13:58:01.348122+0000","last_became_peered":"2023-12-19T13:58:01.348122+0000","last_unstale":"2023-12-19T13:58:02.354659+0000","last_undegraded":"2023-12-19T13:58:02.354659+0000","last_fullsized":"2023-12-19T13:58:02.354659+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:53.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930268+0000","last_change":"2023-12-19T13:58:01.373331+0000","last_active":"2023-12-19T13:58:02.930268+0000","last_peered":"2023-12-19T13:58:02.930268+0000","last_clean":"2023-12-19T13:58:02.930268+0000","last_became_active":"2023-12-19T13:58:01.372609+0000","last_became_peered":"2023-12-19T13:58:01.372609+0000","last_unstale":"2023-12-19T13:58:02.930268+0000","last_undegraded":"2023-12-19T13:58:02.930268+0000","last_fullsized":"2023-12-19T13:58:02.930268+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:25.974517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356108+0000","last_change":"2023-12-19T13:58:01.361240+0000","last_active":"2023-12-19T13:58:02.356108+0000","last_peered":"2023-12-19T13:58:02.356108+0000","last_clean":"2023-12-19T13:58:02.356108+0000","last_became_active":"2023-12-19T13:58:01.360922+0000","last_became_peered":"2023-12-19T13:58:01.360922+0000","last_unstale":"2023-12-19T13:58:02.356108+0000","last_undegraded":"2023-12-19T13:58:02.356108+0000","last_fullsized":"2023-12-19T13:58:02.356108+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:25.974517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.927955+0000","last_change":"2023-12-19T13:58:01.362414+0000","last_active":"2023-12-19T13:58:02.927955+0000","last_peered":"2023-12-19T13:58:02.927955+0000","last_clean":"2023-12-19T13:58:02.927955+0000","last_became_active":"2023-12-19T13:58:01.362176+0000","last_became_peered":"2023-12-19T13:58:01.362176+0000","last_unstale":"2023-12-19T13:58:02.927955+0000","last_undegraded":"2023-12-19T13:58:02.927955+0000","last_fullsized":"2023-12-19T13:58:02.927955+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:28.281510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356093+0000","last_change":"2023-12-19T13:58:01.357444+0000","last_active":"2023-12-19T13:58:02.356093+0000","last_peered":"2023-12-19T13:58:02.356093+0000","last_clean":"2023-12-19T13:58:02.356093+0000","last_became_active":"2023-12-19T13:58:01.357230+0000","last_became_peered":"2023-12-19T13:58:01.357230+0000","last_unstale":"2023-12-19T13:58:02.356093+0000","last_undegraded":"2023-12-19T13:58:02.356093+0000","last_fullsized":"2023-12-19T13:58:02.356093+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.066941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.928634+0000","last_change":"2023-12-19T13:58:01.374208+0000","last_active":"2023-12-19T13:58:02.928634+0000","last_peered":"2023-12-19T13:58:02.928634+0000","last_clean":"2023-12-19T13:58:02.928634+0000","last_became_active":"2023-12-19T13:58:01.373989+0000","last_became_peered":"2023-12-19T13:58:01.373989+0000","last_unstale":"2023-12-19T13:58:02.928634+0000","last_undegraded":"2023-12-19T13:58:02.928634+0000","last_fullsized":"2023-12-19T13:58:02.928634+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:53.775319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930873+0000","last_change":"2023-12-19T13:58:01.368197+0000","last_active":"2023-12-19T13:58:02.930873+0000","last_peered":"2023-12-19T13:58:02.930873+0000","last_clean":"2023-12-19T13:58:02.930873+0000","last_became_active":"2023-12-19T13:58:01.367961+0000","last_became_peered":"2023-12-19T13:58:01.367961+0000","last_unstale":"2023-12-19T13:58:02.930873+0000","last_undegraded":"2023-12-19T13:58:02.930873+0000","last_fullsized":"2023-12-19T13:58:02.930873+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:05.767274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.354422+0000","last_change":"2023-12-19T13:58:01.359026+0000","last_active":"2023-12-19T13:58:02.354422+0000","last_peered":"2023-12-19T13:58:02.354422+0000","last_clean":"2023-12-19T13:58:02.354422+0000","last_became_active":"2023-12-19T13:58:01.357489+0000","last_became_peered":"2023-12-19T13:58:01.357489+0000","last_unstale":"2023-12-19T13:58:02.354422+0000","last_undegraded":"2023-12-19T13:58:02.354422+0000","last_fullsized":"2023-12-19T13:58:02.354422+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:40.197413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.928195+0000","last_change":"2023-12-19T13:58:01.368522+0000","last_active":"2023-12-19T13:58:02.928195+0000","last_peered":"2023-12-19T13:58:02.928195+0000","last_clean":"2023-12-19T13:58:02.928195+0000","last_became_active":"2023-12-19T13:58:01.368258+0000","last_became_peered":"2023-12-19T13:58:01.368258+0000","last_unstale":"2023-12-19T13:58:02.928195+0000","last_undegraded":"2023-12-19T13:58:02.928195+0000","last_fullsized":"2023-12-19T13:58:02.928195+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:12.803619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929393+0000","last_change":"2023-12-19T13:58:01.372080+0000","last_active":"2023-12-19T13:58:02.929393+0000","last_peered":"2023-12-19T13:58:02.929393+0000","last_clean":"2023-12-19T13:58:02.929393+0000","last_became_active":"2023-12-19T13:58:01.369802+0000","last_became_peered":"2023-12-19T13:58:01.369802+0000","last_unstale":"2023-12-19T13:58:02.929393+0000","last_undegraded":"2023-12-19T13:58:02.929393+0000","last_fullsized":"2023-12-19T13:58:02.929393+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:07:29.806923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930570+0000","last_change":"2023-12-19T13:58:01.371597+0000","last_active":"2023-12-19T13:58:02.930570+0000","last_peered":"2023-12-19T13:58:02.930570+0000","last_clean":"2023-12-19T13:58:02.930570+0000","last_became_active":"2023-12-19T13:58:01.369698+0000","last_became_peered":"2023-12-19T13:58:01.369698+0000","last_unstale":"2023-12-19T13:58:02.930570+0000","last_undegraded":"2023-12-19T13:58:02.930570+0000","last_fullsized":"2023-12-19T13:58:02.930570+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:51.513766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.354412+0000","last_change":"2023-12-19T13:58:01.357581+0000","last_active":"2023-12-19T13:58:02.354412+0000","last_peered":"2023-12-19T13:58:02.354412+0000","last_clean":"2023-12-19T13:58:02.354412+0000","last_became_active":"2023-12-19T13:58:01.357318+0000","last_became_peered":"2023-12-19T13:58:01.357318+0000","last_unstale":"2023-12-19T13:58:02.354412+0000","last_undegraded":"2023-12-19T13:58:02.354412+0000","last_fullsized":"2023-12-19T13:58:02.354412+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:45.430359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356208+0000","last_change":"2023-12-19T13:58:01.364684+0000","last_active":"2023-12-19T13:58:02.356208+0000","last_peered":"2023-12-19T13:58:02.356208+0000","last_clean":"2023-12-19T13:58:02.356208+0000","last_became_active":"2023-12-19T13:58:01.363466+0000","last_became_peered":"2023-12-19T13:58:01.363466+0000","last_unstale":"2023-12-19T13:58:02.356208+0000","last_undegraded":"2023-12-19T13:58:02.356208+0000","last_fullsized":"2023-12-19T13:58:02.356208+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:32.454166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621042+0000","last_change":"2023-12-19T13:58:01.371405+0000","last_active":"2023-12-19T13:58:02.621042+0000","last_peered":"2023-12-19T13:58:02.621042+0000","last_clean":"2023-12-19T13:58:02.621042+0000","last_became_active":"2023-12-19T13:58:01.371267+0000","last_became_peered":"2023-12-19T13:58:01.371267+0000","last_unstale":"2023-12-19T13:58:02.621042+0000","last_undegraded":"2023-12-19T13:58:02.621042+0000","last_fullsized":"2023-12-19T13:58:02.621042+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:25.974517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.927913+0000","last_change":"2023-12-19T13:58:01.358470+0000","last_active":"2023-12-19T13:58:02.927913+0000","last_peered":"2023-12-19T13:58:02.927913+0000","last_clean":"2023-12-19T13:58:02.927913+0000","last_became_active":"2023-12-19T13:58:01.358255+0000","last_became_peered":"2023-12-19T13:58:01.358255+0000","last_unstale":"2023-12-19T13:58:02.927913+0000","last_undegraded":"2023-12-19T13:58:02.927913+0000","last_fullsized":"2023-12-19T13:58:02.927913+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:00.835380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.357490+0000","last_change":"2023-12-19T13:58:01.369038+0000","last_active":"2023-12-19T13:58:02.357490+0000","last_peered":"2023-12-19T13:58:02.357490+0000","last_clean":"2023-12-19T13:58:02.357490+0000","last_became_active":"2023-12-19T13:58:01.368551+0000","last_became_peered":"2023-12-19T13:58:01.368551+0000","last_unstale":"2023-12-19T13:58:02.357490+0000","last_undegraded":"2023-12-19T13:58:02.357490+0000","last_fullsized":"2023-12-19T13:58:02.357490+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:25.974517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930116+0000","last_change":"2023-12-19T13:58:01.372866+0000","last_active":"2023-12-19T13:58:02.930116+0000","last_peered":"2023-12-19T13:58:02.930116+0000","last_clean":"2023-12-19T13:58:02.930116+0000","last_became_active":"2023-12-19T13:58:01.369586+0000","last_became_peered":"2023-12-19T13:58:01.369586+0000","last_unstale":"2023-12-19T13:58:02.930116+0000","last_undegraded":"2023-12-19T13:58:02.930116+0000","last_fullsized":"2023-12-19T13:58:02.930116+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:58:41.616389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356906+0000","last_change":"2023-12-19T13:58:01.366116+0000","last_active":"2023-12-19T13:58:02.356906+0000","last_peered":"2023-12-19T13:58:02.356906+0000","last_clean":"2023-12-19T13:58:02.356906+0000","last_became_active":"2023-12-19T13:58:01.365860+0000","last_became_peered":"2023-12-19T13:58:01.365860+0000","last_unstale":"2023-12-19T13:58:02.356906+0000","last_undegraded":"2023-12-19T13:58:02.356906+0000","last_fullsized":"2023-12-19T13:58:02.356906+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:47.183949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356916+0000","last_change":"2023-12-19T13:58:01.370167+0000","last_active":"2023-12-19T13:58:02.356916+0000","last_peered":"2023-12-19T13:58:02.356916+0000","last_clean":"2023-12-19T13:58:02.356916+0000","last_became_active":"2023-12-19T13:58:01.369921+0000","last_became_peered":"2023-12-19T13:58:01.369921+0000","last_unstale":"2023-12-19T13:58:02.356916+0000","last_undegraded":"2023-12-19T13:58:02.356916+0000","last_fullsized":"2023-12-19T13:58:02.356916+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.066941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929660+0000","last_change":"2023-12-19T13:58:01.372248+0000","last_active":"2023-12-19T13:58:02.929660+0000","last_peered":"2023-12-19T13:58:02.929660+0000","last_clean":"2023-12-19T13:58:02.929660+0000","last_became_active":"2023-12-19T13:58:01.371770+0000","last_became_peered":"2023-12-19T13:58:01.371770+0000","last_unstale":"2023-12-19T13:58:02.929660+0000","last_undegraded":"2023-12-19T13:58:02.929660+0000","last_fullsized":"2023-12-19T13:58:02.929660+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:44:11.969334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356561+0000","last_change":"2023-12-19T13:58:01.366937+0000","last_active":"2023-12-19T13:58:02.356561+0000","last_peered":"2023-12-19T13:58:02.356561+0000","last_clean":"2023-12-19T13:58:02.356561+0000","last_became_active":"2023-12-19T13:58:01.366737+0000","last_became_peered":"2023-12-19T13:58:01.366737+0000","last_unstale":"2023-12-19T13:58:02.356561+0000","last_undegraded":"2023-12-19T13:58:02.356561+0000","last_fullsized":"2023-12-19T13:58:02.356561+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:37.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.357188+0000","last_change":"2023-12-19T13:58:01.358416+0000","last_active":"2023-12-19T13:58:02.357188+0000","last_peered":"2023-12-19T13:58:02.357188+0000","last_clean":"2023-12-19T13:58:02.357188+0000","last_became_active":"2023-12-19T13:58:01.357943+0000","last_became_peered":"2023-12-19T13:58:01.357943+0000","last_unstale":"2023-12-19T13:58:02.357188+0000","last_undegraded":"2023-12-19T13:58:02.357188+0000","last_fullsized":"2023-12-19T13:58:02.357188+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:15.870981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.357147+0000","last_change":"2023-12-19T13:58:01.363755+0000","last_active":"2023-12-19T13:58:02.357147+0000","last_peered":"2023-12-19T13:58:02.357147+0000","last_clean":"2023-12-19T13:58:02.357147+0000","last_became_active":"2023-12-19T13:58:01.363438+0000","last_became_peered":"2023-12-19T13:58:01.363438+0000","last_unstale":"2023-12-19T13:58:02.357147+0000","last_undegraded":"2023-12-19T13:58:02.357147+0000","last_fullsized":"2023-12-19T13:58:02.357147+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:26.191257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.928091+0000","last_change":"2023-12-19T13:58:01.362117+0000","last_active":"2023-12-19T13:58:02.928091+0000","last_peered":"2023-12-19T13:58:02.928091+0000","last_clean":"2023-12-19T13:58:02.928091+0000","last_became_active":"2023-12-19T13:58:01.361836+0000","last_became_peered":"2023-12-19T13:58:01.361836+0000","last_unstale":"2023-12-19T13:58:02.928091+0000","last_undegraded":"2023-12-19T13:58:02.928091+0000","last_fullsized":"2023-12-19T13:58:02.928091+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:32:31.844402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"177'4","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.373587+0000","last_change":"2023-12-19T13:58:00.902958+0000","last_active":"2023-12-19T13:58:01.373587+0000","last_peered":"2023-12-19T13:58:01.373587+0000","last_clean":"2023-12-19T13:58:01.373587+0000","last_became_active":"2023-12-19T13:58:00.902497+0000","last_became_peered":"2023-12-19T13:58:00.902497+0000","last_unstale":"2023-12-19T13:58:01.373587+0000","last_undegraded":"2023-12-19T13:58:01.373587+0000","last_fullsized":"2023-12-19T13:58:01.373587+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:55.218311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929690+0000","last_change":"2023-12-19T13:58:01.374896+0000","last_active":"2023-12-19T13:58:02.929690+0000","last_peered":"2023-12-19T13:58:02.929690+0000","last_clean":"2023-12-19T13:58:02.929690+0000","last_became_active":"2023-12-19T13:58:01.374466+0000","last_became_peered":"2023-12-19T13:58:01.374466+0000","last_unstale":"2023-12-19T13:58:02.929690+0000","last_undegraded":"2023-12-19T13:58:02.929690+0000","last_fullsized":"2023-12-19T13:58:02.929690+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:50.596950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"177'1","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.365004+0000","last_change":"2023-12-19T13:58:00.896900+0000","last_active":"2023-12-19T13:58:01.365004+0000","last_peered":"2023-12-19T13:58:01.365004+0000","last_clean":"2023-12-19T13:58:01.365004+0000","last_became_active":"2023-12-19T13:58:00.895184+0000","last_became_peered":"2023-12-19T13:58:00.895184+0000","last_unstale":"2023-12-19T13:58:01.365004+0000","last_undegraded":"2023-12-19T13:58:01.365004+0000","last_fullsized":"2023-12-19T13:58:01.365004+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:04.036996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930551+0000","last_change":"2023-12-19T13:58:01.373080+0000","last_active":"2023-12-19T13:58:02.930551+0000","last_peered":"2023-12-19T13:58:02.930551+0000","last_clean":"2023-12-19T13:58:02.930551+0000","last_became_active":"2023-12-19T13:58:01.371943+0000","last_became_peered":"2023-12-19T13:58:01.371943+0000","last_unstale":"2023-12-19T13:58:02.930551+0000","last_undegraded":"2023-12-19T13:58:02.930551+0000","last_fullsized":"2023-12-19T13:58:02.930551+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:47.183949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"177'2","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.364720+0000","last_change":"2023-12-19T13:58:00.908093+0000","last_active":"2023-12-19T13:58:01.364720+0000","last_peered":"2023-12-19T13:58:01.364720+0000","last_clean":"2023-12-19T13:58:01.364720+0000","last_became_active":"2023-12-19T13:58:00.907625+0000","last_became_peered":"2023-12-19T13:58:00.907625+0000","last_unstale":"2023-12-19T13:58:01.364720+0000","last_undegraded":"2023-12-19T13:58:01.364720+0000","last_fullsized":"2023-12-19T13:58:01.364720+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:42.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621069+0000","last_change":"2023-12-19T13:58:01.359618+0000","last_active":"2023-12-19T13:58:02.621069+0000","last_peered":"2023-12-19T13:58:02.621069+0000","last_clean":"2023-12-19T13:58:02.621069+0000","last_became_active":"2023-12-19T13:58:01.359403+0000","last_became_peered":"2023-12-19T13:58:01.359403+0000","last_unstale":"2023-12-19T13:58:02.621069+0000","last_undegraded":"2023-12-19T13:58:02.621069+0000","last_fullsized":"2023-12-19T13:58:02.621069+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:26.191257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"177'2","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.364752+0000","last_change":"2023-12-19T13:58:00.892443+0000","last_active":"2023-12-19T13:58:01.364752+0000","last_peered":"2023-12-19T13:58:01.364752+0000","last_clean":"2023-12-19T13:58:01.364752+0000","last_became_active":"2023-12-19T13:58:00.892135+0000","last_became_peered":"2023-12-19T13:58:00.892135+0000","last_unstale":"2023-12-19T13:58:01.364752+0000","last_undegraded":"2023-12-19T13:58:01.364752+0000","last_fullsized":"2023-12-19T13:58:01.364752+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:40.643609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.357068+0000","last_change":"2023-12-19T13:58:01.366362+0000","last_active":"2023-12-19T13:58:02.357068+0000","last_peered":"2023-12-19T13:58:02.357068+0000","last_clean":"2023-12-19T13:58:02.357068+0000","last_became_active":"2023-12-19T13:58:01.366018+0000","last_became_peered":"2023-12-19T13:58:01.366018+0000","last_unstale":"2023-12-19T13:58:02.357068+0000","last_undegraded":"2023-12-19T13:58:02.357068+0000","last_fullsized":"2023-12-19T13:58:02.357068+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:20.066146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"177'1","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.373802+0000","last_change":"2023-12-19T13:58:00.900184+0000","last_active":"2023-12-19T13:58:01.373802+0000","last_peered":"2023-12-19T13:58:01.373802+0000","last_clean":"2023-12-19T13:58:01.373802+0000","last_became_active":"2023-12-19T13:58:00.899768+0000","last_became_peered":"2023-12-19T13:58:00.899768+0000","last_unstale":"2023-12-19T13:58:01.373802+0000","last_undegraded":"2023-12-19T13:58:01.373802+0000","last_fullsized":"2023-12-19T13:58:01.373802+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:36.345784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.620879+0000","last_change":"2023-12-19T13:58:01.360631+0000","last_active":"2023-12-19T13:58:02.620879+0000","last_peered":"2023-12-19T13:58:02.620879+0000","last_clean":"2023-12-19T13:58:02.620879+0000","last_became_active":"2023-12-19T13:58:01.360245+0000","last_became_peered":"2023-12-19T13:58:01.360245+0000","last_unstale":"2023-12-19T13:58:02.620879+0000","last_undegraded":"2023-12-19T13:58:02.620879+0000","last_fullsized":"2023-12-19T13:58:02.620879+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:48:19.770162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"177'1","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.353677+0000","last_change":"2023-12-19T13:58:00.897864+0000","last_active":"2023-12-19T13:58:01.353677+0000","last_peered":"2023-12-19T13:58:01.353677+0000","last_clean":"2023-12-19T13:58:01.353677+0000","last_became_active":"2023-12-19T13:58:00.897310+0000","last_became_peered":"2023-12-19T13:58:00.897310+0000","last_unstale":"2023-12-19T13:58:01.353677+0000","last_undegraded":"2023-12-19T13:58:01.353677+0000","last_fullsized":"2023-12-19T13:58:01.353677+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:00:04.868968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.357709+0000","last_change":"2023-12-19T13:58:01.368794+0000","last_active":"2023-12-19T13:58:02.357709+0000","last_peered":"2023-12-19T13:58:02.357709+0000","last_clean":"2023-12-19T13:58:02.357709+0000","last_became_active":"2023-12-19T13:58:01.367771+0000","last_became_peered":"2023-12-19T13:58:01.367771+0000","last_unstale":"2023-12-19T13:58:02.357709+0000","last_undegraded":"2023-12-19T13:58:02.357709+0000","last_fullsized":"2023-12-19T13:58:02.357709+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:19.802506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.361653+0000","last_change":"2023-12-19T13:58:00.905285+0000","last_active":"2023-12-19T13:58:01.361653+0000","last_peered":"2023-12-19T13:58:01.361653+0000","last_clean":"2023-12-19T13:58:01.361653+0000","last_became_active":"2023-12-19T13:58:00.904678+0000","last_became_peered":"2023-12-19T13:58:00.904678+0000","last_unstale":"2023-12-19T13:58:01.361653+0000","last_undegraded":"2023-12-19T13:58:01.361653+0000","last_fullsized":"2023-12-19T13:58:01.361653+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:19.922624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621028+0000","last_change":"2023-12-19T13:58:01.373501+0000","last_active":"2023-12-19T13:58:02.621028+0000","last_peered":"2023-12-19T13:58:02.621028+0000","last_clean":"2023-12-19T13:58:02.621028+0000","last_became_active":"2023-12-19T13:58:01.373158+0000","last_became_peered":"2023-12-19T13:58:01.373158+0000","last_unstale":"2023-12-19T13:58:02.621028+0000","last_undegraded":"2023-12-19T13:58:02.621028+0000","last_fullsized":"2023-12-19T13:58:02.621028+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:32.454166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.346605+0000","last_change":"2023-12-19T13:58:00.902774+0000","last_active":"2023-12-19T13:58:01.346605+0000","last_peered":"2023-12-19T13:58:01.346605+0000","last_clean":"2023-12-19T13:58:01.346605+0000","last_became_active":"2023-12-19T13:58:00.901981+0000","last_became_peered":"2023-12-19T13:58:00.901981+0000","last_unstale":"2023-12-19T13:58:01.346605+0000","last_undegraded":"2023-12-19T13:58:01.346605+0000","last_fullsized":"2023-12-19T13:58:01.346605+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:16.535600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621041+0000","last_change":"2023-12-19T13:58:01.367129+0000","last_active":"2023-12-19T13:58:02.621041+0000","last_peered":"2023-12-19T13:58:02.621041+0000","last_clean":"2023-12-19T13:58:02.621041+0000","last_became_active":"2023-12-19T13:58:01.366764+0000","last_became_peered":"2023-12-19T13:58:01.366764+0000","last_unstale":"2023-12-19T13:58:02.621041+0000","last_undegraded":"2023-12-19T13:58:02.621041+0000","last_fullsized":"2023-12-19T13:58:02.621041+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:20.066146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.370504+0000","last_change":"2023-12-19T13:58:00.904159+0000","last_active":"2023-12-19T13:58:01.370504+0000","last_peered":"2023-12-19T13:58:01.370504+0000","last_clean":"2023-12-19T13:58:01.370504+0000","last_became_active":"2023-12-19T13:58:00.903800+0000","last_became_peered":"2023-12-19T13:58:00.903800+0000","last_unstale":"2023-12-19T13:58:01.370504+0000","last_undegraded":"2023-12-19T13:58:01.370504+0000","last_fullsized":"2023-12-19T13:58:01.370504+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:53.842702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356325+0000","last_change":"2023-12-19T13:58:01.357999+0000","last_active":"2023-12-19T13:58:02.356325+0000","last_peered":"2023-12-19T13:58:02.356325+0000","last_clean":"2023-12-19T13:58:02.356325+0000","last_became_active":"2023-12-19T13:58:01.357504+0000","last_became_peered":"2023-12-19T13:58:01.357504+0000","last_unstale":"2023-12-19T13:58:02.356325+0000","last_undegraded":"2023-12-19T13:58:02.356325+0000","last_fullsized":"2023-12-19T13:58:02.356325+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:20.066146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.342186+0000","last_change":"2023-12-19T13:58:00.907657+0000","last_active":"2023-12-19T13:58:01.342186+0000","last_peered":"2023-12-19T13:58:01.342186+0000","last_clean":"2023-12-19T13:58:01.342186+0000","last_became_active":"2023-12-19T13:58:00.907400+0000","last_became_peered":"2023-12-19T13:58:00.907400+0000","last_unstale":"2023-12-19T13:58:01.342186+0000","last_undegraded":"2023-12-19T13:58:01.342186+0000","last_fullsized":"2023-12-19T13:58:01.342186+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:37:59.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929906+0000","last_change":"2023-12-19T13:58:01.367299+0000","last_active":"2023-12-19T13:58:02.929906+0000","last_peered":"2023-12-19T13:58:02.929906+0000","last_clean":"2023-12-19T13:58:02.929906+0000","last_became_active":"2023-12-19T13:58:01.367048+0000","last_became_peered":"2023-12-19T13:58:01.367048+0000","last_unstale":"2023-12-19T13:58:02.929906+0000","last_undegraded":"2023-12-19T13:58:02.929906+0000","last_fullsized":"2023-12-19T13:58:02.929906+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:47:41.848872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"177'6","reported_seq":17,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.376012+0000","last_change":"2023-12-19T13:58:00.908973+0000","last_active":"2023-12-19T13:58:01.376012+0000","last_peered":"2023-12-19T13:58:01.376012+0000","last_clean":"2023-12-19T13:58:01.376012+0000","last_became_active":"2023-12-19T13:58:00.908525+0000","last_became_peered":"2023-12-19T13:58:00.908525+0000","last_unstale":"2023-12-19T13:58:01.376012+0000","last_undegraded":"2023-12-19T13:58:01.376012+0000","last_fullsized":"2023-12-19T13:58:01.376012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:43.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621130+0000","last_change":"2023-12-19T13:58:01.358068+0000","last_active":"2023-12-19T13:58:02.621130+0000","last_peered":"2023-12-19T13:58:02.621130+0000","last_clean":"2023-12-19T13:58:02.621130+0000","last_became_active":"2023-12-19T13:58:01.357730+0000","last_became_peered":"2023-12-19T13:58:01.357730+0000","last_unstale":"2023-12-19T13:58:02.621130+0000","last_undegraded":"2023-12-19T13:58:02.621130+0000","last_fullsized":"2023-12-19T13:58:02.621130+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:13.883399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"177'2","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.365197+0000","last_change":"2023-12-19T13:58:00.907910+0000","last_active":"2023-12-19T13:58:01.365197+0000","last_peered":"2023-12-19T13:58:01.365197+0000","last_clean":"2023-12-19T13:58:01.365197+0000","last_became_active":"2023-12-19T13:58:00.907120+0000","last_became_peered":"2023-12-19T13:58:00.907120+0000","last_unstale":"2023-12-19T13:58:01.365197+0000","last_undegraded":"2023-12-19T13:58:01.365197+0000","last_fullsized":"2023-12-19T13:58:01.365197+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:14.469645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930705+0000","last_change":"2023-12-19T13:58:01.369414+0000","last_active":"2023-12-19T13:58:02.930705+0000","last_peered":"2023-12-19T13:58:02.930705+0000","last_clean":"2023-12-19T13:58:02.930705+0000","last_became_active":"2023-12-19T13:58:01.364266+0000","last_became_peered":"2023-12-19T13:58:01.364266+0000","last_unstale":"2023-12-19T13:58:02.930705+0000","last_undegraded":"2023-12-19T13:58:02.930705+0000","last_fullsized":"2023-12-19T13:58:02.930705+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:40:39.173269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.353995+0000","last_change":"2023-12-19T13:58:00.899450+0000","last_active":"2023-12-19T13:58:01.353995+0000","last_peered":"2023-12-19T13:58:01.353995+0000","last_clean":"2023-12-19T13:58:01.353995+0000","last_became_active":"2023-12-19T13:58:00.898980+0000","last_became_peered":"2023-12-19T13:58:00.898980+0000","last_unstale":"2023-12-19T13:58:01.353995+0000","last_undegraded":"2023-12-19T13:58:01.353995+0000","last_fullsized":"2023-12-19T13:58:01.353995+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:19.922624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621542+0000","last_change":"2023-12-19T13:58:01.358991+0000","last_active":"2023-12-19T13:58:02.621542+0000","last_peered":"2023-12-19T13:58:02.621542+0000","last_clean":"2023-12-19T13:58:02.621542+0000","last_became_active":"2023-12-19T13:58:01.358363+0000","last_became_peered":"2023-12-19T13:58:01.358363+0000","last_unstale":"2023-12-19T13:58:02.621542+0000","last_undegraded":"2023-12-19T13:58:02.621542+0000","last_fullsized":"2023-12-19T13:58:02.621542+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:15.870981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.348634+0000","last_change":"2023-12-19T13:58:00.899163+0000","last_active":"2023-12-19T13:58:01.348634+0000","last_peered":"2023-12-19T13:58:01.348634+0000","last_clean":"2023-12-19T13:58:01.348634+0000","last_became_active":"2023-12-19T13:58:00.898232+0000","last_became_peered":"2023-12-19T13:58:00.898232+0000","last_unstale":"2023-12-19T13:58:01.348634+0000","last_undegraded":"2023-12-19T13:58:01.348634+0000","last_fullsized":"2023-12-19T13:58:01.348634+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:19.088190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621199+0000","last_change":"2023-12-19T13:58:01.366984+0000","last_active":"2023-12-19T13:58:02.621199+0000","last_peered":"2023-12-19T13:58:02.621199+0000","last_clean":"2023-12-19T13:58:02.621199+0000","last_became_active":"2023-12-19T13:58:01.366452+0000","last_became_peered":"2023-12-19T13:58:01.366452+0000","last_unstale":"2023-12-19T13:58:02.621199+0000","last_undegraded":"2023-12-19T13:58:02.621199+0000","last_fullsized":"2023-12-19T13:58:02.621199+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.066941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"177'8","reported_seq":19,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.378983+0000","last_change":"2023-12-19T13:58:00.905395+0000","last_active":"2023-12-19T13:58:01.378983+0000","last_peered":"2023-12-19T13:58:01.378983+0000","last_clean":"2023-12-19T13:58:01.378983+0000","last_became_active":"2023-12-19T13:58:00.904488+0000","last_became_peered":"2023-12-19T13:58:00.904488+0000","last_unstale":"2023-12-19T13:58:01.378983+0000","last_undegraded":"2023-12-19T13:58:01.378983+0000","last_fullsized":"2023-12-19T13:58:01.378983+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:24.969482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.928862+0000","last_change":"2023-12-19T13:58:01.363284+0000","last_active":"2023-12-19T13:58:02.928862+0000","last_peered":"2023-12-19T13:58:02.928862+0000","last_clean":"2023-12-19T13:58:02.928862+0000","last_became_active":"2023-12-19T13:58:01.362906+0000","last_became_peered":"2023-12-19T13:58:01.362906+0000","last_unstale":"2023-12-19T13:58:02.928862+0000","last_undegraded":"2023-12-19T13:58:02.928862+0000","last_fullsized":"2023-12-19T13:58:02.928862+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:13.175581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"177'1","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.369631+0000","last_change":"2023-12-19T13:58:00.905347+0000","last_active":"2023-12-19T13:58:01.369631+0000","last_peered":"2023-12-19T13:58:01.369631+0000","last_clean":"2023-12-19T13:58:01.369631+0000","last_became_active":"2023-12-19T13:58:00.905108+0000","last_became_peered":"2023-12-19T13:58:00.905108+0000","last_unstale":"2023-12-19T13:58:01.369631+0000","last_undegraded":"2023-12-19T13:58:01.369631+0000","last_fullsized":"2023-12-19T13:58:01.369631+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:28.525786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356831+0000","last_change":"2023-12-19T13:58:01.352567+0000","last_active":"2023-12-19T13:58:02.356831+0000","last_peered":"2023-12-19T13:58:02.356831+0000","last_clean":"2023-12-19T13:58:02.356831+0000","last_became_active":"2023-12-19T13:58:01.351743+0000","last_became_peered":"2023-12-19T13:58:01.351743+0000","last_unstale":"2023-12-19T13:58:02.356831+0000","last_undegraded":"2023-12-19T13:58:02.356831+0000","last_fullsized":"2023-12-19T13:58:02.356831+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:13.883399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"177'2","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.375838+0000","last_change":"2023-12-19T13:58:00.903086+0000","last_active":"2023-12-19T13:58:01.375838+0000","last_peered":"2023-12-19T13:58:01.375838+0000","last_clean":"2023-12-19T13:58:01.375838+0000","last_became_active":"2023-12-19T13:58:00.902359+0000","last_became_peered":"2023-12-19T13:58:00.902359+0000","last_unstale":"2023-12-19T13:58:01.375838+0000","last_undegraded":"2023-12-19T13:58:01.375838+0000","last_fullsized":"2023-12-19T13:58:01.375838+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:24:31.449130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.927872+0000","last_change":"2023-12-19T13:58:01.362953+0000","last_active":"2023-12-19T13:58:02.927872+0000","last_peered":"2023-12-19T13:58:02.927872+0000","last_clean":"2023-12-19T13:58:02.927872+0000","last_became_active":"2023-12-19T13:58:01.362688+0000","last_became_peered":"2023-12-19T13:58:01.362688+0000","last_unstale":"2023-12-19T13:58:02.927872+0000","last_undegraded":"2023-12-19T13:58:02.927872+0000","last_fullsized":"2023-12-19T13:58:02.927872+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:25.822512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"177'1","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.364691+0000","last_change":"2023-12-19T13:58:00.909364+0000","last_active":"2023-12-19T13:58:01.364691+0000","last_peered":"2023-12-19T13:58:01.364691+0000","last_clean":"2023-12-19T13:58:01.364691+0000","last_became_active":"2023-12-19T13:58:00.908849+0000","last_became_peered":"2023-12-19T13:58:00.908849+0000","last_unstale":"2023-12-19T13:58:01.364691+0000","last_undegraded":"2023-12-19T13:58:01.364691+0000","last_fullsized":"2023-12-19T13:58:01.364691+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:25.186221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930747+0000","last_change":"2023-12-19T13:58:01.372827+0000","last_active":"2023-12-19T13:58:02.930747+0000","last_peered":"2023-12-19T13:58:02.930747+0000","last_clean":"2023-12-19T13:58:02.930747+0000","last_became_active":"2023-12-19T13:58:01.371649+0000","last_became_peered":"2023-12-19T13:58:01.371649+0000","last_unstale":"2023-12-19T13:58:02.930747+0000","last_undegraded":"2023-12-19T13:58:02.930747+0000","last_fullsized":"2023-12-19T13:58:02.930747+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:20.066146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.351955+0000","last_change":"2023-12-19T13:58:00.907182+0000","last_active":"2023-12-19T13:58:01.351955+0000","last_peered":"2023-12-19T13:58:01.351955+0000","last_clean":"2023-12-19T13:58:01.351955+0000","last_became_active":"2023-12-19T13:58:00.906891+0000","last_became_peered":"2023-12-19T13:58:00.906891+0000","last_unstale":"2023-12-19T13:58:01.351955+0000","last_undegraded":"2023-12-19T13:58:01.351955+0000","last_fullsized":"2023-12-19T13:58:01.351955+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:20.898323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.355972+0000","last_change":"2023-12-19T13:58:01.370429+0000","last_active":"2023-12-19T13:58:02.355972+0000","last_peered":"2023-12-19T13:58:02.355972+0000","last_clean":"2023-12-19T13:58:02.355972+0000","last_became_active":"2023-12-19T13:58:01.370288+0000","last_became_peered":"2023-12-19T13:58:01.370288+0000","last_unstale":"2023-12-19T13:58:02.355972+0000","last_undegraded":"2023-12-19T13:58:02.355972+0000","last_fullsized":"2023-12-19T13:58:02.355972+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:29.561314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"177'2","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.372511+0000","last_change":"2023-12-19T13:58:00.903657+0000","last_active":"2023-12-19T13:58:01.372511+0000","last_peered":"2023-12-19T13:58:01.372511+0000","last_clean":"2023-12-19T13:58:01.372511+0000","last_became_active":"2023-12-19T13:58:00.901829+0000","last_became_peered":"2023-12-19T13:58:00.901829+0000","last_unstale":"2023-12-19T13:58:01.372511+0000","last_undegraded":"2023-12-19T13:58:01.372511+0000","last_fullsized":"2023-12-19T13:58:01.372511+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:56.516367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.357206+0000","last_change":"2023-12-19T13:58:01.357937+0000","last_active":"2023-12-19T13:58:02.357206+0000","last_peered":"2023-12-19T13:58:02.357206+0000","last_clean":"2023-12-19T13:58:02.357206+0000","last_became_active":"2023-12-19T13:58:01.352010+0000","last_became_peered":"2023-12-19T13:58:01.352010+0000","last_unstale":"2023-12-19T13:58:02.357206+0000","last_undegraded":"2023-12-19T13:58:02.357206+0000","last_fullsized":"2023-12-19T13:58:02.357206+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:48:19.770162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.358229+0000","last_change":"2023-12-19T13:58:00.906971+0000","last_active":"2023-12-19T13:58:01.358229+0000","last_peered":"2023-12-19T13:58:01.358229+0000","last_clean":"2023-12-19T13:58:01.358229+0000","last_became_active":"2023-12-19T13:58:00.906747+0000","last_became_peered":"2023-12-19T13:58:00.906747+0000","last_unstale":"2023-12-19T13:58:01.358229+0000","last_undegraded":"2023-12-19T13:58:01.358229+0000","last_fullsized":"2023-12-19T13:58:01.358229+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:45:20.898323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.356385+0000","last_change":"2023-12-19T13:58:01.374397+0000","last_active":"2023-12-19T13:58:02.356385+0000","last_peered":"2023-12-19T13:58:02.356385+0000","last_clean":"2023-12-19T13:58:02.356385+0000","last_became_active":"2023-12-19T13:58:01.374193+0000","last_became_peered":"2023-12-19T13:58:01.374193+0000","last_unstale":"2023-12-19T13:58:02.356385+0000","last_undegraded":"2023-12-19T13:58:02.356385+0000","last_fullsized":"2023-12-19T13:58:02.356385+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:47.183949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.356104+0000","last_change":"2023-12-19T13:58:00.905184+0000","last_active":"2023-12-19T13:58:01.356104+0000","last_peered":"2023-12-19T13:58:01.356104+0000","last_clean":"2023-12-19T13:58:01.356104+0000","last_became_active":"2023-12-19T13:58:00.904953+0000","last_became_peered":"2023-12-19T13:58:00.904953+0000","last_unstale":"2023-12-19T13:58:01.356104+0000","last_undegraded":"2023-12-19T13:58:01.356104+0000","last_fullsized":"2023-12-19T13:58:01.356104+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:09.257373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.357845+0000","last_change":"2023-12-19T13:58:01.361975+0000","last_active":"2023-12-19T13:58:02.357845+0000","last_peered":"2023-12-19T13:58:02.357845+0000","last_clean":"2023-12-19T13:58:02.357845+0000","last_became_active":"2023-12-19T13:58:01.359906+0000","last_became_peered":"2023-12-19T13:58:01.359906+0000","last_unstale":"2023-12-19T13:58:02.357845+0000","last_undegraded":"2023-12-19T13:58:02.357845+0000","last_fullsized":"2023-12-19T13:58:02.357845+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:44.894301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.355556+0000","last_change":"2023-12-19T13:58:00.910039+0000","last_active":"2023-12-19T13:58:01.355556+0000","last_peered":"2023-12-19T13:58:01.355556+0000","last_clean":"2023-12-19T13:58:01.355556+0000","last_became_active":"2023-12-19T13:58:00.909856+0000","last_became_peered":"2023-12-19T13:58:00.909856+0000","last_unstale":"2023-12-19T13:58:01.355556+0000","last_undegraded":"2023-12-19T13:58:01.355556+0000","last_fullsized":"2023-12-19T13:58:01.355556+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:59.616044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621297+0000","last_change":"2023-12-19T13:58:01.359132+0000","last_active":"2023-12-19T13:58:02.621297+0000","last_peered":"2023-12-19T13:58:02.621297+0000","last_clean":"2023-12-19T13:58:02.621297+0000","last_became_active":"2023-12-19T13:58:01.358685+0000","last_became_peered":"2023-12-19T13:58:01.358685+0000","last_unstale":"2023-12-19T13:58:02.621297+0000","last_undegraded":"2023-12-19T13:58:02.621297+0000","last_fullsized":"2023-12-19T13:58:02.621297+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:47.183949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"177'2","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.359502+0000","last_change":"2023-12-19T13:58:00.900768+0000","last_active":"2023-12-19T13:58:01.359502+0000","last_peered":"2023-12-19T13:58:01.359502+0000","last_clean":"2023-12-19T13:58:01.359502+0000","last_became_active":"2023-12-19T13:58:00.900529+0000","last_became_peered":"2023-12-19T13:58:00.900529+0000","last_unstale":"2023-12-19T13:58:01.359502+0000","last_undegraded":"2023-12-19T13:58:01.359502+0000","last_fullsized":"2023-12-19T13:58:01.359502+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:03.449485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621434+0000","last_change":"2023-12-19T13:58:01.360489+0000","last_active":"2023-12-19T13:58:02.621434+0000","last_peered":"2023-12-19T13:58:02.621434+0000","last_clean":"2023-12-19T13:58:02.621434+0000","last_became_active":"2023-12-19T13:58:01.359898+0000","last_became_peered":"2023-12-19T13:58:01.359898+0000","last_unstale":"2023-12-19T13:58:02.621434+0000","last_undegraded":"2023-12-19T13:58:02.621434+0000","last_fullsized":"2023-12-19T13:58:02.621434+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:44.894301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.347988+0000","last_change":"2023-12-19T13:58:00.906633+0000","last_active":"2023-12-19T13:58:01.347988+0000","last_peered":"2023-12-19T13:58:01.347988+0000","last_clean":"2023-12-19T13:58:01.347988+0000","last_became_active":"2023-12-19T13:58:00.906320+0000","last_became_peered":"2023-12-19T13:58:00.906320+0000","last_unstale":"2023-12-19T13:58:01.347988+0000","last_undegraded":"2023-12-19T13:58:01.347988+0000","last_fullsized":"2023-12-19T13:58:01.347988+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:30.555190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.930825+0000","last_change":"2023-12-19T13:58:01.369949+0000","last_active":"2023-12-19T13:58:02.930825+0000","last_peered":"2023-12-19T13:58:02.930825+0000","last_clean":"2023-12-19T13:58:02.930825+0000","last_became_active":"2023-12-19T13:58:01.368442+0000","last_became_peered":"2023-12-19T13:58:01.368442+0000","last_unstale":"2023-12-19T13:58:02.930825+0000","last_undegraded":"2023-12-19T13:58:02.930825+0000","last_fullsized":"2023-12-19T13:58:02.930825+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:46:35.826929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.350882+0000","last_change":"2023-12-19T13:58:00.908779+0000","last_active":"2023-12-19T13:58:01.350882+0000","last_peered":"2023-12-19T13:58:01.350882+0000","last_clean":"2023-12-19T13:58:01.350882+0000","last_became_active":"2023-12-19T13:58:00.908048+0000","last_became_peered":"2023-12-19T13:58:00.908048+0000","last_unstale":"2023-12-19T13:58:01.350882+0000","last_undegraded":"2023-12-19T13:58:01.350882+0000","last_fullsized":"2023-12-19T13:58:01.350882+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.878363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929914+0000","last_change":"2023-12-19T13:58:01.369578+0000","last_active":"2023-12-19T13:58:02.929914+0000","last_peered":"2023-12-19T13:58:02.929914+0000","last_clean":"2023-12-19T13:58:02.929914+0000","last_became_active":"2023-12-19T13:58:01.368919+0000","last_became_peered":"2023-12-19T13:58:01.368919+0000","last_unstale":"2023-12-19T13:58:02.929914+0000","last_undegraded":"2023-12-19T13:58:02.929914+0000","last_fullsized":"2023-12-19T13:58:02.929914+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:42.696168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.350966+0000","last_change":"2023-12-19T13:58:00.909172+0000","last_active":"2023-12-19T13:58:01.350966+0000","last_peered":"2023-12-19T13:58:01.350966+0000","last_clean":"2023-12-19T13:58:01.350966+0000","last_became_active":"2023-12-19T13:58:00.908040+0000","last_became_peered":"2023-12-19T13:58:00.908040+0000","last_unstale":"2023-12-19T13:58:01.350966+0000","last_undegraded":"2023-12-19T13:58:01.350966+0000","last_fullsized":"2023-12-19T13:58:01.350966+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:18.797470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.929606+0000","last_change":"2023-12-19T13:58:01.363464+0000","last_active":"2023-12-19T13:58:02.929606+0000","last_peered":"2023-12-19T13:58:02.929606+0000","last_clean":"2023-12-19T13:58:02.929606+0000","last_became_active":"2023-12-19T13:58:01.363143+0000","last_became_peered":"2023-12-19T13:58:01.363143+0000","last_unstale":"2023-12-19T13:58:02.929606+0000","last_undegraded":"2023-12-19T13:58:02.929606+0000","last_fullsized":"2023-12-19T13:58:02.929606+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:06.013918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.353405+0000","last_change":"2023-12-19T13:58:00.899834+0000","last_active":"2023-12-19T13:58:01.353405+0000","last_peered":"2023-12-19T13:58:01.353405+0000","last_clean":"2023-12-19T13:58:01.353405+0000","last_became_active":"2023-12-19T13:58:00.899421+0000","last_became_peered":"2023-12-19T13:58:00.899421+0000","last_unstale":"2023-12-19T13:58:01.353405+0000","last_undegraded":"2023-12-19T13:58:01.353405+0000","last_fullsized":"2023-12-19T13:58:01.353405+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:59.616044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621376+0000","last_change":"2023-12-19T13:58:01.361236+0000","last_active":"2023-12-19T13:58:02.621376+0000","last_peered":"2023-12-19T13:58:02.621376+0000","last_clean":"2023-12-19T13:58:02.621376+0000","last_became_active":"2023-12-19T13:58:01.361024+0000","last_became_peered":"2023-12-19T13:58:01.361024+0000","last_unstale":"2023-12-19T13:58:02.621376+0000","last_undegraded":"2023-12-19T13:58:02.621376+0000","last_fullsized":"2023-12-19T13:58:02.621376+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:29.561314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.346423+0000","last_change":"2023-12-19T13:58:00.896619+0000","last_active":"2023-12-19T13:58:01.346423+0000","last_peered":"2023-12-19T13:58:01.346423+0000","last_clean":"2023-12-19T13:58:01.346423+0000","last_became_active":"2023-12-19T13:58:00.896106+0000","last_became_peered":"2023-12-19T13:58:00.896106+0000","last_unstale":"2023-12-19T13:58:01.346423+0000","last_undegraded":"2023-12-19T13:58:01.346423+0000","last_fullsized":"2023-12-19T13:58:01.346423+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:57:02.338063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.621279+0000","last_change":"2023-12-19T13:58:01.373371+0000","last_active":"2023-12-19T13:58:02.621279+0000","last_peered":"2023-12-19T13:58:02.621279+0000","last_clean":"2023-12-19T13:58:02.621279+0000","last_became_active":"2023-12-19T13:58:01.372836+0000","last_became_peered":"2023-12-19T13:58:01.372836+0000","last_unstale":"2023-12-19T13:58:02.621279+0000","last_undegraded":"2023-12-19T13:58:02.621279+0000","last_fullsized":"2023-12-19T13:58:02.621279+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:08:37.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.354049+0000","last_change":"2023-12-19T13:58:00.908086+0000","last_active":"2023-12-19T13:58:01.354049+0000","last_peered":"2023-12-19T13:58:01.354049+0000","last_clean":"2023-12-19T13:58:01.354049+0000","last_became_active":"2023-12-19T13:58:00.907822+0000","last_became_peered":"2023-12-19T13:58:00.907822+0000","last_unstale":"2023-12-19T13:58:01.354049+0000","last_undegraded":"2023-12-19T13:58:01.354049+0000","last_fullsized":"2023-12-19T13:58:01.354049+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:56.516367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.354188+0000","last_change":"2023-12-19T13:58:01.374042+0000","last_active":"2023-12-19T13:58:02.354188+0000","last_peered":"2023-12-19T13:58:02.354188+0000","last_clean":"2023-12-19T13:58:02.354188+0000","last_became_active":"2023-12-19T13:58:01.373828+0000","last_became_peered":"2023-12-19T13:58:01.373828+0000","last_unstale":"2023-12-19T13:58:02.354188+0000","last_undegraded":"2023-12-19T13:58:02.354188+0000","last_fullsized":"2023-12-19T13:58:02.354188+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:41:45.418668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.361831+0000","last_change":"2023-12-19T13:58:00.895973+0000","last_active":"2023-12-19T13:58:01.361831+0000","last_peered":"2023-12-19T13:58:01.361831+0000","last_clean":"2023-12-19T13:58:01.361831+0000","last_became_active":"2023-12-19T13:58:00.894370+0000","last_became_peered":"2023-12-19T13:58:00.894370+0000","last_unstale":"2023-12-19T13:58:01.361831+0000","last_undegraded":"2023-12-19T13:58:01.361831+0000","last_fullsized":"2023-12-19T13:58:01.361831+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:03:00.942467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-12-19T13:58:02.928653+0000","last_change":"2023-12-19T13:58:01.357194+0000","last_active":"2023-12-19T13:58:02.928653+0000","last_peered":"2023-12-19T13:58:02.928653+0000","last_clean":"2023-12-19T13:58:02.928653+0000","last_became_active":"2023-12-19T13:58:01.356677+0000","last_became_peered":"2023-12-19T13:58:01.356677+0000","last_unstale":"2023-12-19T13:58:02.928653+0000","last_undegraded":"2023-12-19T13:58:02.928653+0000","last_fullsized":"2023-12-19T13:58:02.928653+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:58:00.867723+0000","last_clean_scrub_stamp":"2023-12-19T13:58:00.867723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.066941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"177'3","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.364555+0000","last_change":"2023-12-19T13:58:00.908603+0000","last_active":"2023-12-19T13:58:01.364555+0000","last_peered":"2023-12-19T13:58:01.364555+0000","last_clean":"2023-12-19T13:58:01.364555+0000","last_became_active":"2023-12-19T13:58:00.908401+0000","last_became_peered":"2023-12-19T13:58:00.908401+0000","last_unstale":"2023-12-19T13:58:01.364555+0000","last_undegraded":"2023-12-19T13:58:01.364555+0000","last_fullsized":"2023-12-19T13:58:01.364555+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:57:59.862688+0000","last_clean_scrub_stamp":"2023-12-19T13:57:59.862688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:03:00.942467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":315,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-12-19T13:58:01.342923+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:58:01.342923+0000","last_peered":"2023-12-19T13:58:01.342923+0000","last_clean":"2023-12-19T13:58:01.342923+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:58:01.342923+0000","last_undegraded":"2023-12-19T13:58:01.342923+0000","last_fullsized":"2023-12-19T13:58:01.342923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194334,"statfs":{"total":200000000,"available":198998310,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.107,"15min":1.0649999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.53900000000000003},"max":{"1min":1.5700000000000001,"5min":1.7190000000000001,"15min":1.9059999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.141,"15min":1.0660000000000001},"min":{"1min":0.89600000000000002,"5min":0.64400000000000002,"15min":0.54400000000000004},"max":{"1min":1.855,"5min":1.855,"15min":2.008},"last":0.94799999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1599999999999999,"15min":1.1259999999999999},"min":{"1min":0.748,"5min":0.67000000000000004,"15min":0.59899999999999998},"max":{"1min":1.55,"5min":1.865,"15min":1.865},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.212,"15min":1.1180000000000001},"min":{"1min":0.81100000000000005,"5min":0.68400000000000005,"15min":0.497},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.034}]},{"osd":2,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1579999999999999,"15min":1.145},"min":{"1min":0.86599999999999999,"5min":0.71999999999999997,"15min":0.57499999999999996},"max":{"1min":1.5740000000000001,"5min":2.008,"15min":2.008},"last":1.173},{"interface":"front","average":{"1min":1.329,"5min":1.256,"15min":1.1990000000000001},"min":{"1min":1.002,"5min":0.84999999999999998,"15min":0.65700000000000003},"max":{"1min":1.6399999999999999,"5min":1.7689999999999999,"15min":1.8720000000000001},"last":0.878}]},{"osd":3,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.296,"15min":1.2210000000000001},"min":{"1min":1.056,"5min":0.74199999999999999,"15min":0.59099999999999997},"max":{"1min":1.589,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.345,"15min":1.294},"min":{"1min":1.1319999999999999,"5min":0.86499999999999999,"15min":0.65200000000000002},"max":{"1min":1.6990000000000001,"5min":1.9810000000000001,"15min":3.6150000000000002},"last":0.999}]},{"osd":4,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.331,"15min":1.2929999999999999},"min":{"1min":0.97399999999999998,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.6830000000000001,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.071},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.371,"15min":1.3740000000000001},"min":{"1min":1,"5min":0.70599999999999996,"15min":0.58499999999999996},"max":{"1min":1.6799999999999999,"5min":2.0859999999999999,"15min":2.6909999999999998},"last":1.1359999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3009999999999999,"15min":1.2569999999999999},"min":{"1min":0.91100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6379999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.468,"15min":1.4359999999999999},"min":{"1min":1.1739999999999999,"5min":0.82499999999999996,"15min":0.76500000000000001},"max":{"1min":1.746,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.516}]},{"osd":6,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.4650000000000001,"15min":1.3600000000000001},"min":{"1min":1.0680000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.7949999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.296},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.514},"min":{"1min":1.2210000000000001,"5min":0.95899999999999996,"15min":0.64800000000000002},"max":{"1min":1.7969999999999999,"5min":2.673,"15min":2.673},"last":1.448}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194334,"statfs":{"total":200000000,"available":198998310,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.131,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.59299999999999997,"15min":0.42699999999999999},"max":{"1min":1.663,"5min":1.663,"15min":2.0640000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.052,"5min":1.0620000000000001,"15min":1.093},"min":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.61199999999999999},"max":{"1min":1.363,"5min":1.605,"15min":3.2069999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.073,"15min":1.0549999999999999},"min":{"1min":0.83199999999999996,"5min":0.64900000000000002,"15min":0.59099999999999997},"max":{"1min":1.851,"5min":1.851,"15min":1.962},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.21,"15min":1.1220000000000001},"min":{"1min":0.83899999999999997,"5min":0.64300000000000002,"15min":0.63800000000000001},"max":{"1min":1.605,"5min":1.671,"15min":1.671},"last":0.77400000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.325,"15min":1.2649999999999999},"min":{"1min":0.90300000000000002,"5min":0.69999999999999996,"15min":0.59199999999999997},"max":{"1min":1.613,"5min":1.806,"15min":1.8180000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.202,"5min":1.2629999999999999,"15min":1.22},"min":{"1min":0.85199999999999998,"5min":0.70999999999999996,"15min":0.68100000000000005},"max":{"1min":1.46,"5min":1.7050000000000001,"15min":1.802},"last":1.0329999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2190000000000001,"15min":1.2809999999999999},"min":{"1min":0.74099999999999999,"5min":0.73699999999999999,"15min":0.73599999999999999},"max":{"1min":1.3720000000000001,"5min":1.665,"15min":4.2690000000000001},"last":1.181},{"interface":"front","average":{"1min":1.258,"5min":1.22,"15min":1.2450000000000001},"min":{"1min":0.91900000000000004,"5min":0.79700000000000004,"15min":0.67900000000000005},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":0.71299999999999997}]},{"osd":4,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.341,"15min":1.2769999999999999},"min":{"1min":0.70699999999999996,"5min":0.65700000000000003,"15min":0.47899999999999998},"max":{"1min":1.6659999999999999,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.159},{"interface":"front","average":{"1min":1.24,"5min":1.3200000000000001,"15min":1.323},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.613,"5min":1.849,"15min":1.895},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.3100000000000001,"15min":1.286},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.49,"15min":1.423},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":2.117,"5min":2.169,"15min":2.169},"last":1.0660000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.4510000000000001,"15min":1.4399999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.597,"5min":1.9570000000000001,"15min":2.5419999999999998},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.462,"15min":1.4119999999999999},"min":{"1min":0.92000000000000004,"5min":0.747,"15min":0.57999999999999996},"max":{"1min":1.889,"5min":2.141,"15min":2.141},"last":1.121}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1556,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193756,"statfs":{"total":200000000,"available":198406184,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.024},"min":{"1min":0.88700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.369,"5min":1.835,"15min":1.835},"last":1.05},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.145,"15min":1.1220000000000001},"min":{"1min":0.84299999999999997,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.5640000000000001,"5min":2.1429999999999998,"15min":5.4219999999999997},"last":1.2350000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.153,"15min":1.1359999999999999},"min":{"1min":0.92500000000000004,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.55,"5min":1.6839999999999999,"15min":6.101},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1779999999999999,"15min":1.109},"min":{"1min":0.77000000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4319999999999999,"5min":1.694,"15min":2.077},"last":0.79700000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.194,"15min":1.2330000000000001},"min":{"1min":0.93500000000000005,"5min":0.69799999999999995,"15min":0.64400000000000002},"max":{"1min":1.6739999999999999,"5min":1.8919999999999999,"15min":5.5350000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2010000000000001,"15min":1.242},"min":{"1min":0.89600000000000002,"5min":0.754,"15min":0.66400000000000003},"max":{"1min":1.593,"5min":1.6020000000000001,"15min":2.863},"last":0.97499999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":1.113,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6599999999999999,"5min":2.1880000000000002,"15min":5.6189999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3240000000000001,"15min":1.282},"min":{"1min":1.075,"5min":0.78300000000000003,"15min":0.69899999999999995},"max":{"1min":1.74,"5min":1.75,"15min":1.8360000000000001},"last":1.266}]},{"osd":4,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2729999999999999,"15min":1.2},"min":{"1min":0.83099999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.74,"5min":1.8919999999999999,"15min":1.982},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.373,"15min":1.343},"min":{"1min":1.018,"5min":0.70299999999999996,"15min":0.64100000000000001},"max":{"1min":1.764,"5min":2.0800000000000001,"15min":5.6970000000000001},"last":1.629}]},{"osd":6,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3720000000000001,"15min":1.351},"min":{"1min":1.0349999999999999,"5min":0.66000000000000003,"15min":0.623},"max":{"1min":1.919,"5min":1.919,"15min":2.0310000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4259999999999999,"15min":1.3839999999999999},"min":{"1min":0.91600000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8240000000000001,"5min":2.133,"15min":2.133},"last":1.4930000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:57:40 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.4810000000000001,"15min":1.458},"min":{"1min":1.1379999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.865,"5min":2.278,"15min":6.3959999999999999},"last":1.786},{"interface":"front","average":{"1min":1.522,"5min":1.5169999999999999,"15min":1.47},"min":{"1min":1.1890000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.855,"5min":2.1070000000000002,"15min":2.1819999999999999},"last":1.677}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":980,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194332,"statfs":{"total":200000000,"available":198996142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.105,"15min":1.0429999999999999},"min":{"1min":0.77500000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.242,"5min":1.1539999999999999,"15min":1.1279999999999999},"min":{"1min":0.91500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.4159999999999999,"5min":2.448,"15min":2.448},"last":1.403}]},{"osd":1,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.163,"15min":1.1000000000000001},"min":{"1min":0.80500000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6890000000000001,"5min":1.754,"15min":1.754},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1679999999999999,"15min":1.1339999999999999},"min":{"1min":0.97699999999999998,"5min":0.73399999999999999,"15min":0.50700000000000001},"max":{"1min":1.8939999999999999,"5min":3.117,"15min":3.117},"last":1.056}]},{"osd":2,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2010000000000001,"15min":1.1140000000000001},"min":{"1min":0.88500000000000001,"5min":0.71999999999999997,"15min":0.629},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2430000000000001,"15min":1.173},"min":{"1min":0.98599999999999999,"5min":0.76600000000000001,"15min":0.68000000000000005},"max":{"1min":1.603,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.2150000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.29,"15min":1.2410000000000001},"min":{"1min":1.0249999999999999,"5min":0.72999999999999998,"15min":0.57599999999999996},"max":{"1min":2.524,"5min":2.653,"15min":2.653},"last":1.611},{"interface":"front","average":{"1min":1.345,"5min":1.3260000000000001,"15min":1.298},"min":{"1min":1.036,"5min":0.82799999999999996,"15min":0.66500000000000004},"max":{"1min":1.8540000000000001,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.1100000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.244,"15min":1.242},"min":{"1min":0.89900000000000002,"5min":0.58299999999999996,"15min":0.51700000000000002},"max":{"1min":3.145,"5min":3.625,"15min":3.625},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.3280000000000001,"15min":1.3340000000000001},"min":{"1min":0.83699999999999997,"5min":0.60499999999999998,"15min":0.58399999999999996},"max":{"1min":2.6989999999999998,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.504}]},{"osd":6,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3660000000000001,"15min":1.377},"min":{"1min":0.96499999999999997,"5min":0.65000000000000002,"15min":0.55900000000000005},"max":{"1min":1.9470000000000001,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.4059999999999999,"15min":1.4279999999999999},"min":{"1min":1.196,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.0299999999999998,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.5620000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:57:41 2023","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":1.548,"15min":1.494},"min":{"1min":1.073,"5min":0.78400000000000003,"15min":0.65500000000000003},"max":{"1min":2.8109999999999999,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.573,"15min":1.542},"min":{"1min":0.98199999999999998,"5min":0.74199999999999999,"15min":0.59999999999999998},"max":{"1min":2.194,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.5409999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194333,"statfs":{"total":200000000,"available":198997694,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.85999999999999999},"min":{"1min":0.56299999999999994,"5min":0.249,"15min":0.249},"max":{"1min":1.3799999999999999,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.90300000000000002,"15min":0.93000000000000005},"min":{"1min":0.63400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.347,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":1.0309999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.84499999999999997,"15min":0.91000000000000003},"min":{"1min":0.67300000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.25,"5min":1.413,"15min":5.3769999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.94999999999999996,"15min":0.96099999999999997},"min":{"1min":0.75600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.573,"5min":1.573,"15min":2.387},"last":0.82199999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.96999999999999997,"15min":1.004},"min":{"1min":0.71899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.569,"5min":1.569,"15min":2.9399999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.0429999999999999,"15min":1.071},"min":{"1min":0.80900000000000005,"5min":0.433,"15min":0.39200000000000002},"max":{"1min":1.5940000000000001,"5min":1.722,"15min":2.657},"last":1.254}]},{"osd":4,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.92600000000000005,"5min":0.65700000000000003,"15min":0.48299999999999998},"max":{"1min":1.5720000000000001,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":1.383},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2430000000000001,"15min":1.2330000000000001},"min":{"1min":1.0329999999999999,"5min":0.626,"15min":0.54600000000000004},"max":{"1min":1.5389999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.5669999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.258,"15min":1.2749999999999999},"min":{"1min":1.0049999999999999,"5min":0.66900000000000004,"15min":0.58299999999999996},"max":{"1min":1.6060000000000001,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.2509999999999999,"15min":1.25},"min":{"1min":1.071,"5min":0.72599999999999998,"15min":0.66700000000000004},"max":{"1min":1.657,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.2310000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2809999999999999,"15min":1.2849999999999999},"min":{"1min":1.0469999999999999,"5min":0.59299999999999997,"15min":0.53300000000000003},"max":{"1min":1.7769999999999999,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.3300000000000001,"15min":1.3320000000000001},"min":{"1min":1.147,"5min":0.746,"15min":0.52600000000000002},"max":{"1min":1.7390000000000001,"5min":2.077,"15min":2.698},"last":1.4199999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.3300000000000001,"15min":1.3420000000000001},"min":{"1min":1.056,"5min":0.73399999999999999,"15min":0.51500000000000001},"max":{"1min":1.72,"5min":2.1160000000000001,"15min":3.609},"last":1.361},{"interface":"front","average":{"1min":1.407,"5min":1.3759999999999999,"15min":1.3839999999999999},"min":{"1min":1.141,"5min":0.69299999999999995,"15min":0.58699999999999997},"max":{"1min":1.704,"5min":1.9370000000000001,"15min":3.0379999999999998},"last":1.659}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194334,"statfs":{"total":200000000,"available":198998288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.82899999999999996,"15min":0.82799999999999996},"min":{"1min":0.65100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3360000000000001,"5min":1.4550000000000001,"15min":2.258},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.90200000000000002,"15min":0.88900000000000001},"min":{"1min":0.55500000000000005,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.377,"5min":1.542,"15min":11.85},"last":1.2509999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.91400000000000003,"15min":0.872},"min":{"1min":0.66900000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.738,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.0369999999999999,"15min":1.0009999999999999},"min":{"1min":0.81599999999999995,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":1.4770000000000001,"5min":4.681,"15min":11.788},"last":1.1679999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0169999999999999,"15min":0.97399999999999998},"min":{"1min":0.90300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4730000000000001,"5min":1.702,"15min":2.3109999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1060000000000001,"15min":1.0669999999999999},"min":{"1min":0.84299999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.4299999999999999,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":1.4199999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.99099999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.631,"5min":1.631,"15min":11.930999999999999},"last":1.022},{"interface":"front","average":{"1min":1.274,"5min":1.194,"15min":1.212},"min":{"1min":1.081,"5min":0.72399999999999998,"15min":0.72299999999999998},"max":{"1min":1.488,"5min":1.806,"15min":2.2189999999999999},"last":1.109}]},{"osd":5,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3160000000000001,"15min":1.302},"min":{"1min":1.1120000000000001,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.6379999999999999,"5min":1.7170000000000001,"15min":11.888},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":1.038,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.698,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.298}]},{"osd":6,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3420000000000001,"15min":1.3169999999999999},"min":{"1min":1.024,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.679,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.327,"15min":1.292},"min":{"1min":1.1659999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7929999999999999,"5min":1.9370000000000001,"15min":2.286},"last":1.3919999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:57:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3919999999999999,"15min":1.3440000000000001},"min":{"1min":1.085,"5min":0.77900000000000003,"15min":0.75600000000000001},"max":{"1min":1.8440000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.357},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.353,"15min":1.3420000000000001},"min":{"1min":1.1819999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7110000000000001,"5min":2.323,"15min":11.962999999999999},"last":1.3440000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193757,"statfs":{"total":200000000,"available":198407872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.79000000000000004},"min":{"1min":0.65200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.28,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":1.081},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.92000000000000004,"15min":0.94499999999999995},"min":{"1min":0.747,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":1.595,"5min":1.6639999999999999,"15min":3.3500000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.92800000000000005,"15min":0.998},"min":{"1min":0.77900000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4830000000000001,"5min":1.4910000000000001,"15min":5.2999999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.0940000000000001,"15min":1.1419999999999999},"min":{"1min":0.83399999999999996,"5min":0.48599999999999999,"15min":0.45800000000000002},"max":{"1min":1.45,"5min":1.619,"15min":5.2009999999999996},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.024,"15min":1.0580000000000001},"min":{"1min":0.80100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.665,"5min":1.7,"15min":3.4300000000000002},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0149999999999999,"15min":1.0920000000000001},"min":{"1min":0.877,"5min":0.47599999999999998,"15min":0.36899999999999999},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.157},"last":1.0029999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1739999999999999,"15min":1.1970000000000001},"min":{"1min":1.002,"5min":0.64400000000000002,"15min":0.61699999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":4.0179999999999998},"last":1.202},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.252,"15min":1.278},"min":{"1min":1.0580000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6599999999999999,"5min":1.7490000000000001,"15min":3.7080000000000002},"last":1.4330000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2170000000000001,"15min":1.2749999999999999},"min":{"1min":1.0449999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.796,"5min":1.796,"15min":3.8849999999999998},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.258,"15min":1.341},"min":{"1min":1.167,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.571,"5min":1.6040000000000001,"15min":15.576000000000001},"last":1.123}]},{"osd":6,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3120000000000001,"15min":1.337},"min":{"1min":1.153,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.849,"5min":1.849,"15min":4.0919999999999996},"last":1.623},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.337,"15min":1.373},"min":{"1min":1.137,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":3.786},"last":1.54}]},{"osd":7,"last update":"Tue Dec 19 13:57:34 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.373,"15min":1.4119999999999999},"min":{"1min":1.105,"5min":0.80900000000000005,"15min":0.78400000000000003},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":3.8159999999999998},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.3240000000000001,"15min":1.3879999999999999},"min":{"1min":1.024,"5min":0.78800000000000003,"15min":0.76500000000000001},"max":{"1min":2.032,"5min":2.032,"15min":4.0519999999999996},"last":1.3899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194334,"statfs":{"total":200000000,"available":198998220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82699999999999996,"15min":0.78800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.28299999999999997},"max":{"1min":1.4339999999999999,"5min":1.639,"15min":1.6399999999999999},"last":0.877},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93500000000000005,"15min":0.96299999999999997},"min":{"1min":0.60799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":1.351}]},{"osd":2,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94199999999999995,"15min":1.0289999999999999},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.6379999999999999,"5min":1.8149999999999999,"15min":33.799999999999997},"last":1.286},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0069999999999999,"15min":1.1319999999999999},"min":{"1min":0.56799999999999995,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.526,"5min":1.708,"15min":41.758000000000003},"last":1.1930000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92400000000000004,"15min":0.95799999999999996},"min":{"1min":0.47999999999999998,"5min":0.42099999999999999,"15min":0.35099999999999998},"max":{"1min":1.401,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.079,"5min":1.0780000000000001,"15min":1.0900000000000001},"min":{"1min":0.58799999999999997,"5min":0.47699999999999998,"15min":0.36499999999999999},"max":{"1min":1.347,"5min":1.9470000000000001,"15min":2.02},"last":0.99299999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.78300000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.488,"5min":1.679,"15min":4.4269999999999996},"last":1.23},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.262,"15min":1.2689999999999999},"min":{"1min":1.1259999999999999,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.5960000000000001,"5min":1.8700000000000001,"15min":15.766},"last":1.444}]},{"osd":5,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2430000000000001,"15min":1.262},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.659,"5min":1.77,"15min":14.337999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.232,"15min":1.2629999999999999},"min":{"1min":0.877,"5min":0.747,"15min":0.63100000000000001},"max":{"1min":1.5389999999999999,"5min":1.6919999999999999,"15min":4.3970000000000002},"last":1.333}]},{"osd":6,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3620000000000001,"15min":1.3240000000000001},"min":{"1min":1.1020000000000001,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":1.5720000000000001,"5min":1.9470000000000001,"15min":5.4669999999999996},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.347,"15min":1.3720000000000001},"min":{"1min":0.93700000000000006,"5min":0.78200000000000003,"15min":0.65100000000000002},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":17.161000000000001},"last":1.538}]},{"osd":7,"last update":"Tue Dec 19 13:57:50 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3740000000000001,"15min":1.3799999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":1.974,"5min":1.974,"15min":14.381},"last":1.486},{"interface":"front","average":{"1min":1.24,"5min":1.28,"15min":1.3640000000000001},"min":{"1min":0.875,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":1.488,"5min":2.1230000000000002,"15min":9.7080000000000002},"last":1.385}]}]}],"pool_statfs":[]}} 2023-12-19T13:58:06.735 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:58:06.735 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:58:06.793 INFO:tasks.ceph.mds.a.smithi113.stderr:2023-12-19T13:58:06.793+0000 7f25f3355640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:58:06.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.998+0000 7f121a241640 1 Processor -- start 2023-12-19T13:58:06.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:06.998+0000 7f121a241640 1 -- start start 2023-12-19T13:58:07.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.000+0000 7f121a241640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12140b8500 0x7f12140d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.000+0000 7f121a241640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f121415da00 0x7f121406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.000+0000 7f121a241640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f12140659d0 0x7f1214065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.000+0000 7f121a241640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140663c0 con 0x7f12140b8500 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.000+0000 7f121a241640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140b88e0 con 0x7f12140659d0 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.000+0000 7f121a241640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121415df50 con 0x7f121415da00 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.000+0000 7f12137fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12140b8500 0x7f12140d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.001+0000 7f12137fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12140b8500 0x7f12140d4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54162/0 (socket says 172.21.15.113:54162) 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.001+0000 7f12137fe640 1 -- 172.21.15.113:0/4214560881 learned_addr learned my addr 172.21.15.113:0/4214560881 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:07.001 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.001+0000 7f12137fe640 1 -- 172.21.15.113:0/4214560881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f121415da00 msgr2=0x7f121406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.001+0000 7f12137fe640 1 --2- 172.21.15.113:0/4214560881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f121415da00 0x7f121406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.001+0000 7f12137fe640 1 -- 172.21.15.113:0/4214560881 >> v2:172.21.15.151:3300/0 conn(0x7f12140659d0 msgr2=0x7f1214065e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.001+0000 7f12137fe640 1 --2- 172.21.15.113:0/4214560881 >> v2:172.21.15.151:3300/0 conn(0x7f12140659d0 0x7f1214065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.001+0000 7f12137fe640 1 -- 172.21.15.113:0/4214560881 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121415e230 con 0x7f12140b8500 2023-12-19T13:58:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.002+0000 7f12137fe640 1 --2- 172.21.15.113:0/4214560881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12140d4050 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f12140b19a0 tx=0x7f120402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f4e6cff2e7d676 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:07.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.002+0000 7f1212ffd640 1 -- 172.21.15.113:0/4214560881 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12040317e0 con 0x7f12140b8500 2023-12-19T13:58:07.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.002+0000 7f1212ffd640 1 -- 172.21.15.113:0/4214560881 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204031940 con 0x7f12140b8500 2023-12-19T13:58:07.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.002+0000 7f1212ffd640 1 -- 172.21.15.113:0/4214560881 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204031cd0 con 0x7f12140b8500 2023-12-19T13:58:07.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 -- 172.21.15.113:0/4214560881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 msgr2=0x7f12140d4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.003 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 --2- 172.21.15.113:0/4214560881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12140d4050 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f12140b19a0 tx=0x7f120402b880 comp rx=0 tx=0).stop 2023-12-19T13:58:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 -- 172.21.15.113:0/4214560881 shutdown_connections 2023-12-19T13:58:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 --2- 172.21.15.113:0/4214560881 >> v2:172.21.15.151:3300/0 conn(0x7f12140659d0 0x7f1214065e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 --2- 172.21.15.113:0/4214560881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f121415da00 0x7f121406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 --2- 172.21.15.113:0/4214560881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12140d4050 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 -- 172.21.15.113:0/4214560881 >> 172.21.15.113:0/4214560881 conn(0x7f12140b4120 msgr2=0x7f12140b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 -- 172.21.15.113:0/4214560881 shutdown_connections 2023-12-19T13:58:07.004 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.003+0000 7f121a241640 1 -- 172.21.15.113:0/4214560881 wait complete. 2023-12-19T13:58:07.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.005+0000 7f121a241640 1 Processor -- start 2023-12-19T13:58:07.005 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.005+0000 7f121a241640 1 -- start start 2023-12-19T13:58:07.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f121a241640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12140659d0 0x7f121415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f121a241640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12141f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f121a241640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f121415da00 0x7f121415fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.006 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f121a241640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121415d300 con 0x7f12140b8500 2023-12-19T13:58:07.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f121a241640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121415a050 con 0x7f121415da00 2023-12-19T13:58:07.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f121a241640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121415a610 con 0x7f12140659d0 2023-12-19T13:58:07.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f120bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12141f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f120bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12141f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54172/0 (socket says 172.21.15.113:54172) 2023-12-19T13:58:07.007 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.006+0000 7f120bfff640 1 -- 172.21.15.113:0/2382312783 learned_addr learned my addr 172.21.15.113:0/2382312783 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:07.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f1213fff640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f121415da00 0x7f121415fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f12137fe640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12140659d0 0x7f121415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f120bfff640 1 -- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12140659d0 msgr2=0x7f121415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.008 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f120bfff640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12140659d0 0x7f121415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f120bfff640 1 -- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f121415da00 msgr2=0x7f121415fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f120bfff640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f121415da00 0x7f121415fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f120bfff640 1 -- 172.21.15.113:0/2382312783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12040094d0 con 0x7f12140b8500 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f1213fff640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f121415da00 0x7f121415fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f12137fe640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12140659d0 0x7f121415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f120bfff640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12141f6570 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00b480 tx=0x7f11fc00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.007+0000 7f1210ff9640 1 -- 172.21.15.113:0/2382312783 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc010870 con 0x7f12140b8500 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.008+0000 7f1210ff9640 1 -- 172.21.15.113:0/2382312783 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc0109d0 con 0x7f12140b8500 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.008+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1214147070 con 0x7f12140b8500 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.008+0000 7f1210ff9640 1 -- 172.21.15.113:0/2382312783 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc010d80 con 0x7f12140b8500 2023-12-19T13:58:07.009 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.008+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12141f7310 con 0x7f12140b8500 2023-12-19T13:58:07.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.009+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1214061910 con 0x7f12140b8500 2023-12-19T13:58:07.010 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.010+0000 7f1210ff9640 1 -- 172.21.15.113:0/2382312783 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f11fc00f3c0 con 0x7f12140b8500 2023-12-19T13:58:07.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.011+0000 7f1210ff9640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f11f406a430 0x7f11f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.011+0000 7f1210ff9640 1 -- 172.21.15.113:0/2382312783 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11fc088970 con 0x7f12140b8500 2023-12-19T13:58:07.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.011+0000 7f12137fe640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f11f406a430 0x7f11f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.011 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.012+0000 7f12137fe640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f11f406a430 0x7f11f406c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1204036000 tx=0x7f120403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:07.015 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.015+0000 7f1210ff9640 1 -- 172.21.15.113:0/2382312783 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f11fc053f50 con 0x7f12140b8500 2023-12-19T13:58:07.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.273+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f12140d3910 con 0x7f12140b8500 2023-12-19T13:58:07.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.281+0000 7f1210ff9640 1 -- 172.21.15.113:0/2382312783 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f11fc0140e0 con 0x7f12140b8500 2023-12-19T13:58:07.282 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:58:07.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f11f406a430 msgr2=0x7f11f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f11f406a430 0x7f11f406c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1204036000 tx=0x7f120403d040 comp rx=0 tx=0).stop 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 msgr2=0x7f12141f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12141f6570 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00b480 tx=0x7f11fc00b940 comp rx=0 tx=0).stop 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 shutdown_connections 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f11f406a430 0x7f11f406c8f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f121415da00 0x7f121415fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12140b8500 0x7f12141f6570 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 --2- 172.21.15.113:0/2382312783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12140659d0 0x7f121415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 >> 172.21.15.113:0/2382312783 conn(0x7f12140b4120 msgr2=0x7f12140b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 shutdown_connections 2023-12-19T13:58:07.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.284+0000 7f121a241640 1 -- 172.21.15.113:0/2382312783 wait complete. 2023-12-19T13:58:07.300 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:58:07.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.558+0000 7fba0759e640 1 Processor -- start 2023-12-19T13:58:07.558 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.558+0000 7fba0759e640 1 -- start start 2023-12-19T13:58:07.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.559+0000 7fba0759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba080b2030 0x7fba0815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.559+0000 7fba0759e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0815ec30 con 0x7fba0815e5a0 2023-12-19T13:58:07.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0815fbc0 con 0x7fba080cdbf0 2023-12-19T13:58:07.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0815e980 con 0x7fba080b2030 2023-12-19T13:58:07.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fba0815e5a0 0x7fba080b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37924/0 (socket says 172.21.15.113:37924) 2023-12-19T13:58:07.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0659c640 1 -- 172.21.15.113:0/3041344580 learned_addr learned my addr 172.21.15.113:0/3041344580 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443028755 0 0) 0x7fba0815ec30 con 0x7fba0815e5a0 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f4003520 con 0x7fba0815e5a0 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba05d9b640 1 --2- 172.21.15.113:0/3041344580 >> v2:172.21.15.151:3300/0 conn(0x7fba080b2030 0x7fba0815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3966571044 0 0) 0x7fb9f4003520 con 0x7fba0815e5a0 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 >> v2:172.21.15.151:3300/0 conn(0x7fba080b2030 msgr2=0x7fba0815f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 --2- 172.21.15.113:0/3041344580 >> v2:172.21.15.151:3300/0 conn(0x7fba080b2030 0x7fba0815f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 >> v1:172.21.15.151:6789/0 conn(0x7fba080cdbf0 legacy=0x7fba0806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba080b2f90 con 0x7fba0815e5a0 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.560+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb9f8001670 con 0x7fba0815e5a0 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 >> v1:172.21.15.113:6789/0 conn(0x7fba0815e5a0 legacy=0x7fba080b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba0559a640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9f40039a0 0x7fb9f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba0559a640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fb9f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba0559a640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f40051d0 0x7fb9f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0815e980 con 0x7fb9f40047c0 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f400c100 con 0x7fb9f40051d0 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f400c2c0 con 0x7fb9f40039a0 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba05d9b640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fb9f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba05d9b640 1 -- 172.21.15.113:0/3041344580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9f40039a0 msgr2=0x7fb9f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba06d9d640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f40051d0 0x7fb9f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba05d9b640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9f40039a0 0x7fb9f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba05d9b640 1 -- 172.21.15.113:0/3041344580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f40051d0 msgr2=0x7fb9f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba05d9b640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f40051d0 0x7fb9f400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba05d9b640 1 -- 172.21.15.113:0/3041344580 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4003520 con 0x7fb9f40047c0 2023-12-19T13:58:07.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.561+0000 7fba06d9d640 1 -- 172.21.15.113:0/3041344580 reap_dead start 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.562+0000 7fba05d9b640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fb9f4004c40 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0007360 tx=0x7fb9f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4638da64e431dd2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f002ccd0 con 0x7fb9f40047c0 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f002ce30 con 0x7fb9f40047c0 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0559a640 1 -- 172.21.15.113:0/3041344580 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0034660 con 0x7fb9f40047c0 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0759e640 1 -- 172.21.15.113:0/3041344580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 msgr2=0x7fb9f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0759e640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fb9f4004c40 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0007360 tx=0x7fb9f40057f0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0759e640 1 -- 172.21.15.113:0/3041344580 shutdown_connections 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0759e640 1 --2- 172.21.15.113:0/3041344580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fb9f4004c40 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.563+0000 7fba0759e640 1 -- 172.21.15.113:0/3041344580 >> 172.21.15.113:0/3041344580 conn(0x7fba080b0100 msgr2=0x7fba080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.564+0000 7fba0759e640 1 -- 172.21.15.113:0/3041344580 shutdown_connections 2023-12-19T13:58:07.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.564+0000 7fba0759e640 1 -- 172.21.15.113:0/3041344580 wait complete. 2023-12-19T13:58:07.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.565+0000 7fba0759e640 1 Processor -- start 2023-12-19T13:58:07.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.565+0000 7fba0759e640 1 -- start start 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.566+0000 7fba0759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fba081569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.566+0000 7fba0759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08159d20 0x7fba0815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.566+0000 7fba0759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba080af200 0x7fba080af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.566+0000 7fba0759e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0815a6e0 con 0x7fb9f40047c0 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.566+0000 7fba0759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba080afbc0 con 0x7fba080af200 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.566+0000 7fba0759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba081574a0 con 0x7fba08159d20 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fba081569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fba081569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54198/0 (socket says 172.21.15.113:54198) 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 -- 172.21.15.113:0/1644558802 learned_addr learned my addr 172.21.15.113:0/1644558802 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 -- 172.21.15.113:0/1644558802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08159d20 msgr2=0x7fba0815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba05d9b640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08159d20 0x7fba0815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08159d20 0x7fba0815a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 -- 172.21.15.113:0/1644558802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba080af200 msgr2=0x7fba080af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba080af200 0x7fba080af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 -- 172.21.15.113:0/1644558802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08156f20 con 0x7fb9f40047c0 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.567+0000 7fba0659c640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fba081569e0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8001eb0 tx=0x7fb9f800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.568+0000 7fb9feffd640 1 -- 172.21.15.113:0/1644558802 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80074e0 con 0x7fb9f40047c0 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.568+0000 7fb9feffd640 1 -- 172.21.15.113:0/1644558802 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8007640 con 0x7fb9f40047c0 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.568+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0815a900 con 0x7fb9f40047c0 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.568+0000 7fb9feffd640 1 -- 172.21.15.113:0/1644558802 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8004a00 con 0x7fb9f40047c0 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.568+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0815b600 con 0x7fb9f40047c0 2023-12-19T13:58:07.569 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.569+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba08061910 con 0x7fb9f40047c0 2023-12-19T13:58:07.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.570+0000 7fb9feffd640 1 -- 172.21.15.113:0/1644558802 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9f8004b60 con 0x7fb9f40047c0 2023-12-19T13:58:07.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.571+0000 7fb9feffd640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9e806a430 0x7fb9e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:07.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.571+0000 7fb9feffd640 1 -- 172.21.15.113:0/1644558802 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9f8088190 con 0x7fb9f40047c0 2023-12-19T13:58:07.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.571+0000 7fba05d9b640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9e806a430 0x7fb9e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:07.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.572+0000 7fba05d9b640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9e806a430 0x7fb9e806c8f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0036000 tx=0x7fb9f0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:07.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.575+0000 7fb9feffd640 1 -- 172.21.15.113:0/1644558802 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9f8053780 con 0x7fb9f40047c0 2023-12-19T13:58:07.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.800+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba080ce570 con 0x7fb9f40047c0 2023-12-19T13:58:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.802+0000 7fb9feffd640 1 -- 172.21.15.113:0/1644558802 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4664 (secure 0 0 0) 0x7fb9f8056da0 con 0x7fb9f40047c0 2023-12-19T13:58:07.802 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:07.802 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:58:01.335603+0000","modified":"2023-12-19T13:58:04.828919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/2910539170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2910539170},{"type":"v1","addr":"172.21.15.113:6837","nonce":2910539170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T13:58:07.802 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 80 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.804+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9e806a430 msgr2=0x7fb9e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.804+0000 7fba0759e640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9e806a430 0x7fb9e806c8f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0036000 tx=0x7fb9f0030000 comp rx=0 tx=0).stop 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.804+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 msgr2=0x7fba081569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.804+0000 7fba0759e640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fba081569e0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8001eb0 tx=0x7fb9f800cc00 comp rx=0 tx=0).stop 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.804+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 shutdown_connections 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.804+0000 7fba0759e640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb9e806a430 0x7fb9e806c8f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.804+0000 7fba0759e640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba080af200 0x7fba080af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.805+0000 7fba0759e640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba08159d20 0x7fba0815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.805+0000 7fba0759e640 1 --2- 172.21.15.113:0/1644558802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb9f40047c0 0x7fba081569e0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:07.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.805+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 >> 172.21.15.113:0/1644558802 conn(0x7fba080b0100 msgr2=0x7fba080ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:07.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.805+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 shutdown_connections 2023-12-19T13:58:07.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:07.805+0000 7fba0759e640 1 -- 172.21.15.113:0/1644558802 wait complete. 2023-12-19T13:58:08.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:58:01.335603+0000', 'modified': '2023-12-19T13:58:04.828919+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8664}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8664': {'gid': 8664, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.113:6837/2910539170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6836', 'nonce': 2910539170}, {'type': 'v1', 'addr': '172.21.15.113:6837', 'nonce': 2910539170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:58:08.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:58:08.226 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T13:58:08.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.443+0000 7fc6d15b9640 1 Processor -- start 2023-12-19T13:58:08.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.443+0000 7fc6d15b9640 1 -- start start 2023-12-19T13:58:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.445+0000 7fc6d15b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc157bf0 0x7fc6cc15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.445+0000 7fc6d15b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6cc0b0810 0x7fc6cc06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.445+0000 7fc6d15b9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc15b740 con 0x7fc6cc0ae110 2023-12-19T13:58:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.445+0000 7fc6d15b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc06b8c0 con 0x7fc6cc0b0810 2023-12-19T13:58:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.445+0000 7fc6d15b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0ae640 con 0x7fc6cc157bf0 2023-12-19T13:58:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.445+0000 7fc6ca7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc6cc0ae110 0x7fc6cc0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:56208/0 (socket says 172.21.15.113:56208) 2023-12-19T13:58:08.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.445+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/1483533755 learned_addr learned my addr 172.21.15.113:0/1483533755 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:58:08.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc157bf0 0x7fc6cc15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091225178 0 0) 0x7fc6cc15b740 con 0x7fc6cc0ae110 2023-12-19T13:58:08.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6cb7fe640 1 --2- 172.21.15.113:0/1483533755 >> v2:172.21.15.151:3300/0 conn(0x7fc6cc0b0810 0x7fc6cc06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b4003520 con 0x7fc6cc0ae110 2023-12-19T13:58:08.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 560170937 0 0) 0x7fc6b4003520 con 0x7fc6cc0ae110 2023-12-19T13:58:08.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc157bf0 msgr2=0x7fc6cc15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc157bf0 0x7fc6cc15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 >> v2:172.21.15.151:3300/0 conn(0x7fc6cc0b0810 msgr2=0x7fc6cc06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 --2- 172.21.15.113:0/1483533755 >> v2:172.21.15.151:3300/0 conn(0x7fc6cc0b0810 0x7fc6cc06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0ae920 con 0x7fc6cc0ae110 2023-12-19T13:58:08.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc6c0001670 con 0x7fc6cc0ae110 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 >> v1:172.21.15.113:6789/0 conn(0x7fc6cc0ae110 legacy=0x7fc6cc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b40047c0 0x7fc6b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc157bf0 0x7fc6b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc06b8c0 con 0x7fc6b40039e0 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0ae640 con 0x7fc6b40047c0 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b400ba00 con 0x7fc6cc157bf0 2023-12-19T13:58:08.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6cb7fe640 1 --2- 172.21.15.113:0/1483533755 >> v2:172.21.15.151:3300/0 conn(0x7fc6cc0b0810 0x7fc6cc06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:58:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.446+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.447+0000 7fc6caffd640 1 -- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc157bf0 msgr2=0x7fc6b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.447+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc157bf0 0x7fc6b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.447+0000 7fc6caffd640 1 -- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b40047c0 msgr2=0x7fc6b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.447+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b40047c0 0x7fc6b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.447+0000 7fc6caffd640 1 -- 172.21.15.113:0/1483533755 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4003520 con 0x7fc6b40039e0 2023-12-19T13:58:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.448+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6b4003e00 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009650 tx=0x7fc6b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb0e6106703759 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.448+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc02e920 con 0x7fc6b40039e0 2023-12-19T13:58:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.448+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc02ea80 con 0x7fc6b40039e0 2023-12-19T13:58:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.448+0000 7fc6c9ffb640 1 -- 172.21.15.113:0/1483533755 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc02ee10 con 0x7fc6b40039e0 2023-12-19T13:58:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.449+0000 7fc6d15b9640 1 -- 172.21.15.113:0/1483533755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 msgr2=0x7fc6b4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.449+0000 7fc6d15b9640 1 --2- 172.21.15.113:0/1483533755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6b4003e00 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009650 tx=0x7fc6b40057f0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.451 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.449+0000 7fc6cb7fe640 1 -- 172.21.15.113:0/1483533755 reap_dead start 2023-12-19T13:58:08.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.449+0000 7fc6d15b9640 1 -- 172.21.15.113:0/1483533755 shutdown_connections 2023-12-19T13:58:08.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.449+0000 7fc6d15b9640 1 -- 172.21.15.113:0/1483533755 >> 172.21.15.113:0/1483533755 conn(0x7fc6cc0cbb70 msgr2=0x7fc6cc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.449+0000 7fc6d15b9640 1 -- 172.21.15.113:0/1483533755 shutdown_connections 2023-12-19T13:58:08.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.449+0000 7fc6d15b9640 1 -- 172.21.15.113:0/1483533755 wait complete. 2023-12-19T13:58:08.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.451+0000 7fc6d15b9640 1 Processor -- start 2023-12-19T13:58:08.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.451+0000 7fc6d15b9640 1 -- start start 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6d15b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6cc151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6d15b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc144a00 0x7fc6cc15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6d15b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc15ceb0 0x7fc6cc159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6d15b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc15d330 con 0x7fc6b40039e0 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6d15b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc151b60 con 0x7fc6cc15ceb0 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6d15b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc150f50 con 0x7fc6cc144a00 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6cc151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6cc151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43662/0 (socket says 172.21.15.113:43662) 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 -- 172.21.15.113:0/4000639185 learned_addr learned my addr 172.21.15.113:0/4000639185 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 -- 172.21.15.113:0/4000639185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc144a00 msgr2=0x7fc6cc15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc144a00 0x7fc6cc15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 -- 172.21.15.113:0/4000639185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc15ceb0 msgr2=0x7fc6cc159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc15ceb0 0x7fc6cc159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.452+0000 7fc6caffd640 1 -- 172.21.15.113:0/4000639185 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc151230 con 0x7fc6b40039e0 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.453+0000 7fc6caffd640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6cc151ff0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc039040 tx=0x7fc6bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.453+0000 7fc6b37fe640 1 -- 172.21.15.113:0/4000639185 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc003810 con 0x7fc6b40039e0 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.453+0000 7fc6b37fe640 1 -- 172.21.15.113:0/4000639185 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc003970 con 0x7fc6b40039e0 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.453+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc151510 con 0x7fc6b40039e0 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.453+0000 7fc6b37fe640 1 -- 172.21.15.113:0/4000639185 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc003d00 con 0x7fc6b40039e0 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.453+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc152530 con 0x7fc6b40039e0 2023-12-19T13:58:08.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.455+0000 7fc6b37fe640 1 -- 172.21.15.113:0/4000639185 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6bc03d070 con 0x7fc6b40039e0 2023-12-19T13:58:08.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.457+0000 7fc6b37fe640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6b806a430 0x7fc6b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.457+0000 7fc6b37fe640 1 -- 172.21.15.113:0/4000639185 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6bc0aa290 con 0x7fc6b40039e0 2023-12-19T13:58:08.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.457+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6b806a430 0x7fc6b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.457 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.457+0000 7fc6d41fe740 1 Processor -- start 2023-12-19T13:58:08.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6d41fe740 1 -- start start 2023-12-19T13:58:08.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6b806a430 0x7fc6b806c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00018a0 tx=0x7fc6c0001550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c61110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c30cb0 0x561339c5dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 0x561339c5e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339ba0f80 con 0x561339c60d30 2023-12-19T13:58:08.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339b9e710 con 0x561339c348b0 2023-12-19T13:58:08.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.458+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561339b9a000 con 0x561339c30cb0 2023-12-19T13:58:08.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c61110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c61110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43676/0 (socket says 172.21.15.113:43676) 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 -- 172.21.15.113:0/1802424904 learned_addr learned my addr 172.21.15.113:0/1802424904 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 -- 172.21.15.113:0/1802424904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c30cb0 msgr2=0x561339c5dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1802424904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c30cb0 0x561339c5dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 -- 172.21.15.113:0/1802424904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 msgr2=0x561339c5e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1802424904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 0x561339c5e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 -- 172.21.15.113:0/1802424904 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561339b61690 con 0x561339c60d30 2023-12-19T13:58:08.460 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1802424904 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c61110 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc075a30 tx=0x7fc6bc079400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3762a7057e29b4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.459+0000 7fc6b0ff9640 1 -- 172.21.15.113:0/1802424904 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc079c30 con 0x561339c60d30 2023-12-19T13:58:08.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6b0ff9640 1 -- 172.21.15.113:0/1802424904 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc07d120 con 0x561339c60d30 2023-12-19T13:58:08.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6b0ff9640 1 -- 172.21.15.113:0/1802424904 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc079530 con 0x561339c60d30 2023-12-19T13:58:08.461 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1802424904 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 msgr2=0x561339c61110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1802424904 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c61110 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc075a30 tx=0x7fc6bc079400 comp rx=0 tx=0).stop 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1802424904 shutdown_connections 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1802424904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 0x561339c5e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1802424904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c30cb0 0x561339c5dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1802424904 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c61110 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1802424904 >> 172.21.15.113:0/1802424904 conn(0x561339c32fc0 msgr2=0x561339c7bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1802424904 shutdown_connections 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.460+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1802424904 wait complete. 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.461+0000 7fc6d41fe740 1 -- start start 2023-12-19T13:58:08.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.461+0000 7fc6d41fe740 1 Processor -- start 2023-12-19T13:58:08.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.462+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 0x561339c5b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.462+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c60d30 0x561339c66870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.462+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c61670 0x561339c62a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.462+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339b3b7d0 con 0x561339c61670 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.462+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339b3b470 con 0x561339c60d30 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.462+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561339901f20 con 0x561339c348b0 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.462+0000 7fc6d41fe740 10 client.0 _ll_register_callbacks cb 0x561339b8a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c61670 0x561339c62a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c61670 0x561339c62a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43678/0 (socket says 172.21.15.113:43678) 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 -- 172.21.15.113:0/2211982420 learned_addr learned my addr 172.21.15.113:0/2211982420 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6caffd640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 0x561339c5b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 -- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 msgr2=0x561339c5b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 0x561339c5b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 -- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c60d30 msgr2=0x561339c66870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c60d30 0x561339c66870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c60d30 0x561339c66870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 -- 172.21.15.113:0/2211982420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc152530 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c60d30 0x561339c66870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6cb7fe640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c61670 0x561339c62a00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4007790 tx=0x7fc6c4007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86766ffe798df089 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2211982420 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400d7c0 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.463+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2211982420 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c400d920 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561339bc4550 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2211982420 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6c400dae0 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 10 client.8814 fetch_fsmap learned FSMap version 80 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x561339b98680 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2211982420 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561339bc4550 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2211982420 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 80) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc6c4012070 con 0x561339c61670 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 10 client.8814 fetch_fsmap finished waiting for FSMap version 80 2023-12-19T13:58:08.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 10 client.8814 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 20 client.8814 populate_metadata read hostname 'smithi113' 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c8e1e0 0x561339c8e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 4 client.8814 mds_command: new command op to 8664 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.464+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 --> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561339b8cb50 con 0x561339c8e1e0 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.465+0000 7fc6caffd640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c8e1e0 0x561339c8e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.465+0000 7fc6caffd640 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c8e1e0 0x561339c8e5c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5491e7de1bd4fd84 server_cookie=d093e6c9f9dd7ad4 in_seq=0 out_seq=0 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.465+0000 7fc6a9ffb640 10 client.8814 ms_handle_connect on v2:172.21.15.113:6836/2910539170 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2211982420 <== mds.0 v2:172.21.15.113:6836/2910539170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561339b8cb50 con 0x561339c8e1e0 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6a9ffb640 10 client.8814 handle_command_reply: tid=0 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 client.8814 shutdown 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c61670 msgr2=0x561339c62a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c61670 0x561339c62a00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4007790 tx=0x7fc6c4007c50 comp rx=0 tx=0).stop 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 shutdown_connections 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c8e1e0 0x561339c8e5c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c61670 0x561339c62a00 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c60d30 0x561339c66870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2211982420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 0x561339c5b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6a9ffb640 0 client.8814 ms_handle_reset on v2:172.21.15.113:6836/2910539170 2023-12-19T13:58:08.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 >> 172.21.15.113:0/2211982420 conn(0x561339c30cb0 msgr2=0x561339c35060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 shutdown_connections 2023-12-19T13:58:08.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2211982420 wait complete. 2023-12-19T13:58:08.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.466+0000 7fc6d41fe740 20 client.8814 trim_cache size 0 max 16384 2023-12-19T13:58:08.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.482+0000 7fc6d41fe740 1 Processor -- start 2023-12-19T13:58:08.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.482+0000 7fc6d41fe740 1 -- start start 2023-12-19T13:58:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.483+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 0x561339c62680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.483+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.483+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c61670 0x561339c64920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.483+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339c66c60 con 0x561339c60d30 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.483+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339c951b0 con 0x561339c348b0 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.483+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561339c5d7d0 con 0x561339c61670 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43690/0 (socket says 172.21.15.113:43690) 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/1856740262 learned_addr learned my addr 172.21.15.113:0/1856740262 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6caffd640 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 0x561339c62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/1856740262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c61670 msgr2=0x561339c64920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c61670 0x561339c64920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/1856740262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 msgr2=0x561339c62680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 0x561339c62680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/1856740262 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561339b3a9e0 con 0x561339c60d30 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c643e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0005a00 tx=0x7fc6c0001430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0ba26fed7ca5df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.484+0000 7fc6b17fa640 1 -- 172.21.15.113:0/1856740262 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0005250 con 0x561339c60d30 2023-12-19T13:58:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6b17fa640 1 -- 172.21.15.113:0/1856740262 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c00053b0 con 0x561339c60d30 2023-12-19T13:58:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6b17fa640 1 -- 172.21.15.113:0/1856740262 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c00047e0 con 0x561339c60d30 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1856740262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 msgr2=0x561339c643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c643e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0005a00 tx=0x7fc6c0001430 comp rx=0 tx=0).stop 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1856740262 shutdown_connections 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c61670 0x561339c64920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c643e0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/1856740262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c348b0 0x561339c62680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1856740262 >> 172.21.15.113:0/1856740262 conn(0x561339c30cb0 msgr2=0x561339c5a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1856740262 shutdown_connections 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.485+0000 7fc6d41fe740 1 -- 172.21.15.113:0/1856740262 wait complete. 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.486+0000 7fc6d41fe740 1 -- start start 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.486+0000 7fc6d41fe740 1 Processor -- start 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 0x561339cde1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c97660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6d41fe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c61670 0x561339c64340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339c97ba0 con 0x561339c60d30 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561339ce1c10 con 0x561339c61670 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6d41fe740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561339c5d070 con 0x561339c348b0 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6d41fe740 10 client.0 _ll_register_callbacks cb 0x7fc6bc02ff10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6ca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c97660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6ca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c97660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43698/0 (socket says 172.21.15.113:43698) 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.487+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/2840102746 learned_addr learned my addr 172.21.15.113:0/2840102746 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/2840102746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 msgr2=0x561339cde1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 0x561339cde1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/2840102746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c61670 msgr2=0x561339c64340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c61670 0x561339c64340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6ca7fc640 1 -- 172.21.15.113:0/2840102746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0ae920 con 0x561339c60d30 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6ca7fc640 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c97660 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0007940 tx=0x7fc6c000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd9ea0439c00d2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2840102746 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0005210 con 0x561339c60d30 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2840102746 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c00049f0 con 0x561339c60d30 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.488+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6bc07d120 con 0x561339c60d30 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2840102746 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6c0004bb0 con 0x561339c60d30 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 10 client.8820 fetch_fsmap learned FSMap version 80 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x561339b5fef0 con 0x561339c60d30 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2840102746 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc07d120 con 0x561339c60d30 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2840102746 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 80) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc6c0004d10 con 0x561339c60d30 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 10 client.8820 fetch_fsmap finished waiting for FSMap version 80 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 10 client.8820 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 20 client.8820 populate_metadata read hostname 'smithi113' 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c5de10 0x561339c5e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 4 client.8820 mds_command: new command op to 8664 tid=0[{"prefix": "status"}] 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 --> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561339b93080 con 0x561339c5de10 2023-12-19T13:58:08.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.489+0000 7fc6caffd640 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c5de10 0x561339c5e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6caffd640 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c5de10 0x561339c5e210 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=387ed593bbf53608 server_cookie=a804f3aa9a216852 in_seq=0 out_seq=0 2023-12-19T13:58:08.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6a9ffb640 10 client.8820 ms_handle_connect on v2:172.21.15.113:6836/2910539170 2023-12-19T13:58:08.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6a9ffb640 1 -- 172.21.15.113:0/2840102746 <== mds.0 v2:172.21.15.113:6836/2910539170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561339b93080 con 0x561339c5de10 2023-12-19T13:58:08.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6a9ffb640 10 client.8820 handle_command_reply: tid=0 2023-12-19T13:58:08.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 client.8820 shutdown 2023-12-19T13:58:08.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 msgr2=0x561339c97660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c97660 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0007940 tx=0x7fc6c000a000 comp rx=0 tx=0).stop 2023-12-19T13:58:08.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 shutdown_connections 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:6836/2910539170,v1:172.21.15.113:6837/2910539170] conn(0x561339c5de10 0x561339c5e210 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561339c61670 0x561339c64340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x561339c60d30 0x561339c97660 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 --2- 172.21.15.113:0/2840102746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561339c348b0 0x561339cde1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6a9ffb640 0 client.8820 ms_handle_reset on v2:172.21.15.113:6836/2910539170 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 >> 172.21.15.113:0/2840102746 conn(0x561339c30cb0 msgr2=0x561339c87f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 shutdown_connections 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.490+0000 7fc6d41fe740 1 -- 172.21.15.113:0/2840102746 wait complete. 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d41fe740 20 client.8820 trim_cache size 0 max 16384 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:58:08.495 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 8664, 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 7.1517600059999999, 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 80, 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 178, 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 178, 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 12.036977706 2023-12-19T13:58:08.496 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:58:08.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6b806a430 msgr2=0x7fc6b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6b806a430 0x7fc6b806c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00018a0 tx=0x7fc6c0001550 comp rx=0 tx=0).stop 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 msgr2=0x7fc6cc151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6cc151ff0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc039040 tx=0x7fc6bc004730 comp rx=0 tx=0).stop 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 shutdown_connections 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc6b806a430 0x7fc6b806c8f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc15ceb0 0x7fc6cc159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc144a00 0x7fc6cc15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 --2- 172.21.15.113:0/4000639185 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b40039e0 0x7fc6cc151ff0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 >> 172.21.15.113:0/4000639185 conn(0x7fc6cc0cbb70 msgr2=0x7fc6cc06da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 shutdown_connections 2023-12-19T13:58:08.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.491+0000 7fc6d15b9640 1 -- 172.21.15.113:0/4000639185 wait complete. 2023-12-19T13:58:08.509 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:58:08.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.714+0000 7f6955c10640 1 Processor -- start 2023-12-19T13:58:08.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.714+0000 7f6955c10640 1 -- start start 2023-12-19T13:58:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.715+0000 7f6955c10640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f69500ae110 0x7f69500b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.715+0000 7f6955c10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 0x7f695006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.715+0000 7f6955c10640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500ae640 con 0x7f6950157bf0 2023-12-19T13:58:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.715+0000 7f6955c10640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695006b8c0 con 0x7f69500ae110 2023-12-19T13:58:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.715+0000 7f6955c10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500b0ab0 con 0x7f69500b0640 2023-12-19T13:58:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.716+0000 7f694f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6950157bf0 0x7f695015b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:56210/0 (socket says 172.21.15.113:56210) 2023-12-19T13:58:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.716+0000 7f694f7fe640 1 -- 172.21.15.113:0/692661093 learned_addr learned my addr 172.21.15.113:0/692661093 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.716+0000 7f694effd640 1 --2- 172.21.15.113:0/692661093 >> v2:172.21.15.151:3300/0 conn(0x7f69500ae110 0x7f69500b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.716+0000 7f694ffff640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 0x7f695006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.716+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593412677 0 0) 0x7f69500ae640 con 0x7f6950157bf0 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.716+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6938003520 con 0x7f6950157bf0 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.716+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3705749000 0 0) 0x7f6938003520 con 0x7f6950157bf0 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 msgr2=0x7f695006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 0x7f695006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 >> v2:172.21.15.151:3300/0 conn(0x7f69500ae110 msgr2=0x7f69500b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 --2- 172.21.15.113:0/692661093 >> v2:172.21.15.151:3300/0 conn(0x7f69500ae110 0x7f69500b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500ae920 con 0x7f6950157bf0 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6940001690 con 0x7f6950157bf0 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 >> v1:172.21.15.113:6789/0 conn(0x7f6950157bf0 legacy=0x7f695015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 0x7f6938003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6938004040 0x7f69380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6938004d00 0x7f6938005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695006b8c0 con 0x7f6938004040 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500b0ab0 con 0x7f6938004d00 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693800bb40 con 0x7f69500b0640 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694effd640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6938004040 0x7f69380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694ffff640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6938004d00 0x7f6938005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694f7fe640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 0x7f6938003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694effd640 1 -- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 msgr2=0x7f6938003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694effd640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 0x7f6938003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694effd640 1 -- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6938004d00 msgr2=0x7f6938005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694effd640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6938004d00 0x7f6938005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694effd640 1 -- 172.21.15.113:0/692661093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938003520 con 0x7f6938004040 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694f7fe640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69500b0640 0x7f6938003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:08.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.717+0000 7f694ffff640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6938004d00 0x7f6938005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:08.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f694effd640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6938004040 0x7f69380047c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f694400b5c0 tx=0x7f69380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebad745de2b3810e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694402f6a0 con 0x7f6938004040 2023-12-19T13:58:08.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694402f800 con 0x7f6938004040 2023-12-19T13:58:08.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f694e7fc640 1 -- 172.21.15.113:0/692661093 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694402fb90 con 0x7f6938004040 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f6955c10640 1 -- 172.21.15.113:0/692661093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6938004040 msgr2=0x7f69380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f6955c10640 1 --2- 172.21.15.113:0/692661093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6938004040 0x7f69380047c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f694400b5c0 tx=0x7f69380057f0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f694ffff640 1 -- 172.21.15.113:0/692661093 reap_dead start 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f6955c10640 1 -- 172.21.15.113:0/692661093 shutdown_connections 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.719+0000 7f6955c10640 1 -- 172.21.15.113:0/692661093 >> 172.21.15.113:0/692661093 conn(0x7f69500cbb70 msgr2=0x7f69500cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.720+0000 7f6955c10640 1 -- 172.21.15.113:0/692661093 shutdown_connections 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.720+0000 7f6955c10640 1 -- 172.21.15.113:0/692661093 wait complete. 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.721+0000 7f6955c10640 1 Processor -- start 2023-12-19T13:58:08.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.721+0000 7f6955c10640 1 -- start start 2023-12-19T13:58:08.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.722+0000 7f6955c10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6938004040 0x7f69500aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.722+0000 7f6955c10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6950073220 0x7f69501489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.722+0000 7f6955c10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69500b14e0 0x7f69500b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.722+0000 7f6955c10640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500a98f0 con 0x7f6950073220 2023-12-19T13:58:08.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.722+0000 7f6955c10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500b1ed0 con 0x7f69500b14e0 2023-12-19T13:58:08.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.722+0000 7f6955c10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500ab290 con 0x7f6938004040 2023-12-19T13:58:08.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6950073220 0x7f69501489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6950073220 0x7f69501489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43710/0 (socket says 172.21.15.113:43710) 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 -- 172.21.15.113:0/1653034918 learned_addr learned my addr 172.21.15.113:0/1653034918 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694ffff640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69500b14e0 0x7f69500b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694f7fe640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6938004040 0x7f69500aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 -- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6938004040 msgr2=0x7f69500aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6938004040 0x7f69500aacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 -- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69500b14e0 msgr2=0x7f69500b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69500b14e0 0x7f69500b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 -- 172.21.15.113:0/1653034918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500ab570 con 0x7f6950073220 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.723+0000 7f694effd640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6950073220 0x7f69501489b0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f694400ba00 tx=0x7f6944004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.724+0000 7f6937fff640 1 -- 172.21.15.113:0/1653034918 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944041070 con 0x7f6950073220 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.724+0000 7f6937fff640 1 -- 172.21.15.113:0/1653034918 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944004020 con 0x7f6950073220 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.724+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69500ab850 con 0x7f6950073220 2023-12-19T13:58:08.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.724+0000 7f6937fff640 1 -- 172.21.15.113:0/1653034918 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69440043b0 con 0x7f6950073220 2023-12-19T13:58:08.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.724+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69500abe10 con 0x7f6950073220 2023-12-19T13:58:08.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.725+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69500abfd0 con 0x7f6950073220 2023-12-19T13:58:08.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.726+0000 7f6937fff640 1 -- 172.21.15.113:0/1653034918 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6944045070 con 0x7f6950073220 2023-12-19T13:58:08.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.727+0000 7f6937fff640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f693c06a460 0x7f693c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:08.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.727+0000 7f6937fff640 1 -- 172.21.15.113:0/1653034918 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69440ac570 con 0x7f6950073220 2023-12-19T13:58:08.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.728+0000 7f694f7fe640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f693c06a460 0x7f693c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:08.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.728+0000 7f694f7fe640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f693c06a460 0x7f693c06c920 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6940001900 tx=0x7f6940009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:08.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.732+0000 7f6937fff640 1 -- 172.21.15.113:0/1653034918 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6944077be0 con 0x7f6950073220 2023-12-19T13:58:08.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.961+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6950061910 con 0x7f6950073220 2023-12-19T13:58:08.961 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.961+0000 7f6937fff640 1 -- 172.21.15.113:0/1653034918 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6944037060 con 0x7f6950073220 2023-12-19T13:58:08.962 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f693c06a460 msgr2=0x7f693c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f693c06a460 0x7f693c06c920 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6940001900 tx=0x7f6940009040 comp rx=0 tx=0).stop 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6950073220 msgr2=0x7f69501489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6950073220 0x7f69501489b0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f694400ba00 tx=0x7f6944004730 comp rx=0 tx=0).stop 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 shutdown_connections 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f693c06a460 0x7f693c06c920 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69500b14e0 0x7f69500b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6950073220 0x7f69501489b0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 --2- 172.21.15.113:0/1653034918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6938004040 0x7f69500aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:08.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 >> 172.21.15.113:0/1653034918 conn(0x7f69500cbb70 msgr2=0x7f695006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:08.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 shutdown_connections 2023-12-19T13:58:08.965 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:08.964+0000 7f6955c10640 1 -- 172.21.15.113:0/1653034918 wait complete. 2023-12-19T13:58:08.981 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:58:08.981 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:58:08.981 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:58:08.982 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:58:08.982 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:58:08.982 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:58:08.982 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:58:08.982 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:58:08.982 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:58:08.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:08.982 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:58:09.033 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:58:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:58:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:58:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:09.033 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:09.034 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 41731sec preferred_lft 41731sec 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:58:09.035 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:09.036 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:58:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:58:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:58:09.036 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:09.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.037 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:58:09.129 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:58:09.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.133 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:58:09.187 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:58:09.187 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:58:09.187 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:58:09.187 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:58:09.187 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:58:09.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.187 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:58:09.187 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:58:09.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:58:09.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:58:09.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:58:09.188 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:58:09.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.379 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:58:09.427 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:58:09.427 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:58:09.428 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:58:09.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.428 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:58:09.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:58:09.520 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:58:09.573 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:58:09.573 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:58:09.573 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:58:09.620 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:58:09.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.621 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:58:09.804 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:58:09.804 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:58:09.838 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:58:09.838 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:58:09.838 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:58:09.839 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:58:09.839 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:58:09.840 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:58:09.840 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:58:09.840 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:58:09.841 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:58:09.841 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:58:09.845 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:58:09.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.845 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:58:09.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:09.931 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:58:09.999 INFO:teuthology.orchestra.run.smithi113.stdout:client5696 2023-12-19T13:58:10.000 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:58:10.000 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:58:10.056 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:58:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.270+0000 7f08173d6640 1 Processor -- start 2023-12-19T13:58:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.270+0000 7f08173d6640 1 -- start start 2023-12-19T13:58:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.271+0000 7f08173d6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0810159f80 0x7f081006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.271+0000 7f08173d6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f081015b1e0 0x7f081015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.271+0000 7f08173d6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081006b520 con 0x7f081015a8a0 2023-12-19T13:58:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.271+0000 7f08173d6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100b2b20 con 0x7f081015b1e0 2023-12-19T13:58:10.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.271+0000 7f08173d6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100b2fb0 con 0x7f0810159f80 2023-12-19T13:58:10.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.272+0000 7f0815bd3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f081015b1e0 0x7f081015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:10.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.272+0000 7f0815bd3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f081015b1e0 0x7f081015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43714/0 (socket says 172.21.15.113:43714) 2023-12-19T13:58:10.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.272+0000 7f0815bd3640 1 -- 172.21.15.113:0/2024185817 learned_addr learned my addr 172.21.15.113:0/2024185817 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:10.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.272+0000 7f0815bd3640 1 -- 172.21.15.113:0/2024185817 >> v2:172.21.15.151:3300/0 conn(0x7f0810159f80 msgr2=0x7f081006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:10.272 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.272+0000 7f0815bd3640 1 --2- 172.21.15.113:0/2024185817 >> v2:172.21.15.151:3300/0 conn(0x7f0810159f80 0x7f081006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.272+0000 7f0815bd3640 1 -- 172.21.15.113:0/2024185817 >> v1:172.21.15.151:6789/0 conn(0x7f081015a8a0 legacy=0x7f081015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:10.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.272+0000 7f0815bd3640 1 -- 172.21.15.113:0/2024185817 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100b1f10 con 0x7f081015b1e0 2023-12-19T13:58:10.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.273+0000 7f0815bd3640 1 --2- 172.21.15.113:0/2024185817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f081015a360 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f08100b3230 tx=0x7f080002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16df42eedc01a4f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:10.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.273+0000 7f08153d2640 1 -- 172.21.15.113:0/2024185817 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800030860 con 0x7f081015b1e0 2023-12-19T13:58:10.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08153d2640 1 -- 172.21.15.113:0/2024185817 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08000309c0 con 0x7f081015b1e0 2023-12-19T13:58:10.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08153d2640 1 -- 172.21.15.113:0/2024185817 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800030d50 con 0x7f081015b1e0 2023-12-19T13:58:10.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 -- 172.21.15.113:0/2024185817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 msgr2=0x7f081015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 --2- 172.21.15.113:0/2024185817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f081015a360 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f08100b3230 tx=0x7f080002b9a0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 -- 172.21.15.113:0/2024185817 shutdown_connections 2023-12-19T13:58:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 --2- 172.21.15.113:0/2024185817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f081015a360 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 --2- 172.21.15.113:0/2024185817 >> v2:172.21.15.151:3300/0 conn(0x7f0810159f80 0x7f081006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 -- 172.21.15.113:0/2024185817 >> 172.21.15.113:0/2024185817 conn(0x7f08100b0100 msgr2=0x7f08100b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 -- 172.21.15.113:0/2024185817 shutdown_connections 2023-12-19T13:58:10.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.274+0000 7f08173d6640 1 -- 172.21.15.113:0/2024185817 wait complete. 2023-12-19T13:58:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.276+0000 7f08173d6640 1 Processor -- start 2023-12-19T13:58:10.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.276+0000 7f08173d6640 1 -- start start 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.277+0000 7f08173d6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0810159f80 0x7f08101f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.277+0000 7f08173d6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081015a8a0 0x7f081014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.277+0000 7f08173d6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f08101f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.277+0000 7f08173d6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08101f3ab0 con 0x7f081015b1e0 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.277+0000 7f08173d6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081014cb40 con 0x7f081015a8a0 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.277+0000 7f08173d6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08101f2af0 con 0x7f0810159f80 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.277+0000 7f0816bd5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f08101f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f08101f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43728/0 (socket says 172.21.15.113:43728) 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 -- 172.21.15.113:0/2368291645 learned_addr learned my addr 172.21.15.113:0/2368291645 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f08163d4640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0810159f80 0x7f08101f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0815bd3640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081015a8a0 0x7f081014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:10.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 -- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0810159f80 msgr2=0x7f08101f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0810159f80 0x7f08101f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 -- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081015a8a0 msgr2=0x7f081014c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081015a8a0 0x7f081014c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 -- 172.21.15.113:0/2368291645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000094d0 con 0x7f081015b1e0 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f08163d4640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0810159f80 0x7f08101f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.278+0000 7f0816bd5640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f08101f60e0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f080800c780 tx=0x7f080800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.279+0000 7f0806ffd640 1 -- 172.21.15.113:0/2368291645 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808003d80 con 0x7f081015b1e0 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.279+0000 7f0806ffd640 1 -- 172.21.15.113:0/2368291645 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080800ce90 con 0x7f081015b1e0 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.279+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08101f6b80 con 0x7f081015b1e0 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.279+0000 7f0806ffd640 1 -- 172.21.15.113:0/2368291645 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08080052b0 con 0x7f081015b1e0 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.279+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08101f2d70 con 0x7f081015b1e0 2023-12-19T13:58:10.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.280+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08100cd240 con 0x7f081015b1e0 2023-12-19T13:58:10.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.281+0000 7f0806ffd640 1 -- 172.21.15.113:0/2368291645 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0808005410 con 0x7f081015b1e0 2023-12-19T13:58:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.282+0000 7f0806ffd640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f07f406a430 0x7f07f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.282+0000 7f0806ffd640 1 -- 172.21.15.113:0/2368291645 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0808087e30 con 0x7f081015b1e0 2023-12-19T13:58:10.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.282+0000 7f08163d4640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f07f406a430 0x7f07f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:10.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.283+0000 7f08163d4640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f07f406a430 0x7f07f406c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f080c006fd0 tx=0x7f080c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:10.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.286+0000 7f0806ffd640 1 -- 172.21.15.113:0/2368291645 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0808053390 con 0x7f081015b1e0 2023-12-19T13:58:10.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.515+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0810061910 con 0x7f081015b1e0 2023-12-19T13:58:10.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.516+0000 7f0806ffd640 1 -- 172.21.15.113:0/2368291645 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08080569b0 con 0x7f081015b1e0 2023-12-19T13:58:10.516 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.518+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f07f406a430 msgr2=0x7f07f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.518+0000 7f08173d6640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f07f406a430 0x7f07f406c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f080c006fd0 tx=0x7f080c008040 comp rx=0 tx=0).stop 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.518+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 msgr2=0x7f08101f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.518+0000 7f08173d6640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f08101f60e0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f080800c780 tx=0x7f080800cc40 comp rx=0 tx=0).stop 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 shutdown_connections 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f07f406a430 0x7f07f406c8f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f081015b1e0 0x7f08101f60e0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081015a8a0 0x7f081014c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 --2- 172.21.15.113:0/2368291645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0810159f80 0x7f08101f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:10.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 >> 172.21.15.113:0/2368291645 conn(0x7f08100b0100 msgr2=0x7f08100ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:10.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 shutdown_connections 2023-12-19T13:58:10.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:10.519+0000 7f08173d6640 1 -- 172.21.15.113:0/2368291645 wait complete. 2023-12-19T13:58:10.537 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:58:10.537 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:58:10.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:58:10.537 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:58:10.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:58:10.538 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:58:10.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:58:10.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:58:10.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:58:10.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:10.538 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:58:10.599 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41704sec preferred_lft 41704sec 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:58:10.600 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:58:10.601 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:58:10.602 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:58:10.602 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:58:10.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:10.603 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:58:10.692 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:58:10.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:10.696 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:58:10.749 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:58:10.749 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:58:10.749 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:58:10.749 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:58:10.749 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:58:10.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:10.750 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:58:10.750 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:58:10.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:58:10.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:58:10.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:58:10.750 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:58:10.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:10.935 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:58:10.983 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:58:10.983 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:58:10.983 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:58:10.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:10.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:58:11.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:58:11.071 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:58:11.124 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:58:11.124 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:58:11.124 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:58:11.177 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:58:11.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:11.177 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:58:11.319 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:58:11.319 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:58:11.351 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:58:11.351 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:58:11.351 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:58:11.351 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:58:11.351 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:58:11.352 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:58:11.352 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:58:11.353 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:58:11.353 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:58:11.353 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:58:11.356 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:58:11.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:11.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:58:11.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:58:11.441 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:58:11.497 INFO:teuthology.orchestra.run.smithi151.stdout:client5699 2023-12-19T13:58:11.497 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:58:11.497 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:58:11.551 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:58:11.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.772+0000 7efdaec8b640 1 Processor -- start 2023-12-19T13:58:11.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.773+0000 7efdaec8b640 1 -- start start 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.774+0000 7efdaec8b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efda8157aa0 0x7efda80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.774+0000 7efdaec8b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 0x7efda815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.774+0000 7efdaec8b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda806e8c0 con 0x7efda806e410 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.774+0000 7efdaec8b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda815e9c0 con 0x7efda8157aa0 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.774+0000 7efdaec8b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80b2600 con 0x7efda815e040 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efdaca27640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efda8157aa0 0x7efda80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efdaca27640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efda8157aa0 0x7efda80b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43736/0 (socket says 172.21.15.113:43736) 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efdaca27640 1 -- 172.21.15.113:0/1937032309 learned_addr learned my addr 172.21.15.113:0/1937032309 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:11.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efda7fff640 1 --1- 172.21.15.113:0/1937032309 >> v1:172.21.15.113:6789/0 conn(0x7efda806e410 0x7efda8161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:56216/0 (socket says 172.21.15.113:56216) 2023-12-19T13:58:11.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efdaca27640 1 -- 172.21.15.113:0/1937032309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 msgr2=0x7efda815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:11.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efdaca27640 1 --2- 172.21.15.113:0/1937032309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 0x7efda815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:11.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efdaca27640 1 -- 172.21.15.113:0/1937032309 >> v1:172.21.15.113:6789/0 conn(0x7efda806e410 legacy=0x7efda8161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:11.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.775+0000 7efdaca27640 1 -- 172.21.15.113:0/1937032309 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80b1d60 con 0x7efda8157aa0 2023-12-19T13:58:11.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.776+0000 7efdaca27640 1 --2- 172.21.15.113:0/1937032309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda8157aa0 0x7efda80b1710 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009870 tx=0x7efd9c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71992736b557f605 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:11.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.776+0000 7efda77fe640 1 -- 172.21.15.113:0/1937032309 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c030840 con 0x7efda8157aa0 2023-12-19T13:58:11.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.776+0000 7efda77fe640 1 -- 172.21.15.113:0/1937032309 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c0309a0 con 0x7efda8157aa0 2023-12-19T13:58:11.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.776+0000 7efda77fe640 1 -- 172.21.15.113:0/1937032309 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c030d30 con 0x7efda8157aa0 2023-12-19T13:58:11.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 -- 172.21.15.113:0/1937032309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda8157aa0 msgr2=0x7efda80b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:11.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 --2- 172.21.15.113:0/1937032309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda8157aa0 0x7efda80b1710 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009870 tx=0x7efd9c02b980 comp rx=0 tx=0).stop 2023-12-19T13:58:11.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 -- 172.21.15.113:0/1937032309 shutdown_connections 2023-12-19T13:58:11.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 --2- 172.21.15.113:0/1937032309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 0x7efda815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:11.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 --2- 172.21.15.113:0/1937032309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda8157aa0 0x7efda80b1710 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:11.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 -- 172.21.15.113:0/1937032309 >> 172.21.15.113:0/1937032309 conn(0x7efda80cbb70 msgr2=0x7efda80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:11.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 -- 172.21.15.113:0/1937032309 shutdown_connections 2023-12-19T13:58:11.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.777+0000 7efdaec8b640 1 -- 172.21.15.113:0/1937032309 wait complete. 2023-12-19T13:58:11.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.779+0000 7efdaec8b640 1 Processor -- start 2023-12-19T13:58:11.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.779+0000 7efdaec8b640 1 -- start start 2023-12-19T13:58:11.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.780+0000 7efdaec8b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda806e410 0x7efda813ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:11.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.780+0000 7efdaec8b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda8157aa0 0x7efda81e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:11.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.780+0000 7efdaec8b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 0x7efda806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:11.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.780+0000 7efdaec8b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda813b800 con 0x7efda806e410 2023-12-19T13:58:11.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.780+0000 7efdaec8b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda81e75e0 con 0x7efda8157aa0 2023-12-19T13:58:11.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.780+0000 7efdaec8b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda81e7ab0 con 0x7efda815e040 2023-12-19T13:58:11.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda806e410 0x7efda813ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:11.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda806e410 0x7efda813ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43748/0 (socket says 172.21.15.113:43748) 2023-12-19T13:58:11.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 -- 172.21.15.113:0/3553864052 learned_addr learned my addr 172.21.15.113:0/3553864052 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 -- 172.21.15.113:0/3553864052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 msgr2=0x7efda806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 0x7efda806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 -- 172.21.15.113:0/3553864052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda8157aa0 msgr2=0x7efda81e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda8157aa0 0x7efda81e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 -- 172.21.15.113:0/3553864052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0094d0 con 0x7efda806e410 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.781+0000 7efdaca27640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda806e410 0x7efda813ba50 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7efd9c000c00 tx=0x7efd9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.782+0000 7efda57fa640 1 -- 172.21.15.113:0/3553864052 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0307f0 con 0x7efda806e410 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.782+0000 7efda57fa640 1 -- 172.21.15.113:0/3553864052 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c043400 con 0x7efda806e410 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.782+0000 7efda57fa640 1 -- 172.21.15.113:0/3553864052 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0437b0 con 0x7efda806e410 2023-12-19T13:58:11.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.782+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda81e77d0 con 0x7efda806e410 2023-12-19T13:58:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.782+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda806b8a0 con 0x7efda806e410 2023-12-19T13:58:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.783+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8061910 con 0x7efda806e410 2023-12-19T13:58:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.784+0000 7efda57fa640 1 -- 172.21.15.113:0/3553864052 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd9c043910 con 0x7efda806e410 2023-12-19T13:58:11.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.785+0000 7efda57fa640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:11.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.785+0000 7efda57fa640 1 -- 172.21.15.113:0/3553864052 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd9c03e070 con 0x7efda806e410 2023-12-19T13:58:11.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.785+0000 7efda7fff640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:11.785 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.786+0000 7efda7fff640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efda8071460 tx=0x7efd940079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:11.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:11.789+0000 7efda57fa640 1 -- 172.21.15.113:0/3553864052 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd9c0771a0 con 0x7efda806e410 2023-12-19T13:58:12.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.016+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efda8071ae0 con 0x7efda806e410 2023-12-19T13:58:12.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.017+0000 7efda57fa640 1 -- 172.21.15.113:0/3553864052 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4664 (secure 0 0 0) 0x7efd9c034090 con 0x7efda806e410 2023-12-19T13:58:12.018 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:58:12.018 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:58:01.335603+0000","modified":"2023-12-19T13:58:04.828919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/2910539170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2910539170},{"type":"v1","addr":"172.21.15.113:6837","nonce":2910539170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T13:58:12.018 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 80 2023-12-19T13:58:12.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 msgr2=0x7efd8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:12.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efda8071460 tx=0x7efd940079c0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda806e410 msgr2=0x7efda813ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:12.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda806e410 0x7efda813ba50 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7efd9c000c00 tx=0x7efd9c004730 comp rx=0 tx=0).stop 2023-12-19T13:58:12.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 shutdown_connections 2023-12-19T13:58:12.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efda815e040 0x7efda806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda8157aa0 0x7efda81e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 --2- 172.21.15.113:0/3553864052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efda806e410 0x7efda813ba50 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 >> 172.21.15.113:0/3553864052 conn(0x7efda80cbb70 msgr2=0x7efda80ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:12.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 shutdown_connections 2023-12-19T13:58:12.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.020+0000 7efdaec8b640 1 -- 172.21.15.113:0/3553864052 wait complete. 2023-12-19T13:58:12.038 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:58:12.259 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":8664,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.905683485999999,"mdsmap_epoch":80,"osdmap_epoch":178,"osdmap_epoch_barrier":178,"uptime":15.790886903000001} 2023-12-19T13:58:12.259 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 8664, "mdsmap_epoch": 80, "osdmap_epoch": 178, "osdmap_epoch_barrier": 178, "rank_uptime": 10.905683486, "state": "up:active", "uptime": 15.790886903, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:58:12.260 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T13:58:12.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.475+0000 7efef3417640 1 Processor -- start 2023-12-19T13:58:12.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.475+0000 7efef3417640 1 -- start start 2023-12-19T13:58:12.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.476+0000 7efef3417640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efeec0cbca0 0x7efeec0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:12.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.476+0000 7efef3417640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0b1dc0 0x7efeec06c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:12.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.476+0000 7efef3417640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec070bc0 con 0x7efeec15a000 2023-12-19T13:58:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.476+0000 7efef3417640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec071c60 con 0x7efeec0cbca0 2023-12-19T13:58:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.476+0000 7efef3417640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0b2250 con 0x7efeec0b1dc0 2023-12-19T13:58:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.477+0000 7efef09b2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efeec0cbca0 0x7efeec0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.477+0000 7efef09b2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efeec0cbca0 0x7efeec0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:34040/0 (socket says 172.21.15.113:34040) 2023-12-19T13:58:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.477+0000 7efef09b2640 1 -- 172.21.15.113:0/1326137209 learned_addr learned my addr 172.21.15.113:0/1326137209 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.477+0000 7efef19b4640 1 --2- 172.21.15.113:0/1326137209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0b1dc0 0x7efeec06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.478+0000 7efef19b4640 1 -- 172.21.15.113:0/1326137209 >> v2:172.21.15.151:3300/0 conn(0x7efeec0cbca0 msgr2=0x7efeec0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:58:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.478+0000 7efef19b4640 1 --2- 172.21.15.113:0/1326137209 >> v2:172.21.15.151:3300/0 conn(0x7efeec0cbca0 0x7efeec0b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.478+0000 7efef19b4640 1 -- 172.21.15.113:0/1326137209 >> v1:172.21.15.151:6789/0 conn(0x7efeec15a000 legacy=0x7efeec15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.478+0000 7efef19b4640 1 -- 172.21.15.113:0/1326137209 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec070ea0 con 0x7efeec0b1dc0 2023-12-19T13:58:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.478+0000 7efef09b2640 1 --2- 172.21.15.113:0/1326137209 >> v2:172.21.15.151:3300/0 conn(0x7efeec0cbca0 0x7efeec0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:58:12.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.478+0000 7efee3fff640 1 -- 172.21.15.113:0/1326137209 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570780902 0 0) 0x7efeec070bc0 con 0x7efeec15a000 2023-12-19T13:58:12.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.479+0000 7efef19b4640 1 --2- 172.21.15.113:0/1326137209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0b1dc0 0x7efeec06c810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efee4009d90 tx=0x7efee402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52e13733345a695a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:12.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.480+0000 7efee3fff640 1 -- 172.21.15.113:0/1326137209 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee402cc50 con 0x7efeec0b1dc0 2023-12-19T13:58:12.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.480+0000 7efee3fff640 1 -- 172.21.15.113:0/1326137209 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee402cdb0 con 0x7efeec0b1dc0 2023-12-19T13:58:12.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.480+0000 7efee3fff640 1 -- 172.21.15.113:0/1326137209 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4034660 con 0x7efeec0b1dc0 2023-12-19T13:58:12.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 -- 172.21.15.113:0/1326137209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0b1dc0 msgr2=0x7efeec06c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:12.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 --2- 172.21.15.113:0/1326137209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0b1dc0 0x7efeec06c810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efee4009d90 tx=0x7efee402bea0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 -- 172.21.15.113:0/1326137209 shutdown_connections 2023-12-19T13:58:12.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 --2- 172.21.15.113:0/1326137209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0b1dc0 0x7efeec06c810 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 --2- 172.21.15.113:0/1326137209 >> v2:172.21.15.151:3300/0 conn(0x7efeec0cbca0 0x7efeec0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 -- 172.21.15.113:0/1326137209 >> 172.21.15.113:0/1326137209 conn(0x7efeec0cf230 msgr2=0x7efeec0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:12.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 -- 172.21.15.113:0/1326137209 shutdown_connections 2023-12-19T13:58:12.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.481+0000 7efef3417640 1 -- 172.21.15.113:0/1326137209 wait complete. 2023-12-19T13:58:12.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.483+0000 7efef3417640 1 Processor -- start 2023-12-19T13:58:12.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.483+0000 7efef3417640 1 -- start start 2023-12-19T13:58:12.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef3417640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec0b1dc0 0x7efeec14b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:12.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef3417640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0cbca0 0x7efeec140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef3417640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efeec15a000 0x7efeec148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef3417640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec147ad0 con 0x7efeec0b1dc0 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef3417640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec1408c0 con 0x7efeec15a000 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef3417640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec1477f0 con 0x7efeec0cbca0 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec0b1dc0 0x7efeec14b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec0b1dc0 0x7efeec14b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43762/0 (socket says 172.21.15.113:43762) 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 -- 172.21.15.113:0/1224186963 learned_addr learned my addr 172.21.15.113:0/1224186963 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef09b2640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0cbca0 0x7efeec140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef19b4640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efeec15a000 0x7efeec148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 -- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0cbca0 msgr2=0x7efeec140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0cbca0 0x7efeec140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 -- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efeec15a000 msgr2=0x7efeec148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:12.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efeec15a000 0x7efeec148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:12.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.484+0000 7efef11b3640 1 -- 172.21.15.113:0/1224186963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc0094d0 con 0x7efeec0b1dc0 2023-12-19T13:58:12.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.485+0000 7efef11b3640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec0b1dc0 0x7efeec14b920 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efee800c3e0 tx=0x7efee800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:12.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.485+0000 7efee1ffb640 1 -- 172.21.15.113:0/1224186963 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80052d0 con 0x7efeec0b1dc0 2023-12-19T13:58:12.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.485+0000 7efee1ffb640 1 -- 172.21.15.113:0/1224186963 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee8005430 con 0x7efeec0b1dc0 2023-12-19T13:58:12.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.485+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee4009a70 con 0x7efeec0b1dc0 2023-12-19T13:58:12.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.485+0000 7efee1ffb640 1 -- 172.21.15.113:0/1224186963 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee8003830 con 0x7efeec0b1dc0 2023-12-19T13:58:12.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.485+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec14b120 con 0x7efeec0b1dc0 2023-12-19T13:58:12.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.486+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec061910 con 0x7efeec0b1dc0 2023-12-19T13:58:12.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.487+0000 7efee1ffb640 1 -- 172.21.15.113:0/1224186963 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efee8003990 con 0x7efeec0b1dc0 2023-12-19T13:58:12.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.489+0000 7efee1ffb640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efed006a430 0x7efed006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:58:12.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.489+0000 7efee1ffb640 1 -- 172.21.15.113:0/1224186963 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efee8087ff0 con 0x7efeec0b1dc0 2023-12-19T13:58:12.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.489+0000 7efef09b2640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efed006a430 0x7efed006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:58:12.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.490+0000 7efef09b2640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efed006a430 0x7efed006c8f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efeec150670 tx=0x7efedc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:58:12.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.494+0000 7efee1ffb640 1 -- 172.21.15.113:0/1224186963 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efee8053540 con 0x7efeec0b1dc0 2023-12-19T13:58:12.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:12.688+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7efeec0cfff0 con 0x7efeec0b1dc0 2023-12-19T13:58:13.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.086+0000 7efee1ffb640 1 -- 172.21.15.113:0/1224186963 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v179) v1 ==== 181+0+0 (secure 0 0 0) 0x7efee8056b60 con 0x7efeec0b1dc0 2023-12-19T13:58:13.087 INFO:teuthology.orchestra.run.smithi113.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T13:58:13.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efed006a430 msgr2=0x7efed006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:13.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efed006a430 0x7efed006c8f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efeec150670 tx=0x7efedc008040 comp rx=0 tx=0).stop 2023-12-19T13:58:13.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec0b1dc0 msgr2=0x7efeec14b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:58:13.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec0b1dc0 0x7efeec14b920 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efee800c3e0 tx=0x7efee800c8a0 comp rx=0 tx=0).stop 2023-12-19T13:58:13.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 shutdown_connections 2023-12-19T13:58:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efed006a430 0x7efed006c8f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efeec15a000 0x7efeec148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efeec0cbca0 0x7efeec140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 --2- 172.21.15.113:0/1224186963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec0b1dc0 0x7efeec14b920 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:58:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 >> 172.21.15.113:0/1224186963 conn(0x7efeec0cf230 msgr2=0x7efeec0ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:58:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 shutdown_connections 2023-12-19T13:58:13.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:58:13.090+0000 7efef3417640 1 -- 172.21.15.113:0/1224186963 wait complete. 2023-12-19T13:58:13.109 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:58:13.321 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:58:13.321 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:58:13.321 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T13:58:13.532 INFO:teuthology.orchestra.run.smithi113.stdout:{"mon_tick_interval":"5"} 2023-12-19T13:58:13.532 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T13:58:13.532 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-19T13:58:13.532 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T13:58:13.532 DEBUG:teuthology.orchestra.run.smithi113:> import time 2023-12-19T13:58:13.532 DEBUG:teuthology.orchestra.run.smithi113:> import datetime 2023-12-19T13:58:13.532 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2023-12-19T13:58:13.532 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-19T13:58:13.532 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> # Write some buffered data through before going full, all should be well 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> print("writing some data through which we expect to succeed") 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> bytes = 0 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> # from write 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> full = False 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> for n in range(0, int(32 * 1.1)): 2023-12-19T13:58:13.533 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> except OSError as e: 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> if False: 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> raise 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> full = True 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> break 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> try: 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> os.fsync(f) 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> print("fsync'"'"'ed successfully") 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> except OSError as e: 2023-12-19T13:58:13.534 DEBUG:teuthology.orchestra.run.smithi113:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> full = True 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> break 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> else: 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> if n > 32 * 0.9: 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> # Be cautious in the last region where we expect to hit 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> time.sleep(15.0) 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> if not full: 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> # close() should not raise an error because we already caught it in 2023-12-19T13:58:13.535 DEBUG:teuthology.orchestra.run.smithi113:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-19T13:58:13.536 DEBUG:teuthology.orchestra.run.smithi113:> # since then because all IOs got cancelled on the full flag. 2023-12-19T13:58:13.536 DEBUG:teuthology.orchestra.run.smithi113:> print("calling close") 2023-12-19T13:58:13.536 DEBUG:teuthology.orchestra.run.smithi113:> os.close(f) 2023-12-19T13:58:13.536 DEBUG:teuthology.orchestra.run.smithi113:> print("close() did not raise error") 2023-12-19T13:58:13.536 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-19T13:58:13.536 DEBUG:teuthology.orchestra.run.smithi113:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T13:58:13.536 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-19T13:58:20.932 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:20.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:51.070 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:51.080 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:16.948 INFO:teuthology.orchestra.run.smithi113.stdout:writing some data through which we expect to succeed 2023-12-19T13:59:16.948 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T13:59:16.948 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.948 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.948 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 1.00 MB 2023-12-19T13:59:16.948 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 2.00 MB 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 3.00 MB 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 4.00 MB 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 5.00 MB 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.949 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 6.00 MB 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 7.00 MB 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 8.00 MB 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 9.00 MB 2023-12-19T13:59:16.950 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 10.00 MB 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 11.00 MB 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 12.00 MB 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.951 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 13.00 MB 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 14.00 MB 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 15.00 MB 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 16.00 MB 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.952 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 17.00 MB 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 18.00 MB 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 19.00 MB 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 20.00 MB 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 21.00 MB 2023-12-19T13:59:16.953 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 22.00 MB 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 23.00 MB 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 24.00 MB 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 25.00 MB 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 26.00 MB 2023-12-19T13:59:16.954 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 27.00 MB 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 28.00 MB 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 29.00 MB 2023-12-19T13:59:16.955 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 30.00 MB 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 31.00 MB 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 32.00 MB 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:fsync'ed successfully 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:Not full yet after 33.00 MB 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T13:59:16.956 INFO:teuthology.orchestra.run.smithi113.stdout:Reached fullness after 33.00 MB 2023-12-19T13:59:16.957 INFO:teuthology.orchestra.run.smithi113.stdout:calling close 2023-12-19T13:59:16.957 INFO:teuthology.orchestra.run.smithi113.stdout:close() did not raise error 2023-12-19T13:59:17.160 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:59:17.161 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:59:17.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:59:17.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:59:17.402 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:17.402 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:17.464 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:17.464 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:17.522 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:17.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.739+0000 7fac3b3b5640 1 Processor -- start 2023-12-19T13:59:17.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.739+0000 7fac3b3b5640 1 -- start start 2023-12-19T13:59:17.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3b3b5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac341469d0 0x7fac34161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3b3b5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fac34146db0 0x7fac3406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3b3b5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac34161d40 con 0x7fac340b49e0 2023-12-19T13:59:17.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3b3b5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340b00a0 con 0x7fac34146db0 2023-12-19T13:59:17.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3b3b5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340af040 con 0x7fac341469d0 2023-12-19T13:59:17.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3abb4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fac340b49e0 0x7fac3406d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37276/0 (socket says 172.21.15.113:37276) 2023-12-19T13:59:17.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3abb4640 1 -- 172.21.15.113:0/1867256772 learned_addr learned my addr 172.21.15.113:0/1867256772 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:17.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1867256772 >> v2:172.21.15.151:3300/0 conn(0x7fac341469d0 0x7fac34161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:17.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac39bb2640 1 --2- 172.21.15.113:0/1867256772 >> v2:172.21.15.113:3300/0 conn(0x7fac34146db0 0x7fac3406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:17.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.741+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050459237 0 0) 0x7fac34161d40 con 0x7fac340b49e0 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac20003520 con 0x7fac340b49e0 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 230456270 0 0) 0x7fac20003520 con 0x7fac340b49e0 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 >> v2:172.21.15.151:3300/0 conn(0x7fac341469d0 msgr2=0x7fac34161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 --2- 172.21.15.113:0/1867256772 >> v2:172.21.15.151:3300/0 conn(0x7fac341469d0 0x7fac34161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 >> v2:172.21.15.113:3300/0 conn(0x7fac34146db0 msgr2=0x7fac3406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 --2- 172.21.15.113:0/1867256772 >> v2:172.21.15.113:3300/0 conn(0x7fac34146db0 0x7fac3406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340af2e0 con 0x7fac340b49e0 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fac2c0019f0 con 0x7fac340b49e0 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 >> v1:172.21.15.113:6789/0 conn(0x7fac340b49e0 legacy=0x7fac3406d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac200039c0 0x7fac20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac200047c0 0x7fac20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac20005180 0x7fac2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b00a0 con 0x7fac200039c0 2023-12-19T13:59:17.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340af040 con 0x7fac20005180 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2000c020 con 0x7fac200047c0 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.742+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac200039c0 0x7fac20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.743+0000 7fac3a3b3640 1 -- 172.21.15.113:0/1867256772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac200047c0 msgr2=0x7fac20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.743+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac200047c0 0x7fac20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.743+0000 7fac3a3b3640 1 -- 172.21.15.113:0/1867256772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac20005180 msgr2=0x7fac2000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.743+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac20005180 0x7fac2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.743+0000 7fac3a3b3640 1 -- 172.21.15.113:0/1867256772 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20003520 con 0x7fac200039c0 2023-12-19T13:59:17.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.743+0000 7fac3abb4640 1 -- 172.21.15.113:0/1867256772 reap_dead start 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.744+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac200039c0 0x7fac20003de0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fac3000ba30 tx=0x7fac200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf27735e71738615 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.744+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30032660 con 0x7fac200039c0 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.744+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac300327c0 con 0x7fac200039c0 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.744+0000 7fac393b1640 1 -- 172.21.15.113:0/1867256772 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30032b50 con 0x7fac200039c0 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.745+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1867256772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac200039c0 msgr2=0x7fac20003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.745+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac200039c0 0x7fac20003de0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fac3000ba30 tx=0x7fac200057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.745+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1867256772 shutdown_connections 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.745+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1867256772 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac200039c0 0x7fac20003de0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.745+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1867256772 >> 172.21.15.113:0/1867256772 conn(0x7fac340b25e0 msgr2=0x7fac340b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:17.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.745+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1867256772 shutdown_connections 2023-12-19T13:59:17.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.745+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1867256772 wait complete. 2023-12-19T13:59:17.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.747+0000 7fac3b3b5640 1 Processor -- start 2023-12-19T13:59:17.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.747+0000 7fac3b3b5640 1 -- start start 2023-12-19T13:59:17.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3b3b5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac200039c0 0x7fac3415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3b3b5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac341602d0 0x7fac3415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3b3b5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac340add20 0x7fac340ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3b3b5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3415d310 con 0x7fac340add20 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3b3b5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340ae6e0 con 0x7fac200039c0 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3b3b5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac341f6dd0 con 0x7fac341602d0 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac340add20 0x7fac340ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac340add20 0x7fac340ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:41064/0 (socket says 172.21.15.113:41064) 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 -- 172.21.15.113:0/1156807448 learned_addr learned my addr 172.21.15.113:0/1156807448 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac39bb2640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac341602d0 0x7fac3415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac200039c0 0x7fac3415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 -- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac341602d0 msgr2=0x7fac3415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac341602d0 0x7fac3415cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 -- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac200039c0 msgr2=0x7fac3415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac200039c0 0x7fac3415f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.748+0000 7fac3abb4640 1 -- 172.21.15.113:0/1156807448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34160840 con 0x7fac340add20 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.749+0000 7fac3abb4640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac340add20 0x7fac340ae1a0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fac340cfaf0 tx=0x7fac2c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.749+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c00ceb0 con 0x7fac340add20 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.749+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c007110 con 0x7fac340add20 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.749+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0074e0 con 0x7fac340add20 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.749+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac34160030 con 0x7fac340add20 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.749+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac341f62f0 con 0x7fac340add20 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.750+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac34061910 con 0x7fac340add20 2023-12-19T13:59:17.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.751+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fac2c007640 con 0x7fac340add20 2023-12-19T13:59:17.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.752+0000 7fac2affd640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac1806a430 0x7fac1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:17.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.752+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fac2c088170 con 0x7fac340add20 2023-12-19T13:59:17.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.752+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac1806a430 0x7fac1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:17.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.753+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7fac18072020 con 0x7fac340add20 2023-12-19T13:59:17.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.753+0000 7fac3a3b3640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac1806a430 0x7fac1806c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fac3000ba00 tx=0x7fac30030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:17.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.757+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fac2c01a060 con 0x7fac340add20 2023-12-19T13:59:17.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.949+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac3415d610 con 0x7fac340add20 2023-12-19T13:59:17.951 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.952+0000 7fac2affd640 1 -- 172.21.15.113:0/1156807448 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+16283 (secure 0 0 0) 0x7fac2c0537b0 con 0x7fac340add20 2023-12-19T13:59:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:17.952 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":183,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:58:53.686673+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.0","mappings":[{"from":2,"to":5}]},{"pgid":"21.11","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:17.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac1806a430 msgr2=0x7fac1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:17.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac1806a430 0x7fac1806c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fac3000ba00 tx=0x7fac30030000 comp rx=0 tx=0).stop 2023-12-19T13:59:17.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac340add20 msgr2=0x7fac340ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:17.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac340add20 0x7fac340ae1a0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fac340cfaf0 tx=0x7fac2c00cc60 comp rx=0 tx=0).stop 2023-12-19T13:59:17.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 shutdown_connections 2023-12-19T13:59:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fac1806a430 0x7fac1806c8f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac340add20 0x7fac340ae1a0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac341602d0 0x7fac3415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 --2- 172.21.15.113:0/1156807448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac200039c0 0x7fac3415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 >> 172.21.15.113:0/1156807448 conn(0x7fac340b25e0 msgr2=0x7fac3406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 shutdown_connections 2023-12-19T13:59:17.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:17.955+0000 7fac3b3b5640 1 -- 172.21.15.113:0/1156807448 wait complete. 2023-12-19T13:59:17.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:57:59.812489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:58:00.348071+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:59:17.973 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:59:18.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.185+0000 7ff3e55ab640 1 Processor -- start 2023-12-19T13:59:18.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.185+0000 7ff3e55ab640 1 -- start start 2023-12-19T13:59:18.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3e55ab640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff3e0154760 0x7ff3e015b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3e55ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 0x7ff3e00b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3e55ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff3e00b0070 0x7ff3e00b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3e55ab640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e00ccf20 con 0x7ff3e0154760 2023-12-19T13:59:18.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3e55ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e00b0a30 con 0x7ff3e00b0070 2023-12-19T13:59:18.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3e55ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00ccbd0 con 0x7ff3e00cb810 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3deffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff3e0154760 0x7ff3e015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3deffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff3e0154760 0x7ff3e015b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60760/0 (socket says 172.21.15.113:60760) 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3deffd640 1 -- 172.21.15.113:0/154660128 learned_addr learned my addr 172.21.15.113:0/154660128 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3df7fe640 1 --2- 172.21.15.113:0/154660128 >> v2:172.21.15.151:3300/0 conn(0x7ff3e00b0070 0x7ff3e00b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.187+0000 7ff3de7fc640 1 --2- 172.21.15.113:0/154660128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 0x7ff3e00b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.188+0000 7ff3deffd640 1 -- 172.21.15.113:0/154660128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 msgr2=0x7ff3e00b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.188+0000 7ff3deffd640 1 --2- 172.21.15.113:0/154660128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 0x7ff3e00b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.188+0000 7ff3deffd640 1 -- 172.21.15.113:0/154660128 >> v2:172.21.15.151:3300/0 conn(0x7ff3e00b0070 msgr2=0x7ff3e00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:18.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.188+0000 7ff3deffd640 1 --2- 172.21.15.113:0/154660128 >> v2:172.21.15.151:3300/0 conn(0x7ff3e00b0070 0x7ff3e00b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.188+0000 7ff3deffd640 1 -- 172.21.15.113:0/154660128 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0154b40 con 0x7ff3e0154760 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.189+0000 7ff3deffd640 1 --2- 172.21.15.113:0/154660128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e015b290 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ce230 tx=0x7ff3d002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a72219eac58b7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.189+0000 7ff3ddffb640 1 -- 172.21.15.113:0/154660128 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d002ee00 con 0x7ff3e0154760 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.189+0000 7ff3ddffb640 1 -- 172.21.15.113:0/154660128 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d0036440 con 0x7ff3e0154760 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.189+0000 7ff3ddffb640 1 -- 172.21.15.113:0/154660128 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00367d0 con 0x7ff3e0154760 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.189+0000 7ff3e55ab640 1 -- 172.21.15.113:0/154660128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 msgr2=0x7ff3e015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.189+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/154660128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e015b290 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ce230 tx=0x7ff3d002e050 comp rx=0 tx=0).stop 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.190+0000 7ff3e55ab640 1 -- 172.21.15.113:0/154660128 shutdown_connections 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.190+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/154660128 >> v2:172.21.15.151:3300/0 conn(0x7ff3e00b0070 0x7ff3e00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.190+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/154660128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 0x7ff3e00b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.190+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/154660128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e015b290 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.190+0000 7ff3e55ab640 1 -- 172.21.15.113:0/154660128 >> 172.21.15.113:0/154660128 conn(0x7ff3e0073150 msgr2=0x7ff3e00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:18.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.190+0000 7ff3e55ab640 1 -- 172.21.15.113:0/154660128 shutdown_connections 2023-12-19T13:59:18.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.190+0000 7ff3e55ab640 1 -- 172.21.15.113:0/154660128 wait complete. 2023-12-19T13:59:18.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.191+0000 7ff3e55ab640 1 Processor -- start 2023-12-19T13:59:18.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.192+0000 7ff3e55ab640 1 -- start start 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.192+0000 7ff3e55ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3e00b0070 0x7ff3e00b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3e55ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 0x7ff3e00b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3e55ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e01447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3e55ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e0142fd0 con 0x7ff3e0154760 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3e55ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e0145530 con 0x7ff3e00b0070 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3e55ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e0142210 con 0x7ff3e00cb810 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e01447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e01447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60764/0 (socket says 172.21.15.113:60764) 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 -- 172.21.15.113:0/2346254228 learned_addr learned my addr 172.21.15.113:0/2346254228 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 -- 172.21.15.113:0/2346254228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 msgr2=0x7ff3e00b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 0x7ff3e00b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3deffd640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3e00b0070 0x7ff3e00b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 -- 172.21.15.113:0/2346254228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3e00b0070 msgr2=0x7ff3e00b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3e00b0070 0x7ff3e00b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.193+0000 7ff3df7fe640 1 -- 172.21.15.113:0/2346254228 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d000b770 con 0x7ff3e0154760 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.194+0000 7ff3df7fe640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e01447b0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8007d50 tx=0x7ff3d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.194+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8014420 con 0x7ff3e0154760 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.194+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d80145a0 con 0x7ff3e0154760 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.194+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8014950 con 0x7ff3e0154760 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.194+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e0142670 con 0x7ff3e0154760 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.194+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e0142bf0 con 0x7ff3e0154760 2023-12-19T13:59:18.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.195+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e0143110 con 0x7ff3e0154760 2023-12-19T13:59:18.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.196+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff3d8014ab0 con 0x7ff3e0154760 2023-12-19T13:59:18.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.197+0000 7ff3c77fe640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff3cc06a460 0x7ff3cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.198+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff3d8089250 con 0x7ff3e0154760 2023-12-19T13:59:18.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.198+0000 7ff3deffd640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff3cc06a460 0x7ff3cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.198+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7ff3cc072050 con 0x7ff3e0154760 2023-12-19T13:59:18.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.198+0000 7ff3deffd640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff3cc06a460 0x7ff3cc06c920 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0038000 tx=0x7ff3d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:18.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.202+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff3e0143110 con 0x7ff3e0154760 2023-12-19T13:59:18.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.394+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3e0143110 con 0x7ff3e0154760 2023-12-19T13:59:18.394 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.395+0000 7ff3c77fe640 1 -- 172.21.15.113:0/2346254228 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3e0143110 con 0x7ff3e0154760 2023-12-19T13:59:18.394 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.398+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff3cc06a460 msgr2=0x7ff3cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.398+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff3cc06a460 0x7ff3cc06c920 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0038000 tx=0x7ff3d0008040 comp rx=0 tx=0).stop 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.398+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 msgr2=0x7ff3e01447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.398+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e01447b0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8007d50 tx=0x7ff3d800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 shutdown_connections 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff3cc06a460 0x7ff3cc06c920 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff3e0154760 0x7ff3e01447b0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3e00cb810 0x7ff3e00b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 --2- 172.21.15.113:0/2346254228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3e00b0070 0x7ff3e00b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 >> 172.21.15.113:0/2346254228 conn(0x7ff3e0073150 msgr2=0x7ff3e00ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:18.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 shutdown_connections 2023-12-19T13:59:18.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.399+0000 7ff3e55ab640 1 -- 172.21.15.113:0/2346254228 wait complete. 2023-12-19T13:59:18.416 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:59:18.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.629+0000 7f3fb0fc4640 1 Processor -- start 2023-12-19T13:59:18.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.629+0000 7f3fb0fc4640 1 -- start start 2023-12-19T13:59:18.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3fb0fc4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3fac15b140 0x7f3fac0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3fb0fc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac0d0210 0x7f3fac140b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3fb0fc4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3fac1410b0 0x7f3fac06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3fb0fc4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac0b1f90 con 0x7f3fac1410b0 2023-12-19T13:59:18.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3fb0fc4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac0d0650 con 0x7f3fac15b140 2023-12-19T13:59:18.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3fb0fc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac1418e0 con 0x7f3fac0d0210 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3faad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3fac1410b0 0x7f3fac06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3faad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3fac1410b0 0x7f3fac06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60768/0 (socket says 172.21.15.113:60768) 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3faad9d640 1 -- 172.21.15.113:0/4267501577 learned_addr learned my addr 172.21.15.113:0/4267501577 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3faa59c640 1 --2- 172.21.15.113:0/4267501577 >> v2:172.21.15.151:3300/0 conn(0x7f3fac15b140 0x7f3fac0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.631+0000 7f3fa9d9b640 1 --2- 172.21.15.113:0/4267501577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac0d0210 0x7f3fac140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.632+0000 7f3faad9d640 1 -- 172.21.15.113:0/4267501577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac0d0210 msgr2=0x7f3fac140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.632+0000 7f3faad9d640 1 --2- 172.21.15.113:0/4267501577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac0d0210 0x7f3fac140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.632+0000 7f3faad9d640 1 -- 172.21.15.113:0/4267501577 >> v2:172.21.15.151:3300/0 conn(0x7f3fac15b140 msgr2=0x7f3fac0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.632+0000 7f3faad9d640 1 --2- 172.21.15.113:0/4267501577 >> v2:172.21.15.151:3300/0 conn(0x7f3fac15b140 0x7f3fac0cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.632+0000 7f3faad9d640 1 -- 172.21.15.113:0/4267501577 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac0b21e0 con 0x7f3fac1410b0 2023-12-19T13:59:18.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.632+0000 7f3fa9d9b640 1 --2- 172.21.15.113:0/4267501577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac0d0210 0x7f3fac140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:18.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.633+0000 7f3faad9d640 1 --2- 172.21.15.113:0/4267501577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac06f160 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0d08a0 tx=0x7f3fa402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d430cdba50f392 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:18.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.633+0000 7f3fa959a640 1 -- 172.21.15.113:0/4267501577 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa402c9f0 con 0x7f3fac1410b0 2023-12-19T13:59:18.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.633+0000 7f3fa959a640 1 -- 172.21.15.113:0/4267501577 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa402cb50 con 0x7f3fac1410b0 2023-12-19T13:59:18.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.633+0000 7f3fa959a640 1 -- 172.21.15.113:0/4267501577 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40343f0 con 0x7f3fac1410b0 2023-12-19T13:59:18.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/4267501577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 msgr2=0x7f3fac06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/4267501577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac06f160 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0d08a0 tx=0x7f3fa402be50 comp rx=0 tx=0).stop 2023-12-19T13:59:18.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/4267501577 shutdown_connections 2023-12-19T13:59:18.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/4267501577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac06f160 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/4267501577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac0d0210 0x7f3fac140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/4267501577 >> v2:172.21.15.151:3300/0 conn(0x7f3fac15b140 0x7f3fac0cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/4267501577 >> 172.21.15.113:0/4267501577 conn(0x7f3fac0cc770 msgr2=0x7f3fac0ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:18.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/4267501577 shutdown_connections 2023-12-19T13:59:18.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.634+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/4267501577 wait complete. 2023-12-19T13:59:18.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.636+0000 7f3fb0fc4640 1 Processor -- start 2023-12-19T13:59:18.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.636+0000 7f3fb0fc4640 1 -- start start 2023-12-19T13:59:18.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fb0fc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fac0d0210 0x7f3fac13c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fb0fc4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fb0fc4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac15b140 0x7f3fac1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fb0fc4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac13c540 con 0x7f3fac1410b0 2023-12-19T13:59:18.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fb0fc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac157af0 con 0x7f3fac0d0210 2023-12-19T13:59:18.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fb0fc4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac159720 con 0x7f3fac15b140 2023-12-19T13:59:18.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fa9d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fa9d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60784/0 (socket says 172.21.15.113:60784) 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3fa9d9b640 1 -- 172.21.15.113:0/3747871910 learned_addr learned my addr 172.21.15.113:0/3747871910 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.638+0000 7f3faa59c640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fac0d0210 0x7f3fac13c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fa9d9b640 1 -- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac15b140 msgr2=0x7f3fac1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3faad9d640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac15b140 0x7f3fac1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fa9d9b640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac15b140 0x7f3fac1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fa9d9b640 1 -- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fac0d0210 msgr2=0x7f3fac13c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fa9d9b640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fac0d0210 0x7f3fac13c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fa9d9b640 1 -- 172.21.15.113:0/3747871910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4009b30 con 0x7f3fac1410b0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fa9d9b640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac158bb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c7f0 tx=0x7f3fa000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0007820 con 0x7f3fac1410b0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa0007980 con 0x7f3fac1410b0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0007cf0 con 0x7f3fac1410b0 2023-12-19T13:59:18.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac159a00 con 0x7f3fac1410b0 2023-12-19T13:59:18.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.639+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac159fc0 con 0x7f3fac1410b0 2023-12-19T13:59:18.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.641+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac061910 con 0x7f3fac1410b0 2023-12-19T13:59:18.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.641+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3fa00113f0 con 0x7f3fac1410b0 2023-12-19T13:59:18.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.642+0000 7f3f9affd640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3f8c06a430 0x7f3f8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:18.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.642+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3fa0088c80 con 0x7f3fac1410b0 2023-12-19T13:59:18.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.643+0000 7f3faa59c640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3f8c06a430 0x7f3f8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:18.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.643+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7f3f8c072020 con 0x7f3fac1410b0 2023-12-19T13:59:18.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.643+0000 7f3faa59c640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3f8c06a430 0x7f3f8c06c8f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c006fd0 tx=0x7f3f9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:18.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.647+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3fa001f060 con 0x7f3fac1410b0 2023-12-19T13:59:18.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.841+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fac0b2770 con 0x7f3fac1410b0 2023-12-19T13:59:18.841 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.841+0000 7f3f9affd640 1 -- 172.21.15.113:0/3747871910 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fa001f0a0 con 0x7f3fac1410b0 2023-12-19T13:59:18.841 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:59:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3f8c06a430 msgr2=0x7f3f8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3f8c06a430 0x7f3f8c06c8f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c006fd0 tx=0x7f3f9c008040 comp rx=0 tx=0).stop 2023-12-19T13:59:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 msgr2=0x7f3fac158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:18.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac158bb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c7f0 tx=0x7f3fa000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 shutdown_connections 2023-12-19T13:59:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3f8c06a430 0x7f3f8c06c8f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fac15b140 0x7f3fac1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.844+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3fac1410b0 0x7f3fac158bb0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.845+0000 7f3fb0fc4640 1 --2- 172.21.15.113:0/3747871910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fac0d0210 0x7f3fac13c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.845+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 >> 172.21.15.113:0/3747871910 conn(0x7f3fac0cc770 msgr2=0x7f3fac15e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:18.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.845+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 shutdown_connections 2023-12-19T13:59:18.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:18.845+0000 7f3fb0fc4640 1 -- 172.21.15.113:0/3747871910 wait complete. 2023-12-19T13:59:18.863 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:59:19.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.080+0000 7fdd8d377640 1 Processor -- start 2023-12-19T13:59:19.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.080+0000 7fdd8d377640 1 -- start start 2023-12-19T13:59:19.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.082+0000 7fdd8d377640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdd880ad300 0x7fdd880ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.082+0000 7fdd8d377640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8815da00 con 0x7fdd880cce30 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.082+0000 7fdd8d377640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8815dcc0 con 0x7fdd88157c30 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.082+0000 7fdd8d377640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8815e940 con 0x7fdd880ad300 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.082+0000 7fdd877fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdd880cce30 0x7fdd880cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40574/0 (socket says 172.21.15.113:40574) 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.082+0000 7fdd877fe640 1 -- 172.21.15.113:0/3946723037 learned_addr learned my addr 172.21.15.113:0/3946723037 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd867fc640 1 --2- 172.21.15.113:0/3946723037 >> v2:172.21.15.151:3300/0 conn(0x7fdd880ad300 0x7fdd880ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790425087 0 0) 0x7fdd8815da00 con 0x7fdd880cce30 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd70003520 con 0x7fdd880cce30 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1503097900 0 0) 0x7fdd70003520 con 0x7fdd880cce30 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 >> v2:172.21.15.151:3300/0 conn(0x7fdd880ad300 msgr2=0x7fdd880ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 --2- 172.21.15.113:0/3946723037 >> v2:172.21.15.151:3300/0 conn(0x7fdd880ad300 0x7fdd880ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 >> v1:172.21.15.151:6789/0 conn(0x7fdd88157c30 legacy=0x7fdd880cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8815dfa0 con 0x7fdd880cce30 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fdd800019f0 con 0x7fdd880cce30 2023-12-19T13:59:19.083 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 >> v1:172.21.15.113:6789/0 conn(0x7fdd880cce30 legacy=0x7fdd880cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd70003a30 0x7fdd70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd700047c0 0x7fdd70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd700052a0 0x7fdd7000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8815e940 con 0x7fdd70003a30 2023-12-19T13:59:19.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7000c1a0 con 0x7fdd700052a0 2023-12-19T13:59:19.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7000c360 con 0x7fdd700047c0 2023-12-19T13:59:19.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.083+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd70003a30 0x7fdd70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.084+0000 7fdd86ffd640 1 -- 172.21.15.113:0/3946723037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd700047c0 msgr2=0x7fdd70004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:19.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.084+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd700047c0 0x7fdd70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.084+0000 7fdd86ffd640 1 -- 172.21.15.113:0/3946723037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd700052a0 msgr2=0x7fdd7000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:19.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.084+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd700052a0 0x7fdd7000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.084+0000 7fdd86ffd640 1 -- 172.21.15.113:0/3946723037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70003520 con 0x7fdd70003a30 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.084+0000 7fdd877fe640 1 -- 172.21.15.113:0/3946723037 reap_dead start 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.085+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd70003a30 0x7fdd70003e70 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001750 tx=0x7fdd700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9199dc33d25c222 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.085+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780052d0 con 0x7fdd70003a30 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.085+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7802e050 con 0x7fdd70003a30 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.085+0000 7fdd85ffb640 1 -- 172.21.15.113:0/3946723037 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78003830 con 0x7fdd70003a30 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.086+0000 7fdd8d377640 1 -- 172.21.15.113:0/3946723037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd70003a30 msgr2=0x7fdd70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.086+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd70003a30 0x7fdd70003e70 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001750 tx=0x7fdd700057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.086+0000 7fdd8d377640 1 -- 172.21.15.113:0/3946723037 shutdown_connections 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.086+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3946723037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd70003a30 0x7fdd70003e70 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.086+0000 7fdd8d377640 1 -- 172.21.15.113:0/3946723037 >> 172.21.15.113:0/3946723037 conn(0x7fdd88073150 msgr2=0x7fdd880659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.086+0000 7fdd8d377640 1 -- 172.21.15.113:0/3946723037 shutdown_connections 2023-12-19T13:59:19.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.086+0000 7fdd8d377640 1 -- 172.21.15.113:0/3946723037 wait complete. 2023-12-19T13:59:19.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.088+0000 7fdd8d377640 1 Processor -- start 2023-12-19T13:59:19.087 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.089+0000 7fdd8d377640 1 -- start start 2023-12-19T13:59:19.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd8d377640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd70003a30 0x7fdd88150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd8d377640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd8806b740 0x7fdd8806c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd8d377640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd8806ca70 0x7fdd8815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd8d377640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881582d0 con 0x7fdd8806ca70 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd8d377640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8806cef0 con 0x7fdd70003a30 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd8d377640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88158520 con 0x7fdd8806b740 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd877fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd8806ca70 0x7fdd8815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd877fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd8806ca70 0x7fdd8815aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60796/0 (socket says 172.21.15.113:60796) 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.090+0000 7fdd877fe640 1 -- 172.21.15.113:0/3645799731 learned_addr learned my addr 172.21.15.113:0/3645799731 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd867fc640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd8806b740 0x7fdd8806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd70003a30 0x7fdd88150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd877fe640 1 -- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd8806b740 msgr2=0x7fdd8806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd877fe640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd8806b740 0x7fdd8806c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd877fe640 1 -- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd70003a30 msgr2=0x7fdd88150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd877fe640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd70003a30 0x7fdd88150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd877fe640 1 -- 172.21.15.113:0/3645799731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88158800 con 0x7fdd8806ca70 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd867fc640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd8806b740 0x7fdd8806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:19.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd70003a30 0x7fdd88150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd877fe640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd8806ca70 0x7fdd8815aa70 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fdd880b11b0 tx=0x7fdd8000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000cea0 con 0x7fdd8806ca70 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8000a610 con 0x7fdd8806ca70 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000a9c0 con 0x7fdd8806ca70 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.091+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd88158ae0 con 0x7fdd8806ca70 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.092+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd881f2ff0 con 0x7fdd8806ca70 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.093+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd88158cd0 con 0x7fdd8806ca70 2023-12-19T13:59:19.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.094+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd8000ab20 con 0x7fdd8806ca70 2023-12-19T13:59:19.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.094+0000 7fdd6f7fe640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdd7406a430 0x7fdd7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.095+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdd800884f0 con 0x7fdd8806ca70 2023-12-19T13:59:19.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.095+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7fdd74072020 con 0x7fdd8806ca70 2023-12-19T13:59:19.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.095+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdd7406a430 0x7fdd7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.094 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.096+0000 7fdd86ffd640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdd7406a430 0x7fdd7406c8f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdd78033000 tx=0x7fdd78009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:19.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.100+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdd80053b30 con 0x7fdd8806ca70 2023-12-19T13:59:19.289 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.290+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd88061910 con 0x7fdd8806ca70 2023-12-19T13:59:19.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.291+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/3645799731 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd8001a030 con 0x7fdd8806ca70 2023-12-19T13:59:19.290 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:59:19.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.293+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdd7406a430 msgr2=0x7fdd7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.293+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdd7406a430 0x7fdd7406c8f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdd78033000 tx=0x7fdd78009030 comp rx=0 tx=0).stop 2023-12-19T13:59:19.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd8806ca70 msgr2=0x7fdd8815aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd8806ca70 0x7fdd8815aa70 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fdd880b11b0 tx=0x7fdd8000cc50 comp rx=0 tx=0).stop 2023-12-19T13:59:19.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 shutdown_connections 2023-12-19T13:59:19.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdd7406a430 0x7fdd7406c8f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd8806ca70 0x7fdd8815aa70 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd8806b740 0x7fdd8806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 --2- 172.21.15.113:0/3645799731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd70003a30 0x7fdd88150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 >> 172.21.15.113:0/3645799731 conn(0x7fdd88073150 msgr2=0x7fdd880b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:19.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 shutdown_connections 2023-12-19T13:59:19.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.294+0000 7fdd8d377640 1 -- 172.21.15.113:0/3645799731 wait complete. 2023-12-19T13:59:19.313 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:59:19.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.526+0000 7f7f2d7dc640 1 Processor -- start 2023-12-19T13:59:19.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.527+0000 7f7f2d7dc640 1 -- start start 2023-12-19T13:59:19.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.528+0000 7f7f2d7dc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7f28155460 0x7f7f280b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.528+0000 7f7f2d7dc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2815c9c0 con 0x7f7f280b0830 2023-12-19T13:59:19.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.528+0000 7f7f2d7dc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2806d270 con 0x7f7f2806cc50 2023-12-19T13:59:19.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.528+0000 7f7f2d7dc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280b0ce0 con 0x7f7f28155460 2023-12-19T13:59:19.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.528+0000 7f7f27fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7f28155460 0x7f7f280b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.529+0000 7f7f27fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7f28155460 0x7f7f280b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60810/0 (socket says 172.21.15.113:60810) 2023-12-19T13:59:19.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.529+0000 7f7f27fff640 1 -- 172.21.15.113:0/3864038351 learned_addr learned my addr 172.21.15.113:0/3864038351 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:19.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.529+0000 7f7f27fff640 1 -- 172.21.15.113:0/3864038351 >> v1:172.21.15.151:6789/0 conn(0x7f7f2806cc50 legacy=0x7f7f280cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:19.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.529+0000 7f7f27fff640 1 -- 172.21.15.113:0/3864038351 >> v1:172.21.15.113:6789/0 conn(0x7f7f280b0830 legacy=0x7f7f2806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.529+0000 7f7f27fff640 1 -- 172.21.15.113:0/3864038351 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2806d550 con 0x7f7f28155460 2023-12-19T13:59:19.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.529+0000 7f7f277fe640 1 -- 172.21.15.113:0/3864038351 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891595836 0 0) 0x7f7f2815c9c0 con 0x7f7f280b0830 2023-12-19T13:59:19.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.530+0000 7f7f27fff640 1 --2- 172.21.15.113:0/3864038351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f28155460 0x7f7f280b02f0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009870 tx=0x7f7f1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cae9ac603d2939 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:19.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.530+0000 7f7f277fe640 1 -- 172.21.15.113:0/3864038351 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18030860 con 0x7f7f28155460 2023-12-19T13:59:19.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f277fe640 1 -- 172.21.15.113:0/3864038351 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180309c0 con 0x7f7f28155460 2023-12-19T13:59:19.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f277fe640 1 -- 172.21.15.113:0/3864038351 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18030d50 con 0x7f7f28155460 2023-12-19T13:59:19.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/3864038351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f28155460 msgr2=0x7f7f280b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/3864038351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f28155460 0x7f7f280b02f0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009870 tx=0x7f7f1802b9a0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/3864038351 shutdown_connections 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/3864038351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f28155460 0x7f7f280b02f0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/3864038351 >> 172.21.15.113:0/3864038351 conn(0x7f7f280659a0 msgr2=0x7f7f28065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/3864038351 shutdown_connections 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.531+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/3864038351 wait complete. 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.533+0000 7f7f2d7dc640 1 Processor -- start 2023-12-19T13:59:19.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.533+0000 7f7f2d7dc640 1 -- start start 2023-12-19T13:59:19.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f2d7dc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f2806cc50 0x7f7f280b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f2d7dc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f280b0830 0x7f7f28158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f2d7dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f28155460 0x7f7f28141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f2d7dc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281589d0 con 0x7f7f280b0830 2023-12-19T13:59:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f2d7dc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280cbe70 con 0x7f7f28155460 2023-12-19T13:59:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f2d7dc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280cc110 con 0x7f7f2806cc50 2023-12-19T13:59:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f280b0830 0x7f7f28158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f280b0830 0x7f7f28158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60816/0 (socket says 172.21.15.113:60816) 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.534+0000 7f7f1ffff640 1 -- 172.21.15.113:0/341232166 learned_addr learned my addr 172.21.15.113:0/341232166 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f27fff640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f2806cc50 0x7f7f280b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f1ffff640 1 -- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f2806cc50 msgr2=0x7f7f280b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f2cfdb640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f28155460 0x7f7f28141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f1ffff640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f2806cc50 0x7f7f280b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f1ffff640 1 -- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f28155460 msgr2=0x7f7f28141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f1ffff640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f28155460 0x7f7f28141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f1ffff640 1 -- 172.21.15.113:0/341232166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180094d0 con 0x7f7f280b0830 2023-12-19T13:59:19.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f27fff640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f2806cc50 0x7f7f280b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:19.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f1ffff640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f280b0830 0x7f7f28158490 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000c4b0 tx=0x7f7f1000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:19.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10005480 con 0x7f7f280b0830 2023-12-19T13:59:19.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f100035f0 con 0x7f7f280b0830 2023-12-19T13:59:19.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.535+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100039e0 con 0x7f7f280b0830 2023-12-19T13:59:19.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.536+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280ce850 con 0x7f7f280b0830 2023-12-19T13:59:19.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.536+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280cee10 con 0x7f7f280b0830 2023-12-19T13:59:19.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.537+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f28061910 con 0x7f7f280b0830 2023-12-19T13:59:19.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.538+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f10003b40 con 0x7f7f280b0830 2023-12-19T13:59:19.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.539+0000 7f7f257fa640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f0806a460 0x7f7f0806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:19.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.539+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7f10087fd0 con 0x7f7f280b0830 2023-12-19T13:59:19.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.539+0000 7f7f27fff640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f0806a460 0x7f7f0806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:19.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.539+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7f7f08072050 con 0x7f7f280b0830 2023-12-19T13:59:19.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.540+0000 7f7f27fff640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f0806a460 0x7f7f0806c920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7f18036000 tx=0x7f7f1803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:19.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.543+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f10017030 con 0x7f7f280b0830 2023-12-19T13:59:19.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.745+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f280afaf0 con 0x7f7f280b0830 2023-12-19T13:59:19.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.746+0000 7f7f257fa640 1 -- 172.21.15.113:0/341232166 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v183) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f10017070 con 0x7f7f280b0830 2023-12-19T13:59:19.745 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f0806a460 msgr2=0x7f7f0806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f0806a460 0x7f7f0806c920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7f18036000 tx=0x7f7f1803b040 comp rx=0 tx=0).stop 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f280b0830 msgr2=0x7f7f28158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f280b0830 0x7f7f28158490 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000c4b0 tx=0x7f7f1000c970 comp rx=0 tx=0).stop 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 shutdown_connections 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7f0806a460 0x7f7f0806c920 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f28155460 0x7f7f28141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f280b0830 0x7f7f28158490 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 --2- 172.21.15.113:0/341232166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f2806cc50 0x7f7f280b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.748+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 >> 172.21.15.113:0/341232166 conn(0x7f7f280659a0 msgr2=0x7f7f2815ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.749+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 shutdown_connections 2023-12-19T13:59:19.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:19.749+0000 7f7f2d7dc640 1 -- 172.21.15.113:0/341232166 wait complete. 2023-12-19T13:59:19.767 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:59:19.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:19.768 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T13:59:19.866 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T13:59:19.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:19.866 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:59:19.914 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:59:19.914 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:19.974 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:59:19.974 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:20.029 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:20.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.244+0000 7f3c6a139640 1 Processor -- start 2023-12-19T13:59:20.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.244+0000 7f3c6a139640 1 -- start start 2023-12-19T13:59:20.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.246+0000 7f3c6a139640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 0x7f3c64164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.246+0000 7f3c6a139640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640ae640 con 0x7f3c64157bf0 2023-12-19T13:59:20.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.246+0000 7f3c6a139640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640ae920 con 0x7f3c640ae110 2023-12-19T13:59:20.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.246+0000 7f3c6a139640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6406b8c0 con 0x7f3c640b0810 2023-12-19T13:59:20.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.246+0000 7f3c637fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3c64157bf0 0x7f3c6415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40588/0 (socket says 172.21.15.113:40588) 2023-12-19T13:59:20.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.246+0000 7f3c637fe640 1 -- 172.21.15.113:0/569583604 learned_addr learned my addr 172.21.15.113:0/569583604 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272099001 0 0) 0x7f3c640ae640 con 0x7f3c64157bf0 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c50003520 con 0x7f3c64157bf0 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c63fff640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 0x7f3c64164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479626255 0 0) 0x7f3c50003520 con 0x7f3c64157bf0 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 msgr2=0x7f3c64164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 0x7f3c64164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 >> v1:172.21.15.151:6789/0 conn(0x7f3c640ae110 legacy=0x7f3c640b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:20.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c640aec00 con 0x7f3c64157bf0 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f3c54001670 con 0x7f3c64157bf0 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 >> v1:172.21.15.113:6789/0 conn(0x7f3c64157bf0 legacy=0x7f3c6415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 0x7f3c50003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c50004070 0x7f3c500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6406b8c0 con 0x7f3c50004070 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5000bbc0 con 0x7f3c50004d50 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5000bd80 con 0x7f3c640b0810 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.247+0000 7f3c5bfff640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c50004070 0x7f3c500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c637fe640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 0x7f3c50003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c5bfff640 1 -- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 msgr2=0x7f3c50003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c63fff640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c5bfff640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c640b0810 0x7f3c50003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c5bfff640 1 -- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004d50 msgr2=0x7f3c500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c5bfff640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c5bfff640 1 -- 172.21.15.113:0/569583604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c50003520 con 0x7f3c50004070 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.248+0000 7f3c63fff640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.249+0000 7f3c5bfff640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c50004070 0x7f3c500047c0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c003d80 tx=0x7f3c500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eff6d2daab53fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.249+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c032600 con 0x7f3c50004070 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.249+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c02e050 con 0x7f3c50004070 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.249+0000 7f3c62ffd640 1 -- 172.21.15.113:0/569583604 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0329e0 con 0x7f3c50004070 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.250+0000 7f3c6a139640 1 -- 172.21.15.113:0/569583604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c50004070 msgr2=0x7f3c500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.250+0000 7f3c6a139640 1 --2- 172.21.15.113:0/569583604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c50004070 0x7f3c500047c0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c003d80 tx=0x7f3c500057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.250+0000 7f3c63fff640 1 -- 172.21.15.113:0/569583604 reap_dead start 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.250+0000 7f3c6a139640 1 -- 172.21.15.113:0/569583604 shutdown_connections 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.250+0000 7f3c6a139640 1 -- 172.21.15.113:0/569583604 >> 172.21.15.113:0/569583604 conn(0x7f3c640cbb70 msgr2=0x7f3c640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.250+0000 7f3c6a139640 1 -- 172.21.15.113:0/569583604 shutdown_connections 2023-12-19T13:59:20.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.250+0000 7f3c6a139640 1 -- 172.21.15.113:0/569583604 wait complete. 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.252+0000 7f3c6a139640 1 Processor -- start 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.252+0000 7f3c6a139640 1 -- start start 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c6a139640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004070 0x7f3c6415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c6a139640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c641f6af0 0x7f3c6414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c6a139640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c64154a50 0x7f3c64154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c6a139640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64156360 con 0x7f3c64154a50 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c6a139640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64155da0 con 0x7f3c50004070 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c6a139640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64156080 con 0x7f3c641f6af0 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c64154a50 0x7f3c64154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c64154a50 0x7f3c64154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60830/0 (socket says 172.21.15.113:60830) 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 -- 172.21.15.113:0/131801806 learned_addr learned my addr 172.21.15.113:0/131801806 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 -- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c641f6af0 msgr2=0x7f3c6414c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c5bfff640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c641f6af0 0x7f3c6414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c641f6af0 0x7f3c6414c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.256 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 -- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004070 msgr2=0x7f3c6415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c637fe640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004070 0x7f3c6415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004070 0x7f3c6415a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.253+0000 7f3c63fff640 1 -- 172.21.15.113:0/131801806 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64154250 con 0x7f3c64154a50 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.254+0000 7f3c63fff640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c64154a50 0x7f3c64154ed0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406ea30 tx=0x7f3c5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.254+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c007cf0 con 0x7f3c64154a50 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.254+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c007e70 con 0x7f3c64154a50 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.254+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c014620 con 0x7f3c64154a50 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.254+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c64154530 con 0x7f3c64154a50 2023-12-19T13:59:20.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.254+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6414c540 con 0x7f3c64154a50 2023-12-19T13:59:20.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.255+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c64154720 con 0x7f3c64154a50 2023-12-19T13:59:20.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.256+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3c5c01d3b0 con 0x7f3c64154a50 2023-12-19T13:59:20.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.257+0000 7f3c60ff9640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3c4406a460 0x7f3c4406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.257+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c5c0887a0 con 0x7f3c64154a50 2023-12-19T13:59:20.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.257+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7f3c44072050 con 0x7f3c64154a50 2023-12-19T13:59:20.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.257+0000 7f3c637fe640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3c4406a460 0x7f3c4406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.258+0000 7f3c637fe640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3c4406a460 0x7f3c4406c920 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3c54001eb0 tx=0x7f3c54000f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:20.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.262+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3c5c019060 con 0x7f3c64154a50 2023-12-19T13:59:20.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.449+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c64061910 con 0x7f3c64154a50 2023-12-19T13:59:20.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.452+0000 7f3c60ff9640 1 -- 172.21.15.113:0/131801806 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+16283 (secure 0 0 0) 0x7f3c5c0577d0 con 0x7f3c64154a50 2023-12-19T13:59:20.453 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:20.453 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":183,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:58:53.686673+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.0","mappings":[{"from":2,"to":5}]},{"pgid":"21.11","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:20.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3c4406a460 msgr2=0x7f3c4406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3c4406a460 0x7f3c4406c920 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3c54001eb0 tx=0x7f3c54000f50 comp rx=0 tx=0).stop 2023-12-19T13:59:20.454 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c64154a50 msgr2=0x7f3c64154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c64154a50 0x7f3c64154ed0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406ea30 tx=0x7f3c5c009da0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 shutdown_connections 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3c4406a460 0x7f3c4406c920 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c64154a50 0x7f3c64154ed0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c641f6af0 0x7f3c6414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 --2- 172.21.15.113:0/131801806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c50004070 0x7f3c6415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 >> 172.21.15.113:0/131801806 conn(0x7f3c640cbb70 msgr2=0x7f3c6415dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 shutdown_connections 2023-12-19T13:59:20.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.455+0000 7f3c6a139640 1 -- 172.21.15.113:0/131801806 wait complete. 2023-12-19T13:59:20.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:57:59.812489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:58:00.348071+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:59:20.479 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:59:20.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.685+0000 7fa5e9ba9640 1 Processor -- start 2023-12-19T13:59:20.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.685+0000 7fa5e9ba9640 1 -- start start 2023-12-19T13:59:20.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.686+0000 7fa5e9ba9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5e40cd4e0 0x7fa5e415e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.686+0000 7fa5e9ba9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa5e40b0470 0x7fa5e415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.686+0000 7fa5e9ba9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e415dae0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.686+0000 7fa5e9ba9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e415b000 con 0x7fa5e40b0470 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.686+0000 7fa5e9ba9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e415b2e0 con 0x7fa5e40cd4e0 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa5e415a4f0 0x7fa5e40afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40600/0 (socket says 172.21.15.113:40600) 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e3fff640 1 -- 172.21.15.113:0/2407561965 learned_addr learned my addr 172.21.15.113:0/2407561965 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e93a8640 1 --2- 172.21.15.113:0/2407561965 >> v2:172.21.15.113:3300/0 conn(0x7fa5e40b0470 0x7fa5e415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e8ba7640 1 --2- 172.21.15.113:0/2407561965 >> v2:172.21.15.151:3300/0 conn(0x7fa5e40cd4e0 0x7fa5e415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e37fe640 1 -- 172.21.15.113:0/2407561965 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205761162 0 0) 0x7fa5e415dae0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e37fe640 1 -- 172.21.15.113:0/2407561965 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d4003520 con 0x7fa5e415a4f0 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e93a8640 1 -- 172.21.15.113:0/2407561965 >> v2:172.21.15.151:3300/0 conn(0x7fa5e40cd4e0 msgr2=0x7fa5e415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e93a8640 1 --2- 172.21.15.113:0/2407561965 >> v2:172.21.15.151:3300/0 conn(0x7fa5e40cd4e0 0x7fa5e415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e93a8640 1 -- 172.21.15.113:0/2407561965 >> v1:172.21.15.113:6789/0 conn(0x7fa5e415a4f0 legacy=0x7fa5e40afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.687+0000 7fa5e93a8640 1 -- 172.21.15.113:0/2407561965 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e415dd80 con 0x7fa5e40b0470 2023-12-19T13:59:20.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.689+0000 7fa5e93a8640 1 --2- 172.21.15.113:0/2407561965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e40b0470 0x7fa5e415a9a0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40ccbc0 tx=0x7fa5dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67df9835718712c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:20.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.689+0000 7fa5e37fe640 1 -- 172.21.15.113:0/2407561965 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc02cc80 con 0x7fa5e40b0470 2023-12-19T13:59:20.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.689+0000 7fa5e37fe640 1 -- 172.21.15.113:0/2407561965 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc02cde0 con 0x7fa5e40b0470 2023-12-19T13:59:20.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.689+0000 7fa5e37fe640 1 -- 172.21.15.113:0/2407561965 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc034660 con 0x7fa5e40b0470 2023-12-19T13:59:20.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/2407561965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e40b0470 msgr2=0x7fa5e415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/2407561965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e40b0470 0x7fa5e415a9a0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40ccbc0 tx=0x7fa5dc02bed0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/2407561965 shutdown_connections 2023-12-19T13:59:20.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/2407561965 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e40b0470 0x7fa5e415a9a0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/2407561965 >> v2:172.21.15.151:3300/0 conn(0x7fa5e40cd4e0 0x7fa5e415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/2407561965 >> 172.21.15.113:0/2407561965 conn(0x7fa5e406f630 msgr2=0x7fa5e406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:20.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/2407561965 shutdown_connections 2023-12-19T13:59:20.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.690+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/2407561965 wait complete. 2023-12-19T13:59:20.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.692+0000 7fa5e9ba9640 1 Processor -- start 2023-12-19T13:59:20.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.692+0000 7fa5e9ba9640 1 -- start start 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e9ba9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5e40b0470 0x7fa5e40c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e9ba9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5e40cd4e0 0x7fa5e40659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e9ba9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e415a4f0 0x7fa5e4065f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e9ba9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40cbf10 con 0x7fa5e415a4f0 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e9ba9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40c3db0 con 0x7fa5e40b0470 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e9ba9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40c4650 con 0x7fa5e40cd4e0 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e93a8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e415a4f0 0x7fa5e4065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e93a8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e415a4f0 0x7fa5e4065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60848/0 (socket says 172.21.15.113:60848) 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e93a8640 1 -- 172.21.15.113:0/1625906400 learned_addr learned my addr 172.21.15.113:0/1625906400 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e3fff640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5e40cd4e0 0x7fa5e40659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e8ba7640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5e40b0470 0x7fa5e40c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e93a8640 1 -- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5e40cd4e0 msgr2=0x7fa5e40659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e93a8640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5e40cd4e0 0x7fa5e40659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e93a8640 1 -- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5e40b0470 msgr2=0x7fa5e40c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.693+0000 7fa5e93a8640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5e40b0470 0x7fa5e40c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.694+0000 7fa5e93a8640 1 -- 172.21.15.113:0/1625906400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009a70 con 0x7fa5e415a4f0 2023-12-19T13:59:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.694+0000 7fa5e93a8640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e415a4f0 0x7fa5e4065f10 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009e80 tx=0x7fa5dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.694+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc040650 con 0x7fa5e415a4f0 2023-12-19T13:59:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.694+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc0407b0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.694+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc040b60 con 0x7fa5e415a4f0 2023-12-19T13:59:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.694+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e414b570 con 0x7fa5e415a4f0 2023-12-19T13:59:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.694+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e40c42e0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.695+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e40674e0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.696+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5dc040cc0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.697+0000 7fa5e17fa640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa5c806a430 0x7fa5c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.697+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa5dc0ab6b0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.697+0000 7fa5e8ba7640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa5c806a430 0x7fa5c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.698+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7fa5c8072020 con 0x7fa5e415a4f0 2023-12-19T13:59:20.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.698+0000 7fa5e8ba7640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa5c806a430 0x7fa5c806c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8006fd0 tx=0x7fa5d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:20.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.701+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5dc076bc0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.889+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5e40ad8f0 con 0x7fa5e415a4f0 2023-12-19T13:59:20.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.890+0000 7fa5e17fa640 1 -- 172.21.15.113:0/1625906400 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5dc044020 con 0x7fa5e415a4f0 2023-12-19T13:59:20.889 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:59:20.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa5c806a430 msgr2=0x7fa5c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa5c806a430 0x7fa5c806c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8006fd0 tx=0x7fa5d8008040 comp rx=0 tx=0).stop 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e415a4f0 msgr2=0x7fa5e4065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e415a4f0 0x7fa5e4065f10 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009e80 tx=0x7fa5dc004a40 comp rx=0 tx=0).stop 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 shutdown_connections 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa5c806a430 0x7fa5c806c8f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5e415a4f0 0x7fa5e4065f10 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5e40cd4e0 0x7fa5e40659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 --2- 172.21.15.113:0/1625906400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5e40b0470 0x7fa5e40c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 >> 172.21.15.113:0/1625906400 conn(0x7fa5e406f630 msgr2=0x7fa5e415e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 shutdown_connections 2023-12-19T13:59:20.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:20.893+0000 7fa5e9ba9640 1 -- 172.21.15.113:0/1625906400 wait complete. 2023-12-19T13:59:20.910 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:59:21.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.115+0000 7f97ac069640 1 Processor -- start 2023-12-19T13:59:21.115 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.115+0000 7f97ac069640 1 -- start start 2023-12-19T13:59:21.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.117+0000 7f97ac069640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 0x7f97a40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.117+0000 7f97ac069640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a40cd840 con 0x7f97a40d2b00 2023-12-19T13:59:21.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.117+0000 7f97ac069640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a40b6e90 con 0x7f97a4146e10 2023-12-19T13:59:21.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.117+0000 7f97ac069640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40d2430 con 0x7f97a40ce820 2023-12-19T13:59:21.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.117+0000 7f97a9604640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f97a40d2b00 0x7f97a40ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40602/0 (socket says 172.21.15.113:40602) 2023-12-19T13:59:21.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.117+0000 7f97a9604640 1 -- 172.21.15.113:0/1431664958 learned_addr learned my addr 172.21.15.113:0/1431664958 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:21.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97aa606640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 0x7f97a40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746068287 0 0) 0x7f97a40cd840 con 0x7f97a40d2b00 2023-12-19T13:59:21.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f978c003520 con 0x7f97a40d2b00 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1306013572 0 0) 0x7f978c003520 con 0x7f97a40d2b00 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 msgr2=0x7f97a40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 0x7f97a40d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 >> v1:172.21.15.151:6789/0 conn(0x7f97a4146e10 legacy=0x7f97a40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a40d2620 con 0x7f97a40d2b00 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f97a0001670 con 0x7f97a40d2b00 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 >> v1:172.21.15.113:6789/0 conn(0x7f97a40d2b00 legacy=0x7f97a40ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.118+0000 7f97a8e03640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 0x7f978c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a8e03640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978c003fe0 0x7f978c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a8e03640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f978c004d00 0x7f978c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00bb90 con 0x7f978c004d00 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00bd00 con 0x7f978c003fe0 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00bec0 con 0x7f97a40ce820 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97aa606640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f978c004d00 0x7f978c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a9e05640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 0x7f978c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a9604640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978c003fe0 0x7f978c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97aa606640 1 -- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 msgr2=0x7f978c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97aa606640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 0x7f978c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97aa606640 1 -- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978c003fe0 msgr2=0x7f978c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:21.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97aa606640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978c003fe0 0x7f978c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97aa606640 1 -- 172.21.15.113:0/1431664958 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c003520 con 0x7f978c004d00 2023-12-19T13:59:21.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.119+0000 7f97a9e05640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a40ce820 0x7f978c003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:59:21.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.121+0000 7f97aa606640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f978c004d00 0x7f978c005180 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f979c009fc0 tx=0x7f978c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a9691c81c35113 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:21.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.121+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c02cc20 con 0x7f978c004d00 2023-12-19T13:59:21.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.121+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00f040 con 0x7f978c004d00 2023-12-19T13:59:21.123 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.121+0000 7f97a8e03640 1 -- 172.21.15.113:0/1431664958 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c034440 con 0x7f978c004d00 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.122+0000 7f97ac069640 1 -- 172.21.15.113:0/1431664958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f978c004d00 msgr2=0x7f978c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.122+0000 7f97ac069640 1 --2- 172.21.15.113:0/1431664958 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f978c004d00 0x7f978c005180 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f979c009fc0 tx=0x7f978c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.122+0000 7f97aa606640 1 -- 172.21.15.113:0/1431664958 reap_dead start 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.122+0000 7f97ac069640 1 -- 172.21.15.113:0/1431664958 shutdown_connections 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.122+0000 7f97ac069640 1 -- 172.21.15.113:0/1431664958 >> 172.21.15.113:0/1431664958 conn(0x7f97a40b29c0 msgr2=0x7f97a40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.122+0000 7f97ac069640 1 -- 172.21.15.113:0/1431664958 shutdown_connections 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.122+0000 7f97ac069640 1 -- 172.21.15.113:0/1431664958 wait complete. 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.124+0000 7f97ac069640 1 Processor -- start 2023-12-19T13:59:21.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.124+0000 7f97ac069640 1 -- start start 2023-12-19T13:59:21.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97ac069640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a413ae50 0x7f97a415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97ac069640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a413b230 0x7f97a415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97ac069640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97a415ccd0 0x7f97a415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97ac069640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a41430a0 con 0x7f97a415ccd0 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97ac069640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4143340 con 0x7f97a413b230 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97ac069640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4143620 con 0x7f97a413ae50 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97aa606640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97a415ccd0 0x7f97a415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97aa606640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97a415ccd0 0x7f97a415eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60866/0 (socket says 172.21.15.113:60866) 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97aa606640 1 -- 172.21.15.113:0/711454431 learned_addr learned my addr 172.21.15.113:0/711454431 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97a9e05640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a413ae50 0x7f97a415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.126+0000 7f97a9604640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a413b230 0x7f97a415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97aa606640 1 -- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a413ae50 msgr2=0x7f97a415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97aa606640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a413ae50 0x7f97a415db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97aa606640 1 -- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a413b230 msgr2=0x7f97a415e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97aa606640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a413b230 0x7f97a415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97aa606640 1 -- 172.21.15.113:0/711454431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4143900 con 0x7f97a415ccd0 2023-12-19T13:59:21.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97aa606640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97a415ccd0 0x7f97a415eea0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f979c037040 tx=0x7f979c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:21.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c043070 con 0x7f97a415ccd0 2023-12-19T13:59:21.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c034ad0 con 0x7f97a415ccd0 2023-12-19T13:59:21.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c034e40 con 0x7f97a415ccd0 2023-12-19T13:59:21.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a4143be0 con 0x7f97a415ccd0 2023-12-19T13:59:21.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.127+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a41f5c30 con 0x7f97a415ccd0 2023-12-19T13:59:21.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.129+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a4143dd0 con 0x7f97a415ccd0 2023-12-19T13:59:21.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.129+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f979c03e440 con 0x7f97a415ccd0 2023-12-19T13:59:21.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.130+0000 7f979a7fc640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f979006a460 0x7f979006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.130+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f979c0aa2e0 con 0x7f97a415ccd0 2023-12-19T13:59:21.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.130+0000 7f97a9e05640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f979006a460 0x7f979006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.131+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7f9790072050 con 0x7f97a415ccd0 2023-12-19T13:59:21.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.131+0000 7f97a9e05640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f979006a460 0x7f979006c920 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9794007fd0 tx=0x7f9794009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:21.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.135+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f979c0758a0 con 0x7f97a415ccd0 2023-12-19T13:59:21.217 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:21.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:21.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.324+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97a4061910 con 0x7f97a415ccd0 2023-12-19T13:59:21.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.325+0000 7f979a7fc640 1 -- 172.21.15.113:0/711454431 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f979c078ec0 con 0x7f97a415ccd0 2023-12-19T13:59:21.324 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.327+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f979006a460 msgr2=0x7f979006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.327+0000 7f97ac069640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f979006a460 0x7f979006c920 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9794007fd0 tx=0x7f9794009040 comp rx=0 tx=0).stop 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.327+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97a415ccd0 msgr2=0x7f97a415eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.327+0000 7f97ac069640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97a415ccd0 0x7f97a415eea0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f979c037040 tx=0x7f979c009750 comp rx=0 tx=0).stop 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 shutdown_connections 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f979006a460 0x7f979006c920 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97a415ccd0 0x7f97a415eea0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a413b230 0x7f97a415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 --2- 172.21.15.113:0/711454431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a413ae50 0x7f97a415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 >> 172.21.15.113:0/711454431 conn(0x7f97a40b29c0 msgr2=0x7f97a4141060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 shutdown_connections 2023-12-19T13:59:21.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.328+0000 7f97ac069640 1 -- 172.21.15.113:0/711454431 wait complete. 2023-12-19T13:59:21.345 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:59:21.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.605+0000 7f288183e640 1 Processor -- start 2023-12-19T13:59:21.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.605+0000 7f288183e640 1 -- start start 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f288183e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f287c1434c0 0x7f287c071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f288183e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f287c0b2bb0 0x7f287c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f288183e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f288183e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c06dd20 con 0x7f287c0b2bb0 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f288183e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c06e070 con 0x7f287c1434c0 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f288183e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c15a6a0 con 0x7f287c06d390 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f287a7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f287c0b2bb0 0x7f287c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f287a7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f287c0b2bb0 0x7f287c15a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60868/0 (socket says 172.21.15.113:60868) 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.607+0000 7f287a7fc640 1 -- 172.21.15.113:0/153195721 learned_addr learned my addr 172.21.15.113:0/153195721 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:21.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287affd640 1 --2- 172.21.15.113:0/153195721 >> v2:172.21.15.151:3300/0 conn(0x7f287c1434c0 0x7f287c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287b7fe640 1 --2- 172.21.15.113:0/153195721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287a7fc640 1 -- 172.21.15.113:0/153195721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 msgr2=0x7f287c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:21.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287a7fc640 1 --2- 172.21.15.113:0/153195721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287a7fc640 1 -- 172.21.15.113:0/153195721 >> v2:172.21.15.151:3300/0 conn(0x7f287c1434c0 msgr2=0x7f287c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:21.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287a7fc640 1 --2- 172.21.15.113:0/153195721 >> v2:172.21.15.151:3300/0 conn(0x7f287c1434c0 0x7f287c071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287a7fc640 1 -- 172.21.15.113:0/153195721 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c1438a0 con 0x7f287c0b2bb0 2023-12-19T13:59:21.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.608+0000 7f287affd640 1 --2- 172.21.15.113:0/153195721 >> v2:172.21.15.151:3300/0 conn(0x7f287c1434c0 0x7f287c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:21.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.609+0000 7f287a7fc640 1 --2- 172.21.15.113:0/153195721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c15a160 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f287c04e320 tx=0x7f286402e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e85cfcf6c06fa18 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:21.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.609+0000 7f2879ffb640 1 -- 172.21.15.113:0/153195721 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286402ee80 con 0x7f287c0b2bb0 2023-12-19T13:59:21.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.609+0000 7f2879ffb640 1 -- 172.21.15.113:0/153195721 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864036440 con 0x7f287c0b2bb0 2023-12-19T13:59:21.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.609+0000 7f2879ffb640 1 -- 172.21.15.113:0/153195721 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640367b0 con 0x7f287c0b2bb0 2023-12-19T13:59:21.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 -- 172.21.15.113:0/153195721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 msgr2=0x7f287c15a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 --2- 172.21.15.113:0/153195721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c15a160 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f287c04e320 tx=0x7f286402e0d0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.609 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 -- 172.21.15.113:0/153195721 shutdown_connections 2023-12-19T13:59:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 --2- 172.21.15.113:0/153195721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 --2- 172.21.15.113:0/153195721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c15a160 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 --2- 172.21.15.113:0/153195721 >> v2:172.21.15.151:3300/0 conn(0x7f287c1434c0 0x7f287c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 -- 172.21.15.113:0/153195721 >> 172.21.15.113:0/153195721 conn(0x7f287c0b2090 msgr2=0x7f287c0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 -- 172.21.15.113:0/153195721 shutdown_connections 2023-12-19T13:59:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.610+0000 7f288183e640 1 -- 172.21.15.113:0/153195721 wait complete. 2023-12-19T13:59:21.610 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.612+0000 7f288183e640 1 Processor -- start 2023-12-19T13:59:21.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.612+0000 7f288183e640 1 -- start start 2023-12-19T13:59:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f288183e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f288183e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f288183e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f287c1434c0 0x7f287c13d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f288183e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c155f00 con 0x7f287c0b2bb0 2023-12-19T13:59:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f288183e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1561e0 con 0x7f287c1434c0 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f288183e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c15a900 con 0x7f287c06d390 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f287a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f287a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60878/0 (socket says 172.21.15.113:60878) 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f287a7fc640 1 -- 172.21.15.113:0/2717920381 learned_addr learned my addr 172.21.15.113:0/2717920381 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f287b7fe640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f287c1434c0 0x7f287c13d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f287a7fc640 1 -- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 msgr2=0x7f287c155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.613+0000 7f287affd640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f287a7fc640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f287a7fc640 1 -- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f287c1434c0 msgr2=0x7f287c13d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f287a7fc640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f287c1434c0 0x7f287c13d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.614 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f287a7fc640 1 -- 172.21.15.113:0/2717920381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286400b770 con 0x7f287c0b2bb0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f287b7fe640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f287c1434c0 0x7f287c13d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f287a7fc640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c154b40 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f286402e110 tx=0x7f28640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864034b80 con 0x7f287c0b2bb0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864036e90 con 0x7f287c0b2bb0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864041460 con 0x7f287c0b2bb0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c15abe0 con 0x7f287c0b2bb0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.614+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1564c0 con 0x7f287c0b2bb0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.615+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c061910 con 0x7f287c0b2bb0 2023-12-19T13:59:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.616+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2864049360 con 0x7f287c0b2bb0 2023-12-19T13:59:21.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.617+0000 7f2873fff640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285c06a430 0x7f285c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:21.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.617+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f28640aadf0 con 0x7f287c0b2bb0 2023-12-19T13:59:21.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.617+0000 7f287affd640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285c06a430 0x7f285c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:21.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.618+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7f285c072020 con 0x7f287c0b2bb0 2023-12-19T13:59:21.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.618+0000 7f287affd640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285c06a430 0x7f285c06c8f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f286c008e60 tx=0x7f286c0083b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:21.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.621+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2864046060 con 0x7f287c0b2bb0 2023-12-19T13:59:21.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.812+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f287c15cc80 con 0x7f287c0b2bb0 2023-12-19T13:59:21.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.813+0000 7f2873fff640 1 -- 172.21.15.113:0/2717920381 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2864046030 con 0x7f287c0b2bb0 2023-12-19T13:59:21.812 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:59:21.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285c06a430 msgr2=0x7f285c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285c06a430 0x7f285c06c8f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f286c008e60 tx=0x7f286c0083b0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 msgr2=0x7f287c154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:21.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c154b40 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f286402e110 tx=0x7f28640046c0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 shutdown_connections 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f285c06a430 0x7f285c06c8f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f287c1434c0 0x7f287c13d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f287c0b2bb0 0x7f287c154b40 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 --2- 172.21.15.113:0/2717920381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287c06d390 0x7f287c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.816+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 >> 172.21.15.113:0/2717920381 conn(0x7f287c0b2090 msgr2=0x7f287c1427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.817+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 shutdown_connections 2023-12-19T13:59:21.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:21.817+0000 7f288183e640 1 -- 172.21.15.113:0/2717920381 wait complete. 2023-12-19T13:59:21.833 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:59:22.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.043+0000 7fcdcfc8b640 1 Processor -- start 2023-12-19T13:59:22.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.043+0000 7fcdcfc8b640 1 -- start start 2023-12-19T13:59:22.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.044+0000 7fcdcfc8b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcdc81449e0 0x7fcdc80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.044+0000 7fcdcfc8b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc80afb10 con 0x7fcdc80b0b50 2023-12-19T13:59:22.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.044+0000 7fcdcfc8b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc806bb30 con 0x7fcdc806c6b0 2023-12-19T13:59:22.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.045+0000 7fcdcfc8b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80b0070 con 0x7fcdc81449e0 2023-12-19T13:59:22.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.045+0000 7fcdcd226640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcdc80b0b50 0x7fcdc806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40612/0 (socket says 172.21.15.113:40612) 2023-12-19T13:59:22.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.045+0000 7fcdcd226640 1 -- 172.21.15.113:0/3525818201 learned_addr learned my addr 172.21.15.113:0/3525818201 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:22.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.045+0000 7fcdcda27640 1 --2- 172.21.15.113:0/3525818201 >> v2:172.21.15.151:3300/0 conn(0x7fcdc81449e0 0x7fcdc80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.045+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818984164 0 0) 0x7fcdc80afb10 con 0x7fcdc80b0b50 2023-12-19T13:59:22.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.045+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb4003520 con 0x7fcdc80b0b50 2023-12-19T13:59:22.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2437507962 0 0) 0x7fcdb4003520 con 0x7fcdc80b0b50 2023-12-19T13:59:22.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 >> v2:172.21.15.151:3300/0 conn(0x7fcdc81449e0 msgr2=0x7fcdc80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:22.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 --2- 172.21.15.113:0/3525818201 >> v2:172.21.15.151:3300/0 conn(0x7fcdc81449e0 0x7fcdc80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 >> v1:172.21.15.151:6789/0 conn(0x7fcdc806c6b0 legacy=0x7fcdc80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80b0350 con 0x7fcdc80b0b50 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fcdb8001670 con 0x7fcdc80b0b50 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 >> v1:172.21.15.113:6789/0 conn(0x7fcdc80b0b50 legacy=0x7fcdc806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdb40039e0 0x7fcdb4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdb40047c0 0x7fcdb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb4005180 0x7fcdb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b0070 con 0x7fcdb40039e0 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb400c0b0 con 0x7fcdb4005180 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb400c270 con 0x7fcdb40047c0 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcda27640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdb40039e0 0x7fcdb4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcda27640 1 -- 172.21.15.113:0/3525818201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdb40047c0 msgr2=0x7fcdb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcda27640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdb40047c0 0x7fcdb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcda27640 1 -- 172.21.15.113:0/3525818201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb4005180 msgr2=0x7fcdb400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdcda27640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb4005180 0x7fcdb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.046+0000 7fcdce228640 1 -- 172.21.15.113:0/3525818201 reap_dead start 2023-12-19T13:59:22.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.047+0000 7fcdcda27640 1 -- 172.21.15.113:0/3525818201 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4003520 con 0x7fcdb40039e0 2023-12-19T13:59:22.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcda27640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdb40039e0 0x7fcdb4003e00 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009ac0 tx=0x7fcdb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bc7521f86e1007 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:22.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc402c710 con 0x7fcdb40039e0 2023-12-19T13:59:22.049 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc402c870 con 0x7fcdb40039e0 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcca25640 1 -- 172.21.15.113:0/3525818201 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc402cc00 con 0x7fcdb40039e0 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/3525818201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdb40039e0 msgr2=0x7fcdb4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdb40039e0 0x7fcdb4003e00 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009ac0 tx=0x7fcdb40057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/3525818201 shutdown_connections 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/3525818201 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdb40039e0 0x7fcdb4003e00 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.048+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/3525818201 >> 172.21.15.113:0/3525818201 conn(0x7fcdc80cbb70 msgr2=0x7fcdc80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.049+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/3525818201 shutdown_connections 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.049+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/3525818201 wait complete. 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.050+0000 7fcdcfc8b640 1 Processor -- start 2023-12-19T13:59:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.050+0000 7fcdcfc8b640 1 -- start start 2023-12-19T13:59:22.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.051+0000 7fcdcfc8b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb40039e0 0x7fcdc81f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.051+0000 7fcdcfc8b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc80ade70 0x7fcdc8142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.051+0000 7fcdcfc8b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc80ad2c0 0x7fcdc815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.051+0000 7fcdcfc8b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80ccd20 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.051+0000 7fcdcfc8b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80cd000 con 0x7fcdb40039e0 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.051+0000 7fcdcfc8b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80cd2e0 con 0x7fcdc80ade70 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc80ad2c0 0x7fcdc815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc80ad2c0 0x7fcdc815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60900/0 (socket says 172.21.15.113:60900) 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 -- 172.21.15.113:0/1075677696 learned_addr learned my addr 172.21.15.113:0/1075677696 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdcda27640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb40039e0 0x7fcdc81f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdcd226640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc80ade70 0x7fcdc8142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 -- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc80ade70 msgr2=0x7fcdc8142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc80ade70 0x7fcdc8142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 -- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb40039e0 msgr2=0x7fcdc81f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb40039e0 0x7fcdc81f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdce228640 1 -- 172.21.15.113:0/1075677696 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80cd5c0 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.052+0000 7fcdcd226640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc80ade70 0x7fcdc8142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.053+0000 7fcdce228640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc80ad2c0 0x7fcdc815a8f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cef20 tx=0x7fcdc000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:22.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.053+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0007070 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.053+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc00071d0 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.053+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0007580 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.053+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc80cd8a0 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.053+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc8143380 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.054+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc8061910 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.055+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcdc00076e0 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.056+0000 7fcdbe7fc640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcdac06a430 0x7fcdac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.056+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcdc0087d00 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.056+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7fcdac072010 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.056+0000 7fcdcda27640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcdac06a430 0x7fcdac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.057+0000 7fcdcda27640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcdac06a430 0x7fcdac06c8f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4036000 tx=0x7fcdc4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:22.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.060+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcdc0017070 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.263+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcdc8143380 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.264+0000 7fcdbe7fc640 1 -- 172.21.15.113:0/1075677696 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v183) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcdc8143380 con 0x7fcdc80ad2c0 2023-12-19T13:59:22.263 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T13:59:22.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcdac06a430 msgr2=0x7fcdac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcdac06a430 0x7fcdac06c8f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4036000 tx=0x7fcdc4030000 comp rx=0 tx=0).stop 2023-12-19T13:59:22.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc80ad2c0 msgr2=0x7fcdc815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc80ad2c0 0x7fcdc815a8f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cef20 tx=0x7fcdc000c980 comp rx=0 tx=0).stop 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 shutdown_connections 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcdac06a430 0x7fcdac06c8f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdc80ad2c0 0x7fcdc815a8f0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdc80ade70 0x7fcdc8142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 --2- 172.21.15.113:0/1075677696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdb40039e0 0x7fcdc81f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 >> 172.21.15.113:0/1075677696 conn(0x7fcdc80cbb70 msgr2=0x7fcdc80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 shutdown_connections 2023-12-19T13:59:22.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.267+0000 7fcdcfc8b640 1 -- 172.21.15.113:0/1075677696 wait complete. 2023-12-19T13:59:22.285 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T13:59:22.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:22.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T13:59:22.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T13:59:22.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:22.388 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T13:59:22.436 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:22.436 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:22.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:59:22.495 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:59:22.495 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:22.545 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:59:22.545 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:22.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.774+0000 7f977a7d9640 1 Processor -- start 2023-12-19T13:59:22.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.774+0000 7f977a7d9640 1 -- start start 2023-12-19T13:59:22.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.775+0000 7f977a7d9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f977415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.775+0000 7f977a7d9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f97740d0590 0x7f97740cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.775+0000 7f977a7d9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f97740ce1e0 0x7f977415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.775+0000 7f977a7d9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977415ece0 con 0x7f97740d0590 2023-12-19T13:59:22.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.775+0000 7f977a7d9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97740ce9d0 con 0x7f97740ce1e0 2023-12-19T13:59:22.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.775+0000 7f977a7d9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740ce6f0 con 0x7f97740d01b0 2023-12-19T13:59:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f97740d0590 0x7f97740cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f97740d0590 0x7f97740cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60912/0 (socket says 172.21.15.113:60912) 2023-12-19T13:59:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 -- 172.21.15.113:0/1938932523 learned_addr learned my addr 172.21.15.113:0/1938932523 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f9773fff640 1 --2- 172.21.15.113:0/1938932523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f977415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f9778d76640 1 --2- 172.21.15.113:0/1938932523 >> v2:172.21.15.151:3300/0 conn(0x7f97740ce1e0 0x7f977415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 -- 172.21.15.113:0/1938932523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 msgr2=0x7f977415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 --2- 172.21.15.113:0/1938932523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f977415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 -- 172.21.15.113:0/1938932523 >> v2:172.21.15.151:3300/0 conn(0x7f97740ce1e0 msgr2=0x7f977415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 --2- 172.21.15.113:0/1938932523 >> v2:172.21.15.151:3300/0 conn(0x7f97740ce1e0 0x7f977415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.776+0000 7f97737fe640 1 -- 172.21.15.113:0/1938932523 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977415dcc0 con 0x7f97740d0590 2023-12-19T13:59:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.777+0000 7f97737fe640 1 --2- 172.21.15.113:0/1938932523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f97740cdca0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f97740d33d0 tx=0x7f976802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a887370de88da3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.778+0000 7f9772ffd640 1 -- 172.21.15.113:0/1938932523 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768031870 con 0x7f97740d0590 2023-12-19T13:59:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.778+0000 7f9772ffd640 1 -- 172.21.15.113:0/1938932523 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97680319d0 con 0x7f97740d0590 2023-12-19T13:59:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.778+0000 7f9772ffd640 1 -- 172.21.15.113:0/1938932523 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768031d60 con 0x7f97740d0590 2023-12-19T13:59:22.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 -- 172.21.15.113:0/1938932523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 msgr2=0x7f97740cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 --2- 172.21.15.113:0/1938932523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f97740cdca0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f97740d33d0 tx=0x7f976802b910 comp rx=0 tx=0).stop 2023-12-19T13:59:22.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 -- 172.21.15.113:0/1938932523 shutdown_connections 2023-12-19T13:59:22.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 --2- 172.21.15.113:0/1938932523 >> v2:172.21.15.151:3300/0 conn(0x7f97740ce1e0 0x7f977415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 --2- 172.21.15.113:0/1938932523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f97740cdca0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 --2- 172.21.15.113:0/1938932523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f977415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.778 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 -- 172.21.15.113:0/1938932523 >> 172.21.15.113:0/1938932523 conn(0x7f97740b27a0 msgr2=0x7f97740b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:22.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 -- 172.21.15.113:0/1938932523 shutdown_connections 2023-12-19T13:59:22.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.779+0000 7f977a7d9640 1 -- 172.21.15.113:0/1938932523 wait complete. 2023-12-19T13:59:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.781+0000 7f977a7d9640 1 Processor -- start 2023-12-19T13:59:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.781+0000 7f977a7d9640 1 -- start start 2023-12-19T13:59:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f977a7d9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97740ce1e0 0x7f97741f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f977a7d9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f97741520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f977a7d9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f9774154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f977a7d9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774152980 con 0x7f97740d0590 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f977a7d9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977415b060 con 0x7f97740ce1e0 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f977a7d9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977415b340 con 0x7f97740d01b0 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f9778d76640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f9774154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f9778d76640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f9774154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60918/0 (socket says 172.21.15.113:60918) 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.782+0000 7f9778d76640 1 -- 172.21.15.113:0/525345435 learned_addr learned my addr 172.21.15.113:0/525345435 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9773fff640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97740ce1e0 0x7f97741f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f97737fe640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f97741520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9778d76640 1 -- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 msgr2=0x7f97741520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9778d76640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f97741520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9778d76640 1 -- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97740ce1e0 msgr2=0x7f97741f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9778d76640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97740ce1e0 0x7f97741f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9778d76640 1 -- 172.21.15.113:0/525345435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680094d0 con 0x7f97740d0590 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f97737fe640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f97741520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9778d76640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f9774154ed0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f976c00cd20 tx=0x7f976c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c003b90 con 0x7f97740d0590 2023-12-19T13:59:22.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c003cf0 con 0x7f97740d0590 2023-12-19T13:59:22.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.783+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c004240 con 0x7f97740d0590 2023-12-19T13:59:22.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.784+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774155c90 con 0x7f97740d0590 2023-12-19T13:59:22.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.784+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9774152eb0 con 0x7f97740d0590 2023-12-19T13:59:22.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.785+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9774061910 con 0x7f97740d0590 2023-12-19T13:59:22.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.786+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f976c0043a0 con 0x7f97740d0590 2023-12-19T13:59:22.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.787+0000 7f9770ff9640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f976006a430 0x7f976006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:22.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.787+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f976c012070 con 0x7f97740d0590 2023-12-19T13:59:22.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.787+0000 7f9773fff640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f976006a430 0x7f976006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:22.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.788+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7f9760072020 con 0x7f97740d0590 2023-12-19T13:59:22.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.788+0000 7f9773fff640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f976006a430 0x7f976006c8f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9764006fd0 tx=0x7f9764008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:22.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:22.791+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f976c0548e0 con 0x7f97740d0590 2023-12-19T13:59:23.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.020+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977415b480 con 0x7f97740d0590 2023-12-19T13:59:23.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.021+0000 7f9770ff9640 1 -- 172.21.15.113:0/525345435 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f976c057f00 con 0x7f97740d0590 2023-12-19T13:59:23.020 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:23.020 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:58:01.335603+0000","modified":"2023-12-19T13:58:04.828919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/2910539170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2910539170},{"type":"v1","addr":"172.21.15.113:6837","nonce":2910539170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T13:59:23.021 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 80 2023-12-19T13:59:23.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f976006a430 msgr2=0x7f976006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f976006a430 0x7f976006c8f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9764006fd0 tx=0x7f9764008040 comp rx=0 tx=0).stop 2023-12-19T13:59:23.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 msgr2=0x7f9774154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f9774154ed0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f976c00cd20 tx=0x7f976c00a660 comp rx=0 tx=0).stop 2023-12-19T13:59:23.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 shutdown_connections 2023-12-19T13:59:23.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f976006a430 0x7f976006c8f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97740d0590 0x7f9774154ed0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97740d01b0 0x7f97741520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 --2- 172.21.15.113:0/525345435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97740ce1e0 0x7f97741f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 >> 172.21.15.113:0/525345435 conn(0x7f97740b27a0 msgr2=0x7f9774070480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 shutdown_connections 2023-12-19T13:59:23.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.024+0000 7f977a7d9640 1 -- 172.21.15.113:0/525345435 wait complete. 2023-12-19T13:59:23.043 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:23.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.258+0000 7efd4cc26640 1 Processor -- start 2023-12-19T13:59:23.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.258+0000 7efd4cc26640 1 -- start start 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.259+0000 7efd4cc26640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd481449e0 0x7efd480af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.259+0000 7efd4cc26640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efd4806c6b0 0x7efd480b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.259+0000 7efd4cc26640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd480afb10 con 0x7efd480b0b50 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.259+0000 7efd4cc26640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4806bb30 con 0x7efd481449e0 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.259+0000 7efd4cc26640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480b0070 con 0x7efd4806c6b0 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd4659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd481449e0 0x7efd480af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd4659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd481449e0 0x7efd480af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60926/0 (socket says 172.21.15.113:60926) 2023-12-19T13:59:23.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd4659c640 1 -- 172.21.15.113:0/3523993129 learned_addr learned my addr 172.21.15.113:0/3523993129 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:23.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd46d9d640 1 --2- 172.21.15.113:0/3523993129 >> v2:172.21.15.151:3300/0 conn(0x7efd4806c6b0 0x7efd480b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd4659c640 1 -- 172.21.15.113:0/3523993129 >> v2:172.21.15.151:3300/0 conn(0x7efd4806c6b0 msgr2=0x7efd480b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:23.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd4659c640 1 --2- 172.21.15.113:0/3523993129 >> v2:172.21.15.151:3300/0 conn(0x7efd4806c6b0 0x7efd480b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd4659c640 1 -- 172.21.15.113:0/3523993129 >> v1:172.21.15.113:6789/0 conn(0x7efd480b0b50 legacy=0x7efd4806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd4659c640 1 -- 172.21.15.113:0/3523993129 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480b0350 con 0x7efd481449e0 2023-12-19T13:59:23.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd45d9b640 1 -- 172.21.15.113:0/3523993129 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532579603 0 0) 0x7efd480afb10 con 0x7efd480b0b50 2023-12-19T13:59:23.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.260+0000 7efd46d9d640 1 --2- 172.21.15.113:0/3523993129 >> v2:172.21.15.151:3300/0 conn(0x7efd4806c6b0 0x7efd480b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:23.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.261+0000 7efd4659c640 1 --2- 172.21.15.113:0/3523993129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd480af5d0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7efd480b1270 tx=0x7efd3802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaef62d468c9120c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:23.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd45d9b640 1 -- 172.21.15.113:0/3523993129 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38030860 con 0x7efd481449e0 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd45d9b640 1 -- 172.21.15.113:0/3523993129 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd380309c0 con 0x7efd481449e0 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd45d9b640 1 -- 172.21.15.113:0/3523993129 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38030d50 con 0x7efd481449e0 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd4cc26640 1 -- 172.21.15.113:0/3523993129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 msgr2=0x7efd480af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd4cc26640 1 --2- 172.21.15.113:0/3523993129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd480af5d0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7efd480b1270 tx=0x7efd3802b9a0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd4cc26640 1 -- 172.21.15.113:0/3523993129 shutdown_connections 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd4cc26640 1 --2- 172.21.15.113:0/3523993129 >> v2:172.21.15.151:3300/0 conn(0x7efd4806c6b0 0x7efd480b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd4cc26640 1 --2- 172.21.15.113:0/3523993129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd480af5d0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd4cc26640 1 -- 172.21.15.113:0/3523993129 >> 172.21.15.113:0/3523993129 conn(0x7efd480cbb70 msgr2=0x7efd480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.262+0000 7efd4cc26640 1 -- 172.21.15.113:0/3523993129 shutdown_connections 2023-12-19T13:59:23.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.263+0000 7efd4cc26640 1 -- 172.21.15.113:0/3523993129 wait complete. 2023-12-19T13:59:23.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.264+0000 7efd4cc26640 1 Processor -- start 2023-12-19T13:59:23.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.264+0000 7efd4cc26640 1 -- start start 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.265+0000 7efd4cc26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd4806c6b0 0x7efd481f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.265+0000 7efd4cc26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd480b0b50 0x7efd4806f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.265+0000 7efd4cc26640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd481f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.265+0000 7efd4cc26640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481440f0 con 0x7efd481449e0 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.265+0000 7efd4cc26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481f2580 con 0x7efd4806c6b0 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.265+0000 7efd4cc26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd481f2860 con 0x7efd480b0b50 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd481f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd481f1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60930/0 (socket says 172.21.15.113:60930) 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 -- 172.21.15.113:0/2876489384 learned_addr learned my addr 172.21.15.113:0/2876489384 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd4659c640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd4806c6b0 0x7efd481f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd3ffff640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd480b0b50 0x7efd4806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 -- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd480b0b50 msgr2=0x7efd4806f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd480b0b50 0x7efd4806f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 -- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd4806c6b0 msgr2=0x7efd481f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd4806c6b0 0x7efd481f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 -- 172.21.15.113:0/2876489384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380094d0 con 0x7efd481449e0 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd4659c640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd4806c6b0 0x7efd481f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.266+0000 7efd46d9d640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd481f1980 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7efd4000cef0 tx=0x7efd4000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.267+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000d840 con 0x7efd481449e0 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.267+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000d9c0 con 0x7efd481449e0 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.267+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481f2b40 con 0x7efd481449e0 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.267+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000dd70 con 0x7efd481449e0 2023-12-19T13:59:23.267 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.267+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481f3100 con 0x7efd481449e0 2023-12-19T13:59:23.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.268+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd48061910 con 0x7efd481449e0 2023-12-19T13:59:23.268 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.269+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd4001e3b0 con 0x7efd481449e0 2023-12-19T13:59:23.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.270+0000 7efd3effd640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd2806a460 0x7efd2806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.270+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efd400893e0 con 0x7efd481449e0 2023-12-19T13:59:23.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.270+0000 7efd4659c640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd2806a460 0x7efd2806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.270+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=184}) v3 -- 0x7efd28072050 con 0x7efd481449e0 2023-12-19T13:59:23.269 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.271+0000 7efd4659c640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd2806a460 0x7efd2806c920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efd38036000 tx=0x7efd3803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:23.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.274+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd4001a070 con 0x7efd481449e0 2023-12-19T13:59:23.462 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.463+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd4806d340 con 0x7efd481449e0 2023-12-19T13:59:23.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.466+0000 7efd3effd640 1 -- 172.21.15.113:0/2876489384 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+16283 (secure 0 0 0) 0x7efd40054a50 con 0x7efd481449e0 2023-12-19T13:59:23.466 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:23.466 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":183,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:58:53.686673+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.0","mappings":[{"from":2,"to":5}]},{"pgid":"21.11","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:23.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd2806a460 msgr2=0x7efd2806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd2806a460 0x7efd2806c920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efd38036000 tx=0x7efd3803b040 comp rx=0 tx=0).stop 2023-12-19T13:59:23.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 msgr2=0x7efd481f1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd481f1980 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7efd4000cef0 tx=0x7efd4000a710 comp rx=0 tx=0).stop 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 shutdown_connections 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd2806a460 0x7efd2806c920 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd481449e0 0x7efd481f1980 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd480b0b50 0x7efd4806f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 --2- 172.21.15.113:0/2876489384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd4806c6b0 0x7efd481f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 >> 172.21.15.113:0/2876489384 conn(0x7efd480cbb70 msgr2=0x7efd480709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 shutdown_connections 2023-12-19T13:59:23.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.469+0000 7efd4cc26640 1 -- 172.21.15.113:0/2876489384 wait complete. 2023-12-19T13:59:23.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:57:59.812489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:58:00.348071+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:59:23.487 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:59:23.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.712+0000 7ff2baac4640 1 Processor -- start 2023-12-19T13:59:23.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.712+0000 7ff2baac4640 1 -- start start 2023-12-19T13:59:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.714+0000 7ff2baac4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.714+0000 7ff2baac4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2b40b0070 0x7ff2b40b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.714+0000 7ff2baac4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b40b0a10 con 0x7ff2b40cb810 2023-12-19T13:59:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.714+0000 7ff2baac4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b40ccf20 con 0x7ff2b40b0070 2023-12-19T13:59:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.714+0000 7ff2baac4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40b1b50 con 0x7ff2b4154760 2023-12-19T13:59:23.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b8860640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b9061640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2b40b0070 0x7ff2b40b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b8860640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:40300/0 (socket says 172.21.15.113:40300) 2023-12-19T13:59:23.714 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b8860640 1 -- 172.21.15.113:0/4127594809 learned_addr learned my addr 172.21.15.113:0/4127594809 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:23.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b9061640 1 -- 172.21.15.113:0/4127594809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 msgr2=0x7ff2b415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:23.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b9061640 1 --2- 172.21.15.113:0/4127594809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b9061640 1 -- 172.21.15.113:0/4127594809 >> v1:172.21.15.151:6789/0 conn(0x7ff2b40cb810 legacy=0x7ff2b40b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.715+0000 7ff2b9061640 1 -- 172.21.15.113:0/4127594809 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40ccbd0 con 0x7ff2b40b0070 2023-12-19T13:59:23.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.717+0000 7ff2b9061640 1 --2- 172.21.15.113:0/4127594809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40b0070 0x7ff2b40b04d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009dc0 tx=0x7ff2ac02be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4f927466f4a0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:23.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.718+0000 7ff2b37fe640 1 -- 172.21.15.113:0/4127594809 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac02cbb0 con 0x7ff2b40b0070 2023-12-19T13:59:23.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.718+0000 7ff2b37fe640 1 -- 172.21.15.113:0/4127594809 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac02cd10 con 0x7ff2b40b0070 2023-12-19T13:59:23.717 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.718+0000 7ff2b37fe640 1 -- 172.21.15.113:0/4127594809 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac034660 con 0x7ff2b40b0070 2023-12-19T13:59:23.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 -- 172.21.15.113:0/4127594809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40b0070 msgr2=0x7ff2b40b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 --2- 172.21.15.113:0/4127594809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40b0070 0x7ff2b40b04d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009dc0 tx=0x7ff2ac02be00 comp rx=0 tx=0).stop 2023-12-19T13:59:23.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 -- 172.21.15.113:0/4127594809 shutdown_connections 2023-12-19T13:59:23.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 --2- 172.21.15.113:0/4127594809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40b0070 0x7ff2b40b04d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 --2- 172.21.15.113:0/4127594809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 -- 172.21.15.113:0/4127594809 >> 172.21.15.113:0/4127594809 conn(0x7ff2b4073150 msgr2=0x7ff2b40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:23.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 -- 172.21.15.113:0/4127594809 shutdown_connections 2023-12-19T13:59:23.719 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.719+0000 7ff2baac4640 1 -- 172.21.15.113:0/4127594809 wait complete. 2023-12-19T13:59:23.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.721+0000 7ff2baac4640 1 Processor -- start 2023-12-19T13:59:23.720 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.721+0000 7ff2baac4640 1 -- start start 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2baac4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2b40b0070 0x7ff2b4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2baac4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40cb810 0x7ff2b41f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2baac4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2baac4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b406c930 con 0x7ff2b40b0070 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2baac4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4151140 con 0x7ff2b40cb810 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2baac4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b415bd60 con 0x7ff2b4154760 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2b8860640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2b40b0070 0x7ff2b4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2b8860640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2b40b0070 0x7ff2b4150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60938/0 (socket says 172.21.15.113:60938) 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.722+0000 7ff2b8860640 1 -- 172.21.15.113:0/2600413297 learned_addr learned my addr 172.21.15.113:0/2600413297 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b8860640 1 -- 172.21.15.113:0/2600413297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 msgr2=0x7ff2b415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b9061640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b8860640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b8860640 1 -- 172.21.15.113:0/2600413297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40cb810 msgr2=0x7ff2b41f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b8860640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40cb810 0x7ff2b41f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b8860640 1 -- 172.21.15.113:0/2600413297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac009a70 con 0x7ff2b40b0070 2023-12-19T13:59:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b8860640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2b40b0070 0x7ff2b4150c00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800e8b0 tx=0x7ff2a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b17fa640 1 -- 172.21.15.113:0/2600413297 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800c940 con 0x7ff2b40b0070 2023-12-19T13:59:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.723+0000 7ff2b17fa640 1 -- 172.21.15.113:0/2600413297 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800caa0 con 0x7ff2b40b0070 2023-12-19T13:59:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.724+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40adb90 con 0x7ff2b40b0070 2023-12-19T13:59:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.724+0000 7ff2b17fa640 1 -- 172.21.15.113:0/2600413297 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800ce30 con 0x7ff2b40b0070 2023-12-19T13:59:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.724+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b406bcb0 con 0x7ff2b40b0070 2023-12-19T13:59:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.725+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b40ced00 con 0x7ff2b40b0070 2023-12-19T13:59:23.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.726+0000 7ff2b17fa640 1 -- 172.21.15.113:0/2600413297 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2a8013470 con 0x7ff2b40b0070 2023-12-19T13:59:23.725 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.727+0000 7ff2b17fa640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff29806a430 0x7ff29806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:23.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.727+0000 7ff2b17fa640 1 -- 172.21.15.113:0/2600413297 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff2a8088af0 con 0x7ff2b40b0070 2023-12-19T13:59:23.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.727+0000 7ff2b3fff640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff29806a430 0x7ff29806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:23.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.728+0000 7ff2b3fff640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff29806a430 0x7ff29806c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0000f60 tx=0x7ff2a00079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:23.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.732+0000 7ff2b17fa640 1 -- 172.21.15.113:0/2600413297 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff2a80540a0 con 0x7ff2b40b0070 2023-12-19T13:59:23.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.923+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2b4061910 con 0x7ff2b40b0070 2023-12-19T13:59:23.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.924+0000 7ff2b17fa640 1 -- 172.21.15.113:0/2600413297 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v184) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2a80170a0 con 0x7ff2b40b0070 2023-12-19T13:59:23.923 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:59:23.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff29806a430 msgr2=0x7ff29806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff29806a430 0x7ff29806c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0000f60 tx=0x7ff2a00079d0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2b40b0070 msgr2=0x7ff2b4150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:23.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2b40b0070 0x7ff2b4150c00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800e8b0 tx=0x7ff2a800ed70 comp rx=0 tx=0).stop 2023-12-19T13:59:23.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 shutdown_connections 2023-12-19T13:59:23.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff29806a430 0x7ff29806c8f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2b4154760 0x7ff2b415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2b40cb810 0x7ff2b41f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 --2- 172.21.15.113:0/2600413297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2b40b0070 0x7ff2b4150c00 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:23.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 >> 172.21.15.113:0/2600413297 conn(0x7ff2b4073150 msgr2=0x7ff2b41519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:23.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 shutdown_connections 2023-12-19T13:59:23.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:23.927+0000 7ff2baac4640 1 -- 172.21.15.113:0/2600413297 wait complete. 2023-12-19T13:59:23.944 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:59:24.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.154+0000 7f6befb77640 1 Processor -- start 2023-12-19T13:59:24.153 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.154+0000 7f6befb77640 1 -- start start 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6befb77640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6be8146e10 0x7f6be80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6befb77640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6be80ce110 0x7f6be80ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6befb77640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be80cd840 con 0x7f6be80d2b00 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6befb77640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80d2430 con 0x7f6be8146e10 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6befb77640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80ceac0 con 0x7f6be80ce110 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6bed913640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6be8146e10 0x7f6be80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6bed913640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6be8146e10 0x7f6be80d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60940/0 (socket says 172.21.15.113:60940) 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.156+0000 7f6bed913640 1 -- 172.21.15.113:0/2457830554 learned_addr learned my addr 172.21.15.113:0/2457830554 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:24.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.157+0000 7f6bee114640 1 --2- 172.21.15.113:0/2457830554 >> v2:172.21.15.151:3300/0 conn(0x7f6be80ce110 0x7f6be80ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.157+0000 7f6bed913640 1 -- 172.21.15.113:0/2457830554 >> v2:172.21.15.151:3300/0 conn(0x7f6be80ce110 msgr2=0x7f6be80ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:24.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.157+0000 7f6bed913640 1 --2- 172.21.15.113:0/2457830554 >> v2:172.21.15.151:3300/0 conn(0x7f6be80ce110 0x7f6be80ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.157+0000 7f6bed913640 1 -- 172.21.15.113:0/2457830554 >> v1:172.21.15.151:6789/0 conn(0x7f6be80d2b00 legacy=0x7f6be80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:24.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.157+0000 7f6bed913640 1 -- 172.21.15.113:0/2457830554 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be80b6e90 con 0x7f6be8146e10 2023-12-19T13:59:24.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.157+0000 7f6bee114640 1 --2- 172.21.15.113:0/2457830554 >> v2:172.21.15.151:3300/0 conn(0x7f6be80ce110 0x7f6be80ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:24.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.158+0000 7f6bed913640 1 --2- 172.21.15.113:0/2457830554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be8146e10 0x7f6be80d1ef0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f6be80cedb0 tx=0x7f6be402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f3d9f4210534b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:24.157 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.158+0000 7f6bec911640 1 -- 172.21.15.113:0/2457830554 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40317d0 con 0x7f6be8146e10 2023-12-19T13:59:24.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.158+0000 7f6bec911640 1 -- 172.21.15.113:0/2457830554 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4031930 con 0x7f6be8146e10 2023-12-19T13:59:24.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.158+0000 7f6bec911640 1 -- 172.21.15.113:0/2457830554 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4031cc0 con 0x7f6be8146e10 2023-12-19T13:59:24.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 -- 172.21.15.113:0/2457830554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be8146e10 msgr2=0x7f6be80d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 --2- 172.21.15.113:0/2457830554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be8146e10 0x7f6be80d1ef0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f6be80cedb0 tx=0x7f6be402b870 comp rx=0 tx=0).stop 2023-12-19T13:59:24.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 -- 172.21.15.113:0/2457830554 shutdown_connections 2023-12-19T13:59:24.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 --2- 172.21.15.113:0/2457830554 >> v2:172.21.15.151:3300/0 conn(0x7f6be80ce110 0x7f6be80ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 --2- 172.21.15.113:0/2457830554 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be8146e10 0x7f6be80d1ef0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 -- 172.21.15.113:0/2457830554 >> 172.21.15.113:0/2457830554 conn(0x7f6be80b29c0 msgr2=0x7f6be80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:24.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 -- 172.21.15.113:0/2457830554 shutdown_connections 2023-12-19T13:59:24.159 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.159+0000 7f6befb77640 1 -- 172.21.15.113:0/2457830554 wait complete. 2023-12-19T13:59:24.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.161+0000 7f6befb77640 1 Processor -- start 2023-12-19T13:59:24.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.161+0000 7f6befb77640 1 -- start start 2023-12-19T13:59:24.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6befb77640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be80ce110 0x7f6be81f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6befb77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be80d2b00 0x7f6be80cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6befb77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be8146e10 0x7f6be80d1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6befb77640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81f2ca0 con 0x7f6be80ce110 2023-12-19T13:59:24.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6befb77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80cd3a0 con 0x7f6be80d2b00 2023-12-19T13:59:24.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6befb77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80ccde0 con 0x7f6be8146e10 2023-12-19T13:59:24.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6bed913640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be80ce110 0x7f6be81f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6bed913640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be80ce110 0x7f6be81f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60952/0 (socket says 172.21.15.113:60952) 2023-12-19T13:59:24.162 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.162+0000 7f6bed913640 1 -- 172.21.15.113:0/2313897542 learned_addr learned my addr 172.21.15.113:0/2313897542 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bed112640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be80d2b00 0x7f6be80cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bee114640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be8146e10 0x7f6be80d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bed913640 1 -- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be8146e10 msgr2=0x7f6be80d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bed913640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be8146e10 0x7f6be80d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bed913640 1 -- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be80d2b00 msgr2=0x7f6be80cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bed913640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be80d2b00 0x7f6be80cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bed913640 1 -- 172.21.15.113:0/2313897542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40094d0 con 0x7f6be80ce110 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.163+0000 7f6bed913640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be80ce110 0x7f6be81f2760 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6be40097f0 tx=0x7f6be40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.164+0000 7f6bde7fc640 1 -- 172.21.15.113:0/2313897542 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4032970 con 0x7f6be80ce110 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.164+0000 7f6bde7fc640 1 -- 172.21.15.113:0/2313897542 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4032ad0 con 0x7f6be80ce110 2023-12-19T13:59:24.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.164+0000 7f6bde7fc640 1 -- 172.21.15.113:0/2313897542 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4032e60 con 0x7f6be80ce110 2023-12-19T13:59:24.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.164+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be80cd0c0 con 0x7f6be80ce110 2023-12-19T13:59:24.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.164+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80c87b0 con 0x7f6be80ce110 2023-12-19T13:59:24.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.165+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be8061910 con 0x7f6be80ce110 2023-12-19T13:59:24.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.166+0000 7f6bde7fc640 1 -- 172.21.15.113:0/2313897542 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6be4030070 con 0x7f6be80ce110 2023-12-19T13:59:24.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.167+0000 7f6bde7fc640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6bcc06a430 0x7f6bcc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.167+0000 7f6bde7fc640 1 -- 172.21.15.113:0/2313897542 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6be40aa600 con 0x7f6be80ce110 2023-12-19T13:59:24.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.167+0000 7f6bed112640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6bcc06a430 0x7f6bcc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.167+0000 7f6bed112640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6bcc06a430 0x7f6bcc06c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6be80b6990 tx=0x7f6bd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:24.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.171+0000 7f6bde7fc640 1 -- 172.21.15.113:0/2313897542 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6be4075ba0 con 0x7f6be80ce110 2023-12-19T13:59:24.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.362+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6be8061910 con 0x7f6be80ce110 2023-12-19T13:59:24.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.363+0000 7f6bde7fc640 1 -- 172.21.15.113:0/2313897542 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v184) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6be40791c0 con 0x7f6be80ce110 2023-12-19T13:59:24.362 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T13:59:24.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6bcc06a430 msgr2=0x7f6bcc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6bcc06a430 0x7f6bcc06c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6be80b6990 tx=0x7f6bd8009040 comp rx=0 tx=0).stop 2023-12-19T13:59:24.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be80ce110 msgr2=0x7f6be81f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be80ce110 0x7f6be81f2760 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6be40097f0 tx=0x7f6be40046c0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 shutdown_connections 2023-12-19T13:59:24.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f6bcc06a430 0x7f6bcc06c8f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be8146e10 0x7f6be80d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be80d2b00 0x7f6be80cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 --2- 172.21.15.113:0/2313897542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6be80ce110 0x7f6be81f2760 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 >> 172.21.15.113:0/2313897542 conn(0x7f6be80b29c0 msgr2=0x7f6be80d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:24.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 shutdown_connections 2023-12-19T13:59:24.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.366+0000 7f6befb77640 1 -- 172.21.15.113:0/2313897542 wait complete. 2023-12-19T13:59:24.384 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:59:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.596+0000 7f0de24e5640 1 Processor -- start 2023-12-19T13:59:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.596+0000 7f0de24e5640 1 -- start start 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de24e5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc141900 0x7f0ddc0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de24e5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ddc0b02a0 0x7f0ddc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de24e5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc06e220 con 0x7f0ddc06da30 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de24e5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0cbea0 con 0x7f0ddc0b02a0 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de24e5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0cc180 con 0x7f0ddc141900 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de0ce2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ddc0b02a0 0x7f0ddc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de0ce2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ddc0b02a0 0x7f0ddc06d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60956/0 (socket says 172.21.15.113:60956) 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de0ce2640 1 -- 172.21.15.113:0/741983006 learned_addr learned my addr 172.21.15.113:0/741983006 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de0ce2640 1 -- 172.21.15.113:0/741983006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc141900 msgr2=0x7f0ddc0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.598+0000 7f0de0ce2640 1 --2- 172.21.15.113:0/741983006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc141900 0x7f0ddc0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.599+0000 7f0de0ce2640 1 -- 172.21.15.113:0/741983006 >> v1:172.21.15.151:6789/0 conn(0x7f0ddc06da30 legacy=0x7f0ddc0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.599+0000 7f0de0ce2640 1 -- 172.21.15.113:0/741983006 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0b0700 con 0x7f0ddc0b02a0 2023-12-19T13:59:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.600+0000 7f0de0ce2640 1 --2- 172.21.15.113:0/741983006 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc0b02a0 0x7f0ddc06d4f0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009870 tx=0x7f0dd802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4314db331033c126 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.600+0000 7f0dd3fff640 1 -- 172.21.15.113:0/741983006 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8031640 con 0x7f0ddc0b02a0 2023-12-19T13:59:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.600+0000 7f0dd3fff640 1 -- 172.21.15.113:0/741983006 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd80317a0 con 0x7f0ddc0b02a0 2023-12-19T13:59:24.599 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.600+0000 7f0dd3fff640 1 -- 172.21.15.113:0/741983006 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8031b30 con 0x7f0ddc0b02a0 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.600+0000 7f0de24e5640 1 -- 172.21.15.113:0/741983006 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc0b02a0 msgr2=0x7f0ddc06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.600+0000 7f0de24e5640 1 --2- 172.21.15.113:0/741983006 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc0b02a0 0x7f0ddc06d4f0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009870 tx=0x7f0dd802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.601+0000 7f0de24e5640 1 -- 172.21.15.113:0/741983006 shutdown_connections 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.601+0000 7f0de24e5640 1 --2- 172.21.15.113:0/741983006 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc0b02a0 0x7f0ddc06d4f0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.601+0000 7f0de24e5640 1 --2- 172.21.15.113:0/741983006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc141900 0x7f0ddc0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.601+0000 7f0de24e5640 1 -- 172.21.15.113:0/741983006 >> 172.21.15.113:0/741983006 conn(0x7f0ddc06f630 msgr2=0x7f0ddc06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.601+0000 7f0de24e5640 1 -- 172.21.15.113:0/741983006 shutdown_connections 2023-12-19T13:59:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.601+0000 7f0de24e5640 1 -- 172.21.15.113:0/741983006 wait complete. 2023-12-19T13:59:24.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.602+0000 7f0de24e5640 1 Processor -- start 2023-12-19T13:59:24.601 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.603+0000 7f0de24e5640 1 -- start start 2023-12-19T13:59:24.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.603+0000 7f0de24e5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc06da30 0x7f0ddc0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.603+0000 7f0de24e5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc0b02a0 0x7f0ddc14c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.602 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.603+0000 7f0de24e5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc141900 0x7f0ddc0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.603+0000 7f0de24e5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc14c910 con 0x7f0ddc141900 2023-12-19T13:59:24.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.603+0000 7f0de24e5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc14cc10 con 0x7f0ddc06da30 2023-12-19T13:59:24.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.603+0000 7f0de24e5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc14ceb0 con 0x7f0ddc0b02a0 2023-12-19T13:59:24.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de1ce4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc141900 0x7f0ddc0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de0ce2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc0b02a0 0x7f0ddc14c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.603 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de14e3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc06da30 0x7f0ddc0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de1ce4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc141900 0x7f0ddc0abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60958/0 (socket says 172.21.15.113:60958) 2023-12-19T13:59:24.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de1ce4640 1 -- 172.21.15.113:0/2147936193 learned_addr learned my addr 172.21.15.113:0/2147936193 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:24.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de1ce4640 1 -- 172.21.15.113:0/2147936193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc0b02a0 msgr2=0x7f0ddc14c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de1ce4640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc0b02a0 0x7f0ddc14c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de1ce4640 1 -- 172.21.15.113:0/2147936193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc06da30 msgr2=0x7f0ddc0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.604+0000 7f0de1ce4640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc06da30 0x7f0ddc0c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.604 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.605+0000 7f0de1ce4640 1 -- 172.21.15.113:0/2147936193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80094d0 con 0x7f0ddc141900 2023-12-19T13:59:24.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.605+0000 7f0de1ce4640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc141900 0x7f0ddc0abf10 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c780 tx=0x7f0dd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:24.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.605+0000 7f0dd1ffb640 1 -- 172.21.15.113:0/2147936193 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4003d80 con 0x7f0ddc141900 2023-12-19T13:59:24.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.605+0000 7f0dd1ffb640 1 -- 172.21.15.113:0/2147936193 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400ce90 con 0x7f0ddc141900 2023-12-19T13:59:24.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.605+0000 7f0dd1ffb640 1 -- 172.21.15.113:0/2147936193 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40052b0 con 0x7f0ddc141900 2023-12-19T13:59:24.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.605+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc14d190 con 0x7f0ddc141900 2023-12-19T13:59:24.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.605+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc14d750 con 0x7f0ddc141900 2023-12-19T13:59:24.605 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.606+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc061910 con 0x7f0ddc141900 2023-12-19T13:59:24.606 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.607+0000 7f0dd1ffb640 1 -- 172.21.15.113:0/2147936193 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0dd4005410 con 0x7f0ddc141900 2023-12-19T13:59:24.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.608+0000 7f0dd1ffb640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0dc006a430 0x7f0dc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:24.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.608+0000 7f0dd1ffb640 1 -- 172.21.15.113:0/2147936193 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0dd4087e20 con 0x7f0ddc141900 2023-12-19T13:59:24.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.608+0000 7f0de14e3640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0dc006a430 0x7f0dc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:24.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.609+0000 7f0de14e3640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0dc006a430 0x7f0dc006c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098e0 tx=0x7f0dcc009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:24.611 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.612+0000 7f0dd1ffb640 1 -- 172.21.15.113:0/2147936193 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0dd40533e0 con 0x7f0ddc141900 2023-12-19T13:59:24.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.804+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ddc14d940 con 0x7f0ddc141900 2023-12-19T13:59:24.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.805+0000 7f0dd1ffb640 1 -- 172.21.15.113:0/2147936193 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v184) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dd40170a0 con 0x7f0ddc141900 2023-12-19T13:59:24.805 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.808+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0dc006a430 msgr2=0x7f0dc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.808+0000 7f0de24e5640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0dc006a430 0x7f0dc006c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098e0 tx=0x7f0dcc009060 comp rx=0 tx=0).stop 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.808+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc141900 msgr2=0x7f0ddc0abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.808+0000 7f0de24e5640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc141900 0x7f0ddc0abf10 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c780 tx=0x7f0dd400cc40 comp rx=0 tx=0).stop 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 shutdown_connections 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0dc006a430 0x7f0dc006c8f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ddc141900 0x7f0ddc0abf10 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc0b02a0 0x7f0ddc14c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 --2- 172.21.15.113:0/2147936193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc06da30 0x7f0ddc0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 >> 172.21.15.113:0/2147936193 conn(0x7f0ddc06f630 msgr2=0x7f0ddc06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 shutdown_connections 2023-12-19T13:59:24.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:24.809+0000 7f0de24e5640 1 -- 172.21.15.113:0/2147936193 wait complete. 2023-12-19T13:59:24.825 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:25.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.036+0000 7f600ffe3640 1 Processor -- start 2023-12-19T13:59:25.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.036+0000 7f600ffe3640 1 -- start start 2023-12-19T13:59:25.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600ffe3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f60080b0b50 0x7f600806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600ffe3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f600806b590 0x7f600806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600ffe3640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600806bb30 con 0x7f60081449e0 2023-12-19T13:59:25.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600ffe3640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60080b0070 con 0x7f600806b590 2023-12-19T13:59:25.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600ffe3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60080b0350 con 0x7f60080b0b50 2023-12-19T13:59:25.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600dd7f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f60081449e0 0x7f60080af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40624/0 (socket says 172.21.15.113:40624) 2023-12-19T13:59:25.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600dd7f640 1 -- 172.21.15.113:0/4155671358 learned_addr learned my addr 172.21.15.113:0/4155671358 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:25.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.038+0000 7f600e580640 1 --2- 172.21.15.113:0/4155671358 >> v2:172.21.15.113:3300/0 conn(0x7f600806b590 0x7f600806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.039+0000 7f600d57e640 1 --2- 172.21.15.113:0/4155671358 >> v2:172.21.15.151:3300/0 conn(0x7f60080b0b50 0x7f600806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.039+0000 7f600e580640 1 -- 172.21.15.113:0/4155671358 >> v2:172.21.15.151:3300/0 conn(0x7f60080b0b50 msgr2=0x7f600806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:25.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.039+0000 7f600e580640 1 --2- 172.21.15.113:0/4155671358 >> v2:172.21.15.151:3300/0 conn(0x7f60080b0b50 0x7f600806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.039+0000 7f600e580640 1 -- 172.21.15.113:0/4155671358 >> v1:172.21.15.113:6789/0 conn(0x7f60081449e0 legacy=0x7f60080af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.039+0000 7f600e580640 1 -- 172.21.15.113:0/4155671358 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080b0630 con 0x7f600806b590 2023-12-19T13:59:25.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.039+0000 7f600cd7d640 1 -- 172.21.15.113:0/4155671358 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367955170 0 0) 0x7f600806bb30 con 0x7f60081449e0 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.040+0000 7f600e580640 1 --2- 172.21.15.113:0/4155671358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f600806b590 0x7f600806c4e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6008071c80 tx=0x7f600002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e679aa4ee16dc30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.040+0000 7f600cd7d640 1 -- 172.21.15.113:0/4155671358 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000031830 con 0x7f600806b590 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.040+0000 7f600cd7d640 1 -- 172.21.15.113:0/4155671358 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6000031990 con 0x7f600806b590 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.040+0000 7f600cd7d640 1 -- 172.21.15.113:0/4155671358 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000031d20 con 0x7f600806b590 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 -- 172.21.15.113:0/4155671358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f600806b590 msgr2=0x7f600806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 --2- 172.21.15.113:0/4155671358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f600806b590 0x7f600806c4e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6008071c80 tx=0x7f600002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 -- 172.21.15.113:0/4155671358 shutdown_connections 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 --2- 172.21.15.113:0/4155671358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f600806b590 0x7f600806c4e0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 --2- 172.21.15.113:0/4155671358 >> v2:172.21.15.151:3300/0 conn(0x7f60080b0b50 0x7f600806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 -- 172.21.15.113:0/4155671358 >> 172.21.15.113:0/4155671358 conn(0x7f60080cbb70 msgr2=0x7f60080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 -- 172.21.15.113:0/4155671358 shutdown_connections 2023-12-19T13:59:25.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.041+0000 7f600ffe3640 1 -- 172.21.15.113:0/4155671358 wait complete. 2023-12-19T13:59:25.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.043+0000 7f600ffe3640 1 Processor -- start 2023-12-19T13:59:25.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.043+0000 7f600ffe3640 1 -- start start 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600ffe3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600806b590 0x7f60081f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600ffe3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60080b0b50 0x7f6008159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600ffe3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60081449e0 0x7f600813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600ffe3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600813d3f0 con 0x7f60080b0b50 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600ffe3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600813c520 con 0x7f600806b590 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600ffe3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60081f6f50 con 0x7f60081449e0 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60080b0b50 0x7f6008159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60080b0b50 0x7f6008159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60972/0 (socket says 172.21.15.113:60972) 2023-12-19T13:59:25.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 -- 172.21.15.113:0/2998393891 learned_addr learned my addr 172.21.15.113:0/2998393891 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:25.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600e580640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60081449e0 0x7f600813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600dd7f640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600806b590 0x7f60081f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 -- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60081449e0 msgr2=0x7f600813f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60081449e0 0x7f600813f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 -- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600806b590 msgr2=0x7f60081f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600806b590 0x7f60081f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.044+0000 7f600d57e640 1 -- 172.21.15.113:0/2998393891 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000009400 con 0x7f60080b0b50 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.045+0000 7f600d57e640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60080b0b50 0x7f6008159ea0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f600400ce40 tx=0x7f600400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.045+0000 7f5ffe7fc640 1 -- 172.21.15.113:0/2998393891 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004003b90 con 0x7f60080b0b50 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.045+0000 7f5ffe7fc640 1 -- 172.21.15.113:0/2998393891 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6004003cf0 con 0x7f60080b0b50 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.045+0000 7f5ffe7fc640 1 -- 172.21.15.113:0/2998393891 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004004240 con 0x7f60080b0b50 2023-12-19T13:59:25.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.045+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600813c770 con 0x7f60080b0b50 2023-12-19T13:59:25.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.045+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600813cd30 con 0x7f60080b0b50 2023-12-19T13:59:25.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.046+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600813d530 con 0x7f60080b0b50 2023-12-19T13:59:25.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.047+0000 7f5ffe7fc640 1 -- 172.21.15.113:0/2998393891 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60040043a0 con 0x7f60080b0b50 2023-12-19T13:59:25.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.048+0000 7f5ffe7fc640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ff406a430 0x7f5ff406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.048+0000 7f5ffe7fc640 1 -- 172.21.15.113:0/2998393891 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6004012070 con 0x7f60080b0b50 2023-12-19T13:59:25.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.048+0000 7f600dd7f640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ff406a430 0x7f5ff406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.049+0000 7f600dd7f640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ff406a430 0x7f5ff406c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8000f60 tx=0x7f5ff8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:25.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.052+0000 7f5ffe7fc640 1 -- 172.21.15.113:0/2998393891 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f600813d530 con 0x7f60080b0b50 2023-12-19T13:59:25.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.283+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f600813d530 con 0x7f60080b0b50 2023-12-19T13:59:25.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.284+0000 7f5ffe7fc640 1 -- 172.21.15.113:0/2998393891 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f600813d530 con 0x7f60080b0b50 2023-12-19T13:59:25.283 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:25.284 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:58:01.335603+0000","modified":"2023-12-19T13:58:04.828919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/2910539170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2910539170},{"type":"v1","addr":"172.21.15.113:6837","nonce":2910539170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T13:59:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 80 2023-12-19T13:59:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ff406a430 msgr2=0x7f5ff406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ff406a430 0x7f5ff406c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8000f60 tx=0x7f5ff8009040 comp rx=0 tx=0).stop 2023-12-19T13:59:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60080b0b50 msgr2=0x7f6008159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60080b0b50 0x7f6008159ea0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f600400ce40 tx=0x7f600400a660 comp rx=0 tx=0).stop 2023-12-19T13:59:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 shutdown_connections 2023-12-19T13:59:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5ff406a430 0x7f5ff406c8f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60081449e0 0x7f600813f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60080b0b50 0x7f6008159ea0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 --2- 172.21.15.113:0/2998393891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600806b590 0x7f60081f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 >> 172.21.15.113:0/2998393891 conn(0x7f60080cbb70 msgr2=0x7f600806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 shutdown_connections 2023-12-19T13:59:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.287+0000 7f600ffe3640 1 -- 172.21.15.113:0/2998393891 wait complete. 2023-12-19T13:59:25.304 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.521+0000 7f1c6eeca640 1 Processor -- start 2023-12-19T13:59:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.521+0000 7f1c6eeca640 1 -- start start 2023-12-19T13:59:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.522+0000 7f1c6eeca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1c68146da0 0x7f1c680aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.522+0000 7f1c6eeca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c68147180 0x7f1c680aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.522+0000 7f1c6eeca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681611f0 0x7f1c68161640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.522+0000 7f1c6eeca640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c68161b80 con 0x7f1c68147180 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.522+0000 7f1c6eeca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c680d1070 con 0x7f1c68146da0 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.522+0000 7f1c6eeca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68162020 con 0x7f1c681611f0 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c68147180 0x7f1c680aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c68147180 0x7f1c680aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60984/0 (socket says 172.21.15.113:60984) 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 -- 172.21.15.113:0/1308972 learned_addr learned my addr 172.21.15.113:0/1308972 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 -- 172.21.15.113:0/1308972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681611f0 msgr2=0x7f1c68161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 --2- 172.21.15.113:0/1308972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681611f0 0x7f1c68161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c6cc66640 1 --2- 172.21.15.113:0/1308972 >> v2:172.21.15.151:3300/0 conn(0x7f1c68146da0 0x7f1c680aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 -- 172.21.15.113:0/1308972 >> v2:172.21.15.151:3300/0 conn(0x7f1c68146da0 msgr2=0x7f1c680aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 --2- 172.21.15.113:0/1308972 >> v2:172.21.15.151:3300/0 conn(0x7f1c68146da0 0x7f1c680aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c67fff640 1 -- 172.21.15.113:0/1308972 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680aabd0 con 0x7f1c68147180 2023-12-19T13:59:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.523+0000 7f1c6cc66640 1 --2- 172.21.15.113:0/1308972 >> v2:172.21.15.151:3300/0 conn(0x7f1c68146da0 0x7f1c680aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.524+0000 7f1c67fff640 1 --2- 172.21.15.113:0/1308972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68147180 0x7f1c680aa5a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f1c680a9470 tx=0x7f1c5402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21812af6c853346b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c677fe640 1 -- 172.21.15.113:0/1308972 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54031860 con 0x7f1c68147180 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c677fe640 1 -- 172.21.15.113:0/1308972 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c540319c0 con 0x7f1c68147180 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c677fe640 1 -- 172.21.15.113:0/1308972 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54031d50 con 0x7f1c68147180 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 -- 172.21.15.113:0/1308972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68147180 msgr2=0x7f1c680aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/1308972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68147180 0x7f1c680aa5a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f1c680a9470 tx=0x7f1c5402b900 comp rx=0 tx=0).stop 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 -- 172.21.15.113:0/1308972 shutdown_connections 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/1308972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681611f0 0x7f1c68161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/1308972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68147180 0x7f1c680aa5a0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/1308972 >> v2:172.21.15.151:3300/0 conn(0x7f1c68146da0 0x7f1c680aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 -- 172.21.15.113:0/1308972 >> 172.21.15.113:0/1308972 conn(0x7f1c68071a50 msgr2=0x7f1c680d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 -- 172.21.15.113:0/1308972 shutdown_connections 2023-12-19T13:59:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.525+0000 7f1c6eeca640 1 -- 172.21.15.113:0/1308972 wait complete. 2023-12-19T13:59:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.527+0000 7f1c6eeca640 1 Processor -- start 2023-12-19T13:59:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.527+0000 7f1c6eeca640 1 -- start start 2023-12-19T13:59:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6eeca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68146da0 0x7f1c680d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6eeca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c681611f0 0x7f1c68145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6eeca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681f6c80 0x7f1c68142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6eeca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68144e70 con 0x7f1c68146da0 2023-12-19T13:59:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6eeca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68145150 con 0x7f1c681611f0 2023-12-19T13:59:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6eeca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68145430 con 0x7f1c681f6c80 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6cc66640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68146da0 0x7f1c680d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.528+0000 7f1c6cc66640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68146da0 0x7f1c680d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60994/0 (socket says 172.21.15.113:60994) 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c6cc66640 1 -- 172.21.15.113:0/879086140 learned_addr learned my addr 172.21.15.113:0/879086140 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c6cc66640 1 -- 172.21.15.113:0/879086140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681f6c80 msgr2=0x7f1c68142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c6cc66640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681f6c80 0x7f1c68142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c6cc66640 1 -- 172.21.15.113:0/879086140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c681611f0 msgr2=0x7f1c68145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c67fff640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c681611f0 0x7f1c68145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c6cc66640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c681611f0 0x7f1c68145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c6cc66640 1 -- 172.21.15.113:0/879086140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540094d0 con 0x7f1c68146da0 2023-12-19T13:59:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c6cc66640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68146da0 0x7f1c680d06e0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c7f0 tx=0x7f1c5c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:25.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.529+0000 7f1c657fa640 1 -- 172.21.15.113:0/879086140 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c007820 con 0x7f1c68146da0 2023-12-19T13:59:25.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.530+0000 7f1c657fa640 1 -- 172.21.15.113:0/879086140 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c007980 con 0x7f1c68146da0 2023-12-19T13:59:25.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.530+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c68145710 con 0x7f1c68146da0 2023-12-19T13:59:25.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.530+0000 7f1c657fa640 1 -- 172.21.15.113:0/879086140 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c007cf0 con 0x7f1c68146da0 2023-12-19T13:59:25.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.530+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68146450 con 0x7f1c68146da0 2023-12-19T13:59:25.530 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.531+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c68073ec0 con 0x7f1c68146da0 2023-12-19T13:59:25.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.532+0000 7f1c657fa640 1 -- 172.21.15.113:0/879086140 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c5c0113f0 con 0x7f1c68146da0 2023-12-19T13:59:25.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.533+0000 7f1c657fa640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4c06a430 0x7f1c4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:25.531 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.533+0000 7f1c657fa640 1 -- 172.21.15.113:0/879086140 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1c5c088d50 con 0x7f1c68146da0 2023-12-19T13:59:25.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.533+0000 7f1c67fff640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4c06a430 0x7f1c4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:25.532 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.534+0000 7f1c67fff640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4c06a430 0x7f1c4c06c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1c54036000 tx=0x7f1c5403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:25.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.537+0000 7f1c657fa640 1 -- 172.21.15.113:0/879086140 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c5c054260 con 0x7f1c68146da0 2023-12-19T13:59:25.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.729+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c68061910 con 0x7f1c68146da0 2023-12-19T13:59:25.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.730+0000 7f1c657fa640 1 -- 172.21.15.113:0/879086140 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+16264 (secure 0 0 0) 0x7f1c5c01f090 con 0x7f1c68146da0 2023-12-19T13:59:25.807 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:25.807 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":184,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:59:23.697723+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.0","mappings":[{"from":2,"to":5}]},{"pgid":"21.11","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4c06a430 msgr2=0x7f1c4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4c06a430 0x7f1c4c06c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1c54036000 tx=0x7f1c5403c040 comp rx=0 tx=0).stop 2023-12-19T13:59:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68146da0 msgr2=0x7f1c680d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68146da0 0x7f1c680d06e0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c7f0 tx=0x7f1c5c00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 shutdown_connections 2023-12-19T13:59:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c4c06a430 0x7f1c4c06c8f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.808 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c681f6c80 0x7f1c68142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c681611f0 0x7f1c68145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 --2- 172.21.15.113:0/879086140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c68146da0 0x7f1c680d06e0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:25.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.733+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 >> 172.21.15.113:0/879086140 conn(0x7f1c68071a50 msgr2=0x7f1c6815dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:25.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.734+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 shutdown_connections 2023-12-19T13:59:25.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:25.734+0000 7f1c6eeca640 1 -- 172.21.15.113:0/879086140 wait complete. 2023-12-19T13:59:25.809 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:59:25.810 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:26.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.030+0000 7ffa0bd6e640 1 Processor -- start 2023-12-19T13:59:26.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.030+0000 7ffa0bd6e640 1 -- start start 2023-12-19T13:59:26.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.032+0000 7ffa0bd6e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa040afa50 0x7ffa04166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.032+0000 7ffa0bd6e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa04165bc0 con 0x7ffa04161a40 2023-12-19T13:59:26.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.032+0000 7ffa0bd6e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0406e520 con 0x7ffa04161660 2023-12-19T13:59:26.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.032+0000 7ffa0bd6e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa040afef0 con 0x7ffa040afa50 2023-12-19T13:59:26.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.033+0000 7ffa0a30b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffa04161a40 0x7ffa040ccc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40636/0 (socket says 172.21.15.113:40636) 2023-12-19T13:59:26.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.033+0000 7ffa0a30b640 1 -- 172.21.15.113:0/2851665328 learned_addr learned my addr 172.21.15.113:0/2851665328 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:26.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.033+0000 7ffa09309640 1 --2- 172.21.15.113:0/2851665328 >> v2:172.21.15.113:3300/0 conn(0x7ffa040afa50 0x7ffa04166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.033+0000 7ffa09309640 1 -- 172.21.15.113:0/2851665328 >> v1:172.21.15.151:6789/0 conn(0x7ffa04161660 legacy=0x7ffa040b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.033+0000 7ffa09309640 1 -- 172.21.15.113:0/2851665328 >> v1:172.21.15.113:6789/0 conn(0x7ffa04161a40 legacy=0x7ffa040ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.033+0000 7ffa09309640 1 -- 172.21.15.113:0/2851665328 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04165570 con 0x7ffa040afa50 2023-12-19T13:59:26.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.035+0000 7ffa09309640 1 --2- 172.21.15.113:0/2851665328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa040afa50 0x7ffa04166050 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40097a0 tx=0x7ff9f402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65d5e739e55c3d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.035+0000 7ffa08b08640 1 -- 172.21.15.113:0/2851665328 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4030610 con 0x7ffa040afa50 2023-12-19T13:59:26.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.035+0000 7ffa08b08640 1 -- 172.21.15.113:0/2851665328 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4030770 con 0x7ffa040afa50 2023-12-19T13:59:26.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.035+0000 7ffa08b08640 1 -- 172.21.15.113:0/2851665328 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4030b00 con 0x7ffa040afa50 2023-12-19T13:59:26.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.036+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/2851665328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa040afa50 msgr2=0x7ffa04166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.036+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/2851665328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa040afa50 0x7ffa04166050 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40097a0 tx=0x7ff9f402b960 comp rx=0 tx=0).stop 2023-12-19T13:59:26.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.036+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/2851665328 shutdown_connections 2023-12-19T13:59:26.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.036+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/2851665328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa040afa50 0x7ffa04166050 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.036+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/2851665328 >> 172.21.15.113:0/2851665328 conn(0x7ffa040cbb70 msgr2=0x7ffa040cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:26.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.036+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/2851665328 shutdown_connections 2023-12-19T13:59:26.035 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.036+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/2851665328 wait complete. 2023-12-19T13:59:26.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.038+0000 7ffa0bd6e640 1 Processor -- start 2023-12-19T13:59:26.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.038+0000 7ffa0bd6e640 1 -- start start 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.039+0000 7ffa0bd6e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa040afa50 0x7ffa041f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.039+0000 7ffa0bd6e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa04161660 0x7ffa04157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.039+0000 7ffa0bd6e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa04161a40 0x7ffa041527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.039+0000 7ffa0bd6e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa041fa8a0 con 0x7ffa04161660 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.039+0000 7ffa0bd6e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa04158d80 con 0x7ffa04161a40 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.039+0000 7ffa0bd6e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa041f7780 con 0x7ffa040afa50 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa04161660 0x7ffa04157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa04161660 0x7ffa04157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:32782/0 (socket says 172.21.15.113:32782) 2023-12-19T13:59:26.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 -- 172.21.15.113:0/906695889 learned_addr learned my addr 172.21.15.113:0/906695889 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:26.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09b0a640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa040afa50 0x7ffa041f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa0a30b640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa04161a40 0x7ffa041527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 -- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa040afa50 msgr2=0x7ffa041f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa040afa50 0x7ffa041f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 -- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa04161a40 msgr2=0x7ffa041527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa04161a40 0x7ffa041527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa09309640 1 -- 172.21.15.113:0/906695889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f4009400 con 0x7ffa04161660 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.040+0000 7ffa0a30b640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa04161a40 0x7ffa041527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.041+0000 7ffa09309640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa04161660 0x7ffa04157f50 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7ff9f402bf70 tx=0x7ff9f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.041+0000 7ff9fa7fc640 1 -- 172.21.15.113:0/906695889 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f403e040 con 0x7ffa04161660 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.041+0000 7ff9fa7fc640 1 -- 172.21.15.113:0/906695889 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4039cb0 con 0x7ffa04161660 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.041+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa041f7a60 con 0x7ffa04161660 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.041+0000 7ff9fa7fc640 1 -- 172.21.15.113:0/906695889 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4044630 con 0x7ffa04161660 2023-12-19T13:59:26.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.041+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa041f8020 con 0x7ffa04161660 2023-12-19T13:59:26.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.042+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04061910 con 0x7ffa04161660 2023-12-19T13:59:26.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.043+0000 7ff9fa7fc640 1 -- 172.21.15.113:0/906695889 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9f4043390 con 0x7ffa04161660 2023-12-19T13:59:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.044+0000 7ff9fa7fc640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.044+0000 7ff9fa7fc640 1 -- 172.21.15.113:0/906695889 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff9f40aad20 con 0x7ffa04161660 2023-12-19T13:59:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.045+0000 7ffa09b0a640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.045+0000 7ffa09b0a640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ffa00000f60 tx=0x7ffa00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.049+0000 7ff9fa7fc640 1 -- 172.21.15.113:0/906695889 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9f4076230 con 0x7ffa04161660 2023-12-19T13:59:26.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.278+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa040cb720 con 0x7ffa04161660 2023-12-19T13:59:26.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.279+0000 7ff9fa7fc640 1 -- 172.21.15.113:0/906695889 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4664 (secure 0 0 0) 0x7ff9f4034090 con 0x7ffa04161660 2023-12-19T13:59:26.278 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:26.278 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:58:01.335603+0000","modified":"2023-12-19T13:58:04.828919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/2910539170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2910539170},{"type":"v1","addr":"172.21.15.113:6837","nonce":2910539170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T13:59:26.279 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 80 2023-12-19T13:59:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 msgr2=0x7ff9e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ffa00000f60 tx=0x7ffa00009040 comp rx=0 tx=0).stop 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa04161660 msgr2=0x7ffa04157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa04161660 0x7ffa04157f50 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7ff9f402bf70 tx=0x7ff9f4004730 comp rx=0 tx=0).stop 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 shutdown_connections 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff9e806a430 0x7ff9e806c8f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa04161a40 0x7ffa041527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa04161660 0x7ffa04157f50 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 --2- 172.21.15.113:0/906695889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa040afa50 0x7ffa041f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 >> 172.21.15.113:0/906695889 conn(0x7ffa040cbb70 msgr2=0x7ffa040b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 shutdown_connections 2023-12-19T13:59:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.282+0000 7ffa0bd6e640 1 -- 172.21.15.113:0/906695889 wait complete. 2023-12-19T13:59:26.300 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.513+0000 7f4eb7cc0640 1 Processor -- start 2023-12-19T13:59:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.513+0000 7f4eb7cc0640 1 -- start start 2023-12-19T13:59:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb7cc0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4eb00b0b50 0x7f4eb006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb7cc0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4eb006b590 0x7f4eb006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb7cc0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb006bb30 con 0x7f4eb01449e0 2023-12-19T13:59:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb7cc0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb00b0070 con 0x7f4eb006b590 2023-12-19T13:59:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb7cc0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb00b0350 con 0x7f4eb00b0b50 2023-12-19T13:59:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb625d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4eb006b590 0x7f4eb006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb625d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4eb006b590 0x7f4eb006c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:32798/0 (socket says 172.21.15.113:32798) 2023-12-19T13:59:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb625d640 1 -- 172.21.15.113:0/1914393879 learned_addr learned my addr 172.21.15.113:0/1914393879 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb625d640 1 -- 172.21.15.113:0/1914393879 >> v2:172.21.15.151:3300/0 conn(0x7f4eb00b0b50 msgr2=0x7f4eb006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb525b640 1 --2- 172.21.15.113:0/1914393879 >> v2:172.21.15.151:3300/0 conn(0x7f4eb00b0b50 0x7f4eb006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb625d640 1 --2- 172.21.15.113:0/1914393879 >> v2:172.21.15.151:3300/0 conn(0x7f4eb00b0b50 0x7f4eb006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb625d640 1 -- 172.21.15.113:0/1914393879 >> v1:172.21.15.113:6789/0 conn(0x7f4eb01449e0 legacy=0x7f4eb00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb4a5a640 1 -- 172.21.15.113:0/1914393879 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627308252 0 0) 0x7f4eb006bb30 con 0x7f4eb01449e0 2023-12-19T13:59:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.515+0000 7f4eb625d640 1 -- 172.21.15.113:0/1914393879 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb00b0630 con 0x7f4eb006b590 2023-12-19T13:59:26.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.517+0000 7f4eb625d640 1 --2- 172.21.15.113:0/1914393879 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb006b590 0x7f4eb006c4e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0071c80 tx=0x7f4ea802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5997409d4bcaa886 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.517+0000 7f4eb4a5a640 1 -- 172.21.15.113:0/1914393879 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea802cb20 con 0x7f4eb006b590 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.517+0000 7f4eb4a5a640 1 -- 172.21.15.113:0/1914393879 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea802cc80 con 0x7f4eb006b590 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.517+0000 7f4eb4a5a640 1 -- 172.21.15.113:0/1914393879 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80343f0 con 0x7f4eb006b590 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.517+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/1914393879 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb006b590 msgr2=0x7f4eb006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.517+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/1914393879 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb006b590 0x7f4eb006c4e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0071c80 tx=0x7f4ea802bf80 comp rx=0 tx=0).stop 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.518+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/1914393879 shutdown_connections 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.518+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/1914393879 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb006b590 0x7f4eb006c4e0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.518+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/1914393879 >> v2:172.21.15.151:3300/0 conn(0x7f4eb00b0b50 0x7f4eb006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.518+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/1914393879 >> 172.21.15.113:0/1914393879 conn(0x7f4eb00cbb70 msgr2=0x7f4eb00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.518+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/1914393879 shutdown_connections 2023-12-19T13:59:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.518+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/1914393879 wait complete. 2023-12-19T13:59:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.519+0000 7f4eb7cc0640 1 Processor -- start 2023-12-19T13:59:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.520+0000 7f4eb7cc0640 1 -- start start 2023-12-19T13:59:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.520+0000 7f4eb7cc0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb006b590 0x7f4eb0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.520+0000 7f4eb7cc0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb00b0b50 0x7f4eb013b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.520+0000 7f4eb7cc0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb01449e0 0x7f4eb013cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.520+0000 7f4eb7cc0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb013edc0 con 0x7f4eb01449e0 2023-12-19T13:59:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.520+0000 7f4eb7cc0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb015bf90 con 0x7f4eb00b0b50 2023-12-19T13:59:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.520+0000 7f4eb7cc0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb013beb0 con 0x7f4eb006b590 2023-12-19T13:59:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb01449e0 0x7f4eb013cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb01449e0 0x7f4eb013cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:32812/0 (socket says 172.21.15.113:32812) 2023-12-19T13:59:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 -- 172.21.15.113:0/2612118637 learned_addr learned my addr 172.21.15.113:0/2612118637 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 -- 172.21.15.113:0/2612118637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb006b590 msgr2=0x7f4eb0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb006b590 0x7f4eb0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 -- 172.21.15.113:0/2612118637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb00b0b50 msgr2=0x7f4eb013b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb00b0b50 0x7f4eb013b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.521+0000 7f4eb625d640 1 -- 172.21.15.113:0/2612118637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea8009b30 con 0x7f4eb01449e0 2023-12-19T13:59:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.522+0000 7f4eb625d640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb01449e0 0x7f4eb013cc40 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009f40 tx=0x7f4ea8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.522+0000 7f4ea67fc640 1 -- 172.21.15.113:0/2612118637 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8007e70 con 0x7f4eb01449e0 2023-12-19T13:59:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.522+0000 7f4ea67fc640 1 -- 172.21.15.113:0/2612118637 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea8009510 con 0x7f4eb01449e0 2023-12-19T13:59:26.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.522+0000 7f4ea67fc640 1 -- 172.21.15.113:0/2612118637 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea803e690 con 0x7f4eb01449e0 2023-12-19T13:59:26.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.522+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb013c190 con 0x7f4eb01449e0 2023-12-19T13:59:26.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.522+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb013ea50 con 0x7f4eb01449e0 2023-12-19T13:59:26.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.523+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb0061910 con 0x7f4eb01449e0 2023-12-19T13:59:26.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.524+0000 7f4ea67fc640 1 -- 172.21.15.113:0/2612118637 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ea803e7f0 con 0x7f4eb01449e0 2023-12-19T13:59:26.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.525+0000 7f4ea67fc640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.525+0000 7f4ea67fc640 1 -- 172.21.15.113:0/2612118637 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4ea80ab690 con 0x7f4eb01449e0 2023-12-19T13:59:26.526 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.525+0000 7f4eb5a5c640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.526+0000 7f4eb5a5c640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4eac001560 tx=0x7f4eac007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.529+0000 7f4ea67fc640 1 -- 172.21.15.113:0/2612118637 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4ea8076df0 con 0x7f4eb01449e0 2023-12-19T13:59:26.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.754+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eb00ae560 con 0x7f4eb01449e0 2023-12-19T13:59:26.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.755+0000 7f4ea67fc640 1 -- 172.21.15.113:0/2612118637 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f4ea807a410 con 0x7f4eb01449e0 2023-12-19T13:59:26.755 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:26.755 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:58:01.335603+0000","modified":"2023-12-19T13:58:04.828919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/2910539170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":2910539170},{"type":"v1","addr":"172.21.15.113:6837","nonce":2910539170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T13:59:26.755 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 80 2023-12-19T13:59:26.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 msgr2=0x7f4e9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4eac001560 tx=0x7f4eac007930 comp rx=0 tx=0).stop 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb01449e0 msgr2=0x7f4eb013cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb01449e0 0x7f4eb013cc40 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009f40 tx=0x7f4ea8004a40 comp rx=0 tx=0).stop 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 shutdown_connections 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e9406a430 0x7f4e9406c8f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4eb01449e0 0x7f4eb013cc40 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb00b0b50 0x7f4eb013b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 --2- 172.21.15.113:0/2612118637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4eb006b590 0x7f4eb0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 >> 172.21.15.113:0/2612118637 conn(0x7f4eb00cbb70 msgr2=0x7f4eb00b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 shutdown_connections 2023-12-19T13:59:26.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.758+0000 7f4eb7cc0640 1 -- 172.21.15.113:0/2612118637 wait complete. 2023-12-19T13:59:26.776 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:26.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.981+0000 7fbf0efb9640 1 Processor -- start 2023-12-19T13:59:26.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.981+0000 7fbf0efb9640 1 -- start start 2023-12-19T13:59:26.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.983+0000 7fbf0efb9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf08157bf0 0x7fbf0815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.983+0000 7fbf0efb9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0815b740 con 0x7fbf080b0810 2023-12-19T13:59:26.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.983+0000 7fbf0efb9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf080ae640 con 0x7fbf080ae110 2023-12-19T13:59:26.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.983+0000 7fbf0efb9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0806b8c0 con 0x7fbf08157bf0 2023-12-19T13:59:26.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.983+0000 7fbf0d556640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbf080b0810 0x7fbf0806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40654/0 (socket says 172.21.15.113:40654) 2023-12-19T13:59:26.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.983+0000 7fbf0d556640 1 -- 172.21.15.113:0/594890818 learned_addr learned my addr 172.21.15.113:0/594890818 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:26.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbf0cd55640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf08157bf0 0x7fbf0815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869727255 0 0) 0x7fbf0815b740 con 0x7fbf080b0810 2023-12-19T13:59:26.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef0003520 con 0x7fbf080b0810 2023-12-19T13:59:26.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131076597 0 0) 0x7fbef0003520 con 0x7fbf080b0810 2023-12-19T13:59:26.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf08157bf0 msgr2=0x7fbf0815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:26.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf08157bf0 0x7fbf0815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.984 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 >> v1:172.21.15.151:6789/0 conn(0x7fbf080ae110 legacy=0x7fbf080b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf080ae920 con 0x7fbf080b0810 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbf00001670 con 0x7fbf080b0810 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 >> v1:172.21.15.113:6789/0 conn(0x7fbf080b0810 legacy=0x7fbf0806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbef0003a10 0x7fbef0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf08157bf0 0x7fbef00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0004d00 0x7fbef0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0806b8c0 con 0x7fbef0003a10 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef000dca0 con 0x7fbef0004d00 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef000de60 con 0x7fbf08157bf0 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.984+0000 7fbf0cd55640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbef0003a10 0x7fbef0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.985+0000 7fbf0cd55640 1 -- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf08157bf0 msgr2=0x7fbef00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:26.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.985+0000 7fbf0cd55640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf08157bf0 0x7fbef00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.985+0000 7fbf0cd55640 1 -- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0004d00 msgr2=0x7fbef0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:26.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.985+0000 7fbf0d556640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0004d00 0x7fbef0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.985+0000 7fbf0cd55640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0004d00 0x7fbef0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.985+0000 7fbf0cd55640 1 -- 172.21.15.113:0/594890818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0003520 con 0x7fbef0003a10 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.986+0000 7fbf0cd55640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbef0003a10 0x7fbef0003e30 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009f90 tx=0x7fbef00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20664907b526b31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.986+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0402cb30 con 0x7fbef0003a10 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.986+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400f040 con 0x7fbef0003a10 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.986+0000 7fbeff7fe640 1 -- 172.21.15.113:0/594890818 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04034440 con 0x7fbef0003a10 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.987+0000 7fbf0efb9640 1 -- 172.21.15.113:0/594890818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbef0003a10 msgr2=0x7fbef0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.987+0000 7fbf0efb9640 1 --2- 172.21.15.113:0/594890818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbef0003a10 0x7fbef0003e30 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009f90 tx=0x7fbef00057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.987+0000 7fbf0d556640 1 -- 172.21.15.113:0/594890818 reap_dead start 2023-12-19T13:59:26.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.987+0000 7fbf0efb9640 1 -- 172.21.15.113:0/594890818 shutdown_connections 2023-12-19T13:59:26.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.987+0000 7fbf0efb9640 1 -- 172.21.15.113:0/594890818 >> 172.21.15.113:0/594890818 conn(0x7fbf080cbb70 msgr2=0x7fbf080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:26.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.987+0000 7fbf0efb9640 1 -- 172.21.15.113:0/594890818 shutdown_connections 2023-12-19T13:59:26.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.987+0000 7fbf0efb9640 1 -- 172.21.15.113:0/594890818 wait complete. 2023-12-19T13:59:26.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.989+0000 7fbf0efb9640 1 Processor -- start 2023-12-19T13:59:26.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.989+0000 7fbf0efb9640 1 -- start start 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbf0efb9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0003a10 0x7fbf081f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbf0efb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf08158780 0x7fbf08146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbf0efb9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf081e3d80 0x7fbf080b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbf0efb9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08147190 con 0x7fbf08158780 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbf0efb9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf081e6620 con 0x7fbef0003a10 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbf0efb9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf081f6cc0 con 0x7fbf081e3d80 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbefffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf08158780 0x7fbf08146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbefffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf08158780 0x7fbf08146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:32830/0 (socket says 172.21.15.113:32830) 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.990+0000 7fbefffff640 1 -- 172.21.15.113:0/1443377325 learned_addr learned my addr 172.21.15.113:0/1443377325 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefffff640 1 -- 172.21.15.113:0/1443377325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf081e3d80 msgr2=0x7fbf080b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefffff640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf081e3d80 0x7fbf080b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefffff640 1 -- 172.21.15.113:0/1443377325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0003a10 msgr2=0x7fbf081f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:26.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefffff640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0003a10 0x7fbf081f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:26.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefffff640 1 -- 172.21.15.113:0/1443377325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf081e4200 con 0x7fbf08158780 2023-12-19T13:59:26.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefffff640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf08158780 0x7fbf08146c50 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fbef800c530 tx=0x7fbef800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefd7fa640 1 -- 172.21.15.113:0/1443377325 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80052d0 con 0x7fbf08158780 2023-12-19T13:59:26.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefd7fa640 1 -- 172.21.15.113:0/1443377325 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8005430 con 0x7fbf08158780 2023-12-19T13:59:26.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf081f6420 con 0x7fbf08158780 2023-12-19T13:59:26.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbefd7fa640 1 -- 172.21.15.113:0/1443377325 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8012850 con 0x7fbf08158780 2023-12-19T13:59:26.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.991+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf081f69e0 con 0x7fbf08158780 2023-12-19T13:59:26.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.992+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf08061910 con 0x7fbf08158780 2023-12-19T13:59:26.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.993+0000 7fbefd7fa640 1 -- 172.21.15.113:0/1443377325 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbef80129b0 con 0x7fbf08158780 2023-12-19T13:59:26.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.994+0000 7fbefd7fa640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbef406a460 0x7fbef406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:26.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.994+0000 7fbefd7fa640 1 -- 172.21.15.113:0/1443377325 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbef80884e0 con 0x7fbf08158780 2023-12-19T13:59:26.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.995+0000 7fbf0cd55640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbef406a460 0x7fbef406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:26.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.995+0000 7fbf0cd55640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbef406a460 0x7fbef406c920 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbf04036000 tx=0x7fbf0402e070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:26.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:26.999+0000 7fbefd7fa640 1 -- 172.21.15.113:0/1443377325 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbef80539f0 con 0x7fbf08158780 2023-12-19T13:59:27.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.188+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf0806dec0 con 0x7fbf08158780 2023-12-19T13:59:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.191+0000 7fbefd7fa640 1 -- 172.21.15.113:0/1443377325 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+16264 (secure 0 0 0) 0x7fbef8057010 con 0x7fbf08158780 2023-12-19T13:59:27.190 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:27.191 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":184,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:59:23.697723+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:57:59.812489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T13:58:00.348071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.0","mappings":[{"from":2,"to":5}]},{"pgid":"21.11","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbef406a460 msgr2=0x7fbef406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbef406a460 0x7fbef406c920 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbf04036000 tx=0x7fbf0402e070 comp rx=0 tx=0).stop 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf08158780 msgr2=0x7fbf08146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf08158780 0x7fbf08146c50 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fbef800c530 tx=0x7fbef800c9f0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 shutdown_connections 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbef406a460 0x7fbef406c920 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf081e3d80 0x7fbf080b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf08158780 0x7fbf08146c50 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 --2- 172.21.15.113:0/1443377325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef0003a10 0x7fbf081f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 >> 172.21.15.113:0/1443377325 conn(0x7fbf080cbb70 msgr2=0x7fbf08156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 shutdown_connections 2023-12-19T13:59:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.194+0000 7fbf0efb9640 1 -- 172.21.15.113:0/1443377325 wait complete. 2023-12-19T13:59:27.210 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:59:27.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.406+0000 7f54cac1a640 1 Processor -- start 2023-12-19T13:59:27.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.406+0000 7f54cac1a640 1 -- start start 2023-12-19T13:59:27.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54cac1a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f54c40ae110 0x7f54c40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54cac1a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54c40b0640 0x7f54c406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54cac1a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b0a60 con 0x7f54c4157bf0 2023-12-19T13:59:27.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54cac1a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c406b8c0 con 0x7f54c40b0640 2023-12-19T13:59:27.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54cac1a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40ae640 con 0x7f54c40ae110 2023-12-19T13:59:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54c89b6640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f54c4157bf0 0x7f54c415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40660/0 (socket says 172.21.15.113:40660) 2023-12-19T13:59:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54c89b6640 1 -- 172.21.15.113:0/677880187 learned_addr learned my addr 172.21.15.113:0/677880187 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.408+0000 7f54c91b7640 1 --2- 172.21.15.113:0/677880187 >> v2:172.21.15.113:3300/0 conn(0x7f54c40b0640 0x7f54c406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:27.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.409+0000 7f54c3fff640 1 --2- 172.21.15.113:0/677880187 >> v2:172.21.15.151:3300/0 conn(0x7f54c40ae110 0x7f54c40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.409+0000 7f54c37fe640 1 -- 172.21.15.113:0/677880187 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626159416 0 0) 0x7f54c40b0a60 con 0x7f54c4157bf0 2023-12-19T13:59:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.409+0000 7f54c37fe640 1 -- 172.21.15.113:0/677880187 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b4003520 con 0x7f54c4157bf0 2023-12-19T13:59:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.409+0000 7f54c91b7640 1 -- 172.21.15.113:0/677880187 >> v2:172.21.15.151:3300/0 conn(0x7f54c40ae110 msgr2=0x7f54c40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.409+0000 7f54c91b7640 1 --2- 172.21.15.113:0/677880187 >> v2:172.21.15.151:3300/0 conn(0x7f54c40ae110 0x7f54c40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.409+0000 7f54c91b7640 1 -- 172.21.15.113:0/677880187 >> v1:172.21.15.113:6789/0 conn(0x7f54c4157bf0 legacy=0x7f54c415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.409+0000 7f54c91b7640 1 -- 172.21.15.113:0/677880187 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40ae920 con 0x7f54c40b0640 2023-12-19T13:59:27.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.410+0000 7f54c91b7640 1 --2- 172.21.15.113:0/677880187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40b0640 0x7f54c406d230 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f54c40af4b0 tx=0x7f54bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab8d4768e27d3e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:27.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.410+0000 7f54c37fe640 1 -- 172.21.15.113:0/677880187 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc02cc80 con 0x7f54c40b0640 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.410+0000 7f54c37fe640 1 -- 172.21.15.113:0/677880187 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc02cde0 con 0x7f54c40b0640 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.410+0000 7f54c37fe640 1 -- 172.21.15.113:0/677880187 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc034660 con 0x7f54c40b0640 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 -- 172.21.15.113:0/677880187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40b0640 msgr2=0x7f54c406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 --2- 172.21.15.113:0/677880187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40b0640 0x7f54c406d230 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f54c40af4b0 tx=0x7f54bc02bed0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 -- 172.21.15.113:0/677880187 shutdown_connections 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 --2- 172.21.15.113:0/677880187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40b0640 0x7f54c406d230 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 --2- 172.21.15.113:0/677880187 >> v2:172.21.15.151:3300/0 conn(0x7f54c40ae110 0x7f54c40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 -- 172.21.15.113:0/677880187 >> 172.21.15.113:0/677880187 conn(0x7f54c40cbb70 msgr2=0x7f54c40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:27.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 -- 172.21.15.113:0/677880187 shutdown_connections 2023-12-19T13:59:27.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.411+0000 7f54cac1a640 1 -- 172.21.15.113:0/677880187 wait complete. 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.413+0000 7f54cac1a640 1 Processor -- start 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.413+0000 7f54cac1a640 1 -- start start 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54cac1a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40ae110 0x7f54c41e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54cac1a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c40b0640 0x7f54c414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54cac1a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c4157bf0 0x7f54c415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54cac1a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c414ad80 con 0x7f54c40ae110 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54cac1a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c415d790 con 0x7f54c40b0640 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54cac1a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c41e5d70 con 0x7f54c4157bf0 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54c89b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40ae110 0x7f54c41e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54c89b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40ae110 0x7f54c41e50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:32852/0 (socket says 172.21.15.113:32852) 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.414+0000 7f54c89b6640 1 -- 172.21.15.113:0/3291933756 learned_addr learned my addr 172.21.15.113:0/3291933756 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:27.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c89b6640 1 -- 172.21.15.113:0/3291933756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c4157bf0 msgr2=0x7f54c415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c89b6640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c4157bf0 0x7f54c415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c89b6640 1 -- 172.21.15.113:0/3291933756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c40b0640 msgr2=0x7f54c414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c89b6640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c40b0640 0x7f54c414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c89b6640 1 -- 172.21.15.113:0/3291933756 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc009a70 con 0x7f54c40ae110 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c89b6640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40ae110 0x7f54c41e50f0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c500 tx=0x7f54b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c17fa640 1 -- 172.21.15.113:0/3291933756 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8005ce0 con 0x7f54c40ae110 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c17fa640 1 -- 172.21.15.113:0/3291933756 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8005e40 con 0x7f54c40ae110 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c41e57b0 con 0x7f54c40ae110 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54c17fa640 1 -- 172.21.15.113:0/3291933756 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8007330 con 0x7f54c40ae110 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.415+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c41593b0 con 0x7f54c40ae110 2023-12-19T13:59:27.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.416+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c4157fd0 con 0x7f54c40ae110 2023-12-19T13:59:27.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.417+0000 7f54c17fa640 1 -- 172.21.15.113:0/3291933756 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f54b8007550 con 0x7f54c40ae110 2023-12-19T13:59:27.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.419+0000 7f54c17fa640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54a806a430 0x7f54a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.419+0000 7f54c17fa640 1 -- 172.21.15.113:0/3291933756 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f54b8087f30 con 0x7f54c40ae110 2023-12-19T13:59:27.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.419+0000 7f54c3fff640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54a806a430 0x7f54a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:27.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.420+0000 7f54c3fff640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54a806a430 0x7f54a806c8f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006fd0 tx=0x7f54b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.423+0000 7f54c17fa640 1 -- 172.21.15.113:0/3291933756 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f54b8053570 con 0x7f54c40ae110 2023-12-19T13:59:27.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.642+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f54c40aebd0 con 0x7f54c40ae110 2023-12-19T13:59:27.642 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T13:59:27.643+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:59:27.657 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.658+0000 7f54c17fa640 1 -- 172.21.15.113:0/3291933756 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) v1 ==== 161+0+0 (secure 0 0 0) 0x7f54b8017090 con 0x7f54c40ae110 2023-12-19T13:59:27.657 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:59:27.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.660+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54a806a430 msgr2=0x7f54a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.660+0000 7f54cac1a640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54a806a430 0x7f54a806c8f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006fd0 tx=0x7f54b0008040 comp rx=0 tx=0).stop 2023-12-19T13:59:27.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.660+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40ae110 msgr2=0x7f54c41e50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.660+0000 7f54cac1a640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40ae110 0x7f54c41e50f0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c500 tx=0x7f54b800c9c0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 shutdown_connections 2023-12-19T13:59:27.660 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f54a806a430 0x7f54a806c8f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c4157bf0 0x7f54c415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c40b0640 0x7f54c414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 --2- 172.21.15.113:0/3291933756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c40ae110 0x7f54c41e50f0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 >> 172.21.15.113:0/3291933756 conn(0x7f54c40cbb70 msgr2=0x7f54c414cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:27.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 shutdown_connections 2023-12-19T13:59:27.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.661+0000 7f54cac1a640 1 -- 172.21.15.113:0/3291933756 wait complete. 2023-12-19T13:59:27.677 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:59:27.734 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:59:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.861+0000 7f09b536e640 1 Processor -- start 2023-12-19T13:59:27.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.862+0000 7f09b536e640 1 -- start start 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.863+0000 7f09b536e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f09b0155460 0x7f09b00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.863+0000 7f09b536e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b015c9c0 con 0x7f09b00b0830 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.863+0000 7f09b536e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b006d270 con 0x7f09b006cc50 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.863+0000 7f09b536e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00b0ce0 con 0x7f09b0155460 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.863+0000 7f09affff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f09b0155460 0x7f09b00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.863+0000 7f09a7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f09b00b0830 0x7f09b006c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:40682/0 (socket says 172.21.15.113:40682) 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.863+0000 7f09a7fff640 1 -- 172.21.15.113:0/1260559658 learned_addr learned my addr 172.21.15.113:0/1260559658 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.864+0000 7f09affff640 1 -- 172.21.15.113:0/1260559658 >> v1:172.21.15.151:6789/0 conn(0x7f09b006cc50 legacy=0x7f09b00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.864+0000 7f09affff640 1 -- 172.21.15.113:0/1260559658 >> v1:172.21.15.113:6789/0 conn(0x7f09b00b0830 legacy=0x7f09b006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.864+0000 7f09affff640 1 -- 172.21.15.113:0/1260559658 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b006d550 con 0x7f09b0155460 2023-12-19T13:59:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.865+0000 7f09affff640 1 --2- 172.21.15.113:0/1260559658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b0155460 0x7f09b00b02f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f09a00097a0 tx=0x7f09a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540be287e05c701f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.865+0000 7f09af7fe640 1 -- 172.21.15.113:0/1260559658 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0031830 con 0x7f09b0155460 2023-12-19T13:59:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.865+0000 7f09af7fe640 1 -- 172.21.15.113:0/1260559658 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0031990 con 0x7f09b0155460 2023-12-19T13:59:27.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.865+0000 7f09af7fe640 1 -- 172.21.15.113:0/1260559658 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0031d20 con 0x7f09b0155460 2023-12-19T13:59:27.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.866+0000 7f09b536e640 1 -- 172.21.15.113:0/1260559658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b0155460 msgr2=0x7f09b00b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.866+0000 7f09b536e640 1 --2- 172.21.15.113:0/1260559658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b0155460 0x7f09b00b02f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f09a00097a0 tx=0x7f09a002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.866+0000 7f09b536e640 1 -- 172.21.15.113:0/1260559658 shutdown_connections 2023-12-19T13:59:27.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.866+0000 7f09b536e640 1 --2- 172.21.15.113:0/1260559658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b0155460 0x7f09b00b02f0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.866+0000 7f09b536e640 1 -- 172.21.15.113:0/1260559658 >> 172.21.15.113:0/1260559658 conn(0x7f09b00659a0 msgr2=0x7f09b0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:27.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.866+0000 7f09b536e640 1 -- 172.21.15.113:0/1260559658 shutdown_connections 2023-12-19T13:59:27.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.866+0000 7f09b536e640 1 -- 172.21.15.113:0/1260559658 wait complete. 2023-12-19T13:59:27.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.868+0000 7f09b536e640 1 Processor -- start 2023-12-19T13:59:27.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.868+0000 7f09b536e640 1 -- start start 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09b536e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b006cc50 0x7f09b01eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09b536e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09b00b0830 0x7f09b0156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09b536e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09b0155460 0x7f09b01f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09b536e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0156790 con 0x7f09b006cc50 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09b536e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0155b80 con 0x7f09b00b0830 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09b536e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0155e60 con 0x7f09b0155460 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b006cc50 0x7f09b01eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b006cc50 0x7f09b01eddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:32890/0 (socket says 172.21.15.113:32890) 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 -- 172.21.15.113:0/1516728424 learned_addr learned my addr 172.21.15.113:0/1516728424 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 -- 172.21.15.113:0/1516728424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09b0155460 msgr2=0x7f09b01f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09b0155460 0x7f09b01f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 -- 172.21.15.113:0/1516728424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09b00b0830 msgr2=0x7f09b0156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09b00b0830 0x7f09b0156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 -- 172.21.15.113:0/1516728424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009400 con 0x7f09b006cc50 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.869+0000 7f09affff640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b006cc50 0x7f09b01eddd0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.870+0000 7f09ad7fa640 1 -- 172.21.15.113:0/1516728424 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a003aa60 con 0x7f09b006cc50 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.870+0000 7f09ad7fa640 1 -- 172.21.15.113:0/1516728424 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a003abc0 con 0x7f09b006cc50 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.870+0000 7f09ad7fa640 1 -- 172.21.15.113:0/1516728424 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00443f0 con 0x7f09b006cc50 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.870+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b0156140 con 0x7f09b006cc50 2023-12-19T13:59:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.870+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b01ee310 con 0x7f09b006cc50 2023-12-19T13:59:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.871+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b0061910 con 0x7f09b006cc50 2023-12-19T13:59:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.872+0000 7f09ad7fa640 1 -- 172.21.15.113:0/1516728424 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09a004d450 con 0x7f09b006cc50 2023-12-19T13:59:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.872+0000 7f09ad7fa640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f099006a430 0x7f099006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.873+0000 7f09ad7fa640 1 -- 172.21.15.113:0/1516728424 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f09a00aabb0 con 0x7f09b006cc50 2023-12-19T13:59:27.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.873+0000 7f09a7fff640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f099006a430 0x7f099006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:27.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.873+0000 7f09a7fff640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f099006a430 0x7f099006c8f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f09b01f3f30 tx=0x7f0998007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:27.877+0000 7f09ad7fa640 1 -- 172.21.15.113:0/1516728424 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f09a0076230 con 0x7f09b006cc50 2023-12-19T13:59:28.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.105+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09b00afaf0 con 0x7f09b006cc50 2023-12-19T13:59:28.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.664+0000 7f09ad7fa640 1 -- 172.21.15.113:0/1516728424 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09a0079850 con 0x7f09b006cc50 2023-12-19T13:59:28.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f099006a430 msgr2=0x7f099006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:28.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f099006a430 0x7f099006c8f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f09b01f3f30 tx=0x7f0998007a40 comp rx=0 tx=0).stop 2023-12-19T13:59:28.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b006cc50 msgr2=0x7f09b01eddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:28.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b006cc50 0x7f09b01eddd0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a00046c0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 shutdown_connections 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f099006a430 0x7f099006c8f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09b0155460 0x7f09b01f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09b00b0830 0x7f09b0156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 --2- 172.21.15.113:0/1516728424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09b006cc50 0x7f09b01eddd0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 >> 172.21.15.113:0/1516728424 conn(0x7f09b00659a0 msgr2=0x7f09b015f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 shutdown_connections 2023-12-19T13:59:28.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.668+0000 7f09b536e640 1 -- 172.21.15.113:0/1516728424 wait complete. 2023-12-19T13:59:28.687 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:59:28.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.900+0000 7fbd91e9e640 1 Processor -- start 2023-12-19T13:59:28.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.900+0000 7fbd91e9e640 1 -- start start 2023-12-19T13:59:28.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd91e9e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:28.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd91e9e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd8c15ac20 0x7fbd8c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:28.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd91e9e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c06d340 con 0x7fbd8c06cf60 2023-12-19T13:59:28.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd91e9e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c15b4a0 con 0x7fbd8c15ac20 2023-12-19T13:59:28.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd91e9e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0b25b0 con 0x7fbd8c0cf100 2023-12-19T13:59:28.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd9169d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd8c15ac20 0x7fbd8c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:28.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd9169d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbd8c15ac20 0x7fbd8c0b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39108/0 (socket says 172.21.15.113:39108) 2023-12-19T13:59:28.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.902+0000 7fbd9169d640 1 -- 172.21.15.113:0/3874648306 learned_addr learned my addr 172.21.15.113:0/3874648306 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.903+0000 7fbd8bfff640 1 --2- 172.21.15.113:0/3874648306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.903+0000 7fbd9169d640 1 -- 172.21.15.113:0/3874648306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 msgr2=0x7fbd8c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.903+0000 7fbd9169d640 1 --2- 172.21.15.113:0/3874648306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.903+0000 7fbd9169d640 1 -- 172.21.15.113:0/3874648306 >> v1:172.21.15.151:6789/0 conn(0x7fbd8c06cf60 legacy=0x7fbd8c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.903+0000 7fbd9169d640 1 -- 172.21.15.113:0/3874648306 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0b2890 con 0x7fbd8c15ac20 2023-12-19T13:59:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.903+0000 7fbd8bfff640 1 --2- 172.21.15.113:0/3874648306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:28.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.904+0000 7fbd9169d640 1 --2- 172.21.15.113:0/3874648306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c0b1180 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009e50 tx=0x7fbd8402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e311b4adb2bb27d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:28.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.904+0000 7fbd8b7fe640 1 -- 172.21.15.113:0/3874648306 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8402cb90 con 0x7fbd8c15ac20 2023-12-19T13:59:28.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.904+0000 7fbd8b7fe640 1 -- 172.21.15.113:0/3874648306 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8402ccf0 con 0x7fbd8c15ac20 2023-12-19T13:59:28.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.904+0000 7fbd8b7fe640 1 -- 172.21.15.113:0/3874648306 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84034610 con 0x7fbd8c15ac20 2023-12-19T13:59:28.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 -- 172.21.15.113:0/3874648306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 msgr2=0x7fbd8c0b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:28.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/3874648306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c0b1180 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009e50 tx=0x7fbd8402bff0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 -- 172.21.15.113:0/3874648306 shutdown_connections 2023-12-19T13:59:28.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/3874648306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c0b1180 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/3874648306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 -- 172.21.15.113:0/3874648306 >> 172.21.15.113:0/3874648306 conn(0x7fbd8c0b4750 msgr2=0x7fbd8c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:28.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 -- 172.21.15.113:0/3874648306 shutdown_connections 2023-12-19T13:59:28.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.905+0000 7fbd91e9e640 1 -- 172.21.15.113:0/3874648306 wait complete. 2023-12-19T13:59:28.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.907+0000 7fbd91e9e640 1 Processor -- start 2023-12-19T13:59:28.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.907+0000 7fbd91e9e640 1 -- start start 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd91e9e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c06cf60 0x7fbd8c149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd91e9e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd91e9e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd91e9e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c1559c0 con 0x7fbd8c15ac20 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd91e9e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c154db0 con 0x7fbd8c06cf60 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd91e9e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c155090 con 0x7fbd8c0cf100 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd9169d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd9169d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c06b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39110/0 (socket says 172.21.15.113:39110) 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.908+0000 7fbd9169d640 1 -- 172.21.15.113:0/1155677878 learned_addr learned my addr 172.21.15.113:0/1155677878 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd90e9c640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c06cf60 0x7fbd8c149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:28.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd8bfff640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:28.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd9169d640 1 -- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 msgr2=0x7fbd8c156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:28.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd9169d640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd9169d640 1 -- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c06cf60 msgr2=0x7fbd8c149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:28.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd9169d640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c06cf60 0x7fbd8c149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:28.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd9169d640 1 -- 172.21.15.113:0/1155677878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84009b30 con 0x7fbd8c15ac20 2023-12-19T13:59:28.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.909+0000 7fbd9169d640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c06b750 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009e50 tx=0x7fbd84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:28.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.910+0000 7fbd897fa640 1 -- 172.21.15.113:0/1155677878 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84040670 con 0x7fbd8c15ac20 2023-12-19T13:59:28.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.910+0000 7fbd897fa640 1 -- 172.21.15.113:0/1155677878 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd840407d0 con 0x7fbd8c15ac20 2023-12-19T13:59:28.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.910+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c155370 con 0x7fbd8c15ac20 2023-12-19T13:59:28.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.910+0000 7fbd897fa640 1 -- 172.21.15.113:0/1155677878 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84040b80 con 0x7fbd8c15ac20 2023-12-19T13:59:28.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.910+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c1566b0 con 0x7fbd8c15ac20 2023-12-19T13:59:28.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.911+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c061910 con 0x7fbd8c15ac20 2023-12-19T13:59:28.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.912+0000 7fbd897fa640 1 -- 172.21.15.113:0/1155677878 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd84040ce0 con 0x7fbd8c15ac20 2023-12-19T13:59:28.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.913+0000 7fbd897fa640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7006a480 0x7fbd7006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:28.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.913+0000 7fbd897fa640 1 -- 172.21.15.113:0/1155677878 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fbd840ab880 con 0x7fbd8c15ac20 2023-12-19T13:59:28.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.913+0000 7fbd90e9c640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7006a480 0x7fbd7006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:28.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.914+0000 7fbd90e9c640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7006a480 0x7fbd7006c940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000f60 tx=0x7fbd80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:28.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:28.917+0000 7fbd897fa640 1 -- 172.21.15.113:0/1155677878 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbd84076e70 con 0x7fbd8c15ac20 2023-12-19T13:59:29.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.091+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd8c0cdbe0 con 0x7fbd8c15ac20 2023-12-19T13:59:29.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.814+0000 7fbd897fa640 1 -- 172.21.15.113:0/1155677878 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v186) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbd8402ce60 con 0x7fbd8c15ac20 2023-12-19T13:59:29.815 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:59:29.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.819+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7006a480 msgr2=0x7fbd7006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:29.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.819+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7006a480 0x7fbd7006c940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000f60 tx=0x7fbd80009040 comp rx=0 tx=0).stop 2023-12-19T13:59:29.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.819+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 msgr2=0x7fbd8c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:29.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.819+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c06b750 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009e50 tx=0x7fbd84004a40 comp rx=0 tx=0).stop 2023-12-19T13:59:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.820+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 shutdown_connections 2023-12-19T13:59:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.820+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbd7006a480 0x7fbd7006c940 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.820+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd8c15ac20 0x7fbd8c06b750 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.820+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8c0cf100 0x7fbd8c156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.820+0000 7fbd91e9e640 1 --2- 172.21.15.113:0/1155677878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd8c06cf60 0x7fbd8c149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.820+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 >> 172.21.15.113:0/1155677878 conn(0x7fbd8c0b4750 msgr2=0x7fbd8c15c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:29.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.821+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 shutdown_connections 2023-12-19T13:59:29.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:29.821+0000 7fbd91e9e640 1 -- 172.21.15.113:0/1155677878 wait complete. 2023-12-19T13:59:29.842 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:59:30.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.057+0000 7f42f96b6640 1 Processor -- start 2023-12-19T13:59:30.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.058+0000 7f42f96b6640 1 -- start start 2023-12-19T13:59:30.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.059+0000 7f42f96b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 0x7f42f4143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.059+0000 7f42f96b6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f4143c50 con 0x7f42f41406a0 2023-12-19T13:59:30.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.060+0000 7f42f96b6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f415db40 con 0x7f42f41402c0 2023-12-19T13:59:30.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.060+0000 7f42f96b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40b6760 con 0x7f42f4161130 2023-12-19T13:59:30.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.060+0000 7f42f37fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f42f41406a0 0x7f42f40b7f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50958/0 (socket says 172.21.15.113:50958) 2023-12-19T13:59:30.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.060+0000 7f42f37fe640 1 -- 172.21.15.113:0/1603572995 learned_addr learned my addr 172.21.15.113:0/1603572995 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:30.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.060+0000 7f42f27fc640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 0x7f42f4143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:30.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.060+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529986859 0 0) 0x7f42ec001110 con 0x7f42f41406a0 2023-12-19T13:59:30.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.060+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42e0003520 con 0x7f42f41406a0 2023-12-19T13:59:30.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3947880491 0 0) 0x7f42e0003520 con 0x7f42f41406a0 2023-12-19T13:59:30.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 msgr2=0x7f42f4143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:30.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 0x7f42f4143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 >> v1:172.21.15.151:6789/0 conn(0x7f42f41402c0 legacy=0x7f42f4140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f4161660 con 0x7f42f41406a0 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f42ec001800 con 0x7f42f41406a0 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 >> v1:172.21.15.113:6789/0 conn(0x7f42f41406a0 legacy=0x7f42f40b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 0x7f42e00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42e0004d00 0x7f42e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40b6760 con 0x7f42e0003f20 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e000ba60 con 0x7f42e0004d00 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e000bc20 con 0x7f42f4161130 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.061+0000 7f42f27fc640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f27fc640 1 -- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 msgr2=0x7f42e00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:30.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f2ffd640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 0x7f42e00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:30.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f37fe640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42e0004d00 0x7f42e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:30.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f27fc640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 0x7f42e00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f27fc640 1 -- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42e0004d00 msgr2=0x7f42e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:30.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f27fc640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42e0004d00 0x7f42e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f27fc640 1 -- 172.21.15.113:0/1603572995 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0003520 con 0x7f42e0003f20 2023-12-19T13:59:30.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f2ffd640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f4161130 0x7f42e00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:30.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.062+0000 7f42f37fe640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42e0004d00 0x7f42e0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.063+0000 7f42f27fc640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42e00047c0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009ac0 tx=0x7f42e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a126eb6e7fbc4bef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.063+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc02c6b0 con 0x7f42e0003f20 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.063+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc02c810 con 0x7f42e0003f20 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.063+0000 7f42f1ffb640 1 -- 172.21.15.113:0/1603572995 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc02cba0 con 0x7f42e0003f20 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.064+0000 7f42f96b6640 1 -- 172.21.15.113:0/1603572995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 msgr2=0x7f42e00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.064+0000 7f42f96b6640 1 --2- 172.21.15.113:0/1603572995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42e00047c0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009ac0 tx=0x7f42e00057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.064+0000 7f42f37fe640 1 -- 172.21.15.113:0/1603572995 reap_dead start 2023-12-19T13:59:30.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.064+0000 7f42f96b6640 1 -- 172.21.15.113:0/1603572995 shutdown_connections 2023-12-19T13:59:30.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.064+0000 7f42f96b6640 1 -- 172.21.15.113:0/1603572995 >> 172.21.15.113:0/1603572995 conn(0x7f42f4065dc0 msgr2=0x7f42f40b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:30.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.064+0000 7f42f96b6640 1 -- 172.21.15.113:0/1603572995 shutdown_connections 2023-12-19T13:59:30.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.064+0000 7f42f96b6640 1 -- 172.21.15.113:0/1603572995 wait complete. 2023-12-19T13:59:30.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.066+0000 7f42f96b6640 1 Processor -- start 2023-12-19T13:59:30.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.066+0000 7f42f96b6640 1 -- start start 2023-12-19T13:59:30.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f96b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42f40702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f96b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f413be30 0x7f42f40707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f96b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f41f6210 0x7f42f41f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f96b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f41f6f80 con 0x7f42e0003f20 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f96b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4153670 con 0x7f42f41f6210 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f96b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4153950 con 0x7f42f413be30 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42f40702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42f40702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39118/0 (socket says 172.21.15.113:39118) 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 -- 172.21.15.113:0/83792166 learned_addr learned my addr 172.21.15.113:0/83792166 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 -- 172.21.15.113:0/83792166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f413be30 msgr2=0x7f42f40707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f413be30 0x7f42f40707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 -- 172.21.15.113:0/83792166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f41f6210 msgr2=0x7f42f41f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f41f6210 0x7f42f41f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.067+0000 7f42f2ffd640 1 -- 172.21.15.113:0/83792166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f4153c30 con 0x7f42e0003f20 2023-12-19T13:59:30.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.068+0000 7f42f2ffd640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42f40702a0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f42e400db10 tx=0x7f42e40020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:30.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.068+0000 7f42eb7fe640 1 -- 172.21.15.113:0/83792166 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4003da0 con 0x7f42e0003f20 2023-12-19T13:59:30.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.068+0000 7f42eb7fe640 1 -- 172.21.15.113:0/83792166 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e4006b50 con 0x7f42e0003f20 2023-12-19T13:59:30.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.068+0000 7f42eb7fe640 1 -- 172.21.15.113:0/83792166 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400b740 con 0x7f42e0003f20 2023-12-19T13:59:30.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.068+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f4153f10 con 0x7f42e0003f20 2023-12-19T13:59:30.068 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.068+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f41567f0 con 0x7f42e0003f20 2023-12-19T13:59:30.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.069+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f41569e0 con 0x7f42e0003f20 2023-12-19T13:59:30.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.070+0000 7f42eb7fe640 1 -- 172.21.15.113:0/83792166 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42e400b8a0 con 0x7f42e0003f20 2023-12-19T13:59:30.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.071+0000 7f42eb7fe640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42d406a430 0x7f42d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:30.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.071+0000 7f42eb7fe640 1 -- 172.21.15.113:0/83792166 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f42e4087d30 con 0x7f42e0003f20 2023-12-19T13:59:30.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.072+0000 7f42f27fc640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42d406a430 0x7f42d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:30.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.072+0000 7f42f27fc640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42d406a430 0x7f42d406c8f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f42dc036000 tx=0x7f42dc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:30.077 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.076+0000 7f42eb7fe640 1 -- 172.21.15.113:0/83792166 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f42e4053580 con 0x7f42e0003f20 2023-12-19T13:59:30.266 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.266+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42f4061910 con 0x7f42e0003f20 2023-12-19T13:59:30.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.827+0000 7f42eb7fe640 1 -- 172.21.15.113:0/83792166 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v187) v1 ==== 169+0+0 (secure 0 0 0) 0x7f42e4056ba0 con 0x7f42e0003f20 2023-12-19T13:59:30.829 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T13:59:30.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.832+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42d406a430 msgr2=0x7f42d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:30.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.832+0000 7f42f96b6640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42d406a430 0x7f42d406c8f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f42dc036000 tx=0x7f42dc02e000 comp rx=0 tx=0).stop 2023-12-19T13:59:30.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.832+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 msgr2=0x7f42f40702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:30.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.832+0000 7f42f96b6640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42f40702a0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f42e400db10 tx=0x7f42e40020c0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 shutdown_connections 2023-12-19T13:59:30.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f42d406a430 0x7f42d406c8f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f41f6210 0x7f42f41f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42f413be30 0x7f42f40707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 --2- 172.21.15.113:0/83792166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e0003f20 0x7f42f40702a0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:30.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 >> 172.21.15.113:0/83792166 conn(0x7f42f4065dc0 msgr2=0x7f42f40d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:30.834 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 shutdown_connections 2023-12-19T13:59:30.835 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:30.834+0000 7f42f96b6640 1 -- 172.21.15.113:0/83792166 wait complete. 2023-12-19T13:59:30.856 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T13:59:31.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.061+0000 7fd386ab2640 1 Processor -- start 2023-12-19T13:59:31.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.061+0000 7fd386ab2640 1 -- start start 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd386ab2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd3801540c0 0x7fd3800b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd386ab2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd38015dd40 0x7fd3800ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd386ab2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38015a940 con 0x7fd3800b1b50 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd386ab2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800b1fe0 con 0x7fd3801540c0 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd386ab2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38015e190 con 0x7fd38015dd40 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd38484e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd3801540c0 0x7fd3800b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd38484e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd3801540c0 0x7fd3800b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39134/0 (socket says 172.21.15.113:39134) 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd38484e640 1 -- 172.21.15.113:0/50810752 learned_addr learned my addr 172.21.15.113:0/50810752 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd38484e640 1 -- 172.21.15.113:0/50810752 >> v2:172.21.15.151:3300/0 conn(0x7fd38015dd40 msgr2=0x7fd3800ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd38484e640 1 --2- 172.21.15.113:0/50810752 >> v2:172.21.15.151:3300/0 conn(0x7fd38015dd40 0x7fd3800ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd38484e640 1 -- 172.21.15.113:0/50810752 >> v1:172.21.15.151:6789/0 conn(0x7fd3800b1b50 legacy=0x7fd38015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:31.065 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.063+0000 7fd38484e640 1 -- 172.21.15.113:0/50810752 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38015a050 con 0x7fd3801540c0 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.065+0000 7fd38484e640 1 --2- 172.21.15.113:0/50810752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800b1610 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fd3740098a0 tx=0x7fd37402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd1d69e0badd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.065+0000 7fd37f7fe640 1 -- 172.21.15.113:0/50810752 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3740317c0 con 0x7fd3801540c0 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.065+0000 7fd37f7fe640 1 -- 172.21.15.113:0/50810752 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374031920 con 0x7fd3801540c0 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.065+0000 7fd37f7fe640 1 -- 172.21.15.113:0/50810752 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374031cb0 con 0x7fd3801540c0 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 -- 172.21.15.113:0/50810752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 msgr2=0x7fd3800b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 --2- 172.21.15.113:0/50810752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800b1610 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fd3740098a0 tx=0x7fd37402b860 comp rx=0 tx=0).stop 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 -- 172.21.15.113:0/50810752 shutdown_connections 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 --2- 172.21.15.113:0/50810752 >> v2:172.21.15.151:3300/0 conn(0x7fd38015dd40 0x7fd3800ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 --2- 172.21.15.113:0/50810752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800b1610 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 -- 172.21.15.113:0/50810752 >> 172.21.15.113:0/50810752 conn(0x7fd380066160 msgr2=0x7fd3800cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:31.066 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 -- 172.21.15.113:0/50810752 shutdown_connections 2023-12-19T13:59:31.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.066+0000 7fd386ab2640 1 -- 172.21.15.113:0/50810752 wait complete. 2023-12-19T13:59:31.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.068+0000 7fd386ab2640 1 Processor -- start 2023-12-19T13:59:31.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.068+0000 7fd386ab2640 1 -- start start 2023-12-19T13:59:31.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd386ab2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3800b1b50 0x7fd380144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd386ab2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd386ab2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd38015dd40 0x7fd3800cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd386ab2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801454a0 con 0x7fd3801540c0 2023-12-19T13:59:31.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd386ab2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380167390 con 0x7fd3800b1b50 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd386ab2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd380167670 con 0x7fd38015dd40 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39146/0 (socket says 172.21.15.113:39146) 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 -- 172.21.15.113:0/2270872528 learned_addr learned my addr 172.21.15.113:0/2270872528 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd38484e640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3800b1b50 0x7fd380144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd38504f640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd38015dd40 0x7fd3800cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 -- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd38015dd40 msgr2=0x7fd3800cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd38015dd40 0x7fd3800cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 -- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3800b1b50 msgr2=0x7fd380144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3800b1b50 0x7fd380144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.069+0000 7fd37ffff640 1 -- 172.21.15.113:0/2270872528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740094d0 con 0x7fd3801540c0 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.070+0000 7fd38484e640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3800b1b50 0x7fd380144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.070+0000 7fd37ffff640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800cf070 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b3e0 tx=0x7fd36c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:31.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.070+0000 7fd37d7fa640 1 -- 172.21.15.113:0/2270872528 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011830 con 0x7fd3801540c0 2023-12-19T13:59:31.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.070+0000 7fd37d7fa640 1 -- 172.21.15.113:0/2270872528 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0119b0 con 0x7fd3801540c0 2023-12-19T13:59:31.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.070+0000 7fd37d7fa640 1 -- 172.21.15.113:0/2270872528 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011d60 con 0x7fd3801540c0 2023-12-19T13:59:31.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.070+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380167950 con 0x7fd3801540c0 2023-12-19T13:59:31.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.070+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd380167f10 con 0x7fd3801540c0 2023-12-19T13:59:31.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.071+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380061910 con 0x7fd3801540c0 2023-12-19T13:59:31.072 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.072+0000 7fd37d7fa640 1 -- 172.21.15.113:0/2270872528 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd36c01a400 con 0x7fd3801540c0 2023-12-19T13:59:31.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.074+0000 7fd37d7fa640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd36406a460 0x7fd36406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.074+0000 7fd37d7fa640 1 -- 172.21.15.113:0/2270872528 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd36c088740 con 0x7fd3801540c0 2023-12-19T13:59:31.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.074+0000 7fd38484e640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd36406a460 0x7fd36406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.074 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.075+0000 7fd38484e640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd36406a460 0x7fd36406c920 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd374036000 tx=0x7fd37403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:31.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.078+0000 7fd37d7fa640 1 -- 172.21.15.113:0/2270872528 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd36c0540a0 con 0x7fd3801540c0 2023-12-19T13:59:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.272+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd38006e860 con 0x7fd3801540c0 2023-12-19T13:59:31.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.284+0000 7fd37d7fa640 1 -- 172.21.15.113:0/2270872528 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd36c0576c0 con 0x7fd3801540c0 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd36406a460 msgr2=0x7fd36406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd36406a460 0x7fd36406c920 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd374036000 tx=0x7fd37403d040 comp rx=0 tx=0).stop 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 msgr2=0x7fd3800cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800cf070 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b3e0 tx=0x7fd36c00b8a0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 shutdown_connections 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd36406a460 0x7fd36406c920 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd38015dd40 0x7fd3800cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3801540c0 0x7fd3800cf070 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 --2- 172.21.15.113:0/2270872528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3800b1b50 0x7fd380144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.287+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 >> 172.21.15.113:0/2270872528 conn(0x7fd380066160 msgr2=0x7fd3800cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.288+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 shutdown_connections 2023-12-19T13:59:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.288+0000 7fd386ab2640 1 -- 172.21.15.113:0/2270872528 wait complete. 2023-12-19T13:59:31.309 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-19T13:59:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.513+0000 7f8b2a74e640 1 Processor -- start 2023-12-19T13:59:31.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.513+0000 7f8b2a74e640 1 -- start start 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.514+0000 7f8b2a74e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b24157bf0 0x7f8b2415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b2a74e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8b240b0810 0x7f8b2406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b2a74e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2415b740 con 0x7f8b240ae110 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b2a74e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2406b8c0 con 0x7f8b240b0810 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b2a74e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240ae640 con 0x7f8b24157bf0 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b237fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8b240ae110 0x7f8b240b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50972/0 (socket says 172.21.15.113:50972) 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b237fe640 1 -- 172.21.15.113:0/3461431154 learned_addr learned my addr 172.21.15.113:0/3461431154 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b28ceb640 1 --2- 172.21.15.113:0/3461431154 >> v2:172.21.15.113:3300/0 conn(0x7f8b240b0810 0x7f8b2406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b22ffd640 1 -- 172.21.15.113:0/3461431154 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107648486 0 0) 0x7f8b2415b740 con 0x7f8b240ae110 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b22ffd640 1 -- 172.21.15.113:0/3461431154 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b0c003520 con 0x7f8b240ae110 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b23fff640 1 --2- 172.21.15.113:0/3461431154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b24157bf0 0x7f8b2415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.515+0000 7f8b28ceb640 1 -- 172.21.15.113:0/3461431154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b24157bf0 msgr2=0x7f8b2415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.516+0000 7f8b28ceb640 1 --2- 172.21.15.113:0/3461431154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b24157bf0 0x7f8b2415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.516+0000 7f8b28ceb640 1 -- 172.21.15.113:0/3461431154 >> v1:172.21.15.113:6789/0 conn(0x7f8b240ae110 legacy=0x7f8b240b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.516+0000 7f8b28ceb640 1 -- 172.21.15.113:0/3461431154 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b240ae920 con 0x7f8b240b0810 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.516+0000 7f8b23fff640 1 --2- 172.21.15.113:0/3461431154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b24157bf0 0x7f8b2415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.517+0000 7f8b28ceb640 1 --2- 172.21.15.113:0/3461431154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b2406d230 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009d90 tx=0x7f8b1c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d15d65094fdd317 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.517+0000 7f8b22ffd640 1 -- 172.21.15.113:0/3461431154 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c02cc50 con 0x7f8b240b0810 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.517+0000 7f8b22ffd640 1 -- 172.21.15.113:0/3461431154 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c02cdb0 con 0x7f8b240b0810 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.517+0000 7f8b22ffd640 1 -- 172.21.15.113:0/3461431154 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c034660 con 0x7f8b240b0810 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3461431154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 msgr2=0x7f8b2406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3461431154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b2406d230 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009d90 tx=0x7f8b1c02bea0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3461431154 shutdown_connections 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3461431154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b2406d230 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3461431154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b24157bf0 0x7f8b2415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.520 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3461431154 >> 172.21.15.113:0/3461431154 conn(0x7f8b240cbb70 msgr2=0x7f8b240cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:31.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3461431154 shutdown_connections 2023-12-19T13:59:31.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.518+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3461431154 wait complete. 2023-12-19T13:59:31.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.520+0000 7f8b2a74e640 1 Processor -- start 2023-12-19T13:59:31.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.520+0000 7f8b2a74e640 1 -- start start 2023-12-19T13:59:31.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b2a74e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b240ae110 0x7f8b24152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b2a74e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b240cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b2a74e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b24157bf0 0x7f8b24149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b2a74e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24152890 con 0x7f8b240b0810 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b2a74e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24153b60 con 0x7f8b24157bf0 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b2a74e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24152ae0 con 0x7f8b240ae110 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b240cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b240cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39154/0 (socket says 172.21.15.113:39154) 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 -- 172.21.15.113:0/3904216449 learned_addr learned my addr 172.21.15.113:0/3904216449 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 -- 172.21.15.113:0/3904216449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b240ae110 msgr2=0x7f8b24152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b240ae110 0x7f8b24152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 -- 172.21.15.113:0/3904216449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b24157bf0 msgr2=0x7f8b24149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b24157bf0 0x7f8b24149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.521+0000 7f8b237fe640 1 -- 172.21.15.113:0/3904216449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009a70 con 0x7f8b240b0810 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.522+0000 7f8b237fe640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b240cdee0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c4d0 tx=0x7f8b1800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.522+0000 7f8b20ff9640 1 -- 172.21.15.113:0/3904216449 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18005ce0 con 0x7f8b240b0810 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.522+0000 7f8b20ff9640 1 -- 172.21.15.113:0/3904216449 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18005e40 con 0x7f8b240b0810 2023-12-19T13:59:31.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.522+0000 7f8b20ff9640 1 -- 172.21.15.113:0/3904216449 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18007270 con 0x7f8b240b0810 2023-12-19T13:59:31.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.522+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b24152dc0 con 0x7f8b240b0810 2023-12-19T13:59:31.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.522+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b24153380 con 0x7f8b240b0810 2023-12-19T13:59:31.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.523+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b24061910 con 0x7f8b240b0810 2023-12-19T13:59:31.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.524+0000 7f8b20ff9640 1 -- 172.21.15.113:0/3904216449 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b180073d0 con 0x7f8b240b0810 2023-12-19T13:59:31.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.525+0000 7f8b20ff9640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b1006a460 0x7f8b1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:31.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.525+0000 7f8b20ff9640 1 -- 172.21.15.113:0/3904216449 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b18087ac0 con 0x7f8b240b0810 2023-12-19T13:59:31.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.525+0000 7f8b23fff640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b1006a460 0x7f8b1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:31.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.526+0000 7f8b23fff640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b1006a460 0x7f8b1006c920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8b14006fd0 tx=0x7f8b14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:31.529 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.529+0000 7f8b20ff9640 1 -- 172.21.15.113:0/3904216449 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b180533c0 con 0x7f8b240b0810 2023-12-19T13:59:31.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.790+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f8b240b1cd0 con 0x7f8b240b0810 2023-12-19T13:59:31.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.840+0000 7f8b20ff9640 1 -- 172.21.15.113:0/3904216449 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v610) v1 ==== 131+0+0 (secure 0 0 0) 0x7f8b18017020 con 0x7f8b240b0810 2023-12-19T13:59:31.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b1006a460 msgr2=0x7f8b1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b1006a460 0x7f8b1006c920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8b14006fd0 tx=0x7f8b14008040 comp rx=0 tx=0).stop 2023-12-19T13:59:31.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 msgr2=0x7f8b240cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:31.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b240cdee0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c4d0 tx=0x7f8b1800c990 comp rx=0 tx=0).stop 2023-12-19T13:59:31.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 shutdown_connections 2023-12-19T13:59:31.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8b1006a460 0x7f8b1006c920 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b24157bf0 0x7f8b24149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8b240b0810 0x7f8b240cdee0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 --2- 172.21.15.113:0/3904216449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b240ae110 0x7f8b24152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:31.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 >> 172.21.15.113:0/3904216449 conn(0x7f8b240cbb70 msgr2=0x7f8b2406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:31.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 shutdown_connections 2023-12-19T13:59:31.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:31.843+0000 7f8b2a74e640 1 -- 172.21.15.113:0/3904216449 wait complete. 2023-12-19T13:59:31.861 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-19T13:59:31.861 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T13:59:31.862 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:32.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.051+0000 7f55d6c8f640 1 Processor -- start 2023-12-19T13:59:32.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.051+0000 7f55d6c8f640 1 -- start start 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55d6c8f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f55d015e750 0x7f55d006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55d6c8f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d00b2600 con 0x7f55d00b1710 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55d6c8f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d00b1d60 con 0x7f55d0157aa0 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55d6c8f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d00b2040 con 0x7f55d015e750 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f55d00b1710 0x7f55d015e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50980/0 (socket says 172.21.15.113:50980) 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cffff640 1 -- 172.21.15.113:0/3329439279 learned_addr learned my addr 172.21.15.113:0/3329439279 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55d522c640 1 --2- 172.21.15.113:0/3329439279 >> v2:172.21.15.151:3300/0 conn(0x7f55d015e750 0x7f55d006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.053 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026480110 0 0) 0x7f55d00b2600 con 0x7f55d00b1710 2023-12-19T13:59:32.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c0003520 con 0x7f55d00b1710 2023-12-19T13:59:32.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3062661021 0 0) 0x7f55c0003520 con 0x7f55d00b1710 2023-12-19T13:59:32.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 >> v2:172.21.15.151:3300/0 conn(0x7f55d015e750 msgr2=0x7f55d006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cf7fe640 1 --2- 172.21.15.113:0/3329439279 >> v2:172.21.15.151:3300/0 conn(0x7f55d015e750 0x7f55d006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.055 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 >> v1:172.21.15.151:6789/0 conn(0x7f55d0157aa0 legacy=0x7f55d0161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.053+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d00b2320 con 0x7f55d00b1710 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f55bc001670 con 0x7f55d00b1710 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 >> v1:172.21.15.113:6789/0 conn(0x7f55d00b1710 legacy=0x7f55d015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55c00047c0 0x7f55c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55c00051d0 0x7f55c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00b2040 con 0x7f55c00039e0 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c000c120 con 0x7f55c00047c0 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c000c2e0 con 0x7f55c00051d0 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55d4a2b640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55d4a2b640 1 -- 172.21.15.113:0/3329439279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55c00051d0 msgr2=0x7f55c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55d4a2b640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55c00051d0 0x7f55c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55d4a2b640 1 -- 172.21.15.113:0/3329439279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55c00047c0 msgr2=0x7f55c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.056 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55d4a2b640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55c00047c0 0x7f55c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55d4a2b640 1 -- 172.21.15.113:0/3329439279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0003520 con 0x7f55c00039e0 2023-12-19T13:59:32.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.054+0000 7f55d522c640 1 -- 172.21.15.113:0/3329439279 reap_dead start 2023-12-19T13:59:32.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.055+0000 7f55d4a2b640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55c0003de0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f55c4003db0 tx=0x7f55c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45feb8d39436f608 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.055+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4032600 con 0x7f55c00039e0 2023-12-19T13:59:32.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c402e050 con 0x7f55c00039e0 2023-12-19T13:59:32.057 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55cf7fe640 1 -- 172.21.15.113:0/3329439279 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40329e0 con 0x7f55c00039e0 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55d6c8f640 1 -- 172.21.15.113:0/3329439279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 msgr2=0x7f55c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55c0003de0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f55c4003db0 tx=0x7f55c00057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55d6c8f640 1 -- 172.21.15.113:0/3329439279 shutdown_connections 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/3329439279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55c0003de0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55d6c8f640 1 -- 172.21.15.113:0/3329439279 >> 172.21.15.113:0/3329439279 conn(0x7f55d00cbb70 msgr2=0x7f55d00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55d6c8f640 1 -- 172.21.15.113:0/3329439279 shutdown_connections 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.056+0000 7f55d6c8f640 1 -- 172.21.15.113:0/3329439279 wait complete. 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.058+0000 7f55d6c8f640 1 Processor -- start 2023-12-19T13:59:32.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.058+0000 7f55d6c8f640 1 -- start start 2023-12-19T13:59:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d6c8f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55d0158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d6c8f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55d01f2cc0 0x7f55d0158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d6c8f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55d0153c00 0x7f55d015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d6c8f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d015b3d0 con 0x7f55c00039e0 2023-12-19T13:59:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d6c8f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0158540 con 0x7f55d0153c00 2023-12-19T13:59:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d6c8f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0154600 con 0x7f55d01f2cc0 2023-12-19T13:59:32.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d4a2b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55d0158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d4a2b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55d0158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39174/0 (socket says 172.21.15.113:39174) 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.059+0000 7f55d4a2b640 1 -- 172.21.15.113:0/1248849582 learned_addr learned my addr 172.21.15.113:0/1248849582 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d522c640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55d0153c00 0x7f55d015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d4a2b640 1 -- 172.21.15.113:0/1248849582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55d01f2cc0 msgr2=0x7f55d0158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d4a2b640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55d01f2cc0 0x7f55d0158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d4a2b640 1 -- 172.21.15.113:0/1248849582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55d0153c00 msgr2=0x7f55d015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d4a2b640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55d0153c00 0x7f55d015a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d4a2b640 1 -- 172.21.15.113:0/1248849582 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d01548e0 con 0x7f55c00039e0 2023-12-19T13:59:32.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d4a2b640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55d0158810 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f55c4000c00 tx=0x7f55c40036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55cd7fa640 1 -- 172.21.15.113:0/1248849582 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c403c410 con 0x7f55c00039e0 2023-12-19T13:59:32.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55cd7fa640 1 -- 172.21.15.113:0/1248849582 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c403c570 con 0x7f55c00039e0 2023-12-19T13:59:32.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55cd7fa640 1 -- 172.21.15.113:0/1248849582 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c403c8e0 con 0x7f55c00039e0 2023-12-19T13:59:32.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d0154bc0 con 0x7f55c00039e0 2023-12-19T13:59:32.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.060+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d01540b0 con 0x7f55c00039e0 2023-12-19T13:59:32.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.062+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d0061910 con 0x7f55c00039e0 2023-12-19T13:59:32.062 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.062+0000 7f55cd7fa640 1 -- 172.21.15.113:0/1248849582 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55c4039050 con 0x7f55c00039e0 2023-12-19T13:59:32.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.063+0000 7f55cd7fa640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f55b406a460 0x7f55b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.063+0000 7f55cd7fa640 1 -- 172.21.15.113:0/1248849582 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f55c40a9950 con 0x7f55c00039e0 2023-12-19T13:59:32.063 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.063+0000 7f55cffff640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f55b406a460 0x7f55b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.064+0000 7f55cffff640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f55b406a460 0x7f55b406c920 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0018e0 tx=0x7f55bc001550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.067+0000 7f55cd7fa640 1 -- 172.21.15.113:0/1248849582 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f55c4075380 con 0x7f55c00039e0 2023-12-19T13:59:32.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.245+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55d00af250 con 0x7f55c00039e0 2023-12-19T13:59:32.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.247+0000 7f55cd7fa640 1 -- 172.21.15.113:0/1248849582 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+12579 (secure 0 0 0) 0x7f55c404b020 con 0x7f55c00039e0 2023-12-19T13:59:32.248 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:32.248 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":187,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:59:30.817695+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:6837/2910539170":"2023-12-20T13:59:27.643204+0000","172.21.15.113:6836/2910539170":"2023-12-20T13:59:27.643204+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f55b406a460 msgr2=0x7f55b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f55b406a460 0x7f55b406c920 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0018e0 tx=0x7f55bc001550 comp rx=0 tx=0).stop 2023-12-19T13:59:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 msgr2=0x7f55d0158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55d0158810 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f55c4000c00 tx=0x7f55c40036f0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 shutdown_connections 2023-12-19T13:59:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f55b406a460 0x7f55b406c920 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55d0153c00 0x7f55d015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55d01f2cc0 0x7f55d0158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 --2- 172.21.15.113:0/1248849582 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55c00039e0 0x7f55d0158810 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 >> 172.21.15.113:0/1248849582 conn(0x7f55d00cbb70 msgr2=0x7f55d00cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:32.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 shutdown_connections 2023-12-19T13:59:32.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.250+0000 7f55d6c8f640 1 -- 172.21.15.113:0/1248849582 wait complete. 2023-12-19T13:59:32.268 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:59:32.268 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:59:32.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.482+0000 7fd9d1c84640 1 Processor -- start 2023-12-19T13:59:32.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.482+0000 7fd9d1c84640 1 -- start start 2023-12-19T13:59:32.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.484+0000 7fd9d1c84640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd9cc146ff0 0x7fd9cc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.484+0000 7fd9d1c84640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc0b6430 0x7fd9cc06f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.484+0000 7fd9d1c84640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9cc161e70 con 0x7fd9cc06fa70 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.484+0000 7fd9d1c84640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc161080 con 0x7fd9cc146ff0 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.484+0000 7fd9d1c84640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc06fef0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.484+0000 7fd9cb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd9cc146ff0 0x7fd9cc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.485+0000 7fd9cb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd9cc146ff0 0x7fd9cc0d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39190/0 (socket says 172.21.15.113:39190) 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.485+0000 7fd9cb7fe640 1 -- 172.21.15.113:0/2458165071 learned_addr learned my addr 172.21.15.113:0/2458165071 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:32.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.485+0000 7fd9c3fff640 1 --2- 172.21.15.113:0/2458165071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc0b6430 0x7fd9cc06f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.485+0000 7fd9cb7fe640 1 -- 172.21.15.113:0/2458165071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc0b6430 msgr2=0x7fd9cc06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.485+0000 7fd9cb7fe640 1 --2- 172.21.15.113:0/2458165071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc0b6430 0x7fd9cc06f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.485+0000 7fd9cb7fe640 1 -- 172.21.15.113:0/2458165071 >> v1:172.21.15.151:6789/0 conn(0x7fd9cc06fa70 legacy=0x7fd9cc15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.485+0000 7fd9cb7fe640 1 -- 172.21.15.113:0/2458165071 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc161260 con 0x7fd9cc146ff0 2023-12-19T13:59:32.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.486+0000 7fd9cb7fe640 1 --2- 172.21.15.113:0/2458165071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d10f0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009870 tx=0x7fd9bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd06f915357dd665 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.486+0000 7fd9caffd640 1 -- 172.21.15.113:0/2458165071 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc031640 con 0x7fd9cc146ff0 2023-12-19T13:59:32.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.486+0000 7fd9caffd640 1 -- 172.21.15.113:0/2458165071 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc0317a0 con 0x7fd9cc146ff0 2023-12-19T13:59:32.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.486+0000 7fd9caffd640 1 -- 172.21.15.113:0/2458165071 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc031b30 con 0x7fd9cc146ff0 2023-12-19T13:59:32.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 -- 172.21.15.113:0/2458165071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc146ff0 msgr2=0x7fd9cc0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/2458165071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d10f0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009870 tx=0x7fd9bc02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 -- 172.21.15.113:0/2458165071 shutdown_connections 2023-12-19T13:59:32.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/2458165071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc0b6430 0x7fd9cc06f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/2458165071 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d10f0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 -- 172.21.15.113:0/2458165071 >> 172.21.15.113:0/2458165071 conn(0x7fd9cc0d3520 msgr2=0x7fd9cc0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:32.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 -- 172.21.15.113:0/2458165071 shutdown_connections 2023-12-19T13:59:32.488 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.487+0000 7fd9d1c84640 1 -- 172.21.15.113:0/2458165071 wait complete. 2023-12-19T13:59:32.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.489+0000 7fd9d1c84640 1 Processor -- start 2023-12-19T13:59:32.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.489+0000 7fd9d1c84640 1 -- start start 2023-12-19T13:59:32.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9d1c84640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc06fa70 0x7fd9cc13b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9d1c84640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc0b6430 0x7fd9cc14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9d1c84640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9d1c84640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc140a30 con 0x7fd9cc0b6430 2023-12-19T13:59:32.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9d1c84640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc140460 con 0x7fd9cc146ff0 2023-12-19T13:59:32.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9d1c84640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc1406e0 con 0x7fd9cc06fa70 2023-12-19T13:59:32.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc0b6430 0x7fd9cc14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc0b6430 0x7fd9cc14ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39206/0 (socket says 172.21.15.113:39206) 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9c3fff640 1 -- 172.21.15.113:0/1939300615 learned_addr learned my addr 172.21.15.113:0/1939300615 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.490+0000 7fd9cbfff640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9cb7fe640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc06fa70 0x7fd9cc13b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c3fff640 1 -- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc06fa70 msgr2=0x7fd9cc13b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c3fff640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc06fa70 0x7fd9cc13b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c3fff640 1 -- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9cc146ff0 msgr2=0x7fd9cc0d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c3fff640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c3fff640 1 -- 172.21.15.113:0/1939300615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc0094d0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9cbfff640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c3fff640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc0b6430 0x7fd9cc14ea90 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400d800 tx=0x7fd9b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c8ff9640 1 -- 172.21.15.113:0/1939300615 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4018070 con 0x7fd9cc0b6430 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c8ff9640 1 -- 172.21.15.113:0/1939300615 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4004020 con 0x7fd9cc0b6430 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9c8ff9640 1 -- 172.21.15.113:0/1939300615 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40041b0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc14f4e0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.491+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc13b590 con 0x7fd9cc0b6430 2023-12-19T13:59:32.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.492+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc140be0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.493 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.493+0000 7fd9c8ff9640 1 -- 172.21.15.113:0/1939300615 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9b4004310 con 0x7fd9cc0b6430 2023-12-19T13:59:32.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.494+0000 7fd9c8ff9640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd9ac06a430 0x7fd9ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.494+0000 7fd9c8ff9640 1 -- 172.21.15.113:0/1939300615 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd9b4088570 con 0x7fd9cc0b6430 2023-12-19T13:59:32.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.495+0000 7fd9cb7fe640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd9ac06a430 0x7fd9ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.495+0000 7fd9cb7fe640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd9ac06a430 0x7fd9ac06c8f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc036000 tx=0x7fd9bc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.498+0000 7fd9c8ff9640 1 -- 172.21.15.113:0/1939300615 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9cc140be0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.688+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9cc140be0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.689+0000 7fd9c8ff9640 1 -- 172.21.15.113:0/1939300615 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v187) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9cc140be0 con 0x7fd9cc0b6430 2023-12-19T13:59:32.689 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.691+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd9ac06a430 msgr2=0x7fd9ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.691+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd9ac06a430 0x7fd9ac06c8f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc036000 tx=0x7fd9bc03c040 comp rx=0 tx=0).stop 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.691+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc0b6430 msgr2=0x7fd9cc14ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.691+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc0b6430 0x7fd9cc14ea90 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400d800 tx=0x7fd9b400dcc0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 shutdown_connections 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd9ac06a430 0x7fd9ac06c8f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9cc146ff0 0x7fd9cc0d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9cc0b6430 0x7fd9cc14ea90 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 --2- 172.21.15.113:0/1939300615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9cc06fa70 0x7fd9cc13b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 >> 172.21.15.113:0/1939300615 conn(0x7fd9cc0d3520 msgr2=0x7fd9cc145ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 shutdown_connections 2023-12-19T13:59:32.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.692+0000 7fd9d1c84640 1 -- 172.21.15.113:0/1939300615 wait complete. 2023-12-19T13:59:32.709 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-19T13:59:32.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.913+0000 7fd34db9f640 1 Processor -- start 2023-12-19T13:59:32.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.914+0000 7fd34db9f640 1 -- start start 2023-12-19T13:59:32.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.915+0000 7fd34db9f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd3480b0b50 0x7fd34806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.915+0000 7fd34db9f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd34806b590 0x7fd34806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.915+0000 7fd34db9f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34806bb30 con 0x7fd3481449e0 2023-12-19T13:59:32.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.915+0000 7fd34db9f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480b0070 con 0x7fd34806b590 2023-12-19T13:59:32.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.915+0000 7fd34db9f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480b0350 con 0x7fd3480b0b50 2023-12-19T13:59:32.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.915+0000 7fd347fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd34806b590 0x7fd34806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd347fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd34806b590 0x7fd34806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39212/0 (socket says 172.21.15.113:39212) 2023-12-19T13:59:32.916 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd347fff640 1 -- 172.21.15.113:0/2464718123 learned_addr learned my addr 172.21.15.113:0/2464718123 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:32.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd33ffff640 1 --2- 172.21.15.113:0/2464718123 >> v2:172.21.15.151:3300/0 conn(0x7fd3480b0b50 0x7fd34806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd347fff640 1 -- 172.21.15.113:0/2464718123 >> v2:172.21.15.151:3300/0 conn(0x7fd3480b0b50 msgr2=0x7fd34806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd347fff640 1 --2- 172.21.15.113:0/2464718123 >> v2:172.21.15.151:3300/0 conn(0x7fd3480b0b50 0x7fd34806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd347fff640 1 -- 172.21.15.113:0/2464718123 >> v1:172.21.15.151:6789/0 conn(0x7fd3481449e0 legacy=0x7fd3480af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:32.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd347fff640 1 -- 172.21.15.113:0/2464718123 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480b0630 con 0x7fd34806b590 2023-12-19T13:59:32.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.916+0000 7fd33ffff640 1 --2- 172.21.15.113:0/2464718123 >> v2:172.21.15.151:3300/0 conn(0x7fd3480b0b50 0x7fd34806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:32.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.917+0000 7fd347fff640 1 --2- 172.21.15.113:0/2464718123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd34806c4e0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fd348071c80 tx=0x7fd34002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f83a061971ef4b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.917+0000 7fd346ffd640 1 -- 172.21.15.113:0/2464718123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34002ca80 con 0x7fd34806b590 2023-12-19T13:59:32.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.917+0000 7fd346ffd640 1 -- 172.21.15.113:0/2464718123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34002cbe0 con 0x7fd34806b590 2023-12-19T13:59:32.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.917+0000 7fd346ffd640 1 -- 172.21.15.113:0/2464718123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400343f0 con 0x7fd34806b590 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 -- 172.21.15.113:0/2464718123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 msgr2=0x7fd34806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 --2- 172.21.15.113:0/2464718123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd34806c4e0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fd348071c80 tx=0x7fd34002bee0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 -- 172.21.15.113:0/2464718123 shutdown_connections 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 --2- 172.21.15.113:0/2464718123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd34806c4e0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 --2- 172.21.15.113:0/2464718123 >> v2:172.21.15.151:3300/0 conn(0x7fd3480b0b50 0x7fd34806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 -- 172.21.15.113:0/2464718123 >> 172.21.15.113:0/2464718123 conn(0x7fd3480cbb70 msgr2=0x7fd3480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 -- 172.21.15.113:0/2464718123 shutdown_connections 2023-12-19T13:59:32.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.918+0000 7fd34db9f640 1 -- 172.21.15.113:0/2464718123 wait complete. 2023-12-19T13:59:32.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.920+0000 7fd34db9f640 1 Processor -- start 2023-12-19T13:59:32.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.920+0000 7fd34db9f640 1 -- start start 2023-12-19T13:59:32.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd34db9f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd3481439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd34db9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3480b0b50 0x7fd34815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd34db9f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3481449e0 0x7fd34813a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd34db9f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34815a6c0 con 0x7fd34806b590 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd34db9f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481440d0 con 0x7fd3481449e0 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd34db9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34815c190 con 0x7fd3480b0b50 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd3481439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd3481439f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39218/0 (socket says 172.21.15.113:39218) 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.921+0000 7fd3477fe640 1 -- 172.21.15.113:0/247546250 learned_addr learned my addr 172.21.15.113:0/247546250 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd3477fe640 1 -- 172.21.15.113:0/247546250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3480b0b50 msgr2=0x7fd34815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd3477fe640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3480b0b50 0x7fd34815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd3477fe640 1 -- 172.21.15.113:0/247546250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3481449e0 msgr2=0x7fd34813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd3477fe640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3481449e0 0x7fd34813a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd3477fe640 1 -- 172.21.15.113:0/247546250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340009b30 con 0x7fd34806b590 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd3477fe640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd3481439f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fd33800b3e0 tx=0x7fd33800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd344ff9640 1 -- 172.21.15.113:0/247546250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011830 con 0x7fd34806b590 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd344ff9640 1 -- 172.21.15.113:0/247546250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380119b0 con 0x7fd34806b590 2023-12-19T13:59:32.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34815c470 con 0x7fd34806b590 2023-12-19T13:59:32.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.922+0000 7fd344ff9640 1 -- 172.21.15.113:0/247546250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011d60 con 0x7fd34806b590 2023-12-19T13:59:32.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.923+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34815be60 con 0x7fd34806b590 2023-12-19T13:59:32.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.924+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd348061910 con 0x7fd34806b590 2023-12-19T13:59:32.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.925+0000 7fd344ff9640 1 -- 172.21.15.113:0/247546250 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd33801a400 con 0x7fd34806b590 2023-12-19T13:59:32.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.925+0000 7fd344ff9640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32806a430 0x7fd32806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:32.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.925+0000 7fd344ff9640 1 -- 172.21.15.113:0/247546250 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd338088860 con 0x7fd34806b590 2023-12-19T13:59:32.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.926+0000 7fd33ffff640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32806a430 0x7fd32806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:32.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.926+0000 7fd33ffff640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32806a430 0x7fd32806c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd330006fd0 tx=0x7fd330008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:32.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:32.929+0000 7fd344ff9640 1 -- 172.21.15.113:0/247546250 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3380540b0 con 0x7fd34806b590 2023-12-19T13:59:33.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.167+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fd3480ae560 con 0x7fd34806b590 2023-12-19T13:59:33.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.852+0000 7fd344ff9640 1 -- 172.21.15.113:0/247546250 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v612) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd3380150d0 con 0x7fd34806b590 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.855+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32806a430 msgr2=0x7fd32806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.855+0000 7fd34db9f640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32806a430 0x7fd32806c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd330006fd0 tx=0x7fd330008040 comp rx=0 tx=0).stop 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.855+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 msgr2=0x7fd3481439f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.855+0000 7fd34db9f640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd3481439f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fd33800b3e0 tx=0x7fd33800b8a0 comp rx=0 tx=0).stop 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.855+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 shutdown_connections 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.856+0000 7fd34db9f640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd32806a430 0x7fd32806c8f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.856+0000 7fd34db9f640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3481449e0 0x7fd34813a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.856+0000 7fd34db9f640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3480b0b50 0x7fd34815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:33.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.856+0000 7fd34db9f640 1 --2- 172.21.15.113:0/247546250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd34806b590 0x7fd3481439f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:33.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.856+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 >> 172.21.15.113:0/247546250 conn(0x7fd3480cbb70 msgr2=0x7fd3480af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:33.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.856+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 shutdown_connections 2023-12-19T13:59:33.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:33.856+0000 7fd34db9f640 1 -- 172.21.15.113:0/247546250 wait complete. 2023-12-19T13:59:33.879 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:59:34.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.096+0000 7eff19715640 1 Processor -- start 2023-12-19T13:59:34.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.096+0000 7eff19715640 1 -- start start 2023-12-19T13:59:34.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.097+0000 7eff19715640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff140cdc70 0x7eff1406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:34.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.097+0000 7eff19715640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1406e220 con 0x7eff14141900 2023-12-19T13:59:34.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.097+0000 7eff19715640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff140cbea0 con 0x7eff140b0470 2023-12-19T13:59:34.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.097+0000 7eff19715640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff140cc180 con 0x7eff140cdc70 2023-12-19T13:59:34.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff13fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7eff14141900 0x7eff140afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:50994/0 (socket says 172.21.15.113:50994) 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff13fff640 1 -- 172.21.15.113:0/3075876744 learned_addr learned my addr 172.21.15.113:0/3075876744 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff18f14640 1 --2- 172.21.15.113:0/3075876744 >> v2:172.21.15.113:3300/0 conn(0x7eff140cdc70 0x7eff1406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff137fe640 1 -- 172.21.15.113:0/3075876744 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341986186 0 0) 0x7eff1406e220 con 0x7eff14141900 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff137fe640 1 -- 172.21.15.113:0/3075876744 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff00003520 con 0x7eff14141900 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff18f14640 1 -- 172.21.15.113:0/3075876744 >> v1:172.21.15.151:6789/0 conn(0x7eff140b0470 legacy=0x7eff1406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff18f14640 1 -- 172.21.15.113:0/3075876744 >> v1:172.21.15.113:6789/0 conn(0x7eff14141900 legacy=0x7eff140afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.098+0000 7eff18f14640 1 -- 172.21.15.113:0/3075876744 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140cc460 con 0x7eff140cdc70 2023-12-19T13:59:34.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.099+0000 7eff18f14640 1 --2- 172.21.15.113:0/3075876744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1406dc00 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009d90 tx=0x7eff0c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bff14f83f8ba8c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff137fe640 1 -- 172.21.15.113:0/3075876744 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c02cc60 con 0x7eff140cdc70 2023-12-19T13:59:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff137fe640 1 -- 172.21.15.113:0/3075876744 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c02cdc0 con 0x7eff140cdc70 2023-12-19T13:59:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff137fe640 1 -- 172.21.15.113:0/3075876744 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c034660 con 0x7eff140cdc70 2023-12-19T13:59:34.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff19715640 1 -- 172.21.15.113:0/3075876744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 msgr2=0x7eff1406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff19715640 1 --2- 172.21.15.113:0/3075876744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1406dc00 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009d90 tx=0x7eff0c02beb0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff19715640 1 -- 172.21.15.113:0/3075876744 shutdown_connections 2023-12-19T13:59:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff19715640 1 --2- 172.21.15.113:0/3075876744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1406dc00 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.100+0000 7eff19715640 1 -- 172.21.15.113:0/3075876744 >> 172.21.15.113:0/3075876744 conn(0x7eff1406f630 msgr2=0x7eff1406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.101+0000 7eff19715640 1 -- 172.21.15.113:0/3075876744 shutdown_connections 2023-12-19T13:59:34.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.101+0000 7eff19715640 1 -- 172.21.15.113:0/3075876744 wait complete. 2023-12-19T13:59:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.102+0000 7eff19715640 1 Processor -- start 2023-12-19T13:59:34.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.102+0000 7eff19715640 1 -- start start 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.103+0000 7eff19715640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff140b0470 0x7eff1413e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.103+0000 7eff19715640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1413f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.103+0000 7eff19715640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff14141900 0x7eff1415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.103+0000 7eff19715640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff141583a0 con 0x7eff140cdc70 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.103+0000 7eff19715640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140b1b70 con 0x7eff14141900 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.103+0000 7eff19715640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff14157d50 con 0x7eff140b0470 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.103+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1413f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39230/0 (socket says 172.21.15.113:39230) 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 -- 172.21.15.113:0/1821602809 learned_addr learned my addr 172.21.15.113:0/1821602809 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:34.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 -- 172.21.15.113:0/1821602809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff140b0470 msgr2=0x7eff1413e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff140b0470 0x7eff1413e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 -- 172.21.15.113:0/1821602809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff14141900 msgr2=0x7eff1415a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff14141900 0x7eff1415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 -- 172.21.15.113:0/1821602809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009a70 con 0x7eff140cdc70 2023-12-19T13:59:34.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff0bfff640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1413f600 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c430 tx=0x7efefc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff117fa640 1 -- 172.21.15.113:0/1821602809 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc011790 con 0x7eff140cdc70 2023-12-19T13:59:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff117fa640 1 -- 172.21.15.113:0/1821602809 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc0118f0 con 0x7eff140cdc70 2023-12-19T13:59:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff117fa640 1 -- 172.21.15.113:0/1821602809 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc011ce0 con 0x7eff140cdc70 2023-12-19T13:59:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.104+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff14158030 con 0x7eff140cdc70 2023-12-19T13:59:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.105+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1413fb40 con 0x7eff140cdc70 2023-12-19T13:59:34.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.106+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff14061910 con 0x7eff140cdc70 2023-12-19T13:59:34.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.107+0000 7eff117fa640 1 -- 172.21.15.113:0/1821602809 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efefc01c460 con 0x7eff140cdc70 2023-12-19T13:59:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.108+0000 7eff117fa640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efef406a430 0x7efef406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.108+0000 7eff117fa640 1 -- 172.21.15.113:0/1821602809 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efefc088580 con 0x7eff140cdc70 2023-12-19T13:59:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.108+0000 7eff13fff640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efef406a430 0x7efef406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.109+0000 7eff13fff640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efef406a430 0x7efef406c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7eff04001570 tx=0x7eff04007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:34.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.113+0000 7eff117fa640 1 -- 172.21.15.113:0/1821602809 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efefc053e70 con 0x7eff140cdc70 2023-12-19T13:59:34.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.302+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7eff141584e0 con 0x7eff140cdc70 2023-12-19T13:59:34.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.308+0000 7eff117fa640 1 -- 172.21.15.113:0/1821602809 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff141584e0 con 0x7eff140cdc70 2023-12-19T13:59:34.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efef406a430 msgr2=0x7efef406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:34.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efef406a430 0x7efef406c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7eff04001570 tx=0x7eff04007930 comp rx=0 tx=0).stop 2023-12-19T13:59:34.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 msgr2=0x7eff1413f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:34.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1413f600 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c430 tx=0x7efefc00c8f0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 shutdown_connections 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efef406a430 0x7efef406c8f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff14141900 0x7eff1415a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff140cdc70 0x7eff1413f600 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 --2- 172.21.15.113:0/1821602809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff140b0470 0x7eff1413e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 >> 172.21.15.113:0/1821602809 conn(0x7eff1406f630 msgr2=0x7eff1406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 shutdown_connections 2023-12-19T13:59:34.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:34.311+0000 7eff19715640 1 -- 172.21.15.113:0/1821602809 wait complete. 2023-12-19T13:59:34.331 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:59:34.331 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:59:34.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:59:34.571 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:59:34.571 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:34.571 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:34.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:59:34.630 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:59:34.631 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:34.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:59:34.687 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:34.687 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:34.745 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T13:59:34.745 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:59:34.745 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:34.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T13:59:34.802 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T13:59:34.802 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:35.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.024+0000 7f761cfb5640 1 Processor -- start 2023-12-19T13:59:35.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.024+0000 7f761cfb5640 1 -- start start 2023-12-19T13:59:35.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.026+0000 7f761cfb5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f76180b1710 0x7f761806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.026+0000 7f761cfb5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f761815e040 0x7f761815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.026+0000 7f761cfb5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761815e9c0 con 0x7f7618157aa0 2023-12-19T13:59:35.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.026+0000 7f761cfb5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76180b2600 con 0x7f76180b1710 2023-12-19T13:59:35.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.026+0000 7f761cfb5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76180b1d60 con 0x7f761815e040 2023-12-19T13:59:35.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.027+0000 7f7615d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f76180b1710 0x7f761806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.027+0000 7f7615d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f76180b1710 0x7f761806e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:36420/0 (socket says 172.21.15.113:36420) 2023-12-19T13:59:35.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.027+0000 7f7615d9b640 1 -- 172.21.15.113:0/2272858192 learned_addr learned my addr 172.21.15.113:0/2272858192 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:35.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.027+0000 7f7616d9d640 1 --2- 172.21.15.113:0/2272858192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f761815e040 0x7f761815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.028+0000 7f7616d9d640 1 -- 172.21.15.113:0/2272858192 >> v2:172.21.15.151:3300/0 conn(0x7f76180b1710 msgr2=0x7f761806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:35.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.028+0000 7f7616d9d640 1 --2- 172.21.15.113:0/2272858192 >> v2:172.21.15.151:3300/0 conn(0x7f76180b1710 0x7f761806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.028+0000 7f761559a640 1 -- 172.21.15.113:0/2272858192 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875203060 0 0) 0x7f761815e9c0 con 0x7f7618157aa0 2023-12-19T13:59:35.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.028+0000 7f7616d9d640 1 -- 172.21.15.113:0/2272858192 >> v1:172.21.15.151:6789/0 conn(0x7f7618157aa0 legacy=0x7f7618161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.028+0000 7f7616d9d640 1 -- 172.21.15.113:0/2272858192 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180b2040 con 0x7f761815e040 2023-12-19T13:59:35.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.029+0000 7f7616d9d640 1 --2- 172.21.15.113:0/2272858192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f761815e040 0x7f761815e480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7610009d90 tx=0x7f761002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a76aad21ff1cc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:35.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.030+0000 7f761559a640 1 -- 172.21.15.113:0/2272858192 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761002cc50 con 0x7f761815e040 2023-12-19T13:59:35.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.030+0000 7f761559a640 1 -- 172.21.15.113:0/2272858192 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761002cdb0 con 0x7f761815e040 2023-12-19T13:59:35.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.030+0000 7f761559a640 1 -- 172.21.15.113:0/2272858192 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7610034660 con 0x7f761815e040 2023-12-19T13:59:35.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 -- 172.21.15.113:0/2272858192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f761815e040 msgr2=0x7f761815e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 --2- 172.21.15.113:0/2272858192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f761815e040 0x7f761815e480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7610009d90 tx=0x7f761002bea0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 -- 172.21.15.113:0/2272858192 shutdown_connections 2023-12-19T13:59:35.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 --2- 172.21.15.113:0/2272858192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f761815e040 0x7f761815e480 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 --2- 172.21.15.113:0/2272858192 >> v2:172.21.15.151:3300/0 conn(0x7f76180b1710 0x7f761806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 -- 172.21.15.113:0/2272858192 >> 172.21.15.113:0/2272858192 conn(0x7f76180cbb70 msgr2=0x7f76180cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:35.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 -- 172.21.15.113:0/2272858192 shutdown_connections 2023-12-19T13:59:35.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.031+0000 7f761cfb5640 1 -- 172.21.15.113:0/2272858192 wait complete. 2023-12-19T13:59:35.033 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.033+0000 7f761cfb5640 1 Processor -- start 2023-12-19T13:59:35.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.033+0000 7f761cfb5640 1 -- start start 2023-12-19T13:59:35.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.034+0000 7f761cfb5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76180b1710 0x7f76181e9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.034+0000 7f761cfb5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7618157aa0 0x7f7618147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.036 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.034+0000 7f761cfb5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f761815e040 0x7f76181580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.034+0000 7f761cfb5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7618160410 con 0x7f761815e040 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.034+0000 7f761cfb5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76181e98a0 con 0x7f7618157aa0 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.034+0000 7f761cfb5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761815fdc0 con 0x7f76180b1710 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f761815e040 0x7f76181580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f761815e040 0x7f76181580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39234/0 (socket says 172.21.15.113:39234) 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 -- 172.21.15.113:0/339564728 learned_addr learned my addr 172.21.15.113:0/339564728 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f761659c640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76180b1710 0x7f76181e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7615d9b640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7618157aa0 0x7f7618147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 -- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76180b1710 msgr2=0x7f76181e9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76180b1710 0x7f76181e9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 -- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7618157aa0 msgr2=0x7f7618147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7618157aa0 0x7f7618147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.037 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.035+0000 7f7616d9d640 1 -- 172.21.15.113:0/339564728 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7610009a70 con 0x7f761815e040 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.036+0000 7f7616d9d640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f761815e040 0x7f76181580b0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f7610009eb0 tx=0x7f7610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.036+0000 7f7606ffd640 1 -- 172.21.15.113:0/339564728 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761003e610 con 0x7f761815e040 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.036+0000 7f7606ffd640 1 -- 172.21.15.113:0/339564728 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761003e770 con 0x7f761815e040 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.036+0000 7f7606ffd640 1 -- 172.21.15.113:0/339564728 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761003eb20 con 0x7f761815e040 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.036+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7618160680 con 0x7f761815e040 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.036+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76181600a0 con 0x7f761815e040 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.037+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7618160ba0 con 0x7f761815e040 2023-12-19T13:59:35.038 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.038+0000 7f7606ffd640 1 -- 172.21.15.113:0/339564728 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f761003b050 con 0x7f761815e040 2023-12-19T13:59:35.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.039+0000 7f7606ffd640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f75f806a430 0x7f75f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.039+0000 7f7606ffd640 1 -- 172.21.15.113:0/339564728 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f76100aaf50 con 0x7f761815e040 2023-12-19T13:59:35.039 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.040+0000 7f761659c640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f75f806a430 0x7f75f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.040+0000 7f761659c640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f75f806a430 0x7f75f806c8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7608000f60 tx=0x7f7608009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:35.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.044+0000 7f7606ffd640 1 -- 172.21.15.113:0/339564728 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7618160ba0 con 0x7f761815e040 2023-12-19T13:59:35.270 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.270+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7618160ba0 con 0x7f761815e040 2023-12-19T13:59:35.271 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.271+0000 7f7606ffd640 1 -- 172.21.15.113:0/339564728 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f7618160ba0 con 0x7f761815e040 2023-12-19T13:59:35.271 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:35.272 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":82,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5654,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3232353331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3232353331},{"type":"v1","addr":"172.21.15.151:6833","nonce":3232353331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6205,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2923016020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2923016020},{"type":"v1","addr":"172.21.15.151:6835","nonce":2923016020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1102670074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1102670074},{"type":"v1","addr":"172.21.15.113:6835","nonce":1102670074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1733028244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1733028244},{"type":"v1","addr":"172.21.15.113:6837","nonce":1733028244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[]} 2023-12-19T13:59:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 82 2023-12-19T13:59:35.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f75f806a430 msgr2=0x7f75f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f75f806a430 0x7f75f806c8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7608000f60 tx=0x7f7608009040 comp rx=0 tx=0).stop 2023-12-19T13:59:35.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f761815e040 msgr2=0x7f76181580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f761815e040 0x7f76181580b0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f7610009eb0 tx=0x7f7610004a40 comp rx=0 tx=0).stop 2023-12-19T13:59:35.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 shutdown_connections 2023-12-19T13:59:35.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f75f806a430 0x7f75f806c8f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f761815e040 0x7f76181580b0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7618157aa0 0x7f7618147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 --2- 172.21.15.113:0/339564728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76180b1710 0x7f76181e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 >> 172.21.15.113:0/339564728 conn(0x7f76180cbb70 msgr2=0x7f7618070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 shutdown_connections 2023-12-19T13:59:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.274+0000 7f761cfb5640 1 -- 172.21.15.113:0/339564728 wait complete. 2023-12-19T13:59:35.293 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:59:35.294 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:59:35.294 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:59:35.294 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:59:35.294 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:59:35.294 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:59:35.294 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:59:35.294 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:59:35.295 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:59:35.295 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:59:35.295 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:59:35.295 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:59:35.295 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T13:59:35.295 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T13:59:35.295 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T13:59:35.296 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:59:35.312 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:59:35.312 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:59:35.317 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:59:35.317 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:59:35.320 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:59:35.321 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:59:35.325 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T13:59:35.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T13:59:35.365 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:59:35.365 DEBUG:teuthology.parallel:result is None 2023-12-19T13:59:35.372 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:59:35.373 DEBUG:teuthology.parallel:result is None 2023-12-19T13:59:35.373 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:59:35.374 DEBUG:teuthology.parallel:result is None 2023-12-19T13:59:35.381 INFO:tasks.ceph.mds.d:Started 2023-12-19T13:59:35.381 DEBUG:teuthology.parallel:result is None 2023-12-19T13:59:35.381 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:59:35.519 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2023-12-19T13:59:35.519 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T13:59:35.541 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-19T13:59:35.542 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-19T13:59:35.543 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-12-19T13:59:35.544+0000 7f14b07f7640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-12-19T13:59:35.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.572+0000 7f7cb1a04640 1 Processor -- start 2023-12-19T13:59:35.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.572+0000 7f7cb1a04640 1 -- start start 2023-12-19T13:59:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.573+0000 7f7cb1a04640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7cac0ce820 0x7f7cac0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.573+0000 7f7cb1a04640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0cd840 con 0x7f7cac146e10 2023-12-19T13:59:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7cb1a04640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0b6e90 con 0x7f7cac0d2b00 2023-12-19T13:59:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7cb1a04640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac0d2430 con 0x7f7cac0ce820 2023-12-19T13:59:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7caaffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7cac146e10 0x7f7cac0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51026/0 (socket says 172.21.15.113:51026) 2023-12-19T13:59:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7caaffd640 1 -- 172.21.15.113:0/3970253668 learned_addr learned my addr 172.21.15.113:0/3970253668 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7cab7fe640 1 --2- 172.21.15.113:0/3970253668 >> v2:172.21.15.151:3300/0 conn(0x7f7cac0ce820 0x7f7cac0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7ca9ffb640 1 -- 172.21.15.113:0/3970253668 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029708508 0 0) 0x7f7cac0cd840 con 0x7f7cac146e10 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7ca9ffb640 1 -- 172.21.15.113:0/3970253668 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c94003520 con 0x7f7cac146e10 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7cab7fe640 1 -- 172.21.15.113:0/3970253668 >> v1:172.21.15.151:6789/0 conn(0x7f7cac0d2b00 legacy=0x7f7cac0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7ca9ffb640 1 -- 172.21.15.113:0/3970253668 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132144002 0 0) 0x7f7cac0b6e90 con 0x7f7cac0d2b00 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7cab7fe640 1 -- 172.21.15.113:0/3970253668 >> v1:172.21.15.113:6789/0 conn(0x7f7cac146e10 legacy=0x7f7cac0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.574+0000 7f7cab7fe640 1 -- 172.21.15.113:0/3970253668 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0d2620 con 0x7f7cac0ce820 2023-12-19T13:59:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.575+0000 7f7cab7fe640 1 --2- 172.21.15.113:0/3970253668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0ce820 0x7f7cac0d1ef0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d988393316a9115d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7ca9ffb640 1 -- 172.21.15.113:0/3970253668 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca402cc60 con 0x7f7cac0ce820 2023-12-19T13:59:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7ca9ffb640 1 -- 172.21.15.113:0/3970253668 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca402cdc0 con 0x7f7cac0ce820 2023-12-19T13:59:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7ca9ffb640 1 -- 172.21.15.113:0/3970253668 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4034660 con 0x7f7cac0ce820 2023-12-19T13:59:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7cb1a04640 1 -- 172.21.15.113:0/3970253668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0ce820 msgr2=0x7f7cac0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/3970253668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0ce820 0x7f7cac0d1ef0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402beb0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7cb1a04640 1 -- 172.21.15.113:0/3970253668 shutdown_connections 2023-12-19T13:59:35.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/3970253668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0ce820 0x7f7cac0d1ef0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7cb1a04640 1 -- 172.21.15.113:0/3970253668 >> 172.21.15.113:0/3970253668 conn(0x7f7cac0b29c0 msgr2=0x7f7cac0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:35.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7cb1a04640 1 -- 172.21.15.113:0/3970253668 shutdown_connections 2023-12-19T13:59:35.577 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.576+0000 7f7cb1a04640 1 -- 172.21.15.113:0/3970253668 wait complete. 2023-12-19T13:59:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.578+0000 7f7cb1a04640 1 Processor -- start 2023-12-19T13:59:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.578+0000 7f7cb1a04640 1 -- start start 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7cb1a04640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cac0ce820 0x7f7cac160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7cb1a04640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0d2b00 0x7f7cac158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7cb1a04640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cac146e10 0x7f7cac1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7cb1a04640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac144e10 con 0x7f7cac0ce820 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7cb1a04640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1591c0 con 0x7f7cac0d2b00 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7cb1a04640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac145060 con 0x7f7cac146e10 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7caaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cac0ce820 0x7f7cac160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7caaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cac0ce820 0x7f7cac160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39262/0 (socket says 172.21.15.113:39262) 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.579+0000 7f7caaffd640 1 -- 172.21.15.113:0/916283974 learned_addr learned my addr 172.21.15.113:0/916283974 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caa7fc640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0d2b00 0x7f7cac158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caaffd640 1 -- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cac146e10 msgr2=0x7f7cac1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7cab7fe640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cac146e10 0x7f7cac1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caaffd640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cac146e10 0x7f7cac1593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caaffd640 1 -- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0d2b00 msgr2=0x7f7cac158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caaffd640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0d2b00 0x7f7cac158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caaffd640 1 -- 172.21.15.113:0/916283974 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4009a70 con 0x7f7cac0ce820 2023-12-19T13:59:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caa7fc640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0d2b00 0x7f7cac158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7caaffd640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cac0ce820 0x7f7cac160540 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c3c0 tx=0x7f7c9c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:35.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7c93fff640 1 -- 172.21.15.113:0/916283974 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c005ce0 con 0x7f7cac0ce820 2023-12-19T13:59:35.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7c93fff640 1 -- 172.21.15.113:0/916283974 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c005e40 con 0x7f7cac0ce820 2023-12-19T13:59:35.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac145340 con 0x7f7cac0ce820 2023-12-19T13:59:35.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7c93fff640 1 -- 172.21.15.113:0/916283974 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0072f0 con 0x7f7cac0ce820 2023-12-19T13:59:35.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.580+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac145900 con 0x7f7cac0ce820 2023-12-19T13:59:35.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.582+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac061910 con 0x7f7cac0ce820 2023-12-19T13:59:35.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.582+0000 7f7c93fff640 1 -- 172.21.15.113:0/916283974 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c9c007450 con 0x7f7cac0ce820 2023-12-19T13:59:35.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.583+0000 7f7c93fff640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c9806a430 0x7f7c9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:35.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.583+0000 7f7c93fff640 1 -- 172.21.15.113:0/916283974 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c9c087bf0 con 0x7f7cac0ce820 2023-12-19T13:59:35.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.583+0000 7f7caa7fc640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c9806a430 0x7f7c9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:35.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.584+0000 7f7caa7fc640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c9806a430 0x7f7c9806c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7cac144360 tx=0x7f7ca0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:35.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.588+0000 7f7c93fff640 1 -- 172.21.15.113:0/916283974 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c9c0534e0 con 0x7f7cac0ce820 2023-12-19T13:59:35.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:35.782+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7cac070c40 con 0x7f7cac0ce820 2023-12-19T13:59:36.578 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.578+0000 7f7c93fff640 1 -- 172.21.15.113:0/916283974 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v192) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7c9c017020 con 0x7f7cac0ce820 2023-12-19T13:59:36.578 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2023-12-19T13:59:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c9806a430 msgr2=0x7f7c9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c9806a430 0x7f7c9806c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7cac144360 tx=0x7f7ca0009040 comp rx=0 tx=0).stop 2023-12-19T13:59:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cac0ce820 msgr2=0x7f7cac160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cac0ce820 0x7f7cac160540 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c3c0 tx=0x7f7c9c00c880 comp rx=0 tx=0).stop 2023-12-19T13:59:36.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 shutdown_connections 2023-12-19T13:59:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f7c9806a430 0x7f7c9806c8f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cac146e10 0x7f7cac1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cac0d2b00 0x7f7cac158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 --2- 172.21.15.113:0/916283974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cac0ce820 0x7f7cac160540 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 >> 172.21.15.113:0/916283974 conn(0x7f7cac0b29c0 msgr2=0x7f7cac0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 shutdown_connections 2023-12-19T13:59:36.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.582+0000 7f7cb1a04640 1 -- 172.21.15.113:0/916283974 wait complete. 2023-12-19T13:59:36.602 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:59:36.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.816+0000 7ffa9ffff640 1 Processor -- start 2023-12-19T13:59:36.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.816+0000 7ffa9ffff640 1 -- start start 2023-12-19T13:59:36.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.817+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa015e5a0 0x7ffaa00b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.817+0000 7ffa9ffff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa015ec30 con 0x7ffaa00cdbf0 2023-12-19T13:59:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.817+0000 7ffa9ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa015e980 con 0x7ffaa015f680 2023-12-19T13:59:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.818+0000 7ffa9ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00b2f90 con 0x7ffaa015e5a0 2023-12-19T13:59:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.818+0000 7ffa9f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffaa00cdbf0 0x7ffaa006c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51042/0 (socket says 172.21.15.113:51042) 2023-12-19T13:59:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.818+0000 7ffa9f7fe640 1 -- 172.21.15.113:0/3433986209 learned_addr learned my addr 172.21.15.113:0/3433986209 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.818+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923713760 0 0) 0x7ffaa015ec30 con 0x7ffaa00cdbf0 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.818+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa8c003520 con 0x7ffaa00cdbf0 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.818+0000 7ffa9effd640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa015e5a0 0x7ffaa00b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3508488678 0 0) 0x7ffa8c003520 con 0x7ffaa00cdbf0 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa015e5a0 msgr2=0x7ffaa00b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa015e5a0 0x7ffaa00b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 >> v1:172.21.15.151:6789/0 conn(0x7ffaa015f680 legacy=0x7ffaa00b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:36.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa00b3270 con 0x7ffaa00cdbf0 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7ffa980019f0 con 0x7ffaa00cdbf0 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 >> v1:172.21.15.113:6789/0 conn(0x7ffaa00cdbf0 legacy=0x7ffaa006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffa8c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa8c0047c0 0x7ffa8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa015e5a0 0x7ffa8c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00b2f90 con 0x7ffa8c0039a0 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c00bb10 con 0x7ffa8c0047c0 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c00bcd0 con 0x7ffaa015e5a0 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9effd640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffa8c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9effd640 1 -- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa015e5a0 msgr2=0x7ffa8c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9effd640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa015e5a0 0x7ffa8c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa967fc640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa8c0047c0 0x7ffa8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.819+0000 7ffa9effd640 1 -- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa8c0047c0 msgr2=0x7ffa8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.820+0000 7ffa9effd640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa8c0047c0 0x7ffa8c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.821 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.820+0000 7ffa9effd640 1 -- 172.21.15.113:0/3433986209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c003520 con 0x7ffa8c0039a0 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9effd640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffa8c003dc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000ba30 tx=0x7ffa8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c499dad9919f77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90032680 con 0x7ffa8c0039a0 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa900327e0 con 0x7ffa8c0039a0 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9e7fc640 1 -- 172.21.15.113:0/3433986209 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90032b70 con 0x7ffa8c0039a0 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9ffff640 1 -- 172.21.15.113:0/3433986209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 msgr2=0x7ffa8c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9ffff640 1 --2- 172.21.15.113:0/3433986209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffa8c003dc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000ba30 tx=0x7ffa8c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9f7fe640 1 -- 172.21.15.113:0/3433986209 reap_dead start 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9ffff640 1 -- 172.21.15.113:0/3433986209 shutdown_connections 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.821+0000 7ffa9ffff640 1 -- 172.21.15.113:0/3433986209 >> 172.21.15.113:0/3433986209 conn(0x7ffaa00b0100 msgr2=0x7ffaa00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.822+0000 7ffa9ffff640 1 -- 172.21.15.113:0/3433986209 shutdown_connections 2023-12-19T13:59:36.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.822+0000 7ffa9ffff640 1 -- 172.21.15.113:0/3433986209 wait complete. 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.823+0000 7ffa9ffff640 1 Processor -- start 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.823+0000 7ffa9ffff640 1 -- start start 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.824+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffaa00c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.824+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa0142c30 0x7ffaa01556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.824+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa00c88c0 0x7ffaa0144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.824+0000 7ffa9ffff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0143d40 con 0x7ffa8c0039a0 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.824+0000 7ffa9ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01430c0 con 0x7ffaa0142c30 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.824+0000 7ffa9ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01433a0 con 0x7ffaa00c88c0 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffaa00c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:36.826 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffaa00c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39286/0 (socket says 172.21.15.113:39286) 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 -- 172.21.15.113:0/1908918395 learned_addr learned my addr 172.21.15.113:0/1908918395 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa967fc640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa0142c30 0x7ffaa01556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 -- 172.21.15.113:0/1908918395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa00c88c0 msgr2=0x7ffaa0144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa00c88c0 0x7ffaa0144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 -- 172.21.15.113:0/1908918395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa0142c30 msgr2=0x7ffaa01556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa0142c30 0x7ffaa01556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 -- 172.21.15.113:0/1908918395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0143680 con 0x7ffa8c0039a0 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.825+0000 7ffa9effd640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffaa00c8380 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7ffa9002bf00 tx=0x7ffa90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.826+0000 7ffa97fff640 1 -- 172.21.15.113:0/1908918395 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90004220 con 0x7ffa8c0039a0 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.826+0000 7ffa97fff640 1 -- 172.21.15.113:0/1908918395 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa900043a0 con 0x7ffa8c0039a0 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.826+0000 7ffa97fff640 1 -- 172.21.15.113:0/1908918395 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90030ae0 con 0x7ffa8c0039a0 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.826+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa0143960 con 0x7ffa8c0039a0 2023-12-19T13:59:36.827 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.826+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa0142880 con 0x7ffa8c0039a0 2023-12-19T13:59:36.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.827+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa0061910 con 0x7ffa8c0039a0 2023-12-19T13:59:36.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.828+0000 7ffa97fff640 1 -- 172.21.15.113:0/1908918395 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa90030c40 con 0x7ffa8c0039a0 2023-12-19T13:59:36.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.828+0000 7ffa97fff640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa8006a4b0 0x7ffa8006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:36.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.829+0000 7ffa97fff640 1 -- 172.21.15.113:0/1908918395 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffa900aaef0 con 0x7ffa8c0039a0 2023-12-19T13:59:36.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.829+0000 7ffa967fc640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa8006a4b0 0x7ffa8006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:36.829 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.829+0000 7ffa967fc640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa8006a4b0 0x7ffa8006c970 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0154d50 tx=0x7ffa88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:36.832 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:36.833+0000 7ffa97fff640 1 -- 172.21.15.113:0/1908918395 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffa900768a0 con 0x7ffa8c0039a0 2023-12-19T13:59:37.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.071+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffaa0061910 con 0x7ffa8c0039a0 2023-12-19T13:59:37.071 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.071+0000 7ffa97fff640 1 -- 172.21.15.113:0/1908918395 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ffa90006c30 con 0x7ffa8c0039a0 2023-12-19T13:59:37.071 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlSAzXARAAUaX0CqTWhJu0IFjdx+t2cQ==", 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.072 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIN74IRAA/T9YtRsHTvc/IRmi1jhyHw==", 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlhpgTEhAA04n2G4ibfyLvt1QmeWEsRw==", 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.073 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCPnoFlIYgoMRAAealrkhHr02NINIn2Zyv1TQ==", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUnoFl7PtGMRAAf5BURZ40vc5h1Yul3jnnFw==", 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlM+nYBBAAUN0z/ZOvjvmx7ap+PTCBIg==", 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.075 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlZDc0FBAA9hvrWPWCdpa3SS0DTriuSQ==", 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.076 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCVnoFlRAFHIxAAxUx+VPGpNnoJ0hYV1XdNeA==", 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2023-12-19T13:59:37.077 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCZnoFlKOwjLBAA6CXXGy3k0NimQ52Ml3/3OQ==", 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl3QrDABAAG0IZs6aKbo9SEgmFc5dk3g==", 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFlb0rYEBAASF/5SrWODR8S4K0sAUlBmw==", 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCanoFl5UBwIBAAa77vFkPvvi9+QsGg8pSKRg==", 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.079 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlwoHBAhAAE80UCsjGuXvde1BGUGObvA==", 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow r", 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.080 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlIsRBGBAABPMYv/8SqqI9aa21iAFDtw==", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlZHfIDRAAC+qmlNZYb5uoRCdh/vxNaw==", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.081 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCQnoFlXSNIIxAAb3emvnRA1cnv7KnC8kKbkw==", 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.082 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNnoFl4627LRAARgrnrljy4pDB9/gSBdWULA==", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFln/BnMRAAZZr5H0adkqyQY9pN93IpOg==", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:59:37.083 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCOnoFlLUqyJRAAhE7lYH8SjRXL5Vw79F4gnw==", 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2023-12-19T13:59:37.084 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2023-12-19T13:59:37.085 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.085 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:37.085 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:59:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa8006a4b0 msgr2=0x7ffa8006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa8006a4b0 0x7ffa8006c970 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0154d50 tx=0x7ffa88009040 comp rx=0 tx=0).stop 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 msgr2=0x7ffaa00c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffaa00c8380 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7ffa9002bf00 tx=0x7ffa90004730 comp rx=0 tx=0).stop 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 shutdown_connections 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffa8006a4b0 0x7ffa8006c970 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa00c88c0 0x7ffaa0144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa0142c30 0x7ffaa01556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 --2- 172.21.15.113:0/1908918395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa8c0039a0 0x7ffaa00c8380 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 >> 172.21.15.113:0/1908918395 conn(0x7ffaa00b0100 msgr2=0x7ffaa006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 shutdown_connections 2023-12-19T13:59:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.074+0000 7ffa9ffff640 1 -- 172.21.15.113:0/1908918395 wait complete. 2023-12-19T13:59:37.092 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:37.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.294+0000 7f8261bfd640 1 Processor -- start 2023-12-19T13:59:37.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.294+0000 7f8261bfd640 1 -- start start 2023-12-19T13:59:37.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.295+0000 7f8261bfd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f825c0ce300 0x7f825c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.295+0000 7f8261bfd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c15ec30 con 0x7f825c0b2030 2023-12-19T13:59:37.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.295+0000 7f8261bfd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c15fbc0 con 0x7f825c15e5a0 2023-12-19T13:59:37.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.295+0000 7f8261bfd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c15e980 con 0x7f825c0ce300 2023-12-19T13:59:37.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.295+0000 7f82613fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f825c0ce300 0x7f825c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.295+0000 7f825bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f825c0b2030 0x7f825c0cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51058/0 (socket says 172.21.15.113:51058) 2023-12-19T13:59:37.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.295+0000 7f825bfff640 1 -- 172.21.15.113:0/79081299 learned_addr learned my addr 172.21.15.113:0/79081299 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:37.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.296+0000 7f82613fc640 1 -- 172.21.15.113:0/79081299 >> v1:172.21.15.151:6789/0 conn(0x7f825c15e5a0 legacy=0x7f825c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:37.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.296+0000 7f82613fc640 1 -- 172.21.15.113:0/79081299 >> v1:172.21.15.113:6789/0 conn(0x7f825c0b2030 legacy=0x7f825c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.296+0000 7f82613fc640 1 -- 172.21.15.113:0/79081299 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0b2f90 con 0x7f825c0ce300 2023-12-19T13:59:37.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.296+0000 7f825b7fe640 1 -- 172.21.15.113:0/79081299 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134660670 0 0) 0x7f825c15ec30 con 0x7f825c0b2030 2023-12-19T13:59:37.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.297+0000 7f82613fc640 1 --2- 172.21.15.113:0/79081299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0ce300 0x7f825c15f680 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f8254009dc0 tx=0x7f825402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ddb80a1346a3b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:37.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.297+0000 7f825b7fe640 1 -- 172.21.15.113:0/79081299 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825402cc40 con 0x7f825c0ce300 2023-12-19T13:59:37.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.297+0000 7f825b7fe640 1 -- 172.21.15.113:0/79081299 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825402cda0 con 0x7f825c0ce300 2023-12-19T13:59:37.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.297+0000 7f825b7fe640 1 -- 172.21.15.113:0/79081299 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254034660 con 0x7f825c0ce300 2023-12-19T13:59:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.298+0000 7f8261bfd640 1 -- 172.21.15.113:0/79081299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0ce300 msgr2=0x7f825c15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.298+0000 7f8261bfd640 1 --2- 172.21.15.113:0/79081299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0ce300 0x7f825c15f680 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f8254009dc0 tx=0x7f825402be90 comp rx=0 tx=0).stop 2023-12-19T13:59:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.298+0000 7f8261bfd640 1 -- 172.21.15.113:0/79081299 shutdown_connections 2023-12-19T13:59:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.298+0000 7f8261bfd640 1 --2- 172.21.15.113:0/79081299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0ce300 0x7f825c15f680 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.298+0000 7f8261bfd640 1 -- 172.21.15.113:0/79081299 >> 172.21.15.113:0/79081299 conn(0x7f825c0b0100 msgr2=0x7f825c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.298+0000 7f8261bfd640 1 -- 172.21.15.113:0/79081299 shutdown_connections 2023-12-19T13:59:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.298+0000 7f8261bfd640 1 -- 172.21.15.113:0/79081299 wait complete. 2023-12-19T13:59:37.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.299+0000 7f8261bfd640 1 Processor -- start 2023-12-19T13:59:37.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.300+0000 7f8261bfd640 1 -- start start 2023-12-19T13:59:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.300+0000 7f8261bfd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0b2030 0x7f825c147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.300+0000 7f8261bfd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f825c0ce300 0x7f825c1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.300+0000 7f8261bfd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f825c15e5a0 0x7f825c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.300+0000 7f8261bfd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1482f0 con 0x7f825c0b2030 2023-12-19T13:59:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.300+0000 7f8261bfd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c9e60 con 0x7f825c15e5a0 2023-12-19T13:59:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.300+0000 7f8261bfd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0ca140 con 0x7f825c0ce300 2023-12-19T13:59:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0b2030 0x7f825c147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0b2030 0x7f825c147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39304/0 (socket says 172.21.15.113:39304) 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 -- 172.21.15.113:0/4078685880 learned_addr learned my addr 172.21.15.113:0/4078685880 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f82613fc640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f825c15e5a0 0x7f825c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 -- 172.21.15.113:0/4078685880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f825c0ce300 msgr2=0x7f825c1449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f825c0ce300 0x7f825c1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 -- 172.21.15.113:0/4078685880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f825c15e5a0 msgr2=0x7f825c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f825c15e5a0 0x7f825c15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 -- 172.21.15.113:0/4078685880 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254009a70 con 0x7f825c0b2030 2023-12-19T13:59:37.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.301+0000 7f8260bfb640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0b2030 0x7f825c147db0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f825000b3f0 tx=0x7f825000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.302+0000 7f82597fa640 1 -- 172.21.15.113:0/4078685880 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011830 con 0x7f825c0b2030 2023-12-19T13:59:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.302+0000 7f82597fa640 1 -- 172.21.15.113:0/4078685880 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250011990 con 0x7f825c0b2030 2023-12-19T13:59:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.302+0000 7f82597fa640 1 -- 172.21.15.113:0/4078685880 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011d40 con 0x7f825c0b2030 2023-12-19T13:59:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.302+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c0ca420 con 0x7f825c0b2030 2023-12-19T13:59:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.302+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c0ca9e0 con 0x7f825c0b2030 2023-12-19T13:59:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.303+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c0cabd0 con 0x7f825c0b2030 2023-12-19T13:59:37.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.304+0000 7f82597fa640 1 -- 172.21.15.113:0/4078685880 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f825001a400 con 0x7f825c0b2030 2023-12-19T13:59:37.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.304+0000 7f82597fa640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824006a430 0x7f824006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.305+0000 7f82597fa640 1 -- 172.21.15.113:0/4078685880 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f82500883d0 con 0x7f825c0b2030 2023-12-19T13:59:37.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.305+0000 7f825bfff640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824006a430 0x7f824006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.305+0000 7f825bfff640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824006a430 0x7f824006c8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8248007fd0 tx=0x7f8248007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:37.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.309+0000 7f82597fa640 1 -- 172.21.15.113:0/4078685880 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8250053da0 con 0x7f825c0b2030 2023-12-19T13:59:37.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.484+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f825c061910 con 0x7f825c0b2030 2023-12-19T13:59:37.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.486+0000 7f82597fa640 1 -- 172.21.15.113:0/4078685880 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+12448 (secure 0 0 0) 0x7f82500573c0 con 0x7f825c0b2030 2023-12-19T13:59:37.487 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:37.487 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":192,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:59:36.570852+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:37.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824006a430 msgr2=0x7f824006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824006a430 0x7f824006c8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8248007fd0 tx=0x7f8248007920 comp rx=0 tx=0).stop 2023-12-19T13:59:37.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0b2030 msgr2=0x7f825c147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0b2030 0x7f825c147db0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f825000b3f0 tx=0x7f825000b8b0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 shutdown_connections 2023-12-19T13:59:37.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f824006a430 0x7f824006c8f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f825c15e5a0 0x7f825c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f825c0ce300 0x7f825c1449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 --2- 172.21.15.113:0/4078685880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f825c0b2030 0x7f825c147db0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.489+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 >> 172.21.15.113:0/4078685880 conn(0x7f825c0b0100 msgr2=0x7f825c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:37.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.490+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 shutdown_connections 2023-12-19T13:59:37.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.490+0000 7f8261bfd640 1 -- 172.21.15.113:0/4078685880 wait complete. 2023-12-19T13:59:37.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:59:37.509 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:59:37.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.721+0000 7fc61e17e640 1 Processor -- start 2023-12-19T13:59:37.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.721+0000 7fc61e17e640 1 -- start start 2023-12-19T13:59:37.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.723+0000 7fc61e17e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc61815b290 0x7fc6180b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.723+0000 7fc61e17e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6180b0070 0x7fc6180b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.723+0000 7fc61e17e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6180ccbd0 con 0x7fc618154760 2023-12-19T13:59:37.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.723+0000 7fc61e17e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6180ccf20 con 0x7fc6180b0070 2023-12-19T13:59:37.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.723+0000 7fc61e17e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180b0a30 con 0x7fc61815b290 2023-12-19T13:59:37.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.723+0000 7fc6177fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc618154760 0x7fc6180cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51060/0 (socket says 172.21.15.113:51060) 2023-12-19T13:59:37.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.723+0000 7fc6177fe640 1 -- 172.21.15.113:0/3463208600 learned_addr learned my addr 172.21.15.113:0/3463208600 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc617fff640 1 --2- 172.21.15.113:0/3463208600 >> v2:172.21.15.151:3300/0 conn(0x7fc6180b0070 0x7fc6180b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc616ffd640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc61815b290 0x7fc6180b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211826288 0 0) 0x7fc6180ccbd0 con 0x7fc618154760 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc600005730 con 0x7fc618154760 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866397091 0 0) 0x7fc600005730 con 0x7fc618154760 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc61815b290 msgr2=0x7fc6180b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc61815b290 0x7fc6180b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 >> v2:172.21.15.151:3300/0 conn(0x7fc6180b0070 msgr2=0x7fc6180b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 --2- 172.21.15.113:0/3463208600 >> v2:172.21.15.151:3300/0 conn(0x7fc6180b0070 0x7fc6180b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618154b40 con 0x7fc618154760 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fc608001670 con 0x7fc618154760 2023-12-19T13:59:37.726 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc617fff640 1 --2- 172.21.15.113:0/3463208600 >> v2:172.21.15.151:3300/0 conn(0x7fc6180b0070 0x7fc6180b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:59:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 >> v1:172.21.15.113:6789/0 conn(0x7fc618154760 legacy=0x7fc6180cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc61815b290 0x7fc600005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6000061c0 0x7fc6000069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc600006f10 0x7fc600007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180ccf20 con 0x7fc600006f10 2023-12-19T13:59:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180b0a30 con 0x7fc6000061c0 2023-12-19T13:59:37.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.724+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60000dd50 con 0x7fc61815b290 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc617fff640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc600006f10 0x7fc600007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc616ffd640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6000061c0 0x7fc6000069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc617fff640 1 -- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc61815b290 msgr2=0x7fc600005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc617fff640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc61815b290 0x7fc600005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc617fff640 1 -- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6000061c0 msgr2=0x7fc6000069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc617fff640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6000061c0 0x7fc6000069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc617fff640 1 -- 172.21.15.113:0/3463208600 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600005730 con 0x7fc600006f10 2023-12-19T13:59:37.728 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.725+0000 7fc616ffd640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6000061c0 0x7fc6000069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:37.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.726+0000 7fc617fff640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc600006f10 0x7fc600007390 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fc6100073e0 tx=0x7fc600007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aff9f073c6b307 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:37.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.726+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61002cdc0 con 0x7fc600006f10 2023-12-19T13:59:37.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.726+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc610034440 con 0x7fc600006f10 2023-12-19T13:59:37.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.726+0000 7fc6167fc640 1 -- 172.21.15.113:0/3463208600 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100347b0 con 0x7fc600006f10 2023-12-19T13:59:37.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.727+0000 7fc61e17e640 1 -- 172.21.15.113:0/3463208600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc600006f10 msgr2=0x7fc600007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.727+0000 7fc61e17e640 1 --2- 172.21.15.113:0/3463208600 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc600006f10 0x7fc600007390 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fc6100073e0 tx=0x7fc600007a00 comp rx=0 tx=0).stop 2023-12-19T13:59:37.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.727+0000 7fc617fff640 1 -- 172.21.15.113:0/3463208600 reap_dead start 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.727+0000 7fc61e17e640 1 -- 172.21.15.113:0/3463208600 shutdown_connections 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.727+0000 7fc61e17e640 1 -- 172.21.15.113:0/3463208600 >> 172.21.15.113:0/3463208600 conn(0x7fc618073150 msgr2=0x7fc6180659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.727+0000 7fc61e17e640 1 -- 172.21.15.113:0/3463208600 shutdown_connections 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.727+0000 7fc61e17e640 1 -- 172.21.15.113:0/3463208600 wait complete. 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.729+0000 7fc61e17e640 1 Processor -- start 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.729+0000 7fc61e17e640 1 -- start start 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc61e17e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc600006f10 0x7fc618144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc61e17e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc61814e770 0x7fc618145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc61e17e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc618145c70 0x7fc6181f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc61e17e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61814d6d0 con 0x7fc61814e770 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc61e17e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61814d9b0 con 0x7fc618145c70 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc61e17e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61814dc90 con 0x7fc600006f10 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc616ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc61814e770 0x7fc618145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc616ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc61814e770 0x7fc618145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39324/0 (socket says 172.21.15.113:39324) 2023-12-19T13:59:37.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.730+0000 7fc616ffd640 1 -- 172.21.15.113:0/3789866234 learned_addr learned my addr 172.21.15.113:0/3789866234 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc6177fe640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc600006f10 0x7fc618144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc616ffd640 1 -- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc600006f10 msgr2=0x7fc618144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc617fff640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc618145c70 0x7fc6181f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc616ffd640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc600006f10 0x7fc618144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc616ffd640 1 -- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc618145c70 msgr2=0x7fc6181f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc616ffd640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc618145c70 0x7fc6181f1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc616ffd640 1 -- 172.21.15.113:0/3789866234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61814df70 con 0x7fc61814e770 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc616ffd640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc61814e770 0x7fc618145730 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0107e0 tx=0x7fc60c010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc5fffff640 1 -- 172.21.15.113:0/3789866234 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00eb60 con 0x7fc61814e770 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc5fffff640 1 -- 172.21.15.113:0/3789866234 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00ecc0 con 0x7fc61814e770 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc5fffff640 1 -- 172.21.15.113:0/3789866234 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c01c400 con 0x7fc61814e770 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61814e250 con 0x7fc61814e770 2023-12-19T13:59:37.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.731+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc618144850 con 0x7fc61814e770 2023-12-19T13:59:37.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.733+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc618061910 con 0x7fc61814e770 2023-12-19T13:59:37.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.733+0000 7fc5fffff640 1 -- 172.21.15.113:0/3789866234 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc60c01c560 con 0x7fc61814e770 2023-12-19T13:59:37.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.734+0000 7fc5fffff640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc60406a430 0x7fc60406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:37.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.734+0000 7fc5fffff640 1 -- 172.21.15.113:0/3789866234 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc60c088b10 con 0x7fc61814e770 2023-12-19T13:59:37.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.735+0000 7fc6177fe640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc60406a430 0x7fc60406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:37.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.735+0000 7fc6177fe640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc60406a430 0x7fc60406c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc6080011e0 tx=0x7fc608009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:37.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.739+0000 7fc5fffff640 1 -- 172.21.15.113:0/3789866234 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc60c0544f0 con 0x7fc61814e770 2023-12-19T13:59:37.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.927+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6180af7e0 con 0x7fc61814e770 2023-12-19T13:59:37.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.928+0000 7fc5fffff640 1 -- 172.21.15.113:0/3789866234 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc60c057b10 con 0x7fc61814e770 2023-12-19T13:59:37.928 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc60406a430 msgr2=0x7fc60406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc60406a430 0x7fc60406c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc6080011e0 tx=0x7fc608009040 comp rx=0 tx=0).stop 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc61814e770 msgr2=0x7fc618145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc61814e770 0x7fc618145730 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0107e0 tx=0x7fc60c010ca0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 shutdown_connections 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc60406a430 0x7fc60406c8f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc618145c70 0x7fc6181f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc61814e770 0x7fc618145730 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 --2- 172.21.15.113:0/3789866234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc600006f10 0x7fc618144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:37.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 >> 172.21.15.113:0/3789866234 conn(0x7fc618073150 msgr2=0x7fc6180b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:37.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 shutdown_connections 2023-12-19T13:59:37.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:37.931+0000 7fc61e17e640 1 -- 172.21.15.113:0/3789866234 wait complete. 2023-12-19T13:59:37.951 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:59:38.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.158+0000 7f8ccc604640 1 Processor -- start 2023-12-19T13:59:38.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.158+0000 7f8ccc604640 1 -- start start 2023-12-19T13:59:38.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.159+0000 7f8ccc604640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc415c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.159+0000 7f8ccc604640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cc406f160 0x7f8cc40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.159+0000 7f8ccc604640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc4070130 con 0x7f8cc406d850 2023-12-19T13:59:38.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.159+0000 7f8ccc604640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc406f5e0 con 0x7f8cc406f160 2023-12-19T13:59:38.160 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.159+0000 7f8ccc604640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc406f890 con 0x7f8cc4158df0 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc9b9f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cc406f160 0x7f8cc40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc9b9f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cc406f160 0x7f8cc40cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51872/0 (socket says 172.21.15.113:51872) 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8ccaba1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8cc406d850 0x7f8cc406dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46864/0 (socket says 172.21.15.113:46864) 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2012513250 learned_addr learned my addr 172.21.15.113:0/2012513250 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2012513250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 msgr2=0x7f8cc415c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cca3a0640 1 --2- 172.21.15.113:0/2012513250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc939e640 1 -- 172.21.15.113:0/2012513250 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311168172 0 0) 0x7f8cc4070130 con 0x7f8cc406d850 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc9b9f640 1 --2- 172.21.15.113:0/2012513250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc415c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2012513250 >> v1:172.21.15.113:6789/0 conn(0x7f8cc406d850 legacy=0x7f8cc406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2012513250 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc406fb70 con 0x7f8cc406f160 2023-12-19T13:59:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.160+0000 7f8cca3a0640 1 --2- 172.21.15.113:0/2012513250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.161+0000 7f8cc9b9f640 1 --2- 172.21.15.113:0/2012513250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc40cb800 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009870 tx=0x7f8cb802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b810fe60e717f509 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8cc939e640 1 -- 172.21.15.113:0/2012513250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031640 con 0x7f8cc406f160 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8cc939e640 1 -- 172.21.15.113:0/2012513250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb80317a0 con 0x7f8cc406f160 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8cc939e640 1 -- 172.21.15.113:0/2012513250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031b30 con 0x7f8cc406f160 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 -- 172.21.15.113:0/2012513250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 msgr2=0x7f8cc40cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2012513250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc40cb800 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009870 tx=0x7f8cb802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 -- 172.21.15.113:0/2012513250 shutdown_connections 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2012513250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc40cb800 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2012513250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 -- 172.21.15.113:0/2012513250 >> 172.21.15.113:0/2012513250 conn(0x7f8cc40cf0b0 msgr2=0x7f8cc40cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 -- 172.21.15.113:0/2012513250 shutdown_connections 2023-12-19T13:59:38.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.162+0000 7f8ccc604640 1 -- 172.21.15.113:0/2012513250 wait complete. 2023-12-19T13:59:38.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.164+0000 7f8ccc604640 1 Processor -- start 2023-12-19T13:59:38.164 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.164+0000 7f8ccc604640 1 -- start start 2023-12-19T13:59:38.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8ccc604640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc406d850 0x7f8cc414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.166 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8ccc604640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8ccc604640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8ccc604640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc415d020 con 0x7f8cc406f160 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8ccc604640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc415d300 con 0x7f8cc406d850 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8ccc604640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc415d5e0 con 0x7f8cc4158df0 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8cc9b9f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8cc9b9f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc415e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51886/0 (socket says 172.21.15.113:51886) 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.165+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2382738227 learned_addr learned my addr 172.21.15.113:0/2382738227 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cca3a0640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc406d850 0x7f8cc414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 msgr2=0x7f8cc40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc9b9f640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc406d850 msgr2=0x7f8cc414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc9b9f640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc406d850 0x7f8cc414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc9b9f640 1 -- 172.21.15.113:0/2382738227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80094d0 con 0x7f8cc406f160 2023-12-19T13:59:38.167 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cca3a0640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc406d850 0x7f8cc414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc9b9f640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc415e350 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8000c00 tx=0x7f8cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc2ffd640 1 -- 172.21.15.113:0/2382738227 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb803ac60 con 0x7f8cc406f160 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc2ffd640 1 -- 172.21.15.113:0/2382738227 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb803ade0 con 0x7f8cc406f160 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8cc2ffd640 1 -- 172.21.15.113:0/2382738227 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8044630 con 0x7f8cc406f160 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.166+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc415d8c0 con 0x7f8cc406f160 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.167+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc415e890 con 0x7f8cc406f160 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.168+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc4074770 con 0x7f8cc406f160 2023-12-19T13:59:38.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.168+0000 7f8cc2ffd640 1 -- 172.21.15.113:0/2382738227 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8cb802f050 con 0x7f8cc406f160 2023-12-19T13:59:38.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.170+0000 7f8cc2ffd640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8cb006a430 0x7f8cb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.170+0000 7f8cc2ffd640 1 -- 172.21.15.113:0/2382738227 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8cb80aa660 con 0x7f8cc406f160 2023-12-19T13:59:38.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.170+0000 7f8cca3a0640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8cb006a430 0x7f8cb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.170 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.171+0000 7f8cca3a0640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8cb006a430 0x7f8cb006c8f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8cc406d780 tx=0x7f8cb4007550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:38.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.174+0000 7f8cc2ffd640 1 -- 172.21.15.113:0/2382738227 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8cb8076060 con 0x7f8cc406f160 2023-12-19T13:59:38.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.350+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8cc415dde0 con 0x7f8cc406f160 2023-12-19T13:59:38.350 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.351+0000 7f8cc2ffd640 1 -- 172.21.15.113:0/2382738227 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v192) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8cc415dde0 con 0x7f8cc406f160 2023-12-19T13:59:38.351 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:38.351 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2023-12-19T13:59:38.351 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:38.351 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2023-12-19T13:59:38.351 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2023-12-19T13:59:38.351 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:38.351 INFO:teuthology.orchestra.run.smithi113.stdout:] 2023-12-19T13:59:38.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8cb006a430 msgr2=0x7f8cb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8cb006a430 0x7f8cb006c8f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8cc406d780 tx=0x7f8cb4007550 comp rx=0 tx=0).stop 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 msgr2=0x7f8cc415e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc415e350 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8000c00 tx=0x7f8cb80046c0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 shutdown_connections 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f8cb006a430 0x7f8cb006c8f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc4158df0 0x7f8cc40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cc406f160 0x7f8cc415e350 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 --2- 172.21.15.113:0/2382738227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc406d850 0x7f8cc414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.353+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 >> 172.21.15.113:0/2382738227 conn(0x7f8cc40cf0b0 msgr2=0x7f8cc41580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.354+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 shutdown_connections 2023-12-19T13:59:38.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.354+0000 7f8ccc604640 1 -- 172.21.15.113:0/2382738227 wait complete. 2023-12-19T13:59:38.370 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:59:38.370 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:59:38.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.584+0000 7f861b947640 1 Processor -- start 2023-12-19T13:59:38.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.584+0000 7f861b947640 1 -- start start 2023-12-19T13:59:38.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.586+0000 7f861b947640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86140ab150 0x7f86140a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.586+0000 7f861b947640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8614147060 con 0x7f8614146800 2023-12-19T13:59:38.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.586+0000 7f861b947640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86140ab710 con 0x7f86140ac7b0 2023-12-19T13:59:38.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.586+0000 7f861b947640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8614146be0 con 0x7f86140ab150 2023-12-19T13:59:38.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.586+0000 7f86196e3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8614146800 0x7f86140a9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46870/0 (socket says 172.21.15.113:46870) 2023-12-19T13:59:38.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.586+0000 7f86196e3640 1 -- 172.21.15.113:0/4115550681 learned_addr learned my addr 172.21.15.113:0/4115550681 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:38.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.586+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182537968 0 0) 0x7f8614147060 con 0x7f8614146800 2023-12-19T13:59:38.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8600003520 con 0x7f8614146800 2023-12-19T13:59:38.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8618ee2640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86140ab150 0x7f86140a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 951699778 0 0) 0x7f8600003520 con 0x7f8614146800 2023-12-19T13:59:38.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86140ab150 msgr2=0x7f86140a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:38.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86140ab150 0x7f86140a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 >> v1:172.21.15.151:6789/0 conn(0x7f86140ac7b0 legacy=0x7f86140acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86140ab9f0 con 0x7f8614146800 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f8610001670 con 0x7f8614146800 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 >> v1:172.21.15.113:6789/0 conn(0x7f8614146800 legacy=0x7f86140a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f8600003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000047c0 0x7f8600004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86140ab150 0x7f860000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8614146be0 con 0x7f8600003a10 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000055c0 con 0x7f86000047c0 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860000bec0 con 0x7f86140ab150 2023-12-19T13:59:38.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.587+0000 7f86196e3640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f8600003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.588+0000 7f8618ee2640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000047c0 0x7f8600004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.588+0000 7f86196e3640 1 -- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86140ab150 msgr2=0x7f860000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:38.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.588+0000 7f86196e3640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86140ab150 0x7f860000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.588+0000 7f86196e3640 1 -- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000047c0 msgr2=0x7f8600004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:38.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.588+0000 7f86196e3640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000047c0 0x7f8600004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.588+0000 7f86196e3640 1 -- 172.21.15.113:0/4115550681 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600003520 con 0x7f8600003a10 2023-12-19T13:59:38.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.589+0000 7f86196e3640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f8600003e30 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f861000c0e0 tx=0x7f86000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e8a7ddd1292e4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:38.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.589+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610005ad0 con 0x7f8600003a10 2023-12-19T13:59:38.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.589+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8610005c30 con 0x7f8600003a10 2023-12-19T13:59:38.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.589+0000 7f8607fff640 1 -- 172.21.15.113:0/4115550681 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861002c810 con 0x7f8600003a10 2023-12-19T13:59:38.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.589+0000 7f861b947640 1 -- 172.21.15.113:0/4115550681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 msgr2=0x7f8600003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.589+0000 7f861b947640 1 --2- 172.21.15.113:0/4115550681 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f8600003e30 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f861000c0e0 tx=0x7f86000057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.590+0000 7f8619ee4640 1 -- 172.21.15.113:0/4115550681 reap_dead start 2023-12-19T13:59:38.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.590+0000 7f861b947640 1 -- 172.21.15.113:0/4115550681 shutdown_connections 2023-12-19T13:59:38.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.590+0000 7f861b947640 1 -- 172.21.15.113:0/4115550681 >> 172.21.15.113:0/4115550681 conn(0x7f861406f5a0 msgr2=0x7f861406f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:38.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.590+0000 7f861b947640 1 -- 172.21.15.113:0/4115550681 shutdown_connections 2023-12-19T13:59:38.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.590+0000 7f861b947640 1 -- 172.21.15.113:0/4115550681 wait complete. 2023-12-19T13:59:38.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.591+0000 7f861b947640 1 Processor -- start 2023-12-19T13:59:38.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.592+0000 7f861b947640 1 -- start start 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.592+0000 7f861b947640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f861413db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.592+0000 7f861b947640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86141458b0 0x7f8614140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.592+0000 7f861b947640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8614145d10 0x7f8614140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.592+0000 7f861b947640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8614144ba0 con 0x7f8600003a10 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.592+0000 7f861b947640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861415e960 con 0x7f8614145d10 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.592+0000 7f861b947640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861415e680 con 0x7f86141458b0 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f861413db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f861413db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51910/0 (socket says 172.21.15.113:51910) 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 -- 172.21.15.113:0/81080736 learned_addr learned my addr 172.21.15.113:0/81080736 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:38.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f8619ee4640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8614145d10 0x7f8614140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f8618ee2640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86141458b0 0x7f8614140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 -- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86141458b0 msgr2=0x7f8614140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86141458b0 0x7f8614140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 -- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8614145d10 msgr2=0x7f8614140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8614145d10 0x7f8614140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 -- 172.21.15.113:0/81080736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614144dd0 con 0x7f8600003a10 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f8619ee4640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8614145d10 0x7f8614140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.593+0000 7f86196e3640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f861413db20 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f861002c3b0 tx=0x7f8610001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.594+0000 7f8605ffb640 1 -- 172.21.15.113:0/81080736 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610039070 con 0x7f8600003a10 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.594+0000 7f8605ffb640 1 -- 172.21.15.113:0/81080736 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861002cc20 con 0x7f8600003a10 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.594+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86141450b0 con 0x7f8600003a10 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.594+0000 7f8605ffb640 1 -- 172.21.15.113:0/81080736 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861003c040 con 0x7f8600003a10 2023-12-19T13:59:38.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.594+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861413e060 con 0x7f8600003a10 2023-12-19T13:59:38.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.595+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8614061910 con 0x7f8600003a10 2023-12-19T13:59:38.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.596+0000 7f8605ffb640 1 -- 172.21.15.113:0/81080736 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8610032070 con 0x7f8600003a10 2023-12-19T13:59:38.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.597+0000 7f8605ffb640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f806a460 0x7f85f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:38.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.597+0000 7f8605ffb640 1 -- 172.21.15.113:0/81080736 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f86100a98a0 con 0x7f8600003a10 2023-12-19T13:59:38.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.597+0000 7f8618ee2640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f806a460 0x7f85f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:38.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.598+0000 7f8618ee2640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f806a460 0x7f85f806c920 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8614141750 tx=0x7f8608008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:38.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.601+0000 7f8605ffb640 1 -- 172.21.15.113:0/81080736 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86100751e0 con 0x7f8600003a10 2023-12-19T13:59:38.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:38.792+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f86140aaba0 con 0x7f8600003a10 2023-12-19T13:59:39.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.713+0000 7f8605ffb640 1 -- 172.21.15.113:0/81080736 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v193) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8610078800 con 0x7f8600003a10 2023-12-19T13:59:39.714 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2023-12-19T13:59:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.721+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f806a460 msgr2=0x7f85f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.721+0000 7f861b947640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f806a460 0x7f85f806c920 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8614141750 tx=0x7f8608008040 comp rx=0 tx=0).stop 2023-12-19T13:59:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.721+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 msgr2=0x7f861413db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:39.721 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.721+0000 7f861b947640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f861413db20 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f861002c3b0 tx=0x7f8610001930 comp rx=0 tx=0).stop 2023-12-19T13:59:39.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.722+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 shutdown_connections 2023-12-19T13:59:39.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.722+0000 7f861b947640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f85f806a460 0x7f85f806c920 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.722+0000 7f861b947640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8614145d10 0x7f8614140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.722+0000 7f861b947640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86141458b0 0x7f8614140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.722+0000 7f861b947640 1 --2- 172.21.15.113:0/81080736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8600003a10 0x7f861413db20 secure :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f861002c3b0 tx=0x7f8610001930 comp rx=0 tx=0).stop 2023-12-19T13:59:39.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.722+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 >> 172.21.15.113:0/81080736 conn(0x7f861406f5a0 msgr2=0x7f86140a9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:39.723 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.723+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 shutdown_connections 2023-12-19T13:59:39.724 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.724+0000 7f861b947640 1 -- 172.21.15.113:0/81080736 wait complete. 2023-12-19T13:59:39.747 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:59:39.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.968+0000 7f71ca129640 1 Processor -- start 2023-12-19T13:59:39.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.968+0000 7f71ca129640 1 -- start start 2023-12-19T13:59:39.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.970+0000 7f71ca129640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 0x7f71c40b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.970+0000 7f71ca129640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c415a470 con 0x7f71c40b0a40 2023-12-19T13:59:39.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.970+0000 7f71ca129640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c406b4d0 con 0x7f71c40b2770 2023-12-19T13:59:39.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.970+0000 7f71ca129640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b2400 con 0x7f71c415a090 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71c9928640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f71c40b0a40 0x7f71c406b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46886/0 (socket says 172.21.15.113:46886) 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71c9928640 1 -- 172.21.15.113:0/2568076391 learned_addr learned my addr 172.21.15.113:0/2568076391 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71c9127640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 0x7f71c40b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809085265 0 0) 0x7f71c415a470 con 0x7f71c40b0a40 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b0003520 con 0x7f71c40b0a40 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 608518771 0 0) 0x7f71b0003520 con 0x7f71c40b0a40 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 msgr2=0x7f71c40b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.971+0000 7f71bbfff640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 0x7f71c40b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 >> v1:172.21.15.151:6789/0 conn(0x7f71c40b2770 legacy=0x7f71c40b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:39.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c406e380 con 0x7f71c40b0a40 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f71bc0019f0 con 0x7f71c40b0a40 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 >> v1:172.21.15.113:6789/0 conn(0x7f71c40b0a40 legacy=0x7f71c406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 0x7f71b00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b0003f20 0x7f71b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71b0004d00 0x7f71b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b2400 con 0x7f71b0004d00 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b000ba60 con 0x7f71b0003f20 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b000bc20 con 0x7f71c415a090 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71c9928640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71b0004d00 0x7f71b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.972+0000 7f71c8926640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b0003f20 0x7f71b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.973+0000 7f71c9127640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 0x7f71b00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.973+0000 7f71c9928640 1 -- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 msgr2=0x7f71b00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.973+0000 7f71c9928640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 0x7f71b00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.973+0000 7f71c9928640 1 -- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b0003f20 msgr2=0x7f71b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:39.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.973+0000 7f71c9928640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b0003f20 0x7f71b00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.973+0000 7f71c9928640 1 -- 172.21.15.113:0/2568076391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0003520 con 0x7f71b0004d00 2023-12-19T13:59:39.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.973+0000 7f71c9127640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c415a090 0x7f71b00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.974+0000 7f71c9928640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71b0004d00 0x7f71b0005180 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f71c40b1010 tx=0x7f71b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239721589fc3ea6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.974+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0072d0 con 0x7f71b0004d00 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.974+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc02f070 con 0x7f71b0004d00 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.974+0000 7f71bbfff640 1 -- 172.21.15.113:0/2568076391 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc007690 con 0x7f71b0004d00 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.975+0000 7f71ca129640 1 -- 172.21.15.113:0/2568076391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71b0004d00 msgr2=0x7f71b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.975+0000 7f71ca129640 1 --2- 172.21.15.113:0/2568076391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71b0004d00 0x7f71b0005180 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f71c40b1010 tx=0x7f71b00057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.975+0000 7f71c9928640 1 -- 172.21.15.113:0/2568076391 reap_dead start 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.975+0000 7f71ca129640 1 -- 172.21.15.113:0/2568076391 shutdown_connections 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.975+0000 7f71ca129640 1 -- 172.21.15.113:0/2568076391 >> 172.21.15.113:0/2568076391 conn(0x7f71c40659a0 msgr2=0x7f71c4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.975+0000 7f71ca129640 1 -- 172.21.15.113:0/2568076391 shutdown_connections 2023-12-19T13:59:39.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.975+0000 7f71ca129640 1 -- 172.21.15.113:0/2568076391 wait complete. 2023-12-19T13:59:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.977+0000 7f71ca129640 1 Processor -- start 2023-12-19T13:59:39.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.977+0000 7f71ca129640 1 -- start start 2023-12-19T13:59:39.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71ca129640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71b0004d00 0x7f71c40acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71ca129640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71c4150030 0x7f71c414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71ca129640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c4152950 0x7f71c4152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71ca129640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4151580 con 0x7f71c4150030 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71ca129640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4150a00 con 0x7f71c4152950 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71ca129640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4150c50 con 0x7f71b0004d00 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71c8926640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71c4150030 0x7f71c414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71c8926640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71c4150030 0x7f71c414f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51934/0 (socket says 172.21.15.113:51934) 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71c8926640 1 -- 172.21.15.113:0/2361974941 learned_addr learned my addr 172.21.15.113:0/2361974941 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71c8926640 1 -- 172.21.15.113:0/2361974941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71b0004d00 msgr2=0x7f71c40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.978+0000 7f71c8926640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71b0004d00 0x7f71c40acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71c8926640 1 -- 172.21.15.113:0/2361974941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c4152950 msgr2=0x7f71c4152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71c9928640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c4152950 0x7f71c4152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71c8926640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c4152950 0x7f71c4152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:39.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71c8926640 1 -- 172.21.15.113:0/2361974941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4150f30 con 0x7f71c4150030 2023-12-19T13:59:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71c8926640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71c4150030 0x7f71c414f410 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f71b40109c0 tx=0x7f71b4010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71b9ffb640 1 -- 172.21.15.113:0/2361974941 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40054e0 con 0x7f71c4150030 2023-12-19T13:59:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71b9ffb640 1 -- 172.21.15.113:0/2361974941 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400e8d0 con 0x7f71c4150030 2023-12-19T13:59:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71b9ffb640 1 -- 172.21.15.113:0/2361974941 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400ec60 con 0x7f71c4150030 2023-12-19T13:59:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c4151210 con 0x7f71c4150030 2023-12-19T13:59:39.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.979+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40ad4f0 con 0x7f71c4150030 2023-12-19T13:59:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.980+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4061910 con 0x7f71c4150030 2023-12-19T13:59:39.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.982+0000 7f71b9ffb640 1 -- 172.21.15.113:0/2361974941 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f71b40035f0 con 0x7f71c4150030 2023-12-19T13:59:39.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.982+0000 7f71b9ffb640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f71a806a430 0x7f71a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:39.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.983+0000 7f71b9ffb640 1 -- 172.21.15.113:0/2361974941 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f71b408b520 con 0x7f71c4150030 2023-12-19T13:59:39.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.983+0000 7f71c9127640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f71a806a430 0x7f71a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:39.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.983+0000 7f71c9127640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f71a806a430 0x7f71a806c8f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f71c00099e0 tx=0x7f71c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:39.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:39.986+0000 7f71b9ffb640 1 -- 172.21.15.113:0/2361974941 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71b4056d60 con 0x7f71c4150030 2023-12-19T13:59:40.174 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.174+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f71c406fab0 con 0x7f71c4150030 2023-12-19T13:59:40.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.736+0000 7f71b9ffb640 1 -- 172.21.15.113:0/2361974941 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v194) v1 ==== 170+0+0 (secure 0 0 0) 0x7f71b405a380 con 0x7f71c4150030 2023-12-19T13:59:40.740 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2023-12-19T13:59:40.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.746+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f71a806a430 msgr2=0x7f71a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:40.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.746+0000 7f71ca129640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f71a806a430 0x7f71a806c8f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f71c00099e0 tx=0x7f71c0008040 comp rx=0 tx=0).stop 2023-12-19T13:59:40.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.746+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71c4150030 msgr2=0x7f71c414f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:40.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.746+0000 7f71ca129640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71c4150030 0x7f71c414f410 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f71b40109c0 tx=0x7f71b4010e80 comp rx=0 tx=0).stop 2023-12-19T13:59:40.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.747+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 shutdown_connections 2023-12-19T13:59:40.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.747+0000 7f71ca129640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f71a806a430 0x7f71a806c8f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.747+0000 7f71ca129640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c4152950 0x7f71c4152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.747+0000 7f71ca129640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71c4150030 0x7f71c414f410 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.747+0000 7f71ca129640 1 --2- 172.21.15.113:0/2361974941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71b0004d00 0x7f71c40acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.747+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 >> 172.21.15.113:0/2361974941 conn(0x7f71c40659a0 msgr2=0x7f71c4156070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:40.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.747+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 shutdown_connections 2023-12-19T13:59:40.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.748+0000 7f71ca129640 1 -- 172.21.15.113:0/2361974941 wait complete. 2023-12-19T13:59:40.772 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:59:40.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.963+0000 7f34c1fbf640 1 Processor -- start 2023-12-19T13:59:40.964 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.964+0000 7f34c1fbf640 1 -- start start 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.965+0000 7f34c1fbf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34bc141900 0x7f34bc0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.965+0000 7f34c1fbf640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f34bc0b02a0 0x7f34bc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.965+0000 7f34c1fbf640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc06e220 con 0x7f34bc06da30 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.965+0000 7f34c1fbf640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc0b0730 con 0x7f34bc141900 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.965+0000 7f34c1fbf640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc0cbea0 con 0x7f34bc0b02a0 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34c0fbd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34bc141900 0x7f34bc0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34c17be640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f34bc06da30 0x7f34bc0ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46892/0 (socket says 172.21.15.113:46892) 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34c17be640 1 -- 172.21.15.113:0/2122829283 learned_addr learned my addr 172.21.15.113:0/2122829283 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:40.966 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34bbfff640 1 --2- 172.21.15.113:0/2122829283 >> v2:172.21.15.151:3300/0 conn(0x7f34bc0b02a0 0x7f34bc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:40.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34c0fbd640 1 -- 172.21.15.113:0/2122829283 >> v2:172.21.15.151:3300/0 conn(0x7f34bc0b02a0 msgr2=0x7f34bc06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:40.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34c0fbd640 1 --2- 172.21.15.113:0/2122829283 >> v2:172.21.15.151:3300/0 conn(0x7f34bc0b02a0 0x7f34bc06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34c0fbd640 1 -- 172.21.15.113:0/2122829283 >> v1:172.21.15.113:6789/0 conn(0x7f34bc06da30 legacy=0x7f34bc0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:40.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34c0fbd640 1 -- 172.21.15.113:0/2122829283 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0cc180 con 0x7f34bc141900 2023-12-19T13:59:40.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.966+0000 7f34bb7fe640 1 -- 172.21.15.113:0/2122829283 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172453939 0 0) 0x7f34bc06e220 con 0x7f34bc06da30 2023-12-19T13:59:40.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.968+0000 7f34c0fbd640 1 --2- 172.21.15.113:0/2122829283 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc141900 0x7f34bc0afd60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f34bc04eaa0 tx=0x7f34b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0ea731f1cca083 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:40.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.968+0000 7f34bb7fe640 1 -- 172.21.15.113:0/2122829283 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0031830 con 0x7f34bc141900 2023-12-19T13:59:40.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.968+0000 7f34bb7fe640 1 -- 172.21.15.113:0/2122829283 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0031990 con 0x7f34bc141900 2023-12-19T13:59:40.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.968+0000 7f34bb7fe640 1 -- 172.21.15.113:0/2122829283 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0031d20 con 0x7f34bc141900 2023-12-19T13:59:40.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2122829283 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc141900 msgr2=0x7f34bc0afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:40.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2122829283 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc141900 0x7f34bc0afd60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f34bc04eaa0 tx=0x7f34b002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2122829283 shutdown_connections 2023-12-19T13:59:40.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2122829283 >> v2:172.21.15.151:3300/0 conn(0x7f34bc0b02a0 0x7f34bc06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.969 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2122829283 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc141900 0x7f34bc0afd60 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2122829283 >> 172.21.15.113:0/2122829283 conn(0x7f34bc06f630 msgr2=0x7f34bc06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:40.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2122829283 shutdown_connections 2023-12-19T13:59:40.970 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.969+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2122829283 wait complete. 2023-12-19T13:59:40.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.971+0000 7f34c1fbf640 1 Processor -- start 2023-12-19T13:59:40.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.971+0000 7f34c1fbf640 1 -- start start 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34c1fbf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34bc06da30 0x7f34bc15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34c1fbf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc0b02a0 0x7f34bc15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34c1fbf640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34bc141900 0x7f34bc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34c1fbf640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc159ca0 con 0x7f34bc0b02a0 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34c1fbf640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc157c20 con 0x7f34bc06da30 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34c1fbf640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc157f00 con 0x7f34bc141900 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc0b02a0 0x7f34bc15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc0b02a0 0x7f34bc15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51962/0 (socket says 172.21.15.113:51962) 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.972+0000 7f34bbfff640 1 -- 172.21.15.113:0/2154493580 learned_addr learned my addr 172.21.15.113:0/2154493580 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34c0fbd640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34bc06da30 0x7f34bc15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34bbfff640 1 -- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34bc141900 msgr2=0x7f34bc15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34c17be640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34bc141900 0x7f34bc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34bbfff640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34bc141900 0x7f34bc15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34bbfff640 1 -- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34bc06da30 msgr2=0x7f34bc15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34bbfff640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34bc06da30 0x7f34bc15bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34bbfff640 1 -- 172.21.15.113:0/2154493580 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b0009400 con 0x7f34bc0b02a0 2023-12-19T13:59:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34c0fbd640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34bc06da30 0x7f34bc15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34bbfff640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc0b02a0 0x7f34bc15c440 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f34a800d800 tx=0x7f34a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:40.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34b97fa640 1 -- 172.21.15.113:0/2154493580 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800b6c0 con 0x7f34bc0b02a0 2023-12-19T13:59:40.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34b97fa640 1 -- 172.21.15.113:0/2154493580 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a800b820 con 0x7f34bc0b02a0 2023-12-19T13:59:40.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34b97fa640 1 -- 172.21.15.113:0/2154493580 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800bbb0 con 0x7f34bc0b02a0 2023-12-19T13:59:40.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc1581e0 con 0x7f34bc0b02a0 2023-12-19T13:59:40.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.973+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc156fa0 con 0x7f34bc0b02a0 2023-12-19T13:59:40.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.974+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc159e70 con 0x7f34bc0b02a0 2023-12-19T13:59:40.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.976+0000 7f34b97fa640 1 -- 172.21.15.113:0/2154493580 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34a800bd10 con 0x7f34bc0b02a0 2023-12-19T13:59:40.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.977+0000 7f34b97fa640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f34a006a430 0x7f34a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.977+0000 7f34b97fa640 1 -- 172.21.15.113:0/2154493580 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f34a8088dd0 con 0x7f34bc0b02a0 2023-12-19T13:59:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.977+0000 7f34c0fbd640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f34a006a430 0x7f34a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.978+0000 7f34c0fbd640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f34a006a430 0x7f34a006c8f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f34b0036000 tx=0x7f34b003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:40.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:40.981+0000 7f34b97fa640 1 -- 172.21.15.113:0/2154493580 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f34bc159e70 con 0x7f34bc0b02a0 2023-12-19T13:59:41.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.207+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f34bc061910 con 0x7f34bc0b02a0 2023-12-19T13:59:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.218+0000 7f34b97fa640 1 -- 172.21.15.113:0/2154493580 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v84) v1 ==== 174+0+0 (secure 0 0 0) 0x7f34a8054410 con 0x7f34bc0b02a0 2023-12-19T13:59:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 22 and data pool 23 2023-12-19T13:59:41.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f34a006a430 msgr2=0x7f34a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f34a006a430 0x7f34a006c8f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f34b0036000 tx=0x7f34b003c040 comp rx=0 tx=0).stop 2023-12-19T13:59:41.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc0b02a0 msgr2=0x7f34bc15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc0b02a0 0x7f34bc15c440 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f34a800d800 tx=0x7f34a800dcc0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 shutdown_connections 2023-12-19T13:59:41.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f34a006a430 0x7f34a006c8f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34bc141900 0x7f34bc15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34bc0b02a0 0x7f34bc15c440 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 --2- 172.21.15.113:0/2154493580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34bc06da30 0x7f34bc15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.222+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 >> 172.21.15.113:0/2154493580 conn(0x7f34bc06f630 msgr2=0x7f34bc15d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:41.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.223+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 shutdown_connections 2023-12-19T13:59:41.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.223+0000 7f34c1fbf640 1 -- 172.21.15.113:0/2154493580 wait complete. 2023-12-19T13:59:41.251 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:41.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.431+0000 7f9293177640 1 Processor -- start 2023-12-19T13:59:41.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.431+0000 7f9293177640 1 -- start start 2023-12-19T13:59:41.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9293177640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f928c157bf0 0x7f928c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9293177640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f928c0b0810 0x7f928c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9293177640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c15b740 con 0x7f928c0ae110 2023-12-19T13:59:41.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9293177640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c06b8c0 con 0x7f928c0b0810 2023-12-19T13:59:41.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9293177640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0ae640 con 0x7f928c157bf0 2023-12-19T13:59:41.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9291714640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f928c0b0810 0x7f928c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9291714640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f928c0b0810 0x7f928c06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51974/0 (socket says 172.21.15.113:51974) 2023-12-19T13:59:41.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.432+0000 7f9291714640 1 -- 172.21.15.113:0/4198091888 learned_addr learned my addr 172.21.15.113:0/4198091888 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:41.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.433+0000 7f9290f13640 1 --2- 172.21.15.113:0/4198091888 >> v2:172.21.15.151:3300/0 conn(0x7f928c157bf0 0x7f928c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.433+0000 7f9291714640 1 -- 172.21.15.113:0/4198091888 >> v2:172.21.15.151:3300/0 conn(0x7f928c157bf0 msgr2=0x7f928c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:41.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.433+0000 7f9291714640 1 --2- 172.21.15.113:0/4198091888 >> v2:172.21.15.151:3300/0 conn(0x7f928c157bf0 0x7f928c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.433+0000 7f9291714640 1 -- 172.21.15.113:0/4198091888 >> v1:172.21.15.151:6789/0 conn(0x7f928c0ae110 legacy=0x7f928c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:41.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.433+0000 7f9291714640 1 -- 172.21.15.113:0/4198091888 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c0ae920 con 0x7f928c0b0810 2023-12-19T13:59:41.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.434+0000 7f9291714640 1 --2- 172.21.15.113:0/4198091888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c06d230 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f928c0ccbc0 tx=0x7f928402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b567f4a2223e6418 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:41.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.434+0000 7f928b7fe640 1 -- 172.21.15.113:0/4198091888 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928402ea90 con 0x7f928c0b0810 2023-12-19T13:59:41.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.434+0000 7f928b7fe640 1 -- 172.21.15.113:0/4198091888 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928402ebf0 con 0x7f928c0b0810 2023-12-19T13:59:41.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.434+0000 7f928b7fe640 1 -- 172.21.15.113:0/4198091888 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284009600 con 0x7f928c0b0810 2023-12-19T13:59:41.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 -- 172.21.15.113:0/4198091888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 msgr2=0x7f928c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 --2- 172.21.15.113:0/4198091888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c06d230 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f928c0ccbc0 tx=0x7f928402e0f0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 -- 172.21.15.113:0/4198091888 shutdown_connections 2023-12-19T13:59:41.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 --2- 172.21.15.113:0/4198091888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c06d230 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 --2- 172.21.15.113:0/4198091888 >> v2:172.21.15.151:3300/0 conn(0x7f928c157bf0 0x7f928c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 -- 172.21.15.113:0/4198091888 >> 172.21.15.113:0/4198091888 conn(0x7f928c0cbb70 msgr2=0x7f928c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 -- 172.21.15.113:0/4198091888 shutdown_connections 2023-12-19T13:59:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.435+0000 7f9293177640 1 -- 172.21.15.113:0/4198091888 wait complete. 2023-12-19T13:59:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.437+0000 7f9293177640 1 Processor -- start 2023-12-19T13:59:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.437+0000 7f9293177640 1 -- start start 2023-12-19T13:59:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9293177640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f928c0ae110 0x7f928c1f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9293177640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c1f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9293177640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f928c157bf0 0x7f928c1f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9293177640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1f3c30 con 0x7f928c0b0810 2023-12-19T13:59:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9293177640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c15a3f0 con 0x7f928c0ae110 2023-12-19T13:59:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9293177640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0cd7f0 con 0x7f928c157bf0 2023-12-19T13:59:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c1f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c1f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51984/0 (socket says 172.21.15.113:51984) 2023-12-19T13:59:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 -- 172.21.15.113:0/2941578827 learned_addr learned my addr 172.21.15.113:0/2941578827 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9290f13640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f928c0ae110 0x7f928c1f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f9291714640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f928c157bf0 0x7f928c1f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 -- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f928c157bf0 msgr2=0x7f928c1f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f928c157bf0 0x7f928c1f6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 -- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f928c0ae110 msgr2=0x7f928c1f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f928c0ae110 0x7f928c1f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.438+0000 7f928bfff640 1 -- 172.21.15.113:0/2941578827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928400bd40 con 0x7f928c0b0810 2023-12-19T13:59:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.439+0000 7f928bfff640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c1f2450 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f928000c410 tx=0x7f928000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.439+0000 7f92897fa640 1 -- 172.21.15.113:0/2941578827 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800035f0 con 0x7f928c0b0810 2023-12-19T13:59:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.439+0000 7f92897fa640 1 -- 172.21.15.113:0/2941578827 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280003750 con 0x7f928c0b0810 2023-12-19T13:59:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.439+0000 7f92897fa640 1 -- 172.21.15.113:0/2941578827 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280003b40 con 0x7f928c0b0810 2023-12-19T13:59:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.439+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c0c2b90 con 0x7f928c0b0810 2023-12-19T13:59:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.439+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c1f6370 con 0x7f928c0b0810 2023-12-19T13:59:41.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.440+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c061910 con 0x7f928c0b0810 2023-12-19T13:59:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.441+0000 7f92897fa640 1 -- 172.21.15.113:0/2941578827 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9280003ca0 con 0x7f928c0b0810 2023-12-19T13:59:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.443+0000 7f92897fa640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f927806a430 0x7f927806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.443+0000 7f92897fa640 1 -- 172.21.15.113:0/2941578827 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9280087b70 con 0x7f928c0b0810 2023-12-19T13:59:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.443+0000 7f9290f13640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f927806a430 0x7f927806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.444+0000 7f9290f13640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f927806a430 0x7f927806c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f927c006fd0 tx=0x7f927c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.447+0000 7f92897fa640 1 -- 172.21.15.113:0/2941578827 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9280053150 con 0x7f928c0b0810 2023-12-19T13:59:41.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.641+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f928c15ad90 con 0x7f928c0b0810 2023-12-19T13:59:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.644+0000 7f92897fa640 1 -- 172.21.15.113:0/2941578827 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f9280056770 con 0x7f928c0b0810 2023-12-19T13:59:41.644 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:41.644 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":195,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:59:41.209964+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f927806a430 msgr2=0x7f927806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f927806a430 0x7f927806c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f927c006fd0 tx=0x7f927c008040 comp rx=0 tx=0).stop 2023-12-19T13:59:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 msgr2=0x7f928c1f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c1f2450 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f928000c410 tx=0x7f928000c8d0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 shutdown_connections 2023-12-19T13:59:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f927806a430 0x7f927806c8f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f928c157bf0 0x7f928c1f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f928c0b0810 0x7f928c1f2450 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 --2- 172.21.15.113:0/2941578827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f928c0ae110 0x7f928c1f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 >> 172.21.15.113:0/2941578827 conn(0x7f928c0cbb70 msgr2=0x7f928c06d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 shutdown_connections 2023-12-19T13:59:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.647+0000 7f9293177640 1 -- 172.21.15.113:0/2941578827 wait complete. 2023-12-19T13:59:41.665 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:41.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.869+0000 7f2adcd92640 1 Processor -- start 2023-12-19T13:59:41.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.869+0000 7f2adcd92640 1 -- start start 2023-12-19T13:59:41.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.871+0000 7f2adcd92640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2ad8157bf0 0x7f2ad815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.871+0000 7f2adcd92640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad80b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.871+0000 7f2adcd92640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad80b0a90 con 0x7f2ad80b0640 2023-12-19T13:59:41.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.871+0000 7f2adcd92640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad806b8c0 con 0x7f2ad8157bf0 2023-12-19T13:59:41.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.871+0000 7f2adcd92640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad815b740 con 0x7f2ad80ae110 2023-12-19T13:59:41.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.872+0000 7f2ad659c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2ad8157bf0 0x7f2ad815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.872+0000 7f2acffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad80b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.872+0000 7f2acffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad80b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:38480/0 (socket says 172.21.15.113:38480) 2023-12-19T13:59:41.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.872+0000 7f2acffff640 1 -- 172.21.15.113:0/563991212 learned_addr learned my addr 172.21.15.113:0/563991212 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:41.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.872+0000 7f2ad659c640 1 -- 172.21.15.113:0/563991212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 msgr2=0x7f2ad80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:41.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.873+0000 7f2ad659c640 1 --2- 172.21.15.113:0/563991212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad80b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.873+0000 7f2ad659c640 1 -- 172.21.15.113:0/563991212 >> v1:172.21.15.151:6789/0 conn(0x7f2ad80b0640 legacy=0x7f2ad815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.873+0000 7f2ad659c640 1 -- 172.21.15.113:0/563991212 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80ae640 con 0x7f2ad8157bf0 2023-12-19T13:59:41.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.874+0000 7f2ad659c640 1 --2- 172.21.15.113:0/563991212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad815b200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80097a0 tx=0x7f2ac802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2eccb9564d7f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:41.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.874+0000 7f2ad5d9b640 1 -- 172.21.15.113:0/563991212 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac802d040 con 0x7f2ad8157bf0 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2ad5d9b640 1 -- 172.21.15.113:0/563991212 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac8031810 con 0x7f2ad8157bf0 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2ad5d9b640 1 -- 172.21.15.113:0/563991212 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8031ba0 con 0x7f2ad8157bf0 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2adcd92640 1 -- 172.21.15.113:0/563991212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 msgr2=0x7f2ad815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2adcd92640 1 --2- 172.21.15.113:0/563991212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad815b200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80097a0 tx=0x7f2ac802b8b0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2adcd92640 1 -- 172.21.15.113:0/563991212 shutdown_connections 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2adcd92640 1 --2- 172.21.15.113:0/563991212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad80b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2adcd92640 1 --2- 172.21.15.113:0/563991212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad815b200 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2adcd92640 1 -- 172.21.15.113:0/563991212 >> 172.21.15.113:0/563991212 conn(0x7f2ad80cbb70 msgr2=0x7f2ad80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.875+0000 7f2adcd92640 1 -- 172.21.15.113:0/563991212 shutdown_connections 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.876+0000 7f2adcd92640 1 -- 172.21.15.113:0/563991212 wait complete. 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.877+0000 7f2adcd92640 1 Processor -- start 2023-12-19T13:59:41.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.877+0000 7f2adcd92640 1 -- start start 2023-12-19T13:59:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.878+0000 7f2adcd92640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad813dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.878+0000 7f2adcd92640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad80b0640 0x7f2ad80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.878+0000 7f2adcd92640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.878+0000 7f2adcd92640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad813e190 con 0x7f2ad80b0640 2023-12-19T13:59:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.878+0000 7f2adcd92640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad81407f0 con 0x7f2ad8157bf0 2023-12-19T13:59:41.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.878+0000 7f2adcd92640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad8140ad0 con 0x7f2ad80ae110 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad80b0640 0x7f2ad80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad80b0640 0x7f2ad80ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51986/0 (socket says 172.21.15.113:51986) 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 -- 172.21.15.113:0/1509298693 learned_addr learned my addr 172.21.15.113:0/1509298693 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2ad659c640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad813dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2ad6d9d640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 -- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 msgr2=0x7f2ad813dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad813dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 -- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 msgr2=0x7f2ad80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad80acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 -- 172.21.15.113:0/1509298693 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8009400 con 0x7f2ad80b0640 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2ad6d9d640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.879+0000 7f2acffff640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad80b0640 0x7f2ad80ac8b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e900 tx=0x7f2ac000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:41.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.880+0000 7f2aceffd640 1 -- 172.21.15.113:0/1509298693 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000ca00 con 0x7f2ad80b0640 2023-12-19T13:59:41.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.880+0000 7f2aceffd640 1 -- 172.21.15.113:0/1509298693 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000cb60 con 0x7f2ad80b0640 2023-12-19T13:59:41.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.880+0000 7f2aceffd640 1 -- 172.21.15.113:0/1509298693 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0013470 con 0x7f2ad80b0640 2023-12-19T13:59:41.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.880+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad8140db0 con 0x7f2ad80b0640 2023-12-19T13:59:41.882 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.880+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad813e630 con 0x7f2ad80b0640 2023-12-19T13:59:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.881+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad81415b0 con 0x7f2ad80b0640 2023-12-19T13:59:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.882+0000 7f2aceffd640 1 -- 172.21.15.113:0/1509298693 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ac00135d0 con 0x7f2ad80b0640 2023-12-19T13:59:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.883+0000 7f2aceffd640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ab806a460 0x7f2ab806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.883+0000 7f2aceffd640 1 -- 172.21.15.113:0/1509298693 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ac0088e10 con 0x7f2ad80b0640 2023-12-19T13:59:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.883+0000 7f2ad659c640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ab806a460 0x7f2ab806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:41.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.884+0000 7f2ad659c640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ab806a460 0x7f2ab806c920 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8036000 tx=0x7f2ac803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:41.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:41.887+0000 7f2aceffd640 1 -- 172.21.15.113:0/1509298693 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ad81415b0 con 0x7f2ad80b0640 2023-12-19T13:59:42.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.079+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad81415b0 con 0x7f2ad80b0640 2023-12-19T13:59:42.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.082+0000 7f2aceffd640 1 -- 172.21.15.113:0/1509298693 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f2ad81415b0 con 0x7f2ad80b0640 2023-12-19T13:59:42.082 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:42.082 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":195,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:59:41.209964+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:42.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ab806a460 msgr2=0x7f2ab806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:42.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ab806a460 0x7f2ab806c920 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8036000 tx=0x7f2ac803c040 comp rx=0 tx=0).stop 2023-12-19T13:59:42.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad80b0640 msgr2=0x7f2ad80ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:42.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad80b0640 0x7f2ad80ac8b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e900 tx=0x7f2ac000edc0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 shutdown_connections 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f2ab806a460 0x7f2ab806c920 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad8157bf0 0x7f2ad80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad80b0640 0x7f2ad80ac8b0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 --2- 172.21.15.113:0/1509298693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad80ae110 0x7f2ad813dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.084+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 >> 172.21.15.113:0/1509298693 conn(0x7f2ad80cbb70 msgr2=0x7f2ad806e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.085+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 shutdown_connections 2023-12-19T13:59:42.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.085+0000 7f2adcd92640 1 -- 172.21.15.113:0/1509298693 wait complete. 2023-12-19T13:59:42.103 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:59:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.321+0000 7f7a07573640 1 Processor -- start 2023-12-19T13:59:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.321+0000 7f7a07573640 1 -- start start 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a07573640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a00157aa0 0x7f7a000b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a07573640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a0006e410 0x7f7a00161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a07573640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0006e8c0 con 0x7f7a00161540 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a07573640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a000b2600 con 0x7f7a00157aa0 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a07573640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a000b1d60 con 0x7f7a0006e410 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a0530f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a00157aa0 0x7f7a000b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a0530f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7a00157aa0 0x7f7a000b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51990/0 (socket says 172.21.15.113:51990) 2023-12-19T13:59:42.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a0530f640 1 -- 172.21.15.113:0/1601177166 learned_addr learned my addr 172.21.15.113:0/1601177166 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a0530f640 1 -- 172.21.15.113:0/1601177166 >> v2:172.21.15.151:3300/0 conn(0x7f7a0006e410 msgr2=0x7f7a00161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a0530f640 1 --2- 172.21.15.113:0/1601177166 >> v2:172.21.15.151:3300/0 conn(0x7f7a0006e410 0x7f7a00161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a0530f640 1 -- 172.21.15.113:0/1601177166 >> v1:172.21.15.151:6789/0 conn(0x7f7a00161540 legacy=0x7f7a0015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:42.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.323+0000 7f7a0530f640 1 -- 172.21.15.113:0/1601177166 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a000b2040 con 0x7f7a00157aa0 2023-12-19T13:59:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.325+0000 7f7a0530f640 1 --2- 172.21.15.113:0/1601177166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00157aa0 0x7f7a000b1710 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f7a000cc8c0 tx=0x7f79fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4016a6ba9ddee9bf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.325+0000 7f79f3fff640 1 -- 172.21.15.113:0/1601177166 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc031870 con 0x7f7a00157aa0 2023-12-19T13:59:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.325+0000 7f79f3fff640 1 -- 172.21.15.113:0/1601177166 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0319d0 con 0x7f7a00157aa0 2023-12-19T13:59:42.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.325+0000 7f79f3fff640 1 -- 172.21.15.113:0/1601177166 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc031d60 con 0x7f7a00157aa0 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.325+0000 7f7a07573640 1 -- 172.21.15.113:0/1601177166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00157aa0 msgr2=0x7f7a000b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.325+0000 7f7a07573640 1 --2- 172.21.15.113:0/1601177166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00157aa0 0x7f7a000b1710 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f7a000cc8c0 tx=0x7f79fc02b910 comp rx=0 tx=0).stop 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.326+0000 7f7a07573640 1 -- 172.21.15.113:0/1601177166 shutdown_connections 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.326+0000 7f7a07573640 1 --2- 172.21.15.113:0/1601177166 >> v2:172.21.15.151:3300/0 conn(0x7f7a0006e410 0x7f7a00161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.326+0000 7f7a07573640 1 --2- 172.21.15.113:0/1601177166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00157aa0 0x7f7a000b1710 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.326+0000 7f7a07573640 1 -- 172.21.15.113:0/1601177166 >> 172.21.15.113:0/1601177166 conn(0x7f7a000cbb70 msgr2=0x7f7a000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.326+0000 7f7a07573640 1 -- 172.21.15.113:0/1601177166 shutdown_connections 2023-12-19T13:59:42.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.326+0000 7f7a07573640 1 -- 172.21.15.113:0/1601177166 wait complete. 2023-12-19T13:59:42.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.327+0000 7f7a07573640 1 Processor -- start 2023-12-19T13:59:42.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.328+0000 7f7a07573640 1 -- start start 2023-12-19T13:59:42.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.328+0000 7f7a07573640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a0006e410 0x7f7a0014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.328+0000 7f7a07573640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00157aa0 0x7f7a0015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.328+0000 7f7a07573640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161540 0x7f7a00155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.328+0000 7f7a07573640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0015f200 con 0x7f7a00161540 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.328+0000 7f7a07573640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0015f4e0 con 0x7f7a0006e410 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.328+0000 7f7a07573640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0015f7c0 con 0x7f7a00157aa0 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161540 0x7f7a00155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161540 0x7f7a00155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51998/0 (socket says 172.21.15.113:51998) 2023-12-19T13:59:42.329 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 -- 172.21.15.113:0/2399862263 learned_addr learned my addr 172.21.15.113:0/2399862263 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:42.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a0530f640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a0006e410 0x7f7a0014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:42.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 -- 172.21.15.113:0/2399862263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00157aa0 msgr2=0x7f7a0015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:42.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00157aa0 0x7f7a0015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 -- 172.21.15.113:0/2399862263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a0006e410 msgr2=0x7f7a0014f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a0006e410 0x7f7a0014f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 -- 172.21.15.113:0/2399862263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0094d0 con 0x7f7a00161540 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.329+0000 7f7a05b10640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161540 0x7f7a00155330 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f79f800b410 tx=0x7f79f800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.330+0000 7f79f1ffb640 1 -- 172.21.15.113:0/2399862263 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8011830 con 0x7f7a00161540 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.330+0000 7f79f1ffb640 1 -- 172.21.15.113:0/2399862263 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8011990 con 0x7f7a00161540 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.330+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0015faa0 con 0x7f7a00161540 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.330+0000 7f79f1ffb640 1 -- 172.21.15.113:0/2399862263 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8011d40 con 0x7f7a00161540 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.330+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0015ac70 con 0x7f7a00161540 2023-12-19T13:59:42.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.331+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0015ffc0 con 0x7f7a00161540 2023-12-19T13:59:42.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.332+0000 7f79f1ffb640 1 -- 172.21.15.113:0/2399862263 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79f801a400 con 0x7f7a00161540 2023-12-19T13:59:42.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.333+0000 7f79f1ffb640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e406a460 0x7f79e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:42.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.333+0000 7f79f1ffb640 1 -- 172.21.15.113:0/2399862263 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79f8088880 con 0x7f7a00161540 2023-12-19T13:59:42.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.333+0000 7f7a0530f640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e406a460 0x7f79e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:42.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.334+0000 7f7a0530f640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e406a460 0x7f79e406c920 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f79fc036000 tx=0x7f79fc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:42.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.337+0000 7f79f1ffb640 1 -- 172.21.15.113:0/2399862263 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7a0015ffc0 con 0x7f7a00161540 2023-12-19T13:59:42.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:42.565+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a0015ffc0 con 0x7f7a00161540 2023-12-19T13:59:43.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.239+0000 7f79f1ffb640 1 -- 172.21.15.113:0/2399862263 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7a0015ffc0 con 0x7f7a00161540 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e406a460 msgr2=0x7f79e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e406a460 0x7f79e406c920 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f79fc036000 tx=0x7f79fc03c040 comp rx=0 tx=0).stop 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161540 msgr2=0x7f7a00155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161540 0x7f7a00155330 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f79f800b410 tx=0x7f79f800b8d0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 shutdown_connections 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e406a460 0x7f79e406c920 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161540 0x7f7a00155330 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00157aa0 0x7f7a0015a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 --2- 172.21.15.113:0/2399862263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a0006e410 0x7f7a0014f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 >> 172.21.15.113:0/2399862263 conn(0x7f7a000cbb70 msgr2=0x7f7a0015cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:43.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 shutdown_connections 2023-12-19T13:59:43.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.243+0000 7f7a07573640 1 -- 172.21.15.113:0/2399862263 wait complete. 2023-12-19T13:59:43.264 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:59:43.264 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:59:43.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.487+0000 7f69708bd640 1 Processor -- start 2023-12-19T13:59:43.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.487+0000 7f69708bd640 1 -- start start 2023-12-19T13:59:43.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.489+0000 7f69708bd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 0x7f696c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.489+0000 7f69708bd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c0afb10 con 0x7f696c0b0b50 2023-12-19T13:59:43.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.489+0000 7f69708bd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c06bb30 con 0x7f696c06c6b0 2023-12-19T13:59:43.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.489+0000 7f69708bd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0b0070 con 0x7f696c1449e0 2023-12-19T13:59:43.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.489+0000 7f6963fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f696c0b0b50 0x7f696c06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46900/0 (socket says 172.21.15.113:46900) 2023-12-19T13:59:43.489 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.489+0000 7f6963fff640 1 -- 172.21.15.113:0/265108639 learned_addr learned my addr 172.21.15.113:0/265108639 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326991407 0 0) 0x7f696c0afb10 con 0x7f696c0b0b50 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f696a59c640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 0x7f696c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6958003520 con 0x7f696c0b0b50 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 592754851 0 0) 0x7f6958003520 con 0x7f696c0b0b50 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 msgr2=0x7f696c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 0x7f696c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 >> v1:172.21.15.151:6789/0 conn(0x7f696c06c6b0 legacy=0x7f696c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0b0350 con 0x7f696c0b0b50 2023-12-19T13:59:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f6954001670 con 0x7f696c0b0b50 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 >> v1:172.21.15.113:6789/0 conn(0x7f696c0b0b50 legacy=0x7f696c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6958003a10 0x7f6958003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69580047c0 0x7f6958004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 0x7f69580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0b0070 con 0x7f6958003a10 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695800bab0 con 0x7f69580047c0 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.490+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695800bc70 con 0x7f696c1449e0 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f696a59c640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6958003a10 0x7f6958003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f6963fff640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69580047c0 0x7f6958004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f696ad9d640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 0x7f69580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f696a59c640 1 -- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 msgr2=0x7f69580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f696a59c640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f696c1449e0 0x7f69580051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f696a59c640 1 -- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69580047c0 msgr2=0x7f6958004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f696a59c640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69580047c0 0x7f6958004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.492 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.491+0000 7f696a59c640 1 -- 172.21.15.113:0/265108639 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958003520 con 0x7f6958003a10 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.492+0000 7f696a59c640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6958003a10 0x7f6958003e10 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f695c009ac0 tx=0x7f69580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f12664765b8f24 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.492+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c02c6b0 con 0x7f6958003a10 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.492+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c02c810 con 0x7f6958003a10 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.492+0000 7f6969d9b640 1 -- 172.21.15.113:0/265108639 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c02cba0 con 0x7f6958003a10 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.493+0000 7f69708bd640 1 -- 172.21.15.113:0/265108639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6958003a10 msgr2=0x7f6958003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.493+0000 7f69708bd640 1 --2- 172.21.15.113:0/265108639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6958003a10 0x7f6958003e10 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f695c009ac0 tx=0x7f69580057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.493+0000 7f696ad9d640 1 -- 172.21.15.113:0/265108639 reap_dead start 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.493+0000 7f69708bd640 1 -- 172.21.15.113:0/265108639 shutdown_connections 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.493+0000 7f69708bd640 1 -- 172.21.15.113:0/265108639 >> 172.21.15.113:0/265108639 conn(0x7f696c0cbb70 msgr2=0x7f696c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.493+0000 7f69708bd640 1 -- 172.21.15.113:0/265108639 shutdown_connections 2023-12-19T13:59:43.494 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.493+0000 7f69708bd640 1 -- 172.21.15.113:0/265108639 wait complete. 2023-12-19T13:59:43.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.495+0000 7f69708bd640 1 Processor -- start 2023-12-19T13:59:43.495 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.495+0000 7f69708bd640 1 -- start start 2023-12-19T13:59:43.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f69708bd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6958003a10 0x7f696c1f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f69708bd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f696c138940 0x7f696c0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f69708bd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f696c0adce0 0x7f696c0cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f69708bd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0ae1b0 con 0x7f696c138940 2023-12-19T13:59:43.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f69708bd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0c2c30 con 0x7f696c0adce0 2023-12-19T13:59:43.497 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f69708bd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0c2f10 con 0x7f6958003a10 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f6963fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f696c138940 0x7f696c0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f6963fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f696c138940 0x7f696c0ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52018/0 (socket says 172.21.15.113:52018) 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.496+0000 7f6963fff640 1 -- 172.21.15.113:0/2216693903 learned_addr learned my addr 172.21.15.113:0/2216693903 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f696ad9d640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f696c0adce0 0x7f696c0cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6963fff640 1 -- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6958003a10 msgr2=0x7f696c1f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f696a59c640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6958003a10 0x7f696c1f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6963fff640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6958003a10 0x7f696c1f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6963fff640 1 -- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f696c0adce0 msgr2=0x7f696c0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6963fff640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f696c0adce0 0x7f696c0cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6963fff640 1 -- 172.21.15.113:0/2216693903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0c31f0 con 0x7f696c138940 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f696ad9d640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f696c0adce0 0x7f696c0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6963fff640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f696c138940 0x7f696c0ad7a0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f695400d7a0 tx=0x7f695400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6962ffd640 1 -- 172.21.15.113:0/2216693903 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540074e0 con 0x7f696c138940 2023-12-19T13:59:43.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6962ffd640 1 -- 172.21.15.113:0/2216693903 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954007640 con 0x7f696c138940 2023-12-19T13:59:43.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c0c34d0 con 0x7f696c138940 2023-12-19T13:59:43.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f6962ffd640 1 -- 172.21.15.113:0/2216693903 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954004a20 con 0x7f696c138940 2023-12-19T13:59:43.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.497+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c0ac9d0 con 0x7f696c138940 2023-12-19T13:59:43.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.499+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c061910 con 0x7f696c138940 2023-12-19T13:59:43.499 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.499+0000 7f6962ffd640 1 -- 172.21.15.113:0/2216693903 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6954004b80 con 0x7f696c138940 2023-12-19T13:59:43.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.500+0000 7f6962ffd640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f694c06a430 0x7f694c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:43.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.500+0000 7f6962ffd640 1 -- 172.21.15.113:0/2216693903 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69540885d0 con 0x7f696c138940 2023-12-19T13:59:43.500 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.501+0000 7f696a59c640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f694c06a430 0x7f694c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:43.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.501+0000 7f696a59c640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f694c06a430 0x7f694c06c8f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f695c036000 tx=0x7f695c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:43.504 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.505+0000 7f6962ffd640 1 -- 172.21.15.113:0/2216693903 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6954053bc0 con 0x7f696c138940 2023-12-19T13:59:43.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:43.735+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f696c0cec70 con 0x7f696c138940 2023-12-19T13:59:44.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.749+0000 7f6962ffd640 1 -- 172.21.15.113:0/2216693903 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) v1 ==== 122+0+0 (secure 0 0 0) 0x7f69540571e0 con 0x7f696c138940 2023-12-19T13:59:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f694c06a430 msgr2=0x7f694c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f694c06a430 0x7f694c06c8f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f695c036000 tx=0x7f695c030000 comp rx=0 tx=0).stop 2023-12-19T13:59:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f696c138940 msgr2=0x7f696c0ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f696c138940 0x7f696c0ad7a0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f695400d7a0 tx=0x7f695400dc60 comp rx=0 tx=0).stop 2023-12-19T13:59:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 shutdown_connections 2023-12-19T13:59:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f694c06a430 0x7f694c06c8f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f696c0adce0 0x7f696c0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f696c138940 0x7f696c0ad7a0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 --2- 172.21.15.113:0/2216693903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6958003a10 0x7f696c1f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 >> 172.21.15.113:0/2216693903 conn(0x7f696c0cbb70 msgr2=0x7f696c070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 shutdown_connections 2023-12-19T13:59:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.753+0000 7f69708bd640 1 -- 172.21.15.113:0/2216693903 wait complete. 2023-12-19T13:59:44.773 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:59:44.773 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:44.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.983+0000 7f12d0e3f640 1 Processor -- start 2023-12-19T13:59:44.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.983+0000 7f12d0e3f640 1 -- start start 2023-12-19T13:59:44.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12d0e3f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f12cc1613e0 0x7f12cc0b9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:44.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12d0e3f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12cc0cfe50 0x7f12cc0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:44.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12d0e3f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12cc0b8bf0 con 0x7f12cc154270 2023-12-19T13:59:44.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12d0e3f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12cc0b82e0 con 0x7f12cc0cfe50 2023-12-19T13:59:44.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12d0e3f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12cc0d0bf0 con 0x7f12cc1613e0 2023-12-19T13:59:44.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12cbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12cc0cfe50 0x7f12cc0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:44.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12cbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12cc0cfe50 0x7f12cc0d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52032/0 (socket says 172.21.15.113:52032) 2023-12-19T13:59:44.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.985+0000 7f12cbfff640 1 -- 172.21.15.113:0/1303882251 learned_addr learned my addr 172.21.15.113:0/1303882251 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:44.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.986+0000 7f12c2ffd640 1 --2- 172.21.15.113:0/1303882251 >> v2:172.21.15.151:3300/0 conn(0x7f12cc1613e0 0x7f12cc0b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:44.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.986+0000 7f12cbfff640 1 -- 172.21.15.113:0/1303882251 >> v2:172.21.15.151:3300/0 conn(0x7f12cc1613e0 msgr2=0x7f12cc0b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:44.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.986+0000 7f12cbfff640 1 --2- 172.21.15.113:0/1303882251 >> v2:172.21.15.151:3300/0 conn(0x7f12cc1613e0 0x7f12cc0b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.986+0000 7f12cbfff640 1 -- 172.21.15.113:0/1303882251 >> v1:172.21.15.151:6789/0 conn(0x7f12cc154270 legacy=0x7f12cc160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:44.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.986+0000 7f12cbfff640 1 -- 172.21.15.113:0/1303882251 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0b85a0 con 0x7f12cc0cfe50 2023-12-19T13:59:44.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.987+0000 7f12cbfff640 1 --2- 172.21.15.113:0/1303882251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc0cfe50 0x7f12cc0d02a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f12cc08b050 tx=0x7f12c402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf207424dad2cfb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:44.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.987+0000 7f12caffd640 1 -- 172.21.15.113:0/1303882251 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c402ca80 con 0x7f12cc0cfe50 2023-12-19T13:59:44.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.987+0000 7f12caffd640 1 -- 172.21.15.113:0/1303882251 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c402cbe0 con 0x7f12cc0cfe50 2023-12-19T13:59:44.987 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.987+0000 7f12caffd640 1 -- 172.21.15.113:0/1303882251 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40343f0 con 0x7f12cc0cfe50 2023-12-19T13:59:44.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 -- 172.21.15.113:0/1303882251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc0cfe50 msgr2=0x7f12cc0d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:44.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/1303882251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc0cfe50 0x7f12cc0d02a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f12cc08b050 tx=0x7f12c402bee0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 -- 172.21.15.113:0/1303882251 shutdown_connections 2023-12-19T13:59:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/1303882251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc0cfe50 0x7f12cc0d02a0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/1303882251 >> v2:172.21.15.151:3300/0 conn(0x7f12cc1613e0 0x7f12cc0b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 -- 172.21.15.113:0/1303882251 >> 172.21.15.113:0/1303882251 conn(0x7f12cc06f160 msgr2=0x7f12cc06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 -- 172.21.15.113:0/1303882251 shutdown_connections 2023-12-19T13:59:44.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.988+0000 7f12d0e3f640 1 -- 172.21.15.113:0/1303882251 wait complete. 2023-12-19T13:59:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.990+0000 7f12d0e3f640 1 Processor -- start 2023-12-19T13:59:44.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.990+0000 7f12d0e3f640 1 -- start start 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12d0e3f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12cc0cfe50 0x7f12cc0ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12d0e3f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12cc154270 0x7f12cc1f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12d0e3f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc1613e0 0x7f12cc1f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12d0e3f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc152d70 con 0x7f12cc1613e0 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12d0e3f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc152160 con 0x7f12cc0cfe50 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12d0e3f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc152440 con 0x7f12cc154270 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12cbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc1613e0 0x7f12cc1f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12cbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc1613e0 0x7f12cc1f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52040/0 (socket says 172.21.15.113:52040) 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.991+0000 7f12cbfff640 1 -- 172.21.15.113:0/224249303 learned_addr learned my addr 172.21.15.113:0/224249303 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12cb7fe640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12cc0cfe50 0x7f12cc0ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12c2ffd640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12cc154270 0x7f12cc1f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12cbfff640 1 -- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12cc154270 msgr2=0x7f12cc1f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:44.993 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12cbfff640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12cc154270 0x7f12cc1f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12cbfff640 1 -- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12cc0cfe50 msgr2=0x7f12cc0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12cbfff640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12cc0cfe50 0x7f12cc0ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12cbfff640 1 -- 172.21.15.113:0/224249303 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4009b30 con 0x7f12cc1613e0 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12c2ffd640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12cc154270 0x7f12cc1f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.992+0000 7f12cbfff640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc1613e0 0x7f12cc1f20e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f12c4036040 tx=0x7f12c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.993+0000 7f12c8ff9640 1 -- 172.21.15.113:0/224249303 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4009510 con 0x7f12cc1613e0 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.993+0000 7f12c8ff9640 1 -- 172.21.15.113:0/224249303 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c403e450 con 0x7f12cc1613e0 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.993+0000 7f12c8ff9640 1 -- 172.21.15.113:0/224249303 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c403e7e0 con 0x7f12cc1613e0 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.993+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc152720 con 0x7f12cc1613e0 2023-12-19T13:59:44.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.993+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc151df0 con 0x7f12cc1613e0 2023-12-19T13:59:44.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.994+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc13c610 con 0x7f12cc1613e0 2023-12-19T13:59:44.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.995+0000 7f12c8ff9640 1 -- 172.21.15.113:0/224249303 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12c402cd50 con 0x7f12cc1613e0 2023-12-19T13:59:44.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.995+0000 7f12c8ff9640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f12ac06a430 0x7f12ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:44.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.996+0000 7f12c8ff9640 1 -- 172.21.15.113:0/224249303 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12c40ab4a0 con 0x7f12cc1613e0 2023-12-19T13:59:44.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.996+0000 7f12cb7fe640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f12ac06a430 0x7f12ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:44.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:44.996+0000 7f12cb7fe640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f12ac06a430 0x7f12ac06c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f12cc15e950 tx=0x7f12bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:45.000 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.000+0000 7f12c8ff9640 1 -- 172.21.15.113:0/224249303 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12cc13c610 con 0x7f12cc1613e0 2023-12-19T13:59:45.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.225+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12cc13c610 con 0x7f12cc1613e0 2023-12-19T13:59:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.226+0000 7f12c8ff9640 1 -- 172.21.15.113:0/224249303 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f12cc13c610 con 0x7f12cc1613e0 2023-12-19T13:59:45.226 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:45.226 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T13:59:45.226 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.228+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f12ac06a430 msgr2=0x7f12ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.228+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f12ac06a430 0x7f12ac06c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f12cc15e950 tx=0x7f12bc009040 comp rx=0 tx=0).stop 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.228+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc1613e0 msgr2=0x7f12cc1f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.228+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc1613e0 0x7f12cc1f20e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f12c4036040 tx=0x7f12c4004a40 comp rx=0 tx=0).stop 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 shutdown_connections 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f12ac06a430 0x7f12ac06c8f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12cc1613e0 0x7f12cc1f20e0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12cc154270 0x7f12cc1f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 --2- 172.21.15.113:0/224249303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12cc0cfe50 0x7f12cc0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 >> 172.21.15.113:0/224249303 conn(0x7f12cc06f160 msgr2=0x7f12cc15ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:45.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 shutdown_connections 2023-12-19T13:59:45.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.229+0000 7f12d0e3f640 1 -- 172.21.15.113:0/224249303 wait complete. 2023-12-19T13:59:45.248 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:59:45.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.465+0000 7efe0f241640 1 Processor -- start 2023-12-19T13:59:45.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.465+0000 7efe0f241640 1 -- start start 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.466+0000 7efe0f241640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efe080ae110 0x7efe080b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.466+0000 7efe0f241640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efe080b0640 0x7efe0806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe0f241640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080b0a60 con 0x7efe08157bf0 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe0f241640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0806b8c0 con 0x7efe080ae110 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe0f241640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe080ae640 con 0x7efe080b0640 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe0cfdd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7efe08157bf0 0x7efe0815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46916/0 (socket says 172.21.15.113:46916) 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe0cfdd640 1 -- 172.21.15.113:0/2823308189 learned_addr learned my addr 172.21.15.113:0/2823308189 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:45.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe07fff640 1 --2- 172.21.15.113:0/2823308189 >> v2:172.21.15.113:3300/0 conn(0x7efe080ae110 0x7efe080b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe077fe640 1 -- 172.21.15.113:0/2823308189 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172125866 0 0) 0x7efe080b0a60 con 0x7efe08157bf0 2023-12-19T13:59:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe0d7de640 1 --2- 172.21.15.113:0/2823308189 >> v2:172.21.15.151:3300/0 conn(0x7efe080b0640 0x7efe0806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe077fe640 1 -- 172.21.15.113:0/2823308189 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf8003520 con 0x7efe08157bf0 2023-12-19T13:59:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe07fff640 1 -- 172.21.15.113:0/2823308189 >> v2:172.21.15.151:3300/0 conn(0x7efe080b0640 msgr2=0x7efe0806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe07fff640 1 --2- 172.21.15.113:0/2823308189 >> v2:172.21.15.151:3300/0 conn(0x7efe080b0640 0x7efe0806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe07fff640 1 -- 172.21.15.113:0/2823308189 >> v1:172.21.15.113:6789/0 conn(0x7efe08157bf0 legacy=0x7efe0815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.468 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.467+0000 7efe07fff640 1 -- 172.21.15.113:0/2823308189 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080ae920 con 0x7efe080ae110 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.469+0000 7efe07fff640 1 --2- 172.21.15.113:0/2823308189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080ae110 0x7efe080b0100 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7efe080b1210 tx=0x7efdf402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d992f1811619702 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.469+0000 7efe077fe640 1 -- 172.21.15.113:0/2823308189 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4031830 con 0x7efe080ae110 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.469+0000 7efe077fe640 1 -- 172.21.15.113:0/2823308189 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4031990 con 0x7efe080ae110 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.469+0000 7efe077fe640 1 -- 172.21.15.113:0/2823308189 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4031d20 con 0x7efe080ae110 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 -- 172.21.15.113:0/2823308189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080ae110 msgr2=0x7efe080b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 --2- 172.21.15.113:0/2823308189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080ae110 0x7efe080b0100 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7efe080b1210 tx=0x7efdf402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 -- 172.21.15.113:0/2823308189 shutdown_connections 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 --2- 172.21.15.113:0/2823308189 >> v2:172.21.15.151:3300/0 conn(0x7efe080b0640 0x7efe0806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 --2- 172.21.15.113:0/2823308189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080ae110 0x7efe080b0100 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 -- 172.21.15.113:0/2823308189 >> 172.21.15.113:0/2823308189 conn(0x7efe080cbb70 msgr2=0x7efe080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 -- 172.21.15.113:0/2823308189 shutdown_connections 2023-12-19T13:59:45.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.470+0000 7efe0f241640 1 -- 172.21.15.113:0/2823308189 wait complete. 2023-12-19T13:59:45.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.471+0000 7efe0f241640 1 Processor -- start 2023-12-19T13:59:45.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.472+0000 7efe0f241640 1 -- start start 2023-12-19T13:59:45.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe0f241640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe080ae110 0x7efe0814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe0f241640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080b0640 0x7efe081f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe0f241640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe08157bf0 0x7efe0815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe0f241640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0815bc40 con 0x7efe080b0640 2023-12-19T13:59:45.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe0f241640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe08159100 con 0x7efe080ae110 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe0f241640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0814ba60 con 0x7efe08157bf0 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080b0640 0x7efe081f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080b0640 0x7efe081f2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52054/0 (socket says 172.21.15.113:52054) 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 -- 172.21.15.113:0/2730716237 learned_addr learned my addr 172.21.15.113:0/2730716237 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 -- 172.21.15.113:0/2730716237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe08157bf0 msgr2=0x7efe0815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe08157bf0 0x7efe0815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe0cfdd640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe080ae110 0x7efe0814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 -- 172.21.15.113:0/2730716237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe080ae110 msgr2=0x7efe0814b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe080ae110 0x7efe0814b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.473+0000 7efe07fff640 1 -- 172.21.15.113:0/2730716237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009400 con 0x7efe080b0640 2023-12-19T13:59:45.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.474+0000 7efe07fff640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080b0640 0x7efe081f2a60 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:45.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.474+0000 7efe057fa640 1 -- 172.21.15.113:0/2730716237 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf403a960 con 0x7efe080b0640 2023-12-19T13:59:45.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.474+0000 7efe057fa640 1 -- 172.21.15.113:0/2730716237 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf403aac0 con 0x7efe080b0640 2023-12-19T13:59:45.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.474+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe081581e0 con 0x7efe080b0640 2023-12-19T13:59:45.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.474+0000 7efe057fa640 1 -- 172.21.15.113:0/2730716237 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf403ae30 con 0x7efe080b0640 2023-12-19T13:59:45.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.474+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08158480 con 0x7efe080b0640 2023-12-19T13:59:45.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.476+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe08159240 con 0x7efe080b0640 2023-12-19T13:59:45.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.476+0000 7efe057fa640 1 -- 172.21.15.113:0/2730716237 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efdf404d450 con 0x7efe080b0640 2023-12-19T13:59:45.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.477+0000 7efe057fa640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efdec06a430 0x7efdec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.477+0000 7efe057fa640 1 -- 172.21.15.113:0/2730716237 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdf40aa8c0 con 0x7efe080b0640 2023-12-19T13:59:45.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.477+0000 7efe0cfdd640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efdec06a430 0x7efdec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.478+0000 7efe0cfdd640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efdec06a430 0x7efdec06c8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000f60 tx=0x7efdfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:45.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.481+0000 7efe057fa640 1 -- 172.21.15.113:0/2730716237 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe08159240 con 0x7efe080b0640 2023-12-19T13:59:45.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.673+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe08159240 con 0x7efe080b0640 2023-12-19T13:59:45.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.675+0000 7efe057fa640 1 -- 172.21.15.113:0/2730716237 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16160 (secure 0 0 0) 0x7efe08159240 con 0x7efe080b0640 2023-12-19T13:59:45.676 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:45.676 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":196,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T13:59:42.215543+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:59:45.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efdec06a430 msgr2=0x7efdec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efdec06a430 0x7efdec06c8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000f60 tx=0x7efdfc009040 comp rx=0 tx=0).stop 2023-12-19T13:59:45.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080b0640 msgr2=0x7efe081f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080b0640 0x7efe081f2a60 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf40046c0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 shutdown_connections 2023-12-19T13:59:45.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efdec06a430 0x7efdec06c8f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe08157bf0 0x7efe0815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe080b0640 0x7efe081f2a60 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 --2- 172.21.15.113:0/2730716237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe080ae110 0x7efe0814b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 >> 172.21.15.113:0/2730716237 conn(0x7efe080cbb70 msgr2=0x7efe0814ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:45.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 shutdown_connections 2023-12-19T13:59:45.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.678+0000 7efe0f241640 1 -- 172.21.15.113:0/2730716237 wait complete. 2023-12-19T13:59:45.696 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:59:45.696 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:59:45.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.896+0000 7faf04d0a640 1 Processor -- start 2023-12-19T13:59:45.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.897+0000 7faf04d0a640 1 -- start start 2023-12-19T13:59:45.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.898+0000 7faf04d0a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faf001449e0 0x7faf000af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.898+0000 7faf04d0a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf000afb10 con 0x7faf0006c6b0 2023-12-19T13:59:45.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.898+0000 7faf04d0a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0006bb30 con 0x7faf000b0b50 2023-12-19T13:59:45.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.898+0000 7faf04d0a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf000b0070 con 0x7faf001449e0 2023-12-19T13:59:45.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.898+0000 7faefe59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faf001449e0 0x7faf000af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.898+0000 7faefe59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faf001449e0 0x7faf000af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52068/0 (socket says 172.21.15.113:52068) 2023-12-19T13:59:45.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.898+0000 7faefe59c640 1 -- 172.21.15.113:0/1557469392 learned_addr learned my addr 172.21.15.113:0/1557469392 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:45.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.899+0000 7faefe59c640 1 -- 172.21.15.113:0/1557469392 >> v1:172.21.15.151:6789/0 conn(0x7faf000b0b50 legacy=0x7faf0006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:45.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.899+0000 7faefe59c640 1 -- 172.21.15.113:0/1557469392 >> v1:172.21.15.113:6789/0 conn(0x7faf0006c6b0 legacy=0x7faf000b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.899+0000 7faefe59c640 1 -- 172.21.15.113:0/1557469392 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000b0350 con 0x7faf001449e0 2023-12-19T13:59:45.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.900+0000 7faefe59c640 1 --2- 172.21.15.113:0/1557469392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf001449e0 0x7faf000af5d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7faef0009e50 tx=0x7faef002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19aa02f36aa7d0dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:45.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.900+0000 7faefd59a640 1 -- 172.21.15.113:0/1557469392 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef002cb10 con 0x7faf001449e0 2023-12-19T13:59:45.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.900+0000 7faefd59a640 1 -- 172.21.15.113:0/1557469392 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef002cc70 con 0x7faf001449e0 2023-12-19T13:59:45.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.900+0000 7faefd59a640 1 -- 172.21.15.113:0/1557469392 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef00343f0 con 0x7faf001449e0 2023-12-19T13:59:45.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.901+0000 7faf04d0a640 1 -- 172.21.15.113:0/1557469392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf001449e0 msgr2=0x7faf000af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.901+0000 7faf04d0a640 1 --2- 172.21.15.113:0/1557469392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf001449e0 0x7faf000af5d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7faef0009e50 tx=0x7faef002bf70 comp rx=0 tx=0).stop 2023-12-19T13:59:45.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.901+0000 7faf04d0a640 1 -- 172.21.15.113:0/1557469392 shutdown_connections 2023-12-19T13:59:45.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.901+0000 7faf04d0a640 1 --2- 172.21.15.113:0/1557469392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf001449e0 0x7faf000af5d0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.901+0000 7faf04d0a640 1 -- 172.21.15.113:0/1557469392 >> 172.21.15.113:0/1557469392 conn(0x7faf000cbb70 msgr2=0x7faf000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:45.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.901+0000 7faf04d0a640 1 -- 172.21.15.113:0/1557469392 shutdown_connections 2023-12-19T13:59:45.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.901+0000 7faf04d0a640 1 -- 172.21.15.113:0/1557469392 wait complete. 2023-12-19T13:59:45.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.903+0000 7faf04d0a640 1 Processor -- start 2023-12-19T13:59:45.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.903+0000 7faf04d0a640 1 -- start start 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faf04d0a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf0006c6b0 0x7faf0015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faf04d0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf000b0b50 0x7faf000adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faf04d0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf001449e0 0x7faf00143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faf04d0a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0015aff0 con 0x7faf0006c6b0 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faf04d0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf000ace20 con 0x7faf000b0b50 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faf04d0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf000ad100 con 0x7faf001449e0 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf0006c6b0 0x7faf0015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf0006c6b0 0x7faf0015aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52070/0 (socket says 172.21.15.113:52070) 2023-12-19T13:59:45.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 -- 172.21.15.113:0/2152161893 learned_addr learned my addr 172.21.15.113:0/2152161893 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:45.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 -- 172.21.15.113:0/2152161893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf001449e0 msgr2=0x7faf00143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf001449e0 0x7faf00143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 -- 172.21.15.113:0/2152161893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf000b0b50 msgr2=0x7faf000adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf000b0b50 0x7faf000adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.904+0000 7faefe59c640 1 -- 172.21.15.113:0/2152161893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0009b30 con 0x7faf0006c6b0 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.905+0000 7faefe59c640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf0006c6b0 0x7faf0015aab0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7faef0009e50 tx=0x7faef0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.905+0000 7faeeeffd640 1 -- 172.21.15.113:0/2152161893 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef003e450 con 0x7faf0006c6b0 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.905+0000 7faeeeffd640 1 -- 172.21.15.113:0/2152161893 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef003e5f0 con 0x7faf0006c6b0 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.905+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf000ad3e0 con 0x7faf0006c6b0 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.905+0000 7faeeeffd640 1 -- 172.21.15.113:0/2152161893 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef003e9a0 con 0x7faf0006c6b0 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.905+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0013e370 con 0x7faf0006c6b0 2023-12-19T13:59:45.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.906+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf00061910 con 0x7faf0006c6b0 2023-12-19T13:59:45.907 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.907+0000 7faeeeffd640 1 -- 172.21.15.113:0/2152161893 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faef003eb00 con 0x7faf0006c6b0 2023-12-19T13:59:45.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.909+0000 7faeeeffd640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faee006a430 0x7faee006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:45.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.909+0000 7faeeeffd640 1 -- 172.21.15.113:0/2152161893 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faef00ab820 con 0x7faf0006c6b0 2023-12-19T13:59:45.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.909+0000 7faefdd9b640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faee006a430 0x7faee006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:45.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.910+0000 7faefdd9b640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faee006a430 0x7faee006c8f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faf000ae530 tx=0x7faef40079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:45.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:45.913+0000 7faeeeffd640 1 -- 172.21.15.113:0/2152161893 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faef0076e10 con 0x7faf0006c6b0 2023-12-19T13:59:46.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.098+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf001406b0 con 0x7faee006a430 2023-12-19T13:59:46.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.120+0000 7faeeeffd640 1 -- 172.21.15.113:0/2152161893 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273552 (secure 0 0 0) 0x7faf001406b0 con 0x7faee006a430 2023-12-19T13:59:46.124 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:46.126 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.126+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faee006a430 msgr2=0x7faee006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.126+0000 7faf04d0a640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faee006a430 0x7faee006c8f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faf000ae530 tx=0x7faef40079d0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.126+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf0006c6b0 msgr2=0x7faf0015aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.126+0000 7faf04d0a640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf0006c6b0 0x7faf0015aab0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7faef0009e50 tx=0x7faef0004a40 comp rx=0 tx=0).stop 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 shutdown_connections 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faee006a430 0x7faee006c8f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf001449e0 0x7faf00143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf000b0b50 0x7faf000adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 --2- 172.21.15.113:0/2152161893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf0006c6b0 0x7faf0015aab0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 >> 172.21.15.113:0/2152161893 conn(0x7faf000cbb70 msgr2=0x7faf000b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 shutdown_connections 2023-12-19T13:59:46.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.127+0000 7faf04d0a640 1 -- 172.21.15.113:0/2152161893 wait complete. 2023-12-19T13:59:46.146 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2023-12-19T13:59:44.683694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9641,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552858,"statfs":{"total":1600000000,"available":1590127162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.968973"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.725838+0000","last_change":"2023-12-19T13:59:39.725838+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.725838+0000","last_undegraded":"2023-12-19T13:59:39.725838+0000","last_fullsized":"2023-12-19T13:59:39.725838+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:47.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720706+0000","last_change":"2023-12-19T13:59:39.720706+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720706+0000","last_undegraded":"2023-12-19T13:59:39.720706+0000","last_fullsized":"2023-12-19T13:59:39.720706+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718640+0000","last_change":"2023-12-19T13:59:39.718640+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718640+0000","last_undegraded":"2023-12-19T13:59:39.718640+0000","last_fullsized":"2023-12-19T13:59:39.718640+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717190+0000","last_change":"2023-12-19T13:59:39.717190+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717190+0000","last_undegraded":"2023-12-19T13:59:39.717190+0000","last_fullsized":"2023-12-19T13:59:39.717190+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.722339+0000","last_change":"2023-12-19T13:59:39.722339+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.722339+0000","last_undegraded":"2023-12-19T13:59:39.722339+0000","last_fullsized":"2023-12-19T13:59:39.722339+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:41.632120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720245+0000","last_change":"2023-12-19T13:59:39.720245+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720245+0000","last_undegraded":"2023-12-19T13:59:39.720245+0000","last_fullsized":"2023-12-19T13:59:39.720245+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:14.369247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.722791+0000","last_change":"2023-12-19T13:59:39.722791+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.722791+0000","last_undegraded":"2023-12-19T13:59:39.722791+0000","last_fullsized":"2023-12-19T13:59:39.722791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:48.297185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718521+0000","last_change":"2023-12-19T13:59:39.718521+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718521+0000","last_undegraded":"2023-12-19T13:59:39.718521+0000","last_fullsized":"2023-12-19T13:59:39.718521+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.721583+0000","last_change":"2023-12-19T13:59:39.721583+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.721583+0000","last_undegraded":"2023-12-19T13:59:39.721583+0000","last_fullsized":"2023-12-19T13:59:39.721583+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718299+0000","last_change":"2023-12-19T13:59:39.718299+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718299+0000","last_undegraded":"2023-12-19T13:59:39.718299+0000","last_fullsized":"2023-12-19T13:59:39.718299+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:23.997927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718082+0000","last_change":"2023-12-19T13:59:39.718082+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718082+0000","last_undegraded":"2023-12-19T13:59:39.718082+0000","last_fullsized":"2023-12-19T13:59:39.718082+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:54.455895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.721615+0000","last_change":"2023-12-19T13:59:39.721615+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.721615+0000","last_undegraded":"2023-12-19T13:59:39.721615+0000","last_fullsized":"2023-12-19T13:59:39.721615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717794+0000","last_change":"2023-12-19T13:59:39.717794+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717794+0000","last_undegraded":"2023-12-19T13:59:39.717794+0000","last_fullsized":"2023-12-19T13:59:39.717794+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:27.254354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.724684+0000","last_change":"2023-12-19T13:59:39.724684+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.724684+0000","last_undegraded":"2023-12-19T13:59:39.724684+0000","last_fullsized":"2023-12-19T13:59:39.724684+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:56.900887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.716990+0000","last_change":"2023-12-19T13:59:39.716990+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.716990+0000","last_undegraded":"2023-12-19T13:59:39.716990+0000","last_fullsized":"2023-12-19T13:59:39.716990+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:03:01.484380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717170+0000","last_change":"2023-12-19T13:59:39.717170+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717170+0000","last_undegraded":"2023-12-19T13:59:39.717170+0000","last_fullsized":"2023-12-19T13:59:39.717170+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:01.897389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.722866+0000","last_change":"2023-12-19T13:59:39.722866+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.722866+0000","last_undegraded":"2023-12-19T13:59:39.722866+0000","last_fullsized":"2023-12-19T13:59:39.722866+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717957+0000","last_change":"2023-12-19T13:59:39.717957+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717957+0000","last_undegraded":"2023-12-19T13:59:39.717957+0000","last_fullsized":"2023-12-19T13:59:39.717957+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:32.613084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719146+0000","last_change":"2023-12-19T13:59:39.719146+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719146+0000","last_undegraded":"2023-12-19T13:59:39.719146+0000","last_fullsized":"2023-12-19T13:59:39.719146+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:35.922857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717242+0000","last_change":"2023-12-19T13:59:39.717242+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717242+0000","last_undegraded":"2023-12-19T13:59:39.717242+0000","last_fullsized":"2023-12-19T13:59:39.717242+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:10.622788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718828+0000","last_change":"2023-12-19T13:59:39.718828+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718828+0000","last_undegraded":"2023-12-19T13:59:39.718828+0000","last_fullsized":"2023-12-19T13:59:39.718828+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:59.840480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720431+0000","last_change":"2023-12-19T13:59:39.720431+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720431+0000","last_undegraded":"2023-12-19T13:59:39.720431+0000","last_fullsized":"2023-12-19T13:59:39.720431+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719632+0000","last_change":"2023-12-19T13:59:39.719632+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719632+0000","last_undegraded":"2023-12-19T13:59:39.719632+0000","last_fullsized":"2023-12-19T13:59:39.719632+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:42.399866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720337+0000","last_change":"2023-12-19T13:59:39.720337+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720337+0000","last_undegraded":"2023-12-19T13:59:39.720337+0000","last_fullsized":"2023-12-19T13:59:39.720337+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:20.161760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719781+0000","last_change":"2023-12-19T13:59:39.719781+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719781+0000","last_undegraded":"2023-12-19T13:59:39.719781+0000","last_fullsized":"2023-12-19T13:59:39.719781+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:34:34.051846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.726100+0000","last_change":"2023-12-19T13:59:39.726100+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.726100+0000","last_undegraded":"2023-12-19T13:59:39.726100+0000","last_fullsized":"2023-12-19T13:59:39.726100+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:43.569437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717366+0000","last_change":"2023-12-19T13:59:39.717366+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717366+0000","last_undegraded":"2023-12-19T13:59:39.717366+0000","last_fullsized":"2023-12-19T13:59:39.717366+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:51.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.716993+0000","last_change":"2023-12-19T13:59:39.716993+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.716993+0000","last_undegraded":"2023-12-19T13:59:39.716993+0000","last_fullsized":"2023-12-19T13:59:39.716993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:40:10.283382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.723701+0000","last_change":"2023-12-19T13:59:39.723701+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.723701+0000","last_undegraded":"2023-12-19T13:59:39.723701+0000","last_fullsized":"2023-12-19T13:59:39.723701+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:40.342502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.723355+0000","last_change":"2023-12-19T13:59:39.723355+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.723355+0000","last_undegraded":"2023-12-19T13:59:39.723355+0000","last_fullsized":"2023-12-19T13:59:39.723355+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:24.028489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.723734+0000","last_change":"2023-12-19T13:59:39.723734+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.723734+0000","last_undegraded":"2023-12-19T13:59:39.723734+0000","last_fullsized":"2023-12-19T13:59:39.723734+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:42:17.961232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719351+0000","last_change":"2023-12-19T13:59:39.719351+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719351+0000","last_undegraded":"2023-12-19T13:59:39.719351+0000","last_fullsized":"2023-12-19T13:59:39.719351+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:05.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":328,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T13:59:37.233493+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:59:37.233493+0000","last_peered":"2023-12-19T13:59:37.233493+0000","last_clean":"2023-12-19T13:59:37.233493+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:59:37.233493+0000","last_undegraded":"2023-12-19T13:59:37.233493+0000","last_fullsized":"2023-12-19T13:59:37.233493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.131,"15min":1.077},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.53900000000000003},"max":{"1min":1.476,"5min":1.7190000000000001,"15min":1.9059999999999999},"last":1.306},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.133,"15min":1.077},"min":{"1min":0.73899999999999999,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.5189999999999999,"5min":1.855,"15min":2.008},"last":1.3480000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1559999999999999,"15min":1.133},"min":{"1min":0.73299999999999998,"5min":0.67000000000000004,"15min":0.59899999999999998},"max":{"1min":1.5620000000000001,"5min":1.865,"15min":1.865},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.1850000000000001,"15min":1.125},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.497},"max":{"1min":1.5820000000000001,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.1839999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1519999999999999,"15min":1.143},"min":{"1min":0.79000000000000004,"5min":0.76300000000000001,"15min":0.57499999999999996},"max":{"1min":1.607,"5min":1.607,"15min":2.008},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2709999999999999,"15min":1.21},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.65700000000000003},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.5149999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.294,"15min":1.232},"min":{"1min":0.95199999999999996,"5min":0.874,"15min":0.59099999999999997},"max":{"1min":1.6499999999999999,"5min":1.9359999999999999,"15min":2.2589999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.3089999999999999,"15min":1.2909999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.65200000000000002},"max":{"1min":1.5169999999999999,"5min":1.9810000000000001,"15min":3.6150000000000002},"last":1.6399999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3149999999999999,"15min":1.2929999999999999},"min":{"1min":1.006,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.6579999999999999,"5min":2.0179999999999998,"15min":2.4089999999999998},"last":1.151},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.365,"15min":1.367},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6679999999999999,"5min":1.75,"15min":2.6909999999999998},"last":1.581}]},{"osd":5,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.2410000000000001,"15min":1.25},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.472,"5min":1.819,"15min":2.3109999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4510000000000001,"15min":1.4330000000000001},"min":{"1min":1.111,"5min":0.82499999999999996,"15min":0.76500000000000001},"max":{"1min":1.712,"5min":2.097,"15min":2.7719999999999998},"last":1.2749999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.415,"15min":1.3620000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5720000000000001,"5min":1.853,"15min":2.2080000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.542,"15min":1.516},"min":{"1min":1.3380000000000001,"5min":0.95899999999999996,"15min":0.64800000000000002},"max":{"1min":1.877,"5min":2.202,"15min":2.673},"last":1.4279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1279999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.42699999999999999},"max":{"1min":1.4530000000000001,"5min":1.663,"15min":2.0640000000000001},"last":1.002},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.077,"15min":1.0960000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5,"5min":1.605,"15min":3.2069999999999999},"last":1.0880000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.0600000000000001},"min":{"1min":0.73199999999999998,"5min":0.64900000000000002,"15min":0.59099999999999997},"max":{"1min":1.6699999999999999,"5min":1.851,"15min":1.962},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.2190000000000001,"15min":1.1339999999999999},"min":{"1min":0.77400000000000002,"5min":0.74099999999999999,"15min":0.63800000000000001},"max":{"1min":1.595,"5min":1.671,"15min":1.671},"last":1.1799999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.319,"15min":1.2709999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.226},"min":{"1min":0.85899999999999999,"5min":0.70999999999999996,"15min":0.68100000000000005},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.2250000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.248,"15min":1.278},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":4.2690000000000001},"last":1.496},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2190000000000001,"15min":1.24},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.5669999999999999,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.141}]},{"osd":4,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.325,"15min":1.282},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.823,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.425},{"interface":"front","average":{"1min":1.357,"5min":1.3260000000000001,"15min":1.3280000000000001},"min":{"1min":0.67200000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3959999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2969999999999999,"15min":1.2869999999999999},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.8879999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.47,"15min":1.4239999999999999},"min":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.962,"5min":2.117,"15min":2.169},"last":1.302}]},{"osd":7,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.46,"15min":1.446},"min":{"1min":0.80100000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8919999999999999,"5min":1.9570000000000001,"15min":2.5419999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.4470000000000001,"15min":1.4139999999999999},"min":{"1min":0.89300000000000002,"5min":0.747,"15min":0.57999999999999996},"max":{"1min":1.7509999999999999,"5min":2.141,"15min":2.141},"last":1.4670000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575010,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1633,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193679,"statfs":{"total":200000000,"available":198327482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0569999999999999,"15min":1.032},"min":{"1min":0.70799999999999996,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.569,"5min":1.569,"15min":1.835},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1180000000000001,"15min":1.1259999999999999},"min":{"1min":0.878,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.8100000000000001,"5min":1.8700000000000001,"15min":5.4219999999999997},"last":1.288}]},{"osd":1,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.133},"min":{"1min":0.80100000000000005,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.5009999999999999,"5min":1.6839999999999999,"15min":6.101},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.161,"15min":1.1140000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.476,"5min":1.6439999999999999,"15min":2.077},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.196,"15min":1.224},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.72,"5min":1.8919999999999999,"15min":5.5350000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.145,"5min":1.1899999999999999,"15min":1.2330000000000001},"min":{"1min":0.91200000000000003,"5min":0.76900000000000002,"15min":0.66400000000000003},"max":{"1min":1.4990000000000001,"5min":1.6020000000000001,"15min":2.863},"last":1.252}]},{"osd":3,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.95699999999999996,"5min":0.82499999999999996,"15min":0.56000000000000005},"max":{"1min":1.5960000000000001,"5min":2.1880000000000002,"15min":5.6189999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.321,"15min":1.288},"min":{"1min":0.747,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.8360000000000001},"last":1.002}]},{"osd":4,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.272,"15min":1.2070000000000001},"min":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6439999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.042},{"interface":"front","average":{"1min":1.381,"5min":1.379,"15min":1.3500000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.798,"5min":2.0800000000000001,"15min":5.6970000000000001},"last":1.125}]},{"osd":6,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.349,"15min":1.351},"min":{"1min":0.85099999999999998,"5min":0.66300000000000003,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.919,"15min":2.0310000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.411,"15min":1.381},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6579999999999999,"5min":2.133,"15min":2.133},"last":1.181}]},{"osd":7,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.474,"15min":1.462},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.893,"5min":2.278,"15min":6.3959999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.498,"15min":1.476},"min":{"1min":1.0629999999999999,"5min":0.80200000000000005,"15min":0.71899999999999997},"max":{"1min":1.8169999999999999,"5min":1.974,"15min":2.1819999999999999},"last":1.381}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.091,"15min":1.046},"min":{"1min":0.73199999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.639,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1639999999999999,"15min":1.1259999999999999},"min":{"1min":0.79300000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.609,"5min":2.448,"15min":2.448},"last":0.84399999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.171,"15min":1.1020000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.554,"5min":1.754,"15min":1.754},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.171,"15min":1.131},"min":{"1min":0.84299999999999997,"5min":0.75,"15min":0.50700000000000001},"max":{"1min":1.486,"5min":3.117,"15min":3.117},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2290000000000001,"15min":1.127},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.629},"max":{"1min":1.6499999999999999,"5min":2.613,"15min":2.613},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.2649999999999999,"15min":1.1819999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.68000000000000005},"max":{"1min":1.7190000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.145}]},{"osd":3,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.3069999999999999,"15min":1.246},"min":{"1min":0.94899999999999995,"5min":0.72999999999999998,"15min":0.57599999999999996},"max":{"1min":1.611,"5min":2.653,"15min":2.653},"last":1.224},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3400000000000001,"15min":1.3},"min":{"1min":0.94899999999999995,"5min":0.82799999999999996,"15min":0.66500000000000004},"max":{"1min":1.8959999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.276}]},{"osd":5,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2569999999999999,"15min":1.2390000000000001},"min":{"1min":0.76500000000000001,"5min":0.58299999999999996,"15min":0.51700000000000002},"max":{"1min":1.5640000000000001,"5min":3.625,"15min":3.625},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.3620000000000001,"15min":1.3380000000000001},"min":{"1min":0.83899999999999997,"5min":0.60499999999999998,"15min":0.58399999999999996},"max":{"1min":1.821,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.4259999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4059999999999999,"15min":1.377},"min":{"1min":0.89500000000000002,"5min":0.65000000000000002,"15min":0.55900000000000005},"max":{"1min":1.9159999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.462},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.417,"15min":1.423},"min":{"1min":0.61699999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.7070000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5600000000000001,"15min":1.4990000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.925,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.546},"min":{"1min":0.98799999999999999,"5min":0.74199999999999999,"15min":0.59999999999999998},"max":{"1min":2.0390000000000001,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.7210000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.84999999999999998},"min":{"1min":0.38600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":1.429,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.89900000000000002,"15min":0.91900000000000004},"min":{"1min":0.46800000000000003,"5min":0.318,"15min":0.318},"max":{"1min":1.2829999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.363,"5min":1.413,"15min":5.3769999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96399999999999997,"15min":0.95899999999999996},"min":{"1min":0.435,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.302,"5min":1.573,"15min":2.387},"last":0.84499999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.008,"15min":1.0049999999999999},"min":{"1min":0.56000000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.046,"15min":1.0620000000000001},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.39200000000000002},"max":{"1min":1.3819999999999999,"5min":1.6319999999999999,"15min":2.657},"last":0.81000000000000005}]},{"osd":4,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2430000000000001,"15min":1.236},"min":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.48299999999999998},"max":{"1min":1.746,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":1.121},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.258,"15min":1.236},"min":{"1min":1.0469999999999999,"5min":0.626,"15min":0.54600000000000004},"max":{"1min":1.5669999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2729999999999999,"15min":1.272},"min":{"1min":0.86299999999999999,"5min":0.75700000000000001,"15min":0.58299999999999996},"max":{"1min":1.7490000000000001,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.258,"5min":1.264,"15min":1.248},"min":{"1min":0.82299999999999995,"5min":0.72599999999999998,"15min":0.66700000000000004},"max":{"1min":1.52,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.262}]},{"osd":6,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3100000000000001,"15min":1.284},"min":{"1min":1.01,"5min":0.70499999999999996,"15min":0.53300000000000003},"max":{"1min":1.6060000000000001,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.224},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.337,"15min":1.333},"min":{"1min":0.81499999999999995,"5min":0.746,"15min":0.52600000000000002},"max":{"1min":1.7250000000000001,"5min":2.077,"15min":2.698},"last":1.1739999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.355,"15min":1.341},"min":{"1min":0.753,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8320000000000001,"5min":2.1160000000000001,"15min":3.609},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.3939999999999999,"15min":1.385},"min":{"1min":0.86699999999999999,"5min":0.82099999999999995,"15min":0.58699999999999997},"max":{"1min":1.7849999999999999,"5min":1.9370000000000001,"15min":3.0379999999999998},"last":1.395}]}]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194255,"statfs":{"total":200000000,"available":198917850,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.4330000000000001,"15min":2.258},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.03,"5min":0.93999999999999995,"15min":0.90600000000000003},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":11.85},"last":0.81899999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4179999999999999,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.056,"15min":1.012},"min":{"1min":0.54300000000000004,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":1.456,"5min":4.681,"15min":11.788},"last":0.59899999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":0.97499999999999998},"min":{"1min":0.57199999999999995,"5min":0.41799999999999998,"15min":0.39300000000000002},"max":{"1min":1.262,"5min":1.702,"15min":2.3109999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.167,"5min":1.1319999999999999,"15min":1.077},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7549999999999999,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":11.930999999999999},"last":0.874},{"interface":"front","average":{"1min":1.236,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.873,"5min":0.72399999999999998,"15min":0.72299999999999998},"max":{"1min":1.7050000000000001,"5min":1.806,"15min":2.2189999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3240000000000001,"15min":1.3149999999999999},"min":{"1min":1.0109999999999999,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.6559999999999999,"5min":1.7170000000000001,"15min":11.888},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.367,"15min":1.325},"min":{"1min":1.107,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.55,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.94299999999999995}]},{"osd":6,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3440000000000001,"15min":1.3160000000000001},"min":{"1min":1.0209999999999999,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.855,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3400000000000001,"15min":1.2989999999999999},"min":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.786,"5min":1.9370000000000001,"15min":2.286},"last":1.1259999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4019999999999999,"15min":1.349},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.8089999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.425,"5min":1.3759999999999999,"15min":1.355},"min":{"1min":0.85399999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.77,"5min":2.323,"15min":11.962999999999999},"last":1.05}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1638,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193673,"statfs":{"total":200000000,"available":198321665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.46100000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.081,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.92500000000000004,"15min":0.93700000000000006},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.41499999999999998},"max":{"1min":1.3979999999999999,"5min":1.6639999999999999,"15min":3.3500000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.98399999999999999},"min":{"1min":0.47599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.4830000000000001,"15min":5.2999999999999998},"last":1.345},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0820000000000001,"15min":1.127},"min":{"1min":0.624,"5min":0.54100000000000004,"15min":0.45800000000000002},"max":{"1min":1.282,"5min":1.619,"15min":5.2009999999999996},"last":0.80200000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.018,"15min":1.0489999999999999},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.522,"5min":1.7,"15min":3.4300000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.0309999999999999,"15min":1.0760000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":1.214}]},{"osd":4,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1830000000000001,"15min":1.1879999999999999},"min":{"1min":0.73099999999999998,"5min":0.64400000000000002,"15min":0.61699999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.27,"15min":1.2749999999999999},"min":{"1min":0.84299999999999997,"5min":0.751,"15min":0.59799999999999998},"max":{"1min":1.661,"5min":1.7490000000000001,"15min":3.7080000000000002},"last":1.294}]},{"osd":5,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2270000000000001,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.554,"5min":1.796,"15min":3.8849999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2589999999999999,"15min":1.3280000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.74199999999999999},"max":{"1min":1.77,"5min":1.77,"15min":15.576000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":1.0840000000000001,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.823,"5min":1.849,"15min":4.0919999999999996},"last":1.169},{"interface":"front","average":{"1min":1.335,"5min":1.3540000000000001,"15min":1.365},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.8480000000000001,"5min":1.8720000000000001,"15min":3.786},"last":1.133}]},{"osd":7,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.3979999999999999,"15min":1.4079999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.905,"5min":1.9339999999999999,"15min":3.8159999999999998},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3420000000000001,"15min":1.375},"min":{"1min":0.89900000000000002,"5min":0.86899999999999999,"15min":0.76500000000000001},"max":{"1min":1.845,"5min":2.032,"15min":4.0519999999999996},"last":1.407}]}]},{"osd":0,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.45600000000000002,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.6399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.497,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.6140000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.92400000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.97399999999999998,"15min":1.0429999999999999},"min":{"1min":0.79500000000000004,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.492,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.0289999999999999,"15min":1.1399999999999999},"min":{"1min":0.60199999999999998,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.2869999999999999,"5min":1.708,"15min":41.758000000000003},"last":1.0229999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.95099999999999996},"min":{"1min":0.63100000000000001,"5min":0.42099999999999999,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.109,"15min":1.0920000000000001},"min":{"1min":0.80900000000000005,"5min":0.47699999999999998,"15min":0.36499999999999999},"max":{"1min":1.407,"5min":1.7210000000000001,"15min":2.02},"last":1.2589999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2050000000000001,"15min":1.1890000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.738,"5min":1.738,"15min":4.4269999999999996},"last":1.484},{"interface":"front","average":{"1min":1.306,"5min":1.2809999999999999,"15min":1.28},"min":{"1min":0.96499999999999997,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.5760000000000001,"5min":1.79,"15min":15.766},"last":1.4039999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2629999999999999,"15min":1.27},"min":{"1min":0.94199999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.26,"15min":1.262},"min":{"1min":0.77500000000000002,"5min":0.747,"15min":0.63100000000000001},"max":{"1min":1.605,"5min":1.6919999999999999,"15min":4.3970000000000002},"last":1.0620000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.391,"15min":1.3380000000000001},"min":{"1min":1.0940000000000001,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":1.6970000000000001,"5min":1.9470000000000001,"15min":5.4669999999999996},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.762,"5min":1.8939999999999999,"15min":17.161000000000001},"last":1.5109999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3759999999999999,"15min":1.3819999999999999},"min":{"1min":0.85599999999999998,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":1.655,"5min":1.974,"15min":14.381},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.3109999999999999,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":1.8759999999999999,"5min":2.1230000000000002,"15min":9.7080000000000002},"last":1.3660000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:59:46.151 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:59:46.330 INFO:tasks.ceph.mds.a.smithi113.stderr:2023-12-19T13:59:46.330+0000 7f0c97b6f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:59:46.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.405+0000 7effc5df6640 1 Processor -- start 2023-12-19T13:59:46.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.405+0000 7effc5df6640 1 -- start start 2023-12-19T13:59:46.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effc5df6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effc5df6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7effc00b0810 0x7effc006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effc5df6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc015b740 con 0x7effc00ae110 2023-12-19T13:59:46.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effc5df6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc006b8c0 con 0x7effc00b0810 2023-12-19T13:59:46.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effc5df6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc00ae640 con 0x7effc0157bf0 2023-12-19T13:59:46.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effbeffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7effc00ae110 0x7effc00b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46940/0 (socket says 172.21.15.113:46940) 2023-12-19T13:59:46.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effbeffd640 1 -- 172.21.15.113:0/257319133 learned_addr learned my addr 172.21.15.113:0/257319133 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:46.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effbf7fe640 1 --2- 172.21.15.113:0/257319133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.407+0000 7effbffff640 1 --2- 172.21.15.113:0/257319133 >> v2:172.21.15.151:3300/0 conn(0x7effc00b0810 0x7effc006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.408+0000 7effbe7fc640 1 -- 172.21.15.113:0/257319133 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287791980 0 0) 0x7effc015b740 con 0x7effc00ae110 2023-12-19T13:59:46.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.408+0000 7effbe7fc640 1 -- 172.21.15.113:0/257319133 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa8003520 con 0x7effc00ae110 2023-12-19T13:59:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.408+0000 7effbf7fe640 1 -- 172.21.15.113:0/257319133 >> v2:172.21.15.151:3300/0 conn(0x7effc00b0810 msgr2=0x7effc006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.408+0000 7effbf7fe640 1 --2- 172.21.15.113:0/257319133 >> v2:172.21.15.151:3300/0 conn(0x7effc00b0810 0x7effc006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.408+0000 7effbe7fc640 1 -- 172.21.15.113:0/257319133 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1162568163 0 0) 0x7effa8003520 con 0x7effc00ae110 2023-12-19T13:59:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.408+0000 7effbf7fe640 1 -- 172.21.15.113:0/257319133 >> v1:172.21.15.113:6789/0 conn(0x7effc00ae110 legacy=0x7effc00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.408+0000 7effbf7fe640 1 -- 172.21.15.113:0/257319133 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00ae920 con 0x7effc0157bf0 2023-12-19T13:59:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.409+0000 7effbf7fe640 1 --2- 172.21.15.113:0/257319133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc015b200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7effb00097a0 tx=0x7effb002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e928ac7937ca9b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:46.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.410+0000 7effbe7fc640 1 -- 172.21.15.113:0/257319133 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4001670 con 0x7effc0157bf0 2023-12-19T13:59:46.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.410+0000 7effbe7fc640 1 -- 172.21.15.113:0/257319133 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb002e050 con 0x7effc0157bf0 2023-12-19T13:59:46.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.410+0000 7effbe7fc640 1 -- 172.21.15.113:0/257319133 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0030730 con 0x7effc0157bf0 2023-12-19T13:59:46.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 -- 172.21.15.113:0/257319133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 msgr2=0x7effc015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 --2- 172.21.15.113:0/257319133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc015b200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7effb00097a0 tx=0x7effb002b790 comp rx=0 tx=0).stop 2023-12-19T13:59:46.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 -- 172.21.15.113:0/257319133 shutdown_connections 2023-12-19T13:59:46.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 --2- 172.21.15.113:0/257319133 >> v2:172.21.15.151:3300/0 conn(0x7effc00b0810 0x7effc006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 --2- 172.21.15.113:0/257319133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc015b200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 -- 172.21.15.113:0/257319133 >> 172.21.15.113:0/257319133 conn(0x7effc00cbb70 msgr2=0x7effc00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:46.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 -- 172.21.15.113:0/257319133 shutdown_connections 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.411+0000 7effc5df6640 1 -- 172.21.15.113:0/257319133 wait complete. 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.412+0000 7effc5df6640 1 Processor -- start 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.413+0000 7effc5df6640 1 -- start start 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effc5df6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effc00ae110 0x7effc0145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effc5df6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effc00b0810 0x7effc00acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effc5df6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc00caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effc5df6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0146080 con 0x7effc00b0810 2023-12-19T13:59:46.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effc5df6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc00ab8a0 con 0x7effc00ae110 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effc5df6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc00ab000 con 0x7effc0157bf0 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effc00b0810 0x7effc00acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effc00b0810 0x7effc00acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52084/0 (socket says 172.21.15.113:52084) 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 -- 172.21.15.113:0/912897713 learned_addr learned my addr 172.21.15.113:0/912897713 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbffff640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc00caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 -- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 msgr2=0x7effc00caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbf7fe640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effc00ae110 0x7effc0145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc00caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 -- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effc00ae110 msgr2=0x7effc0145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effc00ae110 0x7effc0145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbeffd640 1 -- 172.21.15.113:0/912897713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009400 con 0x7effc00b0810 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.414+0000 7effbf7fe640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effc00ae110 0x7effc0145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.415+0000 7effbeffd640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effc00b0810 0x7effc00acda0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7effb400c700 tx=0x7effb400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:46.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.415+0000 7effa7fff640 1 -- 172.21.15.113:0/912897713 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4005ad0 con 0x7effc00b0810 2023-12-19T13:59:46.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.415+0000 7effa7fff640 1 -- 172.21.15.113:0/912897713 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb4005c30 con 0x7effc00b0810 2023-12-19T13:59:46.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.415+0000 7effa7fff640 1 -- 172.21.15.113:0/912897713 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4007070 con 0x7effc00b0810 2023-12-19T13:59:46.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.415+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc00ab2e0 con 0x7effc00b0810 2023-12-19T13:59:46.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.415+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc00a85d0 con 0x7effc00b0810 2023-12-19T13:59:46.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.416+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc00a87f0 con 0x7effc00b0810 2023-12-19T13:59:46.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.417+0000 7effa7fff640 1 -- 172.21.15.113:0/912897713 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7effb40071d0 con 0x7effc00b0810 2023-12-19T13:59:46.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.418+0000 7effa7fff640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7effac06a430 0x7effac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.418+0000 7effa7fff640 1 -- 172.21.15.113:0/912897713 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effb40886a0 con 0x7effc00b0810 2023-12-19T13:59:46.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.418+0000 7effbf7fe640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7effac06a430 0x7effac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.419+0000 7effbf7fe640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7effac06a430 0x7effac06c8f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb002f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:46.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.422+0000 7effa7fff640 1 -- 172.21.15.113:0/912897713 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7effb40577b0 con 0x7effc00b0810 2023-12-19T13:59:46.608 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.608+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effc00aeee0 con 0x7effac06a430 2023-12-19T13:59:46.616 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.616+0000 7effa7fff640 1 -- 172.21.15.113:0/912897713 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273552 (secure 0 0 0) 0x7effb00308e0 con 0x7effac06a430 2023-12-19T13:59:46.622 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:46.624 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:59:46.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7effac06a430 msgr2=0x7effac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7effac06a430 0x7effac06c8f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb002f000 comp rx=0 tx=0).stop 2023-12-19T13:59:46.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effc00b0810 msgr2=0x7effc00acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effc00b0810 0x7effc00acda0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7effb400c700 tx=0x7effb400cbc0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 shutdown_connections 2023-12-19T13:59:46.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7effac06a430 0x7effac06c8f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effc0157bf0 0x7effc00caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effc00b0810 0x7effc00acda0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 --2- 172.21.15.113:0/912897713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effc00ae110 0x7effc0145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 >> 172.21.15.113:0/912897713 conn(0x7effc00cbb70 msgr2=0x7effc0155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:46.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 shutdown_connections 2023-12-19T13:59:46.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.621+0000 7effc5df6640 1 -- 172.21.15.113:0/912897713 wait complete. 2023-12-19T13:59:46.642 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2023-12-19T13:59:44.683694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9641,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552858,"statfs":{"total":1600000000,"available":1590127162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.968973"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.725838+0000","last_change":"2023-12-19T13:59:39.725838+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.725838+0000","last_undegraded":"2023-12-19T13:59:39.725838+0000","last_fullsized":"2023-12-19T13:59:39.725838+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:47.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720706+0000","last_change":"2023-12-19T13:59:39.720706+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720706+0000","last_undegraded":"2023-12-19T13:59:39.720706+0000","last_fullsized":"2023-12-19T13:59:39.720706+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718640+0000","last_change":"2023-12-19T13:59:39.718640+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718640+0000","last_undegraded":"2023-12-19T13:59:39.718640+0000","last_fullsized":"2023-12-19T13:59:39.718640+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717190+0000","last_change":"2023-12-19T13:59:39.717190+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717190+0000","last_undegraded":"2023-12-19T13:59:39.717190+0000","last_fullsized":"2023-12-19T13:59:39.717190+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.722339+0000","last_change":"2023-12-19T13:59:39.722339+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.722339+0000","last_undegraded":"2023-12-19T13:59:39.722339+0000","last_fullsized":"2023-12-19T13:59:39.722339+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:41.632120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720245+0000","last_change":"2023-12-19T13:59:39.720245+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720245+0000","last_undegraded":"2023-12-19T13:59:39.720245+0000","last_fullsized":"2023-12-19T13:59:39.720245+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:14.369247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.722791+0000","last_change":"2023-12-19T13:59:39.722791+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.722791+0000","last_undegraded":"2023-12-19T13:59:39.722791+0000","last_fullsized":"2023-12-19T13:59:39.722791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:48.297185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718521+0000","last_change":"2023-12-19T13:59:39.718521+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718521+0000","last_undegraded":"2023-12-19T13:59:39.718521+0000","last_fullsized":"2023-12-19T13:59:39.718521+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.721583+0000","last_change":"2023-12-19T13:59:39.721583+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.721583+0000","last_undegraded":"2023-12-19T13:59:39.721583+0000","last_fullsized":"2023-12-19T13:59:39.721583+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718299+0000","last_change":"2023-12-19T13:59:39.718299+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718299+0000","last_undegraded":"2023-12-19T13:59:39.718299+0000","last_fullsized":"2023-12-19T13:59:39.718299+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:23.997927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718082+0000","last_change":"2023-12-19T13:59:39.718082+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718082+0000","last_undegraded":"2023-12-19T13:59:39.718082+0000","last_fullsized":"2023-12-19T13:59:39.718082+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:54.455895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.721615+0000","last_change":"2023-12-19T13:59:39.721615+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.721615+0000","last_undegraded":"2023-12-19T13:59:39.721615+0000","last_fullsized":"2023-12-19T13:59:39.721615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717794+0000","last_change":"2023-12-19T13:59:39.717794+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717794+0000","last_undegraded":"2023-12-19T13:59:39.717794+0000","last_fullsized":"2023-12-19T13:59:39.717794+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:27.254354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.724684+0000","last_change":"2023-12-19T13:59:39.724684+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.724684+0000","last_undegraded":"2023-12-19T13:59:39.724684+0000","last_fullsized":"2023-12-19T13:59:39.724684+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:56.900887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.716990+0000","last_change":"2023-12-19T13:59:39.716990+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.716990+0000","last_undegraded":"2023-12-19T13:59:39.716990+0000","last_fullsized":"2023-12-19T13:59:39.716990+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:03:01.484380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717170+0000","last_change":"2023-12-19T13:59:39.717170+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717170+0000","last_undegraded":"2023-12-19T13:59:39.717170+0000","last_fullsized":"2023-12-19T13:59:39.717170+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:01.897389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.722866+0000","last_change":"2023-12-19T13:59:39.722866+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.722866+0000","last_undegraded":"2023-12-19T13:59:39.722866+0000","last_fullsized":"2023-12-19T13:59:39.722866+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717957+0000","last_change":"2023-12-19T13:59:39.717957+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717957+0000","last_undegraded":"2023-12-19T13:59:39.717957+0000","last_fullsized":"2023-12-19T13:59:39.717957+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:32.613084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719146+0000","last_change":"2023-12-19T13:59:39.719146+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719146+0000","last_undegraded":"2023-12-19T13:59:39.719146+0000","last_fullsized":"2023-12-19T13:59:39.719146+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:35.922857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717242+0000","last_change":"2023-12-19T13:59:39.717242+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717242+0000","last_undegraded":"2023-12-19T13:59:39.717242+0000","last_fullsized":"2023-12-19T13:59:39.717242+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:10.622788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.718828+0000","last_change":"2023-12-19T13:59:39.718828+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.718828+0000","last_undegraded":"2023-12-19T13:59:39.718828+0000","last_fullsized":"2023-12-19T13:59:39.718828+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:59.840480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720431+0000","last_change":"2023-12-19T13:59:39.720431+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720431+0000","last_undegraded":"2023-12-19T13:59:39.720431+0000","last_fullsized":"2023-12-19T13:59:39.720431+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719632+0000","last_change":"2023-12-19T13:59:39.719632+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719632+0000","last_undegraded":"2023-12-19T13:59:39.719632+0000","last_fullsized":"2023-12-19T13:59:39.719632+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:42.399866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.720337+0000","last_change":"2023-12-19T13:59:39.720337+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.720337+0000","last_undegraded":"2023-12-19T13:59:39.720337+0000","last_fullsized":"2023-12-19T13:59:39.720337+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:20.161760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719781+0000","last_change":"2023-12-19T13:59:39.719781+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719781+0000","last_undegraded":"2023-12-19T13:59:39.719781+0000","last_fullsized":"2023-12-19T13:59:39.719781+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:34:34.051846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.726100+0000","last_change":"2023-12-19T13:59:39.726100+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.726100+0000","last_undegraded":"2023-12-19T13:59:39.726100+0000","last_fullsized":"2023-12-19T13:59:39.726100+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:43.569437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.717366+0000","last_change":"2023-12-19T13:59:39.717366+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.717366+0000","last_undegraded":"2023-12-19T13:59:39.717366+0000","last_fullsized":"2023-12-19T13:59:39.717366+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:51.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.716993+0000","last_change":"2023-12-19T13:59:39.716993+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.716993+0000","last_undegraded":"2023-12-19T13:59:39.716993+0000","last_fullsized":"2023-12-19T13:59:39.716993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:40:10.283382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.723701+0000","last_change":"2023-12-19T13:59:39.723701+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.723701+0000","last_undegraded":"2023-12-19T13:59:39.723701+0000","last_fullsized":"2023-12-19T13:59:39.723701+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:40.342502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.723355+0000","last_change":"2023-12-19T13:59:39.723355+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.723355+0000","last_undegraded":"2023-12-19T13:59:39.723355+0000","last_fullsized":"2023-12-19T13:59:39.723355+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:24.028489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.723734+0000","last_change":"2023-12-19T13:59:39.723734+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.723734+0000","last_undegraded":"2023-12-19T13:59:39.723734+0000","last_fullsized":"2023-12-19T13:59:39.723734+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:42:17.961232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:59:40.711505+0000","last_change":"2023-12-19T13:59:40.711505+0000","last_active":"2023-12-19T13:59:40.711505+0000","last_peered":"2023-12-19T13:59:40.711505+0000","last_clean":"2023-12-19T13:59:40.711505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:40.711505+0000","last_undegraded":"2023-12-19T13:59:40.711505+0000","last_fullsized":"2023-12-19T13:59:40.711505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-12-19T13:59:39.719351+0000","last_change":"2023-12-19T13:59:39.719351+0000","last_active":"2023-12-19T13:59:39.705658+0000","last_peered":"2023-12-19T13:59:39.705658+0000","last_clean":"2023-12-19T13:59:39.705658+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:59:39.719351+0000","last_undegraded":"2023-12-19T13:59:39.719351+0000","last_fullsized":"2023-12-19T13:59:39.719351+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:05.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":328,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T13:59:37.233493+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:59:37.233493+0000","last_peered":"2023-12-19T13:59:37.233493+0000","last_clean":"2023-12-19T13:59:37.233493+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:59:37.233493+0000","last_undegraded":"2023-12-19T13:59:37.233493+0000","last_fullsized":"2023-12-19T13:59:37.233493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.131,"15min":1.077},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.53900000000000003},"max":{"1min":1.476,"5min":1.7190000000000001,"15min":1.9059999999999999},"last":1.306},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.133,"15min":1.077},"min":{"1min":0.73899999999999999,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.5189999999999999,"5min":1.855,"15min":2.008},"last":1.3480000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1559999999999999,"15min":1.133},"min":{"1min":0.73299999999999998,"5min":0.67000000000000004,"15min":0.59899999999999998},"max":{"1min":1.5620000000000001,"5min":1.865,"15min":1.865},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.1850000000000001,"15min":1.125},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.497},"max":{"1min":1.5820000000000001,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.1839999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1519999999999999,"15min":1.143},"min":{"1min":0.79000000000000004,"5min":0.76300000000000001,"15min":0.57499999999999996},"max":{"1min":1.607,"5min":1.607,"15min":2.008},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2709999999999999,"15min":1.21},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.65700000000000003},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.5149999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.294,"15min":1.232},"min":{"1min":0.95199999999999996,"5min":0.874,"15min":0.59099999999999997},"max":{"1min":1.6499999999999999,"5min":1.9359999999999999,"15min":2.2589999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.3089999999999999,"15min":1.2909999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.65200000000000002},"max":{"1min":1.5169999999999999,"5min":1.9810000000000001,"15min":3.6150000000000002},"last":1.6399999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3149999999999999,"15min":1.2929999999999999},"min":{"1min":1.006,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.6579999999999999,"5min":2.0179999999999998,"15min":2.4089999999999998},"last":1.151},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.365,"15min":1.367},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6679999999999999,"5min":1.75,"15min":2.6909999999999998},"last":1.581}]},{"osd":5,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.2410000000000001,"15min":1.25},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.472,"5min":1.819,"15min":2.3109999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4510000000000001,"15min":1.4330000000000001},"min":{"1min":1.111,"5min":0.82499999999999996,"15min":0.76500000000000001},"max":{"1min":1.712,"5min":2.097,"15min":2.7719999999999998},"last":1.2749999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.415,"15min":1.3620000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5720000000000001,"5min":1.853,"15min":2.2080000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.542,"15min":1.516},"min":{"1min":1.3380000000000001,"5min":0.95899999999999996,"15min":0.64800000000000002},"max":{"1min":1.877,"5min":2.202,"15min":2.673},"last":1.4279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1279999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.42699999999999999},"max":{"1min":1.4530000000000001,"5min":1.663,"15min":2.0640000000000001},"last":1.002},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.077,"15min":1.0960000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5,"5min":1.605,"15min":3.2069999999999999},"last":1.0880000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.0600000000000001},"min":{"1min":0.73199999999999998,"5min":0.64900000000000002,"15min":0.59099999999999997},"max":{"1min":1.6699999999999999,"5min":1.851,"15min":1.962},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.2190000000000001,"15min":1.1339999999999999},"min":{"1min":0.77400000000000002,"5min":0.74099999999999999,"15min":0.63800000000000001},"max":{"1min":1.595,"5min":1.671,"15min":1.671},"last":1.1799999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.319,"15min":1.2709999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.226},"min":{"1min":0.85899999999999999,"5min":0.70999999999999996,"15min":0.68100000000000005},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.2250000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.248,"15min":1.278},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":4.2690000000000001},"last":1.496},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2190000000000001,"15min":1.24},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.5669999999999999,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.141}]},{"osd":4,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.325,"15min":1.282},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.823,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.425},{"interface":"front","average":{"1min":1.357,"5min":1.3260000000000001,"15min":1.3280000000000001},"min":{"1min":0.67200000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3959999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2969999999999999,"15min":1.2869999999999999},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.8879999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.47,"15min":1.4239999999999999},"min":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.962,"5min":2.117,"15min":2.169},"last":1.302}]},{"osd":7,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.46,"15min":1.446},"min":{"1min":0.80100000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8919999999999999,"5min":1.9570000000000001,"15min":2.5419999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.4470000000000001,"15min":1.4139999999999999},"min":{"1min":0.89300000000000002,"5min":0.747,"15min":0.57999999999999996},"max":{"1min":1.7509999999999999,"5min":2.141,"15min":2.141},"last":1.4670000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575010,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1633,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193679,"statfs":{"total":200000000,"available":198327482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0569999999999999,"15min":1.032},"min":{"1min":0.70799999999999996,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.569,"5min":1.569,"15min":1.835},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1180000000000001,"15min":1.1259999999999999},"min":{"1min":0.878,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.8100000000000001,"5min":1.8700000000000001,"15min":5.4219999999999997},"last":1.288}]},{"osd":1,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.133},"min":{"1min":0.80100000000000005,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.5009999999999999,"5min":1.6839999999999999,"15min":6.101},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.161,"15min":1.1140000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.476,"5min":1.6439999999999999,"15min":2.077},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.196,"15min":1.224},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.72,"5min":1.8919999999999999,"15min":5.5350000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.145,"5min":1.1899999999999999,"15min":1.2330000000000001},"min":{"1min":0.91200000000000003,"5min":0.76900000000000002,"15min":0.66400000000000003},"max":{"1min":1.4990000000000001,"5min":1.6020000000000001,"15min":2.863},"last":1.252}]},{"osd":3,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.95699999999999996,"5min":0.82499999999999996,"15min":0.56000000000000005},"max":{"1min":1.5960000000000001,"5min":2.1880000000000002,"15min":5.6189999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.321,"15min":1.288},"min":{"1min":0.747,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.752,"5min":1.752,"15min":1.8360000000000001},"last":1.002}]},{"osd":4,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.272,"15min":1.2070000000000001},"min":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6439999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.042},{"interface":"front","average":{"1min":1.381,"5min":1.379,"15min":1.3500000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.798,"5min":2.0800000000000001,"15min":5.6970000000000001},"last":1.125}]},{"osd":6,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.349,"15min":1.351},"min":{"1min":0.85099999999999998,"5min":0.66300000000000003,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.919,"15min":2.0310000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.411,"15min":1.381},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6579999999999999,"5min":2.133,"15min":2.133},"last":1.181}]},{"osd":7,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.474,"15min":1.462},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.893,"5min":2.278,"15min":6.3959999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.498,"15min":1.476},"min":{"1min":1.0629999999999999,"5min":0.80200000000000005,"15min":0.71899999999999997},"max":{"1min":1.8169999999999999,"5min":1.974,"15min":2.1819999999999999},"last":1.381}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.091,"15min":1.046},"min":{"1min":0.73199999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.639,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1639999999999999,"15min":1.1259999999999999},"min":{"1min":0.79300000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.609,"5min":2.448,"15min":2.448},"last":0.84399999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.171,"15min":1.1020000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.554,"5min":1.754,"15min":1.754},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.171,"15min":1.131},"min":{"1min":0.84299999999999997,"5min":0.75,"15min":0.50700000000000001},"max":{"1min":1.486,"5min":3.117,"15min":3.117},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2290000000000001,"15min":1.127},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.629},"max":{"1min":1.6499999999999999,"5min":2.613,"15min":2.613},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.2649999999999999,"15min":1.1819999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.68000000000000005},"max":{"1min":1.7190000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.145}]},{"osd":3,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.3069999999999999,"15min":1.246},"min":{"1min":0.94899999999999995,"5min":0.72999999999999998,"15min":0.57599999999999996},"max":{"1min":1.611,"5min":2.653,"15min":2.653},"last":1.224},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3400000000000001,"15min":1.3},"min":{"1min":0.94899999999999995,"5min":0.82799999999999996,"15min":0.66500000000000004},"max":{"1min":1.8959999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.276}]},{"osd":5,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2569999999999999,"15min":1.2390000000000001},"min":{"1min":0.76500000000000001,"5min":0.58299999999999996,"15min":0.51700000000000002},"max":{"1min":1.5640000000000001,"5min":3.625,"15min":3.625},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.3620000000000001,"15min":1.3380000000000001},"min":{"1min":0.83899999999999997,"5min":0.60499999999999998,"15min":0.58399999999999996},"max":{"1min":1.821,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.4259999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4059999999999999,"15min":1.377},"min":{"1min":0.89500000000000002,"5min":0.65000000000000002,"15min":0.55900000000000005},"max":{"1min":1.9159999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.462},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.417,"15min":1.423},"min":{"1min":0.61699999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.7070000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5600000000000001,"15min":1.4990000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.925,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.546},"min":{"1min":0.98799999999999999,"5min":0.74199999999999999,"15min":0.59999999999999998},"max":{"1min":2.0390000000000001,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.7210000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.84999999999999998},"min":{"1min":0.38600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":1.429,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.89900000000000002,"15min":0.91900000000000004},"min":{"1min":0.46800000000000003,"5min":0.318,"15min":0.318},"max":{"1min":1.2829999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.363,"5min":1.413,"15min":5.3769999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96399999999999997,"15min":0.95899999999999996},"min":{"1min":0.435,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.302,"5min":1.573,"15min":2.387},"last":0.84499999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.008,"15min":1.0049999999999999},"min":{"1min":0.56000000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.046,"15min":1.0620000000000001},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.39200000000000002},"max":{"1min":1.3819999999999999,"5min":1.6319999999999999,"15min":2.657},"last":0.81000000000000005}]},{"osd":4,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2430000000000001,"15min":1.236},"min":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.48299999999999998},"max":{"1min":1.746,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":1.121},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.258,"15min":1.236},"min":{"1min":1.0469999999999999,"5min":0.626,"15min":0.54600000000000004},"max":{"1min":1.5669999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2729999999999999,"15min":1.272},"min":{"1min":0.86299999999999999,"5min":0.75700000000000001,"15min":0.58299999999999996},"max":{"1min":1.7490000000000001,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.258,"5min":1.264,"15min":1.248},"min":{"1min":0.82299999999999995,"5min":0.72599999999999998,"15min":0.66700000000000004},"max":{"1min":1.52,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.262}]},{"osd":6,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3100000000000001,"15min":1.284},"min":{"1min":1.01,"5min":0.70499999999999996,"15min":0.53300000000000003},"max":{"1min":1.6060000000000001,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.224},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.337,"15min":1.333},"min":{"1min":0.81499999999999995,"5min":0.746,"15min":0.52600000000000002},"max":{"1min":1.7250000000000001,"5min":2.077,"15min":2.698},"last":1.1739999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.355,"15min":1.341},"min":{"1min":0.753,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8320000000000001,"5min":2.1160000000000001,"15min":3.609},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.3939999999999999,"15min":1.385},"min":{"1min":0.86699999999999999,"5min":0.82099999999999995,"15min":0.58699999999999997},"max":{"1min":1.7849999999999999,"5min":1.9370000000000001,"15min":3.0379999999999998},"last":1.395}]}]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194255,"statfs":{"total":200000000,"available":198917850,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.4330000000000001,"15min":2.258},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.03,"5min":0.93999999999999995,"15min":0.90600000000000003},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":11.85},"last":0.81899999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4179999999999999,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.056,"15min":1.012},"min":{"1min":0.54300000000000004,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":1.456,"5min":4.681,"15min":11.788},"last":0.59899999999999998}]},{"osd":3,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":0.97499999999999998},"min":{"1min":0.57199999999999995,"5min":0.41799999999999998,"15min":0.39300000000000002},"max":{"1min":1.262,"5min":1.702,"15min":2.3109999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.167,"5min":1.1319999999999999,"15min":1.077},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7549999999999999,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":11.930999999999999},"last":0.874},{"interface":"front","average":{"1min":1.236,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.873,"5min":0.72399999999999998,"15min":0.72299999999999998},"max":{"1min":1.7050000000000001,"5min":1.806,"15min":2.2189999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3240000000000001,"15min":1.3149999999999999},"min":{"1min":1.0109999999999999,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.6559999999999999,"5min":1.7170000000000001,"15min":11.888},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.367,"15min":1.325},"min":{"1min":1.107,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.55,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.94299999999999995}]},{"osd":6,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3440000000000001,"15min":1.3160000000000001},"min":{"1min":1.0209999999999999,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.855,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3400000000000001,"15min":1.2989999999999999},"min":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.786,"5min":1.9370000000000001,"15min":2.286},"last":1.1259999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4019999999999999,"15min":1.349},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.8089999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.425,"5min":1.3759999999999999,"15min":1.355},"min":{"1min":0.85399999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.77,"5min":2.323,"15min":11.962999999999999},"last":1.05}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1638,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193673,"statfs":{"total":200000000,"available":198321665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.46100000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.081,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.92500000000000004,"15min":0.93700000000000006},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.41499999999999998},"max":{"1min":1.3979999999999999,"5min":1.6639999999999999,"15min":3.3500000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.98399999999999999},"min":{"1min":0.47599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.4830000000000001,"15min":5.2999999999999998},"last":1.345},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0820000000000001,"15min":1.127},"min":{"1min":0.624,"5min":0.54100000000000004,"15min":0.45800000000000002},"max":{"1min":1.282,"5min":1.619,"15min":5.2009999999999996},"last":0.80200000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.018,"15min":1.0489999999999999},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.522,"5min":1.7,"15min":3.4300000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.0309999999999999,"15min":1.0760000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":1.214}]},{"osd":4,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1830000000000001,"15min":1.1879999999999999},"min":{"1min":0.73099999999999998,"5min":0.64400000000000002,"15min":0.61699999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.27,"15min":1.2749999999999999},"min":{"1min":0.84299999999999997,"5min":0.751,"15min":0.59799999999999998},"max":{"1min":1.661,"5min":1.7490000000000001,"15min":3.7080000000000002},"last":1.294}]},{"osd":5,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2270000000000001,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.554,"5min":1.796,"15min":3.8849999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2589999999999999,"15min":1.3280000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.74199999999999999},"max":{"1min":1.77,"5min":1.77,"15min":15.576000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":1.0840000000000001,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.823,"5min":1.849,"15min":4.0919999999999996},"last":1.169},{"interface":"front","average":{"1min":1.335,"5min":1.3540000000000001,"15min":1.365},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.8480000000000001,"5min":1.8720000000000001,"15min":3.786},"last":1.133}]},{"osd":7,"last update":"Tue Dec 19 13:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.3979999999999999,"15min":1.4079999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.905,"5min":1.9339999999999999,"15min":3.8159999999999998},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3420000000000001,"15min":1.375},"min":{"1min":0.89900000000000002,"5min":0.86899999999999999,"15min":0.76500000000000001},"max":{"1min":1.845,"5min":2.032,"15min":4.0519999999999996},"last":1.407}]}]},{"osd":0,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194250,"statfs":{"total":200000000,"available":198912033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.45600000000000002,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.6399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.497,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.6140000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.92400000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.97399999999999998,"15min":1.0429999999999999},"min":{"1min":0.79500000000000004,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.492,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.0289999999999999,"15min":1.1399999999999999},"min":{"1min":0.60199999999999998,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.2869999999999999,"5min":1.708,"15min":41.758000000000003},"last":1.0229999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.95099999999999996},"min":{"1min":0.63100000000000001,"5min":0.42099999999999999,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.109,"15min":1.0920000000000001},"min":{"1min":0.80900000000000005,"5min":0.47699999999999998,"15min":0.36499999999999999},"max":{"1min":1.407,"5min":1.7210000000000001,"15min":2.02},"last":1.2589999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2050000000000001,"15min":1.1890000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.738,"5min":1.738,"15min":4.4269999999999996},"last":1.484},{"interface":"front","average":{"1min":1.306,"5min":1.2809999999999999,"15min":1.28},"min":{"1min":0.96499999999999997,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.5760000000000001,"5min":1.79,"15min":15.766},"last":1.4039999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2629999999999999,"15min":1.27},"min":{"1min":0.94199999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.26,"15min":1.262},"min":{"1min":0.77500000000000002,"5min":0.747,"15min":0.63100000000000001},"max":{"1min":1.605,"5min":1.6919999999999999,"15min":4.3970000000000002},"last":1.0620000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.391,"15min":1.3380000000000001},"min":{"1min":1.0940000000000001,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":1.6970000000000001,"5min":1.9470000000000001,"15min":5.4669999999999996},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.762,"5min":1.8939999999999999,"15min":17.161000000000001},"last":1.5109999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3759999999999999,"15min":1.3819999999999999},"min":{"1min":0.85599999999999998,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":1.655,"5min":1.974,"15min":14.381},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.3109999999999999,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":1.8759999999999999,"5min":2.1230000000000002,"15min":9.7080000000000002},"last":1.3660000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T13:59:46.646 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:59:46.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.890+0000 7f8208da4640 1 Processor -- start 2023-12-19T13:59:46.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.890+0000 7f8208da4640 1 -- start start 2023-12-19T13:59:46.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.892+0000 7f8208da4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82040d2b00 0x7f82040d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.892+0000 7f8208da4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82040ce110 0x7f82040ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.892+0000 7f8208da4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82040cd840 con 0x7f8204146e10 2023-12-19T13:59:46.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.892+0000 7f8208da4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82040d2430 con 0x7f82040ce110 2023-12-19T13:59:46.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.892+0000 7f8208da4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040ceae0 con 0x7f82040d2b00 2023-12-19T13:59:46.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f8202d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82040ce110 0x7f82040ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82040d2b00 0x7f82040d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82040d2b00 0x7f82040d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:38600/0 (socket says 172.21.15.113:38600) 2023-12-19T13:59:46.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f81fbfff640 1 -- 172.21.15.113:0/3543354101 learned_addr learned my addr 172.21.15.113:0/3543354101 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:46.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f81fbfff640 1 -- 172.21.15.113:0/3543354101 >> v2:172.21.15.151:3300/0 conn(0x7f82040ce110 msgr2=0x7f82040ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:46.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f81fbfff640 1 --2- 172.21.15.113:0/3543354101 >> v2:172.21.15.151:3300/0 conn(0x7f82040ce110 0x7f82040ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f81fbfff640 1 -- 172.21.15.113:0/3543354101 >> v1:172.21.15.151:6789/0 conn(0x7f8204146e10 legacy=0x7f82040b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.893+0000 7f81fbfff640 1 -- 172.21.15.113:0/3543354101 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040b6e90 con 0x7f82040d2b00 2023-12-19T13:59:46.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.895+0000 7f81fbfff640 1 --2- 172.21.15.113:0/3543354101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82040d2b00 0x7f82040d1ef0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4605706106156d76 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:46.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.895+0000 7f8201d9b640 1 -- 172.21.15.113:0/3543354101 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec030840 con 0x7f82040d2b00 2023-12-19T13:59:46.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.896+0000 7f8201d9b640 1 -- 172.21.15.113:0/3543354101 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec0309a0 con 0x7f82040d2b00 2023-12-19T13:59:46.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.896+0000 7f8201d9b640 1 -- 172.21.15.113:0/3543354101 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec030d30 con 0x7f82040d2b00 2023-12-19T13:59:46.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.896+0000 7f8208da4640 1 -- 172.21.15.113:0/3543354101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82040d2b00 msgr2=0x7f82040d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.896+0000 7f8208da4640 1 --2- 172.21.15.113:0/3543354101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82040d2b00 0x7f82040d1ef0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec02b980 comp rx=0 tx=0).stop 2023-12-19T13:59:46.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.897+0000 7f8208da4640 1 -- 172.21.15.113:0/3543354101 shutdown_connections 2023-12-19T13:59:46.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.897+0000 7f8208da4640 1 --2- 172.21.15.113:0/3543354101 >> v2:172.21.15.151:3300/0 conn(0x7f82040ce110 0x7f82040ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.897+0000 7f8208da4640 1 --2- 172.21.15.113:0/3543354101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82040d2b00 0x7f82040d1ef0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.897+0000 7f8208da4640 1 -- 172.21.15.113:0/3543354101 >> 172.21.15.113:0/3543354101 conn(0x7f82040b29c0 msgr2=0x7f82040b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:46.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.897+0000 7f8208da4640 1 -- 172.21.15.113:0/3543354101 shutdown_connections 2023-12-19T13:59:46.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.897+0000 7f8208da4640 1 -- 172.21.15.113:0/3543354101 wait complete. 2023-12-19T13:59:46.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.898+0000 7f8208da4640 1 Processor -- start 2023-12-19T13:59:46.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.899+0000 7f8208da4640 1 -- start start 2023-12-19T13:59:46.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8208da4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82040ce110 0x7f820413cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8208da4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82040d2b00 0x7f820413dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8208da4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8204146e10 0x7f8204159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8208da4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8204158720 con 0x7f82040d2b00 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8208da4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82041589c0 con 0x7f82040ce110 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8208da4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8204158ca0 con 0x7f8204146e10 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82040d2b00 0x7f820413dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82040d2b00 0x7f820413dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52086/0 (socket says 172.21.15.113:52086) 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 -- 172.21.15.113:0/1772830997 learned_addr learned my addr 172.21.15.113:0/1772830997 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f820259c640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82040ce110 0x7f820413cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8202d9d640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8204146e10 0x7f8204159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 -- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8204146e10 msgr2=0x7f8204159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8204146e10 0x7f8204159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 -- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82040ce110 msgr2=0x7f820413cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82040ce110 0x7f820413cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f81fbfff640 1 -- 172.21.15.113:0/1772830997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0094d0 con 0x7f82040d2b00 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.900+0000 7f8202d9d640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8204146e10 0x7f8204159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.901+0000 7f81fbfff640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82040d2b00 0x7f820413dda0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f81ec02b9c0 tx=0x7f81ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.901+0000 7f81faffd640 1 -- 172.21.15.113:0/1772830997 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec039c90 con 0x7f82040d2b00 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.901+0000 7f81faffd640 1 -- 172.21.15.113:0/1772830997 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec039e10 con 0x7f82040d2b00 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.901+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8204158f80 con 0x7f82040d2b00 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.901+0000 7f81faffd640 1 -- 172.21.15.113:0/1772830997 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec043640 con 0x7f82040d2b00 2023-12-19T13:59:46.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.901+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8204140950 con 0x7f82040d2b00 2023-12-19T13:59:46.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.902+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8204140b40 con 0x7f82040d2b00 2023-12-19T13:59:46.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.903+0000 7f81faffd640 1 -- 172.21.15.113:0/1772830997 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81ec0437a0 con 0x7f82040d2b00 2023-12-19T13:59:46.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.905+0000 7f81faffd640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f81e406a460 0x7f81e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:46.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.905+0000 7f81faffd640 1 -- 172.21.15.113:0/1772830997 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81ec03e070 con 0x7f82040d2b00 2023-12-19T13:59:46.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.905+0000 7f820259c640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f81e406a460 0x7f81e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:46.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.906+0000 7f820259c640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f81e406a460 0x7f81e406c920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000f60 tx=0x7f81f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:46.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:46.909+0000 7f81faffd640 1 -- 172.21.15.113:0/1772830997 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8204140b40 con 0x7f82040d2b00 2023-12-19T13:59:47.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.095+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82040b41c0 con 0x7f81e406a460 2023-12-19T13:59:47.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.108+0000 7f81faffd640 1 -- 172.21.15.113:0/1772830997 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282529 (secure 0 0 0) 0x7f81f4001c70 con 0x7f81e406a460 2023-12-19T13:59:47.111 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f81e406a460 msgr2=0x7f81e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f81e406a460 0x7f81e406c920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000f60 tx=0x7f81f4009040 comp rx=0 tx=0).stop 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82040d2b00 msgr2=0x7f820413dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82040d2b00 0x7f820413dda0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f81ec02b9c0 tx=0x7f81ec004730 comp rx=0 tx=0).stop 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 shutdown_connections 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f81e406a460 0x7f81e406c920 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8204146e10 0x7f8204159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82040d2b00 0x7f820413dda0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 --2- 172.21.15.113:0/1772830997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82040ce110 0x7f820413cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 >> 172.21.15.113:0/1772830997 conn(0x7f82040b29c0 msgr2=0x7f820415cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.115+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 shutdown_connections 2023-12-19T13:59:47.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.116+0000 7f8208da4640 1 -- 172.21.15.113:0/1772830997 wait complete. 2023-12-19T13:59:47.134 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2023-12-19T13:59:46.684301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552691,"statfs":{"total":1600000000,"available":1589956004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001960"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232493+0000","last_change":"2023-12-19T13:59:41.242564+0000","last_active":"2023-12-19T13:59:42.232493+0000","last_peered":"2023-12-19T13:59:42.232493+0000","last_clean":"2023-12-19T13:59:42.232493+0000","last_became_active":"2023-12-19T13:59:41.241965+0000","last_became_peered":"2023-12-19T13:59:41.241965+0000","last_unstale":"2023-12-19T13:59:42.232493+0000","last_undegraded":"2023-12-19T13:59:42.232493+0000","last_fullsized":"2023-12-19T13:59:42.232493+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:32.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231924+0000","last_change":"2023-12-19T13:59:41.242978+0000","last_active":"2023-12-19T13:59:42.231924+0000","last_peered":"2023-12-19T13:59:42.231924+0000","last_clean":"2023-12-19T13:59:42.231924+0000","last_became_active":"2023-12-19T13:59:41.241144+0000","last_became_peered":"2023-12-19T13:59:41.241144+0000","last_unstale":"2023-12-19T13:59:42.231924+0000","last_undegraded":"2023-12-19T13:59:42.231924+0000","last_fullsized":"2023-12-19T13:59:42.231924+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:19.325426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232090+0000","last_change":"2023-12-19T13:59:41.237937+0000","last_active":"2023-12-19T13:59:42.232090+0000","last_peered":"2023-12-19T13:59:42.232090+0000","last_clean":"2023-12-19T13:59:42.232090+0000","last_became_active":"2023-12-19T13:59:41.237305+0000","last_became_peered":"2023-12-19T13:59:41.237305+0000","last_unstale":"2023-12-19T13:59:42.232090+0000","last_undegraded":"2023-12-19T13:59:42.232090+0000","last_fullsized":"2023-12-19T13:59:42.232090+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.011938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135449+0000","last_change":"2023-12-19T13:59:41.247807+0000","last_active":"2023-12-19T13:59:43.135449+0000","last_peered":"2023-12-19T13:59:43.135449+0000","last_clean":"2023-12-19T13:59:43.135449+0000","last_became_active":"2023-12-19T13:59:41.247553+0000","last_became_peered":"2023-12-19T13:59:41.247553+0000","last_unstale":"2023-12-19T13:59:43.135449+0000","last_undegraded":"2023-12-19T13:59:43.135449+0000","last_fullsized":"2023-12-19T13:59:43.135449+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:28:55.166135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.230037+0000","last_change":"2023-12-19T13:59:41.241641+0000","last_active":"2023-12-19T13:59:42.230037+0000","last_peered":"2023-12-19T13:59:42.230037+0000","last_clean":"2023-12-19T13:59:42.230037+0000","last_became_active":"2023-12-19T13:59:41.241409+0000","last_became_peered":"2023-12-19T13:59:41.241409+0000","last_unstale":"2023-12-19T13:59:42.230037+0000","last_undegraded":"2023-12-19T13:59:42.230037+0000","last_fullsized":"2023-12-19T13:59:42.230037+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:09:15.894760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233092+0000","last_change":"2023-12-19T13:59:41.248482+0000","last_active":"2023-12-19T13:59:42.233092+0000","last_peered":"2023-12-19T13:59:42.233092+0000","last_clean":"2023-12-19T13:59:42.233092+0000","last_became_active":"2023-12-19T13:59:41.248082+0000","last_became_peered":"2023-12-19T13:59:41.248082+0000","last_unstale":"2023-12-19T13:59:42.233092+0000","last_undegraded":"2023-12-19T13:59:42.233092+0000","last_fullsized":"2023-12-19T13:59:42.233092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:04.846345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354326+0000","last_change":"2023-12-19T13:59:41.236767+0000","last_active":"2023-12-19T13:59:42.354326+0000","last_peered":"2023-12-19T13:59:42.354326+0000","last_clean":"2023-12-19T13:59:42.354326+0000","last_became_active":"2023-12-19T13:59:41.235106+0000","last_became_peered":"2023-12-19T13:59:41.235106+0000","last_unstale":"2023-12-19T13:59:42.354326+0000","last_undegraded":"2023-12-19T13:59:42.354326+0000","last_fullsized":"2023-12-19T13:59:42.354326+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:25.034336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134754+0000","last_change":"2023-12-19T13:59:41.238951+0000","last_active":"2023-12-19T13:59:43.134754+0000","last_peered":"2023-12-19T13:59:43.134754+0000","last_clean":"2023-12-19T13:59:43.134754+0000","last_became_active":"2023-12-19T13:59:41.238736+0000","last_became_peered":"2023-12-19T13:59:41.238736+0000","last_unstale":"2023-12-19T13:59:43.134754+0000","last_undegraded":"2023-12-19T13:59:43.134754+0000","last_fullsized":"2023-12-19T13:59:43.134754+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:00.217591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134753+0000","last_change":"2023-12-19T13:59:41.245111+0000","last_active":"2023-12-19T13:59:43.134753+0000","last_peered":"2023-12-19T13:59:43.134753+0000","last_clean":"2023-12-19T13:59:43.134753+0000","last_became_active":"2023-12-19T13:59:41.243800+0000","last_became_peered":"2023-12-19T13:59:41.243800+0000","last_unstale":"2023-12-19T13:59:43.134753+0000","last_undegraded":"2023-12-19T13:59:43.134753+0000","last_fullsized":"2023-12-19T13:59:43.134753+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134743+0000","last_change":"2023-12-19T13:59:41.242728+0000","last_active":"2023-12-19T13:59:43.134743+0000","last_peered":"2023-12-19T13:59:43.134743+0000","last_clean":"2023-12-19T13:59:43.134743+0000","last_became_active":"2023-12-19T13:59:41.242497+0000","last_became_peered":"2023-12-19T13:59:41.242497+0000","last_unstale":"2023-12-19T13:59:43.134743+0000","last_undegraded":"2023-12-19T13:59:43.134743+0000","last_fullsized":"2023-12-19T13:59:43.134743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229680+0000","last_change":"2023-12-19T13:59:41.247111+0000","last_active":"2023-12-19T13:59:42.229680+0000","last_peered":"2023-12-19T13:59:42.229680+0000","last_clean":"2023-12-19T13:59:42.229680+0000","last_became_active":"2023-12-19T13:59:41.246891+0000","last_became_peered":"2023-12-19T13:59:41.246891+0000","last_unstale":"2023-12-19T13:59:42.229680+0000","last_undegraded":"2023-12-19T13:59:42.229680+0000","last_fullsized":"2023-12-19T13:59:42.229680+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:50:48.963616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351038+0000","last_change":"2023-12-19T13:59:41.233205+0000","last_active":"2023-12-19T13:59:42.351038+0000","last_peered":"2023-12-19T13:59:42.351038+0000","last_clean":"2023-12-19T13:59:42.351038+0000","last_became_active":"2023-12-19T13:59:41.233027+0000","last_became_peered":"2023-12-19T13:59:41.233027+0000","last_unstale":"2023-12-19T13:59:42.351038+0000","last_undegraded":"2023-12-19T13:59:42.351038+0000","last_fullsized":"2023-12-19T13:59:42.351038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:47.128360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351040+0000","last_change":"2023-12-19T13:59:41.250248+0000","last_active":"2023-12-19T13:59:42.351040+0000","last_peered":"2023-12-19T13:59:42.351040+0000","last_clean":"2023-12-19T13:59:42.351040+0000","last_became_active":"2023-12-19T13:59:41.250010+0000","last_became_peered":"2023-12-19T13:59:41.250010+0000","last_unstale":"2023-12-19T13:59:42.351040+0000","last_undegraded":"2023-12-19T13:59:42.351040+0000","last_fullsized":"2023-12-19T13:59:42.351040+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:01:23.346929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135052+0000","last_change":"2023-12-19T13:59:41.241997+0000","last_active":"2023-12-19T13:59:43.135052+0000","last_peered":"2023-12-19T13:59:43.135052+0000","last_clean":"2023-12-19T13:59:43.135052+0000","last_became_active":"2023-12-19T13:59:41.241781+0000","last_became_peered":"2023-12-19T13:59:41.241781+0000","last_unstale":"2023-12-19T13:59:43.135052+0000","last_undegraded":"2023-12-19T13:59:43.135052+0000","last_fullsized":"2023-12-19T13:59:43.135052+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:26.244097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135017+0000","last_change":"2023-12-19T13:59:41.247859+0000","last_active":"2023-12-19T13:59:43.135017+0000","last_peered":"2023-12-19T13:59:43.135017+0000","last_clean":"2023-12-19T13:59:43.135017+0000","last_became_active":"2023-12-19T13:59:41.247512+0000","last_became_peered":"2023-12-19T13:59:41.247512+0000","last_unstale":"2023-12-19T13:59:43.135017+0000","last_undegraded":"2023-12-19T13:59:43.135017+0000","last_fullsized":"2023-12-19T13:59:43.135017+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354167+0000","last_change":"2023-12-19T13:59:41.233301+0000","last_active":"2023-12-19T13:59:42.354167+0000","last_peered":"2023-12-19T13:59:42.354167+0000","last_clean":"2023-12-19T13:59:42.354167+0000","last_became_active":"2023-12-19T13:59:41.232270+0000","last_became_peered":"2023-12-19T13:59:41.232270+0000","last_unstale":"2023-12-19T13:59:42.354167+0000","last_undegraded":"2023-12-19T13:59:42.354167+0000","last_fullsized":"2023-12-19T13:59:42.354167+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233862+0000","last_change":"2023-12-19T13:59:41.245683+0000","last_active":"2023-12-19T13:59:42.233862+0000","last_peered":"2023-12-19T13:59:42.233862+0000","last_clean":"2023-12-19T13:59:42.233862+0000","last_became_active":"2023-12-19T13:59:41.243550+0000","last_became_peered":"2023-12-19T13:59:41.243550+0000","last_unstale":"2023-12-19T13:59:42.233862+0000","last_undegraded":"2023-12-19T13:59:42.233862+0000","last_fullsized":"2023-12-19T13:59:42.233862+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135151+0000","last_change":"2023-12-19T13:59:41.237992+0000","last_active":"2023-12-19T13:59:43.135151+0000","last_peered":"2023-12-19T13:59:43.135151+0000","last_clean":"2023-12-19T13:59:43.135151+0000","last_became_active":"2023-12-19T13:59:41.237713+0000","last_became_peered":"2023-12-19T13:59:41.237713+0000","last_unstale":"2023-12-19T13:59:43.135151+0000","last_undegraded":"2023-12-19T13:59:43.135151+0000","last_fullsized":"2023-12-19T13:59:43.135151+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:36.573957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353790+0000","last_change":"2023-12-19T13:59:41.236497+0000","last_active":"2023-12-19T13:59:42.353790+0000","last_peered":"2023-12-19T13:59:42.353790+0000","last_clean":"2023-12-19T13:59:42.353790+0000","last_became_active":"2023-12-19T13:59:41.236253+0000","last_became_peered":"2023-12-19T13:59:41.236253+0000","last_unstale":"2023-12-19T13:59:42.353790+0000","last_undegraded":"2023-12-19T13:59:42.353790+0000","last_fullsized":"2023-12-19T13:59:42.353790+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.350981+0000","last_change":"2023-12-19T13:59:41.223055+0000","last_active":"2023-12-19T13:59:42.350981+0000","last_peered":"2023-12-19T13:59:42.350981+0000","last_clean":"2023-12-19T13:59:42.350981+0000","last_became_active":"2023-12-19T13:59:41.222909+0000","last_became_peered":"2023-12-19T13:59:41.222909+0000","last_unstale":"2023-12-19T13:59:42.350981+0000","last_undegraded":"2023-12-19T13:59:42.350981+0000","last_fullsized":"2023-12-19T13:59:42.350981+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:20.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233271+0000","last_change":"2023-12-19T13:59:41.232831+0000","last_active":"2023-12-19T13:59:42.233271+0000","last_peered":"2023-12-19T13:59:42.233271+0000","last_clean":"2023-12-19T13:59:42.233271+0000","last_became_active":"2023-12-19T13:59:41.232491+0000","last_became_peered":"2023-12-19T13:59:41.232491+0000","last_unstale":"2023-12-19T13:59:42.233271+0000","last_undegraded":"2023-12-19T13:59:42.233271+0000","last_fullsized":"2023-12-19T13:59:42.233271+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229028+0000","last_change":"2023-12-19T13:59:41.249345+0000","last_active":"2023-12-19T13:59:42.229028+0000","last_peered":"2023-12-19T13:59:42.229028+0000","last_clean":"2023-12-19T13:59:42.229028+0000","last_became_active":"2023-12-19T13:59:41.249209+0000","last_became_peered":"2023-12-19T13:59:41.249209+0000","last_unstale":"2023-12-19T13:59:42.229028+0000","last_undegraded":"2023-12-19T13:59:42.229028+0000","last_fullsized":"2023-12-19T13:59:42.229028+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:40.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352951+0000","last_change":"2023-12-19T13:59:41.249931+0000","last_active":"2023-12-19T13:59:42.352951+0000","last_peered":"2023-12-19T13:59:42.352951+0000","last_clean":"2023-12-19T13:59:42.352951+0000","last_became_active":"2023-12-19T13:59:41.248821+0000","last_became_peered":"2023-12-19T13:59:41.248821+0000","last_unstale":"2023-12-19T13:59:42.352951+0000","last_undegraded":"2023-12-19T13:59:42.352951+0000","last_fullsized":"2023-12-19T13:59:42.352951+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:42.764784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.228902+0000","last_change":"2023-12-19T13:59:41.241869+0000","last_active":"2023-12-19T13:59:42.228902+0000","last_peered":"2023-12-19T13:59:42.228902+0000","last_clean":"2023-12-19T13:59:42.228902+0000","last_became_active":"2023-12-19T13:59:41.241628+0000","last_became_peered":"2023-12-19T13:59:41.241628+0000","last_unstale":"2023-12-19T13:59:42.228902+0000","last_undegraded":"2023-12-19T13:59:42.228902+0000","last_fullsized":"2023-12-19T13:59:42.228902+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:06.319730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.230147+0000","last_change":"2023-12-19T13:59:41.235933+0000","last_active":"2023-12-19T13:59:42.230147+0000","last_peered":"2023-12-19T13:59:42.230147+0000","last_clean":"2023-12-19T13:59:42.230147+0000","last_became_active":"2023-12-19T13:59:41.235709+0000","last_became_peered":"2023-12-19T13:59:41.235709+0000","last_unstale":"2023-12-19T13:59:42.230147+0000","last_undegraded":"2023-12-19T13:59:42.230147+0000","last_fullsized":"2023-12-19T13:59:42.230147+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:17.967495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353278+0000","last_change":"2023-12-19T13:59:41.246586+0000","last_active":"2023-12-19T13:59:42.353278+0000","last_peered":"2023-12-19T13:59:42.353278+0000","last_clean":"2023-12-19T13:59:42.353278+0000","last_became_active":"2023-12-19T13:59:41.246110+0000","last_became_peered":"2023-12-19T13:59:41.246110+0000","last_unstale":"2023-12-19T13:59:42.353278+0000","last_undegraded":"2023-12-19T13:59:42.353278+0000","last_fullsized":"2023-12-19T13:59:42.353278+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:23.752394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229265+0000","last_change":"2023-12-19T13:59:41.231910+0000","last_active":"2023-12-19T13:59:42.229265+0000","last_peered":"2023-12-19T13:59:42.229265+0000","last_clean":"2023-12-19T13:59:42.229265+0000","last_became_active":"2023-12-19T13:59:41.231746+0000","last_became_peered":"2023-12-19T13:59:41.231746+0000","last_unstale":"2023-12-19T13:59:42.229265+0000","last_undegraded":"2023-12-19T13:59:42.229265+0000","last_fullsized":"2023-12-19T13:59:42.229265+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:22.296457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353191+0000","last_change":"2023-12-19T13:59:41.237305+0000","last_active":"2023-12-19T13:59:42.353191+0000","last_peered":"2023-12-19T13:59:42.353191+0000","last_clean":"2023-12-19T13:59:42.353191+0000","last_became_active":"2023-12-19T13:59:41.237047+0000","last_became_peered":"2023-12-19T13:59:41.237047+0000","last_unstale":"2023-12-19T13:59:42.353191+0000","last_undegraded":"2023-12-19T13:59:42.353191+0000","last_fullsized":"2023-12-19T13:59:42.353191+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231961+0000","last_change":"2023-12-19T13:59:41.236965+0000","last_active":"2023-12-19T13:59:42.231961+0000","last_peered":"2023-12-19T13:59:42.231961+0000","last_clean":"2023-12-19T13:59:42.231961+0000","last_became_active":"2023-12-19T13:59:41.236731+0000","last_became_peered":"2023-12-19T13:59:41.236731+0000","last_unstale":"2023-12-19T13:59:42.231961+0000","last_undegraded":"2023-12-19T13:59:42.231961+0000","last_fullsized":"2023-12-19T13:59:42.231961+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:23.156246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135165+0000","last_change":"2023-12-19T13:59:41.233678+0000","last_active":"2023-12-19T13:59:43.135165+0000","last_peered":"2023-12-19T13:59:43.135165+0000","last_clean":"2023-12-19T13:59:43.135165+0000","last_became_active":"2023-12-19T13:59:41.233416+0000","last_became_peered":"2023-12-19T13:59:41.233416+0000","last_unstale":"2023-12-19T13:59:43.135165+0000","last_undegraded":"2023-12-19T13:59:43.135165+0000","last_fullsized":"2023-12-19T13:59:43.135165+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232761+0000","last_change":"2023-12-19T13:59:41.242694+0000","last_active":"2023-12-19T13:59:42.232761+0000","last_peered":"2023-12-19T13:59:42.232761+0000","last_clean":"2023-12-19T13:59:42.232761+0000","last_became_active":"2023-12-19T13:59:41.242235+0000","last_became_peered":"2023-12-19T13:59:41.242235+0000","last_unstale":"2023-12-19T13:59:42.232761+0000","last_undegraded":"2023-12-19T13:59:42.232761+0000","last_fullsized":"2023-12-19T13:59:42.232761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:23.752394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232826+0000","last_change":"2023-12-19T13:59:41.246013+0000","last_active":"2023-12-19T13:59:42.232826+0000","last_peered":"2023-12-19T13:59:42.232826+0000","last_clean":"2023-12-19T13:59:42.232826+0000","last_became_active":"2023-12-19T13:59:41.244697+0000","last_became_peered":"2023-12-19T13:59:41.244697+0000","last_unstale":"2023-12-19T13:59:42.232826+0000","last_undegraded":"2023-12-19T13:59:42.232826+0000","last_fullsized":"2023-12-19T13:59:42.232826+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135768+0000","last_change":"2023-12-19T13:59:41.250162+0000","last_active":"2023-12-19T13:59:43.135768+0000","last_peered":"2023-12-19T13:59:43.135768+0000","last_clean":"2023-12-19T13:59:43.135768+0000","last_became_active":"2023-12-19T13:59:41.249030+0000","last_became_peered":"2023-12-19T13:59:41.249030+0000","last_unstale":"2023-12-19T13:59:43.135768+0000","last_undegraded":"2023-12-19T13:59:43.135768+0000","last_fullsized":"2023-12-19T13:59:43.135768+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:51.041386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"195'4","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.248517+0000","last_change":"2023-12-19T13:59:40.757724+0000","last_active":"2023-12-19T13:59:41.248517+0000","last_peered":"2023-12-19T13:59:41.248517+0000","last_clean":"2023-12-19T13:59:41.248517+0000","last_became_active":"2023-12-19T13:59:40.757462+0000","last_became_peered":"2023-12-19T13:59:40.757462+0000","last_unstale":"2023-12-19T13:59:41.248517+0000","last_undegraded":"2023-12-19T13:59:41.248517+0000","last_fullsized":"2023-12-19T13:59:41.248517+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:47.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231967+0000","last_change":"2023-12-19T13:59:41.249661+0000","last_active":"2023-12-19T13:59:42.231967+0000","last_peered":"2023-12-19T13:59:42.231967+0000","last_clean":"2023-12-19T13:59:42.231967+0000","last_became_active":"2023-12-19T13:59:41.249501+0000","last_became_peered":"2023-12-19T13:59:41.249501+0000","last_unstale":"2023-12-19T13:59:42.231967+0000","last_undegraded":"2023-12-19T13:59:42.231967+0000","last_fullsized":"2023-12-19T13:59:42.231967+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:51.275689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.240163+0000","last_change":"2023-12-19T13:59:40.739255+0000","last_active":"2023-12-19T13:59:41.240163+0000","last_peered":"2023-12-19T13:59:41.240163+0000","last_clean":"2023-12-19T13:59:41.240163+0000","last_became_active":"2023-12-19T13:59:40.738115+0000","last_became_peered":"2023-12-19T13:59:40.738115+0000","last_unstale":"2023-12-19T13:59:41.240163+0000","last_undegraded":"2023-12-19T13:59:41.240163+0000","last_fullsized":"2023-12-19T13:59:41.240163+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233406+0000","last_change":"2023-12-19T13:59:41.238418+0000","last_active":"2023-12-19T13:59:42.233406+0000","last_peered":"2023-12-19T13:59:42.233406+0000","last_clean":"2023-12-19T13:59:42.233406+0000","last_became_active":"2023-12-19T13:59:41.236352+0000","last_became_peered":"2023-12-19T13:59:41.236352+0000","last_unstale":"2023-12-19T13:59:42.233406+0000","last_undegraded":"2023-12-19T13:59:42.233406+0000","last_fullsized":"2023-12-19T13:59:42.233406+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:11.628635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.238791+0000","last_change":"2023-12-19T13:59:40.751638+0000","last_active":"2023-12-19T13:59:41.238791+0000","last_peered":"2023-12-19T13:59:41.238791+0000","last_clean":"2023-12-19T13:59:41.238791+0000","last_became_active":"2023-12-19T13:59:40.751276+0000","last_became_peered":"2023-12-19T13:59:40.751276+0000","last_unstale":"2023-12-19T13:59:41.238791+0000","last_undegraded":"2023-12-19T13:59:41.238791+0000","last_fullsized":"2023-12-19T13:59:41.238791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135296+0000","last_change":"2023-12-19T13:59:41.247725+0000","last_active":"2023-12-19T13:59:43.135296+0000","last_peered":"2023-12-19T13:59:43.135296+0000","last_clean":"2023-12-19T13:59:43.135296+0000","last_became_active":"2023-12-19T13:59:41.247225+0000","last_became_peered":"2023-12-19T13:59:41.247225+0000","last_unstale":"2023-12-19T13:59:43.135296+0000","last_undegraded":"2023-12-19T13:59:43.135296+0000","last_fullsized":"2023-12-19T13:59:43.135296+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.249416+0000","last_change":"2023-12-19T13:59:40.756112+0000","last_active":"2023-12-19T13:59:41.249416+0000","last_peered":"2023-12-19T13:59:41.249416+0000","last_clean":"2023-12-19T13:59:41.249416+0000","last_became_active":"2023-12-19T13:59:40.754231+0000","last_became_peered":"2023-12-19T13:59:40.754231+0000","last_unstale":"2023-12-19T13:59:41.249416+0000","last_undegraded":"2023-12-19T13:59:41.249416+0000","last_fullsized":"2023-12-19T13:59:41.249416+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135345+0000","last_change":"2023-12-19T13:59:41.250665+0000","last_active":"2023-12-19T13:59:43.135345+0000","last_peered":"2023-12-19T13:59:43.135345+0000","last_clean":"2023-12-19T13:59:43.135345+0000","last_became_active":"2023-12-19T13:59:41.250399+0000","last_became_peered":"2023-12-19T13:59:41.250399+0000","last_unstale":"2023-12-19T13:59:43.135345+0000","last_undegraded":"2023-12-19T13:59:43.135345+0000","last_fullsized":"2023-12-19T13:59:43.135345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:42.764784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.240895+0000","last_change":"2023-12-19T13:59:40.752503+0000","last_active":"2023-12-19T13:59:41.240895+0000","last_peered":"2023-12-19T13:59:41.240895+0000","last_clean":"2023-12-19T13:59:41.240895+0000","last_became_active":"2023-12-19T13:59:40.752267+0000","last_became_peered":"2023-12-19T13:59:40.752267+0000","last_unstale":"2023-12-19T13:59:41.240895+0000","last_undegraded":"2023-12-19T13:59:41.240895+0000","last_fullsized":"2023-12-19T13:59:41.240895+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:41.632120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233107+0000","last_change":"2023-12-19T13:59:41.246159+0000","last_active":"2023-12-19T13:59:42.233107+0000","last_peered":"2023-12-19T13:59:42.233107+0000","last_clean":"2023-12-19T13:59:42.233107+0000","last_became_active":"2023-12-19T13:59:41.244984+0000","last_became_peered":"2023-12-19T13:59:41.244984+0000","last_unstale":"2023-12-19T13:59:42.233107+0000","last_undegraded":"2023-12-19T13:59:42.233107+0000","last_fullsized":"2023-12-19T13:59:42.233107+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.244900+0000","last_change":"2023-12-19T13:59:40.757849+0000","last_active":"2023-12-19T13:59:41.244900+0000","last_peered":"2023-12-19T13:59:41.244900+0000","last_clean":"2023-12-19T13:59:41.244900+0000","last_became_active":"2023-12-19T13:59:40.756277+0000","last_became_peered":"2023-12-19T13:59:40.756277+0000","last_unstale":"2023-12-19T13:59:41.244900+0000","last_undegraded":"2023-12-19T13:59:41.244900+0000","last_fullsized":"2023-12-19T13:59:41.244900+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:14.369247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353902+0000","last_change":"2023-12-19T13:59:41.246566+0000","last_active":"2023-12-19T13:59:42.353902+0000","last_peered":"2023-12-19T13:59:42.353902+0000","last_clean":"2023-12-19T13:59:42.353902+0000","last_became_active":"2023-12-19T13:59:41.245863+0000","last_became_peered":"2023-12-19T13:59:41.245863+0000","last_unstale":"2023-12-19T13:59:42.353902+0000","last_undegraded":"2023-12-19T13:59:42.353902+0000","last_fullsized":"2023-12-19T13:59:42.353902+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:39.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228832+0000","last_change":"2023-12-19T13:59:40.754966+0000","last_active":"2023-12-19T13:59:41.228832+0000","last_peered":"2023-12-19T13:59:41.228832+0000","last_clean":"2023-12-19T13:59:41.228832+0000","last_became_active":"2023-12-19T13:59:40.754540+0000","last_became_peered":"2023-12-19T13:59:40.754540+0000","last_unstale":"2023-12-19T13:59:41.228832+0000","last_undegraded":"2023-12-19T13:59:41.228832+0000","last_fullsized":"2023-12-19T13:59:41.228832+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:48.297185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136021+0000","last_change":"2023-12-19T13:59:41.250368+0000","last_active":"2023-12-19T13:59:43.136021+0000","last_peered":"2023-12-19T13:59:43.136021+0000","last_clean":"2023-12-19T13:59:43.136021+0000","last_became_active":"2023-12-19T13:59:41.249893+0000","last_became_peered":"2023-12-19T13:59:41.249893+0000","last_unstale":"2023-12-19T13:59:43.136021+0000","last_undegraded":"2023-12-19T13:59:43.136021+0000","last_fullsized":"2023-12-19T13:59:43.136021+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:51.302356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.234857+0000","last_change":"2023-12-19T13:59:40.758803+0000","last_active":"2023-12-19T13:59:41.234857+0000","last_peered":"2023-12-19T13:59:41.234857+0000","last_clean":"2023-12-19T13:59:41.234857+0000","last_became_active":"2023-12-19T13:59:40.758490+0000","last_became_peered":"2023-12-19T13:59:40.758490+0000","last_unstale":"2023-12-19T13:59:41.234857+0000","last_undegraded":"2023-12-19T13:59:41.234857+0000","last_fullsized":"2023-12-19T13:59:41.234857+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354421+0000","last_change":"2023-12-19T13:59:41.240770+0000","last_active":"2023-12-19T13:59:42.354421+0000","last_peered":"2023-12-19T13:59:42.354421+0000","last_clean":"2023-12-19T13:59:42.354421+0000","last_became_active":"2023-12-19T13:59:41.240398+0000","last_became_peered":"2023-12-19T13:59:41.240398+0000","last_unstale":"2023-12-19T13:59:42.354421+0000","last_undegraded":"2023-12-19T13:59:42.354421+0000","last_fullsized":"2023-12-19T13:59:42.354421+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.236681+0000","last_change":"2023-12-19T13:59:40.754706+0000","last_active":"2023-12-19T13:59:41.236681+0000","last_peered":"2023-12-19T13:59:41.236681+0000","last_clean":"2023-12-19T13:59:41.236681+0000","last_became_active":"2023-12-19T13:59:40.754288+0000","last_became_peered":"2023-12-19T13:59:40.754288+0000","last_unstale":"2023-12-19T13:59:41.236681+0000","last_undegraded":"2023-12-19T13:59:41.236681+0000","last_fullsized":"2023-12-19T13:59:41.236681+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352758+0000","last_change":"2023-12-19T13:59:41.240088+0000","last_active":"2023-12-19T13:59:42.352758+0000","last_peered":"2023-12-19T13:59:42.352758+0000","last_clean":"2023-12-19T13:59:42.352758+0000","last_became_active":"2023-12-19T13:59:41.239764+0000","last_became_peered":"2023-12-19T13:59:41.239764+0000","last_unstale":"2023-12-19T13:59:42.352758+0000","last_undegraded":"2023-12-19T13:59:42.352758+0000","last_fullsized":"2023-12-19T13:59:42.352758+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.252522+0000","last_change":"2023-12-19T13:59:40.758037+0000","last_active":"2023-12-19T13:59:41.252522+0000","last_peered":"2023-12-19T13:59:41.252522+0000","last_clean":"2023-12-19T13:59:41.252522+0000","last_became_active":"2023-12-19T13:59:40.757303+0000","last_became_peered":"2023-12-19T13:59:40.757303+0000","last_unstale":"2023-12-19T13:59:41.252522+0000","last_undegraded":"2023-12-19T13:59:41.252522+0000","last_fullsized":"2023-12-19T13:59:41.252522+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:23.997927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232033+0000","last_change":"2023-12-19T13:59:41.238081+0000","last_active":"2023-12-19T13:59:42.232033+0000","last_peered":"2023-12-19T13:59:42.232033+0000","last_clean":"2023-12-19T13:59:42.232033+0000","last_became_active":"2023-12-19T13:59:41.237709+0000","last_became_peered":"2023-12-19T13:59:41.237709+0000","last_unstale":"2023-12-19T13:59:42.232033+0000","last_undegraded":"2023-12-19T13:59:42.232033+0000","last_fullsized":"2023-12-19T13:59:42.232033+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:53:40.351475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"195'6","reported_seq":17,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.245216+0000","last_change":"2023-12-19T13:59:40.750401+0000","last_active":"2023-12-19T13:59:41.245216+0000","last_peered":"2023-12-19T13:59:41.245216+0000","last_clean":"2023-12-19T13:59:41.245216+0000","last_became_active":"2023-12-19T13:59:40.750050+0000","last_became_peered":"2023-12-19T13:59:40.750050+0000","last_unstale":"2023-12-19T13:59:41.245216+0000","last_undegraded":"2023-12-19T13:59:41.245216+0000","last_fullsized":"2023-12-19T13:59:41.245216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:54.455895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354682+0000","last_change":"2023-12-19T13:59:41.232936+0000","last_active":"2023-12-19T13:59:42.354682+0000","last_peered":"2023-12-19T13:59:42.354682+0000","last_clean":"2023-12-19T13:59:42.354682+0000","last_became_active":"2023-12-19T13:59:41.231124+0000","last_became_peered":"2023-12-19T13:59:41.231124+0000","last_unstale":"2023-12-19T13:59:42.354682+0000","last_undegraded":"2023-12-19T13:59:42.354682+0000","last_fullsized":"2023-12-19T13:59:42.354682+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:26.244097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.241380+0000","last_change":"2023-12-19T13:59:40.753740+0000","last_active":"2023-12-19T13:59:41.241380+0000","last_peered":"2023-12-19T13:59:41.241380+0000","last_clean":"2023-12-19T13:59:41.241380+0000","last_became_active":"2023-12-19T13:59:40.753400+0000","last_became_peered":"2023-12-19T13:59:40.753400+0000","last_unstale":"2023-12-19T13:59:41.241380+0000","last_undegraded":"2023-12-19T13:59:41.241380+0000","last_fullsized":"2023-12-19T13:59:41.241380+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354038+0000","last_change":"2023-12-19T13:59:41.246381+0000","last_active":"2023-12-19T13:59:42.354038+0000","last_peered":"2023-12-19T13:59:42.354038+0000","last_clean":"2023-12-19T13:59:42.354038+0000","last_became_active":"2023-12-19T13:59:41.245531+0000","last_became_peered":"2023-12-19T13:59:41.245531+0000","last_unstale":"2023-12-19T13:59:42.354038+0000","last_undegraded":"2023-12-19T13:59:42.354038+0000","last_fullsized":"2023-12-19T13:59:42.354038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:51.275689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229294+0000","last_change":"2023-12-19T13:59:40.754054+0000","last_active":"2023-12-19T13:59:41.229294+0000","last_peered":"2023-12-19T13:59:41.229294+0000","last_clean":"2023-12-19T13:59:41.229294+0000","last_became_active":"2023-12-19T13:59:40.753792+0000","last_became_peered":"2023-12-19T13:59:40.753792+0000","last_unstale":"2023-12-19T13:59:41.229294+0000","last_undegraded":"2023-12-19T13:59:41.229294+0000","last_fullsized":"2023-12-19T13:59:41.229294+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:27.254354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233120+0000","last_change":"2023-12-19T13:59:41.243143+0000","last_active":"2023-12-19T13:59:42.233120+0000","last_peered":"2023-12-19T13:59:42.233120+0000","last_clean":"2023-12-19T13:59:42.233120+0000","last_became_active":"2023-12-19T13:59:41.242704+0000","last_became_peered":"2023-12-19T13:59:41.242704+0000","last_unstale":"2023-12-19T13:59:42.233120+0000","last_undegraded":"2023-12-19T13:59:42.233120+0000","last_fullsized":"2023-12-19T13:59:42.233120+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229667+0000","last_change":"2023-12-19T13:59:40.755123+0000","last_active":"2023-12-19T13:59:41.229667+0000","last_peered":"2023-12-19T13:59:41.229667+0000","last_clean":"2023-12-19T13:59:41.229667+0000","last_became_active":"2023-12-19T13:59:40.751688+0000","last_became_peered":"2023-12-19T13:59:40.751688+0000","last_unstale":"2023-12-19T13:59:41.229667+0000","last_undegraded":"2023-12-19T13:59:41.229667+0000","last_fullsized":"2023-12-19T13:59:41.229667+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:56.900887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135237+0000","last_change":"2023-12-19T13:59:41.240461+0000","last_active":"2023-12-19T13:59:43.135237+0000","last_peered":"2023-12-19T13:59:43.135237+0000","last_clean":"2023-12-19T13:59:43.135237+0000","last_became_active":"2023-12-19T13:59:41.240163+0000","last_became_peered":"2023-12-19T13:59:41.240163+0000","last_unstale":"2023-12-19T13:59:43.135237+0000","last_undegraded":"2023-12-19T13:59:43.135237+0000","last_fullsized":"2023-12-19T13:59:43.135237+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"195'8","reported_seq":19,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.233844+0000","last_change":"2023-12-19T13:59:40.755661+0000","last_active":"2023-12-19T13:59:41.233844+0000","last_peered":"2023-12-19T13:59:41.233844+0000","last_clean":"2023-12-19T13:59:41.233844+0000","last_became_active":"2023-12-19T13:59:40.755379+0000","last_became_peered":"2023-12-19T13:59:40.755379+0000","last_unstale":"2023-12-19T13:59:41.233844+0000","last_undegraded":"2023-12-19T13:59:41.233844+0000","last_fullsized":"2023-12-19T13:59:41.233844+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:03:01.484380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353930+0000","last_change":"2023-12-19T13:59:41.250060+0000","last_active":"2023-12-19T13:59:42.353930+0000","last_peered":"2023-12-19T13:59:42.353930+0000","last_clean":"2023-12-19T13:59:42.353930+0000","last_became_active":"2023-12-19T13:59:41.249203+0000","last_became_peered":"2023-12-19T13:59:41.249203+0000","last_unstale":"2023-12-19T13:59:42.353930+0000","last_undegraded":"2023-12-19T13:59:42.353930+0000","last_fullsized":"2023-12-19T13:59:42.353930+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.231326+0000","last_change":"2023-12-19T13:59:40.751375+0000","last_active":"2023-12-19T13:59:41.231326+0000","last_peered":"2023-12-19T13:59:41.231326+0000","last_clean":"2023-12-19T13:59:41.231326+0000","last_became_active":"2023-12-19T13:59:40.751136+0000","last_became_peered":"2023-12-19T13:59:40.751136+0000","last_unstale":"2023-12-19T13:59:41.231326+0000","last_undegraded":"2023-12-19T13:59:41.231326+0000","last_fullsized":"2023-12-19T13:59:41.231326+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:01.897389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136255+0000","last_change":"2023-12-19T13:59:41.237066+0000","last_active":"2023-12-19T13:59:43.136255+0000","last_peered":"2023-12-19T13:59:43.136255+0000","last_clean":"2023-12-19T13:59:43.136255+0000","last_became_active":"2023-12-19T13:59:41.236720+0000","last_became_peered":"2023-12-19T13:59:41.236720+0000","last_unstale":"2023-12-19T13:59:43.136255+0000","last_undegraded":"2023-12-19T13:59:43.136255+0000","last_fullsized":"2023-12-19T13:59:43.136255+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:39.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.242274+0000","last_change":"2023-12-19T13:59:40.742871+0000","last_active":"2023-12-19T13:59:41.242274+0000","last_peered":"2023-12-19T13:59:41.242274+0000","last_clean":"2023-12-19T13:59:41.242274+0000","last_became_active":"2023-12-19T13:59:40.739429+0000","last_became_peered":"2023-12-19T13:59:40.739429+0000","last_unstale":"2023-12-19T13:59:41.242274+0000","last_undegraded":"2023-12-19T13:59:41.242274+0000","last_fullsized":"2023-12-19T13:59:41.242274+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135773+0000","last_change":"2023-12-19T13:59:41.248711+0000","last_active":"2023-12-19T13:59:43.135773+0000","last_peered":"2023-12-19T13:59:43.135773+0000","last_clean":"2023-12-19T13:59:43.135773+0000","last_became_active":"2023-12-19T13:59:41.248451+0000","last_became_peered":"2023-12-19T13:59:41.248451+0000","last_unstale":"2023-12-19T13:59:43.135773+0000","last_undegraded":"2023-12-19T13:59:43.135773+0000","last_fullsized":"2023-12-19T13:59:43.135773+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:24.303264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.241056+0000","last_change":"2023-12-19T13:59:40.752367+0000","last_active":"2023-12-19T13:59:41.241056+0000","last_peered":"2023-12-19T13:59:41.241056+0000","last_clean":"2023-12-19T13:59:41.241056+0000","last_became_active":"2023-12-19T13:59:40.752125+0000","last_became_peered":"2023-12-19T13:59:40.752125+0000","last_unstale":"2023-12-19T13:59:41.241056+0000","last_undegraded":"2023-12-19T13:59:41.241056+0000","last_fullsized":"2023-12-19T13:59:41.241056+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:32.613084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352855+0000","last_change":"2023-12-19T13:59:41.247167+0000","last_active":"2023-12-19T13:59:42.352855+0000","last_peered":"2023-12-19T13:59:42.352855+0000","last_clean":"2023-12-19T13:59:42.352855+0000","last_became_active":"2023-12-19T13:59:41.246824+0000","last_became_peered":"2023-12-19T13:59:41.246824+0000","last_unstale":"2023-12-19T13:59:42.352855+0000","last_undegraded":"2023-12-19T13:59:42.352855+0000","last_fullsized":"2023-12-19T13:59:42.352855+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218993+0000","last_change":"2023-12-19T13:59:40.754731+0000","last_active":"2023-12-19T13:59:41.218993+0000","last_peered":"2023-12-19T13:59:41.218993+0000","last_clean":"2023-12-19T13:59:41.218993+0000","last_became_active":"2023-12-19T13:59:40.750725+0000","last_became_peered":"2023-12-19T13:59:40.750725+0000","last_unstale":"2023-12-19T13:59:41.218993+0000","last_undegraded":"2023-12-19T13:59:41.218993+0000","last_fullsized":"2023-12-19T13:59:41.218993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:35.922857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232092+0000","last_change":"2023-12-19T13:59:41.242805+0000","last_active":"2023-12-19T13:59:42.232092+0000","last_peered":"2023-12-19T13:59:42.232092+0000","last_clean":"2023-12-19T13:59:42.232092+0000","last_became_active":"2023-12-19T13:59:41.242397+0000","last_became_peered":"2023-12-19T13:59:41.242397+0000","last_unstale":"2023-12-19T13:59:42.232092+0000","last_undegraded":"2023-12-19T13:59:42.232092+0000","last_fullsized":"2023-12-19T13:59:42.232092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:55:10.819607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.252682+0000","last_change":"2023-12-19T13:59:40.756603+0000","last_active":"2023-12-19T13:59:41.252682+0000","last_peered":"2023-12-19T13:59:41.252682+0000","last_clean":"2023-12-19T13:59:41.252682+0000","last_became_active":"2023-12-19T13:59:40.754960+0000","last_became_peered":"2023-12-19T13:59:40.754960+0000","last_unstale":"2023-12-19T13:59:41.252682+0000","last_undegraded":"2023-12-19T13:59:41.252682+0000","last_fullsized":"2023-12-19T13:59:41.252682+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:10.622788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353206+0000","last_change":"2023-12-19T13:59:41.250110+0000","last_active":"2023-12-19T13:59:42.353206+0000","last_peered":"2023-12-19T13:59:42.353206+0000","last_clean":"2023-12-19T13:59:42.353206+0000","last_became_active":"2023-12-19T13:59:41.249509+0000","last_became_peered":"2023-12-19T13:59:41.249509+0000","last_unstale":"2023-12-19T13:59:42.353206+0000","last_undegraded":"2023-12-19T13:59:42.353206+0000","last_fullsized":"2023-12-19T13:59:42.353206+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:13.046781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218101+0000","last_change":"2023-12-19T13:59:40.743247+0000","last_active":"2023-12-19T13:59:41.218101+0000","last_peered":"2023-12-19T13:59:41.218101+0000","last_clean":"2023-12-19T13:59:41.218101+0000","last_became_active":"2023-12-19T13:59:40.742681+0000","last_became_peered":"2023-12-19T13:59:40.742681+0000","last_unstale":"2023-12-19T13:59:41.218101+0000","last_undegraded":"2023-12-19T13:59:41.218101+0000","last_fullsized":"2023-12-19T13:59:41.218101+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:59.840480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232978+0000","last_change":"2023-12-19T13:59:41.235473+0000","last_active":"2023-12-19T13:59:42.232978+0000","last_peered":"2023-12-19T13:59:42.232978+0000","last_clean":"2023-12-19T13:59:42.232978+0000","last_became_active":"2023-12-19T13:59:41.235312+0000","last_became_peered":"2023-12-19T13:59:41.235312+0000","last_unstale":"2023-12-19T13:59:42.232978+0000","last_undegraded":"2023-12-19T13:59:42.232978+0000","last_fullsized":"2023-12-19T13:59:42.232978+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:23.270911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.226262+0000","last_change":"2023-12-19T13:59:40.754422+0000","last_active":"2023-12-19T13:59:41.226262+0000","last_peered":"2023-12-19T13:59:41.226262+0000","last_clean":"2023-12-19T13:59:41.226262+0000","last_became_active":"2023-12-19T13:59:40.754095+0000","last_became_peered":"2023-12-19T13:59:40.754095+0000","last_unstale":"2023-12-19T13:59:41.226262+0000","last_undegraded":"2023-12-19T13:59:41.226262+0000","last_fullsized":"2023-12-19T13:59:41.226262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354177+0000","last_change":"2023-12-19T13:59:41.229774+0000","last_active":"2023-12-19T13:59:42.354177+0000","last_peered":"2023-12-19T13:59:42.354177+0000","last_clean":"2023-12-19T13:59:42.354177+0000","last_became_active":"2023-12-19T13:59:41.229064+0000","last_became_peered":"2023-12-19T13:59:41.229064+0000","last_unstale":"2023-12-19T13:59:42.354177+0000","last_undegraded":"2023-12-19T13:59:42.354177+0000","last_fullsized":"2023-12-19T13:59:42.354177+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:48.988107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218208+0000","last_change":"2023-12-19T13:59:40.737867+0000","last_active":"2023-12-19T13:59:41.218208+0000","last_peered":"2023-12-19T13:59:41.218208+0000","last_clean":"2023-12-19T13:59:41.218208+0000","last_became_active":"2023-12-19T13:59:40.737071+0000","last_became_peered":"2023-12-19T13:59:40.737071+0000","last_unstale":"2023-12-19T13:59:41.218208+0000","last_undegraded":"2023-12-19T13:59:41.218208+0000","last_fullsized":"2023-12-19T13:59:41.218208+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:42.399866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353497+0000","last_change":"2023-12-19T13:59:41.249766+0000","last_active":"2023-12-19T13:59:42.353497+0000","last_peered":"2023-12-19T13:59:42.353497+0000","last_clean":"2023-12-19T13:59:42.353497+0000","last_became_active":"2023-12-19T13:59:41.247736+0000","last_became_peered":"2023-12-19T13:59:41.247736+0000","last_unstale":"2023-12-19T13:59:42.353497+0000","last_undegraded":"2023-12-19T13:59:42.353497+0000","last_fullsized":"2023-12-19T13:59:42.353497+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:32.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.245837+0000","last_change":"2023-12-19T13:59:40.749251+0000","last_active":"2023-12-19T13:59:41.245837+0000","last_peered":"2023-12-19T13:59:41.245837+0000","last_clean":"2023-12-19T13:59:41.245837+0000","last_became_active":"2023-12-19T13:59:40.748175+0000","last_became_peered":"2023-12-19T13:59:40.748175+0000","last_unstale":"2023-12-19T13:59:41.245837+0000","last_undegraded":"2023-12-19T13:59:41.245837+0000","last_fullsized":"2023-12-19T13:59:41.245837+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:20.161760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136152+0000","last_change":"2023-12-19T13:59:41.242349+0000","last_active":"2023-12-19T13:59:43.136152+0000","last_peered":"2023-12-19T13:59:43.136152+0000","last_clean":"2023-12-19T13:59:43.136152+0000","last_became_active":"2023-12-19T13:59:41.241320+0000","last_became_peered":"2023-12-19T13:59:41.241320+0000","last_unstale":"2023-12-19T13:59:43.136152+0000","last_undegraded":"2023-12-19T13:59:43.136152+0000","last_fullsized":"2023-12-19T13:59:43.136152+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:43.809350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"196'1","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351249+0000","last_change":"2023-12-19T13:59:40.754238+0000","last_active":"2023-12-19T13:59:42.351249+0000","last_peered":"2023-12-19T13:59:42.351249+0000","last_clean":"2023-12-19T13:59:42.351249+0000","last_became_active":"2023-12-19T13:59:40.754008+0000","last_became_peered":"2023-12-19T13:59:40.754008+0000","last_unstale":"2023-12-19T13:59:42.351249+0000","last_undegraded":"2023-12-19T13:59:42.351249+0000","last_fullsized":"2023-12-19T13:59:42.351249+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:34:34.051846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135613+0000","last_change":"2023-12-19T13:59:41.238293+0000","last_active":"2023-12-19T13:59:43.135613+0000","last_peered":"2023-12-19T13:59:43.135613+0000","last_clean":"2023-12-19T13:59:43.135613+0000","last_became_active":"2023-12-19T13:59:41.237440+0000","last_became_peered":"2023-12-19T13:59:41.237440+0000","last_unstale":"2023-12-19T13:59:43.135613+0000","last_undegraded":"2023-12-19T13:59:43.135613+0000","last_fullsized":"2023-12-19T13:59:43.135613+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:13.046781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228562+0000","last_change":"2023-12-19T13:59:40.758774+0000","last_active":"2023-12-19T13:59:41.228562+0000","last_peered":"2023-12-19T13:59:41.228562+0000","last_clean":"2023-12-19T13:59:41.228562+0000","last_became_active":"2023-12-19T13:59:40.758506+0000","last_became_peered":"2023-12-19T13:59:40.758506+0000","last_unstale":"2023-12-19T13:59:41.228562+0000","last_undegraded":"2023-12-19T13:59:41.228562+0000","last_fullsized":"2023-12-19T13:59:41.228562+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:43.569437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136512+0000","last_change":"2023-12-19T13:59:41.241804+0000","last_active":"2023-12-19T13:59:43.136512+0000","last_peered":"2023-12-19T13:59:43.136512+0000","last_clean":"2023-12-19T13:59:43.136512+0000","last_became_active":"2023-12-19T13:59:41.241542+0000","last_became_peered":"2023-12-19T13:59:41.241542+0000","last_unstale":"2023-12-19T13:59:43.136512+0000","last_undegraded":"2023-12-19T13:59:43.136512+0000","last_fullsized":"2023-12-19T13:59:43.136512+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.234971+0000","last_change":"2023-12-19T13:59:40.756150+0000","last_active":"2023-12-19T13:59:41.234971+0000","last_peered":"2023-12-19T13:59:41.234971+0000","last_clean":"2023-12-19T13:59:41.234971+0000","last_became_active":"2023-12-19T13:59:40.755399+0000","last_became_peered":"2023-12-19T13:59:40.755399+0000","last_unstale":"2023-12-19T13:59:41.234971+0000","last_undegraded":"2023-12-19T13:59:41.234971+0000","last_fullsized":"2023-12-19T13:59:41.234971+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:51.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233385+0000","last_change":"2023-12-19T13:59:41.246300+0000","last_active":"2023-12-19T13:59:42.233385+0000","last_peered":"2023-12-19T13:59:42.233385+0000","last_clean":"2023-12-19T13:59:42.233385+0000","last_became_active":"2023-12-19T13:59:41.245455+0000","last_became_peered":"2023-12-19T13:59:41.245455+0000","last_unstale":"2023-12-19T13:59:42.233385+0000","last_undegraded":"2023-12-19T13:59:42.233385+0000","last_fullsized":"2023-12-19T13:59:42.233385+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222725+0000","last_change":"2023-12-19T13:59:40.756950+0000","last_active":"2023-12-19T13:59:41.222725+0000","last_peered":"2023-12-19T13:59:41.222725+0000","last_clean":"2023-12-19T13:59:41.222725+0000","last_became_active":"2023-12-19T13:59:40.756683+0000","last_became_peered":"2023-12-19T13:59:40.756683+0000","last_unstale":"2023-12-19T13:59:41.222725+0000","last_undegraded":"2023-12-19T13:59:41.222725+0000","last_fullsized":"2023-12-19T13:59:41.222725+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:40:10.283382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233194+0000","last_change":"2023-12-19T13:59:41.242433+0000","last_active":"2023-12-19T13:59:42.233194+0000","last_peered":"2023-12-19T13:59:42.233194+0000","last_clean":"2023-12-19T13:59:42.233194+0000","last_became_active":"2023-12-19T13:59:41.241707+0000","last_became_peered":"2023-12-19T13:59:41.241707+0000","last_unstale":"2023-12-19T13:59:42.233194+0000","last_undegraded":"2023-12-19T13:59:42.233194+0000","last_fullsized":"2023-12-19T13:59:42.233194+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229814+0000","last_change":"2023-12-19T13:59:40.756938+0000","last_active":"2023-12-19T13:59:41.229814+0000","last_peered":"2023-12-19T13:59:41.229814+0000","last_clean":"2023-12-19T13:59:41.229814+0000","last_became_active":"2023-12-19T13:59:40.756694+0000","last_became_peered":"2023-12-19T13:59:40.756694+0000","last_unstale":"2023-12-19T13:59:41.229814+0000","last_undegraded":"2023-12-19T13:59:41.229814+0000","last_fullsized":"2023-12-19T13:59:41.229814+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:40.342502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353025+0000","last_change":"2023-12-19T13:59:41.243143+0000","last_active":"2023-12-19T13:59:42.353025+0000","last_peered":"2023-12-19T13:59:42.353025+0000","last_clean":"2023-12-19T13:59:42.353025+0000","last_became_active":"2023-12-19T13:59:41.242300+0000","last_became_peered":"2023-12-19T13:59:41.242300+0000","last_unstale":"2023-12-19T13:59:42.353025+0000","last_undegraded":"2023-12-19T13:59:42.353025+0000","last_fullsized":"2023-12-19T13:59:42.353025+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:00.217591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.231079+0000","last_change":"2023-12-19T13:59:40.758915+0000","last_active":"2023-12-19T13:59:41.231079+0000","last_peered":"2023-12-19T13:59:41.231079+0000","last_clean":"2023-12-19T13:59:41.231079+0000","last_became_active":"2023-12-19T13:59:40.758617+0000","last_became_peered":"2023-12-19T13:59:40.758617+0000","last_unstale":"2023-12-19T13:59:41.231079+0000","last_undegraded":"2023-12-19T13:59:41.231079+0000","last_fullsized":"2023-12-19T13:59:41.231079+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:24.028489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232176+0000","last_change":"2023-12-19T13:59:41.236526+0000","last_active":"2023-12-19T13:59:42.232176+0000","last_peered":"2023-12-19T13:59:42.232176+0000","last_clean":"2023-12-19T13:59:42.232176+0000","last_became_active":"2023-12-19T13:59:41.236211+0000","last_became_peered":"2023-12-19T13:59:41.236211+0000","last_unstale":"2023-12-19T13:59:42.232176+0000","last_undegraded":"2023-12-19T13:59:42.232176+0000","last_fullsized":"2023-12-19T13:59:42.232176+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:38.840494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228711+0000","last_change":"2023-12-19T13:59:40.753470+0000","last_active":"2023-12-19T13:59:41.228711+0000","last_peered":"2023-12-19T13:59:41.228711+0000","last_clean":"2023-12-19T13:59:41.228711+0000","last_became_active":"2023-12-19T13:59:40.753203+0000","last_became_peered":"2023-12-19T13:59:40.753203+0000","last_unstale":"2023-12-19T13:59:41.228711+0000","last_undegraded":"2023-12-19T13:59:41.228711+0000","last_fullsized":"2023-12-19T13:59:41.228711+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:42:17.961232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354185+0000","last_change":"2023-12-19T13:59:41.242547+0000","last_active":"2023-12-19T13:59:42.354185+0000","last_peered":"2023-12-19T13:59:42.354185+0000","last_clean":"2023-12-19T13:59:42.354185+0000","last_became_active":"2023-12-19T13:59:41.242244+0000","last_became_peered":"2023-12-19T13:59:41.242244+0000","last_unstale":"2023-12-19T13:59:42.354185+0000","last_undegraded":"2023-12-19T13:59:42.354185+0000","last_fullsized":"2023-12-19T13:59:42.354185+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:44.575284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222524+0000","last_change":"2023-12-19T13:59:40.758615+0000","last_active":"2023-12-19T13:59:41.222524+0000","last_peered":"2023-12-19T13:59:41.222524+0000","last_clean":"2023-12-19T13:59:41.222524+0000","last_became_active":"2023-12-19T13:59:40.758214+0000","last_became_peered":"2023-12-19T13:59:40.758214+0000","last_unstale":"2023-12-19T13:59:41.222524+0000","last_undegraded":"2023-12-19T13:59:41.222524+0000","last_fullsized":"2023-12-19T13:59:41.222524+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:05.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":331,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222365+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:59:41.222365+0000","last_peered":"2023-12-19T13:59:41.222365+0000","last_clean":"2023-12-19T13:59:41.222365+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:59:41.222365+0000","last_undegraded":"2023-12-19T13:59:41.222365+0000","last_fullsized":"2023-12-19T13:59:41.222365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":1.0840000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.9059999999999999},"last":1.171},{"interface":"front","average":{"1min":1.131,"5min":1.1379999999999999,"15min":1.0880000000000001},"min":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.601,"5min":1.855,"15min":2.008},"last":1.258}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1679999999999999,"15min":1.141},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.494,"5min":1.865,"15min":1.865},"last":1.355},{"interface":"front","average":{"1min":1.198,"5min":1.175,"15min":1.1359999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.54,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.4159999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.159,"15min":1.1459999999999999},"min":{"1min":0.88900000000000001,"5min":0.77600000000000002,"15min":0.57499999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.008},"last":1.081},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2829999999999999,"15min":1.222},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7090000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.879}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2649999999999999,"15min":1.2330000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.6659999999999999,"15min":2.2589999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3240000000000001,"15min":1.3029999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":1.6319999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2949999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.702,"5min":1.702,"15min":2.4089999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.359,"15min":1.367},"min":{"1min":0.83699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.901,"5min":1.901,"15min":2.6909999999999998},"last":1.498}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.218,"15min":1.2490000000000001},"min":{"1min":0.72799999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":2.3109999999999999},"last":1.121},{"interface":"front","average":{"1min":1.375,"5min":1.4279999999999999,"15min":1.429},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6359999999999999,"5min":1.7949999999999999,"15min":2.7719999999999998},"last":1.2}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.387,"15min":1.369},"min":{"1min":0.65900000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5209999999999999,"15min":1.516},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.64800000000000002},"max":{"1min":1.833,"5min":1.9390000000000001,"15min":2.673},"last":1.462}]}]},{"osd":6,"up_from":13,"seq":55834575011,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1279999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.42699999999999999},"max":{"1min":1.4530000000000001,"5min":1.663,"15min":2.0640000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.077,"15min":1.0960000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5,"5min":1.605,"15min":3.2069999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.0600000000000001},"min":{"1min":0.73199999999999998,"5min":0.64900000000000002,"15min":0.59099999999999997},"max":{"1min":1.6699999999999999,"5min":1.851,"15min":1.962},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.206,"5min":1.2190000000000001,"15min":1.1339999999999999},"min":{"1min":0.77400000000000002,"5min":0.74099999999999999,"15min":0.63800000000000001},"max":{"1min":1.595,"5min":1.671,"15min":1.671},"last":1.1850000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.319,"15min":1.2709999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.226},"min":{"1min":0.85899999999999999,"5min":0.70999999999999996,"15min":0.68100000000000005},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.0900000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.248,"15min":1.278},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":4.2690000000000001},"last":1.294},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2190000000000001,"15min":1.24},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.5669999999999999,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.04}]},{"osd":4,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.325,"15min":1.282},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.823,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3260000000000001,"15min":1.3280000000000001},"min":{"1min":0.67200000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2969999999999999,"15min":1.2869999999999999},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.8879999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.141},{"interface":"front","average":{"1min":1.369,"5min":1.47,"15min":1.4239999999999999},"min":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.962,"5min":2.117,"15min":2.169},"last":1.681}]},{"osd":7,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.46,"15min":1.446},"min":{"1min":0.80100000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8919999999999999,"5min":1.9570000000000001,"15min":2.5419999999999998},"last":1.605},{"interface":"front","average":{"1min":1.383,"5min":1.4470000000000001,"15min":1.4139999999999999},"min":{"1min":0.89300000000000002,"5min":0.747,"15min":0.57999999999999996},"max":{"1min":1.7509999999999999,"5min":2.141,"15min":2.141},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575011,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193653,"statfs":{"total":200000000,"available":198301643,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0880000000000001,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.631,"5min":1.631,"15min":1.835},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.645,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":0.92400000000000004}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.5549999999999999,"15min":6.101},"last":1.494},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.155,"15min":1.1220000000000001},"min":{"1min":0.70599999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.617,"5min":1.6439999999999999,"15min":2.077},"last":0.82399999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6439999999999999,"5min":1.72,"15min":5.5350000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.208,"15min":1.2270000000000001},"min":{"1min":0.85399999999999998,"5min":0.80500000000000005,"15min":0.66400000000000003},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.863},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.6599999999999999,"15min":5.6189999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.333,"15min":1.292},"min":{"1min":1.002,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.6200000000000001,"5min":1.752,"15min":1.8360000000000001},"last":1.238}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.264,"15min":1.2150000000000001},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.5429999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.46},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.734,"5min":1.798,"15min":5.6970000000000001},"last":1.585}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":1.919,"15min":2.0310000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3939999999999999,"15min":1.379},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6970000000000001,"5min":1.853,"15min":2.133},"last":1.5489999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.462,"15min":1.4690000000000001},"min":{"1min":1.1919999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.8260000000000001,"5min":1.893,"15min":6.3959999999999999},"last":1.712},{"interface":"front","average":{"1min":1.496,"5min":1.498,"15min":1.4830000000000001},"min":{"1min":1.1930000000000001,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.6819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.091,"15min":1.0509999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4350000000000001,"5min":1.679,"15min":2.1349999999999998},"last":1.411},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.143,"15min":1.1180000000000001},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.48799999999999999},"max":{"1min":1.4750000000000001,"5min":2.448,"15min":2.448},"last":0.96599999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1519999999999999,"15min":1.0980000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.55,"5min":1.754,"15min":1.754},"last":0.878},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.50700000000000001},"max":{"1min":1.5509999999999999,"5min":3.117,"15min":3.117},"last":1.504}]},{"osd":2,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.21,"15min":1.1339999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5309999999999999,"5min":2.613,"15min":2.613},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.7070000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.032}]},{"osd":3,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2929999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.409,"5min":2.653,"15min":2.653},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.214}]},{"osd":5,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.278,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.51700000000000002},"max":{"1min":1.647,"5min":3.625,"15min":3.625},"last":1.345},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5940000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.1839999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.415,"15min":1.375},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.921,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4419999999999999,"15min":1.4179999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.52200000000000002},"max":{"1min":1.7829999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.458}]},{"osd":7,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5589999999999999,"15min":1.498},"min":{"1min":0.77000000000000002,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.746,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.593,"15min":1.5449999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.829,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.4339999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1082,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194229,"statfs":{"total":200000000,"available":198891097,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":0.83899999999999997},"min":{"1min":0.67500000000000004,"5min":0.36499999999999999,"15min":0.249},"max":{"1min":1.2050000000000001,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.751},{"interface":"front","average":{"1min":1.032,"5min":0.95799999999999996,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.5609999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.82999999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.877,"15min":0.88},"min":{"1min":0.63500000000000001,"5min":0.46600000000000003,"15min":0.32800000000000001},"max":{"1min":1.137,"5min":1.413,"15min":5.3769999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.026,"15min":0.96199999999999997},"min":{"1min":0.83599999999999997,"5min":0.40899999999999997,"15min":0.29499999999999998},"max":{"1min":1.3799999999999999,"5min":1.573,"15min":2.387},"last":0.93000000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.077,"15min":1.0129999999999999},"min":{"1min":0.88600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.5820000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1000000000000001,"15min":1.0580000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.6319999999999999,"15min":2.657},"last":1}]},{"osd":4,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2909999999999999,"15min":1.2390000000000001},"min":{"1min":1.0329999999999999,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.583,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.258,"5min":1.2909999999999999,"15min":1.2370000000000001},"min":{"1min":0.90700000000000003,"5min":0.76300000000000001,"15min":0.54600000000000004},"max":{"1min":1.5269999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.095}]},{"osd":5,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.306,"15min":1.2709999999999999},"min":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.58299999999999996},"max":{"1min":1.579,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.272},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.304,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.78700000000000003,"15min":0.66700000000000004},"max":{"1min":1.655,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.242}]},{"osd":6,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":1.0820000000000001,"5min":0.76900000000000002,"15min":0.53300000000000003},"max":{"1min":1.458,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.3919999999999999,"15min":1.3340000000000001},"min":{"1min":0.95799999999999996,"5min":0.81499999999999995,"15min":0.52600000000000002},"max":{"1min":1.6819999999999999,"5min":2.077,"15min":2.698},"last":1.5880000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4159999999999999,"15min":1.3420000000000001},"min":{"1min":1.258,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":2.1160000000000001,"15min":3.609},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4399999999999999,"15min":1.3899999999999999},"min":{"1min":1.155,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.131}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194230,"statfs":{"total":200000000,"available":198892101,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.4330000000000001,"15min":2.258},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.93999999999999995,"15min":0.90600000000000003},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":11.85},"last":0.69499999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4179999999999999,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.056,"15min":1.012},"min":{"1min":0.54300000000000004,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":1.456,"5min":4.681,"15min":11.788},"last":1.155}]},{"osd":3,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":0.97499999999999998},"min":{"1min":0.57199999999999995,"5min":0.41799999999999998,"15min":0.39300000000000002},"max":{"1min":1.262,"5min":1.702,"15min":2.3109999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.1319999999999999,"15min":1.077},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7549999999999999,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":1.5}]},{"osd":4,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":11.930999999999999},"last":1.45},{"interface":"front","average":{"1min":1.236,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.873,"5min":0.72399999999999998,"15min":0.72299999999999998},"max":{"1min":1.7050000000000001,"5min":1.806,"15min":2.2189999999999999},"last":1.758}]},{"osd":5,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3240000000000001,"15min":1.3149999999999999},"min":{"1min":1.0109999999999999,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.6559999999999999,"5min":1.7170000000000001,"15min":11.888},"last":1.542},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.367,"15min":1.325},"min":{"1min":1.107,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.55,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.383}]},{"osd":6,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3440000000000001,"15min":1.3160000000000001},"min":{"1min":1.0209999999999999,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.855,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":1.665},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3400000000000001,"15min":1.2989999999999999},"min":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.786,"5min":1.9370000000000001,"15min":2.286},"last":1.885}]},{"osd":7,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4019999999999999,"15min":1.349},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.8089999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.3759999999999999,"15min":1.355},"min":{"1min":0.85399999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.77,"5min":2.323,"15min":11.962999999999999},"last":1.595}]}]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193652,"statfs":{"total":200000000,"available":198300569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.2470000000000001,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.746},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.712,"5min":1.712,"15min":3.3500000000000001},"last":1.712}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.101,"15min":1.117},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.887,"5min":1.887,"15min":5.2009999999999996},"last":1.887}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.04,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.835,"5min":1.835,"15min":3.4300000000000002},"last":1.835},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.0569999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":1.1850000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1739999999999999,"15min":1.1759999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.61699999999999999},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.292,"15min":1.274},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.583,"5min":1.661,"15min":3.7080000000000002},"last":1.448}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.226,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.456,"5min":1.796,"15min":3.8849999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2609999999999999,"15min":1.319},"min":{"1min":0.75,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.748,"5min":1.77,"15min":15.576000000000001},"last":1.2609999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.333},"min":{"1min":0.85299999999999998,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.345,"15min":1.3540000000000001},"min":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.895,"5min":1.895,"15min":3.786},"last":1.4219999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.401,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":1.599},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.355,"15min":1.363},"min":{"1min":0.92400000000000004,"5min":0.89900000000000002,"15min":0.76500000000000001},"max":{"1min":1.913,"5min":2.032,"15min":4.0519999999999996},"last":1.365}]}]},{"osd":0,"up_from":13,"seq":55834575012,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892613,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.45600000000000002,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.6399999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.497,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.6140000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.72299999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.97399999999999998,"15min":1.0429999999999999},"min":{"1min":0.79500000000000004,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.492,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.0289999999999999,"15min":1.1399999999999999},"min":{"1min":0.60199999999999998,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.2869999999999999,"5min":1.708,"15min":41.758000000000003},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.95099999999999996},"min":{"1min":0.63100000000000001,"5min":0.42099999999999999,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.109,"15min":1.0920000000000001},"min":{"1min":0.80900000000000005,"5min":0.47699999999999998,"15min":0.36499999999999999},"max":{"1min":1.407,"5min":1.7210000000000001,"15min":2.02},"last":0.89900000000000002}]},{"osd":4,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2050000000000001,"15min":1.1890000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.738,"5min":1.738,"15min":4.4269999999999996},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.2809999999999999,"15min":1.28},"min":{"1min":0.96499999999999997,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.5760000000000001,"5min":1.79,"15min":15.766},"last":0.92900000000000005}]},{"osd":5,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2629999999999999,"15min":1.27},"min":{"1min":0.94199999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.26,"15min":1.262},"min":{"1min":0.77500000000000002,"5min":0.747,"15min":0.63100000000000001},"max":{"1min":1.605,"5min":1.6919999999999999,"15min":4.3970000000000002},"last":0.95099999999999996}]},{"osd":6,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.391,"15min":1.3380000000000001},"min":{"1min":1.0940000000000001,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":1.6970000000000001,"5min":1.9470000000000001,"15min":5.4669999999999996},"last":1.159},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.762,"5min":1.8939999999999999,"15min":17.161000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3759999999999999,"15min":1.3819999999999999},"min":{"1min":0.85599999999999998,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":1.655,"5min":1.974,"15min":14.381},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.3109999999999999,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":1.8759999999999999,"5min":2.1230000000000002,"15min":9.7080000000000002},"last":1.01}]}]}],"pool_statfs":[]}} 2023-12-19T13:59:47.140 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T13:59:47.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.392+0000 7fa13699f640 1 Processor -- start 2023-12-19T13:59:47.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.393+0000 7fa13699f640 1 -- start start 2023-12-19T13:59:47.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.394+0000 7fa13699f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa1300ae110 0x7fa1300b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.394+0000 7fa13699f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1300b0640 0x7fa13006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.394+0000 7fa13699f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300b0a60 con 0x7fa130157bf0 2023-12-19T13:59:47.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.394+0000 7fa13699f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13006b8c0 con 0x7fa1300b0640 2023-12-19T13:59:47.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.394+0000 7fa13699f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300ae640 con 0x7fa1300ae110 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa12ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa130157bf0 0x7fa13015b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46952/0 (socket says 172.21.15.113:46952) 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa12ffff640 1 -- 172.21.15.113:0/2720444375 learned_addr learned my addr 172.21.15.113:0/2720444375 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa134f3c640 1 --2- 172.21.15.113:0/2720444375 >> v2:172.21.15.113:3300/0 conn(0x7fa1300b0640 0x7fa13006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa12f7fe640 1 -- 172.21.15.113:0/2720444375 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11545121 0 0) 0x7fa1300b0a60 con 0x7fa130157bf0 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa134f3c640 1 -- 172.21.15.113:0/2720444375 >> v2:172.21.15.151:3300/0 conn(0x7fa1300ae110 msgr2=0x7fa1300b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa127fff640 1 --2- 172.21.15.113:0/2720444375 >> v2:172.21.15.151:3300/0 conn(0x7fa1300ae110 0x7fa1300b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa134f3c640 1 --2- 172.21.15.113:0/2720444375 >> v2:172.21.15.151:3300/0 conn(0x7fa1300ae110 0x7fa1300b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa134f3c640 1 -- 172.21.15.113:0/2720444375 >> v1:172.21.15.113:6789/0 conn(0x7fa130157bf0 legacy=0x7fa13015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa134f3c640 1 -- 172.21.15.113:0/2720444375 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300ae920 con 0x7fa1300b0640 2023-12-19T13:59:47.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.395+0000 7fa127fff640 1 --2- 172.21.15.113:0/2720444375 >> v2:172.21.15.151:3300/0 conn(0x7fa1300ae110 0x7fa1300b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:47.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.396+0000 7fa134f3c640 1 --2- 172.21.15.113:0/2720444375 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1300b0640 0x7fa13006d230 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fa1300af4b0 tx=0x7fa12802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b86d25f72a2192e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:47.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.397+0000 7fa12f7fe640 1 -- 172.21.15.113:0/2720444375 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12802cc70 con 0x7fa1300b0640 2023-12-19T13:59:47.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.397+0000 7fa12f7fe640 1 -- 172.21.15.113:0/2720444375 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12802cdd0 con 0x7fa1300b0640 2023-12-19T13:59:47.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.397+0000 7fa12f7fe640 1 -- 172.21.15.113:0/2720444375 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128034660 con 0x7fa1300b0640 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.397+0000 7fa13699f640 1 -- 172.21.15.113:0/2720444375 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1300b0640 msgr2=0x7fa13006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.397+0000 7fa13699f640 1 --2- 172.21.15.113:0/2720444375 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1300b0640 0x7fa13006d230 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fa1300af4b0 tx=0x7fa12802bec0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.398+0000 7fa13699f640 1 -- 172.21.15.113:0/2720444375 shutdown_connections 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.398+0000 7fa13699f640 1 --2- 172.21.15.113:0/2720444375 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1300b0640 0x7fa13006d230 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.398+0000 7fa13699f640 1 --2- 172.21.15.113:0/2720444375 >> v2:172.21.15.151:3300/0 conn(0x7fa1300ae110 0x7fa1300b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.398+0000 7fa13699f640 1 -- 172.21.15.113:0/2720444375 >> 172.21.15.113:0/2720444375 conn(0x7fa1300cbb70 msgr2=0x7fa1300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.398+0000 7fa13699f640 1 -- 172.21.15.113:0/2720444375 shutdown_connections 2023-12-19T13:59:47.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.398+0000 7fa13699f640 1 -- 172.21.15.113:0/2720444375 wait complete. 2023-12-19T13:59:47.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.399+0000 7fa13699f640 1 Processor -- start 2023-12-19T13:59:47.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.400+0000 7fa13699f640 1 -- start start 2023-12-19T13:59:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.400+0000 7fa13699f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1300ae110 0x7fa130145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.400+0000 7fa13699f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1300b0640 0x7fa13015b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa13699f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa130157bf0 0x7fa1300a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa13699f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301460f0 con 0x7fa130157bf0 2023-12-19T13:59:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa13699f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13015c330 con 0x7fa1300ae110 2023-12-19T13:59:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa13699f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13015c610 con 0x7fa1300b0640 2023-12-19T13:59:47.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa130157bf0 0x7fa1300a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa130157bf0 0x7fa1300a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52108/0 (socket says 172.21.15.113:52108) 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 -- 172.21.15.113:0/469708004 learned_addr learned my addr 172.21.15.113:0/469708004 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa12ffff640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1300ae110 0x7fa130145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa127fff640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1300b0640 0x7fa13015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 -- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1300b0640 msgr2=0x7fa13015b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1300b0640 0x7fa13015b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 -- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1300ae110 msgr2=0x7fa130145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1300ae110 0x7fa130145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa134f3c640 1 -- 172.21.15.113:0/469708004 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128009a70 con 0x7fa130157bf0 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.401+0000 7fa127fff640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1300b0640 0x7fa13015b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.402+0000 7fa134f3c640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa130157bf0 0x7fa1300a8d20 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa12802c4d0 tx=0x7fa128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.402+0000 7fa12d7fa640 1 -- 172.21.15.113:0/469708004 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12803e610 con 0x7fa130157bf0 2023-12-19T13:59:47.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.402+0000 7fa12d7fa640 1 -- 172.21.15.113:0/469708004 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12803e770 con 0x7fa130157bf0 2023-12-19T13:59:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.402+0000 7fa12d7fa640 1 -- 172.21.15.113:0/469708004 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12803eb20 con 0x7fa130157bf0 2023-12-19T13:59:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.402+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13015c8f0 con 0x7fa130157bf0 2023-12-19T13:59:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.402+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13015ceb0 con 0x7fa130157bf0 2023-12-19T13:59:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.403+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa130061910 con 0x7fa130157bf0 2023-12-19T13:59:47.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.404+0000 7fa12d7fa640 1 -- 172.21.15.113:0/469708004 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa12803b050 con 0x7fa130157bf0 2023-12-19T13:59:47.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.405+0000 7fa12d7fa640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa11006a430 0x7fa11006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.405+0000 7fa12d7fa640 1 -- 172.21.15.113:0/469708004 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1280ab210 con 0x7fa130157bf0 2023-12-19T13:59:47.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.405+0000 7fa12ffff640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa11006a430 0x7fa11006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.406+0000 7fa12ffff640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa11006a430 0x7fa11006c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa120000f60 tx=0x7fa120007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:47.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.409+0000 7fa12d7fa640 1 -- 172.21.15.113:0/469708004 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa128076920 con 0x7fa130157bf0 2023-12-19T13:59:47.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.661+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa13015d7d0 con 0x7fa130157bf0 2023-12-19T13:59:47.661 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.661+0000 7fa12d7fa640 1 -- 172.21.15.113:0/469708004 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7fa128079f40 con 0x7fa130157bf0 2023-12-19T13:59:47.662 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:47.662 INFO:teuthology.orchestra.run.smithi113.stdout:{"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":814,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":196,"num_osds":8,"num_up_osds":8,"osd_up_since":1702993580,"num_in_osds":8,"osd_in_since":1702993577,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592730,"bytes_used":10043996,"bytes_avail":1589956004,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":88,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9081}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-12-19T13:59:08.672133+0000","services":{}},"progress_events":{}} 2023-12-19T13:59:47.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.663+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa11006a430 msgr2=0x7fa11006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.663+0000 7fa13699f640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa11006a430 0x7fa11006c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa120000f60 tx=0x7fa120007b50 comp rx=0 tx=0).stop 2023-12-19T13:59:47.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa130157bf0 msgr2=0x7fa1300a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa130157bf0 0x7fa1300a8d20 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa12802c4d0 tx=0x7fa128004a40 comp rx=0 tx=0).stop 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 shutdown_connections 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa11006a430 0x7fa11006c8f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa130157bf0 0x7fa1300a8d20 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1300b0640 0x7fa13015b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 --2- 172.21.15.113:0/469708004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1300ae110 0x7fa130145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 >> 172.21.15.113:0/469708004 conn(0x7fa1300cbb70 msgr2=0x7fa13015dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 shutdown_connections 2023-12-19T13:59:47.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.664+0000 7fa13699f640 1 -- 172.21.15.113:0/469708004 wait complete. 2023-12-19T13:59:47.681 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T13:59:47.681 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:59:47.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.884+0000 7f972923f640 1 Processor -- start 2023-12-19T13:59:47.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.884+0000 7f972923f640 1 -- start start 2023-12-19T13:59:47.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f972923f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f972415e880 0x7f97240d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f972923f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240d12d0 con 0x7f97240b8070 2023-12-19T13:59:47.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f972923f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240d15b0 con 0x7f9724146e30 2023-12-19T13:59:47.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f972923f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9724147210 con 0x7f972415e880 2023-12-19T13:59:47.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f97237fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f97240b8070 0x7f97240d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:46954/0 (socket says 172.21.15.113:46954) 2023-12-19T13:59:47.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f97237fe640 1 -- 172.21.15.113:0/865419447 learned_addr learned my addr 172.21.15.113:0/865419447 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:47.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f9728a3e640 1 --2- 172.21.15.113:0/865419447 >> v2:172.21.15.151:3300/0 conn(0x7f972415e880 0x7f97240d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398462990 0 0) 0x7f97240d12d0 con 0x7f97240b8070 2023-12-19T13:59:47.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.886+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9710003520 con 0x7f97240b8070 2023-12-19T13:59:47.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3970206564 0 0) 0x7f9710003520 con 0x7f97240b8070 2023-12-19T13:59:47.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 >> v2:172.21.15.151:3300/0 conn(0x7f972415e880 msgr2=0x7f97240d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:47.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 --2- 172.21.15.113:0/865419447 >> v2:172.21.15.151:3300/0 conn(0x7f972415e880 0x7f97240d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 >> v1:172.21.15.151:6789/0 conn(0x7f9724146e30 legacy=0x7f97240b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240d1890 con 0x7f97240b8070 2023-12-19T13:59:47.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f970c001670 con 0x7f97240b8070 2023-12-19T13:59:47.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 >> v1:172.21.15.113:6789/0 conn(0x7f97240b8070 legacy=0x7f97240d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9710003970 0x7f9710003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100047c0 0x7f9710004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f971000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9724147210 con 0x7f9710005180 2023-12-19T13:59:47.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971000c120 con 0x7f97100047c0 2023-12-19T13:59:47.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971000c2e0 con 0x7f9710003970 2023-12-19T13:59:47.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.887+0000 7f9728a3e640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f971000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f97237fe640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100047c0 0x7f9710004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f9728a3e640 1 -- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9710003970 msgr2=0x7f9710003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:47.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f9723fff640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9710003970 0x7f9710003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f9728a3e640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9710003970 0x7f9710003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f9728a3e640 1 -- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100047c0 msgr2=0x7f9710004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:47.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f9728a3e640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100047c0 0x7f9710004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f9728a3e640 1 -- 172.21.15.113:0/865419447 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710003520 con 0x7f9710005180 2023-12-19T13:59:47.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f97237fe640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100047c0 0x7f9710004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:47.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.888+0000 7f9723fff640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9710003970 0x7f9710003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:47.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.889+0000 7f9728a3e640 1 -- 172.21.15.113:0/865419447 reap_dead start 2023-12-19T13:59:47.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.889+0000 7f9728a3e640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f971000b980 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f971c009fc0 tx=0x7f97100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7e973399f8636c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:47.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.889+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c02cc30 con 0x7f9710005180 2023-12-19T13:59:47.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.889+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c00f040 con 0x7f9710005180 2023-12-19T13:59:47.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.889+0000 7f9722ffd640 1 -- 172.21.15.113:0/865419447 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c003990 con 0x7f9710005180 2023-12-19T13:59:47.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.890+0000 7f972923f640 1 -- 172.21.15.113:0/865419447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 msgr2=0x7f971000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.890+0000 7f972923f640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f971000b980 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f971c009fc0 tx=0x7f97100057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.890+0000 7f972923f640 1 -- 172.21.15.113:0/865419447 shutdown_connections 2023-12-19T13:59:47.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.890+0000 7f972923f640 1 --2- 172.21.15.113:0/865419447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f971000b980 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.890+0000 7f972923f640 1 -- 172.21.15.113:0/865419447 >> 172.21.15.113:0/865419447 conn(0x7f97240b2990 msgr2=0x7f97240b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:47.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.890+0000 7f972923f640 1 -- 172.21.15.113:0/865419447 shutdown_connections 2023-12-19T13:59:47.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.890+0000 7f972923f640 1 -- 172.21.15.113:0/865419447 wait complete. 2023-12-19T13:59:47.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.892+0000 7f972923f640 1 Processor -- start 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.892+0000 7f972923f640 1 -- start start 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f972923f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f97241e4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f972923f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f972413c500 0x7f9724155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f972923f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97241443b0 0x7f9724144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f972923f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9724144d70 con 0x7f9710005180 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f972923f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972413d860 con 0x7f972413c500 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f972923f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972413cc50 con 0x7f97241443b0 2023-12-19T13:59:47.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f97241e4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f97241e4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52134/0 (socket says 172.21.15.113:52134) 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 -- 172.21.15.113:0/1965855343 learned_addr learned my addr 172.21.15.113:0/1965855343 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 -- 172.21.15.113:0/1965855343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97241443b0 msgr2=0x7f9724144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97241443b0 0x7f9724144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 -- 172.21.15.113:0/1965855343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f972413c500 msgr2=0x7f9724155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f972413c500 0x7f9724155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.893+0000 7f9723fff640 1 -- 172.21.15.113:0/1965855343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972413cf30 con 0x7f9710005180 2023-12-19T13:59:47.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.894+0000 7f9723fff640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f97241e4be0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f971400d7a0 tx=0x7f971400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:47.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.894+0000 7f9720ff9640 1 -- 172.21.15.113:0/1965855343 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714005270 con 0x7f9710005180 2023-12-19T13:59:47.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.894+0000 7f9720ff9640 1 -- 172.21.15.113:0/1965855343 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97140053d0 con 0x7f9710005180 2023-12-19T13:59:47.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.894+0000 7f9720ff9640 1 -- 172.21.15.113:0/1965855343 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971400b8f0 con 0x7f9710005180 2023-12-19T13:59:47.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.894+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972413d210 con 0x7f9710005180 2023-12-19T13:59:47.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.894+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972413c960 con 0x7f9710005180 2023-12-19T13:59:47.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.895+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9724061910 con 0x7f9710005180 2023-12-19T13:59:47.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.896+0000 7f9720ff9640 1 -- 172.21.15.113:0/1965855343 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f971400ba50 con 0x7f9710005180 2023-12-19T13:59:47.907 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.897+0000 7f9720ff9640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f970406a460 0x7f970406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:47.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.897+0000 7f9720ff9640 1 -- 172.21.15.113:0/1965855343 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97140888f0 con 0x7f9710005180 2023-12-19T13:59:47.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.897+0000 7f97237fe640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f970406a460 0x7f970406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:47.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.898+0000 7f97237fe640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f970406a460 0x7f970406c920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f970c001200 tx=0x7f970c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:47.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:47.901+0000 7f9720ff9640 1 -- 172.21.15.113:0/1965855343 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9714053e50 con 0x7f9710005180 2023-12-19T13:59:48.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.090+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97240d1b70 con 0x7f970406a460 2023-12-19T13:59:48.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.112+0000 7f9720ff9640 1 -- 172.21.15.113:0/1965855343 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282529 (secure 0 0 0) 0x7f970c00d860 con 0x7f970406a460 2023-12-19T13:59:48.115 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:48.118 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:59:48.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f970406a460 msgr2=0x7f970406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:48.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f970406a460 0x7f970406c920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f970c001200 tx=0x7f970c009040 comp rx=0 tx=0).stop 2023-12-19T13:59:48.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 msgr2=0x7f97241e4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:48.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f97241e4be0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f971400d7a0 tx=0x7f971400dc60 comp rx=0 tx=0).stop 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 shutdown_connections 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f970406a460 0x7f970406c920 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97241443b0 0x7f9724144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f972413c500 0x7f9724155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 --2- 172.21.15.113:0/1965855343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9710005180 0x7f97241e4be0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 >> 172.21.15.113:0/1965855343 conn(0x7f97240b2990 msgr2=0x7f97240b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 shutdown_connections 2023-12-19T13:59:48.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:48.119+0000 7f972923f640 1 -- 172.21.15.113:0/1965855343 wait complete. 2023-12-19T13:59:48.139 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2023-12-19T13:59:46.684301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552691,"statfs":{"total":1600000000,"available":1589956004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001960"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232493+0000","last_change":"2023-12-19T13:59:41.242564+0000","last_active":"2023-12-19T13:59:42.232493+0000","last_peered":"2023-12-19T13:59:42.232493+0000","last_clean":"2023-12-19T13:59:42.232493+0000","last_became_active":"2023-12-19T13:59:41.241965+0000","last_became_peered":"2023-12-19T13:59:41.241965+0000","last_unstale":"2023-12-19T13:59:42.232493+0000","last_undegraded":"2023-12-19T13:59:42.232493+0000","last_fullsized":"2023-12-19T13:59:42.232493+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:32.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231924+0000","last_change":"2023-12-19T13:59:41.242978+0000","last_active":"2023-12-19T13:59:42.231924+0000","last_peered":"2023-12-19T13:59:42.231924+0000","last_clean":"2023-12-19T13:59:42.231924+0000","last_became_active":"2023-12-19T13:59:41.241144+0000","last_became_peered":"2023-12-19T13:59:41.241144+0000","last_unstale":"2023-12-19T13:59:42.231924+0000","last_undegraded":"2023-12-19T13:59:42.231924+0000","last_fullsized":"2023-12-19T13:59:42.231924+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:19.325426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232090+0000","last_change":"2023-12-19T13:59:41.237937+0000","last_active":"2023-12-19T13:59:42.232090+0000","last_peered":"2023-12-19T13:59:42.232090+0000","last_clean":"2023-12-19T13:59:42.232090+0000","last_became_active":"2023-12-19T13:59:41.237305+0000","last_became_peered":"2023-12-19T13:59:41.237305+0000","last_unstale":"2023-12-19T13:59:42.232090+0000","last_undegraded":"2023-12-19T13:59:42.232090+0000","last_fullsized":"2023-12-19T13:59:42.232090+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.011938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135449+0000","last_change":"2023-12-19T13:59:41.247807+0000","last_active":"2023-12-19T13:59:43.135449+0000","last_peered":"2023-12-19T13:59:43.135449+0000","last_clean":"2023-12-19T13:59:43.135449+0000","last_became_active":"2023-12-19T13:59:41.247553+0000","last_became_peered":"2023-12-19T13:59:41.247553+0000","last_unstale":"2023-12-19T13:59:43.135449+0000","last_undegraded":"2023-12-19T13:59:43.135449+0000","last_fullsized":"2023-12-19T13:59:43.135449+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:28:55.166135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.230037+0000","last_change":"2023-12-19T13:59:41.241641+0000","last_active":"2023-12-19T13:59:42.230037+0000","last_peered":"2023-12-19T13:59:42.230037+0000","last_clean":"2023-12-19T13:59:42.230037+0000","last_became_active":"2023-12-19T13:59:41.241409+0000","last_became_peered":"2023-12-19T13:59:41.241409+0000","last_unstale":"2023-12-19T13:59:42.230037+0000","last_undegraded":"2023-12-19T13:59:42.230037+0000","last_fullsized":"2023-12-19T13:59:42.230037+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:09:15.894760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233092+0000","last_change":"2023-12-19T13:59:41.248482+0000","last_active":"2023-12-19T13:59:42.233092+0000","last_peered":"2023-12-19T13:59:42.233092+0000","last_clean":"2023-12-19T13:59:42.233092+0000","last_became_active":"2023-12-19T13:59:41.248082+0000","last_became_peered":"2023-12-19T13:59:41.248082+0000","last_unstale":"2023-12-19T13:59:42.233092+0000","last_undegraded":"2023-12-19T13:59:42.233092+0000","last_fullsized":"2023-12-19T13:59:42.233092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:04.846345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354326+0000","last_change":"2023-12-19T13:59:41.236767+0000","last_active":"2023-12-19T13:59:42.354326+0000","last_peered":"2023-12-19T13:59:42.354326+0000","last_clean":"2023-12-19T13:59:42.354326+0000","last_became_active":"2023-12-19T13:59:41.235106+0000","last_became_peered":"2023-12-19T13:59:41.235106+0000","last_unstale":"2023-12-19T13:59:42.354326+0000","last_undegraded":"2023-12-19T13:59:42.354326+0000","last_fullsized":"2023-12-19T13:59:42.354326+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:25.034336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134754+0000","last_change":"2023-12-19T13:59:41.238951+0000","last_active":"2023-12-19T13:59:43.134754+0000","last_peered":"2023-12-19T13:59:43.134754+0000","last_clean":"2023-12-19T13:59:43.134754+0000","last_became_active":"2023-12-19T13:59:41.238736+0000","last_became_peered":"2023-12-19T13:59:41.238736+0000","last_unstale":"2023-12-19T13:59:43.134754+0000","last_undegraded":"2023-12-19T13:59:43.134754+0000","last_fullsized":"2023-12-19T13:59:43.134754+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:00.217591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134753+0000","last_change":"2023-12-19T13:59:41.245111+0000","last_active":"2023-12-19T13:59:43.134753+0000","last_peered":"2023-12-19T13:59:43.134753+0000","last_clean":"2023-12-19T13:59:43.134753+0000","last_became_active":"2023-12-19T13:59:41.243800+0000","last_became_peered":"2023-12-19T13:59:41.243800+0000","last_unstale":"2023-12-19T13:59:43.134753+0000","last_undegraded":"2023-12-19T13:59:43.134753+0000","last_fullsized":"2023-12-19T13:59:43.134753+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134743+0000","last_change":"2023-12-19T13:59:41.242728+0000","last_active":"2023-12-19T13:59:43.134743+0000","last_peered":"2023-12-19T13:59:43.134743+0000","last_clean":"2023-12-19T13:59:43.134743+0000","last_became_active":"2023-12-19T13:59:41.242497+0000","last_became_peered":"2023-12-19T13:59:41.242497+0000","last_unstale":"2023-12-19T13:59:43.134743+0000","last_undegraded":"2023-12-19T13:59:43.134743+0000","last_fullsized":"2023-12-19T13:59:43.134743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229680+0000","last_change":"2023-12-19T13:59:41.247111+0000","last_active":"2023-12-19T13:59:42.229680+0000","last_peered":"2023-12-19T13:59:42.229680+0000","last_clean":"2023-12-19T13:59:42.229680+0000","last_became_active":"2023-12-19T13:59:41.246891+0000","last_became_peered":"2023-12-19T13:59:41.246891+0000","last_unstale":"2023-12-19T13:59:42.229680+0000","last_undegraded":"2023-12-19T13:59:42.229680+0000","last_fullsized":"2023-12-19T13:59:42.229680+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:50:48.963616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351038+0000","last_change":"2023-12-19T13:59:41.233205+0000","last_active":"2023-12-19T13:59:42.351038+0000","last_peered":"2023-12-19T13:59:42.351038+0000","last_clean":"2023-12-19T13:59:42.351038+0000","last_became_active":"2023-12-19T13:59:41.233027+0000","last_became_peered":"2023-12-19T13:59:41.233027+0000","last_unstale":"2023-12-19T13:59:42.351038+0000","last_undegraded":"2023-12-19T13:59:42.351038+0000","last_fullsized":"2023-12-19T13:59:42.351038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:47.128360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351040+0000","last_change":"2023-12-19T13:59:41.250248+0000","last_active":"2023-12-19T13:59:42.351040+0000","last_peered":"2023-12-19T13:59:42.351040+0000","last_clean":"2023-12-19T13:59:42.351040+0000","last_became_active":"2023-12-19T13:59:41.250010+0000","last_became_peered":"2023-12-19T13:59:41.250010+0000","last_unstale":"2023-12-19T13:59:42.351040+0000","last_undegraded":"2023-12-19T13:59:42.351040+0000","last_fullsized":"2023-12-19T13:59:42.351040+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:01:23.346929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135052+0000","last_change":"2023-12-19T13:59:41.241997+0000","last_active":"2023-12-19T13:59:43.135052+0000","last_peered":"2023-12-19T13:59:43.135052+0000","last_clean":"2023-12-19T13:59:43.135052+0000","last_became_active":"2023-12-19T13:59:41.241781+0000","last_became_peered":"2023-12-19T13:59:41.241781+0000","last_unstale":"2023-12-19T13:59:43.135052+0000","last_undegraded":"2023-12-19T13:59:43.135052+0000","last_fullsized":"2023-12-19T13:59:43.135052+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:26.244097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135017+0000","last_change":"2023-12-19T13:59:41.247859+0000","last_active":"2023-12-19T13:59:43.135017+0000","last_peered":"2023-12-19T13:59:43.135017+0000","last_clean":"2023-12-19T13:59:43.135017+0000","last_became_active":"2023-12-19T13:59:41.247512+0000","last_became_peered":"2023-12-19T13:59:41.247512+0000","last_unstale":"2023-12-19T13:59:43.135017+0000","last_undegraded":"2023-12-19T13:59:43.135017+0000","last_fullsized":"2023-12-19T13:59:43.135017+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354167+0000","last_change":"2023-12-19T13:59:41.233301+0000","last_active":"2023-12-19T13:59:42.354167+0000","last_peered":"2023-12-19T13:59:42.354167+0000","last_clean":"2023-12-19T13:59:42.354167+0000","last_became_active":"2023-12-19T13:59:41.232270+0000","last_became_peered":"2023-12-19T13:59:41.232270+0000","last_unstale":"2023-12-19T13:59:42.354167+0000","last_undegraded":"2023-12-19T13:59:42.354167+0000","last_fullsized":"2023-12-19T13:59:42.354167+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233862+0000","last_change":"2023-12-19T13:59:41.245683+0000","last_active":"2023-12-19T13:59:42.233862+0000","last_peered":"2023-12-19T13:59:42.233862+0000","last_clean":"2023-12-19T13:59:42.233862+0000","last_became_active":"2023-12-19T13:59:41.243550+0000","last_became_peered":"2023-12-19T13:59:41.243550+0000","last_unstale":"2023-12-19T13:59:42.233862+0000","last_undegraded":"2023-12-19T13:59:42.233862+0000","last_fullsized":"2023-12-19T13:59:42.233862+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135151+0000","last_change":"2023-12-19T13:59:41.237992+0000","last_active":"2023-12-19T13:59:43.135151+0000","last_peered":"2023-12-19T13:59:43.135151+0000","last_clean":"2023-12-19T13:59:43.135151+0000","last_became_active":"2023-12-19T13:59:41.237713+0000","last_became_peered":"2023-12-19T13:59:41.237713+0000","last_unstale":"2023-12-19T13:59:43.135151+0000","last_undegraded":"2023-12-19T13:59:43.135151+0000","last_fullsized":"2023-12-19T13:59:43.135151+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:36.573957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353790+0000","last_change":"2023-12-19T13:59:41.236497+0000","last_active":"2023-12-19T13:59:42.353790+0000","last_peered":"2023-12-19T13:59:42.353790+0000","last_clean":"2023-12-19T13:59:42.353790+0000","last_became_active":"2023-12-19T13:59:41.236253+0000","last_became_peered":"2023-12-19T13:59:41.236253+0000","last_unstale":"2023-12-19T13:59:42.353790+0000","last_undegraded":"2023-12-19T13:59:42.353790+0000","last_fullsized":"2023-12-19T13:59:42.353790+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.350981+0000","last_change":"2023-12-19T13:59:41.223055+0000","last_active":"2023-12-19T13:59:42.350981+0000","last_peered":"2023-12-19T13:59:42.350981+0000","last_clean":"2023-12-19T13:59:42.350981+0000","last_became_active":"2023-12-19T13:59:41.222909+0000","last_became_peered":"2023-12-19T13:59:41.222909+0000","last_unstale":"2023-12-19T13:59:42.350981+0000","last_undegraded":"2023-12-19T13:59:42.350981+0000","last_fullsized":"2023-12-19T13:59:42.350981+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:20.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233271+0000","last_change":"2023-12-19T13:59:41.232831+0000","last_active":"2023-12-19T13:59:42.233271+0000","last_peered":"2023-12-19T13:59:42.233271+0000","last_clean":"2023-12-19T13:59:42.233271+0000","last_became_active":"2023-12-19T13:59:41.232491+0000","last_became_peered":"2023-12-19T13:59:41.232491+0000","last_unstale":"2023-12-19T13:59:42.233271+0000","last_undegraded":"2023-12-19T13:59:42.233271+0000","last_fullsized":"2023-12-19T13:59:42.233271+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229028+0000","last_change":"2023-12-19T13:59:41.249345+0000","last_active":"2023-12-19T13:59:42.229028+0000","last_peered":"2023-12-19T13:59:42.229028+0000","last_clean":"2023-12-19T13:59:42.229028+0000","last_became_active":"2023-12-19T13:59:41.249209+0000","last_became_peered":"2023-12-19T13:59:41.249209+0000","last_unstale":"2023-12-19T13:59:42.229028+0000","last_undegraded":"2023-12-19T13:59:42.229028+0000","last_fullsized":"2023-12-19T13:59:42.229028+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:40.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352951+0000","last_change":"2023-12-19T13:59:41.249931+0000","last_active":"2023-12-19T13:59:42.352951+0000","last_peered":"2023-12-19T13:59:42.352951+0000","last_clean":"2023-12-19T13:59:42.352951+0000","last_became_active":"2023-12-19T13:59:41.248821+0000","last_became_peered":"2023-12-19T13:59:41.248821+0000","last_unstale":"2023-12-19T13:59:42.352951+0000","last_undegraded":"2023-12-19T13:59:42.352951+0000","last_fullsized":"2023-12-19T13:59:42.352951+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:42.764784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.228902+0000","last_change":"2023-12-19T13:59:41.241869+0000","last_active":"2023-12-19T13:59:42.228902+0000","last_peered":"2023-12-19T13:59:42.228902+0000","last_clean":"2023-12-19T13:59:42.228902+0000","last_became_active":"2023-12-19T13:59:41.241628+0000","last_became_peered":"2023-12-19T13:59:41.241628+0000","last_unstale":"2023-12-19T13:59:42.228902+0000","last_undegraded":"2023-12-19T13:59:42.228902+0000","last_fullsized":"2023-12-19T13:59:42.228902+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:06.319730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.230147+0000","last_change":"2023-12-19T13:59:41.235933+0000","last_active":"2023-12-19T13:59:42.230147+0000","last_peered":"2023-12-19T13:59:42.230147+0000","last_clean":"2023-12-19T13:59:42.230147+0000","last_became_active":"2023-12-19T13:59:41.235709+0000","last_became_peered":"2023-12-19T13:59:41.235709+0000","last_unstale":"2023-12-19T13:59:42.230147+0000","last_undegraded":"2023-12-19T13:59:42.230147+0000","last_fullsized":"2023-12-19T13:59:42.230147+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:17.967495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353278+0000","last_change":"2023-12-19T13:59:41.246586+0000","last_active":"2023-12-19T13:59:42.353278+0000","last_peered":"2023-12-19T13:59:42.353278+0000","last_clean":"2023-12-19T13:59:42.353278+0000","last_became_active":"2023-12-19T13:59:41.246110+0000","last_became_peered":"2023-12-19T13:59:41.246110+0000","last_unstale":"2023-12-19T13:59:42.353278+0000","last_undegraded":"2023-12-19T13:59:42.353278+0000","last_fullsized":"2023-12-19T13:59:42.353278+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:23.752394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229265+0000","last_change":"2023-12-19T13:59:41.231910+0000","last_active":"2023-12-19T13:59:42.229265+0000","last_peered":"2023-12-19T13:59:42.229265+0000","last_clean":"2023-12-19T13:59:42.229265+0000","last_became_active":"2023-12-19T13:59:41.231746+0000","last_became_peered":"2023-12-19T13:59:41.231746+0000","last_unstale":"2023-12-19T13:59:42.229265+0000","last_undegraded":"2023-12-19T13:59:42.229265+0000","last_fullsized":"2023-12-19T13:59:42.229265+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:22.296457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353191+0000","last_change":"2023-12-19T13:59:41.237305+0000","last_active":"2023-12-19T13:59:42.353191+0000","last_peered":"2023-12-19T13:59:42.353191+0000","last_clean":"2023-12-19T13:59:42.353191+0000","last_became_active":"2023-12-19T13:59:41.237047+0000","last_became_peered":"2023-12-19T13:59:41.237047+0000","last_unstale":"2023-12-19T13:59:42.353191+0000","last_undegraded":"2023-12-19T13:59:42.353191+0000","last_fullsized":"2023-12-19T13:59:42.353191+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231961+0000","last_change":"2023-12-19T13:59:41.236965+0000","last_active":"2023-12-19T13:59:42.231961+0000","last_peered":"2023-12-19T13:59:42.231961+0000","last_clean":"2023-12-19T13:59:42.231961+0000","last_became_active":"2023-12-19T13:59:41.236731+0000","last_became_peered":"2023-12-19T13:59:41.236731+0000","last_unstale":"2023-12-19T13:59:42.231961+0000","last_undegraded":"2023-12-19T13:59:42.231961+0000","last_fullsized":"2023-12-19T13:59:42.231961+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:23.156246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135165+0000","last_change":"2023-12-19T13:59:41.233678+0000","last_active":"2023-12-19T13:59:43.135165+0000","last_peered":"2023-12-19T13:59:43.135165+0000","last_clean":"2023-12-19T13:59:43.135165+0000","last_became_active":"2023-12-19T13:59:41.233416+0000","last_became_peered":"2023-12-19T13:59:41.233416+0000","last_unstale":"2023-12-19T13:59:43.135165+0000","last_undegraded":"2023-12-19T13:59:43.135165+0000","last_fullsized":"2023-12-19T13:59:43.135165+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232761+0000","last_change":"2023-12-19T13:59:41.242694+0000","last_active":"2023-12-19T13:59:42.232761+0000","last_peered":"2023-12-19T13:59:42.232761+0000","last_clean":"2023-12-19T13:59:42.232761+0000","last_became_active":"2023-12-19T13:59:41.242235+0000","last_became_peered":"2023-12-19T13:59:41.242235+0000","last_unstale":"2023-12-19T13:59:42.232761+0000","last_undegraded":"2023-12-19T13:59:42.232761+0000","last_fullsized":"2023-12-19T13:59:42.232761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:23.752394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232826+0000","last_change":"2023-12-19T13:59:41.246013+0000","last_active":"2023-12-19T13:59:42.232826+0000","last_peered":"2023-12-19T13:59:42.232826+0000","last_clean":"2023-12-19T13:59:42.232826+0000","last_became_active":"2023-12-19T13:59:41.244697+0000","last_became_peered":"2023-12-19T13:59:41.244697+0000","last_unstale":"2023-12-19T13:59:42.232826+0000","last_undegraded":"2023-12-19T13:59:42.232826+0000","last_fullsized":"2023-12-19T13:59:42.232826+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135768+0000","last_change":"2023-12-19T13:59:41.250162+0000","last_active":"2023-12-19T13:59:43.135768+0000","last_peered":"2023-12-19T13:59:43.135768+0000","last_clean":"2023-12-19T13:59:43.135768+0000","last_became_active":"2023-12-19T13:59:41.249030+0000","last_became_peered":"2023-12-19T13:59:41.249030+0000","last_unstale":"2023-12-19T13:59:43.135768+0000","last_undegraded":"2023-12-19T13:59:43.135768+0000","last_fullsized":"2023-12-19T13:59:43.135768+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:51.041386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"195'4","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.248517+0000","last_change":"2023-12-19T13:59:40.757724+0000","last_active":"2023-12-19T13:59:41.248517+0000","last_peered":"2023-12-19T13:59:41.248517+0000","last_clean":"2023-12-19T13:59:41.248517+0000","last_became_active":"2023-12-19T13:59:40.757462+0000","last_became_peered":"2023-12-19T13:59:40.757462+0000","last_unstale":"2023-12-19T13:59:41.248517+0000","last_undegraded":"2023-12-19T13:59:41.248517+0000","last_fullsized":"2023-12-19T13:59:41.248517+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:47.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231967+0000","last_change":"2023-12-19T13:59:41.249661+0000","last_active":"2023-12-19T13:59:42.231967+0000","last_peered":"2023-12-19T13:59:42.231967+0000","last_clean":"2023-12-19T13:59:42.231967+0000","last_became_active":"2023-12-19T13:59:41.249501+0000","last_became_peered":"2023-12-19T13:59:41.249501+0000","last_unstale":"2023-12-19T13:59:42.231967+0000","last_undegraded":"2023-12-19T13:59:42.231967+0000","last_fullsized":"2023-12-19T13:59:42.231967+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:51.275689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.240163+0000","last_change":"2023-12-19T13:59:40.739255+0000","last_active":"2023-12-19T13:59:41.240163+0000","last_peered":"2023-12-19T13:59:41.240163+0000","last_clean":"2023-12-19T13:59:41.240163+0000","last_became_active":"2023-12-19T13:59:40.738115+0000","last_became_peered":"2023-12-19T13:59:40.738115+0000","last_unstale":"2023-12-19T13:59:41.240163+0000","last_undegraded":"2023-12-19T13:59:41.240163+0000","last_fullsized":"2023-12-19T13:59:41.240163+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233406+0000","last_change":"2023-12-19T13:59:41.238418+0000","last_active":"2023-12-19T13:59:42.233406+0000","last_peered":"2023-12-19T13:59:42.233406+0000","last_clean":"2023-12-19T13:59:42.233406+0000","last_became_active":"2023-12-19T13:59:41.236352+0000","last_became_peered":"2023-12-19T13:59:41.236352+0000","last_unstale":"2023-12-19T13:59:42.233406+0000","last_undegraded":"2023-12-19T13:59:42.233406+0000","last_fullsized":"2023-12-19T13:59:42.233406+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:11.628635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.238791+0000","last_change":"2023-12-19T13:59:40.751638+0000","last_active":"2023-12-19T13:59:41.238791+0000","last_peered":"2023-12-19T13:59:41.238791+0000","last_clean":"2023-12-19T13:59:41.238791+0000","last_became_active":"2023-12-19T13:59:40.751276+0000","last_became_peered":"2023-12-19T13:59:40.751276+0000","last_unstale":"2023-12-19T13:59:41.238791+0000","last_undegraded":"2023-12-19T13:59:41.238791+0000","last_fullsized":"2023-12-19T13:59:41.238791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135296+0000","last_change":"2023-12-19T13:59:41.247725+0000","last_active":"2023-12-19T13:59:43.135296+0000","last_peered":"2023-12-19T13:59:43.135296+0000","last_clean":"2023-12-19T13:59:43.135296+0000","last_became_active":"2023-12-19T13:59:41.247225+0000","last_became_peered":"2023-12-19T13:59:41.247225+0000","last_unstale":"2023-12-19T13:59:43.135296+0000","last_undegraded":"2023-12-19T13:59:43.135296+0000","last_fullsized":"2023-12-19T13:59:43.135296+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.249416+0000","last_change":"2023-12-19T13:59:40.756112+0000","last_active":"2023-12-19T13:59:41.249416+0000","last_peered":"2023-12-19T13:59:41.249416+0000","last_clean":"2023-12-19T13:59:41.249416+0000","last_became_active":"2023-12-19T13:59:40.754231+0000","last_became_peered":"2023-12-19T13:59:40.754231+0000","last_unstale":"2023-12-19T13:59:41.249416+0000","last_undegraded":"2023-12-19T13:59:41.249416+0000","last_fullsized":"2023-12-19T13:59:41.249416+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135345+0000","last_change":"2023-12-19T13:59:41.250665+0000","last_active":"2023-12-19T13:59:43.135345+0000","last_peered":"2023-12-19T13:59:43.135345+0000","last_clean":"2023-12-19T13:59:43.135345+0000","last_became_active":"2023-12-19T13:59:41.250399+0000","last_became_peered":"2023-12-19T13:59:41.250399+0000","last_unstale":"2023-12-19T13:59:43.135345+0000","last_undegraded":"2023-12-19T13:59:43.135345+0000","last_fullsized":"2023-12-19T13:59:43.135345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:42.764784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.240895+0000","last_change":"2023-12-19T13:59:40.752503+0000","last_active":"2023-12-19T13:59:41.240895+0000","last_peered":"2023-12-19T13:59:41.240895+0000","last_clean":"2023-12-19T13:59:41.240895+0000","last_became_active":"2023-12-19T13:59:40.752267+0000","last_became_peered":"2023-12-19T13:59:40.752267+0000","last_unstale":"2023-12-19T13:59:41.240895+0000","last_undegraded":"2023-12-19T13:59:41.240895+0000","last_fullsized":"2023-12-19T13:59:41.240895+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:41.632120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233107+0000","last_change":"2023-12-19T13:59:41.246159+0000","last_active":"2023-12-19T13:59:42.233107+0000","last_peered":"2023-12-19T13:59:42.233107+0000","last_clean":"2023-12-19T13:59:42.233107+0000","last_became_active":"2023-12-19T13:59:41.244984+0000","last_became_peered":"2023-12-19T13:59:41.244984+0000","last_unstale":"2023-12-19T13:59:42.233107+0000","last_undegraded":"2023-12-19T13:59:42.233107+0000","last_fullsized":"2023-12-19T13:59:42.233107+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.244900+0000","last_change":"2023-12-19T13:59:40.757849+0000","last_active":"2023-12-19T13:59:41.244900+0000","last_peered":"2023-12-19T13:59:41.244900+0000","last_clean":"2023-12-19T13:59:41.244900+0000","last_became_active":"2023-12-19T13:59:40.756277+0000","last_became_peered":"2023-12-19T13:59:40.756277+0000","last_unstale":"2023-12-19T13:59:41.244900+0000","last_undegraded":"2023-12-19T13:59:41.244900+0000","last_fullsized":"2023-12-19T13:59:41.244900+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:14.369247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353902+0000","last_change":"2023-12-19T13:59:41.246566+0000","last_active":"2023-12-19T13:59:42.353902+0000","last_peered":"2023-12-19T13:59:42.353902+0000","last_clean":"2023-12-19T13:59:42.353902+0000","last_became_active":"2023-12-19T13:59:41.245863+0000","last_became_peered":"2023-12-19T13:59:41.245863+0000","last_unstale":"2023-12-19T13:59:42.353902+0000","last_undegraded":"2023-12-19T13:59:42.353902+0000","last_fullsized":"2023-12-19T13:59:42.353902+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:39.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228832+0000","last_change":"2023-12-19T13:59:40.754966+0000","last_active":"2023-12-19T13:59:41.228832+0000","last_peered":"2023-12-19T13:59:41.228832+0000","last_clean":"2023-12-19T13:59:41.228832+0000","last_became_active":"2023-12-19T13:59:40.754540+0000","last_became_peered":"2023-12-19T13:59:40.754540+0000","last_unstale":"2023-12-19T13:59:41.228832+0000","last_undegraded":"2023-12-19T13:59:41.228832+0000","last_fullsized":"2023-12-19T13:59:41.228832+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:48.297185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136021+0000","last_change":"2023-12-19T13:59:41.250368+0000","last_active":"2023-12-19T13:59:43.136021+0000","last_peered":"2023-12-19T13:59:43.136021+0000","last_clean":"2023-12-19T13:59:43.136021+0000","last_became_active":"2023-12-19T13:59:41.249893+0000","last_became_peered":"2023-12-19T13:59:41.249893+0000","last_unstale":"2023-12-19T13:59:43.136021+0000","last_undegraded":"2023-12-19T13:59:43.136021+0000","last_fullsized":"2023-12-19T13:59:43.136021+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:51.302356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.234857+0000","last_change":"2023-12-19T13:59:40.758803+0000","last_active":"2023-12-19T13:59:41.234857+0000","last_peered":"2023-12-19T13:59:41.234857+0000","last_clean":"2023-12-19T13:59:41.234857+0000","last_became_active":"2023-12-19T13:59:40.758490+0000","last_became_peered":"2023-12-19T13:59:40.758490+0000","last_unstale":"2023-12-19T13:59:41.234857+0000","last_undegraded":"2023-12-19T13:59:41.234857+0000","last_fullsized":"2023-12-19T13:59:41.234857+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354421+0000","last_change":"2023-12-19T13:59:41.240770+0000","last_active":"2023-12-19T13:59:42.354421+0000","last_peered":"2023-12-19T13:59:42.354421+0000","last_clean":"2023-12-19T13:59:42.354421+0000","last_became_active":"2023-12-19T13:59:41.240398+0000","last_became_peered":"2023-12-19T13:59:41.240398+0000","last_unstale":"2023-12-19T13:59:42.354421+0000","last_undegraded":"2023-12-19T13:59:42.354421+0000","last_fullsized":"2023-12-19T13:59:42.354421+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.236681+0000","last_change":"2023-12-19T13:59:40.754706+0000","last_active":"2023-12-19T13:59:41.236681+0000","last_peered":"2023-12-19T13:59:41.236681+0000","last_clean":"2023-12-19T13:59:41.236681+0000","last_became_active":"2023-12-19T13:59:40.754288+0000","last_became_peered":"2023-12-19T13:59:40.754288+0000","last_unstale":"2023-12-19T13:59:41.236681+0000","last_undegraded":"2023-12-19T13:59:41.236681+0000","last_fullsized":"2023-12-19T13:59:41.236681+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352758+0000","last_change":"2023-12-19T13:59:41.240088+0000","last_active":"2023-12-19T13:59:42.352758+0000","last_peered":"2023-12-19T13:59:42.352758+0000","last_clean":"2023-12-19T13:59:42.352758+0000","last_became_active":"2023-12-19T13:59:41.239764+0000","last_became_peered":"2023-12-19T13:59:41.239764+0000","last_unstale":"2023-12-19T13:59:42.352758+0000","last_undegraded":"2023-12-19T13:59:42.352758+0000","last_fullsized":"2023-12-19T13:59:42.352758+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.252522+0000","last_change":"2023-12-19T13:59:40.758037+0000","last_active":"2023-12-19T13:59:41.252522+0000","last_peered":"2023-12-19T13:59:41.252522+0000","last_clean":"2023-12-19T13:59:41.252522+0000","last_became_active":"2023-12-19T13:59:40.757303+0000","last_became_peered":"2023-12-19T13:59:40.757303+0000","last_unstale":"2023-12-19T13:59:41.252522+0000","last_undegraded":"2023-12-19T13:59:41.252522+0000","last_fullsized":"2023-12-19T13:59:41.252522+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:23.997927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232033+0000","last_change":"2023-12-19T13:59:41.238081+0000","last_active":"2023-12-19T13:59:42.232033+0000","last_peered":"2023-12-19T13:59:42.232033+0000","last_clean":"2023-12-19T13:59:42.232033+0000","last_became_active":"2023-12-19T13:59:41.237709+0000","last_became_peered":"2023-12-19T13:59:41.237709+0000","last_unstale":"2023-12-19T13:59:42.232033+0000","last_undegraded":"2023-12-19T13:59:42.232033+0000","last_fullsized":"2023-12-19T13:59:42.232033+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:53:40.351475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"195'6","reported_seq":17,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.245216+0000","last_change":"2023-12-19T13:59:40.750401+0000","last_active":"2023-12-19T13:59:41.245216+0000","last_peered":"2023-12-19T13:59:41.245216+0000","last_clean":"2023-12-19T13:59:41.245216+0000","last_became_active":"2023-12-19T13:59:40.750050+0000","last_became_peered":"2023-12-19T13:59:40.750050+0000","last_unstale":"2023-12-19T13:59:41.245216+0000","last_undegraded":"2023-12-19T13:59:41.245216+0000","last_fullsized":"2023-12-19T13:59:41.245216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:54.455895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354682+0000","last_change":"2023-12-19T13:59:41.232936+0000","last_active":"2023-12-19T13:59:42.354682+0000","last_peered":"2023-12-19T13:59:42.354682+0000","last_clean":"2023-12-19T13:59:42.354682+0000","last_became_active":"2023-12-19T13:59:41.231124+0000","last_became_peered":"2023-12-19T13:59:41.231124+0000","last_unstale":"2023-12-19T13:59:42.354682+0000","last_undegraded":"2023-12-19T13:59:42.354682+0000","last_fullsized":"2023-12-19T13:59:42.354682+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:26.244097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.241380+0000","last_change":"2023-12-19T13:59:40.753740+0000","last_active":"2023-12-19T13:59:41.241380+0000","last_peered":"2023-12-19T13:59:41.241380+0000","last_clean":"2023-12-19T13:59:41.241380+0000","last_became_active":"2023-12-19T13:59:40.753400+0000","last_became_peered":"2023-12-19T13:59:40.753400+0000","last_unstale":"2023-12-19T13:59:41.241380+0000","last_undegraded":"2023-12-19T13:59:41.241380+0000","last_fullsized":"2023-12-19T13:59:41.241380+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354038+0000","last_change":"2023-12-19T13:59:41.246381+0000","last_active":"2023-12-19T13:59:42.354038+0000","last_peered":"2023-12-19T13:59:42.354038+0000","last_clean":"2023-12-19T13:59:42.354038+0000","last_became_active":"2023-12-19T13:59:41.245531+0000","last_became_peered":"2023-12-19T13:59:41.245531+0000","last_unstale":"2023-12-19T13:59:42.354038+0000","last_undegraded":"2023-12-19T13:59:42.354038+0000","last_fullsized":"2023-12-19T13:59:42.354038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:51.275689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229294+0000","last_change":"2023-12-19T13:59:40.754054+0000","last_active":"2023-12-19T13:59:41.229294+0000","last_peered":"2023-12-19T13:59:41.229294+0000","last_clean":"2023-12-19T13:59:41.229294+0000","last_became_active":"2023-12-19T13:59:40.753792+0000","last_became_peered":"2023-12-19T13:59:40.753792+0000","last_unstale":"2023-12-19T13:59:41.229294+0000","last_undegraded":"2023-12-19T13:59:41.229294+0000","last_fullsized":"2023-12-19T13:59:41.229294+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:27.254354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233120+0000","last_change":"2023-12-19T13:59:41.243143+0000","last_active":"2023-12-19T13:59:42.233120+0000","last_peered":"2023-12-19T13:59:42.233120+0000","last_clean":"2023-12-19T13:59:42.233120+0000","last_became_active":"2023-12-19T13:59:41.242704+0000","last_became_peered":"2023-12-19T13:59:41.242704+0000","last_unstale":"2023-12-19T13:59:42.233120+0000","last_undegraded":"2023-12-19T13:59:42.233120+0000","last_fullsized":"2023-12-19T13:59:42.233120+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229667+0000","last_change":"2023-12-19T13:59:40.755123+0000","last_active":"2023-12-19T13:59:41.229667+0000","last_peered":"2023-12-19T13:59:41.229667+0000","last_clean":"2023-12-19T13:59:41.229667+0000","last_became_active":"2023-12-19T13:59:40.751688+0000","last_became_peered":"2023-12-19T13:59:40.751688+0000","last_unstale":"2023-12-19T13:59:41.229667+0000","last_undegraded":"2023-12-19T13:59:41.229667+0000","last_fullsized":"2023-12-19T13:59:41.229667+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:56.900887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135237+0000","last_change":"2023-12-19T13:59:41.240461+0000","last_active":"2023-12-19T13:59:43.135237+0000","last_peered":"2023-12-19T13:59:43.135237+0000","last_clean":"2023-12-19T13:59:43.135237+0000","last_became_active":"2023-12-19T13:59:41.240163+0000","last_became_peered":"2023-12-19T13:59:41.240163+0000","last_unstale":"2023-12-19T13:59:43.135237+0000","last_undegraded":"2023-12-19T13:59:43.135237+0000","last_fullsized":"2023-12-19T13:59:43.135237+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"195'8","reported_seq":19,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.233844+0000","last_change":"2023-12-19T13:59:40.755661+0000","last_active":"2023-12-19T13:59:41.233844+0000","last_peered":"2023-12-19T13:59:41.233844+0000","last_clean":"2023-12-19T13:59:41.233844+0000","last_became_active":"2023-12-19T13:59:40.755379+0000","last_became_peered":"2023-12-19T13:59:40.755379+0000","last_unstale":"2023-12-19T13:59:41.233844+0000","last_undegraded":"2023-12-19T13:59:41.233844+0000","last_fullsized":"2023-12-19T13:59:41.233844+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:03:01.484380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353930+0000","last_change":"2023-12-19T13:59:41.250060+0000","last_active":"2023-12-19T13:59:42.353930+0000","last_peered":"2023-12-19T13:59:42.353930+0000","last_clean":"2023-12-19T13:59:42.353930+0000","last_became_active":"2023-12-19T13:59:41.249203+0000","last_became_peered":"2023-12-19T13:59:41.249203+0000","last_unstale":"2023-12-19T13:59:42.353930+0000","last_undegraded":"2023-12-19T13:59:42.353930+0000","last_fullsized":"2023-12-19T13:59:42.353930+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.231326+0000","last_change":"2023-12-19T13:59:40.751375+0000","last_active":"2023-12-19T13:59:41.231326+0000","last_peered":"2023-12-19T13:59:41.231326+0000","last_clean":"2023-12-19T13:59:41.231326+0000","last_became_active":"2023-12-19T13:59:40.751136+0000","last_became_peered":"2023-12-19T13:59:40.751136+0000","last_unstale":"2023-12-19T13:59:41.231326+0000","last_undegraded":"2023-12-19T13:59:41.231326+0000","last_fullsized":"2023-12-19T13:59:41.231326+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:01.897389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136255+0000","last_change":"2023-12-19T13:59:41.237066+0000","last_active":"2023-12-19T13:59:43.136255+0000","last_peered":"2023-12-19T13:59:43.136255+0000","last_clean":"2023-12-19T13:59:43.136255+0000","last_became_active":"2023-12-19T13:59:41.236720+0000","last_became_peered":"2023-12-19T13:59:41.236720+0000","last_unstale":"2023-12-19T13:59:43.136255+0000","last_undegraded":"2023-12-19T13:59:43.136255+0000","last_fullsized":"2023-12-19T13:59:43.136255+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:39.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.242274+0000","last_change":"2023-12-19T13:59:40.742871+0000","last_active":"2023-12-19T13:59:41.242274+0000","last_peered":"2023-12-19T13:59:41.242274+0000","last_clean":"2023-12-19T13:59:41.242274+0000","last_became_active":"2023-12-19T13:59:40.739429+0000","last_became_peered":"2023-12-19T13:59:40.739429+0000","last_unstale":"2023-12-19T13:59:41.242274+0000","last_undegraded":"2023-12-19T13:59:41.242274+0000","last_fullsized":"2023-12-19T13:59:41.242274+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135773+0000","last_change":"2023-12-19T13:59:41.248711+0000","last_active":"2023-12-19T13:59:43.135773+0000","last_peered":"2023-12-19T13:59:43.135773+0000","last_clean":"2023-12-19T13:59:43.135773+0000","last_became_active":"2023-12-19T13:59:41.248451+0000","last_became_peered":"2023-12-19T13:59:41.248451+0000","last_unstale":"2023-12-19T13:59:43.135773+0000","last_undegraded":"2023-12-19T13:59:43.135773+0000","last_fullsized":"2023-12-19T13:59:43.135773+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:24.303264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.241056+0000","last_change":"2023-12-19T13:59:40.752367+0000","last_active":"2023-12-19T13:59:41.241056+0000","last_peered":"2023-12-19T13:59:41.241056+0000","last_clean":"2023-12-19T13:59:41.241056+0000","last_became_active":"2023-12-19T13:59:40.752125+0000","last_became_peered":"2023-12-19T13:59:40.752125+0000","last_unstale":"2023-12-19T13:59:41.241056+0000","last_undegraded":"2023-12-19T13:59:41.241056+0000","last_fullsized":"2023-12-19T13:59:41.241056+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:32.613084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352855+0000","last_change":"2023-12-19T13:59:41.247167+0000","last_active":"2023-12-19T13:59:42.352855+0000","last_peered":"2023-12-19T13:59:42.352855+0000","last_clean":"2023-12-19T13:59:42.352855+0000","last_became_active":"2023-12-19T13:59:41.246824+0000","last_became_peered":"2023-12-19T13:59:41.246824+0000","last_unstale":"2023-12-19T13:59:42.352855+0000","last_undegraded":"2023-12-19T13:59:42.352855+0000","last_fullsized":"2023-12-19T13:59:42.352855+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218993+0000","last_change":"2023-12-19T13:59:40.754731+0000","last_active":"2023-12-19T13:59:41.218993+0000","last_peered":"2023-12-19T13:59:41.218993+0000","last_clean":"2023-12-19T13:59:41.218993+0000","last_became_active":"2023-12-19T13:59:40.750725+0000","last_became_peered":"2023-12-19T13:59:40.750725+0000","last_unstale":"2023-12-19T13:59:41.218993+0000","last_undegraded":"2023-12-19T13:59:41.218993+0000","last_fullsized":"2023-12-19T13:59:41.218993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:35.922857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232092+0000","last_change":"2023-12-19T13:59:41.242805+0000","last_active":"2023-12-19T13:59:42.232092+0000","last_peered":"2023-12-19T13:59:42.232092+0000","last_clean":"2023-12-19T13:59:42.232092+0000","last_became_active":"2023-12-19T13:59:41.242397+0000","last_became_peered":"2023-12-19T13:59:41.242397+0000","last_unstale":"2023-12-19T13:59:42.232092+0000","last_undegraded":"2023-12-19T13:59:42.232092+0000","last_fullsized":"2023-12-19T13:59:42.232092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:55:10.819607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.252682+0000","last_change":"2023-12-19T13:59:40.756603+0000","last_active":"2023-12-19T13:59:41.252682+0000","last_peered":"2023-12-19T13:59:41.252682+0000","last_clean":"2023-12-19T13:59:41.252682+0000","last_became_active":"2023-12-19T13:59:40.754960+0000","last_became_peered":"2023-12-19T13:59:40.754960+0000","last_unstale":"2023-12-19T13:59:41.252682+0000","last_undegraded":"2023-12-19T13:59:41.252682+0000","last_fullsized":"2023-12-19T13:59:41.252682+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:10.622788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353206+0000","last_change":"2023-12-19T13:59:41.250110+0000","last_active":"2023-12-19T13:59:42.353206+0000","last_peered":"2023-12-19T13:59:42.353206+0000","last_clean":"2023-12-19T13:59:42.353206+0000","last_became_active":"2023-12-19T13:59:41.249509+0000","last_became_peered":"2023-12-19T13:59:41.249509+0000","last_unstale":"2023-12-19T13:59:42.353206+0000","last_undegraded":"2023-12-19T13:59:42.353206+0000","last_fullsized":"2023-12-19T13:59:42.353206+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:13.046781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218101+0000","last_change":"2023-12-19T13:59:40.743247+0000","last_active":"2023-12-19T13:59:41.218101+0000","last_peered":"2023-12-19T13:59:41.218101+0000","last_clean":"2023-12-19T13:59:41.218101+0000","last_became_active":"2023-12-19T13:59:40.742681+0000","last_became_peered":"2023-12-19T13:59:40.742681+0000","last_unstale":"2023-12-19T13:59:41.218101+0000","last_undegraded":"2023-12-19T13:59:41.218101+0000","last_fullsized":"2023-12-19T13:59:41.218101+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:59.840480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232978+0000","last_change":"2023-12-19T13:59:41.235473+0000","last_active":"2023-12-19T13:59:42.232978+0000","last_peered":"2023-12-19T13:59:42.232978+0000","last_clean":"2023-12-19T13:59:42.232978+0000","last_became_active":"2023-12-19T13:59:41.235312+0000","last_became_peered":"2023-12-19T13:59:41.235312+0000","last_unstale":"2023-12-19T13:59:42.232978+0000","last_undegraded":"2023-12-19T13:59:42.232978+0000","last_fullsized":"2023-12-19T13:59:42.232978+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:23.270911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.226262+0000","last_change":"2023-12-19T13:59:40.754422+0000","last_active":"2023-12-19T13:59:41.226262+0000","last_peered":"2023-12-19T13:59:41.226262+0000","last_clean":"2023-12-19T13:59:41.226262+0000","last_became_active":"2023-12-19T13:59:40.754095+0000","last_became_peered":"2023-12-19T13:59:40.754095+0000","last_unstale":"2023-12-19T13:59:41.226262+0000","last_undegraded":"2023-12-19T13:59:41.226262+0000","last_fullsized":"2023-12-19T13:59:41.226262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354177+0000","last_change":"2023-12-19T13:59:41.229774+0000","last_active":"2023-12-19T13:59:42.354177+0000","last_peered":"2023-12-19T13:59:42.354177+0000","last_clean":"2023-12-19T13:59:42.354177+0000","last_became_active":"2023-12-19T13:59:41.229064+0000","last_became_peered":"2023-12-19T13:59:41.229064+0000","last_unstale":"2023-12-19T13:59:42.354177+0000","last_undegraded":"2023-12-19T13:59:42.354177+0000","last_fullsized":"2023-12-19T13:59:42.354177+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:48.988107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218208+0000","last_change":"2023-12-19T13:59:40.737867+0000","last_active":"2023-12-19T13:59:41.218208+0000","last_peered":"2023-12-19T13:59:41.218208+0000","last_clean":"2023-12-19T13:59:41.218208+0000","last_became_active":"2023-12-19T13:59:40.737071+0000","last_became_peered":"2023-12-19T13:59:40.737071+0000","last_unstale":"2023-12-19T13:59:41.218208+0000","last_undegraded":"2023-12-19T13:59:41.218208+0000","last_fullsized":"2023-12-19T13:59:41.218208+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:42.399866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353497+0000","last_change":"2023-12-19T13:59:41.249766+0000","last_active":"2023-12-19T13:59:42.353497+0000","last_peered":"2023-12-19T13:59:42.353497+0000","last_clean":"2023-12-19T13:59:42.353497+0000","last_became_active":"2023-12-19T13:59:41.247736+0000","last_became_peered":"2023-12-19T13:59:41.247736+0000","last_unstale":"2023-12-19T13:59:42.353497+0000","last_undegraded":"2023-12-19T13:59:42.353497+0000","last_fullsized":"2023-12-19T13:59:42.353497+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:32.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.245837+0000","last_change":"2023-12-19T13:59:40.749251+0000","last_active":"2023-12-19T13:59:41.245837+0000","last_peered":"2023-12-19T13:59:41.245837+0000","last_clean":"2023-12-19T13:59:41.245837+0000","last_became_active":"2023-12-19T13:59:40.748175+0000","last_became_peered":"2023-12-19T13:59:40.748175+0000","last_unstale":"2023-12-19T13:59:41.245837+0000","last_undegraded":"2023-12-19T13:59:41.245837+0000","last_fullsized":"2023-12-19T13:59:41.245837+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:20.161760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136152+0000","last_change":"2023-12-19T13:59:41.242349+0000","last_active":"2023-12-19T13:59:43.136152+0000","last_peered":"2023-12-19T13:59:43.136152+0000","last_clean":"2023-12-19T13:59:43.136152+0000","last_became_active":"2023-12-19T13:59:41.241320+0000","last_became_peered":"2023-12-19T13:59:41.241320+0000","last_unstale":"2023-12-19T13:59:43.136152+0000","last_undegraded":"2023-12-19T13:59:43.136152+0000","last_fullsized":"2023-12-19T13:59:43.136152+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:43.809350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"196'1","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351249+0000","last_change":"2023-12-19T13:59:40.754238+0000","last_active":"2023-12-19T13:59:42.351249+0000","last_peered":"2023-12-19T13:59:42.351249+0000","last_clean":"2023-12-19T13:59:42.351249+0000","last_became_active":"2023-12-19T13:59:40.754008+0000","last_became_peered":"2023-12-19T13:59:40.754008+0000","last_unstale":"2023-12-19T13:59:42.351249+0000","last_undegraded":"2023-12-19T13:59:42.351249+0000","last_fullsized":"2023-12-19T13:59:42.351249+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:34:34.051846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135613+0000","last_change":"2023-12-19T13:59:41.238293+0000","last_active":"2023-12-19T13:59:43.135613+0000","last_peered":"2023-12-19T13:59:43.135613+0000","last_clean":"2023-12-19T13:59:43.135613+0000","last_became_active":"2023-12-19T13:59:41.237440+0000","last_became_peered":"2023-12-19T13:59:41.237440+0000","last_unstale":"2023-12-19T13:59:43.135613+0000","last_undegraded":"2023-12-19T13:59:43.135613+0000","last_fullsized":"2023-12-19T13:59:43.135613+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:13.046781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228562+0000","last_change":"2023-12-19T13:59:40.758774+0000","last_active":"2023-12-19T13:59:41.228562+0000","last_peered":"2023-12-19T13:59:41.228562+0000","last_clean":"2023-12-19T13:59:41.228562+0000","last_became_active":"2023-12-19T13:59:40.758506+0000","last_became_peered":"2023-12-19T13:59:40.758506+0000","last_unstale":"2023-12-19T13:59:41.228562+0000","last_undegraded":"2023-12-19T13:59:41.228562+0000","last_fullsized":"2023-12-19T13:59:41.228562+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:43.569437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136512+0000","last_change":"2023-12-19T13:59:41.241804+0000","last_active":"2023-12-19T13:59:43.136512+0000","last_peered":"2023-12-19T13:59:43.136512+0000","last_clean":"2023-12-19T13:59:43.136512+0000","last_became_active":"2023-12-19T13:59:41.241542+0000","last_became_peered":"2023-12-19T13:59:41.241542+0000","last_unstale":"2023-12-19T13:59:43.136512+0000","last_undegraded":"2023-12-19T13:59:43.136512+0000","last_fullsized":"2023-12-19T13:59:43.136512+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.234971+0000","last_change":"2023-12-19T13:59:40.756150+0000","last_active":"2023-12-19T13:59:41.234971+0000","last_peered":"2023-12-19T13:59:41.234971+0000","last_clean":"2023-12-19T13:59:41.234971+0000","last_became_active":"2023-12-19T13:59:40.755399+0000","last_became_peered":"2023-12-19T13:59:40.755399+0000","last_unstale":"2023-12-19T13:59:41.234971+0000","last_undegraded":"2023-12-19T13:59:41.234971+0000","last_fullsized":"2023-12-19T13:59:41.234971+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:51.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233385+0000","last_change":"2023-12-19T13:59:41.246300+0000","last_active":"2023-12-19T13:59:42.233385+0000","last_peered":"2023-12-19T13:59:42.233385+0000","last_clean":"2023-12-19T13:59:42.233385+0000","last_became_active":"2023-12-19T13:59:41.245455+0000","last_became_peered":"2023-12-19T13:59:41.245455+0000","last_unstale":"2023-12-19T13:59:42.233385+0000","last_undegraded":"2023-12-19T13:59:42.233385+0000","last_fullsized":"2023-12-19T13:59:42.233385+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222725+0000","last_change":"2023-12-19T13:59:40.756950+0000","last_active":"2023-12-19T13:59:41.222725+0000","last_peered":"2023-12-19T13:59:41.222725+0000","last_clean":"2023-12-19T13:59:41.222725+0000","last_became_active":"2023-12-19T13:59:40.756683+0000","last_became_peered":"2023-12-19T13:59:40.756683+0000","last_unstale":"2023-12-19T13:59:41.222725+0000","last_undegraded":"2023-12-19T13:59:41.222725+0000","last_fullsized":"2023-12-19T13:59:41.222725+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:40:10.283382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233194+0000","last_change":"2023-12-19T13:59:41.242433+0000","last_active":"2023-12-19T13:59:42.233194+0000","last_peered":"2023-12-19T13:59:42.233194+0000","last_clean":"2023-12-19T13:59:42.233194+0000","last_became_active":"2023-12-19T13:59:41.241707+0000","last_became_peered":"2023-12-19T13:59:41.241707+0000","last_unstale":"2023-12-19T13:59:42.233194+0000","last_undegraded":"2023-12-19T13:59:42.233194+0000","last_fullsized":"2023-12-19T13:59:42.233194+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229814+0000","last_change":"2023-12-19T13:59:40.756938+0000","last_active":"2023-12-19T13:59:41.229814+0000","last_peered":"2023-12-19T13:59:41.229814+0000","last_clean":"2023-12-19T13:59:41.229814+0000","last_became_active":"2023-12-19T13:59:40.756694+0000","last_became_peered":"2023-12-19T13:59:40.756694+0000","last_unstale":"2023-12-19T13:59:41.229814+0000","last_undegraded":"2023-12-19T13:59:41.229814+0000","last_fullsized":"2023-12-19T13:59:41.229814+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:40.342502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353025+0000","last_change":"2023-12-19T13:59:41.243143+0000","last_active":"2023-12-19T13:59:42.353025+0000","last_peered":"2023-12-19T13:59:42.353025+0000","last_clean":"2023-12-19T13:59:42.353025+0000","last_became_active":"2023-12-19T13:59:41.242300+0000","last_became_peered":"2023-12-19T13:59:41.242300+0000","last_unstale":"2023-12-19T13:59:42.353025+0000","last_undegraded":"2023-12-19T13:59:42.353025+0000","last_fullsized":"2023-12-19T13:59:42.353025+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:00.217591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.231079+0000","last_change":"2023-12-19T13:59:40.758915+0000","last_active":"2023-12-19T13:59:41.231079+0000","last_peered":"2023-12-19T13:59:41.231079+0000","last_clean":"2023-12-19T13:59:41.231079+0000","last_became_active":"2023-12-19T13:59:40.758617+0000","last_became_peered":"2023-12-19T13:59:40.758617+0000","last_unstale":"2023-12-19T13:59:41.231079+0000","last_undegraded":"2023-12-19T13:59:41.231079+0000","last_fullsized":"2023-12-19T13:59:41.231079+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:24.028489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232176+0000","last_change":"2023-12-19T13:59:41.236526+0000","last_active":"2023-12-19T13:59:42.232176+0000","last_peered":"2023-12-19T13:59:42.232176+0000","last_clean":"2023-12-19T13:59:42.232176+0000","last_became_active":"2023-12-19T13:59:41.236211+0000","last_became_peered":"2023-12-19T13:59:41.236211+0000","last_unstale":"2023-12-19T13:59:42.232176+0000","last_undegraded":"2023-12-19T13:59:42.232176+0000","last_fullsized":"2023-12-19T13:59:42.232176+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:38.840494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228711+0000","last_change":"2023-12-19T13:59:40.753470+0000","last_active":"2023-12-19T13:59:41.228711+0000","last_peered":"2023-12-19T13:59:41.228711+0000","last_clean":"2023-12-19T13:59:41.228711+0000","last_became_active":"2023-12-19T13:59:40.753203+0000","last_became_peered":"2023-12-19T13:59:40.753203+0000","last_unstale":"2023-12-19T13:59:41.228711+0000","last_undegraded":"2023-12-19T13:59:41.228711+0000","last_fullsized":"2023-12-19T13:59:41.228711+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:42:17.961232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354185+0000","last_change":"2023-12-19T13:59:41.242547+0000","last_active":"2023-12-19T13:59:42.354185+0000","last_peered":"2023-12-19T13:59:42.354185+0000","last_clean":"2023-12-19T13:59:42.354185+0000","last_became_active":"2023-12-19T13:59:41.242244+0000","last_became_peered":"2023-12-19T13:59:41.242244+0000","last_unstale":"2023-12-19T13:59:42.354185+0000","last_undegraded":"2023-12-19T13:59:42.354185+0000","last_fullsized":"2023-12-19T13:59:42.354185+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:44.575284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222524+0000","last_change":"2023-12-19T13:59:40.758615+0000","last_active":"2023-12-19T13:59:41.222524+0000","last_peered":"2023-12-19T13:59:41.222524+0000","last_clean":"2023-12-19T13:59:41.222524+0000","last_became_active":"2023-12-19T13:59:40.758214+0000","last_became_peered":"2023-12-19T13:59:40.758214+0000","last_unstale":"2023-12-19T13:59:41.222524+0000","last_undegraded":"2023-12-19T13:59:41.222524+0000","last_fullsized":"2023-12-19T13:59:41.222524+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:05.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":331,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222365+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:59:41.222365+0000","last_peered":"2023-12-19T13:59:41.222365+0000","last_clean":"2023-12-19T13:59:41.222365+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:59:41.222365+0000","last_undegraded":"2023-12-19T13:59:41.222365+0000","last_fullsized":"2023-12-19T13:59:41.222365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":1.0840000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.9059999999999999},"last":1.171},{"interface":"front","average":{"1min":1.131,"5min":1.1379999999999999,"15min":1.0880000000000001},"min":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.601,"5min":1.855,"15min":2.008},"last":1.258}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1679999999999999,"15min":1.141},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.494,"5min":1.865,"15min":1.865},"last":1.355},{"interface":"front","average":{"1min":1.198,"5min":1.175,"15min":1.1359999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.54,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.4159999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.159,"15min":1.1459999999999999},"min":{"1min":0.88900000000000001,"5min":0.77600000000000002,"15min":0.57499999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.008},"last":1.081},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2829999999999999,"15min":1.222},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7090000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.879}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2649999999999999,"15min":1.2330000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.6659999999999999,"15min":2.2589999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3240000000000001,"15min":1.3029999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":1.6319999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2949999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.702,"5min":1.702,"15min":2.4089999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.359,"15min":1.367},"min":{"1min":0.83699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.901,"5min":1.901,"15min":2.6909999999999998},"last":1.498}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.218,"15min":1.2490000000000001},"min":{"1min":0.72799999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":2.3109999999999999},"last":1.121},{"interface":"front","average":{"1min":1.375,"5min":1.4279999999999999,"15min":1.429},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6359999999999999,"5min":1.7949999999999999,"15min":2.7719999999999998},"last":1.2}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.387,"15min":1.369},"min":{"1min":0.65900000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5209999999999999,"15min":1.516},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.64800000000000002},"max":{"1min":1.833,"5min":1.9390000000000001,"15min":2.673},"last":1.462}]}]},{"osd":6,"up_from":13,"seq":55834575011,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1279999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.42699999999999999},"max":{"1min":1.4530000000000001,"5min":1.663,"15min":2.0640000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.077,"15min":1.0960000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5,"5min":1.605,"15min":3.2069999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.0600000000000001},"min":{"1min":0.73199999999999998,"5min":0.64900000000000002,"15min":0.59099999999999997},"max":{"1min":1.6699999999999999,"5min":1.851,"15min":1.962},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.206,"5min":1.2190000000000001,"15min":1.1339999999999999},"min":{"1min":0.77400000000000002,"5min":0.74099999999999999,"15min":0.63800000000000001},"max":{"1min":1.595,"5min":1.671,"15min":1.671},"last":1.1850000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.319,"15min":1.2709999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.226},"min":{"1min":0.85899999999999999,"5min":0.70999999999999996,"15min":0.68100000000000005},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.0900000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.248,"15min":1.278},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":4.2690000000000001},"last":1.294},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2190000000000001,"15min":1.24},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.5669999999999999,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.04}]},{"osd":4,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.325,"15min":1.282},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.823,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3260000000000001,"15min":1.3280000000000001},"min":{"1min":0.67200000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2969999999999999,"15min":1.2869999999999999},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.8879999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.141},{"interface":"front","average":{"1min":1.369,"5min":1.47,"15min":1.4239999999999999},"min":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.962,"5min":2.117,"15min":2.169},"last":1.681}]},{"osd":7,"last update":"Tue Dec 19 13:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.46,"15min":1.446},"min":{"1min":0.80100000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8919999999999999,"5min":1.9570000000000001,"15min":2.5419999999999998},"last":1.605},{"interface":"front","average":{"1min":1.383,"5min":1.4470000000000001,"15min":1.4139999999999999},"min":{"1min":0.89300000000000002,"5min":0.747,"15min":0.57999999999999996},"max":{"1min":1.7509999999999999,"5min":2.141,"15min":2.141},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575011,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193653,"statfs":{"total":200000000,"available":198301643,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0880000000000001,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.631,"5min":1.631,"15min":1.835},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.645,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":0.92400000000000004}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.5549999999999999,"15min":6.101},"last":1.494},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.155,"15min":1.1220000000000001},"min":{"1min":0.70599999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.617,"5min":1.6439999999999999,"15min":2.077},"last":0.82399999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6439999999999999,"5min":1.72,"15min":5.5350000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.208,"15min":1.2270000000000001},"min":{"1min":0.85399999999999998,"5min":0.80500000000000005,"15min":0.66400000000000003},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.863},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.6599999999999999,"15min":5.6189999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.333,"15min":1.292},"min":{"1min":1.002,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.6200000000000001,"5min":1.752,"15min":1.8360000000000001},"last":1.238}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.264,"15min":1.2150000000000001},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.5429999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.46},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.734,"5min":1.798,"15min":5.6970000000000001},"last":1.585}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":1.919,"15min":2.0310000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3939999999999999,"15min":1.379},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6970000000000001,"5min":1.853,"15min":2.133},"last":1.5489999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.462,"15min":1.4690000000000001},"min":{"1min":1.1919999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.8260000000000001,"5min":1.893,"15min":6.3959999999999999},"last":1.712},{"interface":"front","average":{"1min":1.496,"5min":1.498,"15min":1.4830000000000001},"min":{"1min":1.1930000000000001,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.6819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.091,"15min":1.0509999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4350000000000001,"5min":1.679,"15min":2.1349999999999998},"last":1.411},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.143,"15min":1.1180000000000001},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.48799999999999999},"max":{"1min":1.4750000000000001,"5min":2.448,"15min":2.448},"last":0.96599999999999997}]},{"osd":1,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1519999999999999,"15min":1.0980000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.55,"5min":1.754,"15min":1.754},"last":0.878},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.50700000000000001},"max":{"1min":1.5509999999999999,"5min":3.117,"15min":3.117},"last":1.504}]},{"osd":2,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.21,"15min":1.1339999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5309999999999999,"5min":2.613,"15min":2.613},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.7070000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.032}]},{"osd":3,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2929999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.409,"5min":2.653,"15min":2.653},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.214}]},{"osd":5,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.278,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.51700000000000002},"max":{"1min":1.647,"5min":3.625,"15min":3.625},"last":1.345},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5940000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.1839999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.415,"15min":1.375},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.921,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4419999999999999,"15min":1.4179999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.52200000000000002},"max":{"1min":1.7829999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.458}]},{"osd":7,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5589999999999999,"15min":1.498},"min":{"1min":0.77000000000000002,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.746,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.593,"15min":1.5449999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.829,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.4339999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1082,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194229,"statfs":{"total":200000000,"available":198891097,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":0.83899999999999997},"min":{"1min":0.67500000000000004,"5min":0.36499999999999999,"15min":0.249},"max":{"1min":1.2050000000000001,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.751},{"interface":"front","average":{"1min":1.032,"5min":0.95799999999999996,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.5609999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.82999999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.877,"15min":0.88},"min":{"1min":0.63500000000000001,"5min":0.46600000000000003,"15min":0.32800000000000001},"max":{"1min":1.137,"5min":1.413,"15min":5.3769999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.026,"15min":0.96199999999999997},"min":{"1min":0.83599999999999997,"5min":0.40899999999999997,"15min":0.29499999999999998},"max":{"1min":1.3799999999999999,"5min":1.573,"15min":2.387},"last":0.93000000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.077,"15min":1.0129999999999999},"min":{"1min":0.88600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.5820000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1000000000000001,"15min":1.0580000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.6319999999999999,"15min":2.657},"last":1}]},{"osd":4,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2909999999999999,"15min":1.2390000000000001},"min":{"1min":1.0329999999999999,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.583,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.258,"5min":1.2909999999999999,"15min":1.2370000000000001},"min":{"1min":0.90700000000000003,"5min":0.76300000000000001,"15min":0.54600000000000004},"max":{"1min":1.5269999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.095}]},{"osd":5,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.306,"15min":1.2709999999999999},"min":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.58299999999999996},"max":{"1min":1.579,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.272},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.304,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.78700000000000003,"15min":0.66700000000000004},"max":{"1min":1.655,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.242}]},{"osd":6,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":1.0820000000000001,"5min":0.76900000000000002,"15min":0.53300000000000003},"max":{"1min":1.458,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.3919999999999999,"15min":1.3340000000000001},"min":{"1min":0.95799999999999996,"5min":0.81499999999999995,"15min":0.52600000000000002},"max":{"1min":1.6819999999999999,"5min":2.077,"15min":2.698},"last":1.5880000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4159999999999999,"15min":1.3420000000000001},"min":{"1min":1.258,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":2.1160000000000001,"15min":3.609},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4399999999999999,"15min":1.3899999999999999},"min":{"1min":1.155,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.131}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194230,"statfs":{"total":200000000,"available":198892101,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.4330000000000001,"15min":2.258},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.93999999999999995,"15min":0.90600000000000003},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":11.85},"last":0.69499999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4179999999999999,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.056,"15min":1.012},"min":{"1min":0.54300000000000004,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":1.456,"5min":4.681,"15min":11.788},"last":1.155}]},{"osd":3,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":0.97499999999999998},"min":{"1min":0.57199999999999995,"5min":0.41799999999999998,"15min":0.39300000000000002},"max":{"1min":1.262,"5min":1.702,"15min":2.3109999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.1319999999999999,"15min":1.077},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7549999999999999,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":1.5}]},{"osd":4,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":11.930999999999999},"last":1.45},{"interface":"front","average":{"1min":1.236,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.873,"5min":0.72399999999999998,"15min":0.72299999999999998},"max":{"1min":1.7050000000000001,"5min":1.806,"15min":2.2189999999999999},"last":1.758}]},{"osd":5,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3240000000000001,"15min":1.3149999999999999},"min":{"1min":1.0109999999999999,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.6559999999999999,"5min":1.7170000000000001,"15min":11.888},"last":1.542},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.367,"15min":1.325},"min":{"1min":1.107,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.55,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.383}]},{"osd":6,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3440000000000001,"15min":1.3160000000000001},"min":{"1min":1.0209999999999999,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.855,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":1.665},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3400000000000001,"15min":1.2989999999999999},"min":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.786,"5min":1.9370000000000001,"15min":2.286},"last":1.885}]},{"osd":7,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4019999999999999,"15min":1.349},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.8089999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.3759999999999999,"15min":1.355},"min":{"1min":0.85399999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.77,"5min":2.323,"15min":11.962999999999999},"last":1.595}]}]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193652,"statfs":{"total":200000000,"available":198300569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.2470000000000001,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.746},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.712,"5min":1.712,"15min":3.3500000000000001},"last":1.712}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.101,"15min":1.117},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.887,"5min":1.887,"15min":5.2009999999999996},"last":1.887}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.04,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.835,"5min":1.835,"15min":3.4300000000000002},"last":1.835},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.0569999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":1.1850000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1739999999999999,"15min":1.1759999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.61699999999999999},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.292,"15min":1.274},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.583,"5min":1.661,"15min":3.7080000000000002},"last":1.448}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.226,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.456,"5min":1.796,"15min":3.8849999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2609999999999999,"15min":1.319},"min":{"1min":0.75,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.748,"5min":1.77,"15min":15.576000000000001},"last":1.2609999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.333},"min":{"1min":0.85299999999999998,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.345,"15min":1.3540000000000001},"min":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.895,"5min":1.895,"15min":3.786},"last":1.4219999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.401,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":1.599},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.355,"15min":1.363},"min":{"1min":0.92400000000000004,"5min":0.89900000000000002,"15min":0.76500000000000001},"max":{"1min":1.913,"5min":2.032,"15min":4.0519999999999996},"last":1.365}]}]},{"osd":0,"up_from":13,"seq":55834575012,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892613,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.45600000000000002,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.6399999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.497,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.6140000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.72299999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.97399999999999998,"15min":1.0429999999999999},"min":{"1min":0.79500000000000004,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.492,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.0289999999999999,"15min":1.1399999999999999},"min":{"1min":0.60199999999999998,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.2869999999999999,"5min":1.708,"15min":41.758000000000003},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.95099999999999996},"min":{"1min":0.63100000000000001,"5min":0.42099999999999999,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.109,"15min":1.0920000000000001},"min":{"1min":0.80900000000000005,"5min":0.47699999999999998,"15min":0.36499999999999999},"max":{"1min":1.407,"5min":1.7210000000000001,"15min":2.02},"last":0.89900000000000002}]},{"osd":4,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2050000000000001,"15min":1.1890000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.738,"5min":1.738,"15min":4.4269999999999996},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.2809999999999999,"15min":1.28},"min":{"1min":0.96499999999999997,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.5760000000000001,"5min":1.79,"15min":15.766},"last":0.92900000000000005}]},{"osd":5,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2629999999999999,"15min":1.27},"min":{"1min":0.94199999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.26,"15min":1.262},"min":{"1min":0.77500000000000002,"5min":0.747,"15min":0.63100000000000001},"max":{"1min":1.605,"5min":1.6919999999999999,"15min":4.3970000000000002},"last":0.95099999999999996}]},{"osd":6,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.391,"15min":1.3380000000000001},"min":{"1min":1.0940000000000001,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":1.6970000000000001,"5min":1.9470000000000001,"15min":5.4669999999999996},"last":1.159},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.762,"5min":1.8939999999999999,"15min":17.161000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3759999999999999,"15min":1.3819999999999999},"min":{"1min":0.85599999999999998,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":1.655,"5min":1.974,"15min":14.381},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.3109999999999999,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":1.8759999999999999,"5min":2.1230000000000002,"15min":9.7080000000000002},"last":1.01}]}]}],"pool_statfs":[]}} 2023-12-19T13:59:51.145 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:59:51.356 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:51.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.368+0000 7efd7ed9b640 1 Processor -- start 2023-12-19T13:59:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.368+0000 7efd7ed9b640 1 -- start start 2023-12-19T13:59:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.369+0000 7efd7ed9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd78146e30 0x7efd780b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.369+0000 7efd7ed9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efd780b7ea0 0x7efd780d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.369+0000 7efd7ed9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd780d0a90 0x7efd7806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.369+0000 7efd7ed9b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd78147210 con 0x7efd780d0a90 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7ed9b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780d2370 con 0x7efd780b7ea0 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7ed9b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b8300 con 0x7efd78146e30 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd780d0a90 0x7efd7806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd780d0a90 0x7efd7806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38808/0 (socket says 172.21.15.113:38808) 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 -- 172.21.15.113:0/2288446511 learned_addr learned my addr 172.21.15.113:0/2288446511 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7d598640 1 --2- 172.21.15.113:0/2288446511 >> v2:172.21.15.151:3300/0 conn(0x7efd780b7ea0 0x7efd780d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7dd99640 1 --2- 172.21.15.113:0/2288446511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd78146e30 0x7efd780b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 -- 172.21.15.113:0/2288446511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd78146e30 msgr2=0x7efd780b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 --2- 172.21.15.113:0/2288446511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd78146e30 0x7efd780b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 -- 172.21.15.113:0/2288446511 >> v2:172.21.15.151:3300/0 conn(0x7efd780b7ea0 msgr2=0x7efd780d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:51.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 --2- 172.21.15.113:0/2288446511 >> v2:172.21.15.151:3300/0 conn(0x7efd780b7ea0 0x7efd780d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.370+0000 7efd7e59a640 1 -- 172.21.15.113:0/2288446511 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780d12d0 con 0x7efd780d0a90 2023-12-19T13:59:51.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.371+0000 7efd7e59a640 1 --2- 172.21.15.113:0/2288446511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780d0a90 0x7efd7806f160 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7efd78066470 tx=0x7efd7002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41c3dcb63cc79cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:51.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.371+0000 7efd7cd97640 1 -- 172.21.15.113:0/2288446511 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7002c9e0 con 0x7efd780d0a90 2023-12-19T13:59:51.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.371+0000 7efd7cd97640 1 -- 172.21.15.113:0/2288446511 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7002cb40 con 0x7efd780d0a90 2023-12-19T13:59:51.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.371+0000 7efd7cd97640 1 -- 172.21.15.113:0/2288446511 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700343f0 con 0x7efd780d0a90 2023-12-19T13:59:51.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2288446511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780d0a90 msgr2=0x7efd7806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2288446511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780d0a90 0x7efd7806f160 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7efd78066470 tx=0x7efd7002be40 comp rx=0 tx=0).stop 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2288446511 shutdown_connections 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2288446511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780d0a90 0x7efd7806f160 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2288446511 >> v2:172.21.15.151:3300/0 conn(0x7efd780b7ea0 0x7efd780d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2288446511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd78146e30 0x7efd780b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2288446511 >> 172.21.15.113:0/2288446511 conn(0x7efd780b2990 msgr2=0x7efd780b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2288446511 shutdown_connections 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.373+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2288446511 wait complete. 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.375+0000 7efd7ed9b640 1 Processor -- start 2023-12-19T13:59:51.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.375+0000 7efd7ed9b640 1 -- start start 2023-12-19T13:59:51.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7ed9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780b7ea0 0x7efd78142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7ed9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd780d0a90 0x7efd780c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7ed9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd78146e30 0x7efd780cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7ed9b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780cad90 con 0x7efd780b7ea0 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7ed9b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780ca180 con 0x7efd78146e30 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7ed9b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780ca460 con 0x7efd780d0a90 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7dd99640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780b7ea0 0x7efd78142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7dd99640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780b7ea0 0x7efd78142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38820/0 (socket says 172.21.15.113:38820) 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7dd99640 1 -- 172.21.15.113:0/2106718816 learned_addr learned my addr 172.21.15.113:0/2106718816 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7d598640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd780d0a90 0x7efd780c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.376+0000 7efd7e59a640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd78146e30 0x7efd780cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7dd99640 1 -- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd780d0a90 msgr2=0x7efd780c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7dd99640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd780d0a90 0x7efd780c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7dd99640 1 -- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd78146e30 msgr2=0x7efd780cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7dd99640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd78146e30 0x7efd780cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7dd99640 1 -- 172.21.15.113:0/2106718816 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009b30 con 0x7efd780b7ea0 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7e59a640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd78146e30 0x7efd780cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7dd99640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780b7ea0 0x7efd78142b60 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7efd7400d800 tx=0x7efd7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd6e7fc640 1 -- 172.21.15.113:0/2106718816 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400b6c0 con 0x7efd780b7ea0 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd6e7fc640 1 -- 172.21.15.113:0/2106718816 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400b820 con 0x7efd780b7ea0 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd780ca740 con 0x7efd780b7ea0 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd6e7fc640 1 -- 172.21.15.113:0/2106718816 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400bbb0 con 0x7efd780b7ea0 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.377+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780cbe60 con 0x7efd780b7ea0 2023-12-19T13:59:51.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.379+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd78061910 con 0x7efd780b7ea0 2023-12-19T13:59:51.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.379+0000 7efd6e7fc640 1 -- 172.21.15.113:0/2106718816 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd7400bd10 con 0x7efd780b7ea0 2023-12-19T13:59:51.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.380+0000 7efd6e7fc640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd5c06a430 0x7efd5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.381+0000 7efd6e7fc640 1 -- 172.21.15.113:0/2106718816 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd74088e70 con 0x7efd780b7ea0 2023-12-19T13:59:51.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.381+0000 7efd7d598640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd5c06a430 0x7efd5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.382+0000 7efd7d598640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd5c06a430 0x7efd5c06c8f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efd68006fd0 tx=0x7efd68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:51.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.385+0000 7efd6e7fc640 1 -- 172.21.15.113:0/2106718816 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd74054450 con 0x7efd780b7ea0 2023-12-19T13:59:51.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.573+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd780ca5d0 con 0x7efd5c06a430 2023-12-19T13:59:51.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.582+0000 7efd6e7fc640 1 -- 172.21.15.113:0/2106718816 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282674 (secure 0 0 0) 0x7efd780ca5d0 con 0x7efd5c06a430 2023-12-19T13:59:51.583 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:51.587 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T13:59:51.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd5c06a430 msgr2=0x7efd5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd5c06a430 0x7efd5c06c8f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efd68006fd0 tx=0x7efd68008040 comp rx=0 tx=0).stop 2023-12-19T13:59:51.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780b7ea0 msgr2=0x7efd78142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780b7ea0 0x7efd78142b60 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7efd7400d800 tx=0x7efd7400dcc0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 shutdown_connections 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd5c06a430 0x7efd5c06c8f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd78146e30 0x7efd780cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd780d0a90 0x7efd780c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 --2- 172.21.15.113:0/2106718816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd780b7ea0 0x7efd78142b60 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.589+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 >> 172.21.15.113:0/2106718816 conn(0x7efd780b2990 msgr2=0x7efd780b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.590+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 shutdown_connections 2023-12-19T13:59:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.590+0000 7efd7ed9b640 1 -- 172.21.15.113:0/2106718816 wait complete. 2023-12-19T13:59:51.606 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2023-12-19T13:59:50.685987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552691,"statfs":{"total":1600000000,"available":1589956004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.467004"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232493+0000","last_change":"2023-12-19T13:59:41.242564+0000","last_active":"2023-12-19T13:59:42.232493+0000","last_peered":"2023-12-19T13:59:42.232493+0000","last_clean":"2023-12-19T13:59:42.232493+0000","last_became_active":"2023-12-19T13:59:41.241965+0000","last_became_peered":"2023-12-19T13:59:41.241965+0000","last_unstale":"2023-12-19T13:59:42.232493+0000","last_undegraded":"2023-12-19T13:59:42.232493+0000","last_fullsized":"2023-12-19T13:59:42.232493+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:32.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231924+0000","last_change":"2023-12-19T13:59:41.242978+0000","last_active":"2023-12-19T13:59:42.231924+0000","last_peered":"2023-12-19T13:59:42.231924+0000","last_clean":"2023-12-19T13:59:42.231924+0000","last_became_active":"2023-12-19T13:59:41.241144+0000","last_became_peered":"2023-12-19T13:59:41.241144+0000","last_unstale":"2023-12-19T13:59:42.231924+0000","last_undegraded":"2023-12-19T13:59:42.231924+0000","last_fullsized":"2023-12-19T13:59:42.231924+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:19.325426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232090+0000","last_change":"2023-12-19T13:59:41.237937+0000","last_active":"2023-12-19T13:59:42.232090+0000","last_peered":"2023-12-19T13:59:42.232090+0000","last_clean":"2023-12-19T13:59:42.232090+0000","last_became_active":"2023-12-19T13:59:41.237305+0000","last_became_peered":"2023-12-19T13:59:41.237305+0000","last_unstale":"2023-12-19T13:59:42.232090+0000","last_undegraded":"2023-12-19T13:59:42.232090+0000","last_fullsized":"2023-12-19T13:59:42.232090+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.011938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135449+0000","last_change":"2023-12-19T13:59:41.247807+0000","last_active":"2023-12-19T13:59:43.135449+0000","last_peered":"2023-12-19T13:59:43.135449+0000","last_clean":"2023-12-19T13:59:43.135449+0000","last_became_active":"2023-12-19T13:59:41.247553+0000","last_became_peered":"2023-12-19T13:59:41.247553+0000","last_unstale":"2023-12-19T13:59:43.135449+0000","last_undegraded":"2023-12-19T13:59:43.135449+0000","last_fullsized":"2023-12-19T13:59:43.135449+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:28:55.166135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.230037+0000","last_change":"2023-12-19T13:59:41.241641+0000","last_active":"2023-12-19T13:59:42.230037+0000","last_peered":"2023-12-19T13:59:42.230037+0000","last_clean":"2023-12-19T13:59:42.230037+0000","last_became_active":"2023-12-19T13:59:41.241409+0000","last_became_peered":"2023-12-19T13:59:41.241409+0000","last_unstale":"2023-12-19T13:59:42.230037+0000","last_undegraded":"2023-12-19T13:59:42.230037+0000","last_fullsized":"2023-12-19T13:59:42.230037+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:09:15.894760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233092+0000","last_change":"2023-12-19T13:59:41.248482+0000","last_active":"2023-12-19T13:59:42.233092+0000","last_peered":"2023-12-19T13:59:42.233092+0000","last_clean":"2023-12-19T13:59:42.233092+0000","last_became_active":"2023-12-19T13:59:41.248082+0000","last_became_peered":"2023-12-19T13:59:41.248082+0000","last_unstale":"2023-12-19T13:59:42.233092+0000","last_undegraded":"2023-12-19T13:59:42.233092+0000","last_fullsized":"2023-12-19T13:59:42.233092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:04.846345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354326+0000","last_change":"2023-12-19T13:59:41.236767+0000","last_active":"2023-12-19T13:59:42.354326+0000","last_peered":"2023-12-19T13:59:42.354326+0000","last_clean":"2023-12-19T13:59:42.354326+0000","last_became_active":"2023-12-19T13:59:41.235106+0000","last_became_peered":"2023-12-19T13:59:41.235106+0000","last_unstale":"2023-12-19T13:59:42.354326+0000","last_undegraded":"2023-12-19T13:59:42.354326+0000","last_fullsized":"2023-12-19T13:59:42.354326+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:25.034336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134754+0000","last_change":"2023-12-19T13:59:41.238951+0000","last_active":"2023-12-19T13:59:43.134754+0000","last_peered":"2023-12-19T13:59:43.134754+0000","last_clean":"2023-12-19T13:59:43.134754+0000","last_became_active":"2023-12-19T13:59:41.238736+0000","last_became_peered":"2023-12-19T13:59:41.238736+0000","last_unstale":"2023-12-19T13:59:43.134754+0000","last_undegraded":"2023-12-19T13:59:43.134754+0000","last_fullsized":"2023-12-19T13:59:43.134754+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:00.217591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134753+0000","last_change":"2023-12-19T13:59:41.245111+0000","last_active":"2023-12-19T13:59:43.134753+0000","last_peered":"2023-12-19T13:59:43.134753+0000","last_clean":"2023-12-19T13:59:43.134753+0000","last_became_active":"2023-12-19T13:59:41.243800+0000","last_became_peered":"2023-12-19T13:59:41.243800+0000","last_unstale":"2023-12-19T13:59:43.134753+0000","last_undegraded":"2023-12-19T13:59:43.134753+0000","last_fullsized":"2023-12-19T13:59:43.134753+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.134743+0000","last_change":"2023-12-19T13:59:41.242728+0000","last_active":"2023-12-19T13:59:43.134743+0000","last_peered":"2023-12-19T13:59:43.134743+0000","last_clean":"2023-12-19T13:59:43.134743+0000","last_became_active":"2023-12-19T13:59:41.242497+0000","last_became_peered":"2023-12-19T13:59:41.242497+0000","last_unstale":"2023-12-19T13:59:43.134743+0000","last_undegraded":"2023-12-19T13:59:43.134743+0000","last_fullsized":"2023-12-19T13:59:43.134743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229680+0000","last_change":"2023-12-19T13:59:41.247111+0000","last_active":"2023-12-19T13:59:42.229680+0000","last_peered":"2023-12-19T13:59:42.229680+0000","last_clean":"2023-12-19T13:59:42.229680+0000","last_became_active":"2023-12-19T13:59:41.246891+0000","last_became_peered":"2023-12-19T13:59:41.246891+0000","last_unstale":"2023-12-19T13:59:42.229680+0000","last_undegraded":"2023-12-19T13:59:42.229680+0000","last_fullsized":"2023-12-19T13:59:42.229680+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:50:48.963616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351038+0000","last_change":"2023-12-19T13:59:41.233205+0000","last_active":"2023-12-19T13:59:42.351038+0000","last_peered":"2023-12-19T13:59:42.351038+0000","last_clean":"2023-12-19T13:59:42.351038+0000","last_became_active":"2023-12-19T13:59:41.233027+0000","last_became_peered":"2023-12-19T13:59:41.233027+0000","last_unstale":"2023-12-19T13:59:42.351038+0000","last_undegraded":"2023-12-19T13:59:42.351038+0000","last_fullsized":"2023-12-19T13:59:42.351038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:47.128360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351040+0000","last_change":"2023-12-19T13:59:41.250248+0000","last_active":"2023-12-19T13:59:42.351040+0000","last_peered":"2023-12-19T13:59:42.351040+0000","last_clean":"2023-12-19T13:59:42.351040+0000","last_became_active":"2023-12-19T13:59:41.250010+0000","last_became_peered":"2023-12-19T13:59:41.250010+0000","last_unstale":"2023-12-19T13:59:42.351040+0000","last_undegraded":"2023-12-19T13:59:42.351040+0000","last_fullsized":"2023-12-19T13:59:42.351040+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:01:23.346929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135052+0000","last_change":"2023-12-19T13:59:41.241997+0000","last_active":"2023-12-19T13:59:43.135052+0000","last_peered":"2023-12-19T13:59:43.135052+0000","last_clean":"2023-12-19T13:59:43.135052+0000","last_became_active":"2023-12-19T13:59:41.241781+0000","last_became_peered":"2023-12-19T13:59:41.241781+0000","last_unstale":"2023-12-19T13:59:43.135052+0000","last_undegraded":"2023-12-19T13:59:43.135052+0000","last_fullsized":"2023-12-19T13:59:43.135052+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:26.244097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135017+0000","last_change":"2023-12-19T13:59:41.247859+0000","last_active":"2023-12-19T13:59:43.135017+0000","last_peered":"2023-12-19T13:59:43.135017+0000","last_clean":"2023-12-19T13:59:43.135017+0000","last_became_active":"2023-12-19T13:59:41.247512+0000","last_became_peered":"2023-12-19T13:59:41.247512+0000","last_unstale":"2023-12-19T13:59:43.135017+0000","last_undegraded":"2023-12-19T13:59:43.135017+0000","last_fullsized":"2023-12-19T13:59:43.135017+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354167+0000","last_change":"2023-12-19T13:59:41.233301+0000","last_active":"2023-12-19T13:59:42.354167+0000","last_peered":"2023-12-19T13:59:42.354167+0000","last_clean":"2023-12-19T13:59:42.354167+0000","last_became_active":"2023-12-19T13:59:41.232270+0000","last_became_peered":"2023-12-19T13:59:41.232270+0000","last_unstale":"2023-12-19T13:59:42.354167+0000","last_undegraded":"2023-12-19T13:59:42.354167+0000","last_fullsized":"2023-12-19T13:59:42.354167+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233862+0000","last_change":"2023-12-19T13:59:41.245683+0000","last_active":"2023-12-19T13:59:42.233862+0000","last_peered":"2023-12-19T13:59:42.233862+0000","last_clean":"2023-12-19T13:59:42.233862+0000","last_became_active":"2023-12-19T13:59:41.243550+0000","last_became_peered":"2023-12-19T13:59:41.243550+0000","last_unstale":"2023-12-19T13:59:42.233862+0000","last_undegraded":"2023-12-19T13:59:42.233862+0000","last_fullsized":"2023-12-19T13:59:42.233862+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135151+0000","last_change":"2023-12-19T13:59:41.237992+0000","last_active":"2023-12-19T13:59:43.135151+0000","last_peered":"2023-12-19T13:59:43.135151+0000","last_clean":"2023-12-19T13:59:43.135151+0000","last_became_active":"2023-12-19T13:59:41.237713+0000","last_became_peered":"2023-12-19T13:59:41.237713+0000","last_unstale":"2023-12-19T13:59:43.135151+0000","last_undegraded":"2023-12-19T13:59:43.135151+0000","last_fullsized":"2023-12-19T13:59:43.135151+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:29:36.573957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353790+0000","last_change":"2023-12-19T13:59:41.236497+0000","last_active":"2023-12-19T13:59:42.353790+0000","last_peered":"2023-12-19T13:59:42.353790+0000","last_clean":"2023-12-19T13:59:42.353790+0000","last_became_active":"2023-12-19T13:59:41.236253+0000","last_became_peered":"2023-12-19T13:59:41.236253+0000","last_unstale":"2023-12-19T13:59:42.353790+0000","last_undegraded":"2023-12-19T13:59:42.353790+0000","last_fullsized":"2023-12-19T13:59:42.353790+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.350981+0000","last_change":"2023-12-19T13:59:41.223055+0000","last_active":"2023-12-19T13:59:42.350981+0000","last_peered":"2023-12-19T13:59:42.350981+0000","last_clean":"2023-12-19T13:59:42.350981+0000","last_became_active":"2023-12-19T13:59:41.222909+0000","last_became_peered":"2023-12-19T13:59:41.222909+0000","last_unstale":"2023-12-19T13:59:42.350981+0000","last_undegraded":"2023-12-19T13:59:42.350981+0000","last_fullsized":"2023-12-19T13:59:42.350981+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:20.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233271+0000","last_change":"2023-12-19T13:59:41.232831+0000","last_active":"2023-12-19T13:59:42.233271+0000","last_peered":"2023-12-19T13:59:42.233271+0000","last_clean":"2023-12-19T13:59:42.233271+0000","last_became_active":"2023-12-19T13:59:41.232491+0000","last_became_peered":"2023-12-19T13:59:41.232491+0000","last_unstale":"2023-12-19T13:59:42.233271+0000","last_undegraded":"2023-12-19T13:59:42.233271+0000","last_fullsized":"2023-12-19T13:59:42.233271+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229028+0000","last_change":"2023-12-19T13:59:41.249345+0000","last_active":"2023-12-19T13:59:42.229028+0000","last_peered":"2023-12-19T13:59:42.229028+0000","last_clean":"2023-12-19T13:59:42.229028+0000","last_became_active":"2023-12-19T13:59:41.249209+0000","last_became_peered":"2023-12-19T13:59:41.249209+0000","last_unstale":"2023-12-19T13:59:42.229028+0000","last_undegraded":"2023-12-19T13:59:42.229028+0000","last_fullsized":"2023-12-19T13:59:42.229028+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:40.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352951+0000","last_change":"2023-12-19T13:59:41.249931+0000","last_active":"2023-12-19T13:59:42.352951+0000","last_peered":"2023-12-19T13:59:42.352951+0000","last_clean":"2023-12-19T13:59:42.352951+0000","last_became_active":"2023-12-19T13:59:41.248821+0000","last_became_peered":"2023-12-19T13:59:41.248821+0000","last_unstale":"2023-12-19T13:59:42.352951+0000","last_undegraded":"2023-12-19T13:59:42.352951+0000","last_fullsized":"2023-12-19T13:59:42.352951+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:42.764784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.228902+0000","last_change":"2023-12-19T13:59:41.241869+0000","last_active":"2023-12-19T13:59:42.228902+0000","last_peered":"2023-12-19T13:59:42.228902+0000","last_clean":"2023-12-19T13:59:42.228902+0000","last_became_active":"2023-12-19T13:59:41.241628+0000","last_became_peered":"2023-12-19T13:59:41.241628+0000","last_unstale":"2023-12-19T13:59:42.228902+0000","last_undegraded":"2023-12-19T13:59:42.228902+0000","last_fullsized":"2023-12-19T13:59:42.228902+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:06.319730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.230147+0000","last_change":"2023-12-19T13:59:41.235933+0000","last_active":"2023-12-19T13:59:42.230147+0000","last_peered":"2023-12-19T13:59:42.230147+0000","last_clean":"2023-12-19T13:59:42.230147+0000","last_became_active":"2023-12-19T13:59:41.235709+0000","last_became_peered":"2023-12-19T13:59:41.235709+0000","last_unstale":"2023-12-19T13:59:42.230147+0000","last_undegraded":"2023-12-19T13:59:42.230147+0000","last_fullsized":"2023-12-19T13:59:42.230147+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:17.967495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353278+0000","last_change":"2023-12-19T13:59:41.246586+0000","last_active":"2023-12-19T13:59:42.353278+0000","last_peered":"2023-12-19T13:59:42.353278+0000","last_clean":"2023-12-19T13:59:42.353278+0000","last_became_active":"2023-12-19T13:59:41.246110+0000","last_became_peered":"2023-12-19T13:59:41.246110+0000","last_unstale":"2023-12-19T13:59:42.353278+0000","last_undegraded":"2023-12-19T13:59:42.353278+0000","last_fullsized":"2023-12-19T13:59:42.353278+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:23.752394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.229265+0000","last_change":"2023-12-19T13:59:41.231910+0000","last_active":"2023-12-19T13:59:42.229265+0000","last_peered":"2023-12-19T13:59:42.229265+0000","last_clean":"2023-12-19T13:59:42.229265+0000","last_became_active":"2023-12-19T13:59:41.231746+0000","last_became_peered":"2023-12-19T13:59:41.231746+0000","last_unstale":"2023-12-19T13:59:42.229265+0000","last_undegraded":"2023-12-19T13:59:42.229265+0000","last_fullsized":"2023-12-19T13:59:42.229265+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:22.296457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353191+0000","last_change":"2023-12-19T13:59:41.237305+0000","last_active":"2023-12-19T13:59:42.353191+0000","last_peered":"2023-12-19T13:59:42.353191+0000","last_clean":"2023-12-19T13:59:42.353191+0000","last_became_active":"2023-12-19T13:59:41.237047+0000","last_became_peered":"2023-12-19T13:59:41.237047+0000","last_unstale":"2023-12-19T13:59:42.353191+0000","last_undegraded":"2023-12-19T13:59:42.353191+0000","last_fullsized":"2023-12-19T13:59:42.353191+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:34.496188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231961+0000","last_change":"2023-12-19T13:59:41.236965+0000","last_active":"2023-12-19T13:59:42.231961+0000","last_peered":"2023-12-19T13:59:42.231961+0000","last_clean":"2023-12-19T13:59:42.231961+0000","last_became_active":"2023-12-19T13:59:41.236731+0000","last_became_peered":"2023-12-19T13:59:41.236731+0000","last_unstale":"2023-12-19T13:59:42.231961+0000","last_undegraded":"2023-12-19T13:59:42.231961+0000","last_fullsized":"2023-12-19T13:59:42.231961+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:23.156246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135165+0000","last_change":"2023-12-19T13:59:41.233678+0000","last_active":"2023-12-19T13:59:43.135165+0000","last_peered":"2023-12-19T13:59:43.135165+0000","last_clean":"2023-12-19T13:59:43.135165+0000","last_became_active":"2023-12-19T13:59:41.233416+0000","last_became_peered":"2023-12-19T13:59:41.233416+0000","last_unstale":"2023-12-19T13:59:43.135165+0000","last_undegraded":"2023-12-19T13:59:43.135165+0000","last_fullsized":"2023-12-19T13:59:43.135165+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:44:59.528649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232761+0000","last_change":"2023-12-19T13:59:41.242694+0000","last_active":"2023-12-19T13:59:42.232761+0000","last_peered":"2023-12-19T13:59:42.232761+0000","last_clean":"2023-12-19T13:59:42.232761+0000","last_became_active":"2023-12-19T13:59:41.242235+0000","last_became_peered":"2023-12-19T13:59:41.242235+0000","last_unstale":"2023-12-19T13:59:42.232761+0000","last_undegraded":"2023-12-19T13:59:42.232761+0000","last_fullsized":"2023-12-19T13:59:42.232761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:23.752394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232826+0000","last_change":"2023-12-19T13:59:41.246013+0000","last_active":"2023-12-19T13:59:42.232826+0000","last_peered":"2023-12-19T13:59:42.232826+0000","last_clean":"2023-12-19T13:59:42.232826+0000","last_became_active":"2023-12-19T13:59:41.244697+0000","last_became_peered":"2023-12-19T13:59:41.244697+0000","last_unstale":"2023-12-19T13:59:42.232826+0000","last_undegraded":"2023-12-19T13:59:42.232826+0000","last_fullsized":"2023-12-19T13:59:42.232826+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135768+0000","last_change":"2023-12-19T13:59:41.250162+0000","last_active":"2023-12-19T13:59:43.135768+0000","last_peered":"2023-12-19T13:59:43.135768+0000","last_clean":"2023-12-19T13:59:43.135768+0000","last_became_active":"2023-12-19T13:59:41.249030+0000","last_became_peered":"2023-12-19T13:59:41.249030+0000","last_unstale":"2023-12-19T13:59:43.135768+0000","last_undegraded":"2023-12-19T13:59:43.135768+0000","last_fullsized":"2023-12-19T13:59:43.135768+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:51.041386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"195'4","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.248517+0000","last_change":"2023-12-19T13:59:40.757724+0000","last_active":"2023-12-19T13:59:41.248517+0000","last_peered":"2023-12-19T13:59:41.248517+0000","last_clean":"2023-12-19T13:59:41.248517+0000","last_became_active":"2023-12-19T13:59:40.757462+0000","last_became_peered":"2023-12-19T13:59:40.757462+0000","last_unstale":"2023-12-19T13:59:41.248517+0000","last_undegraded":"2023-12-19T13:59:41.248517+0000","last_fullsized":"2023-12-19T13:59:41.248517+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:47.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.231967+0000","last_change":"2023-12-19T13:59:41.249661+0000","last_active":"2023-12-19T13:59:42.231967+0000","last_peered":"2023-12-19T13:59:42.231967+0000","last_clean":"2023-12-19T13:59:42.231967+0000","last_became_active":"2023-12-19T13:59:41.249501+0000","last_became_peered":"2023-12-19T13:59:41.249501+0000","last_unstale":"2023-12-19T13:59:42.231967+0000","last_undegraded":"2023-12-19T13:59:42.231967+0000","last_fullsized":"2023-12-19T13:59:42.231967+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:51.275689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.240163+0000","last_change":"2023-12-19T13:59:40.739255+0000","last_active":"2023-12-19T13:59:41.240163+0000","last_peered":"2023-12-19T13:59:41.240163+0000","last_clean":"2023-12-19T13:59:41.240163+0000","last_became_active":"2023-12-19T13:59:40.738115+0000","last_became_peered":"2023-12-19T13:59:40.738115+0000","last_unstale":"2023-12-19T13:59:41.240163+0000","last_undegraded":"2023-12-19T13:59:41.240163+0000","last_fullsized":"2023-12-19T13:59:41.240163+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233406+0000","last_change":"2023-12-19T13:59:41.238418+0000","last_active":"2023-12-19T13:59:42.233406+0000","last_peered":"2023-12-19T13:59:42.233406+0000","last_clean":"2023-12-19T13:59:42.233406+0000","last_became_active":"2023-12-19T13:59:41.236352+0000","last_became_peered":"2023-12-19T13:59:41.236352+0000","last_unstale":"2023-12-19T13:59:42.233406+0000","last_undegraded":"2023-12-19T13:59:42.233406+0000","last_fullsized":"2023-12-19T13:59:42.233406+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:11.628635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.238791+0000","last_change":"2023-12-19T13:59:40.751638+0000","last_active":"2023-12-19T13:59:41.238791+0000","last_peered":"2023-12-19T13:59:41.238791+0000","last_clean":"2023-12-19T13:59:41.238791+0000","last_became_active":"2023-12-19T13:59:40.751276+0000","last_became_peered":"2023-12-19T13:59:40.751276+0000","last_unstale":"2023-12-19T13:59:41.238791+0000","last_undegraded":"2023-12-19T13:59:41.238791+0000","last_fullsized":"2023-12-19T13:59:41.238791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:25:33.111938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135296+0000","last_change":"2023-12-19T13:59:41.247725+0000","last_active":"2023-12-19T13:59:43.135296+0000","last_peered":"2023-12-19T13:59:43.135296+0000","last_clean":"2023-12-19T13:59:43.135296+0000","last_became_active":"2023-12-19T13:59:41.247225+0000","last_became_peered":"2023-12-19T13:59:41.247225+0000","last_unstale":"2023-12-19T13:59:43.135296+0000","last_undegraded":"2023-12-19T13:59:43.135296+0000","last_fullsized":"2023-12-19T13:59:43.135296+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.249416+0000","last_change":"2023-12-19T13:59:40.756112+0000","last_active":"2023-12-19T13:59:41.249416+0000","last_peered":"2023-12-19T13:59:41.249416+0000","last_clean":"2023-12-19T13:59:41.249416+0000","last_became_active":"2023-12-19T13:59:40.754231+0000","last_became_peered":"2023-12-19T13:59:40.754231+0000","last_unstale":"2023-12-19T13:59:41.249416+0000","last_undegraded":"2023-12-19T13:59:41.249416+0000","last_fullsized":"2023-12-19T13:59:41.249416+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135345+0000","last_change":"2023-12-19T13:59:41.250665+0000","last_active":"2023-12-19T13:59:43.135345+0000","last_peered":"2023-12-19T13:59:43.135345+0000","last_clean":"2023-12-19T13:59:43.135345+0000","last_became_active":"2023-12-19T13:59:41.250399+0000","last_became_peered":"2023-12-19T13:59:41.250399+0000","last_unstale":"2023-12-19T13:59:43.135345+0000","last_undegraded":"2023-12-19T13:59:43.135345+0000","last_fullsized":"2023-12-19T13:59:43.135345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:42.764784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.240895+0000","last_change":"2023-12-19T13:59:40.752503+0000","last_active":"2023-12-19T13:59:41.240895+0000","last_peered":"2023-12-19T13:59:41.240895+0000","last_clean":"2023-12-19T13:59:41.240895+0000","last_became_active":"2023-12-19T13:59:40.752267+0000","last_became_peered":"2023-12-19T13:59:40.752267+0000","last_unstale":"2023-12-19T13:59:41.240895+0000","last_undegraded":"2023-12-19T13:59:41.240895+0000","last_fullsized":"2023-12-19T13:59:41.240895+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:41.632120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233107+0000","last_change":"2023-12-19T13:59:41.246159+0000","last_active":"2023-12-19T13:59:42.233107+0000","last_peered":"2023-12-19T13:59:42.233107+0000","last_clean":"2023-12-19T13:59:42.233107+0000","last_became_active":"2023-12-19T13:59:41.244984+0000","last_became_peered":"2023-12-19T13:59:41.244984+0000","last_unstale":"2023-12-19T13:59:42.233107+0000","last_undegraded":"2023-12-19T13:59:42.233107+0000","last_fullsized":"2023-12-19T13:59:42.233107+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.244900+0000","last_change":"2023-12-19T13:59:40.757849+0000","last_active":"2023-12-19T13:59:41.244900+0000","last_peered":"2023-12-19T13:59:41.244900+0000","last_clean":"2023-12-19T13:59:41.244900+0000","last_became_active":"2023-12-19T13:59:40.756277+0000","last_became_peered":"2023-12-19T13:59:40.756277+0000","last_unstale":"2023-12-19T13:59:41.244900+0000","last_undegraded":"2023-12-19T13:59:41.244900+0000","last_fullsized":"2023-12-19T13:59:41.244900+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:14.369247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353902+0000","last_change":"2023-12-19T13:59:41.246566+0000","last_active":"2023-12-19T13:59:42.353902+0000","last_peered":"2023-12-19T13:59:42.353902+0000","last_clean":"2023-12-19T13:59:42.353902+0000","last_became_active":"2023-12-19T13:59:41.245863+0000","last_became_peered":"2023-12-19T13:59:41.245863+0000","last_unstale":"2023-12-19T13:59:42.353902+0000","last_undegraded":"2023-12-19T13:59:42.353902+0000","last_fullsized":"2023-12-19T13:59:42.353902+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:39.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228832+0000","last_change":"2023-12-19T13:59:40.754966+0000","last_active":"2023-12-19T13:59:41.228832+0000","last_peered":"2023-12-19T13:59:41.228832+0000","last_clean":"2023-12-19T13:59:41.228832+0000","last_became_active":"2023-12-19T13:59:40.754540+0000","last_became_peered":"2023-12-19T13:59:40.754540+0000","last_unstale":"2023-12-19T13:59:41.228832+0000","last_undegraded":"2023-12-19T13:59:41.228832+0000","last_fullsized":"2023-12-19T13:59:41.228832+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:48.297185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136021+0000","last_change":"2023-12-19T13:59:41.250368+0000","last_active":"2023-12-19T13:59:43.136021+0000","last_peered":"2023-12-19T13:59:43.136021+0000","last_clean":"2023-12-19T13:59:43.136021+0000","last_became_active":"2023-12-19T13:59:41.249893+0000","last_became_peered":"2023-12-19T13:59:41.249893+0000","last_unstale":"2023-12-19T13:59:43.136021+0000","last_undegraded":"2023-12-19T13:59:43.136021+0000","last_fullsized":"2023-12-19T13:59:43.136021+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:51.302356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.234857+0000","last_change":"2023-12-19T13:59:40.758803+0000","last_active":"2023-12-19T13:59:41.234857+0000","last_peered":"2023-12-19T13:59:41.234857+0000","last_clean":"2023-12-19T13:59:41.234857+0000","last_became_active":"2023-12-19T13:59:40.758490+0000","last_became_peered":"2023-12-19T13:59:40.758490+0000","last_unstale":"2023-12-19T13:59:41.234857+0000","last_undegraded":"2023-12-19T13:59:41.234857+0000","last_fullsized":"2023-12-19T13:59:41.234857+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354421+0000","last_change":"2023-12-19T13:59:41.240770+0000","last_active":"2023-12-19T13:59:42.354421+0000","last_peered":"2023-12-19T13:59:42.354421+0000","last_clean":"2023-12-19T13:59:42.354421+0000","last_became_active":"2023-12-19T13:59:41.240398+0000","last_became_peered":"2023-12-19T13:59:41.240398+0000","last_unstale":"2023-12-19T13:59:42.354421+0000","last_undegraded":"2023-12-19T13:59:42.354421+0000","last_fullsized":"2023-12-19T13:59:42.354421+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.236681+0000","last_change":"2023-12-19T13:59:40.754706+0000","last_active":"2023-12-19T13:59:41.236681+0000","last_peered":"2023-12-19T13:59:41.236681+0000","last_clean":"2023-12-19T13:59:41.236681+0000","last_became_active":"2023-12-19T13:59:40.754288+0000","last_became_peered":"2023-12-19T13:59:40.754288+0000","last_unstale":"2023-12-19T13:59:41.236681+0000","last_undegraded":"2023-12-19T13:59:41.236681+0000","last_fullsized":"2023-12-19T13:59:41.236681+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352758+0000","last_change":"2023-12-19T13:59:41.240088+0000","last_active":"2023-12-19T13:59:42.352758+0000","last_peered":"2023-12-19T13:59:42.352758+0000","last_clean":"2023-12-19T13:59:42.352758+0000","last_became_active":"2023-12-19T13:59:41.239764+0000","last_became_peered":"2023-12-19T13:59:41.239764+0000","last_unstale":"2023-12-19T13:59:42.352758+0000","last_undegraded":"2023-12-19T13:59:42.352758+0000","last_fullsized":"2023-12-19T13:59:42.352758+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.252522+0000","last_change":"2023-12-19T13:59:40.758037+0000","last_active":"2023-12-19T13:59:41.252522+0000","last_peered":"2023-12-19T13:59:41.252522+0000","last_clean":"2023-12-19T13:59:41.252522+0000","last_became_active":"2023-12-19T13:59:40.757303+0000","last_became_peered":"2023-12-19T13:59:40.757303+0000","last_unstale":"2023-12-19T13:59:41.252522+0000","last_undegraded":"2023-12-19T13:59:41.252522+0000","last_fullsized":"2023-12-19T13:59:41.252522+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:23.997927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232033+0000","last_change":"2023-12-19T13:59:41.238081+0000","last_active":"2023-12-19T13:59:42.232033+0000","last_peered":"2023-12-19T13:59:42.232033+0000","last_clean":"2023-12-19T13:59:42.232033+0000","last_became_active":"2023-12-19T13:59:41.237709+0000","last_became_peered":"2023-12-19T13:59:41.237709+0000","last_unstale":"2023-12-19T13:59:42.232033+0000","last_undegraded":"2023-12-19T13:59:42.232033+0000","last_fullsized":"2023-12-19T13:59:42.232033+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:53:40.351475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"195'6","reported_seq":17,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.245216+0000","last_change":"2023-12-19T13:59:40.750401+0000","last_active":"2023-12-19T13:59:41.245216+0000","last_peered":"2023-12-19T13:59:41.245216+0000","last_clean":"2023-12-19T13:59:41.245216+0000","last_became_active":"2023-12-19T13:59:40.750050+0000","last_became_peered":"2023-12-19T13:59:40.750050+0000","last_unstale":"2023-12-19T13:59:41.245216+0000","last_undegraded":"2023-12-19T13:59:41.245216+0000","last_fullsized":"2023-12-19T13:59:41.245216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:54.455895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354682+0000","last_change":"2023-12-19T13:59:41.232936+0000","last_active":"2023-12-19T13:59:42.354682+0000","last_peered":"2023-12-19T13:59:42.354682+0000","last_clean":"2023-12-19T13:59:42.354682+0000","last_became_active":"2023-12-19T13:59:41.231124+0000","last_became_peered":"2023-12-19T13:59:41.231124+0000","last_unstale":"2023-12-19T13:59:42.354682+0000","last_undegraded":"2023-12-19T13:59:42.354682+0000","last_fullsized":"2023-12-19T13:59:42.354682+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:26.244097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.241380+0000","last_change":"2023-12-19T13:59:40.753740+0000","last_active":"2023-12-19T13:59:41.241380+0000","last_peered":"2023-12-19T13:59:41.241380+0000","last_clean":"2023-12-19T13:59:41.241380+0000","last_became_active":"2023-12-19T13:59:40.753400+0000","last_became_peered":"2023-12-19T13:59:40.753400+0000","last_unstale":"2023-12-19T13:59:41.241380+0000","last_undegraded":"2023-12-19T13:59:41.241380+0000","last_fullsized":"2023-12-19T13:59:41.241380+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:03.840497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354038+0000","last_change":"2023-12-19T13:59:41.246381+0000","last_active":"2023-12-19T13:59:42.354038+0000","last_peered":"2023-12-19T13:59:42.354038+0000","last_clean":"2023-12-19T13:59:42.354038+0000","last_became_active":"2023-12-19T13:59:41.245531+0000","last_became_peered":"2023-12-19T13:59:41.245531+0000","last_unstale":"2023-12-19T13:59:42.354038+0000","last_undegraded":"2023-12-19T13:59:42.354038+0000","last_fullsized":"2023-12-19T13:59:42.354038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:51.275689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229294+0000","last_change":"2023-12-19T13:59:40.754054+0000","last_active":"2023-12-19T13:59:41.229294+0000","last_peered":"2023-12-19T13:59:41.229294+0000","last_clean":"2023-12-19T13:59:41.229294+0000","last_became_active":"2023-12-19T13:59:40.753792+0000","last_became_peered":"2023-12-19T13:59:40.753792+0000","last_unstale":"2023-12-19T13:59:41.229294+0000","last_undegraded":"2023-12-19T13:59:41.229294+0000","last_fullsized":"2023-12-19T13:59:41.229294+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:27.254354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233120+0000","last_change":"2023-12-19T13:59:41.243143+0000","last_active":"2023-12-19T13:59:42.233120+0000","last_peered":"2023-12-19T13:59:42.233120+0000","last_clean":"2023-12-19T13:59:42.233120+0000","last_became_active":"2023-12-19T13:59:41.242704+0000","last_became_peered":"2023-12-19T13:59:41.242704+0000","last_unstale":"2023-12-19T13:59:42.233120+0000","last_undegraded":"2023-12-19T13:59:42.233120+0000","last_fullsized":"2023-12-19T13:59:42.233120+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:26.160216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229667+0000","last_change":"2023-12-19T13:59:40.755123+0000","last_active":"2023-12-19T13:59:41.229667+0000","last_peered":"2023-12-19T13:59:41.229667+0000","last_clean":"2023-12-19T13:59:41.229667+0000","last_became_active":"2023-12-19T13:59:40.751688+0000","last_became_peered":"2023-12-19T13:59:40.751688+0000","last_unstale":"2023-12-19T13:59:41.229667+0000","last_undegraded":"2023-12-19T13:59:41.229667+0000","last_fullsized":"2023-12-19T13:59:41.229667+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:56.900887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135237+0000","last_change":"2023-12-19T13:59:41.240461+0000","last_active":"2023-12-19T13:59:43.135237+0000","last_peered":"2023-12-19T13:59:43.135237+0000","last_clean":"2023-12-19T13:59:43.135237+0000","last_became_active":"2023-12-19T13:59:41.240163+0000","last_became_peered":"2023-12-19T13:59:41.240163+0000","last_unstale":"2023-12-19T13:59:43.135237+0000","last_undegraded":"2023-12-19T13:59:43.135237+0000","last_fullsized":"2023-12-19T13:59:43.135237+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:52.527025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"195'8","reported_seq":19,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.233844+0000","last_change":"2023-12-19T13:59:40.755661+0000","last_active":"2023-12-19T13:59:41.233844+0000","last_peered":"2023-12-19T13:59:41.233844+0000","last_clean":"2023-12-19T13:59:41.233844+0000","last_became_active":"2023-12-19T13:59:40.755379+0000","last_became_peered":"2023-12-19T13:59:40.755379+0000","last_unstale":"2023-12-19T13:59:41.233844+0000","last_undegraded":"2023-12-19T13:59:41.233844+0000","last_fullsized":"2023-12-19T13:59:41.233844+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:03:01.484380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353930+0000","last_change":"2023-12-19T13:59:41.250060+0000","last_active":"2023-12-19T13:59:42.353930+0000","last_peered":"2023-12-19T13:59:42.353930+0000","last_clean":"2023-12-19T13:59:42.353930+0000","last_became_active":"2023-12-19T13:59:41.249203+0000","last_became_peered":"2023-12-19T13:59:41.249203+0000","last_unstale":"2023-12-19T13:59:42.353930+0000","last_undegraded":"2023-12-19T13:59:42.353930+0000","last_fullsized":"2023-12-19T13:59:42.353930+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:25.003774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.231326+0000","last_change":"2023-12-19T13:59:40.751375+0000","last_active":"2023-12-19T13:59:41.231326+0000","last_peered":"2023-12-19T13:59:41.231326+0000","last_clean":"2023-12-19T13:59:41.231326+0000","last_became_active":"2023-12-19T13:59:40.751136+0000","last_became_peered":"2023-12-19T13:59:40.751136+0000","last_unstale":"2023-12-19T13:59:41.231326+0000","last_undegraded":"2023-12-19T13:59:41.231326+0000","last_fullsized":"2023-12-19T13:59:41.231326+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:01.897389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136255+0000","last_change":"2023-12-19T13:59:41.237066+0000","last_active":"2023-12-19T13:59:43.136255+0000","last_peered":"2023-12-19T13:59:43.136255+0000","last_clean":"2023-12-19T13:59:43.136255+0000","last_became_active":"2023-12-19T13:59:41.236720+0000","last_became_peered":"2023-12-19T13:59:41.236720+0000","last_unstale":"2023-12-19T13:59:43.136255+0000","last_undegraded":"2023-12-19T13:59:43.136255+0000","last_fullsized":"2023-12-19T13:59:43.136255+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:39.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.242274+0000","last_change":"2023-12-19T13:59:40.742871+0000","last_active":"2023-12-19T13:59:41.242274+0000","last_peered":"2023-12-19T13:59:41.242274+0000","last_clean":"2023-12-19T13:59:41.242274+0000","last_became_active":"2023-12-19T13:59:40.739429+0000","last_became_peered":"2023-12-19T13:59:40.739429+0000","last_unstale":"2023-12-19T13:59:41.242274+0000","last_undegraded":"2023-12-19T13:59:41.242274+0000","last_fullsized":"2023-12-19T13:59:41.242274+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:44.132626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135773+0000","last_change":"2023-12-19T13:59:41.248711+0000","last_active":"2023-12-19T13:59:43.135773+0000","last_peered":"2023-12-19T13:59:43.135773+0000","last_clean":"2023-12-19T13:59:43.135773+0000","last_became_active":"2023-12-19T13:59:41.248451+0000","last_became_peered":"2023-12-19T13:59:41.248451+0000","last_unstale":"2023-12-19T13:59:43.135773+0000","last_undegraded":"2023-12-19T13:59:43.135773+0000","last_fullsized":"2023-12-19T13:59:43.135773+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:24.303264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"195'1","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.241056+0000","last_change":"2023-12-19T13:59:40.752367+0000","last_active":"2023-12-19T13:59:41.241056+0000","last_peered":"2023-12-19T13:59:41.241056+0000","last_clean":"2023-12-19T13:59:41.241056+0000","last_became_active":"2023-12-19T13:59:40.752125+0000","last_became_peered":"2023-12-19T13:59:40.752125+0000","last_unstale":"2023-12-19T13:59:41.241056+0000","last_undegraded":"2023-12-19T13:59:41.241056+0000","last_fullsized":"2023-12-19T13:59:41.241056+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:32.613084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.352855+0000","last_change":"2023-12-19T13:59:41.247167+0000","last_active":"2023-12-19T13:59:42.352855+0000","last_peered":"2023-12-19T13:59:42.352855+0000","last_clean":"2023-12-19T13:59:42.352855+0000","last_became_active":"2023-12-19T13:59:41.246824+0000","last_became_peered":"2023-12-19T13:59:41.246824+0000","last_unstale":"2023-12-19T13:59:42.352855+0000","last_undegraded":"2023-12-19T13:59:42.352855+0000","last_fullsized":"2023-12-19T13:59:42.352855+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218993+0000","last_change":"2023-12-19T13:59:40.754731+0000","last_active":"2023-12-19T13:59:41.218993+0000","last_peered":"2023-12-19T13:59:41.218993+0000","last_clean":"2023-12-19T13:59:41.218993+0000","last_became_active":"2023-12-19T13:59:40.750725+0000","last_became_peered":"2023-12-19T13:59:40.750725+0000","last_unstale":"2023-12-19T13:59:41.218993+0000","last_undegraded":"2023-12-19T13:59:41.218993+0000","last_fullsized":"2023-12-19T13:59:41.218993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:35.922857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232092+0000","last_change":"2023-12-19T13:59:41.242805+0000","last_active":"2023-12-19T13:59:42.232092+0000","last_peered":"2023-12-19T13:59:42.232092+0000","last_clean":"2023-12-19T13:59:42.232092+0000","last_became_active":"2023-12-19T13:59:41.242397+0000","last_became_peered":"2023-12-19T13:59:41.242397+0000","last_unstale":"2023-12-19T13:59:42.232092+0000","last_undegraded":"2023-12-19T13:59:42.232092+0000","last_fullsized":"2023-12-19T13:59:42.232092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:55:10.819607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.252682+0000","last_change":"2023-12-19T13:59:40.756603+0000","last_active":"2023-12-19T13:59:41.252682+0000","last_peered":"2023-12-19T13:59:41.252682+0000","last_clean":"2023-12-19T13:59:41.252682+0000","last_became_active":"2023-12-19T13:59:40.754960+0000","last_became_peered":"2023-12-19T13:59:40.754960+0000","last_unstale":"2023-12-19T13:59:41.252682+0000","last_undegraded":"2023-12-19T13:59:41.252682+0000","last_fullsized":"2023-12-19T13:59:41.252682+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:10.622788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353206+0000","last_change":"2023-12-19T13:59:41.250110+0000","last_active":"2023-12-19T13:59:42.353206+0000","last_peered":"2023-12-19T13:59:42.353206+0000","last_clean":"2023-12-19T13:59:42.353206+0000","last_became_active":"2023-12-19T13:59:41.249509+0000","last_became_peered":"2023-12-19T13:59:41.249509+0000","last_unstale":"2023-12-19T13:59:42.353206+0000","last_undegraded":"2023-12-19T13:59:42.353206+0000","last_fullsized":"2023-12-19T13:59:42.353206+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:13.046781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218101+0000","last_change":"2023-12-19T13:59:40.743247+0000","last_active":"2023-12-19T13:59:41.218101+0000","last_peered":"2023-12-19T13:59:41.218101+0000","last_clean":"2023-12-19T13:59:41.218101+0000","last_became_active":"2023-12-19T13:59:40.742681+0000","last_became_peered":"2023-12-19T13:59:40.742681+0000","last_unstale":"2023-12-19T13:59:41.218101+0000","last_undegraded":"2023-12-19T13:59:41.218101+0000","last_fullsized":"2023-12-19T13:59:41.218101+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:59.840480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232978+0000","last_change":"2023-12-19T13:59:41.235473+0000","last_active":"2023-12-19T13:59:42.232978+0000","last_peered":"2023-12-19T13:59:42.232978+0000","last_clean":"2023-12-19T13:59:42.232978+0000","last_became_active":"2023-12-19T13:59:41.235312+0000","last_became_peered":"2023-12-19T13:59:41.235312+0000","last_unstale":"2023-12-19T13:59:42.232978+0000","last_undegraded":"2023-12-19T13:59:42.232978+0000","last_fullsized":"2023-12-19T13:59:42.232978+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:23.270911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.226262+0000","last_change":"2023-12-19T13:59:40.754422+0000","last_active":"2023-12-19T13:59:41.226262+0000","last_peered":"2023-12-19T13:59:41.226262+0000","last_clean":"2023-12-19T13:59:41.226262+0000","last_became_active":"2023-12-19T13:59:40.754095+0000","last_became_peered":"2023-12-19T13:59:40.754095+0000","last_unstale":"2023-12-19T13:59:41.226262+0000","last_undegraded":"2023-12-19T13:59:41.226262+0000","last_fullsized":"2023-12-19T13:59:41.226262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:48.616859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354177+0000","last_change":"2023-12-19T13:59:41.229774+0000","last_active":"2023-12-19T13:59:42.354177+0000","last_peered":"2023-12-19T13:59:42.354177+0000","last_clean":"2023-12-19T13:59:42.354177+0000","last_became_active":"2023-12-19T13:59:41.229064+0000","last_became_peered":"2023-12-19T13:59:41.229064+0000","last_unstale":"2023-12-19T13:59:42.354177+0000","last_undegraded":"2023-12-19T13:59:42.354177+0000","last_fullsized":"2023-12-19T13:59:42.354177+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:39:48.988107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.218208+0000","last_change":"2023-12-19T13:59:40.737867+0000","last_active":"2023-12-19T13:59:41.218208+0000","last_peered":"2023-12-19T13:59:41.218208+0000","last_clean":"2023-12-19T13:59:41.218208+0000","last_became_active":"2023-12-19T13:59:40.737071+0000","last_became_peered":"2023-12-19T13:59:40.737071+0000","last_unstale":"2023-12-19T13:59:41.218208+0000","last_undegraded":"2023-12-19T13:59:41.218208+0000","last_fullsized":"2023-12-19T13:59:41.218208+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:42.399866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353497+0000","last_change":"2023-12-19T13:59:41.249766+0000","last_active":"2023-12-19T13:59:42.353497+0000","last_peered":"2023-12-19T13:59:42.353497+0000","last_clean":"2023-12-19T13:59:42.353497+0000","last_became_active":"2023-12-19T13:59:41.247736+0000","last_became_peered":"2023-12-19T13:59:41.247736+0000","last_unstale":"2023-12-19T13:59:42.353497+0000","last_undegraded":"2023-12-19T13:59:42.353497+0000","last_fullsized":"2023-12-19T13:59:42.353497+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:47:32.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"195'2","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.245837+0000","last_change":"2023-12-19T13:59:40.749251+0000","last_active":"2023-12-19T13:59:41.245837+0000","last_peered":"2023-12-19T13:59:41.245837+0000","last_clean":"2023-12-19T13:59:41.245837+0000","last_became_active":"2023-12-19T13:59:40.748175+0000","last_became_peered":"2023-12-19T13:59:40.748175+0000","last_unstale":"2023-12-19T13:59:41.245837+0000","last_undegraded":"2023-12-19T13:59:41.245837+0000","last_fullsized":"2023-12-19T13:59:41.245837+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:20.161760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136152+0000","last_change":"2023-12-19T13:59:41.242349+0000","last_active":"2023-12-19T13:59:43.136152+0000","last_peered":"2023-12-19T13:59:43.136152+0000","last_clean":"2023-12-19T13:59:43.136152+0000","last_became_active":"2023-12-19T13:59:41.241320+0000","last_became_peered":"2023-12-19T13:59:41.241320+0000","last_unstale":"2023-12-19T13:59:43.136152+0000","last_undegraded":"2023-12-19T13:59:43.136152+0000","last_fullsized":"2023-12-19T13:59:43.136152+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:43.809350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"196'1","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.351249+0000","last_change":"2023-12-19T13:59:40.754238+0000","last_active":"2023-12-19T13:59:42.351249+0000","last_peered":"2023-12-19T13:59:42.351249+0000","last_clean":"2023-12-19T13:59:42.351249+0000","last_became_active":"2023-12-19T13:59:40.754008+0000","last_became_peered":"2023-12-19T13:59:40.754008+0000","last_unstale":"2023-12-19T13:59:42.351249+0000","last_undegraded":"2023-12-19T13:59:42.351249+0000","last_fullsized":"2023-12-19T13:59:42.351249+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:34:34.051846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.135613+0000","last_change":"2023-12-19T13:59:41.238293+0000","last_active":"2023-12-19T13:59:43.135613+0000","last_peered":"2023-12-19T13:59:43.135613+0000","last_clean":"2023-12-19T13:59:43.135613+0000","last_became_active":"2023-12-19T13:59:41.237440+0000","last_became_peered":"2023-12-19T13:59:41.237440+0000","last_unstale":"2023-12-19T13:59:43.135613+0000","last_undegraded":"2023-12-19T13:59:43.135613+0000","last_fullsized":"2023-12-19T13:59:43.135613+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:13.046781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228562+0000","last_change":"2023-12-19T13:59:40.758774+0000","last_active":"2023-12-19T13:59:41.228562+0000","last_peered":"2023-12-19T13:59:41.228562+0000","last_clean":"2023-12-19T13:59:41.228562+0000","last_became_active":"2023-12-19T13:59:40.758506+0000","last_became_peered":"2023-12-19T13:59:40.758506+0000","last_unstale":"2023-12-19T13:59:41.228562+0000","last_undegraded":"2023-12-19T13:59:41.228562+0000","last_fullsized":"2023-12-19T13:59:41.228562+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:43.569437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:43.136512+0000","last_change":"2023-12-19T13:59:41.241804+0000","last_active":"2023-12-19T13:59:43.136512+0000","last_peered":"2023-12-19T13:59:43.136512+0000","last_clean":"2023-12-19T13:59:43.136512+0000","last_became_active":"2023-12-19T13:59:41.241542+0000","last_became_peered":"2023-12-19T13:59:41.241542+0000","last_unstale":"2023-12-19T13:59:43.136512+0000","last_undegraded":"2023-12-19T13:59:43.136512+0000","last_fullsized":"2023-12-19T13:59:43.136512+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.234971+0000","last_change":"2023-12-19T13:59:40.756150+0000","last_active":"2023-12-19T13:59:41.234971+0000","last_peered":"2023-12-19T13:59:41.234971+0000","last_clean":"2023-12-19T13:59:41.234971+0000","last_became_active":"2023-12-19T13:59:40.755399+0000","last_became_peered":"2023-12-19T13:59:40.755399+0000","last_unstale":"2023-12-19T13:59:41.234971+0000","last_undegraded":"2023-12-19T13:59:41.234971+0000","last_fullsized":"2023-12-19T13:59:41.234971+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:51.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233385+0000","last_change":"2023-12-19T13:59:41.246300+0000","last_active":"2023-12-19T13:59:42.233385+0000","last_peered":"2023-12-19T13:59:42.233385+0000","last_clean":"2023-12-19T13:59:42.233385+0000","last_became_active":"2023-12-19T13:59:41.245455+0000","last_became_peered":"2023-12-19T13:59:41.245455+0000","last_unstale":"2023-12-19T13:59:42.233385+0000","last_undegraded":"2023-12-19T13:59:42.233385+0000","last_fullsized":"2023-12-19T13:59:42.233385+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:56.144211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222725+0000","last_change":"2023-12-19T13:59:40.756950+0000","last_active":"2023-12-19T13:59:41.222725+0000","last_peered":"2023-12-19T13:59:41.222725+0000","last_clean":"2023-12-19T13:59:41.222725+0000","last_became_active":"2023-12-19T13:59:40.756683+0000","last_became_peered":"2023-12-19T13:59:40.756683+0000","last_unstale":"2023-12-19T13:59:41.222725+0000","last_undegraded":"2023-12-19T13:59:41.222725+0000","last_fullsized":"2023-12-19T13:59:41.222725+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:40:10.283382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.233194+0000","last_change":"2023-12-19T13:59:41.242433+0000","last_active":"2023-12-19T13:59:42.233194+0000","last_peered":"2023-12-19T13:59:42.233194+0000","last_clean":"2023-12-19T13:59:42.233194+0000","last_became_active":"2023-12-19T13:59:41.241707+0000","last_became_peered":"2023-12-19T13:59:41.241707+0000","last_unstale":"2023-12-19T13:59:42.233194+0000","last_undegraded":"2023-12-19T13:59:42.233194+0000","last_fullsized":"2023-12-19T13:59:42.233194+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:34.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.229814+0000","last_change":"2023-12-19T13:59:40.756938+0000","last_active":"2023-12-19T13:59:41.229814+0000","last_peered":"2023-12-19T13:59:41.229814+0000","last_clean":"2023-12-19T13:59:41.229814+0000","last_became_active":"2023-12-19T13:59:40.756694+0000","last_became_peered":"2023-12-19T13:59:40.756694+0000","last_unstale":"2023-12-19T13:59:41.229814+0000","last_undegraded":"2023-12-19T13:59:41.229814+0000","last_fullsized":"2023-12-19T13:59:41.229814+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:40.342502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.353025+0000","last_change":"2023-12-19T13:59:41.243143+0000","last_active":"2023-12-19T13:59:42.353025+0000","last_peered":"2023-12-19T13:59:42.353025+0000","last_clean":"2023-12-19T13:59:42.353025+0000","last_became_active":"2023-12-19T13:59:41.242300+0000","last_became_peered":"2023-12-19T13:59:41.242300+0000","last_unstale":"2023-12-19T13:59:42.353025+0000","last_undegraded":"2023-12-19T13:59:42.353025+0000","last_fullsized":"2023-12-19T13:59:42.353025+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:00.217591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.231079+0000","last_change":"2023-12-19T13:59:40.758915+0000","last_active":"2023-12-19T13:59:41.231079+0000","last_peered":"2023-12-19T13:59:41.231079+0000","last_clean":"2023-12-19T13:59:41.231079+0000","last_became_active":"2023-12-19T13:59:40.758617+0000","last_became_peered":"2023-12-19T13:59:40.758617+0000","last_unstale":"2023-12-19T13:59:41.231079+0000","last_undegraded":"2023-12-19T13:59:41.231079+0000","last_fullsized":"2023-12-19T13:59:41.231079+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:24.028489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.232176+0000","last_change":"2023-12-19T13:59:41.236526+0000","last_active":"2023-12-19T13:59:42.232176+0000","last_peered":"2023-12-19T13:59:42.232176+0000","last_clean":"2023-12-19T13:59:42.232176+0000","last_became_active":"2023-12-19T13:59:41.236211+0000","last_became_peered":"2023-12-19T13:59:41.236211+0000","last_unstale":"2023-12-19T13:59:42.232176+0000","last_undegraded":"2023-12-19T13:59:42.232176+0000","last_fullsized":"2023-12-19T13:59:42.232176+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:38.840494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.228711+0000","last_change":"2023-12-19T13:59:40.753470+0000","last_active":"2023-12-19T13:59:41.228711+0000","last_peered":"2023-12-19T13:59:41.228711+0000","last_clean":"2023-12-19T13:59:41.228711+0000","last_became_active":"2023-12-19T13:59:40.753203+0000","last_became_peered":"2023-12-19T13:59:40.753203+0000","last_unstale":"2023-12-19T13:59:41.228711+0000","last_undegraded":"2023-12-19T13:59:41.228711+0000","last_fullsized":"2023-12-19T13:59:41.228711+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:42:17.961232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-12-19T13:59:42.354185+0000","last_change":"2023-12-19T13:59:41.242547+0000","last_active":"2023-12-19T13:59:42.354185+0000","last_peered":"2023-12-19T13:59:42.354185+0000","last_clean":"2023-12-19T13:59:42.354185+0000","last_became_active":"2023-12-19T13:59:41.242244+0000","last_became_peered":"2023-12-19T13:59:41.242244+0000","last_unstale":"2023-12-19T13:59:42.354185+0000","last_undegraded":"2023-12-19T13:59:42.354185+0000","last_fullsized":"2023-12-19T13:59:42.354185+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:40.711505+0000","last_clean_scrub_stamp":"2023-12-19T13:59:40.711505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:44.575284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222524+0000","last_change":"2023-12-19T13:59:40.758615+0000","last_active":"2023-12-19T13:59:41.222524+0000","last_peered":"2023-12-19T13:59:41.222524+0000","last_clean":"2023-12-19T13:59:41.222524+0000","last_became_active":"2023-12-19T13:59:40.758214+0000","last_became_peered":"2023-12-19T13:59:40.758214+0000","last_unstale":"2023-12-19T13:59:41.222524+0000","last_undegraded":"2023-12-19T13:59:41.222524+0000","last_fullsized":"2023-12-19T13:59:41.222524+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:59:39.705658+0000","last_clean_scrub_stamp":"2023-12-19T13:59:39.705658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:05.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":331,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-12-19T13:59:41.222365+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T13:59:41.222365+0000","last_peered":"2023-12-19T13:59:41.222365+0000","last_clean":"2023-12-19T13:59:41.222365+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T13:59:41.222365+0000","last_undegraded":"2023-12-19T13:59:41.222365+0000","last_fullsized":"2023-12-19T13:59:41.222365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575012,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":1.0840000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.9059999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.1379999999999999,"15min":1.0880000000000001},"min":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.601,"5min":1.855,"15min":2.008},"last":1.202}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1679999999999999,"15min":1.141},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.494,"5min":1.865,"15min":1.865},"last":1.038},{"interface":"front","average":{"1min":1.198,"5min":1.175,"15min":1.1359999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.54,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.097}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.159,"15min":1.1459999999999999},"min":{"1min":0.88900000000000001,"5min":0.77600000000000002,"15min":0.57499999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.008},"last":1.131},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2829999999999999,"15min":1.222},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7090000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.403}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2649999999999999,"15min":1.2330000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.6659999999999999,"15min":2.2589999999999999},"last":1.373},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3240000000000001,"15min":1.3029999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":1.159}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2949999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.702,"5min":1.702,"15min":2.4089999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.359,"15min":1.367},"min":{"1min":0.83699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.901,"5min":1.901,"15min":2.6909999999999998},"last":1.254}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.218,"15min":1.2490000000000001},"min":{"1min":0.72799999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":2.3109999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.4279999999999999,"15min":1.429},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6359999999999999,"5min":1.7949999999999999,"15min":2.7719999999999998},"last":1.4730000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.387,"15min":1.369},"min":{"1min":0.65900000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.512},{"interface":"front","average":{"1min":1.47,"5min":1.5209999999999999,"15min":1.516},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.64800000000000002},"max":{"1min":1.833,"5min":1.9390000000000001,"15min":2.673},"last":1.7689999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1499999999999999,"15min":1.0820000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.42699999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":2.0640000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.0940000000000001,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":3.2069999999999999},"last":1.0680000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0960000000000001,"15min":1.0649999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.851,"15min":1.962},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.135,"5min":1.206,"15min":1.1419999999999999},"min":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.63800000000000001},"max":{"1min":1.3340000000000001,"5min":1.671,"15min":1.671},"last":0.96199999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3300000000000001,"15min":1.28},"min":{"1min":1.1599999999999999,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.5960000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.29,"15min":1.242},"min":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.68100000000000005},"max":{"1min":1.7769999999999999,"5min":1.821,"15min":1.821},"last":1.7769999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":1.0660000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6919999999999999,"5min":1.782,"15min":4.2690000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2370000000000001},"min":{"1min":0.876,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.4850000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.155}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3340000000000001,"15min":1.294},"min":{"1min":0.995,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.7130000000000001,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.323,"15min":1.333},"min":{"1min":0.86599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.623,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.623}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.284,"15min":1.2909999999999999},"min":{"1min":0.92700000000000005,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.585,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.407},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4650000000000001,"15min":1.4330000000000001},"min":{"1min":1.002,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.857,"5min":2.117,"15min":2.169},"last":1.6930000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.464,"15min":1.456},"min":{"1min":1.3839999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8540000000000001,"5min":1.8919999999999999,"15min":2.5419999999999998},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.4490000000000001,"15min":1.425},"min":{"1min":1.0469999999999999,"5min":0.89300000000000002,"15min":0.57999999999999996},"max":{"1min":1.7250000000000001,"5min":2.0219999999999998,"15min":2.141},"last":1.5449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193653,"statfs":{"total":200000000,"available":198301643,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0880000000000001,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.631,"5min":1.631,"15min":1.835},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.645,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":1.125}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.5549999999999999,"15min":6.101},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.155,"15min":1.1220000000000001},"min":{"1min":0.70599999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.617,"5min":1.6439999999999999,"15min":2.077},"last":1.1659999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6439999999999999,"5min":1.72,"15min":5.5350000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.208,"15min":1.2270000000000001},"min":{"1min":0.85399999999999998,"5min":0.80500000000000005,"15min":0.66400000000000003},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.863},"last":1.0940000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.6599999999999999,"15min":5.6189999999999998},"last":1.026},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.333,"15min":1.292},"min":{"1min":1.002,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.6200000000000001,"5min":1.752,"15min":1.8360000000000001},"last":1.3360000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.264,"15min":1.2150000000000001},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.5429999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.298},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.734,"5min":1.798,"15min":5.6970000000000001},"last":1.613}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":1.919,"15min":2.0310000000000001},"last":1.409},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3939999999999999,"15min":1.379},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6970000000000001,"5min":1.853,"15min":2.133},"last":1.363}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.462,"15min":1.4690000000000001},"min":{"1min":1.1919999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.8260000000000001,"5min":1.893,"15min":6.3959999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.498,"15min":1.4830000000000001},"min":{"1min":1.1930000000000001,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.579}]}]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.091,"15min":1.0509999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4350000000000001,"5min":1.679,"15min":2.1349999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.143,"15min":1.1180000000000001},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.48799999999999999},"max":{"1min":1.4750000000000001,"5min":2.448,"15min":2.448},"last":0.88100000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1519999999999999,"15min":1.0980000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.55,"5min":1.754,"15min":1.754},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.50700000000000001},"max":{"1min":1.5509999999999999,"5min":3.117,"15min":3.117},"last":1.2310000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.21,"15min":1.1339999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5309999999999999,"5min":2.613,"15min":2.613},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.7070000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.3260000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2929999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.409,"5min":2.653,"15min":2.653},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.417}]},{"osd":5,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.278,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.51700000000000002},"max":{"1min":1.647,"5min":3.625,"15min":3.625},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5940000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.661}]},{"osd":6,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.415,"15min":1.375},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.921,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.468},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4419999999999999,"15min":1.4179999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.52200000000000002},"max":{"1min":1.7829999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.45}]},{"osd":7,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5589999999999999,"15min":1.498},"min":{"1min":0.77000000000000002,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.746,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.397},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.593,"15min":1.5449999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.829,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.5349999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575012,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1082,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194229,"statfs":{"total":200000000,"available":198891097,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":0.83899999999999997},"min":{"1min":0.67500000000000004,"5min":0.36499999999999999,"15min":0.249},"max":{"1min":1.2050000000000001,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.032,"5min":0.95799999999999996,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.5609999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.68899999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.877,"15min":0.88},"min":{"1min":0.63500000000000001,"5min":0.46600000000000003,"15min":0.32800000000000001},"max":{"1min":1.137,"5min":1.413,"15min":5.3769999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.026,"15min":0.96199999999999997},"min":{"1min":0.83599999999999997,"5min":0.40899999999999997,"15min":0.29499999999999998},"max":{"1min":1.3799999999999999,"5min":1.573,"15min":2.387},"last":0.61399999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.077,"15min":1.0129999999999999},"min":{"1min":0.88600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.5820000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1000000000000001,"15min":1.0580000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.6319999999999999,"15min":2.657},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2909999999999999,"15min":1.2390000000000001},"min":{"1min":1.0329999999999999,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.583,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.2909999999999999,"15min":1.2370000000000001},"min":{"1min":0.90700000000000003,"5min":0.76300000000000001,"15min":0.54600000000000004},"max":{"1min":1.5269999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.169}]},{"osd":5,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.306,"15min":1.2709999999999999},"min":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.58299999999999996},"max":{"1min":1.579,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.304,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.78700000000000003,"15min":0.66700000000000004},"max":{"1min":1.655,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":0.85399999999999998}]},{"osd":6,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":1.0820000000000001,"5min":0.76900000000000002,"15min":0.53300000000000003},"max":{"1min":1.458,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.391,"5min":1.3919999999999999,"15min":1.3340000000000001},"min":{"1min":0.95799999999999996,"5min":0.81499999999999995,"15min":0.52600000000000002},"max":{"1min":1.6819999999999999,"5min":2.077,"15min":2.698},"last":1.099}]},{"osd":7,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4159999999999999,"15min":1.3420000000000001},"min":{"1min":1.258,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":2.1160000000000001,"15min":3.609},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4399999999999999,"15min":1.3899999999999999},"min":{"1min":1.155,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.1359999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194230,"statfs":{"total":200000000,"available":198892101,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.4330000000000001,"15min":2.258},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.93999999999999995,"15min":0.90600000000000003},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":11.85},"last":0.69499999999999995}]},{"osd":1,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4179999999999999,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.056,"15min":1.012},"min":{"1min":0.54300000000000004,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":1.456,"5min":4.681,"15min":11.788},"last":1.155}]},{"osd":3,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":0.97499999999999998},"min":{"1min":0.57199999999999995,"5min":0.41799999999999998,"15min":0.39300000000000002},"max":{"1min":1.262,"5min":1.702,"15min":2.3109999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.1319999999999999,"15min":1.077},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.7549999999999999,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":1.5}]},{"osd":4,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.21,"15min":1.2250000000000001},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":11.930999999999999},"last":1.45},{"interface":"front","average":{"1min":1.236,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.873,"5min":0.72399999999999998,"15min":0.72299999999999998},"max":{"1min":1.7050000000000001,"5min":1.806,"15min":2.2189999999999999},"last":1.758}]},{"osd":5,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3240000000000001,"15min":1.3149999999999999},"min":{"1min":1.0109999999999999,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.6559999999999999,"5min":1.7170000000000001,"15min":11.888},"last":1.542},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.367,"15min":1.325},"min":{"1min":1.107,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.55,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.383}]},{"osd":6,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3440000000000001,"15min":1.3160000000000001},"min":{"1min":1.0209999999999999,"5min":0.76200000000000001,"15min":0.72399999999999998},"max":{"1min":1.855,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":1.665},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3400000000000001,"15min":1.2989999999999999},"min":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.786,"5min":1.9370000000000001,"15min":2.286},"last":1.885}]},{"osd":7,"last update":"Tue Dec 19 13:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4019999999999999,"15min":1.349},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.8089999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.3759999999999999,"15min":1.355},"min":{"1min":0.85399999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.77,"5min":2.323,"15min":11.962999999999999},"last":1.595}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193652,"statfs":{"total":200000000,"available":198300569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.2470000000000001,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.712,"5min":1.712,"15min":3.3500000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.101,"15min":1.117},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.887,"5min":1.887,"15min":5.2009999999999996},"last":1.018}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.04,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.835,"5min":1.835,"15min":3.4300000000000002},"last":1.4590000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.0569999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":1.0860000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1739999999999999,"15min":1.1759999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.61699999999999999},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.341},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.292,"15min":1.274},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.583,"5min":1.661,"15min":3.7080000000000002},"last":1.3720000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.226,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.456,"5min":1.796,"15min":3.8849999999999998},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2609999999999999,"15min":1.319},"min":{"1min":0.75,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.748,"5min":1.77,"15min":15.576000000000001},"last":1.2709999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.333},"min":{"1min":0.85299999999999998,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":1.23},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.345,"15min":1.3540000000000001},"min":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.895,"5min":1.895,"15min":3.786},"last":1.4079999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.401,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.355,"15min":1.363},"min":{"1min":0.92400000000000004,"5min":0.89900000000000002,"15min":0.76500000000000001},"max":{"1min":1.913,"5min":2.032,"15min":4.0519999999999996},"last":1.4930000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575013,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1081,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194231,"statfs":{"total":200000000,"available":198892613,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.45600000000000002,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.6399999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.497,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.6140000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":1.1000000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.97399999999999998,"15min":1.0429999999999999},"min":{"1min":0.79500000000000004,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.492,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.0289999999999999,"15min":1.1399999999999999},"min":{"1min":0.60199999999999998,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.2869999999999999,"5min":1.708,"15min":41.758000000000003},"last":1.214}]},{"osd":3,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.95099999999999996},"min":{"1min":0.63100000000000001,"5min":0.42099999999999999,"15min":0.35099999999999998},"max":{"1min":1.3500000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.109,"15min":1.0920000000000001},"min":{"1min":0.80900000000000005,"5min":0.47699999999999998,"15min":0.36499999999999999},"max":{"1min":1.407,"5min":1.7210000000000001,"15min":2.02},"last":0.97899999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2050000000000001,"15min":1.1890000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.738,"5min":1.738,"15min":4.4269999999999996},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.2809999999999999,"15min":1.28},"min":{"1min":0.96499999999999997,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.5760000000000001,"5min":1.79,"15min":15.766},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2629999999999999,"15min":1.27},"min":{"1min":0.94199999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.321},{"interface":"front","average":{"1min":1.284,"5min":1.26,"15min":1.262},"min":{"1min":0.77500000000000002,"5min":0.747,"15min":0.63100000000000001},"max":{"1min":1.605,"5min":1.6919999999999999,"15min":4.3970000000000002},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.391,"15min":1.3380000000000001},"min":{"1min":1.0940000000000001,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":1.6970000000000001,"5min":1.9470000000000001,"15min":5.4669999999999996},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.762,"5min":1.8939999999999999,"15min":17.161000000000001},"last":1.2749999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:58:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3759999999999999,"15min":1.3819999999999999},"min":{"1min":0.85599999999999998,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":1.655,"5min":1.974,"15min":14.381},"last":1.405},{"interface":"front","average":{"1min":1.325,"5min":1.3109999999999999,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":1.8759999999999999,"5min":2.1230000000000002,"15min":9.7080000000000002},"last":1.343}]}]}],"pool_statfs":[]}} 2023-12-19T13:59:51.611 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:59:51.611 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:59:51.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.874+0000 7f076d68b640 1 Processor -- start 2023-12-19T13:59:51.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.874+0000 7f076d68b640 1 -- start start 2023-12-19T13:59:51.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.876+0000 7f076d68b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b2d50 0x7f076815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.876+0000 7f076d68b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f076815a210 0x7f07680b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.877+0000 7f076d68b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680b1460 con 0x7f07680b0000 2023-12-19T13:59:51.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.877+0000 7f076d68b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07680ce9a0 con 0x7f076815a210 2023-12-19T13:59:51.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.877+0000 7f076d68b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076815ab20 con 0x7f07680b2d50 2023-12-19T13:59:51.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.877+0000 7f075e7fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b2d50 0x7f076815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.877+0000 7f07677fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f076815a210 0x7f07680b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.877+0000 7f075e7fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b2d50 0x7f076815b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:44498/0 (socket says 172.21.15.113:44498) 2023-12-19T13:59:51.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.877+0000 7f075e7fc640 1 -- 172.21.15.113:0/3793892186 learned_addr learned my addr 172.21.15.113:0/3793892186 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:51.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.878+0000 7f075e7fc640 1 -- 172.21.15.113:0/3793892186 >> v2:172.21.15.151:3300/0 conn(0x7f076815a210 msgr2=0x7f07680b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:51.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.878+0000 7f075e7fc640 1 --2- 172.21.15.113:0/3793892186 >> v2:172.21.15.151:3300/0 conn(0x7f076815a210 0x7f07680b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.878+0000 7f075e7fc640 1 -- 172.21.15.113:0/3793892186 >> v1:172.21.15.151:6789/0 conn(0x7f07680b0000 legacy=0x7f07680b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.878+0000 7f075e7fc640 1 -- 172.21.15.113:0/3793892186 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076815ae00 con 0x7f07680b2d50 2023-12-19T13:59:51.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.879+0000 7f075e7fc640 1 --2- 172.21.15.113:0/3793892186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b2d50 0x7f076815b720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0750009870 tx=0x7f075002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c2343b20de0378 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:51.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f07667fc640 1 -- 172.21.15.113:0/3793892186 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750030840 con 0x7f07680b2d50 2023-12-19T13:59:51.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f07667fc640 1 -- 172.21.15.113:0/3793892186 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500309a0 con 0x7f07680b2d50 2023-12-19T13:59:51.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f07667fc640 1 -- 172.21.15.113:0/3793892186 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750030d30 con 0x7f07680b2d50 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f076d68b640 1 -- 172.21.15.113:0/3793892186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b2d50 msgr2=0x7f076815b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f076d68b640 1 --2- 172.21.15.113:0/3793892186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b2d50 0x7f076815b720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0750009870 tx=0x7f075002b980 comp rx=0 tx=0).stop 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f076d68b640 1 -- 172.21.15.113:0/3793892186 shutdown_connections 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f076d68b640 1 --2- 172.21.15.113:0/3793892186 >> v2:172.21.15.151:3300/0 conn(0x7f076815a210 0x7f07680b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f076d68b640 1 --2- 172.21.15.113:0/3793892186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b2d50 0x7f076815b720 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.880+0000 7f076d68b640 1 -- 172.21.15.113:0/3793892186 >> 172.21.15.113:0/3793892186 conn(0x7f0768073180 msgr2=0x7f07680659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.881+0000 7f076d68b640 1 -- 172.21.15.113:0/3793892186 shutdown_connections 2023-12-19T13:59:51.880 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.881+0000 7f076d68b640 1 -- 172.21.15.113:0/3793892186 wait complete. 2023-12-19T13:59:51.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.882+0000 7f076d68b640 1 Processor -- start 2023-12-19T13:59:51.881 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.882+0000 7f076d68b640 1 -- start start 2023-12-19T13:59:51.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.883+0000 7f076d68b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b0000 0x7f0768141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.883+0000 7f076d68b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07680b2d50 0x7f076806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.883+0000 7f076d68b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f076815a210 0x7f076806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.883+0000 7f076d68b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0768148a80 con 0x7f076815a210 2023-12-19T13:59:51.883 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.883+0000 7f076d68b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076806c700 con 0x7f07680b2d50 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.883+0000 7f076d68b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076806baf0 con 0x7f07680b0000 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f076815a210 0x7f076806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f076815a210 0x7f076806dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38826/0 (socket says 172.21.15.113:38826) 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 -- 172.21.15.113:0/2189779862 learned_addr learned my addr 172.21.15.113:0/2189779862 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f0766ffd640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b0000 0x7f0768141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f075e7fc640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07680b2d50 0x7f076806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 -- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b0000 msgr2=0x7f0768141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b0000 0x7f0768141440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 -- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07680b2d50 msgr2=0x7f076806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07680b2d50 0x7f076806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:51.884 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f07677fe640 1 -- 172.21.15.113:0/2189779862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500094d0 con 0x7f076815a210 2023-12-19T13:59:51.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.884+0000 7f075e7fc640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07680b2d50 0x7f076806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:51.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.885+0000 7f07677fe640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f076815a210 0x7f076806dbf0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f076000e7f0 tx=0x7f076000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:51.885 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.885+0000 7f075ffff640 1 -- 172.21.15.113:0/2189779862 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760009510 con 0x7f076815a210 2023-12-19T13:59:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.885+0000 7f075ffff640 1 -- 172.21.15.113:0/2189779862 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076000ee40 con 0x7f076815a210 2023-12-19T13:59:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.885+0000 7f075ffff640 1 -- 172.21.15.113:0/2189779862 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000cb80 con 0x7f076815a210 2023-12-19T13:59:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.885+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076806bdd0 con 0x7f076815a210 2023-12-19T13:59:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.885+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076806c390 con 0x7f076815a210 2023-12-19T13:59:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.886+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076806c870 con 0x7f076815a210 2023-12-19T13:59:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.887+0000 7f075ffff640 1 -- 172.21.15.113:0/2189779862 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f076000cce0 con 0x7f076815a210 2023-12-19T13:59:51.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.888+0000 7f075ffff640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f074806a430 0x7f074806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:51.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.888+0000 7f075ffff640 1 -- 172.21.15.113:0/2189779862 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0760088a20 con 0x7f076815a210 2023-12-19T13:59:51.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.888+0000 7f0766ffd640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f074806a430 0x7f074806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:51.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.889+0000 7f0766ffd640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f074806a430 0x7f074806c8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f07580012e0 tx=0x7f0758009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:51.893+0000 7f075ffff640 1 -- 172.21.15.113:0/2189779862 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0760053fb0 con 0x7f076815a210 2023-12-19T13:59:52.156 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.157+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0768061910 con 0x7f076815a210 2023-12-19T13:59:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.166+0000 7f075ffff640 1 -- 172.21.15.113:0/2189779862 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f07600170e0 con 0x7f076815a210 2023-12-19T13:59:52.165 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2023-12-19T13:59:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f074806a430 msgr2=0x7f074806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f074806a430 0x7f074806c8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f07580012e0 tx=0x7f0758009040 comp rx=0 tx=0).stop 2023-12-19T13:59:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f076815a210 msgr2=0x7f076806dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.168 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f076815a210 0x7f076806dbf0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f076000e7f0 tx=0x7f076000ebf0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 shutdown_connections 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f074806a430 0x7f074806c8f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f076815a210 0x7f076806dbf0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07680b2d50 0x7f076806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 --2- 172.21.15.113:0/2189779862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07680b0000 0x7f0768141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 >> 172.21.15.113:0/2189779862 conn(0x7f0768073180 msgr2=0x7f076815cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 shutdown_connections 2023-12-19T13:59:52.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.169+0000 7f076d68b640 1 -- 172.21.15.113:0/2189779862 wait complete. 2023-12-19T13:59:52.187 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:52.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.402+0000 7fbfe4dae640 1 Processor -- start 2023-12-19T13:59:52.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.402+0000 7fbfe4dae640 1 -- start start 2023-12-19T13:59:52.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfe4dae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 0x7fbfe006df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfe4dae640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe0141e50 con 0x7fbfe0141a70 2023-12-19T13:59:52.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfe4dae640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe006b480 con 0x7fbfe006e4a0 2023-12-19T13:59:52.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfe4dae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe006b760 con 0x7fbfe00af7d0 2023-12-19T13:59:52.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfde59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbfe0141a70 0x7fbfe006c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:42788/0 (socket says 172.21.15.113:42788) 2023-12-19T13:59:52.403 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfde59c640 1 -- 172.21.15.113:0/441245362 learned_addr learned my addr 172.21.15.113:0/441245362 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014397271 0 0) 0x7fbfe0141e50 con 0x7fbfe0141a70 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfddd9b640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 0x7fbfe006df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.404+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc8003520 con 0x7fbfe0141a70 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3251988340 0 0) 0x7fbfc8003520 con 0x7fbfe0141a70 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 msgr2=0x7fbfe006df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 0x7fbfe006df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 >> v1:172.21.15.151:6789/0 conn(0x7fbfe006e4a0 legacy=0x7fbfe00b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe006ba40 con 0x7fbfe0141a70 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbfd00019f0 con 0x7fbfe0141a70 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 >> v1:172.21.15.113:6789/0 conn(0x7fbfe0141a70 legacy=0x7fbfe006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfc8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 0x7fbfc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc8004d00 0x7fbfc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe006b760 con 0x7fbfc80039a0 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc800ba60 con 0x7fbfc8004d00 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc800bc20 con 0x7fbfe00af7d0 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.405+0000 7fbfde59c640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfc8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.406+0000 7fbfddd9b640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 0x7fbfc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.406+0000 7fbfded9d640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc8004d00 0x7fbfc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.406+0000 7fbfde59c640 1 -- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 msgr2=0x7fbfc80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.406+0000 7fbfde59c640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe00af7d0 0x7fbfc80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.406+0000 7fbfde59c640 1 -- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc8004d00 msgr2=0x7fbfc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:52.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.406+0000 7fbfde59c640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc8004d00 0x7fbfc8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.406+0000 7fbfde59c640 1 -- 172.21.15.113:0/441245362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc8003520 con 0x7fbfc80039a0 2023-12-19T13:59:52.407 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.407+0000 7fbfde59c640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfc8003dc0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0002230 tx=0x7fbfc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4259e21d2e5bb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.407+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0034630 con 0x7fbfc80039a0 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.407+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd002f070 con 0x7fbfc80039a0 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.407+0000 7fbfdd59a640 1 -- 172.21.15.113:0/441245362 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0034a10 con 0x7fbfc80039a0 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.408+0000 7fbfe4dae640 1 -- 172.21.15.113:0/441245362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 msgr2=0x7fbfc8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.408+0000 7fbfe4dae640 1 --2- 172.21.15.113:0/441245362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfc8003dc0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0002230 tx=0x7fbfc80057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.408+0000 7fbfded9d640 1 -- 172.21.15.113:0/441245362 reap_dead start 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.408+0000 7fbfe4dae640 1 -- 172.21.15.113:0/441245362 shutdown_connections 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.408+0000 7fbfe4dae640 1 -- 172.21.15.113:0/441245362 >> 172.21.15.113:0/441245362 conn(0x7fbfe00cef20 msgr2=0x7fbfe00cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.408+0000 7fbfe4dae640 1 -- 172.21.15.113:0/441245362 shutdown_connections 2023-12-19T13:59:52.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.408+0000 7fbfe4dae640 1 -- 172.21.15.113:0/441245362 wait complete. 2023-12-19T13:59:52.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.410+0000 7fbfe4dae640 1 Processor -- start 2023-12-19T13:59:52.409 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.410+0000 7fbfe4dae640 1 -- start start 2023-12-19T13:59:52.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfe4dae640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfe00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfe4dae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe015a880 0x7fbfe015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfe4dae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe0132570 0x7fbfe01329f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfe4dae640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0133510 con 0x7fbfc80039a0 2023-12-19T13:59:52.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfe4dae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00a9bc0 con 0x7fbfe015a880 2023-12-19T13:59:52.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfe4dae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe015b220 con 0x7fbfe0132570 2023-12-19T13:59:52.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfe00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:52.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfe00ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38848/0 (socket says 172.21.15.113:38848) 2023-12-19T13:59:52.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 -- 172.21.15.113:0/2883210607 learned_addr learned my addr 172.21.15.113:0/2883210607 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:52.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 -- 172.21.15.113:0/2883210607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe0132570 msgr2=0x7fbfe01329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe0132570 0x7fbfe01329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 -- 172.21.15.113:0/2883210607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe015a880 msgr2=0x7fbfe015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe015a880 0x7fbfe015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.411+0000 7fbfde59c640 1 -- 172.21.15.113:0/2883210607 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0133230 con 0x7fbfc80039a0 2023-12-19T13:59:52.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.412+0000 7fbfde59c640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfe00ccce0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fbfd002ca70 tx=0x7fbfd0001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:52.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.412+0000 7fbfceffd640 1 -- 172.21.15.113:0/2883210607 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0034980 con 0x7fbfc80039a0 2023-12-19T13:59:52.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.412+0000 7fbfceffd640 1 -- 172.21.15.113:0/2883210607 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0034ae0 con 0x7fbfc80039a0 2023-12-19T13:59:52.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.412+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe0130680 con 0x7fbfc80039a0 2023-12-19T13:59:52.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.412+0000 7fbfceffd640 1 -- 172.21.15.113:0/2883210607 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0034e70 con 0x7fbfc80039a0 2023-12-19T13:59:52.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.412+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe0130c40 con 0x7fbfc80039a0 2023-12-19T13:59:52.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.413+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe01304e0 con 0x7fbfc80039a0 2023-12-19T13:59:52.413 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.414+0000 7fbfceffd640 1 -- 172.21.15.113:0/2883210607 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfd0031030 con 0x7fbfc80039a0 2023-12-19T13:59:52.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.415+0000 7fbfceffd640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfc006a460 0x7fbfc006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:52.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.415+0000 7fbfceffd640 1 -- 172.21.15.113:0/2883210607 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfd00aab20 con 0x7fbfc80039a0 2023-12-19T13:59:52.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.415+0000 7fbfddd9b640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfc006a460 0x7fbfc006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:52.414 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.416+0000 7fbfddd9b640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfc006a460 0x7fbfc006c920 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00cde30 tx=0x7fbfd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:52.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.419+0000 7fbfceffd640 1 -- 172.21.15.113:0/2883210607 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbfe01304e0 con 0x7fbfc80039a0 2023-12-19T13:59:52.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.645+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfe01304e0 con 0x7fbfc80039a0 2023-12-19T13:59:52.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.646+0000 7fbfceffd640 1 -- 172.21.15.113:0/2883210607 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fbfe01304e0 con 0x7fbfc80039a0 2023-12-19T13:59:52.645 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:52.645 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T13:59:52.645 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.648+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfc006a460 msgr2=0x7fbfc006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.648+0000 7fbfe4dae640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfc006a460 0x7fbfc006c920 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00cde30 tx=0x7fbfd4008040 comp rx=0 tx=0).stop 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.648+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 msgr2=0x7fbfe00ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.648+0000 7fbfe4dae640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfe00ccce0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fbfd002ca70 tx=0x7fbfd0001cb0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 shutdown_connections 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbfc006a460 0x7fbfc006c920 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfe0132570 0x7fbfe01329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe015a880 0x7fbfe015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 --2- 172.21.15.113:0/2883210607 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbfc80039a0 0x7fbfe00ccce0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 >> 172.21.15.113:0/2883210607 conn(0x7fbfe00cef20 msgr2=0x7fbfe006c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 shutdown_connections 2023-12-19T13:59:52.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:52.649+0000 7fbfe4dae640 1 -- 172.21.15.113:0/2883210607 wait complete. 2023-12-19T13:59:53.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:59:41.210577+0000', 'modified': '2023-12-19T13:59:44.735733+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9081}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9081': {'gid': 9081, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.113:6837/3462211339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6835', 'nonce': 3462211339}, {'type': 'v1', 'addr': '172.21.15.113:6837', 'nonce': 3462211339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:59:53.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:59:53.069 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T13:59:53.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.295+0000 7fe08ebc9640 1 Processor -- start 2023-12-19T13:59:53.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.295+0000 7fe08ebc9640 1 -- start start 2023-12-19T13:59:53.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe08ebc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe088146e10 0x7fe0880d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe08ebc9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe0880d2b00 0x7fe0880b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe08ebc9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0880ce110 0x7fe0880ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe08ebc9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0880d2430 con 0x7fe0880d2b00 2023-12-19T13:59:53.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe08ebc9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0880ceae0 con 0x7fe0880ce110 2023-12-19T13:59:53.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe08ebc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880cd840 con 0x7fe088146e10 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe0880d2b00 0x7fe0880b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe0880d2b00 0x7fe0880b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38854/0 (socket says 172.21.15.113:38854) 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 -- 172.21.15.113:0/2066863303 learned_addr learned my addr 172.21.15.113:0/2066863303 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 -- 172.21.15.113:0/2066863303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe088146e10 msgr2=0x7fe0880d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 --2- 172.21.15.113:0/2066863303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe088146e10 0x7fe0880d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 -- 172.21.15.113:0/2066863303 >> v2:172.21.15.151:3300/0 conn(0x7fe0880ce110 msgr2=0x7fe0880ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 --2- 172.21.15.113:0/2066863303 >> v2:172.21.15.151:3300/0 conn(0x7fe0880ce110 0x7fe0880ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.297+0000 7fe087fff640 1 -- 172.21.15.113:0/2066863303 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0880d2620 con 0x7fe0880d2b00 2023-12-19T13:59:53.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.298+0000 7fe087fff640 1 --2- 172.21.15.113:0/2066863303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0880d2b00 0x7fe0880b6780 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fe0880d3360 tx=0x7fe07402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49fe633090870cd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.299+0000 7fe0877fe640 1 -- 172.21.15.113:0/2066863303 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074031640 con 0x7fe0880d2b00 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.299+0000 7fe0877fe640 1 -- 172.21.15.113:0/2066863303 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0740317a0 con 0x7fe0880d2b00 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.299+0000 7fe0877fe640 1 -- 172.21.15.113:0/2066863303 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074031b30 con 0x7fe0880d2b00 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.299+0000 7fe08ebc9640 1 -- 172.21.15.113:0/2066863303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0880d2b00 msgr2=0x7fe0880b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.299+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/2066863303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0880d2b00 0x7fe0880b6780 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fe0880d3360 tx=0x7fe07402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.300+0000 7fe08ebc9640 1 -- 172.21.15.113:0/2066863303 shutdown_connections 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.300+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/2066863303 >> v2:172.21.15.151:3300/0 conn(0x7fe0880ce110 0x7fe0880ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.300+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/2066863303 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0880d2b00 0x7fe0880b6780 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.300+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/2066863303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe088146e10 0x7fe0880d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.300+0000 7fe08ebc9640 1 -- 172.21.15.113:0/2066863303 >> 172.21.15.113:0/2066863303 conn(0x7fe0880b29c0 msgr2=0x7fe0880b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.300+0000 7fe08ebc9640 1 -- 172.21.15.113:0/2066863303 shutdown_connections 2023-12-19T13:59:53.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.300+0000 7fe08ebc9640 1 -- 172.21.15.113:0/2066863303 wait complete. 2023-12-19T13:59:53.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.301+0000 7fe08ebc9640 1 Processor -- start 2023-12-19T13:59:53.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.301+0000 7fe08ebc9640 1 -- start start 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.302+0000 7fe08ebc9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0880ce110 0x7fe0881f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.302+0000 7fe08ebc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0880d2b00 0x7fe088131560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.302+0000 7fe08ebc9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe088146e10 0x7fe088131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.302+0000 7fe08ebc9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe088132440 con 0x7fe088146e10 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.302+0000 7fe08ebc9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08813e1a0 con 0x7fe0880ce110 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.302+0000 7fe08ebc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08813dec0 con 0x7fe0880d2b00 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe088146e10 0x7fe088131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe088146e10 0x7fe088131aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38860/0 (socket says 172.21.15.113:38860) 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 -- 172.21.15.113:0/1041948209 learned_addr learned my addr 172.21.15.113:0/1041948209 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe087fff640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0880d2b00 0x7fe088131560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08c965640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0880ce110 0x7fe0881f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 -- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0880d2b00 msgr2=0x7fe088131560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0880d2b00 0x7fe088131560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 -- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0880ce110 msgr2=0x7fe0881f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0880ce110 0x7fe0881f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe08d166640 1 -- 172.21.15.113:0/1041948209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740094d0 con 0x7fe088146e10 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.303+0000 7fe087fff640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0880d2b00 0x7fe088131560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.304+0000 7fe08d166640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe088146e10 0x7fe088131aa0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fe08000b970 tx=0x7fe08000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.304+0000 7fe0857fa640 1 -- 172.21.15.113:0/1041948209 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08000cb40 con 0x7fe088146e10 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.304+0000 7fe0857fa640 1 -- 172.21.15.113:0/1041948209 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08000ccc0 con 0x7fe088146e10 2023-12-19T13:59:53.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.304+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe088142f90 con 0x7fe088146e10 2023-12-19T13:59:53.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.304+0000 7fe0857fa640 1 -- 172.21.15.113:0/1041948209 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080014680 con 0x7fe088146e10 2023-12-19T13:59:53.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.304+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe088143550 con 0x7fe088146e10 2023-12-19T13:59:53.305 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.306+0000 7fe0857fa640 1 -- 172.21.15.113:0/1041948209 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe08001d3b0 con 0x7fe088146e10 2023-12-19T13:59:53.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.307+0000 7fe0857fa640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe06c06a430 0x7fe06c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.307+0000 7fe0857fa640 1 -- 172.21.15.113:0/1041948209 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe080088950 con 0x7fe088146e10 2023-12-19T13:59:53.306 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.307+0000 7fe08c965640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe06c06a430 0x7fe06c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.308+0000 7fe091811740 1 Processor -- start 2023-12-19T13:59:53.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.308+0000 7fe091811740 1 -- start start 2023-12-19T13:59:53.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.308+0000 7fe08c965640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe06c06a430 0x7fe06c06c8f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b810 tx=0x7fe07c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8bd30 0x557568e8c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e5bcb0 0x557568e88fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe091811740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe091811740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568dcbf80 con 0x557568e5f8b0 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568dc9710 con 0x557568e5bcb0 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557568dc5000 con 0x557568e8bd30 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe08d166640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe08d166640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e894e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38868/0 (socket says 172.21.15.113:38868) 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.309+0000 7fe08d166640 1 -- 172.21.15.113:0/16702826 learned_addr learned my addr 172.21.15.113:0/16702826 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe08d166640 1 -- 172.21.15.113:0/16702826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8bd30 msgr2=0x557568e8c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe08d166640 1 --2- 172.21.15.113:0/16702826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8bd30 0x557568e8c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe08d166640 1 -- 172.21.15.113:0/16702826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e5bcb0 msgr2=0x557568e88fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe08d166640 1 --2- 172.21.15.113:0/16702826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e5bcb0 0x557568e88fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe08d166640 1 -- 172.21.15.113:0/16702826 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557568d8c690 con 0x557568e5f8b0 2023-12-19T13:59:53.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe08d166640 1 --2- 172.21.15.113:0/16702826 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e894e0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fe080057af0 tx=0x7fe080004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcff870f63fcc809 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe0727fc640 1 -- 172.21.15.113:0/16702826 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08005b990 con 0x557568e5f8b0 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe0727fc640 1 -- 172.21.15.113:0/16702826 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08005fb40 con 0x557568e5f8b0 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.310+0000 7fe0727fc640 1 -- 172.21.15.113:0/16702826 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080054270 con 0x557568e5f8b0 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 -- 172.21.15.113:0/16702826 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 msgr2=0x557568e894e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 --2- 172.21.15.113:0/16702826 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e894e0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fe080057af0 tx=0x7fe080004b50 comp rx=0 tx=0).stop 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 -- 172.21.15.113:0/16702826 shutdown_connections 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 --2- 172.21.15.113:0/16702826 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e894e0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 --2- 172.21.15.113:0/16702826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e5bcb0 0x557568e88fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 --2- 172.21.15.113:0/16702826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8bd30 0x557568e8c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 -- 172.21.15.113:0/16702826 >> 172.21.15.113:0/16702826 conn(0x557568e5dfc0 msgr2=0x557568ea6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 -- 172.21.15.113:0/16702826 shutdown_connections 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.311+0000 7fe091811740 1 -- 172.21.15.113:0/16702826 wait complete. 2023-12-19T13:59:53.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.312+0000 7fe091811740 1 -- start start 2023-12-19T13:59:53.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.312+0000 7fe091811740 1 Processor -- start 2023-12-19T13:59:53.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe091811740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e81450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8bd30 0x557568e864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 0x557568e878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe091811740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568d667d0 con 0x557568e5f8b0 2023-12-19T13:59:53.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568d66470 con 0x557568e8bd30 2023-12-19T13:59:53.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557568b2cf20 con 0x557568e8d9f0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe091811740 10 client.0 _ll_register_callbacks cb 0x557568db51b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe08c965640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e81450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe08c965640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e81450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38874/0 (socket says 172.21.15.113:38874) 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.313+0000 7fe08c965640 1 -- 172.21.15.113:0/3672383736 learned_addr learned my addr 172.21.15.113:0/3672383736 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe087fff640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8bd30 0x557568e864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe08c965640 1 -- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 msgr2=0x557568e878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe08d166640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 0x557568e878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe08c965640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 0x557568e878b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe08c965640 1 -- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8bd30 msgr2=0x557568e864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe08c965640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8bd30 0x557568e864c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe08c965640 1 -- 172.21.15.113:0/3672383736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe088143550 con 0x557568e5f8b0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe087fff640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8bd30 0x557568e864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe08c965640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e81450 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00dd10 tx=0x7fe07c014800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5522b4b8de844667 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe0677fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:59:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe0677fe640 1 -- 172.21.15.113:0/3672383736 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c01f400 con 0x557568e5f8b0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe0677fe640 1 -- 172.21.15.113:0/3672383736 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe07c01f560 con 0x557568e5f8b0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.314+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557568def550 con 0x557568e5f8b0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe0677fe640 1 -- 172.21.15.113:0/3672383736 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe07c01f720 con 0x557568e5f8b0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 10 client.9243 fetch_fsmap learned FSMap version 88 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x557568dc3680 con 0x557568e5f8b0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe0677fe640 1 -- 172.21.15.113:0/3672383736 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557568def550 con 0x557568e5f8b0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe0677fe640 1 -- 172.21.15.113:0/3672383736 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 88) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe07c01f880 con 0x557568e5f8b0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 10 client.9243 fetch_fsmap finished waiting for FSMap version 88 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 10 client.9243 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 20 client.9243 populate_metadata read hostname 'smithi113' 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568eb95f0 0x557568eb99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 4 client.9243 mds_command: new command op to 9081 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 --> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557568db7b50 con 0x557568eb95f0 2023-12-19T13:59:53.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.315+0000 7fe087fff640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568eb95f0 0x557568eb99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.316+0000 7fe087fff640 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568eb95f0 0x557568eb99d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85728f7cb28c83ea server_cookie=124e86227956c1e7 in_seq=0 out_seq=0 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.316+0000 7fe0677fe640 10 client.9243 ms_handle_connect on v2:172.21.15.113:6835/3462211339 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe0677fe640 1 -- 172.21.15.113:0/3672383736 <== mds.0 v2:172.21.15.113:6835/3462211339 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x557568db7b50 con 0x557568eb95f0 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe0677fe640 10 client.9243 handle_command_reply: tid=0 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 client.9243 shutdown 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 msgr2=0x557568e81450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e81450 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00dd10 tx=0x7fe07c014800 comp rx=0 tx=0).stop 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 shutdown_connections 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568eb95f0 0x557568eb99d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 0x557568e878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8bd30 0x557568e864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 --2- 172.21.15.113:0/3672383736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e81450 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe0677fe640 0 client.9243 ms_handle_reset on v2:172.21.15.113:6835/3462211339 2023-12-19T13:59:53.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 >> 172.21.15.113:0/3672383736 conn(0x557568e5bcb0 msgr2=0x557568e60130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 shutdown_connections 2023-12-19T13:59:53.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 1 -- 172.21.15.113:0/3672383736 wait complete. 2023-12-19T13:59:53.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.317+0000 7fe091811740 20 client.9243 trim_cache size 0 max 16384 2023-12-19T13:59:53.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 Processor -- start 2023-12-19T13:59:53.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 -- start start 2023-12-19T13:59:53.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e5f8b0 0x557568ea9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e8bd30 0x557568e84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8d9f0 0x557568e85040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568e85580 con 0x557568e8bd30 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568eb9120 con 0x557568e8d9f0 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.334+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557568dce590 con 0x557568e5f8b0 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e8bd30 0x557568e84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e8bd30 0x557568e84b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38886/0 (socket says 172.21.15.113:38886) 2023-12-19T13:59:53.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 -- 172.21.15.113:0/3763296086 learned_addr learned my addr 172.21.15.113:0/3763296086 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 -- 172.21.15.113:0/3763296086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e5f8b0 msgr2=0x557568ea9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe08c965640 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e5f8b0 0x557568ea9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e5f8b0 0x557568ea9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 -- 172.21.15.113:0/3763296086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8d9f0 msgr2=0x557568e85040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8d9f0 0x557568e85040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.335+0000 7fe087fff640 1 -- 172.21.15.113:0/3763296086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557568d659e0 con 0x557568e8bd30 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe087fff640 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e8bd30 0x557568e84b00 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fe074009870 tx=0x7fe074030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9eb50d4486538e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe072ffd640 1 -- 172.21.15.113:0/3763296086 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074031ce0 con 0x557568e8bd30 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe072ffd640 1 -- 172.21.15.113:0/3763296086 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074031e40 con 0x557568e8bd30 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe072ffd640 1 -- 172.21.15.113:0/3763296086 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074047250 con 0x557568e8bd30 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 -- 172.21.15.113:0/3763296086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e8bd30 msgr2=0x557568e84b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e8bd30 0x557568e84b00 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fe074009870 tx=0x7fe074030000 comp rx=0 tx=0).stop 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 -- 172.21.15.113:0/3763296086 shutdown_connections 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e8d9f0 0x557568e85040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e8bd30 0x557568e84b00 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 --2- 172.21.15.113:0/3763296086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e5f8b0 0x557568ea9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 -- 172.21.15.113:0/3763296086 >> 172.21.15.113:0/3763296086 conn(0x557568e5bcb0 msgr2=0x557568ebfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 -- 172.21.15.113:0/3763296086 shutdown_connections 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.336+0000 7fe091811740 1 -- 172.21.15.113:0/3763296086 wait complete. 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.337+0000 7fe091811740 1 -- start start 2023-12-19T13:59:53.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.337+0000 7fe091811740 1 Processor -- start 2023-12-19T13:59:53.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe091811740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e84240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 0x557568e7ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe091811740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e7f770 0x557568ebfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe091811740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568f165e0 con 0x557568e5f8b0 2023-12-19T13:59:53.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557568f15c40 con 0x557568e7f770 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe091811740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557568f15f20 con 0x557568e8d9f0 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe091811740 10 client.0 _ll_register_callbacks cb 0x7fe080057930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe08c965640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e84240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.338+0000 7fe08c965640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e84240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38890/0 (socket says 172.21.15.113:38890) 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe08c965640 1 -- 172.21.15.113:0/2814323505 learned_addr learned my addr 172.21.15.113:0/2814323505 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe08c965640 1 -- 172.21.15.113:0/2814323505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 msgr2=0x557568e7ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe08c965640 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 0x557568e7ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe08c965640 1 -- 172.21.15.113:0/2814323505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e7f770 msgr2=0x557568ebfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe08c965640 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e7f770 0x557568ebfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe08c965640 1 -- 172.21.15.113:0/2814323505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0880d2620 con 0x557568e5f8b0 2023-12-19T13:59:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe08c965640 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e84240 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fe07c000c00 tx=0x7fe07c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dc8cb361c13293 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe0677fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe0677fe640 1 -- 172.21.15.113:0/2814323505 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c005d30 con 0x557568e5f8b0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.339+0000 7fe0677fe640 1 -- 172.21.15.113:0/2814323505 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe07c01fd90 con 0x557568e5f8b0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe08005fb40 con 0x557568e5f8b0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe0677fe640 1 -- 172.21.15.113:0/2814323505 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe07c005e90 con 0x557568e5f8b0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 10 client.9249 fetch_fsmap learned FSMap version 88 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x557568d8aef0 con 0x557568e5f8b0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe0677fe640 1 -- 172.21.15.113:0/2814323505 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08005fb40 con 0x557568e5f8b0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe0677fe640 1 -- 172.21.15.113:0/2814323505 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 88) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe07c034020 con 0x557568e5f8b0 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 10 client.9249 fetch_fsmap finished waiting for FSMap version 88 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 10 client.9249 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 20 client.9249 populate_metadata read hostname 'smithi113' 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568e61620 0x557568f20cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 4 client.9249 mds_command: new command op to 9081 tid=0[{"prefix": "status"}] 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 --> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557568dbe080 con 0x557568e61620 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.340+0000 7fe087fff640 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568e61620 0x557568f20cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe087fff640 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568e61620 0x557568f20cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c67a8fa696f315b5 server_cookie=9789613d1a7ab99d in_seq=0 out_seq=0 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe0677fe640 10 client.9249 ms_handle_connect on v2:172.21.15.113:6835/3462211339 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe0677fe640 1 -- 172.21.15.113:0/2814323505 <== mds.0 v2:172.21.15.113:6835/3462211339 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557568dbe080 con 0x557568e61620 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe0677fe640 10 client.9249 handle_command_reply: tid=0 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 client.9249 shutdown 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 msgr2=0x557568e84240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e84240 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fe07c000c00 tx=0x7fe07c013000 comp rx=0 tx=0).stop 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 shutdown_connections 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:6835/3462211339,v1:172.21.15.113:6837/3462211339] conn(0x557568e61620 0x557568f20cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557568e7f770 0x557568ebfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557568e8d9f0 0x557568e7ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 --2- 172.21.15.113:0/2814323505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557568e5f8b0 0x557568e84240 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe0677fe640 0 client.9249 ms_handle_reset on v2:172.21.15.113:6835/3462211339 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.341+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 >> 172.21.15.113:0/2814323505 conn(0x557568e5bcb0 msgr2=0x557568e84c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 shutdown_connections 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe091811740 1 -- 172.21.15.113:0/2814323505 wait complete. 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe091811740 20 client.9249 trim_cache size 0 max 16384 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 9081, 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2023-12-19T13:59:53.346 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2023-12-19T13:59:53.347 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2023-12-19T13:59:53.347 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 12.126250461, 2023-12-19T13:59:53.347 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 88, 2023-12-19T13:59:53.347 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 196, 2023-12-19T13:59:53.347 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 196, 2023-12-19T13:59:53.347 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 17.817134711000001 2023-12-19T13:59:53.347 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:59:53.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe06c06a430 msgr2=0x7fe06c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe06c06a430 0x7fe06c06c8f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b810 tx=0x7fe07c008040 comp rx=0 tx=0).stop 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe088146e10 msgr2=0x7fe088131aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe088146e10 0x7fe088131aa0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fe08000b970 tx=0x7fe08000be30 comp rx=0 tx=0).stop 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 shutdown_connections 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fe06c06a430 0x7fe06c06c8f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe088146e10 0x7fe088131aa0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0880d2b00 0x7fe088131560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 --2- 172.21.15.113:0/1041948209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0880ce110 0x7fe0881f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.342+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 >> 172.21.15.113:0/1041948209 conn(0x7fe0880b29c0 msgr2=0x7fe088144a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.343+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 shutdown_connections 2023-12-19T13:59:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.343+0000 7fe08ebc9640 1 -- 172.21.15.113:0/1041948209 wait complete. 2023-12-19T13:59:53.358 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:59:53.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.561+0000 7f4e834ab640 1 Processor -- start 2023-12-19T13:59:53.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.561+0000 7f4e834ab640 1 -- start start 2023-12-19T13:59:53.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e834ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e7c0ae110 0x7f4e7c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e834ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e834ab640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c0ae640 con 0x7f4e7c157bf0 2023-12-19T13:59:53.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e834ab640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c06b8c0 con 0x7f4e7c0ae110 2023-12-19T13:59:53.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e834ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c0b0ab0 con 0x7f4e7c0b0640 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e80a46640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e7c0ae110 0x7f4e7c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e81a48640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e81a48640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:44608/0 (socket says 172.21.15.113:44608) 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e81a48640 1 -- 172.21.15.113:0/1576265461 learned_addr learned my addr 172.21.15.113:0/1576265461 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.563+0000 7f4e80a46640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e7c0ae110 0x7f4e7c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:41536/0 (socket says 172.21.15.113:41536) 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.564+0000 7f4e80a46640 1 -- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 msgr2=0x7f4e7c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.564+0000 7f4e80a46640 1 --2- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.563 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.564+0000 7f4e80a46640 1 -- 172.21.15.113:0/1576265461 >> v1:172.21.15.151:6789/0 conn(0x7f4e7c157bf0 legacy=0x7f4e7c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.564+0000 7f4e80a46640 1 -- 172.21.15.113:0/1576265461 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0ae920 con 0x7f4e7c0ae110 2023-12-19T13:59:53.564 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.564+0000 7f4e81a48640 1 --2- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:59:53.565 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.566+0000 7f4e80a46640 1 --2- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c0b0100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0097d0 tx=0x7f4e6c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5466f75b9658b01f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.567+0000 7f4e73fff640 1 -- 172.21.15.113:0/1576265461 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c031800 con 0x7f4e7c0ae110 2023-12-19T13:59:53.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.567+0000 7f4e73fff640 1 -- 172.21.15.113:0/1576265461 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c031960 con 0x7f4e7c0ae110 2023-12-19T13:59:53.566 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.567+0000 7f4e73fff640 1 -- 172.21.15.113:0/1576265461 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c031cf0 con 0x7f4e7c0ae110 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.567+0000 7f4e834ab640 1 -- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c0ae110 msgr2=0x7f4e7c0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.567+0000 7f4e834ab640 1 --2- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c0b0100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0097d0 tx=0x7f4e6c02b8a0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.568+0000 7f4e834ab640 1 -- 172.21.15.113:0/1576265461 shutdown_connections 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.568+0000 7f4e834ab640 1 --2- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.568+0000 7f4e834ab640 1 --2- 172.21.15.113:0/1576265461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c0b0100 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.568+0000 7f4e834ab640 1 -- 172.21.15.113:0/1576265461 >> 172.21.15.113:0/1576265461 conn(0x7f4e7c0cbb70 msgr2=0x7f4e7c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.568+0000 7f4e834ab640 1 -- 172.21.15.113:0/1576265461 shutdown_connections 2023-12-19T13:59:53.567 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.568+0000 7f4e834ab640 1 -- 172.21.15.113:0/1576265461 wait complete. 2023-12-19T13:59:53.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.569+0000 7f4e834ab640 1 Processor -- start 2023-12-19T13:59:53.568 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.570+0000 7f4e834ab640 1 -- start start 2023-12-19T13:59:53.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.570+0000 7f4e834ab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.570+0000 7f4e834ab640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.570+0000 7f4e834ab640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c157bf0 0x7f4e7c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.570+0000 7f4e834ab640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c167f60 con 0x7f4e7c0ae110 2023-12-19T13:59:53.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.570+0000 7f4e834ab640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c1662f0 con 0x7f4e7c157bf0 2023-12-19T13:59:53.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.570+0000 7f4e834ab640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c070f30 con 0x7f4e7c0b0640 2023-12-19T13:59:53.570 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c14b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38904/0 (socket says 172.21.15.113:38904) 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 -- 172.21.15.113:0/2348661652 learned_addr learned my addr 172.21.15.113:0/2348661652 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e80a46640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81a48640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c157bf0 0x7f4e7c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 -- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 msgr2=0x7f4e7c14c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c14c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 -- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c157bf0 msgr2=0x7f4e7c148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c157bf0 0x7f4e7c148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.571+0000 7f4e81247640 1 -- 172.21.15.113:0/2348661652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74009b30 con 0x7f4e7c0ae110 2023-12-19T13:59:53.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.572+0000 7f4e81247640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c14b8e0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c390 tx=0x7f4e7800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.572+0000 7f4e71ffb640 1 -- 172.21.15.113:0/2348661652 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780052d0 con 0x7f4e7c0ae110 2023-12-19T13:59:53.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.572+0000 7f4e71ffb640 1 -- 172.21.15.113:0/2348661652 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e78005430 con 0x7f4e7c0ae110 2023-12-19T13:59:53.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.572+0000 7f4e71ffb640 1 -- 172.21.15.113:0/2348661652 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78003830 con 0x7f4e7c0ae110 2023-12-19T13:59:53.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.572+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c009400 con 0x7f4e7c0ae110 2023-12-19T13:59:53.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.572+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c165f80 con 0x7f4e7c0ae110 2023-12-19T13:59:53.572 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.573+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c061910 con 0x7f4e7c0ae110 2023-12-19T13:59:53.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.574+0000 7f4e71ffb640 1 -- 172.21.15.113:0/2348661652 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e78003990 con 0x7f4e7c0ae110 2023-12-19T13:59:53.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.575+0000 7f4e71ffb640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e6006a430 0x7f4e6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:53.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.575+0000 7f4e71ffb640 1 -- 172.21.15.113:0/2348661652 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e78087e70 con 0x7f4e7c0ae110 2023-12-19T13:59:53.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.575+0000 7f4e80a46640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e6006a430 0x7f4e6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:53.575 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.576+0000 7f4e80a46640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e6006a430 0x7f4e6006c8f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c036000 tx=0x7f4e6c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:53.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.580+0000 7f4e71ffb640 1 -- 172.21.15.113:0/2348661652 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4e78053460 con 0x7f4e7c0ae110 2023-12-19T13:59:53.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.812+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e7c0b0df0 con 0x7f4e7c0ae110 2023-12-19T13:59:53.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.813+0000 7f4e71ffb640 1 -- 172.21.15.113:0/2348661652 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e78017060 con 0x7f4e7c0ae110 2023-12-19T13:59:53.812 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:59:53.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e6006a430 msgr2=0x7f4e6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e6006a430 0x7f4e6006c8f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c036000 tx=0x7f4e6c03c040 comp rx=0 tx=0).stop 2023-12-19T13:59:53.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e7c0ae110 msgr2=0x7f4e7c14b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:53.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c14b8e0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c390 tx=0x7f4e7800c850 comp rx=0 tx=0).stop 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 shutdown_connections 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4e6006a430 0x7f4e6006c8f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c157bf0 0x7f4e7c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0b0640 0x7f4e7c14c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 --2- 172.21.15.113:0/2348661652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e7c0ae110 0x7f4e7c14b8e0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 >> 172.21.15.113:0/2348661652 conn(0x7f4e7c0cbb70 msgr2=0x7f4e7c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 shutdown_connections 2023-12-19T13:59:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:53.816+0000 7f4e834ab640 1 -- 172.21.15.113:0/2348661652 wait complete. 2023-12-19T13:59:53.834 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:59:53.834 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:59:53.834 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-19T13:59:53.834 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:59:53.834 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:59:53.834 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:59:53.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:59:53.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:59:53.835 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:59:53.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:53.835 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-19T13:59:53.884 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:59:53.884 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:59:53.884 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:59:53.884 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:53.884 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:59:53.885 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 41626sec preferred_lft 41626sec 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::8005:f5ff:fe6a:da57/64 scope link 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:1f:ab:9f:63:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a01f:abff:fe9f:637e/64 scope link 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:59:53.886 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether a2:c7:6a:80:ac:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T13:59:53.887 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::a0c7:6aff:fe80:ac0d/64 scope link 2023-12-19T13:59:53.887 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:53.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:53.888 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:59:53.977 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-19T13:59:53.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:53.982 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-19T13:59:54.037 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-19T13:59:54.037 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:59:54.037 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:59:54.038 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:59:54.038 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:59:54.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:54.038 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-19T13:59:54.038 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-19T13:59:54.038 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:59:54.038 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:59:54.038 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:59:54.038 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-19T13:59:54.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:54.222 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T13:59:54.275 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:59:54.275 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T13:59:54.275 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:59:54.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:54.275 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-19T13:59:54.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:59:54.368 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:59:54.420 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:59:54.420 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:59:54.420 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:59:54.469 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T13:59:54.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:54.469 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:59:54.605 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:59:54.605 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:59:54.636 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:59:54.637 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:59:54.637 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:59:54.637 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:59:54.637 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:59:54.638 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:59:54.639 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:59:54.639 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:59:54.639 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:59:54.639 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:59:54.642 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:59:54.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:54.642 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:59:54.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:54.729 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:59:54.794 INFO:teuthology.orchestra.run.smithi113.stdout:client6424 2023-12-19T13:59:54.794 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:54.794 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:54.847 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:59:55.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.108+0000 7faa15851640 1 Processor -- start 2023-12-19T13:59:55.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.109+0000 7faa15851640 1 -- start start 2023-12-19T13:59:55.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.110+0000 7faa15851640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faa101449e0 0x7faa100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:55.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa15851640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faa100b0b50 0x7faa1006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:55.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa15851640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100afb10 con 0x7faa1006b590 2023-12-19T13:59:55.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa15851640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1006bb30 con 0x7faa101449e0 2023-12-19T13:59:55.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa15851640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa100b0070 con 0x7faa100b0b50 2023-12-19T13:59:55.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa0effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faa101449e0 0x7faa100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:55.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa0effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faa101449e0 0x7faa100af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38920/0 (socket says 172.21.15.113:38920) 2023-12-19T13:59:55.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa0effd640 1 -- 172.21.15.113:0/877388219 learned_addr learned my addr 172.21.15.113:0/877388219 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:55.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa0effd640 1 -- 172.21.15.113:0/877388219 >> v2:172.21.15.151:3300/0 conn(0x7faa100b0b50 msgr2=0x7faa1006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:55.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa0effd640 1 --2- 172.21.15.113:0/877388219 >> v2:172.21.15.151:3300/0 conn(0x7faa100b0b50 0x7faa1006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa0effd640 1 -- 172.21.15.113:0/877388219 >> v1:172.21.15.151:6789/0 conn(0x7faa1006b590 legacy=0x7faa1015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:55.111 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.111+0000 7faa0effd640 1 -- 172.21.15.113:0/877388219 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100b0350 con 0x7faa101449e0 2023-12-19T13:59:55.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.112+0000 7faa0effd640 1 --2- 172.21.15.113:0/877388219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa101449e0 0x7faa100af5d0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7faa10071c80 tx=0x7faa0002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945906fd7052217d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:55.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa0dffb640 1 -- 172.21.15.113:0/877388219 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0002ca80 con 0x7faa101449e0 2023-12-19T13:59:55.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa0dffb640 1 -- 172.21.15.113:0/877388219 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0002cbe0 con 0x7faa101449e0 2023-12-19T13:59:55.112 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa0dffb640 1 -- 172.21.15.113:0/877388219 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000343f0 con 0x7faa101449e0 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa15851640 1 -- 172.21.15.113:0/877388219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa101449e0 msgr2=0x7faa100af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa15851640 1 --2- 172.21.15.113:0/877388219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa101449e0 0x7faa100af5d0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7faa10071c80 tx=0x7faa0002bee0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa15851640 1 -- 172.21.15.113:0/877388219 shutdown_connections 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa15851640 1 --2- 172.21.15.113:0/877388219 >> v2:172.21.15.151:3300/0 conn(0x7faa100b0b50 0x7faa1006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa15851640 1 --2- 172.21.15.113:0/877388219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa101449e0 0x7faa100af5d0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.113+0000 7faa15851640 1 -- 172.21.15.113:0/877388219 >> 172.21.15.113:0/877388219 conn(0x7faa100cbb70 msgr2=0x7faa100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.114+0000 7faa15851640 1 -- 172.21.15.113:0/877388219 shutdown_connections 2023-12-19T13:59:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.114+0000 7faa15851640 1 -- 172.21.15.113:0/877388219 wait complete. 2023-12-19T13:59:55.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.115+0000 7faa15851640 1 Processor -- start 2023-12-19T13:59:55.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.115+0000 7faa15851640 1 -- start start 2023-12-19T13:59:55.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.116+0000 7faa15851640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1006b590 0x7faa1013bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:55.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.116+0000 7faa15851640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa100b0b50 0x7faa1013f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:55.116 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.116+0000 7faa15851640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa101449e0 0x7faa10158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.116+0000 7faa15851640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1013c530 con 0x7faa100b0b50 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.116+0000 7faa15851640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1013c810 con 0x7faa101449e0 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.116+0000 7faa15851640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1013caf0 con 0x7faa1006b590 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa100b0b50 0x7faa1013f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa100b0b50 0x7faa1013f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38936/0 (socket says 172.21.15.113:38936) 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 -- 172.21.15.113:0/2950619867 learned_addr learned my addr 172.21.15.113:0/2950619867 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0f7fe640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa101449e0 0x7faa10158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 -- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1006b590 msgr2=0x7faa1013bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1006b590 0x7faa1013bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 -- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa101449e0 msgr2=0x7faa10158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa101449e0 0x7faa10158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 -- 172.21.15.113:0/2950619867 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009b30 con 0x7faa100b0b50 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0f7fe640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa101449e0 0x7faa10158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.117+0000 7faa0e7fc640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa100b0b50 0x7faa1013f240 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800b4a0 tx=0x7fa9f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:55.117 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.118+0000 7faa07fff640 1 -- 172.21.15.113:0/2950619867 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8010610 con 0x7faa100b0b50 2023-12-19T13:59:55.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.118+0000 7faa07fff640 1 -- 172.21.15.113:0/2950619867 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8010770 con 0x7faa100b0b50 2023-12-19T13:59:55.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.118+0000 7faa07fff640 1 -- 172.21.15.113:0/2950619867 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8010b20 con 0x7faa100b0b50 2023-12-19T13:59:55.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.118+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1013cdd0 con 0x7faa100b0b50 2023-12-19T13:59:55.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.118+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1013f780 con 0x7faa100b0b50 2023-12-19T13:59:55.118 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.119+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa10140c40 con 0x7faa100b0b50 2023-12-19T13:59:55.119 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.120+0000 7faa07fff640 1 -- 172.21.15.113:0/2950619867 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa9f8010c80 con 0x7faa100b0b50 2023-12-19T13:59:55.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.121+0000 7faa07fff640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa9f006a430 0x7fa9f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:55.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.121+0000 7faa07fff640 1 -- 172.21.15.113:0/2950619867 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9f8088520 con 0x7faa100b0b50 2023-12-19T13:59:55.120 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.121+0000 7faa0effd640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa9f006a430 0x7fa9f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:55.121 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.122+0000 7faa0effd640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa9f006a430 0x7fa9f006c8f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faa00035000 tx=0x7faa0002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:55.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.126+0000 7faa07fff640 1 -- 172.21.15.113:0/2950619867 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa9f8053b00 con 0x7faa100b0b50 2023-12-19T13:59:55.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.355+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa10061910 con 0x7faa100b0b50 2023-12-19T13:59:55.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.356+0000 7faa07fff640 1 -- 172.21.15.113:0/2950619867 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa9f8014060 con 0x7faa100b0b50 2023-12-19T13:59:55.355 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:59:55.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa9f006a430 msgr2=0x7fa9f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:55.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa9f006a430 0x7fa9f006c8f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faa00035000 tx=0x7faa0002e000 comp rx=0 tx=0).stop 2023-12-19T13:59:55.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa100b0b50 msgr2=0x7faa1013f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:55.357 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa100b0b50 0x7faa1013f240 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800b4a0 tx=0x7fa9f800b960 comp rx=0 tx=0).stop 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 shutdown_connections 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa9f006a430 0x7fa9f006c8f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa101449e0 0x7faa10158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.358+0000 7faa15851640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa100b0b50 0x7faa1013f240 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.359+0000 7faa15851640 1 --2- 172.21.15.113:0/2950619867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1006b590 0x7faa1013bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.359+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 >> 172.21.15.113:0/2950619867 conn(0x7faa100cbb70 msgr2=0x7faa100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.359+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 shutdown_connections 2023-12-19T13:59:55.358 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:55.359+0000 7faa15851640 1 -- 172.21.15.113:0/2950619867 wait complete. 2023-12-19T13:59:55.377 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:59:55.377 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:59:55.378 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T13:59:55.378 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T13:59:55.378 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T13:59:55.378 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:59:55.378 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:59:55.378 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:59:55.378 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:59:55.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:55.378 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T13:59:55.437 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:59:55.437 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:59:55.437 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:59:55.437 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:55.437 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41599sec preferred_lft 41599sec 2023-12-19T13:59:55.438 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::509d:59ff:fe36:e2b4/64 scope link 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:e9:36:60:bc:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a0e9:36ff:fe60:bc7f/64 scope link 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9e:cb:c1:76:0d:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T13:59:55.439 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::9ccb:c1ff:fe76:d85/64 scope link 2023-12-19T13:59:55.440 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:59:55.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:55.441 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:59:55.535 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T13:59:55.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:55.538 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T13:59:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T13:59:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:59:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:59:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:59:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:59:55.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:55.589 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T13:59:55.590 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T13:59:55.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:59:55.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:59:55.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:59:55.590 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T13:59:55.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:55.768 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T13:59:55.820 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T13:59:55.820 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T13:59:55.820 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:59:55.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:55.821 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T13:59:55.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:59:55.910 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T13:59:55.965 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T13:59:55.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:59:55.965 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:59:56.016 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T13:59:56.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:56.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:59:56.156 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:59:56.156 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:59:56.188 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T13:59:56.189 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T13:59:56.189 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-19T13:59:56.189 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@b8121e09-ebc1-4371-9bac-afd10a2a5b83.cephfs=/ 2023-12-19T13:59:56.189 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-12-19T13:59:56.190 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T13:59:56.190 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:59:56.190 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:59:56.190 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:59:56.191 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:59:56.195 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:59:56.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:56.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T13:59:56.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:56.282 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:59:56.338 INFO:teuthology.orchestra.run.smithi151.stdout:client5816 2023-12-19T13:59:56.338 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T13:59:56.338 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:56.392 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:59:56.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.618+0000 7fb40cbb5640 1 Processor -- start 2023-12-19T13:59:56.617 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.618+0000 7fb40cbb5640 1 -- start start 2023-12-19T13:59:56.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.619+0000 7fb40cbb5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb40815e3f0 0x7fb4080b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:56.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.619+0000 7fb40cbb5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4080acfc0 0x7fb40806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:56.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.619+0000 7fb40cbb5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4080b2fa0 con 0x7fb4080b2460 2023-12-19T13:59:56.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.619+0000 7fb40cbb5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40806f600 con 0x7fb4080acfc0 2023-12-19T13:59:56.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.619+0000 7fb40cbb5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40815e7d0 con 0x7fb40815e3f0 2023-12-19T13:59:56.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb407fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4080acfc0 0x7fb40806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:56.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb407fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4080acfc0 0x7fb40806fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38942/0 (socket says 172.21.15.113:38942) 2023-12-19T13:59:56.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb407fff640 1 -- 172.21.15.113:0/2344728262 learned_addr learned my addr 172.21.15.113:0/2344728262 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:56.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb4077fe640 1 --2- 172.21.15.113:0/2344728262 >> v2:172.21.15.151:3300/0 conn(0x7fb40815e3f0 0x7fb4080b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:56.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb407fff640 1 -- 172.21.15.113:0/2344728262 >> v2:172.21.15.151:3300/0 conn(0x7fb40815e3f0 msgr2=0x7fb4080b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:56.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb407fff640 1 --2- 172.21.15.113:0/2344728262 >> v2:172.21.15.151:3300/0 conn(0x7fb40815e3f0 0x7fb4080b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb407fff640 1 -- 172.21.15.113:0/2344728262 >> v1:172.21.15.151:6789/0 conn(0x7fb4080b2460 legacy=0x7fb4080ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:56.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.620+0000 7fb407fff640 1 -- 172.21.15.113:0/2344728262 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080b29e0 con 0x7fb4080acfc0 2023-12-19T13:59:56.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.621+0000 7fb407fff640 1 --2- 172.21.15.113:0/2344728262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080acfc0 0x7fb40806fa90 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb4080b5200 tx=0x7fb40002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6899d576f4eae58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:56.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb406ffd640 1 -- 172.21.15.113:0/2344728262 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40002c9f0 con 0x7fb4080acfc0 2023-12-19T13:59:56.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb406ffd640 1 -- 172.21.15.113:0/2344728262 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40002cb50 con 0x7fb4080acfc0 2023-12-19T13:59:56.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb406ffd640 1 -- 172.21.15.113:0/2344728262 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000343f0 con 0x7fb4080acfc0 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb40cbb5640 1 -- 172.21.15.113:0/2344728262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080acfc0 msgr2=0x7fb40806fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/2344728262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080acfc0 0x7fb40806fa90 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb4080b5200 tx=0x7fb40002be50 comp rx=0 tx=0).stop 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb40cbb5640 1 -- 172.21.15.113:0/2344728262 shutdown_connections 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/2344728262 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080acfc0 0x7fb40806fa90 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/2344728262 >> v2:172.21.15.151:3300/0 conn(0x7fb40815e3f0 0x7fb4080b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.622+0000 7fb40cbb5640 1 -- 172.21.15.113:0/2344728262 >> 172.21.15.113:0/2344728262 conn(0x7fb4080b0100 msgr2=0x7fb4080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.623+0000 7fb40cbb5640 1 -- 172.21.15.113:0/2344728262 shutdown_connections 2023-12-19T13:59:56.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.623+0000 7fb40cbb5640 1 -- 172.21.15.113:0/2344728262 wait complete. 2023-12-19T13:59:56.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.624+0000 7fb40cbb5640 1 Processor -- start 2023-12-19T13:59:56.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.625+0000 7fb40cbb5640 1 -- start start 2023-12-19T13:59:56.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.625+0000 7fb40cbb5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4080acfc0 0x7fb408153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:56.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.625+0000 7fb40cbb5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080b2460 0x7fb40815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:56.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb40cbb5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb40815e3f0 0x7fb40814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:56.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb40cbb5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb408153fc0 con 0x7fb4080b2460 2023-12-19T13:59:56.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb40cbb5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb408154240 con 0x7fb40815e3f0 2023-12-19T13:59:56.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb40cbb5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb408154520 con 0x7fb4080acfc0 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080b2460 0x7fb40815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080b2460 0x7fb40815fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38946/0 (socket says 172.21.15.113:38946) 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 -- 172.21.15.113:0/1195400509 learned_addr learned my addr 172.21.15.113:0/1195400509 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb4077fe640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4080acfc0 0x7fb408153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb407fff640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb40815e3f0 0x7fb40814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 -- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4080acfc0 msgr2=0x7fb408153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4080acfc0 0x7fb408153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 -- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb40815e3f0 msgr2=0x7fb40814ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb40815e3f0 0x7fb40814ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.626+0000 7fb3fffff640 1 -- 172.21.15.113:0/1195400509 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb400009b30 con 0x7fb4080b2460 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.627+0000 7fb3fffff640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080b2460 0x7fb40815fe30 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000b3e0 tx=0x7fb3f000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.627+0000 7fb404ff9640 1 -- 172.21.15.113:0/1195400509 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0011830 con 0x7fb4080b2460 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.627+0000 7fb404ff9640 1 -- 172.21.15.113:0/1195400509 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f00119b0 con 0x7fb4080b2460 2023-12-19T13:59:56.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.627+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb408154800 con 0x7fb4080b2460 2023-12-19T13:59:56.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.627+0000 7fb404ff9640 1 -- 172.21.15.113:0/1195400509 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0011d60 con 0x7fb4080b2460 2023-12-19T13:59:56.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.627+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40806bd00 con 0x7fb4080b2460 2023-12-19T13:59:56.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.628+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40815da90 con 0x7fb4080b2460 2023-12-19T13:59:56.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.629+0000 7fb404ff9640 1 -- 172.21.15.113:0/1195400509 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3f001a400 con 0x7fb4080b2460 2023-12-19T13:59:56.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.630+0000 7fb404ff9640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb3e806a430 0x7fb3e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:56.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.630+0000 7fb404ff9640 1 -- 172.21.15.113:0/1195400509 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3f0088ad0 con 0x7fb4080b2460 2023-12-19T13:59:56.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.630+0000 7fb4077fe640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb3e806a430 0x7fb3e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:56.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.631+0000 7fb4077fe640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb3e806a430 0x7fb3e806c8f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8006fd0 tx=0x7fb3f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:56.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.634+0000 7fb404ff9640 1 -- 172.21.15.113:0/1195400509 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb3f00540c0 con 0x7fb4080b2460 2023-12-19T13:59:56.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.857+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb40806bf20 con 0x7fb4080b2460 2023-12-19T13:59:56.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.858+0000 7fb404ff9640 1 -- 172.21.15.113:0/1195400509 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fb3f0015020 con 0x7fb4080b2460 2023-12-19T13:59:56.858 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:56.858 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T13:59:56.859 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T13:59:56.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb3e806a430 msgr2=0x7fb3e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:56.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb3e806a430 0x7fb3e806c8f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8006fd0 tx=0x7fb3f8008040 comp rx=0 tx=0).stop 2023-12-19T13:59:56.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080b2460 msgr2=0x7fb40815fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:56.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080b2460 0x7fb40815fe30 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000b3e0 tx=0x7fb3f000b8a0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 shutdown_connections 2023-12-19T13:59:56.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb3e806a430 0x7fb3e806c8f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb40815e3f0 0x7fb40814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4080b2460 0x7fb40815fe30 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 --2- 172.21.15.113:0/1195400509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4080acfc0 0x7fb408153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:56.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 >> 172.21.15.113:0/1195400509 conn(0x7fb4080b0100 msgr2=0x7fb4080b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:56.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 shutdown_connections 2023-12-19T13:59:56.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:56.861+0000 7fb40cbb5640 1 -- 172.21.15.113:0/1195400509 wait complete. 2023-12-19T13:59:56.879 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T13:59:57.103 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":9081,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.873165602,"mdsmap_epoch":88,"osdmap_epoch":196,"osdmap_epoch_barrier":196,"uptime":21.564071180999999} 2023-12-19T13:59:57.104 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 9081, "mdsmap_epoch": 88, "osdmap_epoch": 196, "osdmap_epoch_barrier": 196, "rank_uptime": 15.873165602, "state": "up:active", "uptime": 21.564071181, "want_state": "up:active", "whoami": 0 } 2023-12-19T13:59:57.104 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T13:59:57.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.316+0000 7f60af24b640 1 Processor -- start 2023-12-19T13:59:57.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.317+0000 7f60af24b640 1 -- start start 2023-12-19T13:59:57.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60af24b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f60a813e200 0x7f60a80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:57.317 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60af24b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f60a8141660 0x7f60a8140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60af24b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a80b1880 con 0x7f60a8140f70 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60af24b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a80b26e0 con 0x7f60a813e200 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60af24b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a8141380 con 0x7f60a8141660 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60acfe7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f60a813e200 0x7f60a80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60acfe7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f60a813e200 0x7f60a80ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38958/0 (socket says 172.21.15.113:38958) 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60acfe7640 1 -- 172.21.15.113:0/2679818493 learned_addr learned my addr 172.21.15.113:0/2679818493 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60acfe7640 1 -- 172.21.15.113:0/2679818493 >> v2:172.21.15.151:3300/0 conn(0x7f60a8141660 msgr2=0x7f60a8140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.318+0000 7f60acfe7640 1 --2- 172.21.15.113:0/2679818493 >> v2:172.21.15.151:3300/0 conn(0x7f60a8141660 0x7f60a8140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.319+0000 7f60acfe7640 1 -- 172.21.15.113:0/2679818493 >> v1:172.21.15.151:6789/0 conn(0x7f60a8140f70 legacy=0x7f60a815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:57.318 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.319+0000 7f60acfe7640 1 -- 172.21.15.113:0/2679818493 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a80cf020 con 0x7f60a813e200 2023-12-19T13:59:57.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60acfe7640 1 --2- 172.21.15.113:0/2679818493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a813e200 0x7f60a80ceae0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f60a806dc10 tx=0x7f609c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c068910d243600 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:57.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60a77fe640 1 -- 172.21.15.113:0/2679818493 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c031870 con 0x7f60a813e200 2023-12-19T13:59:57.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60a77fe640 1 -- 172.21.15.113:0/2679818493 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c0319d0 con 0x7f60a813e200 2023-12-19T13:59:57.319 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60a77fe640 1 -- 172.21.15.113:0/2679818493 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c031d60 con 0x7f60a813e200 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60af24b640 1 -- 172.21.15.113:0/2679818493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a813e200 msgr2=0x7f60a80ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60af24b640 1 --2- 172.21.15.113:0/2679818493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a813e200 0x7f60a80ceae0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f60a806dc10 tx=0x7f609c02b910 comp rx=0 tx=0).stop 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60af24b640 1 -- 172.21.15.113:0/2679818493 shutdown_connections 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60af24b640 1 --2- 172.21.15.113:0/2679818493 >> v2:172.21.15.151:3300/0 conn(0x7f60a8141660 0x7f60a8140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60af24b640 1 --2- 172.21.15.113:0/2679818493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a813e200 0x7f60a80ceae0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.320+0000 7f60af24b640 1 -- 172.21.15.113:0/2679818493 >> 172.21.15.113:0/2679818493 conn(0x7f60a80cf230 msgr2=0x7f60a80cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.321+0000 7f60af24b640 1 -- 172.21.15.113:0/2679818493 shutdown_connections 2023-12-19T13:59:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.321+0000 7f60af24b640 1 -- 172.21.15.113:0/2679818493 wait complete. 2023-12-19T13:59:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.322+0000 7f60af24b640 1 Processor -- start 2023-12-19T13:59:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.322+0000 7f60af24b640 1 -- start start 2023-12-19T13:59:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60af24b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60a813e200 0x7f60a8138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60af24b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a8140f70 0x7f60a8142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60af24b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60a8141660 0x7f60a8142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60af24b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8143450 con 0x7f60a8140f70 2023-12-19T13:59:57.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60af24b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8070cf0 con 0x7f60a8141660 2023-12-19T13:59:57.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60af24b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8070fd0 con 0x7f60a813e200 2023-12-19T13:59:57.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60a7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a8140f70 0x7f60a8142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:57.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60a7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a8140f70 0x7f60a8142620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38972/0 (socket says 172.21.15.113:38972) 2023-12-19T13:59:57.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.323+0000 7f60a7fff640 1 -- 172.21.15.113:0/1107703970 learned_addr learned my addr 172.21.15.113:0/1107703970 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a7fff640 1 -- 172.21.15.113:0/1107703970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60a813e200 msgr2=0x7f60a8138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a7fff640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60a813e200 0x7f60a8138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a7fff640 1 -- 172.21.15.113:0/1107703970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60a8141660 msgr2=0x7f60a8142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a7fff640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60a8141660 0x7f60a8142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a7fff640 1 -- 172.21.15.113:0/1107703970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0094d0 con 0x7f60a8140f70 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a7fff640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a8140f70 0x7f60a8142620 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f609400b450 tx=0x7f609400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a57fa640 1 -- 172.21.15.113:0/1107703970 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011890 con 0x7f60a8140f70 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a57fa640 1 -- 172.21.15.113:0/1107703970 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60940119f0 con 0x7f60a8140f70 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60a57fa640 1 -- 172.21.15.113:0/1107703970 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011da0 con 0x7f60a8140f70 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.324+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a80712b0 con 0x7f60a8140f70 2023-12-19T13:59:57.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.325+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a8070920 con 0x7f60a8140f70 2023-12-19T13:59:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.325+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a8071970 con 0x7f60a8140f70 2023-12-19T13:59:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.326+0000 7f60a57fa640 1 -- 172.21.15.113:0/1107703970 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f609401a400 con 0x7f60a8140f70 2023-12-19T13:59:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.327+0000 7f60a57fa640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f608c06a430 0x7f608c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.327+0000 7f60a57fa640 1 -- 172.21.15.113:0/1107703970 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6094088d20 con 0x7f60a8140f70 2023-12-19T13:59:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.327+0000 7f60acfe7640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f608c06a430 0x7f608c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.328+0000 7f60acfe7640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f608c06a430 0x7f608c06c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f609c036000 tx=0x7f609c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:57.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.331+0000 7f60a57fa640 1 -- 172.21.15.113:0/1107703970 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6094054300 con 0x7f60a8140f70 2023-12-19T13:59:57.506 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.507+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f60a813bb20 con 0x7f60a8140f70 2023-12-19T13:59:57.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.811+0000 7f60a57fa640 1 -- 172.21.15.113:0/1107703970 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v197) v1 ==== 181+0+0 (secure 0 0 0) 0x7f60a813bb20 con 0x7f60a8140f70 2023-12-19T13:59:57.810 INFO:teuthology.orchestra.run.smithi113.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T13:59:57.813 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f608c06a430 msgr2=0x7f608c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f608c06a430 0x7f608c06c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f609c036000 tx=0x7f609c030000 comp rx=0 tx=0).stop 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a8140f70 msgr2=0x7f60a8142620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a8140f70 0x7f60a8142620 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f609400b450 tx=0x7f609400b910 comp rx=0 tx=0).stop 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 shutdown_connections 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f608c06a430 0x7f608c06c8f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60a8141660 0x7f60a8142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60a8140f70 0x7f60a8142620 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 --2- 172.21.15.113:0/1107703970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60a813e200 0x7f60a8138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 >> 172.21.15.113:0/1107703970 conn(0x7f60a80cf230 msgr2=0x7f60a8140810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 shutdown_connections 2023-12-19T13:59:57.814 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:57.814+0000 7f60af24b640 1 -- 172.21.15.113:0/1107703970 wait complete. 2023-12-19T13:59:57.833 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T13:59:58.055 INFO:teuthology.orchestra.run.smithi113.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T13:59:58.055 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T13:59:58.055 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-19T13:59:58.056 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:58.056 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:58.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:58.105 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-19T13:59:58.343 INFO:teuthology.orchestra.run.smithi113.stderr:16+0 records in 2023-12-19T13:59:58.343 INFO:teuthology.orchestra.run.smithi113.stderr:16+0 records out 2023-12-19T13:59:58.343 INFO:teuthology.orchestra.run.smithi113.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.139048 s, 121 MB/s 2023-12-19T13:59:58.345 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T13:59:58.345 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:59:58.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:59:58.397 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-19T13:59:58.639 INFO:teuthology.orchestra.run.smithi113.stderr:17+0 records in 2023-12-19T13:59:58.639 INFO:teuthology.orchestra.run.smithi113.stderr:17+0 records out 2023-12-19T13:59:58.639 INFO:teuthology.orchestra.run.smithi113.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.149217 s, 119 MB/s 2023-12-19T13:59:58.641 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T13:59:58.641 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T13:59:58.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.846+0000 7fbe70efb640 1 Processor -- start 2023-12-19T13:59:58.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.846+0000 7fbe70efb640 1 -- start start 2023-12-19T13:59:58.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.847+0000 7fbe70efb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbe6c0b0b50 0x7fbe6c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.847+0000 7fbe70efb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c06bb30 con 0x7fbe6c1449e0 2023-12-19T13:59:58.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.847+0000 7fbe70efb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c0b0070 con 0x7fbe6c06b590 2023-12-19T13:59:58.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.847+0000 7fbe70efb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b0350 con 0x7fbe6c0b0b50 2023-12-19T13:59:58.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe6a59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbe6c1449e0 0x7fbe6c0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:56138/0 (socket says 172.21.15.113:56138) 2023-12-19T13:59:58.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe6a59c640 1 -- 172.21.15.113:0/2323477123 learned_addr learned my addr 172.21.15.113:0/2323477123 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T13:59:58.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258673928 0 0) 0x7fbe6c06bb30 con 0x7fbe6c1449e0 2023-12-19T13:59:58.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe58003520 con 0x7fbe6c1449e0 2023-12-19T13:59:58.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe61d9b640 1 --2- 172.21.15.113:0/2323477123 >> v2:172.21.15.151:3300/0 conn(0x7fbe6c0b0b50 0x7fbe6c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1083723034 0 0) 0x7fbe58003520 con 0x7fbe6c1449e0 2023-12-19T13:59:58.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 >> v2:172.21.15.151:3300/0 conn(0x7fbe6c0b0b50 msgr2=0x7fbe6c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 --2- 172.21.15.113:0/2323477123 >> v2:172.21.15.151:3300/0 conn(0x7fbe6c0b0b50 0x7fbe6c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 >> v1:172.21.15.151:6789/0 conn(0x7fbe6c06b590 legacy=0x7fbe6c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0b0630 con 0x7fbe6c1449e0 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbe5c001670 con 0x7fbe6c1449e0 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 >> v1:172.21.15.113:6789/0 conn(0x7fbe6c1449e0 legacy=0x7fbe6c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.848+0000 7fbe69d9b640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe58003a30 0x7fbe58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe69d9b640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580047c0 0x7fbe58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe69d9b640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe580052a0 0x7fbe5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b0350 con 0x7fbe580052a0 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5800c170 con 0x7fbe580047c0 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5800c330 con 0x7fbe58003a30 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6ad9d640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe580052a0 0x7fbe5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6a59c640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe58003a30 0x7fbe58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe61d9b640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580047c0 0x7fbe58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe58003a30 msgr2=0x7fbe58003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6ad9d640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe58003a30 0x7fbe58003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580047c0 msgr2=0x7fbe58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6ad9d640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580047c0 0x7fbe58004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/2323477123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58003520 con 0x7fbe580052a0 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.849+0000 7fbe6a59c640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe58003a30 0x7fbe58003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.850+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/2323477123 reap_dead start 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.850+0000 7fbe6ad9d640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe580052a0 0x7fbe5800b980 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fbe64001d20 tx=0x7fbe580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97c24bb84b14bbd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.850+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64034070 con 0x7fbe580052a0 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64003970 con 0x7fbe580052a0 2023-12-19T13:59:58.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe69d9b640 1 -- 172.21.15.113:0/2323477123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64003d00 con 0x7fbe580052a0 2023-12-19T13:59:58.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe70efb640 1 -- 172.21.15.113:0/2323477123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe580052a0 msgr2=0x7fbe5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:58.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe70efb640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe580052a0 0x7fbe5800b980 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fbe64001d20 tx=0x7fbe580057f0 comp rx=0 tx=0).stop 2023-12-19T13:59:58.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe70efb640 1 -- 172.21.15.113:0/2323477123 shutdown_connections 2023-12-19T13:59:58.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe70efb640 1 --2- 172.21.15.113:0/2323477123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe580052a0 0x7fbe5800b980 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:58.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe70efb640 1 -- 172.21.15.113:0/2323477123 >> 172.21.15.113:0/2323477123 conn(0x7fbe6c0cbb70 msgr2=0x7fbe6c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:58.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe70efb640 1 -- 172.21.15.113:0/2323477123 shutdown_connections 2023-12-19T13:59:58.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.851+0000 7fbe70efb640 1 -- 172.21.15.113:0/2323477123 wait complete. 2023-12-19T13:59:58.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.853+0000 7fbe70efb640 1 Processor -- start 2023-12-19T13:59:58.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.853+0000 7fbe70efb640 1 -- start start 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.854+0000 7fbe70efb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580052a0 0x7fbe6c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.854+0000 7fbe70efb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe6c1552c0 0x7fbe6c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.854+0000 7fbe70efb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe6c12f650 0x7fbe6c12fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.854+0000 7fbe70efb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c12e5b0 con 0x7fbe6c12f650 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.854+0000 7fbe70efb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c12e890 con 0x7fbe580052a0 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.854+0000 7fbe70efb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c12eb70 con 0x7fbe6c1552c0 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe6c12f650 0x7fbe6c12fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe6c12f650 0x7fbe6c12fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53776/0 (socket says 172.21.15.113:53776) 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/3347345768 learned_addr learned my addr 172.21.15.113:0/3347345768 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe61d9b640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe6c1552c0 0x7fbe6c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6a59c640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580052a0 0x7fbe6c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe6c1552c0 msgr2=0x7fbe6c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe6c1552c0 0x7fbe6c155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580052a0 msgr2=0x7fbe6c1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580052a0 0x7fbe6c1520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 -- 172.21.15.113:0/3347345768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c12ee50 con 0x7fbe6c12f650 2023-12-19T13:59:58.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.855+0000 7fbe6ad9d640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe6c12f650 0x7fbe6c12fad0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fbe64000f80 tx=0x7fbe64001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:58.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.856+0000 7fbe637fe640 1 -- 172.21.15.113:0/3347345768 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64034070 con 0x7fbe6c12f650 2023-12-19T13:59:58.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.856+0000 7fbe637fe640 1 -- 172.21.15.113:0/3347345768 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64006b30 con 0x7fbe6c12f650 2023-12-19T13:59:58.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.856+0000 7fbe637fe640 1 -- 172.21.15.113:0/3347345768 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64006ce0 con 0x7fbe6c12f650 2023-12-19T13:59:58.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.856+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c12f130 con 0x7fbe6c12f650 2023-12-19T13:59:58.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.856+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c130010 con 0x7fbe6c12f650 2023-12-19T13:59:58.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.857+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c12f350 con 0x7fbe6c12f650 2023-12-19T13:59:58.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.858+0000 7fbe637fe640 1 -- 172.21.15.113:0/3347345768 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe64007030 con 0x7fbe6c12f650 2023-12-19T13:59:58.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.859+0000 7fbe637fe640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4c06a430 0x7fbe4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:59:58.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.859+0000 7fbe637fe640 1 -- 172.21.15.113:0/3347345768 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe640a8fb0 con 0x7fbe6c12f650 2023-12-19T13:59:58.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.859+0000 7fbe6a59c640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4c06a430 0x7fbe4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:59:58.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.860+0000 7fbe6a59c640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4c06a430 0x7fbe4c06c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c001200 tx=0x7fbe5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:59:58.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:58.864+0000 7fbe637fe640 1 -- 172.21.15.113:0/3347345768 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbe64074590 con 0x7fbe6c12f650 2023-12-19T13:59:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.052+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbe6c061910 con 0x7fbe6c12f650 2023-12-19T13:59:59.054 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.055+0000 7fbe637fe640 1 -- 172.21.15.113:0/3347345768 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v197) v1 ==== 81+0+33602 (secure 0 0 0) 0x7fbe64077bb0 con 0x7fbe6c12f650 2023-12-19T13:59:59.055 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T13:59:59.055 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T13:59:59.055 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 197, 2023-12-19T13:59:59.055 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T13:59:59.055 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T13:59:59.055 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T13:59:57.794814+0000", 2023-12-19T13:59:59.055 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T13:59:59.056 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 23, 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:59:59.057 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T13:59:59.058 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:59:59.059 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:59:59.060 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:59:59.061 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T13:59:59.062 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 22, 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T13:59:59.063 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:38.845347+0000", 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T13:59:59.064 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "195", 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:59:59.065 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:59:59.066 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:59:59.067 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.068 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 23, 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T13:59:59.069 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:40.229435+0000", 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T13:59:59.070 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T13:59:59.071 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "197", 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T13:59:59.072 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T13:59:59.073 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T13:59:59.074 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T13:59:59.075 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.076 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T13:59:59.077 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.078 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.079 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.080 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T13:59:59.081 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.082 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.083 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.084 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.085 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.086 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.087 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.088 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.089 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.090 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.091 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.092 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.093 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.094 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.095 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.096 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.097 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.098 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.099 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.100 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.101 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T13:59:59.102 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.103 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.104 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.105 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.106 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.107 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.108 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.109 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.110 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.111 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.112 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.113 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T13:59:59.114 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.115 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.116 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.117 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T13:59:59.118 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:59:59.119 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.120 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.121 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.122 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.123 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.124 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T13:59:59.125 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T13:59:59.126 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T13:59:59.127 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4c06a430 msgr2=0x7fbe4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4c06a430 0x7fbe4c06c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c001200 tx=0x7fbe5c009040 comp rx=0 tx=0).stop 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe6c12f650 msgr2=0x7fbe6c12fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe6c12f650 0x7fbe6c12fad0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fbe64000f80 tx=0x7fbe64001330 comp rx=0 tx=0).stop 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 shutdown_connections 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbe4c06a430 0x7fbe4c06c8f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbe6c12f650 0x7fbe6c12fad0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe6c1552c0 0x7fbe6c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:59.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 --2- 172.21.15.113:0/3347345768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe580052a0 0x7fbe6c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:59:59.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.058+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 >> 172.21.15.113:0/3347345768 conn(0x7fbe6c0cbb70 msgr2=0x7fbe6c0ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:59:59.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.059+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 shutdown_connections 2023-12-19T13:59:59.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T13:59:59.059+0000 7fbe70efb640 1 -- 172.21.15.113:0/3347345768 wait complete. 2023-12-19T13:59:59.130 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T14:00:04.132 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T14:00:04.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.363+0000 7f006aead640 1 Processor -- start 2023-12-19T14:00:04.362 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.363+0000 7f006aead640 1 -- start start 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.365+0000 7f006aead640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 0x7f0064166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.365+0000 7f006aead640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0064165bc0 con 0x7f0064161660 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.365+0000 7f006aead640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006406e520 con 0x7f00640afa50 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.365+0000 7f006aead640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640afef0 con 0x7f0064161a40 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.365+0000 7f0068c49640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0064161660 0x7f00640b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:56144/0 (socket says 172.21.15.113:56144) 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.365+0000 7f0068c49640 1 -- 172.21.15.113:0/2892078635 learned_addr learned my addr 172.21.15.113:0/2892078635 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f006944a640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 0x7f0064166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320564994 0 0) 0x7f0064165bc0 con 0x7f0064161660 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0054003520 con 0x7f0064161660 2023-12-19T14:00:04.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 920065419 0 0) 0x7f0054003520 con 0x7f0064161660 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 msgr2=0x7f0064166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 0x7f0064166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 >> v1:172.21.15.151:6789/0 conn(0x7f00640afa50 legacy=0x7f00640ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064165570 con 0x7f0064161660 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0058001670 con 0x7f0064161660 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 >> v1:172.21.15.113:6789/0 conn(0x7f0064161660 legacy=0x7f00640b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f0054003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540047c0 0x7f0054004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 0x7f0054005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640afef0 con 0x7f0054003a10 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005400ba80 con 0x7f00540047c0 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.366+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005400bc40 con 0x7f0064161a40 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f0068c49640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f0054003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f006944a640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 0x7f0054005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f0063fff640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540047c0 0x7f0054004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f0068c49640 1 -- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 msgr2=0x7f0054005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f0068c49640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0064161a40 0x7f0054005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f0068c49640 1 -- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540047c0 msgr2=0x7f0054004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f0068c49640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540047c0 0x7f0054004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.367+0000 7f0068c49640 1 -- 172.21.15.113:0/2892078635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054003520 con 0x7f0054003a10 2023-12-19T14:00:04.371 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.368+0000 7f0068c49640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f0054003e30 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f005800c240 tx=0x7f00540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adab0d183b27d044 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.368+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058005ad0 con 0x7f0054003a10 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.368+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058005c50 con 0x7f0054003a10 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.368+0000 7f00637fe640 1 -- 172.21.15.113:0/2892078635 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005802c8b0 con 0x7f0054003a10 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.369+0000 7f006aead640 1 -- 172.21.15.113:0/2892078635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 msgr2=0x7f0054003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.369+0000 7f006aead640 1 --2- 172.21.15.113:0/2892078635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f0054003e30 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f005800c240 tx=0x7f00540057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.369+0000 7f006944a640 1 -- 172.21.15.113:0/2892078635 reap_dead start 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.369+0000 7f006aead640 1 -- 172.21.15.113:0/2892078635 shutdown_connections 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.369+0000 7f006aead640 1 -- 172.21.15.113:0/2892078635 >> 172.21.15.113:0/2892078635 conn(0x7f00640cbb70 msgr2=0x7f00640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.369+0000 7f006aead640 1 -- 172.21.15.113:0/2892078635 shutdown_connections 2023-12-19T14:00:04.372 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.369+0000 7f006aead640 1 -- 172.21.15.113:0/2892078635 wait complete. 2023-12-19T14:00:04.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.371+0000 7f006aead640 1 Processor -- start 2023-12-19T14:00:04.374 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.371+0000 7f006aead640 1 -- start start 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f006aead640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f006406c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f006aead640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006406b730 0x7f00640b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f006aead640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00641f6fa0 0x7f0064157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f006aead640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006415d090 con 0x7f0054003a10 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f006aead640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006415d370 con 0x7f006406b730 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f006aead640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006415d650 con 0x7f00641f6fa0 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f0068c49640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f006406c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f0068c49640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f006406c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53804/0 (socket says 172.21.15.113:53804) 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.372+0000 7f0068c49640 1 -- 172.21.15.113:0/3223133205 learned_addr learned my addr 172.21.15.113:0/3223133205 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f0068c49640 1 -- 172.21.15.113:0/3223133205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00641f6fa0 msgr2=0x7f0064157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f0068c49640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00641f6fa0 0x7f0064157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f0068c49640 1 -- 172.21.15.113:0/3223133205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006406b730 msgr2=0x7f00640b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f0068c49640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006406b730 0x7f00640b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f0068c49640 1 -- 172.21.15.113:0/3223133205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006415d930 con 0x7f0054003a10 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f0068c49640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f006406c600 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f005800c240 tx=0x7f0058001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058039070 con 0x7f0054003a10 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005802ccc0 con 0x7f0054003a10 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006415dc10 con 0x7f0054003a10 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.373+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005803c040 con 0x7f0054003a10 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.374+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640b0960 con 0x7f0054003a10 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.375+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00640b0b50 con 0x7f0054003a10 2023-12-19T14:00:04.376 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.375+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0058032070 con 0x7f0054003a10 2023-12-19T14:00:04.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.376+0000 7f00617fa640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004806a430 0x7f004806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:04.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.377+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00580a9d10 con 0x7f0054003a10 2023-12-19T14:00:04.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.377+0000 7f0063fff640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004806a430 0x7f004806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:04.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.377+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7f0048071f60 con 0x7f0054003a10 2023-12-19T14:00:04.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.377+0000 7f0063fff640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004806a430 0x7f004806c8f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0064164020 tx=0x7f0050009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:04.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.381+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f00580af020 con 0x7f0054003a10 2023-12-19T14:00:04.571 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.572+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0064061910 con 0x7f0054003a10 2023-12-19T14:00:04.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.574+0000 7f00617fa640 1 -- 172.21.15.113:0/3223133205 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v198) v1 ==== 81+0+33621 (secure 0 0 0) 0x7f0058075260 con 0x7f0054003a10 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 198, 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T14:00:03.711437+0000", 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T14:00:04.574 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 23, 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T14:00:04.575 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:04.576 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:04.577 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:04.578 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.579 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.580 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.581 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 22, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:38.845347+0000", 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:04.582 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "195", 2023-12-19T14:00:04.583 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:04.584 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:04.585 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:04.586 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.587 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 23, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:40.229435+0000", 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:04.588 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "198", 2023-12-19T14:00:04.589 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:04.590 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:04.591 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:04.592 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.593 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.594 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.597 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T14:00:04.598 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.599 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T14:00:04.601 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T14:00:04.602 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T14:00:04.603 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:04.604 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.605 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.606 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.607 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.608 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T14:00:04.609 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.610 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T14:00:04.611 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.612 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.613 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.614 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.615 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.616 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.617 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.618 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.619 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.620 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.621 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.622 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T14:00:04.623 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T14:00:04.624 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.625 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.626 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.627 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.628 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.629 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.630 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:04.631 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.632 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.633 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.634 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.635 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:04.636 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:04.637 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.638 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.639 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.640 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:04.641 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T14:00:04.642 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T14:00:04.643 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:04.644 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:04.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004806a430 msgr2=0x7f004806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:04.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004806a430 0x7f004806c8f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0064164020 tx=0x7f0050009040 comp rx=0 tx=0).stop 2023-12-19T14:00:04.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 msgr2=0x7f006406c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f006406c600 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f005800c240 tx=0x7f0058001a00 comp rx=0 tx=0).stop 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 shutdown_connections 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f004806a430 0x7f004806c8f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00641f6fa0 0x7f0064157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006406b730 0x7f00640b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 --2- 172.21.15.113:0/3223133205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0054003a10 0x7f006406c600 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 >> 172.21.15.113:0/3223133205 conn(0x7f00640cbb70 msgr2=0x7f006406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 shutdown_connections 2023-12-19T14:00:04.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:04.577+0000 7f006aead640 1 -- 172.21.15.113:0/3223133205 wait complete. 2023-12-19T14:00:04.647 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T14:00:04.647 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T14:00:04.647 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:04.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:04.710 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-19T14:00:05.143 INFO:teuthology.orchestra.run.smithi113.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T14:00:05.144 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T14:00:05.144 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T14:00:05.144 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.379058 s, 138 MB/s 2023-12-19T14:00:05.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T14:00:05.145 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T14:00:05.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.354+0000 7ff52d300640 1 Processor -- start 2023-12-19T14:00:05.354 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.355+0000 7ff52d300640 1 -- start start 2023-12-19T14:00:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.356+0000 7ff52d300640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff528161a40 0x7ff528166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.356+0000 7ff52d300640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff528165bc0 con 0x7ff5280afa50 2023-12-19T14:00:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.356+0000 7ff52d300640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52806e520 con 0x7ff528161660 2023-12-19T14:00:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.356+0000 7ff52d300640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5280afef0 con 0x7ff528161a40 2023-12-19T14:00:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.356+0000 7ff51e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff5280afa50 0x7ff5280ccc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:56146/0 (socket says 172.21.15.113:56146) 2023-12-19T14:00:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.357+0000 7ff51e7fc640 1 -- 172.21.15.113:0/3062858475 learned_addr learned my addr 172.21.15.113:0/3062858475 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.357+0000 7ff5277fe640 1 --2- 172.21.15.113:0/3062858475 >> v2:172.21.15.113:3300/0 conn(0x7ff528161a40 0x7ff528166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:05.359 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.357+0000 7ff5267fc640 1 -- 172.21.15.113:0/3062858475 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498390191 0 0) 0x7ff528165bc0 con 0x7ff5280afa50 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.357+0000 7ff5267fc640 1 -- 172.21.15.113:0/3062858475 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff514003520 con 0x7ff5280afa50 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.357+0000 7ff5277fe640 1 -- 172.21.15.113:0/3062858475 >> v1:172.21.15.151:6789/0 conn(0x7ff528161660 legacy=0x7ff5280b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.357+0000 7ff5277fe640 1 -- 172.21.15.113:0/3062858475 >> v1:172.21.15.113:6789/0 conn(0x7ff5280afa50 legacy=0x7ff5280ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.357+0000 7ff5277fe640 1 -- 172.21.15.113:0/3062858475 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff528165570 con 0x7ff528161a40 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.358+0000 7ff5277fe640 1 --2- 172.21.15.113:0/3062858475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff528161a40 0x7ff528166050 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7ff520009d90 tx=0x7ff52002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1fa8b1947ba105 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.358+0000 7ff5267fc640 1 -- 172.21.15.113:0/3062858475 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52002cc60 con 0x7ff528161a40 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.358+0000 7ff5267fc640 1 -- 172.21.15.113:0/3062858475 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52002cdc0 con 0x7ff528161a40 2023-12-19T14:00:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff5267fc640 1 -- 172.21.15.113:0/3062858475 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520034660 con 0x7ff528161a40 2023-12-19T14:00:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff52d300640 1 -- 172.21.15.113:0/3062858475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff528161a40 msgr2=0x7ff528166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff52d300640 1 --2- 172.21.15.113:0/3062858475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff528161a40 0x7ff528166050 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7ff520009d90 tx=0x7ff52002beb0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff52d300640 1 -- 172.21.15.113:0/3062858475 shutdown_connections 2023-12-19T14:00:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff52d300640 1 --2- 172.21.15.113:0/3062858475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff528161a40 0x7ff528166050 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff52d300640 1 -- 172.21.15.113:0/3062858475 >> 172.21.15.113:0/3062858475 conn(0x7ff5280cbb70 msgr2=0x7ff5280cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff52d300640 1 -- 172.21.15.113:0/3062858475 shutdown_connections 2023-12-19T14:00:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.359+0000 7ff52d300640 1 -- 172.21.15.113:0/3062858475 wait complete. 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.361+0000 7ff52d300640 1 Processor -- start 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.361+0000 7ff52d300640 1 -- start start 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff52d300640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5280afa50 0x7ff5281f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff52d300640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff528161660 0x7ff52806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff52d300640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff528161a40 0x7ff52806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff52d300640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5281fa6a0 con 0x7ff5280afa50 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff52d300640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5281fa940 con 0x7ff528161a40 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff52d300640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5281fac20 con 0x7ff528161660 2023-12-19T14:00:05.365 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff526ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5280afa50 0x7ff5281f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:05.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff526ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5280afa50 0x7ff5281f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53822/0 (socket says 172.21.15.113:53822) 2023-12-19T14:00:05.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.362+0000 7ff526ffd640 1 -- 172.21.15.113:0/3113335807 learned_addr learned my addr 172.21.15.113:0/3113335807 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:05.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff526ffd640 1 -- 172.21.15.113:0/3113335807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff528161660 msgr2=0x7ff52806d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff526ffd640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff528161660 0x7ff52806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff526ffd640 1 -- 172.21.15.113:0/3113335807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff528161a40 msgr2=0x7ff52806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff526ffd640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff528161a40 0x7ff52806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.366 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff526ffd640 1 -- 172.21.15.113:0/3113335807 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520009a70 con 0x7ff5280afa50 2023-12-19T14:00:05.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff526ffd640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5280afa50 0x7ff5281f6770 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c430 tx=0x7ff51800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:05.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011790 con 0x7ff5280afa50 2023-12-19T14:00:05.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5180118f0 con 0x7ff5280afa50 2023-12-19T14:00:05.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011ce0 con 0x7ff5280afa50 2023-12-19T14:00:05.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.363+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5281faf00 con 0x7ff5280afa50 2023-12-19T14:00:05.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.364+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5281f6cb0 con 0x7ff5280afa50 2023-12-19T14:00:05.367 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.365+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5281f6e40 con 0x7ff5280afa50 2023-12-19T14:00:05.368 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.366+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff51801c460 con 0x7ff5280afa50 2023-12-19T14:00:05.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.367+0000 7ff51ffff640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff50806a430 0x7ff50806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.367+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5180888c0 con 0x7ff5280afa50 2023-12-19T14:00:05.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.367+0000 7ff51e7fc640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff50806a430 0x7ff50806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:05.369 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.367+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7ff508071f60 con 0x7ff5280afa50 2023-12-19T14:00:05.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.367+0000 7ff51e7fc640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff50806a430 0x7ff50806c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff510000f60 tx=0x7ff510007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:05.370 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.371+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff518053ea0 con 0x7ff5280afa50 2023-12-19T14:00:05.560 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.561+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff528061910 con 0x7ff5280afa50 2023-12-19T14:00:05.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.563+0000 7ff51ffff640 1 -- 172.21.15.113:0/3113335807 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v198) v1 ==== 81+0+33621 (secure 0 0 0) 0x7ff518088070 con 0x7ff5280afa50 2023-12-19T14:00:05.563 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:05.563 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:05.563 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 198, 2023-12-19T14:00:05.563 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T14:00:05.563 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T14:00:05.563 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T14:00:03.711437+0000", 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T14:00:05.564 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 23, 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:05.565 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T14:00:05.566 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:05.567 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:05.568 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:05.569 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T14:00:05.570 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 22, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:38.845347+0000", 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:05.571 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:05.572 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "195", 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:05.573 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:05.574 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:05.575 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T14:00:05.576 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 23, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:40.229435+0000", 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T14:00:05.577 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T14:00:05.578 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "198", 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:05.579 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:05.580 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:05.581 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T14:00:05.582 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.583 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.584 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.585 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.586 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.587 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.588 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.589 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.590 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.591 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.592 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T14:00:05.593 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.594 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.595 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.596 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.597 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.598 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.599 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.600 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.601 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.602 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T14:00:05.603 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.604 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.605 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.606 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.607 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.608 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.609 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.610 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.611 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.612 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.613 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T14:00:05.614 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.615 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T14:00:05.616 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T14:00:05.617 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.618 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.619 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:05.620 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.621 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.622 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.623 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T14:00:05.624 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:05.625 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.626 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.627 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.628 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.629 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:05.630 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T14:00:05.631 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T14:00:05.632 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T14:00:05.633 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T14:00:05.633 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T14:00:05.633 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T14:00:05.633 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:05.633 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:05.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff50806a430 msgr2=0x7ff50806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff50806a430 0x7ff50806c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff510000f60 tx=0x7ff510007970 comp rx=0 tx=0).stop 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5280afa50 msgr2=0x7ff5281f6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5280afa50 0x7ff5281f6770 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c430 tx=0x7ff51800c8f0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 shutdown_connections 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff50806a430 0x7ff50806c8f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff528161a40 0x7ff52806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff528161660 0x7ff52806d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 --2- 172.21.15.113:0/3113335807 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5280afa50 0x7ff5281f6770 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 >> 172.21.15.113:0/3113335807 conn(0x7ff5280cbb70 msgr2=0x7ff5280aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 shutdown_connections 2023-12-19T14:00:05.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.566+0000 7ff52d300640 1 -- 172.21.15.113:0/3113335807 wait complete. 2023-12-19T14:00:05.636 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T14:00:05.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.860+0000 7f682ceb6640 1 Processor -- start 2023-12-19T14:00:05.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.860+0000 7f682ceb6640 1 -- start start 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.861+0000 7f682ceb6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6828157bf0 0x7f682815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.861+0000 7f682ceb6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682815b740 con 0x7f68280ae110 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.861+0000 7f682ceb6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68280ae640 con 0x7f68280b0810 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.861+0000 7f682ceb6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682806b8c0 con 0x7f6828157bf0 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.862+0000 7f682659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6828157bf0 0x7f682815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.862+0000 7f681dd9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f68280ae110 0x7f68280b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:56158/0 (socket says 172.21.15.113:56158) 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.862+0000 7f681dd9b640 1 -- 172.21.15.113:0/1744543942 learned_addr learned my addr 172.21.15.113:0/1744543942 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:05.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.862+0000 7f682659c640 1 -- 172.21.15.113:0/1744543942 >> v1:172.21.15.151:6789/0 conn(0x7f68280b0810 legacy=0x7f682806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:05.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.862+0000 7f682659c640 1 -- 172.21.15.113:0/1744543942 >> v1:172.21.15.113:6789/0 conn(0x7f68280ae110 legacy=0x7f68280b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.862+0000 7f682659c640 1 -- 172.21.15.113:0/1744543942 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68280ae920 con 0x7f6828157bf0 2023-12-19T14:00:05.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.863+0000 7f682659c640 1 --2- 172.21.15.113:0/1744543942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6828157bf0 0x7f682815b200 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f68180097a0 tx=0x7f681802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c39f2e8700de15f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:05.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.863+0000 7f6825d9b640 1 -- 172.21.15.113:0/1744543942 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818031830 con 0x7f6828157bf0 2023-12-19T14:00:05.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f6825d9b640 1 -- 172.21.15.113:0/1744543942 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6818031990 con 0x7f6828157bf0 2023-12-19T14:00:05.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f6825d9b640 1 -- 172.21.15.113:0/1744543942 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818031d20 con 0x7f6828157bf0 2023-12-19T14:00:05.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f682ceb6640 1 -- 172.21.15.113:0/1744543942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6828157bf0 msgr2=0x7f682815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f682ceb6640 1 --2- 172.21.15.113:0/1744543942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6828157bf0 0x7f682815b200 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f68180097a0 tx=0x7f681802b8d0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f682ceb6640 1 -- 172.21.15.113:0/1744543942 shutdown_connections 2023-12-19T14:00:05.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f682ceb6640 1 --2- 172.21.15.113:0/1744543942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6828157bf0 0x7f682815b200 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.863 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f682ceb6640 1 -- 172.21.15.113:0/1744543942 >> 172.21.15.113:0/1744543942 conn(0x7f68280cbb70 msgr2=0x7f68280cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:05.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f682ceb6640 1 -- 172.21.15.113:0/1744543942 shutdown_connections 2023-12-19T14:00:05.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.864+0000 7f682ceb6640 1 -- 172.21.15.113:0/1744543942 wait complete. 2023-12-19T14:00:05.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.866+0000 7f682ceb6640 1 Processor -- start 2023-12-19T14:00:05.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.866+0000 7f682ceb6640 1 -- start start 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682ceb6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68280ae110 0x7f68281439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682ceb6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68280b0810 0x7f68281409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682ceb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6828157bf0 0x7f6828141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682ceb6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682815d6c0 con 0x7f68280ae110 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682ceb6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68281516c0 con 0x7f68280b0810 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682ceb6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68281519a0 con 0x7f6828157bf0 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68280ae110 0x7f68281439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68280ae110 0x7f68281439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53850/0 (socket says 172.21.15.113:53850) 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.867+0000 7f682659c640 1 -- 172.21.15.113:0/2290602311 learned_addr learned my addr 172.21.15.113:0/2290602311 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f682659c640 1 -- 172.21.15.113:0/2290602311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6828157bf0 msgr2=0x7f6828141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f682659c640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6828157bf0 0x7f6828141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f682659c640 1 -- 172.21.15.113:0/2290602311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68280b0810 msgr2=0x7f68281409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:05.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f682659c640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68280b0810 0x7f68281409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:05.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f682659c640 1 -- 172.21.15.113:0/2290602311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818009400 con 0x7f68280ae110 2023-12-19T14:00:05.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f682659c640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68280ae110 0x7f68281439d0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f68180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:05.868 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681803aa60 con 0x7f68280ae110 2023-12-19T14:00:05.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681803abc0 con 0x7f68280ae110 2023-12-19T14:00:05.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68180443f0 con 0x7f68280ae110 2023-12-19T14:00:05.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.868+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6828151c80 con 0x7f68280ae110 2023-12-19T14:00:05.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.869+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68281513b0 con 0x7f68280ae110 2023-12-19T14:00:05.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.870+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68281521a0 con 0x7f68280ae110 2023-12-19T14:00:05.869 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.871+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f681804d450 con 0x7f68280ae110 2023-12-19T14:00:05.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.871+0000 7f681f7fe640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f680806a430 0x7f680806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:05.870 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.872+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68180aab90 con 0x7f68280ae110 2023-12-19T14:00:05.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.872+0000 7f681dd9b640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f680806a430 0x7f680806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:05.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.872+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7f6808071f60 con 0x7f68280ae110 2023-12-19T14:00:05.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.872+0000 7f681dd9b640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f680806a430 0x7f680806c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6828143f10 tx=0x7f6810007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:05.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:05.876+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6818035070 con 0x7f68280ae110 2023-12-19T14:00:06.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.101+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6828061910 con 0x7f68280ae110 2023-12-19T14:00:06.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.102+0000 7f681f7fe640 1 -- 172.21.15.113:0/2290602311 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f6818076200 con 0x7f68280ae110 2023-12-19T14:00:06.101 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:06.101 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T14:00:06.102 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T14:00:06.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f680806a430 msgr2=0x7f680806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:06.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f680806a430 0x7f680806c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6828143f10 tx=0x7f6810007a40 comp rx=0 tx=0).stop 2023-12-19T14:00:06.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68280ae110 msgr2=0x7f68281439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:06.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68280ae110 0x7f68281439d0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f68180046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 shutdown_connections 2023-12-19T14:00:06.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f680806a430 0x7f680806c8f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6828157bf0 0x7f6828141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68280b0810 0x7f68281409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 --2- 172.21.15.113:0/2290602311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68280ae110 0x7f68281439d0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 >> 172.21.15.113:0/2290602311 conn(0x7f68280cbb70 msgr2=0x7f682806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:06.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 shutdown_connections 2023-12-19T14:00:06.105 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.105+0000 7f682ceb6640 1 -- 172.21.15.113:0/2290602311 wait complete. 2023-12-19T14:00:06.121 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T14:00:06.342 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":9081,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":25.113184922999999,"mdsmap_epoch":88,"osdmap_epoch":198,"osdmap_epoch_barrier":198,"uptime":30.804102292} 2023-12-19T14:00:06.342 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 9081, "mdsmap_epoch": 88, "osdmap_epoch": 198, "osdmap_epoch_barrier": 198, "rank_uptime": 25.113184923, "state": "up:active", "uptime": 30.804102292, "want_state": "up:active", "whoami": 0 } 2023-12-19T14:00:06.342 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T14:00:06.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:06.343 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T14:00:06.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:06.394 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T14:00:06.460 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T14:00:06.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.666+0000 7f9a0b270640 1 Processor -- start 2023-12-19T14:00:06.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.666+0000 7f9a0b270640 1 -- start start 2023-12-19T14:00:06.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.668+0000 7f9a0b270640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a040b0b50 0x7f9a0406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:06.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.668+0000 7f9a0b270640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0406b590 0x7f9a0406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:06.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.668+0000 7f9a0b270640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0406bb30 con 0x7f9a041449e0 2023-12-19T14:00:06.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.668+0000 7f9a0b270640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a040b0070 con 0x7f9a040b0b50 2023-12-19T14:00:06.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.668+0000 7f9a0b270640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040b0350 con 0x7f9a0406b590 2023-12-19T14:00:06.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0880b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a040b0b50 0x7f9a0406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:06.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0980d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0406b590 0x7f9a0406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:06.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0880b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a040b0b50 0x7f9a0406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:36962/0 (socket says 172.21.15.113:36962) 2023-12-19T14:00:06.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0880b640 1 -- 172.21.15.113:0/4279628615 learned_addr learned my addr 172.21.15.113:0/4279628615 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:06.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0880b640 1 -- 172.21.15.113:0/4279628615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0406b590 msgr2=0x7f9a0406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:06.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0880b640 1 --2- 172.21.15.113:0/4279628615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0406b590 0x7f9a0406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0880b640 1 -- 172.21.15.113:0/4279628615 >> v1:172.21.15.151:6789/0 conn(0x7f9a041449e0 legacy=0x7f9a040af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:06.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.669+0000 7f9a0880b640 1 -- 172.21.15.113:0/4279628615 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040b0630 con 0x7f9a040b0b50 2023-12-19T14:00:06.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.671+0000 7f9a0880b640 1 --2- 172.21.15.113:0/4279628615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a040b0b50 0x7f9a0406bfa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009870 tx=0x7f99f402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab82dfca8c5c0d27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:06.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.671+0000 7f99fbfff640 1 -- 172.21.15.113:0/4279628615 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4030840 con 0x7f9a040b0b50 2023-12-19T14:00:06.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f99fbfff640 1 -- 172.21.15.113:0/4279628615 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40309a0 con 0x7f9a040b0b50 2023-12-19T14:00:06.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f99fbfff640 1 -- 172.21.15.113:0/4279628615 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4030d30 con 0x7f9a040b0b50 2023-12-19T14:00:06.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 -- 172.21.15.113:0/4279628615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a040b0b50 msgr2=0x7f9a0406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:06.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 --2- 172.21.15.113:0/4279628615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a040b0b50 0x7f9a0406bfa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009870 tx=0x7f99f402b980 comp rx=0 tx=0).stop 2023-12-19T14:00:06.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 -- 172.21.15.113:0/4279628615 shutdown_connections 2023-12-19T14:00:06.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 --2- 172.21.15.113:0/4279628615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0406b590 0x7f9a0406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 --2- 172.21.15.113:0/4279628615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a040b0b50 0x7f9a0406bfa0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 -- 172.21.15.113:0/4279628615 >> 172.21.15.113:0/4279628615 conn(0x7f9a040cbb70 msgr2=0x7f9a040cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:06.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 -- 172.21.15.113:0/4279628615 shutdown_connections 2023-12-19T14:00:06.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.672+0000 7f9a0b270640 1 -- 172.21.15.113:0/4279628615 wait complete. 2023-12-19T14:00:06.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.674+0000 7f9a0b270640 1 Processor -- start 2023-12-19T14:00:06.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.674+0000 7f9a0b270640 1 -- start start 2023-12-19T14:00:06.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.675+0000 7f9a0b270640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0406b590 0x7f9a0415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:06.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.675+0000 7f9a0b270640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a040b0b50 0x7f9a0413a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:06.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.675+0000 7f9a0b270640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a041449e0 0x7f9a0415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:06.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.675+0000 7f9a0b270640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0415d260 con 0x7f9a041449e0 2023-12-19T14:00:06.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.675+0000 7f9a0b270640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0415d540 con 0x7f9a0406b590 2023-12-19T14:00:06.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.675+0000 7f9a0b270640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0415d820 con 0x7f9a040b0b50 2023-12-19T14:00:06.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.675+0000 7f9a0980d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a041449e0 0x7f9a0415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:06.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a041449e0 0x7f9a0415c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53862/0 (socket says 172.21.15.113:53862) 2023-12-19T14:00:06.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 -- 172.21.15.113:0/2578054700 learned_addr learned my addr 172.21.15.113:0/2578054700 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:06.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0900c640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0406b590 0x7f9a0415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:06.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0880b640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a040b0b50 0x7f9a0413a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:06.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 -- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a040b0b50 msgr2=0x7f9a0413a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:06.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a040b0b50 0x7f9a0413a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 -- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0406b590 msgr2=0x7f9a0415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:06.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0406b590 0x7f9a0415e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.678 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 -- 172.21.15.113:0/2578054700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40094d0 con 0x7f9a041449e0 2023-12-19T14:00:06.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f9a0980d640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a041449e0 0x7f9a0415c910 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00efc0 tx=0x7f99fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:06.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.676+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc014480 con 0x7f9a041449e0 2023-12-19T14:00:06.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.677+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00f040 con 0x7f9a041449e0 2023-12-19T14:00:06.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.677+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0415db00 con 0x7f9a041449e0 2023-12-19T14:00:06.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.677+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc014820 con 0x7f9a041449e0 2023-12-19T14:00:06.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.677+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0413ae80 con 0x7f9a041449e0 2023-12-19T14:00:06.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.678+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a04158410 con 0x7f9a041449e0 2023-12-19T14:00:06.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.679+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f99fc014980 con 0x7f9a041449e0 2023-12-19T14:00:06.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.680+0000 7f99f9ffb640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f99e806a430 0x7f99e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:06.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.680+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99fc089420 con 0x7f9a041449e0 2023-12-19T14:00:06.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.680+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7f99e8071f60 con 0x7f9a041449e0 2023-12-19T14:00:06.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.680+0000 7f9a0900c640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f99e806a430 0x7f99e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:06.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.681+0000 7f9a0900c640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f99e806a430 0x7f99e806c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9a00000f60 tx=0x7f9a00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:06.683 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.684+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f99fc054aa0 con 0x7f9a041449e0 2023-12-19T14:00:06.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.875+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9a040b16e0 con 0x7f9a041449e0 2023-12-19T14:00:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.878+0000 7f99f9ffb640 1 -- 172.21.15.113:0/2578054700 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v198) v1 ==== 81+0+33621 (secure 0 0 0) 0x7f99fc018030 con 0x7f9a041449e0 2023-12-19T14:00:06.878 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:06.878 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:06.878 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 198, 2023-12-19T14:00:06.878 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T14:00:03.711437+0000", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T14:00:06.879 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 23, 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T14:00:06.880 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:06.881 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:06.882 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:06.883 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:06.884 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:06.885 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T14:00:06.886 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 22, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:38.845347+0000", 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:06.887 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:06.888 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:06.889 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "195", 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:06.890 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:06.891 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:06.892 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.893 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 23, 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T14:00:06.894 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:40.229435+0000", 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:06.895 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:06.896 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:06.896 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:06.896 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T14:00:06.896 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T14:00:06.896 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T14:00:06.896 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T14:00:06.896 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T14:00:06.897 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:06.897 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:06.897 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:06.897 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:06.897 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:06.897 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "198", 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:06.898 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:06.899 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:06.900 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:06.901 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:06.902 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T14:00:06.903 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.904 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.905 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T14:00:06.906 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.907 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.908 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.909 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.910 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.911 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.912 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.913 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.914 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.915 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.916 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.917 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.918 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.919 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.920 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.921 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.922 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.923 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.924 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.925 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.926 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.927 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.928 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.929 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.930 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.931 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.932 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.933 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.934 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.935 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.936 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.937 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.938 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.940 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.941 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.942 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:06.943 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.944 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.946 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.947 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.948 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.949 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.950 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.951 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:06.953 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T14:00:06.954 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:06.955 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T14:00:06.956 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T14:00:06.957 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T14:00:06.957 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:06.957 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:06.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f99e806a430 msgr2=0x7f99e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:06.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f99e806a430 0x7f99e806c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9a00000f60 tx=0x7f9a00009040 comp rx=0 tx=0).stop 2023-12-19T14:00:06.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a041449e0 msgr2=0x7f9a0415c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:06.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a041449e0 0x7f9a0415c910 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00efc0 tx=0x7f99fc00c490 comp rx=0 tx=0).stop 2023-12-19T14:00:06.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 shutdown_connections 2023-12-19T14:00:06.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f99e806a430 0x7f99e806c8f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a041449e0 0x7f9a0415c910 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a040b0b50 0x7f9a0413a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 --2- 172.21.15.113:0/2578054700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0406b590 0x7f9a0415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:06.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 >> 172.21.15.113:0/2578054700 conn(0x7f9a040cbb70 msgr2=0x7f9a0406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:06.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 shutdown_connections 2023-12-19T14:00:06.959 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:06.881+0000 7f9a0b270640 1 -- 172.21.15.113:0/2578054700 wait complete. 2023-12-19T14:00:06.960 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T14:00:11.961 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T14:00:12.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.183+0000 7f685e5ff640 1 Processor -- start 2023-12-19T14:00:12.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.183+0000 7f685e5ff640 1 -- start start 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.184+0000 7f685e5ff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6858159810 0x7f6858159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.184+0000 7f685e5ff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f68580cc990 0x7f68580ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685e5ff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685815d0e0 con 0x7f68580b2630 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685e5ff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68580b1590 con 0x7f6858159810 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685e5ff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68580b1870 con 0x7f68580cc990 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685d5fd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6858159810 0x7f6858159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685ddfe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f68580b2630 0x7f68580b2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48240/0 (socket says 172.21.15.113:48240) 2023-12-19T14:00:12.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685ddfe640 1 -- 172.21.15.113:0/727675692 learned_addr learned my addr 172.21.15.113:0/727675692 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:12.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685cdfc640 1 --2- 172.21.15.113:0/727675692 >> v2:172.21.15.151:3300/0 conn(0x7f68580cc990 0x7f68580ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:12.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685d5fd640 1 -- 172.21.15.113:0/727675692 >> v2:172.21.15.151:3300/0 conn(0x7f68580cc990 msgr2=0x7f68580ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:12.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685d5fd640 1 --2- 172.21.15.113:0/727675692 >> v2:172.21.15.151:3300/0 conn(0x7f68580cc990 0x7f68580ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685d5fd640 1 -- 172.21.15.113:0/727675692 >> v1:172.21.15.113:6789/0 conn(0x7f68580b2630 legacy=0x7f68580b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:12.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.185+0000 7f685d5fd640 1 -- 172.21.15.113:0/727675692 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580b1b50 con 0x7f6858159810 2023-12-19T14:00:12.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.186+0000 7f685d5fd640 1 --2- 172.21.15.113:0/727675692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6858159810 0x7f6858159bf0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f685804e320 tx=0x7f685402de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d072f1b592ed2545 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:12.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.187+0000 7f684ffff640 1 -- 172.21.15.113:0/727675692 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685402eb80 con 0x7f6858159810 2023-12-19T14:00:12.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.187+0000 7f684ffff640 1 -- 172.21.15.113:0/727675692 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685402ece0 con 0x7f6858159810 2023-12-19T14:00:12.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.187+0000 7f684ffff640 1 -- 172.21.15.113:0/727675692 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854036660 con 0x7f6858159810 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.187+0000 7f685e5ff640 1 -- 172.21.15.113:0/727675692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6858159810 msgr2=0x7f6858159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.187+0000 7f685e5ff640 1 --2- 172.21.15.113:0/727675692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6858159810 0x7f6858159bf0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f685804e320 tx=0x7f685402de50 comp rx=0 tx=0).stop 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.187+0000 7f685e5ff640 1 -- 172.21.15.113:0/727675692 shutdown_connections 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.188+0000 7f685e5ff640 1 --2- 172.21.15.113:0/727675692 >> v2:172.21.15.151:3300/0 conn(0x7f68580cc990 0x7f68580ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.188+0000 7f685e5ff640 1 --2- 172.21.15.113:0/727675692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6858159810 0x7f6858159bf0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.188+0000 7f685e5ff640 1 -- 172.21.15.113:0/727675692 >> 172.21.15.113:0/727675692 conn(0x7f68580b0100 msgr2=0x7f68580b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.188+0000 7f685e5ff640 1 -- 172.21.15.113:0/727675692 shutdown_connections 2023-12-19T14:00:12.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.188+0000 7f685e5ff640 1 -- 172.21.15.113:0/727675692 wait complete. 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.189+0000 7f685e5ff640 1 Processor -- start 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.189+0000 7f685e5ff640 1 -- start start 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.190+0000 7f685e5ff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68580b2630 0x7f685806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.190+0000 7f685e5ff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68580cc990 0x7f68581e2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.190+0000 7f685e5ff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6858159810 0x7f68581e2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.190+0000 7f685e5ff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581e3b50 con 0x7f68580b2630 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.190+0000 7f685e5ff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581e2cb0 con 0x7f6858159810 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.190+0000 7f685e5ff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68581e2f40 con 0x7f68580cc990 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68580b2630 0x7f685806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:12.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68580b2630 0x7f685806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60550/0 (socket says 172.21.15.113:60550) 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 -- 172.21.15.113:0/2996803165 learned_addr learned my addr 172.21.15.113:0/2996803165 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 -- 172.21.15.113:0/2996803165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68580cc990 msgr2=0x7f68581e2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68580cc990 0x7f68581e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 -- 172.21.15.113:0/2996803165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6858159810 msgr2=0x7f68581e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6858159810 0x7f68581e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 -- 172.21.15.113:0/2996803165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685400b6a0 con 0x7f68580b2630 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.191+0000 7f685d5fd640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68580b2630 0x7f685806da90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f685400bb30 tx=0x7f68540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.192+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854042650 con 0x7f68580b2630 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.192+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68540427b0 con 0x7f68580b2630 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.192+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854042b60 con 0x7f68580b2630 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.192+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68581e3220 con 0x7f68580b2630 2023-12-19T14:00:12.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.192+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68581e37e0 con 0x7f68580b2630 2023-12-19T14:00:12.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.193+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6858061910 con 0x7f68580b2630 2023-12-19T14:00:12.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.194+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6854042cc0 con 0x7f68580b2630 2023-12-19T14:00:12.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.195+0000 7f684dffb640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f683c06a430 0x7f683c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:12.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.195+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68540ad740 con 0x7f68580b2630 2023-12-19T14:00:12.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.195+0000 7f685cdfc640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f683c06a430 0x7f683c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:12.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.195+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7f683c071f60 con 0x7f68580b2630 2023-12-19T14:00:12.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.196+0000 7f685cdfc640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f683c06a430 0x7f683c06c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f68581f1f50 tx=0x7f6848008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:12.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.199+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6854078c90 con 0x7f68580b2630 2023-12-19T14:00:12.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.385+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6858061910 con 0x7f68580b2630 2023-12-19T14:00:12.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.387+0000 7f684dffb640 1 -- 172.21.15.113:0/2996803165 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v198) v1 ==== 81+0+33621 (secure 0 0 0) 0x7f685403b090 con 0x7f68580b2630 2023-12-19T14:00:12.387 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:12.387 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:12.387 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 198, 2023-12-19T14:00:12.387 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T14:00:03.711437+0000", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T14:00:12.388 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 23, 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T14:00:12.389 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.390 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T14:00:12.390 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T14:00:12.390 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T14:00:12.390 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:12.390 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:12.390 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:12.390 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:12.391 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:12.392 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:12.393 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:12.394 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T14:00:12.395 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:12.396 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 22, 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:38.845347+0000", 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:12.397 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:12.398 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "195", 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:12.399 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:12.400 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:12.401 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.402 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T14:00:12.403 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 23, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:40.229435+0000", 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1027, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:12.404 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:12.405 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "198", 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:12.406 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:12.407 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:12.408 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.409 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:12.410 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.411 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.412 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.413 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.414 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.415 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T14:00:12.416 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.417 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T14:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T14:00:12.422 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.423 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.424 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.425 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.426 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.427 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.428 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.429 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.430 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.431 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T14:00:12.432 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.432 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.432 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.432 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.432 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.432 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.433 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.433 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.433 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T14:00:12.433 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.433 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.433 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.433 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.434 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T14:00:12.434 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.434 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.434 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.434 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.434 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.435 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.435 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.435 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.435 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T14:00:12.435 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.435 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.436 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.436 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.436 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T14:00:12.436 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:12.436 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.436 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.436 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.437 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T14:00:12.437 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T14:00:12.437 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T14:00:12.437 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T14:00:12.437 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.437 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.437 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.438 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T14:00:12.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.441 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.441 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.441 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.441 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.441 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.441 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.442 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.442 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T14:00:12.442 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.442 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.442 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.442 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.442 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.443 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.445 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.446 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.447 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.448 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.449 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.450 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.451 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.452 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.453 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.455 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:12.456 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.457 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.458 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.459 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.461 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T14:00:12.462 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T14:00:12.463 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.464 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.465 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.467 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T14:00:12.469 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T14:00:12.470 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T14:00:12.471 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T14:00:12.471 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T14:00:12.471 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T14:00:12.471 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T14:00:12.471 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:12.472 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T14:00:12.472 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T14:00:12.472 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T14:00:12.472 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T14:00:12.472 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T14:00:12.472 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T14:00:12.472 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T14:00:12.473 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T14:00:12.473 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T14:00:12.473 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T14:00:12.473 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T14:00:12.473 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:12.473 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:12.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f683c06a430 msgr2=0x7f683c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:12.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f683c06a430 0x7f683c06c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f68581f1f50 tx=0x7f6848008040 comp rx=0 tx=0).stop 2023-12-19T14:00:12.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68580b2630 msgr2=0x7f685806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:12.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68580b2630 0x7f685806da90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f685400bb30 tx=0x7f68540046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 shutdown_connections 2023-12-19T14:00:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f683c06a430 0x7f683c06c8f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6858159810 0x7f68581e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68580cc990 0x7f68581e2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 --2- 172.21.15.113:0/2996803165 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68580b2630 0x7f685806da90 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 >> 172.21.15.113:0/2996803165 conn(0x7f68580b0100 msgr2=0x7f6858157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:12.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 shutdown_connections 2023-12-19T14:00:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:12.390+0000 7f685e5ff640 1 -- 172.21.15.113:0/2996803165 wait complete. 2023-12-19T14:00:12.479 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T14:00:17.479 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T14:00:17.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.704+0000 7f0acfb22640 1 Processor -- start 2023-12-19T14:00:17.704 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.705+0000 7f0acfb22640 1 -- start start 2023-12-19T14:00:17.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.706+0000 7f0acfb22640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac80b0b50 0x7f0ac806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.706+0000 7f0acfb22640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac806bb30 con 0x7f0ac81449e0 2023-12-19T14:00:17.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.706+0000 7f0acfb22640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80b0070 con 0x7f0ac806b590 2023-12-19T14:00:17.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.706+0000 7f0acfb22640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80b0350 con 0x7f0ac80b0b50 2023-12-19T14:00:17.705 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.706+0000 7f0acd8be640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0ac81449e0 0x7f0ac80af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48246/0 (socket says 172.21.15.113:48246) 2023-12-19T14:00:17.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.706+0000 7f0acd8be640 1 -- 172.21.15.113:0/1947436015 learned_addr learned my addr 172.21.15.113:0/1947436015 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952657634 0 0) 0x7f0ac806bb30 con 0x7f0ac81449e0 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab4003520 con 0x7f0ac81449e0 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227606652 0 0) 0x7f0ab4003520 con 0x7f0ac81449e0 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac80b0b50 msgr2=0x7f0ac806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac80b0b50 0x7f0ac806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac80b0b50 0x7f0ac806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 >> v1:172.21.15.151:6789/0 conn(0x7f0ac806b590 legacy=0x7f0ac80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:17.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80b0630 con 0x7f0ac81449e0 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0ac4001670 con 0x7f0ac81449e0 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 >> v1:172.21.15.113:6789/0 conn(0x7f0ac81449e0 legacy=0x7f0ac80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.707+0000 7f0acc8bc640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab4003a10 0x7f0ab4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acc8bc640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acc8bc640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab4005380 0x7f0ab400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80b0350 con 0x7f0ab40047c0 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab400c1a0 con 0x7f0ab4003a10 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab400c360 con 0x7f0ab4005380 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac80b0b50 0x7f0ac806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0ace0bf640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab4005380 0x7f0ab400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd8be640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab4003a10 0x7f0ab4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd0bd640 1 -- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab4005380 msgr2=0x7f0ab400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:17.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ab4005380 0x7f0ab400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd0bd640 1 -- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab4003a10 msgr2=0x7f0ab4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:17.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ab4003a10 0x7f0ab4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.710 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.708+0000 7f0acd0bd640 1 -- 172.21.15.113:0/1947436015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4003520 con 0x7f0ab40047c0 2023-12-19T14:00:17.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.710+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800a860 tx=0x7f0ab40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e845e9666aa8ab85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:17.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.710+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8032600 con 0x7f0ab40047c0 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.710+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8032780 con 0x7f0ab40047c0 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.710+0000 7f0acc8bc640 1 -- 172.21.15.113:0/1947436015 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8032b30 con 0x7f0ab40047c0 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.710+0000 7f0acfb22640 1 -- 172.21.15.113:0/1947436015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 msgr2=0x7f0ab4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.710+0000 7f0acfb22640 1 --2- 172.21.15.113:0/1947436015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800a860 tx=0x7f0ab40057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.710+0000 7f0ace0bf640 1 -- 172.21.15.113:0/1947436015 reap_dead start 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.711+0000 7f0acfb22640 1 -- 172.21.15.113:0/1947436015 shutdown_connections 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.711+0000 7f0acfb22640 1 -- 172.21.15.113:0/1947436015 >> 172.21.15.113:0/1947436015 conn(0x7f0ac80cbb70 msgr2=0x7f0ac80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.711+0000 7f0acfb22640 1 -- 172.21.15.113:0/1947436015 shutdown_connections 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.711+0000 7f0acfb22640 1 -- 172.21.15.113:0/1947436015 wait complete. 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.712+0000 7f0acfb22640 1 Processor -- start 2023-12-19T14:00:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.712+0000 7f0acfb22640 1 -- start start 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.713+0000 7f0acfb22640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ac813ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.713+0000 7f0acfb22640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac8143020 0x7f0ac81434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.713+0000 7f0acfb22640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac8152d50 0x7f0ac81531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.713+0000 7f0acfb22640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac815cdf0 con 0x7f0ab40047c0 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.713+0000 7f0acfb22640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81439e0 con 0x7f0ac8143020 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.713+0000 7f0acfb22640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac815c960 con 0x7f0ac8152d50 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ac813ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ac813ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60564/0 (socket says 172.21.15.113:60564) 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 -- 172.21.15.113:0/2650438767 learned_addr learned my addr 172.21.15.113:0/2650438767 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0ace0bf640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac8152d50 0x7f0ac81531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 -- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac8152d50 msgr2=0x7f0ac81531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:17.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac8152d50 0x7f0ac81531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac8143020 0x7f0ac81434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 -- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac8143020 msgr2=0x7f0ac81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac8143020 0x7f0ac81434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 -- 172.21.15.113:0/2650438767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac815bd50 con 0x7f0ab40047c0 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.714+0000 7f0acd8be640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ac813ac20 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4001200 tx=0x7f0ac400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.715+0000 7f0abe7fc640 1 -- 172.21.15.113:0/2650438767 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400ee00 con 0x7f0ab40047c0 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.715+0000 7f0abe7fc640 1 -- 172.21.15.113:0/2650438767 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac400c840 con 0x7f0ab40047c0 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.715+0000 7f0abe7fc640 1 -- 172.21.15.113:0/2650438767 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400cbf0 con 0x7f0ab40047c0 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.715+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac815c030 con 0x7f0ab40047c0 2023-12-19T14:00:17.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.715+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac815c5f0 con 0x7f0ab40047c0 2023-12-19T14:00:17.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.716+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac8061910 con 0x7f0ab40047c0 2023-12-19T14:00:17.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.717+0000 7f0abe7fc640 1 -- 172.21.15.113:0/2650438767 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ac400cd50 con 0x7f0ab40047c0 2023-12-19T14:00:17.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.718+0000 7f0abe7fc640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aac06a460 0x7f0aac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:17.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.718+0000 7f0abe7fc640 1 -- 172.21.15.113:0/2650438767 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ac4088440 con 0x7f0ab40047c0 2023-12-19T14:00:17.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.719+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aac06a460 0x7f0aac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:17.718 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.719+0000 7f0acd0bd640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aac06a460 0x7f0aac06c920 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8036000 tx=0x7f0ab8031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:17.722 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.723+0000 7f0abe7fc640 1 -- 172.21.15.113:0/2650438767 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ac4053a20 con 0x7f0ab40047c0 2023-12-19T14:00:17.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.910+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0ac80ae560 con 0x7f0ab40047c0 2023-12-19T14:00:17.913 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.914+0000 7f0abe7fc640 1 -- 172.21.15.113:0/2650438767 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v199) v1 ==== 81+0+33602 (secure 0 0 0) 0x7f0ac4057040 con 0x7f0ab40047c0 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 199, 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T14:00:13.716004+0000", 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T14:00:17.914 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 23, 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T14:00:17.915 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:17.916 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:17.917 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:17.918 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:17.919 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:17.920 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.921 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 22, 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T14:00:17.922 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:38.845347+0000", 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T14:00:17.923 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "195", 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:17.924 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:17.925 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:17.926 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:17.927 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.928 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 23, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:40.229435+0000", 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:17.929 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.930 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "199", 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:17.931 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:17.932 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T14:00:17.933 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T14:00:17.934 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.935 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.936 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.937 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.938 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.939 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.940 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.941 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.942 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.943 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.944 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.945 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.946 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T14:00:17.947 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.948 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.949 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.950 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T14:00:17.951 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.952 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.953 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.954 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.955 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.956 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.957 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T14:00:17.958 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.959 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T14:00:17.960 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.961 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T14:00:17.962 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.963 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.964 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.965 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.966 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.967 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.968 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.969 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.970 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.971 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.972 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.973 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:17.974 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.975 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.976 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.977 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:17.978 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T14:00:17.979 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.980 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.981 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.982 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T14:00:17.983 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:17.984 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:17.985 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T14:00:17.986 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T14:00:17.987 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T14:00:17.988 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T14:00:17.988 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:17.988 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:17.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.916+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aac06a460 msgr2=0x7f0aac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:17.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.916+0000 7f0acfb22640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aac06a460 0x7f0aac06c920 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8036000 tx=0x7f0ab8031000 comp rx=0 tx=0).stop 2023-12-19T14:00:17.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.916+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 msgr2=0x7f0ac813ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:17.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.916+0000 7f0acfb22640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ac813ac20 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4001200 tx=0x7f0ac400ec10 comp rx=0 tx=0).stop 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 shutdown_connections 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0aac06a460 0x7f0aac06c920 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac8152d50 0x7f0ac81531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac8143020 0x7f0ac81434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 --2- 172.21.15.113:0/2650438767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ab40047c0 0x7f0ac813ac20 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 >> 172.21.15.113:0/2650438767 conn(0x7f0ac80cbb70 msgr2=0x7f0ac806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 shutdown_connections 2023-12-19T14:00:17.990 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:17.917+0000 7f0acfb22640 1 -- 172.21.15.113:0/2650438767 wait complete. 2023-12-19T14:00:17.991 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T14:00:17.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T14:00:18.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.204+0000 7f0fb2c38640 1 Processor -- start 2023-12-19T14:00:18.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.204+0000 7f0fb2c38640 1 -- start start 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.205+0000 7f0fb2c38640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0fac0d2b00 0x7f0fac0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.205+0000 7f0fb2c38640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0cd840 con 0x7f0fac146e10 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.205+0000 7f0fb2c38640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0b6e90 con 0x7f0fac0ce110 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.205+0000 7f0fb2c38640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac0d2430 con 0x7f0fac0d2b00 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.205+0000 7f0fb09d4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0fac146e10 0x7f0fac0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57588/0 (socket says 172.21.15.113:57588) 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.205+0000 7f0fb09d4640 1 -- 172.21.15.113:0/2450773909 learned_addr learned my addr 172.21.15.113:0/2450773909 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.205+0000 7f0fabfff640 1 --2- 172.21.15.113:0/2450773909 >> v2:172.21.15.113:3300/0 conn(0x7f0fac0d2b00 0x7f0fac0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.206+0000 7f0fab7fe640 1 -- 172.21.15.113:0/2450773909 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645737066 0 0) 0x7f0fac0cd840 con 0x7f0fac146e10 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.206+0000 7f0fab7fe640 1 -- 172.21.15.113:0/2450773909 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9c003520 con 0x7f0fac146e10 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.206+0000 7f0fabfff640 1 -- 172.21.15.113:0/2450773909 >> v1:172.21.15.151:6789/0 conn(0x7f0fac0ce110 legacy=0x7f0fac0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.206+0000 7f0fabfff640 1 -- 172.21.15.113:0/2450773909 >> v1:172.21.15.113:6789/0 conn(0x7f0fac146e10 legacy=0x7f0fac0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.206+0000 7f0fabfff640 1 -- 172.21.15.113:0/2450773909 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0d2620 con 0x7f0fac0d2b00 2023-12-19T14:00:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.207+0000 7f0fabfff640 1 --2- 172.21.15.113:0/2450773909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac0d2b00 0x7f0fac0d1ef0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f0f980097a0 tx=0x7f0f9802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ad790d1d190be2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.207+0000 7f0fab7fe640 1 -- 172.21.15.113:0/2450773909 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9802e070 con 0x7f0fac0d2b00 2023-12-19T14:00:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.207+0000 7f0fab7fe640 1 -- 172.21.15.113:0/2450773909 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f980315a0 con 0x7f0fac0d2b00 2023-12-19T14:00:18.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.207+0000 7f0fab7fe640 1 -- 172.21.15.113:0/2450773909 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98031930 con 0x7f0fac0d2b00 2023-12-19T14:00:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.208+0000 7f0fb2c38640 1 -- 172.21.15.113:0/2450773909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac0d2b00 msgr2=0x7f0fac0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.208+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/2450773909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac0d2b00 0x7f0fac0d1ef0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f0f980097a0 tx=0x7f0f9802b840 comp rx=0 tx=0).stop 2023-12-19T14:00:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.208+0000 7f0fb2c38640 1 -- 172.21.15.113:0/2450773909 shutdown_connections 2023-12-19T14:00:18.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.208+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/2450773909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac0d2b00 0x7f0fac0d1ef0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.208+0000 7f0fb2c38640 1 -- 172.21.15.113:0/2450773909 >> 172.21.15.113:0/2450773909 conn(0x7f0fac0b29c0 msgr2=0x7f0fac0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:18.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.208+0000 7f0fb2c38640 1 -- 172.21.15.113:0/2450773909 shutdown_connections 2023-12-19T14:00:18.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.208+0000 7f0fb2c38640 1 -- 172.21.15.113:0/2450773909 wait complete. 2023-12-19T14:00:18.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.210+0000 7f0fb2c38640 1 Processor -- start 2023-12-19T14:00:18.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.210+0000 7f0fb2c38640 1 -- start start 2023-12-19T14:00:18.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb2c38640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fac0ce110 0x7f0fac13d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb2c38640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fac0d2b00 0x7f0fac0b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb2c38640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac146e10 0x7f0fac13c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb2c38640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac13ef40 con 0x7f0fac146e10 2023-12-19T14:00:18.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb2c38640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac13eba0 con 0x7f0fac0ce110 2023-12-19T14:00:18.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb2c38640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac13e250 con 0x7f0fac0d2b00 2023-12-19T14:00:18.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb11d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac146e10 0x7f0fac13c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb11d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac146e10 0x7f0fac13c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50616/0 (socket says 172.21.15.113:50616) 2023-12-19T14:00:18.211 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb11d5640 1 -- 172.21.15.113:0/3347178684 learned_addr learned my addr 172.21.15.113:0/3347178684 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:18.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.211+0000 7f0fb09d4640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fac0ce110 0x7f0fac13d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb11d5640 1 -- 172.21.15.113:0/3347178684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fac0d2b00 msgr2=0x7f0fac0b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb11d5640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fac0d2b00 0x7f0fac0b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb11d5640 1 -- 172.21.15.113:0/3347178684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fac0ce110 msgr2=0x7f0fac13d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb11d5640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fac0ce110 0x7f0fac13d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb11d5640 1 -- 172.21.15.113:0/3347178684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009400 con 0x7f0fac146e10 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb11d5640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac146e10 0x7f0fac13c8f0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400c780 tx=0x7f0fa400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fa97fa640 1 -- 172.21.15.113:0/3347178684 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4003d80 con 0x7f0fac146e10 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fa97fa640 1 -- 172.21.15.113:0/3347178684 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400ce90 con 0x7f0fac146e10 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fa97fa640 1 -- 172.21.15.113:0/3347178684 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40052b0 con 0x7f0fac146e10 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac13e530 con 0x7f0fac146e10 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.212+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac13de40 con 0x7f0fac146e10 2023-12-19T14:00:18.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.213+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac13f080 con 0x7f0fac146e10 2023-12-19T14:00:18.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.214+0000 7f0fa97fa640 1 -- 172.21.15.113:0/3347178684 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fa4005410 con 0x7f0fac146e10 2023-12-19T14:00:18.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.215+0000 7f0fa97fa640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f9006a430 0x7f0f9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.215+0000 7f0fa97fa640 1 -- 172.21.15.113:0/3347178684 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fa4087ea0 con 0x7f0fac146e10 2023-12-19T14:00:18.214 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.215+0000 7f0fb09d4640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f9006a430 0x7f0f9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.215 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.216+0000 7f0fb09d4640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f9006a430 0x7f0f9006c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00011e0 tx=0x7f0fa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:18.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.219+0000 7f0fa97fa640 1 -- 172.21.15.113:0/3347178684 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0fac13f080 con 0x7f0fac146e10 2023-12-19T14:00:18.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.409+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0fac13f080 con 0x7f0fac146e10 2023-12-19T14:00:18.410 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.411+0000 7f0fa97fa640 1 -- 172.21.15.113:0/3347178684 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v199) v1 ==== 81+0+33602 (secure 0 0 0) 0x7f0fac13f080 con 0x7f0fac146e10 2023-12-19T14:00:18.410 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 199, 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "created": "2023-12-19T13:46:13.655778+0000", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "modified": "2023-12-19T14:00:13.716004+0000", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_up_change": "2023-12-19T13:46:20.209042+0000", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "last_in_change": "2023-12-19T13:46:17.187145+0000", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_num": 5799936, 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_set": [ 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "pglog_hardlimit", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "purged_snapdirs", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_deletes", 2023-12-19T14:00:18.411 INFO:teuthology.orchestra.run.smithi113.stdout: "sortbitwise" 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_version": 4, 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_snapshot": "", 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_max": 23, 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "max_osd": 8, 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "require_min_compat_client": "luminous", 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "min_compat_client": "jewel", 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "require_osd_release": "reef", 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "allow_crimson": false, 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "pools": [ 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.412 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 1, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": ".mgr", 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:46:20.490857+0000", 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:18.413 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 1, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 1, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 1, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 1, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 1, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "120", 2023-12-19T14:00:18.414 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:18.415 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.416 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_max": 32, 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 1 2023-12-19T14:00:18.417 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": {} 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 8, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 8, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 0.25, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 2, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 2, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.418 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 22, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_metadata", 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:38.845347+0000", 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:18.419 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 32, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 32, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 32, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 32, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 32, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.420 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "195", 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 0, 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:18.422 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_bias": 4, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 16, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "recovery_priority": 5 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.423 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": "cephfs" 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.5, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.5, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.5, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.5, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:18.424 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "pool": 23, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_name": "cephfs_data", 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "create_time": "2023-12-19T13:59:40.229435+0000", 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "flags": 1, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "flags_names": "hashpspool", 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "type": 1, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "size": 2, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "min_size": 1, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_rule": 0, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_count": 0, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_target": 0, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T14:00:18.425 INFO:teuthology.orchestra.run.smithi113.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "object_hash": 2, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_autoscale_mode": "off", 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num": 64, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num": 64, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_placement_num_target": 64, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_target": 64, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_pending": 64, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "last_pg_merge_meta": { 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "source_pgid": "0.0", 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "ready_epoch": 0, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_started": 0, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "last_epoch_clean": 0, 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "source_version": "0'0", 2023-12-19T14:00:18.426 INFO:teuthology.orchestra.run.smithi113.stdout: "target_version": "0'0" 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "last_change": "199", 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend": "0", 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "auid": 0, 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_mode": "selfmanaged", 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_seq": 0, 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "snap_epoch": 0, 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "pool_snaps": [], 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps": "[]", 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_bytes": 33554432, 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "quota_max_objects": 0, 2023-12-19T14:00:18.427 INFO:teuthology.orchestra.run.smithi113.stdout: "tiers": [], 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "tier_of": -1, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "read_tier": -1, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "write_tier": -1, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_mode": "none", 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_bytes": 0, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "target_max_objects": 0, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_flush_age": 0, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "cache_min_evict_age": 0, 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profile": "", 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_params": { 2023-12-19T14:00:18.428 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "none" 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_period": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_count": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "use_gmt_hitset": true, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "min_read_recency_for_promote": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "min_write_recency_for_promote": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "hit_set_search_last_n": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "grade_table": [], 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "stripe_width": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "expected_num_objects": 0, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "fast_read": false, 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "options": { 2023-12-19T14:00:18.429 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_num_min": 64, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "application_metadata": { 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "cephfs": { 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "data": "cephfs" 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "read_balance": { 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "score_acting": 1.3799999952316284, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "score_stable": 1.3799999952316284, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "optimal_score": 1, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity_weighted": 1, 2023-12-19T14:00:18.430 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity": 1, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "average_primary_affinity_weighted": 1 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "osds": [ 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.431 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6811", 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6814", 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.432 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6817", 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6821", 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.433 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6830", 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6831", 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.434 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6825", 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6828", 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84090 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.435 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6814/84090", 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6821/84090", 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6831/84090", 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6828/84090", 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.436 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6800", 2023-12-19T14:00:18.437 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6801", 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6802", 2023-12-19T14:00:18.438 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6803", 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6806", 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.439 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6807", 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6804", 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.440 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6805", 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84088 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6801/84088", 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6803/84088", 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6807/84088", 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6805/84088", 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.441 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.442 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6809", 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6812", 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.443 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6815", 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6818", 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.444 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6824", 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6827", 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.445 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6820", 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6822", 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84093 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6812/84093", 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6818/84093", 2023-12-19T14:00:18.446 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6827/84093", 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6822/84093", 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.447 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6808", 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.448 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6810", 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6813", 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.449 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6816", 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6826", 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6829", 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.450 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6819", 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.113:6823", 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84094 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.113:6810/84094", 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.113:6816/84094", 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.113:6829/84094", 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.113:6823/84094", 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.452 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6800", 2023-12-19T14:00:18.453 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6801", 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6802", 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.454 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6803", 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6806", 2023-12-19T14:00:18.455 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.456 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.456 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.456 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6807", 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6804", 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.457 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6805", 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84063 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6801/84063", 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6803/84063", 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6807/84063", 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6805/84063", 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.458 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.459 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6808", 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6809", 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.460 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6810", 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6811", 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.461 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6815", 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6816", 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.462 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6812", 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6813", 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84062 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6809/84062", 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6811/84062", 2023-12-19T14:00:18.463 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6816/84062", 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6813/84062", 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.464 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6824", 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.465 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6825", 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6826", 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.466 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6827", 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6830", 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.467 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6831", 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6828", 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.468 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6829", 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84065 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6825/84065", 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6827/84065", 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6831/84065", 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6829/84065", 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.469 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "up": 1, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "in": 1, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "weight": 1, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_affinity": 1, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_begin": 0, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "last_clean_end": 0, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "up_from": 13, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "up_thru": 194, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "down_at": 0, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "lost_at": 0, 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addrs": { 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.470 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6814", 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6817", 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addrs": { 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.471 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6818", 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6819", 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addrs": { 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.472 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6822", 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6823", 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addrs": { 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "addrvec": [ 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.473 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v2", 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6820", 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "172.21.15.151:6821", 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 84064 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "public_addr": "172.21.15.151:6817/84064", 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_addr": "172.21.15.151:6819/84064", 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_back_addr": "172.21.15.151:6823/84064", 2023-12-19T14:00:18.474 INFO:teuthology.orchestra.run.smithi113.stdout: "heartbeat_front_addr": "172.21.15.151:6821/84064", 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "state": [ 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "exists", 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "up" 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_xinfo": [ 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 0, 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.475 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.452587+0000", 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 1, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.400953+0000", 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 2, 2023-12-19T14:00:18.476 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.474166+0000", 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 3, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.477 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.486247+0000", 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 4, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.491768+0000", 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.478 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 5, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.412231+0000", 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 6, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.479 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.510911+0000", 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: { 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": 7, 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "down_stamp": "0.000000", 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_probability": 0, 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "laggy_interval": 0, 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "features": 4540138322906710015, 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "old_weight": 0, 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "last_purged_snaps_scrub": "2023-12-19T13:46:18.471808+0000", 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "dead_epoch": 0 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: ], 2023-12-19T14:00:18.480 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap": [], 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_items": [], 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_upmap_primaries": [], 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "pg_temp": [], 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "primary_temp": [], 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklist": {}, 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "range_blocklist": {}, 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "erasure_code_profiles": { 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "default": { 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "crush-failure-domain": "osd", 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "k": "2", 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "m": "1", 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "plugin": "jerasure", 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: "technique": "reed_sol_van" 2023-12-19T14:00:18.481 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "removed_snaps_queue": [], 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "new_removed_snaps": [], 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "new_purged_snaps": [], 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "crush_node_flags": {}, 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "device_class_flags": {}, 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode": { 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_enabled": false, 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_bucket_count": 0, 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "degraded_stretch_mode": 0, 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "recovering_stretch_mode": 0, 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: "stretch_mode_bucket": 0 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-19T14:00:18.482 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.413+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f9006a430 msgr2=0x7f0f9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.413+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f9006a430 0x7f0f9006c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00011e0 tx=0x7f0fa0009040 comp rx=0 tx=0).stop 2023-12-19T14:00:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.413+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac146e10 msgr2=0x7f0fac13c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.413+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac146e10 0x7f0fac13c8f0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400c780 tx=0x7f0fa400cc40 comp rx=0 tx=0).stop 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 shutdown_connections 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0f9006a430 0x7f0f9006c8f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0fac146e10 0x7f0fac13c8f0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fac0d2b00 0x7f0fac0b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 --2- 172.21.15.113:0/3347178684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fac0ce110 0x7f0fac13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 >> 172.21.15.113:0/3347178684 conn(0x7f0fac0b29c0 msgr2=0x7f0fac161340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 shutdown_connections 2023-12-19T14:00:18.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.414+0000 7f0fb2c38640 1 -- 172.21.15.113:0/3347178684 wait complete. 2023-12-19T14:00:18.486 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T14:00:18.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.697+0000 7fc2dc3ae640 1 Processor -- start 2023-12-19T14:00:18.696 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.697+0000 7fc2dc3ae640 1 -- start start 2023-12-19T14:00:18.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.698+0000 7fc2dc3ae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.699+0000 7fc2dc3ae640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2d40af540 0x7fc2d40af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.699+0000 7fc2dc3ae640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d415e400 con 0x7fc2d406e190 2023-12-19T14:00:18.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.699+0000 7fc2dc3ae640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d415daa0 con 0x7fc2d40af540 2023-12-19T14:00:18.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.699+0000 7fc2dc3ae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40aff30 con 0x7fc2d41599c0 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.699+0000 7fc2da14a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.699+0000 7fc2da14a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:33432/0 (socket says 172.21.15.113:33432) 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.699+0000 7fc2da14a640 1 -- 172.21.15.113:0/2873100772 learned_addr learned my addr 172.21.15.113:0/2873100772 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.700+0000 7fc2da94b640 1 --2- 172.21.15.113:0/2873100772 >> v2:172.21.15.151:3300/0 conn(0x7fc2d40af540 0x7fc2d40af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.700+0000 7fc2da14a640 1 -- 172.21.15.113:0/2873100772 >> v2:172.21.15.151:3300/0 conn(0x7fc2d40af540 msgr2=0x7fc2d40af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.700+0000 7fc2da14a640 1 --2- 172.21.15.113:0/2873100772 >> v2:172.21.15.151:3300/0 conn(0x7fc2d40af540 0x7fc2d40af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.700+0000 7fc2da14a640 1 -- 172.21.15.113:0/2873100772 >> v1:172.21.15.151:6789/0 conn(0x7fc2d406e190 legacy=0x7fc2d40cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.700+0000 7fc2da14a640 1 -- 172.21.15.113:0/2873100772 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40ce780 con 0x7fc2d41599c0 2023-12-19T14:00:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.701+0000 7fc2da14a640 1 --2- 172.21.15.113:0/2873100772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d415dec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009870 tx=0x7fc2d002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c5a3d4b5f8cdaa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:18.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2d9148640 1 -- 172.21.15.113:0/2873100772 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00317c0 con 0x7fc2d41599c0 2023-12-19T14:00:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2d9148640 1 -- 172.21.15.113:0/2873100772 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0031920 con 0x7fc2d41599c0 2023-12-19T14:00:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2d9148640 1 -- 172.21.15.113:0/2873100772 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0031cb0 con 0x7fc2d41599c0 2023-12-19T14:00:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2873100772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 msgr2=0x7fc2d415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2873100772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d415dec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009870 tx=0x7fc2d002b860 comp rx=0 tx=0).stop 2023-12-19T14:00:18.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2873100772 shutdown_connections 2023-12-19T14:00:18.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2873100772 >> v2:172.21.15.151:3300/0 conn(0x7fc2d40af540 0x7fc2d40af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2873100772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d415dec0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.702+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2873100772 >> 172.21.15.113:0/2873100772 conn(0x7fc2d40cbb70 msgr2=0x7fc2d40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:18.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.703+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2873100772 shutdown_connections 2023-12-19T14:00:18.702 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.703+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2873100772 wait complete. 2023-12-19T14:00:18.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.704+0000 7fc2dc3ae640 1 Processor -- start 2023-12-19T14:00:18.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.704+0000 7fc2dc3ae640 1 -- start start 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.705+0000 7fc2dc3ae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2d406e190 0x7fc2d40cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.705+0000 7fc2dc3ae640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2d40af540 0x7fc2d40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.705+0000 7fc2dc3ae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.705+0000 7fc2dc3ae640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4168090 con 0x7fc2d40af540 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.705+0000 7fc2dc3ae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40ce420 con 0x7fc2d406e190 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.705+0000 7fc2dc3ae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40ce140 con 0x7fc2d41599c0 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.705+0000 7fc2d9949640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2d40af540 0x7fc2d40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2d40af540 0x7fc2d40ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50628/0 (socket says 172.21.15.113:50628) 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 -- 172.21.15.113:0/2034492060 learned_addr learned my addr 172.21.15.113:0/2034492060 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2da94b640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2da14a640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2d406e190 0x7fc2d40cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 -- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 msgr2=0x7fc2d40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.706 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d40cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 -- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2d406e190 msgr2=0x7fc2d40cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2d406e190 0x7fc2d40cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 -- 172.21.15.113:0/2034492060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00094d0 con 0x7fc2d40af540 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2d9949640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2d40af540 0x7fc2d40ccc60 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c3c0 tx=0x7fc2c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.706+0000 7fc2caffd640 1 -- 172.21.15.113:0/2034492060 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40052d0 con 0x7fc2d40af540 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.707+0000 7fc2caffd640 1 -- 172.21.15.113:0/2034492060 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c4005450 con 0x7fc2d40af540 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.707+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4167a40 con 0x7fc2d40af540 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.707+0000 7fc2caffd640 1 -- 172.21.15.113:0/2034492060 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4003830 con 0x7fc2d40af540 2023-12-19T14:00:18.707 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.707+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d40cdd80 con 0x7fc2d40af540 2023-12-19T14:00:18.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.708+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d4061910 con 0x7fc2d40af540 2023-12-19T14:00:18.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.709+0000 7fc2caffd640 1 -- 172.21.15.113:0/2034492060 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc2c4003990 con 0x7fc2d40af540 2023-12-19T14:00:18.708 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.710+0000 7fc2caffd640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2b806a430 0x7fc2b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:18.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.710+0000 7fc2caffd640 1 -- 172.21.15.113:0/2034492060 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2c4087e30 con 0x7fc2d40af540 2023-12-19T14:00:18.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.710+0000 7fc2da14a640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2b806a430 0x7fc2b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:18.709 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.710+0000 7fc2da14a640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2b806a430 0x7fc2b806c8f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0036000 tx=0x7fc2d003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:18.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.714+0000 7fc2caffd640 1 -- 172.21.15.113:0/2034492060 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc2c4053420 con 0x7fc2d40af540 2023-12-19T14:00:18.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.929+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2d415d110 con 0x7fc2d40af540 2023-12-19T14:00:18.929 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.930+0000 7fc2caffd640 1 -- 172.21.15.113:0/2034492060 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fc2c4056a40 con 0x7fc2d40af540 2023-12-19T14:00:18.930 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:18.930 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T14:00:18.930 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.932+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2b806a430 msgr2=0x7fc2b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2b806a430 0x7fc2b806c8f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0036000 tx=0x7fc2d003d040 comp rx=0 tx=0).stop 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2d40af540 msgr2=0x7fc2d40ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2d40af540 0x7fc2d40ccc60 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c3c0 tx=0x7fc2c400c880 comp rx=0 tx=0).stop 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 shutdown_connections 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc2b806a430 0x7fc2b806c8f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2d41599c0 0x7fc2d40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.932 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2d40af540 0x7fc2d40ccc60 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 --2- 172.21.15.113:0/2034492060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2d406e190 0x7fc2d40cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:18.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 >> 172.21.15.113:0/2034492060 conn(0x7fc2d40cbb70 msgr2=0x7fc2d406c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:18.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 shutdown_connections 2023-12-19T14:00:18.933 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:18.933+0000 7fc2dc3ae640 1 -- 172.21.15.113:0/2034492060 wait complete. 2023-12-19T14:00:18.950 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T14:00:19.184 INFO:teuthology.orchestra.run.smithi113.stdout:{"cluster_fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","whoami":0,"id":9081,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":37.954451075000001,"mdsmap_epoch":88,"osdmap_epoch":199,"osdmap_epoch_barrier":198,"uptime":43.645347831000002} 2023-12-19T14:00:19.185 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b8121e09-ebc1-4371-9bac-afd10a2a5b83", "fs_name": "cephfs", "id": 9081, "mdsmap_epoch": 88, "osdmap_epoch": 199, "osdmap_epoch_barrier": 198, "rank_uptime": 37.954451075, "state": "up:active", "uptime": 43.645347831, "want_state": "up:active", "whoami": 0 } 2023-12-19T14:00:19.185 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T14:00:19.185 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T14:00:19.185 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:19.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:19.241 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T14:00:19.673 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records in 2023-12-19T14:00:19.674 INFO:teuthology.orchestra.run.smithi113.stderr:50+0 records out 2023-12-19T14:00:19.674 INFO:teuthology.orchestra.run.smithi113.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.378006 s, 139 MB/s 2023-12-19T14:00:19.675 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T14:00:19.675 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T14:00:19.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T14:00:19.903 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T14:00:19.903 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T14:00:19.903 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:19.964 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T14:00:19.964 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:20.013 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T14:00:20.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.273+0000 7f4f69030640 1 Processor -- start 2023-12-19T14:00:20.274 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.274+0000 7f4f69030640 1 -- start start 2023-12-19T14:00:20.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.275+0000 7f4f69030640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f64157bf0 0x7f4f6415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.275+0000 7f4f69030640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f640ae110 0x7f4f640b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.275+0000 7f4f69030640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640b0a90 con 0x7f4f640b0640 2023-12-19T14:00:20.275 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.275+0000 7f4f69030640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6406b8c0 con 0x7f4f640ae110 2023-12-19T14:00:20.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.275+0000 7f4f69030640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6415b740 con 0x7f4f64157bf0 2023-12-19T14:00:20.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.276+0000 7f4f62d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f64157bf0 0x7f4f6415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.276+0000 7f4f5a59c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f640ae110 0x7f4f640b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.276+0000 7f4f62d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f64157bf0 0x7f4f6415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:33446/0 (socket says 172.21.15.113:33446) 2023-12-19T14:00:20.276 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.276+0000 7f4f62d9d640 1 -- 172.21.15.113:0/2495797846 learned_addr learned my addr 172.21.15.113:0/2495797846 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:20.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.277+0000 7f4f62d9d640 1 -- 172.21.15.113:0/2495797846 >> v2:172.21.15.151:3300/0 conn(0x7f4f640ae110 msgr2=0x7f4f640b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:20.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.277+0000 7f4f62d9d640 1 --2- 172.21.15.113:0/2495797846 >> v2:172.21.15.151:3300/0 conn(0x7f4f640ae110 0x7f4f640b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.277+0000 7f4f62d9d640 1 -- 172.21.15.113:0/2495797846 >> v1:172.21.15.151:6789/0 conn(0x7f4f640b0640 legacy=0x7f4f6415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.277 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.277+0000 7f4f62d9d640 1 -- 172.21.15.113:0/2495797846 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640ae640 con 0x7f4f64157bf0 2023-12-19T14:00:20.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.278+0000 7f4f62d9d640 1 --2- 172.21.15.113:0/2495797846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f64157bf0 0x7f4f6415b200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400bb10 tx=0x7f4f5402e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=293bb29f77a9ee33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:20.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.278+0000 7f4f6259c640 1 -- 172.21.15.113:0/2495797846 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54036440 con 0x7f4f64157bf0 2023-12-19T14:00:20.278 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f6259c640 1 -- 172.21.15.113:0/2495797846 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f540365a0 con 0x7f4f64157bf0 2023-12-19T14:00:20.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f6259c640 1 -- 172.21.15.113:0/2495797846 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54036930 con 0x7f4f64157bf0 2023-12-19T14:00:20.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 -- 172.21.15.113:0/2495797846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f64157bf0 msgr2=0x7f4f6415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 --2- 172.21.15.113:0/2495797846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f64157bf0 0x7f4f6415b200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400bb10 tx=0x7f4f5402e150 comp rx=0 tx=0).stop 2023-12-19T14:00:20.279 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 -- 172.21.15.113:0/2495797846 shutdown_connections 2023-12-19T14:00:20.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 --2- 172.21.15.113:0/2495797846 >> v2:172.21.15.151:3300/0 conn(0x7f4f640ae110 0x7f4f640b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 --2- 172.21.15.113:0/2495797846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f64157bf0 0x7f4f6415b200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 -- 172.21.15.113:0/2495797846 >> 172.21.15.113:0/2495797846 conn(0x7f4f640cbb70 msgr2=0x7f4f640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:20.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 -- 172.21.15.113:0/2495797846 shutdown_connections 2023-12-19T14:00:20.280 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.279+0000 7f4f69030640 1 -- 172.21.15.113:0/2495797846 wait complete. 2023-12-19T14:00:20.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.281+0000 7f4f69030640 1 Processor -- start 2023-12-19T14:00:20.281 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.281+0000 7f4f69030640 1 -- start start 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.282+0000 7f4f69030640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f640ae110 0x7f4f64157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.282+0000 7f4f69030640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f640b0640 0x7f4f641f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.282+0000 7f4f69030640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f64157bf0 0x7f4f640ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.282+0000 7f4f69030640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f641529f0 con 0x7f4f64157bf0 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.282+0000 7f4f69030640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f641f3250 con 0x7f4f640b0640 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.282+0000 7f4f69030640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640cacd0 con 0x7f4f640ae110 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f64157bf0 0x7f4f640ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f64157bf0 0x7f4f640ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50632/0 (socket says 172.21.15.113:50632) 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 -- 172.21.15.113:0/2108883519 learned_addr learned my addr 172.21.15.113:0/2108883519 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f5a59c640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f640b0640 0x7f4f641f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f62d9d640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f640ae110 0x7f4f64157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 -- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f640ae110 msgr2=0x7f4f64157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f640ae110 0x7f4f64157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 -- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f640b0640 msgr2=0x7f4f641f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f640b0640 0x7f4f641f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 -- 172.21.15.113:0/2108883519 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5400b770 con 0x7f4f64157bf0 2023-12-19T14:00:20.284 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.283+0000 7f4f6359e640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f64157bf0 0x7f4f640ca790 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00c7a0 tx=0x7f4f5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:20.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.284+0000 7f4f5bfff640 1 -- 172.21.15.113:0/2108883519 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c003b70 con 0x7f4f64157bf0 2023-12-19T14:00:20.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.284+0000 7f4f5bfff640 1 -- 172.21.15.113:0/2108883519 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c003cf0 con 0x7f4f64157bf0 2023-12-19T14:00:20.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.284+0000 7f4f5bfff640 1 -- 172.21.15.113:0/2108883519 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c003ea0 con 0x7f4f64157bf0 2023-12-19T14:00:20.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.284+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f641585b0 con 0x7f4f64157bf0 2023-12-19T14:00:20.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.284+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f64158b70 con 0x7f4f64157bf0 2023-12-19T14:00:20.285 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.285+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f64152ba0 con 0x7f4f64157bf0 2023-12-19T14:00:20.286 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.286+0000 7f4f5bfff640 1 -- 172.21.15.113:0/2108883519 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f5c00aa90 con 0x7f4f64157bf0 2023-12-19T14:00:20.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.287+0000 7f4f5bfff640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4406a460 0x7f4f4406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.287+0000 7f4f5bfff640 1 -- 172.21.15.113:0/2108883519 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f5c088570 con 0x7f4f64157bf0 2023-12-19T14:00:20.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.287+0000 7f4f62d9d640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4406a460 0x7f4f4406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.287 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.288+0000 7f4f62d9d640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4406a460 0x7f4f4406c920 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4f54038000 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:20.291 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.291+0000 7f4f5bfff640 1 -- 172.21.15.113:0/2108883519 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f64152ba0 con 0x7f4f64157bf0 2023-12-19T14:00:20.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.481+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f640b0a90 con 0x7f4f64157bf0 2023-12-19T14:00:20.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.483+0000 7f4f5bfff640 1 -- 172.21.15.113:0/2108883519 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16167 (secure 0 0 0) 0x7f4f640b0a90 con 0x7f4f64157bf0 2023-12-19T14:00:20.483 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:20.484 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":199,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T14:00:13.716004+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4406a460 msgr2=0x7f4f4406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4406a460 0x7f4f4406c920 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4f54038000 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f64157bf0 msgr2=0x7f4f640ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f64157bf0 0x7f4f640ca790 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00c7a0 tx=0x7f4f5c00cc60 comp rx=0 tx=0).stop 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 shutdown_connections 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f4f4406a460 0x7f4f4406c920 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4f64157bf0 0x7f4f640ca790 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f640b0640 0x7f4f641f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 --2- 172.21.15.113:0/2108883519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f640ae110 0x7f4f64157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 >> 172.21.15.113:0/2108883519 conn(0x7f4f640cbb70 msgr2=0x7f4f64156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:20.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 shutdown_connections 2023-12-19T14:00:20.487 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.486+0000 7f4f69030640 1 -- 172.21.15.113:0/2108883519 wait complete. 2023-12-19T14:00:20.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:59:38.845347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:59:40.229435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '199', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T14:00:20.508 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T14:00:20.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.727+0000 7fda822b6640 1 Processor -- start 2023-12-19T14:00:20.727 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.727+0000 7fda822b6640 1 -- start start 2023-12-19T14:00:20.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.729+0000 7fda822b6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fda7c154760 0x7fda7c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.729+0000 7fda822b6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0ccbd0 con 0x7fda7c0cb810 2023-12-19T14:00:20.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.729+0000 7fda822b6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c154b40 con 0x7fda7c0b0070 2023-12-19T14:00:20.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.729+0000 7fda822b6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0ccf20 con 0x7fda7c154760 2023-12-19T14:00:20.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.729+0000 7fda73fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fda7c0cb810 0x7fda7c0b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57592/0 (socket says 172.21.15.113:57592) 2023-12-19T14:00:20.729 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.729+0000 7fda73fff640 1 -- 172.21.15.113:0/2662096653 learned_addr learned my addr 172.21.15.113:0/2662096653 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:20.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.729+0000 7fda7bfff640 1 --2- 172.21.15.113:0/2662096653 >> v2:172.21.15.151:3300/0 conn(0x7fda7c154760 0x7fda7c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828531307 0 0) 0x7fda7c0ccbd0 con 0x7fda7c0cb810 2023-12-19T14:00:20.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003520 con 0x7fda7c0cb810 2023-12-19T14:00:20.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217197787 0 0) 0x7fda68003520 con 0x7fda7c0cb810 2023-12-19T14:00:20.731 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 >> v2:172.21.15.151:3300/0 conn(0x7fda7c154760 msgr2=0x7fda7c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 --2- 172.21.15.113:0/2662096653 >> v2:172.21.15.151:3300/0 conn(0x7fda7c154760 0x7fda7c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 >> v1:172.21.15.151:6789/0 conn(0x7fda7c0b0070 legacy=0x7fda7c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0cc060 con 0x7fda7c0cb810 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fda64001670 con 0x7fda7c0cb810 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 >> v1:172.21.15.113:6789/0 conn(0x7fda7c0cb810 legacy=0x7fda7c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda68003a30 0x7fda68003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda680047c0 0x7fda68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda680052a0 0x7fda6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0ccf20 con 0x7fda680052a0 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800c170 con 0x7fda680047c0 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.730+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800c330 con 0x7fda68003a30 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda80853640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda680052a0 0x7fda6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda7bfff640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda68003a30 0x7fda68003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda73fff640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda680047c0 0x7fda68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda80853640 1 -- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda68003a30 msgr2=0x7fda68003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:20.732 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda80853640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda68003a30 0x7fda68003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda80853640 1 -- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda680047c0 msgr2=0x7fda68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:20.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda80853640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda680047c0 0x7fda68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.733 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.731+0000 7fda80853640 1 -- 172.21.15.113:0/2662096653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68003520 con 0x7fda680052a0 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.732+0000 7fda80853640 1 -- 172.21.15.113:0/2662096653 reap_dead start 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.732+0000 7fda80853640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda680052a0 0x7fda6800b980 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fda74004480 tx=0x7fda680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3639d36a43e75735 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.732+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74006b50 con 0x7fda680052a0 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.732+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74006cd0 con 0x7fda680052a0 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.732+0000 7fda7b7fe640 1 -- 172.21.15.113:0/2662096653 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74007260 con 0x7fda680052a0 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.733+0000 7fda822b6640 1 -- 172.21.15.113:0/2662096653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda680052a0 msgr2=0x7fda6800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.733+0000 7fda822b6640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda680052a0 0x7fda6800b980 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fda74004480 tx=0x7fda680057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.733+0000 7fda822b6640 1 -- 172.21.15.113:0/2662096653 shutdown_connections 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.733+0000 7fda822b6640 1 --2- 172.21.15.113:0/2662096653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda680052a0 0x7fda6800b980 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.733+0000 7fda822b6640 1 -- 172.21.15.113:0/2662096653 >> 172.21.15.113:0/2662096653 conn(0x7fda7c073150 msgr2=0x7fda7c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:20.734 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.733+0000 7fda822b6640 1 -- 172.21.15.113:0/2662096653 shutdown_connections 2023-12-19T14:00:20.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.733+0000 7fda822b6640 1 -- 172.21.15.113:0/2662096653 wait complete. 2023-12-19T14:00:20.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.735+0000 7fda822b6640 1 Processor -- start 2023-12-19T14:00:20.735 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.735+0000 7fda822b6640 1 -- start start 2023-12-19T14:00:20.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda822b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda680052a0 0x7fda7c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda822b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda7c151250 0x7fda7c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda822b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda7c0aed10 0x7fda7c0af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda822b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c157be0 con 0x7fda7c0aed10 2023-12-19T14:00:20.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda822b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0af6d0 con 0x7fda7c151250 2023-12-19T14:00:20.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda822b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c157340 con 0x7fda680052a0 2023-12-19T14:00:20.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda80853640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda7c0aed10 0x7fda7c0af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda80853640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda7c0aed10 0x7fda7c0af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50642/0 (socket says 172.21.15.113:50642) 2023-12-19T14:00:20.737 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.736+0000 7fda80853640 1 -- 172.21.15.113:0/4112747538 learned_addr learned my addr 172.21.15.113:0/4112747538 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:20.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda73fff640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda7c151250 0x7fda7c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda7bfff640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda680052a0 0x7fda7c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda80853640 1 -- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda680052a0 msgr2=0x7fda7c1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda80853640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda680052a0 0x7fda7c1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda80853640 1 -- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda7c151250 msgr2=0x7fda7c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda80853640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda7c151250 0x7fda7c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda80853640 1 -- 172.21.15.113:0/4112747538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c157620 con 0x7fda7c0aed10 2023-12-19T14:00:20.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.737+0000 7fda80853640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda7c0aed10 0x7fda7c0af190 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fda74004480 tx=0x7fda74003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:20.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.738+0000 7fda797fa640 1 -- 172.21.15.113:0/4112747538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7403d040 con 0x7fda7c0aed10 2023-12-19T14:00:20.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.738+0000 7fda797fa640 1 -- 172.21.15.113:0/4112747538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74038810 con 0x7fda7c0aed10 2023-12-19T14:00:20.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.738+0000 7fda797fa640 1 -- 172.21.15.113:0/4112747538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74038bc0 con 0x7fda7c0aed10 2023-12-19T14:00:20.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.738+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c157900 con 0x7fda7c0aed10 2023-12-19T14:00:20.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.738+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c151f50 con 0x7fda7c0aed10 2023-12-19T14:00:20.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.739+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c06c0d0 con 0x7fda7c0aed10 2023-12-19T14:00:20.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.740+0000 7fda797fa640 1 -- 172.21.15.113:0/4112747538 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda74038d20 con 0x7fda7c0aed10 2023-12-19T14:00:20.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.741+0000 7fda797fa640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda5c06a4b0 0x7fda5c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:20.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.741+0000 7fda797fa640 1 -- 172.21.15.113:0/4112747538 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda740aa1d0 con 0x7fda7c0aed10 2023-12-19T14:00:20.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.741+0000 7fda7bfff640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda5c06a4b0 0x7fda5c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:20.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.742+0000 7fda7bfff640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda5c06a4b0 0x7fda5c06c970 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fda7c06a0a0 tx=0x7fda6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:20.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.745+0000 7fda797fa640 1 -- 172.21.15.113:0/4112747538 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fda7c06c0d0 con 0x7fda7c0aed10 2023-12-19T14:00:20.942 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.942+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda7c06c4b0 con 0x7fda7c0aed10 2023-12-19T14:00:20.943 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.943+0000 7fda797fa640 1 -- 172.21.15.113:0/4112747538 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v199) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda7c06c4b0 con 0x7fda7c0aed10 2023-12-19T14:00:20.943 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T14:00:20.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda5c06a4b0 msgr2=0x7fda5c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda5c06a4b0 0x7fda5c06c970 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fda7c06a0a0 tx=0x7fda6c008040 comp rx=0 tx=0).stop 2023-12-19T14:00:20.946 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda7c0aed10 msgr2=0x7fda7c0af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda7c0aed10 0x7fda7c0af190 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fda74004480 tx=0x7fda74003ae0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 shutdown_connections 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fda5c06a4b0 0x7fda5c06c970 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda7c0aed10 0x7fda7c0af190 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda7c151250 0x7fda7c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 --2- 172.21.15.113:0/4112747538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda680052a0 0x7fda7c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 >> 172.21.15.113:0/4112747538 conn(0x7fda7c073150 msgr2=0x7fda7c15e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 shutdown_connections 2023-12-19T14:00:20.947 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:20.946+0000 7fda822b6640 1 -- 172.21.15.113:0/4112747538 wait complete. 2023-12-19T14:00:20.963 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T14:00:21.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.178+0000 7f0cd29d3640 1 Processor -- start 2023-12-19T14:00:21.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.179+0000 7f0cd29d3640 1 -- start start 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.180+0000 7f0cd29d3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ccc0b0b50 0x7f0ccc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.180+0000 7f0cd29d3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ccc06b590 0x7f0ccc06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.180+0000 7f0cd29d3640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc06bb30 con 0x7f0ccc1449e0 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.180+0000 7f0cd29d3640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc0b0070 con 0x7f0ccc0b0b50 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.180+0000 7f0cd29d3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc0b0350 con 0x7f0ccc06b590 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0ccb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ccc0b0b50 0x7f0ccc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0ccb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0ccc0b0b50 0x7f0ccc06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50650/0 (socket says 172.21.15.113:50650) 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0ccb7fe640 1 -- 172.21.15.113:0/3497556474 learned_addr learned my addr 172.21.15.113:0/3497556474 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0ccb7fe640 1 -- 172.21.15.113:0/3497556474 >> v2:172.21.15.151:3300/0 conn(0x7f0ccc06b590 msgr2=0x7f0ccc06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:21.181 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0cd0f70640 1 --2- 172.21.15.113:0/3497556474 >> v2:172.21.15.151:3300/0 conn(0x7f0ccc06b590 0x7f0ccc06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0ccb7fe640 1 --2- 172.21.15.113:0/3497556474 >> v2:172.21.15.151:3300/0 conn(0x7f0ccc06b590 0x7f0ccc06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0ccb7fe640 1 -- 172.21.15.113:0/3497556474 >> v1:172.21.15.151:6789/0 conn(0x7f0ccc1449e0 legacy=0x7f0ccc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:21.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0ccb7fe640 1 -- 172.21.15.113:0/3497556474 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0b0630 con 0x7f0ccc0b0b50 2023-12-19T14:00:21.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.181+0000 7f0cd0f70640 1 --2- 172.21.15.113:0/3497556474 >> v2:172.21.15.151:3300/0 conn(0x7f0ccc06b590 0x7f0ccc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:21.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.182+0000 7f0ccb7fe640 1 --2- 172.21.15.113:0/3497556474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc0b0b50 0x7f0ccc06bfa0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0b1270 tx=0x7f0cb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4df70f69f915e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:21.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0ccaffd640 1 -- 172.21.15.113:0/3497556474 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4031870 con 0x7f0ccc0b0b50 2023-12-19T14:00:21.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0ccaffd640 1 -- 172.21.15.113:0/3497556474 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb40319d0 con 0x7f0ccc0b0b50 2023-12-19T14:00:21.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0ccaffd640 1 -- 172.21.15.113:0/3497556474 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4031d60 con 0x7f0ccc0b0b50 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 -- 172.21.15.113:0/3497556474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc0b0b50 msgr2=0x7f0ccc06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/3497556474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc0b0b50 0x7f0ccc06bfa0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0b1270 tx=0x7f0cb402b910 comp rx=0 tx=0).stop 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 -- 172.21.15.113:0/3497556474 shutdown_connections 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/3497556474 >> v2:172.21.15.151:3300/0 conn(0x7f0ccc06b590 0x7f0ccc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/3497556474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc0b0b50 0x7f0ccc06bfa0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 -- 172.21.15.113:0/3497556474 >> 172.21.15.113:0/3497556474 conn(0x7f0ccc0cbb70 msgr2=0x7f0ccc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 -- 172.21.15.113:0/3497556474 shutdown_connections 2023-12-19T14:00:21.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.183+0000 7f0cd29d3640 1 -- 172.21.15.113:0/3497556474 wait complete. 2023-12-19T14:00:21.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.185+0000 7f0cd29d3640 1 Processor -- start 2023-12-19T14:00:21.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.185+0000 7f0cd29d3640 1 -- start start 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.186+0000 7f0cd29d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc06b590 0x7f0ccc158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.186+0000 7f0cd29d3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0b0b50 0x7f0ccc13bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.186+0000 7f0cd29d3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc1449e0 0x7f0ccc13c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.186+0000 7f0cd29d3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0cd550 con 0x7f0ccc06b590 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.186+0000 7f0cd29d3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0ccc80 con 0x7f0ccc1449e0 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.186+0000 7f0cd29d3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc1f3c60 con 0x7f0ccc0b0b50 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.186+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc06b590 0x7f0ccc158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc06b590 0x7f0ccc158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50664/0 (socket says 172.21.15.113:50664) 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 -- 172.21.15.113:0/735318161 learned_addr learned my addr 172.21.15.113:0/735318161 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:21.187 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 -- 172.21.15.113:0/735318161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0b0b50 msgr2=0x7f0ccc13bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0b0b50 0x7f0ccc13bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 -- 172.21.15.113:0/735318161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc1449e0 msgr2=0x7f0ccc13c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc1449e0 0x7f0ccc13c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 -- 172.21.15.113:0/735318161 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40094d0 con 0x7f0ccc06b590 2023-12-19T14:00:21.188 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0ccbfff640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc06b590 0x7f0ccc158e90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b420 tx=0x7f0cbc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.187+0000 7f0cc8ff9640 1 -- 172.21.15.113:0/735318161 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011830 con 0x7f0ccc06b590 2023-12-19T14:00:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.188+0000 7f0cc8ff9640 1 -- 172.21.15.113:0/735318161 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc011990 con 0x7f0ccc06b590 2023-12-19T14:00:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.188+0000 7f0cc8ff9640 1 -- 172.21.15.113:0/735318161 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011d40 con 0x7f0ccc06b590 2023-12-19T14:00:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.188+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc0ae060 con 0x7f0ccc06b590 2023-12-19T14:00:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.188+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc0cd170 con 0x7f0ccc06b590 2023-12-19T14:00:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.189+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc061910 con 0x7f0ccc06b590 2023-12-19T14:00:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.190+0000 7f0cc8ff9640 1 -- 172.21.15.113:0/735318161 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0cbc01b460 con 0x7f0ccc06b590 2023-12-19T14:00:21.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.190+0000 7f0cc8ff9640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a430 0x7f0cac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.191+0000 7f0cc8ff9640 1 -- 172.21.15.113:0/735318161 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cbc0884d0 con 0x7f0ccc06b590 2023-12-19T14:00:21.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.191+0000 7f0ccb7fe640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a430 0x7f0cac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.192+0000 7f0ccb7fe640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a430 0x7f0cac06c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4036000 tx=0x7f0cb4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:21.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.195+0000 7f0cc8ff9640 1 -- 172.21.15.113:0/735318161 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0cbc053ab0 con 0x7f0ccc06b590 2023-12-19T14:00:21.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.392+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ccc0ae560 con 0x7f0ccc06b590 2023-12-19T14:00:21.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.393+0000 7f0cc8ff9640 1 -- 172.21.15.113:0/735318161 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v199) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0cbc0570d0 con 0x7f0ccc06b590 2023-12-19T14:00:21.393 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.395+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a430 msgr2=0x7f0cac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.395+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a430 0x7f0cac06c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4036000 tx=0x7f0cb4030000 comp rx=0 tx=0).stop 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.395+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc06b590 msgr2=0x7f0ccc158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.395+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc06b590 0x7f0ccc158e90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b420 tx=0x7f0cbc00b8e0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 shutdown_connections 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0cac06a430 0x7f0cac06c8f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc1449e0 0x7f0ccc13c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0b0b50 0x7f0ccc13bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 --2- 172.21.15.113:0/735318161 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ccc06b590 0x7f0ccc158e90 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 >> 172.21.15.113:0/735318161 conn(0x7f0ccc0cbb70 msgr2=0x7f0ccc0b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 shutdown_connections 2023-12-19T14:00:21.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.396+0000 7f0cd29d3640 1 -- 172.21.15.113:0/735318161 wait complete. 2023-12-19T14:00:21.415 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T14:00:21.496 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:21.505 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:21.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.634+0000 7f9ed41b9640 1 Processor -- start 2023-12-19T14:00:21.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.634+0000 7f9ed41b9640 1 -- start start 2023-12-19T14:00:21.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.635+0000 7f9ed41b9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ecc15b1d0 0x7f9ecc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.635+0000 7f9ed41b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0b1ec0 0x7f9ecc15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.635+0000 7f9ed41b9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ecc0ceea0 0x7f9ecc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.635+0000 7f9ed41b9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0cf870 con 0x7f9ecc0ceea0 2023-12-19T14:00:21.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.635+0000 7f9ed41b9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc15ef10 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.635+0000 7f9ed41b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b2320 con 0x7f9ecc0b1ec0 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ecc0ceea0 0x7f9ecc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ecc0ceea0 0x7f9ecc0cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50678/0 (socket says 172.21.15.113:50678) 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 -- 172.21.15.113:0/2807447891 learned_addr learned my addr 172.21.15.113:0/2807447891 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed1f55640 1 --2- 172.21.15.113:0/2807447891 >> v2:172.21.15.151:3300/0 conn(0x7f9ecc15b1d0 0x7f9ecc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed1754640 1 --2- 172.21.15.113:0/2807447891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0b1ec0 0x7f9ecc15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 -- 172.21.15.113:0/2807447891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0b1ec0 msgr2=0x7f9ecc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 --2- 172.21.15.113:0/2807447891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0b1ec0 0x7f9ecc15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 -- 172.21.15.113:0/2807447891 >> v2:172.21.15.151:3300/0 conn(0x7f9ecc15b1d0 msgr2=0x7f9ecc0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:21.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 --2- 172.21.15.113:0/2807447891 >> v2:172.21.15.151:3300/0 conn(0x7f9ecc15b1d0 0x7f9ecc0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed2756640 1 -- 172.21.15.113:0/2807447891 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0b2e40 con 0x7f9ecc0ceea0 2023-12-19T14:00:21.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed1f55640 1 --2- 172.21.15.113:0/2807447891 >> v2:172.21.15.151:3300/0 conn(0x7f9ecc15b1d0 0x7f9ecc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:21.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.636+0000 7f9ed1754640 1 --2- 172.21.15.113:0/2807447891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0b1ec0 0x7f9ecc15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.637+0000 7f9ed2756640 1 --2- 172.21.15.113:0/2807447891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc0ceea0 0x7f9ecc0cf330 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0ae020 tx=0x7f9ec402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcf6545b2c72f0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.637+0000 7f9ed0f53640 1 -- 172.21.15.113:0/2807447891 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec402ca80 con 0x7f9ecc0ceea0 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.637+0000 7f9ed0f53640 1 -- 172.21.15.113:0/2807447891 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec402cbe0 con 0x7f9ecc0ceea0 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.637+0000 7f9ed0f53640 1 -- 172.21.15.113:0/2807447891 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40343f0 con 0x7f9ecc0ceea0 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 -- 172.21.15.113:0/2807447891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc0ceea0 msgr2=0x7f9ecc0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/2807447891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc0ceea0 0x7f9ecc0cf330 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0ae020 tx=0x7f9ec402bee0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 -- 172.21.15.113:0/2807447891 shutdown_connections 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/2807447891 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc0ceea0 0x7f9ecc0cf330 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/2807447891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0b1ec0 0x7f9ecc15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/2807447891 >> v2:172.21.15.151:3300/0 conn(0x7f9ecc15b1d0 0x7f9ecc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 -- 172.21.15.113:0/2807447891 >> 172.21.15.113:0/2807447891 conn(0x7f9ecc073150 msgr2=0x7f9ecc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 -- 172.21.15.113:0/2807447891 shutdown_connections 2023-12-19T14:00:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.638+0000 7f9ed41b9640 1 -- 172.21.15.113:0/2807447891 wait complete. 2023-12-19T14:00:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.640+0000 7f9ed41b9640 1 Processor -- start 2023-12-19T14:00:21.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.640+0000 7f9ed41b9640 1 -- start start 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed41b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0b1ec0 0x7f9ecc155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed41b9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0ceea0 0x7f9ecc0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed41b9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc15b1d0 0x7f9ecc159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed41b9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc156400 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed41b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0c3e90 con 0x7f9ecc0b1ec0 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed41b9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0c7ce0 con 0x7f9ecc0ceea0 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed2756640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc15b1d0 0x7f9ecc159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed2756640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc15b1d0 0x7f9ecc159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50694/0 (socket says 172.21.15.113:50694) 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed2756640 1 -- 172.21.15.113:0/4204784928 learned_addr learned my addr 172.21.15.113:0/4204784928 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:21.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.641+0000 7f9ed1f55640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0b1ec0 0x7f9ecc155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed1754640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0ceea0 0x7f9ecc0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed2756640 1 -- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0ceea0 msgr2=0x7f9ecc0c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed2756640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0ceea0 0x7f9ecc0c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed2756640 1 -- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0b1ec0 msgr2=0x7f9ecc155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed2756640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0b1ec0 0x7f9ecc155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed2756640 1 -- 172.21.15.113:0/4204784928 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009b30 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed1754640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0ceea0 0x7f9ecc0c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T14:00:21.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed2756640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc15b1d0 0x7f9ecc159150 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4036040 tx=0x7f9ec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ec27fc640 1 -- 172.21.15.113:0/4204784928 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec403e450 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ec27fc640 1 -- 172.21.15.113:0/4204784928 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec403e5d0 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc0c40e0 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.642+0000 7f9ec27fc640 1 -- 172.21.15.113:0/4204784928 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec403e980 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.643+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc0c46a0 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.644+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc0c4890 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.645+0000 7f9ec27fc640 1 -- 172.21.15.113:0/4204784928 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ec402cd50 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.645+0000 7f9ec27fc640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9eb006a480 0x7f9eb006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:21.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.646+0000 7f9ec27fc640 1 -- 172.21.15.113:0/4204784928 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ec40ab460 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.646+0000 7f9ed1f55640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9eb006a480 0x7f9eb006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:21.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.646+0000 7f9ed1f55640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9eb006a480 0x7f9eb006c940 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800a950 tx=0x7f9ec8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:21.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.650+0000 7f9ec27fc640 1 -- 172.21.15.113:0/4204784928 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ec4076be0 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.842 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.842+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ecc061910 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.843+0000 7f9ec27fc640 1 -- 172.21.15.113:0/4204784928 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v199) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ec407a200 con 0x7f9ecc15b1d0 2023-12-19T14:00:21.843 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T14:00:21.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.845+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9eb006a480 msgr2=0x7f9eb006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.845+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9eb006a480 0x7f9eb006c940 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800a950 tx=0x7f9ec8008040 comp rx=0 tx=0).stop 2023-12-19T14:00:21.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.845+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc15b1d0 msgr2=0x7f9ecc159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:21.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.845+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc15b1d0 0x7f9ecc159150 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4036040 tx=0x7f9ec4004a40 comp rx=0 tx=0).stop 2023-12-19T14:00:21.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 shutdown_connections 2023-12-19T14:00:21.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9eb006a480 0x7f9eb006c940 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ecc15b1d0 0x7f9ecc159150 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0ceea0 0x7f9ecc0c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 --2- 172.21.15.113:0/4204784928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0b1ec0 0x7f9ecc155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:21.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 >> 172.21.15.113:0/4204784928 conn(0x7f9ecc073150 msgr2=0x7f9ecc15e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:21.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 shutdown_connections 2023-12-19T14:00:21.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:21.846+0000 7f9ed41b9640 1 -- 172.21.15.113:0/4204784928 wait complete. 2023-12-19T14:00:21.863 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T14:00:22.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.124+0000 7f598476e640 1 Processor -- start 2023-12-19T14:00:22.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.124+0000 7f598476e640 1 -- start start 2023-12-19T14:00:22.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f598476e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f598476e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f597c0d2b00 0x7f597c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f598476e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f597c0ce110 0x7f597c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f598476e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0d2430 con 0x7f597c0ce110 2023-12-19T14:00:22.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f598476e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0ceae0 con 0x7f597c0d2b00 2023-12-19T14:00:22.126 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f598476e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0cd840 con 0x7f597c146e10 2023-12-19T14:00:22.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f5982d0b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f597c0ce110 0x7f597c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f5982d0b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f597c0ce110 0x7f597c0ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50700/0 (socket says 172.21.15.113:50700) 2023-12-19T14:00:22.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.126+0000 7f5982d0b640 1 -- 172.21.15.113:0/3944591629 learned_addr learned my addr 172.21.15.113:0/3944591629 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:22.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.127+0000 7f5981d09640 1 --2- 172.21.15.113:0/3944591629 >> v2:172.21.15.151:3300/0 conn(0x7f597c0d2b00 0x7f597c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.127+0000 7f598250a640 1 --2- 172.21.15.113:0/3944591629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.127+0000 7f5982d0b640 1 -- 172.21.15.113:0/3944591629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 msgr2=0x7f597c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:22.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.127+0000 7f5982d0b640 1 --2- 172.21.15.113:0/3944591629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.127+0000 7f5982d0b640 1 -- 172.21.15.113:0/3944591629 >> v2:172.21.15.151:3300/0 conn(0x7f597c0d2b00 msgr2=0x7f597c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:22.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.127+0000 7f5982d0b640 1 --2- 172.21.15.113:0/3944591629 >> v2:172.21.15.151:3300/0 conn(0x7f597c0d2b00 0x7f597c0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.127+0000 7f5982d0b640 1 -- 172.21.15.113:0/3944591629 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0d2620 con 0x7f597c0ce110 2023-12-19T14:00:22.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.128+0000 7f5982d0b640 1 --2- 172.21.15.113:0/3944591629 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c0ce5a0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f597c0d44a0 tx=0x7f597402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285137b736fd6c8d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:22.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.129+0000 7f5981508640 1 -- 172.21.15.113:0/3944591629 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597402ca70 con 0x7f597c0ce110 2023-12-19T14:00:22.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.129+0000 7f5981508640 1 -- 172.21.15.113:0/3944591629 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597402cbd0 con 0x7f597c0ce110 2023-12-19T14:00:22.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.129+0000 7f5981508640 1 -- 172.21.15.113:0/3944591629 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740343f0 con 0x7f597c0ce110 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.129+0000 7f598476e640 1 -- 172.21.15.113:0/3944591629 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 msgr2=0x7f597c0ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.129+0000 7f598476e640 1 --2- 172.21.15.113:0/3944591629 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c0ce5a0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f597c0d44a0 tx=0x7f597402bed0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.130+0000 7f598476e640 1 -- 172.21.15.113:0/3944591629 shutdown_connections 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.130+0000 7f598476e640 1 --2- 172.21.15.113:0/3944591629 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c0ce5a0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.130+0000 7f598476e640 1 --2- 172.21.15.113:0/3944591629 >> v2:172.21.15.151:3300/0 conn(0x7f597c0d2b00 0x7f597c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.130+0000 7f598476e640 1 --2- 172.21.15.113:0/3944591629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.130+0000 7f598476e640 1 -- 172.21.15.113:0/3944591629 >> 172.21.15.113:0/3944591629 conn(0x7f597c0b29c0 msgr2=0x7f597c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.130+0000 7f598476e640 1 -- 172.21.15.113:0/3944591629 shutdown_connections 2023-12-19T14:00:22.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.130+0000 7f598476e640 1 -- 172.21.15.113:0/3944591629 wait complete. 2023-12-19T14:00:22.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.131+0000 7f598476e640 1 Processor -- start 2023-12-19T14:00:22.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.132+0000 7f598476e640 1 -- start start 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.132+0000 7f598476e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c13cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598476e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0d2b00 0x7f597c141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598476e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c13fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598476e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0b6ac0 con 0x7f597c0ce110 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598476e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0b6da0 con 0x7f597c0d2b00 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598476e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0b7080 con 0x7f597c146e10 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c13cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c13cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50702/0 (socket says 172.21.15.113:50702) 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 -- 172.21.15.113:0/911169029 learned_addr learned my addr 172.21.15.113:0/911169029 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:22.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f5981d09640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0d2b00 0x7f597c141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 -- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 msgr2=0x7f597c13fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c13fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 -- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0d2b00 msgr2=0x7f597c141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0d2b00 0x7f597c141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f598250a640 1 -- 172.21.15.113:0/911169029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974009b30 con 0x7f597c0ce110 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.133+0000 7f5981d09640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0d2b00 0x7f597c141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.134+0000 7f598250a640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c13cd70 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f597800d5f0 tx=0x7f597800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.134+0000 7f5972ffd640 1 -- 172.21.15.113:0/911169029 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59780125f0 con 0x7f597c0ce110 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.134+0000 7f5972ffd640 1 -- 172.21.15.113:0/911169029 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5978012750 con 0x7f597c0ce110 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.134+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c0b7360 con 0x7f597c0ce110 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.134+0000 7f5972ffd640 1 -- 172.21.15.113:0/911169029 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978012b00 con 0x7f597c0ce110 2023-12-19T14:00:22.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.134+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c140950 con 0x7f597c0ce110 2023-12-19T14:00:22.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.135+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c0b4480 con 0x7f597c0ce110 2023-12-19T14:00:22.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.136+0000 7f5972ffd640 1 -- 172.21.15.113:0/911169029 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5978012c60 con 0x7f597c0ce110 2023-12-19T14:00:22.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.137+0000 7f5972ffd640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.137+0000 7f5972ffd640 1 -- 172.21.15.113:0/911169029 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5978088da0 con 0x7f597c0ce110 2023-12-19T14:00:22.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.137+0000 7f5981d09640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.138+0000 7f5981d09640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f597c071010 tx=0x7f596c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:22.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.141+0000 7f5972ffd640 1 -- 172.21.15.113:0/911169029 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f597c0b4480 con 0x7f597c0ce110 2023-12-19T14:00:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.343+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f597c0b4480 con 0x7f597c0ce110 2023-12-19T14:00:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.343+0000 7f5972ffd640 1 -- 172.21.15.113:0/911169029 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v199) v1 ==== 80+0+0 (secure 0 0 0) 0x7f597c0b4480 con 0x7f597c0ce110 2023-12-19T14:00:22.343 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 msgr2=0x7f596006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f597c071010 tx=0x7f596c008040 comp rx=0 tx=0).stop 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 msgr2=0x7f597c13cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c13cd70 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f597800d5f0 tx=0x7f597800dab0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 shutdown_connections 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f596006a430 0x7f596006c8f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f597c146e10 0x7f597c13fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f597c0d2b00 0x7f597c141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 --2- 172.21.15.113:0/911169029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f597c0ce110 0x7f597c13cd70 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 >> 172.21.15.113:0/911169029 conn(0x7f597c0b29c0 msgr2=0x7f597c144490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:22.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 shutdown_connections 2023-12-19T14:00:22.347 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.346+0000 7f598476e640 1 -- 172.21.15.113:0/911169029 wait complete. 2023-12-19T14:00:22.363 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T14:00:22.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:22.363 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T14:00:22.497 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T14:00:22.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:22.498 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T14:00:22.542 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T14:00:22.542 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:22.584 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T14:00:22.584 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:22.679 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T14:00:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.899+0000 7fd462217640 1 Processor -- start 2023-12-19T14:00:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.900+0000 7fd462217640 1 -- start start 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd462217640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd45c146e10 0x7fd45c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd462217640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0d2b00 0x7fd45c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd462217640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd45c0ce110 0x7fd45c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd462217640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c0d2430 con 0x7fd45c0ce110 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd462217640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c0ceae0 con 0x7fd45c146e10 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd462217640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0cd840 con 0x7fd45c0d2b00 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd45bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd45c0ce110 0x7fd45c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd45bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd45c0ce110 0x7fd45c0ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50706/0 (socket says 172.21.15.113:50706) 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.901+0000 7fd45bfff640 1 -- 172.21.15.113:0/2800979566 learned_addr learned my addr 172.21.15.113:0/2800979566 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd45b7fe640 1 --2- 172.21.15.113:0/2800979566 >> v2:172.21.15.151:3300/0 conn(0x7fd45c146e10 0x7fd45c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd45bfff640 1 -- 172.21.15.113:0/2800979566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0d2b00 msgr2=0x7fd45c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd453fff640 1 --2- 172.21.15.113:0/2800979566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0d2b00 0x7fd45c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd45bfff640 1 --2- 172.21.15.113:0/2800979566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0d2b00 0x7fd45c0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd45bfff640 1 -- 172.21.15.113:0/2800979566 >> v2:172.21.15.151:3300/0 conn(0x7fd45c146e10 msgr2=0x7fd45c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd45bfff640 1 --2- 172.21.15.113:0/2800979566 >> v2:172.21.15.151:3300/0 conn(0x7fd45c146e10 0x7fd45c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd45bfff640 1 -- 172.21.15.113:0/2800979566 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0d2620 con 0x7fd45c0ce110 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd45b7fe640 1 --2- 172.21.15.113:0/2800979566 >> v2:172.21.15.151:3300/0 conn(0x7fd45c146e10 0x7fd45c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:22.903 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.902+0000 7fd453fff640 1 --2- 172.21.15.113:0/2800979566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0d2b00 0x7fd45c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:22.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.903+0000 7fd45bfff640 1 --2- 172.21.15.113:0/2800979566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0ce110 0x7fd45c0ce5a0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0d0720 tx=0x7fd45402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f56b1f2ec1f2b0a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:22.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.903+0000 7fd45affd640 1 -- 172.21.15.113:0/2800979566 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45402ca70 con 0x7fd45c0ce110 2023-12-19T14:00:22.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.903+0000 7fd45affd640 1 -- 172.21.15.113:0/2800979566 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45402cbd0 con 0x7fd45c0ce110 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.903+0000 7fd45affd640 1 -- 172.21.15.113:0/2800979566 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540343f0 con 0x7fd45c0ce110 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 -- 172.21.15.113:0/2800979566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0ce110 msgr2=0x7fd45c0ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 --2- 172.21.15.113:0/2800979566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0ce110 0x7fd45c0ce5a0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0d0720 tx=0x7fd45402bed0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 -- 172.21.15.113:0/2800979566 shutdown_connections 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 --2- 172.21.15.113:0/2800979566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0ce110 0x7fd45c0ce5a0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 --2- 172.21.15.113:0/2800979566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0d2b00 0x7fd45c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 --2- 172.21.15.113:0/2800979566 >> v2:172.21.15.151:3300/0 conn(0x7fd45c146e10 0x7fd45c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 -- 172.21.15.113:0/2800979566 >> 172.21.15.113:0/2800979566 conn(0x7fd45c0b29c0 msgr2=0x7fd45c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 -- 172.21.15.113:0/2800979566 shutdown_connections 2023-12-19T14:00:22.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.904+0000 7fd462217640 1 -- 172.21.15.113:0/2800979566 wait complete. 2023-12-19T14:00:22.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.906+0000 7fd462217640 1 Processor -- start 2023-12-19T14:00:22.906 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.906+0000 7fd462217640 1 -- start start 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd462217640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0ce110 0x7fd45c142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd462217640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0d2b00 0x7fd45c0b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd462217640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd45c146e10 0x7fd45c13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd462217640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1443b0 con 0x7fd45c0d2b00 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd462217640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c143650 con 0x7fd45c146e10 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd462217640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c143930 con 0x7fd45c0ce110 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd453fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0d2b00 0x7fd45c0b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.908 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd453fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0d2b00 0x7fd45c0b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50720/0 (socket says 172.21.15.113:50720) 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.907+0000 7fd453fff640 1 -- 172.21.15.113:0/252277344 learned_addr learned my addr 172.21.15.113:0/252277344 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd453fff640 1 -- 172.21.15.113:0/252277344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0ce110 msgr2=0x7fd45c142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd453fff640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0ce110 0x7fd45c142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd453fff640 1 -- 172.21.15.113:0/252277344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd45c146e10 msgr2=0x7fd45c13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd45bfff640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd45c146e10 0x7fd45c13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd453fff640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd45c146e10 0x7fd45c13fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd453fff640 1 -- 172.21.15.113:0/252277344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454009b30 con 0x7fd45c0d2b00 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd453fff640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0d2b00 0x7fd45c0b7a00 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c7c0 tx=0x7fd44400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd458ff9640 1 -- 172.21.15.113:0/252277344 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444007a30 con 0x7fd45c0d2b00 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd458ff9640 1 -- 172.21.15.113:0/252277344 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd444007b90 con 0x7fd45c0d2b00 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c143c10 con 0x7fd45c0d2b00 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd458ff9640 1 -- 172.21.15.113:0/252277344 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400ce70 con 0x7fd45c0d2b00 2023-12-19T14:00:22.909 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.908+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c143290 con 0x7fd45c0d2b00 2023-12-19T14:00:22.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.909+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c061910 con 0x7fd45c0d2b00 2023-12-19T14:00:22.910 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.910+0000 7fd458ff9640 1 -- 172.21.15.113:0/252277344 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd4440113f0 con 0x7fd45c0d2b00 2023-12-19T14:00:22.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.911+0000 7fd458ff9640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd43c06a460 0x7fd43c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:22.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.911+0000 7fd458ff9640 1 -- 172.21.15.113:0/252277344 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd444088990 con 0x7fd45c0d2b00 2023-12-19T14:00:22.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.911+0000 7fd45b7fe640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd43c06a460 0x7fd43c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:22.912 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.912+0000 7fd45b7fe640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd43c06a460 0x7fd43c06c920 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006fd0 tx=0x7fd44c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:22.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:22.916+0000 7fd458ff9640 1 -- 172.21.15.113:0/252277344 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd444053ff0 con 0x7fd45c0d2b00 2023-12-19T14:00:23.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.095+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd45c0ce7d0 con 0x7fd45c0d2b00 2023-12-19T14:00:23.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.096+0000 7fd458ff9640 1 -- 172.21.15.113:0/252277344 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+16217 (secure 0 0 0) 0x7fd44401f090 con 0x7fd45c0d2b00 2023-12-19T14:00:23.097 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:23.097 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":200,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T14:00:22.782833+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.26","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.099+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd43c06a460 msgr2=0x7fd43c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.099+0000 7fd462217640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd43c06a460 0x7fd43c06c920 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006fd0 tx=0x7fd44c008040 comp rx=0 tx=0).stop 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.099+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0d2b00 msgr2=0x7fd45c0b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.099+0000 7fd462217640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0d2b00 0x7fd45c0b7a00 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c7c0 tx=0x7fd44400cc80 comp rx=0 tx=0).stop 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 shutdown_connections 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd43c06a460 0x7fd43c06c920 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd45c146e10 0x7fd45c13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd45c0d2b00 0x7fd45c0b7a00 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 --2- 172.21.15.113:0/252277344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd45c0ce110 0x7fd45c142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 >> 172.21.15.113:0/252277344 conn(0x7fd45c0b29c0 msgr2=0x7fd45c141710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 shutdown_connections 2023-12-19T14:00:23.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.100+0000 7fd462217640 1 -- 172.21.15.113:0/252277344 wait complete. 2023-12-19T14:00:23.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:59:38.845347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:59:40.229435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '199', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T14:00:23.119 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T14:00:23.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.331+0000 7fdf631d3640 1 Processor -- start 2023-12-19T14:00:23.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.331+0000 7fdf631d3640 1 -- start start 2023-12-19T14:00:23.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.332+0000 7fdf631d3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c15b1d0 0x7fdf5c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.332+0000 7fdf631d3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdf5c0b1ec0 0x7fdf5c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf631d3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdf5c0ceea0 0x7fdf5c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf631d3640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c0cf870 con 0x7fdf5c0b1ec0 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf631d3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c15ef10 con 0x7fdf5c0ceea0 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf631d3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0b2320 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdf5c0b1ec0 0x7fdf5c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdf5c0b1ec0 0x7fdf5c15f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50724/0 (socket says 172.21.15.113:50724) 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 -- 172.21.15.113:0/1597785996 learned_addr learned my addr 172.21.15.113:0/1597785996 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 -- 172.21.15.113:0/1597785996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c15b1d0 msgr2=0x7fdf5c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 --2- 172.21.15.113:0/1597785996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c15b1d0 0x7fdf5c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 -- 172.21.15.113:0/1597785996 >> v2:172.21.15.151:3300/0 conn(0x7fdf5c0ceea0 msgr2=0x7fdf5c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 --2- 172.21.15.113:0/1597785996 >> v2:172.21.15.151:3300/0 conn(0x7fdf5c0ceea0 0x7fdf5c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.333+0000 7fdf5bfff640 1 -- 172.21.15.113:0/1597785996 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0b2e40 con 0x7fdf5c0b1ec0 2023-12-19T14:00:23.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.334+0000 7fdf5bfff640 1 --2- 172.21.15.113:0/1597785996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c0b1ec0 0x7fdf5c15f6d0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c071a10 tx=0x7fdf4802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a504bd02a019a0ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:23.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.334+0000 7fdf5b7fe640 1 -- 172.21.15.113:0/1597785996 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48031860 con 0x7fdf5c0b1ec0 2023-12-19T14:00:23.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf5b7fe640 1 -- 172.21.15.113:0/1597785996 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf480319c0 con 0x7fdf5c0b1ec0 2023-12-19T14:00:23.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf5b7fe640 1 -- 172.21.15.113:0/1597785996 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48031d50 con 0x7fdf5c0b1ec0 2023-12-19T14:00:23.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 -- 172.21.15.113:0/1597785996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c0b1ec0 msgr2=0x7fdf5c15f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1597785996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c0b1ec0 0x7fdf5c15f6d0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c071a10 tx=0x7fdf4802b900 comp rx=0 tx=0).stop 2023-12-19T14:00:23.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 -- 172.21.15.113:0/1597785996 shutdown_connections 2023-12-19T14:00:23.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1597785996 >> v2:172.21.15.151:3300/0 conn(0x7fdf5c0ceea0 0x7fdf5c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1597785996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c0b1ec0 0x7fdf5c15f6d0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1597785996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c15b1d0 0x7fdf5c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 -- 172.21.15.113:0/1597785996 >> 172.21.15.113:0/1597785996 conn(0x7fdf5c073150 msgr2=0x7fdf5c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:23.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 -- 172.21.15.113:0/1597785996 shutdown_connections 2023-12-19T14:00:23.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.335+0000 7fdf631d3640 1 -- 172.21.15.113:0/1597785996 wait complete. 2023-12-19T14:00:23.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.337+0000 7fdf631d3640 1 Processor -- start 2023-12-19T14:00:23.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.337+0000 7fdf631d3640 1 -- start start 2023-12-19T14:00:23.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf631d3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c0b1ec0 0x7fdf5c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf631d3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c0ceea0 0x7fdf5c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf631d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c15b1d0 0x7fdf5c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf631d3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c15c820 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf631d3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c15cd20 con 0x7fdf5c0b1ec0 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf631d3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0cd9b0 con 0x7fdf5c0ceea0 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf61770640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c15b1d0 0x7fdf5c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf61770640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c15b1d0 0x7fdf5c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50736/0 (socket says 172.21.15.113:50736) 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.338+0000 7fdf61770640 1 -- 172.21.15.113:0/1001735732 learned_addr learned my addr 172.21.15.113:0/1001735732 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf61770640 1 -- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c0ceea0 msgr2=0x7fdf5c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf5bfff640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c0ceea0 0x7fdf5c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf60f6f640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c0b1ec0 0x7fdf5c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf61770640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c0ceea0 0x7fdf5c0cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf61770640 1 -- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c0b1ec0 msgr2=0x7fdf5c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf61770640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c0b1ec0 0x7fdf5c153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf61770640 1 -- 172.21.15.113:0/1001735732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480094d0 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.340 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf61770640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c15b1d0 0x7fdf5c0ac8b0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400b970 tx=0x7fdf5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:23.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf597fa640 1 -- 172.21.15.113:0/1001735732 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5400cb40 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf597fa640 1 -- 172.21.15.113:0/1001735732 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5400ccc0 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf597fa640 1 -- 172.21.15.113:0/1001735732 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54014680 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c15cf30 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.339+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c15d4f0 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.340+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c15d6e0 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.341+0000 7fdf597fa640 1 -- 172.21.15.113:0/1001735732 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdf5401d3b0 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.342+0000 7fdf597fa640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf4006a430 0x7fdf4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.342+0000 7fdf597fa640 1 -- 172.21.15.113:0/1001735732 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdf54088890 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.342+0000 7fdf60f6f640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf4006a430 0x7fdf4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.343+0000 7fdf60f6f640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf4006a430 0x7fdf4006c8f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000a770 tx=0x7fdf50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:23.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.346+0000 7fdf597fa640 1 -- 172.21.15.113:0/1001735732 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdf54053e60 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.518+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf5c061910 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.518+0000 7fdf597fa640 1 -- 172.21.15.113:0/1001735732 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v200) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf54019020 con 0x7fdf5c15b1d0 2023-12-19T14:00:23.518 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf4006a430 msgr2=0x7fdf4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf4006a430 0x7fdf4006c8f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000a770 tx=0x7fdf50008040 comp rx=0 tx=0).stop 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c15b1d0 msgr2=0x7fdf5c0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c15b1d0 0x7fdf5c0ac8b0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400b970 tx=0x7fdf5400be30 comp rx=0 tx=0).stop 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 shutdown_connections 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf4006a430 0x7fdf4006c8f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf5c15b1d0 0x7fdf5c0ac8b0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf5c0ceea0 0x7fdf5c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.521 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 --2- 172.21.15.113:0/1001735732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c0b1ec0 0x7fdf5c153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 >> 172.21.15.113:0/1001735732 conn(0x7fdf5c073150 msgr2=0x7fdf5c06c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:23.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 shutdown_connections 2023-12-19T14:00:23.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.521+0000 7fdf631d3640 1 -- 172.21.15.113:0/1001735732 wait complete. 2023-12-19T14:00:23.538 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T14:00:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.748+0000 7f87de821640 1 Processor -- start 2023-12-19T14:00:23.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.748+0000 7f87de821640 1 -- start start 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87de821640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f87d80afa50 0x7f87d8166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87de821640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87de821640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d8165bc0 con 0x7f87d8161660 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87de821640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d806e520 con 0x7f87d80afa50 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87de821640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80afef0 con 0x7f87d8161a40 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87cffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f87d80afa50 0x7f87d8166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87cffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f87d80afa50 0x7f87d8166050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50752/0 (socket says 172.21.15.113:50752) 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.750+0000 7f87cffff640 1 -- 172.21.15.113:0/1278782021 learned_addr learned my addr 172.21.15.113:0/1278782021 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.751+0000 7f87dcdbe640 1 --2- 172.21.15.113:0/1278782021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.751+0000 7f87cffff640 1 -- 172.21.15.113:0/1278782021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 msgr2=0x7f87d80b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.751+0000 7f87cffff640 1 --2- 172.21.15.113:0/1278782021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d80b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.751+0000 7f87cffff640 1 -- 172.21.15.113:0/1278782021 >> v1:172.21.15.113:6789/0 conn(0x7f87d8161660 legacy=0x7f87d80b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.751+0000 7f87d77fe640 1 -- 172.21.15.113:0/1278782021 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141703680 0 0) 0x7f87d8165bc0 con 0x7f87d8161660 2023-12-19T14:00:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.751+0000 7f87cffff640 1 -- 172.21.15.113:0/1278782021 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8165570 con 0x7f87d80afa50 2023-12-19T14:00:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.752+0000 7f87cffff640 1 --2- 172.21.15.113:0/1278782021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d80afa50 0x7f87d8166050 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009870 tx=0x7f87c002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465df9e66e0c3d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.752+0000 7f87d77fe640 1 -- 172.21.15.113:0/1278782021 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0030840 con 0x7f87d80afa50 2023-12-19T14:00:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.752+0000 7f87d77fe640 1 -- 172.21.15.113:0/1278782021 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c00309a0 con 0x7f87d80afa50 2023-12-19T14:00:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.752+0000 7f87d77fe640 1 -- 172.21.15.113:0/1278782021 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0030d30 con 0x7f87d80afa50 2023-12-19T14:00:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 -- 172.21.15.113:0/1278782021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d80afa50 msgr2=0x7f87d8166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 --2- 172.21.15.113:0/1278782021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d80afa50 0x7f87d8166050 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009870 tx=0x7f87c002b980 comp rx=0 tx=0).stop 2023-12-19T14:00:23.753 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 -- 172.21.15.113:0/1278782021 shutdown_connections 2023-12-19T14:00:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 --2- 172.21.15.113:0/1278782021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d80b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 --2- 172.21.15.113:0/1278782021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d80afa50 0x7f87d8166050 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 -- 172.21.15.113:0/1278782021 >> 172.21.15.113:0/1278782021 conn(0x7f87d80cbb70 msgr2=0x7f87d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 -- 172.21.15.113:0/1278782021 shutdown_connections 2023-12-19T14:00:23.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.753+0000 7f87de821640 1 -- 172.21.15.113:0/1278782021 wait complete. 2023-12-19T14:00:23.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.755+0000 7f87de821640 1 Processor -- start 2023-12-19T14:00:23.755 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.755+0000 7f87de821640 1 -- start start 2023-12-19T14:00:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87de821640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d80afa50 0x7f87d81648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87de821640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d8161660 0x7f87d8158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87de821640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d806f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87de821640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d806dd30 con 0x7f87d8161660 2023-12-19T14:00:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87de821640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8164e10 con 0x7f87d80afa50 2023-12-19T14:00:23.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87de821640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81601d0 con 0x7f87d8161a40 2023-12-19T14:00:23.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87cffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d8161660 0x7f87d8158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87cffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d8161660 0x7f87d8158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50756/0 (socket says 172.21.15.113:50756) 2023-12-19T14:00:23.757 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.756+0000 7f87cffff640 1 -- 172.21.15.113:0/417627272 learned_addr learned my addr 172.21.15.113:0/417627272 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87cffff640 1 -- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 msgr2=0x7f87d806f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87dcdbe640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d806f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87cffff640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d806f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87d7fff640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d80afa50 0x7f87d81648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87cffff640 1 -- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d80afa50 msgr2=0x7f87d81648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87cffff640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d80afa50 0x7f87d81648d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87cffff640 1 -- 172.21.15.113:0/417627272 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00094d0 con 0x7f87d8161660 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87cffff640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d8161660 0x7f87d8158a90 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009870 tx=0x7f87c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:23.758 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0039c90 con 0x7f87d8161660 2023-12-19T14:00:23.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0039df0 con 0x7f87d8161660 2023-12-19T14:00:23.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.757+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0043620 con 0x7f87d8161660 2023-12-19T14:00:23.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.758+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d815d340 con 0x7f87d8161660 2023-12-19T14:00:23.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.758+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d815d900 con 0x7f87d8161660 2023-12-19T14:00:23.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.759+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d8061910 con 0x7f87d8161660 2023-12-19T14:00:23.759 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.760+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87c0043780 con 0x7f87d8161660 2023-12-19T14:00:23.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.760+0000 7f87d57fa640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87b806a430 0x7f87b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:23.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.760+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f87c003e070 con 0x7f87d8161660 2023-12-19T14:00:23.760 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.761+0000 7f87d7fff640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87b806a430 0x7f87b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:23.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.761+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f87b8071fc0 con 0x7f87d8161660 2023-12-19T14:00:23.761 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.761+0000 7f87d7fff640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87b806a430 0x7f87b806c8f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f87c8000f60 tx=0x7f87c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:23.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.765+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87c0077000 con 0x7f87d8161660 2023-12-19T14:00:23.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.954+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87d80cb720 con 0x7f87d8161660 2023-12-19T14:00:23.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.955+0000 7f87d57fa640 1 -- 172.21.15.113:0/417627272 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v201) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87c0034020 con 0x7f87d8161660 2023-12-19T14:00:23.955 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87b806a430 msgr2=0x7f87b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87b806a430 0x7f87b806c8f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f87c8000f60 tx=0x7f87c8009040 comp rx=0 tx=0).stop 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d8161660 msgr2=0x7f87d8158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d8161660 0x7f87d8158a90 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009870 tx=0x7f87c0004730 comp rx=0 tx=0).stop 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 shutdown_connections 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f87b806a430 0x7f87b806c8f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d8161a40 0x7f87d806f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f87d8161660 0x7f87d8158a90 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 --2- 172.21.15.113:0/417627272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d80afa50 0x7f87d81648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.957+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 >> 172.21.15.113:0/417627272 conn(0x7f87d80cbb70 msgr2=0x7f87d815bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.958+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 shutdown_connections 2023-12-19T14:00:23.958 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:23.958+0000 7f87de821640 1 -- 172.21.15.113:0/417627272 wait complete. 2023-12-19T14:00:23.976 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T14:00:24.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.194+0000 7f0193d0a640 1 Processor -- start 2023-12-19T14:00:24.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.194+0000 7f0193d0a640 1 -- start start 2023-12-19T14:00:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f0193d0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c15b1d0 0x7f018c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f0193d0a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f018c0b1ec0 0x7f018c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f0193d0a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018c15ef10 con 0x7f018c0ceea0 2023-12-19T14:00:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f0193d0a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018c0b2320 con 0x7f018c0b1ec0 2023-12-19T14:00:24.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f0193d0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c0b2e40 con 0x7f018c15b1d0 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f01912a5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f018c0b1ec0 0x7f018c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f01912a5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f018c0b1ec0 0x7f018c15f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50770/0 (socket says 172.21.15.113:50770) 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.196+0000 7f01912a5640 1 -- 172.21.15.113:0/4054005559 learned_addr learned my addr 172.21.15.113:0/4054005559 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.197+0000 7f0191aa6640 1 --2- 172.21.15.113:0/4054005559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c15b1d0 0x7f018c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.197+0000 7f01912a5640 1 -- 172.21.15.113:0/4054005559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c15b1d0 msgr2=0x7f018c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.197+0000 7f01912a5640 1 --2- 172.21.15.113:0/4054005559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c15b1d0 0x7f018c0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.197+0000 7f01912a5640 1 -- 172.21.15.113:0/4054005559 >> v1:172.21.15.113:6789/0 conn(0x7f018c0ceea0 legacy=0x7f018c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:24.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.197+0000 7f01912a5640 1 -- 172.21.15.113:0/4054005559 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c0b3120 con 0x7f018c0b1ec0 2023-12-19T14:00:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.198+0000 7f01912a5640 1 --2- 172.21.15.113:0/4054005559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c15f6d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f017c009870 tx=0x7f017c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86f3dadbcbbaf44 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.198+0000 7f0190aa4640 1 -- 172.21.15.113:0/4054005559 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c030840 con 0x7f018c0b1ec0 2023-12-19T14:00:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.198+0000 7f0190aa4640 1 -- 172.21.15.113:0/4054005559 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c0309a0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.198+0000 7f0190aa4640 1 -- 172.21.15.113:0/4054005559 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c030d30 con 0x7f018c0b1ec0 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 -- 172.21.15.113:0/4054005559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 msgr2=0x7f018c15f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 --2- 172.21.15.113:0/4054005559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c15f6d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f017c009870 tx=0x7f017c02b980 comp rx=0 tx=0).stop 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 -- 172.21.15.113:0/4054005559 shutdown_connections 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 --2- 172.21.15.113:0/4054005559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c15f6d0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 --2- 172.21.15.113:0/4054005559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c15b1d0 0x7f018c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 -- 172.21.15.113:0/4054005559 >> 172.21.15.113:0/4054005559 conn(0x7f018c073150 msgr2=0x7f018c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 -- 172.21.15.113:0/4054005559 shutdown_connections 2023-12-19T14:00:24.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.199+0000 7f0193d0a640 1 -- 172.21.15.113:0/4054005559 wait complete. 2023-12-19T14:00:24.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.201+0000 7f0193d0a640 1 Processor -- start 2023-12-19T14:00:24.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.201+0000 7f0193d0a640 1 -- start start 2023-12-19T14:00:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0193d0a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0193d0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ceea0 0x7f018c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0193d0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c15b1d0 0x7f018c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0193d0a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c14b1f0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0193d0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c0cc2e0 con 0x7f018c15b1d0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0193d0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c0cc5c0 con 0x7f018c0ceea0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0191aa6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0191aa6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c1472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50776/0 (socket says 172.21.15.113:50776) 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.202+0000 7f0191aa6640 1 -- 172.21.15.113:0/1071520538 learned_addr learned my addr 172.21.15.113:0/1071520538 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f01912a5640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ceea0 0x7f018c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0191aa6640 1 -- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ceea0 msgr2=0x7f018c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0191aa6640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ceea0 0x7f018c0cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f01922a7640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c15b1d0 0x7f018c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0191aa6640 1 -- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c15b1d0 msgr2=0x7f018c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0191aa6640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c15b1d0 0x7f018c15daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0191aa6640 1 -- 172.21.15.113:0/1071520538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0094d0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f01922a7640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c15b1d0 0x7f018c15daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0191aa6640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c1472d0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f018800c7f0 tx=0x7f018800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188004220 con 0x7f018c0b1ec0 2023-12-19T14:00:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01880043a0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018c0cc8a0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188007860 con 0x7f018c0b1ec0 2023-12-19T14:00:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.203+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018c0cbef0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.204+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018c061910 con 0x7f018c0b1ec0 2023-12-19T14:00:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.205+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0188007bd0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.206+0000 7f01827fc640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f017006a430 0x7f017006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.206+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0188088900 con 0x7f018c0b1ec0 2023-12-19T14:00:24.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.206+0000 7f01912a5640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f017006a430 0x7f017006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.207 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.207+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f0170071fc0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.208 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.207+0000 7f01912a5640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f017006a430 0x7f017006c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f017c036000 tx=0x7f017c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.211+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f018801e020 con 0x7f018c0b1ec0 2023-12-19T14:00:24.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.401+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f018c0cdc90 con 0x7f018c0b1ec0 2023-12-19T14:00:24.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.401+0000 7f01827fc640 1 -- 172.21.15.113:0/1071520538 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v201) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0188053ec0 con 0x7f018c0b1ec0 2023-12-19T14:00:24.401 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f017006a430 msgr2=0x7f017006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f017006a430 0x7f017006c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f017c036000 tx=0x7f017c03b040 comp rx=0 tx=0).stop 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 msgr2=0x7f018c1472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c1472d0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f018800c7f0 tx=0x7f018800ccb0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 shutdown_connections 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f017006a430 0x7f017006c8f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c15b1d0 0x7f018c15daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ceea0 0x7f018c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 --2- 172.21.15.113:0/1071520538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f018c0b1ec0 0x7f018c1472d0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 >> 172.21.15.113:0/1071520538 conn(0x7f018c073150 msgr2=0x7f018c1588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 shutdown_connections 2023-12-19T14:00:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.404+0000 7f0193d0a640 1 -- 172.21.15.113:0/1071520538 wait complete. 2023-12-19T14:00:24.424 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T14:00:24.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.633+0000 7f47ae173640 1 Processor -- start 2023-12-19T14:00:24.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.633+0000 7f47ae173640 1 -- start start 2023-12-19T14:00:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.634+0000 7f47ae173640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f47a8157dc0 0x7f47a80ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.634+0000 7f47ae173640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f47a80ab800 0x7f47a806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.634+0000 7f47ae173640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a8161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.634+0000 7f47ae173640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80a91b0 con 0x7f47a80ab800 2023-12-19T14:00:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.634+0000 7f47ae173640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80abcb0 con 0x7f47a8157dc0 2023-12-19T14:00:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.634+0000 7f47ae173640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81581a0 con 0x7f47a806f830 2023-12-19T14:00:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f47a80ab800 0x7f47a806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f47a80ab800 0x7f47a806f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50786/0 (socket says 172.21.15.113:50786) 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 -- 172.21.15.113:0/4046477433 learned_addr learned my addr 172.21.15.113:0/4046477433 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f47a77fe640 1 --2- 172.21.15.113:0/4046477433 >> v2:172.21.15.151:3300/0 conn(0x7f47a8157dc0 0x7f47a80ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f47a7fff640 1 --2- 172.21.15.113:0/4046477433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a8161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 -- 172.21.15.113:0/4046477433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 msgr2=0x7f47a8161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 --2- 172.21.15.113:0/4046477433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a8161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 -- 172.21.15.113:0/4046477433 >> v2:172.21.15.151:3300/0 conn(0x7f47a8157dc0 msgr2=0x7f47a80ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 --2- 172.21.15.113:0/4046477433 >> v2:172.21.15.151:3300/0 conn(0x7f47a8157dc0 0x7f47a80ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.635+0000 7f479ffff640 1 -- 172.21.15.113:0/4046477433 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8070050 con 0x7f47a80ab800 2023-12-19T14:00:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.636+0000 7f479ffff640 1 --2- 172.21.15.113:0/4046477433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a806f2f0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f47a8066440 tx=0x7f479002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425ffdacce8fe40b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.637+0000 7f47a6ffd640 1 -- 172.21.15.113:0/4046477433 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900317e0 con 0x7f47a80ab800 2023-12-19T14:00:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.637+0000 7f47a6ffd640 1 -- 172.21.15.113:0/4046477433 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790031940 con 0x7f47a80ab800 2023-12-19T14:00:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.637+0000 7f47a6ffd640 1 -- 172.21.15.113:0/4046477433 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790031cd0 con 0x7f47a80ab800 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.637+0000 7f47ae173640 1 -- 172.21.15.113:0/4046477433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 msgr2=0x7f47a806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.637+0000 7f47ae173640 1 --2- 172.21.15.113:0/4046477433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a806f2f0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f47a8066440 tx=0x7f479002b880 comp rx=0 tx=0).stop 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.638+0000 7f47ae173640 1 -- 172.21.15.113:0/4046477433 shutdown_connections 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.638+0000 7f47ae173640 1 --2- 172.21.15.113:0/4046477433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a8161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.638+0000 7f47ae173640 1 --2- 172.21.15.113:0/4046477433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a806f2f0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.638+0000 7f47ae173640 1 --2- 172.21.15.113:0/4046477433 >> v2:172.21.15.151:3300/0 conn(0x7f47a8157dc0 0x7f47a80ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.638+0000 7f47ae173640 1 -- 172.21.15.113:0/4046477433 >> 172.21.15.113:0/4046477433 conn(0x7f47a8065fd0 msgr2=0x7f47a80d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.638+0000 7f47ae173640 1 -- 172.21.15.113:0/4046477433 shutdown_connections 2023-12-19T14:00:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.638+0000 7f47ae173640 1 -- 172.21.15.113:0/4046477433 wait complete. 2023-12-19T14:00:24.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.639+0000 7f47ae173640 1 Processor -- start 2023-12-19T14:00:24.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.640+0000 7f47ae173640 1 -- start start 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.640+0000 7f47ae173640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a80ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.640+0000 7f47ae173640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a80ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.640+0000 7f47ae173640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a8157dc0 0x7f47a80d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.640+0000 7f47ae173640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8149fb0 con 0x7f47a80ab800 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.640+0000 7f47ae173640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80ae370 con 0x7f47a8157dc0 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.640+0000 7f47ae173640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80b06c0 con 0x7f47a806f830 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a80ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.641 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a80ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50796/0 (socket says 172.21.15.113:50796) 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 -- 172.21.15.113:0/3064911919 learned_addr learned my addr 172.21.15.113:0/3064911919 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f47a77fe640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a80ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 -- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 msgr2=0x7f47a80ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f47a7fff640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a8157dc0 0x7f47a80d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a80ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 -- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a8157dc0 msgr2=0x7f47a80d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a8157dc0 0x7f47a80d1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f479ffff640 1 -- 172.21.15.113:0/3064911919 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900094d0 con 0x7f47a80ab800 2023-12-19T14:00:24.642 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.641+0000 7f47a77fe640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a80ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.642+0000 7f479ffff640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a80ade30 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4790000c00 tx=0x7f47900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.642+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790032880 con 0x7f47a80ab800 2023-12-19T14:00:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.642+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790032a20 con 0x7f47a80ab800 2023-12-19T14:00:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.642+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790032dd0 con 0x7f47a80ab800 2023-12-19T14:00:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.642+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a80b09a0 con 0x7f47a80ab800 2023-12-19T14:00:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.642+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a80b0f60 con 0x7f47a80ab800 2023-12-19T14:00:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.643+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8074770 con 0x7f47a80ab800 2023-12-19T14:00:24.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.644+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f479004e450 con 0x7f47a80ab800 2023-12-19T14:00:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.645+0000 7f47a4ff9640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f478806a430 0x7f478806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.645+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f47900aab40 con 0x7f47a80ab800 2023-12-19T14:00:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.645+0000 7f47a77fe640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f478806a430 0x7f478806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.645+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f4788071fc0 con 0x7f47a80ab800 2023-12-19T14:00:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.646+0000 7f47a77fe640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f478806a430 0x7f478806c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4798006fd0 tx=0x7f4798008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:24.649 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.649+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4790076130 con 0x7f47a80ab800 2023-12-19T14:00:24.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.860+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47a80b1150 con 0x7f47a80ab800 2023-12-19T14:00:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.861+0000 7f47a4ff9640 1 -- 172.21.15.113:0/3064911919 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v201) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4790079750 con 0x7f47a80ab800 2023-12-19T14:00:24.861 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2023-12-19T14:00:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f478806a430 msgr2=0x7f478806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f478806a430 0x7f478806c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4798006fd0 tx=0x7f4798008040 comp rx=0 tx=0).stop 2023-12-19T14:00:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 msgr2=0x7f47a80ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a80ade30 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4790000c00 tx=0x7f47900046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 shutdown_connections 2023-12-19T14:00:24.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f478806a430 0x7f478806c8f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a8157dc0 0x7f47a80d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a80ab800 0x7f47a80ade30 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 --2- 172.21.15.113:0/3064911919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47a806f830 0x7f47a80ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 >> 172.21.15.113:0/3064911919 conn(0x7f47a8065fd0 msgr2=0x7f47a80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 shutdown_connections 2023-12-19T14:00:24.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:24.864+0000 7f47ae173640 1 -- 172.21.15.113:0/3064911919 wait complete. 2023-12-19T14:00:24.881 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T14:00:24.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:24.882 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T14:00:24.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T14:00:24.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:24.992 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T14:00:25.042 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T14:00:25.043 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:25.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T14:00:25.103 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T14:00:25.103 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:25.161 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T14:00:25.161 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T14:00:25.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.375+0000 7f08353b5640 1 Processor -- start 2023-12-19T14:00:25.375 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.375+0000 7f08353b5640 1 -- start start 2023-12-19T14:00:25.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.376+0000 7f08353b5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f08300b89a0 0x7f08300b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f08353b5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083015e1a0 con 0x7f0830161020 2023-12-19T14:00:25.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f08353b5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083015e480 con 0x7f083015da30 2023-12-19T14:00:25.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f08353b5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083015e760 con 0x7f08300b89a0 2023-12-19T14:00:25.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f082effd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0830161020 0x7f0830143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57618/0 (socket says 172.21.15.113:57618) 2023-12-19T14:00:25.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f082effd640 1 -- 172.21.15.113:0/629679831 learned_addr learned my addr 172.21.15.113:0/629679831 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:25.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f082f7fe640 1 --2- 172.21.15.113:0/629679831 >> v2:172.21.15.113:3300/0 conn(0x7f08300b89a0 0x7f08300b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f082f7fe640 1 -- 172.21.15.113:0/629679831 >> v1:172.21.15.151:6789/0 conn(0x7f083015da30 legacy=0x7f08300b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:25.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f082f7fe640 1 -- 172.21.15.113:0/629679831 >> v1:172.21.15.113:6789/0 conn(0x7f0830161020 legacy=0x7f0830143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.377+0000 7f082f7fe640 1 -- 172.21.15.113:0/629679831 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830142d10 con 0x7f08300b89a0 2023-12-19T14:00:25.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.378+0000 7f082f7fe640 1 --2- 172.21.15.113:0/629679831 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f08300b8dd0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f0828009d90 tx=0x7f082802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36275517c7ea9bc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:25.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f082dffb640 1 -- 172.21.15.113:0/629679831 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082802cc60 con 0x7f08300b89a0 2023-12-19T14:00:25.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f082dffb640 1 -- 172.21.15.113:0/629679831 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082802cdc0 con 0x7f08300b89a0 2023-12-19T14:00:25.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f082dffb640 1 -- 172.21.15.113:0/629679831 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828034660 con 0x7f08300b89a0 2023-12-19T14:00:25.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f08353b5640 1 -- 172.21.15.113:0/629679831 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 msgr2=0x7f08300b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.379 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f08353b5640 1 --2- 172.21.15.113:0/629679831 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f08300b8dd0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f0828009d90 tx=0x7f082802beb0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f08353b5640 1 -- 172.21.15.113:0/629679831 shutdown_connections 2023-12-19T14:00:25.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f08353b5640 1 --2- 172.21.15.113:0/629679831 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f08300b8dd0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f08353b5640 1 -- 172.21.15.113:0/629679831 >> 172.21.15.113:0/629679831 conn(0x7f08300b26f0 msgr2=0x7f08300b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:25.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f08353b5640 1 -- 172.21.15.113:0/629679831 shutdown_connections 2023-12-19T14:00:25.380 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.379+0000 7f08353b5640 1 -- 172.21.15.113:0/629679831 wait complete. 2023-12-19T14:00:25.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.381+0000 7f08353b5640 1 Processor -- start 2023-12-19T14:00:25.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.381+0000 7f08353b5640 1 -- start start 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.382+0000 7f08353b5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f0830158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.382+0000 7f08353b5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f083015da30 0x7f0830144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.382+0000 7f08353b5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0830161020 0x7f08300d2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.382+0000 7f08353b5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08301461e0 con 0x7f08300b89a0 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.382+0000 7f08353b5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830145320 con 0x7f0830161020 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.382+0000 7f08353b5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08301455d0 con 0x7f083015da30 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f0830158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f0830158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50806/0 (socket says 172.21.15.113:50806) 2023-12-19T14:00:25.383 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 -- 172.21.15.113:0/153026308 learned_addr learned my addr 172.21.15.113:0/153026308 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:25.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 -- 172.21.15.113:0/153026308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f083015da30 msgr2=0x7f0830144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f083015da30 0x7f0830144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 -- 172.21.15.113:0/153026308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0830161020 msgr2=0x7f08300d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0830161020 0x7f08300d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 -- 172.21.15.113:0/153026308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828009a70 con 0x7f08300b89a0 2023-12-19T14:00:25.384 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.383+0000 7f082effd640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f0830158dc0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f082000c4a0 tx=0x7f082000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:25.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.384+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820005ce0 con 0x7f08300b89a0 2023-12-19T14:00:25.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.384+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0820005e40 con 0x7f08300b89a0 2023-12-19T14:00:25.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.384+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820007270 con 0x7f08300b89a0 2023-12-19T14:00:25.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.384+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08301458b0 con 0x7f08300b89a0 2023-12-19T14:00:25.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.384+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0830145e70 con 0x7f08300b89a0 2023-12-19T14:00:25.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.385+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083015dea0 con 0x7f08300b89a0 2023-12-19T14:00:25.385 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.386+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0820007490 con 0x7f08300b89a0 2023-12-19T14:00:25.386 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.386+0000 7f08177fe640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f081c06a430 0x7f081c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.387 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.387+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0820087ed0 con 0x7f08300b89a0 2023-12-19T14:00:25.387 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.387+0000 7f082e7fc640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f081c06a430 0x7f081c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.387 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.387+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f081c071fc0 con 0x7f08300b89a0 2023-12-19T14:00:25.387 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.387+0000 7f082e7fc640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f081c06a430 0x7f081c06c8f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f08300d3310 tx=0x7f08240079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:25.391 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.391+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0820017060 con 0x7f08300b89a0 2023-12-19T14:00:25.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.621+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0830061910 con 0x7f08300b89a0 2023-12-19T14:00:25.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.622+0000 7f08177fe640 1 -- 172.21.15.113:0/153026308 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f083015dea0 con 0x7f08300b89a0 2023-12-19T14:00:25.623 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:25.623 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T14:00:25.623 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T14:00:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f081c06a430 msgr2=0x7f081c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f081c06a430 0x7f081c06c8f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f08300d3310 tx=0x7f08240079b0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 msgr2=0x7f0830158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f0830158dc0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f082000c4a0 tx=0x7f082000c960 comp rx=0 tx=0).stop 2023-12-19T14:00:25.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 shutdown_connections 2023-12-19T14:00:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f081c06a430 0x7f081c06c8f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0830161020 0x7f08300d2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f083015da30 0x7f0830144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 --2- 172.21.15.113:0/153026308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f08300b89a0 0x7f0830158dc0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 >> 172.21.15.113:0/153026308 conn(0x7f08300b26f0 msgr2=0x7f0830141e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 shutdown_connections 2023-12-19T14:00:25.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.626+0000 7f08353b5640 1 -- 172.21.15.113:0/153026308 wait complete. 2023-12-19T14:00:25.645 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T14:00:25.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.852+0000 7fd7a2501640 1 Processor -- start 2023-12-19T14:00:25.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.853+0000 7fd7a2501640 1 -- start start 2023-12-19T14:00:25.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.854+0000 7fd7a2501640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c146ef0 0x7fd79c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.854+0000 7fd7a2501640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd79c1618a0 0x7fd79c0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.854+0000 7fd7a2501640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0d2a50 con 0x7fd79c0b6710 2023-12-19T14:00:25.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.854+0000 7fd7a2501640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0cda90 con 0x7fd79c1618a0 2023-12-19T14:00:25.854 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.854+0000 7fd7a2501640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0cdca0 con 0x7fd79c146ef0 2023-12-19T14:00:25.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.855+0000 7fd79bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c146ef0 0x7fd79c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.855+0000 7fd79bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c146ef0 0x7fd79c0ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:33632/0 (socket says 172.21.15.113:33632) 2023-12-19T14:00:25.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.855+0000 7fd79bfff640 1 -- 172.21.15.113:0/3954779675 learned_addr learned my addr 172.21.15.113:0/3954779675 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:25.855 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.855+0000 7fd7a0a9e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd79c1618a0 0x7fd79c0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.856+0000 7fd79bfff640 1 -- 172.21.15.113:0/3954779675 >> v2:172.21.15.151:3300/0 conn(0x7fd79c1618a0 msgr2=0x7fd79c0b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:25.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.856+0000 7fd79bfff640 1 --2- 172.21.15.113:0/3954779675 >> v2:172.21.15.151:3300/0 conn(0x7fd79c1618a0 0x7fd79c0b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.856+0000 7fd79bfff640 1 -- 172.21.15.113:0/3954779675 >> v1:172.21.15.151:6789/0 conn(0x7fd79c0b6710 legacy=0x7fd79c161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.856 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.856+0000 7fd79bfff640 1 -- 172.21.15.113:0/3954779675 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c0cdf80 con 0x7fd79c146ef0 2023-12-19T14:00:25.857 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.857+0000 7fd79bfff640 1 --2- 172.21.15.113:0/3954779675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c146ef0 0x7fd79c0ce4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009e50 tx=0x7fd78c02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473c2744df7cb6f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:25.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.858+0000 7fd79b7fe640 1 -- 172.21.15.113:0/3954779675 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c02c9e0 con 0x7fd79c146ef0 2023-12-19T14:00:25.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.858+0000 7fd79b7fe640 1 -- 172.21.15.113:0/3954779675 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c02cb40 con 0x7fd79c146ef0 2023-12-19T14:00:25.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.858+0000 7fd79b7fe640 1 -- 172.21.15.113:0/3954779675 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0343f0 con 0x7fd79c146ef0 2023-12-19T14:00:25.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.858+0000 7fd7a2501640 1 -- 172.21.15.113:0/3954779675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c146ef0 msgr2=0x7fd79c0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.858+0000 7fd7a2501640 1 --2- 172.21.15.113:0/3954779675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c146ef0 0x7fd79c0ce4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009e50 tx=0x7fd78c02be40 comp rx=0 tx=0).stop 2023-12-19T14:00:25.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.859+0000 7fd7a2501640 1 -- 172.21.15.113:0/3954779675 shutdown_connections 2023-12-19T14:00:25.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.859+0000 7fd7a2501640 1 --2- 172.21.15.113:0/3954779675 >> v2:172.21.15.151:3300/0 conn(0x7fd79c1618a0 0x7fd79c0b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.859+0000 7fd7a2501640 1 --2- 172.21.15.113:0/3954779675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c146ef0 0x7fd79c0ce4a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.859+0000 7fd7a2501640 1 -- 172.21.15.113:0/3954779675 >> 172.21.15.113:0/3954779675 conn(0x7fd79c0b29c0 msgr2=0x7fd79c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:25.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.859+0000 7fd7a2501640 1 -- 172.21.15.113:0/3954779675 shutdown_connections 2023-12-19T14:00:25.859 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.859+0000 7fd7a2501640 1 -- 172.21.15.113:0/3954779675 wait complete. 2023-12-19T14:00:25.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.860+0000 7fd7a2501640 1 Processor -- start 2023-12-19T14:00:25.860 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.861+0000 7fd7a2501640 1 -- start start 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.861+0000 7fd7a2501640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd79c0b6710 0x7fd79c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.861+0000 7fd7a2501640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79c146ef0 0x7fd79c160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.861+0000 7fd7a2501640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c1618a0 0x7fd79c1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.861+0000 7fd7a2501640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c15ffd0 con 0x7fd79c0b6710 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.861+0000 7fd7a2501640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c15f6e0 con 0x7fd79c146ef0 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.861+0000 7fd7a2501640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c15f980 con 0x7fd79c1618a0 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd79c0b6710 0x7fd79c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd79c0b6710 0x7fd79c15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50810/0 (socket says 172.21.15.113:50810) 2023-12-19T14:00:25.862 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 -- 172.21.15.113:0/2731444211 learned_addr learned my addr 172.21.15.113:0/2731444211 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd7937fe640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79c146ef0 0x7fd79c160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd7a0a9e640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c1618a0 0x7fd79c1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 -- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c1618a0 msgr2=0x7fd79c1f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c1618a0 0x7fd79c1f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 -- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79c146ef0 msgr2=0x7fd79c160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79c146ef0 0x7fd79c160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.862+0000 7fd79bfff640 1 -- 172.21.15.113:0/2731444211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c009b30 con 0x7fd79c0b6710 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.863+0000 7fd79bfff640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd79c0b6710 0x7fd79c15c160 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fd78c000f80 tx=0x7fd78c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.863+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c03e450 con 0x7fd79c0b6710 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.863+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c03e5b0 con 0x7fd79c0b6710 2023-12-19T14:00:25.864 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.863+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c03e960 con 0x7fd79c0b6710 2023-12-19T14:00:25.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.863+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c15fc60 con 0x7fd79c0b6710 2023-12-19T14:00:25.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.863+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c1609a0 con 0x7fd79c0b6710 2023-12-19T14:00:25.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.864+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c061910 con 0x7fd79c0b6710 2023-12-19T14:00:25.865 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.865+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd78c03eac0 con 0x7fd79c0b6710 2023-12-19T14:00:25.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.866+0000 7fd7997fa640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd77c06a430 0x7fd77c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:25.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.866+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd78c0ab700 con 0x7fd79c0b6710 2023-12-19T14:00:25.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.867+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7fd77c071fc0 con 0x7fd79c0b6710 2023-12-19T14:00:25.866 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.867+0000 7fd7937fe640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd77c06a430 0x7fd77c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:25.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.867+0000 7fd7937fe640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd77c06a430 0x7fd77c06c8f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd79c13e610 tx=0x7fd784009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:25.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:25.871+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd78c076ce0 con 0x7fd79c0b6710 2023-12-19T14:00:26.064 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.064+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd79c0b8e00 con 0x7fd79c0b6710 2023-12-19T14:00:26.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.067+0000 7fd7997fa640 1 -- 172.21.15.113:0/2731444211 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+16236 (secure 0 0 0) 0x7fd78c043020 con 0x7fd79c0b6710 2023-12-19T14:00:26.067 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:26.067 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":201,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T14:00:23.719473+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.26","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T14:00:26.069 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd77c06a430 msgr2=0x7fd77c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd77c06a430 0x7fd77c06c8f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd79c13e610 tx=0x7fd784009040 comp rx=0 tx=0).stop 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd79c0b6710 msgr2=0x7fd79c15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd79c0b6710 0x7fd79c15c160 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fd78c000f80 tx=0x7fd78c004a40 comp rx=0 tx=0).stop 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 shutdown_connections 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd77c06a430 0x7fd77c06c8f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd79c1618a0 0x7fd79c1f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79c146ef0 0x7fd79c160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 --2- 172.21.15.113:0/2731444211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd79c0b6710 0x7fd79c15c160 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.069+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 >> 172.21.15.113:0/2731444211 conn(0x7fd79c0b29c0 msgr2=0x7fd79c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.070+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 shutdown_connections 2023-12-19T14:00:26.070 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.070+0000 7fd7a2501640 1 -- 172.21.15.113:0/2731444211 wait complete. 2023-12-19T14:00:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:46:20.490857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:59:38.845347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:59:40.229435+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T14:00:26.088 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T14:00:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.303+0000 7f0ebd5f6640 1 Processor -- start 2023-12-19T14:00:26.303 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.303+0000 7f0ebd5f6640 1 -- start start 2023-12-19T14:00:26.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.304+0000 7f0ebd5f6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0eb815b1d0 0x7f0eb80b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.304+0000 7f0ebd5f6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb815fde0 con 0x7f0eb80b1ec0 2023-12-19T14:00:26.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.304+0000 7f0ebd5f6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb815ef10 con 0x7f0eb80ceea0 2023-12-19T14:00:26.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.304+0000 7f0ebd5f6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80b2320 con 0x7f0eb815b1d0 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.305+0000 7f0eaffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0eb80b1ec0 0x7f0eb815f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57628/0 (socket says 172.21.15.113:57628) 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.305+0000 7f0eaffff640 1 -- 172.21.15.113:0/3511502888 learned_addr learned my addr 172.21.15.113:0/3511502888 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.305+0000 7f0eb6ffd640 1 --2- 172.21.15.113:0/3511502888 >> v2:172.21.15.151:3300/0 conn(0x7f0eb815b1d0 0x7f0eb80b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.305+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475554601 0 0) 0x7f0eb815fde0 con 0x7f0eb80b1ec0 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.305+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea4003520 con 0x7f0eb80b1ec0 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309621585 0 0) 0x7f0ea4003520 con 0x7f0eb80b1ec0 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 >> v2:172.21.15.151:3300/0 conn(0x7f0eb815b1d0 msgr2=0x7f0eb80b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 --2- 172.21.15.113:0/3511502888 >> v2:172.21.15.151:3300/0 conn(0x7f0eb815b1d0 0x7f0eb80b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 >> v1:172.21.15.151:6789/0 conn(0x7f0eb80ceea0 legacy=0x7f0eb806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80b2e40 con 0x7f0eb80b1ec0 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0ea0001670 con 0x7f0eb80b1ec0 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 >> v1:172.21.15.113:6789/0 conn(0x7f0eb80b1ec0 legacy=0x7f0eb815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea4003a30 0x7f0ea4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea40047c0 0x7f0ea4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea40051d0 0x7f0ea400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b2320 con 0x7f0ea40047c0 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea400c100 con 0x7f0ea40051d0 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea400c2c0 con 0x7f0ea4003a30 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.306+0000 7f0eaffff640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea40047c0 0x7f0ea4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eaffff640 1 -- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea4003a30 msgr2=0x7f0ea4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eb6ffd640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea4003a30 0x7f0ea4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eb77fe640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea40051d0 0x7f0ea400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eaffff640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea4003a30 0x7f0ea4003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eaffff640 1 -- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea40051d0 msgr2=0x7f0ea400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eaffff640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea40051d0 0x7f0ea400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eaffff640 1 -- 172.21.15.113:0/3511502888 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4003520 con 0x7f0ea40047c0 2023-12-19T14:00:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eb77fe640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea40051d0 0x7f0ea400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:26.309 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.307+0000 7f0eb77fe640 1 -- 172.21.15.113:0/3511502888 reap_dead start 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.308+0000 7f0eaffff640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea40047c0 0x7f0ea4004c40 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000c0e0 tx=0x7f0ea40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912aa882ca921f51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.308+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0005ad0 con 0x7f0ea40047c0 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.308+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0005c30 con 0x7f0ea40047c0 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.308+0000 7f0eb67fc640 1 -- 172.21.15.113:0/3511502888 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea002c7d0 con 0x7f0ea40047c0 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.308+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/3511502888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea40047c0 msgr2=0x7f0ea4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.308+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea40047c0 0x7f0ea4004c40 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000c0e0 tx=0x7f0ea40057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.309+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/3511502888 shutdown_connections 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.309+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/3511502888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea40047c0 0x7f0ea4004c40 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.309+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/3511502888 >> 172.21.15.113:0/3511502888 conn(0x7f0eb8073150 msgr2=0x7f0eb80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.309+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/3511502888 shutdown_connections 2023-12-19T14:00:26.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.309+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/3511502888 wait complete. 2023-12-19T14:00:26.311 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.310+0000 7f0ebd5f6640 1 Processor -- start 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.311+0000 7f0ebd5f6640 1 -- start start 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.311+0000 7f0ebd5f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea40047c0 0x7f0eb81f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.311+0000 7f0ebd5f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eb8145a10 0x7f0eb815da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.311+0000 7f0ebd5f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0eb80b0270 0x7f0eb80b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.311+0000 7f0ebd5f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b0c60 con 0x7f0eb80b0270 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.311+0000 7f0ebd5f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815dfa0 con 0x7f0eb8145a10 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.311+0000 7f0ebd5f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815e4c0 con 0x7f0ea40047c0 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0eb80b0270 0x7f0eb80b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0eb80b0270 0x7f0eb80b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50834/0 (socket says 172.21.15.113:50834) 2023-12-19T14:00:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 -- 172.21.15.113:0/1068491596 learned_addr learned my addr 172.21.15.113:0/1068491596 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:26.313 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb6ffd640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea40047c0 0x7f0eb81f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 -- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea40047c0 msgr2=0x7f0eb81f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea40047c0 0x7f0eb81f4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eaffff640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eb8145a10 0x7f0eb815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 -- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eb8145a10 msgr2=0x7f0eb815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eb8145a10 0x7f0eb815da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 -- 172.21.15.113:0/1068491596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb8145e90 con 0x7f0eb80b0270 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.312+0000 7f0eb77fe640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0eb80b0270 0x7f0eb80b0720 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f0eb806e8e0 tx=0x7f0eb000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.313+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0003d80 con 0x7f0eb80b0270 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.313+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0005070 con 0x7f0eb80b0270 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.313+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb815e1e0 con 0x7f0eb80b0270 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.313+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0005420 con 0x7f0eb80b0270 2023-12-19T14:00:26.314 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.313+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb815b930 con 0x7f0eb80b0270 2023-12-19T14:00:26.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.314+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb8061910 con 0x7f0eb80b0270 2023-12-19T14:00:26.315 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.315+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0eb0005580 con 0x7f0eb80b0270 2023-12-19T14:00:26.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.316+0000 7f0eaf7fe640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0e9806a460 0x7f0e9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.316+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0eb0088100 con 0x7f0eb80b0270 2023-12-19T14:00:26.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.316+0000 7f0eb6ffd640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0e9806a460 0x7f0e9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.316+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f0e98071ff0 con 0x7f0eb80b0270 2023-12-19T14:00:26.316 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.317+0000 7f0eb6ffd640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0e9806a460 0x7f0e9806c920 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009990 tx=0x7f0ea8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:26.320 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.320+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0eb0018060 con 0x7f0eb80b0270 2023-12-19T14:00:26.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.512+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0eb80cdc90 con 0x7f0eb80b0270 2023-12-19T14:00:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.513+0000 7f0eaf7fe640 1 -- 172.21.15.113:0/1068491596 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v201) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0eb00536d0 con 0x7f0eb80b0270 2023-12-19T14:00:26.513 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2023-12-19T14:00:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.515+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0e9806a460 msgr2=0x7f0e9806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.515+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0e9806a460 0x7f0e9806c920 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009990 tx=0x7f0ea8008040 comp rx=0 tx=0).stop 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.515+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0eb80b0270 msgr2=0x7f0eb80b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.515+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0eb80b0270 0x7f0eb80b0720 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f0eb806e8e0 tx=0x7f0eb000d9d0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 shutdown_connections 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f0e9806a460 0x7f0e9806c920 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0eb80b0270 0x7f0eb80b0720 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eb8145a10 0x7f0eb815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 --2- 172.21.15.113:0/1068491596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea40047c0 0x7f0eb81f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 >> 172.21.15.113:0/1068491596 conn(0x7f0eb8073150 msgr2=0x7f0eb80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 shutdown_connections 2023-12-19T14:00:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.516+0000 7f0ebd5f6640 1 -- 172.21.15.113:0/1068491596 wait complete. 2023-12-19T14:00:26.535 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T14:00:26.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.738+0000 7fbf7c9b8640 1 Processor -- start 2023-12-19T14:00:26.739 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.739+0000 7fbf7c9b8640 1 -- start start 2023-12-19T14:00:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.740+0000 7fbf7c9b8640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbf78146cf0 0x7fbf78071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.740+0000 7fbf7c9b8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf780b7360 0x7fbf780b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.740+0000 7fbf7c9b8640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf78070e00 con 0x7fbf78161980 2023-12-19T14:00:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.740+0000 7fbf7c9b8640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780d2d20 con 0x7fbf78146cf0 2023-12-19T14:00:26.740 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.740+0000 7fbf7c9b8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780b7d30 con 0x7fbf780b7360 2023-12-19T14:00:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.741+0000 7fbf76d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbf78146cf0 0x7fbf78071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.741+0000 7fbf76d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbf78146cf0 0x7fbf78071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:44336/0 (socket says 172.21.15.113:44336) 2023-12-19T14:00:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.741+0000 7fbf76d9d640 1 -- 172.21.15.113:0/1447677198 learned_addr learned my addr 172.21.15.113:0/1447677198 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:26.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.741+0000 7fbf7759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf780b7360 0x7fbf780b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.742+0000 7fbf76d9d640 1 -- 172.21.15.113:0/1447677198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf780b7360 msgr2=0x7fbf780b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:26.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.742+0000 7fbf76d9d640 1 --2- 172.21.15.113:0/1447677198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf780b7360 0x7fbf780b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.742+0000 7fbf76d9d640 1 -- 172.21.15.113:0/1447677198 >> v1:172.21.15.151:6789/0 conn(0x7fbf78161980 legacy=0x7fbf780d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.742+0000 7fbf76d9d640 1 -- 172.21.15.113:0/1447677198 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf78070540 con 0x7fbf78146cf0 2023-12-19T14:00:26.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.743+0000 7fbf76d9d640 1 --2- 172.21.15.113:0/1447677198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf78146cf0 0x7fbf78071290 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009870 tx=0x7fbf6802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=563d5ee6554ec130 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:26.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.743+0000 7fbf7659c640 1 -- 172.21.15.113:0/1447677198 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68030840 con 0x7fbf78146cf0 2023-12-19T14:00:26.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7659c640 1 -- 172.21.15.113:0/1447677198 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680309a0 con 0x7fbf78146cf0 2023-12-19T14:00:26.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7659c640 1 -- 172.21.15.113:0/1447677198 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68030d30 con 0x7fbf78146cf0 2023-12-19T14:00:26.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/1447677198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf78146cf0 msgr2=0x7fbf78071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/1447677198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf78146cf0 0x7fbf78071290 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009870 tx=0x7fbf6802b980 comp rx=0 tx=0).stop 2023-12-19T14:00:26.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/1447677198 shutdown_connections 2023-12-19T14:00:26.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/1447677198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf780b7360 0x7fbf780b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/1447677198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf78146cf0 0x7fbf78071290 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/1447677198 >> 172.21.15.113:0/1447677198 conn(0x7fbf780d31b0 msgr2=0x7fbf780d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:26.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/1447677198 shutdown_connections 2023-12-19T14:00:26.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.744+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/1447677198 wait complete. 2023-12-19T14:00:26.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.746+0000 7fbf7c9b8640 1 Processor -- start 2023-12-19T14:00:26.746 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.746+0000 7fbf7c9b8640 1 -- start start 2023-12-19T14:00:26.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.747+0000 7fbf7c9b8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf780b7360 0x7fbf78152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.747+0000 7fbf7c9b8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf78146cf0 0x7fbf780c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.747+0000 7fbf7c9b8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf78161980 0x7fbf780c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.747+0000 7fbf7c9b8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780c95b0 con 0x7fbf78146cf0 2023-12-19T14:00:26.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.747+0000 7fbf7c9b8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780c8930 con 0x7fbf780b7360 2023-12-19T14:00:26.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.747+0000 7fbf7c9b8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780c8c10 con 0x7fbf78161980 2023-12-19T14:00:26.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.747+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf78146cf0 0x7fbf780c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf78146cf0 0x7fbf780c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50838/0 (socket says 172.21.15.113:50838) 2023-12-19T14:00:26.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 -- 172.21.15.113:0/2829383524 learned_addr learned my addr 172.21.15.113:0/2829383524 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf7759e640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf78161980 0x7fbf780c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf76d9d640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf780b7360 0x7fbf78152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 -- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf78161980 msgr2=0x7fbf780c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf78161980 0x7fbf780c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 -- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf780b7360 msgr2=0x7fbf78152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf780b7360 0x7fbf78152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 -- 172.21.15.113:0/2829383524 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680094d0 con 0x7fbf78146cf0 2023-12-19T14:00:26.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.748+0000 7fbf6ffff640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf78146cf0 0x7fbf780c99d0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000c3c0 tx=0x7fbf6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:26.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.749+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600052d0 con 0x7fbf78146cf0 2023-12-19T14:00:26.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.749+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf60005450 con 0x7fbf78146cf0 2023-12-19T14:00:26.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.749+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf780c8ef0 con 0x7fbf78146cf0 2023-12-19T14:00:26.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.749+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60007260 con 0x7fbf78146cf0 2023-12-19T14:00:26.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.749+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7815d450 con 0x7fbf78146cf0 2023-12-19T14:00:26.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.750+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf780c96f0 con 0x7fbf78146cf0 2023-12-19T14:00:26.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.751+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf600073c0 con 0x7fbf78146cf0 2023-12-19T14:00:26.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.752+0000 7fbf6f7fe640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf5806a430 0x7fbf5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:26.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.752+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbf60087d30 con 0x7fbf78146cf0 2023-12-19T14:00:26.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.752+0000 7fbf76d9d640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf5806a430 0x7fbf5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:26.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.752+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7fbf58071fc0 con 0x7fbf78146cf0 2023-12-19T14:00:26.752 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.753+0000 7fbf76d9d640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf5806a430 0x7fbf5806c8f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbf68036000 tx=0x7fbf68008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:26.756 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.756+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf6008d020 con 0x7fbf78146cf0 2023-12-19T14:00:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.949+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf78061910 con 0x7fbf78146cf0 2023-12-19T14:00:26.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.950+0000 7fbf6f7fe640 1 -- 172.21.15.113:0/2829383524 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v201) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf600532f0 con 0x7fbf78146cf0 2023-12-19T14:00:26.951 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2023-12-19T14:00:26.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.952+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf5806a430 msgr2=0x7fbf5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.953 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.952+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf5806a430 0x7fbf5806c8f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbf68036000 tx=0x7fbf68008030 comp rx=0 tx=0).stop 2023-12-19T14:00:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.952+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf78146cf0 msgr2=0x7fbf780c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.952+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf78146cf0 0x7fbf780c99d0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000c3c0 tx=0x7fbf6000c880 comp rx=0 tx=0).stop 2023-12-19T14:00:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 shutdown_connections 2023-12-19T14:00:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbf5806a430 0x7fbf5806c8f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf78161980 0x7fbf780c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.954 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf78146cf0 0x7fbf780c99d0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 --2- 172.21.15.113:0/2829383524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf780b7360 0x7fbf78152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 >> 172.21.15.113:0/2829383524 conn(0x7fbf780d31b0 msgr2=0x7fbf780b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 shutdown_connections 2023-12-19T14:00:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:26.953+0000 7fbf7c9b8640 1 -- 172.21.15.113:0/2829383524 wait complete. 2023-12-19T14:00:26.972 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T14:00:27.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.189+0000 7fb74d83e640 1 Processor -- start 2023-12-19T14:00:27.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.190+0000 7fb74d83e640 1 -- start start 2023-12-19T14:00:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.191+0000 7fb74d83e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb748146ff0 0x7fb7480d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.191+0000 7fb74d83e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb74806fc40 0x7fb74815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.191+0000 7fb74d83e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb748161e70 con 0x7fb7480b6430 2023-12-19T14:00:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.191+0000 7fb74d83e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb748161080 con 0x7fb748146ff0 2023-12-19T14:00:27.191 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.191+0000 7fb74d83e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb748161260 con 0x7fb74806fc40 2023-12-19T14:00:27.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.192+0000 7fb746ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb748146ff0 0x7fb7480d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.192+0000 7fb7477fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb74806fc40 0x7fb74815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.192+0000 7fb7477fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb74806fc40 0x7fb74815dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:33690/0 (socket says 172.21.15.113:33690) 2023-12-19T14:00:27.192 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.192+0000 7fb7477fe640 1 -- 172.21.15.113:0/2436872767 learned_addr learned my addr 172.21.15.113:0/2436872767 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.193+0000 7fb746ffd640 1 -- 172.21.15.113:0/2436872767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb74806fc40 msgr2=0x7fb74815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.193+0000 7fb746ffd640 1 --2- 172.21.15.113:0/2436872767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb74806fc40 0x7fb74815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.193+0000 7fb746ffd640 1 -- 172.21.15.113:0/2436872767 >> v1:172.21.15.151:6789/0 conn(0x7fb7480b6430 legacy=0x7fb74806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.193+0000 7fb746ffd640 1 -- 172.21.15.113:0/2436872767 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748161540 con 0x7fb748146ff0 2023-12-19T14:00:27.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.194+0000 7fb746ffd640 1 --2- 172.21.15.113:0/2436872767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480d10f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb7380097a0 tx=0x7fb73802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3119ec2e758c44d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.194+0000 7fb7467fc640 1 -- 172.21.15.113:0/2436872767 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73802d040 con 0x7fb748146ff0 2023-12-19T14:00:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.194+0000 7fb7467fc640 1 -- 172.21.15.113:0/2436872767 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738031810 con 0x7fb748146ff0 2023-12-19T14:00:27.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.194+0000 7fb7467fc640 1 -- 172.21.15.113:0/2436872767 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738031ba0 con 0x7fb748146ff0 2023-12-19T14:00:27.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 -- 172.21.15.113:0/2436872767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 msgr2=0x7fb7480d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 --2- 172.21.15.113:0/2436872767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480d10f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb7380097a0 tx=0x7fb73802b8b0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 -- 172.21.15.113:0/2436872767 shutdown_connections 2023-12-19T14:00:27.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 --2- 172.21.15.113:0/2436872767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb74806fc40 0x7fb74815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 --2- 172.21.15.113:0/2436872767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480d10f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 -- 172.21.15.113:0/2436872767 >> 172.21.15.113:0/2436872767 conn(0x7fb7480d3520 msgr2=0x7fb7480d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:27.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 -- 172.21.15.113:0/2436872767 shutdown_connections 2023-12-19T14:00:27.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.195+0000 7fb74d83e640 1 -- 172.21.15.113:0/2436872767 wait complete. 2023-12-19T14:00:27.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.197+0000 7fb74d83e640 1 Processor -- start 2023-12-19T14:00:27.197 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.197+0000 7fb74d83e640 1 -- start start 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb74d83e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb74806fc40 0x7fb74815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb74d83e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7480b6430 0x7fb7481430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb74d83e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb74d83e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480c8900 con 0x7fb74806fc40 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb74d83e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480cc4c0 con 0x7fb748146ff0 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb74d83e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480ce3d0 con 0x7fb7480b6430 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb746ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb74806fc40 0x7fb74815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb746ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb74806fc40 0x7fb74815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50844/0 (socket says 172.21.15.113:50844) 2023-12-19T14:00:27.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.198+0000 7fb746ffd640 1 -- 172.21.15.113:0/360029885 learned_addr learned my addr 172.21.15.113:0/360029885 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb746ffd640 1 -- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7480b6430 msgr2=0x7fb7481430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb746ffd640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7480b6430 0x7fb7481430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb746ffd640 1 -- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 msgr2=0x7fb7480cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb7477fe640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb746ffd640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb746ffd640 1 -- 172.21.15.113:0/360029885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738009400 con 0x7fb74806fc40 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb7477fe640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:27.200 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb746ffd640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb74806fc40 0x7fb74815cc60 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fb7380098c0 tx=0x7fb7380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:27.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73803ad60 con 0x7fb74806fc40 2023-12-19T14:00:27.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7380423f0 con 0x7fb74806fc40 2023-12-19T14:00:27.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7481437c0 con 0x7fb74806fc40 2023-12-19T14:00:27.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380427a0 con 0x7fb74806fc40 2023-12-19T14:00:27.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.199+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7480c8520 con 0x7fb74806fc40 2023-12-19T14:00:27.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.200+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb748143ce0 con 0x7fb74806fc40 2023-12-19T14:00:27.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.201+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb73804b3b0 con 0x7fb74806fc40 2023-12-19T14:00:27.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.202+0000 7fb744ff9640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb72806a430 0x7fb72806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.202+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb7380aab20 con 0x7fb74806fc40 2023-12-19T14:00:27.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.203+0000 7fb73ffff640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb72806a430 0x7fb72806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.203+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7fb728071fc0 con 0x7fb74806fc40 2023-12-19T14:00:27.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.203+0000 7fb73ffff640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb72806a430 0x7fb72806c8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb730000f60 tx=0x7fb7300079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:27.206 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.207+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb748143ce0 con 0x7fb74806fc40 2023-12-19T14:00:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.392+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb748143ce0 con 0x7fb74806fc40 2023-12-19T14:00:27.393 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.393+0000 7fb744ff9640 1 -- 172.21.15.113:0/360029885 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v201) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb748143ce0 con 0x7fb74806fc40 2023-12-19T14:00:27.393 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb72806a430 msgr2=0x7fb72806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb72806a430 0x7fb72806c8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb730000f60 tx=0x7fb7300079b0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb74806fc40 msgr2=0x7fb74815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb74806fc40 0x7fb74815cc60 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fb7380098c0 tx=0x7fb7380046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 shutdown_connections 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb72806a430 0x7fb72806c8f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748146ff0 0x7fb7480cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7480b6430 0x7fb7481430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 --2- 172.21.15.113:0/360029885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb74806fc40 0x7fb74815cc60 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.395+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 >> 172.21.15.113:0/360029885 conn(0x7fb7480d3520 msgr2=0x7fb74815ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.396+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 shutdown_connections 2023-12-19T14:00:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.396+0000 7fb74d83e640 1 -- 172.21.15.113:0/360029885 wait complete. 2023-12-19T14:00:27.414 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T14:00:27.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.628+0000 7fcc4e577640 1 Processor -- start 2023-12-19T14:00:27.628 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.628+0000 7fcc4e577640 1 -- start start 2023-12-19T14:00:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.629+0000 7fcc4e577640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcc480b0b50 0x7fcc4806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.629+0000 7fcc4e577640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc4806b590 0x7fcc4806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.629+0000 7fcc4e577640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4806bb30 con 0x7fcc481449e0 2023-12-19T14:00:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.629+0000 7fcc4e577640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480b0070 con 0x7fcc480b0b50 2023-12-19T14:00:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.629+0000 7fcc4e577640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480b0350 con 0x7fcc4806b590 2023-12-19T14:00:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc3ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcc480b0b50 0x7fcc4806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc3ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcc480b0b50 0x7fcc4806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50856/0 (socket says 172.21.15.113:50856) 2023-12-19T14:00:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc3ffff640 1 -- 172.21.15.113:0/4201711 learned_addr learned my addr 172.21.15.113:0/4201711 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc4cb14640 1 --2- 172.21.15.113:0/4201711 >> v2:172.21.15.151:3300/0 conn(0x7fcc4806b590 0x7fcc4806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc3ffff640 1 -- 172.21.15.113:0/4201711 >> v2:172.21.15.151:3300/0 conn(0x7fcc4806b590 msgr2=0x7fcc4806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc3ffff640 1 --2- 172.21.15.113:0/4201711 >> v2:172.21.15.151:3300/0 conn(0x7fcc4806b590 0x7fcc4806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc3ffff640 1 -- 172.21.15.113:0/4201711 >> v1:172.21.15.151:6789/0 conn(0x7fcc481449e0 legacy=0x7fcc480af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:27.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.630+0000 7fcc3ffff640 1 -- 172.21.15.113:0/4201711 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc480b0630 con 0x7fcc480b0b50 2023-12-19T14:00:27.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.631+0000 7fcc3ffff640 1 --2- 172.21.15.113:0/4201711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4806bfa0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fcc480b1270 tx=0x7fcc3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd903fb11c4d0d72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:27.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc477fe640 1 -- 172.21.15.113:0/4201711 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30031870 con 0x7fcc480b0b50 2023-12-19T14:00:27.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc477fe640 1 -- 172.21.15.113:0/4201711 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc300319d0 con 0x7fcc480b0b50 2023-12-19T14:00:27.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc477fe640 1 -- 172.21.15.113:0/4201711 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30031d60 con 0x7fcc480b0b50 2023-12-19T14:00:27.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc4e577640 1 -- 172.21.15.113:0/4201711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 msgr2=0x7fcc4806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc4e577640 1 --2- 172.21.15.113:0/4201711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4806bfa0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fcc480b1270 tx=0x7fcc3002b910 comp rx=0 tx=0).stop 2023-12-19T14:00:27.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc4e577640 1 -- 172.21.15.113:0/4201711 shutdown_connections 2023-12-19T14:00:27.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc4e577640 1 --2- 172.21.15.113:0/4201711 >> v2:172.21.15.151:3300/0 conn(0x7fcc4806b590 0x7fcc4806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc4e577640 1 --2- 172.21.15.113:0/4201711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4806bfa0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.632+0000 7fcc4e577640 1 -- 172.21.15.113:0/4201711 >> 172.21.15.113:0/4201711 conn(0x7fcc480cbb70 msgr2=0x7fcc480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:27.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.633+0000 7fcc4e577640 1 -- 172.21.15.113:0/4201711 shutdown_connections 2023-12-19T14:00:27.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.633+0000 7fcc4e577640 1 -- 172.21.15.113:0/4201711 wait complete. 2023-12-19T14:00:27.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.634+0000 7fcc4e577640 1 Processor -- start 2023-12-19T14:00:27.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.634+0000 7fcc4e577640 1 -- start start 2023-12-19T14:00:27.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.635+0000 7fcc4e577640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc4806b590 0x7fcc4813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.635+0000 7fcc4e577640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.635+0000 7fcc4e577640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc481449e0 0x7fcc4815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.635+0000 7fcc4e577640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4813b8e0 con 0x7fcc480b0b50 2023-12-19T14:00:27.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.635+0000 7fcc4e577640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48141220 con 0x7fcc4806b590 2023-12-19T14:00:27.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.635+0000 7fcc4e577640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48141500 con 0x7fcc481449e0 2023-12-19T14:00:27.636 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4815d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50862/0 (socket says 172.21.15.113:50862) 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 -- 172.21.15.113:0/796837181 learned_addr learned my addr 172.21.15.113:0/796837181 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc47fff640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc4806b590 0x7fcc4813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 -- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc481449e0 msgr2=0x7fcc4815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc481449e0 0x7fcc4815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 -- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc4806b590 msgr2=0x7fcc4813ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc4806b590 0x7fcc4813ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 -- 172.21.15.113:0/796837181 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300094d0 con 0x7fcc480b0b50 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc47fff640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc4806b590 0x7fcc4813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:27.637 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.636+0000 7fcc3ffff640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4815d9c0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fcc30000c00 tx=0x7fcc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:27.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.637+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3003abe0 con 0x7fcc480b0b50 2023-12-19T14:00:27.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.637+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3003ad40 con 0x7fcc480b0b50 2023-12-19T14:00:27.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.637+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30044610 con 0x7fcc480b0b50 2023-12-19T14:00:27.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.637+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc481417e0 con 0x7fcc480b0b50 2023-12-19T14:00:27.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.637+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc481405a0 con 0x7fcc480b0b50 2023-12-19T14:00:27.638 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.638+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc48061910 con 0x7fcc480b0b50 2023-12-19T14:00:27.639 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.639+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcc3004d450 con 0x7fcc480b0b50 2023-12-19T14:00:27.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.640+0000 7fcc457fa640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcc2806a430 0x7fcc2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:27.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.640+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcc3002d040 con 0x7fcc480b0b50 2023-12-19T14:00:27.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.640+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7fcc28071fc0 con 0x7fcc480b0b50 2023-12-19T14:00:27.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.640+0000 7fcc47fff640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcc2806a430 0x7fcc2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:27.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.641+0000 7fcc47fff640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcc2806a430 0x7fcc2806c8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800a830 tx=0x7fcc38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:27.644 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.644+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcc30035060 con 0x7fcc480b0b50 2023-12-19T14:00:27.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.871+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc480ae560 con 0x7fcc480b0b50 2023-12-19T14:00:27.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.872+0000 7fcc457fa640 1 -- 172.21.15.113:0/796837181 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fcc30076570 con 0x7fcc480b0b50 2023-12-19T14:00:27.872 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:27.872 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T14:00:27.873 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T14:00:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcc2806a430 msgr2=0x7fcc2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcc2806a430 0x7fcc2806c8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800a830 tx=0x7fcc38008040 comp rx=0 tx=0).stop 2023-12-19T14:00:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 msgr2=0x7fcc4815d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4815d9c0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fcc30000c00 tx=0x7fcc300046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 shutdown_connections 2023-12-19T14:00:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fcc2806a430 0x7fcc2806c8f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc481449e0 0x7fcc4815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcc480b0b50 0x7fcc4815d9c0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 --2- 172.21.15.113:0/796837181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc4806b590 0x7fcc4813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 >> 172.21.15.113:0/796837181 conn(0x7fcc480cbb70 msgr2=0x7fcc48070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 shutdown_connections 2023-12-19T14:00:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:27.875+0000 7fcc4e577640 1 -- 172.21.15.113:0/796837181 wait complete. 2023-12-19T14:00:27.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T14:00:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.096+0000 7f7a04bd0640 1 Processor -- start 2023-12-19T14:00:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.097+0000 7f7a04bd0640 1 -- start start 2023-12-19T14:00:28.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.098+0000 7f7a04bd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00161020 0x7f7a0015da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.098+0000 7f7a04bd0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a00143230 0x7f7a00143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.098+0000 7f7a04bd0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0015df70 con 0x7f7a000b63c0 2023-12-19T14:00:28.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.098+0000 7f7a04bd0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0015e1a0 con 0x7f7a00143230 2023-12-19T14:00:28.098 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.098+0000 7f7a04bd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0015e480 con 0x7f7a00161020 2023-12-19T14:00:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.099+0000 7f79fe59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00161020 0x7f7a0015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.099+0000 7f79fdd9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a00143230 0x7f7a00143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.099+0000 7f79fdd9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a00143230 0x7f7a00143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.113:37632/0 (socket says 172.21.15.113:37632) 2023-12-19T14:00:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.099+0000 7f79fdd9b640 1 -- 172.21.15.113:0/201029322 learned_addr learned my addr 172.21.15.113:0/201029322 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.099+0000 7f79fe59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00161020 0x7f7a0015da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.113:35646/0 (socket says 172.21.15.113:35646) 2023-12-19T14:00:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.100+0000 7f79fe59c640 1 -- 172.21.15.113:0/201029322 >> v2:172.21.15.151:3300/0 conn(0x7f7a00143230 msgr2=0x7f7a00143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.100+0000 7f79fe59c640 1 --2- 172.21.15.113:0/201029322 >> v2:172.21.15.151:3300/0 conn(0x7f7a00143230 0x7f7a00143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.100+0000 7f79fe59c640 1 -- 172.21.15.113:0/201029322 >> v1:172.21.15.151:6789/0 conn(0x7f7a000b63c0 legacy=0x7f7a000b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.100+0000 7f79fe59c640 1 -- 172.21.15.113:0/201029322 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0015e760 con 0x7f7a00161020 2023-12-19T14:00:28.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.101+0000 7f79fe59c640 1 --2- 172.21.15.113:0/201029322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00161020 0x7f7a0015da30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009d90 tx=0x7f79f002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4399ad47ae18f91b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:28.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f79fd59a640 1 -- 172.21.15.113:0/201029322 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f002cc60 con 0x7f7a00161020 2023-12-19T14:00:28.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f79fd59a640 1 -- 172.21.15.113:0/201029322 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f002cdc0 con 0x7f7a00161020 2023-12-19T14:00:28.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f79fd59a640 1 -- 172.21.15.113:0/201029322 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0034660 con 0x7f7a00161020 2023-12-19T14:00:28.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 -- 172.21.15.113:0/201029322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00161020 msgr2=0x7f7a0015da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.102 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/201029322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00161020 0x7f7a0015da30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009d90 tx=0x7f79f002beb0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 -- 172.21.15.113:0/201029322 shutdown_connections 2023-12-19T14:00:28.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/201029322 >> v2:172.21.15.151:3300/0 conn(0x7f7a00143230 0x7f7a00143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/201029322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00161020 0x7f7a0015da30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 -- 172.21.15.113:0/201029322 >> 172.21.15.113:0/201029322 conn(0x7f7a000b26f0 msgr2=0x7f7a000b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:28.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 -- 172.21.15.113:0/201029322 shutdown_connections 2023-12-19T14:00:28.103 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.102+0000 7f7a04bd0640 1 -- 172.21.15.113:0/201029322 wait complete. 2023-12-19T14:00:28.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.104+0000 7f7a04bd0640 1 Processor -- start 2023-12-19T14:00:28.104 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.104+0000 7f7a04bd0640 1 -- start start 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.105+0000 7f7a04bd0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a000b63c0 0x7f7a0013ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.105+0000 7f7a04bd0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00143230 0x7f7a001421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.105+0000 7f7a04bd0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161020 0x7f7a00142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.105+0000 7f7a04bd0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00158040 con 0x7f7a00161020 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.105+0000 7f7a04bd0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00158e60 con 0x7f7a000b63c0 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.105+0000 7f7a04bd0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0013d3b0 con 0x7f7a00143230 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161020 0x7f7a00142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161020 0x7f7a00142700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38502/0 (socket says 172.21.15.113:38502) 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 -- 172.21.15.113:0/3860294914 learned_addr learned my addr 172.21.15.113:0/3860294914 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:28.106 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fdd9b640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00143230 0x7f7a001421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fe59c640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a000b63c0 0x7f7a0013ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 -- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00143230 msgr2=0x7f7a001421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00143230 0x7f7a001421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 -- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a000b63c0 msgr2=0x7f7a0013ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a000b63c0 0x7f7a0013ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.107 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 -- 172.21.15.113:0/3860294914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f0009a70 con 0x7f7a00161020 2023-12-19T14:00:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.106+0000 7f79fed9d640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161020 0x7f7a00142700 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c400 tx=0x7f79f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.107+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80052d0 con 0x7f7a00161020 2023-12-19T14:00:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.107+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8005430 con 0x7f7a00161020 2023-12-19T14:00:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.107+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8003810 con 0x7f7a00161020 2023-12-19T14:00:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.107+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a00158250 con 0x7f7a00161020 2023-12-19T14:00:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.107+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a00158810 con 0x7f7a00161020 2023-12-19T14:00:28.108 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.108+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a00159010 con 0x7f7a00161020 2023-12-19T14:00:28.109 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.109+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79f8003970 con 0x7f7a00161020 2023-12-19T14:00:28.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.110+0000 7f79f6ffd640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e006a430 0x7f79e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.110+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f79f8087f90 con 0x7f7a00161020 2023-12-19T14:00:28.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.110+0000 7f79fe59c640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e006a430 0x7f79e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.110+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f79e0071fc0 con 0x7f7a00161020 2023-12-19T14:00:28.110 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.111+0000 7f79fe59c640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e006a430 0x7f79e006c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f79f0036000 tx=0x7f79f0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:28.114 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.114+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7a00159010 con 0x7f7a00161020 2023-12-19T14:00:28.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.304+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a00159010 con 0x7f7a00161020 2023-12-19T14:00:28.307 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.307+0000 7f79f6ffd640 1 -- 172.21.15.113:0/3860294914 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+16236 (secure 0 0 0) 0x7f7a00159010 con 0x7f7a00161020 2023-12-19T14:00:28.307 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:28.308 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":201,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T14:00:23.719473+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.26","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.309+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e006a430 msgr2=0x7f79e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.309+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e006a430 0x7f79e006c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f79f0036000 tx=0x7f79f0030000 comp rx=0 tx=0).stop 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.309+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161020 msgr2=0x7f7a00142700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.309+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161020 0x7f7a00142700 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c400 tx=0x7f79f800c8c0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 shutdown_connections 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f79e006a430 0x7f79e006c8f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a00161020 0x7f7a00142700 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a00143230 0x7f7a001421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 --2- 172.21.15.113:0/3860294914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a000b63c0 0x7f7a0013ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 >> 172.21.15.113:0/3860294914 conn(0x7f7a000b26f0 msgr2=0x7f7a00141790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 shutdown_connections 2023-12-19T14:00:28.310 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.310+0000 7f7a04bd0640 1 -- 172.21.15.113:0/3860294914 wait complete. 2023-12-19T14:00:28.327 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T14:00:28.328 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T14:00:28.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.539+0000 7f992d465640 1 Processor -- start 2023-12-19T14:00:28.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.539+0000 7f992d465640 1 -- start start 2023-12-19T14:00:28.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.540+0000 7f992d465640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f992815aa70 0x7f9928164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.540+0000 7f992d465640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992806b520 con 0x7f9928159f80 2023-12-19T14:00:28.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.540+0000 7f992d465640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280b2b20 con 0x7f992815b1e0 2023-12-19T14:00:28.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.540+0000 7f992d465640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99280b2fb0 con 0x7f992815aa70 2023-12-19T14:00:28.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f9927fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9928159f80 0x7f992806f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54938/0 (socket says 172.21.15.113:54938) 2023-12-19T14:00:28.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f9927fff640 1 -- 172.21.15.113:0/3003871174 learned_addr learned my addr 172.21.15.113:0/3003871174 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:28.541 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f992cc64640 1 --2- 172.21.15.113:0/3003871174 >> v2:172.21.15.113:3300/0 conn(0x7f992815aa70 0x7f9928164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f99277fe640 1 -- 172.21.15.113:0/3003871174 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305444896 0 0) 0x7f992806b520 con 0x7f9928159f80 2023-12-19T14:00:28.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f99277fe640 1 -- 172.21.15.113:0/3003871174 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9914003520 con 0x7f9928159f80 2023-12-19T14:00:28.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f992cc64640 1 -- 172.21.15.113:0/3003871174 >> v1:172.21.15.151:6789/0 conn(0x7f992815b1e0 legacy=0x7f992815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:28.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f992cc64640 1 -- 172.21.15.113:0/3003871174 >> v1:172.21.15.113:6789/0 conn(0x7f9928159f80 legacy=0x7f992806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.542 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.541+0000 7f992cc64640 1 -- 172.21.15.113:0/3003871174 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280b1f10 con 0x7f992815aa70 2023-12-19T14:00:28.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.542+0000 7f992cc64640 1 --2- 172.21.15.113:0/3003871174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f992815aa70 0x7f9928164f30 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f9920009d90 tx=0x7f992002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99759cb10b30471e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:28.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f99277fe640 1 -- 172.21.15.113:0/3003871174 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992002ccf0 con 0x7f992815aa70 2023-12-19T14:00:28.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f99277fe640 1 -- 172.21.15.113:0/3003871174 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992002ce50 con 0x7f992815aa70 2023-12-19T14:00:28.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f99277fe640 1 -- 172.21.15.113:0/3003871174 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920034660 con 0x7f992815aa70 2023-12-19T14:00:28.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f992d465640 1 -- 172.21.15.113:0/3003871174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f992815aa70 msgr2=0x7f9928164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f992d465640 1 --2- 172.21.15.113:0/3003871174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f992815aa70 0x7f9928164f30 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f9920009d90 tx=0x7f992002bf40 comp rx=0 tx=0).stop 2023-12-19T14:00:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f992d465640 1 -- 172.21.15.113:0/3003871174 shutdown_connections 2023-12-19T14:00:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f992d465640 1 --2- 172.21.15.113:0/3003871174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f992815aa70 0x7f9928164f30 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f992d465640 1 -- 172.21.15.113:0/3003871174 >> 172.21.15.113:0/3003871174 conn(0x7f99280b0100 msgr2=0x7f99280b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.543+0000 7f992d465640 1 -- 172.21.15.113:0/3003871174 shutdown_connections 2023-12-19T14:00:28.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.544+0000 7f992d465640 1 -- 172.21.15.113:0/3003871174 wait complete. 2023-12-19T14:00:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.545+0000 7f992d465640 1 Processor -- start 2023-12-19T14:00:28.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.545+0000 7f992d465640 1 -- start start 2023-12-19T14:00:28.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f992d465640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9928159f80 0x7f99281506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f992d465640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992815aa70 0x7f9928151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f992d465640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992815b1e0 0x7f992806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f992d465640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992814fc40 con 0x7f9928159f80 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f992d465640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992806c0a0 con 0x7f992815b1e0 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f992d465640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992814fee0 con 0x7f992815aa70 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f9927fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9928159f80 0x7f99281506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f9927fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9928159f80 0x7f99281506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38518/0 (socket says 172.21.15.113:38518) 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.546+0000 7f9927fff640 1 -- 172.21.15.113:0/4237855966 learned_addr learned my addr 172.21.15.113:0/4237855966 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f9927fff640 1 -- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992815aa70 msgr2=0x7f9928151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f9927fff640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992815aa70 0x7f9928151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f9927fff640 1 -- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992815b1e0 msgr2=0x7f992806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f992cc64640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992815b1e0 0x7f992806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f9927fff640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992815b1e0 0x7f992806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f9927fff640 1 -- 172.21.15.113:0/4237855966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920009a70 con 0x7f9928159f80 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f992cc64640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992815b1e0 0x7f992806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f9927fff640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9928159f80 0x7f99281506e0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f991800c500 tx=0x7f991800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918005ce0 con 0x7f9928159f80 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918005e40 con 0x7f9928159f80 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918007330 con 0x7f9928159f80 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.547+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99281501c0 con 0x7f9928159f80 2023-12-19T14:00:28.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.548+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9928150c20 con 0x7f9928159f80 2023-12-19T14:00:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.549+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9928150400 con 0x7f9928159f80 2023-12-19T14:00:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.550+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9918007490 con 0x7f9928159f80 2023-12-19T14:00:28.550 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.551+0000 7f99257fa640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f990806a430 0x7f990806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:28.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.551+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9918088060 con 0x7f9928159f80 2023-12-19T14:00:28.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.551+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f9908071fc0 con 0x7f9928159f80 2023-12-19T14:00:28.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.551+0000 7f991ffff640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f990806a430 0x7f990806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:28.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.551+0000 7f991ffff640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f990806a430 0x7f990806c8f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9910006fd0 tx=0x7f9910006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:28.555 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.555+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f99180bac80 con 0x7f9928159f80 2023-12-19T14:00:28.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.787+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99280ce720 con 0x7f9928159f80 2023-12-19T14:00:28.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.788+0000 7f99257fa640 1 -- 172.21.15.113:0/4237855966 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f9918017060 con 0x7f9928159f80 2023-12-19T14:00:28.789 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:28.789 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T14:00:28.789 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T14:00:28.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f990806a430 msgr2=0x7f990806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f990806a430 0x7f990806c8f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9910006fd0 tx=0x7f9910006bc0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9928159f80 msgr2=0x7f99281506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:28.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9928159f80 0x7f99281506e0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f991800c500 tx=0x7f991800c9c0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 shutdown_connections 2023-12-19T14:00:28.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f990806a430 0x7f990806c8f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992815b1e0 0x7f992806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992815aa70 0x7f9928151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 --2- 172.21.15.113:0/4237855966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9928159f80 0x7f99281506e0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:28.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 >> 172.21.15.113:0/4237855966 conn(0x7f99280b0100 msgr2=0x7f99280b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:28.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 shutdown_connections 2023-12-19T14:00:28.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:28.791+0000 7f992d465640 1 -- 172.21.15.113:0/4237855966 wait complete. 2023-12-19T14:00:28.812 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T14:00:29.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.015+0000 7f9ca188b640 1 Processor -- start 2023-12-19T14:00:29.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.016+0000 7f9ca188b640 1 -- start start 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.017+0000 7f9ca188b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c9c157bf0 0x7f9c9c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.017+0000 7f9ca188b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c9c0b0810 0x7f9c9c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.017+0000 7f9ca188b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c15b740 con 0x7f9c9c0ae110 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.017+0000 7f9ca188b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c06b8c0 con 0x7f9c9c0b0810 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.017+0000 7f9ca188b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ae640 con 0x7f9c9c157bf0 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9a7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9c9c0ae110 0x7f9c9c0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54944/0 (socket says 172.21.15.113:54944) 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9a7fc640 1 -- 172.21.15.113:0/950621058 learned_addr learned my addr 172.21.15.113:0/950621058 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9b7fe640 1 --2- 172.21.15.113:0/950621058 >> v2:172.21.15.113:3300/0 conn(0x7f9c9c0b0810 0x7f9c9c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9affd640 1 --2- 172.21.15.113:0/950621058 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c157bf0 0x7f9c9c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c99ffb640 1 -- 172.21.15.113:0/950621058 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781409623 0 0) 0x7f9c9c15b740 con 0x7f9c9c0ae110 2023-12-19T14:00:29.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c99ffb640 1 -- 172.21.15.113:0/950621058 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c84003520 con 0x7f9c9c0ae110 2023-12-19T14:00:29.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9b7fe640 1 -- 172.21.15.113:0/950621058 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c157bf0 msgr2=0x7f9c9c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:29.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9b7fe640 1 --2- 172.21.15.113:0/950621058 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c157bf0 0x7f9c9c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9b7fe640 1 -- 172.21.15.113:0/950621058 >> v1:172.21.15.113:6789/0 conn(0x7f9c9c0ae110 legacy=0x7f9c9c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.018+0000 7f9c9b7fe640 1 -- 172.21.15.113:0/950621058 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c0ae920 con 0x7f9c9c0b0810 2023-12-19T14:00:29.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.019+0000 7f9c9b7fe640 1 --2- 172.21.15.113:0/950621058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b0810 0x7f9c9c06d230 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0ccbc0 tx=0x7f9c9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce273a1daa2042b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9c99ffb640 1 -- 172.21.15.113:0/950621058 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94031830 con 0x7f9c9c0b0810 2023-12-19T14:00:29.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9c99ffb640 1 -- 172.21.15.113:0/950621058 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c94031990 con 0x7f9c9c0b0810 2023-12-19T14:00:29.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9c99ffb640 1 -- 172.21.15.113:0/950621058 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94031d20 con 0x7f9c9c0b0810 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 -- 172.21.15.113:0/950621058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b0810 msgr2=0x7f9c9c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 --2- 172.21.15.113:0/950621058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b0810 0x7f9c9c06d230 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0ccbc0 tx=0x7f9c9402b8d0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 -- 172.21.15.113:0/950621058 shutdown_connections 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 --2- 172.21.15.113:0/950621058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c0b0810 0x7f9c9c06d230 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 --2- 172.21.15.113:0/950621058 >> v2:172.21.15.151:3300/0 conn(0x7f9c9c157bf0 0x7f9c9c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 -- 172.21.15.113:0/950621058 >> 172.21.15.113:0/950621058 conn(0x7f9c9c0cbb70 msgr2=0x7f9c9c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 -- 172.21.15.113:0/950621058 shutdown_connections 2023-12-19T14:00:29.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.020+0000 7f9ca188b640 1 -- 172.21.15.113:0/950621058 wait complete. 2023-12-19T14:00:29.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.022+0000 7f9ca188b640 1 Processor -- start 2023-12-19T14:00:29.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.022+0000 7f9ca188b640 1 -- start start 2023-12-19T14:00:29.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.023+0000 7f9ca188b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c0ae110 0x7f9c9c145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.023+0000 7f9ca188b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0b0810 0x7f9c9c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.023+0000 7f9ca188b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c157bf0 0x7f9c9c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.023+0000 7f9ca188b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ccee0 con 0x7f9c9c157bf0 2023-12-19T14:00:29.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.023+0000 7f9ca188b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0cdd40 con 0x7f9c9c0ae110 2023-12-19T14:00:29.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.023+0000 7f9ca188b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0cd130 con 0x7f9c9c0b0810 2023-12-19T14:00:29.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.023+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c157bf0 0x7f9c9c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c157bf0 0x7f9c9c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38542/0 (socket says 172.21.15.113:38542) 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 -- 172.21.15.113:0/2752733532 learned_addr learned my addr 172.21.15.113:0/2752733532 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9affd640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c0ae110 0x7f9c9c145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9a7fc640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0b0810 0x7f9c9c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 -- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0b0810 msgr2=0x7f9c9c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0b0810 0x7f9c9c0ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 -- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c0ae110 msgr2=0x7f9c9c145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c0ae110 0x7f9c9c145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 -- 172.21.15.113:0/2752733532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94009400 con 0x7f9c9c157bf0 2023-12-19T14:00:29.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.024+0000 7f9c9b7fe640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c157bf0 0x7f9c9c157fd0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402bee0 tx=0x7f9c940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.025+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9403a630 con 0x7f9c9c157bf0 2023-12-19T14:00:29.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.025+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9403a7b0 con 0x7f9c9c157bf0 2023-12-19T14:00:29.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.025+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9403ab60 con 0x7f9c9c157bf0 2023-12-19T14:00:29.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.025+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c0cd410 con 0x7f9c9c157bf0 2023-12-19T14:00:29.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.025+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c0cd9d0 con 0x7f9c9c157bf0 2023-12-19T14:00:29.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.026+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c0af7e0 con 0x7f9c9c157bf0 2023-12-19T14:00:29.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.027+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c9403acc0 con 0x7f9c9c157bf0 2023-12-19T14:00:29.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.028+0000 7f9c83fff640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8806a430 0x7f9c8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.028+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9c940aa420 con 0x7f9c9c157bf0 2023-12-19T14:00:29.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.028+0000 7f9c9affd640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8806a430 0x7f9c8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.028+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f9c88071fc0 con 0x7f9c9c157bf0 2023-12-19T14:00:29.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.029+0000 7f9c9affd640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8806a430 0x7f9c8806c8f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0099c0 tx=0x7f9c8c003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.032 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.032+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c94035060 con 0x7f9c9c157bf0 2023-12-19T14:00:29.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.259+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c9c061910 con 0x7f9c9c157bf0 2023-12-19T14:00:29.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.260+0000 7f9c83fff640 1 -- 172.21.15.113:0/2752733532 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f9c94075b10 con 0x7f9c9c157bf0 2023-12-19T14:00:29.260 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:29.260 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:59:41.210577+0000","modified":"2023-12-19T13:59:44.735733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6837/3462211339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":3462211339},{"type":"v1","addr":"172.21.15.113:6837","nonce":3462211339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T14:00:29.261 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 88 2023-12-19T14:00:29.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8806a430 msgr2=0x7f9c8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8806a430 0x7f9c8806c8f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0099c0 tx=0x7f9c8c003990 comp rx=0 tx=0).stop 2023-12-19T14:00:29.263 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c157bf0 msgr2=0x7f9c9c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c157bf0 0x7f9c9c157fd0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402bee0 tx=0x7f9c940046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 shutdown_connections 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9c8806a430 0x7f9c8806c8f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c9c157bf0 0x7f9c9c157fd0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c9c0b0810 0x7f9c9c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 --2- 172.21.15.113:0/2752733532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9c0ae110 0x7f9c9c145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 >> 172.21.15.113:0/2752733532 conn(0x7f9c9c0cbb70 msgr2=0x7f9c9c0b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 shutdown_connections 2023-12-19T14:00:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.263+0000 7f9ca188b640 1 -- 172.21.15.113:0/2752733532 wait complete. 2023-12-19T14:00:29.279 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T14:00:29.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.474+0000 7f5c7b47d640 1 Processor -- start 2023-12-19T14:00:29.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.474+0000 7f5c7b47d640 1 -- start start 2023-12-19T14:00:29.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c7b47d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c74146e10 0x7f5c740d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c7b47d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c740cd840 con 0x7f5c740d2b00 2023-12-19T14:00:29.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c7b47d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c740b6e90 con 0x7f5c740ce110 2023-12-19T14:00:29.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c7b47d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c740d2430 con 0x7f5c74146e10 2023-12-19T14:00:29.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c79219640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c74146e10 0x7f5c740d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c79219640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c74146e10 0x7f5c740d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38550/0 (socket says 172.21.15.113:38550) 2023-12-19T14:00:29.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c78a18640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5c740d2b00 0x7f5c740b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54952/0 (socket says 172.21.15.113:54952) 2023-12-19T14:00:29.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.476+0000 7f5c79219640 1 -- 172.21.15.113:0/3949207279 learned_addr learned my addr 172.21.15.113:0/3949207279 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:29.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.477+0000 7f5c79219640 1 -- 172.21.15.113:0/3949207279 >> v1:172.21.15.151:6789/0 conn(0x7f5c740ce110 legacy=0x7f5c740b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:29.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.477+0000 7f5c79219640 1 -- 172.21.15.113:0/3949207279 >> v1:172.21.15.113:6789/0 conn(0x7f5c740d2b00 legacy=0x7f5c740b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.477+0000 7f5c79219640 1 -- 172.21.15.113:0/3949207279 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c740d2620 con 0x7f5c74146e10 2023-12-19T14:00:29.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.478+0000 7f5c79219640 1 --2- 172.21.15.113:0/3949207279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c74146e10 0x7f5c740d1ef0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acf60e0fe86d9d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.478+0000 7f5c6bfff640 1 -- 172.21.15.113:0/3949207279 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70031870 con 0x7f5c74146e10 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.478+0000 7f5c6bfff640 1 -- 172.21.15.113:0/3949207279 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c700319d0 con 0x7f5c74146e10 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.478+0000 7f5c6bfff640 1 -- 172.21.15.113:0/3949207279 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70031d60 con 0x7f5c74146e10 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.479+0000 7f5c7b47d640 1 -- 172.21.15.113:0/3949207279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c74146e10 msgr2=0x7f5c740d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.479+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/3949207279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c74146e10 0x7f5c740d1ef0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c7002b910 comp rx=0 tx=0).stop 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.479+0000 7f5c7b47d640 1 -- 172.21.15.113:0/3949207279 shutdown_connections 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.479+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/3949207279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c74146e10 0x7f5c740d1ef0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.479+0000 7f5c7b47d640 1 -- 172.21.15.113:0/3949207279 >> 172.21.15.113:0/3949207279 conn(0x7f5c740b29c0 msgr2=0x7f5c740b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.479+0000 7f5c7b47d640 1 -- 172.21.15.113:0/3949207279 shutdown_connections 2023-12-19T14:00:29.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.479+0000 7f5c7b47d640 1 -- 172.21.15.113:0/3949207279 wait complete. 2023-12-19T14:00:29.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.481+0000 7f5c7b47d640 1 Processor -- start 2023-12-19T14:00:29.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.481+0000 7f5c7b47d640 1 -- start start 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.481+0000 7f5c7b47d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c740ce110 0x7f5c74144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.481+0000 7f5c7b47d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c740d2b00 0x7f5c7415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c7b47d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c74146e10 0x7f5c7415fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c7b47d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74145490 con 0x7f5c740ce110 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c7b47d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74144880 con 0x7f5c74146e10 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c7b47d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74144b60 con 0x7f5c740d2b00 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c740ce110 0x7f5c74144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c740ce110 0x7f5c74144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38566/0 (socket says 172.21.15.113:38566) 2023-12-19T14:00:29.482 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 -- 172.21.15.113:0/2522280158 learned_addr learned my addr 172.21.15.113:0/2522280158 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:29.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79a1a640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c74146e10 0x7f5c7415fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 -- 172.21.15.113:0/2522280158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c740d2b00 msgr2=0x7f5c7415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c740d2b00 0x7f5c7415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 -- 172.21.15.113:0/2522280158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c74146e10 msgr2=0x7f5c7415fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c74146e10 0x7f5c7415fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.483 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.482+0000 7f5c79219640 1 -- 172.21.15.113:0/2522280158 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c700094d0 con 0x7f5c740ce110 2023-12-19T14:00:29.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.483+0000 7f5c79219640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c740ce110 0x7f5c74144210 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.483+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70031820 con 0x7f5c740ce110 2023-12-19T14:00:29.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.483+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c700443f0 con 0x7f5c740ce110 2023-12-19T14:00:29.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.483+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c74144e40 con 0x7f5c740ce110 2023-12-19T14:00:29.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.483+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700447a0 con 0x7f5c740ce110 2023-12-19T14:00:29.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.483+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7415f200 con 0x7f5c740ce110 2023-12-19T14:00:29.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.484+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c740b4760 con 0x7f5c740ce110 2023-12-19T14:00:29.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.485+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c7004d450 con 0x7f5c740ce110 2023-12-19T14:00:29.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.486+0000 7f5c69ffb640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c5806a430 0x7f5c5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.486+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5c7002d040 con 0x7f5c740ce110 2023-12-19T14:00:29.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.486+0000 7f5c78a18640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c5806a430 0x7f5c5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.486+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f5c58071fc0 con 0x7f5c740ce110 2023-12-19T14:00:29.486 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.487+0000 7f5c78a18640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c5806a430 0x7f5c5806c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5c74146500 tx=0x7f5c640079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.490 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.490+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c740b4760 con 0x7f5c740ce110 2023-12-19T14:00:29.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.680+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c740b4760 con 0x7f5c740ce110 2023-12-19T14:00:29.682 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.682+0000 7f5c69ffb640 1 -- 172.21.15.113:0/2522280158 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+16236 (secure 0 0 0) 0x7f5c740b4760 con 0x7f5c740ce110 2023-12-19T14:00:29.682 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:29.682 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":201,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T14:00:23.719473+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:59:38.845347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T13:59:40.229435+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.26","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T14:00:29.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c5806a430 msgr2=0x7f5c5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c5806a430 0x7f5c5806c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5c74146500 tx=0x7f5c640079c0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c740ce110 msgr2=0x7f5c74144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c740ce110 0x7f5c74144210 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c700046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 shutdown_connections 2023-12-19T14:00:29.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5c5806a430 0x7f5c5806c8f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c74146e10 0x7f5c7415fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c740d2b00 0x7f5c7415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 --2- 172.21.15.113:0/2522280158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c740ce110 0x7f5c74144210 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 >> 172.21.15.113:0/2522280158 conn(0x7f5c740b29c0 msgr2=0x7f5c740b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:29.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 shutdown_connections 2023-12-19T14:00:29.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.685+0000 7f5c7b47d640 1 -- 172.21.15.113:0/2522280158 wait complete. 2023-12-19T14:00:29.705 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T14:00:29.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.915+0000 7f147681a640 1 Processor -- start 2023-12-19T14:00:29.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.915+0000 7f147681a640 1 -- start start 2023-12-19T14:00:29.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.916+0000 7f147681a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14700b0810 0x7f1470164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.916+0000 7f147681a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700ae640 con 0x7f14700ae110 2023-12-19T14:00:29.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f147681a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700ae920 con 0x7f1470157bf0 2023-12-19T14:00:29.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f147681a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147006b8c0 con 0x7f14700b0810 2023-12-19T14:00:29.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f146f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f14700ae110 0x7f14700b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54960/0 (socket says 172.21.15.113:54960) 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f146f7fe640 1 -- 172.21.15.113:0/1208866454 learned_addr learned my addr 172.21.15.113:0/1208866454 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f1474db7640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14700b0810 0x7f1470164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208105911 0 0) 0x7f14700ae640 con 0x7f14700ae110 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f145c003520 con 0x7f14700ae110 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.917+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309421050 0 0) 0x7f145c003520 con 0x7f14700ae110 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14700b0810 msgr2=0x7f1470164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14700b0810 0x7f1470164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 >> v1:172.21.15.151:6789/0 conn(0x7f1470157bf0 legacy=0x7f147015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700aec00 con 0x7f14700ae110 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f1458001670 con 0x7f14700ae110 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 >> v1:172.21.15.113:6789/0 conn(0x7f14700ae110 legacy=0x7f14700b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f145c003a10 0x7f145c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c0047c0 0x7f145c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14700b0810 0x7f145c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147006b8c0 con 0x7f145c003a10 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c00dd80 con 0x7f145c0047c0 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c00df40 con 0x7f14700b0810 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146ffff640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f145c003a10 0x7f145c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146f7fe640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c0047c0 0x7f145c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146ffff640 1 -- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14700b0810 msgr2=0x7f145c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146ffff640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14700b0810 0x7f145c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146ffff640 1 -- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c0047c0 msgr2=0x7f145c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146ffff640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c0047c0 0x7f145c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146ffff640 1 -- 172.21.15.113:0/1208866454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c003520 con 0x7f145c003a10 2023-12-19T14:00:29.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.918+0000 7f146f7fe640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c0047c0 0x7f145c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.919+0000 7f146ffff640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f145c003a10 0x7f145c003e30 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f1460001e50 tx=0x7f145c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a88f26fbfafc19 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460003b70 con 0x7f145c003a10 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460003cd0 con 0x7f145c003a10 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f146effd640 1 -- 172.21.15.113:0/1208866454 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460005310 con 0x7f145c003a10 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f147681a640 1 -- 172.21.15.113:0/1208866454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f145c003a10 msgr2=0x7f145c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f147681a640 1 --2- 172.21.15.113:0/1208866454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f145c003a10 0x7f145c003e30 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f1460001e50 tx=0x7f145c0057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f1474db7640 1 -- 172.21.15.113:0/1208866454 reap_dead start 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f147681a640 1 -- 172.21.15.113:0/1208866454 shutdown_connections 2023-12-19T14:00:29.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f147681a640 1 -- 172.21.15.113:0/1208866454 >> 172.21.15.113:0/1208866454 conn(0x7f14700cbb70 msgr2=0x7f14700cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:29.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f147681a640 1 -- 172.21.15.113:0/1208866454 shutdown_connections 2023-12-19T14:00:29.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.920+0000 7f147681a640 1 -- 172.21.15.113:0/1208866454 wait complete. 2023-12-19T14:00:29.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.922+0000 7f147681a640 1 Processor -- start 2023-12-19T14:00:29.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.922+0000 7f147681a640 1 -- start start 2023-12-19T14:00:29.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f147681a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a10 0x7f1470147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f147681a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1470145460 0x7f1470147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f147681a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147015a7f0 0x7f147015b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f147681a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147015b040 con 0x7f1470145460 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f147681a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470154920 con 0x7f147015a7f0 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f147681a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1470153ff0 con 0x7f145c003a10 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1470145460 0x7f1470147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1470145460 0x7f1470147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38582/0 (socket says 172.21.15.113:38582) 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.923+0000 7f146f7fe640 1 -- 172.21.15.113:0/1428053899 learned_addr learned my addr 172.21.15.113:0/1428053899 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146f7fe640 1 -- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a10 msgr2=0x7f1470147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146ffff640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a10 0x7f1470147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f1474db7640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147015a7f0 0x7f147015b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146f7fe640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a10 0x7f1470147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146f7fe640 1 -- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147015a7f0 msgr2=0x7f147015b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146f7fe640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147015a7f0 0x7f147015b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:29.926 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146f7fe640 1 -- 172.21.15.113:0/1428053899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14701542d0 con 0x7f1470145460 2023-12-19T14:00:29.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146f7fe640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1470145460 0x7f1470147320 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f145800d800 tx=0x7f145800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580074e0 con 0x7f1470145460 2023-12-19T14:00:29.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458007640 con 0x7f1470145460 2023-12-19T14:00:29.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580049e0 con 0x7f1470145460 2023-12-19T14:00:29.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14701545b0 con 0x7f1470145460 2023-12-19T14:00:29.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.924+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14701458c0 con 0x7f1470145460 2023-12-19T14:00:29.927 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.925+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1470154130 con 0x7f1470145460 2023-12-19T14:00:29.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.926+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1458004b40 con 0x7f1470145460 2023-12-19T14:00:29.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.927+0000 7f146cff9640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145006a430 0x7f145006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:29.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.927+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1458088660 con 0x7f1470145460 2023-12-19T14:00:29.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.927+0000 7f146ffff640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145006a430 0x7f145006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:29.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.927+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f1450071fc0 con 0x7f1470145460 2023-12-19T14:00:29.928 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.928+0000 7f146ffff640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145006a430 0x7f145006c8f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1460034000 tx=0x7f1460009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:29.931 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:29.931+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1458019060 con 0x7f1470145460 2023-12-19T14:00:30.158 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.158+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14700aee90 con 0x7f1470145460 2023-12-19T14:00:30.160 INFO:tasks.ceph.mon.a.smithi113.stderr:2023-12-19T14:00:30.160+0000 7f3868cff640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T14:00:30.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.163+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(202..202 src has 1..202) v4 ==== 374+0+0 (secure 0 0 0) 0x7f145805b5f0 con 0x7f1470145460 2023-12-19T14:00:30.163 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.163+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=203}) v3 -- 0x7f1450072870 con 0x7f1470145460 2023-12-19T14:00:30.179 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.179+0000 7f146cff9640 1 -- 172.21.15.113:0/1428053899 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1470154130 con 0x7f1470145460 2023-12-19T14:00:30.179 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T14:00:30.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145006a430 msgr2=0x7f145006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:30.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145006a430 0x7f145006c8f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1460034000 tx=0x7f1460009030 comp rx=0 tx=0).stop 2023-12-19T14:00:30.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1470145460 msgr2=0x7f1470147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:30.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1470145460 0x7f1470147320 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f145800d800 tx=0x7f145800dcc0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 shutdown_connections 2023-12-19T14:00:30.182 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f145006a430 0x7f145006c8f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147015a7f0 0x7f147015b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1470145460 0x7f1470147320 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 --2- 172.21.15.113:0/1428053899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a10 0x7f1470147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 >> 172.21.15.113:0/1428053899 conn(0x7f14700cbb70 msgr2=0x7f1470156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:30.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 shutdown_connections 2023-12-19T14:00:30.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.182+0000 7f147681a640 1 -- 172.21.15.113:0/1428053899 wait complete. 2023-12-19T14:00:30.189 INFO:tasks.ceph.mds.a.smithi113.stderr: -9171> 2023-12-19T13:59:46.330+0000 7f0c97b6f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T14:00:30.202 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T14:00:30.251 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2023-12-19T14:00:30.395 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.395+0000 7ff765992640 1 Processor -- start 2023-12-19T14:00:30.396 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.396+0000 7ff765992640 1 -- start start 2023-12-19T14:00:30.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff765992640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff7600af8b0 0x7ff76015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:30.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff765992640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff7600ce480 0x7ff7600b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:30.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff765992640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7600cd070 con 0x7ff76015b3e0 2023-12-19T14:00:30.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff765992640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7600cd350 con 0x7ff7600af8b0 2023-12-19T14:00:30.397 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff765992640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7600cd630 con 0x7ff7600ce480 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff75e7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff7600af8b0 0x7ff76015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff75e7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff7600af8b0 0x7ff76015efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38620/0 (socket says 172.21.15.113:38620) 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.397+0000 7ff75e7fc640 1 -- 172.21.15.113:0/871552134 learned_addr learned my addr 172.21.15.113:0/871552134 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.398+0000 7ff75f7fe640 1 --2- 172.21.15.113:0/871552134 >> v2:172.21.15.151:3300/0 conn(0x7ff7600ce480 0x7ff7600b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.398+0000 7ff75e7fc640 1 -- 172.21.15.113:0/871552134 >> v2:172.21.15.151:3300/0 conn(0x7ff7600ce480 msgr2=0x7ff7600b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.398+0000 7ff75e7fc640 1 --2- 172.21.15.113:0/871552134 >> v2:172.21.15.151:3300/0 conn(0x7ff7600ce480 0x7ff7600b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.398+0000 7ff75e7fc640 1 -- 172.21.15.113:0/871552134 >> v1:172.21.15.151:6789/0 conn(0x7ff76015b3e0 legacy=0x7ff7600cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:30.398 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.398+0000 7ff75e7fc640 1 -- 172.21.15.113:0/871552134 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600cd910 con 0x7ff7600af8b0 2023-12-19T14:00:30.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.399+0000 7ff75e7fc640 1 --2- 172.21.15.113:0/871552134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600af8b0 0x7ff76015efb0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7ff76006e110 tx=0x7ff74802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5046e8517d9cee8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:30.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.399+0000 7ff75dffb640 1 -- 172.21.15.113:0/871552134 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748004230 con 0x7ff7600af8b0 2023-12-19T14:00:30.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.399+0000 7ff75dffb640 1 -- 172.21.15.113:0/871552134 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff748004390 con 0x7ff7600af8b0 2023-12-19T14:00:30.399 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.399+0000 7ff75dffb640 1 -- 172.21.15.113:0/871552134 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748003810 con 0x7ff7600af8b0 2023-12-19T14:00:30.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 -- 172.21.15.113:0/871552134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600af8b0 msgr2=0x7ff76015efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:30.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 --2- 172.21.15.113:0/871552134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600af8b0 0x7ff76015efb0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7ff76006e110 tx=0x7ff74802b8f0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 -- 172.21.15.113:0/871552134 shutdown_connections 2023-12-19T14:00:30.400 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 --2- 172.21.15.113:0/871552134 >> v2:172.21.15.151:3300/0 conn(0x7ff7600ce480 0x7ff7600b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 --2- 172.21.15.113:0/871552134 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600af8b0 0x7ff76015efb0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 -- 172.21.15.113:0/871552134 >> 172.21.15.113:0/871552134 conn(0x7ff7600659d0 msgr2=0x7ff760065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:30.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 -- 172.21.15.113:0/871552134 shutdown_connections 2023-12-19T14:00:30.401 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.400+0000 7ff765992640 1 -- 172.21.15.113:0/871552134 wait complete. 2023-12-19T14:00:30.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.402+0000 7ff765992640 1 Processor -- start 2023-12-19T14:00:30.402 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.402+0000 7ff765992640 1 -- start start 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff765992640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7600ce480 0x7ff7600b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff765992640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff76015b3e0 0x7ff76014be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff765992640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600706b0 0x7ff7601596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff765992640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601589d0 con 0x7ff7600706b0 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff765992640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600b49b0 con 0x7ff7600ce480 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff765992640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76014c350 con 0x7ff76015b3e0 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff75f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600706b0 0x7ff7601596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff75f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600706b0 0x7ff7601596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38630/0 (socket says 172.21.15.113:38630) 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.403+0000 7ff75f7fe640 1 -- 172.21.15.113:0/3145603029 learned_addr learned my addr 172.21.15.113:0/3145603029 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75effd640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7600ce480 0x7ff7600b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:30.404 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75f7fe640 1 -- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff76015b3e0 msgr2=0x7ff76014be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:30.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75e7fc640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff76015b3e0 0x7ff76014be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:30.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75f7fe640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff76015b3e0 0x7ff76014be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75f7fe640 1 -- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7600ce480 msgr2=0x7ff7600b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:30.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75f7fe640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7600ce480 0x7ff7600b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:30.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75f7fe640 1 -- 172.21.15.113:0/3145603029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff748009460 con 0x7ff7600706b0 2023-12-19T14:00:30.405 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff75f7fe640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600706b0 0x7ff7601596c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff75800d5d0 tx=0x7ff75800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:30.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580125f0 con 0x7ff7600706b0 2023-12-19T14:00:30.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758012750 con 0x7ff7600706b0 2023-12-19T14:00:30.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758012b00 con 0x7ff7600706b0 2023-12-19T14:00:30.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.404+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7600718b0 con 0x7ff7600706b0 2023-12-19T14:00:30.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.405+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff760158ec0 con 0x7ff7600706b0 2023-12-19T14:00:30.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.406+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff760061910 con 0x7ff7600706b0 2023-12-19T14:00:30.406 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.407+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff758012c60 con 0x7ff7600706b0 2023-12-19T14:00:30.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.408+0000 7ff757fff640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff74006a430 0x7ff74006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:30.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.408+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5824+0+0 (secure 0 0 0) 0x7ff758088ea0 con 0x7ff7600706b0 2023-12-19T14:00:30.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.408+0000 7ff75effd640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff74006a430 0x7ff74006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:30.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.408+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=203}) v3 -- 0x7ff7400720d0 con 0x7ff7600706b0 2023-12-19T14:00:30.408 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.409+0000 7ff75effd640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff74006a430 0x7ff74006c8f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff750007bf0 tx=0x7ff750007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:30.412 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.412+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff758054420 con 0x7ff7600706b0 2023-12-19T14:00:30.632 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:30.632+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff7600666e0 con 0x7ff7600706b0 2023-12-19T14:00:31.189 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.189+0000 7ff757fff640 1 -- 172.21.15.113:0/3145603029 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff758057a40 con 0x7ff7600706b0 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.192+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff74006a430 msgr2=0x7ff74006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.192+0000 7ff765992640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff74006a430 0x7ff74006c8f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff750007bf0 tx=0x7ff750007240 comp rx=0 tx=0).stop 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.192+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600706b0 msgr2=0x7ff7601596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.192+0000 7ff765992640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600706b0 0x7ff7601596c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff75800d5d0 tx=0x7ff75800da90 comp rx=0 tx=0).stop 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 shutdown_connections 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ff74006a430 0x7ff74006c8f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7600706b0 0x7ff7601596c0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff76015b3e0 0x7ff76014be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 --2- 172.21.15.113:0/3145603029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7600ce480 0x7ff7600b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 >> 172.21.15.113:0/3145603029 conn(0x7ff7600659d0 msgr2=0x7ff76015b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:31.193 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 shutdown_connections 2023-12-19T14:00:31.194 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.193+0000 7ff765992640 1 -- 172.21.15.113:0/3145603029 wait complete. 2023-12-19T14:00:31.215 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T14:00:31.427 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.427+0000 7f9ab521a640 1 Processor -- start 2023-12-19T14:00:31.428 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.428+0000 7f9ab521a640 1 -- start start 2023-12-19T14:00:31.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.429+0000 7f9ab521a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 0x7f9ab00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.429+0000 7f9ab521a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab0161a20 con 0x7f9ab00b1dc0 2023-12-19T14:00:31.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.429+0000 7f9ab521a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab0161d00 con 0x7f9ab01402b0 2023-12-19T14:00:31.429 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.429+0000 7f9ab521a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0143150 con 0x7f9ab0143570 2023-12-19T14:00:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aaf59e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9ab00b1dc0 0x7f9ab0070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54984/0 (socket says 172.21.15.113:54984) 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aaf59e640 1 -- 172.21.15.113:0/3015909632 learned_addr learned my addr 172.21.15.113:0/3015909632 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aae59c640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 0x7f9ab00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992467565 0 0) 0x7f9ab0161a20 con 0x7f9ab00b1dc0 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c003520 con 0x7f9ab00b1dc0 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458802906 0 0) 0x7f9a9c003520 con 0x7f9ab00b1dc0 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 msgr2=0x7f9ab00b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 0x7f9ab00b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 >> v1:172.21.15.151:6789/0 conn(0x7f9ab01402b0 legacy=0x7f9ab0160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0142d70 con 0x7f9ab00b1dc0 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f9aa80019f0 con 0x7f9ab00b1dc0 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 >> v1:172.21.15.113:6789/0 conn(0x7f9ab00b1dc0 legacy=0x7f9ab0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.430+0000 7f9aadd9b640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a9c003a10 0x7f9a9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aadd9b640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 0x7f9a9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aadd9b640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9a9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0143150 con 0x7f9a9c004d00 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00bb90 con 0x7f9a9c003a10 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00bd50 con 0x7f9ab0143570 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaf59e640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9a9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaed9d640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a9c003a10 0x7f9a9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaf59e640 1 -- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 msgr2=0x7f9a9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aae59c640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 0x7f9a9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaf59e640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab0143570 0x7f9a9c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaf59e640 1 -- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a9c003a10 msgr2=0x7f9a9c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaf59e640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a9c003a10 0x7f9a9c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaf59e640 1 -- 172.21.15.113:0/3015909632 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c003520 con 0x7f9a9c004d00 2023-12-19T14:00:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.431+0000 7f9aaed9d640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a9c003a10 0x7f9a9c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.432+0000 7f9aaf59e640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9a9c005180 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800a760 tx=0x7f9a9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fce46363fa5e79 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.432+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8034630 con 0x7f9a9c004d00 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa802f070 con 0x7f9a9c004d00 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9aadd9b640 1 -- 172.21.15.113:0/3015909632 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80349f0 con 0x7f9a9c004d00 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9ab521a640 1 -- 172.21.15.113:0/3015909632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 msgr2=0x7f9a9c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9ab521a640 1 --2- 172.21.15.113:0/3015909632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9a9c005180 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800a760 tx=0x7f9a9c0057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9aaf59e640 1 -- 172.21.15.113:0/3015909632 reap_dead start 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9ab521a640 1 -- 172.21.15.113:0/3015909632 shutdown_connections 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9ab521a640 1 -- 172.21.15.113:0/3015909632 >> 172.21.15.113:0/3015909632 conn(0x7f9ab00cf230 msgr2=0x7f9ab00cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9ab521a640 1 -- 172.21.15.113:0/3015909632 shutdown_connections 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.433+0000 7f9ab521a640 1 -- 172.21.15.113:0/3015909632 wait complete. 2023-12-19T14:00:31.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.435+0000 7f9ab521a640 1 Processor -- start 2023-12-19T14:00:31.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.435+0000 7f9ab521a640 1 -- start start 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.436+0000 7f9ab521a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9ab01f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.436+0000 7f9ab521a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab00add20 0x7f9ab00b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.436+0000 7f9ab521a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab00b09e0 0x7f9ab00ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.436+0000 7f9ab521a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01f2e10 con 0x7f9a9c004d00 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.436+0000 7f9ab521a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01f3060 con 0x7f9ab00add20 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.436+0000 7f9ab521a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01f3340 con 0x7f9ab00b09e0 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9ab01f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9ab01f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38640/0 (socket says 172.21.15.113:38640) 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 -- 172.21.15.113:0/2000699126 learned_addr learned my addr 172.21.15.113:0/2000699126 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aae59c640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab00add20 0x7f9ab00b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaf59e640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab00b09e0 0x7f9ab00ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 -- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab00b09e0 msgr2=0x7f9ab00ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab00b09e0 0x7f9ab00ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 -- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab00add20 msgr2=0x7f9ab00b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab00add20 0x7f9ab00b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 -- 172.21.15.113:0/2000699126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab01f3620 con 0x7f9a9c004d00 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aae59c640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab00add20 0x7f9ab00b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaf59e640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab00b09e0 0x7f9ab00ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.437+0000 7f9aaed9d640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9ab01f5b60 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d770 tx=0x7f9aa000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.438+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0005270 con 0x7f9a9c004d00 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.438+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00053d0 con 0x7f9a9c004d00 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.438+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000b8d0 con 0x7f9a9c004d00 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.438+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab01f3900 con 0x7f9a9c004d00 2023-12-19T14:00:31.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.438+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab00aeb60 con 0x7f9a9c004d00 2023-12-19T14:00:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.439+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab01616c0 con 0x7f9a9c004d00 2023-12-19T14:00:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.440+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9aa000ba30 con 0x7f9a9c004d00 2023-12-19T14:00:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.441+0000 7f9aa77fe640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9a9006a430 0x7f9a9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.441+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9aa0088850 con 0x7f9a9c004d00 2023-12-19T14:00:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.441+0000 7f9aae59c640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9a9006a430 0x7f9a9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.441+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=203}) v3 -- 0x7f9a900720d0 con 0x7f9a9c004d00 2023-12-19T14:00:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.442+0000 7f9aae59c640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9a9006a430 0x7f9a9006c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9ab006c940 tx=0x7f9a98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.445+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ab01616c0 con 0x7f9a9c004d00 2023-12-19T14:00:31.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:31.621+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ab01616a0 con 0x7f9a9c004d00 2023-12-19T14:00:32.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.190+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(203..203 src has 1..203) v4 ==== 296+0+0 (secure 0 0 0) 0x7f9aa0058220 con 0x7f9a9c004d00 2023-12-19T14:00:32.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.190+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=204}) v3 -- 0x7f9a90070500 con 0x7f9a9c004d00 2023-12-19T14:00:32.202 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.198+0000 7f9aa77fe640 1 -- 172.21.15.113:0/2000699126 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v203) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9aa0053e60 con 0x7f9a9c004d00 2023-12-19T14:00:32.202 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2023-12-19T14:00:32.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.203+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9a9006a430 msgr2=0x7f9a9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:32.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.203+0000 7f9ab521a640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9a9006a430 0x7f9a9006c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9ab006c940 tx=0x7f9a98008040 comp rx=0 tx=0).stop 2023-12-19T14:00:32.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.203+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 msgr2=0x7f9ab01f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:32.203 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.203+0000 7f9ab521a640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9ab01f5b60 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d770 tx=0x7f9aa000dc30 comp rx=0 tx=0).stop 2023-12-19T14:00:32.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.204+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 shutdown_connections 2023-12-19T14:00:32.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.204+0000 7f9ab521a640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f9a9006a430 0x7f9a9006c8f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.204+0000 7f9ab521a640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ab00b09e0 0x7f9ab00ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.204+0000 7f9ab521a640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab00add20 0x7f9ab00b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.204 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.204+0000 7f9ab521a640 1 --2- 172.21.15.113:0/2000699126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a9c004d00 0x7f9ab01f5b60 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.204+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 >> 172.21.15.113:0/2000699126 conn(0x7f9ab00cf230 msgr2=0x7f9ab01420f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:32.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.205+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 shutdown_connections 2023-12-19T14:00:32.205 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.205+0000 7f9ab521a640 1 -- 172.21.15.113:0/2000699126 wait complete. 2023-12-19T14:00:32.227 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T14:00:32.432 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.432+0000 7fb5edf5c640 1 Processor -- start 2023-12-19T14:00:32.433 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.433+0000 7fb5edf5c640 1 -- start start 2023-12-19T14:00:32.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.434+0000 7fb5edf5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e80c3670 0x7fb5e80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.434+0000 7fb5edf5c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e815e1b0 con 0x7fb5e80c3ad0 2023-12-19T14:00:32.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.434+0000 7fb5edf5c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e815dbc0 con 0x7fb5e8070940 2023-12-19T14:00:32.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.434+0000 7fb5edf5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80c4030 con 0x7fb5e80c3670 2023-12-19T14:00:32.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb5e80c3ad0 0x7fb5e81611b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54986/0 (socket says 172.21.15.113:54986) 2023-12-19T14:00:32.435 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e7fff640 1 -- 172.21.15.113:0/3088170280 learned_addr learned my addr 172.21.15.113:0/3088170280 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:32.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e80c3670 0x7fb5e80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299755530 0 0) 0x7fb5e815e1b0 con 0x7fb5e80c3ad0 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d4003520 con 0x7fb5e80c3ad0 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045711838 0 0) 0x7fb5d4003520 con 0x7fb5e80c3ad0 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e80c3670 msgr2=0x7fb5e80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e6ffd640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e80c3670 0x7fb5e80cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.435+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 >> v1:172.21.15.151:6789/0 conn(0x7fb5e8070940 legacy=0x7fb5e815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80c4310 con 0x7fb5e80c3ad0 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb5e00019f0 con 0x7fb5e80c3ad0 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 >> v1:172.21.15.113:6789/0 conn(0x7fb5e80c3ad0 legacy=0x7fb5e81611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d40039a0 0x7fb5d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5d40047c0 0x7fb5d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e80c3670 0x7fb5d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80c4030 con 0x7fb5d40047c0 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d400bab0 con 0x7fb5d40039a0 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d400bc70 con 0x7fb5e80c3670 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5d40047c0 0x7fb5d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5e77fe640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d40039a0 0x7fb5d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5dffff640 1 -- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e80c3670 msgr2=0x7fb5d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e80c3670 0x7fb5d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5dffff640 1 -- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d40039a0 msgr2=0x7fb5d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d40039a0 0x7fb5d4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.436+0000 7fb5dffff640 1 -- 172.21.15.113:0/3088170280 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4003520 con 0x7fb5d40047c0 2023-12-19T14:00:32.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.438+0000 7fb5dffff640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5d40047c0 0x7fb5d4004c40 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009ac0 tx=0x7fb5d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d688da4c0dd65d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:32.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.438+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d002c710 con 0x7fb5d40047c0 2023-12-19T14:00:32.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.438+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d002c870 con 0x7fb5d40047c0 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.438+0000 7fb5e6ffd640 1 -- 172.21.15.113:0/3088170280 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d002cc00 con 0x7fb5d40047c0 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.438+0000 7fb5edf5c640 1 -- 172.21.15.113:0/3088170280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5d40047c0 msgr2=0x7fb5d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.438+0000 7fb5edf5c640 1 --2- 172.21.15.113:0/3088170280 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5d40047c0 0x7fb5d4004c40 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009ac0 tx=0x7fb5d40057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.438+0000 7fb5e7fff640 1 -- 172.21.15.113:0/3088170280 reap_dead start 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.439+0000 7fb5edf5c640 1 -- 172.21.15.113:0/3088170280 shutdown_connections 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.439+0000 7fb5edf5c640 1 -- 172.21.15.113:0/3088170280 >> 172.21.15.113:0/3088170280 conn(0x7fb5e806a700 msgr2=0x7fb5e806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.439+0000 7fb5edf5c640 1 -- 172.21.15.113:0/3088170280 shutdown_connections 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.439+0000 7fb5edf5c640 1 -- 172.21.15.113:0/3088170280 wait complete. 2023-12-19T14:00:32.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.440+0000 7fb5edf5c640 1 Processor -- start 2023-12-19T14:00:32.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.441+0000 7fb5edf5c640 1 -- start start 2023-12-19T14:00:32.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5edf5c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d40047c0 0x7fb5e80cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5edf5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e815ccc0 0x7fb5e81f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5edf5c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e80c9450 0x7fb5e813df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5edf5c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e81f3c00 con 0x7fb5e815ccc0 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5edf5c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e815d140 con 0x7fb5e80c9450 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5edf5c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80cb8d0 con 0x7fb5d40047c0 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e815ccc0 0x7fb5e81f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e815ccc0 0x7fb5e81f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38662/0 (socket says 172.21.15.113:38662) 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 -- 172.21.15.113:0/2937077735 learned_addr learned my addr 172.21.15.113:0/2937077735 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5e77fe640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d40047c0 0x7fb5e80cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 -- 172.21.15.113:0/2937077735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d40047c0 msgr2=0x7fb5e80cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d40047c0 0x7fb5e80cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 -- 172.21.15.113:0/2937077735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e80c9450 msgr2=0x7fb5e813df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e80c9450 0x7fb5e813df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.442+0000 7fb5dffff640 1 -- 172.21.15.113:0/2937077735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80cbbb0 con 0x7fb5e815ccc0 2023-12-19T14:00:32.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.443+0000 7fb5dffff640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e815ccc0 0x7fb5e81f36c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb5d002c2b0 tx=0x7fb5d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:32.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.443+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0003810 con 0x7fb5e815ccc0 2023-12-19T14:00:32.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.443+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0003970 con 0x7fb5e815ccc0 2023-12-19T14:00:32.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.443+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e80cbe90 con 0x7fb5e815ccc0 2023-12-19T14:00:32.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.443+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0003ce0 con 0x7fb5e815ccc0 2023-12-19T14:00:32.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.443+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e813c790 con 0x7fb5e815ccc0 2023-12-19T14:00:32.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.444+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e8061910 con 0x7fb5e815ccc0 2023-12-19T14:00:32.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.445+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5d0040450 con 0x7fb5e815ccc0 2023-12-19T14:00:32.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.446+0000 7fb5e4ff9640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c806a460 0x7fb5c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:32.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.446+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5386+0+0 (secure 0 0 0) 0x7fb5d00aa820 con 0x7fb5e815ccc0 2023-12-19T14:00:32.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.446+0000 7fb5e77fe640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c806a460 0x7fb5c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:32.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.447+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=204}) v3 -- 0x7fb5c8071290 con 0x7fb5e815ccc0 2023-12-19T14:00:32.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.447+0000 7fb5e77fe640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c806a460 0x7fb5c806c920 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8007fd0 tx=0x7fb5d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:32.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.451+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5d0075eb0 con 0x7fb5e815ccc0 2023-12-19T14:00:32.640 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:32.640+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb5e80b30a0 con 0x7fb5e815ccc0 2023-12-19T14:00:33.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.201+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 7 ==== osd_map(204..204 src has 1..204) v4 ==== 313+0+0 (secure 0 0 0) 0x7fb5d0003e40 con 0x7fb5e815ccc0 2023-12-19T14:00:33.201 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.201+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=205}) v3 -- 0x7fb5c8070020 con 0x7fb5e815ccc0 2023-12-19T14:00:33.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.213+0000 7fb5e4ff9640 1 -- 172.21.15.113:0/2937077735 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v204) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb5d0039070 con 0x7fb5e815ccc0 2023-12-19T14:00:33.216 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2023-12-19T14:00:33.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.220+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c806a460 msgr2=0x7fb5c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.220+0000 7fb5edf5c640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c806a460 0x7fb5c806c920 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8007fd0 tx=0x7fb5d8009040 comp rx=0 tx=0).stop 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.220+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e815ccc0 msgr2=0x7fb5e81f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.220+0000 7fb5edf5c640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e815ccc0 0x7fb5e81f36c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb5d002c2b0 tx=0x7fb5d0004730 comp rx=0 tx=0).stop 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.221+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 shutdown_connections 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.221+0000 7fb5edf5c640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb5c806a460 0x7fb5c806c920 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.221+0000 7fb5edf5c640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e80c9450 0x7fb5e813df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.221+0000 7fb5edf5c640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5e815ccc0 0x7fb5e81f36c0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.221+0000 7fb5edf5c640 1 --2- 172.21.15.113:0/2937077735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d40047c0 0x7fb5e80cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.221+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 >> 172.21.15.113:0/2937077735 conn(0x7fb5e806a700 msgr2=0x7fb5e815ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:33.223 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.223+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 shutdown_connections 2023-12-19T14:00:33.224 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.223+0000 7fb5edf5c640 1 -- 172.21.15.113:0/2937077735 wait complete. 2023-12-19T14:00:33.244 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T14:00:33.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.439+0000 7fd0b1747640 1 Processor -- start 2023-12-19T14:00:33.440 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.439+0000 7fd0b1747640 1 -- start start 2023-12-19T14:00:33.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0b1747640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd0ac0adf00 0x7fd0ac0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0b1747640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd0ac0b1610 0x7fd0ac15c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0b1747640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0b1dd0 con 0x7fd0ac15c660 2023-12-19T14:00:33.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0b1747640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac15bd00 con 0x7fd0ac0b1610 2023-12-19T14:00:33.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0b1747640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0b20b0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0a3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd0ac0b1610 0x7fd0ac15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0a3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd0ac0b1610 0x7fd0ac15c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38666/0 (socket says 172.21.15.113:38666) 2023-12-19T14:00:33.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.441+0000 7fd0a3fff640 1 -- 172.21.15.113:0/3060489763 learned_addr learned my addr 172.21.15.113:0/3060489763 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:33.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.442+0000 7fd0aaffd640 1 --2- 172.21.15.113:0/3060489763 >> v2:172.21.15.151:3300/0 conn(0x7fd0ac0adf00 0x7fd0ac0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.442+0000 7fd0a3fff640 1 -- 172.21.15.113:0/3060489763 >> v2:172.21.15.151:3300/0 conn(0x7fd0ac0adf00 msgr2=0x7fd0ac0c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:33.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.442+0000 7fd0a3fff640 1 --2- 172.21.15.113:0/3060489763 >> v2:172.21.15.151:3300/0 conn(0x7fd0ac0adf00 0x7fd0ac0c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.442+0000 7fd0a3fff640 1 -- 172.21.15.113:0/3060489763 >> v1:172.21.15.151:6789/0 conn(0x7fd0ac15c660 legacy=0x7fd0ac0ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:33.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.442+0000 7fd0a3fff640 1 -- 172.21.15.113:0/3060489763 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac0b2390 con 0x7fd0ac0b1610 2023-12-19T14:00:33.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.443+0000 7fd0a3fff640 1 --2- 172.21.15.113:0/3060489763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0b1610 0x7fd0ac15c120 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0cba50 tx=0x7fd09402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387417d239c0578e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:33.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0aa7fc640 1 -- 172.21.15.113:0/3060489763 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094031870 con 0x7fd0ac0b1610 2023-12-19T14:00:33.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0aa7fc640 1 -- 172.21.15.113:0/3060489763 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0940319d0 con 0x7fd0ac0b1610 2023-12-19T14:00:33.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0aa7fc640 1 -- 172.21.15.113:0/3060489763 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094031d60 con 0x7fd0ac0b1610 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 -- 172.21.15.113:0/3060489763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0b1610 msgr2=0x7fd0ac15c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 --2- 172.21.15.113:0/3060489763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0b1610 0x7fd0ac15c120 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0cba50 tx=0x7fd09402b910 comp rx=0 tx=0).stop 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 -- 172.21.15.113:0/3060489763 shutdown_connections 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 --2- 172.21.15.113:0/3060489763 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0b1610 0x7fd0ac15c120 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 --2- 172.21.15.113:0/3060489763 >> v2:172.21.15.151:3300/0 conn(0x7fd0ac0adf00 0x7fd0ac0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 -- 172.21.15.113:0/3060489763 >> 172.21.15.113:0/3060489763 conn(0x7fd0ac066160 msgr2=0x7fd0ac0cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 -- 172.21.15.113:0/3060489763 shutdown_connections 2023-12-19T14:00:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.444+0000 7fd0b1747640 1 -- 172.21.15.113:0/3060489763 wait complete. 2023-12-19T14:00:33.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.446+0000 7fd0b1747640 1 Processor -- start 2023-12-19T14:00:33.446 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.446+0000 7fd0b1747640 1 -- start start 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.447+0000 7fd0b1747640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0adf00 0x7fd0ac156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.447+0000 7fd0b1747640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac0b1610 0x7fd0ac1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.447+0000 7fd0b1747640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac15c660 0x7fd0ac1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.447+0000 7fd0b1747640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac156f30 con 0x7fd0ac0adf00 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.447+0000 7fd0b1747640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac155930 con 0x7fd0ac0b1610 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.447+0000 7fd0b1747640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac156c50 con 0x7fd0ac15c660 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.447+0000 7fd0aaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0adf00 0x7fd0ac156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0adf00 0x7fd0ac156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38670/0 (socket says 172.21.15.113:38670) 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 -- 172.21.15.113:0/1911609757 learned_addr learned my addr 172.21.15.113:0/1911609757 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0a3fff640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac0b1610 0x7fd0ac1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 -- 172.21.15.113:0/1911609757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac15c660 msgr2=0x7fd0ac1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac15c660 0x7fd0ac1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 -- 172.21.15.113:0/1911609757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac0b1610 msgr2=0x7fd0ac1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac0b1610 0x7fd0ac1553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 -- 172.21.15.113:0/1911609757 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940094d0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.449 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0aaffd640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0adf00 0x7fd0ac156570 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00d800 tx=0x7fd09c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0a37fe640 1 -- 172.21.15.113:0/1911609757 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00b6c0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.448+0000 7fd0a37fe640 1 -- 172.21.15.113:0/1911609757 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00b820 con 0x7fd0ac0adf00 2023-12-19T14:00:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.449+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac0cd640 con 0x7fd0ac0adf00 2023-12-19T14:00:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.449+0000 7fd0a37fe640 1 -- 172.21.15.113:0/1911609757 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00bbb0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.449+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac0cdc00 con 0x7fd0ac0adf00 2023-12-19T14:00:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.450+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac0cd4a0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.451+0000 7fd0a37fe640 1 -- 172.21.15.113:0/1911609757 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd09c00bd10 con 0x7fd0ac0adf00 2023-12-19T14:00:33.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.452+0000 7fd0a37fe640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd08c06a430 0x7fd08c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.452+0000 7fd0a37fe640 1 -- 172.21.15.113:0/1911609757 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd09c088b50 con 0x7fd0ac0adf00 2023-12-19T14:00:33.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.452+0000 7fd0a3fff640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd08c06a430 0x7fd08c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.453 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.453+0000 7fd0a3fff640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd08c06a430 0x7fd08c06c8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd094036000 tx=0x7fd09403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:33.456 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.456+0000 7fd0a37fe640 1 -- 172.21.15.113:0/1911609757 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0ac0cd4a0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.646 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.646+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd0ac0cd4a0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.654 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.654+0000 7fd0a37fe640 1 -- 172.21.15.113:0/1911609757 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd0ac0cd4a0 con 0x7fd0ac0adf00 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd08c06a430 msgr2=0x7fd08c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd08c06a430 0x7fd08c06c8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd094036000 tx=0x7fd09403c040 comp rx=0 tx=0).stop 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0adf00 msgr2=0x7fd0ac156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0adf00 0x7fd0ac156570 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00d800 tx=0x7fd09c00dcc0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 shutdown_connections 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fd08c06a430 0x7fd08c06c8f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac15c660 0x7fd0ac1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac0b1610 0x7fd0ac1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 --2- 172.21.15.113:0/1911609757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ac0adf00 0x7fd0ac156570 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.657+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 >> 172.21.15.113:0/1911609757 conn(0x7fd0ac066160 msgr2=0x7fd0ac0cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.658+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 shutdown_connections 2023-12-19T14:00:33.658 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.658+0000 7fd0b1747640 1 -- 172.21.15.113:0/1911609757 wait complete. 2023-12-19T14:00:33.675 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-19T14:00:33.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.888+0000 7fbde1c87640 1 Processor -- start 2023-12-19T14:00:33.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.888+0000 7fbde1c87640 1 -- start start 2023-12-19T14:00:33.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.889+0000 7fbde1c87640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 0x7fbddc0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.889+0000 7fbde1c87640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc0b0a90 con 0x7fbddc0b0640 2023-12-19T14:00:33.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.889+0000 7fbde1c87640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc0ae640 con 0x7fbddc157bf0 2023-12-19T14:00:33.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.889+0000 7fbde1c87640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc06b8c0 con 0x7fbddc0ae110 2023-12-19T14:00:33.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbddbfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbddc0b0640 0x7fbddc06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55000/0 (socket says 172.21.15.113:55000) 2023-12-19T14:00:33.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbddbfff640 1 -- 172.21.15.113:0/2699170793 learned_addr learned my addr 172.21.15.113:0/2699170793 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbddaffd640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 0x7fbddc0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176657663 0 0) 0x7fbdd4001490 con 0x7fbddc0b0640 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc4003520 con 0x7fbddc0b0640 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727593896 0 0) 0x7fbdc4003520 con 0x7fbddc0b0640 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 msgr2=0x7fbddc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbdda7fc640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 0x7fbddc0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 >> v1:172.21.15.151:6789/0 conn(0x7fbddc157bf0 legacy=0x7fbddc15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.890+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc0ae920 con 0x7fbddc0b0640 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fbdd4001b80 con 0x7fbddc0b0640 2023-12-19T14:00:33.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 >> v1:172.21.15.113:6789/0 conn(0x7fbddc0b0640 legacy=0x7fbddc06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 0x7fbdc4003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc4004090 0x7fbdc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc4004d70 0x7fbdc40051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc06b8c0 con 0x7fbdc4004090 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc400bbe0 con 0x7fbdc4004d70 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc400dfb0 con 0x7fbddc0ae110 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddaffd640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc4004090 0x7fbdc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddb7fe640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 0x7fbdc4003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddaffd640 1 -- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 msgr2=0x7fbdc4003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddaffd640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbddc0ae110 0x7fbdc4003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddbfff640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc4004d70 0x7fbdc40051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddaffd640 1 -- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc4004d70 msgr2=0x7fbdc40051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddaffd640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc4004d70 0x7fbdc40051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.891+0000 7fbddaffd640 1 -- 172.21.15.113:0/2699170793 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4003520 con 0x7fbdc4004090 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.893+0000 7fbddaffd640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc4004090 0x7fbdc40047c0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000ba00 tx=0x7fbdc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eaf82dbaeba389 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.893+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0032620 con 0x7fbdc4004090 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.893+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd0032780 con 0x7fbdc4004090 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.893+0000 7fbdda7fc640 1 -- 172.21.15.113:0/2699170793 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0032b10 con 0x7fbdc4004090 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.893+0000 7fbde1c87640 1 -- 172.21.15.113:0/2699170793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc4004090 msgr2=0x7fbdc40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.893+0000 7fbde1c87640 1 --2- 172.21.15.113:0/2699170793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdc4004090 0x7fbdc40047c0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000ba00 tx=0x7fbdc40057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.893+0000 7fbddbfff640 1 -- 172.21.15.113:0/2699170793 reap_dead start 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.894+0000 7fbde1c87640 1 -- 172.21.15.113:0/2699170793 shutdown_connections 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.894+0000 7fbde1c87640 1 -- 172.21.15.113:0/2699170793 >> 172.21.15.113:0/2699170793 conn(0x7fbddc0cbb70 msgr2=0x7fbddc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.894+0000 7fbde1c87640 1 -- 172.21.15.113:0/2699170793 shutdown_connections 2023-12-19T14:00:33.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.894+0000 7fbde1c87640 1 -- 172.21.15.113:0/2699170793 wait complete. 2023-12-19T14:00:33.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.895+0000 7fbde1c87640 1 Processor -- start 2023-12-19T14:00:33.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.896+0000 7fbde1c87640 1 -- start start 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.896+0000 7fbde1c87640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc4004090 0x7fbddc1f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.896+0000 7fbde1c87640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbddc152c10 0x7fbddc154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.896+0000 7fbde1c87640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbddc153070 0x7fbddc154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.896+0000 7fbde1c87640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc158b80 con 0x7fbddc152c10 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.896+0000 7fbde1c87640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc158e60 con 0x7fbddc153070 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.896+0000 7fbde1c87640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc159140 con 0x7fbdc4004090 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbddc152c10 0x7fbddc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbddc152c10 0x7fbddc154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38686/0 (socket says 172.21.15.113:38686) 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 -- 172.21.15.113:0/3038584318 learned_addr learned my addr 172.21.15.113:0/3038584318 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddb7fe640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc4004090 0x7fbddc1f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddbfff640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbddc153070 0x7fbddc154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 -- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc4004090 msgr2=0x7fbddc1f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc4004090 0x7fbddc1f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 -- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbddc153070 msgr2=0x7fbddc154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbddc153070 0x7fbddc154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.897+0000 7fbddaffd640 1 -- 172.21.15.113:0/3038584318 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc159420 con 0x7fbddc152c10 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.898+0000 7fbddaffd640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbddc152c10 0x7fbddc154530 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fbdd002bea0 tx=0x7fbdd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.898+0000 7fbdc3fff640 1 -- 172.21.15.113:0/3038584318 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd003b620 con 0x7fbddc152c10 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.898+0000 7fbdc3fff640 1 -- 172.21.15.113:0/3038584318 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd003b780 con 0x7fbddc152c10 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.898+0000 7fbdc3fff640 1 -- 172.21.15.113:0/3038584318 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd003bb30 con 0x7fbddc152c10 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.898+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc159700 con 0x7fbddc152c10 2023-12-19T14:00:33.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.898+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbddc15b6d0 con 0x7fbddc152c10 2023-12-19T14:00:33.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.899+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbddc1598c0 con 0x7fbddc152c10 2023-12-19T14:00:33.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.900+0000 7fbdc3fff640 1 -- 172.21.15.113:0/3038584318 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdd003bc90 con 0x7fbddc152c10 2023-12-19T14:00:33.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.901+0000 7fbdc3fff640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdc806a430 0x7fbdc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:33.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.901+0000 7fbdc3fff640 1 -- 172.21.15.113:0/3038584318 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbdd00aa830 con 0x7fbddc152c10 2023-12-19T14:00:33.901 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.901+0000 7fbddb7fe640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdc806a430 0x7fbdc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:33.902 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.902+0000 7fbddb7fe640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdc806a430 0x7fbdc806c8f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc007fd0 tx=0x7fbdcc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:33.905 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:33.906+0000 7fbdc3fff640 1 -- 172.21.15.113:0/3038584318 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbdd0076120 con 0x7fbddc152c10 2023-12-19T14:00:34.169 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.169+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fbddc061910 con 0x7fbddc152c10 2023-12-19T14:00:34.209 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.209+0000 7fbdc3fff640 1 -- 172.21.15.113:0/3038584318 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v663) v1 ==== 135+0+0 (secure 0 0 0) 0x7fbdd00360c0 con 0x7fbddc152c10 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdc806a430 msgr2=0x7fbdc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdc806a430 0x7fbdc806c8f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc007fd0 tx=0x7fbdcc009040 comp rx=0 tx=0).stop 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbddc152c10 msgr2=0x7fbddc154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbddc152c10 0x7fbddc154530 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fbdd002bea0 tx=0x7fbdd0004730 comp rx=0 tx=0).stop 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 shutdown_connections 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fbdc806a430 0x7fbdc806c8f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbddc153070 0x7fbddc154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbddc152c10 0x7fbddc154530 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 --2- 172.21.15.113:0/3038584318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc4004090 0x7fbddc1f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:34.212 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 >> 172.21.15.113:0/3038584318 conn(0x7fbddc0cbb70 msgr2=0x7fbddc06d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:34.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 shutdown_connections 2023-12-19T14:00:34.213 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:34.212+0000 7fbde1c87640 1 -- 172.21.15.113:0/3038584318 wait complete. 2023-12-19T14:00:34.231 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-19T14:00:34.231 INFO:tasks.cephfs_test_runner: 2023-12-19T14:00:34.231 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T14:00:34.231 INFO:tasks.cephfs_test_runner:Ran 10 tests in 800.815s 2023-12-19T14:00:34.231 INFO:tasks.cephfs_test_runner: 2023-12-19T14:00:34.231 INFO:tasks.cephfs_test_runner:OK 2023-12-19T14:00:34.232 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T14:00:34.241 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-19T14:00:34.249 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-19T14:00:34.249 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T14:00:34.249 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:34.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T14:00:34.300 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-19T14:00:34.300 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:34.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054290,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498812k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T14:00:34.350 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T14:00:34.350 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:34.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T14:00:34.409 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T14:00:34.409 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T14:00:34.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T14:00:34.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:34.461 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T14:00:34.522 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T14:00:34.522 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T14:00:34.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:34.523 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T14:00:34.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:34.621 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T14:00:34.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:34.707 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2023-12-19T14:00:34.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:34.856 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-19T14:00:34.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:34.907 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2023-12-19T14:00:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:Cannot find device "ceph-brx" 2023-12-19T14:00:35.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T14:00:35.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:35.047 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T14:00:35.108 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T14:00:35.109 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T14:00:35.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:35.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T14:00:35.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:35.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T14:00:35.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:35.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-19T14:00:35.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:35.403 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T14:00:35.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T14:00:35.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-19T14:00:35.578 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-12-19T14:00:35.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T14:00:35.582 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T14:00:35.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T14:00:35.591 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T14:00:35.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.811+0000 7fef32516640 1 Processor -- start 2023-12-19T14:00:35.811 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.811+0000 7fef32516640 1 -- start start 2023-12-19T14:00:35.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.812+0000 7fef32516640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 0x7fef2c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.812+0000 7fef32516640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fef2c0b0810 0x7fef2c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.812+0000 7fef32516640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c15b740 con 0x7fef2c0ae110 2023-12-19T14:00:35.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.812+0000 7fef32516640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c06b8c0 con 0x7fef2c0b0810 2023-12-19T14:00:35.812 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.812+0000 7fef32516640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0ae640 con 0x7fef2c157bf0 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.813+0000 7fef23fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fef2c0ae110 0x7fef2c0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55014/0 (socket says 172.21.15.113:55014) 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.813+0000 7fef23fff640 1 -- 172.21.15.113:0/3399036583 learned_addr learned my addr 172.21.15.113:0/3399036583 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.813+0000 7fef30ab3640 1 --2- 172.21.15.113:0/3399036583 >> v2:172.21.15.151:3300/0 conn(0x7fef2c0b0810 0x7fef2c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.813+0000 7fef2bfff640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 0x7fef2c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.813+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597456619 0 0) 0x7fef2c15b740 con 0x7fef2c0ae110 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.813+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef18005730 con 0x7fef2c0ae110 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196040353 0 0) 0x7fef18005730 con 0x7fef2c0ae110 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 msgr2=0x7fef2c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 0x7fef2c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 >> v2:172.21.15.151:3300/0 conn(0x7fef2c0b0810 msgr2=0x7fef2c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 --2- 172.21.15.113:0/3399036583 >> v2:172.21.15.151:3300/0 conn(0x7fef2c0b0810 0x7fef2c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0ae920 con 0x7fef2c0ae110 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fef14001670 con 0x7fef2c0ae110 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 >> v1:172.21.15.113:6789/0 conn(0x7fef2c0ae110 legacy=0x7fef2c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef18005bf0 0x7fef18006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180069d0 0x7fef18006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 0x7fef18007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c06b8c0 con 0x7fef180069d0 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0ae640 con 0x7fef18005bf0 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1800dc10 con 0x7fef2c157bf0 2023-12-19T14:00:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef23fff640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180069d0 0x7fef18006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef2bfff640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef18005bf0 0x7fef18006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.814+0000 7fef30ab3640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 0x7fef18007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.815+0000 7fef23fff640 1 -- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 msgr2=0x7fef18007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.815+0000 7fef23fff640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 0x7fef18007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.815+0000 7fef23fff640 1 -- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef18005bf0 msgr2=0x7fef18006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.815+0000 7fef23fff640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef18005bf0 0x7fef18006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.815+0000 7fef23fff640 1 -- 172.21.15.113:0/3399036583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef18005730 con 0x7fef180069d0 2023-12-19T14:00:35.817 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.815+0000 7fef30ab3640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef2c157bf0 0x7fef18007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:35.818 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.816+0000 7fef23fff640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180069d0 0x7fef18006e50 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c210 tx=0x7fef18007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebf089d24a38468 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.816+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14005ad0 con 0x7fef180069d0 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.816+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14005c30 con 0x7fef180069d0 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.816+0000 7fef2b7fe640 1 -- 172.21.15.113:0/3399036583 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1402c8d0 con 0x7fef180069d0 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.816+0000 7fef32516640 1 -- 172.21.15.113:0/3399036583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180069d0 msgr2=0x7fef18006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.816+0000 7fef32516640 1 --2- 172.21.15.113:0/3399036583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef180069d0 0x7fef18006e50 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c210 tx=0x7fef18007a00 comp rx=0 tx=0).stop 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.817+0000 7fef30ab3640 1 -- 172.21.15.113:0/3399036583 reap_dead start 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.817+0000 7fef32516640 1 -- 172.21.15.113:0/3399036583 shutdown_connections 2023-12-19T14:00:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.817+0000 7fef32516640 1 -- 172.21.15.113:0/3399036583 >> 172.21.15.113:0/3399036583 conn(0x7fef2c0cbb70 msgr2=0x7fef2c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:35.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.817+0000 7fef32516640 1 -- 172.21.15.113:0/3399036583 shutdown_connections 2023-12-19T14:00:35.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.817+0000 7fef32516640 1 -- 172.21.15.113:0/3399036583 wait complete. 2023-12-19T14:00:35.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.818+0000 7fef32516640 1 Processor -- start 2023-12-19T14:00:35.820 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.819+0000 7fef32516640 1 -- start start 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef32516640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180069d0 0x7fef2c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef32516640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef2c0c2b90 0x7fef2c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef32516640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef2c1547e0 0x7fef2c154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef32516640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c15e990 con 0x7fef2c0c2b90 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef32516640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c159020 con 0x7fef2c1547e0 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef32516640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0ce670 con 0x7fef180069d0 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef2c0c2b90 0x7fef2c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef2c0c2b90 0x7fef2c0acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38696/0 (socket says 172.21.15.113:38696) 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 -- 172.21.15.113:0/249838187 learned_addr learned my addr 172.21.15.113:0/249838187 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef2bfff640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180069d0 0x7fef2c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef30ab3640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef2c1547e0 0x7fef2c154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 -- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180069d0 msgr2=0x7fef2c15e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:35.822 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180069d0 0x7fef2c15e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 -- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef2c1547e0 msgr2=0x7fef2c154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef2c1547e0 0x7fef2c154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.820+0000 7fef23fff640 1 -- 172.21.15.113:0/249838187 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0c3090 con 0x7fef2c0c2b90 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.821+0000 7fef23fff640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef2c0c2b90 0x7fef2c0acb20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fef1402c540 tx=0x7fef14001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.821+0000 7fef297fa640 1 -- 172.21.15.113:0/249838187 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1402cce0 con 0x7fef2c0c2b90 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.821+0000 7fef297fa640 1 -- 172.21.15.113:0/249838187 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1402ce80 con 0x7fef2c0c2b90 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.821+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c159230 con 0x7fef2c0c2b90 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.821+0000 7fef297fa640 1 -- 172.21.15.113:0/249838187 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140072b0 con 0x7fef2c0c2b90 2023-12-19T14:00:35.823 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.821+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c1597f0 con 0x7fef2c0c2b90 2023-12-19T14:00:35.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.822+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c1599b0 con 0x7fef2c0c2b90 2023-12-19T14:00:35.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.823+0000 7fef297fa640 1 -- 172.21.15.113:0/249838187 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef14032070 con 0x7fef2c0c2b90 2023-12-19T14:00:35.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.824+0000 7fef297fa640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef0c06a460 0x7fef0c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:35.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.824+0000 7fef297fa640 1 -- 172.21.15.113:0/249838187 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fef140a9ac0 con 0x7fef2c0c2b90 2023-12-19T14:00:35.824 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.824+0000 7fef2bfff640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef0c06a460 0x7fef0c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:35.825 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.825+0000 7fef2bfff640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef0c06a460 0x7fef0c06c920 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fef1c006fd0 tx=0x7fef1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:35.828 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:35.829+0000 7fef297fa640 1 -- 172.21.15.113:0/249838187 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef14075570 con 0x7fef2c0c2b90 2023-12-19T14:00:36.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.017+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef2c0aeee0 con 0x7fef0c06a460 2023-12-19T14:00:36.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.023+0000 7fef297fa640 1 -- 172.21.15.113:0/249838187 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47248 (secure 0 0 0) 0x7fef1c0118e0 con 0x7fef0c06a460 2023-12-19T14:00:36.023 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:36.024 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T14:00:36.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef0c06a460 msgr2=0x7fef0c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef0c06a460 0x7fef0c06c920 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fef1c006fd0 tx=0x7fef1c008040 comp rx=0 tx=0).stop 2023-12-19T14:00:36.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef2c0c2b90 msgr2=0x7fef2c0acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef2c0c2b90 0x7fef2c0acb20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fef1402c540 tx=0x7fef14001a00 comp rx=0 tx=0).stop 2023-12-19T14:00:36.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 shutdown_connections 2023-12-19T14:00:36.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef0c06a460 0x7fef0c06c920 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.025 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef2c1547e0 0x7fef2c154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef2c0c2b90 0x7fef2c0acb20 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 --2- 172.21.15.113:0/249838187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef180069d0 0x7fef2c15e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 >> 172.21.15.113:0/249838187 conn(0x7fef2c0cbb70 msgr2=0x7fef2c0cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:36.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 shutdown_connections 2023-12-19T14:00:36.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.025+0000 7fef32516640 1 -- 172.21.15.113:0/249838187 wait complete. 2023-12-19T14:00:36.045 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":623,"stamp":"2023-12-19T14:00:34.701809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1449913,"statfs":{"total":1600000000,"available":1484711092,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490837,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002147"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":338,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-12-19T14:00:25.534981+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T14:00:25.534981+0000","last_peered":"2023-12-19T14:00:25.534981+0000","last_clean":"2023-12-19T14:00:25.534981+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T14:00:25.534981+0000","last_undegraded":"2023-12-19T14:00:25.534981+0000","last_fullsized":"2023-12-19T14:00:25.534981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575020,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190098,"statfs":{"total":200000000,"available":194661065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":1.0840000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.9059999999999999},"last":1.29},{"interface":"front","average":{"1min":1.131,"5min":1.1379999999999999,"15min":1.0880000000000001},"min":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.601,"5min":1.855,"15min":2.008},"last":0.95099999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1679999999999999,"15min":1.141},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.494,"5min":1.865,"15min":1.865},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.175,"15min":1.1359999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.54,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.159,"15min":1.1459999999999999},"min":{"1min":0.88900000000000001,"5min":0.77600000000000002,"15min":0.57499999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.008},"last":1.351},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2829999999999999,"15min":1.222},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7090000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2649999999999999,"15min":1.2330000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.6659999999999999,"15min":2.2589999999999999},"last":1.157},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3240000000000001,"15min":1.3029999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":0.98899999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2949999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.702,"5min":1.702,"15min":2.4089999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.359,"15min":1.367},"min":{"1min":0.83699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.901,"5min":1.901,"15min":2.6909999999999998},"last":1.5009999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.218,"15min":1.2490000000000001},"min":{"1min":0.72799999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":2.3109999999999999},"last":1.036},{"interface":"front","average":{"1min":1.375,"5min":1.4279999999999999,"15min":1.429},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6359999999999999,"5min":1.7949999999999999,"15min":2.7719999999999998},"last":1.47}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.387,"15min":1.369},"min":{"1min":0.65900000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.131},{"interface":"front","average":{"1min":1.47,"5min":1.5209999999999999,"15min":1.516},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.64800000000000002},"max":{"1min":1.833,"5min":1.9390000000000001,"15min":2.673},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834575020,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":17496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":177816,"statfs":{"total":200000000,"available":182084027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1499999999999999,"15min":1.0820000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.42699999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":2.0640000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.0940000000000001,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":3.2069999999999999},"last":1.2270000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0960000000000001,"15min":1.0649999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.851,"15min":1.962},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.135,"5min":1.206,"15min":1.1419999999999999},"min":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.63800000000000001},"max":{"1min":1.3340000000000001,"5min":1.671,"15min":1.671},"last":1.0840000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3300000000000001,"15min":1.28},"min":{"1min":1.1599999999999999,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.5960000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.29,"15min":1.242},"min":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.68100000000000005},"max":{"1min":1.7769999999999999,"5min":1.821,"15min":1.821},"last":0.99299999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":1.0660000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6919999999999999,"5min":1.782,"15min":4.2690000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2370000000000001},"min":{"1min":0.876,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.4850000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.3129999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3340000000000001,"15min":1.294},"min":{"1min":0.995,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.7130000000000001,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.323,"15min":1.333},"min":{"1min":0.86599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.623,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.5620000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.284,"15min":1.2909999999999999},"min":{"1min":0.92700000000000005,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.585,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4650000000000001,"15min":1.4330000000000001},"min":{"1min":1.002,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.857,"5min":2.117,"15min":2.169},"last":1.427}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.464,"15min":1.456},"min":{"1min":1.3839999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8540000000000001,"5min":1.8919999999999999,"15min":2.5419999999999998},"last":1.502},{"interface":"front","average":{"1min":1.508,"5min":1.4490000000000001,"15min":1.425},"min":{"1min":1.0469999999999999,"5min":0.89300000000000002,"15min":0.57999999999999996},"max":{"1min":1.7250000000000001,"5min":2.0219999999999998,"15min":2.141},"last":1.542}]}]},{"osd":5,"up_from":13,"seq":55834575020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22169,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173143,"statfs":{"total":200000000,"available":177298919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0880000000000001,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.631,"5min":1.631,"15min":1.835},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.645,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.5549999999999999,"15min":6.101},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.155,"15min":1.1220000000000001},"min":{"1min":0.70599999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.617,"5min":1.6439999999999999,"15min":2.077},"last":1.234}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6439999999999999,"5min":1.72,"15min":5.5350000000000001},"last":1.5},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.208,"15min":1.2270000000000001},"min":{"1min":0.85399999999999998,"5min":0.80500000000000005,"15min":0.66400000000000003},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.863},"last":1.3260000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.6599999999999999,"15min":5.6189999999999998},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.333,"15min":1.292},"min":{"1min":1.002,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.6200000000000001,"5min":1.752,"15min":1.8360000000000001},"last":1.462}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.264,"15min":1.2150000000000001},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.5429999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.661},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.734,"5min":1.798,"15min":5.6970000000000001},"last":1.7270000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":1.919,"15min":2.0310000000000001},"last":1.556},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3939999999999999,"15min":1.379},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6970000000000001,"5min":1.853,"15min":2.133},"last":1.907}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.462,"15min":1.4690000000000001},"min":{"1min":1.1919999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.8260000000000001,"5min":1.893,"15min":6.3959999999999999},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.498,"15min":1.4830000000000001},"min":{"1min":1.1930000000000001,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.7669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575020,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186002,"statfs":{"total":200000000,"available":190466727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.091,"15min":1.0509999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4350000000000001,"5min":1.679,"15min":2.1349999999999998},"last":1.095},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.143,"15min":1.1180000000000001},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.48799999999999999},"max":{"1min":1.4750000000000001,"5min":2.448,"15min":2.448},"last":0.91000000000000003}]},{"osd":1,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1519999999999999,"15min":1.0980000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.55,"5min":1.754,"15min":1.754},"last":1.282},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.50700000000000001},"max":{"1min":1.5509999999999999,"5min":3.117,"15min":3.117},"last":0.68200000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.21,"15min":1.1339999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5309999999999999,"5min":2.613,"15min":2.613},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.7070000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.94599999999999995}]},{"osd":3,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2929999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.409,"5min":2.653,"15min":2.653},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.278,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.51700000000000002},"max":{"1min":1.647,"5min":3.625,"15min":3.625},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5940000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.1659999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.415,"15min":1.375},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.921,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.486},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4419999999999999,"15min":1.4179999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.52200000000000002},"max":{"1min":1.7829999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5589999999999999,"15min":1.498},"min":{"1min":0.77000000000000002,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.746,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.593,"15min":1.5449999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.829,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.5580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575020,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":11411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":183901,"statfs":{"total":200000000,"available":188314660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":0.83899999999999997},"min":{"1min":0.67500000000000004,"5min":0.36499999999999999,"15min":0.249},"max":{"1min":1.2050000000000001,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.032,"5min":0.95799999999999996,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.5609999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.877,"15min":0.88},"min":{"1min":0.63500000000000001,"5min":0.46600000000000003,"15min":0.32800000000000001},"max":{"1min":1.137,"5min":1.413,"15min":5.3769999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.026,"15min":0.96199999999999997},"min":{"1min":0.83599999999999997,"5min":0.40899999999999997,"15min":0.29499999999999998},"max":{"1min":1.3799999999999999,"5min":1.573,"15min":2.387},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.077,"15min":1.0129999999999999},"min":{"1min":0.88600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.5820000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1000000000000001,"15min":1.0580000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.6319999999999999,"15min":2.657},"last":1.091}]},{"osd":4,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2909999999999999,"15min":1.2390000000000001},"min":{"1min":1.0329999999999999,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.583,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.2909999999999999,"15min":1.2370000000000001},"min":{"1min":0.90700000000000003,"5min":0.76300000000000001,"15min":0.54600000000000004},"max":{"1min":1.5269999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.306,"15min":1.2709999999999999},"min":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.58299999999999996},"max":{"1min":1.579,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.194},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.304,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.78700000000000003,"15min":0.66700000000000004},"max":{"1min":1.655,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.3380000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":1.0820000000000001,"5min":0.76900000000000002,"15min":0.53300000000000003},"max":{"1min":1.458,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.3919999999999999,"15min":1.3340000000000001},"min":{"1min":0.95799999999999996,"5min":0.81499999999999995,"15min":0.52600000000000002},"max":{"1min":1.6819999999999999,"5min":2.077,"15min":2.698},"last":1.3660000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4159999999999999,"15min":1.3420000000000001},"min":{"1min":1.258,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":2.1160000000000001,"15min":3.609},"last":1.605},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4399999999999999,"15min":1.3899999999999999},"min":{"1min":1.155,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.3979999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575020,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190103,"statfs":{"total":200000000,"available":194666391,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.83399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":2.258},"last":0.63},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.35899999999999999},"max":{"1min":1.1779999999999999,"5min":1.5600000000000001,"15min":11.85},"last":0.47999999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.91900000000000004,"15min":0.877},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.401,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.498},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.056,"15min":1.016},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3,"5min":4.681,"15min":11.788},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0369999999999999,"15min":0.97899999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.425,"5min":1.702,"15min":2.3109999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.042,"5min":1.137,"15min":1.079},"min":{"1min":0.56200000000000006,"5min":0.439,"15min":0.439},"max":{"1min":1.569,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.70899999999999996},"max":{"1min":1.534,"5min":1.6910000000000001,"15min":11.930999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2270000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.758,"5min":1.806,"15min":2.2189999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.347,"15min":1.3220000000000001},"min":{"1min":0.81499999999999995,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.542,"5min":1.7170000000000001,"15min":11.888},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.363,"15min":1.323},"min":{"1min":0.80700000000000005,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.6990000000000001,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.054}]},{"osd":6,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.3149999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.72399999999999998},"max":{"1min":1.756,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.351,"15min":1.304},"min":{"1min":0.88200000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.885,"5min":1.9370000000000001,"15min":2.286},"last":1.103}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.351},"min":{"1min":0.85599999999999998,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.9650000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.121},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.393,"15min":1.357},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67300000000000004},"max":{"1min":1.617,"5min":2.323,"15min":11.962999999999999},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22234,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173078,"statfs":{"total":200000000,"available":177232262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.2470000000000001,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":1.232},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.712,"5min":1.712,"15min":3.3500000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.101,"15min":1.117},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.887,"5min":1.887,"15min":5.2009999999999996},"last":1.425}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.04,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.835,"5min":1.835,"15min":3.4300000000000002},"last":1.026},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.0569999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1739999999999999,"15min":1.1759999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.61699999999999999},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.393},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.292,"15min":1.274},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.583,"5min":1.661,"15min":3.7080000000000002},"last":1.131}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.226,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.456,"5min":1.796,"15min":3.8849999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2609999999999999,"15min":1.319},"min":{"1min":0.75,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.748,"5min":1.77,"15min":15.576000000000001},"last":1.075}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.333},"min":{"1min":0.85299999999999998,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.345,"15min":1.3540000000000001},"min":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.895,"5min":1.895,"15min":3.786},"last":1.3}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.401,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.355,"15min":1.363},"min":{"1min":0.92400000000000004,"5min":0.89900000000000002,"15min":0.76500000000000001},"max":{"1min":1.913,"5min":2.032,"15min":4.0519999999999996},"last":1.3300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175768,"statfs":{"total":200000000,"available":179987041,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.79800000000000004},"min":{"1min":0.58399999999999996,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.337,"5min":1.502,"15min":1.6399999999999999},"last":0.755},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.4590000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":1.0469999999999999},"min":{"1min":0.58399999999999996,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.296,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":1.1499999999999999},"min":{"1min":0.54600000000000004,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.45,"5min":1.5509999999999999,"15min":41.758000000000003},"last":1.052}]},{"osd":3,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96699999999999997,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.45500000000000002,"15min":0.35099999999999998},"max":{"1min":1.4470000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.129,"15min":1.093},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.36499999999999999},"max":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":2.02},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6060000000000001,"5min":1.738,"15min":4.4269999999999996},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.286,"15min":1.2889999999999999},"min":{"1min":0.876,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":15.766},"last":1.2849999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.27,"15min":1.2789999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.0059999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.264,"15min":1.258},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.63100000000000001},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":4.3970000000000002},"last":1.1140000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3939999999999999,"15min":1.351},"min":{"1min":0.91400000000000003,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":5.4669999999999996},"last":1.087},{"interface":"front","average":{"1min":1.363,"5min":1.361,"15min":1.387},"min":{"1min":0.88400000000000001,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":17.161000000000001},"last":1.26}]},{"osd":7,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3839999999999999,"15min":1.3919999999999999},"min":{"1min":0.84499999999999997,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":2.387,"5min":2.387,"15min":14.381},"last":1.216},{"interface":"front","average":{"1min":1.363,"5min":1.325,"15min":1.3560000000000001},"min":{"1min":0.89100000000000001,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":2.121,"5min":2.121,"15min":9.7080000000000002},"last":1.1899999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T14:00:36.047 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T14:00:36.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.247+0000 7f3694773640 1 Processor -- start 2023-12-19T14:00:36.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.247+0000 7f3694773640 1 -- start start 2023-12-19T14:00:36.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.249+0000 7f3694773640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 0x7f368c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.249+0000 7f3694773640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c0cd840 con 0x7f368c0ce110 2023-12-19T14:00:36.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.249+0000 7f3694773640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c0b6e90 con 0x7f368c0d2b00 2023-12-19T14:00:36.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.249+0000 7f3694773640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0d2430 con 0x7f368c146e10 2023-12-19T14:00:36.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.249+0000 7f3692d10640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f368c0ce110 0x7f368c0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55018/0 (socket says 172.21.15.113:55018) 2023-12-19T14:00:36.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.249+0000 7f3692d10640 1 -- 172.21.15.113:0/4052186454 learned_addr learned my addr 172.21.15.113:0/4052186454 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:36.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.249+0000 7f369250f640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 0x7f368c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716478198 0 0) 0x7f368c0cd840 con 0x7f368c0ce110 2023-12-19T14:00:36.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3678003520 con 0x7f368c0ce110 2023-12-19T14:00:36.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3106415140 0 0) 0x7f3678003520 con 0x7f368c0ce110 2023-12-19T14:00:36.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 msgr2=0x7f368c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:36.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 0x7f368c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.251 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 >> v1:172.21.15.151:6789/0 conn(0x7f368c0d2b00 legacy=0x7f368c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0d2620 con 0x7f368c0ce110 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f36840019f0 con 0x7f368c0ce110 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 >> v1:172.21.15.113:6789/0 conn(0x7f368c0ce110 legacy=0x7f368c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3678003a10 0x7f3678003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780047c0 0x7f3678004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 0x7f36780051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367800bb10 con 0x7f36780047c0 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367800bc80 con 0x7f3678003a10 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.250+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367800be40 con 0x7f368c146e10 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f3691d0e640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780047c0 0x7f3678004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f369250f640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3678003a10 0x7f3678003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f3692d10640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 0x7f36780051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f3691d0e640 1 -- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 msgr2=0x7f36780051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:36.252 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f3691d0e640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f368c146e10 0x7f36780051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f3691d0e640 1 -- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3678003a10 msgr2=0x7f3678003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:36.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f3691d0e640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3678003a10 0x7f3678003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f3691d0e640 1 -- 172.21.15.113:0/4052186454 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678003520 con 0x7f36780047c0 2023-12-19T14:00:36.253 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.251+0000 7f369250f640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3678003a10 0x7f3678003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.252+0000 7f3691d0e640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780047c0 0x7f3678004c40 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f367c001750 tx=0x7f36780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaddba165a55110e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0052d0 con 0x7f36780047c0 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c02e050 con 0x7f36780047c0 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f369150d640 1 -- 172.21.15.113:0/4052186454 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0035f0 con 0x7f36780047c0 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f3694773640 1 -- 172.21.15.113:0/4052186454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780047c0 msgr2=0x7f3678004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f3694773640 1 --2- 172.21.15.113:0/4052186454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36780047c0 0x7f3678004c40 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f367c001750 tx=0x7f36780057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f3692d10640 1 -- 172.21.15.113:0/4052186454 reap_dead start 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f3694773640 1 -- 172.21.15.113:0/4052186454 shutdown_connections 2023-12-19T14:00:36.254 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f3694773640 1 -- 172.21.15.113:0/4052186454 >> 172.21.15.113:0/4052186454 conn(0x7f368c0b29c0 msgr2=0x7f368c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:36.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f3694773640 1 -- 172.21.15.113:0/4052186454 shutdown_connections 2023-12-19T14:00:36.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.253+0000 7f3694773640 1 -- 172.21.15.113:0/4052186454 wait complete. 2023-12-19T14:00:36.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.255+0000 7f3694773640 1 Processor -- start 2023-12-19T14:00:36.255 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.255+0000 7f3694773640 1 -- start start 2023-12-19T14:00:36.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.256+0000 7f3694773640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780047c0 0x7f368c15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.256+0000 7f3694773640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f368c145f80 0x7f368c144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.256+0000 7f3694773640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f368c1463c0 0x7f368c144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.256+0000 7f3694773640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c144dd0 con 0x7f368c1463c0 2023-12-19T14:00:36.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.256+0000 7f3694773640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c142880 con 0x7f368c145f80 2023-12-19T14:00:36.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.256+0000 7f3694773640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c142b20 con 0x7f36780047c0 2023-12-19T14:00:36.257 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.256+0000 7f3692d10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f368c1463c0 0x7f368c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f368c1463c0 0x7f368c144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38704/0 (socket says 172.21.15.113:38704) 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 -- 172.21.15.113:0/4036800979 learned_addr learned my addr 172.21.15.113:0/4036800979 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f369250f640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780047c0 0x7f368c15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3691d0e640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f368c145f80 0x7f368c144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 -- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780047c0 msgr2=0x7f368c15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780047c0 0x7f368c15c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 -- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f368c145f80 msgr2=0x7f368c144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f368c145f80 0x7f368c144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 -- 172.21.15.113:0/4036800979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c145020 con 0x7f368c1463c0 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f369250f640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780047c0 0x7f368c15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3691d0e640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f368c145f80 0x7f368c144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:36.258 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.257+0000 7f3692d10640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f368c1463c0 0x7f368c144890 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f3684007c40 tx=0x7f368400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:36.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.258+0000 7f3682ffd640 1 -- 172.21.15.113:0/4036800979 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684004d60 con 0x7f368c1463c0 2023-12-19T14:00:36.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.258+0000 7f3682ffd640 1 -- 172.21.15.113:0/4036800979 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400bb80 con 0x7f368c1463c0 2023-12-19T14:00:36.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.258+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c145300 con 0x7f368c1463c0 2023-12-19T14:00:36.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.258+0000 7f3682ffd640 1 -- 172.21.15.113:0/4036800979 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684007110 con 0x7f368c1463c0 2023-12-19T14:00:36.259 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.258+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c15ceb0 con 0x7f368c1463c0 2023-12-19T14:00:36.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.259+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c061910 con 0x7f368c1463c0 2023-12-19T14:00:36.260 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.260+0000 7f3682ffd640 1 -- 172.21.15.113:0/4036800979 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3684007270 con 0x7f368c1463c0 2023-12-19T14:00:36.261 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.261+0000 7f3682ffd640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f367006a480 0x7f367006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.262+0000 7f3682ffd640 1 -- 172.21.15.113:0/4036800979 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f36840886f0 con 0x7f368c1463c0 2023-12-19T14:00:36.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.262+0000 7f369250f640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f367006a480 0x7f367006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.262 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.262+0000 7f369250f640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f367006a480 0x7f367006c940 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3688009a80 tx=0x7f3688008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:36.265 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.265+0000 7f3682ffd640 1 -- 172.21.15.113:0/4036800979 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3684054050 con 0x7f368c1463c0 2023-12-19T14:00:36.452 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.451+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f368c142c90 con 0x7f367006a480 2023-12-19T14:00:36.455 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.455+0000 7f3682ffd640 1 -- 172.21.15.113:0/4036800979 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47248 (secure 0 0 0) 0x7f368c142c90 con 0x7f367006a480 2023-12-19T14:00:36.455 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:36.456 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T14:00:36.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.457+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f367006a480 msgr2=0x7f367006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f367006a480 0x7f367006c940 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3688009a80 tx=0x7f3688008040 comp rx=0 tx=0).stop 2023-12-19T14:00:36.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f368c1463c0 msgr2=0x7f368c144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f368c1463c0 0x7f368c144890 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f3684007c40 tx=0x7f368400b4a0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 shutdown_connections 2023-12-19T14:00:36.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f367006a480 0x7f367006c940 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.458 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f368c1463c0 0x7f368c144890 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f368c145f80 0x7f368c144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 --2- 172.21.15.113:0/4036800979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780047c0 0x7f368c15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 >> 172.21.15.113:0/4036800979 conn(0x7f368c0b29c0 msgr2=0x7f368c0b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:36.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 shutdown_connections 2023-12-19T14:00:36.459 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.458+0000 7f3694773640 1 -- 172.21.15.113:0/4036800979 wait complete. 2023-12-19T14:00:36.475 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":623,"stamp":"2023-12-19T14:00:34.701809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1449913,"statfs":{"total":1600000000,"available":1484711092,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490837,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002147"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":338,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-12-19T14:00:25.534981+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T14:00:25.534981+0000","last_peered":"2023-12-19T14:00:25.534981+0000","last_clean":"2023-12-19T14:00:25.534981+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T14:00:25.534981+0000","last_undegraded":"2023-12-19T14:00:25.534981+0000","last_fullsized":"2023-12-19T14:00:25.534981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575020,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190098,"statfs":{"total":200000000,"available":194661065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":1.0840000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.9059999999999999},"last":1.29},{"interface":"front","average":{"1min":1.131,"5min":1.1379999999999999,"15min":1.0880000000000001},"min":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.601,"5min":1.855,"15min":2.008},"last":0.95099999999999996}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1679999999999999,"15min":1.141},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.494,"5min":1.865,"15min":1.865},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.175,"15min":1.1359999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.54,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.159,"15min":1.1459999999999999},"min":{"1min":0.88900000000000001,"5min":0.77600000000000002,"15min":0.57499999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.008},"last":1.351},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2829999999999999,"15min":1.222},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7090000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2649999999999999,"15min":1.2330000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.6659999999999999,"15min":2.2589999999999999},"last":1.157},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3240000000000001,"15min":1.3029999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":0.98899999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2949999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.702,"5min":1.702,"15min":2.4089999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.359,"15min":1.367},"min":{"1min":0.83699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.901,"5min":1.901,"15min":2.6909999999999998},"last":1.5009999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.218,"15min":1.2490000000000001},"min":{"1min":0.72799999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":2.3109999999999999},"last":1.036},{"interface":"front","average":{"1min":1.375,"5min":1.4279999999999999,"15min":1.429},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6359999999999999,"5min":1.7949999999999999,"15min":2.7719999999999998},"last":1.47}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.387,"15min":1.369},"min":{"1min":0.65900000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.131},{"interface":"front","average":{"1min":1.47,"5min":1.5209999999999999,"15min":1.516},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.64800000000000002},"max":{"1min":1.833,"5min":1.9390000000000001,"15min":2.673},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834575020,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":17496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":177816,"statfs":{"total":200000000,"available":182084027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1499999999999999,"15min":1.0820000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.42699999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":2.0640000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.0940000000000001,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":3.2069999999999999},"last":1.2270000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0960000000000001,"15min":1.0649999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.851,"15min":1.962},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.135,"5min":1.206,"15min":1.1419999999999999},"min":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.63800000000000001},"max":{"1min":1.3340000000000001,"5min":1.671,"15min":1.671},"last":1.0840000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3300000000000001,"15min":1.28},"min":{"1min":1.1599999999999999,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.5960000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.29,"15min":1.242},"min":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.68100000000000005},"max":{"1min":1.7769999999999999,"5min":1.821,"15min":1.821},"last":0.99299999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":1.0660000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6919999999999999,"5min":1.782,"15min":4.2690000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2370000000000001},"min":{"1min":0.876,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.4850000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.3129999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3340000000000001,"15min":1.294},"min":{"1min":0.995,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.7130000000000001,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.323,"15min":1.333},"min":{"1min":0.86599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.623,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.5620000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.284,"15min":1.2909999999999999},"min":{"1min":0.92700000000000005,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.585,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4650000000000001,"15min":1.4330000000000001},"min":{"1min":1.002,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.857,"5min":2.117,"15min":2.169},"last":1.427}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.464,"15min":1.456},"min":{"1min":1.3839999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8540000000000001,"5min":1.8919999999999999,"15min":2.5419999999999998},"last":1.502},{"interface":"front","average":{"1min":1.508,"5min":1.4490000000000001,"15min":1.425},"min":{"1min":1.0469999999999999,"5min":0.89300000000000002,"15min":0.57999999999999996},"max":{"1min":1.7250000000000001,"5min":2.0219999999999998,"15min":2.141},"last":1.542}]}]},{"osd":5,"up_from":13,"seq":55834575020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22169,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173143,"statfs":{"total":200000000,"available":177298919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0880000000000001,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.631,"5min":1.631,"15min":1.835},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.645,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.5549999999999999,"15min":6.101},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.155,"15min":1.1220000000000001},"min":{"1min":0.70599999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.617,"5min":1.6439999999999999,"15min":2.077},"last":1.234}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6439999999999999,"5min":1.72,"15min":5.5350000000000001},"last":1.5},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.208,"15min":1.2270000000000001},"min":{"1min":0.85399999999999998,"5min":0.80500000000000005,"15min":0.66400000000000003},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.863},"last":1.3260000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.6599999999999999,"15min":5.6189999999999998},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.333,"15min":1.292},"min":{"1min":1.002,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.6200000000000001,"5min":1.752,"15min":1.8360000000000001},"last":1.462}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.264,"15min":1.2150000000000001},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.5429999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.661},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.734,"5min":1.798,"15min":5.6970000000000001},"last":1.7270000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":1.919,"15min":2.0310000000000001},"last":1.556},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3939999999999999,"15min":1.379},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6970000000000001,"5min":1.853,"15min":2.133},"last":1.907}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.462,"15min":1.4690000000000001},"min":{"1min":1.1919999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.8260000000000001,"5min":1.893,"15min":6.3959999999999999},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.498,"15min":1.4830000000000001},"min":{"1min":1.1930000000000001,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.7669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575020,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186002,"statfs":{"total":200000000,"available":190466727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.091,"15min":1.0509999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4350000000000001,"5min":1.679,"15min":2.1349999999999998},"last":1.095},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.143,"15min":1.1180000000000001},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.48799999999999999},"max":{"1min":1.4750000000000001,"5min":2.448,"15min":2.448},"last":0.91000000000000003}]},{"osd":1,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1519999999999999,"15min":1.0980000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.55,"5min":1.754,"15min":1.754},"last":1.282},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.50700000000000001},"max":{"1min":1.5509999999999999,"5min":3.117,"15min":3.117},"last":0.68200000000000005}]},{"osd":2,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.21,"15min":1.1339999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5309999999999999,"5min":2.613,"15min":2.613},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.7070000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.94599999999999995}]},{"osd":3,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2929999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.409,"5min":2.653,"15min":2.653},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.278,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.51700000000000002},"max":{"1min":1.647,"5min":3.625,"15min":3.625},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5940000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.1659999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.415,"15min":1.375},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.921,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.486},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4419999999999999,"15min":1.4179999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.52200000000000002},"max":{"1min":1.7829999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5589999999999999,"15min":1.498},"min":{"1min":0.77000000000000002,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.746,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.593,"15min":1.5449999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.829,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.5580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575020,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":11411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":183901,"statfs":{"total":200000000,"available":188314660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":0.83899999999999997},"min":{"1min":0.67500000000000004,"5min":0.36499999999999999,"15min":0.249},"max":{"1min":1.2050000000000001,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.032,"5min":0.95799999999999996,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.5609999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.877,"15min":0.88},"min":{"1min":0.63500000000000001,"5min":0.46600000000000003,"15min":0.32800000000000001},"max":{"1min":1.137,"5min":1.413,"15min":5.3769999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.026,"15min":0.96199999999999997},"min":{"1min":0.83599999999999997,"5min":0.40899999999999997,"15min":0.29499999999999998},"max":{"1min":1.3799999999999999,"5min":1.573,"15min":2.387},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.077,"15min":1.0129999999999999},"min":{"1min":0.88600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.5820000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1000000000000001,"15min":1.0580000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.6319999999999999,"15min":2.657},"last":1.091}]},{"osd":4,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2909999999999999,"15min":1.2390000000000001},"min":{"1min":1.0329999999999999,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.583,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.2909999999999999,"15min":1.2370000000000001},"min":{"1min":0.90700000000000003,"5min":0.76300000000000001,"15min":0.54600000000000004},"max":{"1min":1.5269999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.306,"15min":1.2709999999999999},"min":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.58299999999999996},"max":{"1min":1.579,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.194},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.304,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.78700000000000003,"15min":0.66700000000000004},"max":{"1min":1.655,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.3380000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":1.0820000000000001,"5min":0.76900000000000002,"15min":0.53300000000000003},"max":{"1min":1.458,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.3919999999999999,"15min":1.3340000000000001},"min":{"1min":0.95799999999999996,"5min":0.81499999999999995,"15min":0.52600000000000002},"max":{"1min":1.6819999999999999,"5min":2.077,"15min":2.698},"last":1.3660000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4159999999999999,"15min":1.3420000000000001},"min":{"1min":1.258,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":2.1160000000000001,"15min":3.609},"last":1.605},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4399999999999999,"15min":1.3899999999999999},"min":{"1min":1.155,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.3979999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575020,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190103,"statfs":{"total":200000000,"available":194666391,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.83399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":2.258},"last":0.63},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.35899999999999999},"max":{"1min":1.1779999999999999,"5min":1.5600000000000001,"15min":11.85},"last":0.47999999999999998}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.91900000000000004,"15min":0.877},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.401,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.498},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.056,"15min":1.016},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3,"5min":4.681,"15min":11.788},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0369999999999999,"15min":0.97899999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.425,"5min":1.702,"15min":2.3109999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.042,"5min":1.137,"15min":1.079},"min":{"1min":0.56200000000000006,"5min":0.439,"15min":0.439},"max":{"1min":1.569,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.70899999999999996},"max":{"1min":1.534,"5min":1.6910000000000001,"15min":11.930999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2270000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.758,"5min":1.806,"15min":2.2189999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.347,"15min":1.3220000000000001},"min":{"1min":0.81499999999999995,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.542,"5min":1.7170000000000001,"15min":11.888},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.363,"15min":1.323},"min":{"1min":0.80700000000000005,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.6990000000000001,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.054}]},{"osd":6,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.3149999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.72399999999999998},"max":{"1min":1.756,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.351,"15min":1.304},"min":{"1min":0.88200000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.885,"5min":1.9370000000000001,"15min":2.286},"last":1.103}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.351},"min":{"1min":0.85599999999999998,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.9650000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.121},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.393,"15min":1.357},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67300000000000004},"max":{"1min":1.617,"5min":2.323,"15min":11.962999999999999},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22234,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173078,"statfs":{"total":200000000,"available":177232262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.2470000000000001,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":1.232},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.712,"5min":1.712,"15min":3.3500000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.101,"15min":1.117},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.887,"5min":1.887,"15min":5.2009999999999996},"last":1.425}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.04,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.835,"5min":1.835,"15min":3.4300000000000002},"last":1.026},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.0569999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1739999999999999,"15min":1.1759999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.61699999999999999},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.393},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.292,"15min":1.274},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.583,"5min":1.661,"15min":3.7080000000000002},"last":1.131}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.226,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.456,"5min":1.796,"15min":3.8849999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2609999999999999,"15min":1.319},"min":{"1min":0.75,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.748,"5min":1.77,"15min":15.576000000000001},"last":1.075}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.333},"min":{"1min":0.85299999999999998,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.345,"15min":1.3540000000000001},"min":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.895,"5min":1.895,"15min":3.786},"last":1.3}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.401,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.355,"15min":1.363},"min":{"1min":0.92400000000000004,"5min":0.89900000000000002,"15min":0.76500000000000001},"max":{"1min":1.913,"5min":2.032,"15min":4.0519999999999996},"last":1.3300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175768,"statfs":{"total":200000000,"available":179987041,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.79800000000000004},"min":{"1min":0.58399999999999996,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.337,"5min":1.502,"15min":1.6399999999999999},"last":0.755},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.4590000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":1.0469999999999999},"min":{"1min":0.58399999999999996,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.296,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":1.1499999999999999},"min":{"1min":0.54600000000000004,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.45,"5min":1.5509999999999999,"15min":41.758000000000003},"last":1.052}]},{"osd":3,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96699999999999997,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.45500000000000002,"15min":0.35099999999999998},"max":{"1min":1.4470000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.129,"15min":1.093},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.36499999999999999},"max":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":2.02},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6060000000000001,"5min":1.738,"15min":4.4269999999999996},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.286,"15min":1.2889999999999999},"min":{"1min":0.876,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":15.766},"last":1.2849999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.27,"15min":1.2789999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.0059999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.264,"15min":1.258},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.63100000000000001},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":4.3970000000000002},"last":1.1140000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3939999999999999,"15min":1.351},"min":{"1min":0.91400000000000003,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":5.4669999999999996},"last":1.087},{"interface":"front","average":{"1min":1.363,"5min":1.361,"15min":1.387},"min":{"1min":0.88400000000000001,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":17.161000000000001},"last":1.26}]},{"osd":7,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3839999999999999,"15min":1.3919999999999999},"min":{"1min":0.84499999999999997,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":2.387,"5min":2.387,"15min":14.381},"last":1.216},{"interface":"front","average":{"1min":1.363,"5min":1.325,"15min":1.3560000000000001},"min":{"1min":0.89100000000000001,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":2.121,"5min":2.121,"15min":9.7080000000000002},"last":1.1899999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T14:00:36.477 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T14:00:36.477 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T14:00:36.662 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.662+0000 7fb3036c4640 1 Processor -- start 2023-12-19T14:00:36.663 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.663+0000 7fb3036c4640 1 -- start start 2023-12-19T14:00:36.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.664+0000 7fb3036c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb2fc0b0b50 0x7fb2fc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.664+0000 7fb3036c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc06bb30 con 0x7fb2fc06b590 2023-12-19T14:00:36.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.664+0000 7fb3036c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc0b0070 con 0x7fb2fc1449e0 2023-12-19T14:00:36.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.664+0000 7fb3036c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc0b0350 con 0x7fb2fc0b0b50 2023-12-19T14:00:36.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.664+0000 7fb301c61640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb2fc06b590 0x7fb2fc0b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55032/0 (socket says 172.21.15.113:55032) 2023-12-19T14:00:36.664 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.664+0000 7fb301c61640 1 -- 172.21.15.113:0/3020284184 learned_addr learned my addr 172.21.15.113:0/3020284184 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:36.665 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3020284184 >> v2:172.21.15.151:3300/0 conn(0x7fb2fc0b0b50 0x7fb2fc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.666 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148378625 0 0) 0x7fb2fc06bb30 con 0x7fb2fc06b590 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e8003520 con 0x7fb2fc06b590 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3122295903 0 0) 0x7fb2e8003520 con 0x7fb2fc06b590 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 >> v2:172.21.15.151:3300/0 conn(0x7fb2fc0b0b50 msgr2=0x7fb2fc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 --2- 172.21.15.113:0/3020284184 >> v2:172.21.15.151:3300/0 conn(0x7fb2fc0b0b50 0x7fb2fc06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 >> v1:172.21.15.151:6789/0 conn(0x7fb2fc1449e0 legacy=0x7fb2fc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0b0630 con 0x7fb2fc06b590 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7fb2f40019f0 con 0x7fb2fc06b590 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 >> v1:172.21.15.113:6789/0 conn(0x7fb2fc06b590 legacy=0x7fb2fc0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e80039e0 0x7fb2e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e80047c0 0x7fb2e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e8005180 0x7fb2e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0b0350 con 0x7fb2e80047c0 2023-12-19T14:00:36.667 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e800c0b0 con 0x7fb2e8005180 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.665+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e800c270 con 0x7fb2e80039e0 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e80047c0 0x7fb2e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb301c61640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e8005180 0x7fb2e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb301460640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e80039e0 0x7fb2e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb300c5f640 1 -- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e80039e0 msgr2=0x7fb2e8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e80039e0 0x7fb2e8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb300c5f640 1 -- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e8005180 msgr2=0x7fb2e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e8005180 0x7fb2e800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb300c5f640 1 -- 172.21.15.113:0/3020284184 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8003520 con 0x7fb2e80047c0 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb301c61640 1 -- 172.21.15.113:0/3020284184 reap_dead start 2023-12-19T14:00:36.668 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.666+0000 7fb301460640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e80039e0 0x7fb2e8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.667+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e80047c0 0x7fb2e8004c40 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009ac0 tx=0x7fb2e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfa33bec8d0d34f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.668+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec02c6b0 con 0x7fb2e80047c0 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.668+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec02c810 con 0x7fb2e80047c0 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.668+0000 7fb2f3fff640 1 -- 172.21.15.113:0/3020284184 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec02cba0 con 0x7fb2e80047c0 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.668+0000 7fb3036c4640 1 -- 172.21.15.113:0/3020284184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e80047c0 msgr2=0x7fb2e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.668+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e80047c0 0x7fb2e8004c40 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009ac0 tx=0x7fb2e80057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.669+0000 7fb3036c4640 1 -- 172.21.15.113:0/3020284184 shutdown_connections 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.669+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3020284184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e80047c0 0x7fb2e8004c40 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.669+0000 7fb3036c4640 1 -- 172.21.15.113:0/3020284184 >> 172.21.15.113:0/3020284184 conn(0x7fb2fc0cbb70 msgr2=0x7fb2fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.669+0000 7fb3036c4640 1 -- 172.21.15.113:0/3020284184 shutdown_connections 2023-12-19T14:00:36.670 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.669+0000 7fb3036c4640 1 -- 172.21.15.113:0/3020284184 wait complete. 2023-12-19T14:00:36.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.670+0000 7fb3036c4640 1 Processor -- start 2023-12-19T14:00:36.671 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.671+0000 7fb3036c4640 1 -- start start 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb3036c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e80047c0 0x7fb2fc143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb3036c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2fc137470 0x7fb2fc13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb3036c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2fc1378f0 0x7fb2fc13a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb3036c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc142e10 con 0x7fb2fc137470 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb3036c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc143770 con 0x7fb2e80047c0 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb3036c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc142190 con 0x7fb2fc1378f0 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2fc137470 0x7fb2fc13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2fc137470 0x7fb2fc13d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38724/0 (socket says 172.21.15.113:38724) 2023-12-19T14:00:36.672 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 -- 172.21.15.113:0/3678090515 learned_addr learned my addr 172.21.15.113:0/3678090515 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:36.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb301460640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e80047c0 0x7fb2fc143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 -- 172.21.15.113:0/3678090515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2fc1378f0 msgr2=0x7fb2fc13a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2fc1378f0 0x7fb2fc13a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.673 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 -- 172.21.15.113:0/3678090515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e80047c0 msgr2=0x7fb2fc143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e80047c0 0x7fb2fc143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.672+0000 7fb300c5f640 1 -- 172.21.15.113:0/3678090515 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc142470 con 0x7fb2fc137470 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.673+0000 7fb300c5f640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2fc137470 0x7fb2fc13d2c0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec037040 tx=0x7fb2ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.673+0000 7fb2f1ffb640 1 -- 172.21.15.113:0/3678090515 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec003810 con 0x7fb2fc137470 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.673+0000 7fb2f1ffb640 1 -- 172.21.15.113:0/3678090515 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec003970 con 0x7fb2fc137470 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.673+0000 7fb2f1ffb640 1 -- 172.21.15.113:0/3678090515 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec003d00 con 0x7fb2fc137470 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.673+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc142750 con 0x7fb2fc137470 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.673+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc141db0 con 0x7fb2fc137470 2023-12-19T14:00:36.674 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.674+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc061910 con 0x7fb2fc137470 2023-12-19T14:00:36.675 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.675+0000 7fb2f1ffb640 1 -- 172.21.15.113:0/3678090515 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb2ec040450 con 0x7fb2fc137470 2023-12-19T14:00:36.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.676+0000 7fb2f1ffb640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2e006a430 0x7fb2e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:36.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.676+0000 7fb2f1ffb640 1 -- 172.21.15.113:0/3678090515 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb2ec0aa5f0 con 0x7fb2fc137470 2023-12-19T14:00:36.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.676+0000 7fb301460640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2e006a430 0x7fb2e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:36.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.677+0000 7fb301460640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2e006a430 0x7fb2e006c8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc04f980 tx=0x7fb2f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:36.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.680+0000 7fb2f1ffb640 1 -- 172.21.15.113:0/3678090515 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb2ec075ed0 con 0x7fb2fc137470 2023-12-19T14:00:36.867 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.867+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2fc0af5d0 con 0x7fb2e006a430 2023-12-19T14:00:36.871 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.871+0000 7fb2f1ffb640 1 -- 172.21.15.113:0/3678090515 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47333 (secure 0 0 0) 0x7fb2f800d050 con 0x7fb2e006a430 2023-12-19T14:00:36.871 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:36.872 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T14:00:36.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2e006a430 msgr2=0x7fb2e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2e006a430 0x7fb2e006c8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc04f980 tx=0x7fb2f8009040 comp rx=0 tx=0).stop 2023-12-19T14:00:36.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2fc137470 msgr2=0x7fb2fc13d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:36.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2fc137470 0x7fb2fc13d2c0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec037040 tx=0x7fb2ec004730 comp rx=0 tx=0).stop 2023-12-19T14:00:36.874 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 shutdown_connections 2023-12-19T14:00:36.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fb2e006a430 0x7fb2e006c8f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2fc1378f0 0x7fb2fc13a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2fc137470 0x7fb2fc13d2c0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 --2- 172.21.15.113:0/3678090515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e80047c0 0x7fb2fc143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:36.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 >> 172.21.15.113:0/3678090515 conn(0x7fb2fc0cbb70 msgr2=0x7fb2fc15bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:36.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 shutdown_connections 2023-12-19T14:00:36.875 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:36.874+0000 7fb3036c4640 1 -- 172.21.15.113:0/3678090515 wait complete. 2023-12-19T14:00:36.893 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":624,"stamp":"2023-12-19T14:00:36.702325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10186,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552313,"statfs":{"total":1600000000,"available":1589569304,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490837,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.535518"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":340,"reported_epoch":203,"state":"active+clean","last_fresh":"2023-12-19T14:00:32.198008+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T14:00:32.198008+0000","last_peered":"2023-12-19T14:00:32.198008+0000","last_clean":"2023-12-19T14:00:32.198008+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T14:00:32.198008+0000","last_undegraded":"2023-12-19T14:00:32.198008+0000","last_fullsized":"2023-12-19T14:00:32.198008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:53:32.277389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":1.0840000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.9059999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1379999999999999,"15min":1.0880000000000001},"min":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.601,"5min":1.855,"15min":2.008},"last":1.004}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1679999999999999,"15min":1.141},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.494,"5min":1.865,"15min":1.865},"last":1.079},{"interface":"front","average":{"1min":1.198,"5min":1.175,"15min":1.1359999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.54,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":0.88300000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.159,"15min":1.1459999999999999},"min":{"1min":0.88900000000000001,"5min":0.77600000000000002,"15min":0.57499999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.008},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2829999999999999,"15min":1.222},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7090000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1799999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2649999999999999,"15min":1.2330000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.6659999999999999,"15min":2.2589999999999999},"last":1.409},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3240000000000001,"15min":1.3029999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":1.3400000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2949999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.702,"5min":1.702,"15min":2.4089999999999998},"last":1.536},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.359,"15min":1.367},"min":{"1min":0.83699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.901,"5min":1.901,"15min":2.6909999999999998},"last":1.5029999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.218,"15min":1.2490000000000001},"min":{"1min":0.72799999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":2.3109999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.4279999999999999,"15min":1.429},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6359999999999999,"5min":1.7949999999999999,"15min":2.7719999999999998},"last":1.6100000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.387,"15min":1.369},"min":{"1min":0.65900000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5209999999999999,"15min":1.516},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.64800000000000002},"max":{"1min":1.833,"5min":1.9390000000000001,"15min":2.673},"last":1.6639999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1499999999999999,"15min":1.0820000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.42699999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":2.0640000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.0940000000000001,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":3.2069999999999999},"last":1.0489999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0960000000000001,"15min":1.0649999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.851,"15min":1.962},"last":0.873},{"interface":"front","average":{"1min":1.135,"5min":1.206,"15min":1.1419999999999999},"min":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.63800000000000001},"max":{"1min":1.3340000000000001,"5min":1.671,"15min":1.671},"last":0.81299999999999994}]},{"osd":2,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3300000000000001,"15min":1.28},"min":{"1min":1.1599999999999999,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.5960000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.381,"5min":1.29,"15min":1.242},"min":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.68100000000000005},"max":{"1min":1.7769999999999999,"5min":1.821,"15min":1.821},"last":1.0069999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":1.0660000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6919999999999999,"5min":1.782,"15min":4.2690000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2370000000000001},"min":{"1min":0.876,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.4850000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":0.749}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3340000000000001,"15min":1.294},"min":{"1min":0.995,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.7130000000000001,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.361,"5min":1.323,"15min":1.333},"min":{"1min":0.86599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.623,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.284,"15min":1.2909999999999999},"min":{"1min":0.92700000000000005,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.585,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.627},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4650000000000001,"15min":1.4330000000000001},"min":{"1min":1.002,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.857,"5min":2.117,"15min":2.169},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.464,"15min":1.456},"min":{"1min":1.3839999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8540000000000001,"5min":1.8919999999999999,"15min":2.5419999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.508,"5min":1.4490000000000001,"15min":1.425},"min":{"1min":1.0469999999999999,"5min":0.89300000000000002,"15min":0.57999999999999996},"max":{"1min":1.7250000000000001,"5min":2.0219999999999998,"15min":2.141},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193606,"statfs":{"total":200000000,"available":198253387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0880000000000001,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.631,"5min":1.631,"15min":1.835},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.645,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.5549999999999999,"15min":6.101},"last":1.073},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.155,"15min":1.1220000000000001},"min":{"1min":0.70599999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.617,"5min":1.6439999999999999,"15min":2.077},"last":1.054}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6439999999999999,"5min":1.72,"15min":5.5350000000000001},"last":1.204},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.208,"15min":1.2270000000000001},"min":{"1min":0.85399999999999998,"5min":0.80500000000000005,"15min":0.66400000000000003},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.863},"last":0.94399999999999995}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.6599999999999999,"15min":5.6189999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.333,"15min":1.292},"min":{"1min":1.002,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.6200000000000001,"5min":1.752,"15min":1.8360000000000001},"last":1.165}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.264,"15min":1.2150000000000001},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.5429999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.734,"5min":1.798,"15min":5.6970000000000001},"last":1.5289999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":1.919,"15min":2.0310000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3939999999999999,"15min":1.379},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6970000000000001,"5min":1.853,"15min":2.133},"last":1.264}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.462,"15min":1.4690000000000001},"min":{"1min":1.1919999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.8260000000000001,"5min":1.893,"15min":6.3959999999999999},"last":1.468},{"interface":"front","average":{"1min":1.496,"5min":1.498,"15min":1.4830000000000001},"min":{"1min":1.1930000000000001,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.393}]}]},{"osd":4,"up_from":13,"seq":55834575021,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.091,"15min":1.0509999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4350000000000001,"5min":1.679,"15min":2.1349999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.143,"15min":1.1180000000000001},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.48799999999999999},"max":{"1min":1.4750000000000001,"5min":2.448,"15min":2.448},"last":0.749}]},{"osd":1,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1519999999999999,"15min":1.0980000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.55,"5min":1.754,"15min":1.754},"last":0.874},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.50700000000000001},"max":{"1min":1.5509999999999999,"5min":3.117,"15min":3.117},"last":0.81399999999999995}]},{"osd":2,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.21,"15min":1.1339999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5309999999999999,"5min":2.613,"15min":2.613},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.7070000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.4119999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2929999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.409,"5min":2.653,"15min":2.653},"last":1.194},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.3149999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.278,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.51700000000000002},"max":{"1min":1.647,"5min":3.625,"15min":3.625},"last":1.151},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5940000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.2869999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.415,"15min":1.375},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.921,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4419999999999999,"15min":1.4179999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.52200000000000002},"max":{"1min":1.7829999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.47}]},{"osd":7,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5589999999999999,"15min":1.498},"min":{"1min":0.77000000000000002,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.746,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.7709999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.593,"15min":1.5449999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.829,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.673}]}]},{"osd":3,"up_from":13,"seq":55834575021,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":0.83899999999999997},"min":{"1min":0.67500000000000004,"5min":0.36499999999999999,"15min":0.249},"max":{"1min":1.2050000000000001,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.032,"5min":0.95799999999999996,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.5609999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":0.66000000000000003}]},{"osd":1,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.877,"15min":0.88},"min":{"1min":0.63500000000000001,"5min":0.46600000000000003,"15min":0.32800000000000001},"max":{"1min":1.137,"5min":1.413,"15min":5.3769999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.026,"15min":0.96199999999999997},"min":{"1min":0.83599999999999997,"5min":0.40899999999999997,"15min":0.29499999999999998},"max":{"1min":1.3799999999999999,"5min":1.573,"15min":2.387},"last":0.53500000000000003}]},{"osd":2,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.077,"15min":1.0129999999999999},"min":{"1min":0.88600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.5820000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1000000000000001,"15min":1.0580000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.6319999999999999,"15min":2.657},"last":0.64600000000000002}]},{"osd":4,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2909999999999999,"15min":1.2390000000000001},"min":{"1min":1.0329999999999999,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.583,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.258,"5min":1.2909999999999999,"15min":1.2370000000000001},"min":{"1min":0.90700000000000003,"5min":0.76300000000000001,"15min":0.54600000000000004},"max":{"1min":1.5269999999999999,"5min":1.732,"15min":2.7690000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.306,"15min":1.2709999999999999},"min":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.58299999999999996},"max":{"1min":1.579,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.04},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.304,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.78700000000000003,"15min":0.66700000000000004},"max":{"1min":1.655,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":1.0820000000000001,"5min":0.76900000000000002,"15min":0.53300000000000003},"max":{"1min":1.458,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.391,"5min":1.3919999999999999,"15min":1.3340000000000001},"min":{"1min":0.95799999999999996,"5min":0.81499999999999995,"15min":0.52600000000000002},"max":{"1min":1.6819999999999999,"5min":2.077,"15min":2.698},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4159999999999999,"15min":1.3420000000000001},"min":{"1min":1.258,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":2.1160000000000001,"15min":3.609},"last":1.014},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4399999999999999,"15min":1.3899999999999999},"min":{"1min":1.155,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.0760000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.83399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":2.258},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.35899999999999999},"max":{"1min":1.1779999999999999,"5min":1.5600000000000001,"15min":11.85},"last":0.68799999999999994}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.91900000000000004,"15min":0.877},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.401,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.056,"15min":1.016},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3,"5min":4.681,"15min":11.788},"last":1.1100000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0369999999999999,"15min":0.97899999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.425,"5min":1.702,"15min":2.3109999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.042,"5min":1.137,"15min":1.079},"min":{"1min":0.56200000000000006,"5min":0.439,"15min":0.439},"max":{"1min":1.569,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":1.2470000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.70899999999999996},"max":{"1min":1.534,"5min":1.6910000000000001,"15min":11.930999999999999},"last":1.282},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2270000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.758,"5min":1.806,"15min":2.2189999999999999},"last":1.3160000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.347,"15min":1.3220000000000001},"min":{"1min":0.81499999999999995,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.542,"5min":1.7170000000000001,"15min":11.888},"last":1.409},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.363,"15min":1.323},"min":{"1min":0.80700000000000005,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.6990000000000001,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.367}]},{"osd":6,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.3149999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.72399999999999998},"max":{"1min":1.756,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.351,"15min":1.304},"min":{"1min":0.88200000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.885,"5min":1.9370000000000001,"15min":2.286},"last":1.0649999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.351},"min":{"1min":0.85599999999999998,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.9650000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.393,"15min":1.357},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67300000000000004},"max":{"1min":1.617,"5min":2.323,"15min":11.962999999999999},"last":1.208}]}]},{"osd":1,"up_from":13,"seq":55834575021,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193606,"statfs":{"total":200000000,"available":198253387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.2470000000000001,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.712,"5min":1.712,"15min":3.3500000000000001},"last":0.52000000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.101,"15min":1.117},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.887,"5min":1.887,"15min":5.2009999999999996},"last":0.65100000000000002}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.04,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.835,"5min":1.835,"15min":3.4300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.0569999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":0.75700000000000001}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1739999999999999,"15min":1.1759999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.61699999999999999},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.544},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.292,"15min":1.274},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.583,"5min":1.661,"15min":3.7080000000000002},"last":1.147}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.226,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.456,"5min":1.796,"15min":3.8849999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2609999999999999,"15min":1.319},"min":{"1min":0.75,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.748,"5min":1.77,"15min":15.576000000000001},"last":1.1040000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.333},"min":{"1min":0.85299999999999998,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":1.393},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.345,"15min":1.3540000000000001},"min":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.895,"5min":1.895,"15min":3.786},"last":1.607}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.401,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.355,"15min":1.363},"min":{"1min":0.92400000000000004,"5min":0.89900000000000002,"15min":0.76500000000000001},"max":{"1min":1.913,"5min":2.032,"15min":4.0519999999999996},"last":1.3720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.79800000000000004},"min":{"1min":0.58399999999999996,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.337,"5min":1.502,"15min":1.6399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.4590000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":1.0469999999999999},"min":{"1min":0.58399999999999996,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.296,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":1.1499999999999999},"min":{"1min":0.54600000000000004,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.45,"5min":1.5509999999999999,"15min":41.758000000000003},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96699999999999997,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.45500000000000002,"15min":0.35099999999999998},"max":{"1min":1.4470000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.129,"15min":1.093},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.36499999999999999},"max":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":2.02},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6060000000000001,"5min":1.738,"15min":4.4269999999999996},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.286,"15min":1.2889999999999999},"min":{"1min":0.876,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":15.766},"last":1.268}]},{"osd":5,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.27,"15min":1.2789999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.0059999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.264,"15min":1.258},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.63100000000000001},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":4.3970000000000002},"last":1.415}]},{"osd":6,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3939999999999999,"15min":1.351},"min":{"1min":0.91400000000000003,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":5.4669999999999996},"last":1.446},{"interface":"front","average":{"1min":1.363,"5min":1.361,"15min":1.387},"min":{"1min":0.88400000000000001,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":17.161000000000001},"last":1.4370000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3839999999999999,"15min":1.3919999999999999},"min":{"1min":0.84499999999999997,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":2.387,"5min":2.387,"15min":14.381},"last":1.286},{"interface":"front","average":{"1min":1.363,"5min":1.325,"15min":1.3560000000000001},"min":{"1min":0.89100000000000001,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":2.121,"5min":2.121,"15min":9.7080000000000002},"last":1.3380000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T14:00:36.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T14:00:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.080+0000 7f96747e0640 1 Processor -- start 2023-12-19T14:00:37.080 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.080+0000 7f96747e0640 1 -- start start 2023-12-19T14:00:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.082+0000 7f96747e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c146e10 0x7f966c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.082+0000 7f96747e0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f966c0d2b00 0x7f966c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.082+0000 7f96747e0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c0cd840 con 0x7f966c0ce110 2023-12-19T14:00:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.082+0000 7f96747e0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c0d2430 con 0x7f966c0d2b00 2023-12-19T14:00:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.082+0000 7f96747e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0d2620 con 0x7f966c146e10 2023-12-19T14:00:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.082+0000 7f9672d7d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f966c0ce110 0x7f966c0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55044/0 (socket says 172.21.15.113:55044) 2023-12-19T14:00:37.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.082+0000 7f9672d7d640 1 -- 172.21.15.113:0/1769197293 learned_addr learned my addr 172.21.15.113:0/1769197293 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:37.084 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967257c640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c146e10 0x7f966c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f9671d7b640 1 --2- 172.21.15.113:0/1769197293 >> v2:172.21.15.151:3300/0 conn(0x7f966c0d2b00 0x7f966c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934322909 0 0) 0x7f966c0cd840 con 0x7f966c0ce110 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9658003520 con 0x7f966c0ce110 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1583956414 0 0) 0x7f9658003520 con 0x7f966c0ce110 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c146e10 msgr2=0x7f966c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c146e10 0x7f966c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 >> v2:172.21.15.151:3300/0 conn(0x7f966c0d2b00 msgr2=0x7f966c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 --2- 172.21.15.113:0/1769197293 >> v2:172.21.15.151:3300/0 conn(0x7f966c0d2b00 0x7f966c0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0b41c0 con 0x7f966c0ce110 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f96640019f0 con 0x7f966c0ce110 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 >> v1:172.21.15.113:6789/0 conn(0x7f966c0ce110 legacy=0x7f966c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f9658003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.085 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96580047c0 0x7f9658004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658005180 0x7f965800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0d2620 con 0x7f96580039e0 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965800bfa0 con 0x7f9658005180 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965800c160 con 0x7f96580047c0 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.083+0000 7f967257c640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c146e10 0x7f966c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f967257c640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f9658003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f9672d7d640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658005180 0x7f965800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f9671d7b640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96580047c0 0x7f9658004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f967257c640 1 -- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96580047c0 msgr2=0x7f9658004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f967257c640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96580047c0 0x7f9658004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f967257c640 1 -- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658005180 msgr2=0x7f965800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f967257c640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658005180 0x7f965800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.084+0000 7f967257c640 1 -- 172.21.15.113:0/1769197293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658003520 con 0x7f96580039e0 2023-12-19T14:00:37.086 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.085+0000 7f967257c640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f9658003e00 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f9668006fd0 tx=0x7f96580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9b2558f2f8ca87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.085+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668033600 con 0x7f96580039e0 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.085+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966802f050 con 0x7f96580039e0 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.085+0000 7f967157a640 1 -- 172.21.15.113:0/1769197293 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668033980 con 0x7f96580039e0 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.086+0000 7f96747e0640 1 -- 172.21.15.113:0/1769197293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 msgr2=0x7f9658003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.086+0000 7f96747e0640 1 --2- 172.21.15.113:0/1769197293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f9658003e00 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f9668006fd0 tx=0x7f96580057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.086+0000 7f9672d7d640 1 -- 172.21.15.113:0/1769197293 reap_dead start 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.086+0000 7f96747e0640 1 -- 172.21.15.113:0/1769197293 shutdown_connections 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.086+0000 7f96747e0640 1 -- 172.21.15.113:0/1769197293 >> 172.21.15.113:0/1769197293 conn(0x7f966c0b29c0 msgr2=0x7f966c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.086+0000 7f96747e0640 1 -- 172.21.15.113:0/1769197293 shutdown_connections 2023-12-19T14:00:37.088 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.086+0000 7f96747e0640 1 -- 172.21.15.113:0/1769197293 wait complete. 2023-12-19T14:00:37.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.088+0000 7f96747e0640 1 Processor -- start 2023-12-19T14:00:37.089 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.088+0000 7f96747e0640 1 -- start start 2023-12-19T14:00:37.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f96747e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f966c142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f96747e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f966c13e310 0x7f966c1f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f96747e0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c06fac0 0x7f966c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f96747e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c070480 con 0x7f96580039e0 2023-12-19T14:00:37.090 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f96747e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c13e770 con 0x7f966c13e310 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f96747e0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c13ea10 con 0x7f966c06fac0 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f966c142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f966c142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38740/0 (socket says 172.21.15.113:38740) 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 -- 172.21.15.113:0/579317583 learned_addr learned my addr 172.21.15.113:0/579317583 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 -- 172.21.15.113:0/579317583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c06fac0 msgr2=0x7f966c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c06fac0 0x7f966c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 -- 172.21.15.113:0/579317583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f966c13e310 msgr2=0x7f966c1f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f966c13e310 0x7f966c1f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.089+0000 7f967257c640 1 -- 172.21.15.113:0/579317583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c13ecf0 con 0x7f96580039e0 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.090+0000 7f967257c640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f966c142b60 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f966c0d03c0 tx=0x7f96680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.090+0000 7f9662ffd640 1 -- 172.21.15.113:0/579317583 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966803d710 con 0x7f96580039e0 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.090+0000 7f9662ffd640 1 -- 172.21.15.113:0/579317583 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966803d870 con 0x7f96580039e0 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.090+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c13efd0 con 0x7f96580039e0 2023-12-19T14:00:37.091 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.090+0000 7f9662ffd640 1 -- 172.21.15.113:0/579317583 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966803dc00 con 0x7f96580039e0 2023-12-19T14:00:37.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.090+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c13f590 con 0x7f96580039e0 2023-12-19T14:00:37.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.091+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c0cdca0 con 0x7f96580039e0 2023-12-19T14:00:37.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.092+0000 7f9662ffd640 1 -- 172.21.15.113:0/579317583 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9668032420 con 0x7f96580039e0 2023-12-19T14:00:37.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.093+0000 7f9662ffd640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f965006a460 0x7f965006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:37.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.093+0000 7f9662ffd640 1 -- 172.21.15.113:0/579317583 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f96680aa170 con 0x7f96580039e0 2023-12-19T14:00:37.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.093+0000 7f9671d7b640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f965006a460 0x7f965006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:37.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.094+0000 7f9671d7b640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f965006a460 0x7f965006c920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f965c006a90 tx=0x7f965c006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:37.101 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.101+0000 7f9662ffd640 1 -- 172.21.15.113:0/579317583 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9668075a50 con 0x7f96580039e0 2023-12-19T14:00:37.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.292+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f966c156d60 con 0x7f96580039e0 2023-12-19T14:00:37.293 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.294+0000 7f9662ffd640 1 -- 172.21.15.113:0/579317583 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+12579 (secure 0 0 0) 0x7f9668079070 con 0x7f96580039e0 2023-12-19T14:00:37.294 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:37.294 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":204,"fsid":"b8121e09-ebc1-4371-9bac-afd10a2a5b83","created":"2023-12-19T13:46:13.655778+0000","modified":"2023-12-19T14:00:33.191727+0000","last_up_change":"2023-12-19T13:46:20.209042+0000","last_in_change":"2023-12-19T13:46:17.187145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:46:20.490857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":84090},{"type":"v1","addr":"172.21.15.113:6814","nonce":84090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":84090},{"type":"v1","addr":"172.21.15.113:6821","nonce":84090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":84090},{"type":"v1","addr":"172.21.15.113:6831","nonce":84090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":84090},{"type":"v1","addr":"172.21.15.113:6828","nonce":84090}]},"public_addr":"172.21.15.113:6814/84090","cluster_addr":"172.21.15.113:6821/84090","heartbeat_back_addr":"172.21.15.113:6831/84090","heartbeat_front_addr":"172.21.15.113:6828/84090","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":84088},{"type":"v1","addr":"172.21.15.113:6801","nonce":84088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":84088},{"type":"v1","addr":"172.21.15.113:6803","nonce":84088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":84088},{"type":"v1","addr":"172.21.15.113:6807","nonce":84088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":84088},{"type":"v1","addr":"172.21.15.113:6805","nonce":84088}]},"public_addr":"172.21.15.113:6801/84088","cluster_addr":"172.21.15.113:6803/84088","heartbeat_back_addr":"172.21.15.113:6807/84088","heartbeat_front_addr":"172.21.15.113:6805/84088","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":84093},{"type":"v1","addr":"172.21.15.113:6812","nonce":84093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":84093},{"type":"v1","addr":"172.21.15.113:6818","nonce":84093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":84093},{"type":"v1","addr":"172.21.15.113:6827","nonce":84093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":84093},{"type":"v1","addr":"172.21.15.113:6822","nonce":84093}]},"public_addr":"172.21.15.113:6812/84093","cluster_addr":"172.21.15.113:6818/84093","heartbeat_back_addr":"172.21.15.113:6827/84093","heartbeat_front_addr":"172.21.15.113:6822/84093","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":84094},{"type":"v1","addr":"172.21.15.113:6810","nonce":84094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":84094},{"type":"v1","addr":"172.21.15.113:6816","nonce":84094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":84094},{"type":"v1","addr":"172.21.15.113:6829","nonce":84094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6819","nonce":84094},{"type":"v1","addr":"172.21.15.113:6823","nonce":84094}]},"public_addr":"172.21.15.113:6810/84094","cluster_addr":"172.21.15.113:6816/84094","heartbeat_back_addr":"172.21.15.113:6829/84094","heartbeat_front_addr":"172.21.15.113:6823/84094","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":84063},{"type":"v1","addr":"172.21.15.151:6801","nonce":84063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":84063},{"type":"v1","addr":"172.21.15.151:6803","nonce":84063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":84063},{"type":"v1","addr":"172.21.15.151:6807","nonce":84063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":84063},{"type":"v1","addr":"172.21.15.151:6805","nonce":84063}]},"public_addr":"172.21.15.151:6801/84063","cluster_addr":"172.21.15.151:6803/84063","heartbeat_back_addr":"172.21.15.151:6807/84063","heartbeat_front_addr":"172.21.15.151:6805/84063","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":84062},{"type":"v1","addr":"172.21.15.151:6809","nonce":84062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":84062},{"type":"v1","addr":"172.21.15.151:6811","nonce":84062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":84062},{"type":"v1","addr":"172.21.15.151:6816","nonce":84062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":84062},{"type":"v1","addr":"172.21.15.151:6813","nonce":84062}]},"public_addr":"172.21.15.151:6809/84062","cluster_addr":"172.21.15.151:6811/84062","heartbeat_back_addr":"172.21.15.151:6816/84062","heartbeat_front_addr":"172.21.15.151:6813/84062","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":84065},{"type":"v1","addr":"172.21.15.151:6825","nonce":84065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":84065},{"type":"v1","addr":"172.21.15.151:6827","nonce":84065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":84065},{"type":"v1","addr":"172.21.15.151:6831","nonce":84065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":84065},{"type":"v1","addr":"172.21.15.151:6829","nonce":84065}]},"public_addr":"172.21.15.151:6825/84065","cluster_addr":"172.21.15.151:6827/84065","heartbeat_back_addr":"172.21.15.151:6831/84065","heartbeat_front_addr":"172.21.15.151:6829/84065","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":84064},{"type":"v1","addr":"172.21.15.151:6817","nonce":84064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":84064},{"type":"v1","addr":"172.21.15.151:6819","nonce":84064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":84064},{"type":"v1","addr":"172.21.15.151:6823","nonce":84064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":84064},{"type":"v1","addr":"172.21.15.151:6821","nonce":84064}]},"public_addr":"172.21.15.151:6817/84064","cluster_addr":"172.21.15.151:6819/84064","heartbeat_back_addr":"172.21.15.151:6823/84064","heartbeat_front_addr":"172.21.15.151:6821/84064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.452587+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.400953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.474166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.486247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.491768+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.412231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.510911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:46:18.471808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:6837/3462211339":"2023-12-20T14:00:30.160812+0000","172.21.15.113:6835/3462211339":"2023-12-20T14:00:30.160812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T14:00:37.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f965006a460 msgr2=0x7f965006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f965006a460 0x7f965006c920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f965c006a90 tx=0x7f965c006a20 comp rx=0 tx=0).stop 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 msgr2=0x7f966c142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f966c142b60 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f966c0d03c0 tx=0x7f96680046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 shutdown_connections 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f965006a460 0x7f965006c920 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f966c06fac0 0x7f966c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f966c13e310 0x7f966c1f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 --2- 172.21.15.113:0/579317583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f96580039e0 0x7f966c142b60 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 >> 172.21.15.113:0/579317583 conn(0x7f966c0b29c0 msgr2=0x7f966c0709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 shutdown_connections 2023-12-19T14:00:37.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:37.297+0000 7f96747e0640 1 -- 172.21.15.113:0/579317583 wait complete. 2023-12-19T14:00:38.315 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T14:00:38.315 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:38.533 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.533+0000 7f3974d77640 1 Processor -- start 2023-12-19T14:00:38.534 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.534+0000 7f3974d77640 1 -- start start 2023-12-19T14:00:38.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.535+0000 7f3974d77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 0x7f39700b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.535+0000 7f3974d77640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f39700b1d90 0x7f39700d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.535+0000 7f3974d77640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39700d07c0 con 0x7f39700d3650 2023-12-19T14:00:38.535 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.535+0000 7f3974d77640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39700ce7b0 con 0x7f39700b1d90 2023-12-19T14:00:38.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.535+0000 7f3974d77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39700d3b00 con 0x7f397015d4e0 2023-12-19T14:00:38.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.535+0000 7f3967fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f39700b1d90 0x7f39700d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.535+0000 7f396ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f39700d3650 0x7f3970160fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53662/0 (socket says 172.21.15.113:53662) 2023-12-19T14:00:38.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f396ffff640 1 -- 172.21.15.113:0/293608895 learned_addr learned my addr 172.21.15.113:0/293608895 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:38.536 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f396f7fe640 1 --2- 172.21.15.113:0/293608895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 0x7f39700b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f396effd640 1 -- 172.21.15.113:0/293608895 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999060108 0 0) 0x7f39700d07c0 con 0x7f39700d3650 2023-12-19T14:00:38.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f396effd640 1 -- 172.21.15.113:0/293608895 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f395c003520 con 0x7f39700d3650 2023-12-19T14:00:38.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f3967fff640 1 -- 172.21.15.113:0/293608895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 msgr2=0x7f39700b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:38.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f3967fff640 1 --2- 172.21.15.113:0/293608895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 0x7f39700b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f3967fff640 1 -- 172.21.15.113:0/293608895 >> v1:172.21.15.113:6789/0 conn(0x7f39700d3650 legacy=0x7f3970160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.536+0000 7f3967fff640 1 -- 172.21.15.113:0/293608895 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700d25c0 con 0x7f39700b1d90 2023-12-19T14:00:38.537 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.537+0000 7f3967fff640 1 --2- 172.21.15.113:0/293608895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700d3110 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f39580097a0 tx=0x7f395802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c781fd1b325acc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:38.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f396effd640 1 -- 172.21.15.113:0/293608895 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395802d040 con 0x7f39700b1d90 2023-12-19T14:00:38.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f396effd640 1 -- 172.21.15.113:0/293608895 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958031810 con 0x7f39700b1d90 2023-12-19T14:00:38.538 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f396effd640 1 -- 172.21.15.113:0/293608895 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958031ba0 con 0x7f39700b1d90 2023-12-19T14:00:38.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 -- 172.21.15.113:0/293608895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 msgr2=0x7f39700d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 --2- 172.21.15.113:0/293608895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700d3110 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f39580097a0 tx=0x7f395802b8b0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 -- 172.21.15.113:0/293608895 shutdown_connections 2023-12-19T14:00:38.539 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 --2- 172.21.15.113:0/293608895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700d3110 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 --2- 172.21.15.113:0/293608895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 0x7f39700b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 -- 172.21.15.113:0/293608895 >> 172.21.15.113:0/293608895 conn(0x7f3970072f40 msgr2=0x7f3970073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:38.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 -- 172.21.15.113:0/293608895 shutdown_connections 2023-12-19T14:00:38.540 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.538+0000 7f3974d77640 1 -- 172.21.15.113:0/293608895 wait complete. 2023-12-19T14:00:38.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.540+0000 7f3974d77640 1 Processor -- start 2023-12-19T14:00:38.543 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.540+0000 7f3974d77640 1 -- start start 2023-12-19T14:00:38.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.541+0000 7f3974d77640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.541+0000 7f3974d77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39700d3650 0x7f397006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.541+0000 7f3974d77640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 0x7f39700b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.541+0000 7f3974d77640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39700b60a0 con 0x7f39700b1d90 2023-12-19T14:00:38.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.541+0000 7f3974d77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39700b68b0 con 0x7f39700d3650 2023-12-19T14:00:38.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.541+0000 7f3974d77640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39700b6b90 con 0x7f397015d4e0 2023-12-19T14:00:38.544 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.541+0000 7f396f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57324/0 (socket says 172.21.15.113:57324) 2023-12-19T14:00:38.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 -- 172.21.15.113:0/1992383943 learned_addr learned my addr 172.21.15.113:0/1992383943 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:38.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 -- 172.21.15.113:0/1992383943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 msgr2=0x7f39700b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f397015d4e0 0x7f39700b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 -- 172.21.15.113:0/1992383943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39700d3650 msgr2=0x7f397006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39700d3650 0x7f397006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.545 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 -- 172.21.15.113:0/1992383943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009400 con 0x7f39700b1d90 2023-12-19T14:00:38.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396f7fe640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700b5b60 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f396000d800 tx=0x7f396000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:38.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.542+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000b6c0 con 0x7f39700b1d90 2023-12-19T14:00:38.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.543+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396000b820 con 0x7f39700b1d90 2023-12-19T14:00:38.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.543+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000bbb0 con 0x7f39700b1d90 2023-12-19T14:00:38.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.543+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39700b6e70 con 0x7f39700b1d90 2023-12-19T14:00:38.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.543+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39700b7430 con 0x7f39700b1d90 2023-12-19T14:00:38.546 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.544+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39700cfbb0 con 0x7f39700b1d90 2023-12-19T14:00:38.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.545+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f396000bd10 con 0x7f39700b1d90 2023-12-19T14:00:38.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.545+0000 7f396cff9640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f395006a460 0x7f395006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.546+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3960088bc0 con 0x7f39700b1d90 2023-12-19T14:00:38.547 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.546+0000 7f3967fff640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f395006a460 0x7f395006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.546+0000 7f396cff9640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f39500702c0 0x7f39500726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.546+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 --> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3950072d90 con 0x7f39500702c0 2023-12-19T14:00:38.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.546+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f396008d2a0 con 0x7f39700b1d90 2023-12-19T14:00:38.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.546+0000 7f396ffff640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f39500702c0 0x7f39500726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.546+0000 7f3967fff640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f395006a460 0x7f395006c920 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3958036000 tx=0x7f3958030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:38.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.547+0000 7f396ffff640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f39500702c0 0x7f39500726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:38.548 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.547+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== osd.0 v2:172.21.15.113:6811/84090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f3950072d90 con 0x7f39500702c0 2023-12-19T14:00:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.559+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 --> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f397015d8c0 con 0x7f39500702c0 2023-12-19T14:00:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f396cff9640 1 -- 172.21.15.113:0/1992383943 <== osd.0 v2:172.21.15.113:6811/84090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f3968001c40 con 0x7f39500702c0 2023-12-19T14:00:38.560 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:38.560 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:38.560 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f39500702c0 msgr2=0x7f39500726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6811/84090,v1:172.21.15.113:6814/84090] conn(0x7f39500702c0 0x7f39500726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f395006a460 msgr2=0x7f395006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f395006a460 0x7f395006c920 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3958036000 tx=0x7f3958030000 comp rx=0 tx=0).stop 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 msgr2=0x7f39700b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 --2- 172.21.15.113:0/1992383943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39700b1d90 0x7f39700b5b60 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f396000d800 tx=0x7f396000dcc0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f396ffff640 1 -- 172.21.15.113:0/1992383943 reap_dead start 2023-12-19T14:00:38.561 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 shutdown_connections 2023-12-19T14:00:38.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.560+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 >> 172.21.15.113:0/1992383943 conn(0x7f3970072f40 msgr2=0x7f39700cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:38.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.561+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 shutdown_connections 2023-12-19T14:00:38.562 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.561+0000 7f3974d77640 1 -- 172.21.15.113:0/1992383943 wait complete. 2023-12-19T14:00:38.576 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T14:00:38.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.769+0000 7fa0e24a8640 1 Processor -- start 2023-12-19T14:00:38.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.769+0000 7fa0e24a8640 1 -- start start 2023-12-19T14:00:38.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.771+0000 7fa0e24a8640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0dc06f9f0 0x7fa0dc06fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.771+0000 7fa0e24a8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc0cc990 0x7fa0dc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.771+0000 7fa0e24a8640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc15d0e0 con 0x7fa0dc159810 2023-12-19T14:00:38.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.771+0000 7fa0e24a8640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc070350 con 0x7fa0dc06f9f0 2023-12-19T14:00:38.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.771+0000 7fa0e24a8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0cd360 con 0x7fa0dc0cc990 2023-12-19T14:00:38.771 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.771+0000 7fa0e0ca5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0dc06f9f0 0x7fa0dc06fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e1ca7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc0cc990 0x7fa0dc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e14a6640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa0dc159810 0x7fa0dc159bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:34034/0 (socket says 172.21.15.113:34034) 2023-12-19T14:00:38.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e14a6640 1 -- 172.21.15.113:0/2064043191 learned_addr learned my addr 172.21.15.113:0/2064043191 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:38.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e0ca5640 1 -- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc0cc990 msgr2=0x7fa0dc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:38.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e0ca5640 1 --2- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc0cc990 0x7fa0dc0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.772 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e0ca5640 1 -- 172.21.15.113:0/2064043191 >> v1:172.21.15.151:6789/0 conn(0x7fa0dc159810 legacy=0x7fa0dc159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e0ca5640 1 -- 172.21.15.113:0/2064043191 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0b1590 con 0x7fa0dc06f9f0 2023-12-19T14:00:38.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.772+0000 7fa0e1ca7640 1 --2- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc0cc990 0x7fa0dc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T14:00:38.773 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.774+0000 7fa0e0ca5640 1 --2- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 0x7fa0dc06fe10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0097a0 tx=0x7fa0cc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97c366ad5c08ddde server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:38.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.774+0000 7fa0d3fff640 1 -- 172.21.15.113:0/2064043191 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc031780 con 0x7fa0dc06f9f0 2023-12-19T14:00:38.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.774+0000 7fa0d3fff640 1 -- 172.21.15.113:0/2064043191 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0318e0 con 0x7fa0dc06f9f0 2023-12-19T14:00:38.774 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.774+0000 7fa0d3fff640 1 -- 172.21.15.113:0/2064043191 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc031c70 con 0x7fa0dc06f9f0 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 msgr2=0x7fa0dc06fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 0x7fa0dc06fe10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0097a0 tx=0x7fa0cc02b820 comp rx=0 tx=0).stop 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2064043191 shutdown_connections 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc0cc990 0x7fa0dc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2064043191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 0x7fa0dc06fe10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2064043191 >> 172.21.15.113:0/2064043191 conn(0x7fa0dc0b0100 msgr2=0x7fa0dc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2064043191 shutdown_connections 2023-12-19T14:00:38.775 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.775+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2064043191 wait complete. 2023-12-19T14:00:38.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.777+0000 7fa0e24a8640 1 Processor -- start 2023-12-19T14:00:38.777 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.778+0000 7fa0e24a8640 1 -- start start 2023-12-19T14:00:38.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e24a8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 0x7fa0dc1446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e24a8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0dc0cc990 0x7fa0dc06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e24a8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc159810 0x7fa0dc1e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.779 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e24a8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06da80 con 0x7fa0dc0cc990 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e24a8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06ce00 con 0x7fa0dc06f9f0 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e24a8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06d0e0 con 0x7fa0dc159810 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0dc0cc990 0x7fa0dc06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0dc0cc990 0x7fa0dc06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57330/0 (socket says 172.21.15.113:57330) 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 -- 172.21.15.113:0/2203188687 learned_addr learned my addr 172.21.15.113:0/2203188687 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e14a6640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 0x7fa0dc1446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 -- 172.21.15.113:0/2203188687 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc159810 msgr2=0x7fa0dc1e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc159810 0x7fa0dc1e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 -- 172.21.15.113:0/2203188687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 msgr2=0x7fa0dc1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 0x7fa0dc1446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.779+0000 7fa0e0ca5640 1 -- 172.21.15.113:0/2203188687 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d400ab80 con 0x7fa0dc0cc990 2023-12-19T14:00:38.780 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.780+0000 7fa0e0ca5640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0dc0cc990 0x7fa0dc06c3b0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc034040 tx=0x7fa0cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:38.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.780+0000 7fa0d1ffb640 1 -- 172.21.15.113:0/2203188687 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc032820 con 0x7fa0dc0cc990 2023-12-19T14:00:38.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.780+0000 7fa0d1ffb640 1 -- 172.21.15.113:0/2203188687 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc032980 con 0x7fa0dc0cc990 2023-12-19T14:00:38.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.780+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc009400 con 0x7fa0dc0cc990 2023-12-19T14:00:38.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.780+0000 7fa0d1ffb640 1 -- 172.21.15.113:0/2203188687 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc032d30 con 0x7fa0dc0cc990 2023-12-19T14:00:38.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.780+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc06d6a0 con 0x7fa0dc0cc990 2023-12-19T14:00:38.781 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.781+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc06dbc0 con 0x7fa0dc0cc990 2023-12-19T14:00:38.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.782+0000 7fa0d1ffb640 1 -- 172.21.15.113:0/2203188687 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa0cc04e440 con 0x7fa0dc0cc990 2023-12-19T14:00:38.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.783+0000 7fa0d1ffb640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa0c006a430 0x7fa0c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:38.783 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.783+0000 7fa0d1ffb640 1 -- 172.21.15.113:0/2203188687 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa0cc0aa700 con 0x7fa0dc0cc990 2023-12-19T14:00:38.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.784+0000 7fa0e14a6640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa0c006a430 0x7fa0c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:38.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.784+0000 7fa0e14a6640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa0c006a430 0x7fa0c006c8f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005880 tx=0x7fa0d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:38.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.787+0000 7fa0d1ffb640 1 -- 172.21.15.113:0/2203188687 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa0dc06dbc0 con 0x7fa0dc0cc990 2023-12-19T14:00:38.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.979+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0dc0b1b50 con 0x7fa0c006a430 2023-12-19T14:00:38.979 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.979+0000 7fa0d1ffb640 1 -- 172.21.15.113:0/2203188687 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa0d80013f0 con 0x7fa0c006a430 2023-12-19T14:00:38.979 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T14:00:38.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa0c006a430 msgr2=0x7fa0c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa0c006a430 0x7fa0c006c8f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005880 tx=0x7fa0d8009040 comp rx=0 tx=0).stop 2023-12-19T14:00:38.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0dc0cc990 msgr2=0x7fa0dc06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:38.982 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0dc0cc990 0x7fa0dc06c3b0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc034040 tx=0x7fa0cc0046c0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 shutdown_connections 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fa0c006a430 0x7fa0c006c8f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0dc159810 0x7fa0dc1e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa0dc0cc990 0x7fa0dc06c3b0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 --2- 172.21.15.113:0/2203188687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc06f9f0 0x7fa0dc1446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 >> 172.21.15.113:0/2203188687 conn(0x7fa0dc0b0100 msgr2=0x7fa0dc158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 shutdown_connections 2023-12-19T14:00:38.983 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:38.982+0000 7fa0e24a8640 1 -- 172.21.15.113:0/2203188687 wait complete. 2023-12-19T14:00:39.000 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T14:00:39.000 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:39.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.216+0000 7fdf8bfff640 1 Processor -- start 2023-12-19T14:00:39.216 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.216+0000 7fdf8bfff640 1 -- start start 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf8bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdf8c0b1d90 0x7fdf8c0d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf8bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0d07c0 con 0x7fdf8c0d3650 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf8bfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c15d8c0 con 0x7fdf8c15d4e0 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf8bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0ce7b0 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf83fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdf8c0b1d90 0x7fdf8c0d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf8b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdf8c0d3650 0x7fdf8c0d15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53664/0 (socket says 172.21.15.113:53664) 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf8b7fe640 1 -- 172.21.15.113:0/641530003 learned_addr learned my addr 172.21.15.113:0/641530003 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:39.218 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.218+0000 7fdf83fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdf8c0b1d90 0x7fdf8c0d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57334/0 (socket says 172.21.15.113:57334) 2023-12-19T14:00:39.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.219+0000 7fdf83fff640 1 -- 172.21.15.113:0/641530003 >> v1:172.21.15.151:6789/0 conn(0x7fdf8c15d4e0 legacy=0x7fdf8c0b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:39.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.219+0000 7fdf83fff640 1 -- 172.21.15.113:0/641530003 >> v1:172.21.15.113:6789/0 conn(0x7fdf8c0d3650 legacy=0x7fdf8c0d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.219+0000 7fdf83fff640 1 -- 172.21.15.113:0/641530003 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0cfbb0 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.219 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.219+0000 7fdf8a7fc640 1 -- 172.21.15.113:0/641530003 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435810769 0 0) 0x7fdf8c0d07c0 con 0x7fdf8c0d3650 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.220+0000 7fdf83fff640 1 --2- 172.21.15.113:0/641530003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c0d3110 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fdf740097a0 tx=0x7fdf7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a6ed405ba8f94a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.220+0000 7fdf8a7fc640 1 -- 172.21.15.113:0/641530003 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74031830 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.220+0000 7fdf8a7fc640 1 -- 172.21.15.113:0/641530003 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74031990 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.220+0000 7fdf8a7fc640 1 -- 172.21.15.113:0/641530003 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74031d20 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.221+0000 7fdf8bfff640 1 -- 172.21.15.113:0/641530003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 msgr2=0x7fdf8c0d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.221+0000 7fdf8bfff640 1 --2- 172.21.15.113:0/641530003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c0d3110 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fdf740097a0 tx=0x7fdf7402b8d0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.221+0000 7fdf8bfff640 1 -- 172.21.15.113:0/641530003 shutdown_connections 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.221+0000 7fdf8bfff640 1 --2- 172.21.15.113:0/641530003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c0d3110 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.221+0000 7fdf8bfff640 1 -- 172.21.15.113:0/641530003 >> 172.21.15.113:0/641530003 conn(0x7fdf8c072f40 msgr2=0x7fdf8c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:39.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.221+0000 7fdf8bfff640 1 -- 172.21.15.113:0/641530003 shutdown_connections 2023-12-19T14:00:39.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.221+0000 7fdf8bfff640 1 -- 172.21.15.113:0/641530003 wait complete. 2023-12-19T14:00:39.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.223+0000 7fdf8bfff640 1 Processor -- start 2023-12-19T14:00:39.222 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.223+0000 7fdf8bfff640 1 -- start start 2023-12-19T14:00:39.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8c0d3650 0x7fdf8c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf8c15d4e0 0x7fdf8c0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8bfff640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1f3c20 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c157430 con 0x7fdf8c15d4e0 2023-12-19T14:00:39.225 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c157710 con 0x7fdf8c0d3650 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c1f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57340/0 (socket says 172.21.15.113:57340) 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 -- 172.21.15.113:0/2369501227 learned_addr learned my addr 172.21.15.113:0/2369501227 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 -- 172.21.15.113:0/2369501227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8c0d3650 msgr2=0x7fdf8c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf83fff640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8c0d3650 0x7fdf8c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8c0d3650 0x7fdf8c0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 -- 172.21.15.113:0/2369501227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf8c15d4e0 msgr2=0x7fdf8c0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf8c15d4e0 0x7fdf8c0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.224+0000 7fdf8affd640 1 -- 172.21.15.113:0/2369501227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74009400 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.225+0000 7fdf8affd640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c1f36e0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c430 tx=0x7fdf7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.225+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c011790 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.225+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0118f0 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.225+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c1579f0 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.225+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c011ce0 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.225+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c157fb0 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.226+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf8c0cfe90 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.227 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.227+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdf7c01c460 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.228+0000 7fdf88ff9640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf6c06a460 0x7fdf6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.228+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdf7c0885b0 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.228+0000 7fdf83fff640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf6c06a460 0x7fdf6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.228+0000 7fdf88ff9640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7fdf6c0702c0 0x7fdf6c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.228 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.228+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 --> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf6c072d90 con 0x7fdf6c0702c0 2023-12-19T14:00:39.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.228+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf7c08ab90 con 0x7fdf8c0b1d90 2023-12-19T14:00:39.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.229+0000 7fdf8b7fe640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7fdf6c0702c0 0x7fdf6c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.229+0000 7fdf83fff640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf6c06a460 0x7fdf6c06c920 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdf74036000 tx=0x7fdf7403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.229 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.229+0000 7fdf8b7fe640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7fdf6c0702c0 0x7fdf6c0726e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.230 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.230+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== osd.1 v2:172.21.15.113:6800/84088 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fdf6c072d90 con 0x7fdf6c0702c0 2023-12-19T14:00:39.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.242+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 --> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf8c0d3ae0 con 0x7fdf6c0702c0 2023-12-19T14:00:39.243 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.243+0000 7fdf88ff9640 1 -- 172.21.15.113:0/2369501227 <== osd.1 v2:172.21.15.113:6800/84088 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fdf84001e10 con 0x7fdf6c0702c0 2023-12-19T14:00:39.243 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:39.243 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:39.243 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:39.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.243+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7fdf6c0702c0 msgr2=0x7fdf6c0726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.243+0000 7fdf8bfff640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6800/84088,v1:172.21.15.113:6801/84088] conn(0x7fdf6c0702c0 0x7fdf6c0726e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.243+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf6c06a460 msgr2=0x7fdf6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.243+0000 7fdf8bfff640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fdf6c06a460 0x7fdf6c06c920 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdf74036000 tx=0x7fdf7403c040 comp rx=0 tx=0).stop 2023-12-19T14:00:39.244 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.244+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 msgr2=0x7fdf8c1f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.244+0000 7fdf8bfff640 1 --2- 172.21.15.113:0/2369501227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdf8c0b1d90 0x7fdf8c1f36e0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c430 tx=0x7fdf7c00c8f0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.244+0000 7fdf8b7fe640 1 -- 172.21.15.113:0/2369501227 reap_dead start 2023-12-19T14:00:39.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.244+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 shutdown_connections 2023-12-19T14:00:39.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.244+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 >> 172.21.15.113:0/2369501227 conn(0x7fdf8c072f40 msgr2=0x7fdf8c15fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:39.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.244+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 shutdown_connections 2023-12-19T14:00:39.245 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.244+0000 7fdf8bfff640 1 -- 172.21.15.113:0/2369501227 wait complete. 2023-12-19T14:00:39.261 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T14:00:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.468+0000 7fc34d173640 1 Processor -- start 2023-12-19T14:00:39.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.468+0000 7fc34d173640 1 -- start start 2023-12-19T14:00:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34d173640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348157aa0 0x7fc3480b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34d173640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc34806e410 0x7fc348161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34d173640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34806e890 con 0x7fc348161540 2023-12-19T14:00:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34d173640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480b2600 con 0x7fc34806e410 2023-12-19T14:00:39.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34d173640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480b1d60 con 0x7fc348157aa0 2023-12-19T14:00:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc34806e410 0x7fc348161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc34806e410 0x7fc348161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57356/0 (socket says 172.21.15.113:57356) 2023-12-19T14:00:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34659c640 1 -- 172.21.15.113:0/3178859030 learned_addr learned my addr 172.21.15.113:0/3178859030 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34759e640 1 --1- 172.21.15.113:0/3178859030 >> v1:172.21.15.113:6789/0 conn(0x7fc348161540 0x7fc34815e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53672/0 (socket says 172.21.15.113:53672) 2023-12-19T14:00:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc346d9d640 1 --2- 172.21.15.113:0/3178859030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348157aa0 0x7fc3480b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34659c640 1 -- 172.21.15.113:0/3178859030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348157aa0 msgr2=0x7fc3480b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:39.470 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34659c640 1 --2- 172.21.15.113:0/3178859030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348157aa0 0x7fc3480b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34659c640 1 -- 172.21.15.113:0/3178859030 >> v1:172.21.15.113:6789/0 conn(0x7fc348161540 legacy=0x7fc34815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc345d9b640 1 -- 172.21.15.113:0/3178859030 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641594381 0 0) 0x7fc34806e890 con 0x7fc348161540 2023-12-19T14:00:39.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.470+0000 7fc34659c640 1 -- 172.21.15.113:0/3178859030 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480b2040 con 0x7fc34806e410 2023-12-19T14:00:39.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.471+0000 7fc34659c640 1 --2- 172.21.15.113:0/3178859030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc34806e410 0x7fc348161000 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009870 tx=0x7fc33c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618e35767878826b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.471+0000 7fc345d9b640 1 -- 172.21.15.113:0/3178859030 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c030840 con 0x7fc34806e410 2023-12-19T14:00:39.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.471+0000 7fc345d9b640 1 -- 172.21.15.113:0/3178859030 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c0309a0 con 0x7fc34806e410 2023-12-19T14:00:39.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.471+0000 7fc345d9b640 1 -- 172.21.15.113:0/3178859030 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c030d30 con 0x7fc34806e410 2023-12-19T14:00:39.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 -- 172.21.15.113:0/3178859030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc34806e410 msgr2=0x7fc348161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 --2- 172.21.15.113:0/3178859030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc34806e410 0x7fc348161000 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009870 tx=0x7fc33c02b980 comp rx=0 tx=0).stop 2023-12-19T14:00:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 -- 172.21.15.113:0/3178859030 shutdown_connections 2023-12-19T14:00:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 --2- 172.21.15.113:0/3178859030 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc34806e410 0x7fc348161000 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 --2- 172.21.15.113:0/3178859030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348157aa0 0x7fc3480b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 -- 172.21.15.113:0/3178859030 >> 172.21.15.113:0/3178859030 conn(0x7fc3480cbb70 msgr2=0x7fc3480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 -- 172.21.15.113:0/3178859030 shutdown_connections 2023-12-19T14:00:39.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.472+0000 7fc34d173640 1 -- 172.21.15.113:0/3178859030 wait complete. 2023-12-19T14:00:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.474+0000 7fc34d173640 1 Processor -- start 2023-12-19T14:00:39.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.474+0000 7fc34d173640 1 -- start start 2023-12-19T14:00:39.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34d173640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc34806e410 0x7fc3481607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34d173640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc348157aa0 0x7fc348143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34d173640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348161540 0x7fc3481599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34d173640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34815df40 con 0x7fc348157aa0 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34d173640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc348160d10 con 0x7fc34806e410 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34d173640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc348155d80 con 0x7fc348161540 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc348157aa0 0x7fc348143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc348157aa0 0x7fc348143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57372/0 (socket says 172.21.15.113:57372) 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.475+0000 7fc34659c640 1 -- 172.21.15.113:0/2810894680 learned_addr learned my addr 172.21.15.113:0/2810894680 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc34659c640 1 -- 172.21.15.113:0/2810894680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348161540 msgr2=0x7fc3481599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc34659c640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348161540 0x7fc3481599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc34659c640 1 -- 172.21.15.113:0/2810894680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc34806e410 msgr2=0x7fc3481607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc346d9d640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc34806e410 0x7fc3481607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.477 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc34659c640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc34806e410 0x7fc3481607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc34659c640 1 -- 172.21.15.113:0/2810894680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c0094d0 con 0x7fc348157aa0 2023-12-19T14:00:39.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc34659c640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc348157aa0 0x7fc348143ab0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009870 tx=0x7fc33c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc32f7fe640 1 -- 172.21.15.113:0/2810894680 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c03e040 con 0x7fc348157aa0 2023-12-19T14:00:39.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc32f7fe640 1 -- 172.21.15.113:0/2810894680 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c039c90 con 0x7fc348157aa0 2023-12-19T14:00:39.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc32f7fe640 1 -- 172.21.15.113:0/2810894680 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c004030 con 0x7fc348157aa0 2023-12-19T14:00:39.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.476+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc348156060 con 0x7fc348157aa0 2023-12-19T14:00:39.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.477+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34815e1e0 con 0x7fc348157aa0 2023-12-19T14:00:39.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.478+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc348061910 con 0x7fc348157aa0 2023-12-19T14:00:39.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.479+0000 7fc32f7fe640 1 -- 172.21.15.113:0/2810894680 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc33c004190 con 0x7fc348157aa0 2023-12-19T14:00:39.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.480+0000 7fc32f7fe640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc33406a430 0x7fc33406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.480+0000 7fc32f7fe640 1 -- 172.21.15.113:0/2810894680 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc33c0aab70 con 0x7fc348157aa0 2023-12-19T14:00:39.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.480+0000 7fc346d9d640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc33406a430 0x7fc33406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.481+0000 7fc346d9d640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc33406a430 0x7fc33406c8f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc338006fd0 tx=0x7fc338008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.484 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.484+0000 7fc32f7fe640 1 -- 172.21.15.113:0/2810894680 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc33c0764f0 con 0x7fc348157aa0 2023-12-19T14:00:39.676 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.676+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc34815db20 con 0x7fc33406a430 2023-12-19T14:00:39.677 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.677+0000 7fc32f7fe640 1 -- 172.21.15.113:0/2810894680 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc338009d60 con 0x7fc33406a430 2023-12-19T14:00:39.677 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T14:00:39.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc33406a430 msgr2=0x7fc33406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc33406a430 0x7fc33406c8f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc338006fd0 tx=0x7fc338008040 comp rx=0 tx=0).stop 2023-12-19T14:00:39.679 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc348157aa0 msgr2=0x7fc348143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc348157aa0 0x7fc348143ab0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009870 tx=0x7fc33c004730 comp rx=0 tx=0).stop 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 shutdown_connections 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc33406a430 0x7fc33406c8f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc348161540 0x7fc3481599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc348157aa0 0x7fc348143ab0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 --2- 172.21.15.113:0/2810894680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc34806e410 0x7fc3481607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.679+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 >> 172.21.15.113:0/2810894680 conn(0x7fc3480cbb70 msgr2=0x7fc34815cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.680+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 shutdown_connections 2023-12-19T14:00:39.680 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.680+0000 7fc34d173640 1 -- 172.21.15.113:0/2810894680 wait complete. 2023-12-19T14:00:39.698 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T14:00:39.698 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:39.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.911+0000 7f49497fd640 1 Processor -- start 2023-12-19T14:00:39.911 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.911+0000 7f49497fd640 1 -- start start 2023-12-19T14:00:39.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f49497fd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f494406cf60 0x7f49440ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f49497fd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f494415adf0 0x7f49440b1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f49497fd640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49440cf370 con 0x7f49440cef30 2023-12-19T14:00:39.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f49497fd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494415b280 con 0x7f494415adf0 2023-12-19T14:00:39.914 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f49497fd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494406d340 con 0x7f494406cf60 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f4948ffc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f494415adf0 0x7f49440b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f4948ffc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f494415adf0 0x7f49440b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57380/0 (socket says 172.21.15.113:57380) 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f4948ffc640 1 -- 172.21.15.113:0/426252770 learned_addr learned my addr 172.21.15.113:0/426252770 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.913+0000 7f4943fff640 1 --2- 172.21.15.113:0/426252770 >> v2:172.21.15.151:3300/0 conn(0x7f494406cf60 0x7f49440ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.914+0000 7f4948ffc640 1 -- 172.21.15.113:0/426252770 >> v2:172.21.15.151:3300/0 conn(0x7f494406cf60 msgr2=0x7f49440ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.914+0000 7f4948ffc640 1 --2- 172.21.15.113:0/426252770 >> v2:172.21.15.151:3300/0 conn(0x7f494406cf60 0x7f49440ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.914+0000 7f4948ffc640 1 -- 172.21.15.113:0/426252770 >> v1:172.21.15.151:6789/0 conn(0x7f49440cef30 legacy=0x7f494415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:39.915 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.914+0000 7f4948ffc640 1 -- 172.21.15.113:0/426252770 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494415b4a0 con 0x7f494415adf0 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.915+0000 7f4948ffc640 1 --2- 172.21.15.113:0/426252770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f494415adf0 0x7f49440b1180 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f49440b50d0 tx=0x7f493c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f088897365e1850 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.915+0000 7f4942ffd640 1 -- 172.21.15.113:0/426252770 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c02cb20 con 0x7f494415adf0 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.915+0000 7f4942ffd640 1 -- 172.21.15.113:0/426252770 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c02cc80 con 0x7f494415adf0 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.915+0000 7f4942ffd640 1 -- 172.21.15.113:0/426252770 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0343f0 con 0x7f494415adf0 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 -- 172.21.15.113:0/426252770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f494415adf0 msgr2=0x7f49440b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 --2- 172.21.15.113:0/426252770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f494415adf0 0x7f49440b1180 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f49440b50d0 tx=0x7f493c02bf80 comp rx=0 tx=0).stop 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 -- 172.21.15.113:0/426252770 shutdown_connections 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 --2- 172.21.15.113:0/426252770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f494415adf0 0x7f49440b1180 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.917 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 --2- 172.21.15.113:0/426252770 >> v2:172.21.15.151:3300/0 conn(0x7f494406cf60 0x7f49440ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 -- 172.21.15.113:0/426252770 >> 172.21.15.113:0/426252770 conn(0x7f49440b4750 msgr2=0x7f49440659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:39.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 -- 172.21.15.113:0/426252770 shutdown_connections 2023-12-19T14:00:39.918 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.916+0000 7f49497fd640 1 -- 172.21.15.113:0/426252770 wait complete. 2023-12-19T14:00:39.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.918+0000 7f49497fd640 1 Processor -- start 2023-12-19T14:00:39.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.918+0000 7f49497fd640 1 -- start start 2023-12-19T14:00:39.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49497fd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f494406cf60 0x7f49440af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.920 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49497fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49440cef30 0x7f4944157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49497fd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f494415adf0 0x7f4944150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49497fd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440cc2e0 con 0x7f49440cef30 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49497fd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440cc700 con 0x7f494406cf60 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49497fd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440cb940 con 0x7f494415adf0 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49440cef30 0x7f4944157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49440cef30 0x7f4944157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57396/0 (socket says 172.21.15.113:57396) 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 -- 172.21.15.113:0/2220285249 learned_addr learned my addr 172.21.15.113:0/2220285249 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f4943fff640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f494406cf60 0x7f49440af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 -- 172.21.15.113:0/2220285249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f494415adf0 msgr2=0x7f4944150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f494415adf0 0x7f4944150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 -- 172.21.15.113:0/2220285249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f494406cf60 msgr2=0x7f49440af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f494406cf60 0x7f49440af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f49437fe640 1 -- 172.21.15.113:0/2220285249 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c009b30 con 0x7f49440cef30 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.919+0000 7f4943fff640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f494406cf60 0x7f49440af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.920+0000 7f49437fe640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49440cef30 0x7f4944157290 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f493800c440 tx=0x7f493800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.920+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938005480 con 0x7f49440cef30 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.920+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49380035f0 con 0x7f49440cef30 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.920+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380039c0 con 0x7f49440cef30 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.920+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49440cbc20 con 0x7f49440cef30 2023-12-19T14:00:39.922 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.920+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49441577d0 con 0x7f49440cef30 2023-12-19T14:00:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.921+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49440b2890 con 0x7f49440cef30 2023-12-19T14:00:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.922+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4938003b20 con 0x7f49440cef30 2023-12-19T14:00:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.923+0000 7f4940ff9640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f493006a430 0x7f493006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.923+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4938087900 con 0x7f49440cef30 2023-12-19T14:00:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.923+0000 7f4943fff640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f493006a430 0x7f493006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.923+0000 7f4940ff9640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f4930070290 0x7f49300726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.923+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 --> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4930072d60 con 0x7f4930070290 2023-12-19T14:00:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.923+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f493808c2a0 con 0x7f49440cef30 2023-12-19T14:00:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.924+0000 7f4948ffc640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f4930070290 0x7f49300726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.924+0000 7f4943fff640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f493006a430 0x7f493006c8f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f49441f3a90 tx=0x7f4934008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.924+0000 7f4948ffc640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f4930070290 0x7f49300726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:39.925 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.925+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== osd.2 v2:172.21.15.113:6809/84093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f4930072d60 con 0x7f4930070290 2023-12-19T14:00:39.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 --> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f49440b25b0 con 0x7f4930070290 2023-12-19T14:00:39.938 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f4940ff9640 1 -- 172.21.15.113:0/2220285249 <== osd.2 v2:172.21.15.113:6809/84093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f493c02c9a0 con 0x7f4930070290 2023-12-19T14:00:39.938 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:39.938 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:39.938 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:39.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f4930070290 msgr2=0x7f49300726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f49497fd640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6809/84093,v1:172.21.15.113:6812/84093] conn(0x7f4930070290 0x7f49300726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:39.939 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f493006a430 msgr2=0x7f493006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f49497fd640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f493006a430 0x7f493006c8f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f49441f3a90 tx=0x7f4934008040 comp rx=0 tx=0).stop 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49440cef30 msgr2=0x7f4944157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f49497fd640 1 --2- 172.21.15.113:0/2220285249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49440cef30 0x7f4944157290 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f493800c440 tx=0x7f493800c900 comp rx=0 tx=0).stop 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.938+0000 7f4948ffc640 1 -- 172.21.15.113:0/2220285249 reap_dead start 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.939+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 shutdown_connections 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.939+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 >> 172.21.15.113:0/2220285249 conn(0x7f49440b4750 msgr2=0x7f49440b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.939+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 shutdown_connections 2023-12-19T14:00:39.940 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:39.939+0000 7f49497fd640 1 -- 172.21.15.113:0/2220285249 wait complete. 2023-12-19T14:00:39.954 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T14:00:40.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.174+0000 7f3d1f257640 1 Processor -- start 2023-12-19T14:00:40.173 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.174+0000 7f3d1f257640 1 -- start start 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1f257640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d180ae110 0x7f3d180b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1f257640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3d180b0640 0x7f3d1806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1f257640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180b0a90 con 0x7f3d18157bf0 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1f257640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1806b8c0 con 0x7f3d180b0640 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1f257640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180ae640 con 0x7f3d180ae110 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1d7f4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3d180b0640 0x7f3d1806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1cff3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3d18157bf0 0x7f3d1815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53680/0 (socket says 172.21.15.113:53680) 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1cff3640 1 -- 172.21.15.113:0/4272413595 learned_addr learned my addr 172.21.15.113:0/4272413595 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:40.175 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d17fff640 1 --2- 172.21.15.113:0/4272413595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d180ae110 0x7f3d180b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1d7f4640 1 -- 172.21.15.113:0/4272413595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d180ae110 msgr2=0x7f3d180b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:40.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1d7f4640 1 --2- 172.21.15.113:0/4272413595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d180ae110 0x7f3d180b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1d7f4640 1 -- 172.21.15.113:0/4272413595 >> v1:172.21.15.113:6789/0 conn(0x7f3d18157bf0 legacy=0x7f3d1815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.176+0000 7f3d1d7f4640 1 -- 172.21.15.113:0/4272413595 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180ae920 con 0x7f3d180b0640 2023-12-19T14:00:40.176 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.178+0000 7f3d1d7f4640 1 --2- 172.21.15.113:0/4272413595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d1806d230 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009dc0 tx=0x7f3d1002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ab0598af4da7ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.178+0000 7f3d177fe640 1 -- 172.21.15.113:0/4272413595 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1002cc40 con 0x7f3d180b0640 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.178+0000 7f3d177fe640 1 -- 172.21.15.113:0/4272413595 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1002cda0 con 0x7f3d180b0640 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.178+0000 7f3d177fe640 1 -- 172.21.15.113:0/4272413595 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10034660 con 0x7f3d180b0640 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 -- 172.21.15.113:0/4272413595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 msgr2=0x7f3d1806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 --2- 172.21.15.113:0/4272413595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d1806d230 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009dc0 tx=0x7f3d1002be90 comp rx=0 tx=0).stop 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 -- 172.21.15.113:0/4272413595 shutdown_connections 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 --2- 172.21.15.113:0/4272413595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d1806d230 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 --2- 172.21.15.113:0/4272413595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d180ae110 0x7f3d180b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 -- 172.21.15.113:0/4272413595 >> 172.21.15.113:0/4272413595 conn(0x7f3d180cbb70 msgr2=0x7f3d180cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 -- 172.21.15.113:0/4272413595 shutdown_connections 2023-12-19T14:00:40.178 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.179+0000 7f3d1f257640 1 -- 172.21.15.113:0/4272413595 wait complete. 2023-12-19T14:00:40.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.181+0000 7f3d1f257640 1 Processor -- start 2023-12-19T14:00:40.180 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.181+0000 7f3d1f257640 1 -- start start 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.182+0000 7f3d1f257640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d180ae110 0x7f3d18146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.182+0000 7f3d1f257640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d18154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.182+0000 7f3d1f257640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d18157bf0 0x7f3d1806d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.182+0000 7f3d1f257640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1814d6e0 con 0x7f3d180b0640 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.182+0000 7f3d1f257640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1814d9c0 con 0x7f3d180ae110 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.182+0000 7f3d1f257640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1814dca0 con 0x7f3d18157bf0 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.182+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d18154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d18154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57422/0 (socket says 172.21.15.113:57422) 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 -- 172.21.15.113:0/1575392363 learned_addr learned my addr 172.21.15.113:0/1575392363 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d1cff3640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d180ae110 0x7f3d18146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d1d7f4640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d18157bf0 0x7f3d1806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 -- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d18157bf0 msgr2=0x7f3d1806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.183 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d18157bf0 0x7f3d1806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 -- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d180ae110 msgr2=0x7f3d18146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d180ae110 0x7f3d18146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 -- 172.21.15.113:0/1575392363 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10009a70 con 0x7f3d180b0640 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d1d7f4640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d18157bf0 0x7f3d1806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.183+0000 7f3d17fff640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d18154210 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400d7d0 tx=0x7f3d0400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.184+0000 7f3d157fa640 1 -- 172.21.15.113:0/1575392363 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400b6c0 con 0x7f3d180b0640 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.184+0000 7f3d157fa640 1 -- 172.21.15.113:0/1575392363 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400b820 con 0x7f3d180b0640 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.184+0000 7f3d157fa640 1 -- 172.21.15.113:0/1575392363 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400bbb0 con 0x7f3d180b0640 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.184+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1814df80 con 0x7f3d180b0640 2023-12-19T14:00:40.184 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.184+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d18154750 con 0x7f3d180b0640 2023-12-19T14:00:40.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.185+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d18061910 con 0x7f3d180b0640 2023-12-19T14:00:40.185 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.186+0000 7f3d157fa640 1 -- 172.21.15.113:0/1575392363 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d0400bd10 con 0x7f3d180b0640 2023-12-19T14:00:40.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.187+0000 7f3d157fa640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cfc06a430 0x7f3cfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.187+0000 7f3d157fa640 1 -- 172.21.15.113:0/1575392363 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3d04088b30 con 0x7f3d180b0640 2023-12-19T14:00:40.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.187+0000 7f3d1cff3640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cfc06a430 0x7f3cfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.186 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.188+0000 7f3d1cff3640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cfc06a430 0x7f3cfc06c8f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c005880 tx=0x7f3d0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.190 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.191+0000 7f3d157fa640 1 -- 172.21.15.113:0/1575392363 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3d04054410 con 0x7f3d180b0640 2023-12-19T14:00:40.377 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.378+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d180aeee0 con 0x7f3cfc06a430 2023-12-19T14:00:40.378 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.379+0000 7f3d157fa640 1 -- 172.21.15.113:0/1575392363 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3d0c0058b0 con 0x7f3cfc06a430 2023-12-19T14:00:40.378 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cfc06a430 msgr2=0x7f3cfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cfc06a430 0x7f3cfc06c8f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c005880 tx=0x7f3d0c009040 comp rx=0 tx=0).stop 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 msgr2=0x7f3d18154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d18154210 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400d7d0 tx=0x7f3d0400dc90 comp rx=0 tx=0).stop 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 shutdown_connections 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f3cfc06a430 0x7f3cfc06c8f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d18157bf0 0x7f3d1806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3d180b0640 0x7f3d18154210 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 --2- 172.21.15.113:0/1575392363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d180ae110 0x7f3d18146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.381+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 >> 172.21.15.113:0/1575392363 conn(0x7f3d180cbb70 msgr2=0x7f3d1806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.382+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 shutdown_connections 2023-12-19T14:00:40.381 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.382+0000 7f3d1f257640 1 -- 172.21.15.113:0/1575392363 wait complete. 2023-12-19T14:00:40.399 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T14:00:40.399 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:40.619 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.620+0000 7fef609f6640 1 Processor -- start 2023-12-19T14:00:40.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.621+0000 7fef609f6640 1 -- start start 2023-12-19T14:00:40.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.622+0000 7fef609f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c0a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.622+0000 7fef609f6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fef5c0ac7b0 0x7fef5c0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.622+0000 7fef609f6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c147060 con 0x7fef5c146800 2023-12-19T14:00:40.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.622+0000 7fef609f6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c146be0 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.621 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.622+0000 7fef609f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0ab710 con 0x7fef5c0ab150 2023-12-19T14:00:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef59d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c0a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef5a59c640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fef5c146800 0x7fef5c0a9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.113:34066/0 (socket says 172.21.15.113:34066) 2023-12-19T14:00:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef5a59c640 1 -- 172.21.15.113:0/1394321211 learned_addr learned my addr 172.21.15.113:0/1394321211 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:40.622 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef5ad9d640 1 --2- 172.21.15.113:0/1394321211 >> v2:172.21.15.151:3300/0 conn(0x7fef5c0ac7b0 0x7fef5c0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef59d9b640 1 -- 172.21.15.113:0/1394321211 >> v2:172.21.15.151:3300/0 conn(0x7fef5c0ac7b0 msgr2=0x7fef5c0acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef59d9b640 1 --2- 172.21.15.113:0/1394321211 >> v2:172.21.15.151:3300/0 conn(0x7fef5c0ac7b0 0x7fef5c0acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef5959a640 1 -- 172.21.15.113:0/1394321211 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631518508 0 0) 0x7fef5c147060 con 0x7fef5c146800 2023-12-19T14:00:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef59d9b640 1 -- 172.21.15.113:0/1394321211 >> v1:172.21.15.151:6789/0 conn(0x7fef5c146800 legacy=0x7fef5c0a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.623+0000 7fef59d9b640 1 -- 172.21.15.113:0/1394321211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0ab9f0 con 0x7fef5c0ab150 2023-12-19T14:00:40.623 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.625+0000 7fef59d9b640 1 --2- 172.21.15.113:0/1394321211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c0a9b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef44009d90 tx=0x7fef4402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea767f7a69c81a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.625+0000 7fef5959a640 1 -- 172.21.15.113:0/1394321211 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4402cb30 con 0x7fef5c0ab150 2023-12-19T14:00:40.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.625+0000 7fef5959a640 1 -- 172.21.15.113:0/1394321211 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4402cc90 con 0x7fef5c0ab150 2023-12-19T14:00:40.624 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.625+0000 7fef5959a640 1 -- 172.21.15.113:0/1394321211 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44034440 con 0x7fef5c0ab150 2023-12-19T14:00:40.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 -- 172.21.15.113:0/1394321211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 msgr2=0x7fef5c0a9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.625 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 --2- 172.21.15.113:0/1394321211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c0a9b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef44009d90 tx=0x7fef4402bd80 comp rx=0 tx=0).stop 2023-12-19T14:00:40.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 -- 172.21.15.113:0/1394321211 shutdown_connections 2023-12-19T14:00:40.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 --2- 172.21.15.113:0/1394321211 >> v2:172.21.15.151:3300/0 conn(0x7fef5c0ac7b0 0x7fef5c0acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 --2- 172.21.15.113:0/1394321211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c0a9b10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 -- 172.21.15.113:0/1394321211 >> 172.21.15.113:0/1394321211 conn(0x7fef5c06f5a0 msgr2=0x7fef5c06f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:40.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 -- 172.21.15.113:0/1394321211 shutdown_connections 2023-12-19T14:00:40.626 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.626+0000 7fef609f6640 1 -- 172.21.15.113:0/1394321211 wait complete. 2023-12-19T14:00:40.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.628+0000 7fef609f6640 1 Processor -- start 2023-12-19T14:00:40.627 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.628+0000 7fef609f6640 1 -- start start 2023-12-19T14:00:40.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef609f6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef609f6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef5c0ac7b0 0x7fef5c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.629 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef609f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef5c146800 0x7fef5c13ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef609f6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c13d580 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef609f6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c1510e0 con 0x7fef5c146800 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef609f6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c13f970 con 0x7fef5c0ab150 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef59d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef5c0ac7b0 0x7fef5c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef59d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef5c0ac7b0 0x7fef5c0d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57426/0 (socket says 172.21.15.113:57426) 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef59d9b640 1 -- 172.21.15.113:0/173035660 learned_addr learned my addr 172.21.15.113:0/173035660 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef5ad9d640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef5c146800 0x7fef5c13ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.629+0000 7fef5a59c640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef59d9b640 1 -- 172.21.15.113:0/173035660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 msgr2=0x7fef5c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef59d9b640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef5c0ab150 0x7fef5c150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef59d9b640 1 -- 172.21.15.113:0/173035660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef5c146800 msgr2=0x7fef5c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef59d9b640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef5c146800 0x7fef5c13ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef59d9b640 1 -- 172.21.15.113:0/173035660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44009a70 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.630 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef59d9b640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef5c0ac7b0 0x7fef5c0d0ad0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fef44037040 tx=0x7fef44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44040450 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440405b0 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c0d0640 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44040960 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.630+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c0cfff0 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.631+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef5c0abfb0 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.631 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.632+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef44040ac0 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.634+0000 7fef52ffd640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef4006a430 0x7fef4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.634+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fef440ab230 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.634+0000 7fef5a59c640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef4006a430 0x7fef4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.634+0000 7fef52ffd640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7fef40070290 0x7fef400726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.634+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 --> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef40072d60 con 0x7fef40070290 2023-12-19T14:00:40.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.634+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef440ad810 con 0x7fef5c0ac7b0 2023-12-19T14:00:40.633 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.634+0000 7fef5ad9d640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7fef40070290 0x7fef400726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.635+0000 7fef5a59c640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef4006a430 0x7fef4006c8f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fef4c000f60 tx=0x7fef4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.635+0000 7fef5ad9d640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7fef40070290 0x7fef400726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.634 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.636+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== osd.3 v2:172.21.15.113:6808/84094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fef40072d60 con 0x7fef40070290 2023-12-19T14:00:40.647 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.648+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 --> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef5c0abcd0 con 0x7fef40070290 2023-12-19T14:00:40.648 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef52ffd640 1 -- 172.21.15.113:0/173035660 <== osd.3 v2:172.21.15.113:6808/84094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fef54009a20 con 0x7fef40070290 2023-12-19T14:00:40.648 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:40.648 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:40.648 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7fef40070290 msgr2=0x7fef400726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6808/84094,v1:172.21.15.113:6810/84094] conn(0x7fef40070290 0x7fef400726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef4006a430 msgr2=0x7fef4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fef4006a430 0x7fef4006c8f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fef4c000f60 tx=0x7fef4c009040 comp rx=0 tx=0).stop 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef5c0ac7b0 msgr2=0x7fef5c0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 --2- 172.21.15.113:0/173035660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fef5c0ac7b0 0x7fef5c0d0ad0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fef44037040 tx=0x7fef44004a40 comp rx=0 tx=0).stop 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef5ad9d640 1 -- 172.21.15.113:0/173035660 reap_dead start 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 shutdown_connections 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 >> 172.21.15.113:0/173035660 conn(0x7fef5c06f5a0 msgr2=0x7fef5c144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 shutdown_connections 2023-12-19T14:00:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.649+0000 7fef609f6640 1 -- 172.21.15.113:0/173035660 wait complete. 2023-12-19T14:00:40.667 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T14:00:40.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.887+0000 7faaaee68640 1 Processor -- start 2023-12-19T14:00:40.886 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.887+0000 7faaaee68640 1 -- start start 2023-12-19T14:00:40.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaaee68640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faaa815e5a0 0x7faaa80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaaee68640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa815f680 0x7faaa80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaaee68640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa815ec30 con 0x7faaa80cdbf0 2023-12-19T14:00:40.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaaee68640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa80b2cc0 con 0x7faaa815e5a0 2023-12-19T14:00:40.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaaee68640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa815e980 con 0x7faaa815f680 2023-12-19T14:00:40.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaae667640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7faaa80cdbf0 0x7faaa806c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53688/0 (socket says 172.21.15.113:53688) 2023-12-19T14:00:40.888 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaae667640 1 -- 172.21.15.113:0/1053060973 learned_addr learned my addr 172.21.15.113:0/1053060973 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:40.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaade66640 1 --2- 172.21.15.113:0/1053060973 >> v2:172.21.15.151:3300/0 conn(0x7faaa815e5a0 0x7faaa80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.889+0000 7faaad665640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa815f680 0x7faaa80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467359838 0 0) 0x7faaa815ec30 con 0x7faaa80cdbf0 2023-12-19T14:00:40.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa94003520 con 0x7faaa80cdbf0 2023-12-19T14:00:40.890 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134824084 0 0) 0x7faa94003520 con 0x7faaa80cdbf0 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa815f680 msgr2=0x7faaa80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa815f680 0x7faaa80b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 >> v2:172.21.15.151:3300/0 conn(0x7faaa815e5a0 msgr2=0x7faaa80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 --2- 172.21.15.113:0/1053060973 >> v2:172.21.15.151:3300/0 conn(0x7faaa815e5a0 0x7faaa80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80b2f90 con 0x7faaa80cdbf0 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7faaa00019f0 con 0x7faaa80cdbf0 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 >> v1:172.21.15.113:6789/0 conn(0x7faaa80cdbf0 legacy=0x7faaa806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa815f680 0x7faa94003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa94003ef0 0x7faa940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94004d00 0x7faa94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa80b2cc0 con 0x7faa94003ef0 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa815e980 con 0x7faa94004d00 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.890+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9400fde0 con 0x7faaa815f680 2023-12-19T14:00:40.891 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.891+0000 7faaad665640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa94003ef0 0x7faa940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.891+0000 7faaae667640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94004d00 0x7faa94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.891+0000 7faaad665640 1 -- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa815f680 msgr2=0x7faa94003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:40.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.891+0000 7faaad665640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa815f680 0x7faa94003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.891+0000 7faaad665640 1 -- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94004d00 msgr2=0x7faa94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:40.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.891+0000 7faaad665640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94004d00 0x7faa94005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.892 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.891+0000 7faaad665640 1 -- 172.21.15.113:0/1053060973 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94003520 con 0x7faa94003ef0 2023-12-19T14:00:40.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.892+0000 7faaad665640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa94003ef0 0x7faa940047c0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7faa98009ac0 tx=0x7faa940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e671c14dd2d0476a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9802c710 con 0x7faa94003ef0 2023-12-19T14:00:40.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9802c870 con 0x7faa94003ef0 2023-12-19T14:00:40.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaace64640 1 -- 172.21.15.113:0/1053060973 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9802cc00 con 0x7faa94003ef0 2023-12-19T14:00:40.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaaee68640 1 -- 172.21.15.113:0/1053060973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa94003ef0 msgr2=0x7faa940047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaaee68640 1 --2- 172.21.15.113:0/1053060973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa94003ef0 0x7faa940047c0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7faa98009ac0 tx=0x7faa940057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.893 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaae667640 1 -- 172.21.15.113:0/1053060973 reap_dead start 2023-12-19T14:00:40.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaaee68640 1 -- 172.21.15.113:0/1053060973 shutdown_connections 2023-12-19T14:00:40.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaaee68640 1 -- 172.21.15.113:0/1053060973 >> 172.21.15.113:0/1053060973 conn(0x7faaa80b0100 msgr2=0x7faaa80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:40.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaaee68640 1 -- 172.21.15.113:0/1053060973 shutdown_connections 2023-12-19T14:00:40.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.893+0000 7faaaee68640 1 -- 172.21.15.113:0/1053060973 wait complete. 2023-12-19T14:00:40.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.895+0000 7faaaee68640 1 Processor -- start 2023-12-19T14:00:40.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.895+0000 7faaaee68640 1 -- start start 2023-12-19T14:00:40.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.896+0000 7faaaee68640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94003ef0 0x7faaa815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.896+0000 7faaaee68640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa81f1e10 0x7faaa814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.896+0000 7faaaee68640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa814b7d0 0x7faaa80aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.895 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.896+0000 7faaaee68640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa815c360 con 0x7faaa814b7d0 2023-12-19T14:00:40.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.896+0000 7faaaee68640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81f22a0 con 0x7faa94003ef0 2023-12-19T14:00:40.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.896+0000 7faaaee68640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81f2580 con 0x7faaa81f1e10 2023-12-19T14:00:40.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa814b7d0 0x7faaa80aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa814b7d0 0x7faaa80aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57442/0 (socket says 172.21.15.113:57442) 2023-12-19T14:00:40.896 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 -- 172.21.15.113:0/989131736 learned_addr learned my addr 172.21.15.113:0/989131736 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:40.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaad665640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa81f1e10 0x7faaa814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 -- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa81f1e10 msgr2=0x7faaa814b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaade66640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94003ef0 0x7faaa815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa81f1e10 0x7faaa814b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 -- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94003ef0 msgr2=0x7faaa815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94003ef0 0x7faaa815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 -- 172.21.15.113:0/989131736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa81f2860 con 0x7faaa814b7d0 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaad665640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa81f1e10 0x7faaa814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.897+0000 7faaae667640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa814b7d0 0x7faaa80aec80 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7faaa00012e0 tx=0x7faaa000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.898+0000 7faa9e7fc640 1 -- 172.21.15.113:0/989131736 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000bb80 con 0x7faaa814b7d0 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.898+0000 7faa9e7fc640 1 -- 172.21.15.113:0/989131736 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa000bce0 con 0x7faaa814b7d0 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.898+0000 7faa9e7fc640 1 -- 172.21.15.113:0/989131736 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0007330 con 0x7faaa814b7d0 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.898+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa81f2b40 con 0x7faaa814b7d0 2023-12-19T14:00:40.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.898+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa815dd90 con 0x7faaa814b7d0 2023-12-19T14:00:40.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.899+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa81f2d30 con 0x7faaa814b7d0 2023-12-19T14:00:40.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.900+0000 7faa9e7fc640 1 -- 172.21.15.113:0/989131736 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faaa0007490 con 0x7faaa814b7d0 2023-12-19T14:00:40.899 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.901+0000 7faa9e7fc640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faa8c06a430 0x7faa8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:40.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.901+0000 7faa9e7fc640 1 -- 172.21.15.113:0/989131736 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faaa0088b80 con 0x7faaa814b7d0 2023-12-19T14:00:40.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.901+0000 7faaade66640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faa8c06a430 0x7faa8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:40.900 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.902+0000 7faaade66640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faa8c06a430 0x7faa8c06c8f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faaa4006a90 tx=0x7faaa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:40.904 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:40.905+0000 7faa9e7fc640 1 -- 172.21.15.113:0/989131736 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faaa0054460 con 0x7faaa814b7d0 2023-12-19T14:00:41.092 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.093+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7faaa815ee80 con 0x7faa8c06a430 2023-12-19T14:00:41.093 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.094+0000 7faa9e7fc640 1 -- 172.21.15.113:0/989131736 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faaa4009dc0 con 0x7faa8c06a430 2023-12-19T14:00:41.093 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T14:00:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.096+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faa8c06a430 msgr2=0x7faa8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.096+0000 7faaaee68640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faa8c06a430 0x7faa8c06c8f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faaa4006a90 tx=0x7faaa4008040 comp rx=0 tx=0).stop 2023-12-19T14:00:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.096+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa814b7d0 msgr2=0x7faaa80aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.095 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.096+0000 7faaaee68640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa814b7d0 0x7faaa80aec80 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7faaa00012e0 tx=0x7faaa000b4a0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 shutdown_connections 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7faa8c06a430 0x7faa8c06c8f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa814b7d0 0x7faaa80aec80 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa81f1e10 0x7faaa814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 --2- 172.21.15.113:0/989131736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa94003ef0 0x7faaa815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 >> 172.21.15.113:0/989131736 conn(0x7faaa80b0100 msgr2=0x7faaa8156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 shutdown_connections 2023-12-19T14:00:41.096 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.097+0000 7faaaee68640 1 -- 172.21.15.113:0/989131736 wait complete. 2023-12-19T14:00:41.113 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T14:00:41.114 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:41.321 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.322+0000 7ffad3f51640 1 Processor -- start 2023-12-19T14:00:41.322 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.322+0000 7ffad3f51640 1 -- start start 2023-12-19T14:00:41.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad3f51640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffacc146800 0x7ffacc0a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad3f51640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc147060 con 0x7ffacc0ab150 2023-12-19T14:00:41.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad3f51640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0ab710 con 0x7ffacc0ac7b0 2023-12-19T14:00:41.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad3f51640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc146be0 con 0x7ffacc146800 2023-12-19T14:00:41.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad1ced640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffacc146800 0x7ffacc0a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.323 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad14ec640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffacc0ab150 0x7ffacc0a9940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53704/0 (socket says 172.21.15.113:53704) 2023-12-19T14:00:41.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad1ced640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffacc146800 0x7ffacc0a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57450/0 (socket says 172.21.15.113:57450) 2023-12-19T14:00:41.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.324+0000 7ffad14ec640 1 -- 172.21.15.113:0/4199510935 learned_addr learned my addr 172.21.15.113:0/4199510935 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:41.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.325+0000 7ffad1ced640 1 -- 172.21.15.113:0/4199510935 >> v1:172.21.15.151:6789/0 conn(0x7ffacc0ac7b0 legacy=0x7ffacc0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:41.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.325+0000 7ffad1ced640 1 -- 172.21.15.113:0/4199510935 >> v1:172.21.15.113:6789/0 conn(0x7ffacc0ab150 legacy=0x7ffacc0a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.325+0000 7ffad1ced640 1 -- 172.21.15.113:0/4199510935 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0ab9f0 con 0x7ffacc146800 2023-12-19T14:00:41.324 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.325+0000 7ffad0ceb640 1 -- 172.21.15.113:0/4199510935 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723950931 0 0) 0x7ffacc147060 con 0x7ffacc0ab150 2023-12-19T14:00:41.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.326+0000 7ffad1ced640 1 --2- 172.21.15.113:0/4199510935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc0a9400 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7ffac80097a0 tx=0x7ffac802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1e31f5924dd248 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:41.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.326+0000 7ffad0ceb640 1 -- 172.21.15.113:0/4199510935 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac802f050 con 0x7ffacc146800 2023-12-19T14:00:41.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.326+0000 7ffad0ceb640 1 -- 172.21.15.113:0/4199510935 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac8031700 con 0x7ffacc146800 2023-12-19T14:00:41.325 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.326+0000 7ffad0ceb640 1 -- 172.21.15.113:0/4199510935 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8031a90 con 0x7ffacc146800 2023-12-19T14:00:41.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.327+0000 7ffad3f51640 1 -- 172.21.15.113:0/4199510935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 msgr2=0x7ffacc0a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.327+0000 7ffad3f51640 1 --2- 172.21.15.113:0/4199510935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc0a9400 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7ffac80097a0 tx=0x7ffac802b7a0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.327+0000 7ffad3f51640 1 -- 172.21.15.113:0/4199510935 shutdown_connections 2023-12-19T14:00:41.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.327+0000 7ffad3f51640 1 --2- 172.21.15.113:0/4199510935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc0a9400 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.327+0000 7ffad3f51640 1 -- 172.21.15.113:0/4199510935 >> 172.21.15.113:0/4199510935 conn(0x7ffacc06f5a0 msgr2=0x7ffacc06f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:41.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.327+0000 7ffad3f51640 1 -- 172.21.15.113:0/4199510935 shutdown_connections 2023-12-19T14:00:41.326 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.327+0000 7ffad3f51640 1 -- 172.21.15.113:0/4199510935 wait complete. 2023-12-19T14:00:41.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.329+0000 7ffad3f51640 1 Processor -- start 2023-12-19T14:00:41.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.329+0000 7ffad3f51640 1 -- start start 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad3f51640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffacc0ab150 0x7ffacc1f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad3f51640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffacc0ac7b0 0x7ffacc15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad3f51640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad3f51640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc15eba0 con 0x7ffacc146800 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad3f51640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc160450 con 0x7ffacc0ac7b0 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad3f51640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1f3fb0 con 0x7ffacc0ab150 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad24ee640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad24ee640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57460/0 (socket says 172.21.15.113:57460) 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.330+0000 7ffad24ee640 1 -- 172.21.15.113:0/171409902 learned_addr learned my addr 172.21.15.113:0/171409902 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad14ec640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffacc0ac7b0 0x7ffacc15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad24ee640 1 -- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffacc0ab150 msgr2=0x7ffacc1f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad24ee640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffacc0ab150 0x7ffacc1f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad24ee640 1 -- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffacc0ac7b0 msgr2=0x7ffacc15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad24ee640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffacc0ac7b0 0x7ffacc15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad24ee640 1 -- 172.21.15.113:0/171409902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8009400 con 0x7ffacc146800 2023-12-19T14:00:41.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad24ee640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc139f60 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7ffac400b9a0 tx=0x7ffac400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:41.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400cba0 con 0x7ffacc146800 2023-12-19T14:00:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400cd00 con 0x7ffacc146800 2023-12-19T14:00:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4014680 con 0x7ffacc146800 2023-12-19T14:00:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.331+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc15df90 con 0x7ffacc146800 2023-12-19T14:00:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.332+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc15e550 con 0x7ffacc146800 2023-12-19T14:00:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.332+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffacc0abfb0 con 0x7ffacc146800 2023-12-19T14:00:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.334+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffac401d3b0 con 0x7ffacc146800 2023-12-19T14:00:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.334+0000 7ffac27fc640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffab006a430 0x7ffab006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.335+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffac4088400 con 0x7ffacc146800 2023-12-19T14:00:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.335+0000 7ffad1ced640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffab006a430 0x7ffab006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.335+0000 7ffac27fc640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7ffab0070290 0x7ffab00726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.335+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 --> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffab0072d60 con 0x7ffab0070290 2023-12-19T14:00:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.335+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac408aac0 con 0x7ffacc146800 2023-12-19T14:00:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.335+0000 7ffad1ced640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffab006a430 0x7ffab006c8f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffac8035000 tx=0x7ffac8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:41.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.336+0000 7ffad14ec640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7ffab0070290 0x7ffab00726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.337+0000 7ffad14ec640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7ffab0070290 0x7ffab00726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:41.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.338+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== osd.4 v2:172.21.15.151:6800/84063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7ffab0072d60 con 0x7ffab0070290 2023-12-19T14:00:41.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.351+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 --> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffacc0abcd0 con 0x7ffab0070290 2023-12-19T14:00:41.351 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.352+0000 7ffac27fc640 1 -- 172.21.15.113:0/171409902 <== osd.4 v2:172.21.15.151:6800/84063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7ffabc0047e0 con 0x7ffab0070290 2023-12-19T14:00:41.351 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:41.351 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:41.351 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.352+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7ffab0070290 msgr2=0x7ffab00726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.352+0000 7ffad3f51640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.151:6800/84063,v1:172.21.15.151:6801/84063] conn(0x7ffab0070290 0x7ffab00726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.352+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffab006a430 msgr2=0x7ffab006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.352+0000 7ffad3f51640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7ffab006a430 0x7ffab006c8f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffac8035000 tx=0x7ffac8030000 comp rx=0 tx=0).stop 2023-12-19T14:00:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.353+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 msgr2=0x7ffacc139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.353+0000 7ffad3f51640 1 --2- 172.21.15.113:0/171409902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffacc146800 0x7ffacc139f60 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7ffac400b9a0 tx=0x7ffac400be60 comp rx=0 tx=0).stop 2023-12-19T14:00:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.353+0000 7ffad24ee640 1 -- 172.21.15.113:0/171409902 reap_dead start 2023-12-19T14:00:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.353+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 shutdown_connections 2023-12-19T14:00:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.353+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 >> 172.21.15.113:0/171409902 conn(0x7ffacc06f5a0 msgr2=0x7ffacc0acbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.353+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 shutdown_connections 2023-12-19T14:00:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.353+0000 7ffad3f51640 1 -- 172.21.15.113:0/171409902 wait complete. 2023-12-19T14:00:41.369 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T14:00:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.584+0000 7f02dfa61640 1 Processor -- start 2023-12-19T14:00:41.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.584+0000 7f02dfa61640 1 -- start start 2023-12-19T14:00:41.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.586+0000 7f02dfa61640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f02d81449e0 0x7f02d80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.586+0000 7f02dfa61640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d80afb10 con 0x7f02d806c6b0 2023-12-19T14:00:41.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.586+0000 7f02dfa61640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d806bb30 con 0x7f02d80b0b50 2023-12-19T14:00:41.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.586+0000 7f02dfa61640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80b0070 con 0x7f02d81449e0 2023-12-19T14:00:41.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.586+0000 7f02ddffe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f02d806c6b0 0x7f02d80b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53710/0 (socket says 172.21.15.113:53710) 2023-12-19T14:00:41.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.586+0000 7f02ddffe640 1 -- 172.21.15.113:0/612209066 learned_addr learned my addr 172.21.15.113:0/612209066 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:41.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.586+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/612209066 >> v2:172.21.15.151:3300/0 conn(0x7f02d81449e0 0x7f02d80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361254702 0 0) 0x7f02d80afb10 con 0x7f02d806c6b0 2023-12-19T14:00:41.586 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c4003520 con 0x7f02d806c6b0 2023-12-19T14:00:41.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 19422377 0 0) 0x7f02c4003520 con 0x7f02d806c6b0 2023-12-19T14:00:41.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 >> v2:172.21.15.151:3300/0 conn(0x7f02d81449e0 msgr2=0x7f02d80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:41.587 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 --2- 172.21.15.113:0/612209066 >> v2:172.21.15.151:3300/0 conn(0x7f02d81449e0 0x7f02d80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 >> v1:172.21.15.151:6789/0 conn(0x7f02d80b0b50 legacy=0x7f02d806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80b0350 con 0x7f02d806c6b0 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f02d00019f0 con 0x7f02d806c6b0 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 >> v1:172.21.15.113:6789/0 conn(0x7f02d806c6b0 legacy=0x7f02d80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02c4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02c40047c0 0x7f02c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c40051d0 0x7f02c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80b0070 con 0x7f02c4003a30 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c400c100 con 0x7f02c40047c0 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c400c2c0 con 0x7f02c40051d0 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.587+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02c4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.588+0000 7f02dd7fd640 1 -- 172.21.15.113:0/612209066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c40051d0 msgr2=0x7f02c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.588+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02c40051d0 0x7f02c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.588+0000 7f02dd7fd640 1 -- 172.21.15.113:0/612209066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02c40047c0 msgr2=0x7f02c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:41.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.588+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02c40047c0 0x7f02c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.588+0000 7f02dd7fd640 1 -- 172.21.15.113:0/612209066 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4003520 con 0x7f02c4003a30 2023-12-19T14:00:41.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.588+0000 7f02ddffe640 1 -- 172.21.15.113:0/612209066 reap_dead start 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.589+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02c4003e50 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009ac0 tx=0x7f02c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c229ee1f9514a7e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.589+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d402c6b0 con 0x7f02c4003a30 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.589+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d402c810 con 0x7f02c4003a30 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.589+0000 7f02cffff640 1 -- 172.21.15.113:0/612209066 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d402cba0 con 0x7f02c4003a30 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.590+0000 7f02dfa61640 1 -- 172.21.15.113:0/612209066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 msgr2=0x7f02c4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.590+0000 7f02dfa61640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02c4003e50 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009ac0 tx=0x7f02c40057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.590+0000 7f02dfa61640 1 -- 172.21.15.113:0/612209066 shutdown_connections 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.590+0000 7f02dfa61640 1 --2- 172.21.15.113:0/612209066 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02c4003e50 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.590+0000 7f02dfa61640 1 -- 172.21.15.113:0/612209066 >> 172.21.15.113:0/612209066 conn(0x7f02d80cbb70 msgr2=0x7f02d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.590+0000 7f02dfa61640 1 -- 172.21.15.113:0/612209066 shutdown_connections 2023-12-19T14:00:41.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.590+0000 7f02dfa61640 1 -- 172.21.15.113:0/612209066 wait complete. 2023-12-19T14:00:41.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.592+0000 7f02dfa61640 1 Processor -- start 2023-12-19T14:00:41.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.592+0000 7f02dfa61640 1 -- start start 2023-12-19T14:00:41.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dfa61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02d8151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dfa61640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d815e130 0x7f02d815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dfa61640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d815e5b0 0x7f02d815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dfa61640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8142220 con 0x7f02c4003a30 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dfa61640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8151670 con 0x7f02d815e130 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dfa61640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8141300 con 0x7f02d815e5b0 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dd7fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02d8151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dd7fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02d8151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57476/0 (socket says 172.21.15.113:57476) 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.593+0000 7f02dd7fd640 1 -- 172.21.15.113:0/68759062 learned_addr learned my addr 172.21.15.113:0/68759062 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dd7fd640 1 -- 172.21.15.113:0/68759062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d815e5b0 msgr2=0x7f02d815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d815e5b0 0x7f02d815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dd7fd640 1 -- 172.21.15.113:0/68759062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d815e130 msgr2=0x7f02d815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d815e130 0x7f02d815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.593 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dd7fd640 1 -- 172.21.15.113:0/68759062 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d81415a0 con 0x7f02c4003a30 2023-12-19T14:00:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dd7fd640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02d8151130 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f02d402c250 tx=0x7f02d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02cdffb640 1 -- 172.21.15.113:0/68759062 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4003810 con 0x7f02c4003a30 2023-12-19T14:00:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02cdffb640 1 -- 172.21.15.113:0/68759062 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4003970 con 0x7f02c4003a30 2023-12-19T14:00:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02cdffb640 1 -- 172.21.15.113:0/68759062 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4003d00 con 0x7f02c4003a30 2023-12-19T14:00:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d8141880 con 0x7f02c4003a30 2023-12-19T14:00:41.594 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.594+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d8141e40 con 0x7f02c4003a30 2023-12-19T14:00:41.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.596+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d8142490 con 0x7f02c4003a30 2023-12-19T14:00:41.595 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.597+0000 7f02cdffb640 1 -- 172.21.15.113:0/68759062 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02d4034440 con 0x7f02c4003a30 2023-12-19T14:00:41.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.597+0000 7f02cdffb640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:41.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.598+0000 7f02cdffb640 1 -- 172.21.15.113:0/68759062 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f02d40aa880 con 0x7f02c4003a30 2023-12-19T14:00:41.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.598+0000 7f02dcffc640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:41.597 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.598+0000 7f02dcffc640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02bc06a430 0x7f02bc06c8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f02d813fb40 tx=0x7f02c8007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:41.600 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.602+0000 7f02cdffb640 1 -- 172.21.15.113:0/68759062 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02d4076210 con 0x7f02c4003a30 2023-12-19T14:00:41.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.792+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f02d80b0630 con 0x7f02bc06a430 2023-12-19T14:00:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.793+0000 7f02cdffb640 1 -- 172.21.15.113:0/68759062 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f02c8014400 con 0x7f02bc06a430 2023-12-19T14:00:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T14:00:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.795+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02bc06a430 msgr2=0x7f02bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.795+0000 7f02dfa61640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02bc06a430 0x7f02bc06c8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f02d813fb40 tx=0x7f02c8007990 comp rx=0 tx=0).stop 2023-12-19T14:00:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.795+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 msgr2=0x7f02d8151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.795+0000 7f02dfa61640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02d8151130 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f02d402c250 tx=0x7f02d4004730 comp rx=0 tx=0).stop 2023-12-19T14:00:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 shutdown_connections 2023-12-19T14:00:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d815e5b0 0x7f02d815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d815e130 0x7f02d815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 --2- 172.21.15.113:0/68759062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f02c4003a30 0x7f02d8151130 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:41.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 >> 172.21.15.113:0/68759062 conn(0x7f02d80cbb70 msgr2=0x7f02d80b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:41.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 shutdown_connections 2023-12-19T14:00:41.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:41.796+0000 7f02dfa61640 1 -- 172.21.15.113:0/68759062 wait complete. 2023-12-19T14:00:41.812 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T14:00:41.812 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:42.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.030+0000 7f1c529f0640 1 Processor -- start 2023-12-19T14:00:42.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.030+0000 7f1c529f0640 1 -- start start 2023-12-19T14:00:42.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.031+0000 7f1c529f0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1c4c15a000 0x7f1c4c15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.031+0000 7f1c529f0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c4c0cbca0 0x7f1c4c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.031+0000 7f1c529f0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c15ec00 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.031+0000 7f1c529f0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c071c60 con 0x7f1c4c0cbca0 2023-12-19T14:00:42.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.031+0000 7f1c529f0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0b2230 con 0x7f1c4c15a000 2023-12-19T14:00:42.040 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c43fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c4c0cbca0 0x7f1c4c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c43fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c4c0cbca0 0x7f1c4c0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57478/0 (socket says 172.21.15.113:57478) 2023-12-19T14:00:42.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c43fff640 1 -- 172.21.15.113:0/3501217062 learned_addr learned my addr 172.21.15.113:0/3501217062 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:42.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c4bfff640 1 --2- 172.21.15.113:0/3501217062 >> v2:172.21.15.151:3300/0 conn(0x7f1c4c15a000 0x7f1c4c15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c43fff640 1 -- 172.21.15.113:0/3501217062 >> v2:172.21.15.151:3300/0 conn(0x7f1c4c15a000 msgr2=0x7f1c4c15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c43fff640 1 --2- 172.21.15.113:0/3501217062 >> v2:172.21.15.151:3300/0 conn(0x7f1c4c15a000 0x7f1c4c15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.041 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c43fff640 1 -- 172.21.15.113:0/3501217062 >> v1:172.21.15.151:6789/0 conn(0x7f1c4c0b1dc0 legacy=0x7f1c4c06b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.032+0000 7f1c43fff640 1 -- 172.21.15.113:0/3501217062 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c070bc0 con 0x7f1c4c0cbca0 2023-12-19T14:00:42.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.034+0000 7f1c43fff640 1 --2- 172.21.15.113:0/3501217062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0cbca0 0x7f1c4c0b1880 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c06f7a0 tx=0x7f1c3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd53c7b3398767e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.034+0000 7f1c4b7fe640 1 -- 172.21.15.113:0/3501217062 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34031870 con 0x7f1c4c0cbca0 2023-12-19T14:00:42.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.034+0000 7f1c4b7fe640 1 -- 172.21.15.113:0/3501217062 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c340319d0 con 0x7f1c4c0cbca0 2023-12-19T14:00:42.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.034+0000 7f1c4b7fe640 1 -- 172.21.15.113:0/3501217062 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34031d60 con 0x7f1c4c0cbca0 2023-12-19T14:00:42.042 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 -- 172.21.15.113:0/3501217062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0cbca0 msgr2=0x7f1c4c0b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 --2- 172.21.15.113:0/3501217062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0cbca0 0x7f1c4c0b1880 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c06f7a0 tx=0x7f1c3402b910 comp rx=0 tx=0).stop 2023-12-19T14:00:42.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 -- 172.21.15.113:0/3501217062 shutdown_connections 2023-12-19T14:00:42.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 --2- 172.21.15.113:0/3501217062 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0cbca0 0x7f1c4c0b1880 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 --2- 172.21.15.113:0/3501217062 >> v2:172.21.15.151:3300/0 conn(0x7f1c4c15a000 0x7f1c4c15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 -- 172.21.15.113:0/3501217062 >> 172.21.15.113:0/3501217062 conn(0x7f1c4c0cf230 msgr2=0x7f1c4c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:42.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 -- 172.21.15.113:0/3501217062 shutdown_connections 2023-12-19T14:00:42.043 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.035+0000 7f1c529f0640 1 -- 172.21.15.113:0/3501217062 wait complete. 2023-12-19T14:00:42.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.037+0000 7f1c529f0640 1 Processor -- start 2023-12-19T14:00:42.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.037+0000 7f1c529f0640 1 -- start start 2023-12-19T14:00:42.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c529f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0b1dc0 0x7f1c4c06cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c529f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c0cbca0 0x7f1c4c14c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c529f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c4c15a000 0x7f1c4c1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.044 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c529f0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c14c960 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c529f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c14a9e0 con 0x7f1c4c0cbca0 2023-12-19T14:00:42.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c529f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c14acc0 con 0x7f1c4c15a000 2023-12-19T14:00:42.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0b1dc0 0x7f1c4c06cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0b1dc0 0x7f1c4c06cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57488/0 (socket says 172.21.15.113:57488) 2023-12-19T14:00:42.045 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.038+0000 7f1c4bfff640 1 -- 172.21.15.113:0/4070768043 learned_addr learned my addr 172.21.15.113:0/4070768043 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:42.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c43fff640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c0cbca0 0x7f1c4c14c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c4bfff640 1 -- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c4c15a000 msgr2=0x7f1c4c1f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c4bfff640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c4c15a000 0x7f1c4c1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c4bfff640 1 -- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c0cbca0 msgr2=0x7f1c4c14c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c4bfff640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c0cbca0 0x7f1c4c14c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.046 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c4bfff640 1 -- 172.21.15.113:0/4070768043 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340094d0 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c43fff640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4c0cbca0 0x7f1c4c14c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:42.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c4bfff640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0b1dc0 0x7f1c4c06cba0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00d5f0 tx=0x7f1c3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0125f0 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c012750 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c012b00 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.047 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.039+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c14afa0 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.040+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c14b560 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.048 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.040+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c4c071180 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.041+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c3c012c60 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.042+0000 7f1c497fa640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.050 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.042+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1c3c088b40 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.043+0000 7f1c43fff640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.043+0000 7f1c497fa640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f1c2c070290 0x7f1c2c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.043+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 --> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c2c072d60 con 0x7f1c2c070290 2023-12-19T14:00:42.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.043+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c3c08d2a0 con 0x7f1c4c0b1dc0 2023-12-19T14:00:42.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.044+0000 7f1c50f8d640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f1c2c070290 0x7f1c2c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.051 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.044+0000 7f1c43fff640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1c34036000 tx=0x7f1c3403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.045+0000 7f1c50f8d640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f1c2c070290 0x7f1c2c0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.052 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.046+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== osd.5 v2:172.21.15.151:6808/84062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f1c2c072d60 con 0x7f1c2c070290 2023-12-19T14:00:42.058 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.059+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 --> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c4c14ae30 con 0x7f1c2c070290 2023-12-19T14:00:42.059 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.060+0000 7f1c497fa640 1 -- 172.21.15.113:0/4070768043 <== osd.5 v2:172.21.15.151:6808/84062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f1c4c14ae30 con 0x7f1c2c070290 2023-12-19T14:00:42.059 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:42.059 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:42.059 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:42.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f1c2c070290 msgr2=0x7f1c2c0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.151:6808/84062,v1:172.21.15.151:6809/84062] conn(0x7f1c2c070290 0x7f1c2c0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.060 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2c06a430 msgr2=0x7f1c2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1c34036000 tx=0x7f1c3403c040 comp rx=0 tx=0).stop 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0b1dc0 msgr2=0x7f1c4c06cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 --2- 172.21.15.113:0/4070768043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c4c0b1dc0 0x7f1c4c06cba0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00d5f0 tx=0x7f1c3c00dab0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c50f8d640 1 -- 172.21.15.113:0/4070768043 reap_dead start 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 shutdown_connections 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 >> 172.21.15.113:0/4070768043 conn(0x7f1c4c0cf230 msgr2=0x7f1c4c156220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 shutdown_connections 2023-12-19T14:00:42.061 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.061+0000 7f1c529f0640 1 -- 172.21.15.113:0/4070768043 wait complete. 2023-12-19T14:00:42.079 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T14:00:42.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.291+0000 7efe6ddf5640 1 Processor -- start 2023-12-19T14:00:42.290 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.291+0000 7efe6ddf5640 1 -- start start 2023-12-19T14:00:42.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.293+0000 7efe6ddf5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efe68159f80 0x7efe6806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.293+0000 7efe6ddf5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 0x7efe6815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.293+0000 7efe6ddf5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6806b520 con 0x7efe6815a8a0 2023-12-19T14:00:42.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.293+0000 7efe6ddf5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe680b2b20 con 0x7efe68159f80 2023-12-19T14:00:42.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.293+0000 7efe6ddf5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680b2fb0 con 0x7efe6815b1e0 2023-12-19T14:00:42.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.293+0000 7efe6d5f4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7efe6815a8a0 0x7efe6815dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53720/0 (socket says 172.21.15.113:53720) 2023-12-19T14:00:42.292 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.293+0000 7efe6d5f4640 1 -- 172.21.15.113:0/4128117399 learned_addr learned my addr 172.21.15.113:0/4128117399 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:42.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5ffff640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 0x7efe6815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe6cdf3640 1 --2- 172.21.15.113:0/4128117399 >> v2:172.21.15.151:3300/0 conn(0x7efe68159f80 0x7efe6806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214253910 0 0) 0x7efe6806b520 con 0x7efe6815a8a0 2023-12-19T14:00:42.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe50003520 con 0x7efe6815a8a0 2023-12-19T14:00:42.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 201580920 0 0) 0x7efe50003520 con 0x7efe6815a8a0 2023-12-19T14:00:42.294 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 msgr2=0x7efe6815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 0x7efe6815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 >> v2:172.21.15.151:3300/0 conn(0x7efe68159f80 msgr2=0x7efe6806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 --2- 172.21.15.113:0/4128117399 >> v2:172.21.15.151:3300/0 conn(0x7efe68159f80 0x7efe6806f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680b1f10 con 0x7efe6815a8a0 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7efe600019f0 con 0x7efe6815a8a0 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 >> v1:172.21.15.113:6789/0 conn(0x7efe6815a8a0 legacy=0x7efe6815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50003970 0x7efe50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 0x7efe500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe50004d00 0x7efe50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680b2b20 con 0x7efe50004d00 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680b2fb0 con 0x7efe50003970 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.294+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5000dbc0 con 0x7efe6815b1e0 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe6d5f4640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe50004d00 0x7efe50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe6cdf3640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50003970 0x7efe50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.295 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe5ffff640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 0x7efe500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe6d5f4640 1 -- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 msgr2=0x7efe500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe6d5f4640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe6815b1e0 0x7efe500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe6d5f4640 1 -- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50003970 msgr2=0x7efe50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe6d5f4640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50003970 0x7efe50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.296 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.295+0000 7efe6d5f4640 1 -- 172.21.15.113:0/4128117399 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50003520 con 0x7efe50004d00 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.296+0000 7efe6d5f4640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe50004d00 0x7efe50005180 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7efe6000a790 tx=0x7efe500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77b7f685be8692b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60034630 con 0x7efe50004d00 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6002f070 con 0x7efe50004d00 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe5f7fe640 1 -- 172.21.15.113:0/4128117399 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600349f0 con 0x7efe50004d00 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe6ddf5640 1 -- 172.21.15.113:0/4128117399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe50004d00 msgr2=0x7efe50005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe6ddf5640 1 --2- 172.21.15.113:0/4128117399 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe50004d00 0x7efe50005180 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7efe6000a790 tx=0x7efe500057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe6d5f4640 1 -- 172.21.15.113:0/4128117399 reap_dead start 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe6ddf5640 1 -- 172.21.15.113:0/4128117399 shutdown_connections 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe6ddf5640 1 -- 172.21.15.113:0/4128117399 >> 172.21.15.113:0/4128117399 conn(0x7efe680b0100 msgr2=0x7efe680b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:42.297 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe6ddf5640 1 -- 172.21.15.113:0/4128117399 shutdown_connections 2023-12-19T14:00:42.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.297+0000 7efe6ddf5640 1 -- 172.21.15.113:0/4128117399 wait complete. 2023-12-19T14:00:42.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.299+0000 7efe6ddf5640 1 Processor -- start 2023-12-19T14:00:42.298 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.299+0000 7efe6ddf5640 1 -- start start 2023-12-19T14:00:42.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe6ddf5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50004d00 0x7efe680a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe6ddf5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe680aa0f0 0x7efe680b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe6ddf5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe680b1770 0x7efe680ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe6ddf5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680b1bf0 con 0x7efe680aa0f0 2023-12-19T14:00:42.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe6ddf5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680a89e0 con 0x7efe50004d00 2023-12-19T14:00:42.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe6ddf5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe68156970 con 0x7efe680b1770 2023-12-19T14:00:42.299 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe680aa0f0 0x7efe680b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe680aa0f0 0x7efe680b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57504/0 (socket says 172.21.15.113:57504) 2023-12-19T14:00:42.300 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.300+0000 7efe5ffff640 1 -- 172.21.15.113:0/40069883 learned_addr learned my addr 172.21.15.113:0/40069883 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe6cdf3640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50004d00 0x7efe680a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5ffff640 1 -- 172.21.15.113:0/40069883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe680b1770 msgr2=0x7efe680ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5ffff640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe680b1770 0x7efe680ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5ffff640 1 -- 172.21.15.113:0/40069883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50004d00 msgr2=0x7efe680a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5ffff640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50004d00 0x7efe680a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5ffff640 1 -- 172.21.15.113:0/40069883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68156c50 con 0x7efe680aa0f0 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5ffff640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe680aa0f0 0x7efe680b1230 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7efe58011630 tx=0x7efe58011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5d7fa640 1 -- 172.21.15.113:0/40069883 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58015870 con 0x7efe680aa0f0 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5d7fa640 1 -- 172.21.15.113:0/40069883 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580159d0 con 0x7efe680aa0f0 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe68156f30 con 0x7efe680aa0f0 2023-12-19T14:00:42.301 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.301+0000 7efe5d7fa640 1 -- 172.21.15.113:0/40069883 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58015d40 con 0x7efe680aa0f0 2023-12-19T14:00:42.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.302+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe681574f0 con 0x7efe680aa0f0 2023-12-19T14:00:42.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.303+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe68061910 con 0x7efe680aa0f0 2023-12-19T14:00:42.302 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.304+0000 7efe5d7fa640 1 -- 172.21.15.113:0/40069883 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe5800f490 con 0x7efe680aa0f0 2023-12-19T14:00:42.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.305+0000 7efe5d7fa640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5406a460 0x7efe5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.305+0000 7efe5d7fa640 1 -- 172.21.15.113:0/40069883 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efe58088dd0 con 0x7efe680aa0f0 2023-12-19T14:00:42.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.305+0000 7efe6cdf3640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5406a460 0x7efe5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.304 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.306+0000 7efe6cdf3640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5406a460 0x7efe5406c920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efe64009a60 tx=0x7efe64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.308 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.310+0000 7efe5d7fa640 1 -- 172.21.15.113:0/40069883 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe580546c0 con 0x7efe680aa0f0 2023-12-19T14:00:42.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.498+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7efe680b24d0 con 0x7efe5406a460 2023-12-19T14:00:42.498 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.499+0000 7efe5d7fa640 1 -- 172.21.15.113:0/40069883 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efe64013a20 con 0x7efe5406a460 2023-12-19T14:00:42.498 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T14:00:42.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5406a460 msgr2=0x7efe5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5406a460 0x7efe5406c920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efe64009a60 tx=0x7efe64008040 comp rx=0 tx=0).stop 2023-12-19T14:00:42.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe680aa0f0 msgr2=0x7efe680b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe680aa0f0 0x7efe680b1230 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7efe58011630 tx=0x7efe58011af0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 shutdown_connections 2023-12-19T14:00:42.501 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efe5406a460 0x7efe5406c920 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe680b1770 0x7efe680ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe680aa0f0 0x7efe680b1230 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 --2- 172.21.15.113:0/40069883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe50004d00 0x7efe680a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 >> 172.21.15.113:0/40069883 conn(0x7efe680b0100 msgr2=0x7efe6806d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:42.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 shutdown_connections 2023-12-19T14:00:42.502 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.502+0000 7efe6ddf5640 1 -- 172.21.15.113:0/40069883 wait complete. 2023-12-19T14:00:42.521 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T14:00:42.521 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.737+0000 7f005c101640 1 Processor -- start 2023-12-19T14:00:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.737+0000 7f005c101640 1 -- start start 2023-12-19T14:00:42.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.739+0000 7f005c101640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f005406d820 0x7f0054165040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.739+0000 7f005c101640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0054070bc0 con 0x7f005415a000 2023-12-19T14:00:42.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.739+0000 7f005c101640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0054070ea0 con 0x7f00540cbca0 2023-12-19T14:00:42.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.739+0000 7f005c101640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0054071c60 con 0x7f005406d820 2023-12-19T14:00:42.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.739+0000 7f0059e9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f005415a000 0x7f005415e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53736/0 (socket says 172.21.15.113:53736) 2023-12-19T14:00:42.738 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.739+0000 7f0059e9d640 1 -- 172.21.15.113:0/2063601715 learned_addr learned my addr 172.21.15.113:0/2063601715 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f005a69e640 1 --2- 172.21.15.113:0/2063601715 >> v2:172.21.15.151:3300/0 conn(0x7f005406d820 0x7f0054165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486576670 0 0) 0x7f0054070bc0 con 0x7f005415a000 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0040003520 con 0x7f005415a000 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2255923272 0 0) 0x7f0040003520 con 0x7f005415a000 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 >> v2:172.21.15.151:3300/0 conn(0x7f005406d820 msgr2=0x7f0054165040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 --2- 172.21.15.113:0/2063601715 >> v2:172.21.15.151:3300/0 conn(0x7f005406d820 0x7f0054165040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 >> v1:172.21.15.151:6789/0 conn(0x7f00540cbca0 legacy=0x7f00540b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054071180 con 0x7f005415a000 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f0050001670 con 0x7f005415a000 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f005a69e640 1 --2- 172.21.15.113:0/2063601715 >> v2:172.21.15.151:3300/0 conn(0x7f005406d820 0x7f0054165040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 >> v1:172.21.15.113:6789/0 conn(0x7f005415a000 legacy=0x7f005415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00400039e0 0x7f0040003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400047c0 0x7f0040004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00400051f0 0x7f004000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054071c60 con 0x7f00400051f0 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004000c150 con 0x7f00400039e0 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.740+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004000e520 con 0x7f00400047c0 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f005a69e640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00400051f0 0x7f004000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f0059e9d640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00400039e0 0x7f0040003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f005969c640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400047c0 0x7f0040004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f005a69e640 1 -- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400047c0 msgr2=0x7f0040004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f005a69e640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400047c0 0x7f0040004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f005a69e640 1 -- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00400039e0 msgr2=0x7f0040003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f005a69e640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00400039e0 0x7f0040003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.741+0000 7f005a69e640 1 -- 172.21.15.113:0/2063601715 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040003520 con 0x7f00400051f0 2023-12-19T14:00:42.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.742+0000 7f005a69e640 1 -- 172.21.15.113:0/2063601715 reap_dead start 2023-12-19T14:00:42.743 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.742+0000 7f005a69e640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00400051f0 0x7f004000b980 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f004c0073e0 tx=0x7f00400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f9ea15c50a0a61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.742+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c02cdc0 con 0x7f00400051f0 2023-12-19T14:00:42.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.742+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c034440 con 0x7f00400051f0 2023-12-19T14:00:42.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.742+0000 7f0058e9b640 1 -- 172.21.15.113:0/2063601715 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c0347f0 con 0x7f00400051f0 2023-12-19T14:00:42.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.743+0000 7f005c101640 1 -- 172.21.15.113:0/2063601715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00400051f0 msgr2=0x7f004000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.743+0000 7f005c101640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00400051f0 0x7f004000b980 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f004c0073e0 tx=0x7f00400057f0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.744 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.743+0000 7f005c101640 1 -- 172.21.15.113:0/2063601715 shutdown_connections 2023-12-19T14:00:42.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.743+0000 7f005c101640 1 --2- 172.21.15.113:0/2063601715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00400051f0 0x7f004000b980 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.743+0000 7f005c101640 1 -- 172.21.15.113:0/2063601715 >> 172.21.15.113:0/2063601715 conn(0x7f00540cf230 msgr2=0x7f00540cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:42.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.743+0000 7f005c101640 1 -- 172.21.15.113:0/2063601715 shutdown_connections 2023-12-19T14:00:42.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.743+0000 7f005c101640 1 -- 172.21.15.113:0/2063601715 wait complete. 2023-12-19T14:00:42.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.745+0000 7f005c101640 1 Processor -- start 2023-12-19T14:00:42.745 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.745+0000 7f005c101640 1 -- start start 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005c101640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400051f0 0x7f0054145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005c101640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f005415b730 0x7f005415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005c101640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540ac8b0 0x7f00540acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005c101640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540ad270 con 0x7f005415b730 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005c101640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054154950 con 0x7f00540ac8b0 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005c101640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005415bca0 con 0x7f00400051f0 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005969c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f005415b730 0x7f005415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.747 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005969c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f005415b730 0x7f005415ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57526/0 (socket says 172.21.15.113:57526) 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.746+0000 7f005969c640 1 -- 172.21.15.113:0/930160195 learned_addr learned my addr 172.21.15.113:0/930160195 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005a69e640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540ac8b0 0x7f00540acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f0059e9d640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400051f0 0x7f0054145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005969c640 1 -- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400051f0 msgr2=0x7f0054145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005969c640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00400051f0 0x7f0054145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005969c640 1 -- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540ac8b0 msgr2=0x7f00540acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005969c640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540ac8b0 0x7f00540acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005969c640 1 -- 172.21.15.113:0/930160195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005415bf80 con 0x7f005415b730 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005a69e640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00540ac8b0 0x7f00540acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005969c640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f005415b730 0x7f005415ce90 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f004400d570 tx=0x7f004400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044003610 con 0x7f005415b730 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044003770 con 0x7f005415b730 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044003ae0 con 0x7f005415b730 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.747+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005415c260 con 0x7f005415b730 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.748+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00541460d0 con 0x7f005415b730 2023-12-19T14:00:42.748 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.748+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0054071740 con 0x7f005415b730 2023-12-19T14:00:42.749 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.750+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f004401c460 con 0x7f005415b730 2023-12-19T14:00:42.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f004a7fc640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003806a430 0x7f003806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0044088f50 con 0x7f005415b730 2023-12-19T14:00:42.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f004a7fc640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f0038070290 0x7f00380726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 --> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0038072d60 con 0x7f0038070290 2023-12-19T14:00:42.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f0059e9d640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003806a430 0x7f003806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00440892c0 con 0x7f005415b730 2023-12-19T14:00:42.750 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f005a69e640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f0038070290 0x7f00380726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.751+0000 7f0059e9d640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003806a430 0x7f003806c8f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f00500018e0 tx=0x7f0050000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.751 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.752+0000 7f005a69e640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f0038070290 0x7f00380726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.754 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.754+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== osd.6 v2:172.21.15.151:6824/84065 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0038072d60 con 0x7f0038070290 2023-12-19T14:00:42.765 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.767+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 --> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0054071460 con 0x7f0038070290 2023-12-19T14:00:42.767 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.768+0000 7f004a7fc640 1 -- 172.21.15.113:0/930160195 <== osd.6 v2:172.21.15.151:6824/84065 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f004c0345b0 con 0x7f0038070290 2023-12-19T14:00:42.767 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:42.767 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:42.767 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:42.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.768+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f0038070290 msgr2=0x7f00380726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.768+0000 7f005c101640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.151:6824/84065,v1:172.21.15.151:6825/84065] conn(0x7f0038070290 0x7f00380726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.768+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003806a430 msgr2=0x7f003806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.768+0000 7f005c101640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f003806a430 0x7f003806c8f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f00500018e0 tx=0x7f0050000ed0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.768+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f005415b730 msgr2=0x7f005415ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.768 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.768+0000 7f005c101640 1 --2- 172.21.15.113:0/930160195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f005415b730 0x7f005415ce90 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f004400d570 tx=0x7f004400da30 comp rx=0 tx=0).stop 2023-12-19T14:00:42.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.769+0000 7f005a69e640 1 -- 172.21.15.113:0/930160195 reap_dead start 2023-12-19T14:00:42.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.769+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 shutdown_connections 2023-12-19T14:00:42.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.769+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 >> 172.21.15.113:0/930160195 conn(0x7f00540cf230 msgr2=0x7f00541563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:42.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.769+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 shutdown_connections 2023-12-19T14:00:42.769 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.769+0000 7f005c101640 1 -- 172.21.15.113:0/930160195 wait complete. 2023-12-19T14:00:42.785 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T14:00:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.987+0000 7f5b7f59e640 1 Processor -- start 2023-12-19T14:00:42.986 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.987+0000 7f5b7f59e640 1 -- start start 2023-12-19T14:00:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7f59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5b8015aa70 0x7f5b80164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7f59e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8006b520 con 0x7f5b80159f80 2023-12-19T14:00:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7f59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800b2b20 con 0x7f5b8015b1e0 2023-12-19T14:00:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7f59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b800b2fb0 con 0x7f5b8015aa70 2023-12-19T14:00:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7e59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5b80159f80 0x7f5b8006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53742/0 (socket says 172.21.15.113:53742) 2023-12-19T14:00:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7e59c640 1 -- 172.21.15.113:0/3118949757 learned_addr learned my addr 172.21.15.113:0/3118949757 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:42.988 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7ed9d640 1 --2- 172.21.15.113:0/3118949757 >> v2:172.21.15.113:3300/0 conn(0x7f5b8015aa70 0x7f5b80164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7d59a640 1 -- 172.21.15.113:0/3118949757 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770807678 0 0) 0x7f5b8006b520 con 0x7f5b80159f80 2023-12-19T14:00:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7d59a640 1 -- 172.21.15.113:0/3118949757 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68005730 con 0x7f5b80159f80 2023-12-19T14:00:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7ed9d640 1 -- 172.21.15.113:0/3118949757 >> v1:172.21.15.151:6789/0 conn(0x7f5b8015b1e0 legacy=0x7f5b8015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.989+0000 7f5b7ed9d640 1 -- 172.21.15.113:0/3118949757 >> v1:172.21.15.113:6789/0 conn(0x7f5b80159f80 legacy=0x7f5b8006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.989 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.990+0000 7f5b7ed9d640 1 -- 172.21.15.113:0/3118949757 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800b1f10 con 0x7f5b8015aa70 2023-12-19T14:00:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.991+0000 7f5b7ed9d640 1 --2- 172.21.15.113:0/3118949757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b8015aa70 0x7f5b80164f30 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009d90 tx=0x7f5b7802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419405bab3b96146 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.991+0000 7f5b7d59a640 1 -- 172.21.15.113:0/3118949757 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7802cd00 con 0x7f5b8015aa70 2023-12-19T14:00:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.991+0000 7f5b7d59a640 1 -- 172.21.15.113:0/3118949757 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7802ce60 con 0x7f5b8015aa70 2023-12-19T14:00:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.991+0000 7f5b7d59a640 1 -- 172.21.15.113:0/3118949757 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78034660 con 0x7f5b8015aa70 2023-12-19T14:00:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.991+0000 7f5b7f59e640 1 -- 172.21.15.113:0/3118949757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b8015aa70 msgr2=0x7f5b80164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.991+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/3118949757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b8015aa70 0x7f5b80164f30 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009d90 tx=0x7f5b7802bf50 comp rx=0 tx=0).stop 2023-12-19T14:00:42.991 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.992+0000 7f5b7f59e640 1 -- 172.21.15.113:0/3118949757 shutdown_connections 2023-12-19T14:00:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.992+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/3118949757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b8015aa70 0x7f5b80164f30 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.992+0000 7f5b7f59e640 1 -- 172.21.15.113:0/3118949757 >> 172.21.15.113:0/3118949757 conn(0x7f5b800b0100 msgr2=0x7f5b800b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.992+0000 7f5b7f59e640 1 -- 172.21.15.113:0/3118949757 shutdown_connections 2023-12-19T14:00:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.992+0000 7f5b7f59e640 1 -- 172.21.15.113:0/3118949757 wait complete. 2023-12-19T14:00:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.993+0000 7f5b7f59e640 1 Processor -- start 2023-12-19T14:00:42.992 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.994+0000 7f5b7f59e640 1 -- start start 2023-12-19T14:00:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7f59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b80159f80 0x7f5b801f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5b8015aa70 0x7f5b801517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b8015b1e0 0x7f5b8014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.994 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7f59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801f3e50 con 0x7f5b80159f80 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801f41e0 con 0x7f5b8015b1e0 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801f3360 con 0x7f5b8015aa70 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b80159f80 0x7f5b801f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b80159f80 0x7f5b801f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57544/0 (socket says 172.21.15.113:57544) 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 -- 172.21.15.113:0/2058192215 learned_addr learned my addr 172.21.15.113:0/2058192215 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7dd9b640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5b8015aa70 0x7f5b801517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 -- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5b8015aa70 msgr2=0x7f5b801517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7ed9d640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b8015b1e0 0x7f5b8014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5b8015aa70 0x7f5b801517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 -- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b8015b1e0 msgr2=0x7f5b8014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b8015b1e0 0x7f5b8014ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.995+0000 7f5b7e59c640 1 -- 172.21.15.113:0/2058192215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78009a70 con 0x7f5b80159f80 2023-12-19T14:00:42.995 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.996+0000 7f5b7e59c640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b80159f80 0x7f5b801f2e20 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c530 tx=0x7f5b7000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.996+0000 7f5b6effd640 1 -- 172.21.15.113:0/2058192215 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70005ce0 con 0x7f5b80159f80 2023-12-19T14:00:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.996+0000 7f5b6effd640 1 -- 172.21.15.113:0/2058192215 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70005e40 con 0x7f5b80159f80 2023-12-19T14:00:42.996 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.996+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b80151d30 con 0x7f5b80159f80 2023-12-19T14:00:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.996+0000 7f5b6effd640 1 -- 172.21.15.113:0/2058192215 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700072b0 con 0x7f5b80159f80 2023-12-19T14:00:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.996+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b801f3890 con 0x7f5b80159f80 2023-12-19T14:00:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.997+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b80061910 con 0x7f5b80159f80 2023-12-19T14:00:42.997 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.998+0000 7f5b6effd640 1 -- 172.21.15.113:0/2058192215 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b70007410 con 0x7f5b80159f80 2023-12-19T14:00:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.999+0000 7f5b6effd640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5b6006a460 0x7f5b6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.999+0000 7f5b6effd640 1 -- 172.21.15.113:0/2058192215 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5b70087c00 con 0x7f5b80159f80 2023-12-19T14:00:42.998 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:42.999+0000 7f5b7dd9b640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5b6006a460 0x7f5b6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:42.999 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.000+0000 7f5b7dd9b640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5b6006a460 0x7f5b6006c920 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5b80154e80 tx=0x7f5b74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.002 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.003+0000 7f5b6effd640 1 -- 172.21.15.113:0/2058192215 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b700535a0 con 0x7f5b80159f80 2023-12-19T14:00:43.195 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.196+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b800b24d0 con 0x7f5b6006a460 2023-12-19T14:00:43.196 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.197+0000 7f5b6effd640 1 -- 172.21.15.113:0/2058192215 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5b74004020 con 0x7f5b6006a460 2023-12-19T14:00:43.196 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T14:00:43.198 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5b6006a460 msgr2=0x7f5b6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5b6006a460 0x7f5b6006c920 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5b80154e80 tx=0x7f5b74008040 comp rx=0 tx=0).stop 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b80159f80 msgr2=0x7f5b801f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b80159f80 0x7f5b801f2e20 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c530 tx=0x7f5b7000c9f0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 shutdown_connections 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f5b6006a460 0x7f5b6006c920 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b8015b1e0 0x7f5b8014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5b8015aa70 0x7f5b801517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 --2- 172.21.15.113:0/2058192215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5b80159f80 0x7f5b801f2e20 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.199+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 >> 172.21.15.113:0/2058192215 conn(0x7f5b800b0100 msgr2=0x7f5b800b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.200+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 shutdown_connections 2023-12-19T14:00:43.199 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.200+0000 7f5b7f59e640 1 -- 172.21.15.113:0/2058192215 wait complete. 2023-12-19T14:00:43.216 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T14:00:43.216 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T14:00:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.435+0000 7f115d501640 1 Processor -- start 2023-12-19T14:00:43.434 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.435+0000 7f115d501640 1 -- start start 2023-12-19T14:00:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.436+0000 7f115d501640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f115815afd0 0x7f11580ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f115d501640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115806d070 0x7f11580afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f115d501640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115815f920 con 0x7f11580b02f0 2023-12-19T14:00:43.436 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f115d501640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580adc40 con 0x7f115815afd0 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f115d501640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580b0780 con 0x7f115806d070 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f115cd00640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f11580b02f0 0x7f11580ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53746/0 (socket says 172.21.15.113:53746) 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f115cd00640 1 -- 172.21.15.113:0/1046281679 learned_addr learned my addr 172.21.15.113:0/1046281679 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f1157fff640 1 --2- 172.21.15.113:0/1046281679 >> v2:172.21.15.113:3300/0 conn(0x7f115815afd0 0x7f11580ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f114ffff640 1 --2- 172.21.15.113:0/1046281679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115806d070 0x7f11580afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f1157fff640 1 -- 172.21.15.113:0/1046281679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115806d070 msgr2=0x7f11580afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f1157fff640 1 --2- 172.21.15.113:0/1046281679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115806d070 0x7f11580afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f1157fff640 1 -- 172.21.15.113:0/1046281679 >> v1:172.21.15.113:6789/0 conn(0x7f11580b02f0 legacy=0x7f11580ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.437+0000 7f11577fe640 1 -- 172.21.15.113:0/1046281679 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862600213 0 0) 0x7f115815f920 con 0x7f11580b02f0 2023-12-19T14:00:43.437 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.438+0000 7f1157fff640 1 -- 172.21.15.113:0/1046281679 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115815ed10 con 0x7f115815afd0 2023-12-19T14:00:43.438 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.439+0000 7f1157fff640 1 --2- 172.21.15.113:0/1046281679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f115815afd0 0x7f11580ad700 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f11480097a0 tx=0x7f114802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f8faa00c3c844 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.439+0000 7f11577fe640 1 -- 172.21.15.113:0/1046281679 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148031830 con 0x7f115815afd0 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.439+0000 7f11577fe640 1 -- 172.21.15.113:0/1046281679 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1148031990 con 0x7f115815afd0 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.439+0000 7f11577fe640 1 -- 172.21.15.113:0/1046281679 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148031d20 con 0x7f115815afd0 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.439+0000 7f115d501640 1 -- 172.21.15.113:0/1046281679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f115815afd0 msgr2=0x7f11580ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.439+0000 7f115d501640 1 --2- 172.21.15.113:0/1046281679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f115815afd0 0x7f11580ad700 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f11480097a0 tx=0x7f114802b8d0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.440+0000 7f115d501640 1 -- 172.21.15.113:0/1046281679 shutdown_connections 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.440+0000 7f115d501640 1 --2- 172.21.15.113:0/1046281679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115806d070 0x7f11580afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.440+0000 7f115d501640 1 --2- 172.21.15.113:0/1046281679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f115815afd0 0x7f11580ad700 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.440+0000 7f115d501640 1 -- 172.21.15.113:0/1046281679 >> 172.21.15.113:0/1046281679 conn(0x7f11580b4750 msgr2=0x7f11580659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.440+0000 7f115d501640 1 -- 172.21.15.113:0/1046281679 shutdown_connections 2023-12-19T14:00:43.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.440+0000 7f115d501640 1 -- 172.21.15.113:0/1046281679 wait complete. 2023-12-19T14:00:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.442+0000 7f115d501640 1 Processor -- start 2023-12-19T14:00:43.441 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.442+0000 7f115d501640 1 -- start start 2023-12-19T14:00:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f115d501640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f115806d070 0x7f11581f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f115d501640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11580b02f0 0x7f1158140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f115d501640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115815afd0 0x7f115815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f115d501640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115815c4a0 con 0x7f11580b02f0 2023-12-19T14:00:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f115d501640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158140840 con 0x7f115806d070 2023-12-19T14:00:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f115d501640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1158156d00 con 0x7f115815afd0 2023-12-19T14:00:43.443 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f114ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11580b02f0 0x7f1158140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f114ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11580b02f0 0x7f1158140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57552/0 (socket says 172.21.15.113:57552) 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.443+0000 7f114ffff640 1 -- 172.21.15.113:0/3412525081 learned_addr learned my addr 172.21.15.113:0/3412525081 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f115cd00640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115815afd0 0x7f115815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f1157fff640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f115806d070 0x7f11581f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f114ffff640 1 -- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115815afd0 msgr2=0x7f115815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f114ffff640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115815afd0 0x7f115815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f114ffff640 1 -- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f115806d070 msgr2=0x7f11581f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f114ffff640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f115806d070 0x7f11581f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f114ffff640 1 -- 172.21.15.113:0/3412525081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148009400 con 0x7f11580b02f0 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f115cd00640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f115815afd0 0x7f115815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f1157fff640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f115806d070 0x7f11581f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f114ffff640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11580b02f0 0x7f1158140300 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f114000d620 tx=0x7f114000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000b620 con 0x7f11580b02f0 2023-12-19T14:00:43.444 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114000b780 con 0x7f11580b02f0 2023-12-19T14:00:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115815bc00 con 0x7f11580b02f0 2023-12-19T14:00:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000bb30 con 0x7f11580b02f0 2023-12-19T14:00:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.444+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115815c1c0 con 0x7f11580b02f0 2023-12-19T14:00:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.445+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f115815f2d0 con 0x7f11580b02f0 2023-12-19T14:00:43.445 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.447+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f114000bc90 con 0x7f11580b02f0 2023-12-19T14:00:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.448+0000 7f11557fa640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f113806a460 0x7f113806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.448+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1140088b20 con 0x7f11580b02f0 2023-12-19T14:00:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.448+0000 7f11557fa640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7f11380702c0 0x7f11380726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.448+0000 7f1157fff640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f113806a460 0x7f113806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.448+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 --> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1138072d90 con 0x7f11380702c0 2023-12-19T14:00:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.448+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f114008d2a0 con 0x7f11580b02f0 2023-12-19T14:00:43.447 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.449+0000 7f115cd00640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7f11380702c0 0x7f11380726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.449+0000 7f1157fff640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f113806a460 0x7f113806c920 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1148036000 tx=0x7f1148008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.450+0000 7f115cd00640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7f11380702c0 0x7f11380726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.450 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.452+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== osd.7 v2:172.21.15.151:6814/84064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f1138072d90 con 0x7f11380702c0 2023-12-19T14:00:43.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.464+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 --> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f115804e0d0 con 0x7f11380702c0 2023-12-19T14:00:43.465 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.465+0000 7f11557fa640 1 -- 172.21.15.113:0/3412525081 <== osd.7 v2:172.21.15.151:6814/84064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f115804e0d0 con 0x7f11380702c0 2023-12-19T14:00:43.465 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-19T14:00:43.465 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T14:00:43.466 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-19T14:00:43.466 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7f11380702c0 msgr2=0x7f11380726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.151:6814/84064,v1:172.21.15.151:6817/84064] conn(0x7f11380702c0 0x7f11380726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f113806a460 msgr2=0x7f113806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f113806a460 0x7f113806c920 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1148036000 tx=0x7f1148008030 comp rx=0 tx=0).stop 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11580b02f0 msgr2=0x7f1158140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 --2- 172.21.15.113:0/3412525081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11580b02f0 0x7f1158140300 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f114000d620 tx=0x7f114000dae0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115cd00640 1 -- 172.21.15.113:0/3412525081 reap_dead start 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 shutdown_connections 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 >> 172.21.15.113:0/3412525081 conn(0x7f11580b4750 msgr2=0x7f11580add90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 shutdown_connections 2023-12-19T14:00:43.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.466+0000 7f115d501640 1 -- 172.21.15.113:0/3412525081 wait complete. 2023-12-19T14:00:43.481 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T14:00:43.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.682+0000 7fc9e09d6640 1 Processor -- start 2023-12-19T14:00:43.681 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.682+0000 7fc9e09d6640 1 -- start start 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9e09d6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9dc15e3f0 0x7fc9dc0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9e09d6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc9dc0b2460 0x7fc9dc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9e09d6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc0ad240 con 0x7fc9dc0acdf0 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9e09d6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc0b2fa0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9e09d6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc06f600 con 0x7fc9dc0b2460 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9db7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9dc15e3f0 0x7fc9dc0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9db7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9dc15e3f0 0x7fc9dc0b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57568/0 (socket says 172.21.15.113:57568) 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9db7fe640 1 -- 172.21.15.113:0/2229632135 learned_addr learned my addr 172.21.15.113:0/2229632135 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9dbfff640 1 --1- 172.21.15.113:0/2229632135 >> v1:172.21.15.113:6789/0 conn(0x7fc9dc0acdf0 0x7fc9dc160e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53762/0 (socket says 172.21.15.113:53762) 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.684+0000 7fc9daffd640 1 --2- 172.21.15.113:0/2229632135 >> v2:172.21.15.151:3300/0 conn(0x7fc9dc0b2460 0x7fc9dc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.684 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.685+0000 7fc9da7fc640 1 -- 172.21.15.113:0/2229632135 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617524186 0 0) 0x7fc9d4001490 con 0x7fc9dc0acdf0 2023-12-19T14:00:43.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.685+0000 7fc9da7fc640 1 -- 172.21.15.113:0/2229632135 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c4003520 con 0x7fc9dc0acdf0 2023-12-19T14:00:43.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.685+0000 7fc9db7fe640 1 -- 172.21.15.113:0/2229632135 >> v2:172.21.15.151:3300/0 conn(0x7fc9dc0b2460 msgr2=0x7fc9dc0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:43.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.685+0000 7fc9db7fe640 1 --2- 172.21.15.113:0/2229632135 >> v2:172.21.15.151:3300/0 conn(0x7fc9dc0b2460 0x7fc9dc0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.685+0000 7fc9db7fe640 1 -- 172.21.15.113:0/2229632135 >> v1:172.21.15.113:6789/0 conn(0x7fc9dc0acdf0 legacy=0x7fc9dc160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.685 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.685+0000 7fc9db7fe640 1 -- 172.21.15.113:0/2229632135 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc15e7d0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.686+0000 7fc9db7fe640 1 --2- 172.21.15.113:0/2229632135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0b1f20 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0b1b80 tx=0x7fc9cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da01a6a75cc55307 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.686+0000 7fc9da7fc640 1 -- 172.21.15.113:0/2229632135 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc031870 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.686+0000 7fc9da7fc640 1 -- 172.21.15.113:0/2229632135 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0319d0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.686+0000 7fc9da7fc640 1 -- 172.21.15.113:0/2229632135 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc031d60 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 -- 172.21.15.113:0/2229632135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 msgr2=0x7fc9dc0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/2229632135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0b1f20 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0b1b80 tx=0x7fc9cc02b910 comp rx=0 tx=0).stop 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 -- 172.21.15.113:0/2229632135 shutdown_connections 2023-12-19T14:00:43.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/2229632135 >> v2:172.21.15.151:3300/0 conn(0x7fc9dc0b2460 0x7fc9dc0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/2229632135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0b1f20 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 -- 172.21.15.113:0/2229632135 >> 172.21.15.113:0/2229632135 conn(0x7fc9dc0b0100 msgr2=0x7fc9dc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:43.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 -- 172.21.15.113:0/2229632135 shutdown_connections 2023-12-19T14:00:43.687 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.687+0000 7fc9e09d6640 1 -- 172.21.15.113:0/2229632135 wait complete. 2023-12-19T14:00:43.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.689+0000 7fc9e09d6640 1 Processor -- start 2023-12-19T14:00:43.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.689+0000 7fc9e09d6640 1 -- start start 2023-12-19T14:00:43.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9e09d6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9dc0acdf0 0x7fc9dc14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9e09d6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9dc0b2460 0x7fc9dc0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9e09d6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9e09d6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0c5420 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9e09d6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc06b3b0 con 0x7fc9dc0acdf0 2023-12-19T14:00:43.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9e09d6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0c4b80 con 0x7fc9dc0b2460 2023-12-19T14:00:43.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57582/0 (socket says 172.21.15.113:57582) 2023-12-19T14:00:43.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.690+0000 7fc9dbfff640 1 -- 172.21.15.113:0/285964056 learned_addr learned my addr 172.21.15.113:0/285964056 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9dbfff640 1 -- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9dc0b2460 msgr2=0x7fc9dc0c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9daffd640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9dc0b2460 0x7fc9dc0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9db7fe640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9dc0acdf0 0x7fc9dc14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9dbfff640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9dc0b2460 0x7fc9dc0c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9dbfff640 1 -- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9dc0acdf0 msgr2=0x7fc9dc14f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9dbfff640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9dc0acdf0 0x7fc9dc14f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9dbfff640 1 -- 172.21.15.113:0/285964056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0094d0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9dbfff640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0c5c50 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c770 tx=0x7fc9d400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9c3fff640 1 -- 172.21.15.113:0/285964056 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400ce80 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9c3fff640 1 -- 172.21.15.113:0/285964056 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d400a5e0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9c3fff640 1 -- 172.21.15.113:0/285964056 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400a9d0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.691+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc0c4e60 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.692+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc14feb0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.693+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc06b5b0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.694+0000 7fc9c3fff640 1 -- 172.21.15.113:0/285964056 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc9d400ab30 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.695+0000 7fc9c3fff640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9c806a430 0x7fc9c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:43.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.695+0000 7fc9c3fff640 1 -- 172.21.15.113:0/285964056 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc9d4087c60 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.695+0000 7fc9db7fe640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9c806a430 0x7fc9c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:43.694 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.696+0000 7fc9db7fe640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9c806a430 0x7fc9c806c8f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc036000 tx=0x7fc9cc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:43.698 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.699+0000 7fc9c3fff640 1 -- 172.21.15.113:0/285964056 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc9dc06b5b0 con 0x7fc9dc15e3f0 2023-12-19T14:00:43.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.895+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9dc0b2cc0 con 0x7fc9c806a430 2023-12-19T14:00:43.894 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.895+0000 7fc9c3fff640 1 -- 172.21.15.113:0/285964056 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc9cc031bc0 con 0x7fc9c806a430 2023-12-19T14:00:43.895 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T14:00:43.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9c806a430 msgr2=0x7fc9c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9c806a430 0x7fc9c806c8f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc036000 tx=0x7fc9cc03c040 comp rx=0 tx=0).stop 2023-12-19T14:00:43.897 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 msgr2=0x7fc9dc0c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0c5c50 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c770 tx=0x7fc9d400cc30 comp rx=0 tx=0).stop 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 shutdown_connections 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7fc9c806a430 0x7fc9c806c8f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9dc15e3f0 0x7fc9dc0c5c50 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9dc0b2460 0x7fc9dc0c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 --2- 172.21.15.113:0/285964056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9dc0acdf0 0x7fc9dc14f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 >> 172.21.15.113:0/285964056 conn(0x7fc9dc0b0100 msgr2=0x7fc9dc15afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 shutdown_connections 2023-12-19T14:00:43.898 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:43.898+0000 7fc9e09d6640 1 -- 172.21.15.113:0/285964056 wait complete. 2023-12-19T14:00:43.916 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T14:00:44.124 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.125+0000 7f953efc1640 1 Processor -- start 2023-12-19T14:00:44.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.126+0000 7f953efc1640 1 -- start start 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.127+0000 7f953efc1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f953815e5a0 0x7f95380b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.127+0000 7f953efc1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f95380cdbf0 0x7f95380ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.127+0000 7f953efc1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953815ec30 con 0x7f953815f680 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.127+0000 7f953efc1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380ce560 con 0x7f953815e5a0 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.127+0000 7f953efc1640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953815e980 con 0x7f95380cdbf0 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.127+0000 7f953dfbf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f953815e5a0 0x7f95380b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.128+0000 7f953dfbf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f953815e5a0 0x7f95380b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57598/0 (socket says 172.21.15.113:57598) 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.128+0000 7f953dfbf640 1 -- 172.21.15.113:0/3152701734 learned_addr learned my addr 172.21.15.113:0/3152701734 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.128+0000 7f953dfbf640 1 -- 172.21.15.113:0/3152701734 >> v2:172.21.15.151:3300/0 conn(0x7f95380cdbf0 msgr2=0x7f95380ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.128+0000 7f953dfbf640 1 --2- 172.21.15.113:0/3152701734 >> v2:172.21.15.151:3300/0 conn(0x7f95380cdbf0 0x7f95380ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.128+0000 7f953dfbf640 1 -- 172.21.15.113:0/3152701734 >> v1:172.21.15.113:6789/0 conn(0x7f953815f680 legacy=0x7f95380b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:44.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.128+0000 7f953dfbf640 1 -- 172.21.15.113:0/3152701734 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380b2f90 con 0x7f953815e5a0 2023-12-19T14:00:44.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.129+0000 7f953dfbf640 1 --2- 172.21.15.113:0/3152701734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f953815e5a0 0x7f95380b2030 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f9534009870 tx=0x7f953402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b76fe7d14a08913 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:44.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.129+0000 7f953cfbd640 1 -- 172.21.15.113:0/3152701734 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534030850 con 0x7f953815e5a0 2023-12-19T14:00:44.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.129+0000 7f953cfbd640 1 -- 172.21.15.113:0/3152701734 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95340309b0 con 0x7f953815e5a0 2023-12-19T14:00:44.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.129+0000 7f953cfbd640 1 -- 172.21.15.113:0/3152701734 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534030d40 con 0x7f953815e5a0 2023-12-19T14:00:44.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 -- 172.21.15.113:0/3152701734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f953815e5a0 msgr2=0x7f95380b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:44.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 --2- 172.21.15.113:0/3152701734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f953815e5a0 0x7f95380b2030 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f9534009870 tx=0x7f953402b990 comp rx=0 tx=0).stop 2023-12-19T14:00:44.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 -- 172.21.15.113:0/3152701734 shutdown_connections 2023-12-19T14:00:44.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 --2- 172.21.15.113:0/3152701734 >> v2:172.21.15.151:3300/0 conn(0x7f95380cdbf0 0x7f95380ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 --2- 172.21.15.113:0/3152701734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f953815e5a0 0x7f95380b2030 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 -- 172.21.15.113:0/3152701734 >> 172.21.15.113:0/3152701734 conn(0x7f95380b0100 msgr2=0x7f95380b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:44.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 -- 172.21.15.113:0/3152701734 shutdown_connections 2023-12-19T14:00:44.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.130+0000 7f953efc1640 1 -- 172.21.15.113:0/3152701734 wait complete. 2023-12-19T14:00:44.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.132+0000 7f953efc1640 1 Processor -- start 2023-12-19T14:00:44.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.132+0000 7f953efc1640 1 -- start start 2023-12-19T14:00:44.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953efc1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95380cdbf0 0x7f9538157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:44.133 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953efc1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f953815e5a0 0x7f95380cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953efc1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f953815f680 0x7f953806c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953efc1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95381f3880 con 0x7f95380cdbf0 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953efc1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95380af370 con 0x7f953815e5a0 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953efc1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95381581f0 con 0x7f953815f680 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95380cdbf0 0x7f9538157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95380cdbf0 0x7f9538157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57600/0 (socket says 172.21.15.113:57600) 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 -- 172.21.15.113:0/889540960 learned_addr learned my addr 172.21.15.113:0/889540960 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 -- 172.21.15.113:0/889540960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f953815f680 msgr2=0x7f953806c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f953815f680 0x7f953806c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 -- 172.21.15.113:0/889540960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f953815e5a0 msgr2=0x7f95380cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f953815e5a0 0x7f95380cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.134+0000 7f953dfbf640 1 -- 172.21.15.113:0/889540960 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340094d0 con 0x7f95380cdbf0 2023-12-19T14:00:44.134 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.135+0000 7f953dfbf640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95380cdbf0 0x7f9538157cb0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f9534000c00 tx=0x7f9534004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:44.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.135+0000 7f952e7fc640 1 -- 172.21.15.113:0/889540960 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534030800 con 0x7f95380cdbf0 2023-12-19T14:00:44.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.135+0000 7f952e7fc640 1 -- 172.21.15.113:0/889540960 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534043400 con 0x7f95380cdbf0 2023-12-19T14:00:44.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.135+0000 7f952e7fc640 1 -- 172.21.15.113:0/889540960 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95340437b0 con 0x7f95380cdbf0 2023-12-19T14:00:44.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.135+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95381f35a0 con 0x7f95380cdbf0 2023-12-19T14:00:44.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.135+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380a8920 con 0x7f95380cdbf0 2023-12-19T14:00:44.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.136+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95380a84a0 con 0x7f95380cdbf0 2023-12-19T14:00:44.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.137+0000 7f952e7fc640 1 -- 172.21.15.113:0/889540960 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f953402e070 con 0x7f95380cdbf0 2023-12-19T14:00:44.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.138+0000 7f952e7fc640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f951c06a430 0x7f951c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:00:44.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.138+0000 7f952e7fc640 1 -- 172.21.15.113:0/889540960 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f953403e070 con 0x7f95380cdbf0 2023-12-19T14:00:44.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.139+0000 7f953d7be640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f951c06a430 0x7f951c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:00:44.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.139+0000 7f953d7be640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f951c06a430 0x7f951c06c8f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9528000f60 tx=0x7f95280079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:00:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.143+0000 7f952e7fc640 1 -- 172.21.15.113:0/889540960 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f95380a84a0 con 0x7f95380cdbf0 2023-12-19T14:00:44.328 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.329+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f953815ee80 con 0x7f951c06a430 2023-12-19T14:00:44.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.333+0000 7f952e7fc640 1 -- 172.21.15.113:0/889540960 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47271 (secure 0 0 0) 0x7f9528005080 con 0x7f951c06a430 2023-12-19T14:00:44.332 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:00:44.333 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.335+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f951c06a430 msgr2=0x7f951c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.335+0000 7f953efc1640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f951c06a430 0x7f951c06c8f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9528000f60 tx=0x7f95280079b0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.335+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95380cdbf0 msgr2=0x7f9538157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.335+0000 7f953efc1640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95380cdbf0 0x7f9538157cb0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f9534000c00 tx=0x7f9534004730 comp rx=0 tx=0).stop 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 shutdown_connections 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f951c06a430 0x7f951c06c8f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f953815f680 0x7f953806c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f953815e5a0 0x7f95380cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 --2- 172.21.15.113:0/889540960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f95380cdbf0 0x7f9538157cb0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:00:44.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 >> 172.21.15.113:0/889540960 conn(0x7f95380b0100 msgr2=0x7f9538158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:00:44.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 shutdown_connections 2023-12-19T14:00:44.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:00:44.336+0000 7f953efc1640 1 -- 172.21.15.113:0/889540960 wait complete. 2023-12-19T14:00:44.352 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":627,"stamp":"2023-12-19T14:00:42.703680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10186,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552313,"statfs":{"total":1600000000,"available":1589569304,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002530"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":341,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-12-19T14:00:33.207938+0000","last_change":"2023-12-19T13:46:22.257645+0000","last_active":"2023-12-19T14:00:33.207938+0000","last_peered":"2023-12-19T14:00:33.207938+0000","last_clean":"2023-12-19T14:00:33.207938+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T14:00:33.207938+0000","last_undegraded":"2023-12-19T14:00:33.207938+0000","last_fullsized":"2023-12-19T14:00:33.207938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:46:21.231519+0000","last_clean_scrub_stamp":"2023-12-19T13:46:21.231519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":1.0840000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.9059999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.1379999999999999,"15min":1.0880000000000001},"min":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.54400000000000004},"max":{"1min":1.601,"5min":1.855,"15min":2.008},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1679999999999999,"15min":1.141},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.494,"5min":1.865,"15min":1.865},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.175,"15min":1.1359999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.54,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.01}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.159,"15min":1.1459999999999999},"min":{"1min":0.88900000000000001,"5min":0.77600000000000002,"15min":0.57499999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.008},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2829999999999999,"15min":1.222},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7090000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.5109999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2649999999999999,"15min":1.2330000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.6659999999999999,"15min":2.2589999999999999},"last":1.075},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3240000000000001,"15min":1.3029999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":1.115}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2949999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.60299999999999998},"max":{"1min":1.702,"5min":1.702,"15min":2.4089999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.359,"15min":1.367},"min":{"1min":0.83699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.901,"5min":1.901,"15min":2.6909999999999998},"last":1.333}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.218,"15min":1.2490000000000001},"min":{"1min":0.72799999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":2.3109999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.4279999999999999,"15min":1.429},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6359999999999999,"5min":1.7949999999999999,"15min":2.7719999999999998},"last":1.3700000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.387,"15min":1.369},"min":{"1min":0.65900000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5209999999999999,"15min":1.516},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.64800000000000002},"max":{"1min":1.833,"5min":1.9390000000000001,"15min":2.673},"last":1.4710000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1499999999999999,"15min":1.0820000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.42699999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":2.0640000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.0940000000000001,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":3.2069999999999999},"last":1.054}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0960000000000001,"15min":1.0649999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.851,"15min":1.962},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.135,"5min":1.206,"15min":1.1419999999999999},"min":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.63800000000000001},"max":{"1min":1.3340000000000001,"5min":1.671,"15min":1.671},"last":1.125}]},{"osd":2,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3300000000000001,"15min":1.28},"min":{"1min":1.1599999999999999,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.5960000000000001,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.29,"15min":1.242},"min":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.68100000000000005},"max":{"1min":1.7769999999999999,"5min":1.821,"15min":1.821},"last":1.323}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":1.0660000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6919999999999999,"5min":1.782,"15min":4.2690000000000001},"last":1.25},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2370000000000001},"min":{"1min":0.876,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.4850000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":0.73399999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3340000000000001,"15min":1.294},"min":{"1min":0.995,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.7130000000000001,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.036},{"interface":"front","average":{"1min":1.361,"5min":1.323,"15min":1.333},"min":{"1min":0.86599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.623,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.284,"15min":1.2909999999999999},"min":{"1min":0.92700000000000005,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.585,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4650000000000001,"15min":1.4330000000000001},"min":{"1min":1.002,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.857,"5min":2.117,"15min":2.169},"last":1.296}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.464,"15min":1.456},"min":{"1min":1.3839999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8540000000000001,"5min":1.8919999999999999,"15min":2.5419999999999998},"last":1.448},{"interface":"front","average":{"1min":1.508,"5min":1.4490000000000001,"15min":1.425},"min":{"1min":1.0469999999999999,"5min":0.89300000000000002,"15min":0.57999999999999996},"max":{"1min":1.7250000000000001,"5min":2.0219999999999998,"15min":2.141},"last":1.4770000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193606,"statfs":{"total":200000000,"available":198253387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0880000000000001,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.56399999999999995,"15min":0.433},"max":{"1min":1.631,"5min":1.631,"15min":1.835},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.645,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":0.75600000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.5549999999999999,"15min":6.101},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.155,"15min":1.1220000000000001},"min":{"1min":0.70599999999999996,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.617,"5min":1.6439999999999999,"15min":2.077},"last":0.95199999999999996}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6439999999999999,"5min":1.72,"15min":5.5350000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.208,"15min":1.2270000000000001},"min":{"1min":0.85399999999999998,"5min":0.80500000000000005,"15min":0.66400000000000003},"max":{"1min":1.575,"5min":1.6020000000000001,"15min":2.863},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.6599999999999999,"15min":5.6189999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.333,"15min":1.292},"min":{"1min":1.002,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.6200000000000001,"5min":1.752,"15min":1.8360000000000001},"last":0.91300000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.264,"15min":1.2150000000000001},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.5429999999999999,"5min":1.8109999999999999,"15min":1.982},"last":1.159},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.734,"5min":1.798,"15min":5.6970000000000001},"last":1.1220000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":1.919,"15min":2.0310000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3939999999999999,"15min":1.379},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6970000000000001,"5min":1.853,"15min":2.133},"last":1.2649999999999999}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.462,"15min":1.4690000000000001},"min":{"1min":1.1919999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.8260000000000001,"5min":1.893,"15min":6.3959999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.498,"15min":1.4830000000000001},"min":{"1min":1.1930000000000001,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.327}]}]},{"osd":4,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.091,"15min":1.0509999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4350000000000001,"5min":1.679,"15min":2.1349999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.143,"15min":1.1180000000000001},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.48799999999999999},"max":{"1min":1.4750000000000001,"5min":2.448,"15min":2.448},"last":1.2130000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1519999999999999,"15min":1.0980000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.55,"5min":1.754,"15min":1.754},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.50700000000000001},"max":{"1min":1.5509999999999999,"5min":3.117,"15min":3.117},"last":0.97899999999999998}]},{"osd":2,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.21,"15min":1.1339999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5309999999999999,"5min":2.613,"15min":2.613},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.7070000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.2669999999999999}]},{"osd":3,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2929999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.409,"5min":2.653,"15min":2.653},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":2.1320000000000001,"15min":2.2080000000000002},"last":1.3560000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.278,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.51700000000000002},"max":{"1min":1.647,"5min":3.625,"15min":3.625},"last":1.153},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5940000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3129999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.415,"15min":1.375},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.921,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4419999999999999,"15min":1.4179999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.52200000000000002},"max":{"1min":1.7829999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.51}]},{"osd":7,"last update":"Tue Dec 19 13:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5589999999999999,"15min":1.498},"min":{"1min":0.77000000000000002,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.746,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.383},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.593,"15min":1.5449999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.829,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.492}]}]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":0.83899999999999997},"min":{"1min":0.67500000000000004,"5min":0.36499999999999999,"15min":0.249},"max":{"1min":1.2050000000000001,"5min":2.2109999999999999,"15min":3.4119999999999999},"last":0.88},{"interface":"front","average":{"1min":1.032,"5min":0.95799999999999996,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.5609999999999999,"5min":2.0339999999999998,"15min":3.0670000000000002},"last":1.1950000000000001}]},{"osd":1,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.877,"15min":0.88},"min":{"1min":0.63500000000000001,"5min":0.46600000000000003,"15min":0.32800000000000001},"max":{"1min":1.137,"5min":1.413,"15min":5.3769999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.026,"15min":0.96199999999999997},"min":{"1min":0.83599999999999997,"5min":0.40899999999999997,"15min":0.29499999999999998},"max":{"1min":1.3799999999999999,"5min":1.573,"15min":2.387},"last":1.0489999999999999}]},{"osd":2,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.077,"15min":1.0129999999999999},"min":{"1min":0.88600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.5820000000000001,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":1.008},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1000000000000001,"15min":1.0580000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.6319999999999999,"15min":2.657},"last":0.93200000000000005}]},{"osd":4,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2909999999999999,"15min":1.2390000000000001},"min":{"1min":1.0329999999999999,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.583,"5min":1.8049999999999999,"15min":3.0070000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.2909999999999999,"15min":1.2370000000000001},"min":{"1min":0.90700000000000003,"5min":0.76300000000000001,"15min":0.54600000000000004},"max":{"1min":1.5269999999999999,"5min":1.732,"15min":2.7690000000000001},"last":1.26}]},{"osd":5,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.306,"15min":1.2709999999999999},"min":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.58299999999999996},"max":{"1min":1.579,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.482},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.304,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.78700000000000003,"15min":0.66700000000000004},"max":{"1min":1.655,"5min":1.9239999999999999,"15min":3.5249999999999999},"last":1.1399999999999999}]},{"osd":6,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":1.0820000000000001,"5min":0.76900000000000002,"15min":0.53300000000000003},"max":{"1min":1.458,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.121},{"interface":"front","average":{"1min":1.391,"5min":1.3919999999999999,"15min":1.3340000000000001},"min":{"1min":0.95799999999999996,"5min":0.81499999999999995,"15min":0.52600000000000002},"max":{"1min":1.6819999999999999,"5min":2.077,"15min":2.698},"last":1.381}]},{"osd":7,"last update":"Tue Dec 19 13:59:40 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4159999999999999,"15min":1.3420000000000001},"min":{"1min":1.258,"5min":0.73499999999999999,"15min":0.51500000000000001},"max":{"1min":1.8,"5min":2.1160000000000001,"15min":3.609},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4399999999999999,"15min":1.3899999999999999},"min":{"1min":1.155,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.306}]}]},{"osd":2,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.83399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":2.258},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.35899999999999999},"max":{"1min":1.1779999999999999,"5min":1.5600000000000001,"15min":11.85},"last":0.74299999999999999}]},{"osd":1,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.91900000000000004,"15min":0.877},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.401,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.056,"15min":1.016},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3,"5min":4.681,"15min":11.788},"last":0.69899999999999995}]},{"osd":3,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0369999999999999,"15min":0.97899999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.425,"5min":1.702,"15min":2.3109999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.042,"5min":1.137,"15min":1.079},"min":{"1min":0.56200000000000006,"5min":0.439,"15min":0.439},"max":{"1min":1.569,"5min":5.1890000000000001,"15min":5.1890000000000001},"last":0.92100000000000004}]},{"osd":4,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.70899999999999996},"max":{"1min":1.534,"5min":1.6910000000000001,"15min":11.930999999999999},"last":1.204},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2270000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.758,"5min":1.806,"15min":2.2189999999999999},"last":1.51}]},{"osd":5,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.347,"15min":1.3220000000000001},"min":{"1min":0.81499999999999995,"5min":0.73399999999999999,"15min":0.70999999999999996},"max":{"1min":1.542,"5min":1.7170000000000001,"15min":11.888},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.363,"15min":1.323},"min":{"1min":0.80700000000000005,"5min":0.76000000000000001,"15min":0.68899999999999995},"max":{"1min":1.6990000000000001,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":1.3340000000000001}]},{"osd":6,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.3149999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.72399999999999998},"max":{"1min":1.756,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":1.216},{"interface":"front","average":{"1min":1.306,"5min":1.351,"15min":1.304},"min":{"1min":0.88200000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.885,"5min":1.9370000000000001,"15min":2.286},"last":1.5940000000000001}]},{"osd":7,"last update":"Tue Dec 19 13:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.351},"min":{"1min":0.85599999999999998,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.9650000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.393,"15min":1.357},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67300000000000004},"max":{"1min":1.617,"5min":2.323,"15min":11.962999999999999},"last":1.238}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193606,"statfs":{"total":200000000,"available":198253387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.30599999999999999},"max":{"1min":1.2470000000000001,"5min":1.4930000000000001,"15min":3.4700000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.712,"5min":1.712,"15min":3.3500000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.101,"15min":1.117},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.887,"5min":1.887,"15min":5.2009999999999996},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.04,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.835,"5min":1.835,"15min":3.4300000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.0569999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.36899999999999999},"max":{"1min":1.3919999999999999,"5min":1.6519999999999999,"15min":7.157},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1739999999999999,"15min":1.1759999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.61699999999999999},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.292,"15min":1.274},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.583,"5min":1.661,"15min":3.7080000000000002},"last":0.99199999999999999}]},{"osd":5,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.226,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.70199999999999996},"max":{"1min":1.456,"5min":1.796,"15min":3.8849999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2609999999999999,"15min":1.319},"min":{"1min":0.75,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.748,"5min":1.77,"15min":15.576000000000001},"last":1.119}]},{"osd":6,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.333},"min":{"1min":0.85299999999999998,"5min":0.83199999999999996,"15min":0.67800000000000005},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.345,"15min":1.3540000000000001},"min":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.895,"5min":1.895,"15min":3.786},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Dec 19 13:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.401,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.355,"15min":1.363},"min":{"1min":0.92400000000000004,"5min":0.89900000000000002,"15min":0.76500000000000001},"max":{"1min":1.913,"5min":2.032,"15min":4.0519999999999996},"last":1.216}]}]},{"osd":0,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.79800000000000004},"min":{"1min":0.58399999999999996,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.337,"5min":1.502,"15min":1.6399999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.4590000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":1.0469999999999999},"min":{"1min":0.58399999999999996,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.296,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":1.1499999999999999},"min":{"1min":0.54600000000000004,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.45,"5min":1.5509999999999999,"15min":41.758000000000003},"last":1.105}]},{"osd":3,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96699999999999997,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.45500000000000002,"15min":0.35099999999999998},"max":{"1min":1.4470000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":0.63},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.129,"15min":1.093},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.36499999999999999},"max":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":2.02},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6060000000000001,"5min":1.738,"15min":4.4269999999999996},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.286,"15min":1.2889999999999999},"min":{"1min":0.876,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":15.766},"last":0.88900000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.27,"15min":1.2789999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.0059999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.264,"15min":1.258},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.63100000000000001},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":4.3970000000000002},"last":1.145}]},{"osd":6,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3939999999999999,"15min":1.351},"min":{"1min":0.91400000000000003,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":5.4669999999999996},"last":1.012},{"interface":"front","average":{"1min":1.363,"5min":1.361,"15min":1.387},"min":{"1min":0.88400000000000001,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":17.161000000000001},"last":1.194}]},{"osd":7,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3839999999999999,"15min":1.3919999999999999},"min":{"1min":0.84499999999999997,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":2.387,"5min":2.387,"15min":14.381},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.325,"15min":1.3560000000000001},"min":{"1min":0.89100000000000001,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":2.121,"5min":2.121,"15min":9.7080000000000002},"last":1.1870000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T14:00:44.357 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T13:46:21.231519+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=13, tm_min=46, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=14, tm_min=0, tm_sec=37, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T14:00:44.357 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T14:00:51.646 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:51.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:04.358 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T14:01:04.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.580+0000 7f17cac10640 1 Processor -- start 2023-12-19T14:01:04.579 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.580+0000 7f17cac10640 1 -- start start 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.581+0000 7f17cac10640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17c40ae110 0x7f17c40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17cac10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c40b0640 0x7f17c406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17cac10640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40ae640 con 0x7f17c4157bf0 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17cac10640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c406b8c0 con 0x7f17c40ae110 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17cac10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40b0ab0 con 0x7f17c40b0640 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17c40ae110 0x7f17c40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c89ac640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f17c4157bf0 0x7f17c415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51634/0 (socket says 172.21.15.113:51634) 2023-12-19T14:01:04.581 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c89ac640 1 -- 172.21.15.113:0/1177886673 learned_addr learned my addr 172.21.15.113:0/1177886673 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:01:04.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c91ad640 1 --2- 172.21.15.113:0/1177886673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c40b0640 0x7f17c406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:04.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c3fff640 1 -- 172.21.15.113:0/1177886673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c40b0640 msgr2=0x7f17c406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:01:04.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c3fff640 1 --2- 172.21.15.113:0/1177886673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c40b0640 0x7f17c406d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c3fff640 1 -- 172.21.15.113:0/1177886673 >> v1:172.21.15.113:6789/0 conn(0x7f17c4157bf0 legacy=0x7f17c415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:04.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c37fe640 1 -- 172.21.15.113:0/1177886673 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369541425 0 0) 0x7f17c40ae640 con 0x7f17c4157bf0 2023-12-19T14:01:04.582 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.582+0000 7f17c3fff640 1 -- 172.21.15.113:0/1177886673 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40ae920 con 0x7f17c40ae110 2023-12-19T14:01:04.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.584+0000 7f17c3fff640 1 --2- 172.21.15.113:0/1177886673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40b0100 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097d0 tx=0x7f17b002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b07fccc06adf20 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:04.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.584+0000 7f17c37fe640 1 -- 172.21.15.113:0/1177886673 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0031800 con 0x7f17c40ae110 2023-12-19T14:01:04.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.584+0000 7f17c37fe640 1 -- 172.21.15.113:0/1177886673 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0031960 con 0x7f17c40ae110 2023-12-19T14:01:04.583 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.584+0000 7f17c37fe640 1 -- 172.21.15.113:0/1177886673 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0031cf0 con 0x7f17c40ae110 2023-12-19T14:01:04.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 -- 172.21.15.113:0/1177886673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 msgr2=0x7f17c40b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:04.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 --2- 172.21.15.113:0/1177886673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40b0100 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097d0 tx=0x7f17b002b8a0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 -- 172.21.15.113:0/1177886673 shutdown_connections 2023-12-19T14:01:04.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 --2- 172.21.15.113:0/1177886673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c40b0640 0x7f17c406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 --2- 172.21.15.113:0/1177886673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40b0100 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 -- 172.21.15.113:0/1177886673 >> 172.21.15.113:0/1177886673 conn(0x7f17c40cbb70 msgr2=0x7f17c40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:01:04.584 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 -- 172.21.15.113:0/1177886673 shutdown_connections 2023-12-19T14:01:04.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.585+0000 7f17cac10640 1 -- 172.21.15.113:0/1177886673 wait complete. 2023-12-19T14:01:04.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.587+0000 7f17cac10640 1 Processor -- start 2023-12-19T14:01:04.585 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.587+0000 7f17cac10640 1 -- start start 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17cac10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17cac10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17c40b0640 0x7f17c40ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17cac10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c4157bf0 0x7f17c4144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17cac10640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40a9620 con 0x7f17c40ae110 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17cac10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40a8a10 con 0x7f17c40b0640 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17cac10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40a8cf0 con 0x7f17c4157bf0 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17c89ac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17c89ac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33424/0 (socket says 172.21.15.113:33424) 2023-12-19T14:01:04.588 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17c89ac640 1 -- 172.21.15.113:0/3800560032 learned_addr learned my addr 172.21.15.113:0/3800560032 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17c89ac640 1 -- 172.21.15.113:0/3800560032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c4157bf0 msgr2=0x7f17c4144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17c89ac640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c4157bf0 0x7f17c4144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17c89ac640 1 -- 172.21.15.113:0/3800560032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17c40b0640 msgr2=0x7f17c40ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.588+0000 7f17c89ac640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17c40b0640 0x7f17c40ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.589+0000 7f17c89ac640 1 -- 172.21.15.113:0/3800560032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b0009400 con 0x7f17c40ae110 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.589+0000 7f17c89ac640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40acde0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f17b800c400 tx=0x7f17b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.589+0000 7f17c17fa640 1 -- 172.21.15.113:0/3800560032 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8005ce0 con 0x7f17c40ae110 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.589+0000 7f17c17fa640 1 -- 172.21.15.113:0/3800560032 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8005e40 con 0x7f17c40ae110 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.589+0000 7f17c17fa640 1 -- 172.21.15.113:0/3800560032 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8007310 con 0x7f17c40ae110 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.589+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c40a8fd0 con 0x7f17c40ae110 2023-12-19T14:01:04.589 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.589+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c41487d0 con 0x7f17c40ae110 2023-12-19T14:01:04.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.590+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4061910 con 0x7f17c40ae110 2023-12-19T14:01:04.590 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.591+0000 7f17c17fa640 1 -- 172.21.15.113:0/3800560032 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17b8007530 con 0x7f17c40ae110 2023-12-19T14:01:04.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.592+0000 7f17c17fa640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f17a806a430 0x7f17a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:04.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.592+0000 7f17c17fa640 1 -- 172.21.15.113:0/3800560032 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f17b8087d90 con 0x7f17c40ae110 2023-12-19T14:01:04.591 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.593+0000 7f17c3fff640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f17a806a430 0x7f17a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:04.592 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.593+0000 7f17c3fff640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f17a806a430 0x7f17a806c8f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f17b0036000 tx=0x7f17b0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:04.596 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.597+0000 7f17c17fa640 1 -- 172.21.15.113:0/3800560032 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f17b8053550 con 0x7f17c40ae110 2023-12-19T14:01:04.782 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.783+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 --> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17c40aeee0 con 0x7f17a806a430 2023-12-19T14:01:04.784 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.785+0000 7f17c17fa640 1 -- 172.21.15.113:0/3800560032 <== mgr.4101 v2:172.21.15.113:6832/83819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47038 (secure 0 0 0) 0x7f17b003b430 con 0x7f17a806a430 2023-12-19T14:01:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:01:04.785 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2023-12-19T14:01:04.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f17a806a430 msgr2=0x7f17a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:04.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f17a806a430 0x7f17a806c8f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f17b0036000 tx=0x7f17b0030000 comp rx=0 tx=0).stop 2023-12-19T14:01:04.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 msgr2=0x7f17c40acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:04.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40acde0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f17b800c400 tx=0x7f17b800c8c0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 shutdown_connections 2023-12-19T14:01:04.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f17a806a430 0x7f17a806c8f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.787 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17c4157bf0 0x7f17c4144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17c40b0640 0x7f17c40ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 --2- 172.21.15.113:0/3800560032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17c40ae110 0x7f17c40acde0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:04.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 >> 172.21.15.113:0/3800560032 conn(0x7f17c40cbb70 msgr2=0x7f17c4072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:01:04.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 shutdown_connections 2023-12-19T14:01:04.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:04.788+0000 7f17cac10640 1 -- 172.21.15.113:0/3800560032 wait complete. 2023-12-19T14:01:04.807 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":638,"stamp":"2023-12-19T14:01:04.709727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10186,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552313,"statfs":{"total":1600000000,"available":1589569304,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003341"},"pg_stats":[{"pgid":"1.0","version":"204'119","reported_seq":354,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-12-19T14:00:42.263357+0000","last_change":"2023-12-19T14:00:42.263449+0000","last_active":"2023-12-19T14:00:42.263357+0000","last_peered":"2023-12-19T14:00:42.263357+0000","last_clean":"2023-12-19T14:00:42.263357+0000","last_became_active":"2023-12-19T13:46:22.257183+0000","last_became_peered":"2023-12-19T13:46:22.257183+0000","last_unstale":"2023-12-19T14:00:42.263357+0000","last_undegraded":"2023-12-19T14:00:42.263357+0000","last_fullsized":"2023-12-19T14:00:42.263357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'119","last_scrub_stamp":"2023-12-19T14:00:42.263315+0000","last_deep_scrub":"204'119","last_deep_scrub_stamp":"2023-12-19T14:00:42.263315+0000","last_clean_scrub_stamp":"2023-12-19T14:00:42.263315+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:51:48.680170+0000","scrub_duration":0.0060097620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.093},"min":{"1min":0.61899999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4610000000000001,"5min":1.734,"15min":1.9059999999999999},"last":1.002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1379999999999999,"15min":1.095},"min":{"1min":0.78100000000000003,"5min":0.68899999999999995,"15min":0.54400000000000004},"max":{"1min":1.617,"5min":1.855,"15min":2.008},"last":1.2330000000000001}]},{"osd":1,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.169,"15min":1.143},"min":{"1min":0.70899999999999996,"5min":0.60199999999999998,"15min":0.59899999999999998},"max":{"1min":1.4390000000000001,"5min":1.865,"15min":1.865},"last":1.492},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.1459999999999999},"min":{"1min":0.67900000000000005,"5min":0.61399999999999999,"15min":0.497},"max":{"1min":1.577,"5min":1.7949999999999999,"15min":2.1499999999999999},"last":1.0469999999999999}]},{"osd":2,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1519999999999999,"15min":1.1459999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.57499999999999996},"max":{"1min":1.6000000000000001,"5min":1.6899999999999999,"15min":2.008},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.2949999999999999,"15min":1.2330000000000001},"min":{"1min":0.94599999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.589,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1799999999999999}]},{"osd":3,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.266,"15min":1.2410000000000001},"min":{"1min":0.878,"5min":0.82399999999999995,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":2.2589999999999999},"last":1.268},{"interface":"front","average":{"1min":1.216,"5min":1.3180000000000001,"15min":1.3029999999999999},"min":{"1min":0.78100000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.534,"5min":1.8029999999999999,"15min":3.6150000000000002},"last":1.431}]},{"osd":4,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2909999999999999,"15min":1.286},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":2.4089999999999998},"last":1.393},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3660000000000001,"15min":1.3600000000000001},"min":{"1min":0.73799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6850000000000001,"5min":1.901,"15min":2.6909999999999998},"last":1.3029999999999999}]},{"osd":5,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.224,"15min":1.2490000000000001},"min":{"1min":0.84399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.7090000000000001,"5min":1.744,"15min":2.3109999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.4259999999999999,"15min":1.4279999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.887,"5min":1.887,"15min":2.7719999999999998},"last":1.4610000000000001}]},{"osd":6,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.369,"15min":1.3740000000000001},"min":{"1min":0.90000000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":2.0150000000000001,"15min":2.2080000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.512,"15min":1.518},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.64800000000000002},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.673},"last":1.5109999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 14:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1359999999999999,"15min":1.081},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.42699999999999999},"max":{"1min":1.3680000000000001,"5min":1.8400000000000001,"15min":2.0640000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1020000000000001,"15min":1.0900000000000001},"min":{"1min":0.80700000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5049999999999999,"5min":1.5820000000000001,"15min":3.2069999999999999},"last":1.077}]},{"osd":1,"last update":"Tue Dec 19 14:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1040000000000001,"15min":1.0680000000000001},"min":{"1min":0.77200000000000002,"5min":0.73199999999999998,"15min":0.59099999999999997},"max":{"1min":1.4990000000000001,"5min":1.851,"15min":1.962},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1970000000000001,"15min":1.1479999999999999},"min":{"1min":0.81299999999999994,"5min":0.77400000000000002,"15min":0.63800000000000001},"max":{"1min":1.502,"5min":1.671,"15min":1.671},"last":0.99299999999999999}]},{"osd":2,"last update":"Tue Dec 19 14:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3149999999999999,"15min":1.28},"min":{"1min":0.75800000000000001,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.476,"5min":1.7010000000000001,"15min":1.8180000000000001},"last":1.145},{"interface":"front","average":{"1min":1.169,"5min":1.264,"15min":1.244},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.68100000000000005},"max":{"1min":1.615,"5min":1.821,"15min":1.821},"last":1.4830000000000001}]},{"osd":3,"last update":"Tue Dec 19 14:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2829999999999999,"15min":1.268},"min":{"1min":0.96099999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4750000000000001,"5min":1.782,"15min":4.2690000000000001},"last":1.395},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2310000000000001,"15min":1.2330000000000001},"min":{"1min":0.73399999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"max":{"1min":1.6040000000000001,"5min":1.7370000000000001,"15min":4.3899999999999997},"last":1.1950000000000001}]},{"osd":4,"last update":"Tue Dec 19 14:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2869999999999999,"15min":1.296},"min":{"1min":0.70199999999999996,"5min":0.51700000000000002,"15min":0.47899999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":3.8069999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2989999999999999,"15min":1.333},"min":{"1min":0.55400000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.599,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.294}]},{"osd":5,"last update":"Tue Dec 19 14:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.258,"15min":1.2869999999999999},"min":{"1min":0.627,"5min":0.59599999999999997,"15min":0.53700000000000003},"max":{"1min":1.621,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.4390000000000001,"15min":1.4319999999999999},"min":{"1min":0.77100000000000002,"5min":0.75800000000000001,"15min":0.48799999999999999},"max":{"1min":1.7749999999999999,"5min":2.117,"15min":2.169},"last":1.242}]},{"osd":7,"last update":"Tue Dec 19 14:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.456,"15min":1.4550000000000001},"min":{"1min":0.72699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7110000000000001,"5min":1.8919999999999999,"15min":2.5419999999999998},"last":1.556},{"interface":"front","average":{"1min":1.466,"5min":1.446,"15min":1.4330000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.57999999999999996},"max":{"1min":1.8680000000000001,"5min":1.9350000000000001,"15min":2.141},"last":1.607}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193606,"statfs":{"total":200000000,"available":198253387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.129,"15min":1.054},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.433},"max":{"1min":1.472,"5min":1.631,"15min":1.835},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.125,"15min":1.137},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.53900000000000003},"max":{"1min":1.427,"5min":1.8100000000000001,"15min":5.4219999999999997},"last":0.86299999999999999}]},{"osd":1,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.1160000000000001,"15min":1.129},"min":{"1min":0.71999999999999997,"5min":0.69999999999999996,"15min":0.61499999999999999},"max":{"1min":1.47,"5min":1.554,"15min":6.101},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1559999999999999,"15min":1.1339999999999999},"min":{"1min":0.92400000000000004,"5min":0.57799999999999996,"15min":0.52800000000000002},"max":{"1min":1.5609999999999999,"5min":1.6439999999999999,"15min":2.077},"last":1.5029999999999999}]},{"osd":2,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2110000000000001,"15min":1.218},"min":{"1min":0.86799999999999999,"5min":0.68799999999999994,"15min":0.64400000000000002},"max":{"1min":1.6830000000000001,"5min":1.72,"15min":5.5350000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.224},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66400000000000003},"max":{"1min":1.641,"5min":1.641,"15min":2.863},"last":1.3160000000000001}]},{"osd":3,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.28,"15min":1.276},"min":{"1min":0.98899999999999999,"5min":0.82299999999999995,"15min":0.56000000000000005},"max":{"1min":1.827,"5min":1.827,"15min":5.6189999999999998},"last":1.089},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.327,"15min":1.296},"min":{"1min":0.80400000000000005,"5min":0.747,"15min":0.69899999999999995},"max":{"1min":1.649,"5min":1.752,"15min":1.8360000000000001},"last":1.3720000000000001}]},{"osd":4,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2669999999999999,"15min":1.2250000000000001},"min":{"1min":0.92600000000000005,"5min":0.64600000000000002,"15min":0.59899999999999998},"max":{"1min":1.661,"5min":1.8109999999999999,"15min":1.982},"last":1.417},{"interface":"front","average":{"1min":1.46,"5min":1.3819999999999999,"15min":1.365},"min":{"1min":1.1220000000000001,"5min":0.67900000000000005,"15min":0.64100000000000001},"max":{"1min":1.7270000000000001,"5min":1.798,"15min":5.6970000000000001},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.351,"15min":1.357},"min":{"1min":1.0009999999999999,"5min":0.85099999999999998,"15min":0.623},"max":{"1min":1.788,"5min":1.919,"15min":2.0310000000000001},"last":1.47},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.403,"15min":1.3839999999999999},"min":{"1min":1.0600000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.907,"5min":1.907,"15min":2.133},"last":1.5600000000000001}]},{"osd":7,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.472,"15min":1.474},"min":{"1min":1.1259999999999999,"5min":0.74099999999999999,"15min":0.60799999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":6.3959999999999999},"last":1.167},{"interface":"front","average":{"1min":1.552,"5min":1.5109999999999999,"15min":1.494},"min":{"1min":1.327,"5min":1.0629999999999999,"15min":0.71899999999999997},"max":{"1min":1.879,"5min":2.0270000000000001,"15min":2.1819999999999999},"last":1.5209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.492,"5min":1.639,"15min":2.1349999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.1100000000000001,"15min":1.109},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.48799999999999999},"max":{"1min":1.5660000000000001,"5min":2.4159999999999999,"15min":2.448},"last":1.0609999999999999}]},{"osd":1,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.117,"15min":1.0960000000000001},"min":{"1min":0.81399999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3620000000000001,"5min":1.754,"15min":1.754},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.125},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.50700000000000001},"max":{"1min":1.5920000000000001,"5min":1.8939999999999999,"15min":3.117},"last":1.2809999999999999}]},{"osd":2,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1899999999999999,"15min":1.143},"min":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.629},"max":{"1min":1.5960000000000001,"5min":2.613,"15min":2.613},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.2430000000000001,"15min":1.1950000000000001},"min":{"1min":0.90300000000000002,"5min":0.72299999999999998,"15min":0.68000000000000005},"max":{"1min":1.5489999999999999,"5min":1.7190000000000001,"15min":2.0609999999999999},"last":1.236}]},{"osd":3,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2789999999999999,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.57599999999999996},"max":{"1min":1.718,"5min":2.524,"15min":2.653},"last":1.474},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3129999999999999,"15min":1.2949999999999999},"min":{"1min":0.97199999999999998,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.427,"5min":1.8959999999999999,"15min":2.2080000000000002},"last":1.4039999999999999}]},{"osd":5,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2370000000000001,"15min":1.234},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.51700000000000002},"max":{"1min":1.6879999999999999,"5min":3.145,"15min":3.625},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.371,"15min":1.335},"min":{"1min":0.79500000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.716,"5min":2.6989999999999998,"15min":2.9820000000000002},"last":1.5600000000000001}]},{"osd":6,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3939999999999999,"15min":1.3720000000000001},"min":{"1min":0.84999999999999998,"5min":0.65800000000000003,"15min":0.55900000000000005},"max":{"1min":1.6439999999999999,"5min":2.0030000000000001,"15min":3.3479999999999999},"last":1.329},{"interface":"front","average":{"1min":1.335,"5min":1.401,"15min":1.407},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52200000000000002},"max":{"1min":1.766,"5min":2.0299999999999998,"15min":3.6930000000000001},"last":1.631}]},{"osd":7,"last update":"Tue Dec 19 14:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.5249999999999999,"15min":1.4970000000000001},"min":{"1min":0.91500000000000004,"5min":0.71199999999999997,"15min":0.65500000000000003},"max":{"1min":1.8009999999999999,"5min":2.8109999999999999,"15min":3.2320000000000002},"last":1.673},{"interface":"front","average":{"1min":1.532,"5min":1.5649999999999999,"15min":1.5449999999999999},"min":{"1min":1.1910000000000001,"5min":0.86299999999999999,"15min":0.59999999999999998},"max":{"1min":1.7310000000000001,"5min":2.194,"15min":3.4039999999999999},"last":1.5049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 14:00:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48299999999999998,"5min":0.38600000000000001,"15min":0.249},"max":{"1min":1.0289999999999999,"5min":1.429,"15min":3.4119999999999999},"last":0.752},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.96099999999999997,"15min":0.91200000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":1.3129999999999999,"5min":1.581,"15min":3.0670000000000002},"last":1.302}]},{"osd":1,"last update":"Tue Dec 19 14:00:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.32800000000000001},"max":{"1min":1.2350000000000001,"5min":1.363,"15min":5.3769999999999998},"last":1.05},{"interface":"front","average":{"1min":0.85699999999999998,"5min":1.012,"15min":0.95199999999999996},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.29499999999999998},"max":{"1min":1.1759999999999999,"5min":1.573,"15min":2.387},"last":0.85799999999999998}]},{"osd":2,"last update":"Tue Dec 19 14:00:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.075,"15min":1.002},"min":{"1min":0.495,"5min":0.495,"15min":0.38},"max":{"1min":1.4159999999999999,"5min":1.7110000000000001,"15min":2.9399999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0960000000000001,"15min":1.046},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.39200000000000002},"max":{"1min":1.524,"5min":1.597,"15min":2.657},"last":1.1990000000000001}]},{"osd":4,"last update":"Tue Dec 19 14:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.286,"15min":1.2330000000000001},"min":{"1min":0.78500000000000003,"5min":0.76700000000000002,"15min":0.48299999999999998},"max":{"1min":1.486,"5min":1.746,"15min":3.0070000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.2789999999999999,"15min":1.232},"min":{"1min":0.745,"5min":0.745,"15min":0.54600000000000004},"max":{"1min":1.5840000000000001,"5min":1.724,"15min":2.7690000000000001},"last":1.5129999999999999}]},{"osd":5,"last update":"Tue Dec 19 14:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.3149999999999999,"15min":1.2669999999999999},"min":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.58299999999999996},"max":{"1min":1.8200000000000001,"5min":2.1819999999999999,"15min":2.7309999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.28,"15min":1.2410000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.66700000000000004},"max":{"1min":1.738,"5min":1.8089999999999999,"15min":3.5249999999999999},"last":1.375}]},{"osd":6,"last update":"Tue Dec 19 14:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.319,"15min":1.276},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.53300000000000003},"max":{"1min":1.7709999999999999,"5min":1.9890000000000001,"15min":2.9769999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.3759999999999999,"15min":1.329},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.52600000000000002},"max":{"1min":1.9199999999999999,"5min":2.077,"15min":2.698},"last":1.4179999999999999}]},{"osd":7,"last update":"Tue Dec 19 14:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.4039999999999999,"15min":1.335},"min":{"1min":0.94899999999999995,"5min":0.753,"15min":0.51500000000000001},"max":{"1min":1.677,"5min":2.1160000000000001,"15min":3.609},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.4359999999999999,"15min":1.3859999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.58699999999999997},"max":{"1min":2.0110000000000001,"5min":2.1680000000000001,"15min":3.0379999999999998},"last":1.5529999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 14:00:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86799999999999999,"15min":0.83399999999999996},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1779999999999999,"5min":1.4359999999999999,"15min":2.258},"last":1.046},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.95899999999999996,"15min":0.91700000000000004},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.35899999999999999},"max":{"1min":1.409,"5min":1.5600000000000001,"15min":11.85},"last":1.149}]},{"osd":1,"last update":"Tue Dec 19 14:00:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86899999999999999,"15min":0.878},"min":{"1min":0.498,"5min":0.42399999999999999,"15min":0.35699999999999998},"max":{"1min":1.179,"5min":1.738,"15min":4.7640000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.52900000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.351,"5min":1.492,"15min":11.788},"last":1.3680000000000001}]},{"osd":3,"last update":"Tue Dec 19 14:00:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.0249999999999999,"15min":0.97999999999999998},"min":{"1min":0.55600000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3799999999999999,"5min":1.4730000000000001,"15min":2.3109999999999999},"last":1.222},{"interface":"front","average":{"1min":1.133,"5min":1.135,"15min":1.087},"min":{"1min":0.60199999999999998,"5min":0.51300000000000001,"15min":0.439},"max":{"1min":1.46,"5min":1.7549999999999999,"15min":5.1890000000000001},"last":1.103}]},{"osd":4,"last update":"Tue Dec 19 14:00:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.248,"15min":1.238},"min":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.70899999999999996},"max":{"1min":1.5129999999999999,"5min":1.6910000000000001,"15min":11.930999999999999},"last":1.27},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2490000000000001,"15min":1.2170000000000001},"min":{"1min":0.71899999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.73,"5min":1.758,"15min":2.2189999999999999},"last":1.2989999999999999}]},{"osd":5,"last update":"Tue Dec 19 14:00:52 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.357,"15min":1.331},"min":{"1min":0.84899999999999998,"5min":0.81499999999999995,"15min":0.70999999999999996},"max":{"1min":1.5940000000000001,"5min":1.6679999999999999,"15min":11.888},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.349,"15min":1.3240000000000001},"min":{"1min":1.054,"5min":0.80700000000000005,"15min":0.68899999999999995},"max":{"1min":1.778,"5min":1.778,"15min":4.8769999999999998},"last":1.194}]},{"osd":6,"last update":"Tue Dec 19 14:00:52 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3320000000000001,"15min":1.3160000000000001},"min":{"1min":0.88700000000000001,"5min":0.76700000000000002,"15min":0.72399999999999998},"max":{"1min":1.8460000000000001,"5min":1.855,"15min":5.0730000000000004},"last":1.405},{"interface":"front","average":{"1min":1.359,"5min":1.363,"15min":1.3109999999999999},"min":{"1min":0.88500000000000001,"5min":0.78400000000000003,"15min":0.71899999999999997},"max":{"1min":1.988,"5min":1.988,"15min":2.286},"last":1.4359999999999999}]},{"osd":7,"last update":"Tue Dec 19 14:00:52 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.393,"15min":1.355},"min":{"1min":0.999,"5min":0.79900000000000004,"15min":0.75600000000000001},"max":{"1min":1.899,"5min":1.9650000000000001,"15min":4.9710000000000001},"last":1.323},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.373,"15min":1.3620000000000001},"min":{"1min":0.81000000000000005,"5min":0.78200000000000003,"15min":0.67300000000000004},"max":{"1min":1.6499999999999999,"5min":1.853,"15min":11.962999999999999},"last":1.476}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193606,"statfs":{"total":200000000,"available":198253387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.30599999999999999},"max":{"1min":1.232,"5min":1.28,"15min":3.4700000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.91600000000000004,"15min":0.92200000000000004},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.5569999999999999,"5min":1.712,"15min":3.3500000000000001},"last":1.0580000000000001}]},{"osd":2,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.92300000000000004,"15min":0.94599999999999995},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.38300000000000001},"max":{"1min":1.351,"5min":1.4930000000000001,"15min":5.2999999999999998},"last":1.105},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.65100000000000002,"5min":0.51900000000000002,"15min":0.45800000000000002},"max":{"1min":1.4319999999999999,"5min":1.887,"15min":5.2009999999999996},"last":1.3109999999999999}]},{"osd":3,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.0369999999999999,"15min":1.04},"min":{"1min":0.53800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.46,"5min":1.835,"15min":3.4300000000000002},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.014,"15min":1.0329999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":1.6279999999999999,"5min":1.6519999999999999,"15min":7.157},"last":0.94299999999999995}]},{"osd":4,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.179,"15min":1.1659999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.544,"5min":1.6879999999999999,"15min":4.0179999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.276,"15min":1.264},"min":{"1min":0.99199999999999999,"5min":0.84299999999999997,"15min":0.59799999999999998},"max":{"1min":1.3720000000000001,"5min":1.661,"15min":3.7080000000000002},"last":1.1459999999999999}]},{"osd":5,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2210000000000001,"15min":1.24},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70199999999999996},"max":{"1min":1.6080000000000001,"5min":1.796,"15min":3.8849999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.2450000000000001,"15min":1.306},"min":{"1min":0.77400000000000002,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":1.49,"5min":1.77,"15min":15.576000000000001},"last":1.383}]},{"osd":6,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.3220000000000001,"15min":1.3240000000000001},"min":{"1min":0.93000000000000005,"5min":0.85299999999999998,"15min":0.67800000000000005},"max":{"1min":1.5580000000000001,"5min":1.9019999999999999,"15min":4.0919999999999996},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.3320000000000001,"15min":1.339},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.75900000000000001},"max":{"1min":1.653,"5min":1.895,"15min":3.786},"last":1.3600000000000001}]},{"osd":7,"last update":"Tue Dec 19 14:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.76500000000000001,"5min":0.745,"15min":0.745},"max":{"1min":1.744,"5min":1.9790000000000001,"15min":3.8159999999999998},"last":1.448},{"interface":"front","average":{"1min":1.242,"5min":1.345,"15min":1.3460000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6830000000000001,"5min":2.032,"15min":4.0519999999999996},"last":1.524}]}]},{"osd":0,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198843755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.79800000000000004},"min":{"1min":0.58399999999999996,"5min":0.34300000000000003,"15min":0.28299999999999997},"max":{"1min":1.337,"5min":1.502,"15min":1.6399999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":1.4590000000000001,"5min":1.7210000000000001,"15min":14.010999999999999},"last":1.232}]},{"osd":2,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":1.0469999999999999},"min":{"1min":0.58399999999999996,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":1.296,"5min":1.7130000000000001,"15min":33.799999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":1.1499999999999999},"min":{"1min":0.54600000000000004,"5min":0.44800000000000001,"15min":0.34300000000000003},"max":{"1min":1.45,"5min":1.5509999999999999,"15min":41.758000000000003},"last":1.3260000000000001}]},{"osd":3,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96699999999999997,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.45500000000000002,"15min":0.35099999999999998},"max":{"1min":1.4470000000000001,"5min":1.5189999999999999,"15min":4.4530000000000003},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.129,"15min":1.093},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.36499999999999999},"max":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":2.02},"last":0.85899999999999999}]},{"osd":4,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6060000000000001,"5min":1.738,"15min":4.4269999999999996},"last":1.292},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.286,"15min":1.2889999999999999},"min":{"1min":0.876,"5min":0.73199999999999998,"15min":0.68999999999999995},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":15.766},"last":1.4530000000000001}]},{"osd":5,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.27,"15min":1.2789999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.0059999999999998,"5min":2.0339999999999998,"15min":14.337999999999999},"last":1.423},{"interface":"front","average":{"1min":1.24,"5min":1.264,"15min":1.258},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.63100000000000001},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":4.3970000000000002},"last":1.345}]},{"osd":6,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.3939999999999999,"15min":1.351},"min":{"1min":0.91400000000000003,"5min":0.83999999999999997,"15min":0.67800000000000005},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":5.4669999999999996},"last":1.377},{"interface":"front","average":{"1min":1.363,"5min":1.361,"15min":1.387},"min":{"1min":0.88400000000000001,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":17.161000000000001},"last":1.482}]},{"osd":7,"last update":"Tue Dec 19 13:59:57 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.3839999999999999,"15min":1.3919999999999999},"min":{"1min":0.84499999999999997,"5min":0.72899999999999998,"15min":0.61099999999999999},"max":{"1min":2.387,"5min":2.387,"15min":14.381},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.325,"15min":1.3560000000000001},"min":{"1min":0.89100000000000001,"5min":0.78700000000000003,"15min":0.69299999999999995},"max":{"1min":2.121,"5min":2.121,"15min":9.7080000000000002},"last":1.401}]}]}],"pool_statfs":[]}} 2023-12-19T14:01:04.809 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T14:01:05.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.018+0000 7efd350d6640 1 Processor -- start 2023-12-19T14:01:05.017 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.018+0000 7efd350d6640 1 -- start start 2023-12-19T14:01:05.018 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd350d6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 0x7efd300b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd350d6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd3006cc50 0x7efd300cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd350d6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3015c9c0 con 0x7efd300b0830 2023-12-19T14:01:05.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd350d6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd300b0cb0 con 0x7efd3006cc50 2023-12-19T14:01:05.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd350d6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3006d270 con 0x7efd30155460 2023-12-19T14:01:05.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd348d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd3006cc50 0x7efd300cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd348d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd3006cc50 0x7efd300cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33434/0 (socket says 172.21.15.113:33434) 2023-12-19T14:01:05.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd348d5640 1 -- 172.21.15.113:0/3688668482 learned_addr learned my addr 172.21.15.113:0/3688668482 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:01:05.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.020+0000 7efd2ffff640 1 --2- 172.21.15.113:0/3688668482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 0x7efd300b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.021+0000 7efd348d5640 1 -- 172.21.15.113:0/3688668482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 msgr2=0x7efd300b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:01:05.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.021+0000 7efd348d5640 1 --2- 172.21.15.113:0/3688668482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 0x7efd300b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.021+0000 7efd348d5640 1 -- 172.21.15.113:0/3688668482 >> v1:172.21.15.151:6789/0 conn(0x7efd300b0830 legacy=0x7efd3006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.021+0000 7efd348d5640 1 -- 172.21.15.113:0/3688668482 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3006d550 con 0x7efd3006cc50 2023-12-19T14:01:05.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.022+0000 7efd348d5640 1 --2- 172.21.15.113:0/3688668482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300cdcf0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7efd28009e50 tx=0x7efd2802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9706952b863ec788 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:05.021 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.023+0000 7efd2effd640 1 -- 172.21.15.113:0/3688668482 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2802cb00 con 0x7efd3006cc50 2023-12-19T14:01:05.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.023+0000 7efd2effd640 1 -- 172.21.15.113:0/3688668482 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2802cc60 con 0x7efd3006cc50 2023-12-19T14:01:05.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.023+0000 7efd2effd640 1 -- 172.21.15.113:0/3688668482 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280343f0 con 0x7efd3006cc50 2023-12-19T14:01:05.022 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.023+0000 7efd350d6640 1 -- 172.21.15.113:0/3688668482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 msgr2=0x7efd300cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.023+0000 7efd350d6640 1 --2- 172.21.15.113:0/3688668482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300cdcf0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7efd28009e50 tx=0x7efd2802bf60 comp rx=0 tx=0).stop 2023-12-19T14:01:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.024+0000 7efd350d6640 1 -- 172.21.15.113:0/3688668482 shutdown_connections 2023-12-19T14:01:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.024+0000 7efd350d6640 1 --2- 172.21.15.113:0/3688668482 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300cdcf0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.024+0000 7efd350d6640 1 --2- 172.21.15.113:0/3688668482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 0x7efd300b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.024+0000 7efd350d6640 1 -- 172.21.15.113:0/3688668482 >> 172.21.15.113:0/3688668482 conn(0x7efd300659a0 msgr2=0x7efd30065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:01:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.024+0000 7efd350d6640 1 -- 172.21.15.113:0/3688668482 shutdown_connections 2023-12-19T14:01:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.024+0000 7efd350d6640 1 -- 172.21.15.113:0/3688668482 wait complete. 2023-12-19T14:01:05.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.025+0000 7efd350d6640 1 Processor -- start 2023-12-19T14:01:05.024 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.026+0000 7efd350d6640 1 -- start start 2023-12-19T14:01:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.026+0000 7efd350d6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.026+0000 7efd350d6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd300b0830 0x7efd300ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.026+0000 7efd350d6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 0x7efd301426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.026+0000 7efd350d6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300adad0 con 0x7efd3006cc50 2023-12-19T14:01:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.026+0000 7efd350d6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300add00 con 0x7efd300b0830 2023-12-19T14:01:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.026+0000 7efd350d6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300adfe0 con 0x7efd30155460 2023-12-19T14:01:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33450/0 (socket says 172.21.15.113:33450) 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 -- 172.21.15.113:0/3699231644 learned_addr learned my addr 172.21.15.113:0/3699231644 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 -- 172.21.15.113:0/3699231644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 msgr2=0x7efd301426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 0x7efd301426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2f7fe640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd300b0830 0x7efd300ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 -- 172.21.15.113:0/3699231644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd300b0830 msgr2=0x7efd300ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd300b0830 0x7efd300ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 -- 172.21.15.113:0/3699231644 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009b30 con 0x7efd3006cc50 2023-12-19T14:01:05.027 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.027+0000 7efd2ffff640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300b2870 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d5d0 tx=0x7efd2000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:05.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.028+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200125f0 con 0x7efd3006cc50 2023-12-19T14:01:05.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.028+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20012770 con 0x7efd3006cc50 2023-12-19T14:01:05.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.028+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20012b20 con 0x7efd3006cc50 2023-12-19T14:01:05.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.028+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300ae2c0 con 0x7efd3006cc50 2023-12-19T14:01:05.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.028+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300ae880 con 0x7efd3006cc50 2023-12-19T14:01:05.028 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.029+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd300aea40 con 0x7efd3006cc50 2023-12-19T14:01:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.030+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd20012c80 con 0x7efd3006cc50 2023-12-19T14:01:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.031+0000 7efd2cff9640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd1c06a430 0x7efd1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.031+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd20088bb0 con 0x7efd3006cc50 2023-12-19T14:01:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.031+0000 7efd2f7fe640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd1c06a430 0x7efd1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.032+0000 7efd2f7fe640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd1c06a430 0x7efd1c06c8f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efd300b3020 tx=0x7efd24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:05.034 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.036+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd20054400 con 0x7efd3006cc50 2023-12-19T14:01:05.226 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.227+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7efd30061910 con 0x7efd3006cc50 2023-12-19T14:01:05.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.237+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efd20054400 con 0x7efd3006cc50 2023-12-19T14:01:05.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.237+0000 7efd2cff9640 1 -- 172.21.15.113:0/3699231644 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7efd20057a20 con 0x7efd3006cc50 2023-12-19T14:01:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd1c06a430 msgr2=0x7efd1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd1c06a430 0x7efd1c06c8f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efd300b3020 tx=0x7efd24009040 comp rx=0 tx=0).stop 2023-12-19T14:01:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 msgr2=0x7efd300b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300b2870 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d5d0 tx=0x7efd2000da90 comp rx=0 tx=0).stop 2023-12-19T14:01:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 shutdown_connections 2023-12-19T14:01:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7efd1c06a430 0x7efd1c06c8f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd30155460 0x7efd301426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd300b0830 0x7efd300ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 --2- 172.21.15.113:0/3699231644 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd3006cc50 0x7efd300b2870 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 >> 172.21.15.113:0/3699231644 conn(0x7efd300659a0 msgr2=0x7efd30159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:01:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 shutdown_connections 2023-12-19T14:01:05.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.240+0000 7efd350d6640 1 -- 172.21.15.113:0/3699231644 wait complete. 2023-12-19T14:01:05.260 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T14:01:05.260 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T14:01:05.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.468+0000 7f05570bd640 1 Processor -- start 2023-12-19T14:01:05.467 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.468+0000 7f05570bd640 1 -- start start 2023-12-19T14:01:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f05570bd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 0x7f05500af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f05570bd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f05500b0b50 0x7f055006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f05570bd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500afb10 con 0x7f055006b590 2023-12-19T14:01:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f05570bd640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055006bb30 con 0x7f05500b0b50 2023-12-19T14:01:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f05570bd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500b0070 con 0x7f05501449e0 2023-12-19T14:01:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f055565a640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f055006b590 0x7f055015eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51640/0 (socket says 172.21.15.113:51640) 2023-12-19T14:01:05.469 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f055565a640 1 -- 172.21.15.113:0/2943410242 learned_addr learned my addr 172.21.15.113:0/2943410242 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f054ffff640 1 --2- 172.21.15.113:0/2943410242 >> v2:172.21.15.151:3300/0 conn(0x7f05500b0b50 0x7f055006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.470+0000 7f0554e59640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 0x7f05500af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712832069 0 0) 0x7f05500afb10 con 0x7f055006b590 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0540003520 con 0x7f055006b590 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3213093916 0 0) 0x7f0540003520 con 0x7f055006b590 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 msgr2=0x7f05500af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 0x7f05500af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.471 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 >> v2:172.21.15.151:3300/0 conn(0x7f05500b0b50 msgr2=0x7f055006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 --2- 172.21.15.113:0/2943410242 >> v2:172.21.15.151:3300/0 conn(0x7f05500b0b50 0x7f055006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500b0350 con 0x7f055006b590 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3081888274 0 0) 0x7f05480019f0 con 0x7f055006b590 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 >> v1:172.21.15.113:6789/0 conn(0x7f055006b590 legacy=0x7f055015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05400039e0 0x7f0540003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 0x7f05400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f0540005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055006bb30 con 0x7f0540004d00 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500b0070 con 0x7f05400039e0 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054000b980 con 0x7f05501449e0 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.471+0000 7f055565a640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f0540005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.472+0000 7f0554e59640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05400039e0 0x7f0540003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.472+0000 7f054ffff640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 0x7f05400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.472+0000 7f055565a640 1 -- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 msgr2=0x7f05400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:01:05.472 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.472+0000 7f055565a640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05501449e0 0x7f05400047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.472+0000 7f055565a640 1 -- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05400039e0 msgr2=0x7f0540003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T14:01:05.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.472+0000 7f055565a640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05400039e0 0x7f0540003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.473 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.472+0000 7f055565a640 1 -- 172.21.15.113:0/2943410242 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540003520 con 0x7f0540004d00 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.473+0000 7f055565a640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f0540005180 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f054800a860 tx=0x7f05400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbc71cf1ab883e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.473+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548034630 con 0x7f0540004d00 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.473+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f054802f070 con 0x7f0540004d00 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.473+0000 7f054f7fe640 1 -- 172.21.15.113:0/2943410242 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548034a10 con 0x7f0540004d00 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.474+0000 7f05570bd640 1 -- 172.21.15.113:0/2943410242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 msgr2=0x7f0540005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.474+0000 7f05570bd640 1 --2- 172.21.15.113:0/2943410242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f0540005180 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f054800a860 tx=0x7f05400057f0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.474+0000 7f055565a640 1 -- 172.21.15.113:0/2943410242 reap_dead start 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.474+0000 7f05570bd640 1 -- 172.21.15.113:0/2943410242 shutdown_connections 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.474+0000 7f05570bd640 1 -- 172.21.15.113:0/2943410242 >> 172.21.15.113:0/2943410242 conn(0x7f05500cbb70 msgr2=0x7f05500cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:01:05.474 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.474+0000 7f05570bd640 1 -- 172.21.15.113:0/2943410242 shutdown_connections 2023-12-19T14:01:05.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.474+0000 7f05570bd640 1 -- 172.21.15.113:0/2943410242 wait complete. 2023-12-19T14:01:05.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.476+0000 7f05570bd640 1 Processor -- start 2023-12-19T14:01:05.475 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.476+0000 7f05570bd640 1 -- start start 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f05570bd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f055015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f05570bd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05500ad7c0 0x7f05500adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f05570bd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f055015c9d0 0x7f055015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f05570bd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500ae180 con 0x7f0540004d00 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f05570bd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055015e260 con 0x7f05500ad7c0 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f05570bd640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055015d390 con 0x7f055015c9d0 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f0554e59640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f055015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f0554e59640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f055015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33454/0 (socket says 172.21.15.113:33454) 2023-12-19T14:01:05.476 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.477+0000 7f0554e59640 1 -- 172.21.15.113:0/4180962073 learned_addr learned my addr 172.21.15.113:0/4180962073 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f055565a640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f055015c9d0 0x7f055015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f054ffff640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05500ad7c0 0x7f05500adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f0554e59640 1 -- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f055015c9d0 msgr2=0x7f055015ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f0554e59640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f055015c9d0 0x7f055015ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f0554e59640 1 -- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05500ad7c0 msgr2=0x7f05500adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f0554e59640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05500ad7c0 0x7f05500adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f0554e59640 1 -- 172.21.15.113:0/4180962073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055015d650 con 0x7f0540004d00 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f055565a640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f055015c9d0 0x7f055015ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f054ffff640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05500ad7c0 0x7f05500adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f0554e59640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f055015ad90 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f0544011540 tx=0x7f0544011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f054d7fa640 1 -- 172.21.15.113:0/4180962073 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544015930 con 0x7f0540004d00 2023-12-19T14:01:05.478 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f054d7fa640 1 -- 172.21.15.113:0/4180962073 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0544015a90 con 0x7f0540004d00 2023-12-19T14:01:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f054d7fa640 1 -- 172.21.15.113:0/4180962073 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544015e80 con 0x7f0540004d00 2023-12-19T14:01:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.478+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055015d930 con 0x7f0540004d00 2023-12-19T14:01:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.479+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055015def0 con 0x7f0540004d00 2023-12-19T14:01:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.480+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0550061910 con 0x7f0540004d00 2023-12-19T14:01:05.479 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.481+0000 7f054d7fa640 1 -- 172.21.15.113:0/4180962073 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f054400f460 con 0x7f0540004d00 2023-12-19T14:01:05.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.481+0000 7f054d7fa640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f053406a430 0x7f053406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T14:01:05.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.482+0000 7f054d7fa640 1 -- 172.21.15.113:0/4180962073 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0544088fb0 con 0x7f0540004d00 2023-12-19T14:01:05.480 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.482+0000 7f054ffff640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f053406a430 0x7f053406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T14:01:05.481 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.482+0000 7f054ffff640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f053406a430 0x7f053406c8f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0550070fd0 tx=0x7f053c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T14:01:05.485 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.486+0000 7f054d7fa640 1 -- 172.21.15.113:0/4180962073 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0544054770 con 0x7f0540004d00 2023-12-19T14:01:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.712+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05500ae560 con 0x7f0540004d00 2023-12-19T14:01:05.713 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.714+0000 7f054d7fa640 1 -- 172.21.15.113:0/4180962073 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f0544022090 con 0x7f0540004d00 2023-12-19T14:01:05.713 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-19T14:01:05.713 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":90,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/441994361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":441994361},{"type":"v1","addr":"172.21.15.151:6834","nonce":441994361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":5762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/876487296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":876487296},{"type":"v1","addr":"172.21.15.151:6835","nonce":876487296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/352771220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":352771220},{"type":"v1","addr":"172.21.15.113:6836","nonce":352771220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9465,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/1945495183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":1945495183},{"type":"v1","addr":"172.21.15.113:6837","nonce":1945495183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[]} 2023-12-19T14:01:05.713 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 90 2023-12-19T14:01:05.715 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.716+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f053406a430 msgr2=0x7f053406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.716+0000 7f05570bd640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f053406a430 0x7f053406c8f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0550070fd0 tx=0x7f053c008040 comp rx=0 tx=0).stop 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.716+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 msgr2=0x7f055015ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.716+0000 7f05570bd640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f055015ad90 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f0544011540 tx=0x7f0544011a00 comp rx=0 tx=0).stop 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 shutdown_connections 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:6832/83819,v1:172.21.15.113:6833/83819] conn(0x7f053406a430 0x7f053406c8f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f055015c9d0 0x7f055015ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05500ad7c0 0x7f05500adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 --2- 172.21.15.113:0/4180962073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0540004d00 0x7f055015ad90 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 >> 172.21.15.113:0/4180962073 conn(0x7f05500cbb70 msgr2=0x7f05500ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 shutdown_connections 2023-12-19T14:01:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-19T14:01:05.717+0000 7f05570bd640 1 -- 172.21.15.113:0/4180962073 wait complete. 2023-12-19T14:01:05.735 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T14:01:05.735 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T14:01:05.735 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T14:01:05.735 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:05.752 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T14:01:05.753 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T14:01:05.753 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:05.810 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T14:01:05.811 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T14:01:05.811 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:05.840 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T14:01:05.840 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T14:01:05.840 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:05.905 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T14:01:05.905 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T14:01:05.905 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T14:01:05.905 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:05.994 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T14:01:05.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T14:01:05.995 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:06.069 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T14:01:06.069 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T14:01:06.069 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:08.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-19T14:01:12.170 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T14:01:12.171 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T14:01:12.171 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:12.263 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T14:01:12.264 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T14:01:12.264 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:12.330 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T14:01:12.330 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T14:01:12.331 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:12.413 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T14:01:12.414 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T14:01:12.414 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:13.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-19T14:01:13.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-19T14:01:18.515 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T14:01:18.516 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T14:01:18.516 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:19.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-19T14:01:19.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-19T14:01:21.801 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:21.811 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:24.617 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T14:01:24.618 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T14:01:24.618 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T14:01:24.618 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:24.701 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T14:01:24.702 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T14:01:24.702 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:24.784 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T14:01:24.785 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T14:01:24.785 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T14:01:24.785 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:24.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2023-12-19T14:01:24.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-12-19T14:01:24.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-12-19T14:01:24.833 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T14:01:24.833 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T14:01:24.833 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:24.876 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T14:01:24.876 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T14:01:24.877 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T14:01:24.915 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T14:01:24.915 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T14:01:24.916 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T14:01:25.028 INFO:teuthology.orchestra.run.smithi113.stdout:2023-12-19T13:46:19.235537+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench result of 105939.714935 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.4. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-19T14:01:25.029 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-19T14:01:25.029 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T14:01:25.120 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T14:01:25.210 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T14:01:25.299 INFO:teuthology.orchestra.run.smithi113.stdout:2023-12-19T13:46:19.235537+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench result of 105939.714935 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.4. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-19T14:01:25.300 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T14:01:25.300 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T14:01:25.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T14:01:25.551 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T14:01:25.723 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T14:01:25.723 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T14:01:25.883 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T14:01:25.883 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T14:01:26.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T14:01:26.086 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T14:01:26.340 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T14:01:26.340 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T14:01:26.486 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T14:01:26.486 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T14:01:26.626 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T14:01:26.627 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T14:01:26.795 INFO:tasks.ceph:Archiving mon data... 2023-12-19T14:01:26.797 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/data/mon.a.tgz 2023-12-19T14:01:26.797 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2023-12-19T14:01:26.856 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.nCtnPSeBlL 2023-12-19T14:01:26.856 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nCtnPSeBlL 2023-12-19T14:01:27.075 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.nCtnPSeBlL 2023-12-19T14:01:27.222 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.nCtnPSeBlL is 504KB 2023-12-19T14:01:27.340 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.nCtnPSeBlL 2023-12-19T14:01:27.398 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/data/mon.b.tgz 2023-12-19T14:01:27.398 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-12-19T14:01:27.458 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.Y3AUvatJlp 2023-12-19T14:01:27.459 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Y3AUvatJlp 2023-12-19T14:01:27.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.Y3AUvatJlp 2023-12-19T14:01:27.837 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.Y3AUvatJlp is 537KB 2023-12-19T14:01:27.950 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.Y3AUvatJlp 2023-12-19T14:01:28.010 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/data/mon.c.tgz 2023-12-19T14:01:28.010 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-12-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.dhUWN2It3r 2023-12-19T14:01:28.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dhUWN2It3r 2023-12-19T14:01:28.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.dhUWN2It3r 2023-12-19T14:01:28.448 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.dhUWN2It3r is 537KB 2023-12-19T14:01:28.561 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.dhUWN2It3r 2023-12-19T14:01:28.620 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T14:01:28.620 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T14:01:28.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T14:01:28.728 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-19T14:01:28.728 DEBUG:teuthology.orchestra.run.smithi113:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T14:01:28.737 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T14:01:28.837 INFO:teuthology.orchestra.run.smithi113.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T14:01:28.841 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T14:01:28.854 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T14:01:28.856 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/remote/smithi113/crash 2023-12-19T14:01:28.856 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T14:01:28.948 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/remote/smithi151/crash 2023-12-19T14:01:28.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T14:01:29.044 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T14:01:29.044 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:29.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:29.182 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:29.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:29.385 INFO:tasks.ceph:Compressing logs... 2023-12-19T14:01:29.385 DEBUG:teuthology.orchestra.run.smithi113:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T14:01:29.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T14:01:29.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-19T14:01:29.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-12-19T14:01:29.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-12-19T14:01:34.770 INFO:tasks.ceph:Archiving logs... 2023-12-19T14:01:34.770 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/remote/smithi113/log 2023-12-19T14:01:34.771 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T14:01:36.064 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/remote/smithi151/log 2023-12-19T14:01:36.065 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T14:01:36.734 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T14:01:36.745 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T14:01:36.745 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T14:01:36.754 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T14:01:36.896 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T14:01:36.904 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T14:01:36.905 DEBUG:teuthology.orchestra.run.smithi113:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T14:01:36.914 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T14:01:36.961 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2023-12-19T14:01:36.969 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-12-19T14:01:36.971 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T14:01:36.971 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2023-12-19T14:01:36.971 INFO:teuthology.orchestra.run.smithi113.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 -154us[ -154us] +/- 72ms 2023-12-19T14:01:36.971 INFO:teuthology.orchestra.run.smithi113.stdout:^* hv02.front.sepia.ceph.com 3 7 377 85 -135us[ -125us] +/- 52ms 2023-12-19T14:01:36.971 INFO:teuthology.orchestra.run.smithi113.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 86 +428us[ +438us] +/- 70ms 2023-12-19T14:01:36.971 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T14:01:36.978 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T14:01:36.979 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-12-19T14:01:36.979 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 -188us[ -190us] +/- 72ms 2023-12-19T14:01:36.979 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -158us[ -160us] +/- 53ms 2023-12-19T14:01:36.979 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +416us[ +416us] +/- 71ms 2023-12-19T14:01:36.979 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T14:01:36.980 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T14:01:36.989 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T14:01:36.989 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T14:01:37.000 DEBUG:teuthology.orchestra.run.smithi113:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T14:01:37.300 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T14:01:37.562 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T14:01:37.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T14:01:37.676 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T14:01:37.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T14:01:37.786 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T14:01:37.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T14:01:37.805 INFO:teuthology.task.internal:Duration was 1663.748915 seconds 2023-12-19T14:01:37.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T14:01:37.814 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T14:01:37.814 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T14:01:37.823 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T14:01:37.982 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T14:01:37.987 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T14:01:38.295 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T14:01:38.295 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi113.front.sepia.ceph.com 2023-12-19T14:01:38.295 DEBUG:teuthology.orchestra.run.smithi113:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T14:01:38.370 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T14:01:38.371 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T14:01:38.448 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T14:01:38.448 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T14:01:38.458 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T14:01:38.553 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T14:01:38.553 DEBUG:teuthology.orchestra.run.smithi113:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T14:01:38.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T14:01:38.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T14:01:38.779 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T14:01:38.779 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T14:01:38.877 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T14:01:38.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T14:01:38.989 DEBUG:teuthology.orchestra.run.smithi113:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T14:01:38.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T14:01:39.106 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = core 2023-12-19T14:01:39.111 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-12-19T14:01:39.163 DEBUG:teuthology.orchestra.run.smithi113:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T14:01:39.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T14:01:39.214 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T14:01:39.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T14:01:39.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T14:01:39.282 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T14:01:39.282 DEBUG:teuthology.misc:Transferring archived files from smithi113:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/remote/smithi113 2023-12-19T14:01:39.282 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T14:01:39.395 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765/remote/smithi151 2023-12-19T14:01:39.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T14:01:39.508 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T14:01:39.508 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T14:01:39.518 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T14:01:39.577 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T14:01:39.589 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T14:01:39.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T14:01:39.601 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T14:01:39.601 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T14:01:39.609 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T14:01:39.660 INFO:teuthology.orchestra.run.smithi113.stdout: 394093 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 14:01 /home/ubuntu/cephtest 2023-12-19T14:01:39.671 INFO:teuthology.orchestra.run.smithi151.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 14:01 /home/ubuntu/cephtest 2023-12-19T14:01:39.674 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T14:01:39.685 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T14:01:39.704 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T14:01:39.727 DEBUG:teuthology.nuke:shortname: smithi113 2023-12-19T14:01:39.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T14:01:39.748 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:24:21.302689', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCC6TrBF2XUP+csy3HGsU5ZcX6IhgF+WQz/CDZ3rq/FUSMA1eSdbJQm8cc8co/+GZEAX03xqwkaHinBuMLSbb6k='} 2023-12-19T14:01:39.751 DEBUG:teuthology.nuke:shortname: smithi151 2023-12-19T14:01:39.751 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T14:01:39.773 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:24:21.301481', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdKVkjQGz1BKe0fpMFIl7/J2T5IuU7eVQH6u8gHcBuOp8ZZ9fZnodxtRv2XJNWpb6zF0Jv7EryCwGhNo9gsEwQ='} 2023-12-19T14:01:39.800 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-19T14:01:39.800 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T14:01:39.822 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-19T14:01:39.822 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:01:39.836 INFO:teuthology.orchestra.console.smithi151:Power off 2023-12-19T14:01:39.836 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T14:01:39.844 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-19T14:01:39.859 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-12-19T14:01:39.859 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:01:39.880 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-12-19T14:01:43.845 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:01:43.881 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:01:43.955 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-19T14:01:43.991 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-12-19T14:01:47.957 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:01:48.033 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:01:48.068 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-19T14:01:48.148 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-12-19T14:01:48.169 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-19T14:01:52.149 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:01:52.259 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-12-19T14:01:52.360 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-12-19T14:01:52.465 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c client.1-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1663.7489149570465 failure_reason: '"2023-12-19T13:46:19.235537+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench result of 105939.714935 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.4. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-12-19T14:01:52.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:01:52.544 INFO:teuthology.run:FAIL